From michal.skrivanek at redhat.com Fri Apr 4 09:33:25 2014 Content-Type: multipart/mixed; boundary="===============4521504572705692079==" MIME-Version: 1.0 From: Michal Skrivanek To: users at ovirt.org Subject: Re: [Users] TSC clocksource gets lost after live migration Date: Fri, 04 Apr 2014 15:33:17 +0200 Message-ID: <56307342-39C8-4D67-B92E-E68201B68F89@redhat.com> In-Reply-To: 12EF8D94C6F8734FB2FF37B9FBEDD17358615C53@EXCHANGE.collogia.de --===============4521504572705692079== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable --Apple-Mail=3D_BA43FE41-733B-497D-BFE0-FAD8F2CAE57A Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=3Dwindows-1252 Hi, this is more for the KVM folks I suppose=3D85can you get the qemu process = =3D cmdline please? Thanks, michal On 3 Apr 2014, at 12:13, Markus Stockhausen wrote: > Hello, >=3D20 > we have an up to date ovirt 3.4 installation. Inside we are running =3D SLES11 SP3 > VMs (Kernel 3.0.76-0.11). After live migration of these VMs they all =3D of a sudden > do not react any longer and CPU usage of the VM goes to 100%. >=3D20 > We identified kvm-clock source to be the culprit and therefore =3D switched to another > clocksource. We ended with hpet but are not happy with that as our =3D inital goal > was to use the more simple designed TSC clocksoure.=3D20 >=3D20 > The reason behind that is the question I have for you experts. >=3D20 > Our hosts all have the constant_tsc CPU flag available. Just to =3D mention these > are not identical hosts. We have a mix of Xeon 5500 and 5600 machines. = =3D E.G. > [root(a)colovn01 ~]# cat /proc/cpuinfo | grep constant_tsc | wc -l > 8 >=3D20 > When we start the VM the client sees TSC as available clocksource: >=3D20 > colvm53:~ # cat =3D /sys/devices/system/clocksource/clocksource0/available_clocksource > kvm-clock tsc hpet acpi_pm >=3D20 > After the first live migration to another host that also has =3D constant_tsc (see above) > that flag is lost inside the VM. >=3D20 > colvm53:~ # cat =3D /sys/devices/system/clocksource/clocksource0/available_clocksource > kvm-clock hpet acpi_pm >=3D20 > Any ideas? >=3D20 > Markus >=3D20 >=3D20 > =3D _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --Apple-Mail=3D_BA43FE41-733B-497D-BFE0-FAD8F2CAE57A Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=3Dwindows-1252 Hi,

this is more for the KVM folks I =3D suppose=3D85can you get the qemu process cmdline =3D please?

Thanks,

michal

On 3 Apr 2014, at 12:13, Markus Stockhausen wrote:

Hello,

we have an up to date =3D ovirt 3.4 installation. Inside we are running SLES11 SP3
VMs (Kernel =3D 3.0.76-0.11). After live migration of these VMs they all of a =3D sudden
do not react any longer and CPU usage of the VM goes to =3D 100%.

We identified kvm-clock source to be the culprit and =3D therefore switched to another
clocksource. We ended with hpet but are = =3D not happy with that as our inital goal
was to use the more simple =3D designed TSC clocksoure.

The reason behind = =3D that is the question I have for you experts.

Our hosts all have =3D the constant_tsc CPU flag available. Just to mention these
are not =3D identical hosts. We have a mix of Xeon 5500 and 5600 machines. =3D E.G.
[root(a)colovn01 ~]# cat /proc/cpuinfo | grep constant_tsc | wc =3D -l
8

When we start the VM the client sees TSC as available =3D clocksource:

colvm53:~ # cat =3D /sys/devices/system/clocksource/clocksource0/available_clocksource
kvm-= =3D clock tsc hpet acpi_pm

After the first live migration to another =3D host that also has constant_tsc (see above)
that flag is lost inside =3D the VM.

colvm53:~ # cat =3D /sys/devices/system/clocksource/clocksource0/available_clocksource
kvm-= =3D clock hpet acpi_pm

Any =3D ideas?

Markus

<InterScan_Disclaimer.txt&g= =3D t;_______________________________________________
Users =3D mailing list
Users(a)ovirt.org
http://lists.ovirt= .=3D org/mailman/listinfo/users

=3D --Apple-Mail=3D_BA43FE41-733B-497D-BFE0-FAD8F2CAE57A-- --===============4521504572705692079== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" Ci0tQXBwbGUtTWFpbD1fQkE0M0ZFNDEtNzMzQi00OTdELUJGRTAtRkFEOEYyQ0FFNTdBCkNvbnRl bnQtVHJhbnNmZXItRW5jb2Rpbmc6IHF1b3RlZC1wcmludGFibGUKQ29udGVudC1UeXBlOiB0ZXh0 L3BsYWluOwoJY2hhcnNldD13aW5kb3dzLTEyNTIKCkhpLAp0aGlzIGlzIG1vcmUgZm9yIHRoZSBL Vk0gZm9sa3MgSSBzdXBwb3NlPTg1Y2FuIHlvdSBnZXQgdGhlIHFlbXUgcHJvY2VzcyA9CmNtZGxp bmUgcGxlYXNlPwoKVGhhbmtzLAptaWNoYWwKCk9uIDMgQXByIDIwMTQsIGF0IDEyOjEzLCBNYXJr dXMgU3RvY2toYXVzZW4gd3JvdGU6Cgo+IEhlbGxvLAo+PTIwCj4gd2UgaGF2ZSBhbiB1cCB0byBk YXRlIG92aXJ0IDMuNCBpbnN0YWxsYXRpb24uIEluc2lkZSB3ZSBhcmUgcnVubmluZyA9ClNMRVMx MSBTUDMKPiBWTXMgKEtlcm5lbCAzLjAuNzYtMC4xMSkuIEFmdGVyIGxpdmUgbWlncmF0aW9uIG9m IHRoZXNlIFZNcyB0aGV5IGFsbCA9Cm9mIGEgc3VkZGVuCj4gZG8gbm90IHJlYWN0IGFueSBsb25n ZXIgYW5kIENQVSB1c2FnZSBvZiB0aGUgVk0gZ29lcyB0byAxMDAlLgo+PTIwCj4gV2UgaWRlbnRp ZmllZCBrdm0tY2xvY2sgc291cmNlIHRvIGJlIHRoZSBjdWxwcml0IGFuZCB0aGVyZWZvcmUgPQpz d2l0Y2hlZCB0byBhbm90aGVyCj4gY2xvY2tzb3VyY2UuIFdlIGVuZGVkIHdpdGggaHBldCBidXQg YXJlIG5vdCBoYXBweSB3aXRoIHRoYXQgYXMgb3VyID0KaW5pdGFsIGdvYWwKPiB3YXMgdG8gdXNl IHRoZSBtb3JlIHNpbXBsZSBkZXNpZ25lZCBUU0MgY2xvY2tzb3VyZS49MjAKPj0yMAo+IFRoZSBy ZWFzb24gYmVoaW5kIHRoYXQgaXMgdGhlIHF1ZXN0aW9uIEkgaGF2ZSBmb3IgeW91IGV4cGVydHMu Cj49MjAKPiBPdXIgaG9zdHMgYWxsIGhhdmUgdGhlIGNvbnN0YW50X3RzYyBDUFUgZmxhZyBhdmFp bGFibGUuIEp1c3QgdG8gPQptZW50aW9uIHRoZXNlCj4gYXJlIG5vdCBpZGVudGljYWwgaG9zdHMu IFdlIGhhdmUgYSBtaXggb2YgWGVvbiA1NTAwIGFuZCA1NjAwIG1hY2hpbmVzLiA9CkUuRy4KPiBb cm9vdEBjb2xvdm4wMSB+XSMgY2F0IC9wcm9jL2NwdWluZm8gfCBncmVwIGNvbnN0YW50X3RzYyB8 IHdjIC1sCj4gOAo+PTIwCj4gV2hlbiB3ZSBzdGFydCB0aGUgVk0gdGhlIGNsaWVudCBzZWVzIFRT QyBhcyBhdmFpbGFibGUgY2xvY2tzb3VyY2U6Cj49MjAKPiBjb2x2bTUzOn4gIyBjYXQgPQovc3lz L2RldmljZXMvc3lzdGVtL2Nsb2Nrc291cmNlL2Nsb2Nrc291cmNlMC9hdmFpbGFibGVfY2xvY2tz b3VyY2UKPiBrdm0tY2xvY2sgdHNjIGhwZXQgYWNwaV9wbQo+PTIwCj4gQWZ0ZXIgdGhlIGZpcnN0 IGxpdmUgbWlncmF0aW9uIHRvIGFub3RoZXIgaG9zdCB0aGF0IGFsc28gaGFzID0KY29uc3RhbnRf dHNjIChzZWUgYWJvdmUpCj4gdGhhdCBmbGFnIGlzIGxvc3QgaW5zaWRlIHRoZSBWTS4KPj0yMAo+ IGNvbHZtNTM6fiAjIGNhdCA9Ci9zeXMvZGV2aWNlcy9zeXN0ZW0vY2xvY2tzb3VyY2UvY2xvY2tz b3VyY2UwL2F2YWlsYWJsZV9jbG9ja3NvdXJjZQo+IGt2bS1jbG9jayBocGV0IGFjcGlfcG0KPj0y MAo+IEFueSBpZGVhcz8KPj0yMAo+IE1hcmt1cwo+PTIwCj49MjAKPiA9CjxJbnRlclNjYW5fRGlz Y2xhaW1lci50eHQ+X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X18KPiBVc2VycyBtYWlsaW5nIGxpc3QKPiBVc2Vyc0BvdmlydC5vcmcKPiBodHRwOi8vbGlzdHMu b3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMKCgotLUFwcGxlLU1haWw9X0JBNDNGRTQx LTczM0ItNDk3RC1CRkUwLUZBRDhGMkNBRTU3QQpDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiBx dW90ZWQtcHJpbnRhYmxlCkNvbnRlbnQtVHlwZTogdGV4dC9odG1sOwoJY2hhcnNldD13aW5kb3dz LTEyNTIKCjxodG1sPjxoZWFkPjxiYXNlIGhyZWY9M0QieC1tc2c6Ly8xNTc1LyI+PC9oZWFkPjxi b2R5IHN0eWxlPTNEIndvcmQtd3JhcDogPQpicmVhay13b3JkOyAtd2Via2l0LW5ic3AtbW9kZTog c3BhY2U7IC13ZWJraXQtbGluZS1icmVhazogPQphZnRlci13aGl0ZS1zcGFjZTsgIj5IaSw8ZGl2 PnRoaXMgaXMgbW9yZSBmb3IgdGhlIEtWTSBmb2xrcyBJID0Kc3VwcG9zZT04NWNhbiB5b3UgZ2V0 IHRoZSBxZW11IHByb2Nlc3MgY21kbGluZSA9CnBsZWFzZT88L2Rpdj48ZGl2Pjxicj48L2Rpdj48 ZGl2PlRoYW5rcyw8L2Rpdj48ZGl2Pm1pY2hhbDwvZGl2PjxkaXY+PGJyPjxkPQppdj48ZGl2Pk9u IDMgQXByIDIwMTQsIGF0IDEyOjEzLCBNYXJrdXMgU3RvY2toYXVzZW4gd3JvdGU6PC9kaXY+PGJy ID0KY2xhc3M9M0QiQXBwbGUtaW50ZXJjaGFuZ2UtbmV3bGluZSI+PGJsb2NrcXVvdGUgdHlwZT0z RCJjaXRlIj48c3BhbiA9CmNsYXNzPTNEIkFwcGxlLXN0eWxlLXNwYW4iIHN0eWxlPTNEImJvcmRl ci1jb2xsYXBzZTogc2VwYXJhdGU7ID0KZm9udC1mYW1pbHk6IEhlbHZldGljYTsgZm9udC1zdHls ZTogbm9ybWFsOyBmb250LXZhcmlhbnQ6IG5vcm1hbDsgPQpmb250LXdlaWdodDogbm9ybWFsOyBs ZXR0ZXItc3BhY2luZzogbm9ybWFsOyBsaW5lLWhlaWdodDogbm9ybWFsOyA9Cm9ycGhhbnM6IDI7 IHRleHQtYWxpZ246IC13ZWJraXQtYXV0bzsgdGV4dC1pbmRlbnQ6IDBweDsgdGV4dC10cmFuc2Zv cm06ID0Kbm9uZTsgd2hpdGUtc3BhY2U6IG5vcm1hbDsgd2lkb3dzOiAyOyB3b3JkLXNwYWNpbmc6 IDBweDsgPQotd2Via2l0LWJvcmRlci1ob3Jpem9udGFsLXNwYWNpbmc6IDBweDsgLXdlYmtpdC1i b3JkZXItdmVydGljYWwtc3BhY2luZzogPQowcHg7IC13ZWJraXQtdGV4dC1kZWNvcmF0aW9ucy1p bi1lZmZlY3Q6IG5vbmU7IC13ZWJraXQtdGV4dC1zaXplLWFkanVzdDogPQphdXRvOyAtd2Via2l0 LXRleHQtc3Ryb2tlLXdpZHRoOiAwcHg7IGZvbnQtc2l6ZTogbWVkaXVtOyAiPjxkaXYgb2NzaT0z RCIwIj0KIGZwc3R5bGU9M0QiMSI+PGRpdiBzdHlsZT0zRCJkaXJlY3Rpb246IGx0cjsgZm9udC1m YW1pbHk6IFRhaG9tYTsgY29sb3I6ID0KcmdiKDAsIDAsIDApOyBmb250LXNpemU6IDEwcHQ7ICI+ SGVsbG8sPGJyPjxicj53ZSBoYXZlIGFuIHVwIHRvIGRhdGUgPQpvdmlydCAzLjQgaW5zdGFsbGF0 aW9uLiBJbnNpZGUgd2UgYXJlIHJ1bm5pbmcgU0xFUzExIFNQMzxicj5WTXMgKEtlcm5lbCA9CjMu MC43Ni0wLjExKS4gQWZ0ZXIgbGl2ZSBtaWdyYXRpb24gb2YgdGhlc2UgVk1zIHRoZXkgYWxsIG9m IGEgPQpzdWRkZW48YnI+ZG8gbm90IHJlYWN0IGFueSBsb25nZXIgYW5kIENQVSB1c2FnZSBvZiB0 aGUgVk0gZ29lcyB0byA9CjEwMCUuPGJyPjxicj5XZSBpZGVudGlmaWVkIGt2bS1jbG9jayBzb3Vy Y2UgdG8gYmUgdGhlIGN1bHByaXQgYW5kID0KdGhlcmVmb3JlIHN3aXRjaGVkIHRvIGFub3RoZXI8 YnI+Y2xvY2tzb3VyY2UuIFdlIGVuZGVkIHdpdGggaHBldCBidXQgYXJlID0Kbm90IGhhcHB5IHdp dGggdGhhdCBhcyBvdXIgaW5pdGFsIGdvYWw8YnI+d2FzIHRvIHVzZSB0aGUgbW9yZSBzaW1wbGUg PQpkZXNpZ25lZCBUU0MgY2xvY2tzb3VyZS48c3BhbiA9CmNsYXNzPTNEIkFwcGxlLWNvbnZlcnRl ZC1zcGFjZSI+Jm5ic3A7PC9zcGFuPjxicj48YnI+VGhlIHJlYXNvbiBiZWhpbmQgPQp0aGF0IGlz IHRoZSBxdWVzdGlvbiBJIGhhdmUgZm9yIHlvdSBleHBlcnRzLjxicj48YnI+T3VyIGhvc3RzIGFs bCBoYXZlID0KdGhlIGNvbnN0YW50X3RzYyBDUFUgZmxhZyBhdmFpbGFibGUuIEp1c3QgdG8gbWVu dGlvbiB0aGVzZTxicj5hcmUgbm90ID0KaWRlbnRpY2FsIGhvc3RzLiBXZSBoYXZlIGEgbWl4IG9m IFhlb24gNTUwMCBhbmQgNTYwMCBtYWNoaW5lcy4gPQpFLkcuPGJyPltyb290QGNvbG92bjAxIH5d IyBjYXQgL3Byb2MvY3B1aW5mbyB8IGdyZXAgY29uc3RhbnRfdHNjIHwgd2MgPQotbDxicj44PGJy Pjxicj5XaGVuIHdlIHN0YXJ0IHRoZSBWTSB0aGUgY2xpZW50IHNlZXMgVFNDIGFzIGF2YWlsYWJs ZSA9CmNsb2Nrc291cmNlOjxicj48YnI+Y29sdm01Mzp+ICMgY2F0ID0KL3N5cy9kZXZpY2VzL3N5 c3RlbS9jbG9ja3NvdXJjZS9jbG9ja3NvdXJjZTAvYXZhaWxhYmxlX2Nsb2Nrc291cmNlPGJyPmt2 bS09CmNsb2NrIHRzYyBocGV0IGFjcGlfcG08YnI+PGJyPkFmdGVyIHRoZSBmaXJzdCBsaXZlIG1p Z3JhdGlvbiB0byBhbm90aGVyID0KaG9zdCB0aGF0IGFsc28gaGFzIGNvbnN0YW50X3RzYyAoc2Vl IGFib3ZlKTxicj50aGF0IGZsYWcgaXMgbG9zdCBpbnNpZGUgPQp0aGUgVk0uPGJyPjxicj5jb2x2 bTUzOn4gIyBjYXQgPQovc3lzL2RldmljZXMvc3lzdGVtL2Nsb2Nrc291cmNlL2Nsb2Nrc291cmNl MC9hdmFpbGFibGVfY2xvY2tzb3VyY2U8YnI+a3ZtLT0KY2xvY2sgaHBldCBhY3BpX3BtPGJyPjxi cj5BbnkgPQppZGVhcz88YnI+PGJyPk1hcmt1czxicj48YnI+PGJyPjwvZGl2PjxzcGFuPiZsdDtJ bnRlclNjYW5fRGlzY2xhaW1lci50eHQmZz0KdDs8L3NwYW4+X19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX188YnI+VXNlcnMgPQptYWlsaW5nIGxpc3Q8YnI+PGEg PQpocmVmPTNEIm1haWx0bzpVc2Vyc0BvdmlydC5vcmciPlVzZXJzQG92aXJ0Lm9yZzwvYT48YnI+ PGEgPQpocmVmPTNEImh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2Vy cyI+aHR0cDovL2xpc3RzLm92aXJ0Lj0Kb3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E+PC9k aXY+PC9zcGFuPjwvYmxvY2txdW90ZT48L2Rpdj48YnI+PC9kaXY+PC89CmJvZHk+PC9odG1sPj0K Ci0tQXBwbGUtTWFpbD1fQkE0M0ZFNDEtNzMzQi00OTdELUJGRTAtRkFEOEYyQ0FFNTdBLS0K --===============4521504572705692079==--