From darrell.budic at zenfire.com Fri Apr 4 19:19:16 2014 Content-Type: multipart/mixed; boundary="===============0315401318697303081==" MIME-Version: 1.0 From: Darrell Budic To: users at ovirt.org Subject: Re: [Users] TSC clocksource gets lost after live migration Date: Fri, 04 Apr 2014 18:19:55 -0500 Message-ID: In-Reply-To: 56307342-39C8-4D67-B92E-E68201B68F89@redhat.com --===============0315401318697303081== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable --Apple-Mail=3D_2FC1045B-BCA5-43A7-B186-961C9DFED565 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=3Dwindows-1252 I see this on some guests as well, possibly relating to moving between =3D hosts with the same family of CPU but different absolute CPU speeds? -Darrell On Apr 4, 2014, at 8:33 AM, Michal Skrivanek =3D wrote: > Hi, > this is more for the KVM folks I suppose=3D85can you get the qemu =3D process cmdline please? >=3D20 > Thanks, > michal >=3D20 > On 3 Apr 2014, at 12:13, Markus Stockhausen wrote: >=3D20 >> Hello, >>=3D20 >> we have an up to date ovirt 3.4 installation. Inside we are running =3D SLES11 SP3 >> VMs (Kernel 3.0.76-0.11). After live migration of these VMs they all =3D of a sudden >> do not react any longer and CPU usage of the VM goes to 100%. >>=3D20 >> We identified kvm-clock source to be the culprit and therefore =3D switched to another >> clocksource. We ended with hpet but are not happy with that as our =3D inital goal >> was to use the more simple designed TSC clocksoure.=3D20 >>=3D20 >> The reason behind that is the question I have for you experts. >>=3D20 >> Our hosts all have the constant_tsc CPU flag available. Just to =3D mention these >> are not identical hosts. We have a mix of Xeon 5500 and 5600 =3D machines. E.G. >> [root(a)colovn01 ~]# cat /proc/cpuinfo | grep constant_tsc | wc -l >> 8 >>=3D20 >> When we start the VM the client sees TSC as available clocksource: >>=3D20 >> colvm53:~ # cat =3D /sys/devices/system/clocksource/clocksource0/available_clocksource >> kvm-clock tsc hpet acpi_pm >>=3D20 >> After the first live migration to another host that also has =3D constant_tsc (see above) >> that flag is lost inside the VM. >>=3D20 >> colvm53:~ # cat =3D /sys/devices/system/clocksource/clocksource0/available_clocksource >> kvm-clock hpet acpi_pm >>=3D20 >> Any ideas? >>=3D20 >> Markus >>=3D20 >>=3D20 >> =3D _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >=3D20 > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --Apple-Mail=3D_2FC1045B-BCA5-43A7-B186-961C9DFED565 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=3Dwindows-1252 I see =3D this on some guests as well, possibly relating to moving between hosts =3D with the same family of CPU but different absolute CPU =3D speeds?

=3D -Darrell

On Apr 4, 2014, at 8:33 AM, =3D Michal Skrivanek <michal.skrivanek(a)redhat.c= om> wrote:

Hi,
this is more for the KVM folks I =3D suppose=3D85can you get the qemu process cmdline =3D please?

Thanks,
michal

On 3 Apr 2014, at 12:13, Markus Stockhausen wrote:

Hello,

we have an up to date ovirt 3.4 installation. =3D Inside we are running SLES11 SP3
VMs (Kernel 3.0.76-0.11). After live = =3D migration of these VMs they all of a sudden
do not react any longer =3D and CPU usage of the VM goes to 100%.

We identified kvm-clock =3D source to be the culprit and therefore switched to =3D another
clocksource. We ended with hpet but are not happy with that =3D as our inital goal
was to use the more simple designed TSC =3D clocksoure.

The= =3D reason behind that is the question I have for you experts.

Our =3D hosts all have the constant_tsc CPU flag available. Just to mention =3D these
are not identical hosts. We have a mix of Xeon 5500 and 5600 =3D machines. E.G.
[root(a)colovn01 ~]# cat /proc/cpuinfo | grep =3D constant_tsc | wc -l
8

When we start the VM the client sees =3D TSC as available clocksource:

colvm53:~ # cat =3D /sys/devices/system/clocksource/clocksource0/available_clocksource
kvm-= =3D clock tsc hpet acpi_pm

After the first live migration to another =3D host that also has constant_tsc (see above)
that flag is lost inside =3D the VM.

colvm53:~ # cat =3D /sys/devices/system/clocksource/clocksource0/available_clocksource
kvm-= =3D clock hpet acpi_pm

Any =3D ideas?

Markus

<InterScan_Disclaimer.txt>____= =3D ___________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt= .=3D org/mailman/listinfo/users

__= =3D _____________________________________________
Users mailing =3D list
Users(a)ovirt.org
http://lists.o= virt.=3D org/mailman/listinfo/users

= =3D --Apple-Mail=3D_2FC1045B-BCA5-43A7-B186-961C9DFED565-- --===============0315401318697303081== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" Ci0tQXBwbGUtTWFpbD1fMkZDMTA0NUItQkNBNS00M0E3LUIxODYtOTYxQzlERkVENTY1CkNvbnRl bnQtVHJhbnNmZXItRW5jb2Rpbmc6IHF1b3RlZC1wcmludGFibGUKQ29udGVudC1UeXBlOiB0ZXh0 L3BsYWluOwoJY2hhcnNldD13aW5kb3dzLTEyNTIKCkkgc2VlIHRoaXMgb24gc29tZSBndWVzdHMg YXMgd2VsbCwgcG9zc2libHkgcmVsYXRpbmcgdG8gbW92aW5nIGJldHdlZW4gPQpob3N0cyB3aXRo IHRoZSBzYW1lIGZhbWlseSBvZiBDUFUgYnV0IGRpZmZlcmVudCBhYnNvbHV0ZSBDUFUgc3BlZWRz PwoKICAtRGFycmVsbAoKT24gQXByIDQsIDIwMTQsIGF0IDg6MzMgQU0sIE1pY2hhbCBTa3JpdmFu ZWsgPQo8bWljaGFsLnNrcml2YW5la0ByZWRoYXQuY29tPiB3cm90ZToKCj4gSGksCj4gdGhpcyBp cyBtb3JlIGZvciB0aGUgS1ZNIGZvbGtzIEkgc3VwcG9zZT04NWNhbiB5b3UgZ2V0IHRoZSBxZW11 ID0KcHJvY2VzcyBjbWRsaW5lIHBsZWFzZT8KPj0yMAo+IFRoYW5rcywKPiBtaWNoYWwKPj0yMAo+ IE9uIDMgQXByIDIwMTQsIGF0IDEyOjEzLCBNYXJrdXMgU3RvY2toYXVzZW4gd3JvdGU6Cj49MjAK Pj4gSGVsbG8sCj4+PTIwCj4+IHdlIGhhdmUgYW4gdXAgdG8gZGF0ZSBvdmlydCAzLjQgaW5zdGFs bGF0aW9uLiBJbnNpZGUgd2UgYXJlIHJ1bm5pbmcgPQpTTEVTMTEgU1AzCj4+IFZNcyAoS2VybmVs IDMuMC43Ni0wLjExKS4gQWZ0ZXIgbGl2ZSBtaWdyYXRpb24gb2YgdGhlc2UgVk1zIHRoZXkgYWxs ID0Kb2YgYSBzdWRkZW4KPj4gZG8gbm90IHJlYWN0IGFueSBsb25nZXIgYW5kIENQVSB1c2FnZSBv ZiB0aGUgVk0gZ29lcyB0byAxMDAlLgo+Pj0yMAo+PiBXZSBpZGVudGlmaWVkIGt2bS1jbG9jayBz b3VyY2UgdG8gYmUgdGhlIGN1bHByaXQgYW5kIHRoZXJlZm9yZSA9CnN3aXRjaGVkIHRvIGFub3Ro ZXIKPj4gY2xvY2tzb3VyY2UuIFdlIGVuZGVkIHdpdGggaHBldCBidXQgYXJlIG5vdCBoYXBweSB3 aXRoIHRoYXQgYXMgb3VyID0KaW5pdGFsIGdvYWwKPj4gd2FzIHRvIHVzZSB0aGUgbW9yZSBzaW1w bGUgZGVzaWduZWQgVFNDIGNsb2Nrc291cmUuPTIwCj4+PTIwCj4+IFRoZSByZWFzb24gYmVoaW5k IHRoYXQgaXMgdGhlIHF1ZXN0aW9uIEkgaGF2ZSBmb3IgeW91IGV4cGVydHMuCj4+PTIwCj4+IE91 ciBob3N0cyBhbGwgaGF2ZSB0aGUgY29uc3RhbnRfdHNjIENQVSBmbGFnIGF2YWlsYWJsZS4gSnVz dCB0byA9Cm1lbnRpb24gdGhlc2UKPj4gYXJlIG5vdCBpZGVudGljYWwgaG9zdHMuIFdlIGhhdmUg YSBtaXggb2YgWGVvbiA1NTAwIGFuZCA1NjAwID0KbWFjaGluZXMuIEUuRy4KPj4gW3Jvb3RAY29s b3ZuMDEgfl0jIGNhdCAvcHJvYy9jcHVpbmZvIHwgZ3JlcCBjb25zdGFudF90c2MgfCB3YyAtbAo+ PiA4Cj4+PTIwCj4+IFdoZW4gd2Ugc3RhcnQgdGhlIFZNIHRoZSBjbGllbnQgc2VlcyBUU0MgYXMg YXZhaWxhYmxlIGNsb2Nrc291cmNlOgo+Pj0yMAo+PiBjb2x2bTUzOn4gIyBjYXQgPQovc3lzL2Rl dmljZXMvc3lzdGVtL2Nsb2Nrc291cmNlL2Nsb2Nrc291cmNlMC9hdmFpbGFibGVfY2xvY2tzb3Vy Y2UKPj4ga3ZtLWNsb2NrIHRzYyBocGV0IGFjcGlfcG0KPj49MjAKPj4gQWZ0ZXIgdGhlIGZpcnN0 IGxpdmUgbWlncmF0aW9uIHRvIGFub3RoZXIgaG9zdCB0aGF0IGFsc28gaGFzID0KY29uc3RhbnRf dHNjIChzZWUgYWJvdmUpCj4+IHRoYXQgZmxhZyBpcyBsb3N0IGluc2lkZSB0aGUgVk0uCj4+PTIw Cj4+IGNvbHZtNTM6fiAjIGNhdCA9Ci9zeXMvZGV2aWNlcy9zeXN0ZW0vY2xvY2tzb3VyY2UvY2xv Y2tzb3VyY2UwL2F2YWlsYWJsZV9jbG9ja3NvdXJjZQo+PiBrdm0tY2xvY2sgaHBldCBhY3BpX3Bt Cj4+PTIwCj4+IEFueSBpZGVhcz8KPj49MjAKPj4gTWFya3VzCj4+PTIwCj4+PTIwCj4+ID0KPElu dGVyU2Nhbl9EaXNjbGFpbWVyLnR4dD5fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fXwo+PiBVc2VycyBtYWlsaW5nIGxpc3QKPj4gVXNlcnNAb3ZpcnQub3JnCj4+ IGh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2Vycwo+PTIwCj4gX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KPiBVc2VycyBtYWls aW5nIGxpc3QKPiBVc2Vyc0BvdmlydC5vcmcKPiBodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxt YW4vbGlzdGluZm8vdXNlcnMKCgotLUFwcGxlLU1haWw9XzJGQzEwNDVCLUJDQTUtNDNBNy1CMTg2 LTk2MUM5REZFRDU2NQpDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiBxdW90ZWQtcHJpbnRhYmxl CkNvbnRlbnQtVHlwZTogdGV4dC9odG1sOwoJY2hhcnNldD13aW5kb3dzLTEyNTIKCjxodG1sPjxo ZWFkPjxtZXRhIGh0dHAtZXF1aXY9M0QiQ29udGVudC1UeXBlIiBjb250ZW50PTNEInRleHQvaHRt bCA9CmNoYXJzZXQ9M0R3aW5kb3dzLTEyNTIiPjwvaGVhZD48Ym9keSBzdHlsZT0zRCJ3b3JkLXdy YXA6IGJyZWFrLXdvcmQ7ID0KLXdlYmtpdC1uYnNwLW1vZGU6IHNwYWNlOyAtd2Via2l0LWxpbmUt YnJlYWs6IGFmdGVyLXdoaXRlLXNwYWNlOyI+SSBzZWUgPQp0aGlzIG9uIHNvbWUgZ3Vlc3RzIGFz IHdlbGwsIHBvc3NpYmx5IHJlbGF0aW5nIHRvIG1vdmluZyBiZXR3ZWVuIGhvc3RzID0Kd2l0aCB0 aGUgc2FtZSBmYW1pbHkgb2YgQ1BVIGJ1dCBkaWZmZXJlbnQgYWJzb2x1dGUgQ1BVID0Kc3BlZWRz PzxkaXY+PGJyPjwvZGl2PjxkaXY+Jm5ic3A7ID0KLURhcnJlbGw8L2Rpdj48ZGl2Pjxicj48L2Rp dj48ZGl2PjxkaXY+PGRpdj5PbiBBcHIgNCwgMjAxNCwgYXQgODozMyBBTSwgPQpNaWNoYWwgU2ty aXZhbmVrICZsdDs8YSA9CmhyZWY9M0QibWFpbHRvOm1pY2hhbC5za3JpdmFuZWtAcmVkaGF0LmNv bSI+bWljaGFsLnNrcml2YW5la0ByZWRoYXQuY29tPC9hPQo+Jmd0OyB3cm90ZTo8L2Rpdj48YnIg Y2xhc3M9M0QiQXBwbGUtaW50ZXJjaGFuZ2UtbmV3bGluZSI+PGJsb2NrcXVvdGUgPQp0eXBlPTNE ImNpdGUiPjxiYXNlIGhyZWY9M0QieC1tc2c6Ly8xNTc1LyI+PGRpdiBzdHlsZT0zRCJ3b3JkLXdy YXA6ID0KYnJlYWstd29yZDsgLXdlYmtpdC1uYnNwLW1vZGU6IHNwYWNlOyAtd2Via2l0LWxpbmUt YnJlYWs6ID0KYWZ0ZXItd2hpdGUtc3BhY2U7ICI+SGksPGRpdj50aGlzIGlzIG1vcmUgZm9yIHRo ZSBLVk0gZm9sa3MgSSA9CnN1cHBvc2U9ODVjYW4geW91IGdldCB0aGUgcWVtdSBwcm9jZXNzIGNt ZGxpbmUgPQpwbGVhc2U/PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5UaGFua3MsPC9kaXY+PGRp dj5taWNoYWw8L2Rpdj48ZGl2Pjxicj48ZD0KaXY+PGRpdj5PbiAzIEFwciAyMDE0LCBhdCAxMjox MywgTWFya3VzIFN0b2NraGF1c2VuIHdyb3RlOjwvZGl2PjxiciA9CmNsYXNzPTNEIkFwcGxlLWlu dGVyY2hhbmdlLW5ld2xpbmUiPjxibG9ja3F1b3RlIHR5cGU9M0QiY2l0ZSI+PHNwYW4gPQpjbGFz cz0zRCJBcHBsZS1zdHlsZS1zcGFuIiBzdHlsZT0zRCJib3JkZXItY29sbGFwc2U6IHNlcGFyYXRl OyA9CmZvbnQtZmFtaWx5OiBIZWx2ZXRpY2E7IGZvbnQtc3R5bGU6IG5vcm1hbDsgZm9udC12YXJp YW50OiBub3JtYWw7ID0KZm9udC13ZWlnaHQ6IG5vcm1hbDsgbGV0dGVyLXNwYWNpbmc6IG5vcm1h bDsgbGluZS1oZWlnaHQ6IG5vcm1hbDsgPQpvcnBoYW5zOiAyOyB0ZXh0LWFsaWduOiAtd2Via2l0 LWF1dG87IHRleHQtaW5kZW50OiAwcHg7IHRleHQtdHJhbnNmb3JtOiA9Cm5vbmU7IHdoaXRlLXNw YWNlOiBub3JtYWw7IHdpZG93czogMjsgd29yZC1zcGFjaW5nOiAwcHg7IGJvcmRlci1zcGFjaW5n OiA9CjBweDsgLXdlYmtpdC10ZXh0LWRlY29yYXRpb25zLWluLWVmZmVjdDogbm9uZTsgPQotd2Vi a2l0LXRleHQtc3Ryb2tlLXdpZHRoOiAwcHg7IGZvbnQtc2l6ZTogaW5oZXJpdDsiPjxkaXYgPQpz dHlsZT0zRCJkaXJlY3Rpb246IGx0cjsgZm9udC1mYW1pbHk6IFRhaG9tYTsgZm9udC1zaXplOiA9 CjEwcHQ7Ij5IZWxsbyw8YnI+PGJyPndlIGhhdmUgYW4gdXAgdG8gZGF0ZSBvdmlydCAzLjQgaW5z dGFsbGF0aW9uLiA9Ckluc2lkZSB3ZSBhcmUgcnVubmluZyBTTEVTMTEgU1AzPGJyPlZNcyAoS2Vy bmVsIDMuMC43Ni0wLjExKS4gQWZ0ZXIgbGl2ZSA9Cm1pZ3JhdGlvbiBvZiB0aGVzZSBWTXMgdGhl eSBhbGwgb2YgYSBzdWRkZW48YnI+ZG8gbm90IHJlYWN0IGFueSBsb25nZXIgPQphbmQgQ1BVIHVz YWdlIG9mIHRoZSBWTSBnb2VzIHRvIDEwMCUuPGJyPjxicj5XZSBpZGVudGlmaWVkIGt2bS1jbG9j ayA9CnNvdXJjZSB0byBiZSB0aGUgY3VscHJpdCBhbmQgdGhlcmVmb3JlIHN3aXRjaGVkIHRvID0K YW5vdGhlcjxicj5jbG9ja3NvdXJjZS4gV2UgZW5kZWQgd2l0aCBocGV0IGJ1dCBhcmUgbm90IGhh cHB5IHdpdGggdGhhdCA9CmFzIG91ciBpbml0YWwgZ29hbDxicj53YXMgdG8gdXNlIHRoZSBtb3Jl IHNpbXBsZSBkZXNpZ25lZCBUU0MgPQpjbG9ja3NvdXJlLjxzcGFuIGNsYXNzPTNEIkFwcGxlLWNv bnZlcnRlZC1zcGFjZSI+Jm5ic3A7PC9zcGFuPjxicj48YnI+VGhlID0KcmVhc29uIGJlaGluZCB0 aGF0IGlzIHRoZSBxdWVzdGlvbiBJIGhhdmUgZm9yIHlvdSBleHBlcnRzLjxicj48YnI+T3VyID0K aG9zdHMgYWxsIGhhdmUgdGhlIGNvbnN0YW50X3RzYyBDUFUgZmxhZyBhdmFpbGFibGUuIEp1c3Qg dG8gbWVudGlvbiA9CnRoZXNlPGJyPmFyZSBub3QgaWRlbnRpY2FsIGhvc3RzLiBXZSBoYXZlIGEg bWl4IG9mIFhlb24gNTUwMCBhbmQgNTYwMCA9Cm1hY2hpbmVzLiBFLkcuPGJyPltyb290QGNvbG92 bjAxIH5dIyBjYXQgL3Byb2MvY3B1aW5mbyB8IGdyZXAgPQpjb25zdGFudF90c2MgfCB3YyAtbDxi cj44PGJyPjxicj5XaGVuIHdlIHN0YXJ0IHRoZSBWTSB0aGUgY2xpZW50IHNlZXMgPQpUU0MgYXMg YXZhaWxhYmxlIGNsb2Nrc291cmNlOjxicj48YnI+Y29sdm01Mzp+ICMgY2F0ID0KL3N5cy9kZXZp Y2VzL3N5c3RlbS9jbG9ja3NvdXJjZS9jbG9ja3NvdXJjZTAvYXZhaWxhYmxlX2Nsb2Nrc291cmNl PGJyPmt2bS09CmNsb2NrIHRzYyBocGV0IGFjcGlfcG08YnI+PGJyPkFmdGVyIHRoZSBmaXJzdCBs aXZlIG1pZ3JhdGlvbiB0byBhbm90aGVyID0KaG9zdCB0aGF0IGFsc28gaGFzIGNvbnN0YW50X3Rz YyAoc2VlIGFib3ZlKTxicj50aGF0IGZsYWcgaXMgbG9zdCBpbnNpZGUgPQp0aGUgVk0uPGJyPjxi cj5jb2x2bTUzOn4gIyBjYXQgPQovc3lzL2RldmljZXMvc3lzdGVtL2Nsb2Nrc291cmNlL2Nsb2Nr c291cmNlMC9hdmFpbGFibGVfY2xvY2tzb3VyY2U8YnI+a3ZtLT0KY2xvY2sgaHBldCBhY3BpX3Bt PGJyPjxicj5BbnkgPQppZGVhcz88YnI+PGJyPk1hcmt1czxicj48YnI+PGJyPjwvZGl2PiZsdDtJ bnRlclNjYW5fRGlzY2xhaW1lci50eHQmZ3Q7X19fXz0KX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fXzxicj5Vc2VycyBtYWlsaW5nIGxpc3Q8YnI+PGEgPQpocmVmPTNE Im1haWx0bzpVc2Vyc0BvdmlydC5vcmciPlVzZXJzQG92aXJ0Lm9yZzwvYT48YnI+PGEgPQpocmVm PTNEImh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycyI+aHR0cDov L2xpc3RzLm92aXJ0Lj0Kb3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E+PC9zcGFuPjwvYmxv Y2txdW90ZT48L2Rpdj48YnI+PC9kaXY+PC9kaXY+X189Cl9fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fXzxicj5Vc2VycyBtYWlsaW5nID0KbGlzdDxicj48YSA9Cmhy ZWY9M0QibWFpbHRvOlVzZXJzQG92aXJ0Lm9yZyI+VXNlcnNAb3ZpcnQub3JnPC9hPjxicj5odHRw Oi8vbGlzdHMub3ZpcnQuPQpvcmcvbWFpbG1hbi9saXN0aW5mby91c2Vyczxicj48L2Jsb2NrcXVv dGU+PC9kaXY+PGJyPjwvZGl2PjwvYm9keT48L2h0bWw+PQoKLS1BcHBsZS1NYWlsPV8yRkMxMDQ1 Qi1CQ0E1LTQzQTctQjE4Ni05NjFDOURGRUQ1NjUtLQo= --===============0315401318697303081==--