From logank at wolfram.com Wed Sep 20 15:35:04 2017 Content-Type: multipart/mixed; boundary="===============1650959822655694205==" MIME-Version: 1.0 From: Logan Kuhn To: users at ovirt.org Subject: [ovirt-users] VM running on multiple hosts Date: Wed, 20 Sep 2017 10:25:04 -0500 Message-ID: <839412207.8728990.1505921104846.JavaMail.zimbra@wolfram.com> --===============1650959822655694205== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable --=3D_0e272b5f-fcd6-4360-b961-925677073066 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 7bit We had an incident where a VM hosts' disk filled up, the VMs all went unkno= wn in the web console, but were fully functional if you were to login or us= e the services of one. We couldn't migrate them so we powered them down on = that host and powered them up and let ovirt choose the host for it, same as= always. However the disk image on a few of them were corrupted because onc= e we fixed the host with the full disk, it still thought it should be runni= ng the VM. Which promptly corrupted the disk, the error seems to be this in= the logs: = 2017-09-19 21:59:11,058 INFO [org.ovirt.engine.core.vdsbroker.monitoring.Vm= Analyzer] (DefaultQuartzScheduler3) [36c806f6] VM '70cf75c7-0fc2-4bbe-958e-= 7d0095f70960'(testhub) is running in db and not running on VDS 'ef6dc2a3-af= 6e-4e00-aa4 = 0-493b31263417'(vm-int7) = We upgraded to 4.1.6 from 4.0.6 earlier in the day, I don't really think it= 's anything more than coincidence, but it's worrying enough to send to the = community. = Regards, = Logan = --=3D_0e272b5f-fcd6-4360-b961-925677073066 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable
We had an incident where a VM hosts' disk filled up, the VMs all w= =3D ent unknown in the web console, but were fully functional if you were to lo= =3D gin or use the services of one.  We couldn't migrate them so we powere= =3D d them down on that host and powered them up and let ovirt choose the host = =3D for it, same as always.  However the disk image on a few of them were = =3D corrupted because once we fixed the host with the full disk, it still thoug= =3D ht it should be running the VM.  Which promptly corrupted the disk, th= =3D e error seems to be this in the logs:

=
2017-09-19= 2=3D 1:59:11,058 INFO  [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyz= =3D er] (DefaultQuartzScheduler3) [36c806f6] VM '70cf75c7-0fc2-4bbe-958e-7d0095= =3D f70960'(testhub) is running in db and not running on VDS 'ef6dc2a3-af6e-4e00-aa4= =3D
0-493b31263417'(vm-int7)

We upgrade= =3D d to 4.1.6 from 4.0.6 earlier in the day, I don't really think it's anythin= =3D g more than coincidence, but it's worrying enough to send to the community.= =3D

=3D Regards,
Logan
--=3D_0e272b5f-fcd6-4360-b961-925677073066-- --===============1650959822655694205== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS09XzBlMjcyYjVmLWZjZDYtNDM2MC1iOTYxLTkyNTY3NzA3MzA2NgpDb250ZW50LVR5cGU6IHRl eHQvcGxhaW47IGNoYXJzZXQ9dXRmLTgKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogN2JpdAoK V2UgaGFkIGFuIGluY2lkZW50IHdoZXJlIGEgVk0gaG9zdHMnIGRpc2sgZmlsbGVkIHVwLCB0aGUg Vk1zIGFsbCB3ZW50IHVua25vd24gaW4gdGhlIHdlYiBjb25zb2xlLCBidXQgd2VyZSBmdWxseSBm dW5jdGlvbmFsIGlmIHlvdSB3ZXJlIHRvIGxvZ2luIG9yIHVzZSB0aGUgc2VydmljZXMgb2Ygb25l LiBXZSBjb3VsZG4ndCBtaWdyYXRlIHRoZW0gc28gd2UgcG93ZXJlZCB0aGVtIGRvd24gb24gdGhh dCBob3N0IGFuZCBwb3dlcmVkIHRoZW0gdXAgYW5kIGxldCBvdmlydCBjaG9vc2UgdGhlIGhvc3Qg Zm9yIGl0LCBzYW1lIGFzIGFsd2F5cy4gSG93ZXZlciB0aGUgZGlzayBpbWFnZSBvbiBhIGZldyBv ZiB0aGVtIHdlcmUgY29ycnVwdGVkIGJlY2F1c2Ugb25jZSB3ZSBmaXhlZCB0aGUgaG9zdCB3aXRo IHRoZSBmdWxsIGRpc2ssIGl0IHN0aWxsIHRob3VnaHQgaXQgc2hvdWxkIGJlIHJ1bm5pbmcgdGhl IFZNLiBXaGljaCBwcm9tcHRseSBjb3JydXB0ZWQgdGhlIGRpc2ssIHRoZSBlcnJvciBzZWVtcyB0 byBiZSB0aGlzIGluIHRoZSBsb2dzOiAKCjIwMTctMDktMTkgMjE6NTk6MTEsMDU4IElORk8gW29y Zy5vdmlydC5lbmdpbmUuY29yZS52ZHNicm9rZXIubW9uaXRvcmluZy5WbUFuYWx5emVyXSAoRGVm YXVsdFF1YXJ0elNjaGVkdWxlcjMpIFszNmM4MDZmNl0gVk0gJzcwY2Y3NWM3LTBmYzItNGJiZS05 NThlLTdkMDA5NWY3MDk2MCcodGVzdGh1YikgaXMgcnVubmluZyBpbiBkYiBhbmQgbm90IHJ1bm5p bmcgb24gVkRTICdlZjZkYzJhMy1hZjZlLTRlMDAtYWE0IAowLTQ5M2IzMTI2MzQxNycodm0taW50 NykgCgpXZSB1cGdyYWRlZCB0byA0LjEuNiBmcm9tIDQuMC42IGVhcmxpZXIgaW4gdGhlIGRheSwg SSBkb24ndCByZWFsbHkgdGhpbmsgaXQncyBhbnl0aGluZyBtb3JlIHRoYW4gY29pbmNpZGVuY2Us IGJ1dCBpdCdzIHdvcnJ5aW5nIGVub3VnaCB0byBzZW5kIHRvIHRoZSBjb21tdW5pdHkuIAoKUmVn YXJkcywgCkxvZ2FuIAoKLS09XzBlMjcyYjVmLWZjZDYtNDM2MC1iOTYxLTkyNTY3NzA3MzA2NgpD b250ZW50LVR5cGU6IHRleHQvaHRtbDsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVu Y29kaW5nOiBxdW90ZWQtcHJpbnRhYmxlCgo8aHRtbD48Ym9keT48ZGl2IHN0eWxlPTNEImZvbnQt ZmFtaWx5OiBBcmlhbDsgZm9udC1zaXplOiAxMnB0OyBjb2xvcjogIzAwMDA9CjAwIj48ZGl2Pldl IGhhZCBhbiBpbmNpZGVudCB3aGVyZSBhIFZNIGhvc3RzJyBkaXNrIGZpbGxlZCB1cCwgdGhlIFZN cyBhbGwgdz0KZW50IHVua25vd24gaW4gdGhlIHdlYiBjb25zb2xlLCBidXQgd2VyZSBmdWxseSBm dW5jdGlvbmFsIGlmIHlvdSB3ZXJlIHRvIGxvPQpnaW4gb3IgdXNlIHRoZSBzZXJ2aWNlcyBvZiBv bmUuJm5ic3A7IFdlIGNvdWxkbid0IG1pZ3JhdGUgdGhlbSBzbyB3ZSBwb3dlcmU9CmQgdGhlbSBk b3duIG9uIHRoYXQgaG9zdCBhbmQgcG93ZXJlZCB0aGVtIHVwIGFuZCBsZXQgb3ZpcnQgY2hvb3Nl IHRoZSBob3N0ID0KZm9yIGl0LCBzYW1lIGFzIGFsd2F5cy4mbmJzcDsgSG93ZXZlciB0aGUgZGlz ayBpbWFnZSBvbiBhIGZldyBvZiB0aGVtIHdlcmUgPQpjb3JydXB0ZWQgYmVjYXVzZSBvbmNlIHdl IGZpeGVkIHRoZSBob3N0IHdpdGggdGhlIGZ1bGwgZGlzaywgaXQgc3RpbGwgdGhvdWc9Cmh0IGl0 IHNob3VsZCBiZSBydW5uaW5nIHRoZSBWTS4mbmJzcDsgV2hpY2ggcHJvbXB0bHkgY29ycnVwdGVk IHRoZSBkaXNrLCB0aD0KZSBlcnJvciBzZWVtcyB0byBiZSB0aGlzIGluIHRoZSBsb2dzOjwvZGl2 PjxkaXY+PGJyIGRhdGEtbWNlLWJvZ3VzPTNEIjEiPjwvPQpkaXY+PGRpdj48c3BhbiBzdHlsZT0z RCJmb250LWZhbWlseTogbW9ub3NwYWNlOyIgZGF0YS1tY2Utc3R5bGU9M0QiZm9udC1mYW09Cmls eTogbW9ub3NwYWNlOyI+PHNwYW4gc3R5bGU9M0QiY29sb3I6ICMwMDAwMDA7IGJhY2tncm91bmQt Y29sb3I6ICNmZmZmZmY7Ij0KIGRhdGEtbWNlLXN0eWxlPTNEImNvbG9yOiAjMDAwMDAwOyBiYWNr Z3JvdW5kLWNvbG9yOiAjZmZmZmZmOyI+MjAxNy0wOS0xOSAyPQoxOjU5OjExLDA1OCBJTkZPICZu YnNwO1tvcmcub3ZpcnQuZW5naW5lLmNvcmUudmRzYnJva2VyLm1vbml0b3JpbmcuVm1BbmFseXo9 CmVyXSAoRGVmYXVsdFF1YXJ0elNjaGVkdWxlcjMpIFszNmM4MDZmNl0gVk0gJzcwY2Y3NWM3LTBm YzItNGJiZS05NThlLTdkMDA5NT0KZjcwOTYwJyh0ZXN0aHViKSBpcyA8L3NwYW4+PHNwYW4gc3R5 bGU9M0QiZm9udC13ZWlnaHQ6IGJvbGQ7IGNvbG9yOiAjZmY1NDU0PQo7IGJhY2tncm91bmQtY29s b3I6ICNmZmZmZmY7IiBkYXRhLW1jZS1zdHlsZT0zRCJmb250LXdlaWdodDogYm9sZDsgY29sb3I6 ICM9CmZmNTQ1NDsgYmFja2dyb3VuZC1jb2xvcjogI2ZmZmZmZjsiPnJ1bm5pbmc8L3NwYW4+PHNw YW4gc3R5bGU9M0QiY29sb3I6ICMwMD0KMDAwMDsgYmFja2dyb3VuZC1jb2xvcjogI2ZmZmZmZjsi IGRhdGEtbWNlLXN0eWxlPTNEImNvbG9yOiAjMDAwMDAwOyBiYWNrZ3JvPQp1bmQtY29sb3I6ICNm ZmZmZmY7Ij4gaW4gZGIgYW5kIG5vdCA8L3NwYW4+PHNwYW4gc3R5bGU9M0QiZm9udC13ZWlnaHQ6 IGJvbGQ9CjsgY29sb3I6ICNmZjU0NTQ7IGJhY2tncm91bmQtY29sb3I6ICNmZmZmZmY7IiBkYXRh LW1jZS1zdHlsZT0zRCJmb250LXdlaWdodD0KOiBib2xkOyBjb2xvcjogI2ZmNTQ1NDsgYmFja2dy b3VuZC1jb2xvcjogI2ZmZmZmZjsiPnJ1bm5pbmc8L3NwYW4+PHNwYW4gc3R5PQpsZT0zRCJjb2xv cjogIzAwMDAwMDsgYmFja2dyb3VuZC1jb2xvcjogI2ZmZmZmZjsiIGRhdGEtbWNlLXN0eWxlPTNE ImNvbG9yOiA9CiMwMDAwMDA7IGJhY2tncm91bmQtY29sb3I6ICNmZmZmZmY7Ij4gb24gVkRTICdl ZjZkYzJhMy1hZjZlLTRlMDAtYWE0PC9zcGFuPj0KPGJyPjAtNDkzYjMxMjYzNDE3Jyh2bS1pbnQ3 KTxicj48L3NwYW4+PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5XZSB1cGdyYWRlPQpkIHRvIDQu MS42IGZyb20gNC4wLjYgZWFybGllciBpbiB0aGUgZGF5LCBJIGRvbid0IHJlYWxseSB0aGluayBp dCdzIGFueXRoaW49CmcgbW9yZSB0aGFuIGNvaW5jaWRlbmNlLCBidXQgaXQncyB3b3JyeWluZyBl bm91Z2ggdG8gc2VuZCB0byB0aGUgY29tbXVuaXR5Lj0KPC9kaXY+PGRpdj48YnIgZGF0YS1tY2Ut Ym9ndXM9M0QiMSI+PC9kaXY+PGRpdiBkYXRhLW1hcmtlcj0zRCJfX1NJR19QUkVfXyI+PQpSZWdh cmRzLDxicj5Mb2dhbjwvZGl2PjwvZGl2PjwvYm9keT48L2h0bWw+Ci0tPV8wZTI3MmI1Zi1mY2Q2 LTQzNjAtYjk2MS05MjU2NzcwNzMwNjYtLQo= --===============1650959822655694205==--