Several VM's stuck in Migration
Hello, We recently had our storage array hang. We were able to get the disk array back online, however several of our VM's attempted to migrate from one Host to another. Now that the storage is online, several of the VM's still indicate they are in a state of migration and I cannot manage them from withing the ovirt engine web administration gui. Most of the VM's are actually running properly and I can access them either via ssh or RDP (depending on the OS). I have attempted to clear the migration status with the following: - service ovirt-engine restart (on the ovirt-engine vm) - reboot ovirt-engine vm - PGPASSWORD=############### ./unlock_entity.sh -t vm vm-name - restart the vm from within the vm additionally - i went on the HV of one of the VM's and did: vdsClient -s 0 destroy vm_guid unfortunately, that removed all traces of the vm from that HV and it was not on any of the other three HV's - although ovirt-engine still shows it and reports it as migrating. I'd like to clear the migrating status of the affected VM's and figure out how to recover the missing one. Any help would be appreciated. I am not the person who originally setup the ovirt installation, so I am not sure where to go to pull logs. Thank you for your assistance. *** *Mark Steele* CIO / VP Technical Operations | TelVue Corporation TelVue - We Share Your Vision 800.885.8886 x128 | msteele@telvue.com | http://www.telvue.com twitter: http://twitter.com/telvue | facebook: https://www.facebook.com/telvue <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail> This email has been sent from a virus-free computer protected by Avast. www.avast.com <https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=webmail> <#DDB4FAA8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
--_000_1459446496698619camellancasterbaptistorg_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 TWFyaywNCg0KSG9wZWZ1bGx5IHlvdSBoYXZlIHJlc29sdmVkIHlvdXIgc3R1Y2sgVk0gaXNzdWUg Ynkgbm93IChuZWFybHkgdHdvIG1vbnRocyBsYXRlcikuIEkgY2FtZSBhY3Jvc3MgdGhpcyBlbWFp bCBmcm9tIGEgZ29vZ2xlIHNlYXJjaC4gSSB3YXMgaGF2aW5nIHRoZSBzYW1lIGV4YWN0IHByb2Js ZW0gd2l0aCBWTXMgYmVpbmcgc3R1Y2sgaW4gbWlncmF0aW9uIG1vZGUuIFRoZSB0cmlnZ2VyIHRv IHRoZSBWTSBtaWdyYXRpb24gaXNzdWUgd2FzIHRoYXQgSSB3YXMgc2V0dGluZyBteSBIb3N0IGlu dG8gbWFpbnRlbmFuY2UgbW9kZS4gSXQgbWlncmF0ZWQgaGFsZiBvZiB0aGUgYWN0aXZlIFZNcyBz dWNjZXNzZnVsbHkgYW5kIHRoZSBvdGhlciBoYWxmIHdlcmUgc3R1Y2suDQoNClRoZXJlIHdlcmUg dHdvIHRoaW5ncyBJIGhhZCB0byBkbyB0byBmaXggYWxsIG9mIG15IHN0dWNrIFZNczoNCjEuIEkg c2h1dCBkb3duIHRoZSBob3N0IChsb25nIGVub3VnaCBmb3Igb1ZpcnQgdG8gZmVuY2UgaXQgYW5k IG5vdGljZSB0aGF0IGl0IHdhcyBkb3duKS4gSSB0aGVuIHBvd2VyZWQgaXQgb24gYW5kICJjb25m aXJtZWQgaG9zdCBhcyByZWJvb3RlZC4iIFRoaXMgcmVzZXQgdGhlIGFjdGl2ZSBWTSBjb3VudCBv biB0aGUgaG9zdCBhbmQgdHVybmVkIG9uIG15IEhBIFZNcyBvbiBvdGhlciBob3N0cy4NCjIuIEZv ciB0aGUgb25lIFZNIHRoYXQgd2FzIHN0aWxsIHN0dWNrIGFmdGVyIGEgaG9zdCByZWJvb3QsIEkg aGFkIHRvIGxvZ2luIHRvIHBvc3RncmVzIGFuZCBzZXQgdGhlIHN0YXR1cyB0byAwIG9uIHRoYXQg Vk0uIFRoaXMgYWxsb3dlZCBtZSB0byBzaHV0IGRvd24gdGhlIG1pZ3JhdGluZyBWTSBhbmQgc3Rh cnQgaXQgYmFjayB1cC4gKEkgZG8gbm90IHRoaW5rIEkgd291bGQgaGF2ZSBoYWQgdG8gZG8gdGhp cyBzdGVwIGlmIEkgZGlkIG5vdCBhbHRlciB0aGUgZGF0YWJhc2UgZW50cnkgZm9yIHRoaXMgVk0g YmVmb3JlIHJlYm9vdGluZyB0aGUgaG9zdC4pDQoNCkZvciBzdGVwIDIsIEkgdXNlZCB0aGUgbWV0 aG9kcyBkZXNjcmliZWQgaGVyZTogaHR0cHM6Ly9hY2Nlc3MucmVkaGF0LmNvbS9kaXNjdXNzaW9u cy82ODgwNDMgYW5kIGFzIHNlZW4gYmVsb3c6DQpzc2ggb3ZpcnQtZW5naW5lDQpzdSBwb3N0Z3Jl cw0KcHNxbA0KXGNvbm5lY3QgZW5naW5lDQpTRUxFQ1Qgdm1fZ3VpZCBzdGF0dXMgRlJPTSB2bV9z dGF0aWMgV0hFUkUgdm1fbmFtZT0nWFhYWCc7DQpVUERBVEUgdm1fZHluYW1pYyBTRVQgc3RhdHVz PTAgV0hFUkUgdm1fZ3VpZD0neHh4eHh4eHgnOw0KVVBEQVRFIHZtX2R5bmFtaWMgU0VUIHJ1bl9v bl92ZHMgPSBudWxsICBXSEVSRSB2bV9ndWlkPSd4eHh4eHh4eCc7DQpccQ0KKEkgd2FzIHRoZW4g YWJsZSB0byBzaHV0IGRvd24gdGhlIFZNKQ0KDQotLQ0KQW5kcmV3IFdpcHBsZXIgPGFuZHJldy53 aXBwbGVyQGxhbmNhc3RlcmJhcHRpc3Qub3JnPiB8IFNyLiBTeXN0ZW1zIEFkbWluaXN0cmF0b3Ig fCBMYW5jYXN0ZXIgQmFwdGlzdCBDaHVyY2gNCg0K --_000_1459446496698619camellancasterbaptistorg_ Content-Type: text/html; charset="utf-8" Content-ID: <EBC8BF3E930EF94CB7C2B17EA486CAD3@lancasterbaptist.org> Content-Transfer-Encoding: base64 PGh0bWw+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIgY29udGVudD0i dGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjwvaGVhZD4NCjxib2R5IHN0eWxlPSJ3b3JkLXdy YXA6IGJyZWFrLXdvcmQ7IC13ZWJraXQtbmJzcC1tb2RlOiBzcGFjZTsgLXdlYmtpdC1saW5lLWJy ZWFrOiBhZnRlci13aGl0ZS1zcGFjZTsiPg0KPGRpdj5NYXJrLDwvZGl2Pg0KPGRpdj48YnI+DQo8 L2Rpdj4NCjxkaXY+SG9wZWZ1bGx5IHlvdSBoYXZlIHJlc29sdmVkIHlvdXIgc3R1Y2sgVk0gaXNz dWUgYnkgbm93IChuZWFybHkgdHdvIG1vbnRocyBsYXRlcikuIEkgY2FtZSBhY3Jvc3MgdGhpcyBl bWFpbCBmcm9tIGEgZ29vZ2xlIHNlYXJjaC4gSSB3YXMgaGF2aW5nIHRoZSBzYW1lIGV4YWN0IHBy b2JsZW0gd2l0aCBWTXMgYmVpbmcgc3R1Y2sgaW4gbWlncmF0aW9uIG1vZGUuIFRoZSB0cmlnZ2Vy IHRvIHRoZSBWTSBtaWdyYXRpb24gaXNzdWUgd2FzIHRoYXQNCiBJIHdhcyBzZXR0aW5nIG15IEhv c3QgaW50byBtYWludGVuYW5jZSBtb2RlLiBJdCBtaWdyYXRlZCBoYWxmIG9mIHRoZSBhY3RpdmUg Vk1zIHN1Y2Nlc3NmdWxseSBhbmQgdGhlIG90aGVyIGhhbGYgd2VyZSBzdHVjay48L2Rpdj4NCjxk aXY+PGJyPg0KPC9kaXY+DQo8ZGl2PlRoZXJlIHdlcmUgdHdvIHRoaW5ncyBJIGhhZCB0byBkbyB0 byBmaXggYWxsIG9mIG15IHN0dWNrIFZNczo8L2Rpdj4NCjxkaXY+MS4gSSBzaHV0IGRvd24gdGhl IGhvc3QgKGxvbmcgZW5vdWdoIGZvciBvVmlydCB0byBmZW5jZSBpdCBhbmQgbm90aWNlIHRoYXQg aXQgd2FzIGRvd24pLiBJIHRoZW4gcG93ZXJlZCBpdCBvbiBhbmQgJnF1b3Q7Y29uZmlybWVkIGhv c3QgYXMgcmVib290ZWQuJnF1b3Q7IFRoaXMgcmVzZXQgdGhlIGFjdGl2ZSBWTSBjb3VudCBvbiB0 aGUgaG9zdCBhbmQgdHVybmVkIG9uIG15IEhBIFZNcyBvbiBvdGhlciBob3N0cy48L2Rpdj4NCjxk aXY+Mi4gRm9yIHRoZSBvbmUgVk0gdGhhdCB3YXMgc3RpbGwgc3R1Y2sgYWZ0ZXIgYSBob3N0IHJl Ym9vdCwgSSBoYWQgdG8gbG9naW4gdG8gcG9zdGdyZXMgYW5kIHNldCB0aGUgc3RhdHVzIHRvIDAg b24gdGhhdCBWTS4gVGhpcyBhbGxvd2VkIG1lIHRvIHNodXQgZG93biB0aGUgbWlncmF0aW5nIFZN IGFuZCBzdGFydCBpdCBiYWNrIHVwLiAoSSBkbyBub3QgdGhpbmsgSSB3b3VsZCBoYXZlIGhhZCB0 byBkbyB0aGlzIHN0ZXAgaWYgSSBkaWQgbm90DQogYWx0ZXIgdGhlIGRhdGFiYXNlIGVudHJ5IGZv ciB0aGlzIFZNIGJlZm9yZSByZWJvb3RpbmcgdGhlIGhvc3QuKTwvZGl2Pg0KPGRpdj48YnI+DQo8 L2Rpdj4NCjxkaXY+Rm9yIHN0ZXAgMiwgSSB1c2VkIHRoZSBtZXRob2RzIGRlc2NyaWJlZCBoZXJl OiZuYnNwOzxhIGhyZWY9Imh0dHBzOi8vYWNjZXNzLnJlZGhhdC5jb20vZGlzY3Vzc2lvbnMvNjg4 MDQzIj5odHRwczovL2FjY2Vzcy5yZWRoYXQuY29tL2Rpc2N1c3Npb25zLzY4ODA0MzwvYT4mbmJz cDthbmQgYXMgc2VlbiBiZWxvdzo8L2Rpdj4NCjxkaXY+c3NoIG92aXJ0LWVuZ2luZTwvZGl2Pg0K PGRpdj5zdSBwb3N0Z3JlczwvZGl2Pg0KPGRpdj5wc3FsPC9kaXY+DQo8ZGl2Plxjb25uZWN0IGVu Z2luZTwvZGl2Pg0KPGRpdj5TRUxFQ1Qgdm1fZ3VpZCBzdGF0dXMgRlJPTSB2bV9zdGF0aWMgV0hF UkUgdm1fbmFtZT0nWFhYWCc7PC9kaXY+DQo8ZGl2PlVQREFURSB2bV9keW5hbWljIFNFVCBzdGF0 dXM9MCBXSEVSRSB2bV9ndWlkPSd4eHh4eHh4eCc7PC9kaXY+DQo8ZGl2PlVQREFURSB2bV9keW5h bWljIFNFVCBydW5fb25fdmRzID0gbnVsbCZuYnNwOyBXSEVSRSB2bV9ndWlkPSd4eHh4eHh4eCc7 PC9kaXY+DQo8ZGl2PlxxPC9kaXY+DQo8ZGl2PihJIHdhcyB0aGVuIGFibGUgdG8gc2h1dCBkb3du IHRoZSBWTSk8L2Rpdj4NCjxkaXY+PGJyPg0KPC9kaXY+DQo8ZGl2PjxzcGFuPi0tIDxicj4NCkFu ZHJldyBXaXBwbGVyICZsdDs8YSBocmVmPSJhbmRyZXcud2lwcGxlckBsYW5jYXN0ZXJiYXB0aXN0 Lm9yZyZndDsiPmFuZHJldy53aXBwbGVyQGxhbmNhc3RlcmJhcHRpc3Qub3JnJmd0OzwvYT4mbmJz cDt8IFNyLiBTeXN0ZW1zIEFkbWluaXN0cmF0b3IgfCBMYW5jYXN0ZXIgQmFwdGlzdCBDaHVyY2g8 L3NwYW4+PC9kaXY+DQo8ZGl2Pjxicj4NCjwvZGl2Pg0KPC9ib2R5Pg0KPC9odG1sPg0K --_000_1459446496698619camellancasterbaptistorg_--
--Apple-Mail=_CB1BBFEC-A7A9-45F9-B3D1-80014558EFE2 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii
On 31 Mar 2016, at 19:48, Andrew Wippler = <Andrew.Wippler@lancasterbaptist.org> wrote: =20 Mark, =20 Hopefully you have resolved your stuck VM issue by now (nearly two = months later). I came across this email from a google search. I was = having the same exact problem with VMs being stuck in migration mode. = The trigger to the VM migration issue was that I was setting my Host = into maintenance mode. It migrated half of the active VMs successfully = and the other half were stuck.
=20 There were two things I had to do to fix all of my stuck VMs: 1. I shut down the host (long enough for oVirt to fence it and notice =
Hi, It would be great to get logs from the system, or at least describe the = specifics (anything special? gluster? old version?) otherwise no one will ever be able to help;) Thanks, michal that it was down). I then powered it on and "confirmed host as = rebooted." This reset the active VM count on the host and turned on my = HA VMs on other hosts.
2. For the one VM that was still stuck after a host reboot, I had to = login to postgres and set the status to 0 on that VM. This allowed me to = shut down the migrating VM and start it back up. (I do not think I would = have had to do this step if I did not alter the database entry for this = VM before rebooting the host.) =20 For step 2, I used the methods described here: = https://access.redhat.com/discussions/688043 = <https://access.redhat.com/discussions/688043> and as seen below: ssh ovirt-engine su postgres psql \connect engine SELECT vm_guid status FROM vm_static WHERE vm_name=3D'XXXX'; UPDATE vm_dynamic SET status=3D0 WHERE vm_guid=3D'xxxxxxxx'; UPDATE vm_dynamic SET run_on_vds =3D null WHERE vm_guid=3D'xxxxxxxx'; \q (I was then able to shut down the VM) =20 --=20 Andrew Wippler <andrew.wippler@lancasterbaptist.org> = <x-msg://533/andrew.wippler@lancasterbaptist.org%3E> | Sr. Systems = Administrator | Lancaster Baptist Church =20 _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--Apple-Mail=_CB1BBFEC-A7A9-45F9-B3D1-80014558EFE2 Content-Transfer-Encoding: 7bit Content-Type: text/html; charset=us-ascii <html><head><meta http-equiv="Content-Type" content="text/html charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""><br class=""><div><blockquote type="cite" class=""><div class="">On 31 Mar 2016, at 19:48, Andrew Wippler <<a href="mailto:Andrew.Wippler@lancasterbaptist.org" class="">Andrew.Wippler@lancasterbaptist.org</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""> <meta http-equiv="Content-Type" content="text/html; charset=utf-8" class=""> <div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""> <div class="">Mark,</div> <div class=""><br class=""> </div> <div class="">Hopefully you have resolved your stuck VM issue by now (nearly two months later). I came across this email from a google search. I was having the same exact problem with VMs being stuck in migration mode. The trigger to the VM migration issue was that I was setting my Host into maintenance mode. It migrated half of the active VMs successfully and the other half were stuck.</div></div></div></blockquote><div><br class=""></div><div>Hi,</div>It would be great to get logs from the system, or at least describe the specifics (anything special? gluster? old version?)</div><div>otherwise no one will ever be able to help;)</div><div><br class=""></div><div>Thanks,</div><div>michal</div><div><br class=""><blockquote type="cite" class=""><div class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" class=""> <div class=""><br class=""> </div> <div class="">There were two things I had to do to fix all of my stuck VMs:</div> <div class="">1. I shut down the host (long enough for oVirt to fence it and notice that it was down). I then powered it on and "confirmed host as rebooted." This reset the active VM count on the host and turned on my HA VMs on other hosts.</div> <div class="">2. For the one VM that was still stuck after a host reboot, I had to login to postgres and set the status to 0 on that VM. This allowed me to shut down the migrating VM and start it back up. (I do not think I would have had to do this step if I did not alter the database entry for this VM before rebooting the host.)</div> <div class=""><br class=""> </div> <div class="">For step 2, I used the methods described here: <a href="https://access.redhat.com/discussions/688043" class="">https://access.redhat.com/discussions/688043</a> and as seen below:</div> <div class="">ssh ovirt-engine</div> <div class="">su postgres</div> <div class="">psql</div> <div class="">\connect engine</div> <div class="">SELECT vm_guid status FROM vm_static WHERE vm_name='XXXX';</div> <div class="">UPDATE vm_dynamic SET status=0 WHERE vm_guid='xxxxxxxx';</div> <div class="">UPDATE vm_dynamic SET run_on_vds = null WHERE vm_guid='xxxxxxxx';</div> <div class="">\q</div> <div class="">(I was then able to shut down the VM)</div> <div class=""><br class=""> </div> <div class=""><span class="">-- <br class=""> Andrew Wippler <<a href="x-msg://533/andrew.wippler@lancasterbaptist.org%3E" class="">andrew.wippler@lancasterbaptist.org></a> | Sr. Systems Administrator | Lancaster Baptist Church</span></div> <div class=""><br class=""> </div> </div> _______________________________________________<br class="">Users mailing list<br class=""><a href="mailto:Users@ovirt.org" class="">Users@ovirt.org</a><br class="">http://lists.ovirt.org/mailman/listinfo/users<br class=""></div></blockquote></div><br class=""></body></html> --Apple-Mail=_CB1BBFEC-A7A9-45F9-B3D1-80014558EFE2--
--_000_57bb811a2b934054bfb525ea35341e1czerah_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable I was in the process of upgrading from 3.5.5 to 3.6.4 when it happened. I a= m sure there were version mismatches. I think what generated this issue was that I edited the cluster the host be= longed to while it was going down for maintenance. This caused the tasks ta= b to show multiple tasks of the host going down for maintenance. They all e= ventually went into en error state and the task kept repeating itself until= I rebooted the host. Andrew Wippler | Sr. Systems Administrator | Lancaster Baptist Church | Dr.= Paul Chappell, Pastor ________________________________ From: Michal Skrivanek <michal.skrivanek@redhat.com> Sent: Friday, April 01, 2016 1:00 AM To: Andrew Wippler Cc: users@ovirt.org Subject: Re: [ovirt-users] Several VM's stuck in Migration On 31 Mar 2016, at 19:48, Andrew Wippler <Andrew.Wippler@lancasterbaptist.o= rg<mailto:Andrew.Wippler@lancasterbaptist.org>> wrote: Mark, Hopefully you have resolved your stuck VM issue by now (nearly two months l= ater). I came across this email from a google search. I was having the same= exact problem with VMs being stuck in migration mode. The trigger to the V= M migration issue was that I was setting my Host into maintenance mode. It = migrated half of the active VMs successfully and the other half were stuck. Hi, It would be great to get logs from the system, or at least describe the spe= cifics (anything special? gluster? old version?) otherwise no one will ever be able to help;) Thanks, michal There were two things I had to do to fix all of my stuck VMs: 1. I shut down the host (long enough for oVirt to fence it and notice that = it was down). I then powered it on and "confirmed host as rebooted." This r= eset the active VM count on the host and turned on my HA VMs on other hosts= . 2. For the one VM that was still stuck after a host reboot, I had to login = to postgres and set the status to 0 on that VM. This allowed me to shut dow= n the migrating VM and start it back up. (I do not think I would have had t= o do this step if I did not alter the database entry for this VM before reb= ooting the host.) For step 2, I used the methods described here: https://access.redhat.com/di= scussions/688043 and as seen below: ssh ovirt-engine su postgres psql \connect engine SELECT vm_guid status FROM vm_static WHERE vm_name=3D'XXXX'; UPDATE vm_dynamic SET status=3D0 WHERE vm_guid=3D'xxxxxxxx'; UPDATE vm_dynamic SET run_on_vds =3D null WHERE vm_guid=3D'xxxxxxxx'; \q (I was then able to shut down the VM) -- Andrew Wippler <andrew.wippler@lancasterbaptist.org> | Sr. Systems Administ= rator | Lancaster Baptist Church _______________________________________________ Users mailing list Users@ovirt.org<mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users --_000_57bb811a2b934054bfb525ea35341e1czerah_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
<style id=3D"owaParaStyle" type=3D"text/css" style=3D"">=0A= <!--=0A= p=0A= {margin-top:0;=0A= margin-bottom:0}=0A= -->=0A= P {margin-top:0;margin-bottom:0;}</style> </head> <body aria-label=3D"Message body" fpstyle=3D"1" tabindex=3D"0" dir=3D"ltr"> <div name=3D"divtagdefaultwrapper" id=3D"divtagdefaultwrapper" style=3D"fon= t-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:#000000;= margin:0"> I was in the process of upgrading from 3.5.5 to 3.6.4 when it happened. I a= m sure there were version mismatches.<br> <br> I think what generated this issue was that I edited the cluster the host be= longed to while it was going down for maintenance. This caused the tasks ta= b to show multiple tasks of the host going down for maintenance. They all e= ventually went into en error state and the task kept repeating itself until I rebooted the host.<br> <div><br> <div name=3D"divtagdefaultwrapper" style=3D"font-family:Calibri,Arial,Helve= tica,sans-serif; font-size:; margin:0"> Andrew Wippler | Sr. Systems Administrator | Lancaster Baptist Church | Dr.= Paul Chappell, Pastor</div> </div> <br> <div style=3D"color:rgb(40,40,40)"> <hr tabindex=3D"-1" style=3D"display:inline-block; width:98%"> <div id=3D"divRplyFwdMsg" dir=3D"ltr"><font style=3D"font-size:11pt" face= =3D"Calibri, sans-serif" color=3D"#000000"><b>From:</b> Michal Skrivanek &l= t;michal.skrivanek@redhat.com><br> <b>Sent:</b> Friday, April 01, 2016 1:00 AM<br> <b>To:</b> Andrew Wippler<br> <b>Cc:</b> users@ovirt.org<br> <b>Subject:</b> Re: [ovirt-users] Several VM's stuck in Migration</font> <div> </div> </div> <div><br class=3D""> <div> <blockquote type=3D"cite" class=3D""> <div class=3D"">On 31 Mar 2016, at 19:48, Andrew Wippler <<a href=3D"mai= lto:Andrew.Wippler@lancasterbaptist.org" class=3D"">Andrew.Wippler@lancaste= rbaptist.org</a>> wrote:</div> <br class=3D"Apple-interchange-newline"> <div class=3D""> <div class=3D"" style=3D"word-wrap:break-word"> <div class=3D"">Mark,</div> <div class=3D""><br class=3D""> </div> <div class=3D"">Hopefully you have resolved your stuck VM issue by now (nea= rly two months later). I came across this email from a google search. I was= having the same exact problem with VMs being stuck in migration mode. The = trigger to the VM migration issue was that I was setting my Host into maintenance mode. It migrated half of = the active VMs successfully and the other half were stuck.</div> </div> </div> </blockquote> <div><br class=3D""> </div> <div>Hi,</div> It would be great to get logs from the system, or at least describe the spe= cifics (anything special? gluster? old version?)</div> <div>otherwise no one will ever be able to help;)</div> <div><br class=3D""> </div> <div>Thanks,</div> <div>michal</div> <div><br class=3D""> <blockquote type=3D"cite" class=3D""> <div class=3D""> <div class=3D"" style=3D"word-wrap:break-word"> <div class=3D""><br class=3D""> </div> <div class=3D"">There were two things I had to do to fix all of my stuck VM= s:</div> <div class=3D"">1. I shut down the host (long enough for oVirt to fence it = and notice that it was down). I then powered it on and "confirmed host= as rebooted." This reset the active VM count on the host and turned o= n my HA VMs on other hosts.</div> <div class=3D"">2. For the one VM that was still stuck after a host reboot,= I had to login to postgres and set the status to 0 on that VM. This allowe= d me to shut down the migrating VM and start it back up. (I do not think I = would have had to do this step if I did not alter the database entry for this VM before rebooting the host.)= </div> <div class=3D""><br class=3D""> </div> <div class=3D"">For step 2, I used the methods described here: <a href= =3D"https://access.redhat.com/discussions/688043" class=3D"">https://access= .redhat.com/discussions/688043</a> and as seen below:</div> <div class=3D"">ssh ovirt-engine</div> <div class=3D"">su postgres</div> <div class=3D"">psql</div> <div class=3D"">\connect engine</div> <div class=3D"">SELECT vm_guid status FROM vm_static WHERE vm_name=3D'XXXX'= ;</div> <div class=3D"">UPDATE vm_dynamic SET status=3D0 WHERE vm_guid=3D'xxxxxxxx'= ;</div> <div class=3D"">UPDATE vm_dynamic SET run_on_vds =3D null WHERE vm_gu= id=3D'xxxxxxxx';</div> <div class=3D"">\q</div> <div class=3D"">(I was then able to shut down the VM)</div> <div class=3D""><br class=3D""> </div> <div class=3D""><span class=3D"">-- <br class=3D""> Andrew Wippler <<a href=3D"" class=3D"">andrew.wippler@lancasterbaptist.= org></a> | Sr. Systems Administrator | Lancaster Baptist Church</sp= an></div> <div class=3D""><br class=3D""> </div> </div> _______________________________________________<br class=3D""> Users mailing list<br class=3D""> <a href=3D"mailto:Users@ovirt.org" class=3D"">Users@ovirt.org</a><br class= =3D""> http://lists.ovirt.org/mailman/listinfo/users<br class=3D""> </div> </blockquote> </div> <br class=3D""> </div> </div> </div> </body> </html> --_000_57bb811a2b934054bfb525ea35341e1czerah_--
participants (3)
-
Andrew Wippler -
Mark Steele -
Michal Skrivanek