--_000_57bb811a2b934054bfb525ea35341e1czerah_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable I was in the process of upgrading from 3.5.5 to 3.6.4 when it happened. I a= m sure there were version mismatches. I think what generated this issue was that I edited the cluster the host be= longed to while it was going down for maintenance. This caused the tasks ta= b to show multiple tasks of the host going down for maintenance. They all e= ventually went into en error state and the task kept repeating itself until= I rebooted the host. Andrew Wippler | Sr. Systems Administrator | Lancaster Baptist Church | Dr.= Paul Chappell, Pastor ________________________________ From: Michal Skrivanek <michal.skrivanek@redhat.com> Sent: Friday, April 01, 2016 1:00 AM To: Andrew Wippler Cc: users@ovirt.org Subject: Re: [ovirt-users] Several VM's stuck in Migration On 31 Mar 2016, at 19:48, Andrew Wippler <Andrew.Wippler@lancasterbaptist.o= rg<mailto:Andrew.Wippler@lancasterbaptist.org>> wrote: Mark, Hopefully you have resolved your stuck VM issue by now (nearly two months l= ater). I came across this email from a google search. I was having the same= exact problem with VMs being stuck in migration mode. The trigger to the V= M migration issue was that I was setting my Host into maintenance mode. It = migrated half of the active VMs successfully and the other half were stuck. Hi, It would be great to get logs from the system, or at least describe the spe= cifics (anything special? gluster? old version?) otherwise no one will ever be able to help;) Thanks, michal There were two things I had to do to fix all of my stuck VMs: 1. I shut down the host (long enough for oVirt to fence it and notice that = it was down). I then powered it on and "confirmed host as rebooted." This r= eset the active VM count on the host and turned on my HA VMs on other hosts= . 2. For the one VM that was still stuck after a host reboot, I had to login = to postgres and set the status to 0 on that VM. This allowed me to shut dow= n the migrating VM and start it back up. (I do not think I would have had t= o do this step if I did not alter the database entry for this VM before reb= ooting the host.) For step 2, I used the methods described here: https://access.redhat.com/di= scussions/688043 and as seen below: ssh ovirt-engine su postgres psql \connect engine SELECT vm_guid status FROM vm_static WHERE vm_name=3D'XXXX'; UPDATE vm_dynamic SET status=3D0 WHERE vm_guid=3D'xxxxxxxx'; UPDATE vm_dynamic SET run_on_vds =3D null WHERE vm_guid=3D'xxxxxxxx'; \q (I was then able to shut down the VM) -- Andrew Wippler <andrew.wippler@lancasterbaptist.org> | Sr. Systems Administ= rator | Lancaster Baptist Church _______________________________________________ Users mailing list Users@ovirt.org<mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users --_000_57bb811a2b934054bfb525ea35341e1czerah_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
<style id=3D"owaParaStyle" type=3D"text/css" style=3D"">=0A= <!--=0A= p=0A= {margin-top:0;=0A= margin-bottom:0}=0A= -->=0A= P {margin-top:0;margin-bottom:0;}</style> </head> <body aria-label=3D"Message body" fpstyle=3D"1" tabindex=3D"0" dir=3D"ltr"> <div name=3D"divtagdefaultwrapper" id=3D"divtagdefaultwrapper" style=3D"fon= t-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:#000000;= margin:0"> I was in the process of upgrading from 3.5.5 to 3.6.4 when it happened. I a= m sure there were version mismatches.<br> <br> I think what generated this issue was that I edited the cluster the host be= longed to while it was going down for maintenance. This caused the tasks ta= b to show multiple tasks of the host going down for maintenance. They all e= ventually went into en error state and the task kept repeating itself until I rebooted the host.<br> <div><br> <div name=3D"divtagdefaultwrapper" style=3D"font-family:Calibri,Arial,Helve= tica,sans-serif; font-size:; margin:0"> Andrew Wippler | Sr. Systems Administrator | Lancaster Baptist Church | Dr.= Paul Chappell, Pastor</div> </div> <br> <div style=3D"color:rgb(40,40,40)"> <hr tabindex=3D"-1" style=3D"display:inline-block; width:98%"> <div id=3D"divRplyFwdMsg" dir=3D"ltr"><font style=3D"font-size:11pt" face= =3D"Calibri, sans-serif" color=3D"#000000"><b>From:</b> Michal Skrivanek &l= t;michal.skrivanek@redhat.com><br> <b>Sent:</b> Friday, April 01, 2016 1:00 AM<br> <b>To:</b> Andrew Wippler<br> <b>Cc:</b> users@ovirt.org<br> <b>Subject:</b> Re: [ovirt-users] Several VM's stuck in Migration</font> <div> </div> </div> <div><br class=3D""> <div> <blockquote type=3D"cite" class=3D""> <div class=3D"">On 31 Mar 2016, at 19:48, Andrew Wippler <<a href=3D"mai= lto:Andrew.Wippler@lancasterbaptist.org" class=3D"">Andrew.Wippler@lancaste= rbaptist.org</a>> wrote:</div> <br class=3D"Apple-interchange-newline"> <div class=3D""> <div class=3D"" style=3D"word-wrap:break-word"> <div class=3D"">Mark,</div> <div class=3D""><br class=3D""> </div> <div class=3D"">Hopefully you have resolved your stuck VM issue by now (nea= rly two months later). I came across this email from a google search. I was= having the same exact problem with VMs being stuck in migration mode. The = trigger to the VM migration issue was that I was setting my Host into maintenance mode. It migrated half of = the active VMs successfully and the other half were stuck.</div> </div> </div> </blockquote> <div><br class=3D""> </div> <div>Hi,</div> It would be great to get logs from the system, or at least describe the spe= cifics (anything special? gluster? old version?)</div> <div>otherwise no one will ever be able to help;)</div> <div><br class=3D""> </div> <div>Thanks,</div> <div>michal</div> <div><br class=3D""> <blockquote type=3D"cite" class=3D""> <div class=3D""> <div class=3D"" style=3D"word-wrap:break-word"> <div class=3D""><br class=3D""> </div> <div class=3D"">There were two things I had to do to fix all of my stuck VM= s:</div> <div class=3D"">1. I shut down the host (long enough for oVirt to fence it = and notice that it was down). I then powered it on and "confirmed host= as rebooted." This reset the active VM count on the host and turned o= n my HA VMs on other hosts.</div> <div class=3D"">2. For the one VM that was still stuck after a host reboot,= I had to login to postgres and set the status to 0 on that VM. This allowe= d me to shut down the migrating VM and start it back up. (I do not think I = would have had to do this step if I did not alter the database entry for this VM before rebooting the host.)= </div> <div class=3D""><br class=3D""> </div> <div class=3D"">For step 2, I used the methods described here: <a href= =3D"https://access.redhat.com/discussions/688043" class=3D"">https://access= .redhat.com/discussions/688043</a> and as seen below:</div> <div class=3D"">ssh ovirt-engine</div> <div class=3D"">su postgres</div> <div class=3D"">psql</div> <div class=3D"">\connect engine</div> <div class=3D"">SELECT vm_guid status FROM vm_static WHERE vm_name=3D'XXXX'= ;</div> <div class=3D"">UPDATE vm_dynamic SET status=3D0 WHERE vm_guid=3D'xxxxxxxx'= ;</div> <div class=3D"">UPDATE vm_dynamic SET run_on_vds =3D null WHERE vm_gu= id=3D'xxxxxxxx';</div> <div class=3D"">\q</div> <div class=3D"">(I was then able to shut down the VM)</div> <div class=3D""><br class=3D""> </div> <div class=3D""><span class=3D"">-- <br class=3D""> Andrew Wippler <<a href=3D"" class=3D"">andrew.wippler@lancasterbaptist.= org></a> | Sr. Systems Administrator | Lancaster Baptist Church</sp= an></div> <div class=3D""><br class=3D""> </div> </div> _______________________________________________<br class=3D""> Users mailing list<br class=3D""> <a href=3D"mailto:Users@ovirt.org" class=3D"">Users@ovirt.org</a><br class= =3D""> http://lists.ovirt.org/mailman/listinfo/users<br class=3D""> </div> </blockquote> </div> <br class=3D""> </div> </div> </div> </body> </html> --_000_57bb811a2b934054bfb525ea35341e1czerah_--