10:30 p.m.
Hello,
We recently had our storage array hang. We were able to get the disk array
back online, however several of our VM's attempted to migrate from one Host
to another. Now that the storage is online, several of the VM's still
indicate they are in a state of migration and I cannot manage them from
withing the ovirt engine web administration gui.
Most of the VM's are actually running properly and I can access them either
via ssh or RDP (depending on the OS).
I have attempted to clear the migration status with the following:
- service ovirt-engine restart (on the ovirt-engine vm)
- reboot ovirt-engine vm
- PGPASSWORD=############### ./unlock_entity.sh -t vm vm-name
- restart the vm from within the vm
additionally - i went on the HV of one of the VM's and did:
vdsClient -s 0 destroy vm_guid
unfortunately, that removed all traces of the vm from that HV and it was
not on any of the other three HV's - although ovirt-engine still shows it
and reports it as migrating.
I'd like to clear the migrating status of the affected VM's and figure out
how to recover the missing one.
Any help would be appreciated. I am not the person who originally setup the
ovirt installation, so I am not sure where to go to pull logs.
Thank you for your assistance.
***
*Mark Steele*
CIO / VP Technical Operations | TelVue Corporation
TelVue - We Share Your Vision
800.885.8886 x128 | msteele(a)telvue.com | http://www.telvue.com
twitter: http://twitter.com/telvue | facebook:
https://www.facebook.com/telvue
<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&...
This
email has been sent from a virus-free computer protected by Avast.
www.avast.com
<https://www.avast.com/sig-email?utm_medium=email&utm_source=link&...
<#DDB4FAA8-2DD7-40BB-A1B8-4E2AA1F9FDF2>
1:48 p.m.
--_000_1459446496698619camellancasterbaptistorg_
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: base64
TWFyaywNCg0KSG9wZWZ1bGx5IHlvdSBoYXZlIHJlc29sdmVkIHlvdXIgc3R1Y2sgVk0gaXNzdWUg
Ynkgbm93IChuZWFybHkgdHdvIG1vbnRocyBsYXRlcikuIEkgY2FtZSBhY3Jvc3MgdGhpcyBlbWFp
bCBmcm9tIGEgZ29vZ2xlIHNlYXJjaC4gSSB3YXMgaGF2aW5nIHRoZSBzYW1lIGV4YWN0IHByb2Js
ZW0gd2l0aCBWTXMgYmVpbmcgc3R1Y2sgaW4gbWlncmF0aW9uIG1vZGUuIFRoZSB0cmlnZ2VyIHRv
IHRoZSBWTSBtaWdyYXRpb24gaXNzdWUgd2FzIHRoYXQgSSB3YXMgc2V0dGluZyBteSBIb3N0IGlu
dG8gbWFpbnRlbmFuY2UgbW9kZS4gSXQgbWlncmF0ZWQgaGFsZiBvZiB0aGUgYWN0aXZlIFZNcyBz
dWNjZXNzZnVsbHkgYW5kIHRoZSBvdGhlciBoYWxmIHdlcmUgc3R1Y2suDQoNClRoZXJlIHdlcmUg
dHdvIHRoaW5ncyBJIGhhZCB0byBkbyB0byBmaXggYWxsIG9mIG15IHN0dWNrIFZNczoNCjEuIEkg
c2h1dCBkb3duIHRoZSBob3N0IChsb25nIGVub3VnaCBmb3Igb1ZpcnQgdG8gZmVuY2UgaXQgYW5k
IG5vdGljZSB0aGF0IGl0IHdhcyBkb3duKS4gSSB0aGVuIHBvd2VyZWQgaXQgb24gYW5kICJjb25m
aXJtZWQgaG9zdCBhcyByZWJvb3RlZC4iIFRoaXMgcmVzZXQgdGhlIGFjdGl2ZSBWTSBjb3VudCBv
biB0aGUgaG9zdCBhbmQgdHVybmVkIG9uIG15IEhBIFZNcyBvbiBvdGhlciBob3N0cy4NCjIuIEZv
ciB0aGUgb25lIFZNIHRoYXQgd2FzIHN0aWxsIHN0dWNrIGFmdGVyIGEgaG9zdCByZWJvb3QsIEkg
aGFkIHRvIGxvZ2luIHRvIHBvc3RncmVzIGFuZCBzZXQgdGhlIHN0YXR1cyB0byAwIG9uIHRoYXQg
Vk0uIFRoaXMgYWxsb3dlZCBtZSB0byBzaHV0IGRvd24gdGhlIG1pZ3JhdGluZyBWTSBhbmQgc3Rh
cnQgaXQgYmFjayB1cC4gKEkgZG8gbm90IHRoaW5rIEkgd291bGQgaGF2ZSBoYWQgdG8gZG8gdGhp
cyBzdGVwIGlmIEkgZGlkIG5vdCBhbHRlciB0aGUgZGF0YWJhc2UgZW50cnkgZm9yIHRoaXMgVk0g
YmVmb3JlIHJlYm9vdGluZyB0aGUgaG9zdC4pDQoNCkZvciBzdGVwIDIsIEkgdXNlZCB0aGUgbWV0
aG9kcyBkZXNjcmliZWQgaGVyZTogaHR0cHM6Ly9hY2Nlc3MucmVkaGF0LmNvbS9kaXNjdXNzaW9u
cy82ODgwNDMgYW5kIGFzIHNlZW4gYmVsb3c6DQpzc2ggb3ZpcnQtZW5naW5lDQpzdSBwb3N0Z3Jl
cw0KcHNxbA0KXGNvbm5lY3QgZW5naW5lDQpTRUxFQ1Qgdm1fZ3VpZCBzdGF0dXMgRlJPTSB2bV9z
dGF0aWMgV0hFUkUgdm1fbmFtZT0nWFhYWCc7DQpVUERBVEUgdm1fZHluYW1pYyBTRVQgc3RhdHVz
PTAgV0hFUkUgdm1fZ3VpZD0neHh4eHh4eHgnOw0KVVBEQVRFIHZtX2R5bmFtaWMgU0VUIHJ1bl9v
bl92ZHMgPSBudWxsICBXSEVSRSB2bV9ndWlkPSd4eHh4eHh4eCc7DQpccQ0KKEkgd2FzIHRoZW4g
YWJsZSB0byBzaHV0IGRvd24gdGhlIFZNKQ0KDQotLQ0KQW5kcmV3IFdpcHBsZXIgPGFuZHJldy53
aXBwbGVyQGxhbmNhc3RlcmJhcHRpc3Qub3JnPiB8IFNyLiBTeXN0ZW1zIEFkbWluaXN0cmF0b3Ig
fCBMYW5jYXN0ZXIgQmFwdGlzdCBDaHVyY2gNCg0K
--_000_1459446496698619camellancasterbaptistorg_
Content-Type: text/html; charset="utf-8"
Content-ID: <EBC8BF3E930EF94CB7C2B17EA486CAD3(a)lancasterbaptist.org>
Content-Transfer-Encoding: base64
PGh0bWw+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIgY29udGVudD0i
dGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjwvaGVhZD4NCjxib2R5IHN0eWxlPSJ3b3JkLXdy
YXA6IGJyZWFrLXdvcmQ7IC13ZWJraXQtbmJzcC1tb2RlOiBzcGFjZTsgLXdlYmtpdC1saW5lLWJy
ZWFrOiBhZnRlci13aGl0ZS1zcGFjZTsiPg0KPGRpdj5NYXJrLDwvZGl2Pg0KPGRpdj48YnI+DQo8
L2Rpdj4NCjxkaXY+SG9wZWZ1bGx5IHlvdSBoYXZlIHJlc29sdmVkIHlvdXIgc3R1Y2sgVk0gaXNz
dWUgYnkgbm93IChuZWFybHkgdHdvIG1vbnRocyBsYXRlcikuIEkgY2FtZSBhY3Jvc3MgdGhpcyBl
bWFpbCBmcm9tIGEgZ29vZ2xlIHNlYXJjaC4gSSB3YXMgaGF2aW5nIHRoZSBzYW1lIGV4YWN0IHBy
b2JsZW0gd2l0aCBWTXMgYmVpbmcgc3R1Y2sgaW4gbWlncmF0aW9uIG1vZGUuIFRoZSB0cmlnZ2Vy
IHRvIHRoZSBWTSBtaWdyYXRpb24gaXNzdWUgd2FzIHRoYXQNCiBJIHdhcyBzZXR0aW5nIG15IEhv
c3QgaW50byBtYWludGVuYW5jZSBtb2RlLiBJdCBtaWdyYXRlZCBoYWxmIG9mIHRoZSBhY3RpdmUg
Vk1zIHN1Y2Nlc3NmdWxseSBhbmQgdGhlIG90aGVyIGhhbGYgd2VyZSBzdHVjay48L2Rpdj4NCjxk
aXY+PGJyPg0KPC9kaXY+DQo8ZGl2PlRoZXJlIHdlcmUgdHdvIHRoaW5ncyBJIGhhZCB0byBkbyB0
byBmaXggYWxsIG9mIG15IHN0dWNrIFZNczo8L2Rpdj4NCjxkaXY+MS4gSSBzaHV0IGRvd24gdGhl
IGhvc3QgKGxvbmcgZW5vdWdoIGZvciBvVmlydCB0byBmZW5jZSBpdCBhbmQgbm90aWNlIHRoYXQg
aXQgd2FzIGRvd24pLiBJIHRoZW4gcG93ZXJlZCBpdCBvbiBhbmQgJnF1b3Q7Y29uZmlybWVkIGhv
c3QgYXMgcmVib290ZWQuJnF1b3Q7IFRoaXMgcmVzZXQgdGhlIGFjdGl2ZSBWTSBjb3VudCBvbiB0
aGUgaG9zdCBhbmQgdHVybmVkIG9uIG15IEhBIFZNcyBvbiBvdGhlciBob3N0cy48L2Rpdj4NCjxk
aXY+Mi4gRm9yIHRoZSBvbmUgVk0gdGhhdCB3YXMgc3RpbGwgc3R1Y2sgYWZ0ZXIgYSBob3N0IHJl
Ym9vdCwgSSBoYWQgdG8gbG9naW4gdG8gcG9zdGdyZXMgYW5kIHNldCB0aGUgc3RhdHVzIHRvIDAg
b24gdGhhdCBWTS4gVGhpcyBhbGxvd2VkIG1lIHRvIHNodXQgZG93biB0aGUgbWlncmF0aW5nIFZN
IGFuZCBzdGFydCBpdCBiYWNrIHVwLiAoSSBkbyBub3QgdGhpbmsgSSB3b3VsZCBoYXZlIGhhZCB0
byBkbyB0aGlzIHN0ZXAgaWYgSSBkaWQgbm90DQogYWx0ZXIgdGhlIGRhdGFiYXNlIGVudHJ5IGZv
ciB0aGlzIFZNIGJlZm9yZSByZWJvb3RpbmcgdGhlIGhvc3QuKTwvZGl2Pg0KPGRpdj48YnI+DQo8
L2Rpdj4NCjxkaXY+Rm9yIHN0ZXAgMiwgSSB1c2VkIHRoZSBtZXRob2RzIGRlc2NyaWJlZCBoZXJl
OiZuYnNwOzxhIGhyZWY9Imh0dHBzOi8vYWNjZXNzLnJlZGhhdC5jb20vZGlzY3Vzc2lvbnMvNjg4
MDQzIj5odHRwczovL2FjY2Vzcy5yZWRoYXQuY29tL2Rpc2N1c3Npb25zLzY4ODA0MzwvYT4mbmJz
cDthbmQgYXMgc2VlbiBiZWxvdzo8L2Rpdj4NCjxkaXY+c3NoIG92aXJ0LWVuZ2luZTwvZGl2Pg0K
PGRpdj5zdSBwb3N0Z3JlczwvZGl2Pg0KPGRpdj5wc3FsPC9kaXY+DQo8ZGl2Plxjb25uZWN0IGVu
Z2luZTwvZGl2Pg0KPGRpdj5TRUxFQ1Qgdm1fZ3VpZCBzdGF0dXMgRlJPTSB2bV9zdGF0aWMgV0hF
UkUgdm1fbmFtZT0nWFhYWCc7PC9kaXY+DQo8ZGl2PlVQREFURSB2bV9keW5hbWljIFNFVCBzdGF0
dXM9MCBXSEVSRSB2bV9ndWlkPSd4eHh4eHh4eCc7PC9kaXY+DQo8ZGl2PlVQREFURSB2bV9keW5h
bWljIFNFVCBydW5fb25fdmRzID0gbnVsbCZuYnNwOyBXSEVSRSB2bV9ndWlkPSd4eHh4eHh4eCc7
PC9kaXY+DQo8ZGl2PlxxPC9kaXY+DQo8ZGl2PihJIHdhcyB0aGVuIGFibGUgdG8gc2h1dCBkb3du
IHRoZSBWTSk8L2Rpdj4NCjxkaXY+PGJyPg0KPC9kaXY+DQo8ZGl2PjxzcGFuPi0tIDxicj4NCkFu
ZHJldyBXaXBwbGVyICZsdDs8YSBocmVmPSJhbmRyZXcud2lwcGxlckBsYW5jYXN0ZXJiYXB0aXN0
Lm9yZyZndDsiPmFuZHJldy53aXBwbGVyQGxhbmNhc3RlcmJhcHRpc3Qub3JnJmd0OzwvYT4mbmJz
cDt8IFNyLiBTeXN0ZW1zIEFkbWluaXN0cmF0b3IgfCBMYW5jYXN0ZXIgQmFwdGlzdCBDaHVyY2g8
L3NwYW4+PC9kaXY+DQo8ZGl2Pjxicj4NCjwvZGl2Pg0KPC9ib2R5Pg0KPC9odG1sPg0K
--_000_1459446496698619camellancasterbaptistorg_--
4 a.m.
--Apple-Mail=_CB1BBFEC-A7A9-45F9-B3D1-80014558EFE2
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
charset=us-ascii
On 31 Mar 2016, at 19:48, Andrew Wippler =
<Andrew.Wippler(a)lancasterbaptist.org> wrote:
=20
Mark,
=20
Hopefully you have resolved your stuck VM issue by now (nearly two =
months later).
I came across this email from a google search. I was =
having the same exact problem with VMs being stuck in migration mode. =
The trigger to the VM migration issue was that I was setting my Host =
into maintenance mode. It migrated half of the active VMs successfully =
and the other half were stuck.
Hi,
It would be great to get logs from the system, or at least describe the =
specifics (anything special? gluster? old version?)
otherwise no one will ever be able to help;)
Thanks,
michal
=20
There were two things I had to do to fix all of my stuck VMs:
1. I shut down the host (long enough for oVirt to fence it and notice =
that it was
down). I then powered it on and "confirmed host as =
rebooted." This reset the active VM count on the host and turned on my =
HA VMs on other hosts.
2. For the one VM that was still stuck after a host reboot, I had to
=
login to postgres and set the status to 0 on that VM. This allowed me to =
shut down the migrating VM and start it back up. (I do not think I would =
have had to do this step if I did not alter the database entry for this =
VM before rebooting the host.)
=20
For step 2, I used the methods described here: =
https://access.redhat.com/discussions/688043 =
<https://access.redhat.com/discussions/688043> and as seen below:
ssh ovirt-engine
su postgres
psql
\connect engine
SELECT vm_guid status FROM vm_static WHERE vm_name=3D'XXXX';
UPDATE vm_dynamic SET status=3D0 WHERE vm_guid=3D'xxxxxxxx';
UPDATE vm_dynamic SET run_on_vds =3D null WHERE vm_guid=3D'xxxxxxxx';
\q
(I was then able to shut down the VM)
=20
--=20
Andrew Wippler <andrew.wippler(a)lancasterbaptist.org> =
<x-msg://533/andrew.wippler@lancasterbaptist.org%3E> | Sr. Systems =
Administrator | Lancaster Baptist Church
=20
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--Apple-Mail=_CB1BBFEC-A7A9-45F9-B3D1-80014558EFE2
Content-Transfer-Encoding: 7bit
Content-Type: text/html;
charset=us-ascii
<html><head><meta http-equiv="Content-Type"
content="text/html charset=us-ascii"></head><body
style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break:
after-white-space;" class=""><br
class=""><div><blockquote type="cite"
class=""><div class="">On 31 Mar 2016, at 19:48, Andrew
Wippler <<a href="mailto:Andrew.Wippler@lancasterbaptist.org"
class="">Andrew.Wippler(a)lancasterbaptist.org</a>&gt;
wrote:</div><br class="Apple-interchange-newline"><div
class="">
<meta http-equiv="Content-Type" content="text/html; charset=utf-8"
class="">
<div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break:
after-white-space;" class="">
<div class="">Mark,</div>
<div class=""><br class="">
</div>
<div class="">Hopefully you have resolved your stuck VM issue by now
(nearly two months later). I came across this email from a google search. I was having the
same exact problem with VMs being stuck in migration mode. The trigger to the VM migration
issue was that
I was setting my Host into maintenance mode. It migrated half of the active VMs
successfully and the other half were
stuck.</div></div></div></blockquote><div><br
class=""></div><div>Hi,</div>It would be great to get logs
from the system, or at least describe the specifics (anything special? gluster? old
version?)</div><div>otherwise no one will ever be able to
help;)</div><div><br
class=""></div><div>Thanks,</div><div>michal</div><div><br
class=""><blockquote type="cite" class=""><div
class=""><div style="word-wrap: break-word; -webkit-nbsp-mode: space;
-webkit-line-break: after-white-space;" class="">
<div class=""><br class="">
</div>
<div class="">There were two things I had to do to fix all of my stuck
VMs:</div>
<div class="">1. I shut down the host (long enough for oVirt to fence it
and notice that it was down). I then powered it on and "confirmed host as
rebooted." This reset the active VM count on the host and turned on my HA VMs on
other hosts.</div>
<div class="">2. For the one VM that was still stuck after a host reboot,
I had to login to postgres and set the status to 0 on that VM. This allowed me to shut
down the migrating VM and start it back up. (I do not think I would have had to do this
step if I did not
alter the database entry for this VM before rebooting the host.)</div>
<div class=""><br class="">
</div>
<div class="">For step 2, I used the methods described
here: <a href="https://access.redhat.com/discussions/688043"
class="">https://access.redhat.com/discussions/688043</a&...
as seen below:</div>
<div class="">ssh ovirt-engine</div>
<div class="">su postgres</div>
<div class="">psql</div>
<div class="">\connect engine</div>
<div class="">SELECT vm_guid status FROM vm_static WHERE
vm_name='XXXX';</div>
<div class="">UPDATE vm_dynamic SET status=0 WHERE
vm_guid='xxxxxxxx';</div>
<div class="">UPDATE vm_dynamic SET run_on_vds = null WHERE
vm_guid='xxxxxxxx';</div>
<div class="">\q</div>
<div class="">(I was then able to shut down the VM)</div>
<div class=""><br class="">
</div>
<div class=""><span class="">-- <br
class="">
Andrew Wippler <<a
href="x-msg://533/andrew.wippler@lancasterbaptist.org%3E"
class="">andrew.wippler(a)lancasterbaptist.org&gt;</a>&nbsp;| Sr.
Systems Administrator | Lancaster Baptist Church</span></div>
<div class=""><br class="">
</div>
</div>
_______________________________________________<br class="">Users mailing
list<br class=""><a href="mailto:Users@ovirt.org"
class="">Users(a)ovirt.org</a><br
class="">http://lists.ovirt.org/mailman/listinfo/users<br
class=""></div></blockquote></div><br
class=""></body></html>
--Apple-Mail=_CB1BBFEC-A7A9-45F9-B3D1-80014558EFE2--
2:11 p.m.
--_000_57bb811a2b934054bfb525ea35341e1czerah_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
I was in the process of upgrading from 3.5.5 to 3.6.4 when it happened. I a=
m sure there were version mismatches.
I think what generated this issue was that I edited the cluster the host be=
longed to while it was going down for maintenance. This caused the tasks ta=
b to show multiple tasks of the host going down for maintenance. They all e=
ventually went into en error state and the task kept repeating itself until=
I rebooted the host.
Andrew Wippler | Sr. Systems Administrator | Lancaster Baptist Church | Dr.=
Paul Chappell, Pastor
________________________________
From: Michal Skrivanek <michal.skrivanek(a)redhat.com Sent:
Friday, April 01, 2016 1:00 AM
To: Andrew Wippler
Cc: users(a)ovirt.org
Subject: Re: [ovirt-users] Several VM's stuck in Migration
On 31 Mar 2016, at 19:48, Andrew Wippler <Andrew.Wippler(a)lancasterbaptist.o=
rg<mailto:Andrew.Wippler@lancasterbaptist.org>> wrote:
Mark,
Hopefully you have resolved your stuck VM issue by now (nearly two months l=
ater). I came across this email from a google search. I was having the same=
exact problem with VMs being stuck in migration mode. The trigger to the V=
M migration issue was that I was setting my Host into maintenance mode. It =
migrated half of the active VMs successfully and the other half were stuck.
Hi,
It would be great to get logs from the system, or at least describe the spe=
cifics (anything special? gluster? old version?)
otherwise no one will ever be able to help;)
Thanks,
michal
There were two things I had to do to fix all of my stuck VMs:
1. I shut down the host (long enough for oVirt to fence it and notice that =
it was down). I then powered it on and "confirmed host as rebooted." This r=
eset the active VM count on the host and turned on my HA VMs on other hosts=
.
2. For the one VM that was still stuck after a host reboot, I had to login =
to postgres and set the status to 0 on that VM. This allowed me to shut dow=
n the migrating VM and start it back up. (I do not think I would have had t=
o do this step if I did not alter the database entry for this VM before reb=
ooting the host.)
For step 2, I used the methods described here: https://access.redhat.com/di=
scussions/688043 and as seen below:
ssh ovirt-engine
su postgres
psql
\connect engine
SELECT vm_guid status FROM vm_static WHERE vm_name=3D'XXXX';
UPDATE vm_dynamic SET status=3D0 WHERE vm_guid=3D'xxxxxxxx';
UPDATE vm_dynamic SET run_on_vds =3D null WHERE vm_guid=3D'xxxxxxxx';
\q
(I was then able to shut down the VM)
--
Andrew Wippler <andrew.wippler(a)lancasterbaptist.org> | Sr. Systems Administ=
rator | Lancaster Baptist Church
_______________________________________________
Users mailing list
Users@ovirt.org<mailto:Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--_000_57bb811a2b934054bfb525ea35341e1czerah_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
<html <head <meta http-equiv=3D"Content-Type"
content=3D"text/html; charset=3Dus-ascii"=
<style id=3D"owaParaStyle"
type=3D"text/css" style=3D"">=0A=
<!--=0A=
p=0A=
{margin-top:0;=0A=
margin-bottom:0}=0A=
-->=0A=
P {margin-top:0;margin-bottom:0;}</style
</head <body aria-label=3D"Message
body" fpstyle=3D"1" tabindex=3D"0" dir=3D"ltr" <div name=3D"divtagdefaultwrapper"
id=3D"divtagdefaultwrapper" style=3D"fon=
t-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:#000000;=
margin:0" I was in the process of upgrading
from 3.5.5 to 3.6.4 when it happened. I a=
m sure there were version mismatches.<br
<br I think what generated this issue
was that I edited the cluster the host be=
longed to while it was going down for maintenance. This caused the tasks ta=
b to show multiple tasks of the host going down for maintenance. They all e=
ventually went into en error state
and the task kept repeating itself until I rebooted the host.<br <div><br <div
name=3D"divtagdefaultwrapper" style=3D"font-family:Calibri,Arial,Helve=
tica,sans-serif; font-size:; margin:0" Andrew
Wippler | Sr. Systems Administrator | Lancaster Baptist Church | Dr.=
Paul Chappell, Pastor</div </div <br <div
style=3D"color:rgb(40,40,40)" <hr
tabindex=3D"-1" style=3D"display:inline-block; width:98%" <div id=3D"divRplyFwdMsg"
dir=3D"ltr"><font style=3D"font-size:11pt" face=
=3D"Calibri, sans-serif" color=3D"#000000"><b>From:</b>
Michal Skrivanek &l=
t;michal.skrivanek(a)redhat.com&gt;<br
<b>Sent:</b> Friday, April 01, 2016 1:00 AM<br <b>To:</b> Andrew Wippler<br <b>Cc:</b> users(a)ovirt.org<br <b>Subject:</b> Re: [ovirt-users] Several VM's
stuck in Migration</font <div> </div </div
<div><br class=3D""
<div <blockquote
type=3D"cite" class=3D"" <div
class=3D"">On 31 Mar 2016, at 19:48, Andrew Wippler <<a
href=3D"mai=
lto:Andrew.Wippler@lancasterbaptist.org"
class=3D"">Andrew.Wippler@lancaste=
rbaptist.org</a>> wrote:</div <br
class=3D"Apple-interchange-newline" <div
class=3D"" <div class=3D""
style=3D"word-wrap:break-word" <div
class=3D"">Mark,</div <div
class=3D""><br class=3D""
</div <div
class=3D"">Hopefully you have resolved your stuck VM issue by now (nea=
rly two months later). I came across this email from a google search. I was=
having the same exact problem with VMs being stuck in migration mode. The =
trigger to the VM migration issue
was that I was setting my Host into maintenance mode. It migrated half of =
the active VMs successfully and the other half were stuck.</div </div
</div </blockquote <div><br class=3D"" </div
<div>Hi,</div It would be great to get logs from
the system, or at least describe the spe=
cifics (anything special? gluster? old version?)</div
<div>otherwise no one will ever be able to help;)</div <div><br class=3D"" </div
<div>Thanks,</div <div>michal</div <div><br class=3D"" <blockquote type=3D"cite" class=3D"" <div class=3D"" <div
class=3D"" style=3D"word-wrap:break-word" <div
class=3D""><br class=3D""
</div <div
class=3D"">There were two things I had to do to fix all of my stuck VM=
s:</div <div class=3D"">1. I
shut down the host (long enough for oVirt to fence it =
and notice that it was down). I then powered it on and "confirmed host=
as rebooted." This reset the active VM count on the host and turned o=
n my HA VMs on other hosts.</div <div
class=3D"">2. For the one VM that was still stuck after a host reboot,=
I had to login to postgres and set the status to 0 on that VM. This allowe=
d me to shut down the migrating VM and start it back up. (I do not think I =
would have had to do this step if
I did not alter the database entry for this VM before rebooting the host.)=
</div <div
class=3D""><br class=3D""
</div <div class=3D"">For
step 2, I used the methods described here: <a href=
=3D"https://access.redhat.com/discussions/688043"
class=3D"">https://access=
.redhat.com/discussions/688043</a> and as seen below:</div <div class=3D"">ssh ovirt-engine</div <div class=3D"">su postgres</div <div class=3D"">psql</div <div class=3D"">\connect engine</div <div class=3D"">SELECT vm_guid status FROM
vm_static WHERE vm_name=3D'XXXX'=
;</div <div
class=3D"">UPDATE vm_dynamic SET status=3D0 WHERE
vm_guid=3D'xxxxxxxx'=
;</div <div
class=3D"">UPDATE vm_dynamic SET run_on_vds =3D null WHERE vm_gu=
id=3D'xxxxxxxx';</div <div
class=3D"">\q</div <div class=3D"">(I
was then able to shut down the VM)</div <div
class=3D""><br class=3D""
</div <div
class=3D""><span class=3D"">-- <br
class=3D"" Andrew Wippler <<a
href=3D"" class=3D"">andrew.wippler(a)lancasterbaptist.=
org></a> | Sr. Systems Administrator | Lancaster Baptist
Church</sp=
an></div <div
class=3D""><br class=3D""
</div </div _______________________________________________<br
class=3D"" Users mailing list<br
class=3D"" <a
href=3D"mailto:Users@ovirt.org"
class=3D"">Users(a)ovirt.org</a><br class=
=3D""
http://lists.ovirt.org/mailman/listinfo/users<br class=3D"" </div
</blockquote </div <br class=3D""
</div </div </div
</body </html
--_000_57bb811a2b934054bfb525ea35341e1czerah_--
3191
days inactive
3249
days old
3 comments
3 participants
participants (3)
-
Andrew Wippler -
Mark Steele -
Michal Skrivanek