From jhorne at skopos.us Tue Jan 8 15:15:38 2013 Content-Type: multipart/mixed; boundary="===============1789140503645414341==" MIME-Version: 1.0 From: Jonathan Horne To: users at ovirt.org Subject: [Users] ovirt 3.2 migrations failing Date: Tue, 08 Jan 2013 20:15:34 +0000 Message-ID: <9BE6F493F83A594DA60C45E6A09DC5AC0170B5FC@AUSP01DAG0201.collaborationhost.net> --===============1789140503645414341== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable --_000_9BE6F493F83A594DA60C45E6A09DC5AC0170B5FCAUSP01DAG0201co_ Content-Type: text/plain; charset=3D"us-ascii" Content-Transfer-Encoding: quoted-printable i just built up 2 nodes and a manager on 3.2 dreyou packages, and now that = =3D i have a VM up and installed with rhev agent, the VM is unable to migrate. = =3D the failure is pretty much immediate. i don't know where to begin troubleshooting this, can someone help me get g= =3D oing in the right direction? just let me know what logs are appropriate an= =3D d i will post them up. thanks, jonathan ________________________________ This is a PRIVATE message. If you are not the intended recipient, please de= =3D lete without copying and kindly advise us by e-mail of the mistake in deliv= =3D ery. NOTE: Regardless of content, this e-mail shall not operate to bind SKO= =3D POS to any order or other contract unless pursuant to explicit written agre= =3D ement or government initiative expressly permitting the use of e-mail for s= =3D uch purpose. --_000_9BE6F493F83A594DA60C45E6A09DC5AC0170B5FCAUSP01DAG0201co_ Content-Type: text/html; charset=3D"us-ascii" Content-ID: <800473489CC37140A49FAFFF2819AE02(a)collaborationhost.net> Content-Transfer-Encoding: quoted-printable

i just built up 2 nodes and a manager on 3.2 dreyou packages, and now = =3D that i have a VM up and installed with rhev agent, the VM is unable to migr= =3D ate. the failure is pretty much immediate.

i don't know where to begin troubleshooting this, can someone help me = =3D get going in the right direction? just let me know what logs are appr= =3D opriate and i will post them up.

thanks,

jonathan

so far i se= e =3D this, and it looks related:

Traceback (most recent call last):

File "/usr/share/vdsm/vm.py", line 676, in _startUnde= =3D rlyingVm

self._waitForIncomingMigrationFinish()

File "/usr/share/vdsm/libvirtvm.py", line 1757, in _w= =3D aitForIncomingMigrationFinish

self._connection.lookupByUUIDString(self.id),

File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconne= =3D ction.py", line 111, in wrapper

ret =3D3D f(*args, **kwargs)

File "/usr/lib64/python2.6/site-packages/libvirt.py",= =3D line 2682, in lookupByUUIDString

if ret is None:raise libvirtError('virDomainLookupByUUID= =3D String() failed', conn=3D3Dself)

libvirtError: Domain not found: no domain with matching uuid '063c7cbe= =3D -c569-4df3-b9a7-6474c41d797e'

From: Jonathan Horne <jhorne(a)skopos.us>
Date: Tuesday, January 8, 2013 2:= 15=3D PM
To: "users(a)ovirt.org" <=3D users(a)ovirt.org>
Subject: [Users] ovirt 3.2 migrat= io=3D ns failing

i just built up 2 nodes and a manager on 3.2 dreyou packages, and now = =3D that i have a VM up and installed with rhev agent, the VM is unable to migr= =3D ate. the failure is pretty much immediate.

i don't know where to begin troubleshooting this, can someone help me = =3D get going in the right direction? just let me know what logs are appr= =3D opriate and i will post them up.

thanks,

jonathan

This is a PRIVATE mess= age. I=3D f you are not the intended recipient, please delete without copying and kin= =3D dly advise us by e-mail of the mistake in delivery. NOTE: Regardless of con= =3D tent, this e-mail shall not operate to bind SKOPOS to any order or other contract unless pursuant to explicit wri= =3D tten agreement or government initiative expressly permitting the use of e-m= =3D ail for such purpose. --_000_9BE6F493F83A594DA60C45E6A09DC5AC0170B664AUSP01DAG0201co_-- --===============4835059494151170391== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS1fMDAwXzlCRTZGNDkzRjgzQTU5NERBNjBDNDVFNkEwOURDNUFDMDE3MEI2NjRBVVNQMDFEQUcw MjAxY29fCkNvbnRlbnQtVHlwZTogdGV4dC9wbGFpbjsgY2hhcnNldD0idXMtYXNjaWkiCkNvbnRl bnQtVHJhbnNmZXItRW5jb2Rpbmc6IHF1b3RlZC1wcmludGFibGUKCnNvIGZhciBpIHNlZSB0aGlz LCBhbmQgaXQgbG9va3MgcmVsYXRlZDoKClRyYWNlYmFjayAobW9zdCByZWNlbnQgY2FsbCBsYXN0 KToKICBGaWxlICIvdXNyL3NoYXJlL3Zkc20vdm0ucHkiLCBsaW5lIDY3NiwgaW4gX3N0YXJ0VW5k ZXJseWluZ1ZtCiAgICBzZWxmLl93YWl0Rm9ySW5jb21pbmdNaWdyYXRpb25GaW5pc2goKQogIEZp bGUgIi91c3Ivc2hhcmUvdmRzbS9saWJ2aXJ0dm0ucHkiLCBsaW5lIDE3NTcsIGluIF93YWl0Rm9y SW5jb21pbmdNaWdyYXQ9CmlvbkZpbmlzaAogICAgc2VsZi5fY29ubmVjdGlvbi5sb29rdXBCeVVV SURTdHJpbmcoc2VsZi5pZCksCiAgRmlsZSAiL3Vzci9saWI2NC9weXRob24yLjYvc2l0ZS1wYWNr YWdlcy92ZHNtL2xpYnZpcnRjb25uZWN0aW9uLnB5IiwgbGluZT0KIDExMSwgaW4gd3JhcHBlcgog ICAgcmV0ID0zRCBmKCphcmdzLCAqKmt3YXJncykKICBGaWxlICIvdXNyL2xpYjY0L3B5dGhvbjIu Ni9zaXRlLXBhY2thZ2VzL2xpYnZpcnQucHkiLCBsaW5lIDI2ODIsIGluIGxvb2t1PQpwQnlVVUlE U3RyaW5nCiAgICBpZiByZXQgaXMgTm9uZTpyYWlzZSBsaWJ2aXJ0RXJyb3IoJ3ZpckRvbWFpbkxv b2t1cEJ5VVVJRFN0cmluZygpIGZhaWxlZD0KJywgY29ubj0zRHNlbGYpCmxpYnZpcnRFcnJvcjog RG9tYWluIG5vdCBmb3VuZDogbm8gZG9tYWluIHdpdGggbWF0Y2hpbmcgdXVpZCAnMDYzYzdjYmUt YzU2OT0KLTRkZjMtYjlhNy02NDc0YzQxZDc5N2UnCgpGcm9tOiBKb25hdGhhbiBIb3JuZSA8amhv cm5lQHNrb3Bvcy51czxtYWlsdG86amhvcm5lQHNrb3Bvcy51cz4+CkRhdGU6IFR1ZXNkYXksIEph bnVhcnkgOCwgMjAxMyAyOjE1IFBNClRvOiAidXNlcnNAb3ZpcnQub3JnPG1haWx0bzp1c2Vyc0Bv dmlydC5vcmc+IiA8dXNlcnNAb3ZpcnQub3JnPG1haWx0bzp1c2Vycz0KQG92aXJ0Lm9yZz4+ClN1 YmplY3Q6IFtVc2Vyc10gb3ZpcnQgMy4yIG1pZ3JhdGlvbnMgZmFpbGluZwoKaSBqdXN0IGJ1aWx0 IHVwIDIgbm9kZXMgYW5kIGEgbWFuYWdlciBvbiAzLjIgZHJleW91IHBhY2thZ2VzLCBhbmQgbm93 IHRoYXQgPQppIGhhdmUgYSBWTSB1cCBhbmQgaW5zdGFsbGVkIHdpdGggcmhldiBhZ2VudCwgdGhl IFZNIGlzIHVuYWJsZSB0byBtaWdyYXRlLiA9CnRoZSBmYWlsdXJlIGlzIHByZXR0eSBtdWNoIGlt bWVkaWF0ZS4KCmkgZG9uJ3Qga25vdyB3aGVyZSB0byBiZWdpbiB0cm91Ymxlc2hvb3RpbmcgdGhp cywgY2FuIHNvbWVvbmUgaGVscCBtZSBnZXQgZz0Kb2luZyBpbiB0aGUgcmlnaHQgZGlyZWN0aW9u PyAganVzdCBsZXQgbWUga25vdyB3aGF0IGxvZ3MgYXJlIGFwcHJvcHJpYXRlIGFuPQpkIGkgd2ls bCBwb3N0IHRoZW0gdXAuCgp0aGFua3MsCmpvbmF0aGFuCgpfX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fXwpUaGlzIGlzIGEgUFJJVkFURSBtZXNzYWdlLiBJZiB5b3UgYXJlIG5vdCB0aGUg aW50ZW5kZWQgcmVjaXBpZW50LCBwbGVhc2UgZGU9CmxldGUgd2l0aG91dCBjb3B5aW5nIGFuZCBr aW5kbHkgYWR2aXNlIHVzIGJ5IGUtbWFpbCBvZiB0aGUgbWlzdGFrZSBpbiBkZWxpdj0KZXJ5LiBO T1RFOiBSZWdhcmRsZXNzIG9mIGNvbnRlbnQsIHRoaXMgZS1tYWlsIHNoYWxsIG5vdCBvcGVyYXRl IHRvIGJpbmQgU0tPPQpQT1MgdG8gYW55IG9yZGVyIG9yIG90aGVyIGNvbnRyYWN0IHVubGVzcyBw dXJzdWFudCB0byBleHBsaWNpdCB3cml0dGVuIGFncmU9CmVtZW50IG9yIGdvdmVybm1lbnQgaW5p dGlhdGl2ZSBleHByZXNzbHkgcGVybWl0dGluZyB0aGUgdXNlIG9mIGUtbWFpbCBmb3Igcz0KdWNo IHB1cnBvc2UuCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpUaGlzIGlzIGEgUFJJ VkFURSBtZXNzYWdlLiBJZiB5b3UgYXJlIG5vdCB0aGUgaW50ZW5kZWQgcmVjaXBpZW50LCBwbGVh c2UgZGU9CmxldGUgd2l0aG91dCBjb3B5aW5nIGFuZCBraW5kbHkgYWR2aXNlIHVzIGJ5IGUtbWFp bCBvZiB0aGUgbWlzdGFrZSBpbiBkZWxpdj0KZXJ5LiBOT1RFOiBSZWdhcmRsZXNzIG9mIGNvbnRl bnQsIHRoaXMgZS1tYWlsIHNoYWxsIG5vdCBvcGVyYXRlIHRvIGJpbmQgU0tPPQpQT1MgdG8gYW55 IG9yZGVyIG9yIG90aGVyIGNvbnRyYWN0IHVubGVzcyBwdXJzdWFudCB0byBleHBsaWNpdCB3cml0 dGVuIGFncmU9CmVtZW50IG9yIGdvdmVybm1lbnQgaW5pdGlhdGl2ZSBleHByZXNzbHkgcGVybWl0 dGluZyB0aGUgdXNlIG9mIGUtbWFpbCBmb3Igcz0KdWNoIHB1cnBvc2UuCgotLV8wMDBfOUJFNkY0 OTNGODNBNTk0REE2MEM0NUU2QTA5REM1QUMwMTcwQjY2NEFVU1AwMURBRzAyMDFjb18KQ29udGVu dC1UeXBlOiB0ZXh0L2h0bWw7IGNoYXJzZXQ9InVzLWFzY2lpIgpDb250ZW50LUlEOiA8NkE0QTFG NDhEQzY5NzA0NkI4OTVENjY3MDRDNTAyRDBAY29sbGFib3JhdGlvbmhvc3QubmV0PgpDb250ZW50 LVRyYW5zZmVyLUVuY29kaW5nOiBxdW90ZWQtcHJpbnRhYmxlCgo8aHRtbD4KPGhlYWQ+CjxtZXRh IGh0dHAtZXF1aXY9M0QiQ29udGVudC1UeXBlIiBjb250ZW50PTNEInRleHQvaHRtbDsgY2hhcnNl dD0zRHVzLWFzY2lpIj0KPgo8L2hlYWQ+Cjxib2R5IHN0eWxlPTNEIndvcmQtd3JhcDpicmVhay13 b3JkOyBjb2xvcjpyZ2IoMCwwLDApIj4KPGRpdj4KPGRpdj4KPGRpdiBzdHlsZT0zRCJmb250LWZh bWlseTpDYWxpYnJpLHNhbnMtc2VyaWY7IGZvbnQtc2l6ZToxNHB4Ij5zbyBmYXIgaSBzZWUgPQp0 aGlzLCBhbmQgaXQgbG9va3MgcmVsYXRlZDo8L2Rpdj4KPGRpdiBzdHlsZT0zRCJmb250LWZhbWls eTpDYWxpYnJpLHNhbnMtc2VyaWY7IGZvbnQtc2l6ZToxNHB4Ij48YnI+CjwvZGl2Pgo8ZGl2IHN0 eWxlPTNEImZvbnQtZmFtaWx5OkNhbGlicmksc2Fucy1zZXJpZjsgZm9udC1zaXplOjE0cHgiPgo8 ZGl2PlRyYWNlYmFjayAobW9zdCByZWNlbnQgY2FsbCBsYXN0KTo8L2Rpdj4KPGRpdj4mbmJzcDsg RmlsZSAmcXVvdDsvdXNyL3NoYXJlL3Zkc20vdm0ucHkmcXVvdDssIGxpbmUgNjc2LCBpbiBfc3Rh cnRVbmRlPQpybHlpbmdWbTwvZGl2Pgo8ZGl2PiZuYnNwOyAmbmJzcDsgc2VsZi5fd2FpdEZvcklu Y29taW5nTWlncmF0aW9uRmluaXNoKCk8L2Rpdj4KPGRpdj4mbmJzcDsgRmlsZSAmcXVvdDsvdXNy L3NoYXJlL3Zkc20vbGlidmlydHZtLnB5JnF1b3Q7LCBsaW5lIDE3NTcsIGluIF93PQphaXRGb3JJ bmNvbWluZ01pZ3JhdGlvbkZpbmlzaDwvZGl2Pgo8ZGl2PiZuYnNwOyAmbmJzcDsgc2VsZi5fY29u bmVjdGlvbi5sb29rdXBCeVVVSURTdHJpbmcoc2VsZi5pZCksPC9kaXY+CjxkaXY+Jm5ic3A7IEZp bGUgJnF1b3Q7L3Vzci9saWI2NC9weXRob24yLjYvc2l0ZS1wYWNrYWdlcy92ZHNtL2xpYnZpcnRj b25uZT0KY3Rpb24ucHkmcXVvdDssIGxpbmUgMTExLCBpbiB3cmFwcGVyPC9kaXY+CjxkaXY+Jm5i c3A7ICZuYnNwOyByZXQgPTNEIGYoKmFyZ3MsICoqa3dhcmdzKTwvZGl2Pgo8ZGl2PiZuYnNwOyBG aWxlICZxdW90Oy91c3IvbGliNjQvcHl0aG9uMi42L3NpdGUtcGFja2FnZXMvbGlidmlydC5weSZx dW90Oyw9CiBsaW5lIDI2ODIsIGluIGxvb2t1cEJ5VVVJRFN0cmluZzwvZGl2Pgo8ZGl2PiZuYnNw OyAmbmJzcDsgaWYgcmV0IGlzIE5vbmU6cmFpc2UgbGlidmlydEVycm9yKCd2aXJEb21haW5Mb29r dXBCeVVVSUQ9ClN0cmluZygpIGZhaWxlZCcsIGNvbm49M0RzZWxmKTwvZGl2Pgo8ZGl2PmxpYnZp cnRFcnJvcjogRG9tYWluIG5vdCBmb3VuZDogbm8gZG9tYWluIHdpdGggbWF0Y2hpbmcgdXVpZCAn MDYzYzdjYmU9Ci1jNTY5LTRkZjMtYjlhNy02NDc0YzQxZDc5N2UnPC9kaXY+CjwvZGl2Pgo8ZGl2 Pgo8ZGl2Pgo8ZGl2IHN0eWxlPTNEImZvbnQtZmFtaWx5OkNhbGlicmksc2Fucy1zZXJpZjsgZm9u dC1zaXplOjE0cHgiPjwvZGl2Pgo8ZGl2Pjxmb250IGNsYXNzPTNEIkFwcGxlLXN0eWxlLXNwYW4i IGZhY2U9M0QiVGltZXMiPjxzcGFuIGNsYXNzPTNEIkFwcGxlLXM9CnR5bGUtc3BhbiIgc3R5bGU9 M0QiIj48YnI+Cjwvc3Bhbj48L2ZvbnQ+PC9kaXY+CjwvZGl2Pgo8L2Rpdj4KPC9kaXY+CjwvZGl2 Pgo8c3BhbiBpZD0zRCJPTEtfU1JDX0JPRFlfU0VDVElPTiIgc3R5bGU9M0QiZm9udC1zaXplOjE0 cHg7IGZvbnQtZmFtaWx5OkNhbGk9CmJyaSxzYW5zLXNlcmlmIj4KPGRpdiBzdHlsZT0zRCJmb250 LWZhbWlseTpDYWxpYnJpOyBmb250LXNpemU6MTFwdDsgdGV4dC1hbGlnbjpsZWZ0OyBjb2xvcjpi PQpsYWNrOyBib3JkZXItYm90dG9tOm1lZGl1bSBub25lOyBib3JkZXItbGVmdDptZWRpdW0gbm9u ZTsgcGFkZGluZy1ib3R0b206MGk9Cm47IHBhZGRpbmctbGVmdDowaW47IHBhZGRpbmctcmlnaHQ6 MGluOyBib3JkZXItdG9wOiNiNWM0ZGYgMXB0IHNvbGlkOyBib3JkZT0Kci1yaWdodDptZWRpdW0g bm9uZTsgcGFkZGluZy10b3A6M3B0Ij4KPHNwYW4gc3R5bGU9M0QiZm9udC13ZWlnaHQ6Ym9sZCI+ RnJvbTogPC9zcGFuPkpvbmF0aGFuIEhvcm5lICZsdDs8YSBocmVmPTNEPQoibWFpbHRvOmpob3Ju ZUBza29wb3MudXMiPmpob3JuZUBza29wb3MudXM8L2E+Jmd0Ozxicj4KPHNwYW4gc3R5bGU9M0Qi Zm9udC13ZWlnaHQ6Ym9sZCI+RGF0ZTogPC9zcGFuPlR1ZXNkYXksIEphbnVhcnkgOCwgMjAxMyAy OjE1PQogUE08YnI+CjxzcGFuIHN0eWxlPTNEImZvbnQtd2VpZ2h0OmJvbGQiPlRvOiA8L3NwYW4+ JnF1b3Q7PGEgaHJlZj0zRCJtYWlsdG86dXNlcnNAbz0KdmlydC5vcmciPnVzZXJzQG92aXJ0Lm9y ZzwvYT4mcXVvdDsgJmx0OzxhIGhyZWY9M0QibWFpbHRvOnVzZXJzQG92aXJ0Lm9yZyI+PQp1c2Vy c0BvdmlydC5vcmc8L2E+Jmd0Ozxicj4KPHNwYW4gc3R5bGU9M0QiZm9udC13ZWlnaHQ6Ym9sZCI+ U3ViamVjdDogPC9zcGFuPltVc2Vyc10gb3ZpcnQgMy4yIG1pZ3JhdGlvPQpucyBmYWlsaW5nPGJy Pgo8L2Rpdj4KPGRpdj48YnI+CjwvZGl2Pgo8ZGl2Pgo8ZGl2IHN0eWxlPTNEIndvcmQtd3JhcDpi cmVhay13b3JkOyBjb2xvcjpyZ2IoMCwwLDApOyBmb250LXNpemU6MTRweDsgZm9udC09CmZhbWls eTpDYWxpYnJpLHNhbnMtc2VyaWYiPgo8ZGl2Pgo8ZGl2Pgo8ZGl2PmkganVzdCBidWlsdCB1cCAy IG5vZGVzIGFuZCBhIG1hbmFnZXIgb24gMy4yIGRyZXlvdSBwYWNrYWdlcywgYW5kIG5vdyA9CnRo YXQgaSBoYXZlIGEgVk0gdXAgYW5kIGluc3RhbGxlZCB3aXRoIHJoZXYgYWdlbnQsIHRoZSBWTSBp cyB1bmFibGUgdG8gbWlncj0KYXRlLiB0aGUgZmFpbHVyZSBpcyBwcmV0dHkgbXVjaCBpbW1lZGlh dGUuPC9kaXY+CjxkaXY+PGJyPgo8L2Rpdj4KPGRpdj5pIGRvbid0IGtub3cgd2hlcmUgdG8gYmVn aW4gdHJvdWJsZXNob290aW5nIHRoaXMsIGNhbiBzb21lb25lIGhlbHAgbWUgPQpnZXQgZ29pbmcg aW4gdGhlIHJpZ2h0IGRpcmVjdGlvbj8gJm5ic3A7anVzdCBsZXQgbWUga25vdyB3aGF0IGxvZ3Mg YXJlIGFwcHI9Cm9wcmlhdGUgYW5kIGkgd2lsbCBwb3N0IHRoZW0gdXAuPC9kaXY+CjxkaXY+PGJy Pgo8L2Rpdj4KPGRpdj50aGFua3MsPC9kaXY+CjxkaXY+am9uYXRoYW48L2Rpdj4KPGRpdj4KPGRp dj48L2Rpdj4KPC9kaXY+CjwvZGl2Pgo8L2Rpdj4KPGJyPgo8aHI+Cjxmb250IGNvbG9yPTNEIkdy YXkiIGZhY2U9M0QiQXJpYWwiIHNpemU9M0QiMSI+VGhpcyBpcyBhIFBSSVZBVEUgbWVzc2FnZS4g ST0KZiB5b3UgYXJlIG5vdCB0aGUgaW50ZW5kZWQgcmVjaXBpZW50LCBwbGVhc2UgZGVsZXRlIHdp dGhvdXQgY29weWluZyBhbmQga2luPQpkbHkgYWR2aXNlIHVzIGJ5IGUtbWFpbCBvZiB0aGUgbWlz dGFrZSBpbiBkZWxpdmVyeS4gTk9URTogUmVnYXJkbGVzcyBvZiBjb249CnRlbnQsIHRoaXMgZS1t YWlsIHNoYWxsIG5vdCBvcGVyYXRlIHRvCiBiaW5kIFNLT1BPUyB0byBhbnkgb3JkZXIgb3Igb3Ro ZXIgY29udHJhY3QgdW5sZXNzIHB1cnN1YW50IHRvIGV4cGxpY2l0IHdyaT0KdHRlbiBhZ3JlZW1l bnQgb3IgZ292ZXJubWVudCBpbml0aWF0aXZlIGV4cHJlc3NseSBwZXJtaXR0aW5nIHRoZSB1c2Ug b2YgZS1tPQphaWwgZm9yIHN1Y2ggcHVycG9zZS48L2ZvbnQ+PC9kaXY+CjwvZGl2Pgo8L3NwYW4+ PGJyPgo8aHI+Cjxmb250IGNvbG9yPTNEIkdyYXkiIGZhY2U9M0QiQXJpYWwiIHNpemU9M0QiMSI+ VGhpcyBpcyBhIFBSSVZBVEUgbWVzc2FnZS4gST0KZiB5b3UgYXJlIG5vdCB0aGUgaW50ZW5kZWQg cmVjaXBpZW50LCBwbGVhc2UgZGVsZXRlIHdpdGhvdXQgY29weWluZyBhbmQga2luPQpkbHkgYWR2 aXNlIHVzIGJ5IGUtbWFpbCBvZiB0aGUgbWlzdGFrZSBpbiBkZWxpdmVyeS4gTk9URTogUmVnYXJk bGVzcyBvZiBjb249CnRlbnQsIHRoaXMgZS1tYWlsIHNoYWxsIG5vdCBvcGVyYXRlIHRvCiBiaW5k IFNLT1BPUyB0byBhbnkgb3JkZXIgb3Igb3RoZXIgY29udHJhY3QgdW5sZXNzIHB1cnN1YW50IHRv IGV4cGxpY2l0IHdyaT0KdHRlbiBhZ3JlZW1lbnQgb3IgZ292ZXJubWVudCBpbml0aWF0aXZlIGV4 cHJlc3NseSBwZXJtaXR0aW5nIHRoZSB1c2Ugb2YgZS1tPQphaWwgZm9yIHN1Y2ggcHVycG9zZS48 L2ZvbnQ+CjwvYm9keT4KPC9odG1sPgoKLS1fMDAwXzlCRTZGNDkzRjgzQTU5NERBNjBDNDVFNkEw OURDNUFDMDE3MEI2NjRBVVNQMDFEQUcwMjAxY29fLS0K --===============4835059494151170391==-- From hateya at redhat.com Wed Jan 9 02:18:57 2013 Content-Type: multipart/mixed; boundary="===============8428523927417080004==" MIME-Version: 1.0 From: Haim Ateya To: users at ovirt.org Subject: Re: [Users] ovirt 3.2 migrations failing Date: Wed, 09 Jan 2013 02:18:57 -0500 Message-ID: <1509659766.1883463.1357715937179.JavaMail.root@redhat.com> In-Reply-To: 9BE6F493F83A594DA60C45E6A09DC5AC0170B664@AUSP01DAG0201.collaborationhost.net --===============8428523927417080004== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable ----- Original Message ----- > From: "Jonathan Horne" > To: "Jonathan Horne" , users(a)ovirt.org > Sent: Tuesday, January 8, 2013 10:26:52 PM > Subject: Re: [Users] ovirt 3.2 migrations failing > = > = > = > = > = > so far i see this, and it looks related: this only means libvirt can't find the guest on the host, was it on source = or destination? please run the following: on source server: - egrep 'vmMigrate|_setupVdsConnection' /var/log/vdsm/vdsm.log = - then, from output, get the Thread number of both commands and run grep ag= ain: - egrep 'Thread-$x|Thread-$y' /var/log/vdsm/vdsm.log on destination server: - egrep 'vmMigrationCreate|prepareImage' /var/log/vdsm/vdsm.log - then, from output, get the Thread number of both commands and run grep ag= ain: - egrep 'Thread-$x|Thread-$y' /var/log/vdsm/vdsm.log please paste it here. Haim > = > = > = > Traceback (most recent call last): > File "/usr/share/vdsm/vm.py", line 676, in _startUnderlyingVm > self._waitForIncomingMigrationFinish() > File "/usr/share/vdsm/libvirtvm.py", line 1757, in > _waitForIncomingMigrationFinish > self._connection.lookupByUUIDString(self.id), > File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", > line 111, in wrapper > ret =3D f(*args, **kwargs) > File "/usr/lib64/python2.6/site-packages/libvirt.py", line 2682, in > lookupByUUIDString > if ret is None:raise libvirtError('virDomainLookupByUUIDString() > failed', conn=3Dself) > libvirtError: Domain not found: no domain with matching uuid > '063c7cbe-c569-4df3-b9a7-6474c41d797e' > = > = > = > = > = > From: Jonathan Horne < jhorne(a)skopos.us > > Date: Tuesday, January 8, 2013 2:15 PM > To: " users(a)ovirt.org " < users(a)ovirt.org > > Subject: [Users] ovirt 3.2 migrations failing > = > = > = > = > = > = > = > i just built up 2 nodes and a manager on 3.2 dreyou packages, and now > that i have a VM up and installed with rhev agent, the VM is unable > to migrate. the failure is pretty much immediate. > = > = > i don't know where to begin troubleshooting this, can someone help me > get going in the right direction? just let me know what logs are > appropriate and i will post them up. > = > = > thanks, > jonathan > = > = > = > This is a PRIVATE message. If you are not the intended recipient, > please delete without copying and kindly advise us by e-mail of the > mistake in delivery. NOTE: Regardless of content, this e-mail shall > not operate to bind SKOPOS to any order or other contract unless > pursuant to explicit written agreement or government initiative > expressly permitting the use of e-mail for such purpose. > = > This is a PRIVATE message. If you are not the intended recipient, > please delete without copying and kindly advise us by e-mail of the > mistake in delivery. NOTE: Regardless of content, this e-mail shall > not operate to bind SKOPOS to any order or other contract unless > pursuant to explicit written agreement or government initiative > expressly permitting the use of e-mail for such purpose. > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users >=20 --===============8428523927417080004==-- From jhorne at skopos.us Wed Jan 9 08:55:01 2013 Content-Type: multipart/mixed; boundary="===============4754870995828623890==" MIME-Version: 1.0 From: Jonathan Horne To: users at ovirt.org Subject: Re: [Users] ovirt 3.2 migrations failing Date: Wed, 09 Jan 2013 13:54:59 +0000 Message-ID: <9BE6F493F83A594DA60C45E6A09DC5AC0170CC58@AUSP01DAG0201.collaborationhost.net> In-Reply-To: 1509659766.1883463.1357715937179.JavaMail.root@redhat.com --===============4754870995828623890== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable from source: [root(a)d0lppn032 vdsm]# egrep 'Thread-30209|Thread-30210' /var/log/vdsm/vdsm.log Thread-30209::DEBUG::2013-01-09 07:49:08,543::BindingXMLRPC::908::vds::(wrapper) client [10.32.0.21]::call vmMigrate with ({'src': 'd0lppn032.skopos.me', 'dst': 'd0lppn031.skopos.me:54321', 'vmId': 'e00adf83-78d2-4f65-a259-0e01680f57fd', 'method': 'online'},) {} flowID [343d5f4c] Thread-30209::DEBUG::2013-01-09 07:49:08,543::API::435::vds::(migrate) {'src': 'd0lppn032.skopos.me', 'dst': 'd0lppn031.skopos.me:54321', 'vmId': 'e00adf83-78d2-4f65-a259-0e01680f57fd', 'method': 'online'} Thread-30210::DEBUG::2013-01-09 07:49:08,544::vm::139::vm.Vm::(_setupVdsConnection) vmId=3D`e00adf83-78d2-4f65-a259-0e01680f57fd`::Destination server is: d0lppn031.skopos.me:54321 Thread-30210::DEBUG::2013-01-09 07:49:08,545::vm::141::vm.Vm::(_setupVdsConnection) vmId=3D`e00adf83-78d2-4f65-a259-0e01680f57fd`::Initiating connection with destination Thread-30209::DEBUG::2013-01-09 07:49:08,545::BindingXMLRPC::915::vds::(wrapper) return vmMigrate with {'status': {'message': 'Migration process starting', 'code': 0}} Thread-30210::DEBUG::2013-01-09 07:49:08,614::libvirtvm::298::vm.Vm::(_getDiskLatency) vmId=3D`e00adf83-78d2-4f65-a259-0e01680f57fd`::Disk vda latency not availab= le Thread-30210::DEBUG::2013-01-09 07:49:08,659::vm::190::vm.Vm::(_prepareGuest) vmId=3D`e00adf83-78d2-4f65-a259-0e01680f57fd`::migration Process begins Thread-30210::DEBUG::2013-01-09 07:49:08,751::vm::261::vm.Vm::(run) vmId=3D`e00adf83-78d2-4f65-a259-0e01680f57fd`::migration semaphore acquired Thread-30210::DEBUG::2013-01-09 07:49:09,168::libvirtvm::469::vm.Vm::(_startUnderlyingMigration) vmId=3D`e00adf83-78d2-4f65-a259-0e01680f57fd`::starting migration to qemu+tls://d0lppn031.skopos.me/system Thread-30210::DEBUG::2013-01-09 07:49:09,230::libvirtvm::370::vm.Vm::(cancel) vmId=3D`e00adf83-78d2-4f65-a259-0e01680f57fd`::canceling migration downtime thread Thread-30210::DEBUG::2013-01-09 07:49:09,231::libvirtvm::429::vm.Vm::(stop) vmId=3D`e00adf83-78d2-4f65-a259-0e01680f57fd`::stopping migration monitor thread Thread-30210::ERROR::2013-01-09 07:49:09,232::vm::196::vm.Vm::(_recover) vmId=3D`e00adf83-78d2-4f65-a259-0e01680f57fd`::operation failed: Failed to connect to remote libvirt URI qemu+tls://d0lppn031.skopos.me/system Thread-30210::ERROR::2013-01-09 07:49:09,374::vm::284::vm.Vm::(run) vmId=3D`e00adf83-78d2-4f65-a259-0e01680f57fd`::Failed to migrate and from destination: [root(a)d0lppn031 vdsm]# egrep 'Thread-40128|Thread-40129' /var/log/vdsm/vdsm.log Thread-40128::DEBUG::2013-01-09 07:49:08,943::BindingXMLRPC::908::vds::(wrapper) client [10.32.0.32]::call vmMigrationCreate with ({'username': 'root', 'acpiEnable': 'true', 'emulatedMachine': 'pc', 'afterMigrationStatus': 'Up', 'vmId': 'e00adf83-78d2-4f65-a259-0e01680f57fd', 'transparentHugePages': 'true', 'displaySecurePort': '5901', 'timeOffset': 1, 'cpuType': 'SandyBridge', 'custom': {}, 'migrationDest': 'libvirt', 'smp': '4', 'vmType': 'kvm', 'spiceSslCipherSuite': 'DEFAULT', '_srcDomXML': "\n d0lpvf051\n e00adf83-78d2-4f65-a259-0e01680f57fd\n 4194304\n 4194304\n 4= \n \n 1020\n \n \n \n oVirt\n oVirt Node\n 6-3.el6.centos.9\n 4C4C4544-004D-4E10-8036-B3C04F575731\n e00adf83-78d2-4f65-a259-0e01680f57fd\n \n \n \n hvm\n \n \n \n \n \n \n \n SandyBridge\n \n \n \n \n \n destroy\n restart\n destroy\n \n /usr/libexec/qemu-kvm\n \n \n \n \n \n \n \n

\n \n \n \n \n \n 0a9e06f9-2e85-4410-930d-7e381128c212\n \n

\n \n \n \n

\n \n \n = \n

\n \n \n \n \n \n \n \n \n

\n \n \n \n \n \n \n \n \n \n \n

\n \n \n \n \n \n

\n \n \n \n \n

\n \n \n \n \n \n \n \n \n \n \n \n \n \n