From CGrenier at b2b2c.com Thu Feb 23 21:15:10 2017 Content-Type: multipart/mixed; boundary="===============1877672632406748706==" MIME-Version: 1.0 From: Christian Grenier To: users at ovirt.org Subject: [ovirt-users] Troubleshoot failed storage migration Date: Thu, 23 Feb 2017 21:11:23 +0000 Message-ID: <3A56B77305AE8C409AD1F3C35371BB611A67E8FE@SBS.B2B2Cinc.local> --===============1877672632406748706== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable --_000_3A56B77305AE8C409AD1F3C35371BB611A67E8FESBSB2B2Cincloca_ Content-Type: text/plain; charset=3D"us-ascii" Content-Transfer-Encoding: quoted-printable I had an outage during live storage migration of a VM disk between two iSCS= =3D I. Since the outage prevented Ovirt to cleanly remove stuff on the destination= =3D iSCSI when the failure occurred, I think there's leftovers on the destinat= =3D ion iSCSI. The result is that any further attempt to live storage migrate t= =3D his VM disk fails with error "Cannot create Logical Volume" How can I troubleshoot / fix this ? -- Christian Grenier --_000_3A56B77305AE8C409AD1F3C35371BB611A67E8FESBSB2B2Cincloca_ Content-Type: text/html; charset=3D"us-ascii" Content-Transfer-Encoding: quoted-printable

I had an outage during live= sto=3D rage migration of a VM disk between two iSCSI.

 

Since the outage prevented = Ovir=3D t to cleanly remove stuff on the destination iSCSI when the failure occurre= =3D d, I think there’s leftovers on the destination iSCSI. The result is = =3D that any further attempt to live storage migrate this VM disk fails with error “Cannot create Logical Volume”

 

How can I troubleshoot / fi= x th=3D is ?

 

--
Christian Grenier 

 

--_000_3A56B77305AE8C409AD1F3C35371BB611A67E8FESBSB2B2Cincloca_-- --===============1877672632406748706== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS1fMDAwXzNBNTZCNzczMDVBRThDNDA5QUQxRjNDMzUzNzFCQjYxMUE2N0U4RkVTQlNCMkIyQ2lu Y2xvY2FfCkNvbnRlbnQtVHlwZTogdGV4dC9wbGFpbjsgY2hhcnNldD0idXMtYXNjaWkiCkNvbnRl bnQtVHJhbnNmZXItRW5jb2Rpbmc6IHF1b3RlZC1wcmludGFibGUKCkkgaGFkIGFuIG91dGFnZSBk dXJpbmcgbGl2ZSBzdG9yYWdlIG1pZ3JhdGlvbiBvZiBhIFZNIGRpc2sgYmV0d2VlbiB0d28gaVND Uz0KSS4KClNpbmNlIHRoZSBvdXRhZ2UgcHJldmVudGVkIE92aXJ0IHRvIGNsZWFubHkgcmVtb3Zl IHN0dWZmIG9uIHRoZSBkZXN0aW5hdGlvbj0KIGlTQ1NJIHdoZW4gdGhlIGZhaWx1cmUgb2NjdXJy ZWQsIEkgdGhpbmsgdGhlcmUncyBsZWZ0b3ZlcnMgb24gdGhlIGRlc3RpbmF0PQppb24gaVNDU0ku IFRoZSByZXN1bHQgaXMgdGhhdCBhbnkgZnVydGhlciBhdHRlbXB0IHRvIGxpdmUgc3RvcmFnZSBt aWdyYXRlIHQ9CmhpcyBWTSBkaXNrIGZhaWxzIHdpdGggZXJyb3IgIkNhbm5vdCBjcmVhdGUgTG9n aWNhbCBWb2x1bWUiCgpIb3cgY2FuIEkgdHJvdWJsZXNob290IC8gZml4IHRoaXMgPwoKLS0KQ2hy aXN0aWFuIEdyZW5pZXIKCgoKLS1fMDAwXzNBNTZCNzczMDVBRThDNDA5QUQxRjNDMzUzNzFCQjYx MUE2N0U4RkVTQlNCMkIyQ2luY2xvY2FfCkNvbnRlbnQtVHlwZTogdGV4dC9odG1sOyBjaGFyc2V0 PSJ1cy1hc2NpaSIKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogcXVvdGVkLXByaW50YWJsZQoK PGh0bWwgeG1sbnM6dj0zRCJ1cm46c2NoZW1hcy1taWNyb3NvZnQtY29tOnZtbCIgeG1sbnM6bz0z RCJ1cm46c2NoZW1hcy1taWNyPQpvc29mdC1jb206b2ZmaWNlOm9mZmljZSIgeG1sbnM6dz0zRCJ1 cm46c2NoZW1hcy1taWNyb3NvZnQtY29tOm9mZmljZTp3b3JkIiA9CnhtbG5zOm09M0QiaHR0cDov L3NjaGVtYXMubWljcm9zb2Z0LmNvbS9vZmZpY2UvMjAwNC8xMi9vbW1sIiB4bWxucz0zRCJodHRw Oj0KLy93d3cudzMub3JnL1RSL1JFQy1odG1sNDAiPgo8aGVhZD4KPG1ldGEgaHR0cC1lcXVpdj0z RCJDb250ZW50LVR5cGUiIGNvbnRlbnQ9M0QidGV4dC9odG1sOyBjaGFyc2V0PTNEdXMtYXNjaWki PQo+CjxtZXRhIG5hbWU9M0QiR2VuZXJhdG9yIiBjb250ZW50PTNEIk1pY3Jvc29mdCBXb3JkIDE1 IChmaWx0ZXJlZCBtZWRpdW0pIj4KPHN0eWxlPjwhLS0KLyogRm9udCBEZWZpbml0aW9ucyAqLwpA Zm9udC1mYWNlCgl7Zm9udC1mYW1pbHk6IkNhbWJyaWEgTWF0aCI7CglwYW5vc2UtMToyIDQgNSAz IDUgNCA2IDMgMiA0O30KQGZvbnQtZmFjZQoJe2ZvbnQtZmFtaWx5OkNhbGlicmk7CglwYW5vc2Ut MToyIDE1IDUgMiAyIDIgNCAzIDIgNDt9Ci8qIFN0eWxlIERlZmluaXRpb25zICovCnAuTXNvTm9y bWFsLCBsaS5Nc29Ob3JtYWwsIGRpdi5Nc29Ob3JtYWwKCXttYXJnaW46MGNtOwoJbWFyZ2luLWJv dHRvbTouMDAwMXB0OwoJZm9udC1zaXplOjExLjBwdDsKCWZvbnQtZmFtaWx5OiJDYWxpYnJpIixz YW5zLXNlcmlmOwoJbXNvLWZhcmVhc3QtbGFuZ3VhZ2U6RU4tVVM7fQphOmxpbmssIHNwYW4uTXNv SHlwZXJsaW5rCgl7bXNvLXN0eWxlLXByaW9yaXR5Ojk5OwoJY29sb3I6IzA1NjNDMTsKCXRleHQt ZGVjb3JhdGlvbjp1bmRlcmxpbmU7fQphOnZpc2l0ZWQsIHNwYW4uTXNvSHlwZXJsaW5rRm9sbG93 ZWQKCXttc28tc3R5bGUtcHJpb3JpdHk6OTk7Cgljb2xvcjojOTU0RjcyOwoJdGV4dC1kZWNvcmF0 aW9uOnVuZGVybGluZTt9CnNwYW4uRW1haWxTdHlsZTE3Cgl7bXNvLXN0eWxlLXR5cGU6cGVyc29u YWwtY29tcG9zZTsKCWZvbnQtZmFtaWx5OiJDYWxpYnJpIixzYW5zLXNlcmlmOwoJY29sb3I6d2lu ZG93dGV4dDt9Ci5Nc29DaHBEZWZhdWx0Cgl7bXNvLXN0eWxlLXR5cGU6ZXhwb3J0LW9ubHk7Cglm b250LWZhbWlseToiQ2FsaWJyaSIsc2Fucy1zZXJpZjsKCW1zby1mYXJlYXN0LWxhbmd1YWdlOkVO LVVTO30KQHBhZ2UgV29yZFNlY3Rpb24xCgl7c2l6ZTo2MTIuMHB0IDc5Mi4wcHQ7CgltYXJnaW46 NzIuMHB0IDkwLjBwdCA3Mi4wcHQgOTAuMHB0O30KZGl2LldvcmRTZWN0aW9uMQoJe3BhZ2U6V29y ZFNlY3Rpb24xO30KLS0+PC9zdHlsZT48IS0tW2lmIGd0ZSBtc28gOV0+PHhtbD4KPG86c2hhcGVk ZWZhdWx0cyB2OmV4dD0zRCJlZGl0IiBzcGlkbWF4PTNEIjEwMjYiIC8+CjwveG1sPjwhW2VuZGlm XS0tPjwhLS1baWYgZ3RlIG1zbyA5XT48eG1sPgo8bzpzaGFwZWxheW91dCB2OmV4dD0zRCJlZGl0 Ij4KPG86aWRtYXAgdjpleHQ9M0QiZWRpdCIgZGF0YT0zRCIxIiAvPgo8L286c2hhcGVsYXlvdXQ+ PC94bWw+PCFbZW5kaWZdLS0+CjwvaGVhZD4KPGJvZHkgbGFuZz0zRCJGUi1DQSIgbGluaz0zRCIj MDU2M0MxIiB2bGluaz0zRCIjOTU0RjcyIj4KPGRpdiBjbGFzcz0zRCJXb3JkU2VjdGlvbjEiPgo8 cCBjbGFzcz0zRCJNc29Ob3JtYWwiPjxzcGFuIGxhbmc9M0QiRU4tVVMiPkkgaGFkIGFuIG91dGFn ZSBkdXJpbmcgbGl2ZSBzdG89CnJhZ2UgbWlncmF0aW9uIG9mIGEgVk0gZGlzayBiZXR3ZWVuIHR3 byBpU0NTSS4KPG86cD48L286cD48L3NwYW4+PC9wPgo8cCBjbGFzcz0zRCJNc29Ob3JtYWwiPjxz cGFuIGxhbmc9M0QiRU4tVVMiPjxvOnA+Jm5ic3A7PC9vOnA+PC9zcGFuPjwvcD4KPHAgY2xhc3M9 M0QiTXNvTm9ybWFsIj48c3BhbiBsYW5nPTNEIkVOLVVTIj5TaW5jZSB0aGUgb3V0YWdlIHByZXZl bnRlZCBPdmlyPQp0IHRvIGNsZWFubHkgcmVtb3ZlIHN0dWZmIG9uIHRoZSBkZXN0aW5hdGlvbiBp U0NTSSB3aGVuIHRoZSBmYWlsdXJlIG9jY3VycmU9CmQsIEkgdGhpbmsgdGhlcmUmIzgyMTc7cyBs ZWZ0b3ZlcnMgb24gdGhlIGRlc3RpbmF0aW9uIGlTQ1NJLiBUaGUgcmVzdWx0IGlzID0KdGhhdCBh bnkgZnVydGhlciBhdHRlbXB0IHRvIGxpdmUgc3RvcmFnZSBtaWdyYXRlCiB0aGlzIFZNIGRpc2sg ZmFpbHMgd2l0aCBlcnJvciAmIzgyMjA7Q2Fubm90IGNyZWF0ZSBMb2dpY2FsIFZvbHVtZSYjODIy MTs8bz0KOnA+PC9vOnA+PC9zcGFuPjwvcD4KPHAgY2xhc3M9M0QiTXNvTm9ybWFsIj48c3BhbiBs YW5nPTNEIkVOLVVTIj48bzpwPiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+CjxwIGNsYXNzPTNEIk1z b05vcm1hbCI+PHNwYW4gbGFuZz0zRCJFTi1VUyI+SG93IGNhbiBJIHRyb3VibGVzaG9vdCAvIGZp eCB0aD0KaXMgPzxvOnA+PC9vOnA+PC9zcGFuPjwvcD4KPHAgY2xhc3M9M0QiTXNvTm9ybWFsIj48 c3BhbiBsYW5nPTNEIkVOLVVTIj48bzpwPiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+CjxwIGNsYXNz PTNEIk1zb05vcm1hbCIgc3R5bGU9M0QibXNvLW1hcmdpbi10b3AtYWx0OmF1dG87bXNvLW1hcmdp bi1ib3R0b20tYT0KbHQ6YXV0byI+PHNwYW4gc3R5bGU9M0QiZm9udC1zaXplOjEyLjBwdDtmb250 LWZhbWlseTomcXVvdDtUaW1lcyBOZXcgUm9tYW4mPQpxdW90OyxzZXJpZjttc28tZmFyZWFzdC1s YW5ndWFnZTpGUi1DQSI+LS0KPGJyPgpDaHJpc3RpYW4gR3JlbmllciZuYnNwOzxicj4KPGJyPgo8 bzpwPjwvbzpwPjwvc3Bhbj48L3A+CjxwIGNsYXNzPTNEIk1zb05vcm1hbCI+PG86cD4mbmJzcDs8 L286cD48L3A+CjwvZGl2Pgo8L2JvZHk+CjwvaHRtbD4KCi0tXzAwMF8zQTU2Qjc3MzA1QUU4QzQw OUFEMUYzQzM1MzcxQkI2MTFBNjdFOEZFU0JTQjJCMkNpbmNsb2NhXy0tCg== --===============1877672632406748706==-- From alitke at redhat.com Fri Feb 24 14:53:27 2017 Content-Type: multipart/mixed; boundary="===============0752137528225914354==" MIME-Version: 1.0 From: Adam Litke To: users at ovirt.org Subject: Re: [ovirt-users] Troubleshoot failed storage migration Date: Fri, 24 Feb 2017 09:53:26 -0500 Message-ID: In-Reply-To: 3A56B77305AE8C409AD1F3C35371BB611A67E8FE@SBS.B2B2Cinc.local --===============0752137528225914354== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hi Christian, I'd start by checking the vdsm log of the SPM host when you are failing to retry the migration. This should give more detail about the failure. It's possible that you will need to manually remove some LVs on the destination VG. On Thu, Feb 23, 2017 at 4:11 PM, Christian Grenier wrote: > I had an outage during live storage migration of a VM disk between two > iSCSI. > > > > Since the outage prevented Ovirt to cleanly remove stuff on the > destination iSCSI when the failure occurred, I think there=E2=80=99s left= overs on > the destination iSCSI. The result is that any further attempt to live > storage migrate this VM disk fails with error =E2=80=9CCannot create Logi= cal Volume=E2=80=9D > > > > How can I troubleshoot / fix this ? > > > > -- > Christian Grenier > > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > -- = Adam Litke --===============0752137528225914354== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGRpdj5IaSBDaHJpc3RpYW4sPGJyPjxicj48L2Rpdj5JJiMzOTtkIHN0 YXJ0IGJ5IGNoZWNraW5nIHRoZSB2ZHNtIGxvZyBvZiB0aGUgU1BNIGhvc3Qgd2hlbiB5b3UgYXJl IGZhaWxpbmcgdG8gcmV0cnkgdGhlIG1pZ3JhdGlvbi7CoCBUaGlzIHNob3VsZCBnaXZlIG1vcmUg ZGV0YWlsIGFib3V0IHRoZSBmYWlsdXJlLsKgIEl0JiMzOTtzIHBvc3NpYmxlIHRoYXQgeW91IHdp bGwgbmVlZCB0byBtYW51YWxseSByZW1vdmUgc29tZSBMVnMgb24gdGhlIGRlc3RpbmF0aW9uIFZH Ljxicj48L2Rpdj48ZGl2IGNsYXNzPSJnbWFpbF9leHRyYSI+PGJyPjxkaXYgY2xhc3M9ImdtYWls X3F1b3RlIj5PbiBUaHUsIEZlYiAyMywgMjAxNyBhdCA0OjExIFBNLCBDaHJpc3RpYW4gR3Jlbmll ciA8c3BhbiBkaXI9Imx0ciI+Jmx0OzxhIGhyZWY9Im1haWx0bzpDR3JlbmllckBiMmIyYy5jb20i IHRhcmdldD0iX2JsYW5rIj5DR3JlbmllckBiMmIyYy5jb208L2E+Jmd0Ozwvc3Bhbj4gd3JvdGU6 PGJyPjxibG9ja3F1b3RlIGNsYXNzPSJnbWFpbF9xdW90ZSIgc3R5bGU9Im1hcmdpbjowIDAgMCAu OGV4O2JvcmRlci1sZWZ0OjFweCAjY2NjIHNvbGlkO3BhZGRpbmctbGVmdDoxZXgiPgoKCgoKCjxk aXYgbGluaz0iIzA1NjNDMSIgdmxpbms9IiM5NTRGNzIiIGxhbmc9IkZSLUNBIj4KPGRpdiBjbGFz cz0ibV8tNjc0MDE5MzI1NjY4MTI1MzU0N1dvcmRTZWN0aW9uMSI+CjxwIGNsYXNzPSJNc29Ob3Jt YWwiPjxzcGFuIGxhbmc9IkVOLVVTIj5JIGhhZCBhbiBvdXRhZ2UgZHVyaW5nIGxpdmUgc3RvcmFn ZSBtaWdyYXRpb24gb2YgYSBWTSBkaXNrIGJldHdlZW4gdHdvIGlTQ1NJLgo8dT48L3U+PHU+PC91 Pjwvc3Bhbj48L3A+CjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxzcGFuIGxhbmc9IkVOLVVTIj48dT48 L3U+wqA8dT48L3U+PC9zcGFuPjwvcD4KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHNwYW4gbGFuZz0i RU4tVVMiPlNpbmNlIHRoZSBvdXRhZ2UgcHJldmVudGVkIE92aXJ0IHRvIGNsZWFubHkgcmVtb3Zl IHN0dWZmIG9uIHRoZSBkZXN0aW5hdGlvbiBpU0NTSSB3aGVuIHRoZSBmYWlsdXJlIG9jY3VycmVk LCBJIHRoaW5rIHRoZXJl4oCZcyBsZWZ0b3ZlcnMgb24gdGhlIGRlc3RpbmF0aW9uIGlTQ1NJLiBU aGUgcmVzdWx0IGlzIHRoYXQgYW55IGZ1cnRoZXIgYXR0ZW1wdCB0byBsaXZlIHN0b3JhZ2UgbWln cmF0ZQogdGhpcyBWTSBkaXNrIGZhaWxzIHdpdGggZXJyb3Ig4oCcQ2Fubm90IGNyZWF0ZSBMb2dp Y2FsIFZvbHVtZeKAnTx1PjwvdT48dT48L3U+PC9zcGFuPjwvcD4KPHAgY2xhc3M9Ik1zb05vcm1h bCI+PHNwYW4gbGFuZz0iRU4tVVMiPjx1PjwvdT7CoDx1PjwvdT48L3NwYW4+PC9wPgo8cCBjbGFz cz0iTXNvTm9ybWFsIj48c3BhbiBsYW5nPSJFTi1VUyI+SG93IGNhbiBJIHRyb3VibGVzaG9vdCAv IGZpeCB0aGlzID88c3BhbiBjbGFzcz0iSE9FblpiIj48Zm9udCBjb2xvcj0iIzg4ODg4OCI+PHU+ PC91Pjx1PjwvdT48L2ZvbnQ+PC9zcGFuPjwvc3Bhbj48L3A+PHNwYW4gY2xhc3M9IkhPRW5aYiI+ PGZvbnQgY29sb3I9IiM4ODg4ODgiPgo8cCBjbGFzcz0iTXNvTm9ybWFsIj48c3BhbiBsYW5nPSJF Ti1VUyI+PHU+PC91PsKgPHU+PC91Pjwvc3Bhbj48L3A+CjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxz cGFuIHN0eWxlPSJmb250LXNpemU6MTIuMHB0O2ZvbnQtZmFtaWx5OiZxdW90O1RpbWVzIE5ldyBS b21hbiZxdW90OyxzZXJpZiI+LS0KPGJyPgpDaHJpc3RpYW4gR3JlbmllcsKgPGJyPgo8YnI+Cjx1 PjwvdT48dT48L3U+PC9zcGFuPjwvcD4KPHAgY2xhc3M9Ik1zb05vcm1hbCI+PHU+PC91PsKgPHU+ PC91PjwvcD4KPC9mb250Pjwvc3Bhbj48L2Rpdj4KPC9kaXY+Cgo8YnI+X19fX19fX19fX19fX19f X19fX19fX19fX19fX19fPHdicj5fX19fX19fX19fX19fX19fXzxicj4KVXNlcnMgbWFpbGluZyBs aXN0PGJyPgo8YSBocmVmPSJtYWlsdG86VXNlcnNAb3ZpcnQub3JnIj5Vc2Vyc0BvdmlydC5vcmc8 L2E+PGJyPgo8YSBocmVmPSJodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8v dXNlcnMiIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9saXN0cy5vdmly dC5vcmcvPHdicj5tYWlsbWFuL2xpc3RpbmZvL3VzZXJzPC9hPjxicj4KPGJyPjwvYmxvY2txdW90 ZT48L2Rpdj48YnI+PGJyIGNsZWFyPSJhbGwiPjxicj4tLSA8YnI+PGRpdiBjbGFzcz0iZ21haWxf c2lnbmF0dXJlIiBkYXRhLXNtYXJ0bWFpbD0iZ21haWxfc2lnbmF0dXJlIj48ZGl2IGRpcj0ibHRy Ij5BZGFtIExpdGtlPC9kaXY+PC9kaXY+CjwvZGl2Pgo= --===============0752137528225914354==--