From logank at wolfram.com Tue Jul 19 08:21:51 2016 Content-Type: multipart/mixed; boundary="===============4617419231539037891==" MIME-Version: 1.0 From: Logan Kuhn To: users at ovirt.org Subject: [ovirt-users] Unable to import pre-configured nfs data domain Date: Tue, 19 Jul 2016 07:16:04 -0500 Message-ID: <1860049924.40462946.1468930564077.JavaMail.zimbra@wolfram.com> --===============4617419231539037891== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable ------=3D_Part_40462945_127698661.1468930564077 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 7bit We are currently evaluating ovirt for our new VM backend and part of that i= s moving the engine to a physical controller node. So I took the opportunit= y to test a DR scenario where the engine fails and takes more than a reboot= to bring it back up. For the most part it was straight forward to get it u= p and going, but I'm having a hard time getting the previous master data do= main to import into the new engine. I've attached relevant snippets of the = engine and vdsm log. = Engine: http://pastebin.com/xBZ7CBs7 = VDSM: http://pastebin.com/eksVyWBn = Regards, = Logan = ------=3D_Part_40462945_127698661.1468930564077 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable
We are currently evaluating ovirt for our new VM backend and part = =3D of that is moving the engine to a physical controller node.   So I too= =3D k the opportunity to test a DR scenario where the engine fails and takes mo= =3D re than a reboot to bring it back up.  For the most part it was straig= =3D ht forward to get it up and going, but I'm having a hard time getting the p= =3D revious master data domain to import into the new engine.  I've attach= =3D ed relevant snippets of the engine and vdsm log.

Engine: http://pastebin.com/xBZ7CBs7
VDSM: http://pastebin.com/eksVyWBn

<= =3D div>
Reg= ards=3D ,
Logan
------=3D_Part_40462945_127698661.1468930564077-- --===============4617419231539037891== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS0tLS0tPV9QYXJ0XzQwNDYyOTQ1XzEyNzY5ODY2MS4xNDY4OTMwNTY0MDc3CkNvbnRlbnQtVHlw ZTogdGV4dC9wbGFpbjsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA3 Yml0CgpXZSBhcmUgY3VycmVudGx5IGV2YWx1YXRpbmcgb3ZpcnQgZm9yIG91ciBuZXcgVk0gYmFj a2VuZCBhbmQgcGFydCBvZiB0aGF0IGlzIG1vdmluZyB0aGUgZW5naW5lIHRvIGEgcGh5c2ljYWwg Y29udHJvbGxlciBub2RlLiBTbyBJIHRvb2sgdGhlIG9wcG9ydHVuaXR5IHRvIHRlc3QgYSBEUiBz Y2VuYXJpbyB3aGVyZSB0aGUgZW5naW5lIGZhaWxzIGFuZCB0YWtlcyBtb3JlIHRoYW4gYSByZWJv b3QgdG8gYnJpbmcgaXQgYmFjayB1cC4gRm9yIHRoZSBtb3N0IHBhcnQgaXQgd2FzIHN0cmFpZ2h0 IGZvcndhcmQgdG8gZ2V0IGl0IHVwIGFuZCBnb2luZywgYnV0IEknbSBoYXZpbmcgYSBoYXJkIHRp bWUgZ2V0dGluZyB0aGUgcHJldmlvdXMgbWFzdGVyIGRhdGEgZG9tYWluIHRvIGltcG9ydCBpbnRv IHRoZSBuZXcgZW5naW5lLiBJJ3ZlIGF0dGFjaGVkIHJlbGV2YW50IHNuaXBwZXRzIG9mIHRoZSBl bmdpbmUgYW5kIHZkc20gbG9nLiAKCkVuZ2luZTogaHR0cDovL3Bhc3RlYmluLmNvbS94Qlo3Q0Jz NyAKClZEU006IGh0dHA6Ly9wYXN0ZWJpbi5jb20vZWtzVnlXQm4gCgoKUmVnYXJkcywgCkxvZ2Fu IAoKLS0tLS0tPV9QYXJ0XzQwNDYyOTQ1XzEyNzY5ODY2MS4xNDY4OTMwNTY0MDc3CkNvbnRlbnQt VHlwZTogdGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6 IHF1b3RlZC1wcmludGFibGUKCjxodG1sPjxib2R5PjxkaXYgc3R5bGU9M0QiZm9udC1mYW1pbHk6 IEFyaWFsOyBmb250LXNpemU6IDEycHQ7IGNvbG9yOiAjMDAwMD0KMDAiPjxkaXY+V2UgYXJlIGN1 cnJlbnRseSBldmFsdWF0aW5nIG92aXJ0IGZvciBvdXIgbmV3IFZNIGJhY2tlbmQgYW5kIHBhcnQg PQpvZiB0aGF0IGlzIG1vdmluZyB0aGUgZW5naW5lIHRvIGEgcGh5c2ljYWwgY29udHJvbGxlciBu b2RlLiAmbmJzcDsgU28gSSB0b289CmsgdGhlIG9wcG9ydHVuaXR5IHRvIHRlc3QgYSBEUiBzY2Vu YXJpbyB3aGVyZSB0aGUgZW5naW5lIGZhaWxzIGFuZCB0YWtlcyBtbz0KcmUgdGhhbiBhIHJlYm9v dCB0byBicmluZyBpdCBiYWNrIHVwLiAmbmJzcDtGb3IgdGhlIG1vc3QgcGFydCBpdCB3YXMgc3Ry YWlnPQpodCBmb3J3YXJkIHRvIGdldCBpdCB1cCBhbmQgZ29pbmcsIGJ1dCBJJ20gaGF2aW5nIGEg aGFyZCB0aW1lIGdldHRpbmcgdGhlIHA9CnJldmlvdXMgbWFzdGVyIGRhdGEgZG9tYWluIHRvIGlt cG9ydCBpbnRvIHRoZSBuZXcgZW5naW5lLiAmbmJzcDtJJ3ZlIGF0dGFjaD0KZWQgcmVsZXZhbnQg c25pcHBldHMgb2YgdGhlIGVuZ2luZSBhbmQgdmRzbSBsb2cuPC9kaXY+PGRpdj48YnIgZGF0YS1t Y2UtYm9nPQp1cz0zRCIxIj48L2Rpdj48ZGl2PjxzcGFuIHN0eWxlPTNEImZvbnQtc2l6ZTogMTJw dDsiIGRhdGEtbWNlLXN0eWxlPTNEImZvbnQ9Ci1zaXplOiAxMnB0OyI+RW5naW5lOiZuYnNwO2h0 dHA6Ly9wYXN0ZWJpbi5jb20veEJaN0NCczc8L3NwYW4+PC9kaXY+PGRpdj48Yj0Kcj48L2Rpdj48 ZGl2PjxzcGFuIHN0eWxlPTNEImZvbnQtc2l6ZTogMTJwdDsiIGRhdGEtbWNlLXN0eWxlPTNEImZv bnQtc2l6ZTogPQoxMnB0OyI+VkRTTTombmJzcDtodHRwOi8vcGFzdGViaW4uY29tL2Vrc1Z5V0Ju PC9zcGFuPjwvZGl2PjxkaXY+PGJyPjwvZGl2Pjw9CmRpdj48YnIgZGF0YS1tY2UtYm9ndXM9M0Qi MSI+PC9kaXY+PGRpdiBkYXRhLW1hcmtlcj0zRCJfX1NJR19QUkVfXyI+UmVnYXJkcz0KLDxicj5M b2dhbjwvZGl2PjwvZGl2PjwvYm9keT48L2h0bWw+Ci0tLS0tLT1fUGFydF80MDQ2Mjk0NV8xMjc2 OTg2NjEuMTQ2ODkzMDU2NDA3Ny0tCg== --===============4617419231539037891==-- From logank at wolfram.com Wed Jul 20 13:12:21 2016 Content-Type: multipart/mixed; boundary="===============5603689776222186285==" MIME-Version: 1.0 From: Logan Kuhn To: users at ovirt.org Subject: Re: [ovirt-users] Unable to import pre-configured nfs data domain Date: Wed, 20 Jul 2016 12:12:20 -0500 Message-ID: <172543677.41066166.1469034740594.JavaMail.zimbra@wolfram.com> In-Reply-To: 1860049924.40462946.1468930564077.JavaMail.zimbra@wolfram.com --===============5603689776222186285== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable ------=3D_Part_41066165_153903448.1469034740593 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 7bit Am I correct in the assumption that importing a previously master data doma= in into a fresh engine without a current master domain is supported? = Regards, = Logan = ----- On Jul 19, 2016, at 7:16 AM, Logan Kuhn wrote: = | We are currently evaluating ovirt for our new VM backend and part of that= is | moving the engine to a physical controller node. So I took the opportunit= y to | test a DR scenario where the engine fails and takes more than a reboot to= bring | it back up. For the most part it was straight forward to get it up and go= ing, | but I'm having a hard time getting the previous master data domain to imp= ort | into the new engine. I've attached relevant snippets of the engine and vd= sm | log. | Engine: http://pastebin.com/xBZ7CBs7 | VDSM: http://pastebin.com/eksVyWBn | Regards, | Logan | _______________________________________________ | Users mailing list | Users(a)ovirt.org | http://lists.ovirt.org/mailman/listinfo/users ------=3D_Part_41066165_153903448.1469034740593 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable
Am I correct in the assumption that importing a previously master = =3D data domain into a fresh engine without a current master domain is supporte= =3D d?

Regards,
Logan=
----- On Jul 19,= 201=3D 6, at 7:16 AM, Logan Kuhn <logank(a)wolfram.com> wrote:
We are currently evaluating ovirt for our new VM = =3D backend and part of that is moving the engine to a physical controller node= =3D .   So I took the opportunity to test a DR scenario where the engine f= =3D ails and takes more than a reboot to bring it back up.  For the most p= =3D art it was straight forward to get it up and going, but I'm having a hard t= =3D ime getting the previous master data domain to import into the new engine. = =3D  I've attached relevant snippets of the engine and vdsm log.

= =3D
E=3D ngine: http://pastebin.com/xBZ7CBs7

VDSM: ht= tp:/=3D /pastebin.com/eksVyWBn


Regards,
Logan

_______________________________________________
Users mailing list= =3D
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
<= /b=3D lockquote>
------=3D_Part_41066165_153903448.1469034740593-- --===============5603689776222186285== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS0tLS0tPV9QYXJ0XzQxMDY2MTY1XzE1MzkwMzQ0OC4xNDY5MDM0NzQwNTkzCkNvbnRlbnQtVHlw ZTogdGV4dC9wbGFpbjsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA3 Yml0CgpBbSBJIGNvcnJlY3QgaW4gdGhlIGFzc3VtcHRpb24gdGhhdCBpbXBvcnRpbmcgYSBwcmV2 aW91c2x5IG1hc3RlciBkYXRhIGRvbWFpbiBpbnRvIGEgZnJlc2ggZW5naW5lIHdpdGhvdXQgYSBj dXJyZW50IG1hc3RlciBkb21haW4gaXMgc3VwcG9ydGVkPyAKClJlZ2FyZHMsIApMb2dhbiAKCi0t LS0tIE9uIEp1bCAxOSwgMjAxNiwgYXQgNzoxNiBBTSwgTG9nYW4gS3VobiA8bG9nYW5rQHdvbGZy YW0uY29tPiB3cm90ZTogCgp8IFdlIGFyZSBjdXJyZW50bHkgZXZhbHVhdGluZyBvdmlydCBmb3Ig b3VyIG5ldyBWTSBiYWNrZW5kIGFuZCBwYXJ0IG9mIHRoYXQgaXMKfCBtb3ZpbmcgdGhlIGVuZ2lu ZSB0byBhIHBoeXNpY2FsIGNvbnRyb2xsZXIgbm9kZS4gU28gSSB0b29rIHRoZSBvcHBvcnR1bml0 eSB0bwp8IHRlc3QgYSBEUiBzY2VuYXJpbyB3aGVyZSB0aGUgZW5naW5lIGZhaWxzIGFuZCB0YWtl cyBtb3JlIHRoYW4gYSByZWJvb3QgdG8gYnJpbmcKfCBpdCBiYWNrIHVwLiBGb3IgdGhlIG1vc3Qg cGFydCBpdCB3YXMgc3RyYWlnaHQgZm9yd2FyZCB0byBnZXQgaXQgdXAgYW5kIGdvaW5nLAp8IGJ1 dCBJJ20gaGF2aW5nIGEgaGFyZCB0aW1lIGdldHRpbmcgdGhlIHByZXZpb3VzIG1hc3RlciBkYXRh IGRvbWFpbiB0byBpbXBvcnQKfCBpbnRvIHRoZSBuZXcgZW5naW5lLiBJJ3ZlIGF0dGFjaGVkIHJl bGV2YW50IHNuaXBwZXRzIG9mIHRoZSBlbmdpbmUgYW5kIHZkc20KfCBsb2cuCgp8IEVuZ2luZTog aHR0cDovL3Bhc3RlYmluLmNvbS94Qlo3Q0JzNwoKfCBWRFNNOiBodHRwOi8vcGFzdGViaW4uY29t L2Vrc1Z5V0JuCgp8IFJlZ2FyZHMsCnwgTG9nYW4KCnwgX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX18KfCBVc2VycyBtYWlsaW5nIGxpc3QKfCBVc2Vyc0Bvdmly dC5vcmcKfCBodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMKCi0t LS0tLT1fUGFydF80MTA2NjE2NV8xNTM5MDM0NDguMTQ2OTAzNDc0MDU5MwpDb250ZW50LVR5cGU6 IHRleHQvaHRtbDsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiBxdW90 ZWQtcHJpbnRhYmxlCgo8aHRtbD48Ym9keT48ZGl2IHN0eWxlPTNEImZvbnQtZmFtaWx5OiBBcmlh bDsgZm9udC1zaXplOiAxMnB0OyBjb2xvcjogIzAwMDA9CjAwIj48ZGl2PkFtIEkgY29ycmVjdCBp biB0aGUgYXNzdW1wdGlvbiB0aGF0IGltcG9ydGluZyBhIHByZXZpb3VzbHkgbWFzdGVyID0KZGF0 YSBkb21haW4gaW50byBhIGZyZXNoIGVuZ2luZSB3aXRob3V0IGEgY3VycmVudCBtYXN0ZXIgZG9t YWluIGlzIHN1cHBvcnRlPQpkPzwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXYgZGF0YS1tYXJrZXI9 M0QiX19TSUdfUFJFX18iPlJlZ2FyZHMsPGJyPkxvZ2FuPC89CmRpdj48YnI+PHNwYW4gaWQ9M0Qi endjaHIiIGRhdGEtbWFya2VyPTNEIl9fRElWSURFUl9fIj4tLS0tLSBPbiBKdWwgMTksIDIwMT0K NiwgYXQgNzoxNiBBTSwgTG9nYW4gS3VobiAmbHQ7bG9nYW5rQHdvbGZyYW0uY29tJmd0OyB3cm90 ZTo8YnI+PC9zcGFuPjxkaXYgPQpkYXRhLW1hcmtlcj0zRCJfX1FVT1RFRF9URVhUX18iPjxibG9j a3F1b3RlIHN0eWxlPTNEImJvcmRlci1sZWZ0OiAycHggc29saWQ9CiAjMTAxMEZGOyBtYXJnaW4t bGVmdDogNXB4OyBwYWRkaW5nLWxlZnQ6IDVweDsgY29sb3I6ICMwMDA7IGZvbnQtd2VpZ2h0OiBu bz0Kcm1hbDsgZm9udC1zdHlsZTogbm9ybWFsOyB0ZXh0LWRlY29yYXRpb246IG5vbmU7IGZvbnQt ZmFtaWx5OiBIZWx2ZXRpY2EsQXJpPQphbCxzYW5zLXNlcmlmOyBmb250LXNpemU6IDEycHQ7IiBk YXRhLW1jZS1zdHlsZT0zRCJib3JkZXItbGVmdDogMnB4IHNvbGlkICM9CjEwMTBGRjsgbWFyZ2lu LWxlZnQ6IDVweDsgcGFkZGluZy1sZWZ0OiA1cHg7IGNvbG9yOiAjMDAwOyBmb250LXdlaWdodDog bm9ybT0KYWw7IGZvbnQtc3R5bGU6IG5vcm1hbDsgdGV4dC1kZWNvcmF0aW9uOiBub25lOyBmb250 LWZhbWlseTogSGVsdmV0aWNhLEFyaWFsPQosc2Fucy1zZXJpZjsgZm9udC1zaXplOiAxMnB0OyI+ PGRpdiBzdHlsZT0zRCJmb250LWZhbWlseTogQXJpYWw7IGZvbnQtc2l6ZTo9CiAxMnB0OyBjb2xv cjogIzAwMDAwMDsiIGRhdGEtbWNlLXN0eWxlPTNEImZvbnQtZmFtaWx5OiBBcmlhbDsgZm9udC1z aXplOiAxMj0KcHQ7IGNvbG9yOiAjMDAwMDAwOyI+PGRpdj5XZSBhcmUgY3VycmVudGx5IGV2YWx1 YXRpbmcgb3ZpcnQgZm9yIG91ciBuZXcgVk0gPQpiYWNrZW5kIGFuZCBwYXJ0IG9mIHRoYXQgaXMg bW92aW5nIHRoZSBlbmdpbmUgdG8gYSBwaHlzaWNhbCBjb250cm9sbGVyIG5vZGU9Ci4gJm5ic3A7 IFNvIEkgdG9vayB0aGUgb3Bwb3J0dW5pdHkgdG8gdGVzdCBhIERSIHNjZW5hcmlvIHdoZXJlIHRo ZSBlbmdpbmUgZj0KYWlscyBhbmQgdGFrZXMgbW9yZSB0aGFuIGEgcmVib290IHRvIGJyaW5nIGl0 IGJhY2sgdXAuICZuYnNwO0ZvciB0aGUgbW9zdCBwPQphcnQgaXQgd2FzIHN0cmFpZ2h0IGZvcndh cmQgdG8gZ2V0IGl0IHVwIGFuZCBnb2luZywgYnV0IEknbSBoYXZpbmcgYSBoYXJkIHQ9CmltZSBn ZXR0aW5nIHRoZSBwcmV2aW91cyBtYXN0ZXIgZGF0YSBkb21haW4gdG8gaW1wb3J0IGludG8gdGhl IG5ldyBlbmdpbmUuID0KJm5ic3A7SSd2ZSBhdHRhY2hlZCByZWxldmFudCBzbmlwcGV0cyBvZiB0 aGUgZW5naW5lIGFuZCB2ZHNtIGxvZy48L2Rpdj48YnI+PQo8ZGl2PjxzcGFuIHN0eWxlPTNEImZv bnQtc2l6ZTogMTJwdDsiIGRhdGEtbWNlLXN0eWxlPTNEImZvbnQtc2l6ZTogMTJwdDsiPkU9Cm5n aW5lOiZuYnNwO2h0dHA6Ly9wYXN0ZWJpbi5jb20veEJaN0NCczc8L3NwYW4+PC9kaXY+PGJyPjxk aXY+PHNwYW4gc3R5bGU9Cj0zRCJmb250LXNpemU6IDEycHQ7IiBkYXRhLW1jZS1zdHlsZT0zRCJm b250LXNpemU6IDEycHQ7Ij5WRFNNOiZuYnNwO2h0dHA6Lz0KL3Bhc3RlYmluLmNvbS9la3NWeVdC bjwvc3Bhbj48L2Rpdj48YnI+PGJyPjxkaXY+UmVnYXJkcyw8YnI+TG9nYW48L2Rpdj48L2RpPQp2 Pjxicj5fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXzxicj5V c2VycyBtYWlsaW5nIGxpc3Q9Cjxicj5Vc2Vyc0BvdmlydC5vcmc8YnI+aHR0cDovL2xpc3RzLm92 aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzPGJyPjwvYj0KbG9ja3F1b3RlPjwvZGl2Pjwv ZGl2PjwvYm9keT48L2h0bWw+Ci0tLS0tLT1fUGFydF80MTA2NjE2NV8xNTM5MDM0NDguMTQ2OTAz NDc0MDU5My0tCg== --===============5603689776222186285==-- From mzamazal at redhat.com Fri Jul 22 04:06:48 2016 Content-Type: multipart/mixed; boundary="===============4875138805477290623==" MIME-Version: 1.0 From: Milan Zamazal To: users at ovirt.org Subject: Re: [ovirt-users] Unable to import pre-configured nfs data domain Date: Fri, 22 Jul 2016 10:06:45 +0200 Message-ID: <87mvla5c6i.fsf@redhat.com> In-Reply-To: 172543677.41066166.1469034740594.JavaMail.zimbra@wolfram.com --===============4875138805477290623== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Logan Kuhn writes: > Am I correct in the assumption that importing a previously master data do= main > into a fresh engine without a current master domain is supported? It's supported only in case the master domain was previously correctly detached from the data center. In case of an unexpected complete disaster, when a fresh engine is installed and used, it's still possible to recover the master domain in theory. You must find `metadata' file in the master domain and edit it for the new engine. It's completely unsupported and it may or may not work. We don't have guidelines how to do it, but you may try to create a new master domain, then detach it and compare the two metadata files. --===============4875138805477290623==-- From logank at wolfram.com Fri Jul 22 11:10:45 2016 Content-Type: multipart/mixed; boundary="===============4330981737960554603==" MIME-Version: 1.0 From: Logan Kuhn To: users at ovirt.org Subject: Re: [ovirt-users] Unable to import pre-configured nfs data domain Date: Fri, 22 Jul 2016 10:10:44 -0500 Message-ID: <1745656618.41691685.1469200244459.JavaMail.zimbra@wolfram.com> In-Reply-To: 87mvla5c6i.fsf@redhat.com --===============4330981737960554603== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Thank you! That does do some interesting things, but doesn't appear to work. I've added a new storage domain, merged the differences in the metadata fil= e back to the old one and powered it up. When I start up the nodes they en= dlessly report: VDSM ovirt-reqa1 command failed: (-226, 'Unable to read res= ource owners', 'Sanlock exception') I tried reinstalling one of them and the error message continues. At least= for now I've restored the old config and the error is gone. Regards, Logan ----- On Jul 22, 2016, at 3:06 AM, Milan Zamazal mzamazal(a)redhat.com wrot= e: | Logan Kuhn writes: | = |> Am I correct in the assumption that importing a previously master data d= omain |> into a fresh engine without a current master domain is supported? | = | It's supported only in case the master domain was previously correctly | detached from the data center. | = | In case of an unexpected complete disaster, when a fresh engine is | installed and used, it's still possible to recover the master domain in | theory. You must find `metadata' file in the master domain and edit it | for the new engine. It's completely unsupported and it may or may not | work. We don't have guidelines how to do it, but you may try to create | a new master domain, then detach it and compare the two metadata files. --===============4330981737960554603==-- From sbonazzo at redhat.com Mon Jul 25 15:56:42 2016 Content-Type: multipart/mixed; boundary="===============0223659166145304487==" MIME-Version: 1.0 From: Sandro Bonazzola To: users at ovirt.org Subject: Re: [ovirt-users] Unable to import pre-configured nfs data domain Date: Mon, 25 Jul 2016 21:56:40 +0200 Message-ID: In-Reply-To: 1745656618.41691685.1469200244459.JavaMail.zimbra@wolfram.com --===============0223659166145304487== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Il 22/Lug/2016 17:10, "Logan Kuhn" ha scritto: > > Thank you! > > That does do some interesting things, but doesn't appear to work. > > I've added a new storage domain, merged the differences in the metadata file back to the old one and powered it up. When I start up the nodes they endlessly report: VDSM ovirt-reqa1 command failed: (-226, 'Unable to read resource owners', 'Sanlock exception') > > I tried reinstalling one of them and the error message continues. At least for now I've restored the old config and the error is gone. > > Regards, > Logan > Logan, do you mind to write a testcase in ovirt.org website for the disaster recovery test you are doing? Milan, if Logan write it, can you please review it? > ----- On Jul 22, 2016, at 3:06 AM, Milan Zamazal mzamazal(a)redhat.com wrote: > > | Logan Kuhn writes: > | > |> Am I correct in the assumption that importing a previously master data domain > |> into a fresh engine without a current master domain is supported? > | > | It's supported only in case the master domain was previously correctly > | detached from the data center. > | > | In case of an unexpected complete disaster, when a fresh engine is > | installed and used, it's still possible to recover the master domain in > | theory. You must find `metadata' file in the master domain and edit it > | for the new engine. It's completely unsupported and it may or may not > | work. We don't have guidelines how to do it, but you may try to create > | a new master domain, then detach it and compare the two metadata files. > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --===============0223659166145304487== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PHAgZGlyPSJsdHIiPjwvcD4KPHAgZGlyPSJsdHIiPklsIDIyL0x1Zy8yMDE2IDE3OjEwLCAmcXVv dDtMb2dhbiBLdWhuJnF1b3Q7ICZsdDs8YSBocmVmPSJtYWlsdG86bG9nYW5rQHdvbGZyYW0uY29t Ij5sb2dhbmtAd29sZnJhbS5jb208L2E+Jmd0OyBoYSBzY3JpdHRvOjxicj4KJmd0Ozxicj4KJmd0 OyBUaGFuayB5b3UhPGJyPgomZ3Q7PGJyPgomZ3Q7IFRoYXQgZG9lcyBkbyBzb21lIGludGVyZXN0 aW5nIHRoaW5ncywgYnV0IGRvZXNuJiMzOTt0IGFwcGVhciB0byB3b3JrLjxicj4KJmd0Ozxicj4K Jmd0OyBJJiMzOTt2ZSBhZGRlZCBhIG5ldyBzdG9yYWdlIGRvbWFpbiwgbWVyZ2VkIHRoZSBkaWZm ZXJlbmNlcyBpbiB0aGUgbWV0YWRhdGEgZmlsZSBiYWNrIHRvIHRoZSBvbGQgb25lIGFuZCBwb3dl cmVkIGl0IHVwLsKgIFdoZW4gSSBzdGFydCB1cCB0aGUgbm9kZXMgdGhleSBlbmRsZXNzbHkgcmVw b3J0OiBWRFNNIG92aXJ0LXJlcWExIGNvbW1hbmQgZmFpbGVkOiAoLTIyNiwgJiMzOTtVbmFibGUg dG8gcmVhZCByZXNvdXJjZSBvd25lcnMmIzM5OywgJiMzOTtTYW5sb2NrIGV4Y2VwdGlvbiYjMzk7 KTxicj4KJmd0Ozxicj4KJmd0OyBJIHRyaWVkIHJlaW5zdGFsbGluZyBvbmUgb2YgdGhlbSBhbmQg dGhlIGVycm9yIG1lc3NhZ2UgY29udGludWVzLsKgIEF0IGxlYXN0IGZvciBub3cgSSYjMzk7dmUg cmVzdG9yZWQgdGhlIG9sZCBjb25maWcgYW5kIHRoZSBlcnJvciBpcyBnb25lLjxicj4KJmd0Ozxi cj4KJmd0OyBSZWdhcmRzLDxicj4KJmd0OyBMb2dhbjxicj4KJmd0Ozxicj48L3A+CjxwIGRpcj0i bHRyIj5Mb2dhbiwgZG8geW91IG1pbmQgdG8gd3JpdGUgYSB0ZXN0Y2FzZSBpbiA8YSBocmVmPSJo dHRwOi8vb3ZpcnQub3JnIj5vdmlydC5vcmc8L2E+IHdlYnNpdGUgZm9yIHRoZSBkaXNhc3RlciBy ZWNvdmVyeSB0ZXN0IHlvdSBhcmUgZG9pbmc/IE1pbGFuLCBpZiBMb2dhbiB3cml0ZSBpdCwgY2Fu IHlvdSBwbGVhc2UgcmV2aWV3IGl0Pzxicj48YnI+PGJyPjwvcD4KPHAgZGlyPSJsdHIiPiZndDsg LS0tLS0gT24gSnVsIDIyLCAyMDE2LCBhdCAzOjA2IEFNLCBNaWxhbiBaYW1hemFsIDxhIGhyZWY9 Im1haWx0bzptemFtYXphbEByZWRoYXQuY29tIj5temFtYXphbEByZWRoYXQuY29tPC9hPiB3cm90 ZTo8YnI+CiZndDs8YnI+CiZndDsgfCBMb2dhbiBLdWhuICZsdDs8YSBocmVmPSJtYWlsdG86bG9n YW5rQHdvbGZyYW0uY29tIj5sb2dhbmtAd29sZnJhbS5jb208L2E+Jmd0OyB3cml0ZXM6PGJyPgom Z3Q7IHw8YnI+CiZndDsgfCZndDsgQW0gSSBjb3JyZWN0IGluIHRoZSBhc3N1bXB0aW9uIHRoYXQg aW1wb3J0aW5nIGEgcHJldmlvdXNseSBtYXN0ZXIgZGF0YSBkb21haW48YnI+CiZndDsgfCZndDsg aW50byBhIGZyZXNoIGVuZ2luZSB3aXRob3V0IGEgY3VycmVudCBtYXN0ZXIgZG9tYWluIGlzIHN1 cHBvcnRlZD88YnI+CiZndDsgfDxicj4KJmd0OyB8IEl0JiMzOTtzIHN1cHBvcnRlZCBvbmx5IGlu IGNhc2UgdGhlIG1hc3RlciBkb21haW4gd2FzIHByZXZpb3VzbHkgY29ycmVjdGx5PGJyPgomZ3Q7 IHwgZGV0YWNoZWQgZnJvbSB0aGUgZGF0YSBjZW50ZXIuPGJyPgomZ3Q7IHw8YnI+CiZndDsgfCBJ biBjYXNlIG9mIGFuIHVuZXhwZWN0ZWQgY29tcGxldGUgZGlzYXN0ZXIsIHdoZW4gYSBmcmVzaCBl bmdpbmUgaXM8YnI+CiZndDsgfCBpbnN0YWxsZWQgYW5kIHVzZWQsIGl0JiMzOTtzIHN0aWxsIHBv c3NpYmxlIHRvIHJlY292ZXIgdGhlIG1hc3RlciBkb21haW4gaW48YnI+CiZndDsgfCB0aGVvcnku wqAgWW91IG11c3QgZmluZCBgbWV0YWRhdGEmIzM5OyBmaWxlIGluIHRoZSBtYXN0ZXIgZG9tYWlu IGFuZCBlZGl0IGl0PGJyPgomZ3Q7IHwgZm9yIHRoZSBuZXcgZW5naW5lLsKgIEl0JiMzOTtzIGNv bXBsZXRlbHkgdW5zdXBwb3J0ZWQgYW5kIGl0IG1heSBvciBtYXkgbm90PGJyPgomZ3Q7IHwgd29y ay7CoCBXZSBkb24mIzM5O3QgaGF2ZSBndWlkZWxpbmVzIGhvdyB0byBkbyBpdCwgYnV0IHlvdSBt YXkgdHJ5IHRvIGNyZWF0ZTxicj4KJmd0OyB8IGEgbmV3IG1hc3RlciBkb21haW4sIHRoZW4gZGV0 YWNoIGl0IGFuZCBjb21wYXJlIHRoZSB0d28gbWV0YWRhdGEgZmlsZXMuPGJyPgomZ3Q7IF9fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fPGJyPgomZ3Q7IFVzZXJz IG1haWxpbmcgbGlzdDxicj4KJmd0OyA8YSBocmVmPSJtYWlsdG86VXNlcnNAb3ZpcnQub3JnIj5V c2Vyc0BvdmlydC5vcmc8L2E+PGJyPgomZ3Q7IDxhIGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5v cmcvbWFpbG1hbi9saXN0aW5mby91c2VycyI+aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFu L2xpc3RpbmZvL3VzZXJzPC9hPjxicj48L3A+Cg== --===============0223659166145304487==-- From logank at wolfram.com Tue Jul 26 10:15:52 2016 Content-Type: multipart/mixed; boundary="===============5848723861545583573==" MIME-Version: 1.0 From: Logan Kuhn To: users at ovirt.org Subject: Re: [ovirt-users] Unable to import pre-configured nfs data domain Date: Tue, 26 Jul 2016 09:15:52 -0500 Message-ID: <1645880419.42425214.1469542552035.JavaMail.zimbra@wolfram.com> In-Reply-To: CAPQRNTnmeTe0JT9cD9ZJi1mJFCw8vWaVDJ9TqUaL_u6hkr0qHQ@mail.gmail.com --===============5848723861545583573== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable ------=3D_Part_42425213_176413900.1469542552035 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 7bit I'd be happy to, but how/where do I do that? = Regards, = Logan = ----- On Jul 25, 2016, at 2:56 PM, Sandro Bonazzola = wrote: = | Il 22/Lug/2016 17:10, "Logan Kuhn" < logank(a)wolfram.com > ha scritto: | > Thank you! | > That does do some interesting things, but doesn't appear to work. |> I've added a new storage domain, merged the differences in the metadata = file |> back to the old one and powered it up. When I start up the nodes they en= dlessly |> report: VDSM ovirt-reqa1 command failed: (-226, 'Unable to read resource | > owners', 'Sanlock exception') |> I tried reinstalling one of them and the error message continues. At lea= st for | > now I've restored the old config and the error is gone. | > Regards, | > Logan | Logan, do you mind to write a testcase in ovirt.org website for the disas= ter | recovery test you are doing? Milan, if Logan write it, can you please rev= iew | it? | > ----- On Jul 22, 2016, at 3:06 AM, Milan Zamazal mzamazal(a)redhat.com = wrote: | > | Logan Kuhn < logank(a)wolfram.com > writes: | > |> Am I correct in the assumption that importing a previously master da= ta domain | > |> into a fresh engine without a current master domain is supported? | > | It's supported only in case the master domain was previously correctly | > | detached from the data center. | > | In case of an unexpected complete disaster, when a fresh engine is | > | installed and used, it's still possible to recover the master domain = in | > | theory. You must find `metadata' file in the master domain and edit it | > | for the new engine. It's completely unsupported and it may or may not | > | work. We don't have guidelines how to do it, but you may try to create | > | a new master domain, then detach it and compare the two metadata file= s. | > _______________________________________________ | > Users mailing list | > Users(a)ovirt.org | > http://lists.ovirt.org/mailman/listinfo/users ------=3D_Part_42425213_176413900.1469542552035 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 7bit
I'd be happy to, but how/where do I do that?

<= div data-marker=3D"__SIG_PRE__">Regards,
Logan

----- On Jul 25, 2016, at 2:56 PM, Sandro Bo= nazzola <sbonazzo(a)redhat.com> wrote:

Il 22/Lug/2016 17:10, "Logan Kuhn" <logank(a)wolfram.com> ha scritt= o:
>
> Thank you!
>
> That does do some interesting things, but doesn't appear to work.
>
> I've added a new storage domain, merged the differences in the metadat= a file back to the old one and powered it up.  When I start up the nod= es they endlessly report: VDSM ovirt-reqa1 command failed: (-226, 'Unable t= o read resource owners', 'Sanlock exception')
>
> I tried reinstalling one of them and the error message continues. = ; At least for now I've restored the old config and the error is gone.
>
> Regards,
> Logan
>

Logan, do you mind to write a testcase in ovirt.org website for the disaster recover= y test you are doing? Milan, if Logan write it, can you please review it?

> ----- On Jul 22, 2016, at 3:06 AM, Milan Zamazal mzamazal(a)redhat.com<= /a> wrote:
>
> | Logan Kuhn <
logank(a)wolfram.com> writes:
> |
> |> Am I correct in the assumption that importing a previously maste= r data domain
> |> into a fresh engine without a current master domain is supported= ?
> |
> | It's supported only in case the master domain was previously correct= ly
> | detached from the data center.
> |
> | In case of an unexpected complete disaster, when a fresh engine is > | installed and used, it's still possible to recover the master domain= in
> | theory.  You must find `metadata' file in the master domain and= edit it
> | for the new engine.  It's completely unsupported and it may or = may not
> | work.  We don't have guidelines how to do it, but you may try t= o create
> | a new master domain, then detach it and compare the two metadata fil= es.
> _______________________________________________
> Users mailing list
> Users(a)ovirt.o= rg
> http://lists.ovirt.org/mailman/listinfo/users


------=3D_Part_42425213_176413900.1469542552035-- --===============5848723861545583573== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS0tLS0tPV9QYXJ0XzQyNDI1MjEzXzE3NjQxMzkwMC4xNDY5NTQyNTUyMDM1CkNvbnRlbnQtVHlw ZTogdGV4dC9wbGFpbjsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA3 Yml0CgpJJ2QgYmUgaGFwcHkgdG8sIGJ1dCBob3cvd2hlcmUgZG8gSSBkbyB0aGF0PyAKClJlZ2Fy ZHMsIApMb2dhbiAKCi0tLS0tIE9uIEp1bCAyNSwgMjAxNiwgYXQgMjo1NiBQTSwgU2FuZHJvIEJv bmF6em9sYSA8c2JvbmF6em9AcmVkaGF0LmNvbT4gd3JvdGU6IAoKfCBJbCAyMi9MdWcvMjAxNiAx NzoxMCwgIkxvZ2FuIEt1aG4iIDwgbG9nYW5rQHdvbGZyYW0uY29tID4gaGEgc2NyaXR0bzoKCnwg PiBUaGFuayB5b3UhCgp8ID4gVGhhdCBkb2VzIGRvIHNvbWUgaW50ZXJlc3RpbmcgdGhpbmdzLCBi dXQgZG9lc24ndCBhcHBlYXIgdG8gd29yay4KCnw+IEkndmUgYWRkZWQgYSBuZXcgc3RvcmFnZSBk b21haW4sIG1lcmdlZCB0aGUgZGlmZmVyZW5jZXMgaW4gdGhlIG1ldGFkYXRhIGZpbGUKfD4gYmFj ayB0byB0aGUgb2xkIG9uZSBhbmQgcG93ZXJlZCBpdCB1cC4gV2hlbiBJIHN0YXJ0IHVwIHRoZSBu b2RlcyB0aGV5IGVuZGxlc3NseQp8PiByZXBvcnQ6IFZEU00gb3ZpcnQtcmVxYTEgY29tbWFuZCBm YWlsZWQ6ICgtMjI2LCAnVW5hYmxlIHRvIHJlYWQgcmVzb3VyY2UKfCA+IG93bmVycycsICdTYW5s b2NrIGV4Y2VwdGlvbicpCgp8PiBJIHRyaWVkIHJlaW5zdGFsbGluZyBvbmUgb2YgdGhlbSBhbmQg dGhlIGVycm9yIG1lc3NhZ2UgY29udGludWVzLiBBdCBsZWFzdCBmb3IKfCA+IG5vdyBJJ3ZlIHJl c3RvcmVkIHRoZSBvbGQgY29uZmlnIGFuZCB0aGUgZXJyb3IgaXMgZ29uZS4KCnwgPiBSZWdhcmRz LAp8ID4gTG9nYW4KCgp8IExvZ2FuLCBkbyB5b3UgbWluZCB0byB3cml0ZSBhIHRlc3RjYXNlIGlu IG92aXJ0Lm9yZyB3ZWJzaXRlIGZvciB0aGUgZGlzYXN0ZXIKfCByZWNvdmVyeSB0ZXN0IHlvdSBh cmUgZG9pbmc/IE1pbGFuLCBpZiBMb2dhbiB3cml0ZSBpdCwgY2FuIHlvdSBwbGVhc2UgcmV2aWV3 CnwgaXQ/Cgp8ID4gLS0tLS0gT24gSnVsIDIyLCAyMDE2LCBhdCAzOjA2IEFNLCBNaWxhbiBaYW1h emFsIG16YW1hemFsQHJlZGhhdC5jb20gd3JvdGU6Cgp8ID4gfCBMb2dhbiBLdWhuIDwgbG9nYW5r QHdvbGZyYW0uY29tID4gd3JpdGVzOgoKfCA+IHw+IEFtIEkgY29ycmVjdCBpbiB0aGUgYXNzdW1w dGlvbiB0aGF0IGltcG9ydGluZyBhIHByZXZpb3VzbHkgbWFzdGVyIGRhdGEgZG9tYWluCnwgPiB8 PiBpbnRvIGEgZnJlc2ggZW5naW5lIHdpdGhvdXQgYSBjdXJyZW50IG1hc3RlciBkb21haW4gaXMg c3VwcG9ydGVkPwoKfCA+IHwgSXQncyBzdXBwb3J0ZWQgb25seSBpbiBjYXNlIHRoZSBtYXN0ZXIg ZG9tYWluIHdhcyBwcmV2aW91c2x5IGNvcnJlY3RseQp8ID4gfCBkZXRhY2hlZCBmcm9tIHRoZSBk YXRhIGNlbnRlci4KCnwgPiB8IEluIGNhc2Ugb2YgYW4gdW5leHBlY3RlZCBjb21wbGV0ZSBkaXNh c3Rlciwgd2hlbiBhIGZyZXNoIGVuZ2luZSBpcwp8ID4gfCBpbnN0YWxsZWQgYW5kIHVzZWQsIGl0 J3Mgc3RpbGwgcG9zc2libGUgdG8gcmVjb3ZlciB0aGUgbWFzdGVyIGRvbWFpbiBpbgp8ID4gfCB0 aGVvcnkuIFlvdSBtdXN0IGZpbmQgYG1ldGFkYXRhJyBmaWxlIGluIHRoZSBtYXN0ZXIgZG9tYWlu IGFuZCBlZGl0IGl0CnwgPiB8IGZvciB0aGUgbmV3IGVuZ2luZS4gSXQncyBjb21wbGV0ZWx5IHVu c3VwcG9ydGVkIGFuZCBpdCBtYXkgb3IgbWF5IG5vdAp8ID4gfCB3b3JrLiBXZSBkb24ndCBoYXZl IGd1aWRlbGluZXMgaG93IHRvIGRvIGl0LCBidXQgeW91IG1heSB0cnkgdG8gY3JlYXRlCnwgPiB8 IGEgbmV3IG1hc3RlciBkb21haW4sIHRoZW4gZGV0YWNoIGl0IGFuZCBjb21wYXJlIHRoZSB0d28g bWV0YWRhdGEgZmlsZXMuCnwgPiBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fXwp8ID4gVXNlcnMgbWFpbGluZyBsaXN0CnwgPiBVc2Vyc0BvdmlydC5vcmcKfCA+ IGh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycwoKLS0tLS0tPV9Q YXJ0XzQyNDI1MjEzXzE3NjQxMzkwMC4xNDY5NTQyNTUyMDM1CkNvbnRlbnQtVHlwZTogdGV4dC9o dG1sOyBjaGFyc2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDdiaXQKCjxodG1s Pjxib2R5PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiBBcmlhbDsgZm9udC1zaXplOiAxMnB0OyBj b2xvcjogIzAwMDAwMCI+PGRpdj5JJ2QgYmUgaGFwcHkgdG8sIGJ1dCBob3cvd2hlcmUgZG8gSSBk byB0aGF0PzwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXYgZGF0YS1tYXJrZXI9Il9fU0lHX1BSRV9f Ij5SZWdhcmRzLDxicj5Mb2dhbjwvZGl2Pjxicj48c3BhbiBpZD0iendjaHIiIGRhdGEtbWFya2Vy PSJfX0RJVklERVJfXyI+LS0tLS0gT24gSnVsIDI1LCAyMDE2LCBhdCAyOjU2IFBNLCBTYW5kcm8g Qm9uYXp6b2xhICZsdDtzYm9uYXp6b0ByZWRoYXQuY29tJmd0OyB3cm90ZTo8YnI+PC9zcGFuPjxk aXYgZGF0YS1tYXJrZXI9Il9fUVVPVEVEX1RFWFRfXyI+PGJsb2NrcXVvdGUgc3R5bGU9ImJvcmRl ci1sZWZ0OjJweCBzb2xpZCAjMTAxMEZGO21hcmdpbi1sZWZ0OjVweDtwYWRkaW5nLWxlZnQ6NXB4 O2NvbG9yOiMwMDA7Zm9udC13ZWlnaHQ6bm9ybWFsO2ZvbnQtc3R5bGU6bm9ybWFsO3RleHQtZGVj b3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5OkhlbHZldGljYSxBcmlhbCxzYW5zLXNlcmlmO2ZvbnQt c2l6ZToxMnB0OyI+PHAgZGlyPSJsdHIiPjwvcD4KPHAgZGlyPSJsdHIiPklsIDIyL0x1Zy8yMDE2 IDE3OjEwLCAiTG9nYW4gS3VobiIgJmx0OzxhIGhyZWY9Im1haWx0bzpsb2dhbmtAd29sZnJhbS5j b20iIHRhcmdldD0iX2JsYW5rIj5sb2dhbmtAd29sZnJhbS5jb208L2E+Jmd0OyBoYSBzY3JpdHRv Ojxicj4KJmd0Ozxicj4KJmd0OyBUaGFuayB5b3UhPGJyPgomZ3Q7PGJyPgomZ3Q7IFRoYXQgZG9l cyBkbyBzb21lIGludGVyZXN0aW5nIHRoaW5ncywgYnV0IGRvZXNuJ3QgYXBwZWFyIHRvIHdvcmsu PGJyPgomZ3Q7PGJyPgomZ3Q7IEkndmUgYWRkZWQgYSBuZXcgc3RvcmFnZSBkb21haW4sIG1lcmdl ZCB0aGUgZGlmZmVyZW5jZXMgaW4gdGhlIG1ldGFkYXRhIGZpbGUgYmFjayB0byB0aGUgb2xkIG9u ZSBhbmQgcG93ZXJlZCBpdCB1cC4mbmJzcDsgV2hlbiBJIHN0YXJ0IHVwIHRoZSBub2RlcyB0aGV5 IGVuZGxlc3NseSByZXBvcnQ6IFZEU00gb3ZpcnQtcmVxYTEgY29tbWFuZCBmYWlsZWQ6ICgtMjI2 LCAnVW5hYmxlIHRvIHJlYWQgcmVzb3VyY2Ugb3duZXJzJywgJ1NhbmxvY2sgZXhjZXB0aW9uJyk8 YnI+CiZndDs8YnI+CiZndDsgSSB0cmllZCByZWluc3RhbGxpbmcgb25lIG9mIHRoZW0gYW5kIHRo ZSBlcnJvciBtZXNzYWdlIGNvbnRpbnVlcy4mbmJzcDsgQXQgbGVhc3QgZm9yIG5vdyBJJ3ZlIHJl c3RvcmVkIHRoZSBvbGQgY29uZmlnIGFuZCB0aGUgZXJyb3IgaXMgZ29uZS48YnI+CiZndDs8YnI+ CiZndDsgUmVnYXJkcyw8YnI+CiZndDsgTG9nYW48YnI+CiZndDs8YnI+PC9wPgo8cCBkaXI9Imx0 ciI+TG9nYW4sIGRvIHlvdSBtaW5kIHRvIHdyaXRlIGEgdGVzdGNhc2UgaW4gPGEgaHJlZj0iaHR0 cDovL292aXJ0Lm9yZyIgdGFyZ2V0PSJfYmxhbmsiPm92aXJ0Lm9yZzwvYT4gd2Vic2l0ZSBmb3Ig dGhlIGRpc2FzdGVyIHJlY292ZXJ5IHRlc3QgeW91IGFyZSBkb2luZz8gTWlsYW4sIGlmIExvZ2Fu IHdyaXRlIGl0LCBjYW4geW91IHBsZWFzZSByZXZpZXcgaXQ/PGJyPjxicj48YnI+PC9wPgo8cCBk aXI9Imx0ciI+Jmd0OyAtLS0tLSBPbiBKdWwgMjIsIDIwMTYsIGF0IDM6MDYgQU0sIE1pbGFuIFph bWF6YWwgPGEgaHJlZj0ibWFpbHRvOm16YW1hemFsQHJlZGhhdC5jb20iIHRhcmdldD0iX2JsYW5r Ij5temFtYXphbEByZWRoYXQuY29tPC9hPiB3cm90ZTo8YnI+CiZndDs8YnI+CiZndDsgfCBMb2dh biBLdWhuICZsdDs8YSBocmVmPSJtYWlsdG86bG9nYW5rQHdvbGZyYW0uY29tIiB0YXJnZXQ9Il9i bGFuayI+bG9nYW5rQHdvbGZyYW0uY29tPC9hPiZndDsgd3JpdGVzOjxicj4KJmd0OyB8PGJyPgom Z3Q7IHwmZ3Q7IEFtIEkgY29ycmVjdCBpbiB0aGUgYXNzdW1wdGlvbiB0aGF0IGltcG9ydGluZyBh IHByZXZpb3VzbHkgbWFzdGVyIGRhdGEgZG9tYWluPGJyPgomZ3Q7IHwmZ3Q7IGludG8gYSBmcmVz aCBlbmdpbmUgd2l0aG91dCBhIGN1cnJlbnQgbWFzdGVyIGRvbWFpbiBpcyBzdXBwb3J0ZWQ/PGJy PgomZ3Q7IHw8YnI+CiZndDsgfCBJdCdzIHN1cHBvcnRlZCBvbmx5IGluIGNhc2UgdGhlIG1hc3Rl ciBkb21haW4gd2FzIHByZXZpb3VzbHkgY29ycmVjdGx5PGJyPgomZ3Q7IHwgZGV0YWNoZWQgZnJv bSB0aGUgZGF0YSBjZW50ZXIuPGJyPgomZ3Q7IHw8YnI+CiZndDsgfCBJbiBjYXNlIG9mIGFuIHVu ZXhwZWN0ZWQgY29tcGxldGUgZGlzYXN0ZXIsIHdoZW4gYSBmcmVzaCBlbmdpbmUgaXM8YnI+CiZn dDsgfCBpbnN0YWxsZWQgYW5kIHVzZWQsIGl0J3Mgc3RpbGwgcG9zc2libGUgdG8gcmVjb3ZlciB0 aGUgbWFzdGVyIGRvbWFpbiBpbjxicj4KJmd0OyB8IHRoZW9yeS4mbmJzcDsgWW91IG11c3QgZmlu ZCBgbWV0YWRhdGEnIGZpbGUgaW4gdGhlIG1hc3RlciBkb21haW4gYW5kIGVkaXQgaXQ8YnI+CiZn dDsgfCBmb3IgdGhlIG5ldyBlbmdpbmUuJm5ic3A7IEl0J3MgY29tcGxldGVseSB1bnN1cHBvcnRl ZCBhbmQgaXQgbWF5IG9yIG1heSBub3Q8YnI+CiZndDsgfCB3b3JrLiZuYnNwOyBXZSBkb24ndCBo YXZlIGd1aWRlbGluZXMgaG93IHRvIGRvIGl0LCBidXQgeW91IG1heSB0cnkgdG8gY3JlYXRlPGJy PgomZ3Q7IHwgYSBuZXcgbWFzdGVyIGRvbWFpbiwgdGhlbiBkZXRhY2ggaXQgYW5kIGNvbXBhcmUg dGhlIHR3byBtZXRhZGF0YSBmaWxlcy48YnI+CiZndDsgX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX188YnI+CiZndDsgVXNlcnMgbWFpbGluZyBsaXN0PGJyPgom Z3Q7IDxhIGhyZWY9Im1haWx0bzpVc2Vyc0BvdmlydC5vcmciIHRhcmdldD0iX2JsYW5rIj5Vc2Vy c0BvdmlydC5vcmc8L2E+PGJyPgomZ3Q7IDxhIGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcv bWFpbG1hbi9saXN0aW5mby91c2VycyIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9saXN0cy5vdmly dC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VyczwvYT48L3A+PGJyPjwvYmxvY2txdW90ZT48L2Rp dj48L2Rpdj48L2JvZHk+PC9odG1sPgotLS0tLS09X1BhcnRfNDI0MjUyMTNfMTc2NDEzOTAwLjE0 Njk1NDI1NTIwMzUtLQo= --===============5848723861545583573==--