From florent.bello at ville-kourou.fr Fri Sep 25 11:42:22 2015 Content-Type: multipart/mixed; boundary="===============0912834292146179931==" MIME-Version: 1.0 From: Bello Florent To: users at ovirt.org Subject: [ovirt-users] Another way of CTDB to mount engine Date: Fri, 25 Sep 2015 12:36:04 -0300 Message-ID: <3a01d7eb45ed34aea81c550970770256@ville-kourou.fr> --===============0912834292146179931== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable --=3D_e307ea5a1316c74406ff13dc63f12383 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=3DUTF-8 = Hi, = I have 3 nodes with glusterfs installed. I configured replica 3 on my engine volume. i don't want to use ctdb for my hosted-engine, but when i start hosted-engine --deploy, use localhost:/engine or gluster.localdomain:/engine, gluster.localdomain is configured in all servers /etc/hosts like : host 1 : "192.168.100.101 gluster.localdomain gluster" host 2 : "192.168.100.102 gluster.localdomain gluster" host 3 : "192.168.100.103 gluster.localdomain gluster", = the setup failed with : --=3D=3D STORAGE CONFIGURATION =3D=3D-- During customization use CTRL-D to abort. Please specify the storage you would like to use (glusterfs, iscsi, fc, nfs3, nfs4)[nfs3]: glusterfs [ INFO ] Please note that Replica 3 support is required for the shared storage. Please specify the full shared storage connection path to use (example: host:/path): localhost:/engine [WARNING] Due to several bugs in mount.glusterfs the validation of GlusterFS share cannot be reliable. [ INFO ] GlusterFS replica 3 Volume detected [ ERROR ] Failed to execute stage 'Environment customization': Connection to storage server failed [ INFO ] Stage: Clean up [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20150925121036.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination = I have to use obligatory ctdb or keepalived, or existing another way ? = -- Florent BELLO Service Informatique informatique(a)ville-kourou.fr 0594 22 31 22 Mairie de Kourou = --=3D_e307ea5a1316c74406ff13dc63f12383 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=3DUTF-8

Hi,

I have 3 nodes with glusterfs installed. I configured replica 3 on my en= =3D gine volume.

i don't want to use ctdb for my hosted-engine, but = =3D when i start hosted-engine --deploy, use localhost:/engine or gluster.local= =3D domain:/engine, gluster.localdomain is configured in all servers /etc/hosts= =3D like :
host 1 : "192.168.100.101 gluster.localdomain gluster"
ho= =3D st 2 : "192.168.100.102 gluster.localdomain gluster"
host 3 : "192.168= =3D =3D2E100.103 gluster.localdomain gluster",

the setup failed with :

--=3D3D=3D3D STORAGE CONFIGURATION =3D3D=3D3D--

  &= nbsp;&nb=3D sp;      During customization use CTRL-D to abort= =3D =3D2E
          Please sp= ec=3D ify the storage you would like to use (glusterfs, iscsi, fc, nfs3, nfs4)[nf= =3D s3]: glusterfs
[ INFO  ] Please note that Replica 3 support is re= =3D quired for the shared storage.
      &nb= =3D sp;   Please specify the full shared storage connection path to u= =3D se (example: host:/path): localhost:/engine
[WARNING] Due to several b= =3D ugs in mount.glusterfs the validation of GlusterFS share cannot be reliable= =3D =3D2E
[ INFO  ] GlusterFS replica 3 Volume detected
[ ERROR = ] =3D Failed to execute stage 'Environment customization': Connection to storage = =3D server failed
[ INFO  ] Stage: Clean up
[ INFO  ] Gener= =3D ating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20150= =3D 925121036.conf'
[ INFO  ] Stage: Pre-termination
[ INFO = =3D ; ] Stage: Termination

I have to use obligatory ctdb or keepalived, or existing another way ?

--

Florent BELLO
Service Informatique
informatique(a)ville-kourou= =3D =3D2Efr
0594 22 31 22
Mairie de Kourou

--=3D_e307ea5a1316c74406ff13dc63f12383-- --===============0912834292146179931== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS09X2UzMDdlYTVhMTMxNmM3NDQwNmZmMTNkYzYzZjEyMzgzCkNvbnRlbnQtVHJhbnNmZXItRW5j b2Rpbmc6IDdiaXQKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFyc2V0PVVURi04CgogCgpI aSwgCgpJIGhhdmUgMyBub2RlcyB3aXRoIGdsdXN0ZXJmcyBpbnN0YWxsZWQuIEkgY29uZmlndXJl ZCByZXBsaWNhCjMgb24gbXkgZW5naW5lIHZvbHVtZS4KCmkgZG9uJ3Qgd2FudCB0byB1c2UgY3Rk YiBmb3IgbXkgaG9zdGVkLWVuZ2luZSwKYnV0IHdoZW4gaSBzdGFydCBob3N0ZWQtZW5naW5lIC0t ZGVwbG95LCB1c2UgbG9jYWxob3N0Oi9lbmdpbmUgb3IKZ2x1c3Rlci5sb2NhbGRvbWFpbjovZW5n aW5lLCBnbHVzdGVyLmxvY2FsZG9tYWluIGlzIGNvbmZpZ3VyZWQgaW4gYWxsCnNlcnZlcnMgL2V0 Yy9ob3N0cyBsaWtlIDoKaG9zdCAxIDogIjE5Mi4xNjguMTAwLjEwMSBnbHVzdGVyLmxvY2FsZG9t YWluCmdsdXN0ZXIiCmhvc3QgMiA6ICIxOTIuMTY4LjEwMC4xMDIgZ2x1c3Rlci5sb2NhbGRvbWFp biBnbHVzdGVyIgpob3N0IDMgOgoiMTkyLjE2OC4xMDAuMTAzIGdsdXN0ZXIubG9jYWxkb21haW4g Z2x1c3RlciIsIAoKdGhlIHNldHVwIGZhaWxlZCB3aXRoIDoKCgotLT09IFNUT1JBR0UgQ09ORklH VVJBVElPTiA9PS0tCgogRHVyaW5nIGN1c3RvbWl6YXRpb24gdXNlIENUUkwtRCB0bwphYm9ydC4K IFBsZWFzZSBzcGVjaWZ5IHRoZSBzdG9yYWdlIHlvdSB3b3VsZCBsaWtlIHRvIHVzZSAoZ2x1c3Rl cmZzLAppc2NzaSwgZmMsIG5mczMsIG5mczQpW25mczNdOiBnbHVzdGVyZnMKWyBJTkZPIF0gUGxl YXNlIG5vdGUgdGhhdApSZXBsaWNhIDMgc3VwcG9ydCBpcyByZXF1aXJlZCBmb3IgdGhlIHNoYXJl ZCBzdG9yYWdlLgogUGxlYXNlIHNwZWNpZnkKdGhlIGZ1bGwgc2hhcmVkIHN0b3JhZ2UgY29ubmVj dGlvbiBwYXRoIHRvIHVzZSAoZXhhbXBsZTogaG9zdDovcGF0aCk6CmxvY2FsaG9zdDovZW5naW5l CltXQVJOSU5HXSBEdWUgdG8gc2V2ZXJhbCBidWdzIGluIG1vdW50LmdsdXN0ZXJmcyB0aGUKdmFs aWRhdGlvbiBvZiBHbHVzdGVyRlMgc2hhcmUgY2Fubm90IGJlIHJlbGlhYmxlLgpbIElORk8gXSBH bHVzdGVyRlMKcmVwbGljYSAzIFZvbHVtZSBkZXRlY3RlZApbIEVSUk9SIF0gRmFpbGVkIHRvIGV4 ZWN1dGUgc3RhZ2UgJ0Vudmlyb25tZW50CmN1c3RvbWl6YXRpb24nOiBDb25uZWN0aW9uIHRvIHN0 b3JhZ2Ugc2VydmVyIGZhaWxlZApbIElORk8gXSBTdGFnZToKQ2xlYW4gdXAKWyBJTkZPIF0gR2Vu ZXJhdGluZyBhbnN3ZXIgZmlsZQonL3Zhci9saWIvb3ZpcnQtaG9zdGVkLWVuZ2luZS1zZXR1cC9h bnN3ZXJzL2Fuc3dlcnMtMjAxNTA5MjUxMjEwMzYuY29uZicKWwpJTkZPIF0gU3RhZ2U6IFByZS10 ZXJtaW5hdGlvbgpbIElORk8gXSBTdGFnZTogVGVybWluYXRpb24gCgpJIGhhdmUgdG8KdXNlIG9i bGlnYXRvcnkgY3RkYiBvciBrZWVwYWxpdmVkLCBvciBleGlzdGluZyBhbm90aGVyIHdheSA/IAot LQoKCkZsb3JlbnQgQkVMTE8KU2VydmljZSBJbmZvcm1hdGlxdWUKaW5mb3JtYXRpcXVlQHZpbGxl LWtvdXJvdS5mcgowNTk0CjIyIDMxIDIyCk1haXJpZSBkZSBLb3Vyb3UgCi0tPV9lMzA3ZWE1YTEz MTZjNzQ0MDZmZjEzZGM2M2YxMjM4MwpDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiBxdW90ZWQt cHJpbnRhYmxlCkNvbnRlbnQtVHlwZTogdGV4dC9odG1sOyBjaGFyc2V0PVVURi04Cgo8IURPQ1RZ UEUgaHRtbCBQVUJMSUMgIi0vL1czQy8vRFREIFhIVE1MIDEuMCBUcmFuc2l0aW9uYWwvL0VOIj4K PGh0bWw+PGJvZHk+CjxwPkhpLDwvcD4KPHA+SSBoYXZlIDMgbm9kZXMgd2l0aCBnbHVzdGVyZnMg aW5zdGFsbGVkLiBJIGNvbmZpZ3VyZWQgcmVwbGljYSAzIG9uIG15IGVuPQpnaW5lIHZvbHVtZS48 YnIgLz48YnIgLz5pIGRvbid0IHdhbnQgdG8gdXNlIGN0ZGIgZm9yIG15IGhvc3RlZC1lbmdpbmUs IGJ1dCA9CndoZW4gaSBzdGFydCBob3N0ZWQtZW5naW5lIC0tZGVwbG95LCB1c2UgbG9jYWxob3N0 Oi9lbmdpbmUgb3IgZ2x1c3Rlci5sb2NhbD0KZG9tYWluOi9lbmdpbmUsIGdsdXN0ZXIubG9jYWxk b21haW4gaXMgY29uZmlndXJlZCBpbiBhbGwgc2VydmVycyAvZXRjL2hvc3RzPQogbGlrZSA6PGJy IC8+aG9zdCAxIDogIjE5Mi4xNjguMTAwLjEwMSBnbHVzdGVyLmxvY2FsZG9tYWluIGdsdXN0ZXIi PGJyIC8+aG89CnN0IDIgOiAiMTkyLjE2OC4xMDAuMTAyIGdsdXN0ZXIubG9jYWxkb21haW4gZ2x1 c3RlciI8YnIgLz5ob3N0IDMgOiAiMTkyLjE2OD0KPTJFMTAwLjEwMyBnbHVzdGVyLmxvY2FsZG9t YWluIGdsdXN0ZXIiLDwvcD4KPHA+dGhlIHNldHVwIGZhaWxlZCB3aXRoIDo8L3A+CjxwPi0tPTNE PTNEIFNUT1JBR0UgQ09ORklHVVJBVElPTiA9M0Q9M0QtLTxiciAvPjxiciAvPiZuYnNwOyZuYnNw OyZuYnNwOyZuYj0Kc3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7IER1cmluZyBjdXN0 b21pemF0aW9uIHVzZSBDVFJMLUQgdG8gYWJvcnQ9Cj0yRTxiciAvPiZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBQbGVhc2Ugc3BlYz0KaWZ5IHRo ZSBzdG9yYWdlIHlvdSB3b3VsZCBsaWtlIHRvIHVzZSAoZ2x1c3RlcmZzLCBpc2NzaSwgZmMsIG5m czMsIG5mczQpW25mPQpzM106IGdsdXN0ZXJmczxiciAvPlsgSU5GTyZuYnNwOyBdIFBsZWFzZSBu b3RlIHRoYXQgUmVwbGljYSAzIHN1cHBvcnQgaXMgcmU9CnF1aXJlZCBmb3IgdGhlIHNoYXJlZCBz dG9yYWdlLjxiciAvPiZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYj0Kc3A7 Jm5ic3A7Jm5ic3A7IFBsZWFzZSBzcGVjaWZ5IHRoZSBmdWxsIHNoYXJlZCBzdG9yYWdlIGNvbm5l Y3Rpb24gcGF0aCB0byB1PQpzZSAoZXhhbXBsZTogaG9zdDovcGF0aCk6IGxvY2FsaG9zdDovZW5n aW5lPGJyIC8+W1dBUk5JTkddIER1ZSB0byBzZXZlcmFsIGI9CnVncyBpbiBtb3VudC5nbHVzdGVy ZnMgdGhlIHZhbGlkYXRpb24gb2YgR2x1c3RlckZTIHNoYXJlIGNhbm5vdCBiZSByZWxpYWJsZT0K PTJFPGJyIC8+WyBJTkZPJm5ic3A7IF0gR2x1c3RlckZTIHJlcGxpY2EgMyBWb2x1bWUgZGV0ZWN0 ZWQ8YnIgLz5bIEVSUk9SIF0gPQpGYWlsZWQgdG8gZXhlY3V0ZSBzdGFnZSAnRW52aXJvbm1lbnQg Y3VzdG9taXphdGlvbic6IENvbm5lY3Rpb24gdG8gc3RvcmFnZSA9CnNlcnZlciBmYWlsZWQ8YnIg Lz5bIElORk8mbmJzcDsgXSBTdGFnZTogQ2xlYW4gdXA8YnIgLz5bIElORk8mbmJzcDsgXSBHZW5l cj0KYXRpbmcgYW5zd2VyIGZpbGUgJy92YXIvbGliL292aXJ0LWhvc3RlZC1lbmdpbmUtc2V0dXAv YW5zd2Vycy9hbnN3ZXJzLTIwMTUwPQo5MjUxMjEwMzYuY29uZic8YnIgLz5bIElORk8mbmJzcDsg XSBTdGFnZTogUHJlLXRlcm1pbmF0aW9uPGJyIC8+WyBJTkZPJm5ic3A9CjsgXSBTdGFnZTogVGVy bWluYXRpb248L3A+CjxwPkkgaGF2ZSB0byB1c2Ugb2JsaWdhdG9yeSBjdGRiIG9yIGtlZXBhbGl2 ZWQsIG9yIGV4aXN0aW5nIGFub3RoZXIgd2F5ID88Lz0KcD4KPGRpdj4tLSA8YnIgLz4KPHA+Rmxv cmVudCBCRUxMTzxiciAvPlNlcnZpY2UgSW5mb3JtYXRpcXVlPGJyIC8+aW5mb3JtYXRpcXVlQHZp bGxlLWtvdXJvdT0KPTJFZnI8YnIgLz4wNTk0IDIyIDMxIDIyPGJyIC8+TWFpcmllIGRlIEtvdXJv dTwvcD4KPC9kaXY+CjwvYm9keT48L2h0bWw+CgotLT1fZTMwN2VhNWExMzE2Yzc0NDA2ZmYxM2Rj NjNmMTIzODMtLQoK --===============0912834292146179931==-- From stirabos at redhat.com Mon Sep 28 04:45:33 2015 Content-Type: multipart/mixed; boundary="===============1646210806854825686==" MIME-Version: 1.0 From: Simone Tiraboschi To: users at ovirt.org Subject: Re: [ovirt-users] Another way of CTDB to mount engine Date: Mon, 28 Sep 2015 10:45:02 +0200 Message-ID: In-Reply-To: 3a01d7eb45ed34aea81c550970770256@ville-kourou.fr --===============1646210806854825686== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On Fri, Sep 25, 2015 at 5:36 PM, Bello Florent < florent.bello(a)ville-kourou.fr> wrote: > Hi, > > I have 3 nodes with glusterfs installed. I configured replica 3 on my > engine volume. > Hi, on oVirt 3.6 we still not support hyper convergence that means that you cannot use the same hosts for virtualization and for storage with gluster. So the correct approach is renaming your hosts to: host 1 : "192.168.100.101 gluster1.localdomain gluster1" host 2 : "192.168.100.102 gluster2.localdomain gluster2" host 3 : "192.168.100.103 gluster3.localdomain gluster3" On an additional host, deploy hosted-engine choosing the gluster host you prefer as your entry point: it will not be a single point of failure. You don't really need to use CTDB to deploy oVirt hosted-engine. > i don't want to use ctdb for my hosted-engine, but when i start > hosted-engine --deploy, use localhost:/engine or > gluster.localdomain:/engine, gluster.localdomain is configured in all > servers /etc/hosts like : > host 1 : "192.168.100.101 gluster.localdomain gluster" > host 2 : "192.168.100.102 gluster.localdomain gluster" > host 3 : "192.168.100.103 gluster.localdomain gluster", > > the setup failed with : > > --=3D=3D STORAGE CONFIGURATION =3D=3D-- > > During customization use CTRL-D to abort. > Please specify the storage you would like to use (glusterfs, > iscsi, fc, nfs3, nfs4)[nfs3]: glusterfs > [ INFO ] Please note that Replica 3 support is required for the shared > storage. > Please specify the full shared storage connection path to use > (example: host:/path): localhost:/engine > [WARNING] Due to several bugs in mount.glusterfs the validation of > GlusterFS share cannot be reliable. > [ INFO ] GlusterFS replica 3 Volume detected > [ ERROR ] Failed to execute stage 'Environment customization': Connection > to storage server failed > [ INFO ] Stage: Clean up > [ INFO ] Generating answer file > '/var/lib/ovirt-hosted-engine-setup/answers/answers-20150925121036.conf' > [ INFO ] Stage: Pre-termination > [ INFO ] Stage: Termination > > I have to use obligatory ctdb or keepalived, or existing another way ? > -- > > Florent BELLO > Service Informatique > informatique(a)ville-kourou.fr > 0594 22 31 22 > Mairie de Kourou > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > --===============1646210806854825686== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGJyPjxkaXYgY2xhc3M9ImdtYWlsX2V4dHJhIj48YnI+PGRpdiBjbGFz cz0iZ21haWxfcXVvdGUiPk9uIEZyaSwgU2VwIDI1LCAyMDE1IGF0IDU6MzYgUE0sIEJlbGxvIEZs b3JlbnQgPHNwYW4gZGlyPSJsdHIiPiZsdDs8YSBocmVmPSJtYWlsdG86ZmxvcmVudC5iZWxsb0B2 aWxsZS1rb3Vyb3UuZnIiIHRhcmdldD0iX2JsYW5rIj5mbG9yZW50LmJlbGxvQHZpbGxlLWtvdXJv dS5mcjwvYT4mZ3Q7PC9zcGFuPiB3cm90ZTo8YnI+PGJsb2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1 b3RlIiBzdHlsZT0ibWFyZ2luOjBweCAwcHggMHB4IDAuOGV4O2JvcmRlci1sZWZ0LXdpZHRoOjFw eDtib3JkZXItbGVmdC1jb2xvcjpyZ2IoMjA0LDIwNCwyMDQpO2JvcmRlci1sZWZ0LXN0eWxlOnNv bGlkO3BhZGRpbmctbGVmdDoxZXgiPjx1PjwvdT4KPGRpdj4KPHA+SGksPC9wPgo8cD5JIGhhdmUg MyBub2RlcyB3aXRoIGdsdXN0ZXJmcyBpbnN0YWxsZWQuIEkgY29uZmlndXJlZCByZXBsaWNhIDMg b24gbXkgZW5naW5lIHZvbHVtZS48YnI+PC9wPjwvZGl2PjwvYmxvY2txdW90ZT48ZGl2Pjxicj48 L2Rpdj48ZGl2PkhpLDwvZGl2PjxkaXY+b24gb1ZpcnQgwqAzLjYgd2Ugc3RpbGwgbm90IHN1cHBv cnQgaHlwZXIgY29udmVyZ2VuY2UgdGhhdCBtZWFucyB0aGF0IHlvdSBjYW5ub3QgdXNlIHRoZSBz YW1lIGhvc3RzIGZvciB2aXJ0dWFsaXphdGlvbiBhbmQgZm9yIHN0b3JhZ2Ugd2l0aCBnbHVzdGVy LjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+U28gdGhlIGNvcnJlY3QgYXBwcm9hY2ggaXMgcmVu YW1pbmcgeW91ciBob3N0cyB0bzo8L2Rpdj48ZGl2Pmhvc3QgMSA6ICZxdW90OzE5Mi4xNjguMTAw LjEwMSBnbHVzdGVyMS5sb2NhbGRvbWFpbiBnbHVzdGVyMSZxdW90Ozxicj5ob3N0IDIgOiAmcXVv dDsxOTIuMTY4LjEwMC4xMDIgZ2x1c3RlcjIubG9jYWxkb21haW4gZ2x1c3RlcjImcXVvdDs8YnI+ aG9zdCAzIDogJnF1b3Q7MTkyLjE2OC4xMDAuMTAzIGdsdXN0ZXIzLmxvY2FsZG9tYWluIGdsdXN0 ZXIzJnF1b3Q7PGJyPjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+T24gYW4gYWRkaXRpb25hbCBo b3N0LCBkZXBsb3kgaG9zdGVkLWVuZ2luZSBjaG9vc2luZyB0aGUgZ2x1c3RlciBob3N0IHlvdSBw cmVmZXIgYXMgeW91ciBlbnRyeSBwb2ludDogaXQgd2lsbCBub3QgYmUgYSBzaW5nbGUgcG9pbnQg b2YgZmFpbHVyZS48L2Rpdj48ZGl2PllvdSBkb24mIzM5O3QgcmVhbGx5IG5lZWQgdG8gdXNlIENU REIgdG8gZGVwbG95IG9WaXJ0IGhvc3RlZC1lbmdpbmUuPC9kaXY+PGRpdj48YnI+PC9kaXY+PGJs b2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjBweCAwcHggMHB4IDAu OGV4O2JvcmRlci1sZWZ0LXdpZHRoOjFweDtib3JkZXItbGVmdC1jb2xvcjpyZ2IoMjA0LDIwNCwy MDQpO2JvcmRlci1sZWZ0LXN0eWxlOnNvbGlkO3BhZGRpbmctbGVmdDoxZXgiPjxkaXY+PHA+PGJy PmkgZG9uJiMzOTt0IHdhbnQgdG8gdXNlIGN0ZGIgZm9yIG15IGhvc3RlZC1lbmdpbmUsIGJ1dCB3 aGVuIGkgc3RhcnQgaG9zdGVkLWVuZ2luZSAtLWRlcGxveSwgdXNlIGxvY2FsaG9zdDovZW5naW5l IG9yIGdsdXN0ZXIubG9jYWxkb21haW46L2VuZ2luZSwgZ2x1c3Rlci5sb2NhbGRvbWFpbiBpcyBj b25maWd1cmVkIGluIGFsbCBzZXJ2ZXJzIC9ldGMvaG9zdHMgbGlrZSA6PGJyPmhvc3QgMSA6ICZx dW90OzE5Mi4xNjguMTAwLjEwMSBnbHVzdGVyLmxvY2FsZG9tYWluIGdsdXN0ZXImcXVvdDs8YnI+ aG9zdCAyIDogJnF1b3Q7MTkyLjE2OC4xMDAuMTAyIGdsdXN0ZXIubG9jYWxkb21haW4gZ2x1c3Rl ciZxdW90Ozxicj5ob3N0IDMgOiAmcXVvdDsxOTIuMTY4LjEwMC4xMDMgZ2x1c3Rlci5sb2NhbGRv bWFpbiBnbHVzdGVyJnF1b3Q7LDwvcD4KPHA+dGhlIHNldHVwIGZhaWxlZCB3aXRoIDo8L3A+Cjxw Pi0tPT0gU1RPUkFHRSBDT05GSUdVUkFUSU9OID09LS08YnI+PGJyPsKgwqDCoMKgwqDCoMKgwqDC oCBEdXJpbmcgY3VzdG9taXphdGlvbiB1c2UgQ1RSTC1EIHRvIGFib3J0Ljxicj7CoMKgwqDCoMKg wqDCoMKgwqAgUGxlYXNlIHNwZWNpZnkgdGhlIHN0b3JhZ2UgeW91IHdvdWxkIGxpa2UgdG8gdXNl IChnbHVzdGVyZnMsIGlzY3NpLCBmYywgbmZzMywgbmZzNClbbmZzM106IGdsdXN0ZXJmczxicj5b IElORk/CoCBdIFBsZWFzZSBub3RlIHRoYXQgUmVwbGljYSAzIHN1cHBvcnQgaXMgcmVxdWlyZWQg Zm9yIHRoZSBzaGFyZWQgc3RvcmFnZS48YnI+wqDCoMKgwqDCoMKgwqDCoMKgIFBsZWFzZSBzcGVj aWZ5IHRoZSBmdWxsIHNoYXJlZCBzdG9yYWdlIGNvbm5lY3Rpb24gcGF0aCB0byB1c2UgKGV4YW1w bGU6IGhvc3Q6L3BhdGgpOiBsb2NhbGhvc3Q6L2VuZ2luZTxicj5bV0FSTklOR10gRHVlIHRvIHNl dmVyYWwgYnVncyBpbiBtb3VudC5nbHVzdGVyZnMgdGhlIHZhbGlkYXRpb24gb2YgR2x1c3RlckZT IHNoYXJlIGNhbm5vdCBiZSByZWxpYWJsZS48YnI+WyBJTkZPwqAgXSBHbHVzdGVyRlMgcmVwbGlj YSAzIFZvbHVtZSBkZXRlY3RlZDxicj5bIEVSUk9SIF0gRmFpbGVkIHRvIGV4ZWN1dGUgc3RhZ2Ug JiMzOTtFbnZpcm9ubWVudCBjdXN0b21pemF0aW9uJiMzOTs6IENvbm5lY3Rpb24gdG8gc3RvcmFn ZSBzZXJ2ZXIgZmFpbGVkPGJyPlsgSU5GT8KgIF0gU3RhZ2U6IENsZWFuIHVwPGJyPlsgSU5GT8Kg IF0gR2VuZXJhdGluZyBhbnN3ZXIgZmlsZSAmIzM5Oy92YXIvbGliL292aXJ0LWhvc3RlZC1lbmdp bmUtc2V0dXAvYW5zd2Vycy9hbnN3ZXJzLTIwMTUwOTI1MTIxMDM2LmNvbmYmIzM5Ozxicj5bIElO Rk/CoCBdIFN0YWdlOiBQcmUtdGVybWluYXRpb248YnI+WyBJTkZPwqAgXSBTdGFnZTogVGVybWlu YXRpb248L3A+CjxwPkkgaGF2ZSB0byB1c2Ugb2JsaWdhdG9yeSBjdGRiIG9yIGtlZXBhbGl2ZWQs IG9yIGV4aXN0aW5nIGFub3RoZXIgd2F5ID88L3A+PHNwYW4gY2xhc3M9IiI+PGZvbnQgY29sb3I9 IiM4ODg4ODgiPgo8ZGl2Pi0tIDxicj4KPHA+RmxvcmVudCBCRUxMTzxicj5TZXJ2aWNlIEluZm9y bWF0aXF1ZTxicj48YSBocmVmPSJtYWlsdG86aW5mb3JtYXRpcXVlQHZpbGxlLWtvdXJvdS5mciIg dGFyZ2V0PSJfYmxhbmsiPmluZm9ybWF0aXF1ZUB2aWxsZS1rb3Vyb3UuZnI8L2E+PGJyPjA1OTQg MjIgMzEgMjI8YnI+TWFpcmllIGRlIEtvdXJvdTwvcD4KPC9kaXY+CjwvZm9udD48L3NwYW4+PC9k aXY+Cjxicj5fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXzxi cj4KVXNlcnMgbWFpbGluZyBsaXN0PGJyPgo8YSBocmVmPSJtYWlsdG86VXNlcnNAb3ZpcnQub3Jn Ij5Vc2Vyc0BvdmlydC5vcmc8L2E+PGJyPgo8YSBocmVmPSJodHRwOi8vbGlzdHMub3ZpcnQub3Jn L21haWxtYW4vbGlzdGluZm8vdXNlcnMiIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsi Pmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VyczwvYT48YnI+Cjxi cj48L2Jsb2NrcXVvdGU+PC9kaXY+PGJyPjwvZGl2PjwvZGl2Pgo= --===============1646210806854825686==-- From florent.bello at ville-kourou.fr Mon Sep 28 07:35:25 2015 Content-Type: multipart/mixed; boundary="===============8442961952940395636==" MIME-Version: 1.0 From: Bello Florent To: users at ovirt.org Subject: Re: [ovirt-users] Another way of CTDB to mount engine Date: Mon, 28 Sep 2015 08:35:17 -0300 Message-ID: <979898fff6c86967a37200b2c9d62a3c@ville-kourou.fr> In-Reply-To: CAN8-ONp567TK_ySAtPwdti-WHd5po23SO1WuyAwY11eeTk8N1Q@mail.gmail.com --===============8442961952940395636== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable --=3D_224623595751127a21f519d8c22ea815 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=3DUTF-8 = hi, = It's really not a single point of failure ? In this way i see 2 point of failure, if the hosted-engine break and if the mount server adress break. And it's not possible to migrate the engine. = Can you explain me why is not a point of failure for you ? = -- = Florent BELLO Le 28/09/2015 05:45, Simone Tiraboschi a =C3=A9crit : = > On Fri, Sep 25, 2015 at 5:36 PM, Bello Florent wrote: > >> Hi, = >> = >> I have 3 nodes with glusterfs installed. I configured replica 3 on my engine volume. > = > Hi, = > on oVirt 3.6 we still not support hyper convergence that means that you cannot use the same hosts for virtualization and for storage with gluster. = > = > So the correct approach is renaming your hosts to: = > host 1 : "192.168.100.101 gluster1.localdomain gluster1" > host 2 : "192.168.100.102 gluster2.localdomain gluster2" > host 3 : "192.168.100.103 gluster3.localdomain gluster3" = > = > On an additional host, deploy hosted-engine choosing the gluster host you prefer as your entry point: it will not be a single point of failure. = > You don't really need to use CTDB to deploy oVirt hosted-engine. = > = >> i don't want to use ctdb for my hosted-engine, but when i start hosted-engine --deploy, use localhost:/engine or gluster.localdomain:/engine, gluster.localdomain is configured in all servers /etc/hosts like : >> host 1 : "192.168.100.101 gluster.localdomain gluster" >> host 2 : "192.168.100.102 gluster.localdomain gluster" >> host 3 : "192.168.100.103 gluster.localdomain gluster", = >> = >> the setup failed with : = >> = >> --=3D=3D STORAGE CONFIGURATION =3D=3D-- >> = >> During customization use CTRL-D to abort. >> Please specify the storage you would like to use (glusterfs, iscsi, fc, nfs3, nfs4)[nfs3]: glusterfs >> [ INFO ] Please note that Replica 3 support is required for the shared storage. >> Please specify the full shared storage connection path to use (example: host:/path): localhost:/engine >> [WARNING] Due to several bugs in mount.glusterfs the validation of GlusterFS share cannot be reliable. >> [ INFO ] GlusterFS replica 3 Volume detected >> [ ERROR ] Failed to execute stage 'Environment customization': Connection to storage server failed >> [ INFO ] Stage: Clean up >> [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20150925121036.conf' >> [ INFO ] Stage: Pre-termination >> [ INFO ] Stage: Termination = >> = >> I have to use obligatory ctdb or keepalived, or existing another way ? >> -- = >> = >> Florent BELLO >> Service Informatique >> informatique(a)ville-kourou.fr >> 0594 22 31 22 >> Mairie de Kourou = >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users [1] Links: ------ [1] http://lists.ovirt.org/mailman/listinfo/users --=3D_224623595751127a21f519d8c22ea815 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=3DUTF-8
hi,
 
It's really not a single point of failure ? In this way i see 2 point = =3D of failure, if the hosted-engine break and if the mount server adress break= =3D =3D2E And it's not possible to migrate the engine.
 

Can you explain me why is not a point of failure for you ?

 

--

Florent BELLO

 

Le 28/09/2015 05:45, Simone Tiraboschi a écrit :



On Fri, Sep 25, 2015 at 5:36 PM, Bello Florent= <=3D span><florent.bello= (a)vil=3D le-kourou.fr> wrote:

Hi,

I have 3 nodes with glusterfs installed. I configured replica 3 on my en= =3D gine volume.

 
Hi,
on oVirt  3.6 we still not support hyper convergence that means t= =3D hat you cannot use the same hosts for virtualization and for storage with g= =3D luster.
 
So the correct approach is renaming your hosts to:
host 1 : "192.168.100.101 gluster1.localdomain gluster1"
host 2 := =3D "192.168.100.102 gluster2.localdomain gluster2"
host 3 : "192.168.100= =3D =3D2E103 gluster3.localdomain gluster3"
 
On an additional host, deploy hosted-engine choosing the gluster host = =3D you prefer as your entry point: it will not be a single point of failure.
You don't really need to use CTDB to deploy oVirt hosted-engine.
 


i don't want to use ctdb for my hosted-engine, but when i start ho= =3D sted-engine --deploy, use localhost:/engine or gluster.localdomain:/engine,= =3D gluster.localdomain is configured in all servers /etc/hosts like :
ho= =3D st 1 : "192.168.100.101 gluster.localdomain gluster"
host 2 : "192.168= =3D =3D2E100.102 gluster.localdomain gluster"
host 3 : "192.168.100.103 gl= us=3D ter.localdomain gluster",

the setup failed with :

--=3D3D=3D3D STORAGE CONFIGURATION =3D3D=3D3D--

  &= nbsp;&nb=3D sp;      During customization use CTRL-D to abort= =3D =3D2E
          Please sp= ec=3D ify the storage you would like to use (glusterfs, iscsi, fc, nfs3, nfs4)[nf= =3D s3]: glusterfs
[ INFO  ] Please note that Replica 3 support is re= =3D quired for the shared storage.
      &nb= =3D sp;   Please specify the full shared storage connection path to u= =3D se (example: host:/path): localhost:/engine
[WARNING] Due to several b= =3D ugs in mount.glusterfs the validation of GlusterFS share cannot be reliable= =3D =3D2E
[ INFO  ] GlusterFS replica 3 Volume detected
[ ERROR = ] =3D Failed to execute stage 'Environment customization': Connection to storage = =3D server failed
[ INFO  ] Stage: Clean up
[ INFO  ] Gener= =3D ating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20150= =3D 925121036.conf'
[ INFO  ] Stage: Pre-termination
[ INFO = =3D ; ] Stage: Termination

I have to use obligatory ctdb or keepalived, or existing another way ?

--

Florent BELLO
Service Informatique
informatique(a)ville-kourou.fr
0594 22 31 2= 2Mairie de Kourou


_______________________________________________
Users mailing l= =3D ist
Users(a)ovirt.org
= http://lists.ovirt.or= g/=3D mailman/listinfo/users

--=3D_224623595751127a21f519d8c22ea815-- --===============8442961952940395636== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS09XzIyNDYyMzU5NTc1MTEyN2EyMWY1MTlkOGMyMmVhODE1CkNvbnRlbnQtVHJhbnNmZXItRW5j b2Rpbmc6IDhiaXQKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFyc2V0PVVURi04CgogCmhp LCAKCkl0J3MgcmVhbGx5IG5vdCBhIHNpbmdsZSBwb2ludCBvZiBmYWlsdXJlID8gSW4gdGhpcyB3 YXkgaSBzZWUgMgpwb2ludCBvZiBmYWlsdXJlLCBpZiB0aGUgaG9zdGVkLWVuZ2luZSBicmVhayBh bmQgaWYgdGhlIG1vdW50IHNlcnZlcgphZHJlc3MgYnJlYWsuIEFuZCBpdCdzIG5vdCBwb3NzaWJs ZSB0byBtaWdyYXRlIHRoZSBlbmdpbmUuIAoKQ2FuIHlvdQpleHBsYWluIG1lIHdoeSBpcyBub3Qg YSBwb2ludCBvZiBmYWlsdXJlIGZvciB5b3UgPyAKCi0tIAoKRmxvcmVudCBCRUxMTwoKCkxlIDI4 LzA5LzIwMTUgMDU6NDUsIFNpbW9uZSBUaXJhYm9zY2hpIGEgw6ljcml0IDogCgo+IE9uIEZyaSwg U2VwIDI1LAoyMDE1IGF0IDU6MzYgUE0sIEJlbGxvIEZsb3JlbnQgPGZsb3JlbnQuYmVsbG9Admls bGUta291cm91LmZyPiB3cm90ZToKPgoKPj4gSGksIAo+PiAKPj4gSSBoYXZlIDMgbm9kZXMgd2l0 aCBnbHVzdGVyZnMgaW5zdGFsbGVkLiBJIGNvbmZpZ3VyZWQKcmVwbGljYSAzIG9uIG15IGVuZ2lu ZSB2b2x1bWUuCj4gCj4gSGksIAo+IG9uIG9WaXJ0IDMuNiB3ZSBzdGlsbCBub3QKc3VwcG9ydCBo eXBlciBjb252ZXJnZW5jZSB0aGF0IG1lYW5zIHRoYXQgeW91IGNhbm5vdCB1c2UgdGhlIHNhbWUg aG9zdHMKZm9yIHZpcnR1YWxpemF0aW9uIGFuZCBmb3Igc3RvcmFnZSB3aXRoIGdsdXN0ZXIuIAo+ IAo+IFNvIHRoZSBjb3JyZWN0CmFwcHJvYWNoIGlzIHJlbmFtaW5nIHlvdXIgaG9zdHMgdG86IAo+ IGhvc3QgMSA6ICIxOTIuMTY4LjEwMC4xMDEKZ2x1c3RlcjEubG9jYWxkb21haW4gZ2x1c3RlcjEi Cj4gaG9zdCAyIDogIjE5Mi4xNjguMTAwLjEwMgpnbHVzdGVyMi5sb2NhbGRvbWFpbiBnbHVzdGVy MiIKPiBob3N0IDMgOiAiMTkyLjE2OC4xMDAuMTAzCmdsdXN0ZXIzLmxvY2FsZG9tYWluIGdsdXN0 ZXIzIiAKPiAKPiBPbiBhbiBhZGRpdGlvbmFsIGhvc3QsIGRlcGxveQpob3N0ZWQtZW5naW5lIGNo b29zaW5nIHRoZSBnbHVzdGVyIGhvc3QgeW91IHByZWZlciBhcyB5b3VyIGVudHJ5IHBvaW50Ogpp dCB3aWxsIG5vdCBiZSBhIHNpbmdsZSBwb2ludCBvZiBmYWlsdXJlLiAKPiBZb3UgZG9uJ3QgcmVh bGx5IG5lZWQgdG8KdXNlIENUREIgdG8gZGVwbG95IG9WaXJ0IGhvc3RlZC1lbmdpbmUuIAo+IAo+ PiBpIGRvbid0IHdhbnQgdG8gdXNlIGN0ZGIKZm9yIG15IGhvc3RlZC1lbmdpbmUsIGJ1dCB3aGVu IGkgc3RhcnQgaG9zdGVkLWVuZ2luZSAtLWRlcGxveSwgdXNlCmxvY2FsaG9zdDovZW5naW5lIG9y IGdsdXN0ZXIubG9jYWxkb21haW46L2VuZ2luZSwgZ2x1c3Rlci5sb2NhbGRvbWFpbiBpcwpjb25m aWd1cmVkIGluIGFsbCBzZXJ2ZXJzIC9ldGMvaG9zdHMgbGlrZSA6Cj4+IGhvc3QgMSA6ICIxOTIu MTY4LjEwMC4xMDEKZ2x1c3Rlci5sb2NhbGRvbWFpbiBnbHVzdGVyIgo+PiBob3N0IDIgOiAiMTky LjE2OC4xMDAuMTAyCmdsdXN0ZXIubG9jYWxkb21haW4gZ2x1c3RlciIKPj4gaG9zdCAzIDogIjE5 Mi4xNjguMTAwLjEwMwpnbHVzdGVyLmxvY2FsZG9tYWluIGdsdXN0ZXIiLCAKPj4gCj4+IHRoZSBz ZXR1cCBmYWlsZWQgd2l0aCA6IAo+PiAKPj4KLS09PSBTVE9SQUdFIENPTkZJR1VSQVRJT04gPT0t LQo+PiAKPj4gRHVyaW5nIGN1c3RvbWl6YXRpb24gdXNlIENUUkwtRAp0byBhYm9ydC4KPj4gUGxl YXNlIHNwZWNpZnkgdGhlIHN0b3JhZ2UgeW91IHdvdWxkIGxpa2UgdG8gdXNlCihnbHVzdGVyZnMs IGlzY3NpLCBmYywgbmZzMywgbmZzNClbbmZzM106IGdsdXN0ZXJmcwo+PiBbIElORk8gXSBQbGVh c2UKbm90ZSB0aGF0IFJlcGxpY2EgMyBzdXBwb3J0IGlzIHJlcXVpcmVkIGZvciB0aGUgc2hhcmVk IHN0b3JhZ2UuCj4+ClBsZWFzZSBzcGVjaWZ5IHRoZSBmdWxsIHNoYXJlZCBzdG9yYWdlIGNvbm5l Y3Rpb24gcGF0aCB0byB1c2UgKGV4YW1wbGU6Cmhvc3Q6L3BhdGgpOiBsb2NhbGhvc3Q6L2VuZ2lu ZQo+PiBbV0FSTklOR10gRHVlIHRvIHNldmVyYWwgYnVncyBpbgptb3VudC5nbHVzdGVyZnMgdGhl IHZhbGlkYXRpb24gb2YgR2x1c3RlckZTIHNoYXJlIGNhbm5vdCBiZSByZWxpYWJsZS4KPj4KWyBJ TkZPIF0gR2x1c3RlckZTIHJlcGxpY2EgMyBWb2x1bWUgZGV0ZWN0ZWQKPj4gWyBFUlJPUiBdIEZh aWxlZCB0bwpleGVjdXRlIHN0YWdlICdFbnZpcm9ubWVudCBjdXN0b21pemF0aW9uJzogQ29ubmVj dGlvbiB0byBzdG9yYWdlIHNlcnZlcgpmYWlsZWQKPj4gWyBJTkZPIF0gU3RhZ2U6IENsZWFuIHVw Cj4+IFsgSU5GTyBdIEdlbmVyYXRpbmcgYW5zd2VyIGZpbGUKJy92YXIvbGliL292aXJ0LWhvc3Rl ZC1lbmdpbmUtc2V0dXAvYW5zd2Vycy9hbnN3ZXJzLTIwMTUwOTI1MTIxMDM2LmNvbmYnCj4+Clsg SU5GTyBdIFN0YWdlOiBQcmUtdGVybWluYXRpb24KPj4gWyBJTkZPIF0gU3RhZ2U6IFRlcm1pbmF0 aW9uIAo+PiAKPj4KSSBoYXZlIHRvIHVzZSBvYmxpZ2F0b3J5IGN0ZGIgb3Iga2VlcGFsaXZlZCwg b3IgZXhpc3RpbmcgYW5vdGhlciB3YXkgPwoKPj4gLS0gCj4+IAo+PiBGbG9yZW50IEJFTExPCj4+ IFNlcnZpY2UgSW5mb3JtYXRpcXVlCj4+CmluZm9ybWF0aXF1ZUB2aWxsZS1rb3Vyb3UuZnIKPj4g MDU5NCAyMiAzMSAyMgo+PiBNYWlyaWUgZGUgS291cm91IAo+PgpfX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fXwo+PiBVc2VycyBtYWlsaW5nIGxpc3QKPj4KVXNl cnNAb3ZpcnQub3JnCj4+IGh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91 c2VycyBbMV0KCgoKTGlua3M6Ci0tLS0tLQpbMV0gaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWls bWFuL2xpc3RpbmZvL3VzZXJzCgotLT1fMjI0NjIzNTk1NzUxMTI3YTIxZjUxOWQ4YzIyZWE4MTUK Q29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogcXVvdGVkLXByaW50YWJsZQpDb250ZW50LVR5cGU6 IHRleHQvaHRtbDsgY2hhcnNldD1VVEYtOAoKPCFET0NUWVBFIGh0bWwgUFVCTElDICItLy9XM0Mv L0RURCBYSFRNTCAxLjAgVHJhbnNpdGlvbmFsLy9FTiI+CjxodG1sPjxib2R5Pgo8ZGl2PmhpLDwv ZGl2Pgo8ZGl2PiZuYnNwOzwvZGl2Pgo8ZGl2Pkl0J3MgcmVhbGx5IG5vdCBhIHNpbmdsZSBwb2lu dCBvZiBmYWlsdXJlID8gSW4gdGhpcyB3YXkgaSBzZWUgMiBwb2ludCA9Cm9mIGZhaWx1cmUsIGlm IHRoZSBob3N0ZWQtZW5naW5lIGJyZWFrIGFuZCBpZiB0aGUgbW91bnQgc2VydmVyIGFkcmVzcyBi cmVhaz0KPTJFIEFuZCBpdCdzIG5vdCBwb3NzaWJsZSB0byBtaWdyYXRlIHRoZSBlbmdpbmUuPC9k aXY+CjxkaXY+Jm5ic3A7PC9kaXY+CjxwPkNhbiB5b3UgZXhwbGFpbiBtZSB3aHkgaXMgbm90IGEg cG9pbnQgb2YgZmFpbHVyZSBmb3IgeW91ID88L3A+CjxwPiZuYnNwOzwvcD4KPGRpdj4tLSA8YnIg Lz4KPHA+RmxvcmVudCBCRUxMTzwvcD4KPHA+Jm5ic3A7PC9wPgo8L2Rpdj4KPHA+TGUgMjgvMDkv MjAxNSAwNTo0NSwgU2ltb25lIFRpcmFib3NjaGkgYSAmZWFjdXRlO2NyaXQmbmJzcDs6PC9wPgo8 YmxvY2txdW90ZSB0eXBlPTNEImNpdGUiIHN0eWxlPTNEInBhZGRpbmctbGVmdDo1cHg7IGJvcmRl ci1sZWZ0OiMxMDEwZmYgMnA9Cnggc29saWQ7IG1hcmdpbi1sZWZ0OjVweDsgd2lkdGg6MTAwJSI+ PCEtLSBodG1sIGlnbm9yZWQgLS0+PCEtLSBoZWFkIGlnbm9yZT0KZCAtLT48IS0tIG1ldGEgaWdu b3JlZCAtLT4KPGRpdiBkaXI9M0QibHRyIj48YnIgLz4KPGRpdiBjbGFzcz0zRCJnbWFpbF9leHRy YSI+PGJyIC8+CjxkaXYgY2xhc3M9M0QiZ21haWxfcXVvdGUiPk9uIEZyaSwgU2VwIDI1LCAyMDE1 IGF0IDU6MzYgUE0sIEJlbGxvIEZsb3JlbnQgPD0Kc3Bhbj4mbHQ7PGEgaHJlZj0zRCJtYWlsdG86 ZmxvcmVudC5iZWxsb0B2aWxsZS1rb3Vyb3UuZnIiPmZsb3JlbnQuYmVsbG9AdmlsPQpsZS1rb3Vy b3UuZnI8L2E+Jmd0Ozwvc3Bhbj4gd3JvdGU6PGJyIC8+CjxibG9ja3F1b3RlIGNsYXNzPTNEImdt YWlsX3F1b3RlIiBzdHlsZT0zRCJtYXJnaW46IDBweCAgMHB4ICAwcHggIDAuOGV4OyBibz0KcmRl ci1sZWZ0LXdpZHRoOiAxcHg7IGJvcmRlci1sZWZ0LWNvbG9yOiAjY2NjY2NjOyBib3JkZXItbGVm dC1zdHlsZTogc29saWQ7PQogcGFkZGluZy1sZWZ0OiAxZXg7Ij48c3BhbiBzdHlsZT0zRCJ0ZXh0 LWRlY29yYXRpb246IHVuZGVybGluZTsiPjwvc3Bhbj4KPGRpdj4KPHA+SGksPC9wPgo8cD5JIGhh dmUgMyBub2RlcyB3aXRoIGdsdXN0ZXJmcyBpbnN0YWxsZWQuIEkgY29uZmlndXJlZCByZXBsaWNh IDMgb24gbXkgZW49CmdpbmUgdm9sdW1lLjwvcD4KPC9kaXY+CjwvYmxvY2txdW90ZT4KPGRpdj4m bmJzcDs8L2Rpdj4KPGRpdj5IaSw8L2Rpdj4KPGRpdj5vbiBvVmlydCAmbmJzcDszLjYgd2Ugc3Rp bGwgbm90IHN1cHBvcnQgaHlwZXIgY29udmVyZ2VuY2UgdGhhdCBtZWFucyB0PQpoYXQgeW91IGNh bm5vdCB1c2UgdGhlIHNhbWUgaG9zdHMgZm9yIHZpcnR1YWxpemF0aW9uIGFuZCBmb3Igc3RvcmFn ZSB3aXRoIGc9Cmx1c3Rlci48L2Rpdj4KPGRpdj4mbmJzcDs8L2Rpdj4KPGRpdj5TbyB0aGUgY29y cmVjdCBhcHByb2FjaCBpcyByZW5hbWluZyB5b3VyIGhvc3RzIHRvOjwvZGl2Pgo8ZGl2Pmhvc3Qg MSA6ICIxOTIuMTY4LjEwMC4xMDEgZ2x1c3RlcjEubG9jYWxkb21haW4gZ2x1c3RlcjEiPGJyIC8+ aG9zdCAyIDo9CiAiMTkyLjE2OC4xMDAuMTAyIGdsdXN0ZXIyLmxvY2FsZG9tYWluIGdsdXN0ZXIy IjxiciAvPmhvc3QgMyA6ICIxOTIuMTY4LjEwMD0KPTJFMTAzIGdsdXN0ZXIzLmxvY2FsZG9tYWlu IGdsdXN0ZXIzIjwvZGl2Pgo8ZGl2PiZuYnNwOzwvZGl2Pgo8ZGl2Pk9uIGFuIGFkZGl0aW9uYWwg aG9zdCwgZGVwbG95IGhvc3RlZC1lbmdpbmUgY2hvb3NpbmcgdGhlIGdsdXN0ZXIgaG9zdCA9Cnlv dSBwcmVmZXIgYXMgeW91ciBlbnRyeSBwb2ludDogaXQgd2lsbCBub3QgYmUgYSBzaW5nbGUgcG9p bnQgb2YgZmFpbHVyZS48Lz0KZGl2Pgo8ZGl2PllvdSBkb24ndCByZWFsbHkgbmVlZCB0byB1c2Ug Q1REQiB0byBkZXBsb3kgb1ZpcnQgaG9zdGVkLWVuZ2luZS48L2Rpdj4KPGRpdj4mbmJzcDs8L2Rp dj4KPGJsb2NrcXVvdGUgY2xhc3M9M0QiZ21haWxfcXVvdGUiIHN0eWxlPTNEIm1hcmdpbjogMHB4 ICAwcHggIDBweCAgMC44ZXg7IGJvPQpyZGVyLWxlZnQtd2lkdGg6IDFweDsgYm9yZGVyLWxlZnQt Y29sb3I6ICNjY2NjY2M7IGJvcmRlci1sZWZ0LXN0eWxlOiBzb2xpZDs9CiBwYWRkaW5nLWxlZnQ6 IDFleDsiPgo8ZGl2Pgo8cD48YnIgLz5pIGRvbid0IHdhbnQgdG8gdXNlIGN0ZGIgZm9yIG15IGhv c3RlZC1lbmdpbmUsIGJ1dCB3aGVuIGkgc3RhcnQgaG89CnN0ZWQtZW5naW5lIC0tZGVwbG95LCB1 c2UgbG9jYWxob3N0Oi9lbmdpbmUgb3IgZ2x1c3Rlci5sb2NhbGRvbWFpbjovZW5naW5lLD0KIGds dXN0ZXIubG9jYWxkb21haW4gaXMgY29uZmlndXJlZCBpbiBhbGwgc2VydmVycyAvZXRjL2hvc3Rz IGxpa2UgOjxiciAvPmhvPQpzdCAxIDogIjE5Mi4xNjguMTAwLjEwMSBnbHVzdGVyLmxvY2FsZG9t YWluIGdsdXN0ZXIiPGJyIC8+aG9zdCAyIDogIjE5Mi4xNjg9Cj0yRTEwMC4xMDIgZ2x1c3Rlci5s b2NhbGRvbWFpbiBnbHVzdGVyIjxiciAvPmhvc3QgMyA6ICIxOTIuMTY4LjEwMC4xMDMgZ2x1cz0K dGVyLmxvY2FsZG9tYWluIGdsdXN0ZXIiLDwvcD4KPHA+dGhlIHNldHVwIGZhaWxlZCB3aXRoIDo8 L3A+CjxwPi0tPTNEPTNEIFNUT1JBR0UgQ09ORklHVVJBVElPTiA9M0Q9M0QtLTxiciAvPjxiciAv PiZuYnNwOyZuYnNwOyZuYnNwOyZuYj0Kc3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 IER1cmluZyBjdXN0b21pemF0aW9uIHVzZSBDVFJMLUQgdG8gYWJvcnQ9Cj0yRTxiciAvPiZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyBQbGVhc2Ug c3BlYz0KaWZ5IHRoZSBzdG9yYWdlIHlvdSB3b3VsZCBsaWtlIHRvIHVzZSAoZ2x1c3RlcmZzLCBp c2NzaSwgZmMsIG5mczMsIG5mczQpW25mPQpzM106IGdsdXN0ZXJmczxiciAvPlsgSU5GTyZuYnNw OyBdIFBsZWFzZSBub3RlIHRoYXQgUmVwbGljYSAzIHN1cHBvcnQgaXMgcmU9CnF1aXJlZCBmb3Ig dGhlIHNoYXJlZCBzdG9yYWdlLjxiciAvPiZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYj0Kc3A7Jm5ic3A7Jm5ic3A7IFBsZWFzZSBzcGVjaWZ5IHRoZSBmdWxsIHNoYXJlZCBz dG9yYWdlIGNvbm5lY3Rpb24gcGF0aCB0byB1PQpzZSAoZXhhbXBsZTogaG9zdDovcGF0aCk6IGxv Y2FsaG9zdDovZW5naW5lPGJyIC8+W1dBUk5JTkddIER1ZSB0byBzZXZlcmFsIGI9CnVncyBpbiBt b3VudC5nbHVzdGVyZnMgdGhlIHZhbGlkYXRpb24gb2YgR2x1c3RlckZTIHNoYXJlIGNhbm5vdCBi ZSByZWxpYWJsZT0KPTJFPGJyIC8+WyBJTkZPJm5ic3A7IF0gR2x1c3RlckZTIHJlcGxpY2EgMyBW b2x1bWUgZGV0ZWN0ZWQ8YnIgLz5bIEVSUk9SIF0gPQpGYWlsZWQgdG8gZXhlY3V0ZSBzdGFnZSAn RW52aXJvbm1lbnQgY3VzdG9taXphdGlvbic6IENvbm5lY3Rpb24gdG8gc3RvcmFnZSA9CnNlcnZl ciBmYWlsZWQ8YnIgLz5bIElORk8mbmJzcDsgXSBTdGFnZTogQ2xlYW4gdXA8YnIgLz5bIElORk8m bmJzcDsgXSBHZW5lcj0KYXRpbmcgYW5zd2VyIGZpbGUgJy92YXIvbGliL292aXJ0LWhvc3RlZC1l bmdpbmUtc2V0dXAvYW5zd2Vycy9hbnN3ZXJzLTIwMTUwPQo5MjUxMjEwMzYuY29uZic8YnIgLz5b IElORk8mbmJzcDsgXSBTdGFnZTogUHJlLXRlcm1pbmF0aW9uPGJyIC8+WyBJTkZPJm5ic3A9Cjsg XSBTdGFnZTogVGVybWluYXRpb248L3A+CjxwPkkgaGF2ZSB0byB1c2Ugb2JsaWdhdG9yeSBjdGRi IG9yIGtlZXBhbGl2ZWQsIG9yIGV4aXN0aW5nIGFub3RoZXIgd2F5ID88Lz0KcD4KPGRpdj4tLSA8 YnIgLz4KPHA+RmxvcmVudCBCRUxMTzxiciAvPlNlcnZpY2UgSW5mb3JtYXRpcXVlPGJyIC8+PGEg aHJlZj0zRCJtYWlsdG86aW5mb3JtYXRpPQpxdWVAdmlsbGUta291cm91LmZyIj5pbmZvcm1hdGlx dWVAdmlsbGUta291cm91LmZyPC9hPjxiciAvPjA1OTQgMjIgMzEgMjI8YnI9CiAvPk1haXJpZSBk ZSBLb3Vyb3U8L3A+CjwvZGl2Pgo8L2Rpdj4KPGJyIC8+X19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX188YnIgLz4gVXNlcnMgbWFpbGluZyBsPQppc3Q8YnIgLz48 YSBocmVmPTNEIm1haWx0bzpVc2Vyc0BvdmlydC5vcmciPlVzZXJzQG92aXJ0Lm9yZzwvYT48YnIg Lz48YSBocmU9CmY9M0QiaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3Vz ZXJzIj5odHRwOi8vbGlzdHMub3ZpcnQub3JnLz0KbWFpbG1hbi9saXN0aW5mby91c2VyczwvYT48 YnIgLz48YnIgLz48L2Jsb2NrcXVvdGU+CjwvZGl2Pgo8L2Rpdj4KPC9kaXY+CjwvYmxvY2txdW90 ZT4KPC9ib2R5PjwvaHRtbD4KCi0tPV8yMjQ2MjM1OTU3NTExMjdhMjFmNTE5ZDhjMjJlYTgxNS0t Cgo= --===============8442961952940395636==-- From stirabos at redhat.com Tue Sep 29 10:44:32 2015 Content-Type: multipart/mixed; boundary="===============2015363283645993504==" MIME-Version: 1.0 From: Simone Tiraboschi To: users at ovirt.org Subject: Re: [ovirt-users] Another way of CTDB to mount engine Date: Tue, 29 Sep 2015 16:44:01 +0200 Message-ID: In-Reply-To: 979898fff6c86967a37200b2c9d62a3c@ville-kourou.fr --===============2015363283645993504== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On Mon, Sep 28, 2015 at 1:35 PM, Bello Florent < florent.bello(a)ville-kourou.fr> wrote: > hi, > > It's really not a single point of failure ? In this way i see 2 point of > failure, if the hosted-engine break and if the mount server adress break. > And it's not possible to migrate the engine. > > > Can you explain me why is not a point of failure for you ? > That server should be up when you start deploying hosted-engine. When VDSM accesses that volume it gathers the whole brick list so it will then be able to use that volume also if the server you initially pointed to start the deployment process has died. > > -- > > Florent BELLO > > > > Le 28/09/2015 05:45, Simone Tiraboschi a =C3=A9crit : > > > > On Fri, Sep 25, 2015 at 5:36 PM, Bello Florent < > florent.bello(a)ville-kourou.fr> wrote: > >> Hi, >> >> I have 3 nodes with glusterfs installed. I configured replica 3 on my >> engine volume. >> > > Hi, > on oVirt 3.6 we still not support hyper convergence that means that you > cannot use the same hosts for virtualization and for storage with gluster. > > So the correct approach is renaming your hosts to: > host 1 : "192.168.100.101 gluster1.localdomain gluster1" > host 2 : "192.168.100.102 gluster2.localdomain gluster2" > host 3 : "192.168.100.103 gluster3.localdomain gluster3" > > On an additional host, deploy hosted-engine choosing the gluster host you > prefer as your entry point: it will not be a single point of failure. > You don't really need to use CTDB to deploy oVirt hosted-engine. > > >> >> i don't want to use ctdb for my hosted-engine, but when i start >> hosted-engine --deploy, use localhost:/engine or >> gluster.localdomain:/engine, gluster.localdomain is configured in all >> servers /etc/hosts like : >> host 1 : "192.168.100.101 gluster.localdomain gluster" >> host 2 : "192.168.100.102 gluster.localdomain gluster" >> host 3 : "192.168.100.103 gluster.localdomain gluster", >> >> the setup failed with : >> >> --=3D=3D STORAGE CONFIGURATION =3D=3D-- >> >> During customization use CTRL-D to abort. >> Please specify the storage you would like to use (glusterfs, >> iscsi, fc, nfs3, nfs4)[nfs3]: glusterfs >> [ INFO ] Please note that Replica 3 support is required for the shared >> storage. >> Please specify the full shared storage connection path to use >> (example: host:/path): localhost:/engine >> [WARNING] Due to several bugs in mount.glusterfs the validation of >> GlusterFS share cannot be reliable. >> [ INFO ] GlusterFS replica 3 Volume detected >> [ ERROR ] Failed to execute stage 'Environment customization': Connection >> to storage server failed >> [ INFO ] Stage: Clean up >> [ INFO ] Generating answer file >> '/var/lib/ovirt-hosted-engine-setup/answers/answers-20150925121036.conf' >> [ INFO ] Stage: Pre-termination >> [ INFO ] Stage: Termination >> >> I have to use obligatory ctdb or keepalived, or existing another way ? >> -- >> >> Florent BELLO >> Service Informatique >> informatique(a)ville-kourou.fr >> 0594 22 31 22 >> Mairie de Kourou >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> >> > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > --===============2015363283645993504== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGJyPjxkaXYgY2xhc3M9ImdtYWlsX2V4dHJhIj48YnI+PGRpdiBjbGFz cz0iZ21haWxfcXVvdGUiPk9uIE1vbiwgU2VwIDI4LCAyMDE1IGF0IDE6MzUgUE0sIEJlbGxvIEZs b3JlbnQgPHNwYW4gZGlyPSJsdHIiPiZsdDs8YSBocmVmPSJtYWlsdG86ZmxvcmVudC5iZWxsb0B2 aWxsZS1rb3Vyb3UuZnIiIHRhcmdldD0iX2JsYW5rIj5mbG9yZW50LmJlbGxvQHZpbGxlLWtvdXJv dS5mcjwvYT4mZ3Q7PC9zcGFuPiB3cm90ZTo8YnI+PGJsb2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1 b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAwIC44ZXg7Ym9yZGVyLWxlZnQ6MXB4ICNjY2Mgc29saWQ7 cGFkZGluZy1sZWZ0OjFleCI+PHU+PC91Pgo8ZGl2PjxzcGFuPgo8ZGl2PmhpLDwvZGl2Pgo8ZGl2 PsKgPC9kaXY+CjxkaXY+SXQmIzM5O3MgcmVhbGx5IG5vdCBhIHNpbmdsZSBwb2ludCBvZiBmYWls dXJlID8gSW4gdGhpcyB3YXkgaSBzZWUgMiBwb2ludCBvZiBmYWlsdXJlLCBpZiB0aGUgaG9zdGVk LWVuZ2luZSBicmVhayBhbmQgaWYgdGhlIG1vdW50IHNlcnZlciBhZHJlc3MgYnJlYWsuIEFuZCBp dCYjMzk7cyBub3QgcG9zc2libGUgdG8gbWlncmF0ZSB0aGUgZW5naW5lLjwvZGl2Pgo8ZGl2PsKg PC9kaXY+CjxwPkNhbiB5b3UgZXhwbGFpbiBtZSB3aHkgaXMgbm90IGEgcG9pbnQgb2YgZmFpbHVy ZSBmb3IgeW91ID88L3A+PC9zcGFuPjwvZGl2PjwvYmxvY2txdW90ZT48ZGl2PlRoYXQgc2VydmVy IHNob3VsZCBiZSB1cCB3aGVuIHlvdSBzdGFydCBkZXBsb3lpbmcgaG9zdGVkLWVuZ2luZS48L2Rp dj48ZGl2PldoZW4gVkRTTSBhY2Nlc3NlcyB0aGF0IHZvbHVtZSBpdCBnYXRoZXJzIHRoZSB3aG9s ZSBicmljayBsaXN0IHNvIGl0IHdpbGwgdGhlbiBiZSBhYmxlIHRvIHVzZSB0aGF0IHZvbHVtZSBh bHNvIGlmIHRoZSBzZXJ2ZXIgeW91IGluaXRpYWxseSBwb2ludGVkIHRvIHN0YXJ0IHRoZSBkZXBs b3ltZW50IHByb2Nlc3MgaGFzIGRpZWQuPC9kaXY+PGRpdj7CoDwvZGl2PjxibG9ja3F1b3RlIGNs YXNzPSJnbWFpbF9xdW90ZSIgc3R5bGU9Im1hcmdpbjowIDAgMCAuOGV4O2JvcmRlci1sZWZ0OjFw eCAjY2NjIHNvbGlkO3BhZGRpbmctbGVmdDoxZXgiPjxkaXY+PHNwYW4+PHA+wqA8L3A+CjxkaXY+ LS0gPGJyPgo8cD5GbG9yZW50IEJFTExPPC9wPgo8cD7CoDwvcD4KPC9kaXY+CjxwPkxlIDI4LzA5 LzIwMTUgMDU6NDUsIFNpbW9uZSBUaXJhYm9zY2hpIGEgw6ljcml0wqA6PC9wPgo8L3NwYW4+PGRp dj48ZGl2PjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiIHN0eWxlPSJwYWRkaW5nLWxlZnQ6NXB4O2Jv cmRlci1sZWZ0OiMxMDEwZmYgMnB4IHNvbGlkO21hcmdpbi1sZWZ0OjVweDt3aWR0aDoxMDAlIj4K PGRpdiBkaXI9Imx0ciI+PGJyPgo8ZGl2IGNsYXNzPSJnbWFpbF9leHRyYSI+PGJyPgo8ZGl2IGNs YXNzPSJnbWFpbF9xdW90ZSI+T24gRnJpLCBTZXAgMjUsIDIwMTUgYXQgNTozNiBQTSwgQmVsbG8g RmxvcmVudCA8c3Bhbj4mbHQ7PGEgaHJlZj0ibWFpbHRvOmZsb3JlbnQuYmVsbG9AdmlsbGUta291 cm91LmZyIiB0YXJnZXQ9Il9ibGFuayI+ZmxvcmVudC5iZWxsb0B2aWxsZS1rb3Vyb3UuZnI8L2E+ Jmd0Ozwvc3Bhbj4gd3JvdGU6PGJyPgo8YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0 eWxlPSJtYXJnaW46MHB4IDBweCAwcHggMC44ZXg7Ym9yZGVyLWxlZnQtd2lkdGg6MXB4O2JvcmRl ci1sZWZ0LWNvbG9yOiNjY2NjY2M7Ym9yZGVyLWxlZnQtc3R5bGU6c29saWQ7cGFkZGluZy1sZWZ0 OjFleCI+PHNwYW4gc3R5bGU9InRleHQtZGVjb3JhdGlvbjp1bmRlcmxpbmUiPjwvc3Bhbj4KPGRp dj4KPHA+SGksPC9wPgo8cD5JIGhhdmUgMyBub2RlcyB3aXRoIGdsdXN0ZXJmcyBpbnN0YWxsZWQu IEkgY29uZmlndXJlZCByZXBsaWNhIDMgb24gbXkgZW5naW5lIHZvbHVtZS48L3A+CjwvZGl2Pgo8 L2Jsb2NrcXVvdGU+CjxkaXY+wqA8L2Rpdj4KPGRpdj5IaSw8L2Rpdj4KPGRpdj5vbiBvVmlydCDC oDMuNiB3ZSBzdGlsbCBub3Qgc3VwcG9ydCBoeXBlciBjb252ZXJnZW5jZSB0aGF0IG1lYW5zIHRo YXQgeW91IGNhbm5vdCB1c2UgdGhlIHNhbWUgaG9zdHMgZm9yIHZpcnR1YWxpemF0aW9uIGFuZCBm b3Igc3RvcmFnZSB3aXRoIGdsdXN0ZXIuPC9kaXY+CjxkaXY+wqA8L2Rpdj4KPGRpdj5TbyB0aGUg Y29ycmVjdCBhcHByb2FjaCBpcyByZW5hbWluZyB5b3VyIGhvc3RzIHRvOjwvZGl2Pgo8ZGl2Pmhv c3QgMSA6ICZxdW90OzE5Mi4xNjguMTAwLjEwMSBnbHVzdGVyMS5sb2NhbGRvbWFpbiBnbHVzdGVy MSZxdW90Ozxicj5ob3N0IDIgOiAmcXVvdDsxOTIuMTY4LjEwMC4xMDIgZ2x1c3RlcjIubG9jYWxk b21haW4gZ2x1c3RlcjImcXVvdDs8YnI+aG9zdCAzIDogJnF1b3Q7MTkyLjE2OC4xMDAuMTAzIGds dXN0ZXIzLmxvY2FsZG9tYWluIGdsdXN0ZXIzJnF1b3Q7PC9kaXY+CjxkaXY+wqA8L2Rpdj4KPGRp dj5PbiBhbiBhZGRpdGlvbmFsIGhvc3QsIGRlcGxveSBob3N0ZWQtZW5naW5lIGNob29zaW5nIHRo ZSBnbHVzdGVyIGhvc3QgeW91IHByZWZlciBhcyB5b3VyIGVudHJ5IHBvaW50OiBpdCB3aWxsIG5v dCBiZSBhIHNpbmdsZSBwb2ludCBvZiBmYWlsdXJlLjwvZGl2Pgo8ZGl2PllvdSBkb24mIzM5O3Qg cmVhbGx5IG5lZWQgdG8gdXNlIENUREIgdG8gZGVwbG95IG9WaXJ0IGhvc3RlZC1lbmdpbmUuPC9k aXY+CjxkaXY+wqA8L2Rpdj4KPGJsb2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1b3RlIiBzdHlsZT0i bWFyZ2luOjBweCAwcHggMHB4IDAuOGV4O2JvcmRlci1sZWZ0LXdpZHRoOjFweDtib3JkZXItbGVm dC1jb2xvcjojY2NjY2NjO2JvcmRlci1sZWZ0LXN0eWxlOnNvbGlkO3BhZGRpbmctbGVmdDoxZXgi Pgo8ZGl2Pgo8cD48YnI+aSBkb24mIzM5O3Qgd2FudCB0byB1c2UgY3RkYiBmb3IgbXkgaG9zdGVk LWVuZ2luZSwgYnV0IHdoZW4gaSBzdGFydCBob3N0ZWQtZW5naW5lIC0tZGVwbG95LCB1c2UgbG9j YWxob3N0Oi9lbmdpbmUgb3IgZ2x1c3Rlci5sb2NhbGRvbWFpbjovZW5naW5lLCBnbHVzdGVyLmxv Y2FsZG9tYWluIGlzIGNvbmZpZ3VyZWQgaW4gYWxsIHNlcnZlcnMgL2V0Yy9ob3N0cyBsaWtlIDo8 YnI+aG9zdCAxIDogJnF1b3Q7MTkyLjE2OC4xMDAuMTAxIGdsdXN0ZXIubG9jYWxkb21haW4gZ2x1 c3RlciZxdW90Ozxicj5ob3N0IDIgOiAmcXVvdDsxOTIuMTY4LjEwMC4xMDIgZ2x1c3Rlci5sb2Nh bGRvbWFpbiBnbHVzdGVyJnF1b3Q7PGJyPmhvc3QgMyA6ICZxdW90OzE5Mi4xNjguMTAwLjEwMyBn bHVzdGVyLmxvY2FsZG9tYWluIGdsdXN0ZXImcXVvdDssPC9wPgo8cD50aGUgc2V0dXAgZmFpbGVk IHdpdGggOjwvcD4KPHA+LS09PSBTVE9SQUdFIENPTkZJR1VSQVRJT04gPT0tLTxicj48YnI+wqDC oMKgwqDCoMKgwqDCoMKgIER1cmluZyBjdXN0b21pemF0aW9uIHVzZSBDVFJMLUQgdG8gYWJvcnQu PGJyPsKgwqDCoMKgwqDCoMKgwqDCoCBQbGVhc2Ugc3BlY2lmeSB0aGUgc3RvcmFnZSB5b3Ugd291 bGQgbGlrZSB0byB1c2UgKGdsdXN0ZXJmcywgaXNjc2ksIGZjLCBuZnMzLCBuZnM0KVtuZnMzXTog Z2x1c3RlcmZzPGJyPlsgSU5GT8KgIF0gUGxlYXNlIG5vdGUgdGhhdCBSZXBsaWNhIDMgc3VwcG9y dCBpcyByZXF1aXJlZCBmb3IgdGhlIHNoYXJlZCBzdG9yYWdlLjxicj7CoMKgwqDCoMKgwqDCoMKg wqAgUGxlYXNlIHNwZWNpZnkgdGhlIGZ1bGwgc2hhcmVkIHN0b3JhZ2UgY29ubmVjdGlvbiBwYXRo IHRvIHVzZSAoZXhhbXBsZTogaG9zdDovcGF0aCk6IGxvY2FsaG9zdDovZW5naW5lPGJyPltXQVJO SU5HXSBEdWUgdG8gc2V2ZXJhbCBidWdzIGluIG1vdW50LmdsdXN0ZXJmcyB0aGUgdmFsaWRhdGlv biBvZiBHbHVzdGVyRlMgc2hhcmUgY2Fubm90IGJlIHJlbGlhYmxlLjxicj5bIElORk/CoCBdIEds dXN0ZXJGUyByZXBsaWNhIDMgVm9sdW1lIGRldGVjdGVkPGJyPlsgRVJST1IgXSBGYWlsZWQgdG8g ZXhlY3V0ZSBzdGFnZSAmIzM5O0Vudmlyb25tZW50IGN1c3RvbWl6YXRpb24mIzM5OzogQ29ubmVj dGlvbiB0byBzdG9yYWdlIHNlcnZlciBmYWlsZWQ8YnI+WyBJTkZPwqAgXSBTdGFnZTogQ2xlYW4g dXA8YnI+WyBJTkZPwqAgXSBHZW5lcmF0aW5nIGFuc3dlciBmaWxlICYjMzk7L3Zhci9saWIvb3Zp cnQtaG9zdGVkLWVuZ2luZS1zZXR1cC9hbnN3ZXJzL2Fuc3dlcnMtMjAxNTA5MjUxMjEwMzYuY29u ZiYjMzk7PGJyPlsgSU5GT8KgIF0gU3RhZ2U6IFByZS10ZXJtaW5hdGlvbjxicj5bIElORk/CoCBd IFN0YWdlOiBUZXJtaW5hdGlvbjwvcD4KPHA+SSBoYXZlIHRvIHVzZSBvYmxpZ2F0b3J5IGN0ZGIg b3Iga2VlcGFsaXZlZCwgb3IgZXhpc3RpbmcgYW5vdGhlciB3YXkgPzwvcD4KPGRpdj4tLSA8YnI+ CjxwPkZsb3JlbnQgQkVMTE88YnI+U2VydmljZSBJbmZvcm1hdGlxdWU8YnI+PGEgaHJlZj0ibWFp bHRvOmluZm9ybWF0aXF1ZUB2aWxsZS1rb3Vyb3UuZnIiIHRhcmdldD0iX2JsYW5rIj5pbmZvcm1h dGlxdWVAdmlsbGUta291cm91LmZyPC9hPjxicj4wNTk0IDIyIDMxIDIyPGJyPk1haXJpZSBkZSBL b3Vyb3U8L3A+CjwvZGl2Pgo8L2Rpdj4KPGJyPl9fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fPGJyPiBVc2VycyBtYWlsaW5nIGxpc3Q8YnI+PGEgaHJlZj0ibWFp bHRvOlVzZXJzQG92aXJ0Lm9yZyIgdGFyZ2V0PSJfYmxhbmsiPlVzZXJzQG92aXJ0Lm9yZzwvYT48 YnI+PGEgaHJlZj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJz IiB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZv L3VzZXJzPC9hPjxicj48YnI+PC9ibG9ja3F1b3RlPgo8L2Rpdj4KPC9kaXY+CjwvZGl2Pgo8L2Js b2NrcXVvdGU+CjwvZGl2PjwvZGl2PjwvZGl2Pgo8YnI+X19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX188YnI+ClVzZXJzIG1haWxpbmcgbGlzdDxicj4KPGEgaHJl Zj0ibWFpbHRvOlVzZXJzQG92aXJ0Lm9yZyIgdGFyZ2V0PSJfYmxhbmsiPlVzZXJzQG92aXJ0Lm9y ZzwvYT48YnI+CjxhIGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5m by91c2VycyIgcmVsPSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL2xpc3RzLm92 aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzPC9hPjxicj4KPGJyPjwvYmxvY2txdW90ZT48 L2Rpdj48YnI+PC9kaXY+PC9kaXY+Cg== --===============2015363283645993504==--