From artem.tambovskiy at gmail.com Fri Nov 3 07:10:49 2017 Content-Type: multipart/mixed; boundary="===============1996064980825563533==" MIME-Version: 1.0 From: Artem Tambovskiy To: users at ovirt.org Subject: [ovirt-users] Advise needed: building cheap HA oVirt cluster with just 2 physical servers Date: Fri, 03 Nov 2017 10:10:26 +0300 Message-ID: --===============1996064980825563533== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Looking for a design advise on oVirt provisioning. I'm running a PoC lab on single bare-metal host (suddenly it was setup with just Local Storage domain) and no I'd like to rebuild the setup by making a cluster of 2 physical servers, no external storage array available. That are the options here? is there any options to build cheap HA cluster with just 2 servers? Thanks in advance! Artem --===============1996064980825563533== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGRpdj5Mb29raW5nIGZvciBhIGRlc2lnbiBhZHZpc2Ugb24gb1ZpcnQg cHJvdmlzaW9uaW5nLiBJJiMzOTttIHJ1bm5pbmcgYSBQb0MgbGFiIG9uIHNpbmdsZSBiYXJlLW1l dGFsIGhvc3QgKHN1ZGRlbmx5IGl0IHdhcyBzZXR1cCB3aXRoIGp1c3QgTG9jYWwgU3RvcmFnZSBk b21haW4pIGFuZMKgPC9kaXY+PGRpdj5ubyBJJiMzOTtkIGxpa2UgdG8gcmVidWlsZCB0aGUgc2V0 dXAgYnkgbWFraW5nIGEgY2x1c3RlciBvZiAyIHBoeXNpY2FsIHNlcnZlcnMsIG5vIGV4dGVybmFs IHN0b3JhZ2UgYXJyYXkgYXZhaWxhYmxlLiBUaGF0IGFyZSB0aGUgb3B0aW9ucyBoZXJlPyBpcyB0 aGVyZSBhbnkgb3B0aW9ucyB0byBidWlsZCBjaGVhcCBIQSBjbHVzdGVyIHdpdGgganVzdCAyIHNl cnZlcnM/wqA8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PlRoYW5rcyBpbiBhZHZhbmNlITwvZGl2 PjxkaXY+PGJyPjwvZGl2PjxkaXY+QXJ0ZW08L2Rpdj48L2Rpdj4K --===============1996064980825563533==-- From emayoral at arsys.es Fri Nov 3 07:24:50 2017 Content-Type: multipart/mixed; boundary="===============6776103389567548851==" MIME-Version: 1.0 From: Eduardo Mayoral To: users at ovirt.org Subject: Re: [ovirt-users] Advise needed: building cheap HA oVirt cluster with just 2 physical servers Date: Fri, 03 Nov 2017 08:24:47 +0100 Message-ID: <2b700d1b-3295-3ecd-1923-0f05e8347107@arsys.es> In-Reply-To: CAAq+Rfab8fvhNV+uP2hEceJywaezEqyRSDwdBx60333SMR7k4A@mail.gmail.com --===============6776103389567548851== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------7FE4F8F8D0FA672540A59BDE Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 8bit For HA you will need some kind of storage available to all the compute nodes in the cluster. If you have no external storage and few nodes, I think your best option for storage is gluster , and the minimum number of nodes you will need for HA is 3 (the third gluster node can be metadata-only, but you still need that third node to give you quorum, avoid split-brains and have something that you can call "HA" with a straight face. Eduardo Mayoral Jimeno (emayoral(a)arsys.es) Administrador de sistemas. Departamento de Plataformas. Arsys internet. +34 941 620 145 ext. 5153 On 03/11/17 08:10, Artem Tambovskiy wrote: > Looking for a design advise on oVirt provisioning. I'm running a PoC > lab on single bare-metal host (suddenly it was setup with just Local > Storage domain) and=C2=A0 > no I'd like to rebuild the setup by making a cluster of 2 physical > servers, no external storage array available. That are the options > here? is there any options to build cheap HA cluster with just 2 servers?= =C2=A0 > > Thanks in advance! > > Artem > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --------------7FE4F8F8D0FA672540A59BDE Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 8bit

For HA you will need some kind of storage available to all the compute nodes in the cluster. If you have no external storage and few nodes, I think your best option for storage is gluster , and the minimum number of nodes you will need for HA is 3 (the third gluster node can be metadata-only, but you still need that third node to give you quorum, avoid split-brains and have something that you can call "HA" with a straight face.

Eduardo Mayoral Jimeno (emayora=
l(a)arsys.es)
Administrador de sistemas. Departamento de Plataformas. Arsys internet.
+34 941 620 145 ext. 5153
On 03/11/17 08:10, Artem Tambovskiy wrote:
Looking for a design advise on oVirt provisioning. I'm running a PoC lab on single bare-metal host (suddenly it was setup with just Local Storage domain) and=C2=A0
no I'd like to rebuild the setup by making a cluster of 2 physical servers, no external storage array available. That are the options here? is there any options to build cheap HA cluster with just 2 servers?=C2=A0

Thanks in advance!

Artem


_______________________________________________
Users mailing list
Use=
rs(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

--------------7FE4F8F8D0FA672540A59BDE-- --===============6776103389567548851== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS03RkU0RjhGOEQwRkE2NzI1NDBBNTlCREUKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDhiaXQKCkZvciBIQSB5b3Ugd2ls bCBuZWVkIHNvbWUga2luZCBvZiBzdG9yYWdlIGF2YWlsYWJsZSB0byBhbGwgdGhlIGNvbXB1dGUK bm9kZXMgaW4gdGhlIGNsdXN0ZXIuIElmIHlvdSBoYXZlIG5vIGV4dGVybmFsIHN0b3JhZ2UgYW5k IGZldyBub2RlcywgSQp0aGluayB5b3VyIGJlc3Qgb3B0aW9uIGZvciBzdG9yYWdlIGlzIGdsdXN0 ZXIgLCBhbmQgdGhlIG1pbmltdW0gbnVtYmVyCm9mIG5vZGVzIHlvdSB3aWxsIG5lZWQgZm9yIEhB IGlzIDMgKHRoZSB0aGlyZCBnbHVzdGVyIG5vZGUgY2FuIGJlCm1ldGFkYXRhLW9ubHksIGJ1dCB5 b3Ugc3RpbGwgbmVlZCB0aGF0IHRoaXJkIG5vZGUgdG8gZ2l2ZSB5b3UgcXVvcnVtLAphdm9pZCBz cGxpdC1icmFpbnMgYW5kIGhhdmUgc29tZXRoaW5nIHRoYXQgeW91IGNhbiBjYWxsICJIQSIgd2l0 aCBhCnN0cmFpZ2h0IGZhY2UuCgpFZHVhcmRvIE1heW9yYWwgSmltZW5vIChlbWF5b3JhbEBhcnN5 cy5lcykKQWRtaW5pc3RyYWRvciBkZSBzaXN0ZW1hcy4gRGVwYXJ0YW1lbnRvIGRlIFBsYXRhZm9y bWFzLiBBcnN5cyBpbnRlcm5ldC4KKzM0IDk0MSA2MjAgMTQ1IGV4dC4gNTE1MwoKT24gMDMvMTEv MTcgMDg6MTAsIEFydGVtIFRhbWJvdnNraXkgd3JvdGU6Cj4gTG9va2luZyBmb3IgYSBkZXNpZ24g YWR2aXNlIG9uIG9WaXJ0IHByb3Zpc2lvbmluZy4gSSdtIHJ1bm5pbmcgYSBQb0MKPiBsYWIgb24g c2luZ2xlIGJhcmUtbWV0YWwgaG9zdCAoc3VkZGVubHkgaXQgd2FzIHNldHVwIHdpdGgganVzdCBM b2NhbAo+IFN0b3JhZ2UgZG9tYWluKSBhbmTCoAo+IG5vIEknZCBsaWtlIHRvIHJlYnVpbGQgdGhl IHNldHVwIGJ5IG1ha2luZyBhIGNsdXN0ZXIgb2YgMiBwaHlzaWNhbAo+IHNlcnZlcnMsIG5vIGV4 dGVybmFsIHN0b3JhZ2UgYXJyYXkgYXZhaWxhYmxlLiBUaGF0IGFyZSB0aGUgb3B0aW9ucwo+IGhl cmU/IGlzIHRoZXJlIGFueSBvcHRpb25zIHRvIGJ1aWxkIGNoZWFwIEhBIGNsdXN0ZXIgd2l0aCBq dXN0IDIgc2VydmVycz/CoAo+Cj4gVGhhbmtzIGluIGFkdmFuY2UhCj4KPiBBcnRlbQo+Cj4KPiBf X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwo+IFVzZXJzIG1h aWxpbmcgbGlzdAo+IFVzZXJzQG92aXJ0Lm9yZwo+IGh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFp bG1hbi9saXN0aW5mby91c2VycwoKCi0tLS0tLS0tLS0tLS0tN0ZFNEY4RjhEMEZBNjcyNTQwQTU5 QkRFCkNvbnRlbnQtVHlwZTogdGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNm ZXItRW5jb2Rpbmc6IDhiaXQKCjxodG1sPgogIDxoZWFkPgogICAgPG1ldGEgaHR0cC1lcXVpdj0i Q29udGVudC1UeXBlIiBjb250ZW50PSJ0ZXh0L2h0bWw7IGNoYXJzZXQ9dXRmLTgiPgogIDwvaGVh ZD4KICA8Ym9keSB0ZXh0PSIjMDAwMDAwIiBiZ2NvbG9yPSIjRkZGRkZGIj4KICAgIDxwPkZvciBI QSB5b3Ugd2lsbCBuZWVkIHNvbWUga2luZCBvZiBzdG9yYWdlIGF2YWlsYWJsZSB0byBhbGwgdGhl CiAgICAgIGNvbXB1dGUgbm9kZXMgaW4gdGhlIGNsdXN0ZXIuIElmIHlvdSBoYXZlIG5vIGV4dGVy bmFsIHN0b3JhZ2UgYW5kCiAgICAgIGZldyBub2RlcywgSSB0aGluayB5b3VyIGJlc3Qgb3B0aW9u IGZvciBzdG9yYWdlIGlzIGdsdXN0ZXIgLCBhbmQKICAgICAgdGhlIG1pbmltdW0gbnVtYmVyIG9m IG5vZGVzIHlvdSB3aWxsIG5lZWQgZm9yIEhBIGlzIDMgKHRoZSB0aGlyZAogICAgICBnbHVzdGVy IG5vZGUgY2FuIGJlIG1ldGFkYXRhLW9ubHksIGJ1dCB5b3Ugc3RpbGwgbmVlZCB0aGF0IHRoaXJk CiAgICAgIG5vZGUgdG8gZ2l2ZSB5b3UgcXVvcnVtLCBhdm9pZCBzcGxpdC1icmFpbnMgYW5kIGhh dmUgc29tZXRoaW5nCiAgICAgIHRoYXQgeW91IGNhbiBjYWxsICJIQSIgd2l0aCBhIHN0cmFpZ2h0 IGZhY2UuPGJyPgogICAgPC9wPgogICAgPHByZSBjbGFzcz0ibW96LXNpZ25hdHVyZSIgY29scz0i NzIiPkVkdWFyZG8gTWF5b3JhbCBKaW1lbm8gKDxhIGNsYXNzPSJtb3otdHh0LWxpbmstYWJicmV2 aWF0ZWQiIGhyZWY9Im1haWx0bzplbWF5b3JhbEBhcnN5cy5lcyI+ZW1heW9yYWxAYXJzeXMuZXM8 L2E+KQpBZG1pbmlzdHJhZG9yIGRlIHNpc3RlbWFzLiBEZXBhcnRhbWVudG8gZGUgUGxhdGFmb3Jt YXMuIEFyc3lzIGludGVybmV0LgorMzQgOTQxIDYyMCAxNDUgZXh0LiA1MTUzPC9wcmU+CiAgICA8 ZGl2IGNsYXNzPSJtb3otY2l0ZS1wcmVmaXgiPk9uIDAzLzExLzE3IDA4OjEwLCBBcnRlbSBUYW1i b3Zza2l5CiAgICAgIHdyb3RlOjxicj4KICAgIDwvZGl2PgogICAgPGJsb2NrcXVvdGUgdHlwZT0i Y2l0ZSIKY2l0ZT0ibWlkOkNBQXErUmZhYjhmdmhOVit1UDJoRWNlSnl3YWV6RXF5UlNEd2RCeDYw MzMzU01SN2s0QUBtYWlsLmdtYWlsLmNvbSI+CiAgICAgIDxtZXRhIGh0dHAtZXF1aXY9IkNvbnRl bnQtVHlwZSIgY29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4KICAgICAgPGRpdiBk aXI9Imx0ciI+CiAgICAgICAgPGRpdj5Mb29raW5nIGZvciBhIGRlc2lnbiBhZHZpc2Ugb24gb1Zp cnQgcHJvdmlzaW9uaW5nLiBJJ20KICAgICAgICAgIHJ1bm5pbmcgYSBQb0MgbGFiIG9uIHNpbmds ZSBiYXJlLW1ldGFsIGhvc3QgKHN1ZGRlbmx5IGl0IHdhcwogICAgICAgICAgc2V0dXAgd2l0aCBq dXN0IExvY2FsIFN0b3JhZ2UgZG9tYWluKSBhbmTCoDwvZGl2PgogICAgICAgIDxkaXY+bm8gSSdk IGxpa2UgdG8gcmVidWlsZCB0aGUgc2V0dXAgYnkgbWFraW5nIGEgY2x1c3RlciBvZiAyCiAgICAg ICAgICBwaHlzaWNhbCBzZXJ2ZXJzLCBubyBleHRlcm5hbCBzdG9yYWdlIGFycmF5IGF2YWlsYWJs ZS4gVGhhdAogICAgICAgICAgYXJlIHRoZSBvcHRpb25zIGhlcmU/IGlzIHRoZXJlIGFueSBvcHRp b25zIHRvIGJ1aWxkIGNoZWFwIEhBCiAgICAgICAgICBjbHVzdGVyIHdpdGgganVzdCAyIHNlcnZl cnM/wqA8L2Rpdj4KICAgICAgICA8ZGl2Pjxicj4KICAgICAgICA8L2Rpdj4KICAgICAgICA8ZGl2 PlRoYW5rcyBpbiBhZHZhbmNlITwvZGl2PgogICAgICAgIDxkaXY+PGJyPgogICAgICAgIDwvZGl2 PgogICAgICAgIDxkaXY+QXJ0ZW08L2Rpdj4KICAgICAgPC9kaXY+CiAgICAgIDxicj4KICAgICAg PGZpZWxkc2V0IGNsYXNzPSJtaW1lQXR0YWNobWVudEhlYWRlciI+PC9maWVsZHNldD4KICAgICAg PGJyPgogICAgICA8cHJlIHdyYXA9IiI+X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX18KVXNlcnMgbWFpbGluZyBsaXN0CjxhIGNsYXNzPSJtb3otdHh0LWxpbmst YWJicmV2aWF0ZWQiIGhyZWY9Im1haWx0bzpVc2Vyc0BvdmlydC5vcmciPlVzZXJzQG92aXJ0Lm9y ZzwvYT4KPGEgY2xhc3M9Im1vei10eHQtbGluay1mcmVldGV4dCIgaHJlZj0iaHR0cDovL2xpc3Rz Lm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIj5odHRwOi8vbGlzdHMub3ZpcnQub3Jn L21haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E+CjwvcHJlPgogICAgPC9ibG9ja3F1b3RlPgogICAg PGJyPgogIDwvYm9keT4KPC9odG1sPgoKLS0tLS0tLS0tLS0tLS03RkU0RjhGOEQwRkE2NzI1NDBB NTlCREUtLQo= --===============6776103389567548851==-- From artem.tambovskiy at gmail.com Fri Nov 3 07:39:45 2017 Content-Type: multipart/mixed; boundary="===============5419418717041868662==" MIME-Version: 1.0 From: Artem Tambovskiy To: users at ovirt.org Subject: Re: [ovirt-users] Advise needed: building cheap HA oVirt cluster with just 2 physical servers Date: Fri, 03 Nov 2017 10:39:23 +0300 Message-ID: In-Reply-To: 2b700d1b-3295-3ecd-1923-0f05e8347107@arsys.es --===============5419418717041868662== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Thanks Eduardo! I think I can find a third server to build a glusterFS storage. So the first step will be to install a self-hosted engine on the new server and start building a glusterFS storage. IS there any easy way to migrate existing 5 VM's running on the second bare-metal oVirt host, right? I found a little bit tricky moving oVirt backups between the hosts (at least I failed to replicate the existing VM's on the second server). Regards, Artem On Fri, Nov 3, 2017 at 10:24 AM, Eduardo Mayoral wrot= e: > For HA you will need some kind of storage available to all the compute > nodes in the cluster. If you have no external storage and few nodes, I > think your best option for storage is gluster , and the minimum number of > nodes you will need for HA is 3 (the third gluster node can be > metadata-only, but you still need that third node to give you quorum, avo= id > split-brains and have something that you can call "HA" with a straight fa= ce. > > Eduardo Mayoral Jimeno (emayoral(a)arsys.es) > Administrador de sistemas. Departamento de Plataformas. Arsys internet.+3= 4 941 620 145 ext. 5153 <+34%20941%2062%2001%2045> > > On 03/11/17 08:10, Artem Tambovskiy wrote: > > Looking for a design advise on oVirt provisioning. I'm running a PoC lab > on single bare-metal host (suddenly it was setup with just Local Storage > domain) and > no I'd like to rebuild the setup by making a cluster of 2 physical > servers, no external storage array available. That are the options here? = is > there any options to build cheap HA cluster with just 2 servers? > > Thanks in advance! > > Artem > > > _______________________________________________ > Users mailing listUsers(a)ovirt.orghttp://lists.ovirt.org/mailman/listinf= o/users > > > --===============5419418717041868662== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+VGhhbmtzIEVkdWFyZG8hPGJyPjxicj5JIHRoaW5rIEkgY2FuIGZpbmQg YSB0aGlyZCBzZXJ2ZXIgdG8gYnVpbGQgYSBnbHVzdGVyRlMgc3RvcmFnZS4gU28gdGhlIGZpcnN0 IHN0ZXAgd2lsbCBiZSB0byBpbnN0YWxsIGEgc2VsZi1ob3N0ZWQgZW5naW5lIG9uIHRoZSBuZXcg c2VydmVyIGFuZCBzdGFydCBidWlsZGluZyBhIGdsdXN0ZXJGUyBzdG9yYWdlLiBJUyB0aGVyZSBh bnkgZWFzeSB3YXkgdG8gbWlncmF0ZSBleGlzdGluZyA1IFZNJiMzOTtzIHJ1bm5pbmcgb24gdGhl IHNlY29uZCBiYXJlLW1ldGFsIG9WaXJ0IGhvc3QsIHJpZ2h0PyBJIGZvdW5kIGEgbGl0dGxlIGJp dCB0cmlja3kgbW92aW5nIG9WaXJ0IGJhY2t1cHMgYmV0d2VlbiB0aGUgaG9zdHMgKGF0IGxlYXN0 IEkgZmFpbGVkIHRvIHJlcGxpY2F0ZSB0aGUgZXhpc3RpbmcgVk0mIzM5O3Mgb24gdGhlIHNlY29u ZCBzZXJ2ZXIpLjxkaXY+PGJyPjwvZGl2PjxkaXY+UmVnYXJkcyw8L2Rpdj48ZGl2PkFydGVtPGJy Pjxicj48YnI+PC9kaXY+PC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZXh0cmEiPjxicj48ZGl2IGNs YXNzPSJnbWFpbF9xdW90ZSI+T24gRnJpLCBOb3YgMywgMjAxNyBhdCAxMDoyNCBBTSwgRWR1YXJk byBNYXlvcmFsIDxzcGFuIGRpcj0ibHRyIj4mbHQ7PGEgaHJlZj0ibWFpbHRvOmVtYXlvcmFsQGFy c3lzLmVzIiB0YXJnZXQ9Il9ibGFuayI+ZW1heW9yYWxAYXJzeXMuZXM8L2E+Jmd0Ozwvc3Bhbj4g d3JvdGU6PGJyPjxibG9ja3F1b3RlIGNsYXNzPSJnbWFpbF9xdW90ZSIgc3R5bGU9Im1hcmdpbjow IDAgMCAuOGV4O2JvcmRlci1sZWZ0OjFweCAjY2NjIHNvbGlkO3BhZGRpbmctbGVmdDoxZXgiPgog IAogICAgCiAgCiAgPGRpdiB0ZXh0PSIjMDAwMDAwIiBiZ2NvbG9yPSIjRkZGRkZGIj4KICAgIDxw PkZvciBIQSB5b3Ugd2lsbCBuZWVkIHNvbWUga2luZCBvZiBzdG9yYWdlIGF2YWlsYWJsZSB0byBh bGwgdGhlCiAgICAgIGNvbXB1dGUgbm9kZXMgaW4gdGhlIGNsdXN0ZXIuIElmIHlvdSBoYXZlIG5v IGV4dGVybmFsIHN0b3JhZ2UgYW5kCiAgICAgIGZldyBub2RlcywgSSB0aGluayB5b3VyIGJlc3Qg b3B0aW9uIGZvciBzdG9yYWdlIGlzIGdsdXN0ZXIgLCBhbmQKICAgICAgdGhlIG1pbmltdW0gbnVt YmVyIG9mIG5vZGVzIHlvdSB3aWxsIG5lZWQgZm9yIEhBIGlzIDMgKHRoZSB0aGlyZAogICAgICBn bHVzdGVyIG5vZGUgY2FuIGJlIG1ldGFkYXRhLW9ubHksIGJ1dCB5b3Ugc3RpbGwgbmVlZCB0aGF0 IHRoaXJkCiAgICAgIG5vZGUgdG8gZ2l2ZSB5b3UgcXVvcnVtLCBhdm9pZCBzcGxpdC1icmFpbnMg YW5kIGhhdmUgc29tZXRoaW5nCiAgICAgIHRoYXQgeW91IGNhbiBjYWxsICZxdW90O0hBJnF1b3Q7 IHdpdGggYSBzdHJhaWdodCBmYWNlLjxicj4KICAgIDwvcD4KICAgIDxwcmUgY2xhc3M9Im1fLTE5 MjkyOTkyNDIzNDAzMjMyMTltb3otc2lnbmF0dXJlIiBjb2xzPSI3MiI+RWR1YXJkbyBNYXlvcmFs IEppbWVubyAoPGEgY2xhc3M9Im1fLTE5MjkyOTkyNDIzNDAzMjMyMTltb3otdHh0LWxpbmstYWJi cmV2aWF0ZWQiIGhyZWY9Im1haWx0bzplbWF5b3JhbEBhcnN5cy5lcyIgdGFyZ2V0PSJfYmxhbmsi PmVtYXlvcmFsQGFyc3lzLmVzPC9hPikKQWRtaW5pc3RyYWRvciBkZSBzaXN0ZW1hcy4gRGVwYXJ0 YW1lbnRvIGRlIFBsYXRhZm9ybWFzLiBBcnN5cyBpbnRlcm5ldC4KPGEgaHJlZj0idGVsOiszNCUy MDk0MSUyMDYyJTIwMDElMjA0NSIgdmFsdWU9IiszNDk0MTYyMDE0NSIgdGFyZ2V0PSJfYmxhbmsi PiszNCA5NDEgNjIwIDE0NSBleHQuIDUxNTM8L2E+PC9wcmU+PGRpdj48ZGl2IGNsYXNzPSJoNSI+ CiAgICA8ZGl2IGNsYXNzPSJtXy0xOTI5Mjk5MjQyMzQwMzIzMjE5bW96LWNpdGUtcHJlZml4Ij5P biAwMy8xMS8xNyAwODoxMCwgQXJ0ZW0gVGFtYm92c2tpeQogICAgICB3cm90ZTo8YnI+CiAgICA8 L2Rpdj4KICAgIDwvZGl2PjwvZGl2PjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxkaXY+PGRpdiBj bGFzcz0iaDUiPgogICAgICAKICAgICAgPGRpdiBkaXI9Imx0ciI+CiAgICAgICAgPGRpdj5Mb29r aW5nIGZvciBhIGRlc2lnbiBhZHZpc2Ugb24gb1ZpcnQgcHJvdmlzaW9uaW5nLiBJJiMzOTttCiAg ICAgICAgICBydW5uaW5nIGEgUG9DIGxhYiBvbiBzaW5nbGUgYmFyZS1tZXRhbCBob3N0IChzdWRk ZW5seSBpdCB3YXMKICAgICAgICAgIHNldHVwIHdpdGgganVzdCBMb2NhbCBTdG9yYWdlIGRvbWFp bikgYW5kwqA8L2Rpdj4KICAgICAgICA8ZGl2Pm5vIEkmIzM5O2QgbGlrZSB0byByZWJ1aWxkIHRo ZSBzZXR1cCBieSBtYWtpbmcgYSBjbHVzdGVyIG9mIDIKICAgICAgICAgIHBoeXNpY2FsIHNlcnZl cnMsIG5vIGV4dGVybmFsIHN0b3JhZ2UgYXJyYXkgYXZhaWxhYmxlLiBUaGF0CiAgICAgICAgICBh cmUgdGhlIG9wdGlvbnMgaGVyZT8gaXMgdGhlcmUgYW55IG9wdGlvbnMgdG8gYnVpbGQgY2hlYXAg SEEKICAgICAgICAgIGNsdXN0ZXIgd2l0aCBqdXN0IDIgc2VydmVycz/CoDwvZGl2PgogICAgICAg IDxkaXY+PGJyPgogICAgICAgIDwvZGl2PgogICAgICAgIDxkaXY+VGhhbmtzIGluIGFkdmFuY2Uh PC9kaXY+CiAgICAgICAgPGRpdj48YnI+CiAgICAgICAgPC9kaXY+CiAgICAgICAgPGRpdj5BcnRl bTwvZGl2PgogICAgICA8L2Rpdj4KICAgICAgPGJyPgogICAgICA8ZmllbGRzZXQgY2xhc3M9Im1f LTE5MjkyOTkyNDIzNDAzMjMyMTltaW1lQXR0YWNobWVudEhlYWRlciI+PC9maWVsZHNldD4KICAg ICAgPGJyPgogICAgICA8L2Rpdj48L2Rpdj48cHJlPl9fX19fX19fX19fX19fX19fX19fX19fX19f X19fXzx3YnI+X19fX19fX19fX19fX19fX18KVXNlcnMgbWFpbGluZyBsaXN0CjxhIGNsYXNzPSJt Xy0xOTI5Mjk5MjQyMzQwMzIzMjE5bW96LXR4dC1saW5rLWFiYnJldmlhdGVkIiBocmVmPSJtYWls dG86VXNlcnNAb3ZpcnQub3JnIiB0YXJnZXQ9Il9ibGFuayI+VXNlcnNAb3ZpcnQub3JnPC9hPgo8 YSBjbGFzcz0ibV8tMTkyOTI5OTI0MjM0MDMyMzIxOW1vei10eHQtbGluay1mcmVldGV4dCIgaHJl Zj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIiB0YXJnZXQ9 Il9ibGFuayI+aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy88d2JyPm1haWxtYW4vbGlzdGluZm8vdXNl cnM8L2E+CjwvcHJlPgogICAgPC9ibG9ja3F1b3RlPgogICAgPGJyPgogIDwvZGl2PgoKPC9ibG9j a3F1b3RlPjwvZGl2Pjxicj48L2Rpdj4K --===============5419418717041868662==-- From johan at kafit.se Fri Nov 3 07:48:59 2017 Content-Type: multipart/mixed; boundary="===============8036688238523352088==" MIME-Version: 1.0 From: Johan Bernhardsson To: users at ovirt.org Subject: Re: [ovirt-users] Advise needed: building cheap HA oVirt cluster with just 2 physical servers Date: Fri, 03 Nov 2017 08:40:54 +0100 Message-ID: <15f80d35370.2768.ffe2d6cdf294efc1bb86526523af9945@kafit.se> In-Reply-To: CAAq+Rfab8fvhNV+uP2hEceJywaezEqyRSDwdBx60333SMR7k4A@mail.gmail.com --===============8036688238523352088== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. ------------15f80d354a578e9276895b40fa Content-Type: text/plain; format=3Dflowed; charset=3D"UTF-8" Content-Transfer-Encoding: quoted-printable Check on drbd. I have used that to build a cluster for two servers. It ne= =3D ed=3D20 some more work than a three node gluster conf but works well. I even think they have a white paper on how to do it for virtualization. /Johan On November 3, 2017 08:11:04 Artem Tambovskiy =3D20 wrote: > Looking for a design advise on oVirt provisioning. I'm running a PoC la= =3D b on > single bare-metal host (suddenly it was setup with just Local Storage > domain) and > no I'd like to rebuild the setup by making a cluster of 2 physical serv= =3D ers, > no external storage array available. That are the options here? is ther= =3D e > any options to build cheap HA cluster with just 2 servers? > > Thanks in advance! > > Artem > > > > ---------- > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > ------------15f80d354a578e9276895b40fa Content-Type: text/html; charset=3D"UTF-8" Content-Transfer-Encoding: quoted-printable

Check on drbd. I have used = =3D that to build a cluster for two servers. It need some more work than a three node gluster conf but works well.

I even think they have a wh= =3D ite paper on how to do it for virtualization.

/Johan

On November 3, 2017 08:11:04 Artem Tambovskiy <artem.tambovskiy(a)gmail.com> wrote:

Looking for a design advise on oVirt provisioning. I'm running a PoC lab on single bare-metal host (suddenly it was setu= =3D p with just Local Storage domain) and=3DC2=3DA0
no I'd like to = re=3D build the setup by making a cluster of 2 physical servers, no external storage array available. That are the options here? is there any options to build cheap HA cluster with just 2 servers?=3DC2=3DA0

Th= an=3D ks in advance!

Artem
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt= =3D .org/mailman/listinfo/users

------------15f80d354a578e9276895b40fa-- --===============8036688238523352088== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t MTVmODBkMzU0YTU3OGU5Mjc2ODk1YjQwZmEKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBmb3Jt YXQ9Zmxvd2VkOyBjaGFyc2V0PSJVVEYtOCIKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogcXVv dGVkLXByaW50YWJsZQoKQ2hlY2sgb24gZHJiZC4gSSBoYXZlIHVzZWQgdGhhdCB0byBidWlsZCBh IGNsdXN0ZXIgZm9yIHR3byBzZXJ2ZXJzLiBJdCBuZT0KZWQ9MjAKc29tZSBtb3JlIHdvcmsgdGhh biBhIHRocmVlIG5vZGUgZ2x1c3RlciBjb25mIGJ1dCB3b3JrcyB3ZWxsLgoKSSBldmVuIHRoaW5r IHRoZXkgaGF2ZSBhIHdoaXRlIHBhcGVyIG9uIGhvdyB0byBkbyBpdCBmb3IgdmlydHVhbGl6YXRp b24uCgovSm9oYW4KCgpPbiBOb3ZlbWJlciAzLCAyMDE3IDA4OjExOjA0IEFydGVtIFRhbWJvdnNr aXkgPGFydGVtLnRhbWJvdnNraXlAZ21haWwuY29tPQo+PTIwCndyb3RlOgoKPiBMb29raW5nIGZv ciBhIGRlc2lnbiBhZHZpc2Ugb24gb1ZpcnQgcHJvdmlzaW9uaW5nLiBJJ20gcnVubmluZyBhIFBv QyBsYT0KYiBvbgo+IHNpbmdsZSBiYXJlLW1ldGFsIGhvc3QgKHN1ZGRlbmx5IGl0IHdhcyBzZXR1 cCB3aXRoIGp1c3QgTG9jYWwgU3RvcmFnZQo+IGRvbWFpbikgYW5kCj4gbm8gSSdkIGxpa2UgdG8g cmVidWlsZCB0aGUgc2V0dXAgYnkgbWFraW5nIGEgY2x1c3RlciBvZiAyIHBoeXNpY2FsIHNlcnY9 CmVycywKPiBubyBleHRlcm5hbCBzdG9yYWdlIGFycmF5IGF2YWlsYWJsZS4gVGhhdCBhcmUgdGhl IG9wdGlvbnMgaGVyZT8gaXMgdGhlcj0KZQo+IGFueSBvcHRpb25zIHRvIGJ1aWxkIGNoZWFwIEhB IGNsdXN0ZXIgd2l0aCBqdXN0IDIgc2VydmVycz8KPgo+IFRoYW5rcyBpbiBhZHZhbmNlIQo+Cj4g QXJ0ZW0KPgo+Cj4KPiAtLS0tLS0tLS0tCj4gX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX18KPiBVc2VycyBtYWlsaW5nIGxpc3QKPiBVc2Vyc0BvdmlydC5vcmcK PiBodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMKPgoKLS0tLS0t LS0tLS0tMTVmODBkMzU0YTU3OGU5Mjc2ODk1YjQwZmEKQ29udGVudC1UeXBlOiB0ZXh0L2h0bWw7 IGNoYXJzZXQ9IlVURi04IgpDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiBxdW90ZWQtcHJpbnRh YmxlCgo8aHRtbD4KPGhlYWQ+CjwvaGVhZD4KPGJvZHk+CjxkaXYgc3R5bGU9M0QiY29sb3I6IGJs YWNrOyI+CjxkaXYgc3R5bGU9M0QiY29sb3I6IGJsYWNrOyI+CjxwIHN0eWxlPTNEIm1hcmdpbjog MCAwIDFlbSAwOyBjb2xvcjogYmxhY2s7Ij5DaGVjayBvbiBkcmJkLiBJIGhhdmUgdXNlZCA9CnRo YXQKdG8gYnVpbGQgYSBjbHVzdGVyIGZvciB0d28gc2VydmVycy4gSXQgbmVlZCBzb21lIG1vcmUg d29yayB0aGFuIGEgdGhyZWUKbm9kZSBnbHVzdGVyIGNvbmYgYnV0IHdvcmtzIHdlbGwuPC9wPgo8 cCBzdHlsZT0zRCJtYXJnaW46IDAgMCAxZW0gMDsgY29sb3I6IGJsYWNrOyI+SSBldmVuIHRoaW5r IHRoZXkgaGF2ZSBhIHdoPQppdGUKcGFwZXIgb24gaG93IHRvIGRvIGl0IGZvciB2aXJ0dWFsaXph dGlvbi48L3A+CjxwIHN0eWxlPTNEIm1hcmdpbjogMCAwIDFlbSAwOyBjb2xvcjogYmxhY2s7Ij4v Sm9oYW48L3A+CjwvZGl2Pgo8ZGl2IHN0eWxlPTNEImNvbG9yOiBibGFjazsiPgo8cApzdHlsZT0z RCJjb2xvcjogYmxhY2s7IGZvbnQtc2l6ZTogMTBwdDsgZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5z LXNlcmlmOyBtPQphcmdpbjogMTBwdCAwOyI+T24KTm92ZW1iZXIgMywgMjAxNyAwODoxMTowNCBB cnRlbSBUYW1ib3Zza2l5CiZsdDthcnRlbS50YW1ib3Zza2l5QGdtYWlsLmNvbSZndDsgd3JvdGU6 PC9wPgo8YmxvY2txdW90ZSB0eXBlPTNEImNpdGUiIGNsYXNzPTNEImdtYWlsX3F1b3RlIgpzdHls ZT0zRCJtYXJnaW46IDAgMCAwIDAuNzVleDsgYm9yZGVyLWxlZnQ6IDFweCBzb2xpZCAjODA4MDgw OyBwYWRkaW5nLWxlPQpmdDogMC43NWV4OyI+CjxkaXYgZGlyPTNEImx0ciI+PGRpdj5Mb29raW5n IGZvciBhIGRlc2lnbiBhZHZpc2Ugb24gb1ZpcnQgcHJvdmlzaW9uaW5nLgpJJiMzOTttIHJ1bm5p bmcgYSBQb0MgbGFiIG9uIHNpbmdsZSBiYXJlLW1ldGFsIGhvc3QgKHN1ZGRlbmx5IGl0IHdhcyBz ZXR1PQpwCndpdGgganVzdCBMb2NhbCBTdG9yYWdlIGRvbWFpbikgYW5kPUMyPUEwPC9kaXY+PGRp dj5ubyBJJiMzOTtkIGxpa2UgdG8gcmU9CmJ1aWxkCnRoZSBzZXR1cCBieSBtYWtpbmcgYSBjbHVz dGVyIG9mIDIgcGh5c2ljYWwgc2VydmVycywgbm8gZXh0ZXJuYWwgc3RvcmFnZQphcnJheSBhdmFp bGFibGUuIFRoYXQgYXJlIHRoZSBvcHRpb25zIGhlcmU/IGlzIHRoZXJlIGFueSBvcHRpb25zIHRv IGJ1aWxkCmNoZWFwIEhBIGNsdXN0ZXIgd2l0aCBqdXN0IDIgc2VydmVycz89QzI9QTA8L2Rpdj48 ZGl2Pjxicj48L2Rpdj48ZGl2PlRoYW49CmtzIGluCmFkdmFuY2UhPC9kaXY+PGRpdj48YnI+PC9k aXY+PGRpdj5BcnRlbTwvZGl2PjwvZGl2PgoKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX188YnI+ClVzZXJzIG1haWxpbmcgbGlzdDxicj4KPGEgY2xhc3M9M0Qi YXFtLWF1dG9saW5rIGFxbS1hdXRvd3JhcCIKaHJlZj0zRCJtYWlsdG86VXNlcnMlNDBvdmlydC5v cmciPlVzZXJzQG92aXJ0Lm9yZzwvYT48YnI+CjxhIGNsYXNzPTNEImFxbS1hdXRvbGluayBhcW0t YXV0b3dyYXAiCmhyZWY9M0QiaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZv L3VzZXJzIj5odHRwOi8vbGlzdHMub3ZpcnQ9Ci5vcmcvbWFpbG1hbi9saXN0aW5mby91c2Vyczwv YT48YnI+Cjxicj4KPC9ibG9ja3F1b3RlPgo8L2Rpdj4KPC9kaXY+CjwvYm9keT4KPC9odG1sPgoK LS0tLS0tLS0tLS0tMTVmODBkMzU0YTU3OGU5Mjc2ODk1YjQwZmEtLQoK --===============8036688238523352088==-- From karli at inparadise.se Fri Nov 3 07:50:38 2017 Content-Type: multipart/mixed; boundary="===============4261955550132220208==" MIME-Version: 1.0 From: =?utf-8?q?Karli_Sj=C3=B6berg_=3Ckarli_at_inparadise=2Ese=3E?= To: users at ovirt.org Subject: Re: [ovirt-users] Advise needed: building cheap HA oVirt cluster with just 2 physical servers Date: Fri, 03 Nov 2017 08:50:27 +0100 Message-ID: <1509695427.2218.4.camel@inparadise.se> In-Reply-To: CAAq+RfYZT9nYvPh3NttwrRu1JRb+1qhzihGi+WETrO8+vFcEng@mail.gmail.com --===============4261955550132220208== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On fre, 2017-11-03 at 10:39 +0300, Artem Tambovskiy wrote: > Thanks Eduardo! > = > I think I can find a third server to build a glusterFS storage. So > the first step will be to install a self-hosted engine on the new > server and start building a glusterFS storage. = You=C2=B4ll need to build the Gluster storage first, as you=C2=B4ll want to install the Hosted Engine _in_ the HA Gluster storage, right? /K > IS there any easy way to migrate existing 5 VM's running on the > second bare-metal oVirt host, right? I found a little bit tricky > moving oVirt backups between the hosts (at least I failed to > replicate the existing VM's on the second server). > = > Regards, > Artem > = > = > = > On Fri, Nov 3, 2017 at 10:24 AM, Eduardo Mayoral > wrote: > > For HA you will need some kind of storage available to all the > > compute nodes in the cluster. If you have no external storage and > > few nodes, I think your best option for storage is gluster , and > > the minimum number of nodes you will need for HA is 3 (the third > > gluster node can be metadata-only, but you still need that third > > node to give you quorum, avoid split-brains and have something that > > you can call "HA" with a straight face. > > Eduardo Mayoral Jimeno (emayoral(a)arsys.es) > > Administrador de sistemas. Departamento de Plataformas. Arsys > > internet. > > +34 941 620 145 ext. 5153 > > On 03/11/17 08:10, Artem Tambovskiy wrote: > > > Looking for a design advise on oVirt provisioning. I'm running a > > > PoC lab on single bare-metal host (suddenly it was setup with > > > just Local Storage domain) and=C2=A0 > > > no I'd like to rebuild the setup by making a cluster of 2 > > > physical servers, no external storage array available. That are > > > the options here? is there any options to build cheap HA cluster > > > with just 2 servers?=C2=A0 > > > = > > > Thanks in advance! > > > = > > > Artem > > > = > > > = > > > _______________________________________________ > > > Users mailing list > > > Users(a)ovirt.org > > > http://lists.ovirt.org/mailman/listinfo/users > > =C2=A0 > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --===============4261955550132220208==-- From emayoral at arsys.es Fri Nov 3 08:04:47 2017 Content-Type: multipart/mixed; boundary="===============8907342166034351908==" MIME-Version: 1.0 From: Eduardo Mayoral To: users at ovirt.org Subject: Re: [ovirt-users] Advise needed: building cheap HA oVirt cluster with just 2 physical servers Date: Fri, 03 Nov 2017 09:04:45 +0100 Message-ID: <0711091c-66a5-7aa5-0241-3ceba2ba1240@arsys.es> In-Reply-To: 15f80d35370.2768.ffe2d6cdf294efc1bb86526523af9945@kafit.se --===============8907342166034351908== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------933D75B60C3821BFBAB2AF63 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 8bit Just genuinely curious, how do you avoid split-brain situations with a 2-node setup (be it drbd, gluster or anything else)? Eduardo Mayoral Jimeno (emayoral(a)arsys.es) Administrador de sistemas. Departamento de Plataformas. Arsys internet. +34 941 620 145 ext. 5153 On 03/11/17 08:40, Johan Bernhardsson wrote: > > Check on drbd. I have used that to build a cluster for two servers. It > need some more work than a three node gluster conf but works well. > > I even think they have a white paper on how to do it for virtualization. > > /Johan > > On November 3, 2017 08:11:04 Artem Tambovskiy > wrote: > >> Looking for a design advise on oVirt provisioning. I'm running a PoC >> lab on single bare-metal host (suddenly it was setup with just Local >> Storage domain) and=C2=A0 >> no I'd like to rebuild the setup by making a cluster of 2 physical >> servers, no external storage array available. That are the options >> here? is there any options to build cheap HA cluster with just 2 >> servers?=C2=A0 >> >> Thanks in advance! >> >> Artem >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --------------933D75B60C3821BFBAB2AF63 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 8bit

Just genuinely curious, how do you avoid split-brain situations with a 2-node setup (be it drbd, gluster or anything else)?

Eduardo Mayoral Jimeno (emayora=
l(a)arsys.es)
Administrador de sistemas. Departamento de Plataformas. Arsys internet.
+34 941 620 145 ext. 5153
On 03/11/17 08:40, Johan Bernhardsson wrote:

Check on drbd. I have used that to build a cluster for two servers. It need some more work than a three node gluster conf but works well.

I even think they have a white paper on how to do it for virtualization.

/Johan

On November 3, 2017 08:11:04 Artem Tambovskiy <artem.tambovskiy(a)gmail.com> wrote:

Looking for a design advise on oVirt provisioning. I'm running a PoC lab on single bare-metal host (suddenly it was setup with just Local Storage domain) and=C2=A0
no I'd like to rebuild the setup by making a cluster of 2 physical servers, no external storage array available. That are the options here? is there any options to build cheap HA cluster with just 2 servers?=C2=A0

Thanks in advance!

Artem
_______________________________________________
Users mailing list
Us= ers(a)ovirt.org
http://lists.ovirt.org/mailman/listi= nfo/users



_______________________________________________
Users mailing list
Use=
rs(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

--------------933D75B60C3821BFBAB2AF63-- --===============8907342166034351908== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS05MzNENzVCNjBDMzgyMUJGQkFCMkFGNjMKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDhiaXQKCkp1c3QgZ2VudWluZWx5 IGN1cmlvdXMsIGhvdyBkbyB5b3UgYXZvaWQgc3BsaXQtYnJhaW4gc2l0dWF0aW9ucyB3aXRoIGEK Mi1ub2RlIHNldHVwIChiZSBpdCBkcmJkLCBnbHVzdGVyIG9yIGFueXRoaW5nIGVsc2UpPwoKRWR1 YXJkbyBNYXlvcmFsIEppbWVubyAoZW1heW9yYWxAYXJzeXMuZXMpCkFkbWluaXN0cmFkb3IgZGUg c2lzdGVtYXMuIERlcGFydGFtZW50byBkZSBQbGF0YWZvcm1hcy4gQXJzeXMgaW50ZXJuZXQuCisz NCA5NDEgNjIwIDE0NSBleHQuIDUxNTMKCk9uIDAzLzExLzE3IDA4OjQwLCBKb2hhbiBCZXJuaGFy ZHNzb24gd3JvdGU6Cj4KPiBDaGVjayBvbiBkcmJkLiBJIGhhdmUgdXNlZCB0aGF0IHRvIGJ1aWxk IGEgY2x1c3RlciBmb3IgdHdvIHNlcnZlcnMuIEl0Cj4gbmVlZCBzb21lIG1vcmUgd29yayB0aGFu IGEgdGhyZWUgbm9kZSBnbHVzdGVyIGNvbmYgYnV0IHdvcmtzIHdlbGwuCj4KPiBJIGV2ZW4gdGhp bmsgdGhleSBoYXZlIGEgd2hpdGUgcGFwZXIgb24gaG93IHRvIGRvIGl0IGZvciB2aXJ0dWFsaXph dGlvbi4KPgo+IC9Kb2hhbgo+Cj4gT24gTm92ZW1iZXIgMywgMjAxNyAwODoxMTowNCBBcnRlbSBU YW1ib3Zza2l5Cj4gPGFydGVtLnRhbWJvdnNraXlAZ21haWwuY29tPiB3cm90ZToKPgo+PiBMb29r aW5nIGZvciBhIGRlc2lnbiBhZHZpc2Ugb24gb1ZpcnQgcHJvdmlzaW9uaW5nLiBJJ20gcnVubmlu ZyBhIFBvQwo+PiBsYWIgb24gc2luZ2xlIGJhcmUtbWV0YWwgaG9zdCAoc3VkZGVubHkgaXQgd2Fz IHNldHVwIHdpdGgganVzdCBMb2NhbAo+PiBTdG9yYWdlIGRvbWFpbikgYW5kwqAKPj4gbm8gSSdk IGxpa2UgdG8gcmVidWlsZCB0aGUgc2V0dXAgYnkgbWFraW5nIGEgY2x1c3RlciBvZiAyIHBoeXNp Y2FsCj4+IHNlcnZlcnMsIG5vIGV4dGVybmFsIHN0b3JhZ2UgYXJyYXkgYXZhaWxhYmxlLiBUaGF0 IGFyZSB0aGUgb3B0aW9ucwo+PiBoZXJlPyBpcyB0aGVyZSBhbnkgb3B0aW9ucyB0byBidWlsZCBj aGVhcCBIQSBjbHVzdGVyIHdpdGgganVzdCAyCj4+IHNlcnZlcnM/wqAKPj4KPj4gVGhhbmtzIGlu IGFkdmFuY2UhCj4+Cj4+IEFydGVtCj4+IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fCj4+IFVzZXJzIG1haWxpbmcgbGlzdAo+PiBVc2Vyc0BvdmlydC5vcmcg PG1haWx0bzpVc2VycyU0MG92aXJ0Lm9yZz4KPj4gaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWls bWFuL2xpc3RpbmZvL3VzZXJzCj4+Cj4KPgo+IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fCj4gVXNlcnMgbWFpbGluZyBsaXN0Cj4gVXNlcnNAb3ZpcnQub3Jn Cj4gaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzCgoKLS0tLS0t LS0tLS0tLS05MzNENzVCNjBDMzgyMUJGQkFCMkFGNjMKQ29udGVudC1UeXBlOiB0ZXh0L2h0bWw7 IGNoYXJzZXQ9dXRmLTgKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogOGJpdAoKPGh0bWw+CiAg PGhlYWQ+CiAgICA8bWV0YSBodHRwLWVxdWl2PSJDb250ZW50LVR5cGUiIGNvbnRlbnQ9InRleHQv aHRtbDsgY2hhcnNldD11dGYtOCI+CiAgPC9oZWFkPgogIDxib2R5IHRleHQ9IiMwMDAwMDAiIGJn Y29sb3I9IiNGRkZGRkYiPgogICAgPHA+SnVzdCBnZW51aW5lbHkgY3VyaW91cywgaG93IGRvIHlv dSBhdm9pZCBzcGxpdC1icmFpbiBzaXR1YXRpb25zCiAgICAgIHdpdGggYSAyLW5vZGUgc2V0dXAg KGJlIGl0IGRyYmQsIGdsdXN0ZXIgb3IgYW55dGhpbmcgZWxzZSk/PGJyPgogICAgPC9wPgogICAg PHByZSBjbGFzcz0ibW96LXNpZ25hdHVyZSIgY29scz0iNzIiPkVkdWFyZG8gTWF5b3JhbCBKaW1l bm8gKDxhIGNsYXNzPSJtb3otdHh0LWxpbmstYWJicmV2aWF0ZWQiIGhyZWY9Im1haWx0bzplbWF5 b3JhbEBhcnN5cy5lcyI+ZW1heW9yYWxAYXJzeXMuZXM8L2E+KQpBZG1pbmlzdHJhZG9yIGRlIHNp c3RlbWFzLiBEZXBhcnRhbWVudG8gZGUgUGxhdGFmb3JtYXMuIEFyc3lzIGludGVybmV0LgorMzQg OTQxIDYyMCAxNDUgZXh0LiA1MTUzPC9wcmU+CiAgICA8ZGl2IGNsYXNzPSJtb3otY2l0ZS1wcmVm aXgiPk9uIDAzLzExLzE3IDA4OjQwLCBKb2hhbiBCZXJuaGFyZHNzb24KICAgICAgd3JvdGU6PGJy PgogICAgPC9kaXY+CiAgICA8YmxvY2txdW90ZSB0eXBlPSJjaXRlIgogICAgICBjaXRlPSJtaWQ6 MTVmODBkMzUzNzAuMjc2OC5mZmUyZDZjZGYyOTRlZmMxYmI4NjUyNjUyM2FmOTk0NUBrYWZpdC5z ZSI+CiAgICAgIDxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIgY29udGVudD0idGV4dC9o dG1sOyBjaGFyc2V0PXV0Zi04Ij4KICAgICAgPGRpdiBzdHlsZT0iY29sb3I6IGJsYWNrOyI+CiAg ICAgICAgPGRpdiBzdHlsZT0iY29sb3I6IGJsYWNrOyI+CiAgICAgICAgICA8cCBzdHlsZT0ibWFy Z2luOiAwIDAgMWVtIDA7IGNvbG9yOiBibGFjazsiPkNoZWNrIG9uIGRyYmQuIEkKICAgICAgICAg ICAgaGF2ZSB1c2VkIHRoYXQKICAgICAgICAgICAgdG8gYnVpbGQgYSBjbHVzdGVyIGZvciB0d28g c2VydmVycy4gSXQgbmVlZCBzb21lIG1vcmUgd29yawogICAgICAgICAgICB0aGFuIGEgdGhyZWUK ICAgICAgICAgICAgbm9kZSBnbHVzdGVyIGNvbmYgYnV0IHdvcmtzIHdlbGwuPC9wPgogICAgICAg ICAgPHAgc3R5bGU9Im1hcmdpbjogMCAwIDFlbSAwOyBjb2xvcjogYmxhY2s7Ij5JIGV2ZW4gdGhp bmsgdGhleQogICAgICAgICAgICBoYXZlIGEgd2hpdGUKICAgICAgICAgICAgcGFwZXIgb24gaG93 IHRvIGRvIGl0IGZvciB2aXJ0dWFsaXphdGlvbi48L3A+CiAgICAgICAgICA8cCBzdHlsZT0ibWFy Z2luOiAwIDAgMWVtIDA7IGNvbG9yOiBibGFjazsiPi9Kb2hhbjwvcD4KICAgICAgICA8L2Rpdj4K ICAgICAgICA8ZGl2IHN0eWxlPSJjb2xvcjogYmxhY2s7Ij4KICAgICAgICAgIDxwIHN0eWxlPSJj b2xvcjogYmxhY2s7IGZvbnQtc2l6ZTogMTBwdDsgZm9udC1mYW1pbHk6IEFyaWFsLAogICAgICAg ICAgICBzYW5zLXNlcmlmOyBtYXJnaW46IDEwcHQgMDsiPk9uCiAgICAgICAgICAgIE5vdmVtYmVy IDMsIDIwMTcgMDg6MTE6MDQgQXJ0ZW0gVGFtYm92c2tpeQogICAgICAgICAgICA8YSBjbGFzcz0i bW96LXR4dC1saW5rLXJmYzIzOTZFIiBocmVmPSJtYWlsdG86YXJ0ZW0udGFtYm92c2tpeUBnbWFp bC5jb20iPiZsdDthcnRlbS50YW1ib3Zza2l5QGdtYWlsLmNvbSZndDs8L2E+IHdyb3RlOjwvcD4K ICAgICAgICAgIDxibG9ja3F1b3RlIHR5cGU9ImNpdGUiIGNsYXNzPSJnbWFpbF9xdW90ZSIgc3R5 bGU9Im1hcmdpbjogMCAwCiAgICAgICAgICAgIDAgMC43NWV4OyBib3JkZXItbGVmdDogMXB4IHNv bGlkICM4MDgwODA7IHBhZGRpbmctbGVmdDoKICAgICAgICAgICAgMC43NWV4OyI+CiAgICAgICAg ICAgIDxkaXYgZGlyPSJsdHIiPgogICAgICAgICAgICAgIDxkaXY+TG9va2luZyBmb3IgYSBkZXNp Z24gYWR2aXNlIG9uIG9WaXJ0IHByb3Zpc2lvbmluZy4KICAgICAgICAgICAgICAgIEknbSBydW5u aW5nIGEgUG9DIGxhYiBvbiBzaW5nbGUgYmFyZS1tZXRhbCBob3N0CiAgICAgICAgICAgICAgICAo c3VkZGVubHkgaXQgd2FzIHNldHVwCiAgICAgICAgICAgICAgICB3aXRoIGp1c3QgTG9jYWwgU3Rv cmFnZSBkb21haW4pIGFuZMKgPC9kaXY+CiAgICAgICAgICAgICAgPGRpdj5ubyBJJ2QgbGlrZSB0 byByZWJ1aWxkCiAgICAgICAgICAgICAgICB0aGUgc2V0dXAgYnkgbWFraW5nIGEgY2x1c3RlciBv ZiAyIHBoeXNpY2FsIHNlcnZlcnMsIG5vCiAgICAgICAgICAgICAgICBleHRlcm5hbCBzdG9yYWdl CiAgICAgICAgICAgICAgICBhcnJheSBhdmFpbGFibGUuIFRoYXQgYXJlIHRoZSBvcHRpb25zIGhl cmU/IGlzIHRoZXJlIGFueQogICAgICAgICAgICAgICAgb3B0aW9ucyB0byBidWlsZAogICAgICAg ICAgICAgICAgY2hlYXAgSEEgY2x1c3RlciB3aXRoIGp1c3QgMiBzZXJ2ZXJzP8KgPC9kaXY+CiAg ICAgICAgICAgICAgPGRpdj48YnI+CiAgICAgICAgICAgICAgPC9kaXY+CiAgICAgICAgICAgICAg PGRpdj5UaGFua3MgaW4KICAgICAgICAgICAgICAgIGFkdmFuY2UhPC9kaXY+CiAgICAgICAgICAg ICAgPGRpdj48YnI+CiAgICAgICAgICAgICAgPC9kaXY+CiAgICAgICAgICAgICAgPGRpdj5BcnRl bTwvZGl2PgogICAgICAgICAgICA8L2Rpdj4KICAgICAgICAgICAgX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX188YnI+CiAgICAgICAgICAgIFVzZXJzIG1haWxp bmcgbGlzdDxicj4KICAgICAgICAgICAgPGEgY2xhc3M9ImFxbS1hdXRvbGluayBhcW0tYXV0b3dy YXAiCiAgICAgICAgICAgICAgaHJlZj0ibWFpbHRvOlVzZXJzJTQwb3ZpcnQub3JnIiBtb3otZG8t bm90LXNlbmQ9InRydWUiPlVzZXJzQG92aXJ0Lm9yZzwvYT48YnI+CiAgICAgICAgICAgIDxhIGNs YXNzPSJhcW0tYXV0b2xpbmsgYXFtLWF1dG93cmFwIgogICAgICAgICAgICAgIGhyZWY9Imh0dHA6 Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycyIKICAgICAgICAgICAgICBt b3otZG8tbm90LXNlbmQ9InRydWUiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0 aW5mby91c2VyczwvYT48YnI+CiAgICAgICAgICAgIDxicj4KICAgICAgICAgIDwvYmxvY2txdW90 ZT4KICAgICAgICA8L2Rpdj4KICAgICAgPC9kaXY+CiAgICAgIDxicj4KICAgICAgPGZpZWxkc2V0 IGNsYXNzPSJtaW1lQXR0YWNobWVudEhlYWRlciI+PC9maWVsZHNldD4KICAgICAgPGJyPgogICAg ICA8cHJlIHdyYXA9IiI+X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX18KVXNlcnMgbWFpbGluZyBsaXN0CjxhIGNsYXNzPSJtb3otdHh0LWxpbmstYWJicmV2aWF0 ZWQiIGhyZWY9Im1haWx0bzpVc2Vyc0BvdmlydC5vcmciPlVzZXJzQG92aXJ0Lm9yZzwvYT4KPGEg Y2xhc3M9Im1vei10eHQtbGluay1mcmVldGV4dCIgaHJlZj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9y Zy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIj5odHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4v bGlzdGluZm8vdXNlcnM8L2E+CjwvcHJlPgogICAgPC9ibG9ja3F1b3RlPgogICAgPGJyPgogIDwv Ym9keT4KPC9odG1sPgoKLS0tLS0tLS0tLS0tLS05MzNENzVCNjBDMzgyMUJGQkFCMkFGNjMtLQo= --===============8907342166034351908==-- From artem.tambovskiy at gmail.com Fri Nov 3 08:11:33 2017 Content-Type: multipart/mixed; boundary="===============1130132952547010559==" MIME-Version: 1.0 From: Artem Tambovskiy To: users at ovirt.org Subject: Re: [ovirt-users] Advise needed: building cheap HA oVirt cluster with just 2 physical servers Date: Fri, 03 Nov 2017 11:11:11 +0300 Message-ID: In-Reply-To: 1509695427.2218.4.camel@inparadise.se --===============1130132952547010559== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Good point! Need to focus on this first Thanks, Artem On Fri, Nov 3, 2017 at 10:50 AM, Karli Sj=C3=B6berg = wrote: > On fre, 2017-11-03 at 10:39 +0300, Artem Tambovskiy wrote: > > Thanks Eduardo! > > > > I think I can find a third server to build a glusterFS storage. So > > the first step will be to install a self-hosted engine on the new > > server and start building a glusterFS storage. > > You=C2=B4ll need to build the Gluster storage first, as you=C2=B4ll want = to > install the Hosted Engine _in_ the HA Gluster storage, right? > > /K > > > IS there any easy way to migrate existing 5 VM's running on the > > second bare-metal oVirt host, right? I found a little bit tricky > > moving oVirt backups between the hosts (at least I failed to > > replicate the existing VM's on the second server). > > > > Regards, > > Artem > > > > > > > > On Fri, Nov 3, 2017 at 10:24 AM, Eduardo Mayoral > > wrote: > > > For HA you will need some kind of storage available to all the > > > compute nodes in the cluster. If you have no external storage and > > > few nodes, I think your best option for storage is gluster , and > > > the minimum number of nodes you will need for HA is 3 (the third > > > gluster node can be metadata-only, but you still need that third > > > node to give you quorum, avoid split-brains and have something that > > > you can call "HA" with a straight face. > > > Eduardo Mayoral Jimeno (emayoral(a)arsys.es) > > > Administrador de sistemas. Departamento de Plataformas. Arsys > > > internet. > > > +34 941 620 145 ext. 5153 > > > On 03/11/17 08:10, Artem Tambovskiy wrote: > > > > Looking for a design advise on oVirt provisioning. I'm running a > > > > PoC lab on single bare-metal host (suddenly it was setup with > > > > just Local Storage domain) and > > > > no I'd like to rebuild the setup by making a cluster of 2 > > > > physical servers, no external storage array available. That are > > > > the options here? is there any options to build cheap HA cluster > > > > with just 2 servers? > > > > > > > > Thanks in advance! > > > > > > > > Artem > > > > > > > > > > > > _______________________________________________ > > > > Users mailing list > > > > Users(a)ovirt.org > > > > http://lists.ovirt.org/mailman/listinfo/users > > > > > _______________________________________________ > > Users mailing list > > Users(a)ovirt.org > > http://lists.ovirt.org/mailman/listinfo/users > --===============1130132952547010559== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+R29vZCBwb2ludCEgTmVlZCB0byBmb2N1cyBvbiB0aGlzIGZpcnN0PGRp dj48YnI+PC9kaXY+PGRpdj5UaGFua3MsPC9kaXY+PGRpdj5BcnRlbTwvZGl2PjwvZGl2PjxkaXYg Y2xhc3M9ImdtYWlsX2V4dHJhIj48YnI+PGRpdiBjbGFzcz0iZ21haWxfcXVvdGUiPk9uIEZyaSwg Tm92IDMsIDIwMTcgYXQgMTA6NTAgQU0sIEthcmxpIFNqw7ZiZXJnIDxzcGFuIGRpcj0ibHRyIj4m bHQ7PGEgaHJlZj0ibWFpbHRvOmthcmxpQGlucGFyYWRpc2Uuc2UiIHRhcmdldD0iX2JsYW5rIj5r YXJsaUBpbnBhcmFkaXNlLnNlPC9hPiZndDs8L3NwYW4+IHdyb3RlOjxicj48YmxvY2txdW90ZSBj bGFzcz0iZ21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46MCAwIDAgLjhleDtib3JkZXItbGVmdDox cHggI2NjYyBzb2xpZDtwYWRkaW5nLWxlZnQ6MWV4Ij48c3BhbiBjbGFzcz0iIj5PbiBmcmUsIDIw MTctMTEtMDMgYXQgMTA6MzkgKzAzMDAsIEFydGVtIFRhbWJvdnNraXkgd3JvdGU6PGJyPgomZ3Q7 IFRoYW5rcyBFZHVhcmRvITxicj4KJmd0Ozxicj4KJmd0OyBJIHRoaW5rIEkgY2FuIGZpbmQgYSB0 aGlyZCBzZXJ2ZXIgdG8gYnVpbGQgYSBnbHVzdGVyRlMgc3RvcmFnZS4gU288YnI+CiZndDsgdGhl IGZpcnN0IHN0ZXAgd2lsbCBiZSB0byBpbnN0YWxsIGEgc2VsZi1ob3N0ZWQgZW5naW5lIG9uIHRo ZSBuZXc8YnI+CiZndDsgc2VydmVyIGFuZCBzdGFydCBidWlsZGluZyBhIGdsdXN0ZXJGUyBzdG9y YWdlLjxicj4KPGJyPgo8L3NwYW4+WW91wrRsbCBuZWVkIHRvIGJ1aWxkIHRoZSBHbHVzdGVyIHN0 b3JhZ2UgZmlyc3QsIGFzIHlvdcK0bGwgd2FudCB0bzxicj4KaW5zdGFsbCB0aGUgSG9zdGVkIEVu Z2luZSBfaW5fIHRoZSBIQSBHbHVzdGVyIHN0b3JhZ2UsIHJpZ2h0Pzxicj4KPHNwYW4gY2xhc3M9 IkhPRW5aYiI+PGZvbnQgY29sb3I9IiM4ODg4ODgiPjxicj4KL0s8YnI+CjwvZm9udD48L3NwYW4+ PGRpdiBjbGFzcz0iSE9FblpiIj48ZGl2IGNsYXNzPSJoNSI+PGJyPgomZ3Q7IElTIHRoZXJlIGFu eSBlYXN5IHdheSB0byBtaWdyYXRlIGV4aXN0aW5nIDUgVk0mIzM5O3MgcnVubmluZyBvbiB0aGU8 YnI+CiZndDsgc2Vjb25kIGJhcmUtbWV0YWwgb1ZpcnQgaG9zdCwgcmlnaHQ/IEkgZm91bmQgYSBs aXR0bGUgYml0IHRyaWNreTxicj4KJmd0OyBtb3Zpbmcgb1ZpcnQgYmFja3VwcyBiZXR3ZWVuIHRo ZSBob3N0cyAoYXQgbGVhc3QgSSBmYWlsZWQgdG88YnI+CiZndDsgcmVwbGljYXRlIHRoZSBleGlz dGluZyBWTSYjMzk7cyBvbiB0aGUgc2Vjb25kIHNlcnZlcikuPGJyPgomZ3Q7PGJyPgomZ3Q7IFJl Z2FyZHMsPGJyPgomZ3Q7IEFydGVtPGJyPgomZ3Q7PGJyPgomZ3Q7PGJyPgomZ3Q7PGJyPgomZ3Q7 IE9uIEZyaSwgTm92IDMsIDIwMTcgYXQgMTA6MjQgQU0sIEVkdWFyZG8gTWF5b3JhbCAmbHQ7PGEg aHJlZj0ibWFpbHRvOmVtYXlvcmFsQGFyc3lzLmVzIj5lbWF5b3JhbEBhcnN5cy5lczwvYT4mZ3Q7 PGJyPgomZ3Q7IHdyb3RlOjxicj4KJmd0OyAmZ3Q7IEZvciBIQSB5b3Ugd2lsbCBuZWVkIHNvbWUg a2luZCBvZiBzdG9yYWdlIGF2YWlsYWJsZSB0byBhbGwgdGhlPGJyPgomZ3Q7ICZndDsgY29tcHV0 ZSBub2RlcyBpbiB0aGUgY2x1c3Rlci4gSWYgeW91IGhhdmUgbm8gZXh0ZXJuYWwgc3RvcmFnZSBh bmQ8YnI+CiZndDsgJmd0OyBmZXcgbm9kZXMsIEkgdGhpbmsgeW91ciBiZXN0IG9wdGlvbiBmb3Ig c3RvcmFnZSBpcyBnbHVzdGVyICwgYW5kPGJyPgomZ3Q7ICZndDsgdGhlIG1pbmltdW0gbnVtYmVy IG9mIG5vZGVzIHlvdSB3aWxsIG5lZWQgZm9yIEhBIGlzIDMgKHRoZSB0aGlyZDxicj4KJmd0OyAm Z3Q7IGdsdXN0ZXIgbm9kZSBjYW4gYmUgbWV0YWRhdGEtb25seSwgYnV0IHlvdSBzdGlsbCBuZWVk IHRoYXQgdGhpcmQ8YnI+CiZndDsgJmd0OyBub2RlIHRvIGdpdmUgeW91IHF1b3J1bSwgYXZvaWQg c3BsaXQtYnJhaW5zIGFuZCBoYXZlIHNvbWV0aGluZyB0aGF0PGJyPgomZ3Q7ICZndDsgeW91IGNh biBjYWxsICZxdW90O0hBJnF1b3Q7IHdpdGggYSBzdHJhaWdodCBmYWNlLjxicj4KJmd0OyAmZ3Q7 IEVkdWFyZG8gTWF5b3JhbCBKaW1lbm8gKDxhIGhyZWY9Im1haWx0bzplbWF5b3JhbEBhcnN5cy5l cyI+ZW1heW9yYWxAYXJzeXMuZXM8L2E+KTxicj4KJmd0OyAmZ3Q7IEFkbWluaXN0cmFkb3IgZGUg c2lzdGVtYXMuIERlcGFydGFtZW50byBkZSBQbGF0YWZvcm1hcy4gQXJzeXM8YnI+CiZndDsgJmd0 OyBpbnRlcm5ldC48YnI+CiZndDsgJmd0OyA8YSBocmVmPSJ0ZWw6JTJCMzQlMjA5NDElMjA2MjAl MjAxNDUlMjBleHQuJTIwNTE1MyIgdmFsdWU9IiszNDk0MTYyMDE0NSI+KzM0IDk0MSA2MjAgMTQ1 IGV4dC4gNTE1MzwvYT48YnI+CiZndDsgJmd0OyBPbiAwMy8xMS8xNyAwODoxMCwgQXJ0ZW0gVGFt Ym92c2tpeSB3cm90ZTo8YnI+CiZndDsgJmd0OyAmZ3Q7IExvb2tpbmcgZm9yIGEgZGVzaWduIGFk dmlzZSBvbiBvVmlydCBwcm92aXNpb25pbmcuIEkmIzM5O20gcnVubmluZyBhPGJyPgomZ3Q7ICZn dDsgJmd0OyBQb0MgbGFiIG9uIHNpbmdsZSBiYXJlLW1ldGFsIGhvc3QgKHN1ZGRlbmx5IGl0IHdh cyBzZXR1cCB3aXRoPGJyPgomZ3Q7ICZndDsgJmd0OyBqdXN0IExvY2FsIFN0b3JhZ2UgZG9tYWlu KSBhbmTCoDxicj4KJmd0OyAmZ3Q7ICZndDsgbm8gSSYjMzk7ZCBsaWtlIHRvIHJlYnVpbGQgdGhl IHNldHVwIGJ5IG1ha2luZyBhIGNsdXN0ZXIgb2YgMjxicj4KJmd0OyAmZ3Q7ICZndDsgcGh5c2lj YWwgc2VydmVycywgbm8gZXh0ZXJuYWwgc3RvcmFnZSBhcnJheSBhdmFpbGFibGUuIFRoYXQgYXJl PGJyPgomZ3Q7ICZndDsgJmd0OyB0aGUgb3B0aW9ucyBoZXJlPyBpcyB0aGVyZSBhbnkgb3B0aW9u cyB0byBidWlsZCBjaGVhcCBIQSBjbHVzdGVyPGJyPgomZ3Q7ICZndDsgJmd0OyB3aXRoIGp1c3Qg MiBzZXJ2ZXJzP8KgPGJyPgomZ3Q7ICZndDsgJmd0Ozxicj4KJmd0OyAmZ3Q7ICZndDsgVGhhbmtz IGluIGFkdmFuY2UhPGJyPgomZ3Q7ICZndDsgJmd0Ozxicj4KJmd0OyAmZ3Q7ICZndDsgQXJ0ZW08 YnI+CiZndDsgJmd0OyAmZ3Q7PGJyPgomZ3Q7ICZndDsgJmd0Ozxicj4KJmd0OyAmZ3Q7ICZndDsg X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fPHdicj5fX19fX19fX19fX19fX19fXzxicj4K Jmd0OyAmZ3Q7ICZndDsgVXNlcnMgbWFpbGluZyBsaXN0PGJyPgomZ3Q7ICZndDsgJmd0OyA8YSBo cmVmPSJtYWlsdG86VXNlcnNAb3ZpcnQub3JnIj5Vc2Vyc0BvdmlydC5vcmc8L2E+PGJyPgomZ3Q7 ICZndDsgJmd0OyA8YSBocmVmPSJodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGlu Zm8vdXNlcnMiIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9saXN0cy5v dmlydC5vcmcvPHdicj5tYWlsbWFuL2xpc3RpbmZvL3VzZXJzPC9hPjxicj4KJmd0OyAmZ3Q7IMKg PGJyPgomZ3Q7IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fXzx3YnI+X19fX19fX19fX19f X19fX188YnI+CiZndDsgVXNlcnMgbWFpbGluZyBsaXN0PGJyPgomZ3Q7IDxhIGhyZWY9Im1haWx0 bzpVc2Vyc0BvdmlydC5vcmciPlVzZXJzQG92aXJ0Lm9yZzwvYT48YnI+CiZndDsgPGEgaHJlZj0i aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIiByZWw9Im5vcmVm ZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5odHRwOi8vbGlzdHMub3ZpcnQub3JnLzx3YnI+bWFpbG1h bi9saXN0aW5mby91c2VyczwvYT48YnI+CjwvZGl2PjwvZGl2PjwvYmxvY2txdW90ZT48L2Rpdj48 YnI+PC9kaXY+Cg== --===============1130132952547010559==-- From emayoral at arsys.es Fri Nov 3 08:15:17 2017 Content-Type: multipart/mixed; boundary="===============4412800340407802360==" MIME-Version: 1.0 From: Eduardo Mayoral To: users at ovirt.org Subject: Re: [ovirt-users] Advise needed: building cheap HA oVirt cluster with just 2 physical servers Date: Fri, 03 Nov 2017 09:15:14 +0100 Message-ID: In-Reply-To: CAAq+RfYZT9nYvPh3NttwrRu1JRb+1qhzihGi+WETrO8+vFcEng@mail.gmail.com --===============4412800340407802360== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------54D2274BE68ED5ED9B86230D Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 8bit Exporting the VMs to an export storage domain on the first server, copying the files to another export storage domain on the second server and importing it should work. What kind of problem did you find? As for the order of doing things, my first oVirt lab was a 3-node setup with gluster (oVirt version 4.0). I found this guide helpful: https://www.ovirt.org/blog/2016/08/up-and-running-with-ovirt-4-0-and-gluste= r-storage/ I see there is a new version of it: https://www.ovirt.org/blog/2017/04/up-and-running-with-ovirt-4.1-and-gluste= r-storage/ If I understand correctly you plan to re-use the server you already have. I think you will probably find it much easier have to export your VMs, re-deploy and import your VMs back. It means some downtime, but you seem very constrained on the hardware available and there is not much room to manouver... Good luck! Eduardo Mayoral Jimeno (emayoral(a)arsys.es) Administrador de sistemas. Departamento de Plataformas. Arsys internet. +34 941 620 145 ext. 5153 On 03/11/17 08:39, Artem Tambovskiy wrote: > Thanks Eduardo! > > I think I can find a third server to build a glusterFS storage. So the > first step will be to install a self-hosted engine on the new server > and start building a glusterFS storage. IS there any easy way to > migrate existing 5 VM's running on the second bare-metal oVirt host, > right? I found a little bit tricky moving oVirt backups between the > hosts (at least I failed to replicate the existing VM's on the second > server). > > Regards, > Artem > > > > On Fri, Nov 3, 2017 at 10:24 AM, Eduardo Mayoral > wrote: > > For HA you will need some kind of storage available to all the > compute nodes in the cluster. If you have no external storage and > few nodes, I think your best option for storage is gluster , and > the minimum number of nodes you will need for HA is 3 (the third > gluster node can be metadata-only, but you still need that third > node to give you quorum, avoid split-brains and have something > that you can call "HA" with a straight face. > > Eduardo Mayoral Jimeno (emayoral(a)arsys.es ) > Administrador de sistemas. Departamento de Plataformas. Arsys interne= t. > +34 941 620 145 ext. 5153 > > On 03/11/17 08:10, Artem Tambovskiy wrote: >> Looking for a design advise on oVirt provisioning. I'm running a >> PoC lab on single bare-metal host (suddenly it was setup with >> just Local Storage domain) and=C2=A0 >> no I'd like to rebuild the setup by making a cluster of 2 >> physical servers, no external storage array available. That are >> the options here? is there any options to build cheap HA cluster >> with just 2 servers?=C2=A0 >> >> Thanks in advance! >> >> Artem >> >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> > > --------------54D2274BE68ED5ED9B86230D Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 8bit

Exporting the VMs to an export storage domain on the first server, copying the files to another export storage domain on the second server and importing it should work. What kind of problem did you find?

As for the order of doing things, my first oVirt lab was a 3-node setup with gluster (oVirt version 4.0). I found this guide helpful:

https://www.o= virt.org/blog/2016/08/up-and-running-with-ovirt-4-0-and-gluster-storage/

I see there is a new version of it:

https://www.o= virt.org/blog/2017/04/up-and-running-with-ovirt-4.1-and-gluster-storage/

If I understand correctly you plan to re-use the server you already have. I think you will probably find it much easier have to export your VMs, re-deploy and import your VMs back. It means some downtime, but you seem very constrained on the hardware available and there is not much room to manouver...

Good luck!

Eduardo Mayoral Jimeno (emayora=
l(a)arsys.es)
Administrador de sistemas. Departamento de Plataformas. Arsys internet.
+34 941 620 145 ext. 5153
On 03/11/17 08:39, Artem Tambovskiy wrote:
Thanks Eduardo!

I think I can find a third server to build a glusterFS storage. So the first step will be to install a self-hosted engine on the new server and start building a glusterFS storage. IS there any easy way to migrate existing 5 VM's running on the second bare-metal oVirt host, right? I found a little bit tricky moving oVirt backups between the hosts (at least I failed to replicate the existing VM's on the second server).

Regards,
Artem



On Fri, Nov 3, 2017 at 10:24 AM, Eduardo Mayoral <emayoral(a)arsys.es> wrote:

For HA you will need some kind of storage available to all the compute nodes in the cluster. If you have no external storage and few nodes, I think your best option for storage is gluster , and the minimum number of nodes you will need for HA is 3 (the third gluster node can be metadata-only, but you still need that third node to give you quorum, avoid split-brains and have something that you can call "HA" with a straight face.

Eduardo Mayoral Jimeno (emayoral(a)arsys.es)
Administrador de sistemas. Departamento de Plataformas. Arsys internet.
+34 941 620 145 ext. 5153
On 03/11/17 08:10, Artem Tambovskiy wrote:
Looking for a design advise on oVirt provisioning. I'm running a PoC lab on single bare-metal host (suddenly it was setup with just Local Storage domain) and=C2=A0
no I'd like to rebuild the setup by making a cluster of 2 physical servers, no external storage array available. That are the options here? is there any options to build cheap HA cluster with just 2 servers?=C2=A0

Thanks in advance!

Artem

= 

_______________________________________________
Users mailing list
Users(a)ovirt=
.org
http://lists.ovirt.org/mailman/listinfo/users



--------------54D2274BE68ED5ED9B86230D-- --===============4412800340407802360== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS01NEQyMjc0QkU2OEVENUVEOUI4NjIzMEQKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDhiaXQKCkV4cG9ydGluZyB0aGUg Vk1zIHRvIGFuIGV4cG9ydCBzdG9yYWdlIGRvbWFpbiBvbiB0aGUgZmlyc3Qgc2VydmVyLApjb3B5 aW5nIHRoZSBmaWxlcyB0byBhbm90aGVyIGV4cG9ydCBzdG9yYWdlIGRvbWFpbiBvbiB0aGUgc2Vj b25kIHNlcnZlcgphbmQgaW1wb3J0aW5nIGl0IHNob3VsZCB3b3JrLiBXaGF0IGtpbmQgb2YgcHJv YmxlbSBkaWQgeW91IGZpbmQ/CgpBcyBmb3IgdGhlIG9yZGVyIG9mIGRvaW5nIHRoaW5ncywgbXkg Zmlyc3Qgb1ZpcnQgbGFiIHdhcyBhIDMtbm9kZSBzZXR1cAp3aXRoIGdsdXN0ZXIgKG9WaXJ0IHZl cnNpb24gNC4wKS4gSSBmb3VuZCB0aGlzIGd1aWRlIGhlbHBmdWw6CgpodHRwczovL3d3dy5vdmly dC5vcmcvYmxvZy8yMDE2LzA4L3VwLWFuZC1ydW5uaW5nLXdpdGgtb3ZpcnQtNC0wLWFuZC1nbHVz dGVyLXN0b3JhZ2UvCgpJIHNlZSB0aGVyZSBpcyBhIG5ldyB2ZXJzaW9uIG9mIGl0OgoKaHR0cHM6 Ly93d3cub3ZpcnQub3JnL2Jsb2cvMjAxNy8wNC91cC1hbmQtcnVubmluZy13aXRoLW92aXJ0LTQu MS1hbmQtZ2x1c3Rlci1zdG9yYWdlLwoKSWYgSSB1bmRlcnN0YW5kIGNvcnJlY3RseSB5b3UgcGxh biB0byByZS11c2UgdGhlIHNlcnZlciB5b3UgYWxyZWFkeQpoYXZlLiBJIHRoaW5rIHlvdSB3aWxs IHByb2JhYmx5IGZpbmQgaXQgbXVjaCBlYXNpZXIgaGF2ZSB0byBleHBvcnQgeW91cgpWTXMsIHJl LWRlcGxveSBhbmQgaW1wb3J0IHlvdXIgVk1zIGJhY2suIEl0IG1lYW5zIHNvbWUgZG93bnRpbWUs IGJ1dCB5b3UKc2VlbSB2ZXJ5IGNvbnN0cmFpbmVkIG9uIHRoZSBoYXJkd2FyZSBhdmFpbGFibGUg YW5kIHRoZXJlIGlzIG5vdCBtdWNoCnJvb20gdG8gbWFub3V2ZXIuLi4KCkdvb2QgbHVjayEKCkVk dWFyZG8gTWF5b3JhbCBKaW1lbm8gKGVtYXlvcmFsQGFyc3lzLmVzKQpBZG1pbmlzdHJhZG9yIGRl IHNpc3RlbWFzLiBEZXBhcnRhbWVudG8gZGUgUGxhdGFmb3JtYXMuIEFyc3lzIGludGVybmV0Lgor MzQgOTQxIDYyMCAxNDUgZXh0LiA1MTUzCgpPbiAwMy8xMS8xNyAwODozOSwgQXJ0ZW0gVGFtYm92 c2tpeSB3cm90ZToKPiBUaGFua3MgRWR1YXJkbyEKPgo+IEkgdGhpbmsgSSBjYW4gZmluZCBhIHRo aXJkIHNlcnZlciB0byBidWlsZCBhIGdsdXN0ZXJGUyBzdG9yYWdlLiBTbyB0aGUKPiBmaXJzdCBz dGVwIHdpbGwgYmUgdG8gaW5zdGFsbCBhIHNlbGYtaG9zdGVkIGVuZ2luZSBvbiB0aGUgbmV3IHNl cnZlcgo+IGFuZCBzdGFydCBidWlsZGluZyBhIGdsdXN0ZXJGUyBzdG9yYWdlLiBJUyB0aGVyZSBh bnkgZWFzeSB3YXkgdG8KPiBtaWdyYXRlIGV4aXN0aW5nIDUgVk0ncyBydW5uaW5nIG9uIHRoZSBz ZWNvbmQgYmFyZS1tZXRhbCBvVmlydCBob3N0LAo+IHJpZ2h0PyBJIGZvdW5kIGEgbGl0dGxlIGJp dCB0cmlja3kgbW92aW5nIG9WaXJ0IGJhY2t1cHMgYmV0d2VlbiB0aGUKPiBob3N0cyAoYXQgbGVh c3QgSSBmYWlsZWQgdG8gcmVwbGljYXRlIHRoZSBleGlzdGluZyBWTSdzIG9uIHRoZSBzZWNvbmQK PiBzZXJ2ZXIpLgo+Cj4gUmVnYXJkcywKPiBBcnRlbQo+Cj4KPgo+IE9uIEZyaSwgTm92IDMsIDIw MTcgYXQgMTA6MjQgQU0sIEVkdWFyZG8gTWF5b3JhbCA8ZW1heW9yYWxAYXJzeXMuZXMKPiA8bWFp bHRvOmVtYXlvcmFsQGFyc3lzLmVzPj4gd3JvdGU6Cj4KPiAgICAgRm9yIEhBIHlvdSB3aWxsIG5l ZWQgc29tZSBraW5kIG9mIHN0b3JhZ2UgYXZhaWxhYmxlIHRvIGFsbCB0aGUKPiAgICAgY29tcHV0 ZSBub2RlcyBpbiB0aGUgY2x1c3Rlci4gSWYgeW91IGhhdmUgbm8gZXh0ZXJuYWwgc3RvcmFnZSBh bmQKPiAgICAgZmV3IG5vZGVzLCBJIHRoaW5rIHlvdXIgYmVzdCBvcHRpb24gZm9yIHN0b3JhZ2Ug aXMgZ2x1c3RlciAsIGFuZAo+ICAgICB0aGUgbWluaW11bSBudW1iZXIgb2Ygbm9kZXMgeW91IHdp bGwgbmVlZCBmb3IgSEEgaXMgMyAodGhlIHRoaXJkCj4gICAgIGdsdXN0ZXIgbm9kZSBjYW4gYmUg bWV0YWRhdGEtb25seSwgYnV0IHlvdSBzdGlsbCBuZWVkIHRoYXQgdGhpcmQKPiAgICAgbm9kZSB0 byBnaXZlIHlvdSBxdW9ydW0sIGF2b2lkIHNwbGl0LWJyYWlucyBhbmQgaGF2ZSBzb21ldGhpbmcK PiAgICAgdGhhdCB5b3UgY2FuIGNhbGwgIkhBIiB3aXRoIGEgc3RyYWlnaHQgZmFjZS4KPgo+ICAg ICBFZHVhcmRvIE1heW9yYWwgSmltZW5vIChlbWF5b3JhbEBhcnN5cy5lcyA8bWFpbHRvOmVtYXlv cmFsQGFyc3lzLmVzPikKPiAgICAgQWRtaW5pc3RyYWRvciBkZSBzaXN0ZW1hcy4gRGVwYXJ0YW1l bnRvIGRlIFBsYXRhZm9ybWFzLiBBcnN5cyBpbnRlcm5ldC4KPiAgICAgKzM0IDk0MSA2MjAgMTQ1 IGV4dC4gNTE1MyA8dGVsOiszNCUyMDk0MSUyMDYyJTIwMDElMjA0NT4KPgo+ICAgICBPbiAwMy8x MS8xNyAwODoxMCwgQXJ0ZW0gVGFtYm92c2tpeSB3cm90ZToKPj4gICAgIExvb2tpbmcgZm9yIGEg ZGVzaWduIGFkdmlzZSBvbiBvVmlydCBwcm92aXNpb25pbmcuIEknbSBydW5uaW5nIGEKPj4gICAg IFBvQyBsYWIgb24gc2luZ2xlIGJhcmUtbWV0YWwgaG9zdCAoc3VkZGVubHkgaXQgd2FzIHNldHVw IHdpdGgKPj4gICAgIGp1c3QgTG9jYWwgU3RvcmFnZSBkb21haW4pIGFuZMKgCj4+ICAgICBubyBJ J2QgbGlrZSB0byByZWJ1aWxkIHRoZSBzZXR1cCBieSBtYWtpbmcgYSBjbHVzdGVyIG9mIDIKPj4g ICAgIHBoeXNpY2FsIHNlcnZlcnMsIG5vIGV4dGVybmFsIHN0b3JhZ2UgYXJyYXkgYXZhaWxhYmxl LiBUaGF0IGFyZQo+PiAgICAgdGhlIG9wdGlvbnMgaGVyZT8gaXMgdGhlcmUgYW55IG9wdGlvbnMg dG8gYnVpbGQgY2hlYXAgSEEgY2x1c3Rlcgo+PiAgICAgd2l0aCBqdXN0IDIgc2VydmVycz/CoAo+ Pgo+PiAgICAgVGhhbmtzIGluIGFkdmFuY2UhCj4+Cj4+ICAgICBBcnRlbQo+Pgo+Pgo+PiAgICAg X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KPj4gICAgIFVz ZXJzIG1haWxpbmcgbGlzdAo+PiAgICAgVXNlcnNAb3ZpcnQub3JnIDxtYWlsdG86VXNlcnNAb3Zp cnQub3JnPgo+PiAgICAgaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3Vz ZXJzCj4+ICAgICA8aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJz Pgo+Cj4KCgotLS0tLS0tLS0tLS0tLTU0RDIyNzRCRTY4RUQ1RUQ5Qjg2MjMwRApDb250ZW50LVR5 cGU6IHRleHQvaHRtbDsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA4 Yml0Cgo8aHRtbD4KICA8aGVhZD4KICAgIDxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIg Y29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4KICA8L2hlYWQ+CiAgPGJvZHkgdGV4 dD0iIzAwMDAwMCIgYmdjb2xvcj0iI0ZGRkZGRiI+CiAgICA8cD5FeHBvcnRpbmcgdGhlIFZNcyB0 byBhbiBleHBvcnQgc3RvcmFnZSBkb21haW4gb24gdGhlIGZpcnN0CiAgICAgIHNlcnZlciwgY29w eWluZyB0aGUgZmlsZXMgdG8gYW5vdGhlciBleHBvcnQgc3RvcmFnZSBkb21haW4gb24gdGhlCiAg ICAgIHNlY29uZCBzZXJ2ZXIgYW5kIGltcG9ydGluZyBpdCBzaG91bGQgd29yay4gV2hhdCBraW5k IG9mIHByb2JsZW0KICAgICAgZGlkIHlvdSBmaW5kPzwvcD4KICAgIDxwPkFzIGZvciB0aGUgb3Jk ZXIgb2YgZG9pbmcgdGhpbmdzLCBteSBmaXJzdCBvVmlydCBsYWIgd2FzIGEgMy1ub2RlCiAgICAg IHNldHVwIHdpdGggZ2x1c3RlciAob1ZpcnQgdmVyc2lvbiA0LjApLiBJIGZvdW5kIHRoaXMgZ3Vp ZGUKICAgICAgaGVscGZ1bDo8L3A+CiAgICA8cD48YSBjbGFzcz0ibW96LXR4dC1saW5rLWZyZWV0 ZXh0IiBocmVmPSJodHRwczovL3d3dy5vdmlydC5vcmcvYmxvZy8yMDE2LzA4L3VwLWFuZC1ydW5u aW5nLXdpdGgtb3ZpcnQtNC0wLWFuZC1nbHVzdGVyLXN0b3JhZ2UvIj5odHRwczovL3d3dy5vdmly dC5vcmcvYmxvZy8yMDE2LzA4L3VwLWFuZC1ydW5uaW5nLXdpdGgtb3ZpcnQtNC0wLWFuZC1nbHVz dGVyLXN0b3JhZ2UvPC9hPjwvcD4KICAgIDxwPkkgc2VlIHRoZXJlIGlzIGEgbmV3IHZlcnNpb24g b2YgaXQ6PC9wPgogICAgPHA+PGEgY2xhc3M9Im1vei10eHQtbGluay1mcmVldGV4dCIgaHJlZj0i aHR0cHM6Ly93d3cub3ZpcnQub3JnL2Jsb2cvMjAxNy8wNC91cC1hbmQtcnVubmluZy13aXRoLW92 aXJ0LTQuMS1hbmQtZ2x1c3Rlci1zdG9yYWdlLyI+aHR0cHM6Ly93d3cub3ZpcnQub3JnL2Jsb2cv MjAxNy8wNC91cC1hbmQtcnVubmluZy13aXRoLW92aXJ0LTQuMS1hbmQtZ2x1c3Rlci1zdG9yYWdl LzwvYT48L3A+CiAgICA8cD5JZiBJIHVuZGVyc3RhbmQgY29ycmVjdGx5IHlvdSBwbGFuIHRvIHJl LXVzZSB0aGUgc2VydmVyIHlvdQogICAgICBhbHJlYWR5IGhhdmUuIEkgdGhpbmsgeW91IHdpbGwg cHJvYmFibHkgZmluZCBpdCBtdWNoIGVhc2llciBoYXZlCiAgICAgIHRvIGV4cG9ydCB5b3VyIFZN cywgcmUtZGVwbG95IGFuZCBpbXBvcnQgeW91ciBWTXMgYmFjay4gSXQgbWVhbnMKICAgICAgc29t ZSBkb3dudGltZSwgYnV0IHlvdSBzZWVtIHZlcnkgY29uc3RyYWluZWQgb24gdGhlIGhhcmR3YXJl CiAgICAgIGF2YWlsYWJsZSBhbmQgdGhlcmUgaXMgbm90IG11Y2ggcm9vbSB0byBtYW5vdXZlci4u Ljxicj4KICAgIDwvcD4KICAgIDxwPkdvb2QgbHVjayE8YnI+CiAgICA8L3A+CiAgICA8cHJlIGNs YXNzPSJtb3otc2lnbmF0dXJlIiBjb2xzPSI3MiI+RWR1YXJkbyBNYXlvcmFsIEppbWVubyAoPGEg Y2xhc3M9Im1vei10eHQtbGluay1hYmJyZXZpYXRlZCIgaHJlZj0ibWFpbHRvOmVtYXlvcmFsQGFy c3lzLmVzIj5lbWF5b3JhbEBhcnN5cy5lczwvYT4pCkFkbWluaXN0cmFkb3IgZGUgc2lzdGVtYXMu IERlcGFydGFtZW50byBkZSBQbGF0YWZvcm1hcy4gQXJzeXMgaW50ZXJuZXQuCiszNCA5NDEgNjIw IDE0NSBleHQuIDUxNTM8L3ByZT4KICAgIDxkaXYgY2xhc3M9Im1vei1jaXRlLXByZWZpeCI+T24g MDMvMTEvMTcgMDg6MzksIEFydGVtIFRhbWJvdnNraXkKICAgICAgd3JvdGU6PGJyPgogICAgPC9k aXY+CiAgICA8YmxvY2txdW90ZSB0eXBlPSJjaXRlIgpjaXRlPSJtaWQ6Q0FBcStSZllaVDluWXZQ aDNOdHR3clJ1MUpSYisxcWh6aWhHaStXRVRyTzgrdkZjRW5nQG1haWwuZ21haWwuY29tIj4KICAg ICAgPG1ldGEgaHR0cC1lcXVpdj0iQ29udGVudC1UeXBlIiBjb250ZW50PSJ0ZXh0L2h0bWw7IGNo YXJzZXQ9dXRmLTgiPgogICAgICA8ZGl2IGRpcj0ibHRyIj5UaGFua3MgRWR1YXJkbyE8YnI+CiAg ICAgICAgPGJyPgogICAgICAgIEkgdGhpbmsgSSBjYW4gZmluZCBhIHRoaXJkIHNlcnZlciB0byBi dWlsZCBhIGdsdXN0ZXJGUyBzdG9yYWdlLgogICAgICAgIFNvIHRoZSBmaXJzdCBzdGVwIHdpbGwg YmUgdG8gaW5zdGFsbCBhIHNlbGYtaG9zdGVkIGVuZ2luZSBvbiB0aGUKICAgICAgICBuZXcgc2Vy dmVyIGFuZCBzdGFydCBidWlsZGluZyBhIGdsdXN0ZXJGUyBzdG9yYWdlLiBJUyB0aGVyZSBhbnkK ICAgICAgICBlYXN5IHdheSB0byBtaWdyYXRlIGV4aXN0aW5nIDUgVk0ncyBydW5uaW5nIG9uIHRo ZSBzZWNvbmQKICAgICAgICBiYXJlLW1ldGFsIG9WaXJ0IGhvc3QsIHJpZ2h0PyBJIGZvdW5kIGEg bGl0dGxlIGJpdCB0cmlja3kgbW92aW5nCiAgICAgICAgb1ZpcnQgYmFja3VwcyBiZXR3ZWVuIHRo ZSBob3N0cyAoYXQgbGVhc3QgSSBmYWlsZWQgdG8gcmVwbGljYXRlCiAgICAgICAgdGhlIGV4aXN0 aW5nIFZNJ3Mgb24gdGhlIHNlY29uZCBzZXJ2ZXIpLgogICAgICAgIDxkaXY+PGJyPgogICAgICAg IDwvZGl2PgogICAgICAgIDxkaXY+UmVnYXJkcyw8L2Rpdj4KICAgICAgICA8ZGl2PkFydGVtPGJy PgogICAgICAgICAgPGJyPgogICAgICAgICAgPGJyPgogICAgICAgIDwvZGl2PgogICAgICA8L2Rp dj4KICAgICAgPGRpdiBjbGFzcz0iZ21haWxfZXh0cmEiPjxicj4KICAgICAgICA8ZGl2IGNsYXNz PSJnbWFpbF9xdW90ZSI+T24gRnJpLCBOb3YgMywgMjAxNyBhdCAxMDoyNCBBTSwKICAgICAgICAg IEVkdWFyZG8gTWF5b3JhbCA8c3BhbiBkaXI9Imx0ciI+Jmx0OzxhCiAgICAgICAgICAgICAgaHJl Zj0ibWFpbHRvOmVtYXlvcmFsQGFyc3lzLmVzIiB0YXJnZXQ9Il9ibGFuayIKICAgICAgICAgICAg ICBtb3otZG8tbm90LXNlbmQ9InRydWUiPmVtYXlvcmFsQGFyc3lzLmVzPC9hPiZndDs8L3NwYW4+ CiAgICAgICAgICB3cm90ZTo8YnI+CiAgICAgICAgICA8YmxvY2txdW90ZSBjbGFzcz0iZ21haWxf cXVvdGUiIHN0eWxlPSJtYXJnaW46MCAwIDAKICAgICAgICAgICAgLjhleDtib3JkZXItbGVmdDox cHggI2NjYyBzb2xpZDtwYWRkaW5nLWxlZnQ6MWV4Ij4KICAgICAgICAgICAgPGRpdiB0ZXh0PSIj MDAwMDAwIiBiZ2NvbG9yPSIjRkZGRkZGIj4KICAgICAgICAgICAgICA8cD5Gb3IgSEEgeW91IHdp bGwgbmVlZCBzb21lIGtpbmQgb2Ygc3RvcmFnZSBhdmFpbGFibGUgdG8KICAgICAgICAgICAgICAg IGFsbCB0aGUgY29tcHV0ZSBub2RlcyBpbiB0aGUgY2x1c3Rlci4gSWYgeW91IGhhdmUgbm8KICAg ICAgICAgICAgICAgIGV4dGVybmFsIHN0b3JhZ2UgYW5kIGZldyBub2RlcywgSSB0aGluayB5b3Vy IGJlc3Qgb3B0aW9uCiAgICAgICAgICAgICAgICBmb3Igc3RvcmFnZSBpcyBnbHVzdGVyICwgYW5k IHRoZSBtaW5pbXVtIG51bWJlciBvZiBub2RlcwogICAgICAgICAgICAgICAgeW91IHdpbGwgbmVl ZCBmb3IgSEEgaXMgMyAodGhlIHRoaXJkIGdsdXN0ZXIgbm9kZSBjYW4gYmUKICAgICAgICAgICAg ICAgIG1ldGFkYXRhLW9ubHksIGJ1dCB5b3Ugc3RpbGwgbmVlZCB0aGF0IHRoaXJkIG5vZGUgdG8K ICAgICAgICAgICAgICAgIGdpdmUgeW91IHF1b3J1bSwgYXZvaWQgc3BsaXQtYnJhaW5zIGFuZCBo YXZlIHNvbWV0aGluZwogICAgICAgICAgICAgICAgdGhhdCB5b3UgY2FuIGNhbGwgIkhBIiB3aXRo IGEgc3RyYWlnaHQgZmFjZS48YnI+CiAgICAgICAgICAgICAgPC9wPgogICAgICAgICAgICAgIDxw cmUgY2xhc3M9Im1fLTE5MjkyOTkyNDIzNDAzMjMyMTltb3otc2lnbmF0dXJlIiBjb2xzPSI3MiI+ RWR1YXJkbyBNYXlvcmFsIEppbWVubyAoPGEgY2xhc3M9Im1fLTE5MjkyOTkyNDIzNDAzMjMyMTlt b3otdHh0LWxpbmstYWJicmV2aWF0ZWQiIGhyZWY9Im1haWx0bzplbWF5b3JhbEBhcnN5cy5lcyIg dGFyZ2V0PSJfYmxhbmsiIG1vei1kby1ub3Qtc2VuZD0idHJ1ZSI+ZW1heW9yYWxAYXJzeXMuZXM8 L2E+KQpBZG1pbmlzdHJhZG9yIGRlIHNpc3RlbWFzLiBEZXBhcnRhbWVudG8gZGUgUGxhdGFmb3Jt YXMuIEFyc3lzIGludGVybmV0Lgo8YSBocmVmPSJ0ZWw6KzM0JTIwOTQxJTIwNjIlMjAwMSUyMDQ1 IiB2YWx1ZT0iKzM0OTQxNjIwMTQ1IiB0YXJnZXQ9Il9ibGFuayIgbW96LWRvLW5vdC1zZW5kPSJ0 cnVlIj4rMzQgOTQxIDYyMCAxNDUgZXh0LiA1MTUzPC9hPjwvcHJlPgogICAgICAgICAgICAgIDxk aXY+CiAgICAgICAgICAgICAgICA8ZGl2IGNsYXNzPSJoNSI+CiAgICAgICAgICAgICAgICAgIDxk aXYgY2xhc3M9Im1fLTE5MjkyOTkyNDIzNDAzMjMyMTltb3otY2l0ZS1wcmVmaXgiPk9uCiAgICAg ICAgICAgICAgICAgICAgMDMvMTEvMTcgMDg6MTAsIEFydGVtIFRhbWJvdnNraXkgd3JvdGU6PGJy PgogICAgICAgICAgICAgICAgICA8L2Rpdj4KICAgICAgICAgICAgICAgIDwvZGl2PgogICAgICAg ICAgICAgIDwvZGl2PgogICAgICAgICAgICAgIDxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPgogICAg ICAgICAgICAgICAgPGRpdj4KICAgICAgICAgICAgICAgICAgPGRpdiBjbGFzcz0iaDUiPgogICAg ICAgICAgICAgICAgICAgIDxkaXYgZGlyPSJsdHIiPgogICAgICAgICAgICAgICAgICAgICAgPGRp dj5Mb29raW5nIGZvciBhIGRlc2lnbiBhZHZpc2Ugb24gb1ZpcnQKICAgICAgICAgICAgICAgICAg ICAgICAgcHJvdmlzaW9uaW5nLiBJJ20gcnVubmluZyBhIFBvQyBsYWIgb24gc2luZ2xlCiAgICAg ICAgICAgICAgICAgICAgICAgIGJhcmUtbWV0YWwgaG9zdCAoc3VkZGVubHkgaXQgd2FzIHNldHVw IHdpdGgganVzdAogICAgICAgICAgICAgICAgICAgICAgICBMb2NhbCBTdG9yYWdlIGRvbWFpbikg YW5kwqA8L2Rpdj4KICAgICAgICAgICAgICAgICAgICAgIDxkaXY+bm8gSSdkIGxpa2UgdG8gcmVi dWlsZCB0aGUgc2V0dXAgYnkgbWFraW5nIGEKICAgICAgICAgICAgICAgICAgICAgICAgY2x1c3Rl ciBvZiAyIHBoeXNpY2FsIHNlcnZlcnMsIG5vIGV4dGVybmFsCiAgICAgICAgICAgICAgICAgICAg ICAgIHN0b3JhZ2UgYXJyYXkgYXZhaWxhYmxlLiBUaGF0IGFyZSB0aGUgb3B0aW9ucwogICAgICAg ICAgICAgICAgICAgICAgICBoZXJlPyBpcyB0aGVyZSBhbnkgb3B0aW9ucyB0byBidWlsZCBjaGVh cCBIQQogICAgICAgICAgICAgICAgICAgICAgICBjbHVzdGVyIHdpdGgganVzdCAyIHNlcnZlcnM/ wqA8L2Rpdj4KICAgICAgICAgICAgICAgICAgICAgIDxkaXY+PGJyPgogICAgICAgICAgICAgICAg ICAgICAgPC9kaXY+CiAgICAgICAgICAgICAgICAgICAgICA8ZGl2PlRoYW5rcyBpbiBhZHZhbmNl ITwvZGl2PgogICAgICAgICAgICAgICAgICAgICAgPGRpdj48YnI+CiAgICAgICAgICAgICAgICAg ICAgICA8L2Rpdj4KICAgICAgICAgICAgICAgICAgICAgIDxkaXY+QXJ0ZW08L2Rpdj4KICAgICAg ICAgICAgICAgICAgICA8L2Rpdj4KICAgICAgICAgICAgICAgICAgICA8YnI+CiAgICAgICAgICAg ICAgICAgICAgPGZpZWxkc2V0CiAgICAgICAgICAgICAgICAgICAgICBjbGFzcz0ibV8tMTkyOTI5 OTI0MjM0MDMyMzIxOW1pbWVBdHRhY2htZW50SGVhZGVyIj48L2ZpZWxkc2V0PgogICAgICAgICAg ICAgICAgICAgIDxicj4KICAgICAgICAgICAgICAgICAgPC9kaXY+CiAgICAgICAgICAgICAgICA8 L2Rpdj4KICAgICAgICAgICAgICAgIDxwcmU+X19fX19fX19fX19fX19fX19fX19fX19fX19fX19f PHdicj5fX19fX19fX19fX19fX19fXwpVc2VycyBtYWlsaW5nIGxpc3QKPGEgY2xhc3M9Im1fLTE5 MjkyOTkyNDIzNDAzMjMyMTltb3otdHh0LWxpbmstYWJicmV2aWF0ZWQiIGhyZWY9Im1haWx0bzpV c2Vyc0BvdmlydC5vcmciIHRhcmdldD0iX2JsYW5rIiBtb3otZG8tbm90LXNlbmQ9InRydWUiPlVz ZXJzQG92aXJ0Lm9yZzwvYT4KPGEgY2xhc3M9Im1fLTE5MjkyOTkyNDIzNDAzMjMyMTltb3otdHh0 LWxpbmstZnJlZXRleHQiIGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0 aW5mby91c2VycyIgdGFyZ2V0PSJfYmxhbmsiIG1vei1kby1ub3Qtc2VuZD0idHJ1ZSI+aHR0cDov L2xpc3RzLm92aXJ0Lm9yZy88d2JyPm1haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E+CjwvcHJlPgog ICAgICAgICAgICAgIDwvYmxvY2txdW90ZT4KICAgICAgICAgICAgICA8YnI+CiAgICAgICAgICAg IDwvZGl2PgogICAgICAgICAgPC9ibG9ja3F1b3RlPgogICAgICAgIDwvZGl2PgogICAgICAgIDxi cj4KICAgICAgPC9kaXY+CiAgICA8L2Jsb2NrcXVvdGU+CiAgICA8YnI+CiAgPC9ib2R5Pgo8L2h0 bWw+CgotLS0tLS0tLS0tLS0tLTU0RDIyNzRCRTY4RUQ1RUQ5Qjg2MjMwRC0tCg== --===============4412800340407802360==-- From johan at kafit.se Fri Nov 3 08:15:36 2017 Content-Type: multipart/mixed; boundary="===============1544150455771308809==" MIME-Version: 1.0 From: Johan Bernhardsson To: users at ovirt.org Subject: Re: [ovirt-users] Advise needed: building cheap HA oVirt cluster with just 2 physical servers Date: Fri, 03 Nov 2017 09:15:32 +0100 Message-ID: <15f80f308a0.2768.ffe2d6cdf294efc1bb86526523af9945@kafit.se> In-Reply-To: 0711091c-66a5-7aa5-0241-3ceba2ba1240@arsys.es --===============1544150455771308809== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. ------------15f80f30a1b78e9276832d9c5a Content-Type: text/plain; format=3Dflowed; charset=3D"UTF-8" Content-Transfer-Encoding: quoted-printable On drbd you have one master and use iscsi to share the storage. If the=3D20 master fails it will fail over to the other. You have one up that will act as the iscsi storage and jump between the h= =3D osts. If you run drbd master master ... Then you might get split brain and that= =3D =3D20 is not fun :) On November 3, 2017 09:04:49 Eduardo Mayoral wrote: > Just genuinely curious, how do you avoid split-brain situations with a > 2-node setup (be it drbd, gluster or anything else)? > > Eduardo Mayoral Jimeno (emayoral(a)arsys.es) > Administrador de sistemas. Departamento de Plataformas. Arsys internet. > +34 941 620 145 ext. 5153 > > On 03/11/17 08:40, Johan Bernhardsson wrote: >> >> Check on drbd. I have used that to build a cluster for two servers. It >> need some more work than a three node gluster conf but works well. >> >> I even think they have a white paper on how to do it for virtualizatio= =3D n. >> >> /Johan >> >> On November 3, 2017 08:11:04 Artem Tambovskiy >> wrote: >> >>> Looking for a design advise on oVirt provisioning. I'm running a PoC >>> lab on single bare-metal host (suddenly it was setup with just Local >>> Storage domain) and=3DC2=3DA0 >>> no I'd like to rebuild the setup by making a cluster of 2 physical >>> servers, no external storage array available. That are the options >>> here? is there any options to build cheap HA cluster with just 2 >>> servers?=3DC2=3DA0 >>> >>> Thanks in advance! >>> >>> Artem >>> _______________________________________________ >>> Users mailing list >>> Users(a)ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/users >>> >> >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users > ------------15f80f30a1b78e9276832d9c5a Content-Type: text/html; charset=3D"UTF-8" Content-Transfer-Encoding: quoted-printable =3D20

On drbd you have one master= =3D and use iscsi to share the storage. If the master fails it will fail over to the other.

You have one up that will a= =3D ct as the iscsi storage and jump between the hosts.

If you run drbd master mast= =3D er ... Then you might get split brain and that is not fun :)

On November 3, 2017 09:04:49 Eduardo Mayoral <emayoral(a)arsys.es> wrote= =3D :

Just genuinely curious, how do you avoid split-brain situations with a 2-node setup (be it drbd, gluster or anything else)?

Eduardo Mayoral Jimeno (emayoral(a)arsys.es)
Administrador de sistemas. Departamento de Plataformas. Arsys internet.
+34 941 620 145 ext. 5153
On 03/11/17 08:40, Johan Bernhardsson wrote:

Check on drbd. I have used that to build a cluster for two servers. It need some more work than a three node gluster conf but works well.

I even think they have a white paper on how to do it for virtualization.

/Johan

On November 3, 2017 08:11:04 Artem Tambovskiy <artem.tambovskiy(a)gmail= .com=3D > wrote:

Looking for a design advise on oVirt provisioning. I'm running a PoC lab on single bare-metal host (suddenly it was setup with just Local Storage domain) and=3DC2=3DA0
no I'd like to rebuild the setup by making a cluster of 2 physical servers, no external storage array available. That are the options here? is there any options to build cheap HA cluster with just 2 servers?=3DC2=3DA0

Thanks in advance!

Artem
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users



_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt=
=3D
.org/mailman/listinfo/users

------------15f80f30a1b78e9276832d9c5a-- --===============1544150455771308809== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t MTVmODBmMzBhMWI3OGU5Mjc2ODMyZDljNWEKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBmb3Jt YXQ9Zmxvd2VkOyBjaGFyc2V0PSJVVEYtOCIKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogcXVv dGVkLXByaW50YWJsZQoKT24gZHJiZCB5b3UgaGF2ZSBvbmUgbWFzdGVyIGFuZCB1c2UgaXNjc2kg dG8gc2hhcmUgdGhlIHN0b3JhZ2UuIElmIHRoZT0yMAptYXN0ZXIgZmFpbHMgaXQgd2lsbCBmYWls IG92ZXIgdG8gdGhlIG90aGVyLgoKWW91IGhhdmUgb25lIHVwIHRoYXQgd2lsbCBhY3QgYXMgdGhl IGlzY3NpIHN0b3JhZ2UgYW5kIGp1bXAgYmV0d2VlbiB0aGUgaD0Kb3N0cy4KCklmIHlvdSBydW4g ZHJiZCBtYXN0ZXIgbWFzdGVyIC4uLiBUaGVuIHlvdSBtaWdodCBnZXQgc3BsaXQgYnJhaW4gYW5k IHRoYXQ9Cj0yMAppcyBub3QgZnVuIDopCgoKT24gTm92ZW1iZXIgMywgMjAxNyAwOTowNDo0OSBF ZHVhcmRvIE1heW9yYWwgPGVtYXlvcmFsQGFyc3lzLmVzPiB3cm90ZToKCj4gSnVzdCBnZW51aW5l bHkgY3VyaW91cywgaG93IGRvIHlvdSBhdm9pZCBzcGxpdC1icmFpbiBzaXR1YXRpb25zIHdpdGgg YQo+IDItbm9kZSBzZXR1cCAoYmUgaXQgZHJiZCwgZ2x1c3RlciBvciBhbnl0aGluZyBlbHNlKT8K Pgo+IEVkdWFyZG8gTWF5b3JhbCBKaW1lbm8gKGVtYXlvcmFsQGFyc3lzLmVzKQo+IEFkbWluaXN0 cmFkb3IgZGUgc2lzdGVtYXMuIERlcGFydGFtZW50byBkZSBQbGF0YWZvcm1hcy4gQXJzeXMgaW50 ZXJuZXQuCj4gKzM0IDk0MSA2MjAgMTQ1IGV4dC4gNTE1Mwo+Cj4gT24gMDMvMTEvMTcgMDg6NDAs IEpvaGFuIEJlcm5oYXJkc3NvbiB3cm90ZToKPj4KPj4gQ2hlY2sgb24gZHJiZC4gSSBoYXZlIHVz ZWQgdGhhdCB0byBidWlsZCBhIGNsdXN0ZXIgZm9yIHR3byBzZXJ2ZXJzLiBJdAo+PiBuZWVkIHNv bWUgbW9yZSB3b3JrIHRoYW4gYSB0aHJlZSBub2RlIGdsdXN0ZXIgY29uZiBidXQgd29ya3Mgd2Vs bC4KPj4KPj4gSSBldmVuIHRoaW5rIHRoZXkgaGF2ZSBhIHdoaXRlIHBhcGVyIG9uIGhvdyB0byBk byBpdCBmb3IgdmlydHVhbGl6YXRpbz0Kbi4KPj4KPj4gL0pvaGFuCj4+Cj4+IE9uIE5vdmVtYmVy IDMsIDIwMTcgMDg6MTE6MDQgQXJ0ZW0gVGFtYm92c2tpeQo+PiA8YXJ0ZW0udGFtYm92c2tpeUBn bWFpbC5jb20+IHdyb3RlOgo+Pgo+Pj4gTG9va2luZyBmb3IgYSBkZXNpZ24gYWR2aXNlIG9uIG9W aXJ0IHByb3Zpc2lvbmluZy4gSSdtIHJ1bm5pbmcgYSBQb0MKPj4+IGxhYiBvbiBzaW5nbGUgYmFy ZS1tZXRhbCBob3N0IChzdWRkZW5seSBpdCB3YXMgc2V0dXAgd2l0aCBqdXN0IExvY2FsCj4+PiBT dG9yYWdlIGRvbWFpbikgYW5kPUMyPUEwCj4+PiBubyBJJ2QgbGlrZSB0byByZWJ1aWxkIHRoZSBz ZXR1cCBieSBtYWtpbmcgYSBjbHVzdGVyIG9mIDIgcGh5c2ljYWwKPj4+IHNlcnZlcnMsIG5vIGV4 dGVybmFsIHN0b3JhZ2UgYXJyYXkgYXZhaWxhYmxlLiBUaGF0IGFyZSB0aGUgb3B0aW9ucwo+Pj4g aGVyZT8gaXMgdGhlcmUgYW55IG9wdGlvbnMgdG8gYnVpbGQgY2hlYXAgSEEgY2x1c3RlciB3aXRo IGp1c3QgMgo+Pj4gc2VydmVycz89QzI9QTAKPj4+Cj4+PiBUaGFua3MgaW4gYWR2YW5jZSEKPj4+ Cj4+PiBBcnRlbQo+Pj4gX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX18KPj4+IFVzZXJzIG1haWxpbmcgbGlzdAo+Pj4gVXNlcnNAb3ZpcnQub3JnIDxtYWlsdG86 VXNlcnMlNDBvdmlydC5vcmc+Cj4+PiBodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlz dGluZm8vdXNlcnMKPj4+Cj4+Cj4+Cj4+IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fCj4+IFVzZXJzIG1haWxpbmcgbGlzdAo+PiBVc2Vyc0BvdmlydC5vcmcK Pj4gaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzCj4KCi0tLS0t LS0tLS0tLTE1ZjgwZjMwYTFiNzhlOTI3NjgzMmQ5YzVhCkNvbnRlbnQtVHlwZTogdGV4dC9odG1s OyBjaGFyc2V0PSJVVEYtOCIKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogcXVvdGVkLXByaW50 YWJsZQoKPGh0bWw+CjxoZWFkPgogICAgID0yMAoKPC9oZWFkPgo8Ym9keT4KPGRpdiBzdHlsZT0z RCJjb2xvcjogYmxhY2s7Ij4KPGRpdiBzdHlsZT0zRCJjb2xvcjogYmxhY2s7Ij4KPHAgc3R5bGU9 M0QibWFyZ2luOiAwIDAgMWVtIDA7IGNvbG9yOiBibGFjazsiPk9uIGRyYmQgeW91IGhhdmUgb25l IG1hc3Rlcj0KIGFuZAp1c2UgaXNjc2kgdG8gc2hhcmUgdGhlIHN0b3JhZ2UuIElmIHRoZSBtYXN0 ZXIgZmFpbHMgaXQgd2lsbCBmYWlsIG92ZXIgdG8KdGhlIG90aGVyLjwvcD4KPHAgc3R5bGU9M0Qi bWFyZ2luOiAwIDAgMWVtIDA7IGNvbG9yOiBibGFjazsiPllvdSBoYXZlIG9uZSB1cCB0aGF0IHdp bGwgYT0KY3QKYXMgdGhlIGlzY3NpIHN0b3JhZ2UgYW5kIGp1bXAgYmV0d2VlbiB0aGUgaG9zdHMu PC9wPgo8cCBzdHlsZT0zRCJtYXJnaW46IDAgMCAxZW0gMDsgY29sb3I6IGJsYWNrOyI+SWYgeW91 IHJ1biBkcmJkIG1hc3RlciBtYXN0PQplcgouLi4gVGhlbiB5b3UgbWlnaHQgZ2V0IHNwbGl0IGJy YWluIGFuZCB0aGF0IGlzIG5vdCBmdW4gOik8L3A+CjwvZGl2Pgo8ZGl2IHN0eWxlPTNEImNvbG9y OiBibGFjazsiPgo8cApzdHlsZT0zRCJjb2xvcjogYmxhY2s7IGZvbnQtc2l6ZTogMTBwdDsgZm9u dC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBtPQphcmdpbjogMTBwdCAwOyI+T24KTm92ZW1i ZXIgMywgMjAxNyAwOTowNDo0OSBFZHVhcmRvIE1heW9yYWwgJmx0O2VtYXlvcmFsQGFyc3lzLmVz Jmd0OyB3cm90ZT0KOjwvcD4KPGJsb2NrcXVvdGUgdHlwZT0zRCJjaXRlIiBjbGFzcz0zRCJnbWFp bF9xdW90ZSIKc3R5bGU9M0QibWFyZ2luOiAwIDAgMCAwLjc1ZXg7IGJvcmRlci1sZWZ0OiAxcHgg c29saWQgIzgwODA4MDsgcGFkZGluZy1sZT0KZnQ6IDAuNzVleDsiPgogICAgPHA+SnVzdCBnZW51 aW5lbHkgY3VyaW91cywgaG93IGRvIHlvdSBhdm9pZCBzcGxpdC1icmFpbiBzaXR1YXRpb25zCiAg ICAgIHdpdGggYSAyLW5vZGUgc2V0dXAgKGJlIGl0IGRyYmQsIGdsdXN0ZXIgb3IgYW55dGhpbmcg ZWxzZSk/PGJyPgogICAgPC9wPgogICAgPHByZSBjbGFzcz0zRCJtb3otc2lnbmF0dXJlIiBjb2xz PTNEIjcyIj5FZHVhcmRvIE1heW9yYWwgSmltZW5vICg8YQpjbGFzcz0zRCJtb3otdHh0LWxpbmst YWJicmV2aWF0ZWQiCmhyZWY9M0QibWFpbHRvOmVtYXlvcmFsQGFyc3lzLmVzIj5lbWF5b3JhbEBh cnN5cy5lczwvYT4pCkFkbWluaXN0cmFkb3IgZGUgc2lzdGVtYXMuIERlcGFydGFtZW50byBkZSBQ bGF0YWZvcm1hcy4gQXJzeXMgaW50ZXJuZXQuCiszNCA5NDEgNjIwIDE0NSBleHQuIDUxNTM8L3By ZT4KICAgIDxkaXYgY2xhc3M9M0QibW96LWNpdGUtcHJlZml4Ij5PbiAwMy8xMS8xNyAwODo0MCwg Sm9oYW4gQmVybmhhcmRzc29uCiAgICAgIHdyb3RlOjxicj4KICAgIDwvZGl2PgogICAgPGJsb2Nr cXVvdGUgdHlwZT0zRCJjaXRlIgogICAgICBjaXRlPTNEIm1pZDoxNWY4MGQzNTM3MC4yNzY4LmZm ZTJkNmNkZjI5NGVmYzFiYjg2NTI2NTIzYWY5OTQ1QGthZml0PQouc2UiPgogICAgICA8bWV0YSBo dHRwLWVxdWl2PTNEIkNvbnRlbnQtVHlwZSIgY29udGVudD0zRCJ0ZXh0L2h0bWw7IGNoYXJzZXQ9 M0R1PQp0Zi04Ij4KICAgICAgPGRpdiBzdHlsZT0zRCJjb2xvcjogYmxhY2s7Ij4KICAgICAgICA8 ZGl2IHN0eWxlPTNEImNvbG9yOiBibGFjazsiPgogICAgICAgICAgPHAgc3R5bGU9M0QibWFyZ2lu OiAwIDAgMWVtIDA7IGNvbG9yOiBibGFjazsiPkNoZWNrIG9uIGRyYmQuIEkKICAgICAgICAgICAg aGF2ZSB1c2VkIHRoYXQKICAgICAgICAgICAgdG8gYnVpbGQgYSBjbHVzdGVyIGZvciB0d28gc2Vy dmVycy4gSXQgbmVlZCBzb21lIG1vcmUgd29yawogICAgICAgICAgICB0aGFuIGEgdGhyZWUKICAg ICAgICAgICAgbm9kZSBnbHVzdGVyIGNvbmYgYnV0IHdvcmtzIHdlbGwuPC9wPgogICAgICAgICAg PHAgc3R5bGU9M0QibWFyZ2luOiAwIDAgMWVtIDA7IGNvbG9yOiBibGFjazsiPkkgZXZlbiB0aGlu ayB0aGV5CiAgICAgICAgICAgIGhhdmUgYSB3aGl0ZQogICAgICAgICAgICBwYXBlciBvbiBob3cg dG8gZG8gaXQgZm9yIHZpcnR1YWxpemF0aW9uLjwvcD4KICAgICAgICAgIDxwIHN0eWxlPTNEIm1h cmdpbjogMCAwIDFlbSAwOyBjb2xvcjogYmxhY2s7Ij4vSm9oYW48L3A+CiAgICAgICAgPC9kaXY+ CiAgICAgICAgPGRpdiBzdHlsZT0zRCJjb2xvcjogYmxhY2s7Ij4KICAgICAgICAgIDxwIHN0eWxl PTNEImNvbG9yOiBibGFjazsgZm9udC1zaXplOiAxMHB0OyBmb250LWZhbWlseTogQXJpYWwsCiAg ICAgICAgICAgIHNhbnMtc2VyaWY7IG1hcmdpbjogMTBwdCAwOyI+T24KICAgICAgICAgICAgTm92 ZW1iZXIgMywgMjAxNyAwODoxMTowNCBBcnRlbSBUYW1ib3Zza2l5CiAgICAgICAgICAgIDxhIGNs YXNzPTNEIm1vei10eHQtbGluay1yZmMyMzk2RSIKaHJlZj0zRCJtYWlsdG86YXJ0ZW0udGFtYm92 c2tpeUBnbWFpbC5jb20iPiZsdDthcnRlbS50YW1ib3Zza2l5QGdtYWlsLmNvbT0KJmd0OzwvYT4K d3JvdGU6PC9wPgogICAgICAgICAgPGJsb2NrcXVvdGUgdHlwZT0zRCJjaXRlIiBjbGFzcz0zRCJn bWFpbF9xdW90ZSIgc3R5bGU9M0QibWFyZ2luPQo6IDAgMAogICAgICAgICAgICAwIDAuNzVleDsg Ym9yZGVyLWxlZnQ6IDFweCBzb2xpZCAjODA4MDgwOyBwYWRkaW5nLWxlZnQ6CiAgICAgICAgICAg IDAuNzVleDsiPgogICAgICAgICAgICA8ZGl2IGRpcj0zRCJsdHIiPgogICAgICAgICAgICAgIDxk aXY+TG9va2luZyBmb3IgYSBkZXNpZ24gYWR2aXNlIG9uIG9WaXJ0IHByb3Zpc2lvbmluZy4KICAg ICAgICAgICAgICAgIEknbSBydW5uaW5nIGEgUG9DIGxhYiBvbiBzaW5nbGUgYmFyZS1tZXRhbCBo b3N0CiAgICAgICAgICAgICAgICAoc3VkZGVubHkgaXQgd2FzIHNldHVwCiAgICAgICAgICAgICAg ICB3aXRoIGp1c3QgTG9jYWwgU3RvcmFnZSBkb21haW4pIGFuZD1DMj1BMDwvZGl2PgogICAgICAg ICAgICAgIDxkaXY+bm8gSSdkIGxpa2UgdG8gcmVidWlsZAogICAgICAgICAgICAgICAgdGhlIHNl dHVwIGJ5IG1ha2luZyBhIGNsdXN0ZXIgb2YgMiBwaHlzaWNhbCBzZXJ2ZXJzLCBubwogICAgICAg ICAgICAgICAgZXh0ZXJuYWwgc3RvcmFnZQogICAgICAgICAgICAgICAgYXJyYXkgYXZhaWxhYmxl LiBUaGF0IGFyZSB0aGUgb3B0aW9ucyBoZXJlPyBpcyB0aGVyZSBhbnkKICAgICAgICAgICAgICAg IG9wdGlvbnMgdG8gYnVpbGQKICAgICAgICAgICAgICAgIGNoZWFwIEhBIGNsdXN0ZXIgd2l0aCBq dXN0IDIgc2VydmVycz89QzI9QTA8L2Rpdj4KICAgICAgICAgICAgICA8ZGl2Pjxicj4KICAgICAg ICAgICAgICA8L2Rpdj4KICAgICAgICAgICAgICA8ZGl2PlRoYW5rcyBpbgogICAgICAgICAgICAg ICAgYWR2YW5jZSE8L2Rpdj4KICAgICAgICAgICAgICA8ZGl2Pjxicj4KICAgICAgICAgICAgICA8 L2Rpdj4KICAgICAgICAgICAgICA8ZGl2PkFydGVtPC9kaXY+CiAgICAgICAgICAgIDwvZGl2Pgog ICAgICAgICAgICBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f Xzxicj4KICAgICAgICAgICAgVXNlcnMgbWFpbGluZyBsaXN0PGJyPgogICAgICAgICAgICA8YSBj bGFzcz0zRCJhcW0tYXV0b2xpbmsgYXFtLWF1dG93cmFwIgogICAgICAgICAgICAgIGhyZWY9M0Qi bWFpbHRvOlVzZXJzJTQwb3ZpcnQub3JnIgptb3otZG8tbm90LXNlbmQ9M0QidHJ1ZSI+VXNlcnNA b3ZpcnQub3JnPC9hPjxicj4KICAgICAgICAgICAgPGEgY2xhc3M9M0QiYXFtLWF1dG9saW5rIGFx bS1hdXRvd3JhcCIKICAgICAgICAgICAgICBocmVmPTNEImh0dHA6Ly9saXN0cy5vdmlydC5vcmcv bWFpbG1hbi9saXN0aW5mby91c2VycyIKICAgICAgICAgICAgPTIwCm1vei1kby1ub3Qtc2VuZD0z RCJ0cnVlIj5odHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E9 Cj48YnI+CiAgICAgICAgICAgIDxicj4KICAgICAgICAgIDwvYmxvY2txdW90ZT4KICAgICAgICA8 L2Rpdj4KICAgICAgPC9kaXY+CiAgICAgIDxicj4KICAgICAgPGZpZWxkc2V0IGNsYXNzPTNEIm1p bWVBdHRhY2htZW50SGVhZGVyIj48L2ZpZWxkc2V0PgogICAgICA8YnI+CiAgICAgIDxwcmUgd3Jh cD0zRCIiPl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fClVz ZXJzIG1haWxpbmcgbGlzdAo8YSBjbGFzcz0zRCJtb3otdHh0LWxpbmstYWJicmV2aWF0ZWQiCmhy ZWY9M0QibWFpbHRvOlVzZXJzQG92aXJ0Lm9yZyI+VXNlcnNAb3ZpcnQub3JnPC9hPgo8YSBjbGFz cz0zRCJtb3otdHh0LWxpbmstZnJlZXRleHQiCmhyZWY9M0QiaHR0cDovL2xpc3RzLm92aXJ0Lm9y Zy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIj5odHRwOi8vbGlzdHMub3ZpcnQ9Ci5vcmcvbWFpbG1h bi9saXN0aW5mby91c2VyczwvYT4KPC9wcmU+CiAgICA8L2Jsb2NrcXVvdGU+CiAgICA8YnI+CiAg PC9ibG9ja3F1b3RlPgo8L2Rpdj4KPC9kaXY+CjwvYm9keT4KPC9odG1sPgoKLS0tLS0tLS0tLS0t MTVmODBmMzBhMWI3OGU5Mjc2ODMyZDljNWEtLQoK --===============1544150455771308809==-- From kwagner at suse.com Fri Nov 3 09:27:05 2017 Content-Type: multipart/mixed; boundary="===============2250784789847186905==" MIME-Version: 1.0 From: Kai Wagner To: users at ovirt.org Subject: Re: [ovirt-users] Advise needed: building cheap HA oVirt cluster with just 2 physical servers Date: Fri, 03 Nov 2017 10:06:33 +0100 Message-ID: In-Reply-To: 15f80f308a0.2768.ffe2d6cdf294efc1bb86526523af9945@kafit.se --===============2250784789847186905== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --LpidP5sDUwnqXvKTBqwmoV4WNgVOc3LVR Content-Type: multipart/mixed; boundary=3D"EuwhS6IvMgri3Uvk0TBflcE1NlHpw3QJ= U"; protected-headers=3D"v1" From: Kai Wagner To: users(a)ovirt.org Message-ID: Subject: Re: [ovirt-users] Advise needed: building cheap HA oVirt cluster w= ith just 2 physical servers References: <15f80d35370.2768.ffe2d6cdf294efc1bb86526523af9945(a)kafit.se> <0711091c-66a5-7aa5-0241-3ceba2ba1240(a)arsys.es> <15f80f308a0.2768.ffe2d6cdf294efc1bb86526523af9945(a)kafit.se> In-Reply-To: <15f80f308a0.2768.ffe2d6cdf294efc1bb86526523af9945(a)kafit.se> --EuwhS6IvMgri3Uvk0TBflcE1NlHpw3QJU Content-Type: multipart/alternative; boundary=3D"------------2D81AC2A3E3425E12F595D94" Content-Language: en-US This is a multi-part message in MIME format. --------------2D81AC2A3E3425E12F595D94 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable Nevertheless you could end up with a split brain situation because you've no quorum. So it doesn't matter which kind of cluster you want to build, but you'll need a third node as a tiebreaker. I know that a 2 node cluster with drbd would work, but not in all cases, so do yourself a favor and get a third node. On 03.11.2017 09:15, Johan Bernhardsson wrote: > > On drbd you have one master and use iscsi to share the storage. If the > master fails it will fail over to the other. > > You have one up that will act as the iscsi storage and jump between > the hosts. > > If you run drbd master master ... Then you might get split brain and > that is not fun :) > > On November 3, 2017 09:04:49 Eduardo Mayoral wrote:= =3D > >> Just genuinely curious, how do you avoid split-brain situations with >> a 2-node setup (be it drbd, gluster or anything else)? >> >> Eduardo Mayoral Jimeno (emayoral(a)arsys.es) >> Administrador de sistemas. Departamento de Plataformas. Arsys internet= =3D =3D2E >> +34 941 620 145 ext. 5153 >> On 03/11/17 08:40, Johan Bernhardsson wrote: >>> >>> Check on drbd. I have used that to build a cluster for two servers. >>> It need some more work than a three node gluster conf but works well.= =3D >>> >>> I even think they have a white paper on how to do it for virtualizati= =3D on. >>> >>> /Johan >>> >>> On November 3, 2017 08:11:04 Artem Tambovskiy >>> wrote: >>> >>>> Looking for a design advise on oVirt provisioning. I'm running a >>>> PoC lab on single bare-metal host (suddenly it was setup with just >>>> Local Storage domain) and=3DC2=3DA0 >>>> no I'd like to rebuild the setup by making a cluster of 2 physical >>>> servers, no external storage array available. That are the options >>>> here? is there any options to build cheap HA cluster with just 2 >>>> servers?=3DC2=3DA0 >>>> >>>> Thanks in advance! >>>> >>>> Artem >>>> _______________________________________________ >>>> Users mailing list >>>> Users(a)ovirt.org >>>> http://lists.ovirt.org/mailman/listinfo/users >>>> >>> >>> >>> _______________________________________________ >>> Users mailing list >>> Users(a)ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/users >> > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --=3D20 SUSE Linux GmbH, GF: Felix Imend=3DC3=3DB6rffer, Jane Smithard, Graham Nort= on=3D , HRB 21284 (AG N=3DC3=3DBCrnberg) --------------2D81AC2A3E3425E12F595D94 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable

Nevertheless you could end up with a split brain situation because you've no quorum.

So it doesn't matter which kind of cluster you want to build, but you'll need a third node as a tiebreaker.

I know that a 2 node cluster with drbd would work, but not in all cases, so do yourself a favor and get a third node.


On 03.11.2017 09:15, Johan Bernhardsso= =3D n wrote:

On drbd you have one master and use iscsi to share the storage. If the master fails it will fail over to the other.

You have one up that will act as the iscsi storage and jump between the hosts.

If you run drbd master master ... Then you might get split brain and that is not fun :)

= =3D

On November 3, 2017 09:04:49 Eduardo Mayoral <emayoral(a)arsys.es> wrote:

Just genuinely curious, how do you avoid split-brain situations with a 2-node setup (be it drbd, gluster or anything else)?

Eduardo Mayoral Ji=
me=3D
no (emayoral(a)arsys.es)
Administrador de sistemas. Departamento de Plataformas. Arsys internet.
+34 941 620 145 ext. 5153
On 03/11/17 08:40, Johan Bernhardsson wrote:

Check on drbd. I have used that to build a cluster for two servers. It need some more work than a three node gluster conf but works well.

I even think they have a white paper on how to do it for virtualization.

/Johan

On November 3, 2017 08:11:04 Artem Tambovskiy <artem.tambovskiy(a)gma= il=3D =3D2Ecom> wrote:

Looking for a design advise on oVirt provisioning. I'm running a PoC lab on single bare-metal host (suddenly it was setup with just Local Storage domain) and=3DC2=3DA0
no I'd like to rebuild the setup by making a cluster of 2 physical servers, no external storage array available. That are the options here? is there any options to build cheap HA cluster with just 2 servers?=3DC2=3DA0

Thanks in advance!

Artem
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mai= =3D lman/listinfo/users



____________________________________________=
=3D
___
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/=
=3D
listinfo/users




_______________________________________________
Users mailing list
Use=3D
rs(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users


--=3D20
SUSE Linux GmbH, GF: Felix Imend=3DC3=3DB6rffer, Jane Smithard, Graham Nort=
on=3D
, HRB 21284 (AG N=3DC3=3DBCrnberg)
--------------2D81AC2A3E3425E12F595D94-- --EuwhS6IvMgri3Uvk0TBflcE1NlHpw3QJU-- --LpidP5sDUwnqXvKTBqwmoV4WNgVOc3LVR Content-Type: application/pgp-signature; name=3D"signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename=3D"signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBCAAGBQJZ/DGZAAoJEB6MkVYW48Ruh90H/i/6pG6WJtfRBlwM5LaQ1AcK OvzOmoFaX+ZBjq1jUOjghspUO0UUX1FR4OuSoDXMIUk2p7EAhrUoBKSzpXNjw//2 gCLMMMGW3iNAKXsVvnHeNfm4xTMdM6uNtGGSaS6Z4w9gbvrX99HoPnQx3KdiL7Cl 3uEj3Yl5rp4clTy5MRIFFNTweei6KnWyssSkHgmaH+oeqnkTeIdkvYlfDVDkhXfo dl1/K0FoPMlnEccHzh2mdXEItBFr5FhPxWpFob/6dINci4dSiLy3mQ0h87aTy9+q DUOOM4efQ0wWr5+AOtmo2gPrBR5yNrnm3qMjjgB8gKytWmxKUcFjmNPXFd4ge/o=3D =3DoCXV -----END PGP SIGNATURE----- --LpidP5sDUwnqXvKTBqwmoV4WNgVOc3LVR-- --===============2250784789847186905== Content-Type: multipart/signed MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhbiBPcGVuUEdQL01JTUUgc2lnbmVkIG1lc3NhZ2UgKFJGQyA0ODgwIGFuZCAzMTU2 KQotLUxwaWRQNXNEVXducVh2S1RCcXdtb1Y0V05nVk9jM0xWUgpDb250ZW50LVR5cGU6IG11bHRp cGFydC9taXhlZDsgYm91bmRhcnk9IkV1d2hTNkl2TWdyaTNVdmswVEJmbGNFMU5sSHB3M1FKVSI7 CiBwcm90ZWN0ZWQtaGVhZGVycz0idjEiCkZyb206IEthaSBXYWduZXIgPGt3YWduZXJAc3VzZS5j b20+ClRvOiB1c2Vyc0BvdmlydC5vcmcKTWVzc2FnZS1JRDogPGE1ODdiMzZhLWFkYmQtOGY3Yi0w MmNmLTE3YzkzNDM0N2FlMkBzdXNlLmNvbT4KU3ViamVjdDogUmU6IFtvdmlydC11c2Vyc10gQWR2 aXNlIG5lZWRlZDogYnVpbGRpbmcgY2hlYXAgSEEgb1ZpcnQgY2x1c3RlciB3aXRoCiBqdXN0IDIg cGh5c2ljYWwgc2VydmVycwpSZWZlcmVuY2VzOiA8Q0FBcStSZmFiOGZ2aE5WK3VQMmhFY2VKeXdh ZXpFcXlSU0R3ZEJ4NjAzMzNTTVI3azRBQG1haWwuZ21haWwuY29tPgogPDE1ZjgwZDM1MzcwLjI3 NjguZmZlMmQ2Y2RmMjk0ZWZjMWJiODY1MjY1MjNhZjk5NDVAa2FmaXQuc2U+CiA8MDcxMTA5MWMt NjZhNS03YWE1LTAyNDEtM2NlYmEyYmExMjQwQGFyc3lzLmVzPgogPDE1ZjgwZjMwOGEwLjI3Njgu ZmZlMmQ2Y2RmMjk0ZWZjMWJiODY1MjY1MjNhZjk5NDVAa2FmaXQuc2U+CkluLVJlcGx5LVRvOiA8 MTVmODBmMzA4YTAuMjc2OC5mZmUyZDZjZGYyOTRlZmMxYmI4NjUyNjUyM2FmOTk0NUBrYWZpdC5z ZT4KCi0tRXV3aFM2SXZNZ3JpM1V2azBUQmZsY0UxTmxIcHczUUpVCkNvbnRlbnQtVHlwZTogbXVs dGlwYXJ0L2FsdGVybmF0aXZlOwogYm91bmRhcnk9Ii0tLS0tLS0tLS0tLTJEODFBQzJBM0UzNDI1 RTEyRjU5NUQ5NCIKQ29udGVudC1MYW5ndWFnZTogZW4tVVMKClRoaXMgaXMgYSBtdWx0aS1wYXJ0 IG1lc3NhZ2UgaW4gTUlNRSBmb3JtYXQuCi0tLS0tLS0tLS0tLS0tMkQ4MUFDMkEzRTM0MjVFMTJG NTk1RDk0CkNvbnRlbnQtVHlwZTogdGV4dC9wbGFpbjsgY2hhcnNldD11dGYtOApDb250ZW50LVRy YW5zZmVyLUVuY29kaW5nOiBxdW90ZWQtcHJpbnRhYmxlCgpOZXZlcnRoZWxlc3MgeW91IGNvdWxk IGVuZCB1cCB3aXRoIGEgc3BsaXQgYnJhaW4gc2l0dWF0aW9uIGJlY2F1c2UKeW91J3ZlIG5vIHF1 b3J1bS4KClNvIGl0IGRvZXNuJ3QgbWF0dGVyIHdoaWNoIGtpbmQgb2YgY2x1c3RlciB5b3Ugd2Fu dCB0byBidWlsZCwgYnV0IHlvdSdsbApuZWVkIGEgdGhpcmQgbm9kZSBhcyBhIHRpZWJyZWFrZXIu CgpJIGtub3cgdGhhdCBhIDIgbm9kZSBjbHVzdGVyIHdpdGggZHJiZCB3b3VsZCB3b3JrLCBidXQg bm90IGluIGFsbCBjYXNlcywKc28gZG8geW91cnNlbGYgYSBmYXZvciBhbmQgZ2V0IGEgdGhpcmQg bm9kZS4KCgpPbiAwMy4xMS4yMDE3IDA5OjE1LCBKb2hhbiBCZXJuaGFyZHNzb24gd3JvdGU6Cj4K PiBPbiBkcmJkIHlvdSBoYXZlIG9uZSBtYXN0ZXIgYW5kIHVzZSBpc2NzaSB0byBzaGFyZSB0aGUg c3RvcmFnZS4gSWYgdGhlCj4gbWFzdGVyIGZhaWxzIGl0IHdpbGwgZmFpbCBvdmVyIHRvIHRoZSBv dGhlci4KPgo+IFlvdSBoYXZlIG9uZSB1cCB0aGF0IHdpbGwgYWN0IGFzIHRoZSBpc2NzaSBzdG9y YWdlIGFuZCBqdW1wIGJldHdlZW4KPiB0aGUgaG9zdHMuCj4KPiBJZiB5b3UgcnVuIGRyYmQgbWFz dGVyIG1hc3RlciAuLi4gVGhlbiB5b3UgbWlnaHQgZ2V0IHNwbGl0IGJyYWluIGFuZAo+IHRoYXQg aXMgbm90IGZ1biA6KQo+Cj4gT24gTm92ZW1iZXIgMywgMjAxNyAwOTowNDo0OSBFZHVhcmRvIE1h eW9yYWwgPGVtYXlvcmFsQGFyc3lzLmVzPiB3cm90ZTo9Cgo+Cj4+IEp1c3QgZ2VudWluZWx5IGN1 cmlvdXMsIGhvdyBkbyB5b3UgYXZvaWQgc3BsaXQtYnJhaW4gc2l0dWF0aW9ucyB3aXRoCj4+IGEg Mi1ub2RlIHNldHVwIChiZSBpdCBkcmJkLCBnbHVzdGVyIG9yIGFueXRoaW5nIGVsc2UpPwo+Pgo+ PiBFZHVhcmRvIE1heW9yYWwgSmltZW5vIChlbWF5b3JhbEBhcnN5cy5lcykKPj4gQWRtaW5pc3Ry YWRvciBkZSBzaXN0ZW1hcy4gRGVwYXJ0YW1lbnRvIGRlIFBsYXRhZm9ybWFzLiBBcnN5cyBpbnRl cm5ldD0KPTJFCj4+ICszNCA5NDEgNjIwIDE0NSBleHQuIDUxNTMKPj4gT24gMDMvMTEvMTcgMDg6 NDAsIEpvaGFuIEJlcm5oYXJkc3NvbiB3cm90ZToKPj4+Cj4+PiBDaGVjayBvbiBkcmJkLiBJIGhh dmUgdXNlZCB0aGF0IHRvIGJ1aWxkIGEgY2x1c3RlciBmb3IgdHdvIHNlcnZlcnMuCj4+PiBJdCBu ZWVkIHNvbWUgbW9yZSB3b3JrIHRoYW4gYSB0aHJlZSBub2RlIGdsdXN0ZXIgY29uZiBidXQgd29y a3Mgd2VsbC49Cgo+Pj4KPj4+IEkgZXZlbiB0aGluayB0aGV5IGhhdmUgYSB3aGl0ZSBwYXBlciBv biBob3cgdG8gZG8gaXQgZm9yIHZpcnR1YWxpemF0aT0Kb24uCj4+Pgo+Pj4gL0pvaGFuCj4+Pgo+ Pj4gT24gTm92ZW1iZXIgMywgMjAxNyAwODoxMTowNCBBcnRlbSBUYW1ib3Zza2l5Cj4+PiA8YXJ0 ZW0udGFtYm92c2tpeUBnbWFpbC5jb20+IHdyb3RlOgo+Pj4KPj4+PiBMb29raW5nIGZvciBhIGRl c2lnbiBhZHZpc2Ugb24gb1ZpcnQgcHJvdmlzaW9uaW5nLiBJJ20gcnVubmluZyBhCj4+Pj4gUG9D IGxhYiBvbiBzaW5nbGUgYmFyZS1tZXRhbCBob3N0IChzdWRkZW5seSBpdCB3YXMgc2V0dXAgd2l0 aCBqdXN0Cj4+Pj4gTG9jYWwgU3RvcmFnZSBkb21haW4pIGFuZD1DMj1BMAo+Pj4+IG5vIEknZCBs aWtlIHRvIHJlYnVpbGQgdGhlIHNldHVwIGJ5IG1ha2luZyBhIGNsdXN0ZXIgb2YgMiBwaHlzaWNh bAo+Pj4+IHNlcnZlcnMsIG5vIGV4dGVybmFsIHN0b3JhZ2UgYXJyYXkgYXZhaWxhYmxlLiBUaGF0 IGFyZSB0aGUgb3B0aW9ucwo+Pj4+IGhlcmU/IGlzIHRoZXJlIGFueSBvcHRpb25zIHRvIGJ1aWxk IGNoZWFwIEhBIGNsdXN0ZXIgd2l0aCBqdXN0IDIKPj4+PiBzZXJ2ZXJzPz1DMj1BMAo+Pj4+Cj4+ Pj4gVGhhbmtzIGluIGFkdmFuY2UhCj4+Pj4KPj4+PiBBcnRlbQo+Pj4+IF9fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCj4+Pj4gVXNlcnMgbWFpbGluZyBsaXN0 Cj4+Pj4gVXNlcnNAb3ZpcnQub3JnIDxtYWlsdG86VXNlcnMlNDBvdmlydC5vcmc+Cj4+Pj4gaHR0 cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzCj4+Pj4KPj4+Cj4+Pgo+ Pj4gX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KPj4+IFVz ZXJzIG1haWxpbmcgbGlzdAo+Pj4gVXNlcnNAb3ZpcnQub3JnCj4+PiBodHRwOi8vbGlzdHMub3Zp cnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMKPj4KPgo+Cj4gX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX18KPiBVc2VycyBtYWlsaW5nIGxpc3QKPiBVc2Vy c0BvdmlydC5vcmcKPiBodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNl cnMKCi0tPTIwClNVU0UgTGludXggR21iSCwgR0Y6IEZlbGl4IEltZW5kPUMzPUI2cmZmZXIsIEph bmUgU21pdGhhcmQsIEdyYWhhbSBOb3J0b249CiwgSFJCIDIxMjg0IChBRyBOPUMzPUJDcm5iZXJn KQoKCi0tLS0tLS0tLS0tLS0tMkQ4MUFDMkEzRTM0MjVFMTJGNTk1RDk0CkNvbnRlbnQtVHlwZTog dGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IHF1b3Rl ZC1wcmludGFibGUKCjxodG1sPgogIDxoZWFkPgogICAgPG1ldGEgaHR0cC1lcXVpdj0zRCJDb250 ZW50LVR5cGUiIGNvbnRlbnQ9M0QidGV4dC9odG1sOyBjaGFyc2V0PTNEdXRmPQotOCI+CiAgPC9o ZWFkPgogIDxib2R5IHRleHQ9M0QiIzAwMDAwMCIgYmdjb2xvcj0zRCIjRkZGRkZGIj4KICAgIDxw Pk5ldmVydGhlbGVzcyB5b3UgY291bGQgZW5kIHVwIHdpdGggYSBzcGxpdCBicmFpbiBzaXR1YXRp b24KICAgICAgYmVjYXVzZSB5b3UndmUgbm8gcXVvcnVtLjwvcD4KICAgIDxwPlNvIGl0IGRvZXNu J3QgbWF0dGVyIHdoaWNoIGtpbmQgb2YgY2x1c3RlciB5b3Ugd2FudCB0byBidWlsZCwgYnV0CiAg ICAgIHlvdSdsbCBuZWVkIGEgdGhpcmQgbm9kZSBhcyBhIHRpZWJyZWFrZXIuPC9wPgogICAgPHA+ SSBrbm93IHRoYXQgYSAyIG5vZGUgY2x1c3RlciB3aXRoIGRyYmQgd291bGQgd29yaywgYnV0IG5v dCBpbiBhbGwKICAgICAgY2FzZXMsIHNvIGRvIHlvdXJzZWxmIGEgZmF2b3IgYW5kIGdldCBhIHRo aXJkIG5vZGUuIDxicj4KICAgIDwvcD4KICAgIDxicj4KICAgIDxkaXYgY2xhc3M9M0QibW96LWNp dGUtcHJlZml4Ij5PbiAwMy4xMS4yMDE3IDA5OjE1LCBKb2hhbiBCZXJuaGFyZHNzbz0KbgogICAg ICB3cm90ZTo8YnI+CiAgICA8L2Rpdj4KICAgIDxibG9ja3F1b3RlIHR5cGU9M0QiY2l0ZSIKICAg ICAgY2l0ZT0zRCJtaWQ6MTVmODBmMzA4YTAuMjc2OC5mZmUyZDZjZGYyOTRlZmMxYmI4NjUyNjUy M2FmOTk0NUBrYWZpdD0KPTJFc2UiPgogICAgICA8ZGl2IHN0eWxlPTNEImNvbG9yOiBibGFjazsi PgogICAgICAgIDxkaXYgc3R5bGU9M0QiY29sb3I6IGJsYWNrOyI+CiAgICAgICAgICA8cCBzdHls ZT0zRCJtYXJnaW46IDAgMCAxZW0gMDsgY29sb3I6IGJsYWNrOyI+T24gZHJiZCB5b3UgaGF2ZQog ICAgICAgICAgICBvbmUgbWFzdGVyIGFuZAogICAgICAgICAgICB1c2UgaXNjc2kgdG8gc2hhcmUg dGhlIHN0b3JhZ2UuIElmIHRoZSBtYXN0ZXIgZmFpbHMgaXQgd2lsbAogICAgICAgICAgICBmYWls IG92ZXIgdG8KICAgICAgICAgICAgdGhlIG90aGVyLjwvcD4KICAgICAgICAgIDxwIHN0eWxlPTNE Im1hcmdpbjogMCAwIDFlbSAwOyBjb2xvcjogYmxhY2s7Ij5Zb3UgaGF2ZSBvbmUgdXAKICAgICAg ICAgICAgdGhhdCB3aWxsIGFjdAogICAgICAgICAgICBhcyB0aGUgaXNjc2kgc3RvcmFnZSBhbmQg anVtcCBiZXR3ZWVuIHRoZSBob3N0cy48L3A+CiAgICAgICAgICA8cCBzdHlsZT0zRCJtYXJnaW46 IDAgMCAxZW0gMDsgY29sb3I6IGJsYWNrOyI+SWYgeW91IHJ1biBkcmJkCiAgICAgICAgICAgIG1h c3RlciBtYXN0ZXIKICAgICAgICAgICAgLi4uIFRoZW4geW91IG1pZ2h0IGdldCBzcGxpdCBicmFp biBhbmQgdGhhdCBpcyBub3QgZnVuIDopPC9wPj0KCiAgICAgICAgPC9kaXY+CiAgICAgICAgPGRp diBzdHlsZT0zRCJjb2xvcjogYmxhY2s7Ij4KICAgICAgICAgIDxwIHN0eWxlPTNEImNvbG9yOiBi bGFjazsgZm9udC1zaXplOiAxMHB0OyBmb250LWZhbWlseTogQXJpYWwsCiAgICAgICAgICAgIHNh bnMtc2VyaWY7IG1hcmdpbjogMTBwdCAwOyI+T24KICAgICAgICAgICAgTm92ZW1iZXIgMywgMjAx NyAwOTowNDo0OSBFZHVhcmRvIE1heW9yYWwKICAgICAgICAgICAgPGEgY2xhc3M9M0QibW96LXR4 dC1saW5rLXJmYzIzOTZFIiBocmVmPTNEIm1haWx0bzplbWF5b3JhbEBhcj0Kc3lzLmVzIj4mbHQ7 ZW1heW9yYWxAYXJzeXMuZXMmZ3Q7PC9hPiB3cm90ZTo8L3A+CiAgICAgICAgICA8YmxvY2txdW90 ZSB0eXBlPTNEImNpdGUiIGNsYXNzPTNEImdtYWlsX3F1b3RlIiBzdHlsZT0zRCJtYXJnaW49Cjog MCAwCiAgICAgICAgICAgIDAgMC43NWV4OyBib3JkZXItbGVmdDogMXB4IHNvbGlkICM4MDgwODA7 IHBhZGRpbmctbGVmdDoKICAgICAgICAgICAgMC43NWV4OyI+CiAgICAgICAgICAgIDxwPkp1c3Qg Z2VudWluZWx5IGN1cmlvdXMsIGhvdyBkbyB5b3UgYXZvaWQgc3BsaXQtYnJhaW4KICAgICAgICAg ICAgICBzaXR1YXRpb25zIHdpdGggYSAyLW5vZGUgc2V0dXAgKGJlIGl0IGRyYmQsIGdsdXN0ZXIg b3IKICAgICAgICAgICAgICBhbnl0aGluZyBlbHNlKT88YnI+CiAgICAgICAgICAgIDwvcD4KICAg ICAgICAgICAgPHByZSBjbGFzcz0zRCJtb3otc2lnbmF0dXJlIiBjb2xzPTNEIjcyIj5FZHVhcmRv IE1heW9yYWwgSmltZT0Kbm8gKDxhIGNsYXNzPTNEIm1vei10eHQtbGluay1hYmJyZXZpYXRlZCIg aHJlZj0zRCJtYWlsdG86ZW1heW9yYWxAYXJzeXMuZT0KcyIgbW96LWRvLW5vdC1zZW5kPTNEInRy dWUiPmVtYXlvcmFsQGFyc3lzLmVzPC9hPikKQWRtaW5pc3RyYWRvciBkZSBzaXN0ZW1hcy4gRGVw YXJ0YW1lbnRvIGRlIFBsYXRhZm9ybWFzLiBBcnN5cyBpbnRlcm5ldC4KKzM0IDk0MSA2MjAgMTQ1 IGV4dC4gNTE1MzwvcHJlPgogICAgICAgICAgICA8ZGl2IGNsYXNzPTNEIm1vei1jaXRlLXByZWZp eCI+T24gMDMvMTEvMTcgMDg6NDAsIEpvaGFuCiAgICAgICAgICAgICAgQmVybmhhcmRzc29uIHdy b3RlOjxicj4KICAgICAgICAgICAgPC9kaXY+CiAgICAgICAgICAgIDxibG9ja3F1b3RlIHR5cGU9 M0QiY2l0ZSIKICAgICAgICAgICAgICBjaXRlPTNEIm1pZDoxNWY4MGQzNTM3MC4yNzY4LmZmZTJk NmNkZjI5NGVmYzFiYjg2NTI2NTIzYWY5OT0KNDVAa2FmaXQuc2UiPgogICAgICAgICAgICAgIDxt ZXRhIGh0dHAtZXF1aXY9M0QiQ29udGVudC1UeXBlIiBjb250ZW50PTNEInRleHQvaHRtbDsKICAg ICAgICAgICAgICAgIGNoYXJzZXQ9M0R1dGYtOCI+CiAgICAgICAgICAgICAgPGRpdiBzdHlsZT0z RCJjb2xvcjogYmxhY2s7Ij4KICAgICAgICAgICAgICAgIDxkaXYgc3R5bGU9M0QiY29sb3I6IGJs YWNrOyI+CiAgICAgICAgICAgICAgICAgIDxwIHN0eWxlPTNEIm1hcmdpbjogMCAwIDFlbSAwOyBj b2xvcjogYmxhY2s7Ij5DaGVjayBvbgogICAgICAgICAgICAgICAgICAgIGRyYmQuIEkgaGF2ZSB1 c2VkIHRoYXQgdG8gYnVpbGQgYSBjbHVzdGVyIGZvciB0d28KICAgICAgICAgICAgICAgICAgICBz ZXJ2ZXJzLiBJdCBuZWVkIHNvbWUgbW9yZSB3b3JrIHRoYW4gYSB0aHJlZSBub2RlCiAgICAgICAg ICAgICAgICAgICAgZ2x1c3RlciBjb25mIGJ1dCB3b3JrcyB3ZWxsLjwvcD4KICAgICAgICAgICAg ICAgICAgPHAgc3R5bGU9M0QibWFyZ2luOiAwIDAgMWVtIDA7IGNvbG9yOiBibGFjazsiPkkgZXZl bgogICAgICAgICAgICAgICAgICAgIHRoaW5rIHRoZXkgaGF2ZSBhIHdoaXRlIHBhcGVyIG9uIGhv dyB0byBkbyBpdCBmb3IKICAgICAgICAgICAgICAgICAgICB2aXJ0dWFsaXphdGlvbi48L3A+CiAg ICAgICAgICAgICAgICAgIDxwIHN0eWxlPTNEIm1hcmdpbjogMCAwIDFlbSAwOyBjb2xvcjogYmxh Y2s7Ij4vSm9oYW48L3A9Cj4KICAgICAgICAgICAgICAgIDwvZGl2PgogICAgICAgICAgICAgICAg PGRpdiBzdHlsZT0zRCJjb2xvcjogYmxhY2s7Ij4KICAgICAgICAgICAgICAgICAgPHAgc3R5bGU9 M0QiY29sb3I6IGJsYWNrOyBmb250LXNpemU6IDEwcHQ7IGZvbnQtZmFtaWx5Oj0KCiAgICAgICAg ICAgICAgICAgICAgQXJpYWwsIHNhbnMtc2VyaWY7IG1hcmdpbjogMTBwdCAwOyI+T24gTm92ZW1i ZXIgMywKICAgICAgICAgICAgICAgICAgICAyMDE3IDA4OjExOjA0IEFydGVtIFRhbWJvdnNraXkg PGEKICAgICAgICAgICAgICAgICAgICAgIGNsYXNzPTNEIm1vei10eHQtbGluay1yZmMyMzk2RSIK ICAgICAgICAgICAgICAgICAgICAgIGhyZWY9M0QibWFpbHRvOmFydGVtLnRhbWJvdnNraXlAZ21h aWwuY29tIgogICAgICAgICAgICAgICAgICAgICAgbW96LWRvLW5vdC1zZW5kPTNEInRydWUiPiZs dDthcnRlbS50YW1ib3Zza2l5QGdtYWlsPQo9MkVjb20mZ3Q7PC9hPgogICAgICAgICAgICAgICAg ICAgIHdyb3RlOjwvcD4KICAgICAgICAgICAgICAgICAgPGJsb2NrcXVvdGUgdHlwZT0zRCJjaXRl IiBjbGFzcz0zRCJnbWFpbF9xdW90ZSIKICAgICAgICAgICAgICAgICAgICBzdHlsZT0zRCJtYXJn aW46IDAgMCAwIDAuNzVleDsgYm9yZGVyLWxlZnQ6IDFweCBzb2xpZD0KCiAgICAgICAgICAgICAg ICAgICAgIzgwODA4MDsgcGFkZGluZy1sZWZ0OiAwLjc1ZXg7Ij4KICAgICAgICAgICAgICAgICAg ICA8ZGl2IGRpcj0zRCJsdHIiPgogICAgICAgICAgICAgICAgICAgICAgPGRpdj5Mb29raW5nIGZv ciBhIGRlc2lnbiBhZHZpc2Ugb24gb1ZpcnQKICAgICAgICAgICAgICAgICAgICAgICAgcHJvdmlz aW9uaW5nLiBJJ20gcnVubmluZyBhIFBvQyBsYWIgb24gc2luZ2xlCiAgICAgICAgICAgICAgICAg ICAgICAgIGJhcmUtbWV0YWwgaG9zdCAoc3VkZGVubHkgaXQgd2FzIHNldHVwIHdpdGgganVzdAog ICAgICAgICAgICAgICAgICAgICAgICBMb2NhbCBTdG9yYWdlIGRvbWFpbikgYW5kPUMyPUEwPC9k aXY+CiAgICAgICAgICAgICAgICAgICAgICA8ZGl2Pm5vIEknZCBsaWtlIHRvIHJlYnVpbGQgdGhl IHNldHVwIGJ5IG1ha2luZyBhCiAgICAgICAgICAgICAgICAgICAgICAgIGNsdXN0ZXIgb2YgMiBw aHlzaWNhbCBzZXJ2ZXJzLCBubyBleHRlcm5hbAogICAgICAgICAgICAgICAgICAgICAgICBzdG9y YWdlIGFycmF5IGF2YWlsYWJsZS4gVGhhdCBhcmUgdGhlIG9wdGlvbnMKICAgICAgICAgICAgICAg ICAgICAgICAgaGVyZT8gaXMgdGhlcmUgYW55IG9wdGlvbnMgdG8gYnVpbGQgY2hlYXAgSEEKICAg ICAgICAgICAgICAgICAgICAgICAgY2x1c3RlciB3aXRoIGp1c3QgMiBzZXJ2ZXJzPz1DMj1BMDwv ZGl2PgogICAgICAgICAgICAgICAgICAgICAgPGRpdj48YnI+CiAgICAgICAgICAgICAgICAgICAg ICA8L2Rpdj4KICAgICAgICAgICAgICAgICAgICAgIDxkaXY+VGhhbmtzIGluIGFkdmFuY2UhPC9k aXY+CiAgICAgICAgICAgICAgICAgICAgICA8ZGl2Pjxicj4KICAgICAgICAgICAgICAgICAgICAg IDwvZGl2PgogICAgICAgICAgICAgICAgICAgICAgPGRpdj5BcnRlbTwvZGl2PgogICAgICAgICAg ICAgICAgICAgIDwvZGl2PgogICAgICAgICAgICAgICAgICAgIF9fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fPGJyPgogICAgICAgICAgICAgICAgICAgIFVzZXJz IG1haWxpbmcgbGlzdDxicj4KICAgICAgICAgICAgICAgICAgICA8YSBjbGFzcz0zRCJhcW0tYXV0 b2xpbmsgYXFtLWF1dG93cmFwIgogICAgICAgICAgICAgICAgICAgICAgaHJlZj0zRCJtYWlsdG86 VXNlcnMlNDBvdmlydC5vcmciCiAgICAgICAgICAgICAgICAgICAgICBtb3otZG8tbm90LXNlbmQ9 M0QidHJ1ZSI+VXNlcnNAb3ZpcnQub3JnPC9hPjxicj4KICAgICAgICAgICAgICAgICAgICA8YSBj bGFzcz0zRCJhcW0tYXV0b2xpbmsgYXFtLWF1dG93cmFwIgogICAgICAgICAgICAgICAgICAgICAg aHJlZj0zRCJodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlPQpycyIK ICAgICAgICAgICAgICAgICAgICAgIG1vei1kby1ub3Qtc2VuZD0zRCJ0cnVlIj5odHRwOi8vbGlz dHMub3ZpcnQub3JnL21haT0KbG1hbi9saXN0aW5mby91c2VyczwvYT48YnI+CiAgICAgICAgICAg ICAgICAgICAgPGJyPgogICAgICAgICAgICAgICAgICA8L2Jsb2NrcXVvdGU+CiAgICAgICAgICAg ICAgICA8L2Rpdj4KICAgICAgICAgICAgICA8L2Rpdj4KICAgICAgICAgICAgICA8YnI+CiAgICAg ICAgICAgICAgPGZpZWxkc2V0IGNsYXNzPTNEIm1pbWVBdHRhY2htZW50SGVhZGVyIj48L2ZpZWxk c2V0PgogICAgICAgICAgICAgIDxicj4KICAgICAgICAgICAgICA8cHJlIHdyYXA9M0QiIj5fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXz0KX19fClVzZXJzIG1haWxp bmcgbGlzdAo8YSBjbGFzcz0zRCJtb3otdHh0LWxpbmstYWJicmV2aWF0ZWQiIGhyZWY9M0QibWFp bHRvOlVzZXJzQG92aXJ0Lm9yZyIgbW96PQotZG8tbm90LXNlbmQ9M0QidHJ1ZSI+VXNlcnNAb3Zp cnQub3JnPC9hPgo8YSBjbGFzcz0zRCJtb3otdHh0LWxpbmstZnJlZXRleHQiIGhyZWY9M0QiaHR0 cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuPQovbGlzdGluZm8vdXNlcnMiIG1vei1kby1ub3Qt c2VuZD0zRCJ0cnVlIj5odHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vPQpsaXN0aW5mby91 c2VyczwvYT4KPC9wcmU+CiAgICAgICAgICAgIDwvYmxvY2txdW90ZT4KICAgICAgICAgICAgPGJy PgogICAgICAgICAgPC9ibG9ja3F1b3RlPgogICAgICAgIDwvZGl2PgogICAgICA8L2Rpdj4KICAg ICAgPGJyPgogICAgICA8ZmllbGRzZXQgY2xhc3M9M0QibWltZUF0dGFjaG1lbnRIZWFkZXIiPjwv ZmllbGRzZXQ+CiAgICAgIDxicj4KICAgICAgPHByZSB3cmFwPTNEIiI+X19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KVXNlcnMgbWFpbGluZyBsaXN0CjxhIGNs YXNzPTNEIm1vei10eHQtbGluay1hYmJyZXZpYXRlZCIgaHJlZj0zRCJtYWlsdG86VXNlcnNAb3Zp cnQub3JnIj5Vc2U9CnJzQG92aXJ0Lm9yZzwvYT4KPGEgY2xhc3M9M0QibW96LXR4dC1saW5rLWZy ZWV0ZXh0IiBocmVmPTNEImh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbj0KL2xpc3RpbmZv L3VzZXJzIj5odHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E+ CjwvcHJlPgogICAgPC9ibG9ja3F1b3RlPgogICAgPGJyPgogICAgPHByZSBjbGFzcz0zRCJtb3ot c2lnbmF0dXJlIiBjb2xzPTNEIjcyIj4tLT0yMApTVVNFIExpbnV4IEdtYkgsIEdGOiBGZWxpeCBJ bWVuZD1DMz1CNnJmZmVyLCBKYW5lIFNtaXRoYXJkLCBHcmFoYW0gTm9ydG9uPQosIEhSQiAyMTI4 NCAoQUcgTj1DMz1CQ3JuYmVyZyk8L3ByZT4KICA8L2JvZHk+CjwvaHRtbD4KCi0tLS0tLS0tLS0t LS0tMkQ4MUFDMkEzRTM0MjVFMTJGNTk1RDk0LS0KCi0tRXV3aFM2SXZNZ3JpM1V2azBUQmZsY0Ux TmxIcHczUUpVLS0KCi0tTHBpZFA1c0RVd25xWHZLVEJxd21vVjRXTmdWT2MzTFZSCkNvbnRlbnQt VHlwZTogYXBwbGljYXRpb24vcGdwLXNpZ25hdHVyZTsgbmFtZT0ic2lnbmF0dXJlLmFzYyIKQ29u dGVudC1EZXNjcmlwdGlvbjogT3BlblBHUCBkaWdpdGFsIHNpZ25hdHVyZQpDb250ZW50LURpc3Bv c2l0aW9uOiBhdHRhY2htZW50OyBmaWxlbmFtZT0ic2lnbmF0dXJlLmFzYyIKCi0tLS0tQkVHSU4g UEdQIFNJR05BVFVSRS0tLS0tCgppUUVjQkFFQkNBQUdCUUpaL0RHWkFBb0pFQjZNa1ZZVzQ4UnVo OTBIL2kvNnBHNldKdGZSQmx3TTVMYVExQWNLCk92ek9tb0ZhWCtaQmpxMWpVT2pnaHNwVU8wVVVY MUZSNE91U29EWE1JVWsycDdFQWhyVW9CS1N6cFhOancvLzIKZ0NMTU1NR1czaU5BS1hzVnZuSGVO Zm00eFRNZE02dU50R0dTYVM2WjR3OWdidnJYOTlIb1BuUXgzS2RpTDdDbAozdUVqM1lsNXJwNGNs VHk1TVJJRkZOVHdlZWk2S25XeXNzU2tIZ21hSCtvZXFua1RlSWRrdllsZkRWRGtoWGZvCmRsMS9L MEZvUE1sbkVjY0h6aDJtZFhFSXRCRnI1RmhQeFdwRm9iLzZkSU5jaTRkU2lMeTNtUTBoODdhVHk5 K3EKRFVPT000ZWZRMHdXcjUrQU90bW8yZ1ByQlI1eU5ybm0zcU1qamdCOGdLeXRXbXhLVWNGam1O UFhGZDRnZS9vPQo9b0NYVgotLS0tLUVORCBQR1AgU0lHTkFUVVJFLS0tLS0KCi0tTHBpZFA1c0RV d25xWHZLVEJxd21vVjRXTmdWT2MzTFZSLS0K --===============2250784789847186905==-- From msivak at redhat.com Fri Nov 3 09:49:36 2017 Content-Type: multipart/mixed; boundary="===============0699203559285572211==" MIME-Version: 1.0 From: Martin Sivak To: users at ovirt.org Subject: Re: [ovirt-users] Advise needed: building cheap HA oVirt cluster with just 2 physical servers Date: Fri, 03 Nov 2017 10:49:35 +0100 Message-ID: In-Reply-To: CAAq+RfYZT9nYvPh3NttwrRu1JRb+1qhzihGi+WETrO8+vFcEng@mail.gmail.com --===============0699203559285572211== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hi, you should take a look at the hyper converged way of installing oVirt. We have a cockpit wizard that does almost everything for you: https://www.ovirt.org/documentation/gluster-hyperconverged/chap-Deploying_H= yperconverged/ It uses three hosts and collocates the VMs together with Gluster storage. Best regards -- Martin Sivak SLA /oVirt On Fri, Nov 3, 2017 at 8:39 AM, Artem Tambovskiy wrote: > Thanks Eduardo! > > I think I can find a third server to build a glusterFS storage. So the fi= rst > step will be to install a self-hosted engine on the new server and start > building a glusterFS storage. IS there any easy way to migrate existing 5 > VM's running on the second bare-metal oVirt host, right? I found a little > bit tricky moving oVirt backups between the hosts (at least I failed to > replicate the existing VM's on the second server). > > Regards, > Artem > > > > On Fri, Nov 3, 2017 at 10:24 AM, Eduardo Mayoral wr= ote: >> >> For HA you will need some kind of storage available to all the compute >> nodes in the cluster. If you have no external storage and few nodes, I t= hink >> your best option for storage is gluster , and the minimum number of nodes >> you will need for HA is 3 (the third gluster node can be metadata-only, = but >> you still need that third node to give you quorum, avoid split-brains and >> have something that you can call "HA" with a straight face. >> >> Eduardo Mayoral Jimeno (emayoral(a)arsys.es) >> Administrador de sistemas. Departamento de Plataformas. Arsys internet. >> +34 941 620 145 ext. 5153 >> >> On 03/11/17 08:10, Artem Tambovskiy wrote: >> >> Looking for a design advise on oVirt provisioning. I'm running a PoC lab >> on single bare-metal host (suddenly it was setup with just Local Storage >> domain) and >> no I'd like to rebuild the setup by making a cluster of 2 physical >> servers, no external storage array available. That are the options here?= is >> there any options to build cheap HA cluster with just 2 servers? >> >> Thanks in advance! >> >> Artem >> >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> >> > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > --===============0699203559285572211==-- From artem.tambovskiy at gmail.com Fri Nov 3 10:29:57 2017 Content-Type: multipart/mixed; boundary="===============9165061130921690402==" MIME-Version: 1.0 From: Artem Tambovskiy To: users at ovirt.org Subject: Re: [ovirt-users] Advise needed: building cheap HA oVirt cluster with just 2 physical servers Date: Fri, 03 Nov 2017 13:29:34 +0300 Message-ID: In-Reply-To: CAF0zDV5Y+b2sDboeS94n=Rxpa-VE23SJCF0NzCVGTYwfLScVOg@mail.gmail.com --===============9165061130921690402== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Thanks for an article, Martin! Any chance to configure a third cost to act as GlusterFS Arbitr only using this wizard? And stupid question - how to make this wizard up and running? I've everything installed and nothing is runnin on port 9090 :) Regards, Artem On Fri, Nov 3, 2017 at 12:49 PM, Martin Sivak wrote: > Hi, > > you should take a look at the hyper converged way of installing oVirt. > We have a cockpit wizard that does almost everything for you: > > https://www.ovirt.org/documentation/gluster-hyperconverged/chap-Deploying_ > Hyperconverged/ > > It uses three hosts and collocates the VMs together with Gluster storage. > > Best regards > > -- > Martin Sivak > SLA /oVirt > > On Fri, Nov 3, 2017 at 8:39 AM, Artem Tambovskiy > wrote: > > Thanks Eduardo! > > > > I think I can find a third server to build a glusterFS storage. So the > first > > step will be to install a self-hosted engine on the new server and start > > building a glusterFS storage. IS there any easy way to migrate existing= 5 > > VM's running on the second bare-metal oVirt host, right? I found a litt= le > > bit tricky moving oVirt backups between the hosts (at least I failed to > > replicate the existing VM's on the second server). > > > > Regards, > > Artem > > > > > > > > On Fri, Nov 3, 2017 at 10:24 AM, Eduardo Mayoral > wrote: > >> > >> For HA you will need some kind of storage available to all the compute > >> nodes in the cluster. If you have no external storage and few nodes, I > think > >> your best option for storage is gluster , and the minimum number of > nodes > >> you will need for HA is 3 (the third gluster node can be metadata-only, > but > >> you still need that third node to give you quorum, avoid split-brains > and > >> have something that you can call "HA" with a straight face. > >> > >> Eduardo Mayoral Jimeno (emayoral(a)arsys.es) > >> Administrador de sistemas. Departamento de Plataformas. Arsys internet. > >> +34 941 620 145 ext. 5153 > >> > >> On 03/11/17 08:10, Artem Tambovskiy wrote: > >> > >> Looking for a design advise on oVirt provisioning. I'm running a PoC l= ab > >> on single bare-metal host (suddenly it was setup with just Local Stora= ge > >> domain) and > >> no I'd like to rebuild the setup by making a cluster of 2 physical > >> servers, no external storage array available. That are the options > here? is > >> there any options to build cheap HA cluster with just 2 servers? > >> > >> Thanks in advance! > >> > >> Artem > >> > >> > >> _______________________________________________ > >> Users mailing list > >> Users(a)ovirt.org > >> http://lists.ovirt.org/mailman/listinfo/users > >> > >> > > > > > > _______________________________________________ > > Users mailing list > > Users(a)ovirt.org > > http://lists.ovirt.org/mailman/listinfo/users > > > --===============9165061130921690402== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+VGhhbmtzIGZvciBhbiBhcnRpY2xlLCBNYXJ0aW4hPGRpdj5BbnkgY2hh bmNlIHRvIGNvbmZpZ3VyZSBhIHRoaXJkIGNvc3QgdG8gYWN0IGFzIEdsdXN0ZXJGUyBBcmJpdHIg b25seSB1c2luZyB0aGlzIHdpemFyZD/CoDxicj48YnI+QW5kIHN0dXBpZCBxdWVzdGlvbiAtIGhv dyB0byBtYWtlIHRoaXMgd2l6YXJkIHVwIGFuZCBydW5uaW5nPyBJJiMzOTt2ZSBldmVyeXRoaW5n IGluc3RhbGxlZCBhbmQgbm90aGluZyBpcyBydW5uaW4gb24gcG9ydCA5MDkwIDopwqA8YnI+PGJy PjwvZGl2PjxkaXY+UmVnYXJkcyw8L2Rpdj48ZGl2PkFydGVtPC9kaXY+PC9kaXY+PGRpdiBjbGFz cz0iZ21haWxfZXh0cmEiPjxicj48ZGl2IGNsYXNzPSJnbWFpbF9xdW90ZSI+T24gRnJpLCBOb3Yg MywgMjAxNyBhdCAxMjo0OSBQTSwgTWFydGluIFNpdmFrIDxzcGFuIGRpcj0ibHRyIj4mbHQ7PGEg aHJlZj0ibWFpbHRvOm1zaXZha0ByZWRoYXQuY29tIiB0YXJnZXQ9Il9ibGFuayI+bXNpdmFrQHJl ZGhhdC5jb208L2E+Jmd0Ozwvc3Bhbj4gd3JvdGU6PGJyPjxibG9ja3F1b3RlIGNsYXNzPSJnbWFp bF9xdW90ZSIgc3R5bGU9Im1hcmdpbjowIDAgMCAuOGV4O2JvcmRlci1sZWZ0OjFweCAjY2NjIHNv bGlkO3BhZGRpbmctbGVmdDoxZXgiPkhpLDxicj4KPGJyPgp5b3Ugc2hvdWxkIHRha2UgYSBsb29r IGF0IHRoZSBoeXBlciBjb252ZXJnZWQgd2F5IG9mIGluc3RhbGxpbmcgb1ZpcnQuPGJyPgpXZSBo YXZlIGEgY29ja3BpdCB3aXphcmQgdGhhdCBkb2VzIGFsbW9zdCBldmVyeXRoaW5nIGZvciB5b3U6 PGJyPgo8YnI+CjxhIGhyZWY9Imh0dHBzOi8vd3d3Lm92aXJ0Lm9yZy9kb2N1bWVudGF0aW9uL2ds dXN0ZXItaHlwZXJjb252ZXJnZWQvY2hhcC1EZXBsb3lpbmdfSHlwZXJjb252ZXJnZWQvIiByZWw9 Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5odHRwczovL3d3dy5vdmlydC5vcmcvPHdicj5k b2N1bWVudGF0aW9uL2dsdXN0ZXItPHdicj5oeXBlcmNvbnZlcmdlZC9jaGFwLURlcGxveWluZ188 d2JyPkh5cGVyY29udmVyZ2VkLzwvYT48YnI+Cjxicj4KSXQgdXNlcyB0aHJlZSBob3N0cyBhbmQg Y29sbG9jYXRlcyB0aGUgVk1zIHRvZ2V0aGVyIHdpdGggR2x1c3RlciBzdG9yYWdlLjxicj4KPGJy PgpCZXN0IHJlZ2FyZHM8YnI+Cjxicj4KLS08YnI+Ck1hcnRpbiBTaXZhazxicj4KU0xBwqAgL29W aXJ0PGJyPgo8ZGl2IGNsYXNzPSJIT0VuWmIiPjxkaXYgY2xhc3M9Img1Ij48YnI+Ck9uIEZyaSwg Tm92IDMsIDIwMTcgYXQgODozOSBBTSwgQXJ0ZW0gVGFtYm92c2tpeTxicj4KJmx0OzxhIGhyZWY9 Im1haWx0bzphcnRlbS50YW1ib3Zza2l5QGdtYWlsLmNvbSI+YXJ0ZW0udGFtYm92c2tpeUBnbWFp bC5jb208L2E+Jmd0OyB3cm90ZTo8YnI+CiZndDsgVGhhbmtzIEVkdWFyZG8hPGJyPgomZ3Q7PGJy PgomZ3Q7IEkgdGhpbmsgSSBjYW4gZmluZCBhIHRoaXJkIHNlcnZlciB0byBidWlsZCBhIGdsdXN0 ZXJGUyBzdG9yYWdlLiBTbyB0aGUgZmlyc3Q8YnI+CiZndDsgc3RlcCB3aWxsIGJlIHRvIGluc3Rh bGwgYSBzZWxmLWhvc3RlZCBlbmdpbmUgb24gdGhlIG5ldyBzZXJ2ZXIgYW5kIHN0YXJ0PGJyPgom Z3Q7IGJ1aWxkaW5nIGEgZ2x1c3RlckZTIHN0b3JhZ2UuIElTIHRoZXJlIGFueSBlYXN5IHdheSB0 byBtaWdyYXRlIGV4aXN0aW5nIDU8YnI+CiZndDsgVk0mIzM5O3MgcnVubmluZyBvbiB0aGUgc2Vj b25kIGJhcmUtbWV0YWwgb1ZpcnQgaG9zdCwgcmlnaHQ/IEkgZm91bmQgYSBsaXR0bGU8YnI+CiZn dDsgYml0IHRyaWNreSBtb3Zpbmcgb1ZpcnQgYmFja3VwcyBiZXR3ZWVuIHRoZSBob3N0cyAoYXQg bGVhc3QgSSBmYWlsZWQgdG88YnI+CiZndDsgcmVwbGljYXRlIHRoZSBleGlzdGluZyBWTSYjMzk7 cyBvbiB0aGUgc2Vjb25kIHNlcnZlcikuPGJyPgomZ3Q7PGJyPgomZ3Q7IFJlZ2FyZHMsPGJyPgom Z3Q7IEFydGVtPGJyPgomZ3Q7PGJyPgomZ3Q7PGJyPgomZ3Q7PGJyPgomZ3Q7IE9uIEZyaSwgTm92 IDMsIDIwMTcgYXQgMTA6MjQgQU0sIEVkdWFyZG8gTWF5b3JhbCAmbHQ7PGEgaHJlZj0ibWFpbHRv OmVtYXlvcmFsQGFyc3lzLmVzIj5lbWF5b3JhbEBhcnN5cy5lczwvYT4mZ3Q7IHdyb3RlOjxicj4K Jmd0OyZndDs8YnI+CiZndDsmZ3Q7IEZvciBIQSB5b3Ugd2lsbCBuZWVkIHNvbWUga2luZCBvZiBz dG9yYWdlIGF2YWlsYWJsZSB0byBhbGwgdGhlIGNvbXB1dGU8YnI+CiZndDsmZ3Q7IG5vZGVzIGlu IHRoZSBjbHVzdGVyLiBJZiB5b3UgaGF2ZSBubyBleHRlcm5hbCBzdG9yYWdlIGFuZCBmZXcgbm9k ZXMsIEkgdGhpbms8YnI+CiZndDsmZ3Q7IHlvdXIgYmVzdCBvcHRpb24gZm9yIHN0b3JhZ2UgaXMg Z2x1c3RlciAsIGFuZCB0aGUgbWluaW11bSBudW1iZXIgb2Ygbm9kZXM8YnI+CiZndDsmZ3Q7IHlv dSB3aWxsIG5lZWQgZm9yIEhBIGlzIDMgKHRoZSB0aGlyZCBnbHVzdGVyIG5vZGUgY2FuIGJlIG1l dGFkYXRhLW9ubHksIGJ1dDxicj4KJmd0OyZndDsgeW91IHN0aWxsIG5lZWQgdGhhdCB0aGlyZCBu b2RlIHRvIGdpdmUgeW91IHF1b3J1bSwgYXZvaWQgc3BsaXQtYnJhaW5zIGFuZDxicj4KJmd0OyZn dDsgaGF2ZSBzb21ldGhpbmcgdGhhdCB5b3UgY2FuIGNhbGwgJnF1b3Q7SEEmcXVvdDsgd2l0aCBh IHN0cmFpZ2h0IGZhY2UuPGJyPgomZ3Q7Jmd0Ozxicj4KJmd0OyZndDsgRWR1YXJkbyBNYXlvcmFs IEppbWVubyAoPGEgaHJlZj0ibWFpbHRvOmVtYXlvcmFsQGFyc3lzLmVzIj5lbWF5b3JhbEBhcnN5 cy5lczwvYT4pPGJyPgomZ3Q7Jmd0OyBBZG1pbmlzdHJhZG9yIGRlIHNpc3RlbWFzLiBEZXBhcnRh bWVudG8gZGUgUGxhdGFmb3JtYXMuIEFyc3lzIGludGVybmV0Ljxicj4KJmd0OyZndDsgPGEgaHJl Zj0idGVsOiUyQjM0JTIwOTQxJTIwNjIwJTIwMTQ1JTIwZXh0LiUyMDUxNTMiIHZhbHVlPSIrMzQ5 NDE2MjAxNDUiPiszNCA5NDEgNjIwIDE0NSBleHQuIDUxNTM8L2E+PGJyPgomZ3Q7Jmd0Ozxicj4K Jmd0OyZndDsgT24gMDMvMTEvMTcgMDg6MTAsIEFydGVtIFRhbWJvdnNraXkgd3JvdGU6PGJyPgom Z3Q7Jmd0Ozxicj4KJmd0OyZndDsgTG9va2luZyBmb3IgYSBkZXNpZ24gYWR2aXNlIG9uIG9WaXJ0 IHByb3Zpc2lvbmluZy4gSSYjMzk7bSBydW5uaW5nIGEgUG9DIGxhYjxicj4KJmd0OyZndDsgb24g c2luZ2xlIGJhcmUtbWV0YWwgaG9zdCAoc3VkZGVubHkgaXQgd2FzIHNldHVwIHdpdGgganVzdCBM b2NhbCBTdG9yYWdlPGJyPgomZ3Q7Jmd0OyBkb21haW4pIGFuZDxicj4KJmd0OyZndDsgbm8gSSYj Mzk7ZCBsaWtlIHRvIHJlYnVpbGQgdGhlIHNldHVwIGJ5IG1ha2luZyBhIGNsdXN0ZXIgb2YgMiBw aHlzaWNhbDxicj4KJmd0OyZndDsgc2VydmVycywgbm8gZXh0ZXJuYWwgc3RvcmFnZSBhcnJheSBh dmFpbGFibGUuIFRoYXQgYXJlIHRoZSBvcHRpb25zIGhlcmU/IGlzPGJyPgomZ3Q7Jmd0OyB0aGVy ZSBhbnkgb3B0aW9ucyB0byBidWlsZCBjaGVhcCBIQSBjbHVzdGVyIHdpdGgganVzdCAyIHNlcnZl cnM/PGJyPgomZ3Q7Jmd0Ozxicj4KJmd0OyZndDsgVGhhbmtzIGluIGFkdmFuY2UhPGJyPgomZ3Q7 Jmd0Ozxicj4KJmd0OyZndDsgQXJ0ZW08YnI+CiZndDsmZ3Q7PGJyPgomZ3Q7Jmd0Ozxicj4KJmd0 OyZndDsgX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fPHdicj5fX19fX19fX19fX19fX19f Xzxicj4KJmd0OyZndDsgVXNlcnMgbWFpbGluZyBsaXN0PGJyPgomZ3Q7Jmd0OyA8YSBocmVmPSJt YWlsdG86VXNlcnNAb3ZpcnQub3JnIj5Vc2Vyc0BvdmlydC5vcmc8L2E+PGJyPgomZ3Q7Jmd0OyA8 YSBocmVmPSJodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMiIHJl bD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvPHdi cj5tYWlsbWFuL2xpc3RpbmZvL3VzZXJzPC9hPjxicj4KJmd0OyZndDs8YnI+CiZndDsmZ3Q7PGJy PgomZ3Q7PGJyPgomZ3Q7PGJyPgomZ3Q7IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fXzx3 YnI+X19fX19fX19fX19fX19fX188YnI+CiZndDsgVXNlcnMgbWFpbGluZyBsaXN0PGJyPgomZ3Q7 IDxhIGhyZWY9Im1haWx0bzpVc2Vyc0BvdmlydC5vcmciPlVzZXJzQG92aXJ0Lm9yZzwvYT48YnI+ CiZndDsgPGEgaHJlZj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3Vz ZXJzIiByZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5odHRwOi8vbGlzdHMub3ZpcnQu b3JnLzx3YnI+bWFpbG1hbi9saXN0aW5mby91c2VyczwvYT48YnI+CiZndDs8YnI+CjwvZGl2Pjwv ZGl2PjwvYmxvY2txdW90ZT48L2Rpdj48YnI+PC9kaXY+Cg== --===============9165061130921690402==-- From msivak at redhat.com Fri Nov 3 11:28:59 2017 Content-Type: multipart/mixed; boundary="===============6485254351282905210==" MIME-Version: 1.0 From: Martin Sivak To: users at ovirt.org Subject: Re: [ovirt-users] Advise needed: building cheap HA oVirt cluster with just 2 physical servers Date: Fri, 03 Nov 2017 12:28:58 +0100 Message-ID: In-Reply-To: CAAq+RfZw0gBsosEFuZXBjap0K0UQBAsypNk-PnF5VTq0-kaVvQ@mail.gmail.com --===============6485254351282905210== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hi, cockpit is enabled by default when you use ovirt-node. You will probably have to install the necessary cockpit packages yourself on pure CentOS - you will need cockpit and ovirt + gdeploy cockpit plugins (sadly I do not recall the exact package names). With regards to arbiter and the wizard.. I really do not know, but I will alert my colleagues who might have more detailed knowledge of the gluster part. Denis, Sahina: can you please help me here? Best regards Martin Sivak On Fri, Nov 3, 2017 at 11:29 AM, Artem Tambovskiy wrote: > Thanks for an article, Martin! > Any chance to configure a third cost to act as GlusterFS Arbitr only using > this wizard? > > And stupid question - how to make this wizard up and running? I've > everything installed and nothing is runnin on port 9090 :) > > Regards, > Artem > > On Fri, Nov 3, 2017 at 12:49 PM, Martin Sivak wrote: >> >> Hi, >> >> you should take a look at the hyper converged way of installing oVirt. >> We have a cockpit wizard that does almost everything for you: >> >> >> https://www.ovirt.org/documentation/gluster-hyperconverged/chap-Deployin= g_Hyperconverged/ >> >> It uses three hosts and collocates the VMs together with Gluster storage. >> >> Best regards >> >> -- >> Martin Sivak >> SLA /oVirt >> >> On Fri, Nov 3, 2017 at 8:39 AM, Artem Tambovskiy >> wrote: >> > Thanks Eduardo! >> > >> > I think I can find a third server to build a glusterFS storage. So the >> > first >> > step will be to install a self-hosted engine on the new server and sta= rt >> > building a glusterFS storage. IS there any easy way to migrate existing >> > 5 >> > VM's running on the second bare-metal oVirt host, right? I found a >> > little >> > bit tricky moving oVirt backups between the hosts (at least I failed to >> > replicate the existing VM's on the second server). >> > >> > Regards, >> > Artem >> > >> > >> > >> > On Fri, Nov 3, 2017 at 10:24 AM, Eduardo Mayoral >> > wrote: >> >> >> >> For HA you will need some kind of storage available to all the compute >> >> nodes in the cluster. If you have no external storage and few nodes, I >> >> think >> >> your best option for storage is gluster , and the minimum number of >> >> nodes >> >> you will need for HA is 3 (the third gluster node can be metadata-onl= y, >> >> but >> >> you still need that third node to give you quorum, avoid split-brains >> >> and >> >> have something that you can call "HA" with a straight face. >> >> >> >> Eduardo Mayoral Jimeno (emayoral(a)arsys.es) >> >> Administrador de sistemas. Departamento de Plataformas. Arsys interne= t. >> >> +34 941 620 145 ext. 5153 >> >> >> >> On 03/11/17 08:10, Artem Tambovskiy wrote: >> >> >> >> Looking for a design advise on oVirt provisioning. I'm running a PoC >> >> lab >> >> on single bare-metal host (suddenly it was setup with just Local >> >> Storage >> >> domain) and >> >> no I'd like to rebuild the setup by making a cluster of 2 physical >> >> servers, no external storage array available. That are the options >> >> here? is >> >> there any options to build cheap HA cluster with just 2 servers? >> >> >> >> Thanks in advance! >> >> >> >> Artem >> >> >> >> >> >> _______________________________________________ >> >> Users mailing list >> >> Users(a)ovirt.org >> >> http://lists.ovirt.org/mailman/listinfo/users >> >> >> >> >> > >> > >> > _______________________________________________ >> > Users mailing list >> > Users(a)ovirt.org >> > http://lists.ovirt.org/mailman/listinfo/users >> > > > --===============6485254351282905210==-- From artem.tambovskiy at gmail.com Wed Nov 8 09:52:35 2017 Content-Type: multipart/mixed; boundary="===============2129259927907645587==" MIME-Version: 1.0 From: Artem Tambovskiy To: users at ovirt.org Subject: Re: [ovirt-users] Advise needed: building cheap HA oVirt cluster with just 2 physical servers Date: Wed, 08 Nov 2017 12:52:12 +0300 Message-ID: In-Reply-To: CAF0zDV49tNeOd5oUkvA1SLwHCq=yYd9of_h5-kRz_eY_7uWEVw@mail.gmail.com --===============2129259927907645587== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hi, Can anyone share their experience on deploying hosted-engine with GlusterFS cluster? I managed to setup a GlusterFS cluster and started to deploy hosted engine. At first stage I was beaten by firewall rules - the deployment process interrupted at GlusterFS config stage. After fixing the rules I got engine up and running, but the host is non-operational state still. Logged in to Web UI -> and see 2 action points: "Gluster command failed on server" and Gluster status is disconnected for this server" This is a bit strange, since the cluster was properly detected during deployment and deployment script was supposed to configure the cluster. --=3D=3D STORAGE CONFIGURATION =3D=3D-- Please specify the storage you would like to use (glusterfs, iscsi, fc, nfs3, nfs4)[nfs3]: glusterfs [ INFO ] Please note that Replica 3 support is required for the shared storage. Please specify the full shared storage connection path to use (example: host:/path): xxxx.xxxxx.xx:/oVirt [ INFO ] GlusterFS replica 3 Volume detected Do you want to configure this host and its cluster for gluster? (Yes, No) [No]: Yes [ INFO ] GlusterFS replica 3 Volume detected Any ideas how to fix this? Thanks in advance! Regards, Artem On Fri, Nov 3, 2017 at 2:28 PM, Martin Sivak wrote: > Hi, > > cockpit is enabled by default when you use ovirt-node. You will > probably have to install the necessary cockpit packages yourself on > pure CentOS - you will need cockpit and ovirt + gdeploy cockpit > plugins (sadly I do not recall the exact package names). > > With regards to arbiter and the wizard.. I really do not know, but I > will alert my colleagues who might have more detailed knowledge of the > gluster part. > > Denis, Sahina: can you please help me here? > > Best regards > > Martin Sivak > > On Fri, Nov 3, 2017 at 11:29 AM, Artem Tambovskiy > wrote: > > Thanks for an article, Martin! > > Any chance to configure a third cost to act as GlusterFS Arbitr only > using > > this wizard? > > > > And stupid question - how to make this wizard up and running? I've > > everything installed and nothing is runnin on port 9090 :) > > > > Regards, > > Artem > > > > On Fri, Nov 3, 2017 at 12:49 PM, Martin Sivak wro= te: > >> > >> Hi, > >> > >> you should take a look at the hyper converged way of installing oVirt. > >> We have a cockpit wizard that does almost everything for you: > >> > >> > >> https://www.ovirt.org/documentation/gluster- > hyperconverged/chap-Deploying_Hyperconverged/ > >> > >> It uses three hosts and collocates the VMs together with Gluster > storage. > >> > >> Best regards > >> > >> -- > >> Martin Sivak > >> SLA /oVirt > >> > >> On Fri, Nov 3, 2017 at 8:39 AM, Artem Tambovskiy > >> wrote: > >> > Thanks Eduardo! > >> > > >> > I think I can find a third server to build a glusterFS storage. So t= he > >> > first > >> > step will be to install a self-hosted engine on the new server and > start > >> > building a glusterFS storage. IS there any easy way to migrate > existing > >> > 5 > >> > VM's running on the second bare-metal oVirt host, right? I found a > >> > little > >> > bit tricky moving oVirt backups between the hosts (at least I failed > to > >> > replicate the existing VM's on the second server). > >> > > >> > Regards, > >> > Artem > >> > > >> > > >> > > >> > On Fri, Nov 3, 2017 at 10:24 AM, Eduardo Mayoral > >> > wrote: > >> >> > >> >> For HA you will need some kind of storage available to all the > compute > >> >> nodes in the cluster. If you have no external storage and few nodes, > I > >> >> think > >> >> your best option for storage is gluster , and the minimum number of > >> >> nodes > >> >> you will need for HA is 3 (the third gluster node can be > metadata-only, > >> >> but > >> >> you still need that third node to give you quorum, avoid split-brai= ns > >> >> and > >> >> have something that you can call "HA" with a straight face. > >> >> > >> >> Eduardo Mayoral Jimeno (emayoral(a)arsys.es) > >> >> Administrador de sistemas. Departamento de Plataformas. Arsys > internet. > >> >> +34 941 620 145 ext. 5153 > >> >> > >> >> On 03/11/17 08:10, Artem Tambovskiy wrote: > >> >> > >> >> Looking for a design advise on oVirt provisioning. I'm running a PoC > >> >> lab > >> >> on single bare-metal host (suddenly it was setup with just Local > >> >> Storage > >> >> domain) and > >> >> no I'd like to rebuild the setup by making a cluster of 2 physical > >> >> servers, no external storage array available. That are the options > >> >> here? is > >> >> there any options to build cheap HA cluster with just 2 servers? > >> >> > >> >> Thanks in advance! > >> >> > >> >> Artem > >> >> > >> >> > >> >> _______________________________________________ > >> >> Users mailing list > >> >> Users(a)ovirt.org > >> >> http://lists.ovirt.org/mailman/listinfo/users > >> >> > >> >> > >> > > >> > > >> > _______________________________________________ > >> > Users mailing list > >> > Users(a)ovirt.org > >> > http://lists.ovirt.org/mailman/listinfo/users > >> > > > > > > --===============2129259927907645587== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+SGksPGRpdj48YnI+PC9kaXY+PGRpdj5DYW4gYW55b25lIHNoYXJlIHRo ZWlyIGV4cGVyaWVuY2Ugb24gZGVwbG95aW5nIGhvc3RlZC1lbmdpbmUgd2l0aCBHbHVzdGVyRlMg Y2x1c3Rlcj/CoDwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+SSBtYW5hZ2VkIHRvIHNldHVwIGEg R2x1c3RlckZTIGNsdXN0ZXIgYW5kIHN0YXJ0ZWQgdG8gZGVwbG95IGhvc3RlZCBlbmdpbmUuIEF0 IGZpcnN0IHN0YWdlIEkgd2FzIGJlYXRlbiBieSBmaXJld2FsbCBydWxlcyAtIHRoZSBkZXBsb3lt ZW50IHByb2Nlc3MgaW50ZXJydXB0ZWQgYXQgR2x1c3RlckZTIGNvbmZpZyBzdGFnZS7CoDwvZGl2 PjxkaXY+QWZ0ZXIgZml4aW5nIHRoZSBydWxlcyBJIGdvdCBlbmdpbmUgdXAgYW5kIHJ1bm5pbmcs IGJ1dCB0aGUgaG9zdCBpcyBub24tb3BlcmF0aW9uYWwgc3RhdGUgc3RpbGwuIExvZ2dlZCBpbiB0 byBXZWIgVUkgLSZndDsgYW5kIHNlZSAyIGFjdGlvbiBwb2ludHM6ICZxdW90O0dsdXN0ZXIgY29t bWFuZCBmYWlsZWQgb24gc2VydmVyJnF1b3Q7IGFuZCBHbHVzdGVyIHN0YXR1cyBpcyBkaXNjb25u ZWN0ZWQgZm9yIHRoaXMgc2VydmVyJnF1b3Q7PC9kaXY+PGRpdj48YnI+VGhpcyBpcyBhIGJpdCBz dHJhbmdlLCBzaW5jZSB0aGUgY2x1c3RlciB3YXMgcHJvcGVybHkgZGV0ZWN0ZWQgZHVyaW5nIGRl cGxveW1lbnQgYW5kIGRlcGxveW1lbnQgc2NyaXB0IHdhcyBzdXBwb3NlZCB0byBjb25maWd1cmUg dGhlIGNsdXN0ZXIuPGJyPjxicj48L2Rpdj48ZGl2PjxkaXY+wqAgwqAgwqAgwqAgwqAgLS09PSBT VE9SQUdFIENPTkZJR1VSQVRJT04gPT0tLTwvZGl2PjxkaXY+wqAgwqAgwqAgwqAgwqA8L2Rpdj48 ZGl2PsKgIMKgIMKgIMKgIMKgIFBsZWFzZSBzcGVjaWZ5IHRoZSBzdG9yYWdlIHlvdSB3b3VsZCBs aWtlIHRvIHVzZSAoZ2x1c3RlcmZzLCBpc2NzaSwgZmMsIG5mczMsIG5mczQpW25mczNdOiBnbHVz dGVyZnM8L2Rpdj48ZGl2PlsgSU5GTyDCoF0gUGxlYXNlIG5vdGUgdGhhdCBSZXBsaWNhIDMgc3Vw cG9ydCBpcyByZXF1aXJlZCBmb3IgdGhlIHNoYXJlZCBzdG9yYWdlLjwvZGl2PjxkaXY+wqAgwqAg wqAgwqAgwqAgUGxlYXNlIHNwZWNpZnkgdGhlIGZ1bGwgc2hhcmVkIHN0b3JhZ2UgY29ubmVjdGlv biBwYXRoIHRvIHVzZSAoZXhhbXBsZTogaG9zdDovcGF0aCk6IHh4eHgueHh4eHgueHg6L29WaXJ0 PC9kaXY+PGRpdj5bIElORk8gwqBdIEdsdXN0ZXJGUyByZXBsaWNhIDMgVm9sdW1lIGRldGVjdGVk PC9kaXY+PGRpdj7CoCDCoCDCoCDCoCDCoCBEbyB5b3Ugd2FudCB0byBjb25maWd1cmUgdGhpcyBo b3N0IGFuZCBpdHMgY2x1c3RlciBmb3IgZ2x1c3Rlcj8gKFllcywgTm8pIFtOb106IFllczwvZGl2 PjxkaXY+WyBJTkZPIMKgXSBHbHVzdGVyRlMgcmVwbGljYSAzIFZvbHVtZSBkZXRlY3RlZDxicj48 YnI+QW55IGlkZWFzIGhvdyB0byBmaXggdGhpcz/CoDwvZGl2PjwvZGl2PjxkaXY+PGJyPjwvZGl2 PjxkaXY+VGhhbmtzIGluIGFkdmFuY2UhPC9kaXY+PGRpdj5SZWdhcmRzLDxicj5BcnRlbTwvZGl2 PjxkaXY+PGJyPjwvZGl2PjwvZGl2PjxkaXYgY2xhc3M9ImdtYWlsX2V4dHJhIj48YnI+PGRpdiBj bGFzcz0iZ21haWxfcXVvdGUiPk9uIEZyaSwgTm92IDMsIDIwMTcgYXQgMjoyOCBQTSwgTWFydGlu IFNpdmFrIDxzcGFuIGRpcj0ibHRyIj4mbHQ7PGEgaHJlZj0ibWFpbHRvOm1zaXZha0ByZWRoYXQu Y29tIiB0YXJnZXQ9Il9ibGFuayI+bXNpdmFrQHJlZGhhdC5jb208L2E+Jmd0Ozwvc3Bhbj4gd3Jv dGU6PGJyPjxibG9ja3F1b3RlIGNsYXNzPSJnbWFpbF9xdW90ZSIgc3R5bGU9Im1hcmdpbjowIDAg MCAuOGV4O2JvcmRlci1sZWZ0OjFweCAjY2NjIHNvbGlkO3BhZGRpbmctbGVmdDoxZXgiPkhpLDxi cj4KPGJyPgpjb2NrcGl0IGlzIGVuYWJsZWQgYnkgZGVmYXVsdCB3aGVuIHlvdSB1c2Ugb3ZpcnQt bm9kZS4gWW91IHdpbGw8YnI+CnByb2JhYmx5IGhhdmUgdG8gaW5zdGFsbCB0aGUgbmVjZXNzYXJ5 IGNvY2twaXQgcGFja2FnZXMgeW91cnNlbGYgb248YnI+CnB1cmUgQ2VudE9TIC0geW91IHdpbGwg bmVlZCBjb2NrcGl0IGFuZCBvdmlydCArIGdkZXBsb3kgY29ja3BpdDxicj4KcGx1Z2lucyAoc2Fk bHkgSSBkbyBub3QgcmVjYWxsIHRoZSBleGFjdCBwYWNrYWdlIG5hbWVzKS48YnI+Cjxicj4KV2l0 aCByZWdhcmRzIHRvIGFyYml0ZXIgYW5kIHRoZSB3aXphcmQuLiBJIHJlYWxseSBkbyBub3Qga25v dywgYnV0IEk8YnI+CndpbGwgYWxlcnQgbXkgY29sbGVhZ3VlcyB3aG8gbWlnaHQgaGF2ZSBtb3Jl IGRldGFpbGVkIGtub3dsZWRnZSBvZiB0aGU8YnI+CmdsdXN0ZXIgcGFydC48YnI+Cjxicj4KRGVu aXMsIFNhaGluYTogY2FuIHlvdSBwbGVhc2UgaGVscCBtZSBoZXJlPzxicj4KPGJyPgpCZXN0IHJl Z2FyZHM8YnI+Cjxicj4KTWFydGluIFNpdmFrPGJyPgo8YnI+Ck9uIEZyaSwgTm92IDMsIDIwMTcg YXQgMTE6MjkgQU0sIEFydGVtIFRhbWJvdnNraXk8YnI+CjxkaXYgY2xhc3M9IkhPRW5aYiI+PGRp diBjbGFzcz0iaDUiPiZsdDs8YSBocmVmPSJtYWlsdG86YXJ0ZW0udGFtYm92c2tpeUBnbWFpbC5j b20iPmFydGVtLnRhbWJvdnNraXlAZ21haWwuY29tPC9hPiZndDsgd3JvdGU6PGJyPgomZ3Q7IFRo YW5rcyBmb3IgYW4gYXJ0aWNsZSwgTWFydGluITxicj4KJmd0OyBBbnkgY2hhbmNlIHRvIGNvbmZp Z3VyZSBhIHRoaXJkIGNvc3QgdG8gYWN0IGFzIEdsdXN0ZXJGUyBBcmJpdHIgb25seSB1c2luZzxi cj4KJmd0OyB0aGlzIHdpemFyZD88YnI+CiZndDs8YnI+CiZndDsgQW5kIHN0dXBpZCBxdWVzdGlv biAtIGhvdyB0byBtYWtlIHRoaXMgd2l6YXJkIHVwIGFuZCBydW5uaW5nPyBJJiMzOTt2ZTxicj4K Jmd0OyBldmVyeXRoaW5nIGluc3RhbGxlZCBhbmQgbm90aGluZyBpcyBydW5uaW4gb24gcG9ydCA5 MDkwIDopPGJyPgomZ3Q7PGJyPgomZ3Q7IFJlZ2FyZHMsPGJyPgomZ3Q7IEFydGVtPGJyPgomZ3Q7 PGJyPgomZ3Q7IE9uIEZyaSwgTm92IDMsIDIwMTcgYXQgMTI6NDkgUE0sIE1hcnRpbiBTaXZhayAm bHQ7PGEgaHJlZj0ibWFpbHRvOm1zaXZha0ByZWRoYXQuY29tIj5tc2l2YWtAcmVkaGF0LmNvbTwv YT4mZ3Q7IHdyb3RlOjxicj4KJmd0OyZndDs8YnI+CiZndDsmZ3Q7IEhpLDxicj4KJmd0OyZndDs8 YnI+CiZndDsmZ3Q7IHlvdSBzaG91bGQgdGFrZSBhIGxvb2sgYXQgdGhlIGh5cGVyIGNvbnZlcmdl ZCB3YXkgb2YgaW5zdGFsbGluZyBvVmlydC48YnI+CiZndDsmZ3Q7IFdlIGhhdmUgYSBjb2NrcGl0 IHdpemFyZCB0aGF0IGRvZXMgYWxtb3N0IGV2ZXJ5dGhpbmcgZm9yIHlvdTo8YnI+CiZndDsmZ3Q7 PGJyPgomZ3Q7Jmd0Ozxicj4KJmd0OyZndDsgPGEgaHJlZj0iaHR0cHM6Ly93d3cub3ZpcnQub3Jn L2RvY3VtZW50YXRpb24vZ2x1c3Rlci1oeXBlcmNvbnZlcmdlZC9jaGFwLURlcGxveWluZ19IeXBl cmNvbnZlcmdlZC8iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8vd3d3 Lm92aXJ0Lm9yZy88d2JyPmRvY3VtZW50YXRpb24vZ2x1c3Rlci08d2JyPmh5cGVyY29udmVyZ2Vk L2NoYXAtRGVwbG95aW5nXzx3YnI+SHlwZXJjb252ZXJnZWQvPC9hPjxicj4KJmd0OyZndDs8YnI+ CiZndDsmZ3Q7IEl0IHVzZXMgdGhyZWUgaG9zdHMgYW5kIGNvbGxvY2F0ZXMgdGhlIFZNcyB0b2dl dGhlciB3aXRoIEdsdXN0ZXIgc3RvcmFnZS48YnI+CiZndDsmZ3Q7PGJyPgomZ3Q7Jmd0OyBCZXN0 IHJlZ2FyZHM8YnI+CiZndDsmZ3Q7PGJyPgomZ3Q7Jmd0OyAtLTxicj4KJmd0OyZndDsgTWFydGlu IFNpdmFrPGJyPgomZ3Q7Jmd0OyBTTEHCoCAvb1ZpcnQ8YnI+CiZndDsmZ3Q7PGJyPgomZ3Q7Jmd0 OyBPbiBGcmksIE5vdiAzLCAyMDE3IGF0IDg6MzkgQU0sIEFydGVtIFRhbWJvdnNraXk8YnI+CiZn dDsmZ3Q7ICZsdDs8YSBocmVmPSJtYWlsdG86YXJ0ZW0udGFtYm92c2tpeUBnbWFpbC5jb20iPmFy dGVtLnRhbWJvdnNraXlAZ21haWwuY29tPC9hPiZndDsgd3JvdGU6PGJyPgomZ3Q7Jmd0OyAmZ3Q7 IFRoYW5rcyBFZHVhcmRvITxicj4KJmd0OyZndDsgJmd0Ozxicj4KJmd0OyZndDsgJmd0OyBJIHRo aW5rIEkgY2FuIGZpbmQgYSB0aGlyZCBzZXJ2ZXIgdG8gYnVpbGQgYSBnbHVzdGVyRlMgc3RvcmFn ZS4gU28gdGhlPGJyPgomZ3Q7Jmd0OyAmZ3Q7IGZpcnN0PGJyPgomZ3Q7Jmd0OyAmZ3Q7IHN0ZXAg d2lsbCBiZSB0byBpbnN0YWxsIGEgc2VsZi1ob3N0ZWQgZW5naW5lIG9uIHRoZSBuZXcgc2VydmVy IGFuZCBzdGFydDxicj4KJmd0OyZndDsgJmd0OyBidWlsZGluZyBhIGdsdXN0ZXJGUyBzdG9yYWdl LiBJUyB0aGVyZSBhbnkgZWFzeSB3YXkgdG8gbWlncmF0ZSBleGlzdGluZzxicj4KJmd0OyZndDsg Jmd0OyA1PGJyPgomZ3Q7Jmd0OyAmZ3Q7IFZNJiMzOTtzIHJ1bm5pbmcgb24gdGhlIHNlY29uZCBi YXJlLW1ldGFsIG9WaXJ0IGhvc3QsIHJpZ2h0PyBJIGZvdW5kIGE8YnI+CiZndDsmZ3Q7ICZndDsg bGl0dGxlPGJyPgomZ3Q7Jmd0OyAmZ3Q7IGJpdCB0cmlja3kgbW92aW5nIG9WaXJ0IGJhY2t1cHMg YmV0d2VlbiB0aGUgaG9zdHMgKGF0IGxlYXN0IEkgZmFpbGVkIHRvPGJyPgomZ3Q7Jmd0OyAmZ3Q7 IHJlcGxpY2F0ZSB0aGUgZXhpc3RpbmcgVk0mIzM5O3Mgb24gdGhlIHNlY29uZCBzZXJ2ZXIpLjxi cj4KJmd0OyZndDsgJmd0Ozxicj4KJmd0OyZndDsgJmd0OyBSZWdhcmRzLDxicj4KJmd0OyZndDsg Jmd0OyBBcnRlbTxicj4KJmd0OyZndDsgJmd0Ozxicj4KJmd0OyZndDsgJmd0Ozxicj4KJmd0OyZn dDsgJmd0Ozxicj4KJmd0OyZndDsgJmd0OyBPbiBGcmksIE5vdiAzLCAyMDE3IGF0IDEwOjI0IEFN LCBFZHVhcmRvIE1heW9yYWwgJmx0OzxhIGhyZWY9Im1haWx0bzplbWF5b3JhbEBhcnN5cy5lcyI+ ZW1heW9yYWxAYXJzeXMuZXM8L2E+Jmd0Ozxicj4KJmd0OyZndDsgJmd0OyB3cm90ZTo8YnI+CiZn dDsmZ3Q7ICZndDsmZ3Q7PGJyPgomZ3Q7Jmd0OyAmZ3Q7Jmd0OyBGb3IgSEEgeW91IHdpbGwgbmVl ZCBzb21lIGtpbmQgb2Ygc3RvcmFnZSBhdmFpbGFibGUgdG8gYWxsIHRoZSBjb21wdXRlPGJyPgom Z3Q7Jmd0OyAmZ3Q7Jmd0OyBub2RlcyBpbiB0aGUgY2x1c3Rlci4gSWYgeW91IGhhdmUgbm8gZXh0 ZXJuYWwgc3RvcmFnZSBhbmQgZmV3IG5vZGVzLCBJPGJyPgomZ3Q7Jmd0OyAmZ3Q7Jmd0OyB0aGlu azxicj4KJmd0OyZndDsgJmd0OyZndDsgeW91ciBiZXN0IG9wdGlvbiBmb3Igc3RvcmFnZSBpcyBn bHVzdGVyICwgYW5kIHRoZSBtaW5pbXVtIG51bWJlciBvZjxicj4KJmd0OyZndDsgJmd0OyZndDsg bm9kZXM8YnI+CiZndDsmZ3Q7ICZndDsmZ3Q7IHlvdSB3aWxsIG5lZWQgZm9yIEhBIGlzIDMgKHRo ZSB0aGlyZCBnbHVzdGVyIG5vZGUgY2FuIGJlIG1ldGFkYXRhLW9ubHksPGJyPgomZ3Q7Jmd0OyAm Z3Q7Jmd0OyBidXQ8YnI+CiZndDsmZ3Q7ICZndDsmZ3Q7IHlvdSBzdGlsbCBuZWVkIHRoYXQgdGhp cmQgbm9kZSB0byBnaXZlIHlvdSBxdW9ydW0sIGF2b2lkIHNwbGl0LWJyYWluczxicj4KJmd0OyZn dDsgJmd0OyZndDsgYW5kPGJyPgomZ3Q7Jmd0OyAmZ3Q7Jmd0OyBoYXZlIHNvbWV0aGluZyB0aGF0 IHlvdSBjYW4gY2FsbCAmcXVvdDtIQSZxdW90OyB3aXRoIGEgc3RyYWlnaHQgZmFjZS48YnI+CiZn dDsmZ3Q7ICZndDsmZ3Q7PGJyPgomZ3Q7Jmd0OyAmZ3Q7Jmd0OyBFZHVhcmRvIE1heW9yYWwgSmlt ZW5vICg8YSBocmVmPSJtYWlsdG86ZW1heW9yYWxAYXJzeXMuZXMiPmVtYXlvcmFsQGFyc3lzLmVz PC9hPik8YnI+CiZndDsmZ3Q7ICZndDsmZ3Q7IEFkbWluaXN0cmFkb3IgZGUgc2lzdGVtYXMuIERl cGFydGFtZW50byBkZSBQbGF0YWZvcm1hcy4gQXJzeXMgaW50ZXJuZXQuPGJyPgomZ3Q7Jmd0OyAm Z3Q7Jmd0OyA8YSBocmVmPSJ0ZWw6JTJCMzQlMjA5NDElMjA2MjAlMjAxNDUlMjBleHQuJTIwNTE1 MyIgdmFsdWU9IiszNDk0MTYyMDE0NSI+KzM0IDk0MSA2MjAgMTQ1IGV4dC4gNTE1MzwvYT48YnI+ CiZndDsmZ3Q7ICZndDsmZ3Q7PGJyPgomZ3Q7Jmd0OyAmZ3Q7Jmd0OyBPbiAwMy8xMS8xNyAwODox MCwgQXJ0ZW0gVGFtYm92c2tpeSB3cm90ZTo8YnI+CiZndDsmZ3Q7ICZndDsmZ3Q7PGJyPgomZ3Q7 Jmd0OyAmZ3Q7Jmd0OyBMb29raW5nIGZvciBhIGRlc2lnbiBhZHZpc2Ugb24gb1ZpcnQgcHJvdmlz aW9uaW5nLiBJJiMzOTttIHJ1bm5pbmcgYSBQb0M8YnI+CiZndDsmZ3Q7ICZndDsmZ3Q7IGxhYjxi cj4KJmd0OyZndDsgJmd0OyZndDsgb24gc2luZ2xlIGJhcmUtbWV0YWwgaG9zdCAoc3VkZGVubHkg aXQgd2FzIHNldHVwIHdpdGgganVzdCBMb2NhbDxicj4KJmd0OyZndDsgJmd0OyZndDsgU3RvcmFn ZTxicj4KJmd0OyZndDsgJmd0OyZndDsgZG9tYWluKSBhbmQ8YnI+CiZndDsmZ3Q7ICZndDsmZ3Q7 IG5vIEkmIzM5O2QgbGlrZSB0byByZWJ1aWxkIHRoZSBzZXR1cCBieSBtYWtpbmcgYSBjbHVzdGVy IG9mIDIgcGh5c2ljYWw8YnI+CiZndDsmZ3Q7ICZndDsmZ3Q7IHNlcnZlcnMsIG5vIGV4dGVybmFs IHN0b3JhZ2UgYXJyYXkgYXZhaWxhYmxlLiBUaGF0IGFyZSB0aGUgb3B0aW9uczxicj4KJmd0OyZn dDsgJmd0OyZndDsgaGVyZT8gaXM8YnI+CiZndDsmZ3Q7ICZndDsmZ3Q7IHRoZXJlIGFueSBvcHRp b25zIHRvIGJ1aWxkIGNoZWFwIEhBIGNsdXN0ZXIgd2l0aCBqdXN0IDIgc2VydmVycz88YnI+CiZn dDsmZ3Q7ICZndDsmZ3Q7PGJyPgomZ3Q7Jmd0OyAmZ3Q7Jmd0OyBUaGFua3MgaW4gYWR2YW5jZSE8 YnI+CiZndDsmZ3Q7ICZndDsmZ3Q7PGJyPgomZ3Q7Jmd0OyAmZ3Q7Jmd0OyBBcnRlbTxicj4KJmd0 OyZndDsgJmd0OyZndDs8YnI+CiZndDsmZ3Q7ICZndDsmZ3Q7PGJyPgomZ3Q7Jmd0OyAmZ3Q7Jmd0 OyBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX188d2JyPl9fX19fX19fX19fX19fX19fPGJy PgomZ3Q7Jmd0OyAmZ3Q7Jmd0OyBVc2VycyBtYWlsaW5nIGxpc3Q8YnI+CiZndDsmZ3Q7ICZndDsm Z3Q7IDxhIGhyZWY9Im1haWx0bzpVc2Vyc0BvdmlydC5vcmciPlVzZXJzQG92aXJ0Lm9yZzwvYT48 YnI+CiZndDsmZ3Q7ICZndDsmZ3Q7IDxhIGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFp bG1hbi9saXN0aW5mby91c2VycyIgcmVsPSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0 cDovL2xpc3RzLm92aXJ0Lm9yZy88d2JyPm1haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E+PGJyPgom Z3Q7Jmd0OyAmZ3Q7Jmd0Ozxicj4KJmd0OyZndDsgJmd0OyZndDs8YnI+CiZndDsmZ3Q7ICZndDs8 YnI+CiZndDsmZ3Q7ICZndDs8YnI+CiZndDsmZ3Q7ICZndDsgX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fPHdicj5fX19fX19fX19fX19fX19fXzxicj4KJmd0OyZndDsgJmd0OyBVc2VycyBt YWlsaW5nIGxpc3Q8YnI+CiZndDsmZ3Q7ICZndDsgPGEgaHJlZj0ibWFpbHRvOlVzZXJzQG92aXJ0 Lm9yZyI+VXNlcnNAb3ZpcnQub3JnPC9hPjxicj4KJmd0OyZndDsgJmd0OyA8YSBocmVmPSJodHRw Oi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMiIHJlbD0ibm9yZWZlcnJl ciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvPHdicj5tYWlsbWFuL2xp c3RpbmZvL3VzZXJzPC9hPjxicj4KJmd0OyZndDsgJmd0Ozxicj4KJmd0Ozxicj4KJmd0Ozxicj4K PC9kaXY+PC9kaXY+PC9ibG9ja3F1b3RlPjwvZGl2Pjxicj48L2Rpdj4K --===============2129259927907645587==--