From Pax at acronis.com Fri Mar 4 01:46:26 2016 Content-Type: multipart/mixed; boundary="===============8136630449778524425==" MIME-Version: 1.0 From: Pavel Gashev To: users at ovirt.org Subject: Re: [ovirt-users] Multi-node cluster with local storage Date: Fri, 04 Mar 2016 06:46:23 +0000 Message-ID: <2e54f1f3-0c00-4db3-ab56-21ff68a2ffee@acronis.com> In-Reply-To: 2EBB29CB9A8F494FB5253F6AF2E6A1981D5C8CA9@hoshi.uni.lux --===============8136630449778524425== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable --_000_2e54f1f30c004db3ab5621ff68a2ffeeacroniscom_ Content-Type: text/plain; charset=3D"us-ascii" Content-Transfer-Encoding: quoted-printable Christophe, Where is the engine running? Did you use one of NFSs for hosted-engine? Thank you From: Christophe TREFOIS Sent: Mar 4, 2016 2:09 AM To: Pavel Gashev; users(a)ovirt.org Subject: RE: Multi-node cluster with local storage Hi, We have all nodes like you (5 currently), and have them setup as NFS instea= =3D d of local storage. You have slight overhead because it's NFS, but not so much, and it allows y= =3D ou to migrate VMs and disks, even if it's a manual disk, eg no HA will be p= =3D ossible. So yeah, to me, it's a good option given your setup. Best, > -----Original Message----- > From: users-bounces(a)ovirt.org [mailto:users-bounces(a)ovirt.org] On Beh= alf > Of Pavel Gashev > Sent: jeudi 3 mars 2016 21:44 > To: users(a)ovirt.org > Subject: [ovirt-users] Multi-node cluster with local storage > > Hello, > > I'd like to ask community, what is the best way to use oVirt in the follo= =3D wing > hardware configuration: > > Three servers connected 1GB network. Each server - 32 threads, 256GB RAM, > 4TB RAID. > > Please note that a local storage and an 1GB network is a typical hardware > configuration for almost any dedicated hosting. > > Unfortunately, oVirt doesn't support multi-node local storage clusters. > And Gluster/CEPH doesn't work well over 1G network. It looks like that th= =3D e > only way to use oVirt in a three-node cluster is to share local storages = =3D over > NFS. At least it makes possible to migrate VMs and move disks among > hardware nodes. > > Does somebody have such setup? > > Thanks > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --_000_2e54f1f30c004db3ab5621ff68a2ffeeacroniscom_ Content-Type: text/html; charset=3D"us-ascii" Content-Transfer-Encoding: quoted-printable

Christophe,

Where is the engine running? Did you use one of NFSs for h= os=3D ted-engine?

Thank you

F= ro=3D m: Christophe TREFOIS <christophe.trefois(a)uni.lu>
Sent: Mar 4, 2016 2:09 AM
To: Pavel Gashev; users(a)ovirt.org
Subject: RE: Multi-node cluster with local storage

Hi,

We have all nodes like you (5 currently), and have them setup as NFS instea= =3D d of local storage.

You have slight overhead because it's NFS, but not so much, and it allows y= =3D ou to migrate VMs and disks, even if it's a manual disk, eg no HA will be p= =3D ossible.

So yeah, to me, it's a good option given your setup.

Best,

> -----Original Message-----
> From: users-bounces(a)ovirt.org [mailto:users-bounces(a)ovirt.org] On Behalf
> Of Pavel Gashev
> Sent: jeudi 3 mars 2016 21:44
> To: users(a)ovirt.org
> Subject: [ovirt-users] Multi-node cluster with local storage
>
> Hello,
>
> I'd like to ask community, what is the best way to use oVirt in the fo= =3D llowing
> hardware configuration:
>
> Three servers connected 1GB network. Each server - 32 threads, 256GB R= =3D AM,
> 4TB RAID.
>
> Please note that a local storage and an 1GB network is a typical hardw= =3D are
> configuration for almost any dedicated hosting.
>
> Unfortunately, oVirt doesn't support multi-node local storage clusters= =3D .
> And Gluster/CEPH doesn't work well over 1G network. It looks like that= =3D the
> only way to use oVirt in a three-node cluster is to share local storag= =3D es over
> NFS. At least it makes possible to migrate VMs and move disks among > hardware nodes.
>
> Does somebody have such setup?
>
> Thanks
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lis= ts=3D .ovirt.org/mailman/listinfo/users

--_000_2e54f1f30c004db3ab5621ff68a2ffeeacroniscom_-- --===============8136630449778524425== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS1fMDAwXzJlNTRmMWYzMGMwMDRkYjNhYjU2MjFmZjY4YTJmZmVlYWNyb25pc2NvbV8KQ29udGVu dC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFyc2V0PSJ1cy1hc2NpaSIKQ29udGVudC1UcmFuc2Zlci1F bmNvZGluZzogcXVvdGVkLXByaW50YWJsZQoKQ2hyaXN0b3BoZSwKCldoZXJlIGlzIHRoZSBlbmdp bmUgcnVubmluZz8gRGlkIHlvdSB1c2Ugb25lIG9mIE5GU3MgZm9yIGhvc3RlZC1lbmdpbmU/CgpU aGFuayB5b3UKCgpGcm9tOiBDaHJpc3RvcGhlIFRSRUZPSVMgPGNocmlzdG9waGUudHJlZm9pc0B1 bmkubHU+ClNlbnQ6IE1hciA0LCAyMDE2IDI6MDkgQU0KVG86IFBhdmVsIEdhc2hldjsgdXNlcnNA b3ZpcnQub3JnClN1YmplY3Q6IFJFOiBNdWx0aS1ub2RlIGNsdXN0ZXIgd2l0aCBsb2NhbCBzdG9y YWdlCgpIaSwKCldlIGhhdmUgYWxsIG5vZGVzIGxpa2UgeW91ICg1IGN1cnJlbnRseSksIGFuZCBo YXZlIHRoZW0gc2V0dXAgYXMgTkZTIGluc3RlYT0KZCBvZiBsb2NhbCBzdG9yYWdlLgoKWW91IGhh dmUgc2xpZ2h0IG92ZXJoZWFkIGJlY2F1c2UgaXQncyBORlMsIGJ1dCBub3Qgc28gbXVjaCwgYW5k IGl0IGFsbG93cyB5PQpvdSB0byBtaWdyYXRlIFZNcyBhbmQgZGlza3MsIGV2ZW4gaWYgaXQncyBh IG1hbnVhbCBkaXNrLCBlZyBubyBIQSB3aWxsIGJlIHA9Cm9zc2libGUuCgpTbyB5ZWFoLCB0byBt ZSwgaXQncyBhIGdvb2Qgb3B0aW9uIGdpdmVuIHlvdXIgc2V0dXAuCgpCZXN0LAoKPiAtLS0tLU9y aWdpbmFsIE1lc3NhZ2UtLS0tLQo+IEZyb206IHVzZXJzLWJvdW5jZXNAb3ZpcnQub3JnIFttYWls dG86dXNlcnMtYm91bmNlc0BvdmlydC5vcmddIE9uIEJlaGFsZgo+IE9mIFBhdmVsIEdhc2hldgo+ IFNlbnQ6IGpldWRpIDMgbWFycyAyMDE2IDIxOjQ0Cj4gVG86IHVzZXJzQG92aXJ0Lm9yZwo+IFN1 YmplY3Q6IFtvdmlydC11c2Vyc10gTXVsdGktbm9kZSBjbHVzdGVyIHdpdGggbG9jYWwgc3RvcmFn ZQo+Cj4gSGVsbG8sCj4KPiBJJ2QgbGlrZSB0byBhc2sgY29tbXVuaXR5LCB3aGF0IGlzIHRoZSBi ZXN0IHdheSB0byB1c2Ugb1ZpcnQgaW4gdGhlIGZvbGxvPQp3aW5nCj4gaGFyZHdhcmUgY29uZmln dXJhdGlvbjoKPgo+IFRocmVlIHNlcnZlcnMgY29ubmVjdGVkIDFHQiBuZXR3b3JrLiBFYWNoIHNl cnZlciAtIDMyIHRocmVhZHMsIDI1NkdCIFJBTSwKPiA0VEIgUkFJRC4KPgo+IFBsZWFzZSBub3Rl IHRoYXQgYSBsb2NhbCBzdG9yYWdlIGFuZCBhbiAxR0IgbmV0d29yayBpcyBhIHR5cGljYWwgaGFy ZHdhcmUKPiBjb25maWd1cmF0aW9uIGZvciBhbG1vc3QgYW55IGRlZGljYXRlZCBob3N0aW5nLgo+ Cj4gVW5mb3J0dW5hdGVseSwgb1ZpcnQgZG9lc24ndCBzdXBwb3J0IG11bHRpLW5vZGUgbG9jYWwg c3RvcmFnZSBjbHVzdGVycy4KPiBBbmQgR2x1c3Rlci9DRVBIIGRvZXNuJ3Qgd29yayB3ZWxsIG92 ZXIgMUcgbmV0d29yay4gSXQgbG9va3MgbGlrZSB0aGF0IHRoPQplCj4gb25seSB3YXkgdG8gdXNl IG9WaXJ0IGluIGEgdGhyZWUtbm9kZSBjbHVzdGVyIGlzIHRvIHNoYXJlIGxvY2FsIHN0b3JhZ2Vz ID0Kb3Zlcgo+IE5GUy4gQXQgbGVhc3QgaXQgbWFrZXMgcG9zc2libGUgdG8gbWlncmF0ZSBWTXMg YW5kIG1vdmUgZGlza3MgYW1vbmcKPiBoYXJkd2FyZSBub2Rlcy4KPgo+IERvZXMgc29tZWJvZHkg aGF2ZSBzdWNoIHNldHVwPwo+Cj4gVGhhbmtzCj4gX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX18KPiBVc2VycyBtYWlsaW5nIGxpc3QKPiBVc2Vyc0BvdmlydC5v cmcKPiBodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMKCi0tXzAw MF8yZTU0ZjFmMzBjMDA0ZGIzYWI1NjIxZmY2OGEyZmZlZWFjcm9uaXNjb21fCkNvbnRlbnQtVHlw ZTogdGV4dC9odG1sOyBjaGFyc2V0PSJ1cy1hc2NpaSIKQ29udGVudC1UcmFuc2Zlci1FbmNvZGlu ZzogcXVvdGVkLXByaW50YWJsZQoKPGh0bWw+CjxoZWFkPgo8bWV0YSBodHRwLWVxdWl2PTNEIkNv bnRlbnQtVHlwZSIgY29udGVudD0zRCJ0ZXh0L2h0bWw7IGNoYXJzZXQ9M0R1cy1hc2NpaSI9Cj4K PG1ldGEgbmFtZT0zRCJHZW5lcmF0b3IiIGNvbnRlbnQ9M0QiTWljcm9zb2Z0IEV4Y2hhbmdlIFNl cnZlciI+CjwhLS0gY29udmVydGVkIGZyb20gdGV4dCAtLT48c3R5bGU+PCEtLSAuRW1haWxRdW90 ZSB7IG1hcmdpbi1sZWZ0OiAxcHQ7IHBhZD0KZGluZy1sZWZ0OiA0cHQ7IGJvcmRlci1sZWZ0OiAj ODAwMDAwIDJweCBzb2xpZDsgfSAtLT48L3N0eWxlPgo8L2hlYWQ+Cjxib2R5Pgo8c3R5bGUgdHlw ZT0zRCJ0ZXh0L2NzcyI+CjwhLS0KLS0+Cjwvc3R5bGU+CjxkaXY+CjxkaXYgc3R5bGU9M0QiZm9u dC1mYW1pbHk6Q2FsaWJyaSxBcmlhbCxIZWx2ZXRpY2Esc2Fucy1zZXJpZjsgZm9udC1zaXplOjEy Lj0KMHB0OyBjb2xvcjojMUY0OTdEIj4KPHAgZGlyPTNEImx0ciI+Q2hyaXN0b3BoZSw8L3A+Cjxw IGRpcj0zRCJsdHIiPldoZXJlIGlzIHRoZSBlbmdpbmUgcnVubmluZz8gRGlkIHlvdSB1c2Ugb25l IG9mIE5GU3MgZm9yIGhvcz0KdGVkLWVuZ2luZT88L3A+CjxwIGRpcj0zRCJsdHIiPlRoYW5rIHlv dTwvcD4KPGRpdiBpZD0zRCJ4X3NpZ25hdHVyZS14IiBzdHlsZT0zRCJmb250LWZhbWlseTpDYWxp YnJpLEFyaWFsLEhlbHZldGljYSxzYW5zPQotc2VyaWY7IGZvbnQtc2l6ZToxMi4wcHQ7IGNvbG9y OiMxRjQ5N0QiPgo8YnI+CjwvZGl2Pgo8L2Rpdj4KPGRpdiBpZD0zRCJ4X3F1b3RlZF9oZWFkZXIi IHN0eWxlPTNEImNsZWFyOmJvdGgiPjxicj4KPGRpdiBzdHlsZT0zRCJib3JkZXI6bm9uZTsgYm9y ZGVyLXRvcDpzb2xpZCAjRTFFMUUxIDEuMHB0OyBwYWRkaW5nOjMuMHB0IDBjPQptIDBjbSAwY20i Pgo8c3BhbiBzdHlsZT0zRCJmb250LXNpemU6MTEuMHB0OyBmb250LWZhbWlseTonQ2FsaWJyaScs J3NhbnMtc2VyaWYnIj48Yj5Gcm89Cm06PC9iPiBDaHJpc3RvcGhlIFRSRUZPSVMgJmx0O2Nocmlz dG9waGUudHJlZm9pc0B1bmkubHUmZ3Q7PGJyPgo8Yj5TZW50OjwvYj4gTWFyIDQsIDIwMTYgMjow OSBBTTxicj4KPGI+VG86PC9iPiBQYXZlbCBHYXNoZXY7IHVzZXJzQG92aXJ0Lm9yZzxicj4KPGI+ U3ViamVjdDo8L2I+IFJFOiBNdWx0aS1ub2RlIGNsdXN0ZXIgd2l0aCBsb2NhbCBzdG9yYWdlPGJy Pgo8L3NwYW4+PC9kaXY+CjwvZGl2Pgo8YnIgdHlwZT0zRCJhdHRyaWJ1dGlvbiI+CjwvZGl2Pgo8 Zm9udCBzaXplPTNEIjIiPjxzcGFuIHN0eWxlPTNEImZvbnQtc2l6ZToxMHB0OyI+CjxkaXYgY2xh c3M9M0QiUGxhaW5UZXh0Ij5IaSw8YnI+Cjxicj4KV2UgaGF2ZSBhbGwgbm9kZXMgbGlrZSB5b3Ug KDUgY3VycmVudGx5KSwgYW5kIGhhdmUgdGhlbSBzZXR1cCBhcyBORlMgaW5zdGVhPQpkIG9mIGxv Y2FsIHN0b3JhZ2UuPGJyPgo8YnI+CllvdSBoYXZlIHNsaWdodCBvdmVyaGVhZCBiZWNhdXNlIGl0 J3MgTkZTLCBidXQgbm90IHNvIG11Y2gsIGFuZCBpdCBhbGxvd3MgeT0Kb3UgdG8gbWlncmF0ZSBW TXMgYW5kIGRpc2tzLCBldmVuIGlmIGl0J3MgYSBtYW51YWwgZGlzaywgZWcgbm8gSEEgd2lsbCBi ZSBwPQpvc3NpYmxlLjxicj4KPGJyPgpTbyB5ZWFoLCB0byBtZSwgaXQncyBhIGdvb2Qgb3B0aW9u IGdpdmVuIHlvdXIgc2V0dXAuPGJyPgo8YnI+CkJlc3QsPGJyPgo8YnI+CiZndDsgLS0tLS1Pcmln aW5hbCBNZXNzYWdlLS0tLS08YnI+CiZndDsgRnJvbTogdXNlcnMtYm91bmNlc0BvdmlydC5vcmcg WzxhIGhyZWY9M0QibWFpbHRvOnVzZXJzLWJvdW5jZXNAb3ZpcnQubz0KcmciPm1haWx0bzp1c2Vy cy1ib3VuY2VzQG92aXJ0Lm9yZzwvYT5dIE9uIEJlaGFsZjxicj4KJmd0OyBPZiBQYXZlbCBHYXNo ZXY8YnI+CiZndDsgU2VudDogamV1ZGkgMyBtYXJzIDIwMTYgMjE6NDQ8YnI+CiZndDsgVG86IHVz ZXJzQG92aXJ0Lm9yZzxicj4KJmd0OyBTdWJqZWN0OiBbb3ZpcnQtdXNlcnNdIE11bHRpLW5vZGUg Y2x1c3RlciB3aXRoIGxvY2FsIHN0b3JhZ2U8YnI+CiZndDsgPGJyPgomZ3Q7IEhlbGxvLDxicj4K Jmd0OyA8YnI+CiZndDsgSSdkIGxpa2UgdG8gYXNrIGNvbW11bml0eSwgd2hhdCBpcyB0aGUgYmVz dCB3YXkgdG8gdXNlIG9WaXJ0IGluIHRoZSBmbz0KbGxvd2luZzxicj4KJmd0OyBoYXJkd2FyZSBj b25maWd1cmF0aW9uOjxicj4KJmd0OyA8YnI+CiZndDsgVGhyZWUgc2VydmVycyBjb25uZWN0ZWQg MUdCIG5ldHdvcmsuIEVhY2ggc2VydmVyIC0gMzIgdGhyZWFkcywgMjU2R0IgUj0KQU0sPGJyPgom Z3Q7IDRUQiBSQUlELjxicj4KJmd0OyA8YnI+CiZndDsgUGxlYXNlIG5vdGUgdGhhdCBhIGxvY2Fs IHN0b3JhZ2UgYW5kIGFuIDFHQiBuZXR3b3JrIGlzIGEgdHlwaWNhbCBoYXJkdz0KYXJlPGJyPgom Z3Q7IGNvbmZpZ3VyYXRpb24gZm9yIGFsbW9zdCBhbnkgZGVkaWNhdGVkIGhvc3RpbmcuPGJyPgom Z3Q7IDxicj4KJmd0OyBVbmZvcnR1bmF0ZWx5LCBvVmlydCBkb2Vzbid0IHN1cHBvcnQgbXVsdGkt bm9kZSBsb2NhbCBzdG9yYWdlIGNsdXN0ZXJzPQouPGJyPgomZ3Q7IEFuZCBHbHVzdGVyL0NFUEgg ZG9lc24ndCB3b3JrIHdlbGwgb3ZlciAxRyBuZXR3b3JrLiBJdCBsb29rcyBsaWtlIHRoYXQ9CiB0 aGU8YnI+CiZndDsgb25seSB3YXkgdG8gdXNlIG9WaXJ0IGluIGEgdGhyZWUtbm9kZSBjbHVzdGVy IGlzIHRvIHNoYXJlIGxvY2FsIHN0b3JhZz0KZXMgb3Zlcjxicj4KJmd0OyBORlMuIEF0IGxlYXN0 IGl0IG1ha2VzIHBvc3NpYmxlIHRvIG1pZ3JhdGUgVk1zIGFuZCBtb3ZlIGRpc2tzIGFtb25nPGJy PQo+CiZndDsgaGFyZHdhcmUgbm9kZXMuPGJyPgomZ3Q7IDxicj4KJmd0OyBEb2VzIHNvbWVib2R5 IGhhdmUgc3VjaCBzZXR1cD88YnI+CiZndDsgPGJyPgomZ3Q7IFRoYW5rczxicj4KJmd0OyBfX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXzxicj4KJmd0OyBVc2Vy cyBtYWlsaW5nIGxpc3Q8YnI+CiZndDsgVXNlcnNAb3ZpcnQub3JnPGJyPgomZ3Q7IDxhIGhyZWY9 M0QiaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIj5odHRwOi8v bGlzdHM9Ci5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VyczwvYT48YnI+CjwvZGl2Pgo8 L3NwYW4+PC9mb250Pgo8L2JvZHk+CjwvaHRtbD4KCi0tXzAwMF8yZTU0ZjFmMzBjMDA0ZGIzYWI1 NjIxZmY2OGEyZmZlZWFjcm9uaXNjb21fLS0K --===============8136630449778524425==--