From Sven.Achtelik at eps.aero Mon Apr 24 11:33:43 2017 Content-Type: multipart/mixed; boundary="===============0113887551171180600==" MIME-Version: 1.0 From: Sven Achtelik To: users at ovirt.org Subject: [ovirt-users] Hyperconverged Setup and Gluster healing Date: Mon, 24 Apr 2017 06:33:39 -0500 Message-ID: --===============0113887551171180600== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable --_000_BFAB40933B3367488CE6299BAF8592D1014E52CC4354SOCRATESasl_ Content-Type: text/plain; charset=3D"us-ascii" Content-Transfer-Encoding: quoted-printable Hi All, my oVirt-Setup is 3 Hosts with gluster and reaplica 3. I always try to stay= =3D on the current version and I'm applying updates/upgrade if there are any. = =3D For this I put a host in maintenance and also use the "Stop Gluster Service= =3D " checkbox. After it's done updating I'll set it back to active and wait u= =3D ntil the engine sees all bricks again and then I'll go for the next host. This worked fine for me the last month and now that I have more and more VM= =3D s running the changes that are written to the gluster volume while a host i= =3D s in maintenance become a lot more and it takes pretty long for the healing= =3D to complete. What I don't understand is that I don't really see a lot of n= =3D etwork usage in the GUI during that time and it feels quiet slow. The Netwo= =3D rk for the gluster is a 10G and I'm quiet happy with the performance of it,= =3D it's just the healing that takes long. I noticed that because I couldn't u= =3D pdate the third host because of unsynced gluster volumes. Is there any limiting variable that slows down traffic during healing that = =3D needs to be configured ? Or should I maybe change my updating process someh= =3D ow to avoid having so many changes in queue? Thank you, Sven --_000_BFAB40933B3367488CE6299BAF8592D1014E52CC4354SOCRATESasl_ Content-Type: text/html; charset=3D"us-ascii" Content-Transfer-Encoding: quoted-printable

Hi Al= l,

=3D my oVirt-Setup is 3 Hosts with gluster and reaplica 3.= I=3D always try to stay on the current version and I’m applying updates/u= =3D pgrade if there are any. For this I put a host in maintenance and also use = =3D the “Stop Gluster Service” checkbox. After it’s don= =3D e updating I’ll set it back to active and wait until the engine sees = =3D all bricks again and then I’ll go for the next host.

<= /p><=3D p class=3D3DMsoNormal>This worked fine for me the last= mon=3D th and now that I have more and more VMs running the changes that are writt= =3D en to the gluster volume while a host is in maintenance become a lot more a= =3D nd it takes pretty long for the healing to complete. What I don’t und= =3D erstand is that I don’t really see a lot of network usage in the GUI = =3D during that time and it feels quiet slow. The Network for the gluster is a = =3D 10G and I’m quiet happy with the performance of it, it’s just t= =3D he healing that takes long. I noticed that because I couldn’t update = =3D the third host because of unsynced gluster volumes.

Is there any limiting variable that slo= ws d=3D own traffic during healing that needs to be configured ? Or should I maybe = =3D change my updating process somehow to avoid having so many changes in queue= =3D ?

&n= bsp;=3D

Thank you,

Sven<= /p><=3D p class=3D3DMsoNormal>

=3D --_000_BFAB40933B3367488CE6299BAF8592D1014E52CC4354SOCRATESasl_-- --===============0113887551171180600== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS1fMDAwX0JGQUI0MDkzM0IzMzY3NDg4Q0U2Mjk5QkFGODU5MkQxMDE0RTUyQ0M0MzU0U09DUkFU RVNhc2xfCkNvbnRlbnQtVHlwZTogdGV4dC9wbGFpbjsgY2hhcnNldD0idXMtYXNjaWkiCkNvbnRl bnQtVHJhbnNmZXItRW5jb2Rpbmc6IHF1b3RlZC1wcmludGFibGUKCkhpIEFsbCwKCm15IG9WaXJ0 LVNldHVwIGlzIDMgSG9zdHMgd2l0aCBnbHVzdGVyIGFuZCByZWFwbGljYSAzLiBJIGFsd2F5cyB0 cnkgdG8gc3RheT0KIG9uIHRoZSBjdXJyZW50IHZlcnNpb24gYW5kIEknbSBhcHBseWluZyB1cGRh dGVzL3VwZ3JhZGUgaWYgdGhlcmUgYXJlIGFueS4gPQpGb3IgdGhpcyBJIHB1dCBhIGhvc3QgaW4g bWFpbnRlbmFuY2UgYW5kIGFsc28gdXNlIHRoZSAiU3RvcCBHbHVzdGVyIFNlcnZpY2U9CiIgIGNo ZWNrYm94LiBBZnRlciBpdCdzIGRvbmUgdXBkYXRpbmcgSSdsbCBzZXQgaXQgYmFjayB0byBhY3Rp dmUgYW5kIHdhaXQgdT0KbnRpbCB0aGUgZW5naW5lIHNlZXMgYWxsIGJyaWNrcyBhZ2FpbiBhbmQg dGhlbiBJJ2xsIGdvIGZvciB0aGUgbmV4dCBob3N0LgoKVGhpcyB3b3JrZWQgZmluZSBmb3IgbWUg dGhlIGxhc3QgbW9udGggYW5kIG5vdyB0aGF0IEkgaGF2ZSBtb3JlIGFuZCBtb3JlIFZNPQpzIHJ1 bm5pbmcgdGhlIGNoYW5nZXMgdGhhdCBhcmUgd3JpdHRlbiB0byB0aGUgZ2x1c3RlciB2b2x1bWUg d2hpbGUgYSBob3N0IGk9CnMgaW4gbWFpbnRlbmFuY2UgYmVjb21lIGEgbG90IG1vcmUgYW5kIGl0 IHRha2VzIHByZXR0eSBsb25nIGZvciB0aGUgaGVhbGluZz0KIHRvIGNvbXBsZXRlLiBXaGF0IEkg ZG9uJ3QgdW5kZXJzdGFuZCBpcyB0aGF0IEkgZG9uJ3QgcmVhbGx5IHNlZSBhIGxvdCBvZiBuPQpl dHdvcmsgdXNhZ2UgaW4gdGhlIEdVSSBkdXJpbmcgdGhhdCB0aW1lIGFuZCBpdCBmZWVscyBxdWll dCBzbG93LiBUaGUgTmV0d289CnJrIGZvciB0aGUgZ2x1c3RlciBpcyBhIDEwRyBhbmQgSSdtIHF1 aWV0IGhhcHB5IHdpdGggdGhlIHBlcmZvcm1hbmNlIG9mIGl0LD0KIGl0J3MganVzdCB0aGUgaGVh bGluZyB0aGF0IHRha2VzIGxvbmcuIEkgbm90aWNlZCB0aGF0IGJlY2F1c2UgSSBjb3VsZG4ndCB1 PQpwZGF0ZSB0aGUgdGhpcmQgaG9zdCBiZWNhdXNlIG9mIHVuc3luY2VkIGdsdXN0ZXIgdm9sdW1l cy4KCklzIHRoZXJlIGFueSBsaW1pdGluZyB2YXJpYWJsZSB0aGF0IHNsb3dzIGRvd24gdHJhZmZp YyBkdXJpbmcgaGVhbGluZyB0aGF0ID0KbmVlZHMgdG8gYmUgY29uZmlndXJlZCA/IE9yIHNob3Vs ZCBJIG1heWJlIGNoYW5nZSBteSB1cGRhdGluZyBwcm9jZXNzIHNvbWVoPQpvdyB0byBhdm9pZCBo YXZpbmcgc28gbWFueSBjaGFuZ2VzIGluIHF1ZXVlPwoKVGhhbmsgeW91LAoKU3ZlbgoKCi0tXzAw MF9CRkFCNDA5MzNCMzM2NzQ4OENFNjI5OUJBRjg1OTJEMTAxNEU1MkNDNDM1NFNPQ1JBVEVTYXNs XwpDb250ZW50LVR5cGU6IHRleHQvaHRtbDsgY2hhcnNldD0idXMtYXNjaWkiCkNvbnRlbnQtVHJh bnNmZXItRW5jb2Rpbmc6IHF1b3RlZC1wcmludGFibGUKCjxodG1sIHhtbG5zOnY9M0QidXJuOnNj aGVtYXMtbWljcm9zb2Z0LWNvbTp2bWwiIHhtbG5zOm89M0QidXJuOnNjaGVtYXMtbWljcj0Kb3Nv ZnQtY29tOm9mZmljZTpvZmZpY2UiIHhtbG5zOnc9M0QidXJuOnNjaGVtYXMtbWljcm9zb2Z0LWNv bTpvZmZpY2U6d29yZCIgPQp4bWxuczptPTNEImh0dHA6Ly9zY2hlbWFzLm1pY3Jvc29mdC5jb20v b2ZmaWNlLzIwMDQvMTIvb21tbCIgeG1sbnM9M0QiaHR0cDo9Ci8vd3d3LnczLm9yZy9UUi9SRUMt aHRtbDQwIj48aGVhZD48TUVUQSBIVFRQLUVRVUlWPTNEIkNvbnRlbnQtVHlwZSIgQ09OVEVOVD0K PTNEInRleHQvaHRtbDsgY2hhcnNldD0zRHVzLWFzY2lpIj48bWV0YSBuYW1lPTNER2VuZXJhdG9y IGNvbnRlbnQ9M0QiTWljcm9zPQpvZnQgV29yZCAxNSAoZmlsdGVyZWQgbWVkaXVtKSI+PHN0eWxl PjwhLS0KLyogRm9udCBEZWZpbml0aW9ucyAqLwpAZm9udC1mYWNlCgl7Zm9udC1mYW1pbHk6IkNh bWJyaWEgTWF0aCI7CglwYW5vc2UtMToyIDQgNSAzIDUgNCA2IDMgMiA0O30KQGZvbnQtZmFjZQoJ e2ZvbnQtZmFtaWx5OkNhbGlicmk7CglwYW5vc2UtMToyIDE1IDUgMiAyIDIgNCAzIDIgNDt9Ci8q IFN0eWxlIERlZmluaXRpb25zICovCnAuTXNvTm9ybWFsLCBsaS5Nc29Ob3JtYWwsIGRpdi5Nc29O b3JtYWwKCXttYXJnaW46MGNtOwoJbWFyZ2luLWJvdHRvbTouMDAwMXB0OwoJZm9udC1zaXplOjEx LjBwdDsKCWZvbnQtZmFtaWx5OiJDYWxpYnJpIixzYW5zLXNlcmlmOwoJbXNvLWZhcmVhc3QtbGFu Z3VhZ2U6RU4tVVM7fQphOmxpbmssIHNwYW4uTXNvSHlwZXJsaW5rCgl7bXNvLXN0eWxlLXByaW9y aXR5Ojk5OwoJY29sb3I6IzA1NjNDMTsKCXRleHQtZGVjb3JhdGlvbjp1bmRlcmxpbmU7fQphOnZp c2l0ZWQsIHNwYW4uTXNvSHlwZXJsaW5rRm9sbG93ZWQKCXttc28tc3R5bGUtcHJpb3JpdHk6OTk7 Cgljb2xvcjojOTU0RjcyOwoJdGV4dC1kZWNvcmF0aW9uOnVuZGVybGluZTt9CnNwYW4uRS1NYWls Rm9ybWF0dm9ybGFnZTE3Cgl7bXNvLXN0eWxlLXR5cGU6cGVyc29uYWwtY29tcG9zZTsKCWZvbnQt ZmFtaWx5OiJDYWxpYnJpIixzYW5zLXNlcmlmOwoJY29sb3I6d2luZG93dGV4dDt9Ci5Nc29DaHBE ZWZhdWx0Cgl7bXNvLXN0eWxlLXR5cGU6ZXhwb3J0LW9ubHk7Cglmb250LWZhbWlseToiQ2FsaWJy aSIsc2Fucy1zZXJpZjsKCW1zby1mYXJlYXN0LWxhbmd1YWdlOkVOLVVTO30KQHBhZ2UgV29yZFNl Y3Rpb24xCgl7c2l6ZTo2MTIuMHB0IDc5Mi4wcHQ7CgltYXJnaW46NzAuODVwdCA3MC44NXB0IDIu MGNtIDcwLjg1cHQ7fQpkaXYuV29yZFNlY3Rpb24xCgl7cGFnZTpXb3JkU2VjdGlvbjE7fQotLT48 L3N0eWxlPjwhLS1baWYgZ3RlIG1zbyA5XT48eG1sPgo8bzpzaGFwZWRlZmF1bHRzIHY6ZXh0PTNE ImVkaXQiIHNwaWRtYXg9M0QiMTAyNiIgLz4KPC94bWw+PCFbZW5kaWZdLS0+PCEtLVtpZiBndGUg bXNvIDldPjx4bWw+CjxvOnNoYXBlbGF5b3V0IHY6ZXh0PTNEImVkaXQiPgo8bzppZG1hcCB2OmV4 dD0zRCJlZGl0IiBkYXRhPTNEIjEiIC8+CjwvbzpzaGFwZWxheW91dD48L3htbD48IVtlbmRpZl0t LT48L2hlYWQ+PGJvZHkgbGFuZz0zRERFIGxpbms9M0QiIzA1NjNDMSIgdj0KbGluaz0zRCIjOTU0 RjcyIj48ZGl2IGNsYXNzPTNEV29yZFNlY3Rpb24xPjxwIGNsYXNzPTNETXNvTm9ybWFsPkhpIEFs bCwgPG86PQpwPjwvbzpwPjwvcD48cCBjbGFzcz0zRE1zb05vcm1hbD48bzpwPiZuYnNwOzwvbzpw PjwvcD48cCBjbGFzcz0zRE1zb05vcm1hbD49CjxzcGFuIGxhbmc9M0RFTi1VUz5teSBvVmlydC1T ZXR1cCBpcyAzIEhvc3RzIHdpdGggZ2x1c3RlciBhbmQgcmVhcGxpY2EgMy4gST0KIGFsd2F5cyB0 cnkgdG8gc3RheSBvbiB0aGUgY3VycmVudCB2ZXJzaW9uIGFuZCBJJiM4MjE3O20gYXBwbHlpbmcg dXBkYXRlcy91PQpwZ3JhZGUgaWYgdGhlcmUgYXJlIGFueS4gRm9yIHRoaXMgSSBwdXQgYSBob3N0 IGluIG1haW50ZW5hbmNlIGFuZCBhbHNvIHVzZSA9CnRoZSAmIzgyMjA7U3RvcCBHbHVzdGVyIFNl cnZpY2UmIzgyMjE7ICZuYnNwO2NoZWNrYm94LiBBZnRlciBpdCYjODIxNztzIGRvbj0KZSB1cGRh dGluZyBJJiM4MjE3O2xsIHNldCBpdCBiYWNrIHRvIGFjdGl2ZSBhbmQgd2FpdCB1bnRpbCB0aGUg ZW5naW5lIHNlZXMgPQphbGwgYnJpY2tzIGFnYWluIGFuZCB0aGVuIEkmIzgyMTc7bGwgZ28gZm9y IHRoZSBuZXh0IGhvc3QuIDxvOnA+PC9vOnA+PC9zcGE9Cm4+PC9wPjxwIGNsYXNzPTNETXNvTm9y bWFsPjxzcGFuIGxhbmc9M0RFTi1VUz48bzpwPiZuYnNwOzwvbzpwPjwvc3Bhbj48L3A+PD0KcCBj bGFzcz0zRE1zb05vcm1hbD48c3BhbiBsYW5nPTNERU4tVVM+VGhpcyB3b3JrZWQgZmluZSBmb3Ig bWUgdGhlIGxhc3QgbW9uPQp0aCBhbmQgbm93IHRoYXQgSSBoYXZlIG1vcmUgYW5kIG1vcmUgVk1z IHJ1bm5pbmcgdGhlIGNoYW5nZXMgdGhhdCBhcmUgd3JpdHQ9CmVuIHRvIHRoZSBnbHVzdGVyIHZv bHVtZSB3aGlsZSBhIGhvc3QgaXMgaW4gbWFpbnRlbmFuY2UgYmVjb21lIGEgbG90IG1vcmUgYT0K bmQgaXQgdGFrZXMgcHJldHR5IGxvbmcgZm9yIHRoZSBoZWFsaW5nIHRvIGNvbXBsZXRlLiBXaGF0 IEkgZG9uJiM4MjE3O3QgdW5kPQplcnN0YW5kIGlzIHRoYXQgSSBkb24mIzgyMTc7dCByZWFsbHkg c2VlIGEgbG90IG9mIG5ldHdvcmsgdXNhZ2UgaW4gdGhlIEdVSSA9CmR1cmluZyB0aGF0IHRpbWUg YW5kIGl0IGZlZWxzIHF1aWV0IHNsb3cuIFRoZSBOZXR3b3JrIGZvciB0aGUgZ2x1c3RlciBpcyBh ID0KMTBHIGFuZCBJJiM4MjE3O20gcXVpZXQgaGFwcHkgd2l0aCB0aGUgcGVyZm9ybWFuY2Ugb2Yg aXQsIGl0JiM4MjE3O3MganVzdCB0PQpoZSBoZWFsaW5nIHRoYXQgdGFrZXMgbG9uZy4gSSBub3Rp Y2VkIHRoYXQgYmVjYXVzZSBJIGNvdWxkbiYjODIxNzt0IHVwZGF0ZSA9CnRoZSB0aGlyZCBob3N0 IGJlY2F1c2Ugb2YgdW5zeW5jZWQgZ2x1c3RlciB2b2x1bWVzLjxvOnA+PC9vOnA+PC9zcGFuPjwv cD48cD0KIGNsYXNzPTNETXNvTm9ybWFsPjxzcGFuIGxhbmc9M0RFTi1VUz48bzpwPiZuYnNwOzwv bzpwPjwvc3Bhbj48L3A+PHAgY2xhc3M9Cj0zRE1zb05vcm1hbD48c3BhbiBsYW5nPTNERU4tVVM+ SXMgdGhlcmUgYW55IGxpbWl0aW5nIHZhcmlhYmxlIHRoYXQgc2xvd3MgZD0Kb3duIHRyYWZmaWMg ZHVyaW5nIGhlYWxpbmcgdGhhdCBuZWVkcyB0byBiZSBjb25maWd1cmVkID8gT3Igc2hvdWxkIEkg bWF5YmUgPQpjaGFuZ2UgbXkgdXBkYXRpbmcgcHJvY2VzcyBzb21laG93IHRvIGF2b2lkIGhhdmlu ZyBzbyBtYW55IGNoYW5nZXMgaW4gcXVldWU9Cj8gPG86cD48L286cD48L3NwYW4+PC9wPjxwIGNs YXNzPTNETXNvTm9ybWFsPjxzcGFuIGxhbmc9M0RFTi1VUz48bzpwPiZuYnNwOz0KPC9vOnA+PC9z cGFuPjwvcD48cCBjbGFzcz0zRE1zb05vcm1hbD48c3BhbiBsYW5nPTNERU4tVVM+VGhhbmsgeW91 LCA8bzpwPjwvPQpvOnA+PC9zcGFuPjwvcD48cCBjbGFzcz0zRE1zb05vcm1hbD48c3BhbiBsYW5n PTNERU4tVVM+PG86cD4mbmJzcDs8L286cD48L3M9CnBhbj48L3A+PHAgY2xhc3M9M0RNc29Ob3Jt YWw+PHNwYW4gbGFuZz0zREVOLVVTPlN2ZW48bzpwPjwvbzpwPjwvc3Bhbj48L3A+PD0KcCBjbGFz cz0zRE1zb05vcm1hbD48bzpwPiZuYnNwOzwvbzpwPjwvcD48L2Rpdj48L2JvZHk+PC9odG1sPj0K Ci0tXzAwMF9CRkFCNDA5MzNCMzM2NzQ4OENFNjI5OUJBRjg1OTJEMTAxNEU1MkNDNDM1NFNPQ1JB VEVTYXNsXy0tCg== --===============0113887551171180600==--