From tdemeter at itsmart.hu Thu Jan 22 09:33:12 2015 Content-Type: multipart/mixed; boundary="===============9022811447994201615==" MIME-Version: 1.0 From: Demeter Tibor To: users at ovirt.org Subject: [ovirt-users] Upgrade to 3.5.1 Date: Thu, 22 Jan 2015 15:33:06 +0100 Message-ID: <1128794209.21055346.1421937186813.JavaMail.zimbra@itsmart.hu> In-Reply-To: 1611737188.20908485.1421936305294.JavaMail.zimbra@itsmart.hu --===============9022811447994201615== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable ------=3D_Part_21055345_782166728.1421937186811 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 7bit Hello, = I have an ovirt 3.5.0 cluster with three nodes and we using glusterfs for s= erving backend storage for VM-s. Glusterfs are on same servers with ovirt. = We have Gluster 3.5.1 on all of nodes. = How can I upgrade to ovirt 3.5.1 with new glusterfs? I don't want data inco= nsistency/data loss/split brains? = Need I update gluster version to the latest? = How I need to upgrade the nodes ? Is there any whitepaper about this? = Thanks in advance, = Tibor = ------=3D_Part_21055345_782166728.1421937186811 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable
Hello,

I have an ovirt 3.5.0 cluster with = =3D three nodes and we using glusterfs for serving backend storage for VM-s. Gl= =3D usterfs are on same servers with ovirt.
We have Gluster 3.5.1 on = =3D all of nodes.

How can I upgrade to ovirt 3.5.1 wit= =3D h new glusterfs? I don't want data inconsistency/data loss/split brains?

Need I update gluster version to the latest?
How I need to upgrade the nodes ?  Is there any whitepaper about th= =3D is?



Thanks in advance,


Tibor

------=3D_Part_21055345_782166728.1421937186811-- --===============9022811447994201615== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS0tLS0tPV9QYXJ0XzIxMDU1MzQ1Xzc4MjE2NjcyOC4xNDIxOTM3MTg2ODExCkNvbnRlbnQtVHlw ZTogdGV4dC9wbGFpbjsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA3 Yml0CgpIZWxsbywgCgpJIGhhdmUgYW4gb3ZpcnQgMy41LjAgY2x1c3RlciB3aXRoIHRocmVlIG5v ZGVzIGFuZCB3ZSB1c2luZyBnbHVzdGVyZnMgZm9yIHNlcnZpbmcgYmFja2VuZCBzdG9yYWdlIGZv ciBWTS1zLiBHbHVzdGVyZnMgYXJlIG9uIHNhbWUgc2VydmVycyB3aXRoIG92aXJ0LiAKV2UgaGF2 ZSBHbHVzdGVyIDMuNS4xIG9uIGFsbCBvZiBub2Rlcy4gCgpIb3cgY2FuIEkgdXBncmFkZSB0byBv dmlydCAzLjUuMSB3aXRoIG5ldyBnbHVzdGVyZnM/IEkgZG9uJ3Qgd2FudCBkYXRhIGluY29uc2lz dGVuY3kvZGF0YSBsb3NzL3NwbGl0IGJyYWlucz8gCgpOZWVkIEkgdXBkYXRlIGdsdXN0ZXIgdmVy c2lvbiB0byB0aGUgbGF0ZXN0PyAKSG93IEkgbmVlZCB0byB1cGdyYWRlIHRoZSBub2RlcyA/IElz IHRoZXJlIGFueSB3aGl0ZXBhcGVyIGFib3V0IHRoaXM/IAoKCgoKCgoKClRoYW5rcyBpbiBhZHZh bmNlLCAKCgoKClRpYm9yIAoKLS0tLS0tPV9QYXJ0XzIxMDU1MzQ1Xzc4MjE2NjcyOC4xNDIxOTM3 MTg2ODExCkNvbnRlbnQtVHlwZTogdGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04CkNvbnRlbnQtVHJh bnNmZXItRW5jb2Rpbmc6IHF1b3RlZC1wcmludGFibGUKCjxodG1sPjxib2R5PjxkaXYgc3R5bGU9 M0QiZm9udC1mYW1pbHk6IHRpbWVzIG5ldyByb21hbiwgbmV3IHlvcmssIHRpbWVzLCBzZT0Kcmlm OyBmb250LXNpemU6IDEycHQ7IGNvbG9yOiAjMDAwMDAwIj48ZGl2PjxzcGFuIHN0eWxlPTNEImZv bnQtc2l6ZTogMTJwdDsiPQo+SGVsbG8sPC9zcGFuPjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+ SSBoYXZlIGFuIG92aXJ0IDMuNS4wIGNsdXN0ZXIgd2l0aCA9CnRocmVlIG5vZGVzIGFuZCB3ZSB1 c2luZyBnbHVzdGVyZnMgZm9yIHNlcnZpbmcgYmFja2VuZCBzdG9yYWdlIGZvciBWTS1zLiBHbD0K dXN0ZXJmcyBhcmUgb24gc2FtZSBzZXJ2ZXJzIHdpdGggb3ZpcnQuPC9kaXY+PGRpdj5XZSBoYXZl IEdsdXN0ZXIgMy41LjEgb24gPQphbGwgb2Ygbm9kZXMuPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRp dj5Ib3cgY2FuIEkgdXBncmFkZSB0byBvdmlydCAzLjUuMSB3aXQ9CmggbmV3IGdsdXN0ZXJmcz8g SSBkb24ndCB3YW50IGRhdGEgaW5jb25zaXN0ZW5jeS9kYXRhIGxvc3Mvc3BsaXQgYnJhaW5zPzwv ZD0KaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5OZWVkIEkgdXBkYXRlIGdsdXN0ZXIgdmVyc2lvbiB0 byB0aGUgbGF0ZXN0PzwvZGl2PjxkPQppdj5Ib3cgSSBuZWVkIHRvIHVwZ3JhZGUgdGhlIG5vZGVz ID8gJm5ic3A7SXMgdGhlcmUgYW55IHdoaXRlcGFwZXIgYWJvdXQgdGg9CmlzPzwvZGl2PjxkaXY+ PHNwYW4gbmFtZT0zRCJ4Ij48L3NwYW4+PHAgc3R5bGU9M0QiZm9udC1mYW1pbHk6ICdUaW1lcyBO ZXcgUj0Kb21hbic7IGZvbnQtc2l6ZTogbWVkaXVtOyBtYXJnaW46IDBweDsiIGRhdGEtbWNlLXN0 eWxlPTNEImZvbnQtZmFtaWx5OiAnVGltPQplcyBOZXcgUm9tYW4nOyBmb250LXNpemU6IG1lZGl1 bTsgbWFyZ2luOiAwcHg7Ij48c3Ryb25nPjxzcGFuIHN0eWxlPTNEImZvbnQ9Ci1zaXplOiBtZWRp dW07IiBkYXRhLW1jZS1zdHlsZT0zRCJmb250LXNpemU6IG1lZGl1bTsiPjxzcGFuIHNpemU9M0Qi NSIgY29sbz0Kcj0zRCIjMkQ2N0IwIiBzdHlsZT0zRCJjb2xvcjogcmdiKDQ1LCAxMDMsIDE3Nik7 IiBkYXRhLW1jZS1zdHlsZT0zRCJjb2xvcjogPQojMmQ2N2IwOyI+PGJyPjwvc3Bhbj48L3NwYW4+ PC9zdHJvbmc+PC9wPjxwIHN0eWxlPTNEImZvbnQtZmFtaWx5OiAnVGltZXMgTmU9CncgUm9tYW4n OyBmb250LXNpemU6IG1lZGl1bTsgbWFyZ2luOiAwcHg7IiBkYXRhLW1jZS1zdHlsZT0zRCJmb250 LWZhbWlseTogJz0KVGltZXMgTmV3IFJvbWFuJzsgZm9udC1zaXplOiBtZWRpdW07IG1hcmdpbjog MHB4OyI+PHN0cm9uZz48c3BhbiBzdHlsZT0zRCJmPQpvbnQtc2l6ZTogbWVkaXVtOyIgZGF0YS1t Y2Utc3R5bGU9M0QiZm9udC1zaXplOiBtZWRpdW07Ij48c3BhbiBzaXplPTNEIjUiIGM9Cm9sb3I9 M0QiIzJENjdCMCIgc3R5bGU9M0QiY29sb3I6IHJnYig0NSwgMTAzLCAxNzYpOyIgZGF0YS1tY2Ut c3R5bGU9M0QiY29sbz0KcjogIzJkNjdiMDsiPjxicj48L3NwYW4+PC9zcGFuPjwvc3Ryb25nPjwv cD48cCBzdHlsZT0zRCJmb250LWZhbWlseTogJ1RpbWVzPQogTmV3IFJvbWFuJzsgZm9udC1zaXpl OiBtZWRpdW07IG1hcmdpbjogMHB4OyIgZGF0YS1tY2Utc3R5bGU9M0QiZm9udC1mYW1pbHk9Cjog J1RpbWVzIE5ldyBSb21hbic7IGZvbnQtc2l6ZTogbWVkaXVtOyBtYXJnaW46IDBweDsiPlRoYW5r cyBpbiBhZHZhbmNlLDwvcD0KPjxwIHN0eWxlPTNEImZvbnQtZmFtaWx5OiAnVGltZXMgTmV3IFJv bWFuJzsgZm9udC1zaXplOiBtZWRpdW07IG1hcmdpbjogMHB4PQo7IiBkYXRhLW1jZS1zdHlsZT0z RCJmb250LWZhbWlseTogJ1RpbWVzIE5ldyBSb21hbic7IGZvbnQtc2l6ZTogbWVkaXVtOyBtYXI9 CmdpbjogMHB4OyI+PGJyPjwvcD48cCBzdHlsZT0zRCJmb250LWZhbWlseTogJ1RpbWVzIE5ldyBS b21hbic7IGZvbnQtc2l6ZTogbT0KZWRpdW07IG1hcmdpbjogMHB4OyIgZGF0YS1tY2Utc3R5bGU9 M0QiZm9udC1mYW1pbHk6ICdUaW1lcyBOZXcgUm9tYW4nOyBmb250PQotc2l6ZTogbWVkaXVtOyBt YXJnaW46IDBweDsiPlRpYm9yPC9wPjwvZGl2PjwvZGl2PjwvYm9keT48L2h0bWw+Ci0tLS0tLT1f UGFydF8yMTA1NTM0NV83ODIxNjY3MjguMTQyMTkzNzE4NjgxMS0tCg== --===============9022811447994201615==-- From sabose at redhat.com Fri Jan 23 02:03:45 2015 Content-Type: multipart/mixed; boundary="===============0036553618291469851==" MIME-Version: 1.0 From: Sahina Bose To: users at ovirt.org Subject: Re: [ovirt-users] Upgrade to 3.5.1 Date: Fri, 23 Jan 2015 12:33:34 +0530 Message-ID: <54C1F246.9090700@redhat.com> In-Reply-To: 1128794209.21055346.1421937186813.JavaMail.zimbra@itsmart.hu --===============0036553618291469851== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------000907020005080800070103 Content-Type: text/plain; charset=3Dwindows-1252; format=3Dflowed Content-Transfer-Encoding: 7bit On 01/22/2015 08:03 PM, Demeter Tibor wrote: > Hello, > > I have an ovirt 3.5.0 cluster with three nodes and we using glusterfs = > for serving backend storage for VM-s. Glusterfs are on same servers = > with ovirt. > We have Gluster 3.5.1 on all of nodes. > > How can I upgrade to ovirt 3.5.1 with new glusterfs? I don't want data = > inconsistency/data loss/split brains? Do you have a replica 3 volume setup across these 3 nodes? Glusterfs supports rolling upgrade for replica volumes. But there are some issues to upgrade from 3.5 to 3.6 versions (depending = on version used) Adding gluster-users & Pranith for recommended procedures. thanks sahina > > Need I update gluster version to the latest? > How I need to upgrade the nodes ? Is there any whitepaper about this? > > * > * > > * > * > > Thanks in advance, > > > Tibor > > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --------------000907020005080800070103 Content-Type: text/html; charset=3Dwindows-1252 Content-Transfer-Encoding: 8bit
On 01/22/2015 08:03 PM, Demeter Tibor wrote:
Hello,

I have an ovirt 3.5.0 cluster with three nodes and we using glusterfs for serving backend storage for VM-s. Glusterfs are on same servers with ovirt.
We have Gluster 3.5.1 on all of nodes.

How can I upgrade to ovirt 3.5.1 with new glusterfs? I don't want data inconsistency/data loss/split brains?

Do you have a replica 3 volume setup across these 3 nodes?

Glusterfs supports rolling upgrade for replica volumes.
But there are some issues to upgrade from 3.5 to 3.6 versions (depending on version used)
Adding gluster-users & Pranith for recommended procedures.


thanks
sahina


Need I update gluster version to the latest?
How I need to upgrade the nodes ? =C2=A0Is there any whitepaper about this?

Thanks in advance,


Tibor



_______________________________________________
Users mailing list
Use=
rs(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

--------------000907020005080800070103-- --===============0036553618291469851== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS0wMDA5MDcwMjAwMDUwODA4MDAwNzAxMDMKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXdpbmRvd3MtMTI1MjsgZm9ybWF0PWZsb3dlZApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5n OiA3Yml0CgoKT24gMDEvMjIvMjAxNSAwODowMyBQTSwgRGVtZXRlciBUaWJvciB3cm90ZToKPiBI ZWxsbywKPgo+IEkgaGF2ZSBhbiBvdmlydCAzLjUuMCBjbHVzdGVyIHdpdGggdGhyZWUgbm9kZXMg YW5kIHdlIHVzaW5nIGdsdXN0ZXJmcyAKPiBmb3Igc2VydmluZyBiYWNrZW5kIHN0b3JhZ2UgZm9y IFZNLXMuIEdsdXN0ZXJmcyBhcmUgb24gc2FtZSBzZXJ2ZXJzIAo+IHdpdGggb3ZpcnQuCj4gV2Ug aGF2ZSBHbHVzdGVyIDMuNS4xIG9uIGFsbCBvZiBub2Rlcy4KPgo+IEhvdyBjYW4gSSB1cGdyYWRl IHRvIG92aXJ0IDMuNS4xIHdpdGggbmV3IGdsdXN0ZXJmcz8gSSBkb24ndCB3YW50IGRhdGEgCj4g aW5jb25zaXN0ZW5jeS9kYXRhIGxvc3Mvc3BsaXQgYnJhaW5zPwoKRG8geW91IGhhdmUgYSByZXBs aWNhIDMgdm9sdW1lIHNldHVwIGFjcm9zcyB0aGVzZSAzIG5vZGVzPwoKR2x1c3RlcmZzIHN1cHBv cnRzIHJvbGxpbmcgdXBncmFkZSBmb3IgcmVwbGljYSB2b2x1bWVzLgpCdXQgdGhlcmUgYXJlIHNv bWUgaXNzdWVzIHRvIHVwZ3JhZGUgZnJvbSAzLjUgdG8gMy42IHZlcnNpb25zIChkZXBlbmRpbmcg Cm9uIHZlcnNpb24gdXNlZCkKQWRkaW5nIGdsdXN0ZXItdXNlcnMgJiBQcmFuaXRoIGZvciByZWNv bW1lbmRlZCBwcm9jZWR1cmVzLgoKCnRoYW5rcwpzYWhpbmEKCj4KPiBOZWVkIEkgdXBkYXRlIGds dXN0ZXIgdmVyc2lvbiB0byB0aGUgbGF0ZXN0Pwo+IEhvdyBJIG5lZWQgdG8gdXBncmFkZSB0aGUg bm9kZXMgPyAgSXMgdGhlcmUgYW55IHdoaXRlcGFwZXIgYWJvdXQgdGhpcz8KPgo+ICoKPiAqCj4K PiAqCj4gKgo+Cj4gVGhhbmtzIGluIGFkdmFuY2UsCj4KPgo+IFRpYm9yCj4KPgo+Cj4gX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KPiBVc2VycyBtYWlsaW5n IGxpc3QKPiBVc2Vyc0BvdmlydC5vcmcKPiBodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4v bGlzdGluZm8vdXNlcnMKCgotLS0tLS0tLS0tLS0tLTAwMDkwNzAyMDAwNTA4MDgwMDA3MDEwMwpD b250ZW50LVR5cGU6IHRleHQvaHRtbDsgY2hhcnNldD13aW5kb3dzLTEyNTIKQ29udGVudC1UcmFu c2Zlci1FbmNvZGluZzogOGJpdAoKPGh0bWw+CiAgPGhlYWQ+CiAgICA8bWV0YSBjb250ZW50PSJ0 ZXh0L2h0bWw7IGNoYXJzZXQ9d2luZG93cy0xMjUyIgogICAgICBodHRwLWVxdWl2PSJDb250ZW50 LVR5cGUiPgogIDwvaGVhZD4KICA8Ym9keSBiZ2NvbG9yPSIjRkZGRkZGIiB0ZXh0PSIjMDAwMDAw Ij4KICAgIDxicj4KICAgIDxkaXYgY2xhc3M9Im1vei1jaXRlLXByZWZpeCI+T24gMDEvMjIvMjAx NSAwODowMyBQTSwgRGVtZXRlciBUaWJvcgogICAgICB3cm90ZTo8YnI+CiAgICA8L2Rpdj4KICAg IDxibG9ja3F1b3RlCiAgICAgIGNpdGU9Im1pZDoxMTI4Nzk0MjA5LjIxMDU1MzQ2LjE0MjE5Mzcx ODY4MTMuSmF2YU1haWwuemltYnJhQGl0c21hcnQuaHUiCiAgICAgIHR5cGU9ImNpdGUiPgogICAg ICA8ZGl2IHN0eWxlPSJmb250LWZhbWlseTogdGltZXMgbmV3IHJvbWFuLCBuZXcgeW9yaywgdGlt ZXMsIHNlcmlmOwogICAgICAgIGZvbnQtc2l6ZTogMTJwdDsgY29sb3I6ICMwMDAwMDAiPgogICAg ICAgIDxkaXY+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZTogMTJwdDsiPkhlbGxvLDwvc3Bhbj48L2Rp dj4KICAgICAgICA8ZGl2Pjxicj4KICAgICAgICA8L2Rpdj4KICAgICAgICA8ZGl2PkkgaGF2ZSBh biBvdmlydCAzLjUuMCBjbHVzdGVyIHdpdGggdGhyZWUgbm9kZXMgYW5kIHdlIHVzaW5nCiAgICAg ICAgICBnbHVzdGVyZnMgZm9yIHNlcnZpbmcgYmFja2VuZCBzdG9yYWdlIGZvciBWTS1zLiBHbHVz dGVyZnMgYXJlCiAgICAgICAgICBvbiBzYW1lIHNlcnZlcnMgd2l0aCBvdmlydC48L2Rpdj4KICAg ICAgICA8ZGl2PldlIGhhdmUgR2x1c3RlciAzLjUuMSBvbiBhbGwgb2Ygbm9kZXMuPC9kaXY+CiAg ICAgICAgPGRpdj48YnI+CiAgICAgICAgPC9kaXY+CiAgICAgICAgPGRpdj5Ib3cgY2FuIEkgdXBn cmFkZSB0byBvdmlydCAzLjUuMSB3aXRoIG5ldyBnbHVzdGVyZnM/IEkKICAgICAgICAgIGRvbid0 IHdhbnQgZGF0YSBpbmNvbnNpc3RlbmN5L2RhdGEgbG9zcy9zcGxpdCBicmFpbnM/PC9kaXY+CiAg ICAgIDwvZGl2PgogICAgPC9ibG9ja3F1b3RlPgogICAgPGJyPgogICAgRG8geW91IGhhdmUgYSBy ZXBsaWNhIDMgdm9sdW1lIHNldHVwIGFjcm9zcyB0aGVzZSAzIG5vZGVzPzxicj4KICAgIDxicj4K ICAgIEdsdXN0ZXJmcyBzdXBwb3J0cyByb2xsaW5nIHVwZ3JhZGUgZm9yIHJlcGxpY2Egdm9sdW1l cy4gPGJyPgogICAgQnV0IHRoZXJlIGFyZSBzb21lIGlzc3VlcyB0byB1cGdyYWRlIGZyb20gMy41 IHRvIDMuNiB2ZXJzaW9ucwogICAgKGRlcGVuZGluZyBvbiB2ZXJzaW9uIHVzZWQpPGJyPgogICAg QWRkaW5nIGdsdXN0ZXItdXNlcnMgJmFtcDsgUHJhbml0aCBmb3IgcmVjb21tZW5kZWQgcHJvY2Vk dXJlcy48YnI+CiAgICA8YnI+CiAgICA8YnI+CiAgICB0aGFua3M8YnI+CiAgICBzYWhpbmE8YnI+ CiAgICA8YnI+CiAgICA8YmxvY2txdW90ZQogICAgICBjaXRlPSJtaWQ6MTEyODc5NDIwOS4yMTA1 NTM0Ni4xNDIxOTM3MTg2ODEzLkphdmFNYWlsLnppbWJyYUBpdHNtYXJ0Lmh1IgogICAgICB0eXBl PSJjaXRlIj4KICAgICAgPGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IHRpbWVzIG5ldyByb21hbiwg bmV3IHlvcmssIHRpbWVzLCBzZXJpZjsKICAgICAgICBmb250LXNpemU6IDEycHQ7IGNvbG9yOiAj MDAwMDAwIj4KICAgICAgICA8ZGl2Pjxicj4KICAgICAgICA8L2Rpdj4KICAgICAgICA8ZGl2Pk5l ZWQgSSB1cGRhdGUgZ2x1c3RlciB2ZXJzaW9uIHRvIHRoZSBsYXRlc3Q/PC9kaXY+CiAgICAgICAg PGRpdj5Ib3cgSSBuZWVkIHRvIHVwZ3JhZGUgdGhlIG5vZGVzID8goElzIHRoZXJlIGFueSB3aGl0 ZXBhcGVyCiAgICAgICAgICBhYm91dCB0aGlzPzwvZGl2PgogICAgICAgIDxkaXY+PHNwYW4gbmFt ZT0ieCI+PC9zcGFuPgogICAgICAgICAgPHAgc3R5bGU9ImZvbnQtZmFtaWx5OiAnVGltZXMgTmV3 IFJvbWFuJzsgZm9udC1zaXplOiBtZWRpdW07CiAgICAgICAgICAgIG1hcmdpbjogMHB4OyIgZGF0 YS1tY2Utc3R5bGU9ImZvbnQtZmFtaWx5OiAnVGltZXMgTmV3CiAgICAgICAgICAgIFJvbWFuJzsg Zm9udC1zaXplOiBtZWRpdW07IG1hcmdpbjogMHB4OyI+PHN0cm9uZz48c3BhbgogICAgICAgICAg ICAgICAgc3R5bGU9ImZvbnQtc2l6ZTogbWVkaXVtOyIgZGF0YS1tY2Utc3R5bGU9ImZvbnQtc2l6 ZToKICAgICAgICAgICAgICAgIG1lZGl1bTsiPjxzcGFuIHNpemU9IjUiIGNvbG9yPSIjMkQ2N0Iw IiBzdHlsZT0iY29sb3I6CiAgICAgICAgICAgICAgICAgIHJnYig0NSwgMTAzLCAxNzYpOyIgZGF0 YS1tY2Utc3R5bGU9ImNvbG9yOiAjMmQ2N2IwOyI+PGJyPgogICAgICAgICAgICAgICAgPC9zcGFu Pjwvc3Bhbj48L3N0cm9uZz48L3A+CiAgICAgICAgICA8cCBzdHlsZT0iZm9udC1mYW1pbHk6ICdU aW1lcyBOZXcgUm9tYW4nOyBmb250LXNpemU6IG1lZGl1bTsKICAgICAgICAgICAgbWFyZ2luOiAw cHg7IiBkYXRhLW1jZS1zdHlsZT0iZm9udC1mYW1pbHk6ICdUaW1lcyBOZXcKICAgICAgICAgICAg Um9tYW4nOyBmb250LXNpemU6IG1lZGl1bTsgbWFyZ2luOiAwcHg7Ij48c3Ryb25nPjxzcGFuCiAg ICAgICAgICAgICAgICBzdHlsZT0iZm9udC1zaXplOiBtZWRpdW07IiBkYXRhLW1jZS1zdHlsZT0i Zm9udC1zaXplOgogICAgICAgICAgICAgICAgbWVkaXVtOyI+PHNwYW4gc2l6ZT0iNSIgY29sb3I9 IiMyRDY3QjAiIHN0eWxlPSJjb2xvcjoKICAgICAgICAgICAgICAgICAgcmdiKDQ1LCAxMDMsIDE3 Nik7IiBkYXRhLW1jZS1zdHlsZT0iY29sb3I6ICMyZDY3YjA7Ij48YnI+CiAgICAgICAgICAgICAg ICA8L3NwYW4+PC9zcGFuPjwvc3Ryb25nPjwvcD4KICAgICAgICAgIDxwIHN0eWxlPSJmb250LWZh bWlseTogJ1RpbWVzIE5ldyBSb21hbic7IGZvbnQtc2l6ZTogbWVkaXVtOwogICAgICAgICAgICBt YXJnaW46IDBweDsiIGRhdGEtbWNlLXN0eWxlPSJmb250LWZhbWlseTogJ1RpbWVzIE5ldwogICAg ICAgICAgICBSb21hbic7IGZvbnQtc2l6ZTogbWVkaXVtOyBtYXJnaW46IDBweDsiPlRoYW5rcyBp biBhZHZhbmNlLDwvcD4KICAgICAgICAgIDxwIHN0eWxlPSJmb250LWZhbWlseTogJ1RpbWVzIE5l dyBSb21hbic7IGZvbnQtc2l6ZTogbWVkaXVtOwogICAgICAgICAgICBtYXJnaW46IDBweDsiIGRh dGEtbWNlLXN0eWxlPSJmb250LWZhbWlseTogJ1RpbWVzIE5ldwogICAgICAgICAgICBSb21hbic7 IGZvbnQtc2l6ZTogbWVkaXVtOyBtYXJnaW46IDBweDsiPjxicj4KICAgICAgICAgIDwvcD4KICAg ICAgICAgIDxwIHN0eWxlPSJmb250LWZhbWlseTogJ1RpbWVzIE5ldyBSb21hbic7IGZvbnQtc2l6 ZTogbWVkaXVtOwogICAgICAgICAgICBtYXJnaW46IDBweDsiIGRhdGEtbWNlLXN0eWxlPSJmb250 LWZhbWlseTogJ1RpbWVzIE5ldwogICAgICAgICAgICBSb21hbic7IGZvbnQtc2l6ZTogbWVkaXVt OyBtYXJnaW46IDBweDsiPlRpYm9yPC9wPgogICAgICAgIDwvZGl2PgogICAgICA8L2Rpdj4KICAg ICAgPGJyPgogICAgICA8ZmllbGRzZXQgY2xhc3M9Im1pbWVBdHRhY2htZW50SGVhZGVyIj48L2Zp ZWxkc2V0PgogICAgICA8YnI+CiAgICAgIDxwcmUgd3JhcD0iIj5fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fXwpVc2VycyBtYWlsaW5nIGxpc3QKPGEgY2xhc3M9 Im1vei10eHQtbGluay1hYmJyZXZpYXRlZCIgaHJlZj0ibWFpbHRvOlVzZXJzQG92aXJ0Lm9yZyI+ VXNlcnNAb3ZpcnQub3JnPC9hPgo8YSBjbGFzcz0ibW96LXR4dC1saW5rLWZyZWV0ZXh0IiBocmVm PSJodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMiPmh0dHA6Ly9s aXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VyczwvYT4KPC9wcmU+CiAgICA8L2Js b2NrcXVvdGU+CiAgICA8YnI+CiAgPC9ib2R5Pgo8L2h0bWw+CgotLS0tLS0tLS0tLS0tLTAwMDkw NzAyMDAwNTA4MDgwMDA3MDEwMy0tCg== --===============0036553618291469851==-- From sabose at redhat.com Fri Jan 23 02:05:19 2015 Content-Type: multipart/mixed; boundary="===============7520373427523846595==" MIME-Version: 1.0 From: Sahina Bose To: users at ovirt.org Subject: Re: [ovirt-users] Upgrade to 3.5.1 Date: Fri, 23 Jan 2015 12:35:09 +0530 Message-ID: <54C1F2A5.70609@redhat.com> In-Reply-To: 54C1F246.9090700@redhat.com --===============7520373427523846595== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------050900020000030701080303 Content-Type: text/plain; charset=3Dwindows-1252; format=3Dflowed Content-Transfer-Encoding: 7bit Sorry, wrong ML earlier On 01/23/2015 12:33 PM, Sahina Bose wrote: > > On 01/22/2015 08:03 PM, Demeter Tibor wrote: >> Hello, >> >> I have an ovirt 3.5.0 cluster with three nodes and we using glusterfs = >> for serving backend storage for VM-s. Glusterfs are on same servers = >> with ovirt. >> We have Gluster 3.5.1 on all of nodes. >> >> How can I upgrade to ovirt 3.5.1 with new glusterfs? I don't want = >> data inconsistency/data loss/split brains? > > Do you have a replica 3 volume setup across these 3 nodes? > > Glusterfs supports rolling upgrade for replica volumes. > But there are some issues to upgrade from 3.5 to 3.6 versions = > (depending on version used) > Adding gluster-users & Pranith for recommended procedures. > > > thanks > sahina > >> >> Need I update gluster version to the latest? >> How I need to upgrade the nodes ? Is there any whitepaper about this? >> >> * >> * >> >> * >> * >> >> Thanks in advance, >> >> >> Tibor >> >> >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users > > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --------------050900020000030701080303 Content-Type: text/html; charset=3Dwindows-1252 Content-Transfer-Encoding: 8bit Sorry, wrong ML earlier

On 01/23/2015 12:33 PM, Sahina Bose wrote:

On 01/22/2015 08:03 PM, Demeter Tibor wrote:
Hello,

I have an ovirt 3.5.0 cluster with three nodes and we using glusterfs for serving backend storage for VM-s. Glusterfs are on same servers with ovirt.
We have Gluster 3.5.1 on all of nodes.

How can I upgrade to ovirt 3.5.1 with new glusterfs? I don't want data inconsistency/data loss/split brains?

Do you have a replica 3 volume setup across these 3 nodes?

Glusterfs supports rolling upgrade for replica volumes.
But there are some issues to upgrade from 3.5 to 3.6 versions (depending on version used)
Adding gluster-users & Pranith for recommended procedures.


thanks
sahina


Need I update gluster version to the latest?
How I need to upgrade the nodes ? =C2=A0Is there any whitepaper about this?

=

=

Thanks in advance,


Tibor



_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/list=
info/users



_______________________________________________
Users mailing list
Use=
rs(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

--------------050900020000030701080303-- --===============7520373427523846595== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS0wNTA5MDAwMjAwMDAwMzA3MDEwODAzMDMKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXdpbmRvd3MtMTI1MjsgZm9ybWF0PWZsb3dlZApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5n OiA3Yml0CgpTb3JyeSwgd3JvbmcgTUwgZWFybGllcgoKT24gMDEvMjMvMjAxNSAxMjozMyBQTSwg U2FoaW5hIEJvc2Ugd3JvdGU6Cj4KPiBPbiAwMS8yMi8yMDE1IDA4OjAzIFBNLCBEZW1ldGVyIFRp Ym9yIHdyb3RlOgo+PiBIZWxsbywKPj4KPj4gSSBoYXZlIGFuIG92aXJ0IDMuNS4wIGNsdXN0ZXIg d2l0aCB0aHJlZSBub2RlcyBhbmQgd2UgdXNpbmcgZ2x1c3RlcmZzIAo+PiBmb3Igc2VydmluZyBi YWNrZW5kIHN0b3JhZ2UgZm9yIFZNLXMuIEdsdXN0ZXJmcyBhcmUgb24gc2FtZSBzZXJ2ZXJzIAo+ PiB3aXRoIG92aXJ0Lgo+PiBXZSBoYXZlIEdsdXN0ZXIgMy41LjEgb24gYWxsIG9mIG5vZGVzLgo+ Pgo+PiBIb3cgY2FuIEkgdXBncmFkZSB0byBvdmlydCAzLjUuMSB3aXRoIG5ldyBnbHVzdGVyZnM/ IEkgZG9uJ3Qgd2FudCAKPj4gZGF0YSBpbmNvbnNpc3RlbmN5L2RhdGEgbG9zcy9zcGxpdCBicmFp bnM/Cj4KPiBEbyB5b3UgaGF2ZSBhIHJlcGxpY2EgMyB2b2x1bWUgc2V0dXAgYWNyb3NzIHRoZXNl IDMgbm9kZXM/Cj4KPiBHbHVzdGVyZnMgc3VwcG9ydHMgcm9sbGluZyB1cGdyYWRlIGZvciByZXBs aWNhIHZvbHVtZXMuCj4gQnV0IHRoZXJlIGFyZSBzb21lIGlzc3VlcyB0byB1cGdyYWRlIGZyb20g My41IHRvIDMuNiB2ZXJzaW9ucyAKPiAoZGVwZW5kaW5nIG9uIHZlcnNpb24gdXNlZCkKPiBBZGRp bmcgZ2x1c3Rlci11c2VycyAmIFByYW5pdGggZm9yIHJlY29tbWVuZGVkIHByb2NlZHVyZXMuCj4K Pgo+IHRoYW5rcwo+IHNhaGluYQo+Cj4+Cj4+IE5lZWQgSSB1cGRhdGUgZ2x1c3RlciB2ZXJzaW9u IHRvIHRoZSBsYXRlc3Q/Cj4+IEhvdyBJIG5lZWQgdG8gdXBncmFkZSB0aGUgbm9kZXMgPyAgSXMg dGhlcmUgYW55IHdoaXRlcGFwZXIgYWJvdXQgdGhpcz8KPj4KPj4gKgo+PiAqCj4+Cj4+ICoKPj4g Kgo+Pgo+PiBUaGFua3MgaW4gYWR2YW5jZSwKPj4KPj4KPj4gVGlib3IKPj4KPj4KPj4KPj4gX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KPj4gVXNlcnMgbWFp bGluZyBsaXN0Cj4+IFVzZXJzQG92aXJ0Lm9yZwo+PiBodHRwOi8vbGlzdHMub3ZpcnQub3JnL21h aWxtYW4vbGlzdGluZm8vdXNlcnMKPgo+Cj4KPiBfX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fXwo+IFVzZXJzIG1haWxpbmcgbGlzdAo+IFVzZXJzQG92aXJ0Lm9y Zwo+IGh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycwoKCi0tLS0t LS0tLS0tLS0tMDUwOTAwMDIwMDAwMDMwNzAxMDgwMzAzCkNvbnRlbnQtVHlwZTogdGV4dC9odG1s OyBjaGFyc2V0PXdpbmRvd3MtMTI1MgpDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA4Yml0Cgo8 aHRtbD4KICA8aGVhZD4KICAgIDxtZXRhIGNvbnRlbnQ9InRleHQvaHRtbDsgY2hhcnNldD13aW5k b3dzLTEyNTIiCiAgICAgIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSI+CiAgPC9oZWFkPgogIDxi b2R5IGJnY29sb3I9IiNGRkZGRkYiIHRleHQ9IiMwMDAwMDAiPgogICAgU29ycnksIHdyb25nIE1M IGVhcmxpZXI8YnI+CiAgICA8YnI+CiAgICA8ZGl2IGNsYXNzPSJtb3otY2l0ZS1wcmVmaXgiPk9u IDAxLzIzLzIwMTUgMTI6MzMgUE0sIFNhaGluYSBCb3NlCiAgICAgIHdyb3RlOjxicj4KICAgIDwv ZGl2PgogICAgPGJsb2NrcXVvdGUgY2l0ZT0ibWlkOjU0QzFGMjQ2LjkwOTA3MDBAcmVkaGF0LmNv bSIgdHlwZT0iY2l0ZSI+CiAgICAgIDxtZXRhIGNvbnRlbnQ9InRleHQvaHRtbDsgY2hhcnNldD13 aW5kb3dzLTEyNTIiCiAgICAgICAgaHR0cC1lcXVpdj0iQ29udGVudC1UeXBlIj4KICAgICAgPGJy PgogICAgICA8ZGl2IGNsYXNzPSJtb3otY2l0ZS1wcmVmaXgiPk9uIDAxLzIyLzIwMTUgMDg6MDMg UE0sIERlbWV0ZXIgVGlib3IKICAgICAgICB3cm90ZTo8YnI+CiAgICAgIDwvZGl2PgogICAgICA8 YmxvY2txdW90ZQogICAgICAgIGNpdGU9Im1pZDoxMTI4Nzk0MjA5LjIxMDU1MzQ2LjE0MjE5Mzcx ODY4MTMuSmF2YU1haWwuemltYnJhQGl0c21hcnQuaHUiCiAgICAgICAgdHlwZT0iY2l0ZSI+CiAg ICAgICAgPGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IHRpbWVzIG5ldyByb21hbiwgbmV3IHlvcmss IHRpbWVzLAogICAgICAgICAgc2VyaWY7IGZvbnQtc2l6ZTogMTJwdDsgY29sb3I6ICMwMDAwMDAi PgogICAgICAgICAgPGRpdj48c3BhbiBzdHlsZT0iZm9udC1zaXplOiAxMnB0OyI+SGVsbG8sPC9z cGFuPjwvZGl2PgogICAgICAgICAgPGRpdj48YnI+CiAgICAgICAgICA8L2Rpdj4KICAgICAgICAg IDxkaXY+SSBoYXZlIGFuIG92aXJ0IDMuNS4wIGNsdXN0ZXIgd2l0aCB0aHJlZSBub2RlcyBhbmQg d2UKICAgICAgICAgICAgdXNpbmcgZ2x1c3RlcmZzIGZvciBzZXJ2aW5nIGJhY2tlbmQgc3RvcmFn ZSBmb3IgVk0tcy4KICAgICAgICAgICAgR2x1c3RlcmZzIGFyZSBvbiBzYW1lIHNlcnZlcnMgd2l0 aCBvdmlydC48L2Rpdj4KICAgICAgICAgIDxkaXY+V2UgaGF2ZSBHbHVzdGVyIDMuNS4xIG9uIGFs bCBvZiBub2Rlcy48L2Rpdj4KICAgICAgICAgIDxkaXY+PGJyPgogICAgICAgICAgPC9kaXY+CiAg ICAgICAgICA8ZGl2PkhvdyBjYW4gSSB1cGdyYWRlIHRvIG92aXJ0IDMuNS4xIHdpdGggbmV3IGds dXN0ZXJmcz8gSQogICAgICAgICAgICBkb24ndCB3YW50IGRhdGEgaW5jb25zaXN0ZW5jeS9kYXRh IGxvc3Mvc3BsaXQgYnJhaW5zPzwvZGl2PgogICAgICAgIDwvZGl2PgogICAgICA8L2Jsb2NrcXVv dGU+CiAgICAgIDxicj4KICAgICAgRG8geW91IGhhdmUgYSByZXBsaWNhIDMgdm9sdW1lIHNldHVw IGFjcm9zcyB0aGVzZSAzIG5vZGVzPzxicj4KICAgICAgPGJyPgogICAgICBHbHVzdGVyZnMgc3Vw cG9ydHMgcm9sbGluZyB1cGdyYWRlIGZvciByZXBsaWNhIHZvbHVtZXMuIDxicj4KICAgICAgQnV0 IHRoZXJlIGFyZSBzb21lIGlzc3VlcyB0byB1cGdyYWRlIGZyb20gMy41IHRvIDMuNiB2ZXJzaW9u cwogICAgICAoZGVwZW5kaW5nIG9uIHZlcnNpb24gdXNlZCk8YnI+CiAgICAgIEFkZGluZyBnbHVz dGVyLXVzZXJzICZhbXA7IFByYW5pdGggZm9yIHJlY29tbWVuZGVkIHByb2NlZHVyZXMuPGJyPgog ICAgICA8YnI+CiAgICAgIDxicj4KICAgICAgdGhhbmtzPGJyPgogICAgICBzYWhpbmE8YnI+CiAg ICAgIDxicj4KICAgICAgPGJsb2NrcXVvdGUKICAgICAgICBjaXRlPSJtaWQ6MTEyODc5NDIwOS4y MTA1NTM0Ni4xNDIxOTM3MTg2ODEzLkphdmFNYWlsLnppbWJyYUBpdHNtYXJ0Lmh1IgogICAgICAg IHR5cGU9ImNpdGUiPgogICAgICAgIDxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiB0aW1lcyBuZXcg cm9tYW4sIG5ldyB5b3JrLCB0aW1lcywKICAgICAgICAgIHNlcmlmOyBmb250LXNpemU6IDEycHQ7 IGNvbG9yOiAjMDAwMDAwIj4KICAgICAgICAgIDxkaXY+PGJyPgogICAgICAgICAgPC9kaXY+CiAg ICAgICAgICA8ZGl2Pk5lZWQgSSB1cGRhdGUgZ2x1c3RlciB2ZXJzaW9uIHRvIHRoZSBsYXRlc3Q/ PC9kaXY+CiAgICAgICAgICA8ZGl2PkhvdyBJIG5lZWQgdG8gdXBncmFkZSB0aGUgbm9kZXMgPyCg SXMgdGhlcmUgYW55CiAgICAgICAgICAgIHdoaXRlcGFwZXIgYWJvdXQgdGhpcz88L2Rpdj4KICAg ICAgICAgIDxkaXY+PHNwYW4gbmFtZT0ieCI+PC9zcGFuPgogICAgICAgICAgICA8cCBzdHlsZT0i Zm9udC1mYW1pbHk6ICdUaW1lcyBOZXcgUm9tYW4nOyBmb250LXNpemU6IG1lZGl1bTsKICAgICAg ICAgICAgICBtYXJnaW46IDBweDsiIGRhdGEtbWNlLXN0eWxlPSJmb250LWZhbWlseTogJ1RpbWVz IE5ldwogICAgICAgICAgICAgIFJvbWFuJzsgZm9udC1zaXplOiBtZWRpdW07IG1hcmdpbjogMHB4 OyI+PHN0cm9uZz48c3BhbgogICAgICAgICAgICAgICAgICBzdHlsZT0iZm9udC1zaXplOiBtZWRp dW07IiBkYXRhLW1jZS1zdHlsZT0iZm9udC1zaXplOgogICAgICAgICAgICAgICAgICBtZWRpdW07 Ij48c3BhbiBzaXplPSI1IiBjb2xvcj0iIzJENjdCMCIgc3R5bGU9ImNvbG9yOgogICAgICAgICAg ICAgICAgICAgIHJnYig0NSwgMTAzLCAxNzYpOyIgZGF0YS1tY2Utc3R5bGU9ImNvbG9yOiAjMmQ2 N2IwOyI+PGJyPgogICAgICAgICAgICAgICAgICA8L3NwYW4+PC9zcGFuPjwvc3Ryb25nPjwvcD4K ICAgICAgICAgICAgPHAgc3R5bGU9ImZvbnQtZmFtaWx5OiAnVGltZXMgTmV3IFJvbWFuJzsgZm9u dC1zaXplOiBtZWRpdW07CiAgICAgICAgICAgICAgbWFyZ2luOiAwcHg7IiBkYXRhLW1jZS1zdHls ZT0iZm9udC1mYW1pbHk6ICdUaW1lcyBOZXcKICAgICAgICAgICAgICBSb21hbic7IGZvbnQtc2l6 ZTogbWVkaXVtOyBtYXJnaW46IDBweDsiPjxzdHJvbmc+PHNwYW4KICAgICAgICAgICAgICAgICAg c3R5bGU9ImZvbnQtc2l6ZTogbWVkaXVtOyIgZGF0YS1tY2Utc3R5bGU9ImZvbnQtc2l6ZToKICAg ICAgICAgICAgICAgICAgbWVkaXVtOyI+PHNwYW4gc2l6ZT0iNSIgY29sb3I9IiMyRDY3QjAiIHN0 eWxlPSJjb2xvcjoKICAgICAgICAgICAgICAgICAgICByZ2IoNDUsIDEwMywgMTc2KTsiIGRhdGEt bWNlLXN0eWxlPSJjb2xvcjogIzJkNjdiMDsiPjxicj4KICAgICAgICAgICAgICAgICAgPC9zcGFu Pjwvc3Bhbj48L3N0cm9uZz48L3A+CiAgICAgICAgICAgIDxwIHN0eWxlPSJmb250LWZhbWlseTog J1RpbWVzIE5ldyBSb21hbic7IGZvbnQtc2l6ZTogbWVkaXVtOwogICAgICAgICAgICAgIG1hcmdp bjogMHB4OyIgZGF0YS1tY2Utc3R5bGU9ImZvbnQtZmFtaWx5OiAnVGltZXMgTmV3CiAgICAgICAg ICAgICAgUm9tYW4nOyBmb250LXNpemU6IG1lZGl1bTsgbWFyZ2luOiAwcHg7Ij5UaGFua3MgaW4K ICAgICAgICAgICAgICBhZHZhbmNlLDwvcD4KICAgICAgICAgICAgPHAgc3R5bGU9ImZvbnQtZmFt aWx5OiAnVGltZXMgTmV3IFJvbWFuJzsgZm9udC1zaXplOiBtZWRpdW07CiAgICAgICAgICAgICAg bWFyZ2luOiAwcHg7IiBkYXRhLW1jZS1zdHlsZT0iZm9udC1mYW1pbHk6ICdUaW1lcyBOZXcKICAg ICAgICAgICAgICBSb21hbic7IGZvbnQtc2l6ZTogbWVkaXVtOyBtYXJnaW46IDBweDsiPjxicj4K ICAgICAgICAgICAgPC9wPgogICAgICAgICAgICA8cCBzdHlsZT0iZm9udC1mYW1pbHk6ICdUaW1l cyBOZXcgUm9tYW4nOyBmb250LXNpemU6IG1lZGl1bTsKICAgICAgICAgICAgICBtYXJnaW46IDBw eDsiIGRhdGEtbWNlLXN0eWxlPSJmb250LWZhbWlseTogJ1RpbWVzIE5ldwogICAgICAgICAgICAg IFJvbWFuJzsgZm9udC1zaXplOiBtZWRpdW07IG1hcmdpbjogMHB4OyI+VGlib3I8L3A+CiAgICAg ICAgICA8L2Rpdj4KICAgICAgICA8L2Rpdj4KICAgICAgICA8YnI+CiAgICAgICAgPGZpZWxkc2V0 IGNsYXNzPSJtaW1lQXR0YWNobWVudEhlYWRlciI+PC9maWVsZHNldD4KICAgICAgICA8YnI+CiAg ICAgICAgPHByZSB3cmFwPSIiPl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fClVzZXJzIG1haWxpbmcgbGlzdAo8YSBtb3otZG8tbm90LXNlbmQ9InRydWUiIGNs YXNzPSJtb3otdHh0LWxpbmstYWJicmV2aWF0ZWQiIGhyZWY9Im1haWx0bzpVc2Vyc0BvdmlydC5v cmciPlVzZXJzQG92aXJ0Lm9yZzwvYT4KPGEgbW96LWRvLW5vdC1zZW5kPSJ0cnVlIiBjbGFzcz0i bW96LXR4dC1saW5rLWZyZWV0ZXh0IiBocmVmPSJodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxt YW4vbGlzdGluZm8vdXNlcnMiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5m by91c2VyczwvYT4KPC9wcmU+CiAgICAgIDwvYmxvY2txdW90ZT4KICAgICAgPGJyPgogICAgICA8 YnI+CiAgICAgIDxmaWVsZHNldCBjbGFzcz0ibWltZUF0dGFjaG1lbnRIZWFkZXIiPjwvZmllbGRz ZXQ+CiAgICAgIDxicj4KICAgICAgPHByZSB3cmFwPSIiPl9fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fClVzZXJzIG1haWxpbmcgbGlzdAo8YSBjbGFzcz0ibW96 LXR4dC1saW5rLWFiYnJldmlhdGVkIiBocmVmPSJtYWlsdG86VXNlcnNAb3ZpcnQub3JnIj5Vc2Vy c0BvdmlydC5vcmc8L2E+CjxhIGNsYXNzPSJtb3otdHh0LWxpbmstZnJlZXRleHQiIGhyZWY9Imh0 dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycyI+aHR0cDovL2xpc3Rz Lm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzPC9hPgo8L3ByZT4KICAgIDwvYmxvY2tx dW90ZT4KICAgIDxicj4KICA8L2JvZHk+CjwvaHRtbD4KCi0tLS0tLS0tLS0tLS0tMDUwOTAwMDIw MDAwMDMwNzAxMDgwMzAzLS0K --===============7520373427523846595==-- From tdemeter at itsmart.hu Fri Jan 23 03:48:43 2015 Content-Type: multipart/mixed; boundary="===============8297550533043137498==" MIME-Version: 1.0 From: Demeter Tibor To: users at ovirt.org Subject: Re: [ovirt-users] Upgrade to 3.5.1 Date: Fri, 23 Jan 2015 09:48:38 +0100 Message-ID: <1190956082.35855.1422002918753.JavaMail.zimbra@itsmart.hu> In-Reply-To: 54C1F246.9090700@redhat.com --===============8297550533043137498== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable ------=3D_Part_35854_1394331678.1422002918752 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable Hi,=3D20 No, I have only one replica beetwen two nodes.=3D20 The third node is only a host for vms and that using this replica.=3D20 Thanks=3D20 Tibor=3D20 ----- Eredeti =3DC3=3DBCzenet ----- > On 01/22/2015 08:03 PM, Demeter Tibor wrote: > > Hello, >=3D20 > > I have an ovirt 3.5.0 cluster with three nodes and we using glusterfs f= =3D or > > serving backend storage for VM-s. Glusterfs are on same servers with ov= =3D irt. >=3D20 > > We have Gluster 3.5.1 on all of nodes. >=3D20 > > How can I upgrade to ovirt 3.5.1 with new glusterfs? I don't want data > > inconsistency/data loss/split brains? >=3D20 > Do you have a replica 3 volume setup across these 3 nodes? > Glusterfs supports rolling upgrade for replica volumes. > But there are some issues to upgrade from 3.5 to 3.6 versions (depending = =3D on > version used) > Adding gluster-users & Pranith for recommended procedures. > thanks > sahina > > Need I update gluster version to the latest? >=3D20 > > How I need to upgrade the nodes ? Is there any whitepaper about this? >=3D20 > > Thanks in advance, >=3D20 > > Tibor >=3D20 > > _______________________________________________ >=3D20 > > Users mailing list Users(a)ovirt.org > > http://lists.ovirt.org/mailman/listinfo/users >=3D20 ------=3D_Part_35854_1394331678.1422002918752 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable
Hi,

No,= =3D I have only one replica beetwen two nodes.
The third node is onl= =3D y a host for vms and that using this replica.

Than= =3D ks
Tibor



On 01/22/2015 08:03 PM, Demeter Tibor wrote:
= Hell=3D o,

I have an ovirt 3.5.0 cluster with three= =3D nodes and we using glusterfs for serving backend storage for VM-s. Gluster= =3D fs are on same servers with ovirt.
We have Gluster 3.5.1 on all o= =3D f nodes.

How can I upgrade to ovirt 3.5.1 with new= =3D glusterfs? I don't want data inconsistency/data loss/split brains?

Do you have a replica 3 volume setup across these 3 n= =3D odes?

Glusterfs supports rolling upgrade for replica volumes.
= =3D But there are some issues to upgrade from 3.5 to 3.6 versions (depending o= =3D n version used)
Adding gluster-users & Pranith for recommended proc= =3D edures.


thanks
sahina


Need I update gluster version to the latest?
How= =3D I need to upgrade the nodes ?  Is there any whitepaper about this?

Hi, > No, I have only one replica beetwen two nodes. > The third node is only a host for vms and that using this replica. > Thanks > Tibor > ----- Eredeti =3DC3=3DBCzenet ----- > > On 01/22/2015 08:03 PM, Demeter Tibor wrote: >=3D20 > > > Hello, > >=3D20 >=3D20 > > > I have an ovirt 3.5.0 cluster with three nodes and we using glusterfs= =3D for > > > serving backend storage for VM-s. Glusterfs are on same servers with > > > ovirt. > >=3D20 >=3D20 > > > We have Gluster 3.5.1 on all of nodes. > >=3D20 >=3D20 > > > How can I upgrade to ovirt 3.5.1 with new glusterfs? I don't want dat= =3D a > > > inconsistency/data loss/split brains? > >=3D20 >=3D20 > > Do you have a replica 3 volume setup across these 3 nodes? >=3D20 > > Glusterfs supports rolling upgrade for replica volumes. >=3D20 > > But there are some issues to upgrade from 3.5 to 3.6 versions (dependin= =3D g on > > version used) >=3D20 > > Adding gluster-users & Pranith for recommended procedures. >=3D20 > > thanks >=3D20 > > sahina >=3D20 > > > Need I update gluster version to the latest? > >=3D20 >=3D20 > > > How I need to upgrade the nodes ? Is there any whitepaper about this? > >=3D20 >=3D20 > > > Thanks in advance, > >=3D20 >=3D20 > > > Tibor > >=3D20 >=3D20 > > > _______________________________________________ > >=3D20 >=3D20 > > > Users mailing list Users(a)ovirt.org > > > http://lists.ovirt.org/mailman/listinfo/users > >=3D20 >=3D20 > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users ------=3D_Part_5562139_1153542656.1422789028385 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable

Hi,

Is = =3D glusterfs 3.6 is neccessary for ovirt 3.5.1?
I have 3.5.2 at this= =3D moment.

3.6 neccessary for upgade ? 

I'm worried what will happed with my gluster volumes afte= =3D r the upgrade... :(

Plese help me.

<= =3D /div>
Also, how can I upgrade the nodes? Need i'm to a "yum upgrade" on= =3D the compute nodes?

Thanks.

Tibor



Hi,

No, I have only one = =3D replica beetwen two nodes.
The third node is only a host for vms = =3D and that using this replica.

Thanks
Tibo= =3D r



On= 0=3D 1/22/2015 08:03 PM, Demeter Tibor wrote:
Hello,

I have an ovirt 3.5.0 cluster wi= =3D th three nodes and we using glusterfs for serving backend storage for VM-s.= =3D Glusterfs are on same servers with ovirt.
We have Gluster 3.5.1 = =3D on all of nodes.

How can I upgrade to ovirt 3.5.1 = =3D with new glusterfs? I don't want data inconsistency/data loss/split brains?= =3D

Do you have a replica 3 volume setup across t= =3D hese 3 nodes?

Glusterfs supports rolling upgrade for replica volum= =3D es.
But there are some issues to upgrade from 3.5 to 3.6 versions (dep= =3D ending on version used)
Adding gluster-users & Pranith for recommen= =3D ded procedures.


thanks
sahina


Need I update = =3D gluster version to the latest?
How I need to upgrade the nodes ? = =3D  Is there any whitepaper about this?



Thanks in advance,


Tibor



______________________________________=
=3D
_________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/=
us=3D
ers



______________= =3D _________________________________
Users mailing list
Users(a)ovirt.or= g<=3D br>http://lists.ovirt.org/mailman/listinfo/users

<= =3D /div>
------=3D_Part_5562139_1153542656.1422789028385-- --===============8848896548928761495== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS0tLS0tPV9QYXJ0XzU1NjIxMzlfMTE1MzU0MjY1Ni4xNDIyNzg5MDI4Mzg1CkNvbnRlbnQtVHlw ZTogdGV4dC9wbGFpbjsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiBx dW90ZWQtcHJpbnRhYmxlCgpIaSw9MjAKCklzIGdsdXN0ZXJmcyAzLjYgaXMgbmVjY2Vzc2FyeSBm b3Igb3ZpcnQgMy41LjE/PTIwCkkgaGF2ZSAzLjUuMiBhdCB0aGlzIG1vbWVudC49MjAKCjMuNiBu ZWNjZXNzYXJ5IGZvciB1cGdhZGUgPz0yMAoKSSdtIHdvcnJpZWQgd2hhdCB3aWxsIGhhcHBlZCB3 aXRoIG15IGdsdXN0ZXIgdm9sdW1lcyBhZnRlciB0aGUgdXBncmFkZS4uLiA6PQooPTIwCgpQbGVz ZSBoZWxwIG1lLj0yMAoKQWxzbywgaG93IGNhbiBJIHVwZ3JhZGUgdGhlIG5vZGVzPyBOZWVkIGkn bSB0byBhICJ5dW0gdXBncmFkZSIgb24gdGhlIGNvbXB1PQp0ZSBub2Rlcz89MjAKClRoYW5rcy49 MjAKClRpYm9yPTIwCgotLS0tLSBFcmVkZXRpID1DMz1CQ3plbmV0IC0tLS0tCgo+IEhpLAoKPiBO bywgSSBoYXZlIG9ubHkgb25lIHJlcGxpY2EgYmVldHdlbiB0d28gbm9kZXMuCj4gVGhlIHRoaXJk IG5vZGUgaXMgb25seSBhIGhvc3QgZm9yIHZtcyBhbmQgdGhhdCB1c2luZyB0aGlzIHJlcGxpY2Eu Cgo+IFRoYW5rcwo+IFRpYm9yCgo+IC0tLS0tIEVyZWRldGkgPUMzPUJDemVuZXQgLS0tLS0KCj4g PiBPbiAwMS8yMi8yMDE1IDA4OjAzIFBNLCBEZW1ldGVyIFRpYm9yIHdyb3RlOgo+PTIwCgo+ID4g PiBIZWxsbywKPiA+PTIwCj49MjAKCj4gPiA+IEkgaGF2ZSBhbiBvdmlydCAzLjUuMCBjbHVzdGVy IHdpdGggdGhyZWUgbm9kZXMgYW5kIHdlIHVzaW5nIGdsdXN0ZXJmcz0KIGZvcgo+ID4gPiBzZXJ2 aW5nIGJhY2tlbmQgc3RvcmFnZSBmb3IgVk0tcy4gR2x1c3RlcmZzIGFyZSBvbiBzYW1lIHNlcnZl cnMgd2l0aAo+ID4gPiBvdmlydC4KPiA+PTIwCj49MjAKPiA+ID4gV2UgaGF2ZSBHbHVzdGVyIDMu NS4xIG9uIGFsbCBvZiBub2Rlcy4KPiA+PTIwCj49MjAKCj4gPiA+IEhvdyBjYW4gSSB1cGdyYWRl IHRvIG92aXJ0IDMuNS4xIHdpdGggbmV3IGdsdXN0ZXJmcz8gSSBkb24ndCB3YW50IGRhdD0KYQo+ ID4gPiBpbmNvbnNpc3RlbmN5L2RhdGEgbG9zcy9zcGxpdCBicmFpbnM/Cj4gPj0yMAo+PTIwCgo+ ID4gRG8geW91IGhhdmUgYSByZXBsaWNhIDMgdm9sdW1lIHNldHVwIGFjcm9zcyB0aGVzZSAzIG5v ZGVzPwo+PTIwCgo+ID4gR2x1c3RlcmZzIHN1cHBvcnRzIHJvbGxpbmcgdXBncmFkZSBmb3IgcmVw bGljYSB2b2x1bWVzLgo+PTIwCj4gPiBCdXQgdGhlcmUgYXJlIHNvbWUgaXNzdWVzIHRvIHVwZ3Jh ZGUgZnJvbSAzLjUgdG8gMy42IHZlcnNpb25zIChkZXBlbmRpbj0KZyBvbgo+ID4gdmVyc2lvbiB1 c2VkKQo+PTIwCj4gPiBBZGRpbmcgZ2x1c3Rlci11c2VycyAmIFByYW5pdGggZm9yIHJlY29tbWVu ZGVkIHByb2NlZHVyZXMuCj49MjAKCj4gPiB0aGFua3MKPj0yMAo+ID4gc2FoaW5hCj49MjAKCj4g PiA+IE5lZWQgSSB1cGRhdGUgZ2x1c3RlciB2ZXJzaW9uIHRvIHRoZSBsYXRlc3Q/Cj4gPj0yMAo+ PTIwCj4gPiA+IEhvdyBJIG5lZWQgdG8gdXBncmFkZSB0aGUgbm9kZXMgPyBJcyB0aGVyZSBhbnkg d2hpdGVwYXBlciBhYm91dCB0aGlzPwo+ID49MjAKPj0yMAoKPiA+ID4gVGhhbmtzIGluIGFkdmFu Y2UsCj4gPj0yMAo+PTIwCgo+ID4gPiBUaWJvcgo+ID49MjAKPj0yMAoKPiA+ID4gX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KPiA+PTIwCj49MjAKPiA+ID4g VXNlcnMgbWFpbGluZyBsaXN0IFVzZXJzQG92aXJ0Lm9yZwo+ID4gPiBodHRwOi8vbGlzdHMub3Zp cnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMKPiA+PTIwCj49MjAKCj4gX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KPiBVc2VycyBtYWlsaW5nIGxpc3QK PiBVc2Vyc0BvdmlydC5vcmcKPiBodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGlu Zm8vdXNlcnMKCi0tLS0tLT1fUGFydF81NTYyMTM5XzExNTM1NDI2NTYuMTQyMjc4OTAyODM4NQpD b250ZW50LVR5cGU6IHRleHQvaHRtbDsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVu Y29kaW5nOiBxdW90ZWQtcHJpbnRhYmxlCgo8aHRtbD48Ym9keT48ZGl2IHN0eWxlPTNEImZvbnQt ZmFtaWx5OiB0aW1lcyBuZXcgcm9tYW4sIG5ldyB5b3JrLCB0aW1lcywgc2U9CnJpZjsgZm9udC1z aXplOiAxMnB0OyBjb2xvcjogIzAwMDAwMCI+PGRpdj5IaSw8L2Rpdj48ZGl2Pjxicj48L2Rpdj48 ZGl2PklzID0KZ2x1c3RlcmZzIDMuNiBpcyBuZWNjZXNzYXJ5IGZvciBvdmlydCAzLjUuMT88L2Rp dj48ZGl2PkkgaGF2ZSAzLjUuMiBhdCB0aGlzPQogbW9tZW50LjwvZGl2PjxkaXY+PGJyPjwvZGl2 PjxkaXY+My42IG5lY2Nlc3NhcnkgZm9yIHVwZ2FkZSA/Jm5ic3A7PC9kaXY+PGQ9Cml2Pjxicj48 L2Rpdj48ZGl2PkknbSB3b3JyaWVkIHdoYXQgd2lsbCBoYXBwZWQgd2l0aCBteSBnbHVzdGVyIHZv bHVtZXMgYWZ0ZT0KciB0aGUgdXBncmFkZS4uLiA6KDwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+ UGxlc2UgaGVscCBtZS48L2Rpdj48ZGl2Pjxicj48PQovZGl2PjxkaXY+QWxzbywgaG93IGNhbiBJ IHVwZ3JhZGUgdGhlIG5vZGVzPyBOZWVkIGknbSB0byBhICJ5dW0gdXBncmFkZSIgb249CiB0aGUg Y29tcHV0ZSBub2Rlcz88L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PlRoYW5rcy48L2Rpdj48ZGl2 Pjxicj48L2Rpdj48ZD0KaXY+VGlib3I8L2Rpdj48ZGl2PjxzcGFuIG5hbWU9M0QieCI+PC9zcGFu PjxwIHN0eWxlPTNEImZvbnQtZmFtaWx5OiAnVGltZXMgPQpOZXcgUm9tYW4nOyBmb250LXNpemU6 IG1lZGl1bTsgbWFyZ2luOiAwcHg7IiBkYXRhLW1jZS1zdHlsZT0zRCJmb250LWZhbWlseTo9CiAn VGltZXMgTmV3IFJvbWFuJzsgZm9udC1zaXplOiBtZWRpdW07IG1hcmdpbjogMHB4OyI+PGJyPjwv cD48L2Rpdj48aHIgaWQ9Cj0zRCJ6d2NociI+PGJsb2NrcXVvdGUgc3R5bGU9M0QiYm9yZGVyLWxl ZnQ6MnB4IHNvbGlkICMxMDEwRkY7bWFyZ2luLWxlZnQ6NT0KcHg7cGFkZGluZy1sZWZ0OjVweDtj b2xvcjojMDAwO2ZvbnQtd2VpZ2h0Om5vcm1hbDtmb250LXN0eWxlOm5vcm1hbDt0ZXh0LWRlPQpj b3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5OkhlbHZldGljYSxBcmlhbCxzYW5zLXNlcmlmO2ZvbnQt c2l6ZToxMnB0OyI+PGRpdiA9CnN0eWxlPTNEImZvbnQtZmFtaWx5OiB0aW1lcyBuZXcgcm9tYW4s IG5ldyB5b3JrLCB0aW1lcywgc2VyaWY7IGZvbnQtc2l6ZTogMT0KMnB0OyBjb2xvcjogIzAwMDAw MCI+PGRpdj5IaSw8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2Pk5vLCBJIGhhdmUgb25seSBvbmUg PQpyZXBsaWNhIGJlZXR3ZW4gdHdvIG5vZGVzLjwvZGl2PjxkaXY+VGhlIHRoaXJkIG5vZGUgaXMg b25seSBhIGhvc3QgZm9yIHZtcyA9CmFuZCB0aGF0IHVzaW5nIHRoaXMgcmVwbGljYS48L2Rpdj48 ZGl2Pjxicj48L2Rpdj48ZGl2PlRoYW5rczwvZGl2PjxkaXY+VGlibz0KcjwvZGl2PjxkaXY+PHNw YW4+PC9zcGFuPjxicj48L2Rpdj48aHIgaWQ9M0QiendjaHIiPjxibG9ja3F1b3RlIHN0eWxlPTNE ImJvPQpyZGVyLWxlZnQ6MnB4IHNvbGlkICMxMDEwRkY7bWFyZ2luLWxlZnQ6NXB4O3BhZGRpbmct bGVmdDo1cHg7Y29sb3I6IzAwMDtmb249CnQtd2VpZ2h0Om5vcm1hbDtmb250LXN0eWxlOm5vcm1h bDt0ZXh0LWRlY29yYXRpb246bm9uZTtmb250LWZhbWlseTpIZWx2ZXRpYz0KYSxBcmlhbCxzYW5z LXNlcmlmO2ZvbnQtc2l6ZToxMnB0OyI+PGJyPjxkaXYgY2xhc3M9M0QibW96LWNpdGUtcHJlZml4 Ij5PbiAwPQoxLzIyLzIwMTUgMDg6MDMgUE0sIERlbWV0ZXIgVGlib3Igd3JvdGU6PGJyPjwvZGl2 PjxibG9ja3F1b3RlIGNpdGU9M0QibWlkOjE9CjEyODc5NDIwOS4yMTA1NTM0Ni4xNDIxOTM3MTg2 ODEzLkphdmFNYWlsLnppbWJyYUBpdHNtYXJ0Lmh1Ij48ZGl2IHN0eWxlPTNEIj0KZm9udC1mYW1p bHk6IHRpbWVzIG5ldyByb21hbiwgbmV3IHlvcmssIHRpbWVzLCBzZXJpZjsKICAgICAgICBmb250 LXNpemU6IDEycHQ7IGNvbG9yOiAjMDAwMDAwIj48ZGl2PjxzcGFuIHN0eWxlPTNEImZvbnQtc2l6 ZTogMTJwPQp0OyI+SGVsbG8sPC9zcGFuPjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+SSBoYXZl IGFuIG92aXJ0IDMuNS4wIGNsdXN0ZXIgd2k9CnRoIHRocmVlIG5vZGVzIGFuZCB3ZSB1c2luZyBn bHVzdGVyZnMgZm9yIHNlcnZpbmcgYmFja2VuZCBzdG9yYWdlIGZvciBWTS1zLj0KIEdsdXN0ZXJm cyBhcmUgb24gc2FtZSBzZXJ2ZXJzIHdpdGggb3ZpcnQuPC9kaXY+PGRpdj5XZSBoYXZlIEdsdXN0 ZXIgMy41LjEgPQpvbiBhbGwgb2Ygbm9kZXMuPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5Ib3cg Y2FuIEkgdXBncmFkZSB0byBvdmlydCAzLjUuMSA9CndpdGggbmV3IGdsdXN0ZXJmcz8gSSBkb24n dCB3YW50IGRhdGEgaW5jb25zaXN0ZW5jeS9kYXRhIGxvc3Mvc3BsaXQgYnJhaW5zPz0KPC9kaXY+ PC9kaXY+PC9ibG9ja3F1b3RlPjxicj4gRG8geW91IGhhdmUgYSByZXBsaWNhIDMgdm9sdW1lIHNl dHVwIGFjcm9zcyB0PQpoZXNlIDMgbm9kZXM/PGJyPiA8YnI+IEdsdXN0ZXJmcyBzdXBwb3J0cyBy b2xsaW5nIHVwZ3JhZGUgZm9yIHJlcGxpY2Egdm9sdW09CmVzLiA8YnI+IEJ1dCB0aGVyZSBhcmUg c29tZSBpc3N1ZXMgdG8gdXBncmFkZSBmcm9tIDMuNSB0byAzLjYgdmVyc2lvbnMgKGRlcD0KZW5k aW5nIG9uIHZlcnNpb24gdXNlZCk8YnI+IEFkZGluZyBnbHVzdGVyLXVzZXJzICZhbXA7IFByYW5p dGggZm9yIHJlY29tbWVuPQpkZWQgcHJvY2VkdXJlcy48YnI+IDxicj4gPGJyPiB0aGFua3M8YnI+ IHNhaGluYTxicj4gPGJyPjxibG9ja3F1b3RlIGNpdGU9M0Q9CiJtaWQ6MTEyODc5NDIwOS4yMTA1 NTM0Ni4xNDIxOTM3MTg2ODEzLkphdmFNYWlsLnppbWJyYUBpdHNtYXJ0Lmh1Ij48ZGl2IHN0eT0K bGU9M0QiZm9udC1mYW1pbHk6IHRpbWVzIG5ldyByb21hbiwgbmV3IHlvcmssIHRpbWVzLCBzZXJp ZjsKICAgICAgICBmb250LXNpemU6IDEycHQ7IGNvbG9yOiAjMDAwMDAwIj48ZGl2Pjxicj48L2Rp dj48ZGl2Pk5lZWQgSSB1cGRhdGUgPQpnbHVzdGVyIHZlcnNpb24gdG8gdGhlIGxhdGVzdD88L2Rp dj48ZGl2PkhvdyBJIG5lZWQgdG8gdXBncmFkZSB0aGUgbm9kZXMgPyA9CiZuYnNwO0lzIHRoZXJl IGFueSB3aGl0ZXBhcGVyIGFib3V0IHRoaXM/PC9kaXY+PGRpdj48c3Bhbj48L3NwYW4+PHAgc3R5 bGU9Cj0zRCJmb250LWZhbWlseTogJ1RpbWVzIE5ldyBSb21hbic7IGZvbnQtc2l6ZTogbWVkaXVt OwogICAgICAgICAgICBtYXJnaW46IDBweDsiPjxzdHJvbmc+PHNwYW4gc3R5bGU9M0QiZm9udC1z aXplOiBtZWRpdW07Ij48c3BhbiA9CnN0eWxlPTNEImNvbG9yOgogICAgICAgICAgICAgICAgICBy Z2IoNDUsIDEwMywgMTc2KTsiPjxicj4gPC9zcGFuPjwvc3Bhbj48L3N0cm9uZz48L3A+PHAgc3Q9 CnlsZT0zRCJmb250LWZhbWlseTogJ1RpbWVzIE5ldyBSb21hbic7IGZvbnQtc2l6ZTogbWVkaXVt OwogICAgICAgICAgICBtYXJnaW46IDBweDsiPjxzdHJvbmc+PHNwYW4gc3R5bGU9M0QiZm9udC1z aXplOiBtZWRpdW07Ij48c3BhbiA9CnN0eWxlPTNEImNvbG9yOgogICAgICAgICAgICAgICAgICBy Z2IoNDUsIDEwMywgMTc2KTsiPjxicj4gPC9zcGFuPjwvc3Bhbj48L3N0cm9uZz48L3A+PHAgc3Q9 CnlsZT0zRCJmb250LWZhbWlseTogJ1RpbWVzIE5ldyBSb21hbic7IGZvbnQtc2l6ZTogbWVkaXVt OwogICAgICAgICAgICBtYXJnaW46IDBweDsiPlRoYW5rcyBpbiBhZHZhbmNlLDwvcD48cCBzdHls ZT0zRCJmb250LWZhbWlseTogJ1Q9CmltZXMgTmV3IFJvbWFuJzsgZm9udC1zaXplOiBtZWRpdW07 CiAgICAgICAgICAgIG1hcmdpbjogMHB4OyI+PGJyPjwvcD48cCBzdHlsZT0zRCJmb250LWZhbWls eTogJ1RpbWVzIE5ldyBSb21hbj0KJzsgZm9udC1zaXplOiBtZWRpdW07CiAgICAgICAgICAgIG1h cmdpbjogMHB4OyI+VGlib3I8L3A+PC9kaXY+PC9kaXY+PGJyPjxmaWVsZHNldCBjbGFzcz0zRCJt aW1lQT0KdHRhY2htZW50SGVhZGVyIj48L2ZpZWxkc2V0Pjxicj48cHJlPl9fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fPQpfX19fX19fX18KVXNlcnMgbWFpbGluZyBsaXN0Cjxh IGNsYXNzPTNEIm1vei10eHQtbGluay1hYmJyZXZpYXRlZCIgaHJlZj0zRCJtYWlsdG86VXNlcnNA b3ZpcnQub3JnIiB0YXJnZT0KdD0zRCJfYmxhbmsiPlVzZXJzQG92aXJ0Lm9yZzwvYT4KPGEgY2xh c3M9M0QibW96LXR4dC1saW5rLWZyZWV0ZXh0IiBocmVmPTNEImh0dHA6Ly9saXN0cy5vdmlydC5v cmcvbWFpbG1hbi9sPQppc3RpbmZvL3VzZXJzIiB0YXJnZXQ9M0QiX2JsYW5rIj5odHRwOi8vbGlz dHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXM9CmVyczwvYT4KPC9wcmU+PC9ibG9ja3F1 b3RlPjxicj48L2Jsb2NrcXVvdGU+PGRpdj48YnI+PC9kaXY+PC9kaXY+PGJyPl9fX19fX19fX19f X19fPQpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX188YnI+VXNlcnMgbWFpbGluZyBs aXN0PGJyPlVzZXJzQG92aXJ0Lm9yZzw9CmJyPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1h bi9saXN0aW5mby91c2Vyczxicj48L2Jsb2NrcXVvdGU+PGRpdj48YnI+PD0KL2Rpdj48L2Rpdj48 L2JvZHk+PC9odG1sPgotLS0tLS09X1BhcnRfNTU2MjEzOV8xMTUzNTQyNjU2LjE0MjI3ODkwMjgz ODUtLQo= --===============8848896548928761495==-- From sabose at redhat.com Mon Feb 2 03:48:09 2015 Content-Type: multipart/mixed; boundary="===============6488491056434093694==" MIME-Version: 1.0 From: Sahina Bose To: users at ovirt.org Subject: Re: [ovirt-users] Upgrade to 3.5.1 Date: Mon, 02 Feb 2015 14:17:59 +0530 Message-ID: <54CF39BF.8020308@redhat.com> In-Reply-To: 109054276.5562140.1422789028385.JavaMail.zimbra@itsmart.hu --===============6488491056434093694== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------020408090904020700050206 Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed Content-Transfer-Encoding: 7bit On 02/01/2015 04:40 PM, Demeter Tibor wrote: > Hi, > > Is glusterfs 3.6 is neccessary for ovirt 3.5.1? > I have 3.5.2 at this moment. > > 3.6 neccessary for upgade ? > If you only want to upgrade the engine to oVirt 3.5.1 - you don't need = to upgrade the gluster nodes. I understand that your gluster nodes are = separate from the virt nodes. That is, you do not have any cluster = enabled with both virt + gluster service. glusterfs 3.6 is not necessary to upgrade engine to oVirt 3.5.1. It = would only be required if you were upgrading the cluster level (the = compatibility version) which in turn would require newer vdsm versions = and gluster versions. But in your case, I think you already have your = cluster running with glusterfs 3.5.2. What is the cluster compatibility = version? > I'm worried what will happed with my gluster volumes after the = > upgrade... :( > > Plese help me. > > Also, how can I upgrade the nodes? Need i'm to a "yum upgrade" on the = > compute nodes? By upgrade the nodes - you mean only the compute nodes? yum upgrade on = each node should work. You can also move the Host to maintenance mode and click on Reinstall or = upgrade from engine. > > Thanks. > > Tibor > > > ------------------------------------------------------------------------ > > Hi, > > No, I have only one replica beetwen two nodes. > The third node is only a host for vms and that using this replica. > > Thanks > Tibor > > ---------------------------------------------------------------------= --- > > > On 01/22/2015 08:03 PM, Demeter Tibor wrote: > > Hello, > > I have an ovirt 3.5.0 cluster with three nodes and we > using glusterfs for serving backend storage for VM-s. > Glusterfs are on same servers with ovirt. > We have Gluster 3.5.1 on all of nodes. > > How can I upgrade to ovirt 3.5.1 with new glusterfs? I > don't want data inconsistency/data loss/split brains? > > > Do you have a replica 3 volume setup across these 3 nodes? > > Glusterfs supports rolling upgrade for replica volumes. > But there are some issues to upgrade from 3.5 to 3.6 versions > (depending on version used) > Adding gluster-users & Pranith for recommended procedures. > > > thanks > sahina > > > Need I update gluster version to the latest? > How I need to upgrade the nodes ? Is there any whitepaper > about this? > > * > * > > * > * > > Thanks in advance, > > > Tibor > > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > --------------020408090904020700050206 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 8bit
On 02/01/2015 04:40 PM, Demeter Tibor wrote:
Hi,

Is glusterfs 3.6 is neccessary for ovirt 3.5.1?
I have 3.5.2 at this moment.

3.6 neccessary for upgade ?=C2=A0


If you only want to upgrade the engine to oVirt 3.5.1 - you don't need to upgrade the gluster nodes. I understand that your gluster nodes are separate from the virt nodes. That is, you do not have any cluster enabled with both virt + gluster service.

glusterfs 3.6 is not necessary to upgrade engine to oVirt 3.5.1. It would only be required if you were upgrading the cluster level (the compatibility version) which in turn would require newer vdsm versions and gluster versions. But in your case, I think you already have your cluster running with glusterfs 3.5.2. What is the cluster compatibility version?


I'm worried what will happed with my gluster volumes after the upgrade... :(

Plese help me.

Also, how can I upgrade the nodes? Need i'm to a "yum upgrade" on the compute nodes?

By upgrade the nodes - you mean only the compute nodes? yum upgrade on each node should work.
You can also move the Host to maintenance mode and click on Reinstall or upgrade from engine.



Thanks.

Tibor



Hi,

No, I have only one replica beetwen two nodes.
The third node is only a host for vms and that using this replica.

Thanks
Tibor



On 01/22/2015 08:03 PM, Demeter Tibor wrote:
Hello,

I have an ovirt 3.5.0 cluster with three nodes and we using glusterfs for serving backend storage for VM-s. Glusterfs are on same servers with ovirt.
We have Gluster 3.5.1 on all of nodes.

How can I upgrade to ovirt 3.5.1 with new glusterfs? I don't want data inconsistency/data loss/split brains?

Do you have a replica 3 volume setup across these 3 nodes?

Glusterfs supports rolling upgrade for replica volumes.
But there are some issues to upgrade from 3.5 to 3.6 versions (depending on version used)
Adding gluster-users & Pranith for recommended procedures.


thanks
sahina


Need I update gluster version to the latest?
How I need to upgrade the nodes ? =C2=A0Is there any whitepaper about this?



Thanks in advance,


Tibor



_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovir=
t.org/mailman/listinfo/users



_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users<= br>


--------------020408090904020700050206-- --===============6488491056434093694== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS0wMjA0MDgwOTA5MDQwMjA3MDAwNTAyMDYKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXV0Zi04OyBmb3JtYXQ9Zmxvd2VkCkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDdiaXQK CgpPbiAwMi8wMS8yMDE1IDA0OjQwIFBNLCBEZW1ldGVyIFRpYm9yIHdyb3RlOgo+IEhpLAo+Cj4g SXMgZ2x1c3RlcmZzIDMuNiBpcyBuZWNjZXNzYXJ5IGZvciBvdmlydCAzLjUuMT8KPiBJIGhhdmUg My41LjIgYXQgdGhpcyBtb21lbnQuCj4KPiAzLjYgbmVjY2Vzc2FyeSBmb3IgdXBnYWRlID8KPgoK SWYgeW91IG9ubHkgd2FudCB0byB1cGdyYWRlIHRoZSBlbmdpbmUgdG8gb1ZpcnQgMy41LjEgLSB5 b3UgZG9uJ3QgbmVlZCAKdG8gdXBncmFkZSB0aGUgZ2x1c3RlciBub2Rlcy4gSSB1bmRlcnN0YW5k IHRoYXQgeW91ciBnbHVzdGVyIG5vZGVzIGFyZSAKc2VwYXJhdGUgZnJvbSB0aGUgdmlydCBub2Rl cy4gVGhhdCBpcywgeW91IGRvIG5vdCBoYXZlIGFueSBjbHVzdGVyIAplbmFibGVkIHdpdGggYm90 aCB2aXJ0ICsgZ2x1c3RlciBzZXJ2aWNlLgoKZ2x1c3RlcmZzIDMuNiBpcyBub3QgbmVjZXNzYXJ5 IHRvIHVwZ3JhZGUgZW5naW5lIHRvIG9WaXJ0IDMuNS4xLiBJdCAKd291bGQgb25seSBiZSByZXF1 aXJlZCBpZiB5b3Ugd2VyZSB1cGdyYWRpbmcgdGhlIGNsdXN0ZXIgbGV2ZWwgKHRoZSAKY29tcGF0 aWJpbGl0eSB2ZXJzaW9uKSB3aGljaCBpbiB0dXJuIHdvdWxkIHJlcXVpcmUgbmV3ZXIgdmRzbSB2 ZXJzaW9ucyAKYW5kIGdsdXN0ZXIgdmVyc2lvbnMuIEJ1dCBpbiB5b3VyIGNhc2UsIEkgdGhpbmsg eW91IGFscmVhZHkgaGF2ZSB5b3VyIApjbHVzdGVyIHJ1bm5pbmcgd2l0aCBnbHVzdGVyZnMgMy41 LjIuIFdoYXQgaXMgdGhlIGNsdXN0ZXIgY29tcGF0aWJpbGl0eSAKdmVyc2lvbj8KCgo+IEknbSB3 b3JyaWVkIHdoYXQgd2lsbCBoYXBwZWQgd2l0aCBteSBnbHVzdGVyIHZvbHVtZXMgYWZ0ZXIgdGhl IAo+IHVwZ3JhZGUuLi4gOigKPgo+IFBsZXNlIGhlbHAgbWUuCj4KPiBBbHNvLCBob3cgY2FuIEkg dXBncmFkZSB0aGUgbm9kZXM/IE5lZWQgaSdtIHRvIGEgInl1bSB1cGdyYWRlIiBvbiB0aGUgCj4g Y29tcHV0ZSBub2Rlcz8KCkJ5IHVwZ3JhZGUgdGhlIG5vZGVzIC0geW91IG1lYW4gb25seSB0aGUg Y29tcHV0ZSBub2Rlcz8geXVtIHVwZ3JhZGUgb24gCmVhY2ggbm9kZSBzaG91bGQgd29yay4KWW91 IGNhbiBhbHNvIG1vdmUgdGhlIEhvc3QgdG8gbWFpbnRlbmFuY2UgbW9kZSBhbmQgY2xpY2sgb24g UmVpbnN0YWxsIG9yIAp1cGdyYWRlIGZyb20gZW5naW5lLgoKCj4KPiBUaGFua3MuCj4KPiBUaWJv cgo+Cj4KPiAtLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KPgo+ICAgICBIaSwKPgo+ICAgICBObywgSSBoYXZlIG9u bHkgb25lIHJlcGxpY2EgYmVldHdlbiB0d28gbm9kZXMuCj4gICAgIFRoZSB0aGlyZCBub2RlIGlz IG9ubHkgYSBob3N0IGZvciB2bXMgYW5kIHRoYXQgdXNpbmcgdGhpcyByZXBsaWNhLgo+Cj4gICAg IFRoYW5rcwo+ICAgICBUaWJvcgo+Cj4gICAgIC0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLQo+Cj4KPiAgICAgICAg IE9uIDAxLzIyLzIwMTUgMDg6MDMgUE0sIERlbWV0ZXIgVGlib3Igd3JvdGU6Cj4KPiAgICAgICAg ICAgICBIZWxsbywKPgo+ICAgICAgICAgICAgIEkgaGF2ZSBhbiBvdmlydCAzLjUuMCBjbHVzdGVy IHdpdGggdGhyZWUgbm9kZXMgYW5kIHdlCj4gICAgICAgICAgICAgdXNpbmcgZ2x1c3RlcmZzIGZv ciBzZXJ2aW5nIGJhY2tlbmQgc3RvcmFnZSBmb3IgVk0tcy4KPiAgICAgICAgICAgICBHbHVzdGVy ZnMgYXJlIG9uIHNhbWUgc2VydmVycyB3aXRoIG92aXJ0Lgo+ICAgICAgICAgICAgIFdlIGhhdmUg R2x1c3RlciAzLjUuMSBvbiBhbGwgb2Ygbm9kZXMuCj4KPiAgICAgICAgICAgICBIb3cgY2FuIEkg dXBncmFkZSB0byBvdmlydCAzLjUuMSB3aXRoIG5ldyBnbHVzdGVyZnM/IEkKPiAgICAgICAgICAg ICBkb24ndCB3YW50IGRhdGEgaW5jb25zaXN0ZW5jeS9kYXRhIGxvc3Mvc3BsaXQgYnJhaW5zPwo+ Cj4KPiAgICAgICAgIERvIHlvdSBoYXZlIGEgcmVwbGljYSAzIHZvbHVtZSBzZXR1cCBhY3Jvc3Mg dGhlc2UgMyBub2Rlcz8KPgo+ICAgICAgICAgR2x1c3RlcmZzIHN1cHBvcnRzIHJvbGxpbmcgdXBn cmFkZSBmb3IgcmVwbGljYSB2b2x1bWVzLgo+ICAgICAgICAgQnV0IHRoZXJlIGFyZSBzb21lIGlz c3VlcyB0byB1cGdyYWRlIGZyb20gMy41IHRvIDMuNiB2ZXJzaW9ucwo+ICAgICAgICAgKGRlcGVu ZGluZyBvbiB2ZXJzaW9uIHVzZWQpCj4gICAgICAgICBBZGRpbmcgZ2x1c3Rlci11c2VycyAmIFBy YW5pdGggZm9yIHJlY29tbWVuZGVkIHByb2NlZHVyZXMuCj4KPgo+ICAgICAgICAgdGhhbmtzCj4g ICAgICAgICBzYWhpbmEKPgo+Cj4gICAgICAgICAgICAgTmVlZCBJIHVwZGF0ZSBnbHVzdGVyIHZl cnNpb24gdG8gdGhlIGxhdGVzdD8KPiAgICAgICAgICAgICBIb3cgSSBuZWVkIHRvIHVwZ3JhZGUg dGhlIG5vZGVzID8gIElzIHRoZXJlIGFueSB3aGl0ZXBhcGVyCj4gICAgICAgICAgICAgYWJvdXQg dGhpcz8KPgo+ICAgICAgICAgICAgICoKPiAgICAgICAgICAgICAqCj4KPiAgICAgICAgICAgICAq Cj4gICAgICAgICAgICAgKgo+Cj4gICAgICAgICAgICAgVGhhbmtzIGluIGFkdmFuY2UsCj4KPgo+ ICAgICAgICAgICAgIFRpYm9yCj4KPgo+Cj4gICAgICAgICAgICAgX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX18KPiAgICAgICAgICAgICBVc2VycyBtYWlsaW5n IGxpc3QKPiAgICAgICAgICAgICBVc2Vyc0BvdmlydC5vcmcKPiAgICAgICAgICAgICBodHRwOi8v bGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMKPgo+Cj4KPgo+ICAgICBfX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwo+ICAgICBVc2VycyBt YWlsaW5nIGxpc3QKPiAgICAgVXNlcnNAb3ZpcnQub3JnCj4gICAgIGh0dHA6Ly9saXN0cy5vdmly dC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2Vycwo+Cj4KCgotLS0tLS0tLS0tLS0tLTAyMDQwODA5 MDkwNDAyMDcwMDA1MDIwNgpDb250ZW50LVR5cGU6IHRleHQvaHRtbDsgY2hhcnNldD11dGYtOApD b250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA4Yml0Cgo8aHRtbD4KICA8aGVhZD4KICAgIDxtZXRh IGNvbnRlbnQ9InRleHQvaHRtbDsgY2hhcnNldD11dGYtOCIgaHR0cC1lcXVpdj0iQ29udGVudC1U eXBlIj4KICA8L2hlYWQ+CiAgPGJvZHkgYmdjb2xvcj0iI0ZGRkZGRiIgdGV4dD0iIzAwMDAwMCI+ CiAgICA8YnI+CiAgICA8ZGl2IGNsYXNzPSJtb3otY2l0ZS1wcmVmaXgiPk9uIDAyLzAxLzIwMTUg MDQ6NDAgUE0sIERlbWV0ZXIgVGlib3IKICAgICAgd3JvdGU6PGJyPgogICAgPC9kaXY+CiAgICA8 YmxvY2txdW90ZQogICAgICBjaXRlPSJtaWQ6MTA5MDU0Mjc2LjU1NjIxNDAuMTQyMjc4OTAyODM4 NS5KYXZhTWFpbC56aW1icmFAaXRzbWFydC5odSIKICAgICAgdHlwZT0iY2l0ZSI+CiAgICAgIDxk aXYgc3R5bGU9ImZvbnQtZmFtaWx5OiB0aW1lcyBuZXcgcm9tYW4sIG5ldyB5b3JrLCB0aW1lcywg c2VyaWY7CiAgICAgICAgZm9udC1zaXplOiAxMnB0OyBjb2xvcjogIzAwMDAwMCI+CiAgICAgICAg PGRpdj5IaSw8L2Rpdj4KICAgICAgICA8ZGl2Pjxicj4KICAgICAgICA8L2Rpdj4KICAgICAgICA8 ZGl2PklzIGdsdXN0ZXJmcyAzLjYgaXMgbmVjY2Vzc2FyeSBmb3Igb3ZpcnQgMy41LjE/PC9kaXY+ CiAgICAgICAgPGRpdj5JIGhhdmUgMy41LjIgYXQgdGhpcyBtb21lbnQuPC9kaXY+CiAgICAgICAg PGRpdj48YnI+CiAgICAgICAgPC9kaXY+CiAgICAgICAgPGRpdj4zLjYgbmVjY2Vzc2FyeSBmb3Ig dXBnYWRlID/CoDwvZGl2PgogICAgICAgIDxkaXY+PGJyPgogICAgICAgIDwvZGl2PgogICAgICA8 L2Rpdj4KICAgIDwvYmxvY2txdW90ZT4KICAgIDxicj4KICAgIElmIHlvdSBvbmx5IHdhbnQgdG8g dXBncmFkZSB0aGUgZW5naW5lIHRvIG9WaXJ0IDMuNS4xIC0geW91IGRvbid0CiAgICBuZWVkIHRv IHVwZ3JhZGUgdGhlIGdsdXN0ZXIgbm9kZXMuIEkgdW5kZXJzdGFuZCB0aGF0IHlvdXIgZ2x1c3Rl cgogICAgbm9kZXMgYXJlIHNlcGFyYXRlIGZyb20gdGhlIHZpcnQgbm9kZXMuIFRoYXQgaXMsIHlv dSBkbyBub3QgaGF2ZSBhbnkKICAgIGNsdXN0ZXIgZW5hYmxlZCB3aXRoIGJvdGggdmlydCArIGds dXN0ZXIgc2VydmljZS48YnI+CiAgICA8YnI+CiAgICBnbHVzdGVyZnMgMy42IGlzIG5vdCBuZWNl c3NhcnkgdG8gdXBncmFkZSBlbmdpbmUgdG8gb1ZpcnQgMy41LjEuIEl0CiAgICB3b3VsZCBvbmx5 IGJlIHJlcXVpcmVkIGlmIHlvdSB3ZXJlIHVwZ3JhZGluZyB0aGUgY2x1c3RlciBsZXZlbCAodGhl CiAgICBjb21wYXRpYmlsaXR5IHZlcnNpb24pIHdoaWNoIGluIHR1cm4gd291bGQgcmVxdWlyZSBu ZXdlciB2ZHNtCiAgICB2ZXJzaW9ucyBhbmQgZ2x1c3RlciB2ZXJzaW9ucy4gQnV0IGluIHlvdXIg Y2FzZSwgSSB0aGluayB5b3UgYWxyZWFkeQogICAgaGF2ZSB5b3VyIGNsdXN0ZXIgcnVubmluZyB3 aXRoIGdsdXN0ZXJmcyAzLjUuMi4gV2hhdCBpcyB0aGUgY2x1c3RlcgogICAgY29tcGF0aWJpbGl0 eSB2ZXJzaW9uPzxicj4KICAgIDxicj4KICAgIDxicj4KICAgIDxibG9ja3F1b3RlCiAgICAgIGNp dGU9Im1pZDoxMDkwNTQyNzYuNTU2MjE0MC4xNDIyNzg5MDI4Mzg1LkphdmFNYWlsLnppbWJyYUBp dHNtYXJ0Lmh1IgogICAgICB0eXBlPSJjaXRlIj4KICAgICAgPGRpdiBzdHlsZT0iZm9udC1mYW1p bHk6IHRpbWVzIG5ldyByb21hbiwgbmV3IHlvcmssIHRpbWVzLCBzZXJpZjsKICAgICAgICBmb250 LXNpemU6IDEycHQ7IGNvbG9yOiAjMDAwMDAwIj4KICAgICAgICA8ZGl2PkknbSB3b3JyaWVkIHdo YXQgd2lsbCBoYXBwZWQgd2l0aCBteSBnbHVzdGVyIHZvbHVtZXMgYWZ0ZXIKICAgICAgICAgIHRo ZSB1cGdyYWRlLi4uIDooPC9kaXY+CiAgICAgICAgPGRpdj48YnI+CiAgICAgICAgPC9kaXY+CiAg ICAgICAgPGRpdj5QbGVzZSBoZWxwIG1lLjwvZGl2PgogICAgICAgIDxkaXY+PGJyPgogICAgICAg IDwvZGl2PgogICAgICAgIDxkaXY+QWxzbywgaG93IGNhbiBJIHVwZ3JhZGUgdGhlIG5vZGVzPyBO ZWVkIGknbSB0byBhICJ5dW0KICAgICAgICAgIHVwZ3JhZGUiIG9uIHRoZSBjb21wdXRlIG5vZGVz PzwvZGl2PgogICAgICA8L2Rpdj4KICAgIDwvYmxvY2txdW90ZT4KICAgIDxicj4KICAgIEJ5IHVw Z3JhZGUgdGhlIG5vZGVzIC0geW91IG1lYW4gb25seSB0aGUgY29tcHV0ZSBub2Rlcz8geXVtIHVw Z3JhZGUKICAgIG9uIGVhY2ggbm9kZSBzaG91bGQgd29yay48YnI+CiAgICBZb3UgY2FuIGFsc28g bW92ZSB0aGUgSG9zdCB0byBtYWludGVuYW5jZSBtb2RlIGFuZCBjbGljayBvbgogICAgUmVpbnN0 YWxsIG9yIHVwZ3JhZGUgZnJvbSBlbmdpbmUuPGJyPgogICAgPGJyPgogICAgPGJyPgogICAgPGJs b2NrcXVvdGUKICAgICAgY2l0ZT0ibWlkOjEwOTA1NDI3Ni41NTYyMTQwLjE0MjI3ODkwMjgzODUu SmF2YU1haWwuemltYnJhQGl0c21hcnQuaHUiCiAgICAgIHR5cGU9ImNpdGUiPgogICAgICA8ZGl2 IHN0eWxlPSJmb250LWZhbWlseTogdGltZXMgbmV3IHJvbWFuLCBuZXcgeW9yaywgdGltZXMsIHNl cmlmOwogICAgICAgIGZvbnQtc2l6ZTogMTJwdDsgY29sb3I6ICMwMDAwMDAiPgogICAgICAgIDxk aXY+PGJyPgogICAgICAgIDwvZGl2PgogICAgICAgIDxkaXY+VGhhbmtzLjwvZGl2PgogICAgICAg IDxkaXY+PGJyPgogICAgICAgIDwvZGl2PgogICAgICAgIDxkaXY+VGlib3I8L2Rpdj4KICAgICAg ICA8ZGl2PjxzcGFuIG5hbWU9IngiPjwvc3Bhbj4KICAgICAgICAgIDxwIHN0eWxlPSJmb250LWZh bWlseTogJ1RpbWVzIE5ldyBSb21hbic7IGZvbnQtc2l6ZTogbWVkaXVtOwogICAgICAgICAgICBt YXJnaW46IDBweDsiIGRhdGEtbWNlLXN0eWxlPSJmb250LWZhbWlseTogJ1RpbWVzIE5ldwogICAg ICAgICAgICBSb21hbic7IGZvbnQtc2l6ZTogbWVkaXVtOyBtYXJnaW46IDBweDsiPjxicj4KICAg ICAgICAgIDwvcD4KICAgICAgICA8L2Rpdj4KICAgICAgICA8aHIgaWQ9Inp3Y2hyIj4KICAgICAg ICA8YmxvY2txdW90ZSBzdHlsZT0iYm9yZGVyLWxlZnQ6MnB4IHNvbGlkCiMxMDEwRkY7bWFyZ2lu LWxlZnQ6NXB4O3BhZGRpbmctbGVmdDo1cHg7Y29sb3I6IzAwMDtmb250LXdlaWdodDpub3JtYWw7 Zm9udC1zdHlsZTpub3JtYWw7dGV4dC1kZWNvcmF0aW9uOm5vbmU7Zm9udC1mYW1pbHk6SGVsdmV0 aWNhLEFyaWFsLHNhbnMtc2VyaWY7Zm9udC1zaXplOjEycHQ7Ij4KICAgICAgICAgIDxkaXYgc3R5 bGU9ImZvbnQtZmFtaWx5OiB0aW1lcyBuZXcgcm9tYW4sIG5ldyB5b3JrLCB0aW1lcywKICAgICAg ICAgICAgc2VyaWY7IGZvbnQtc2l6ZTogMTJwdDsgY29sb3I6ICMwMDAwMDAiPgogICAgICAgICAg ICA8ZGl2PkhpLDwvZGl2PgogICAgICAgICAgICA8ZGl2Pjxicj4KICAgICAgICAgICAgPC9kaXY+ CiAgICAgICAgICAgIDxkaXY+Tm8sIEkgaGF2ZSBvbmx5IG9uZSByZXBsaWNhIGJlZXR3ZW4gdHdv IG5vZGVzLjwvZGl2PgogICAgICAgICAgICA8ZGl2PlRoZSB0aGlyZCBub2RlIGlzIG9ubHkgYSBo b3N0IGZvciB2bXMgYW5kIHRoYXQgdXNpbmcKICAgICAgICAgICAgICB0aGlzIHJlcGxpY2EuPC9k aXY+CiAgICAgICAgICAgIDxkaXY+PGJyPgogICAgICAgICAgICA8L2Rpdj4KICAgICAgICAgICAg PGRpdj5UaGFua3M8L2Rpdj4KICAgICAgICAgICAgPGRpdj5UaWJvcjwvZGl2PgogICAgICAgICAg ICA8ZGl2PjxzcGFuPjwvc3Bhbj48YnI+CiAgICAgICAgICAgIDwvZGl2PgogICAgICAgICAgICA8 aHIgaWQ9Inp3Y2hyIj4KICAgICAgICAgICAgPGJsb2NrcXVvdGUgc3R5bGU9ImJvcmRlci1sZWZ0 OjJweCBzb2xpZAojMTAxMEZGO21hcmdpbi1sZWZ0OjVweDtwYWRkaW5nLWxlZnQ6NXB4O2NvbG9y OiMwMDA7Zm9udC13ZWlnaHQ6bm9ybWFsO2ZvbnQtc3R5bGU6bm9ybWFsO3RleHQtZGVjb3JhdGlv bjpub25lO2ZvbnQtZmFtaWx5OkhlbHZldGljYSxBcmlhbCxzYW5zLXNlcmlmO2ZvbnQtc2l6ZTox MnB0OyI+PGJyPgogICAgICAgICAgICAgIDxkaXYgY2xhc3M9Im1vei1jaXRlLXByZWZpeCI+T24g MDEvMjIvMjAxNSAwODowMyBQTSwKICAgICAgICAgICAgICAgIERlbWV0ZXIgVGlib3Igd3JvdGU6 PGJyPgogICAgICAgICAgICAgIDwvZGl2PgogICAgICAgICAgICAgIDxibG9ja3F1b3RlCiAgICAg ICAgICAgICAgICBjaXRlPSJtaWQ6MTEyODc5NDIwOS4yMTA1NTM0Ni4xNDIxOTM3MTg2ODEzLkph dmFNYWlsLnppbWJyYUBpdHNtYXJ0Lmh1Ij4KICAgICAgICAgICAgICAgIDxkaXYgc3R5bGU9ImZv bnQtZmFtaWx5OiB0aW1lcyBuZXcgcm9tYW4sIG5ldyB5b3JrLAogICAgICAgICAgICAgICAgICB0 aW1lcywgc2VyaWY7IGZvbnQtc2l6ZTogMTJwdDsgY29sb3I6ICMwMDAwMDAiPgogICAgICAgICAg ICAgICAgICA8ZGl2PjxzcGFuIHN0eWxlPSJmb250LXNpemU6IDEycHQ7Ij5IZWxsbyw8L3NwYW4+ PC9kaXY+CiAgICAgICAgICAgICAgICAgIDxkaXY+PGJyPgogICAgICAgICAgICAgICAgICA8L2Rp dj4KICAgICAgICAgICAgICAgICAgPGRpdj5JIGhhdmUgYW4gb3ZpcnQgMy41LjAgY2x1c3RlciB3 aXRoIHRocmVlIG5vZGVzCiAgICAgICAgICAgICAgICAgICAgYW5kIHdlIHVzaW5nIGdsdXN0ZXJm cyBmb3Igc2VydmluZyBiYWNrZW5kIHN0b3JhZ2UKICAgICAgICAgICAgICAgICAgICBmb3IgVk0t cy4gR2x1c3RlcmZzIGFyZSBvbiBzYW1lIHNlcnZlcnMgd2l0aCBvdmlydC48L2Rpdj4KICAgICAg ICAgICAgICAgICAgPGRpdj5XZSBoYXZlIEdsdXN0ZXIgMy41LjEgb24gYWxsIG9mIG5vZGVzLjwv ZGl2PgogICAgICAgICAgICAgICAgICA8ZGl2Pjxicj4KICAgICAgICAgICAgICAgICAgPC9kaXY+ CiAgICAgICAgICAgICAgICAgIDxkaXY+SG93IGNhbiBJIHVwZ3JhZGUgdG8gb3ZpcnQgMy41LjEg d2l0aCBuZXcKICAgICAgICAgICAgICAgICAgICBnbHVzdGVyZnM/IEkgZG9uJ3Qgd2FudCBkYXRh IGluY29uc2lzdGVuY3kvZGF0YQogICAgICAgICAgICAgICAgICAgIGxvc3Mvc3BsaXQgYnJhaW5z PzwvZGl2PgogICAgICAgICAgICAgICAgPC9kaXY+CiAgICAgICAgICAgICAgPC9ibG9ja3F1b3Rl PgogICAgICAgICAgICAgIDxicj4KICAgICAgICAgICAgICBEbyB5b3UgaGF2ZSBhIHJlcGxpY2Eg MyB2b2x1bWUgc2V0dXAgYWNyb3NzIHRoZXNlIDMgbm9kZXM/PGJyPgogICAgICAgICAgICAgIDxi cj4KICAgICAgICAgICAgICBHbHVzdGVyZnMgc3VwcG9ydHMgcm9sbGluZyB1cGdyYWRlIGZvciBy ZXBsaWNhIHZvbHVtZXMuIDxicj4KICAgICAgICAgICAgICBCdXQgdGhlcmUgYXJlIHNvbWUgaXNz dWVzIHRvIHVwZ3JhZGUgZnJvbSAzLjUgdG8gMy42CiAgICAgICAgICAgICAgdmVyc2lvbnMgKGRl cGVuZGluZyBvbiB2ZXJzaW9uIHVzZWQpPGJyPgogICAgICAgICAgICAgIEFkZGluZyBnbHVzdGVy LXVzZXJzICZhbXA7IFByYW5pdGggZm9yIHJlY29tbWVuZGVkCiAgICAgICAgICAgICAgcHJvY2Vk dXJlcy48YnI+CiAgICAgICAgICAgICAgPGJyPgogICAgICAgICAgICAgIDxicj4KICAgICAgICAg ICAgICB0aGFua3M8YnI+CiAgICAgICAgICAgICAgc2FoaW5hPGJyPgogICAgICAgICAgICAgIDxi cj4KICAgICAgICAgICAgICA8YmxvY2txdW90ZQogICAgICAgICAgICAgICAgY2l0ZT0ibWlkOjEx Mjg3OTQyMDkuMjEwNTUzNDYuMTQyMTkzNzE4NjgxMy5KYXZhTWFpbC56aW1icmFAaXRzbWFydC5o dSI+CiAgICAgICAgICAgICAgICA8ZGl2IHN0eWxlPSJmb250LWZhbWlseTogdGltZXMgbmV3IHJv bWFuLCBuZXcgeW9yaywKICAgICAgICAgICAgICAgICAgdGltZXMsIHNlcmlmOyBmb250LXNpemU6 IDEycHQ7IGNvbG9yOiAjMDAwMDAwIj4KICAgICAgICAgICAgICAgICAgPGRpdj48YnI+CiAgICAg ICAgICAgICAgICAgIDwvZGl2PgogICAgICAgICAgICAgICAgICA8ZGl2Pk5lZWQgSSB1cGRhdGUg Z2x1c3RlciB2ZXJzaW9uIHRvIHRoZSBsYXRlc3Q/PC9kaXY+CiAgICAgICAgICAgICAgICAgIDxk aXY+SG93IEkgbmVlZCB0byB1cGdyYWRlIHRoZSBub2RlcyA/IMKgSXMgdGhlcmUgYW55CiAgICAg ICAgICAgICAgICAgICAgd2hpdGVwYXBlciBhYm91dCB0aGlzPzwvZGl2PgogICAgICAgICAgICAg ICAgICA8ZGl2PjxzcGFuPjwvc3Bhbj4KICAgICAgICAgICAgICAgICAgICA8cCBzdHlsZT0iZm9u dC1mYW1pbHk6ICdUaW1lcyBOZXcgUm9tYW4nOyBmb250LXNpemU6CiAgICAgICAgICAgICAgICAg ICAgICBtZWRpdW07IG1hcmdpbjogMHB4OyI+PHN0cm9uZz48c3BhbgogICAgICAgICAgICAgICAg ICAgICAgICAgIHN0eWxlPSJmb250LXNpemU6IG1lZGl1bTsiPjxzcGFuIHN0eWxlPSJjb2xvcjoK ICAgICAgICAgICAgICAgICAgICAgICAgICAgIHJnYig0NSwgMTAzLCAxNzYpOyI+PGJyPgogICAg ICAgICAgICAgICAgICAgICAgICAgIDwvc3Bhbj48L3NwYW4+PC9zdHJvbmc+PC9wPgogICAgICAg ICAgICAgICAgICAgIDxwIHN0eWxlPSJmb250LWZhbWlseTogJ1RpbWVzIE5ldyBSb21hbic7IGZv bnQtc2l6ZToKICAgICAgICAgICAgICAgICAgICAgIG1lZGl1bTsgbWFyZ2luOiAwcHg7Ij48c3Ry b25nPjxzcGFuCiAgICAgICAgICAgICAgICAgICAgICAgICAgc3R5bGU9ImZvbnQtc2l6ZTogbWVk aXVtOyI+PHNwYW4gc3R5bGU9ImNvbG9yOgogICAgICAgICAgICAgICAgICAgICAgICAgICAgcmdi KDQ1LCAxMDMsIDE3Nik7Ij48YnI+CiAgICAgICAgICAgICAgICAgICAgICAgICAgPC9zcGFuPjwv c3Bhbj48L3N0cm9uZz48L3A+CiAgICAgICAgICAgICAgICAgICAgPHAgc3R5bGU9ImZvbnQtZmFt aWx5OiAnVGltZXMgTmV3IFJvbWFuJzsgZm9udC1zaXplOgogICAgICAgICAgICAgICAgICAgICAg bWVkaXVtOyBtYXJnaW46IDBweDsiPlRoYW5rcyBpbiBhZHZhbmNlLDwvcD4KICAgICAgICAgICAg ICAgICAgICA8cCBzdHlsZT0iZm9udC1mYW1pbHk6ICdUaW1lcyBOZXcgUm9tYW4nOyBmb250LXNp emU6CiAgICAgICAgICAgICAgICAgICAgICBtZWRpdW07IG1hcmdpbjogMHB4OyI+PGJyPgogICAg ICAgICAgICAgICAgICAgIDwvcD4KICAgICAgICAgICAgICAgICAgICA8cCBzdHlsZT0iZm9udC1m YW1pbHk6ICdUaW1lcyBOZXcgUm9tYW4nOyBmb250LXNpemU6CiAgICAgICAgICAgICAgICAgICAg ICBtZWRpdW07IG1hcmdpbjogMHB4OyI+VGlib3I8L3A+CiAgICAgICAgICAgICAgICAgIDwvZGl2 PgogICAgICAgICAgICAgICAgPC9kaXY+CiAgICAgICAgICAgICAgICA8YnI+CiAgICAgICAgICAg ICAgICA8ZmllbGRzZXQgY2xhc3M9Im1pbWVBdHRhY2htZW50SGVhZGVyIj48L2ZpZWxkc2V0Pgog ICAgICAgICAgICAgICAgPGJyPgogICAgICAgICAgICAgICAgPHByZT5fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpVc2VycyBtYWlsaW5nIGxpc3QKPGEgbW96 LWRvLW5vdC1zZW5kPSJ0cnVlIiBjbGFzcz0ibW96LXR4dC1saW5rLWFiYnJldmlhdGVkIiBocmVm PSJtYWlsdG86VXNlcnNAb3ZpcnQub3JnIiB0YXJnZXQ9Il9ibGFuayI+VXNlcnNAb3ZpcnQub3Jn PC9hPgo8YSBtb3otZG8tbm90LXNlbmQ9InRydWUiIGNsYXNzPSJtb3otdHh0LWxpbmstZnJlZXRl eHQiIGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycyIg dGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91 c2VyczwvYT4KPC9wcmU+CiAgICAgICAgICAgICAgPC9ibG9ja3F1b3RlPgogICAgICAgICAgICAg IDxicj4KICAgICAgICAgICAgPC9ibG9ja3F1b3RlPgogICAgICAgICAgICA8ZGl2Pjxicj4KICAg ICAgICAgICAgPC9kaXY+CiAgICAgICAgICA8L2Rpdj4KICAgICAgICAgIDxicj4KICAgICAgICAg IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fPGJyPgogICAg ICAgICAgVXNlcnMgbWFpbGluZyBsaXN0PGJyPgogICAgICAgICAgPGEgY2xhc3M9Im1vei10eHQt bGluay1hYmJyZXZpYXRlZCIgaHJlZj0ibWFpbHRvOlVzZXJzQG92aXJ0Lm9yZyI+VXNlcnNAb3Zp cnQub3JnPC9hPjxicj4KICAgICAgICAgIDxhIGNsYXNzPSJtb3otdHh0LWxpbmstZnJlZXRleHQi IGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycyI+aHR0 cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzPC9hPjxicj4KICAgICAg ICA8L2Jsb2NrcXVvdGU+CiAgICAgICAgPGRpdj48YnI+CiAgICAgICAgPC9kaXY+CiAgICAgIDwv ZGl2PgogICAgPC9ibG9ja3F1b3RlPgogICAgPGJyPgogIDwvYm9keT4KPC9odG1sPgoKLS0tLS0t LS0tLS0tLS0wMjA0MDgwOTA5MDQwMjA3MDAwNTAyMDYtLQo= --===============6488491056434093694==-- From tdemeter at itsmart.hu Mon Feb 2 09:42:22 2015 Content-Type: multipart/mixed; boundary="===============6599818780083244282==" MIME-Version: 1.0 From: Demeter Tibor To: users at ovirt.org Subject: Re: [ovirt-users] Upgrade to 3.5.1 Date: Mon, 02 Feb 2015 15:42:15 +0100 Message-ID: <788184590.6606566.1422888135298.JavaMail.zimbra@itsmart.hu> In-Reply-To: 54CF39BF.8020308@redhat.com --===============6599818780083244282== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable ------=3D_Part_6606565_110442914.1422888135297 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable Hi Sahina,=3D20 Unfortunately my compute nodes and gluster nodes are on same servers. I run= =3D ning my VMs on the gluster nodes and vica-versa.=3D20 Also, my ovirt portal is running on the first node, that is an gluster and = =3D compute node too.=3D20 I have a gluster based installation with three servers, two for replica&VMs= =3D , one for VMs-s only.=3D20 This is a productive environment, so I'm affraid so much of upgrading...:(.= =3D I don't want glusterfs mistakes, split-brains, etc..)=3D20 Also, I could make little downtime for upgrading, but I'm need to know what= =3D is the trustable upgrade procedure. Is there an official upgrade documenta= =3D tion for ovirt, that is contain the glusterfs upgrde methods?=3D20 My cluster level is 3.5.=3D20 Thanks a lot.=3D20 Tibor=3D20 ----- Eredeti =3DC3=3DBCzenet ----- > On 02/01/2015 04:40 PM, Demeter Tibor wrote: > > Hi, >=3D20 > > Is glusterfs 3.6 is neccessary for ovirt 3.5.1? >=3D20 > > I have 3.5.2 at this moment. >=3D20 > > 3.6 neccessary for upgade ? >=3D20 > If you only want to upgrade the engine to oVirt 3.5.1 - you don't need to > upgrade the gluster nodes. I understand that your gluster nodes are separ= =3D ate > from the virt nodes. That is, you do not have any cluster enabled with bo= =3D th > virt + gluster service. > glusterfs 3.6 is not necessary to upgrade engine to oVirt 3.5.1. It would > only be required if you were upgrading the cluster level (the compatibili= =3D ty > version) which in turn would require newer vdsm versions and gluster > versions. But in your case, I think you already have your cluster running > with glusterfs 3.5.2. What is the cluster compatibility version? > > I'm worried what will happed with my gluster volumes after the upgrade.= =3D .. > > :( >=3D20 > > Plese help me. >=3D20 > > Also, how can I upgrade the nodes? Need i'm to a "yum upgrade" on the > > compute > > nodes? >=3D20 > By upgrade the nodes - you mean only the compute nodes? yum upgrade on ea= =3D ch > node should work. > You can also move the Host to maintenance mode and click on Reinstall or > upgrade from engine. > > Thanks. >=3D20 > > Tibor >=3D20 > > ----- Eredeti =3DC3=3DBCzenet ----- >=3D20 > > > Hi, > >=3D20 >=3D20 > > > No, I have only one replica beetwen two nodes. > >=3D20 >=3D20 > > > The third node is only a host for vms and that using this replica. > >=3D20 >=3D20 > > > Thanks > >=3D20 >=3D20 > > > Tibor > >=3D20 >=3D20 > > > ----- Eredeti =3DC3=3DBCzenet ----- > >=3D20 >=3D20 > > > > On 01/22/2015 08:03 PM, Demeter Tibor wrote: > > >=3D20 > >=3D20 >=3D20 > > > > > Hello, > > > >=3D20 > > >=3D20 > >=3D20 >=3D20 > > > > > I have an ovirt 3.5.0 cluster with three nodes and we using glust= =3D erfs > > > > > for > > > > > serving backend storage for VM-s. Glusterfs are on same servers w= =3D ith > > > > > ovirt. > > > >=3D20 > > >=3D20 > >=3D20 >=3D20 > > > > > We have Gluster 3.5.1 on all of nodes. > > > >=3D20 > > >=3D20 > >=3D20 >=3D20 > > > > > How can I upgrade to ovirt 3.5.1 with new glusterfs? I don't want > > > > > data > > > > > inconsistency/data loss/split brains? > > > >=3D20 > > >=3D20 > >=3D20 >=3D20 > > > > Do you have a replica 3 volume setup across these 3 nodes? > > >=3D20 > >=3D20 >=3D20 > > > > Glusterfs supports rolling upgrade for replica volumes. > > >=3D20 > >=3D20 >=3D20 > > > > But there are some issues to upgrade from 3.5 to 3.6 versions > > > > (depending > > > > on > > > > version used) > > >=3D20 > >=3D20 >=3D20 > > > > Adding gluster-users & Pranith for recommended procedures. > > >=3D20 > >=3D20 >=3D20 > > > > thanks > > >=3D20 > >=3D20 >=3D20 > > > > sahina > > >=3D20 > >=3D20 >=3D20 > > > > > Need I update gluster version to the latest? > > > >=3D20 > > >=3D20 > >=3D20 >=3D20 > > > > > How I need to upgrade the nodes ? Is there any whitepaper about t= =3D his? > > > >=3D20 > > >=3D20 > >=3D20 >=3D20 > > > > > Thanks in advance, > > > >=3D20 > > >=3D20 > >=3D20 >=3D20 > > > > > Tibor > > > >=3D20 > > >=3D20 > >=3D20 >=3D20 > > > > > _______________________________________________ > > > >=3D20 > > >=3D20 > >=3D20 >=3D20 > > > > > Users mailing list Users(a)ovirt.org > > > > > http://lists.ovirt.org/mailman/listinfo/users > > > >=3D20 > > >=3D20 > >=3D20 >=3D20 > > > _______________________________________________ > >=3D20 >=3D20 > > > Users mailing list > >=3D20 >=3D20 > > > Users(a)ovirt.org > >=3D20 >=3D20 > > > http://lists.ovirt.org/mailman/listinfo/users > >=3D20 >=3D20 ------=3D_Part_6606565_110442914.1422888135297 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable
Hi Sahina,

Unfortunately my compute nodes and gluster nodes are on same server= =3D s. I running my VMs on the gluster nodes and vica-versa. 
Al= =3D so, my ovirt portal is running on the first node, that is an gluster and co= =3D mpute node too.

I have a gluster based installation with thre= =3D e servers, two for replica&VMs, one for VMs-s only.

This = =3D is a productive environment, so I'm affraid so much of upgrading...:(.I don= =3D 't want glusterfs mistakes, split-brains, etc..)

A= =3D lso, I could make little downtime for upgrading, but I'm need to know what = =3D is the trustable upgrade procedure. Is there an official upgrade documentat= =3D ion for ovirt, that is contain the glusterfs upgrde methods?

= =3D

My cluster level is 3.5.

Thanks a lot.

Tibor


= =3D

=3D20 =3D20 =3D20 =3D20
On 02/01/2015 04:40 PM, Demeter Tibor wrote:
Hi,

Is glusterfs 3.6 is neccessary for ovirt 3.5.1?
I have 3.5.2 at this moment.

3.6 neccessary for upgade ? 


If you only want to upgrade the engine to oVirt 3.5.1 - you don't need to upgrade the gluster nodes. I understand that your gluster nodes are separate from the virt nodes. That is, you do not have any cluster enabled with both virt + gluster service.

glusterfs 3.6 is not necessary to upgrade engine to oVirt 3.5.1. It would only be required if you were upgrading the cluster level (the compatibility version) which in turn would require newer vdsm versions and gluster versions. But in your case, I think you already have your cluster running with glusterfs 3.5.2. What is the cluster compatibility version?


I'm worried what will happed with my gluster volumes after the upgrade... :(

Plese help me.

Also, how can I upgrade the nodes? Need i'm to a "yum upgrade" on the compute nodes?

By upgrade the nodes - you mean only the compute nodes? yum upgrade on each node should work.
You can also move the Host to maintenance mode and click on Reinstall or upgrade from engine.



Thanks.

Tibor



Hi,

No, I have only one replica beetwen two nodes.
The third node is only a host for vms and that using this replica.

Thanks
Tibor



On 01/22/2015 08:03 PM, Demeter Tibor wrote:
Hello,

I have an ovirt 3.5.0 cluster with three nodes and we using glusterfs for serving backend storage for VM-s. Glusterfs are on same servers with ovirt.
We have Gluster 3.5.1 on all of nodes.

How can I upgrade to ovirt 3.5.1 with new glusterfs? I don't want data inconsistency/data loss/split brains?

Do you have a replica 3 volume setup across these 3 nodes?
Glusterfs supports rolling upgrade for replica volumes.
But there are some issues to upgrade from 3.5 to 3.6 versions (depending on version used)
Adding gluster-users & Pranith for recommended procedures.


thanks
sahina


Need I update gluster version to the latest?
How I need to upgrade the nodes ?  Is there any whitepaper about this?



Thanks in advance,


Tibor



_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/=
us=3D
ers



_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman= /l=3D istinfo/users


=3D20

------=3D_Part_6606565_110442914.1422888135297-- --===============6599818780083244282== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS0tLS0tPV9QYXJ0XzY2MDY1NjVfMTEwNDQyOTE0LjE0MjI4ODgxMzUyOTcKQ29udGVudC1UeXBl OiB0ZXh0L3BsYWluOyBjaGFyc2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IHF1 b3RlZC1wcmludGFibGUKCkhpIFNhaGluYSw9MjAKClVuZm9ydHVuYXRlbHkgbXkgY29tcHV0ZSBu b2RlcyBhbmQgZ2x1c3RlciBub2RlcyBhcmUgb24gc2FtZSBzZXJ2ZXJzLiBJIHJ1bj0KbmluZyBt eSBWTXMgb24gdGhlIGdsdXN0ZXIgbm9kZXMgYW5kIHZpY2EtdmVyc2EuPTIwCkFsc28sIG15IG92 aXJ0IHBvcnRhbCBpcyBydW5uaW5nIG9uIHRoZSBmaXJzdCBub2RlLCB0aGF0IGlzIGFuIGdsdXN0 ZXIgYW5kID0KY29tcHV0ZSBub2RlIHRvby49MjAKCkkgaGF2ZSBhIGdsdXN0ZXIgYmFzZWQgaW5z dGFsbGF0aW9uIHdpdGggdGhyZWUgc2VydmVycywgdHdvIGZvciByZXBsaWNhJlZNcz0KLCBvbmUg Zm9yIFZNcy1zIG9ubHkuPTIwCgpUaGlzIGlzIGEgcHJvZHVjdGl2ZSBlbnZpcm9ubWVudCwgc28g SSdtIGFmZnJhaWQgc28gbXVjaCBvZiB1cGdyYWRpbmcuLi46KC49CkkgZG9uJ3Qgd2FudCBnbHVz dGVyZnMgbWlzdGFrZXMsIHNwbGl0LWJyYWlucywgZXRjLi4pPTIwCgpBbHNvLCBJIGNvdWxkIG1h a2UgbGl0dGxlIGRvd250aW1lIGZvciB1cGdyYWRpbmcsIGJ1dCBJJ20gbmVlZCB0byBrbm93IHdo YXQ9CiBpcyB0aGUgdHJ1c3RhYmxlIHVwZ3JhZGUgcHJvY2VkdXJlLiBJcyB0aGVyZSBhbiBvZmZp Y2lhbCB1cGdyYWRlIGRvY3VtZW50YT0KdGlvbiBmb3Igb3ZpcnQsIHRoYXQgaXMgY29udGFpbiB0 aGUgZ2x1c3RlcmZzIHVwZ3JkZSBtZXRob2RzPz0yMAoKTXkgY2x1c3RlciBsZXZlbCBpcyAzLjUu PTIwCgpUaGFua3MgYSBsb3QuPTIwCgpUaWJvcj0yMAoKLS0tLS0gRXJlZGV0aSA9QzM9QkN6ZW5l dCAtLS0tLQoKPiBPbiAwMi8wMS8yMDE1IDA0OjQwIFBNLCBEZW1ldGVyIFRpYm9yIHdyb3RlOgoK PiA+IEhpLAo+PTIwCgo+ID4gSXMgZ2x1c3RlcmZzIDMuNiBpcyBuZWNjZXNzYXJ5IGZvciBvdmly dCAzLjUuMT8KPj0yMAo+ID4gSSBoYXZlIDMuNS4yIGF0IHRoaXMgbW9tZW50Lgo+PTIwCgo+ID4g My42IG5lY2Nlc3NhcnkgZm9yIHVwZ2FkZSA/Cj49MjAKCj4gSWYgeW91IG9ubHkgd2FudCB0byB1 cGdyYWRlIHRoZSBlbmdpbmUgdG8gb1ZpcnQgMy41LjEgLSB5b3UgZG9uJ3QgbmVlZCB0bwo+IHVw Z3JhZGUgdGhlIGdsdXN0ZXIgbm9kZXMuIEkgdW5kZXJzdGFuZCB0aGF0IHlvdXIgZ2x1c3RlciBu b2RlcyBhcmUgc2VwYXI9CmF0ZQo+IGZyb20gdGhlIHZpcnQgbm9kZXMuIFRoYXQgaXMsIHlvdSBk byBub3QgaGF2ZSBhbnkgY2x1c3RlciBlbmFibGVkIHdpdGggYm89CnRoCj4gdmlydCArIGdsdXN0 ZXIgc2VydmljZS4KCj4gZ2x1c3RlcmZzIDMuNiBpcyBub3QgbmVjZXNzYXJ5IHRvIHVwZ3JhZGUg ZW5naW5lIHRvIG9WaXJ0IDMuNS4xLiBJdCB3b3VsZAo+IG9ubHkgYmUgcmVxdWlyZWQgaWYgeW91 IHdlcmUgdXBncmFkaW5nIHRoZSBjbHVzdGVyIGxldmVsICh0aGUgY29tcGF0aWJpbGk9CnR5Cj4g dmVyc2lvbikgd2hpY2ggaW4gdHVybiB3b3VsZCByZXF1aXJlIG5ld2VyIHZkc20gdmVyc2lvbnMg YW5kIGdsdXN0ZXIKPiB2ZXJzaW9ucy4gQnV0IGluIHlvdXIgY2FzZSwgSSB0aGluayB5b3UgYWxy ZWFkeSBoYXZlIHlvdXIgY2x1c3RlciBydW5uaW5nCj4gd2l0aCBnbHVzdGVyZnMgMy41LjIuIFdo YXQgaXMgdGhlIGNsdXN0ZXIgY29tcGF0aWJpbGl0eSB2ZXJzaW9uPwoKPiA+IEknbSB3b3JyaWVk IHdoYXQgd2lsbCBoYXBwZWQgd2l0aCBteSBnbHVzdGVyIHZvbHVtZXMgYWZ0ZXIgdGhlIHVwZ3Jh ZGUuPQouLgo+ID4gOigKPj0yMAoKPiA+IFBsZXNlIGhlbHAgbWUuCj49MjAKCj4gPiBBbHNvLCBo b3cgY2FuIEkgdXBncmFkZSB0aGUgbm9kZXM/IE5lZWQgaSdtIHRvIGEgInl1bSB1cGdyYWRlIiBv biB0aGUKPiA+IGNvbXB1dGUKPiA+IG5vZGVzPwo+PTIwCgo+IEJ5IHVwZ3JhZGUgdGhlIG5vZGVz IC0geW91IG1lYW4gb25seSB0aGUgY29tcHV0ZSBub2Rlcz8geXVtIHVwZ3JhZGUgb24gZWE9CmNo Cj4gbm9kZSBzaG91bGQgd29yay4KPiBZb3UgY2FuIGFsc28gbW92ZSB0aGUgSG9zdCB0byBtYWlu dGVuYW5jZSBtb2RlIGFuZCBjbGljayBvbiBSZWluc3RhbGwgb3IKPiB1cGdyYWRlIGZyb20gZW5n aW5lLgoKPiA+IFRoYW5rcy4KPj0yMAoKPiA+IFRpYm9yCj49MjAKCj4gPiAtLS0tLSBFcmVkZXRp ID1DMz1CQ3plbmV0IC0tLS0tCj49MjAKCj4gPiA+IEhpLAo+ID49MjAKPj0yMAoKPiA+ID4gTm8s IEkgaGF2ZSBvbmx5IG9uZSByZXBsaWNhIGJlZXR3ZW4gdHdvIG5vZGVzLgo+ID49MjAKPj0yMAo+ ID4gPiBUaGUgdGhpcmQgbm9kZSBpcyBvbmx5IGEgaG9zdCBmb3Igdm1zIGFuZCB0aGF0IHVzaW5n IHRoaXMgcmVwbGljYS4KPiA+PTIwCj49MjAKCj4gPiA+IFRoYW5rcwo+ID49MjAKPj0yMAo+ID4g PiBUaWJvcgo+ID49MjAKPj0yMAoKPiA+ID4gLS0tLS0gRXJlZGV0aSA9QzM9QkN6ZW5ldCAtLS0t LQo+ID49MjAKPj0yMAoKPiA+ID4gPiBPbiAwMS8yMi8yMDE1IDA4OjAzIFBNLCBEZW1ldGVyIFRp Ym9yIHdyb3RlOgo+ID4gPj0yMAo+ID49MjAKPj0yMAoKPiA+ID4gPiA+IEhlbGxvLAo+ID4gPiA+ PTIwCj4gPiA+PTIwCj4gPj0yMAo+PTIwCgo+ID4gPiA+ID4gSSBoYXZlIGFuIG92aXJ0IDMuNS4w IGNsdXN0ZXIgd2l0aCB0aHJlZSBub2RlcyBhbmQgd2UgdXNpbmcgZ2x1c3Q9CmVyZnMKPiA+ID4g PiA+IGZvcgo+ID4gPiA+ID4gc2VydmluZyBiYWNrZW5kIHN0b3JhZ2UgZm9yIFZNLXMuIEdsdXN0 ZXJmcyBhcmUgb24gc2FtZSBzZXJ2ZXJzIHc9Cml0aAo+ID4gPiA+ID4gb3ZpcnQuCj4gPiA+ID49 MjAKPiA+ID49MjAKPiA+PTIwCj49MjAKPiA+ID4gPiA+IFdlIGhhdmUgR2x1c3RlciAzLjUuMSBv biBhbGwgb2Ygbm9kZXMuCj4gPiA+ID49MjAKPiA+ID49MjAKPiA+PTIwCj49MjAKCj4gPiA+ID4g PiBIb3cgY2FuIEkgdXBncmFkZSB0byBvdmlydCAzLjUuMSB3aXRoIG5ldyBnbHVzdGVyZnM/IEkg ZG9uJ3Qgd2FudAo+ID4gPiA+ID4gZGF0YQo+ID4gPiA+ID4gaW5jb25zaXN0ZW5jeS9kYXRhIGxv c3Mvc3BsaXQgYnJhaW5zPwo+ID4gPiA+PTIwCj4gPiA+PTIwCj4gPj0yMAo+PTIwCgo+ID4gPiA+ IERvIHlvdSBoYXZlIGEgcmVwbGljYSAzIHZvbHVtZSBzZXR1cCBhY3Jvc3MgdGhlc2UgMyBub2Rl cz8KPiA+ID49MjAKPiA+PTIwCj49MjAKCj4gPiA+ID4gR2x1c3RlcmZzIHN1cHBvcnRzIHJvbGxp bmcgdXBncmFkZSBmb3IgcmVwbGljYSB2b2x1bWVzLgo+ID4gPj0yMAo+ID49MjAKPj0yMAo+ID4g PiA+IEJ1dCB0aGVyZSBhcmUgc29tZSBpc3N1ZXMgdG8gdXBncmFkZSBmcm9tIDMuNSB0byAzLjYg dmVyc2lvbnMKPiA+ID4gPiAoZGVwZW5kaW5nCj4gPiA+ID4gb24KPiA+ID4gPiB2ZXJzaW9uIHVz ZWQpCj4gPiA+PTIwCj4gPj0yMAo+PTIwCj4gPiA+ID4gQWRkaW5nIGdsdXN0ZXItdXNlcnMgJiBQ cmFuaXRoIGZvciByZWNvbW1lbmRlZCBwcm9jZWR1cmVzLgo+ID4gPj0yMAo+ID49MjAKPj0yMAoK PiA+ID4gPiB0aGFua3MKPiA+ID49MjAKPiA+PTIwCj49MjAKPiA+ID4gPiBzYWhpbmEKPiA+ID49 MjAKPiA+PTIwCj49MjAKCj4gPiA+ID4gPiBOZWVkIEkgdXBkYXRlIGdsdXN0ZXIgdmVyc2lvbiB0 byB0aGUgbGF0ZXN0Pwo+ID4gPiA+PTIwCj4gPiA+PTIwCj4gPj0yMAo+PTIwCj4gPiA+ID4gPiBI b3cgSSBuZWVkIHRvIHVwZ3JhZGUgdGhlIG5vZGVzID8gSXMgdGhlcmUgYW55IHdoaXRlcGFwZXIg YWJvdXQgdD0KaGlzPwo+ID4gPiA+PTIwCj4gPiA+PTIwCj4gPj0yMAo+PTIwCgo+ID4gPiA+ID4g VGhhbmtzIGluIGFkdmFuY2UsCj4gPiA+ID49MjAKPiA+ID49MjAKPiA+PTIwCj49MjAKCj4gPiA+ ID4gPiBUaWJvcgo+ID4gPiA+PTIwCj4gPiA+PTIwCj4gPj0yMAo+PTIwCgo+ID4gPiA+ID4gX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KPiA+ID4gPj0yMAo+ ID4gPj0yMAo+ID49MjAKPj0yMAo+ID4gPiA+ID4gVXNlcnMgbWFpbGluZyBsaXN0IFVzZXJzQG92 aXJ0Lm9yZwo+ID4gPiA+ID4gaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZv L3VzZXJzCj4gPiA+ID49MjAKPiA+ID49MjAKPiA+PTIwCj49MjAKCj4gPiA+IF9fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCj4gPj0yMAo+PTIwCj4gPiA+IFVz ZXJzIG1haWxpbmcgbGlzdAo+ID49MjAKPj0yMAo+ID4gPiBVc2Vyc0BvdmlydC5vcmcKPiA+PTIw Cj49MjAKPiA+ID4gaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJz Cj4gPj0yMAo+PTIwCgotLS0tLS09X1BhcnRfNjYwNjU2NV8xMTA0NDI5MTQuMTQyMjg4ODEzNTI5 NwpDb250ZW50LVR5cGU6IHRleHQvaHRtbDsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVy LUVuY29kaW5nOiBxdW90ZWQtcHJpbnRhYmxlCgo8aHRtbD48Ym9keT48ZGl2IHN0eWxlPTNEImZv bnQtZmFtaWx5OiB0aW1lcyBuZXcgcm9tYW4sIG5ldyB5b3JrLCB0aW1lcywgc2U9CnJpZjsgZm9u dC1zaXplOiAxMnB0OyBjb2xvcjogIzAwMDAwMCI+PGRpdj5IaSBTYWhpbmEsPGJyPjwvZGl2Pjxk aXY+PGJyPjwvZD0KaXY+PGRpdj5VbmZvcnR1bmF0ZWx5IG15IGNvbXB1dGUgbm9kZXMgYW5kIGds dXN0ZXIgbm9kZXMgYXJlIG9uIHNhbWUgc2VydmVyPQpzLiBJIHJ1bm5pbmcgbXkgVk1zIG9uIHRo ZSBnbHVzdGVyIG5vZGVzIGFuZCB2aWNhLXZlcnNhLiZuYnNwOzwvZGl2PjxkaXY+QWw9CnNvLCBt eSBvdmlydCBwb3J0YWwgaXMgcnVubmluZyBvbiB0aGUgZmlyc3Qgbm9kZSwgdGhhdCBpcyBhbiBn bHVzdGVyIGFuZCBjbz0KbXB1dGUgbm9kZSB0b28uPC9kaXY+PGRpdj48YnI+SSBoYXZlIGEgZ2x1 c3RlciBiYXNlZCBpbnN0YWxsYXRpb24gd2l0aCB0aHJlPQplIHNlcnZlcnMsIHR3byBmb3IgcmVw bGljYSZhbXA7Vk1zLCBvbmUgZm9yIFZNcy1zIG9ubHkuPC9kaXY+PGRpdj48YnI+VGhpcyA9Cmlz IGEgcHJvZHVjdGl2ZSBlbnZpcm9ubWVudCwgc28gSSdtIGFmZnJhaWQgc28gbXVjaCBvZiB1cGdy YWRpbmcuLi46KC5JIGRvbj0KJ3Qgd2FudCBnbHVzdGVyZnMgbWlzdGFrZXMsIHNwbGl0LWJyYWlu cywgZXRjLi4pPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5BPQpsc28sIEkgY291bGQgbWFrZSBs aXR0bGUgZG93bnRpbWUgZm9yIHVwZ3JhZGluZywgYnV0IEknbSBuZWVkIHRvIGtub3cgd2hhdCA9 CmlzIHRoZSB0cnVzdGFibGUgdXBncmFkZSBwcm9jZWR1cmUuIElzIHRoZXJlIGFuIG9mZmljaWFs IHVwZ3JhZGUgZG9jdW1lbnRhdD0KaW9uIGZvciBvdmlydCwgdGhhdCBpcyBjb250YWluIHRoZSBn bHVzdGVyZnMgdXBncmRlIG1ldGhvZHM/PC9kaXY+PGRpdj48YnI+PQo8L2Rpdj48ZGl2Pjxicj48 L2Rpdj48ZGl2Pk15IGNsdXN0ZXIgbGV2ZWwgaXMgMy41LjwvZGl2PjxkaXY+PGJyPjwvZGl2Pjxk aXY9Cj5UaGFua3MgYSBsb3QuPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5UaWJvcjwvZGl2Pjxk aXY+PGJyPjwvZGl2PjxkaXY+PGJyPj0KPC9kaXY+PGhyIGlkPTNEInp3Y2hyIj48YmxvY2txdW90 ZSBzdHlsZT0zRCJib3JkZXItbGVmdDoycHggc29saWQgIzEwMTBGRjttPQphcmdpbi1sZWZ0OjVw eDtwYWRkaW5nLWxlZnQ6NXB4O2NvbG9yOiMwMDA7Zm9udC13ZWlnaHQ6bm9ybWFsO2ZvbnQtc3R5 bGU6bm89CnJtYWw7dGV4dC1kZWNvcmF0aW9uOm5vbmU7Zm9udC1mYW1pbHk6SGVsdmV0aWNhLEFy aWFsLHNhbnMtc2VyaWY7Zm9udC1zaXplOj0KMTJwdDsiPgogPTIwCiAgID0yMAogPTIwCiA9MjAK ICAgIDxicj4KICAgIDxkaXYgY2xhc3M9M0QibW96LWNpdGUtcHJlZml4Ij5PbiAwMi8wMS8yMDE1 IDA0OjQwIFBNLCBEZW1ldGVyIFRpYm9yCiAgICAgIHdyb3RlOjxicj4KICAgIDwvZGl2PgogICAg PGJsb2NrcXVvdGUgY2l0ZT0zRCJtaWQ6MTA5MDU0Mjc2LjU1NjIxNDAuMTQyMjc4OTAyODM4NS5K YXZhTWFpbC56aW1icmE9CkBpdHNtYXJ0Lmh1Ij4KICAgICAgPGRpdiBzdHlsZT0zRCJmb250LWZh bWlseTogdGltZXMgbmV3IHJvbWFuLCBuZXcgeW9yaywgdGltZXMsIHNlcmlmOwogICAgICAgIGZv bnQtc2l6ZTogMTJwdDsgY29sb3I6ICMwMDAwMDAiPgogICAgICAgIDxkaXY+SGksPC9kaXY+CiAg ICAgICAgPGRpdj48YnI+CiAgICAgICAgPC9kaXY+CiAgICAgICAgPGRpdj5JcyBnbHVzdGVyZnMg My42IGlzIG5lY2Nlc3NhcnkgZm9yIG92aXJ0IDMuNS4xPzwvZGl2PgogICAgICAgIDxkaXY+SSBo YXZlIDMuNS4yIGF0IHRoaXMgbW9tZW50LjwvZGl2PgogICAgICAgIDxkaXY+PGJyPgogICAgICAg IDwvZGl2PgogICAgICAgIDxkaXY+My42IG5lY2Nlc3NhcnkgZm9yIHVwZ2FkZSA/Jm5ic3A7PC9k aXY+CiAgICAgICAgPGRpdj48YnI+CiAgICAgICAgPC9kaXY+CiAgICAgIDwvZGl2PgogICAgPC9i bG9ja3F1b3RlPgogICAgPGJyPgogICAgSWYgeW91IG9ubHkgd2FudCB0byB1cGdyYWRlIHRoZSBl bmdpbmUgdG8gb1ZpcnQgMy41LjEgLSB5b3UgZG9uJ3QKICAgIG5lZWQgdG8gdXBncmFkZSB0aGUg Z2x1c3RlciBub2Rlcy4gSSB1bmRlcnN0YW5kIHRoYXQgeW91ciBnbHVzdGVyCiAgICBub2RlcyBh cmUgc2VwYXJhdGUgZnJvbSB0aGUgdmlydCBub2Rlcy4gVGhhdCBpcywgeW91IGRvIG5vdCBoYXZl IGFueQogICAgY2x1c3RlciBlbmFibGVkIHdpdGggYm90aCB2aXJ0ICsgZ2x1c3RlciBzZXJ2aWNl Ljxicj4KICAgIDxicj4KICAgIGdsdXN0ZXJmcyAzLjYgaXMgbm90IG5lY2Vzc2FyeSB0byB1cGdy YWRlIGVuZ2luZSB0byBvVmlydCAzLjUuMS4gSXQKICAgIHdvdWxkIG9ubHkgYmUgcmVxdWlyZWQg aWYgeW91IHdlcmUgdXBncmFkaW5nIHRoZSBjbHVzdGVyIGxldmVsICh0aGUKICAgIGNvbXBhdGli aWxpdHkgdmVyc2lvbikgd2hpY2ggaW4gdHVybiB3b3VsZCByZXF1aXJlIG5ld2VyIHZkc20KICAg IHZlcnNpb25zIGFuZCBnbHVzdGVyIHZlcnNpb25zLiBCdXQgaW4geW91ciBjYXNlLCBJIHRoaW5r IHlvdSBhbHJlYWR5CiAgICBoYXZlIHlvdXIgY2x1c3RlciBydW5uaW5nIHdpdGggZ2x1c3RlcmZz IDMuNS4yLiBXaGF0IGlzIHRoZSBjbHVzdGVyCiAgICBjb21wYXRpYmlsaXR5IHZlcnNpb24/PGJy PgogICAgPGJyPgogICAgPGJyPgogICAgPGJsb2NrcXVvdGUgY2l0ZT0zRCJtaWQ6MTA5MDU0Mjc2 LjU1NjIxNDAuMTQyMjc4OTAyODM4NS5KYXZhTWFpbC56aW1icmE9CkBpdHNtYXJ0Lmh1Ij4KICAg ICAgPGRpdiBzdHlsZT0zRCJmb250LWZhbWlseTogdGltZXMgbmV3IHJvbWFuLCBuZXcgeW9yaywg dGltZXMsIHNlcmlmOwogICAgICAgIGZvbnQtc2l6ZTogMTJwdDsgY29sb3I6ICMwMDAwMDAiPgog ICAgICAgIDxkaXY+SSdtIHdvcnJpZWQgd2hhdCB3aWxsIGhhcHBlZCB3aXRoIG15IGdsdXN0ZXIg dm9sdW1lcyBhZnRlcgogICAgICAgICAgdGhlIHVwZ3JhZGUuLi4gOig8L2Rpdj4KICAgICAgICA8 ZGl2Pjxicj4KICAgICAgICA8L2Rpdj4KICAgICAgICA8ZGl2PlBsZXNlIGhlbHAgbWUuPC9kaXY+ CiAgICAgICAgPGRpdj48YnI+CiAgICAgICAgPC9kaXY+CiAgICAgICAgPGRpdj5BbHNvLCBob3cg Y2FuIEkgdXBncmFkZSB0aGUgbm9kZXM/IE5lZWQgaSdtIHRvIGEgInl1bQogICAgICAgICAgdXBn cmFkZSIgb24gdGhlIGNvbXB1dGUgbm9kZXM/PC9kaXY+CiAgICAgIDwvZGl2PgogICAgPC9ibG9j a3F1b3RlPgogICAgPGJyPgogICAgQnkgdXBncmFkZSB0aGUgbm9kZXMgLSB5b3UgbWVhbiBvbmx5 IHRoZSBjb21wdXRlIG5vZGVzPyB5dW0gdXBncmFkZQogICAgb24gZWFjaCBub2RlIHNob3VsZCB3 b3JrLjxicj4KICAgIFlvdSBjYW4gYWxzbyBtb3ZlIHRoZSBIb3N0IHRvIG1haW50ZW5hbmNlIG1v ZGUgYW5kIGNsaWNrIG9uCiAgICBSZWluc3RhbGwgb3IgdXBncmFkZSBmcm9tIGVuZ2luZS48YnI+ CiAgICA8YnI+CiAgICA8YnI+CiAgICA8YmxvY2txdW90ZSBjaXRlPTNEIm1pZDoxMDkwNTQyNzYu NTU2MjE0MC4xNDIyNzg5MDI4Mzg1LkphdmFNYWlsLnppbWJyYT0KQGl0c21hcnQuaHUiPgogICAg ICA8ZGl2IHN0eWxlPTNEImZvbnQtZmFtaWx5OiB0aW1lcyBuZXcgcm9tYW4sIG5ldyB5b3JrLCB0 aW1lcywgc2VyaWY7CiAgICAgICAgZm9udC1zaXplOiAxMnB0OyBjb2xvcjogIzAwMDAwMCI+CiAg ICAgICAgPGRpdj48YnI+CiAgICAgICAgPC9kaXY+CiAgICAgICAgPGRpdj5UaGFua3MuPC9kaXY+ CiAgICAgICAgPGRpdj48YnI+CiAgICAgICAgPC9kaXY+CiAgICAgICAgPGRpdj5UaWJvcjwvZGl2 PgogICAgICAgIDxkaXY+PHNwYW4+PC9zcGFuPgogICAgICAgICAgPHAgc3R5bGU9M0QiZm9udC1m YW1pbHk6ICdUaW1lcyBOZXcgUm9tYW4nOyBmb250LXNpemU6IG1lZGl1bTsKICAgICAgICAgICAg bWFyZ2luOiAwcHg7Ij48YnI+CiAgICAgICAgICA8L3A+CiAgICAgICAgPC9kaXY+CiAgICAgICAg PGhyIGlkPTNEInp3Y2hyIj4KICAgICAgICA8YmxvY2txdW90ZSBzdHlsZT0zRCJib3JkZXItbGVm dDoycHggc29saWQKIzEwMTBGRjttYXJnaW4tbGVmdDo1cHg7cGFkZGluZy1sZWZ0OjVweDtjb2xv cjojMDAwO2ZvbnQtd2VpZ2h0Om5vcm1hbDtmb250PQotc3R5bGU6bm9ybWFsO3RleHQtZGVjb3Jh dGlvbjpub25lO2ZvbnQtZmFtaWx5OkhlbHZldGljYSxBcmlhbCxzYW5zLXNlcmlmO2Y9Cm9udC1z aXplOjEycHQ7Ij4KICAgICAgICAgIDxkaXYgc3R5bGU9M0QiZm9udC1mYW1pbHk6IHRpbWVzIG5l dyByb21hbiwgbmV3IHlvcmssIHRpbWVzLAogICAgICAgICAgICBzZXJpZjsgZm9udC1zaXplOiAx MnB0OyBjb2xvcjogIzAwMDAwMCI+CiAgICAgICAgICAgIDxkaXY+SGksPC9kaXY+CiAgICAgICAg ICAgIDxkaXY+PGJyPgogICAgICAgICAgICA8L2Rpdj4KICAgICAgICAgICAgPGRpdj5ObywgSSBo YXZlIG9ubHkgb25lIHJlcGxpY2EgYmVldHdlbiB0d28gbm9kZXMuPC9kaXY+CiAgICAgICAgICAg IDxkaXY+VGhlIHRoaXJkIG5vZGUgaXMgb25seSBhIGhvc3QgZm9yIHZtcyBhbmQgdGhhdCB1c2lu ZwogICAgICAgICAgICAgIHRoaXMgcmVwbGljYS48L2Rpdj4KICAgICAgICAgICAgPGRpdj48YnI+ CiAgICAgICAgICAgIDwvZGl2PgogICAgICAgICAgICA8ZGl2PlRoYW5rczwvZGl2PgogICAgICAg ICAgICA8ZGl2PlRpYm9yPC9kaXY+CiAgICAgICAgICAgIDxkaXY+PHNwYW4+PC9zcGFuPjxicj4K ICAgICAgICAgICAgPC9kaXY+CiAgICAgICAgICAgIDxociBpZD0zRCJ6d2NociI+CiAgICAgICAg ICAgIDxibG9ja3F1b3RlIHN0eWxlPTNEImJvcmRlci1sZWZ0OjJweCBzb2xpZAojMTAxMEZGO21h cmdpbi1sZWZ0OjVweDtwYWRkaW5nLWxlZnQ6NXB4O2NvbG9yOiMwMDA7Zm9udC13ZWlnaHQ6bm9y bWFsO2ZvbnQ9Ci1zdHlsZTpub3JtYWw7dGV4dC1kZWNvcmF0aW9uOm5vbmU7Zm9udC1mYW1pbHk6 SGVsdmV0aWNhLEFyaWFsLHNhbnMtc2VyaWY7Zj0Kb250LXNpemU6MTJwdDsiPjxicj4KICAgICAg ICAgICAgICA8ZGl2IGNsYXNzPTNEIm1vei1jaXRlLXByZWZpeCI+T24gMDEvMjIvMjAxNSAwODow MyBQTSwKICAgICAgICAgICAgICAgIERlbWV0ZXIgVGlib3Igd3JvdGU6PGJyPgogICAgICAgICAg ICAgIDwvZGl2PgogICAgICAgICAgICAgIDxibG9ja3F1b3RlIGNpdGU9M0QibWlkOjExMjg3OTQy MDkuMjEwNTUzNDYuMTQyMTkzNzE4NjgxMy5KYXY9CmFNYWlsLnppbWJyYUBpdHNtYXJ0Lmh1Ij4K ICAgICAgICAgICAgICAgIDxkaXYgc3R5bGU9M0QiZm9udC1mYW1pbHk6IHRpbWVzIG5ldyByb21h biwgbmV3IHlvcmssCiAgICAgICAgICAgICAgICAgIHRpbWVzLCBzZXJpZjsgZm9udC1zaXplOiAx MnB0OyBjb2xvcjogIzAwMDAwMCI+CiAgICAgICAgICAgICAgICAgIDxkaXY+PHNwYW4gc3R5bGU9 M0QiZm9udC1zaXplOiAxMnB0OyI+SGVsbG8sPC9zcGFuPjwvZGl2PgogICAgICAgICAgICAgICAg ICA8ZGl2Pjxicj4KICAgICAgICAgICAgICAgICAgPC9kaXY+CiAgICAgICAgICAgICAgICAgIDxk aXY+SSBoYXZlIGFuIG92aXJ0IDMuNS4wIGNsdXN0ZXIgd2l0aCB0aHJlZSBub2RlcwogICAgICAg ICAgICAgICAgICAgIGFuZCB3ZSB1c2luZyBnbHVzdGVyZnMgZm9yIHNlcnZpbmcgYmFja2VuZCBz dG9yYWdlCiAgICAgICAgICAgICAgICAgICAgZm9yIFZNLXMuIEdsdXN0ZXJmcyBhcmUgb24gc2Ft ZSBzZXJ2ZXJzIHdpdGggb3ZpcnQuPC9kaT0Kdj4KICAgICAgICAgICAgICAgICAgPGRpdj5XZSBo YXZlIEdsdXN0ZXIgMy41LjEgb24gYWxsIG9mIG5vZGVzLjwvZGl2PgogICAgICAgICAgICAgICAg ICA8ZGl2Pjxicj4KICAgICAgICAgICAgICAgICAgPC9kaXY+CiAgICAgICAgICAgICAgICAgIDxk aXY+SG93IGNhbiBJIHVwZ3JhZGUgdG8gb3ZpcnQgMy41LjEgd2l0aCBuZXcKICAgICAgICAgICAg ICAgICAgICBnbHVzdGVyZnM/IEkgZG9uJ3Qgd2FudCBkYXRhIGluY29uc2lzdGVuY3kvZGF0YQog ICAgICAgICAgICAgICAgICAgIGxvc3Mvc3BsaXQgYnJhaW5zPzwvZGl2PgogICAgICAgICAgICAg ICAgPC9kaXY+CiAgICAgICAgICAgICAgPC9ibG9ja3F1b3RlPgogICAgICAgICAgICAgIDxicj4K ICAgICAgICAgICAgICBEbyB5b3UgaGF2ZSBhIHJlcGxpY2EgMyB2b2x1bWUgc2V0dXAgYWNyb3Nz IHRoZXNlIDMgbm9kZXM/PGJyPQo+CiAgICAgICAgICAgICAgPGJyPgogICAgICAgICAgICAgIEds dXN0ZXJmcyBzdXBwb3J0cyByb2xsaW5nIHVwZ3JhZGUgZm9yIHJlcGxpY2Egdm9sdW1lcy4gPGJy PgogICAgICAgICAgICAgIEJ1dCB0aGVyZSBhcmUgc29tZSBpc3N1ZXMgdG8gdXBncmFkZSBmcm9t IDMuNSB0byAzLjYKICAgICAgICAgICAgICB2ZXJzaW9ucyAoZGVwZW5kaW5nIG9uIHZlcnNpb24g dXNlZCk8YnI+CiAgICAgICAgICAgICAgQWRkaW5nIGdsdXN0ZXItdXNlcnMgJmFtcDsgUHJhbml0 aCBmb3IgcmVjb21tZW5kZWQKICAgICAgICAgICAgICBwcm9jZWR1cmVzLjxicj4KICAgICAgICAg ICAgICA8YnI+CiAgICAgICAgICAgICAgPGJyPgogICAgICAgICAgICAgIHRoYW5rczxicj4KICAg ICAgICAgICAgICBzYWhpbmE8YnI+CiAgICAgICAgICAgICAgPGJyPgogICAgICAgICAgICAgIDxi bG9ja3F1b3RlIGNpdGU9M0QibWlkOjExMjg3OTQyMDkuMjEwNTUzNDYuMTQyMTkzNzE4NjgxMy5K YXY9CmFNYWlsLnppbWJyYUBpdHNtYXJ0Lmh1Ij4KICAgICAgICAgICAgICAgIDxkaXYgc3R5bGU9 M0QiZm9udC1mYW1pbHk6IHRpbWVzIG5ldyByb21hbiwgbmV3IHlvcmssCiAgICAgICAgICAgICAg ICAgIHRpbWVzLCBzZXJpZjsgZm9udC1zaXplOiAxMnB0OyBjb2xvcjogIzAwMDAwMCI+CiAgICAg ICAgICAgICAgICAgIDxkaXY+PGJyPgogICAgICAgICAgICAgICAgICA8L2Rpdj4KICAgICAgICAg ICAgICAgICAgPGRpdj5OZWVkIEkgdXBkYXRlIGdsdXN0ZXIgdmVyc2lvbiB0byB0aGUgbGF0ZXN0 PzwvZGl2PgogICAgICAgICAgICAgICAgICA8ZGl2PkhvdyBJIG5lZWQgdG8gdXBncmFkZSB0aGUg bm9kZXMgPyAmbmJzcDtJcyB0aGVyZSBhbnkKICAgICAgICAgICAgICAgICAgICB3aGl0ZXBhcGVy IGFib3V0IHRoaXM/PC9kaXY+CiAgICAgICAgICAgICAgICAgIDxkaXY+PHNwYW4+PC9zcGFuPgog ICAgICAgICAgICAgICAgICAgIDxwIHN0eWxlPTNEImZvbnQtZmFtaWx5OiAnVGltZXMgTmV3IFJv bWFuJzsgZm9udC1zaXplOgogICAgICAgICAgICAgICAgICAgICAgbWVkaXVtOyBtYXJnaW46IDBw eDsiPjxzdHJvbmc+PHNwYW4gc3R5bGU9M0QiZm9udC1zaXo9CmU6IG1lZGl1bTsiPjxzcGFuIHN0 eWxlPTNEImNvbG9yOgogICAgICAgICAgICAgICAgICAgICAgICAgICAgcmdiKDQ1LCAxMDMsIDE3 Nik7Ij48YnI+CiAgICAgICAgICAgICAgICAgICAgICAgICAgPC9zcGFuPjwvc3Bhbj48L3N0cm9u Zz48L3A+CiAgICAgICAgICAgICAgICAgICAgPHAgc3R5bGU9M0QiZm9udC1mYW1pbHk6ICdUaW1l cyBOZXcgUm9tYW4nOyBmb250LXNpemU6CiAgICAgICAgICAgICAgICAgICAgICBtZWRpdW07IG1h cmdpbjogMHB4OyI+PHN0cm9uZz48c3BhbiBzdHlsZT0zRCJmb250LXNpej0KZTogbWVkaXVtOyI+ PHNwYW4gc3R5bGU9M0QiY29sb3I6CiAgICAgICAgICAgICAgICAgICAgICAgICAgICByZ2IoNDUs IDEwMywgMTc2KTsiPjxicj4KICAgICAgICAgICAgICAgICAgICAgICAgICA8L3NwYW4+PC9zcGFu Pjwvc3Ryb25nPjwvcD4KICAgICAgICAgICAgICAgICAgICA8cCBzdHlsZT0zRCJmb250LWZhbWls eTogJ1RpbWVzIE5ldyBSb21hbic7IGZvbnQtc2l6ZToKICAgICAgICAgICAgICAgICAgICAgIG1l ZGl1bTsgbWFyZ2luOiAwcHg7Ij5UaGFua3MgaW4gYWR2YW5jZSw8L3A+CiAgICAgICAgICAgICAg ICAgICAgPHAgc3R5bGU9M0QiZm9udC1mYW1pbHk6ICdUaW1lcyBOZXcgUm9tYW4nOyBmb250LXNp emU6CiAgICAgICAgICAgICAgICAgICAgICBtZWRpdW07IG1hcmdpbjogMHB4OyI+PGJyPgogICAg ICAgICAgICAgICAgICAgIDwvcD4KICAgICAgICAgICAgICAgICAgICA8cCBzdHlsZT0zRCJmb250 LWZhbWlseTogJ1RpbWVzIE5ldyBSb21hbic7IGZvbnQtc2l6ZToKICAgICAgICAgICAgICAgICAg ICAgIG1lZGl1bTsgbWFyZ2luOiAwcHg7Ij5UaWJvcjwvcD4KICAgICAgICAgICAgICAgICAgPC9k aXY+CiAgICAgICAgICAgICAgICA8L2Rpdj4KICAgICAgICAgICAgICAgIDxicj4KICAgICAgICAg ICAgICAgIDxmaWVsZHNldCBjbGFzcz0zRCJtaW1lQXR0YWNobWVudEhlYWRlciI+PC9maWVsZHNl dD4KICAgICAgICAgICAgICAgIDxicj4KICAgICAgICAgICAgICAgIDxwcmU+X19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KVXNlcnMgbWFpbGluZyBsaXN0Cjxh IGNsYXNzPTNEIm1vei10eHQtbGluay1hYmJyZXZpYXRlZCIgaHJlZj0zRCJtYWlsdG86VXNlcnNA b3ZpcnQub3JnIiB0YXJnZT0KdD0zRCJfYmxhbmsiPlVzZXJzQG92aXJ0Lm9yZzwvYT4KPGEgY2xh c3M9M0QibW96LXR4dC1saW5rLWZyZWV0ZXh0IiBocmVmPTNEImh0dHA6Ly9saXN0cy5vdmlydC5v cmcvbWFpbG1hbi9sPQppc3RpbmZvL3VzZXJzIiB0YXJnZXQ9M0QiX2JsYW5rIj5odHRwOi8vbGlz dHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXM9CmVyczwvYT4KPC9wcmU+CiAgICAgICAg ICAgICAgPC9ibG9ja3F1b3RlPgogICAgICAgICAgICAgIDxicj4KICAgICAgICAgICAgPC9ibG9j a3F1b3RlPgogICAgICAgICAgICA8ZGl2Pjxicj4KICAgICAgICAgICAgPC9kaXY+CiAgICAgICAg ICA8L2Rpdj4KICAgICAgICAgIDxicj4KICAgICAgICAgIF9fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fPGJyPgogICAgICAgICAgVXNlcnMgbWFpbGluZyBsaXN0 PGJyPgogICAgICAgICAgPGEgY2xhc3M9M0QibW96LXR4dC1saW5rLWFiYnJldmlhdGVkIiBocmVm PTNEIm1haWx0bzpVc2Vyc0BvdmlydC49Cm9yZyIgdGFyZ2V0PTNEIl9ibGFuayI+VXNlcnNAb3Zp cnQub3JnPC9hPjxicj4KICAgICAgICAgIDxhIGNsYXNzPTNEIm1vei10eHQtbGluay1mcmVldGV4 dCIgaHJlZj0zRCJodHRwOi8vbGlzdHMub3ZpcnQub3JnPQovbWFpbG1hbi9saXN0aW5mby91c2Vy cyIgdGFyZ2V0PTNEIl9ibGFuayI+aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2w9Cmlz dGluZm8vdXNlcnM8L2E+PGJyPgogICAgICAgIDwvYmxvY2txdW90ZT4KICAgICAgICA8ZGl2Pjxi cj4KICAgICAgICA8L2Rpdj4KICAgICAgPC9kaXY+CiAgICA8L2Jsb2NrcXVvdGU+CiAgICA8YnI+ CiA9MjAKCjwvYmxvY2txdW90ZT48ZGl2Pjxicj48L2Rpdj48L2Rpdj48L2JvZHk+PC9odG1sPgot LS0tLS09X1BhcnRfNjYwNjU2NV8xMTA0NDI5MTQuMTQyMjg4ODEzNTI5Ny0tCg== --===============6599818780083244282==-- From sabose at redhat.com Tue Feb 3 06:16:56 2015 Content-Type: multipart/mixed; boundary="===============1801076720775376516==" MIME-Version: 1.0 From: Sahina Bose To: users at ovirt.org Subject: Re: [ovirt-users] Upgrade to 3.5.1 Date: Tue, 03 Feb 2015 16:46:46 +0530 Message-ID: <54D0AE1E.4000809@redhat.com> In-Reply-To: 788184590.6606566.1422888135298.JavaMail.zimbra@itsmart.hu --===============1801076720775376516== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------090407020300060703010202 Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed Content-Transfer-Encoding: 7bit On 02/02/2015 08:12 PM, Demeter Tibor wrote: > Hi Sahina, > > Unfortunately my compute nodes and gluster nodes are on same servers. = > I running my VMs on the gluster nodes and vica-versa. > Also, my ovirt portal is running on the first node, that is an gluster = > and compute node too. Is this hosted-engine setup? Have you looked at = http://www.ovirt.org/Hosted_Engine_Howto#Upgrade_Hosted_Engine ? > > I have a gluster based installation with three servers, two for = > replica&VMs, one for VMs-s only. If you're upgrading from oVirt 3.5 to 3.5.1 - there's no new dependency = on glusterfs. So, you could decide not to upgrade glusterfs and just = upgrade the vdsm on the nodes. > > This is a productive environment, so I'm affraid so much of = > upgrading...:(.I don't want glusterfs mistakes, split-brains, etc..) > > Also, I could make little downtime for upgrading, but I'm need to know = > what is the trustable upgrade procedure. Is there an official upgrade = > documentation for ovirt, that is contain the glusterfs upgrde methods? There are separate documentations - for oVirt upgrade and glusterfs = upgrade. No mechanism to upgrade glusterfs on nodes from within oVirt. > > > My cluster level is 3.5. > > Thanks a lot. > > Tibor > > > ------------------------------------------------------------------------ > > > On 02/01/2015 04:40 PM, Demeter Tibor wrote: > > Hi, > > Is glusterfs 3.6 is neccessary for ovirt 3.5.1? > I have 3.5.2 at this moment. > > 3.6 neccessary for upgade ? > > > If you only want to upgrade the engine to oVirt 3.5.1 - you don't > need to upgrade the gluster nodes. I understand that your gluster > nodes are separate from the virt nodes. That is, you do not have > any cluster enabled with both virt + gluster service. > > glusterfs 3.6 is not necessary to upgrade engine to oVirt 3.5.1. > It would only be required if you were upgrading the cluster level > (the compatibility version) which in turn would require newer vdsm > versions and gluster versions. But in your case, I think you > already have your cluster running with glusterfs 3.5.2. What is > the cluster compatibility version? > > > I'm worried what will happed with my gluster volumes after the > upgrade... :( > > Plese help me. > > Also, how can I upgrade the nodes? Need i'm to a "yum upgrade" > on the compute nodes? > > > By upgrade the nodes - you mean only the compute nodes? yum > upgrade on each node should work. > You can also move the Host to maintenance mode and click on > Reinstall or upgrade from engine. > > > > Thanks. > > Tibor > > > -----------------------------------------------------------------= ------- > > Hi, > > No, I have only one replica beetwen two nodes. > The third node is only a host for vms and that using this > replica. > > Thanks > Tibor > > -------------------------------------------------------------= ----------- > > > On 01/22/2015 08:03 PM, Demeter Tibor wrote: > > Hello, > > I have an ovirt 3.5.0 cluster with three nodes and > we using glusterfs for serving backend storage for > VM-s. Glusterfs are on same servers with ovirt. > We have Gluster 3.5.1 on all of nodes. > > How can I upgrade to ovirt 3.5.1 with new > glusterfs? I don't want data inconsistency/data > loss/split brains? > > > Do you have a replica 3 volume setup across these 3 nodes? > > Glusterfs supports rolling upgrade for replica volumes. > But there are some issues to upgrade from 3.5 to 3.6 > versions (depending on version used) > Adding gluster-users & Pranith for recommended procedures. > > > thanks > sahina > > > Need I update gluster version to the latest? > How I need to upgrade the nodes ? Is there any > whitepaper about this? > > * > * > > * > * > > Thanks in advance, > > > Tibor > > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > > > --------------090407020300060703010202 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 8bit
On 02/02/2015 08:12 PM, Demeter Tibor wrote:
Hi Sahina,

Unfortunately my compute nodes and gluster nodes are on same servers. I running my VMs on the gluster nodes and vica-versa.=C2=A0
Also, my ovirt portal is running on the first node, that is an gluster and compute node too.

Is this hosted-engine setup? Have you looked at http://www.ovirt.org/Hosted_Engine_Howt= o#Upgrade_Hosted_Engine ?


I have a gluster based installation with three servers, two for replica&VMs, one for VMs-s only.

If you're upgrading from oVirt 3.5 to 3.5.1 - there's no new dependency on glusterfs. So, you could decide not to upgrade glusterfs and just upgrade the vdsm on the nodes.


This is a productive environment, so I'm affraid so much of upgrading...:(.I don't want glusterfs mistakes, split-brains, etc..)

Also, I could make little downtime for upgrading, but I'm need to know what is the trustable upgrade procedure. Is there an official upgrade documentation for ovirt, that is contain the glusterfs upgrde methods?

There are separate documentations - for oVirt upgrade and glusterfs upgrade. No mechanism to upgrade glusterfs on nodes from within oVirt.





My cluster level is 3.5.

Thanks a lot.

Tibor




On 02/01/2015 04:40 PM, Demeter Tibor wrote:
Hi,

Is glusterfs 3.6 is neccessary for ovirt 3.5.1?
I have 3.5.2 at this moment.

3.6 neccessary for upgade ?=C2=A0


If you only want to upgrade the engine to oVirt 3.5.1 - you don't need to upgrade the gluster nodes. I understand that your gluster nodes are separate from the virt nodes. That is, you do not have any cluster enabled with both virt + gluster service.

glusterfs 3.6 is not necessary to upgrade engine to oVirt 3.5.1. It would only be required if you were upgrading the cluster level (the compatibility version) which in turn would require newer vdsm versions and gluster versions. But in your case, I think you already have your cluster running with glusterfs 3.5.2. What is the cluster compatibility version?


I'm worried what will happed with my gluster volumes after the upgrade... :(

Plese help me.

Also, how can I upgrade the nodes? Need i'm to a "yum upgrade" on the compute nodes?

By upgrade the nodes - you mean only the compute nodes? yum upgrade on each node should work.
You can also move the Host to maintenance mode and click on Reinstall or upgrade from engine.



Thanks.

Tibor



Hi,

No, I have only one replica beetwen two nodes.
The third node is only a host for vms and that using this replica.

Thanks
Tibor



On 01/22/2015 08:03 PM, Demeter Tibor wrote:
Hello,=

I have an ovirt 3.5.0 cluster with three nodes and we using glusterfs for serving backend storage for VM-s. Glusterfs are on same servers with ovirt.
We have Gluster 3.5.1 on all of nodes.

How can I upgrade to ovirt 3.5.1 with new glusterfs? I don't want data inconsistency/data loss/split brains?

Do you have a replica 3 volume setup across these 3 nodes?

Glusterfs supports rolling upgrade for replica volumes.
But there are some issues to upgrade from 3.5 to 3.6 versions (depending on version used)
Adding gluster-users & Pranith for recommended procedures.


thanks
sahina


Need I update gluster version to the latest?
How I need to upgrade the nodes ? =C2=A0Is the= re any whitepaper about this?



Thanks in advance,


Tibor



_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovir=
t.org/mailman/listinfo/users



_______________________________________________
Users mailing list
Users= (a)ovirt.org
http://lists.ovirt.org/mailman/listinfo= /users




--------------090407020300060703010202-- --===============1801076720775376516== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS0wOTA0MDcwMjAzMDAwNjA3MDMwMTAyMDIKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXV0Zi04OyBmb3JtYXQ9Zmxvd2VkCkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDdiaXQK CgpPbiAwMi8wMi8yMDE1IDA4OjEyIFBNLCBEZW1ldGVyIFRpYm9yIHdyb3RlOgo+IEhpIFNhaGlu YSwKPgo+IFVuZm9ydHVuYXRlbHkgbXkgY29tcHV0ZSBub2RlcyBhbmQgZ2x1c3RlciBub2RlcyBh cmUgb24gc2FtZSBzZXJ2ZXJzLiAKPiBJIHJ1bm5pbmcgbXkgVk1zIG9uIHRoZSBnbHVzdGVyIG5v ZGVzIGFuZCB2aWNhLXZlcnNhLgo+IEFsc28sIG15IG92aXJ0IHBvcnRhbCBpcyBydW5uaW5nIG9u IHRoZSBmaXJzdCBub2RlLCB0aGF0IGlzIGFuIGdsdXN0ZXIgCj4gYW5kIGNvbXB1dGUgbm9kZSB0 b28uCgpJcyB0aGlzIGhvc3RlZC1lbmdpbmUgc2V0dXA/IEhhdmUgeW91IGxvb2tlZCBhdCAKaHR0 cDovL3d3dy5vdmlydC5vcmcvSG9zdGVkX0VuZ2luZV9Ib3d0byNVcGdyYWRlX0hvc3RlZF9Fbmdp bmUgPwoKPgo+IEkgaGF2ZSBhIGdsdXN0ZXIgYmFzZWQgaW5zdGFsbGF0aW9uIHdpdGggdGhyZWUg c2VydmVycywgdHdvIGZvciAKPiByZXBsaWNhJlZNcywgb25lIGZvciBWTXMtcyBvbmx5LgoKSWYg eW91J3JlIHVwZ3JhZGluZyBmcm9tIG9WaXJ0IDMuNSB0byAzLjUuMSAtIHRoZXJlJ3Mgbm8gbmV3 IGRlcGVuZGVuY3kgCm9uIGdsdXN0ZXJmcy4gU28sIHlvdSBjb3VsZCBkZWNpZGUgbm90IHRvIHVw Z3JhZGUgZ2x1c3RlcmZzIGFuZCBqdXN0IAp1cGdyYWRlIHRoZSB2ZHNtIG9uIHRoZSBub2Rlcy4K Cj4KPiBUaGlzIGlzIGEgcHJvZHVjdGl2ZSBlbnZpcm9ubWVudCwgc28gSSdtIGFmZnJhaWQgc28g bXVjaCBvZiAKPiB1cGdyYWRpbmcuLi46KC5JIGRvbid0IHdhbnQgZ2x1c3RlcmZzIG1pc3Rha2Vz LCBzcGxpdC1icmFpbnMsIGV0Yy4uKQo+Cj4gQWxzbywgSSBjb3VsZCBtYWtlIGxpdHRsZSBkb3du dGltZSBmb3IgdXBncmFkaW5nLCBidXQgSSdtIG5lZWQgdG8ga25vdyAKPiB3aGF0IGlzIHRoZSB0 cnVzdGFibGUgdXBncmFkZSBwcm9jZWR1cmUuIElzIHRoZXJlIGFuIG9mZmljaWFsIHVwZ3JhZGUg Cj4gZG9jdW1lbnRhdGlvbiBmb3Igb3ZpcnQsIHRoYXQgaXMgY29udGFpbiB0aGUgZ2x1c3RlcmZz IHVwZ3JkZSBtZXRob2RzPwoKVGhlcmUgYXJlIHNlcGFyYXRlIGRvY3VtZW50YXRpb25zIC0gZm9y IG9WaXJ0IHVwZ3JhZGUgYW5kIGdsdXN0ZXJmcyAKdXBncmFkZS4gTm8gbWVjaGFuaXNtIHRvIHVw Z3JhZGUgZ2x1c3RlcmZzIG9uIG5vZGVzIGZyb20gd2l0aGluIG9WaXJ0LgoKCgo+Cj4KPiBNeSBj bHVzdGVyIGxldmVsIGlzIDMuNS4KPgo+IFRoYW5rcyBhIGxvdC4KPgo+IFRpYm9yCj4KPgo+IC0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLQo+Cj4KPiAgICAgT24gMDIvMDEvMjAxNSAwNDo0MCBQTSwgRGVtZXRlciBU aWJvciB3cm90ZToKPgo+ICAgICAgICAgSGksCj4KPiAgICAgICAgIElzIGdsdXN0ZXJmcyAzLjYg aXMgbmVjY2Vzc2FyeSBmb3Igb3ZpcnQgMy41LjE/Cj4gICAgICAgICBJIGhhdmUgMy41LjIgYXQg dGhpcyBtb21lbnQuCj4KPiAgICAgICAgIDMuNiBuZWNjZXNzYXJ5IGZvciB1cGdhZGUgPwo+Cj4K PiAgICAgSWYgeW91IG9ubHkgd2FudCB0byB1cGdyYWRlIHRoZSBlbmdpbmUgdG8gb1ZpcnQgMy41 LjEgLSB5b3UgZG9uJ3QKPiAgICAgbmVlZCB0byB1cGdyYWRlIHRoZSBnbHVzdGVyIG5vZGVzLiBJ IHVuZGVyc3RhbmQgdGhhdCB5b3VyIGdsdXN0ZXIKPiAgICAgbm9kZXMgYXJlIHNlcGFyYXRlIGZy b20gdGhlIHZpcnQgbm9kZXMuIFRoYXQgaXMsIHlvdSBkbyBub3QgaGF2ZQo+ICAgICBhbnkgY2x1 c3RlciBlbmFibGVkIHdpdGggYm90aCB2aXJ0ICsgZ2x1c3RlciBzZXJ2aWNlLgo+Cj4gICAgIGds dXN0ZXJmcyAzLjYgaXMgbm90IG5lY2Vzc2FyeSB0byB1cGdyYWRlIGVuZ2luZSB0byBvVmlydCAz LjUuMS4KPiAgICAgSXQgd291bGQgb25seSBiZSByZXF1aXJlZCBpZiB5b3Ugd2VyZSB1cGdyYWRp bmcgdGhlIGNsdXN0ZXIgbGV2ZWwKPiAgICAgKHRoZSBjb21wYXRpYmlsaXR5IHZlcnNpb24pIHdo aWNoIGluIHR1cm4gd291bGQgcmVxdWlyZSBuZXdlciB2ZHNtCj4gICAgIHZlcnNpb25zIGFuZCBn bHVzdGVyIHZlcnNpb25zLiBCdXQgaW4geW91ciBjYXNlLCBJIHRoaW5rIHlvdQo+ICAgICBhbHJl YWR5IGhhdmUgeW91ciBjbHVzdGVyIHJ1bm5pbmcgd2l0aCBnbHVzdGVyZnMgMy41LjIuIFdoYXQg aXMKPiAgICAgdGhlIGNsdXN0ZXIgY29tcGF0aWJpbGl0eSB2ZXJzaW9uPwo+Cj4KPiAgICAgICAg IEknbSB3b3JyaWVkIHdoYXQgd2lsbCBoYXBwZWQgd2l0aCBteSBnbHVzdGVyIHZvbHVtZXMgYWZ0 ZXIgdGhlCj4gICAgICAgICB1cGdyYWRlLi4uIDooCj4KPiAgICAgICAgIFBsZXNlIGhlbHAgbWUu Cj4KPiAgICAgICAgIEFsc28sIGhvdyBjYW4gSSB1cGdyYWRlIHRoZSBub2Rlcz8gTmVlZCBpJ20g dG8gYSAieXVtIHVwZ3JhZGUiCj4gICAgICAgICBvbiB0aGUgY29tcHV0ZSBub2Rlcz8KPgo+Cj4g ICAgIEJ5IHVwZ3JhZGUgdGhlIG5vZGVzIC0geW91IG1lYW4gb25seSB0aGUgY29tcHV0ZSBub2Rl cz8geXVtCj4gICAgIHVwZ3JhZGUgb24gZWFjaCBub2RlIHNob3VsZCB3b3JrLgo+ICAgICBZb3Ug Y2FuIGFsc28gbW92ZSB0aGUgSG9zdCB0byBtYWludGVuYW5jZSBtb2RlIGFuZCBjbGljayBvbgo+ ICAgICBSZWluc3RhbGwgb3IgdXBncmFkZSBmcm9tIGVuZ2luZS4KPgo+Cj4KPiAgICAgICAgIFRo YW5rcy4KPgo+ICAgICAgICAgVGlib3IKPgo+Cj4gICAgICAgICAtLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0KPgo+ ICAgICAgICAgICAgIEhpLAo+Cj4gICAgICAgICAgICAgTm8sIEkgaGF2ZSBvbmx5IG9uZSByZXBs aWNhIGJlZXR3ZW4gdHdvIG5vZGVzLgo+ICAgICAgICAgICAgIFRoZSB0aGlyZCBub2RlIGlzIG9u bHkgYSBob3N0IGZvciB2bXMgYW5kIHRoYXQgdXNpbmcgdGhpcwo+ICAgICAgICAgICAgIHJlcGxp Y2EuCj4KPiAgICAgICAgICAgICBUaGFua3MKPiAgICAgICAgICAgICBUaWJvcgo+Cj4gICAgICAg ICAgICAgLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLS0tLS0tLS0tLS0tLS0tLS0tCj4KPgo+ICAgICAgICAgICAgICAgICBPbiAwMS8yMi8yMDE1 IDA4OjAzIFBNLCBEZW1ldGVyIFRpYm9yIHdyb3RlOgo+Cj4gICAgICAgICAgICAgICAgICAgICBI ZWxsbywKPgo+ICAgICAgICAgICAgICAgICAgICAgSSBoYXZlIGFuIG92aXJ0IDMuNS4wIGNsdXN0 ZXIgd2l0aCB0aHJlZSBub2RlcyBhbmQKPiAgICAgICAgICAgICAgICAgICAgIHdlIHVzaW5nIGds dXN0ZXJmcyBmb3Igc2VydmluZyBiYWNrZW5kIHN0b3JhZ2UgZm9yCj4gICAgICAgICAgICAgICAg ICAgICBWTS1zLiBHbHVzdGVyZnMgYXJlIG9uIHNhbWUgc2VydmVycyB3aXRoIG92aXJ0Lgo+ICAg ICAgICAgICAgICAgICAgICAgV2UgaGF2ZSBHbHVzdGVyIDMuNS4xIG9uIGFsbCBvZiBub2Rlcy4K Pgo+ICAgICAgICAgICAgICAgICAgICAgSG93IGNhbiBJIHVwZ3JhZGUgdG8gb3ZpcnQgMy41LjEg d2l0aCBuZXcKPiAgICAgICAgICAgICAgICAgICAgIGdsdXN0ZXJmcz8gSSBkb24ndCB3YW50IGRh dGEgaW5jb25zaXN0ZW5jeS9kYXRhCj4gICAgICAgICAgICAgICAgICAgICBsb3NzL3NwbGl0IGJy YWlucz8KPgo+Cj4gICAgICAgICAgICAgICAgIERvIHlvdSBoYXZlIGEgcmVwbGljYSAzIHZvbHVt ZSBzZXR1cCBhY3Jvc3MgdGhlc2UgMyBub2Rlcz8KPgo+ICAgICAgICAgICAgICAgICBHbHVzdGVy ZnMgc3VwcG9ydHMgcm9sbGluZyB1cGdyYWRlIGZvciByZXBsaWNhIHZvbHVtZXMuCj4gICAgICAg ICAgICAgICAgIEJ1dCB0aGVyZSBhcmUgc29tZSBpc3N1ZXMgdG8gdXBncmFkZSBmcm9tIDMuNSB0 byAzLjYKPiAgICAgICAgICAgICAgICAgdmVyc2lvbnMgKGRlcGVuZGluZyBvbiB2ZXJzaW9uIHVz ZWQpCj4gICAgICAgICAgICAgICAgIEFkZGluZyBnbHVzdGVyLXVzZXJzICYgUHJhbml0aCBmb3Ig cmVjb21tZW5kZWQgcHJvY2VkdXJlcy4KPgo+Cj4gICAgICAgICAgICAgICAgIHRoYW5rcwo+ICAg ICAgICAgICAgICAgICBzYWhpbmEKPgo+Cj4gICAgICAgICAgICAgICAgICAgICBOZWVkIEkgdXBk YXRlIGdsdXN0ZXIgdmVyc2lvbiB0byB0aGUgbGF0ZXN0Pwo+ICAgICAgICAgICAgICAgICAgICAg SG93IEkgbmVlZCB0byB1cGdyYWRlIHRoZSBub2RlcyA/ICBJcyB0aGVyZSBhbnkKPiAgICAgICAg ICAgICAgICAgICAgIHdoaXRlcGFwZXIgYWJvdXQgdGhpcz8KPgo+ICAgICAgICAgICAgICAgICAg ICAgKgo+ICAgICAgICAgICAgICAgICAgICAgKgo+Cj4gICAgICAgICAgICAgICAgICAgICAqCj4g ICAgICAgICAgICAgICAgICAgICAqCj4KPiAgICAgICAgICAgICAgICAgICAgIFRoYW5rcyBpbiBh ZHZhbmNlLAo+Cj4KPiAgICAgICAgICAgICAgICAgICAgIFRpYm9yCj4KPgo+Cj4gICAgICAgICAg ICAgICAgICAgICBfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f Xwo+ICAgICAgICAgICAgICAgICAgICAgVXNlcnMgbWFpbGluZyBsaXN0Cj4gICAgICAgICAgICAg ICAgICAgICBVc2Vyc0BvdmlydC5vcmcKPiAgICAgICAgICAgICAgICAgICAgIGh0dHA6Ly9saXN0 cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2Vycwo+Cj4KPgo+Cj4gICAgICAgICAgICAg X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KPiAgICAgICAg ICAgICBVc2VycyBtYWlsaW5nIGxpc3QKPiAgICAgICAgICAgICBVc2Vyc0BvdmlydC5vcmcKPiAg ICAgICAgICAgICBodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMK Pgo+Cj4KPgoKCi0tLS0tLS0tLS0tLS0tMDkwNDA3MDIwMzAwMDYwNzAzMDEwMjAyCkNvbnRlbnQt VHlwZTogdGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04CkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6 IDhiaXQKCjxodG1sPgogIDxoZWFkPgogICAgPG1ldGEgY29udGVudD0idGV4dC9odG1sOyBjaGFy c2V0PXV0Zi04IiBodHRwLWVxdWl2PSJDb250ZW50LVR5cGUiPgogIDwvaGVhZD4KICA8Ym9keSBi Z2NvbG9yPSIjRkZGRkZGIiB0ZXh0PSIjMDAwMDAwIj4KICAgIDxicj4KICAgIDxkaXYgY2xhc3M9 Im1vei1jaXRlLXByZWZpeCI+T24gMDIvMDIvMjAxNSAwODoxMiBQTSwgRGVtZXRlciBUaWJvcgog ICAgICB3cm90ZTo8YnI+CiAgICA8L2Rpdj4KICAgIDxibG9ja3F1b3RlCiAgICAgIGNpdGU9Im1p ZDo3ODgxODQ1OTAuNjYwNjU2Ni4xNDIyODg4MTM1Mjk4LkphdmFNYWlsLnppbWJyYUBpdHNtYXJ0 Lmh1IgogICAgICB0eXBlPSJjaXRlIj4KICAgICAgPGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IHRp bWVzIG5ldyByb21hbiwgbmV3IHlvcmssIHRpbWVzLCBzZXJpZjsKICAgICAgICBmb250LXNpemU6 IDEycHQ7IGNvbG9yOiAjMDAwMDAwIj4KICAgICAgICA8ZGl2PkhpIFNhaGluYSw8YnI+CiAgICAg ICAgPC9kaXY+CiAgICAgICAgPGRpdj48YnI+CiAgICAgICAgPC9kaXY+CiAgICAgICAgPGRpdj5V bmZvcnR1bmF0ZWx5IG15IGNvbXB1dGUgbm9kZXMgYW5kIGdsdXN0ZXIgbm9kZXMgYXJlIG9uCiAg ICAgICAgICBzYW1lIHNlcnZlcnMuIEkgcnVubmluZyBteSBWTXMgb24gdGhlIGdsdXN0ZXIgbm9k ZXMgYW5kCiAgICAgICAgICB2aWNhLXZlcnNhLsKgPC9kaXY+CiAgICAgICAgPGRpdj5BbHNvLCBt eSBvdmlydCBwb3J0YWwgaXMgcnVubmluZyBvbiB0aGUgZmlyc3Qgbm9kZSwgdGhhdCBpcwogICAg ICAgICAgYW4gZ2x1c3RlciBhbmQgY29tcHV0ZSBub2RlIHRvby48L2Rpdj4KICAgICAgPC9kaXY+ CiAgICA8L2Jsb2NrcXVvdGU+CiAgICA8YnI+CiAgICBJcyB0aGlzIGhvc3RlZC1lbmdpbmUgc2V0 dXA/IEhhdmUgeW91IGxvb2tlZCBhdAogICAgPGEgY2xhc3M9Im1vei10eHQtbGluay1mcmVldGV4 dCIgaHJlZj0iaHR0cDovL3d3dy5vdmlydC5vcmcvSG9zdGVkX0VuZ2luZV9Ib3d0byNVcGdyYWRl X0hvc3RlZF9FbmdpbmUiPmh0dHA6Ly93d3cub3ZpcnQub3JnL0hvc3RlZF9FbmdpbmVfSG93dG8j VXBncmFkZV9Ib3N0ZWRfRW5naW5lPC9hPiA/PGJyPgogICAgPGJyPgogICAgPGJsb2NrcXVvdGUK ICAgICAgY2l0ZT0ibWlkOjc4ODE4NDU5MC42NjA2NTY2LjE0MjI4ODgxMzUyOTguSmF2YU1haWwu emltYnJhQGl0c21hcnQuaHUiCiAgICAgIHR5cGU9ImNpdGUiPgogICAgICA8ZGl2IHN0eWxlPSJm b250LWZhbWlseTogdGltZXMgbmV3IHJvbWFuLCBuZXcgeW9yaywgdGltZXMsIHNlcmlmOwogICAg ICAgIGZvbnQtc2l6ZTogMTJwdDsgY29sb3I6ICMwMDAwMDAiPgogICAgICAgIDxkaXY+PGJyPgog ICAgICAgICAgSSBoYXZlIGEgZ2x1c3RlciBiYXNlZCBpbnN0YWxsYXRpb24gd2l0aCB0aHJlZSBz ZXJ2ZXJzLCB0d28KICAgICAgICAgIGZvciByZXBsaWNhJmFtcDtWTXMsIG9uZSBmb3IgVk1zLXMg b25seS48L2Rpdj4KICAgICAgPC9kaXY+CiAgICA8L2Jsb2NrcXVvdGU+CiAgICA8YnI+CiAgICBJ ZiB5b3UncmUgdXBncmFkaW5nIGZyb20gb1ZpcnQgMy41IHRvIDMuNS4xIC0gdGhlcmUncyBubyBu ZXcKICAgIGRlcGVuZGVuY3kgb24gZ2x1c3RlcmZzLiBTbywgeW91IGNvdWxkIGRlY2lkZSBub3Qg dG8gdXBncmFkZQogICAgZ2x1c3RlcmZzIGFuZCBqdXN0IHVwZ3JhZGUgdGhlIHZkc20gb24gdGhl IG5vZGVzLjxicj4KICAgIDxicj4KICAgIDxibG9ja3F1b3RlCiAgICAgIGNpdGU9Im1pZDo3ODgx ODQ1OTAuNjYwNjU2Ni4xNDIyODg4MTM1Mjk4LkphdmFNYWlsLnppbWJyYUBpdHNtYXJ0Lmh1Igog ICAgICB0eXBlPSJjaXRlIj4KICAgICAgPGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IHRpbWVzIG5l dyByb21hbiwgbmV3IHlvcmssIHRpbWVzLCBzZXJpZjsKICAgICAgICBmb250LXNpemU6IDEycHQ7 IGNvbG9yOiAjMDAwMDAwIj4KICAgICAgICA8ZGl2Pjxicj4KICAgICAgICAgIFRoaXMgaXMgYSBw cm9kdWN0aXZlIGVudmlyb25tZW50LCBzbyBJJ20gYWZmcmFpZCBzbyBtdWNoIG9mCiAgICAgICAg ICB1cGdyYWRpbmcuLi46KC5JIGRvbid0IHdhbnQgZ2x1c3RlcmZzIG1pc3Rha2VzLCBzcGxpdC1i cmFpbnMsCiAgICAgICAgICBldGMuLik8L2Rpdj4KICAgICAgICA8ZGl2Pjxicj4KICAgICAgICA8 L2Rpdj4KICAgICAgICA8ZGl2PkFsc28sIEkgY291bGQgbWFrZSBsaXR0bGUgZG93bnRpbWUgZm9y IHVwZ3JhZGluZywgYnV0IEknbQogICAgICAgICAgbmVlZCB0byBrbm93IHdoYXQgaXMgdGhlIHRy dXN0YWJsZSB1cGdyYWRlIHByb2NlZHVyZS4gSXMgdGhlcmUKICAgICAgICAgIGFuIG9mZmljaWFs IHVwZ3JhZGUgZG9jdW1lbnRhdGlvbiBmb3Igb3ZpcnQsIHRoYXQgaXMgY29udGFpbgogICAgICAg ICAgdGhlIGdsdXN0ZXJmcyB1cGdyZGUgbWV0aG9kcz88L2Rpdj4KICAgICAgPC9kaXY+CiAgICA8 L2Jsb2NrcXVvdGU+CiAgICA8YnI+CiAgICBUaGVyZSBhcmUgc2VwYXJhdGUgZG9jdW1lbnRhdGlv bnMgLSBmb3Igb1ZpcnQgdXBncmFkZSBhbmQgZ2x1c3RlcmZzCiAgICB1cGdyYWRlLiBObyBtZWNo YW5pc20gdG8gdXBncmFkZSBnbHVzdGVyZnMgb24gbm9kZXMgZnJvbSB3aXRoaW4KICAgIG9WaXJ0 Ljxicj4KICAgIDxicj4KICAgIDxicj4KICAgIDxicj4KICAgIDxibG9ja3F1b3RlCiAgICAgIGNp dGU9Im1pZDo3ODgxODQ1OTAuNjYwNjU2Ni4xNDIyODg4MTM1Mjk4LkphdmFNYWlsLnppbWJyYUBp dHNtYXJ0Lmh1IgogICAgICB0eXBlPSJjaXRlIj4KICAgICAgPGRpdiBzdHlsZT0iZm9udC1mYW1p bHk6IHRpbWVzIG5ldyByb21hbiwgbmV3IHlvcmssIHRpbWVzLCBzZXJpZjsKICAgICAgICBmb250 LXNpemU6IDEycHQ7IGNvbG9yOiAjMDAwMDAwIj4KICAgICAgICA8ZGl2Pjxicj4KICAgICAgICA8 L2Rpdj4KICAgICAgICA8ZGl2Pjxicj4KICAgICAgICA8L2Rpdj4KICAgICAgICA8ZGl2Pk15IGNs dXN0ZXIgbGV2ZWwgaXMgMy41LjwvZGl2PgogICAgICAgIDxkaXY+PGJyPgogICAgICAgIDwvZGl2 PgogICAgICAgIDxkaXY+VGhhbmtzIGEgbG90LjwvZGl2PgogICAgICAgIDxkaXY+PGJyPgogICAg ICAgIDwvZGl2PgogICAgICAgIDxkaXY+VGlib3I8L2Rpdj4KICAgICAgICA8ZGl2Pjxicj4KICAg ICAgICA8L2Rpdj4KICAgICAgICA8ZGl2Pjxicj4KICAgICAgICA8L2Rpdj4KICAgICAgICA8aHIg aWQ9Inp3Y2hyIj4KICAgICAgICA8YmxvY2txdW90ZSBzdHlsZT0iYm9yZGVyLWxlZnQ6MnB4IHNv bGlkCiMxMDEwRkY7bWFyZ2luLWxlZnQ6NXB4O3BhZGRpbmctbGVmdDo1cHg7Y29sb3I6IzAwMDtm b250LXdlaWdodDpub3JtYWw7Zm9udC1zdHlsZTpub3JtYWw7dGV4dC1kZWNvcmF0aW9uOm5vbmU7 Zm9udC1mYW1pbHk6SGVsdmV0aWNhLEFyaWFsLHNhbnMtc2VyaWY7Zm9udC1zaXplOjEycHQ7Ij4K ICAgICAgICAgIDxicj4KICAgICAgICAgIDxkaXYgY2xhc3M9Im1vei1jaXRlLXByZWZpeCI+T24g MDIvMDEvMjAxNSAwNDo0MCBQTSwgRGVtZXRlcgogICAgICAgICAgICBUaWJvciB3cm90ZTo8YnI+ CiAgICAgICAgICA8L2Rpdj4KICAgICAgICAgIDxibG9ja3F1b3RlCiAgICAgICAgICAgIGNpdGU9 Im1pZDoxMDkwNTQyNzYuNTU2MjE0MC4xNDIyNzg5MDI4Mzg1LkphdmFNYWlsLnppbWJyYUBpdHNt YXJ0Lmh1Ij4KICAgICAgICAgICAgPGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IHRpbWVzIG5ldyBy b21hbiwgbmV3IHlvcmssIHRpbWVzLAogICAgICAgICAgICAgIHNlcmlmOyBmb250LXNpemU6IDEy cHQ7IGNvbG9yOiAjMDAwMDAwIj4KICAgICAgICAgICAgICA8ZGl2PkhpLDwvZGl2PgogICAgICAg ICAgICAgIDxkaXY+PGJyPgogICAgICAgICAgICAgIDwvZGl2PgogICAgICAgICAgICAgIDxkaXY+ SXMgZ2x1c3RlcmZzIDMuNiBpcyBuZWNjZXNzYXJ5IGZvciBvdmlydCAzLjUuMT88L2Rpdj4KICAg ICAgICAgICAgICA8ZGl2PkkgaGF2ZSAzLjUuMiBhdCB0aGlzIG1vbWVudC48L2Rpdj4KICAgICAg ICAgICAgICA8ZGl2Pjxicj4KICAgICAgICAgICAgICA8L2Rpdj4KICAgICAgICAgICAgICA8ZGl2 PjMuNiBuZWNjZXNzYXJ5IGZvciB1cGdhZGUgP8KgPC9kaXY+CiAgICAgICAgICAgICAgPGRpdj48 YnI+CiAgICAgICAgICAgICAgPC9kaXY+CiAgICAgICAgICAgIDwvZGl2PgogICAgICAgICAgPC9i bG9ja3F1b3RlPgogICAgICAgICAgPGJyPgogICAgICAgICAgSWYgeW91IG9ubHkgd2FudCB0byB1 cGdyYWRlIHRoZSBlbmdpbmUgdG8gb1ZpcnQgMy41LjEgLSB5b3UKICAgICAgICAgIGRvbid0IG5l ZWQgdG8gdXBncmFkZSB0aGUgZ2x1c3RlciBub2Rlcy4gSSB1bmRlcnN0YW5kIHRoYXQKICAgICAg ICAgIHlvdXIgZ2x1c3RlciBub2RlcyBhcmUgc2VwYXJhdGUgZnJvbSB0aGUgdmlydCBub2Rlcy4g VGhhdCBpcywKICAgICAgICAgIHlvdSBkbyBub3QgaGF2ZSBhbnkgY2x1c3RlciBlbmFibGVkIHdp dGggYm90aCB2aXJ0ICsgZ2x1c3RlcgogICAgICAgICAgc2VydmljZS48YnI+CiAgICAgICAgICA8 YnI+CiAgICAgICAgICBnbHVzdGVyZnMgMy42IGlzIG5vdCBuZWNlc3NhcnkgdG8gdXBncmFkZSBl bmdpbmUgdG8gb1ZpcnQKICAgICAgICAgIDMuNS4xLiBJdCB3b3VsZCBvbmx5IGJlIHJlcXVpcmVk IGlmIHlvdSB3ZXJlIHVwZ3JhZGluZyB0aGUKICAgICAgICAgIGNsdXN0ZXIgbGV2ZWwgKHRoZSBj b21wYXRpYmlsaXR5IHZlcnNpb24pIHdoaWNoIGluIHR1cm4gd291bGQKICAgICAgICAgIHJlcXVp cmUgbmV3ZXIgdmRzbSB2ZXJzaW9ucyBhbmQgZ2x1c3RlciB2ZXJzaW9ucy4gQnV0IGluIHlvdXIK ICAgICAgICAgIGNhc2UsIEkgdGhpbmsgeW91IGFscmVhZHkgaGF2ZSB5b3VyIGNsdXN0ZXIgcnVu bmluZyB3aXRoCiAgICAgICAgICBnbHVzdGVyZnMgMy41LjIuIFdoYXQgaXMgdGhlIGNsdXN0ZXIg Y29tcGF0aWJpbGl0eSB2ZXJzaW9uPzxicj4KICAgICAgICAgIDxicj4KICAgICAgICAgIDxicj4K ICAgICAgICAgIDxibG9ja3F1b3RlCiAgICAgICAgICAgIGNpdGU9Im1pZDoxMDkwNTQyNzYuNTU2 MjE0MC4xNDIyNzg5MDI4Mzg1LkphdmFNYWlsLnppbWJyYUBpdHNtYXJ0Lmh1Ij4KICAgICAgICAg ICAgPGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IHRpbWVzIG5ldyByb21hbiwgbmV3IHlvcmssIHRp bWVzLAogICAgICAgICAgICAgIHNlcmlmOyBmb250LXNpemU6IDEycHQ7IGNvbG9yOiAjMDAwMDAw Ij4KICAgICAgICAgICAgICA8ZGl2PkknbSB3b3JyaWVkIHdoYXQgd2lsbCBoYXBwZWQgd2l0aCBt eSBnbHVzdGVyIHZvbHVtZXMKICAgICAgICAgICAgICAgIGFmdGVyIHRoZSB1cGdyYWRlLi4uIDoo PC9kaXY+CiAgICAgICAgICAgICAgPGRpdj48YnI+CiAgICAgICAgICAgICAgPC9kaXY+CiAgICAg ICAgICAgICAgPGRpdj5QbGVzZSBoZWxwIG1lLjwvZGl2PgogICAgICAgICAgICAgIDxkaXY+PGJy PgogICAgICAgICAgICAgIDwvZGl2PgogICAgICAgICAgICAgIDxkaXY+QWxzbywgaG93IGNhbiBJ IHVwZ3JhZGUgdGhlIG5vZGVzPyBOZWVkIGknbSB0byBhICJ5dW0KICAgICAgICAgICAgICAgIHVw Z3JhZGUiIG9uIHRoZSBjb21wdXRlIG5vZGVzPzwvZGl2PgogICAgICAgICAgICA8L2Rpdj4KICAg ICAgICAgIDwvYmxvY2txdW90ZT4KICAgICAgICAgIDxicj4KICAgICAgICAgIEJ5IHVwZ3JhZGUg dGhlIG5vZGVzIC0geW91IG1lYW4gb25seSB0aGUgY29tcHV0ZSBub2Rlcz8geXVtCiAgICAgICAg ICB1cGdyYWRlIG9uIGVhY2ggbm9kZSBzaG91bGQgd29yay48YnI+CiAgICAgICAgICBZb3UgY2Fu IGFsc28gbW92ZSB0aGUgSG9zdCB0byBtYWludGVuYW5jZSBtb2RlIGFuZCBjbGljayBvbgogICAg ICAgICAgUmVpbnN0YWxsIG9yIHVwZ3JhZGUgZnJvbSBlbmdpbmUuPGJyPgogICAgICAgICAgPGJy PgogICAgICAgICAgPGJyPgogICAgICAgICAgPGJsb2NrcXVvdGUKICAgICAgICAgICAgY2l0ZT0i bWlkOjEwOTA1NDI3Ni41NTYyMTQwLjE0MjI3ODkwMjgzODUuSmF2YU1haWwuemltYnJhQGl0c21h cnQuaHUiPgogICAgICAgICAgICA8ZGl2IHN0eWxlPSJmb250LWZhbWlseTogdGltZXMgbmV3IHJv bWFuLCBuZXcgeW9yaywgdGltZXMsCiAgICAgICAgICAgICAgc2VyaWY7IGZvbnQtc2l6ZTogMTJw dDsgY29sb3I6ICMwMDAwMDAiPgogICAgICAgICAgICAgIDxkaXY+PGJyPgogICAgICAgICAgICAg IDwvZGl2PgogICAgICAgICAgICAgIDxkaXY+VGhhbmtzLjwvZGl2PgogICAgICAgICAgICAgIDxk aXY+PGJyPgogICAgICAgICAgICAgIDwvZGl2PgogICAgICAgICAgICAgIDxkaXY+VGlib3I8L2Rp dj4KICAgICAgICAgICAgICA8ZGl2PjxzcGFuPjwvc3Bhbj4KICAgICAgICAgICAgICAgIDxwIHN0 eWxlPSJmb250LWZhbWlseTogJ1RpbWVzIE5ldyBSb21hbic7IGZvbnQtc2l6ZToKICAgICAgICAg ICAgICAgICAgbWVkaXVtOyBtYXJnaW46IDBweDsiPjxicj4KICAgICAgICAgICAgICAgIDwvcD4K ICAgICAgICAgICAgICA8L2Rpdj4KICAgICAgICAgICAgICA8aHIgaWQ9Inp3Y2hyIj4KICAgICAg ICAgICAgICA8YmxvY2txdW90ZSBzdHlsZT0iYm9yZGVyLWxlZnQ6MnB4IHNvbGlkCiMxMDEwRkY7 bWFyZ2luLWxlZnQ6NXB4O3BhZGRpbmctbGVmdDo1cHg7Y29sb3I6IzAwMDtmb250LXdlaWdodDpu b3JtYWw7Zm9udC1zdHlsZTpub3JtYWw7dGV4dC1kZWNvcmF0aW9uOm5vbmU7Zm9udC1mYW1pbHk6 SGVsdmV0aWNhLEFyaWFsLHNhbnMtc2VyaWY7Zm9udC1zaXplOjEycHQ7Ij4KICAgICAgICAgICAg ICAgIDxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiB0aW1lcyBuZXcgcm9tYW4sIG5ldyB5b3JrLAog ICAgICAgICAgICAgICAgICB0aW1lcywgc2VyaWY7IGZvbnQtc2l6ZTogMTJwdDsgY29sb3I6ICMw MDAwMDAiPgogICAgICAgICAgICAgICAgICA8ZGl2PkhpLDwvZGl2PgogICAgICAgICAgICAgICAg ICA8ZGl2Pjxicj4KICAgICAgICAgICAgICAgICAgPC9kaXY+CiAgICAgICAgICAgICAgICAgIDxk aXY+Tm8sIEkgaGF2ZSBvbmx5IG9uZSByZXBsaWNhIGJlZXR3ZW4gdHdvIG5vZGVzLjwvZGl2Pgog ICAgICAgICAgICAgICAgICA8ZGl2PlRoZSB0aGlyZCBub2RlIGlzIG9ubHkgYSBob3N0IGZvciB2 bXMgYW5kIHRoYXQKICAgICAgICAgICAgICAgICAgICB1c2luZyB0aGlzIHJlcGxpY2EuPC9kaXY+ CiAgICAgICAgICAgICAgICAgIDxkaXY+PGJyPgogICAgICAgICAgICAgICAgICA8L2Rpdj4KICAg ICAgICAgICAgICAgICAgPGRpdj5UaGFua3M8L2Rpdj4KICAgICAgICAgICAgICAgICAgPGRpdj5U aWJvcjwvZGl2PgogICAgICAgICAgICAgICAgICA8ZGl2PjxzcGFuPjwvc3Bhbj48YnI+CiAgICAg ICAgICAgICAgICAgIDwvZGl2PgogICAgICAgICAgICAgICAgICA8aHIgaWQ9Inp3Y2hyIj4KICAg ICAgICAgICAgICAgICAgPGJsb2NrcXVvdGUgc3R5bGU9ImJvcmRlci1sZWZ0OjJweCBzb2xpZAoj MTAxMEZGO21hcmdpbi1sZWZ0OjVweDtwYWRkaW5nLWxlZnQ6NXB4O2NvbG9yOiMwMDA7Zm9udC13 ZWlnaHQ6bm9ybWFsO2ZvbnQtc3R5bGU6bm9ybWFsO3RleHQtZGVjb3JhdGlvbjpub25lO2ZvbnQt ZmFtaWx5OkhlbHZldGljYSxBcmlhbCxzYW5zLXNlcmlmO2ZvbnQtc2l6ZToxMnB0OyI+PGJyPgog ICAgICAgICAgICAgICAgICAgIDxkaXYgY2xhc3M9Im1vei1jaXRlLXByZWZpeCI+T24gMDEvMjIv MjAxNSAwODowMyBQTSwKICAgICAgICAgICAgICAgICAgICAgIERlbWV0ZXIgVGlib3Igd3JvdGU6 PGJyPgogICAgICAgICAgICAgICAgICAgIDwvZGl2PgogICAgICAgICAgICAgICAgICAgIDxibG9j a3F1b3RlCiAgICAgICAgICAgICAgICAgICAgICBjaXRlPSJtaWQ6MTEyODc5NDIwOS4yMTA1NTM0 Ni4xNDIxOTM3MTg2ODEzLkphdmFNYWlsLnppbWJyYUBpdHNtYXJ0Lmh1Ij4KICAgICAgICAgICAg ICAgICAgICAgIDxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiB0aW1lcyBuZXcgcm9tYW4sIG5ldwog ICAgICAgICAgICAgICAgICAgICAgICB5b3JrLCB0aW1lcywgc2VyaWY7IGZvbnQtc2l6ZTogMTJw dDsgY29sb3I6CiAgICAgICAgICAgICAgICAgICAgICAgICMwMDAwMDAiPgogICAgICAgICAgICAg ICAgICAgICAgICA8ZGl2PjxzcGFuIHN0eWxlPSJmb250LXNpemU6IDEycHQ7Ij5IZWxsbyw8L3Nw YW4+PC9kaXY+CiAgICAgICAgICAgICAgICAgICAgICAgIDxkaXY+PGJyPgogICAgICAgICAgICAg ICAgICAgICAgICA8L2Rpdj4KICAgICAgICAgICAgICAgICAgICAgICAgPGRpdj5JIGhhdmUgYW4g b3ZpcnQgMy41LjAgY2x1c3RlciB3aXRoIHRocmVlCiAgICAgICAgICAgICAgICAgICAgICAgICAg bm9kZXMgYW5kIHdlIHVzaW5nIGdsdXN0ZXJmcyBmb3Igc2VydmluZwogICAgICAgICAgICAgICAg ICAgICAgICAgIGJhY2tlbmQgc3RvcmFnZSBmb3IgVk0tcy4gR2x1c3RlcmZzIGFyZSBvbgogICAg ICAgICAgICAgICAgICAgICAgICAgIHNhbWUgc2VydmVycyB3aXRoIG92aXJ0LjwvZGl2PgogICAg ICAgICAgICAgICAgICAgICAgICA8ZGl2PldlIGhhdmUgR2x1c3RlciAzLjUuMSBvbiBhbGwgb2Yg bm9kZXMuPC9kaXY+CiAgICAgICAgICAgICAgICAgICAgICAgIDxkaXY+PGJyPgogICAgICAgICAg ICAgICAgICAgICAgICA8L2Rpdj4KICAgICAgICAgICAgICAgICAgICAgICAgPGRpdj5Ib3cgY2Fu IEkgdXBncmFkZSB0byBvdmlydCAzLjUuMSB3aXRoIG5ldwogICAgICAgICAgICAgICAgICAgICAg ICAgIGdsdXN0ZXJmcz8gSSBkb24ndCB3YW50IGRhdGEKICAgICAgICAgICAgICAgICAgICAgICAg ICBpbmNvbnNpc3RlbmN5L2RhdGEgbG9zcy9zcGxpdCBicmFpbnM/PC9kaXY+CiAgICAgICAgICAg ICAgICAgICAgICA8L2Rpdj4KICAgICAgICAgICAgICAgICAgICA8L2Jsb2NrcXVvdGU+CiAgICAg ICAgICAgICAgICAgICAgPGJyPgogICAgICAgICAgICAgICAgICAgIERvIHlvdSBoYXZlIGEgcmVw bGljYSAzIHZvbHVtZSBzZXR1cCBhY3Jvc3MgdGhlc2UgMwogICAgICAgICAgICAgICAgICAgIG5v ZGVzPzxicj4KICAgICAgICAgICAgICAgICAgICA8YnI+CiAgICAgICAgICAgICAgICAgICAgR2x1 c3RlcmZzIHN1cHBvcnRzIHJvbGxpbmcgdXBncmFkZSBmb3IgcmVwbGljYQogICAgICAgICAgICAg ICAgICAgIHZvbHVtZXMuIDxicj4KICAgICAgICAgICAgICAgICAgICBCdXQgdGhlcmUgYXJlIHNv bWUgaXNzdWVzIHRvIHVwZ3JhZGUgZnJvbSAzLjUgdG8gMy42CiAgICAgICAgICAgICAgICAgICAg dmVyc2lvbnMgKGRlcGVuZGluZyBvbiB2ZXJzaW9uIHVzZWQpPGJyPgogICAgICAgICAgICAgICAg ICAgIEFkZGluZyBnbHVzdGVyLXVzZXJzICZhbXA7IFByYW5pdGggZm9yIHJlY29tbWVuZGVkCiAg ICAgICAgICAgICAgICAgICAgcHJvY2VkdXJlcy48YnI+CiAgICAgICAgICAgICAgICAgICAgPGJy PgogICAgICAgICAgICAgICAgICAgIDxicj4KICAgICAgICAgICAgICAgICAgICB0aGFua3M8YnI+ CiAgICAgICAgICAgICAgICAgICAgc2FoaW5hPGJyPgogICAgICAgICAgICAgICAgICAgIDxicj4K ICAgICAgICAgICAgICAgICAgICA8YmxvY2txdW90ZQogICAgICAgICAgICAgICAgICAgICAgY2l0 ZT0ibWlkOjExMjg3OTQyMDkuMjEwNTUzNDYuMTQyMTkzNzE4NjgxMy5KYXZhTWFpbC56aW1icmFA aXRzbWFydC5odSI+CiAgICAgICAgICAgICAgICAgICAgICA8ZGl2IHN0eWxlPSJmb250LWZhbWls eTogdGltZXMgbmV3IHJvbWFuLCBuZXcKICAgICAgICAgICAgICAgICAgICAgICAgeW9yaywgdGlt ZXMsIHNlcmlmOyBmb250LXNpemU6IDEycHQ7IGNvbG9yOgogICAgICAgICAgICAgICAgICAgICAg ICAjMDAwMDAwIj4KICAgICAgICAgICAgICAgICAgICAgICAgPGRpdj48YnI+CiAgICAgICAgICAg ICAgICAgICAgICAgIDwvZGl2PgogICAgICAgICAgICAgICAgICAgICAgICA8ZGl2Pk5lZWQgSSB1 cGRhdGUgZ2x1c3RlciB2ZXJzaW9uIHRvIHRoZQogICAgICAgICAgICAgICAgICAgICAgICAgIGxh dGVzdD88L2Rpdj4KICAgICAgICAgICAgICAgICAgICAgICAgPGRpdj5Ib3cgSSBuZWVkIHRvIHVw Z3JhZGUgdGhlIG5vZGVzID8gwqBJcyB0aGVyZQogICAgICAgICAgICAgICAgICAgICAgICAgIGFu eSB3aGl0ZXBhcGVyIGFib3V0IHRoaXM/PC9kaXY+CiAgICAgICAgICAgICAgICAgICAgICAgIDxk aXY+PHNwYW4+PC9zcGFuPgogICAgICAgICAgICAgICAgICAgICAgICAgIDxwIHN0eWxlPSJmb250 LWZhbWlseTogJ1RpbWVzIE5ldyBSb21hbic7CiAgICAgICAgICAgICAgICAgICAgICAgICAgICBm b250LXNpemU6IG1lZGl1bTsgbWFyZ2luOiAwcHg7Ij48c3Ryb25nPjxzcGFuCiAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgc3R5bGU9ImZvbnQtc2l6ZTogbWVkaXVtOyI+PHNwYW4KICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIHN0eWxlPSJjb2xvcjogcmdiKDQ1LCAxMDMs IDE3Nik7Ij48YnI+CiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgPC9zcGFuPjwvc3Bh bj48L3N0cm9uZz48L3A+CiAgICAgICAgICAgICAgICAgICAgICAgICAgPHAgc3R5bGU9ImZvbnQt ZmFtaWx5OiAnVGltZXMgTmV3IFJvbWFuJzsKICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZv bnQtc2l6ZTogbWVkaXVtOyBtYXJnaW46IDBweDsiPjxzdHJvbmc+PHNwYW4KICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICBzdHlsZT0iZm9udC1zaXplOiBtZWRpdW07Ij48c3BhbgogICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgc3R5bGU9ImNvbG9yOiByZ2IoNDUsIDEwMywg MTc2KTsiPjxicj4KICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICA8L3NwYW4+PC9zcGFu Pjwvc3Ryb25nPjwvcD4KICAgICAgICAgICAgICAgICAgICAgICAgICA8cCBzdHlsZT0iZm9udC1m YW1pbHk6ICdUaW1lcyBOZXcgUm9tYW4nOwogICAgICAgICAgICAgICAgICAgICAgICAgICAgZm9u dC1zaXplOiBtZWRpdW07IG1hcmdpbjogMHB4OyI+VGhhbmtzIGluCiAgICAgICAgICAgICAgICAg ICAgICAgICAgICBhZHZhbmNlLDwvcD4KICAgICAgICAgICAgICAgICAgICAgICAgICA8cCBzdHls ZT0iZm9udC1mYW1pbHk6ICdUaW1lcyBOZXcgUm9tYW4nOwogICAgICAgICAgICAgICAgICAgICAg ICAgICAgZm9udC1zaXplOiBtZWRpdW07IG1hcmdpbjogMHB4OyI+PGJyPgogICAgICAgICAgICAg ICAgICAgICAgICAgIDwvcD4KICAgICAgICAgICAgICAgICAgICAgICAgICA8cCBzdHlsZT0iZm9u dC1mYW1pbHk6ICdUaW1lcyBOZXcgUm9tYW4nOwogICAgICAgICAgICAgICAgICAgICAgICAgICAg Zm9udC1zaXplOiBtZWRpdW07IG1hcmdpbjogMHB4OyI+VGlib3I8L3A+CiAgICAgICAgICAgICAg ICAgICAgICAgIDwvZGl2PgogICAgICAgICAgICAgICAgICAgICAgPC9kaXY+CiAgICAgICAgICAg ICAgICAgICAgICA8YnI+CiAgICAgICAgICAgICAgICAgICAgICA8ZmllbGRzZXQgY2xhc3M9Im1p bWVBdHRhY2htZW50SGVhZGVyIj48L2ZpZWxkc2V0PgogICAgICAgICAgICAgICAgICAgICAgPGJy PgogICAgICAgICAgICAgICAgICAgICAgPHByZT5fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fXwpVc2VycyBtYWlsaW5nIGxpc3QKPGEgbW96LWRvLW5vdC1zZW5k PSJ0cnVlIiBjbGFzcz0ibW96LXR4dC1saW5rLWFiYnJldmlhdGVkIiBocmVmPSJtYWlsdG86VXNl cnNAb3ZpcnQub3JnIiB0YXJnZXQ9Il9ibGFuayI+VXNlcnNAb3ZpcnQub3JnPC9hPgo8YSBtb3ot ZG8tbm90LXNlbmQ9InRydWUiIGNsYXNzPSJtb3otdHh0LWxpbmstZnJlZXRleHQiIGhyZWY9Imh0 dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycyIgdGFyZ2V0PSJfYmxh bmsiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VyczwvYT4KPC9w cmU+CiAgICAgICAgICAgICAgICAgICAgPC9ibG9ja3F1b3RlPgogICAgICAgICAgICAgICAgICAg IDxicj4KICAgICAgICAgICAgICAgICAgPC9ibG9ja3F1b3RlPgogICAgICAgICAgICAgICAgICA8 ZGl2Pjxicj4KICAgICAgICAgICAgICAgICAgPC9kaXY+CiAgICAgICAgICAgICAgICA8L2Rpdj4K ICAgICAgICAgICAgICAgIDxicj4KICAgICAgICAgICAgICAgIF9fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fPGJyPgogICAgICAgICAgICAgICAgVXNlcnMgbWFp bGluZyBsaXN0PGJyPgogICAgICAgICAgICAgICAgPGEgbW96LWRvLW5vdC1zZW5kPSJ0cnVlIgog ICAgICAgICAgICAgICAgICBjbGFzcz0ibW96LXR4dC1saW5rLWFiYnJldmlhdGVkIgogICAgICAg ICAgICAgICAgICBocmVmPSJtYWlsdG86VXNlcnNAb3ZpcnQub3JnIiB0YXJnZXQ9Il9ibGFuayI+ VXNlcnNAb3ZpcnQub3JnPC9hPjxicj4KICAgICAgICAgICAgICAgIDxhIG1vei1kby1ub3Qtc2Vu ZD0idHJ1ZSIgY2xhc3M9Im1vei10eHQtbGluay1mcmVldGV4dCIKICAgICAgICAgICAgICAgICAg aHJlZj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIgogICAg ICAgICAgICAgICAgICB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWls bWFuL2xpc3RpbmZvL3VzZXJzPC9hPjxicj4KICAgICAgICAgICAgICA8L2Jsb2NrcXVvdGU+CiAg ICAgICAgICAgICAgPGRpdj48YnI+CiAgICAgICAgICAgICAgPC9kaXY+CiAgICAgICAgICAgIDwv ZGl2PgogICAgICAgICAgPC9ibG9ja3F1b3RlPgogICAgICAgICAgPGJyPgogICAgICAgIDwvYmxv Y2txdW90ZT4KICAgICAgICA8ZGl2Pjxicj4KICAgICAgICA8L2Rpdj4KICAgICAgPC9kaXY+CiAg ICA8L2Jsb2NrcXVvdGU+CiAgICA8YnI+CiAgPC9ib2R5Pgo8L2h0bWw+CgotLS0tLS0tLS0tLS0t LTA5MDQwNzAyMDMwMDA2MDcwMzAxMDIwMi0tCg== --===============1801076720775376516==--