From blanchet at abes.fr Mon Jun 2 07:24:22 2014
Content-Type: multipart/mixed; boundary="===============8344636356672490087=="
MIME-Version: 1.0
From: =?utf-8?q?Nathana=C3=ABl_Blanchet_=3Cblanchet_at_abes=2Efr=3E?=
To: users at ovirt.org
Subject: [ovirt-users] probing peers in gluster after installing hosts
Date: Mon, 02 Jun 2014 13:24:19 +0200
Message-ID: <538C5EE3.1000808@abes.fr>
--===============8344636356672490087==
Content-Type: text/plain; charset="utf-8"
MIME-Version: 1.0
Content-Transfer-Encoding: quoted-printable
This is a multi-part message in MIME format.
--------------050806000807090207010701
Content-Type: text/plain; charset=3DISO-8859-1; format=3Dflowed
Content-Transfer-Encoding: 8bit
Hi all,
I created 3 clusters in unique datacenter. I installed my hosts to the =
first one after activating the gluster service in the cluster tab. A =
expected otopi installed then the vdsm-gluster rpm and everything were =
ok for this first cluster.
The other ones weren't initially gluster ready and I wanted to activate =
the service after installing the host (so they were without vdsm-gluster =
package). But checking that item didn't do anything for these hosts, so =
that I had to manually install vdsm-gluster package. Then, when creating =
a volume, the UI told me that hosts couldn't communicate. So I had to =
manually probe them. This leads me to that question : is it an expected =
behaviour? The whole gluster job (installing appropriated package and =
probing peers in the cluster) should be done thanks to the UI cluster =
tab "gluster service".
A last question : why isn't it possible to probe host on different =
clusters in the same datacenter, could be very useful.
-- =
Nathana=C3=ABl Blanchet
Supervision r=C3=A9seau
P=C3=B4le exploitation et maintenance
D=C3=A9partement des syst=C3=A8mes d'information
227 avenue Professeur-Jean-Louis-Viala
34193 MONTPELLIER CEDEX 5 =
T=C3=A9l. 33 (0)4 67 54 84 55
Fax 33 (0)4 67 54 84 14
blanchet(a)abes.fr
--------------050806000807090207010701
Content-Type: text/html; charset=3DISO-8859-1
Content-Transfer-Encoding: 7bit
Hi all,
I created 3 clusters in unique datacenter. I installed my hosts to the first one after
activating the gluster service in the cluster tab. A expected
otopi installed then the vdsm-gluster rpm and everything were ok
for this first cluster.
The other ones weren't initially gluster ready and I wanted to
activate the service after installing the host (so they were
without vdsm-gluster package). But checking that item didn't do
anything for these hosts, so that I had to manually install
vdsm-gluster package. Then, when creating a volume, the UI told me
that hosts couldn't communicate. So I had to manually probe them.
This leads me to that question : is it an expected behaviour? The
whole gluster job (installing appropriated package and probing
peers in the cluster) should be done thanks to the UI cluster tab
"gluster service".
A last question : why isn't it possible to probe host on different
clusters in the same datacenter, could be very useful.
-- =
Nathanaël Blanchet
Supervision réseau
Pôle exploitation et maintenance
Département des systèmes d'information
227 avenue Professeur-Jean-Louis-Viala
34193 MONTPELLIER CEDEX 5 =
Tél. 33 (0)4 67 54 84 55
Fax 33 (0)4 67 54 84 14
bl=
anchet(a)abes.fr
--------------050806000807090207010701--
--===============8344636356672490087==
Content-Type: multipart/alternative
MIME-Version: 1.0
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="attachment.bin"
VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t
LS0wNTA4MDYwMDA4MDcwOTAyMDcwMTA3MDEKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy
c2V0PUlTTy04ODU5LTE7IGZvcm1hdD1mbG93ZWQKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzog
OGJpdAoKSGkgYWxsLAoKSSBjcmVhdGVkIDMgY2x1c3RlcnMgaW4gdW5pcXVlIGRhdGFjZW50ZXIu
IEkgaW5zdGFsbGVkIG15IGhvc3RzIHRvIHRoZSAKZmlyc3Qgb25lIGFmdGVyIGFjdGl2YXRpbmcg
dGhlIGdsdXN0ZXIgc2VydmljZSBpbiB0aGUgY2x1c3RlciB0YWIuIEEgCmV4cGVjdGVkIG90b3Bp
IGluc3RhbGxlZCB0aGVuIHRoZSB2ZHNtLWdsdXN0ZXIgcnBtIGFuZCBldmVyeXRoaW5nIHdlcmUg
Cm9rIGZvciB0aGlzIGZpcnN0IGNsdXN0ZXIuClRoZSBvdGhlciBvbmVzIHdlcmVuJ3QgaW5pdGlh
bGx5IGdsdXN0ZXIgcmVhZHkgYW5kIEkgd2FudGVkIHRvIGFjdGl2YXRlIAp0aGUgc2VydmljZSBh
ZnRlciBpbnN0YWxsaW5nIHRoZSBob3N0IChzbyB0aGV5IHdlcmUgd2l0aG91dCB2ZHNtLWdsdXN0
ZXIgCnBhY2thZ2UpLiBCdXQgY2hlY2tpbmcgdGhhdCBpdGVtIGRpZG4ndCBkbyBhbnl0aGluZyBm
b3IgdGhlc2UgaG9zdHMsIHNvIAp0aGF0IEkgaGFkIHRvIG1hbnVhbGx5IGluc3RhbGwgdmRzbS1n
bHVzdGVyIHBhY2thZ2UuIFRoZW4sIHdoZW4gY3JlYXRpbmcgCmEgdm9sdW1lLCB0aGUgVUkgdG9s
ZCBtZSB0aGF0IGhvc3RzIGNvdWxkbid0IGNvbW11bmljYXRlLiBTbyBJIGhhZCB0byAKbWFudWFs
bHkgcHJvYmUgdGhlbS4gVGhpcyBsZWFkcyBtZSB0byB0aGF0IHF1ZXN0aW9uIDogaXMgaXQgYW4g
ZXhwZWN0ZWQgCmJlaGF2aW91cj8gVGhlIHdob2xlIGdsdXN0ZXIgam9iIChpbnN0YWxsaW5nIGFw
cHJvcHJpYXRlZCBwYWNrYWdlIGFuZCAKcHJvYmluZyBwZWVycyBpbiB0aGUgY2x1c3Rlcikgc2hv
dWxkIGJlIGRvbmUgdGhhbmtzIHRvIHRoZSBVSSBjbHVzdGVyIAp0YWIgImdsdXN0ZXIgc2Vydmlj
ZSIuCkEgbGFzdCBxdWVzdGlvbiA6IHdoeSBpc24ndCBpdCBwb3NzaWJsZSB0byBwcm9iZSBob3N0
IG9uIGRpZmZlcmVudCAKY2x1c3RlcnMgaW4gdGhlIHNhbWUgZGF0YWNlbnRlciwgY291bGQgYmUg
dmVyeSB1c2VmdWwuCgotLSAKTmF0aGFuYetsIEJsYW5jaGV0CgpTdXBlcnZpc2lvbiBy6XNlYXUK
UPRsZSBleHBsb2l0YXRpb24gZXQgbWFpbnRlbmFuY2UKROlwYXJ0ZW1lbnQgZGVzIHN5c3TobWVz
IGQnaW5mb3JtYXRpb24KMjI3IGF2ZW51ZSBQcm9mZXNzZXVyLUplYW4tTG91aXMtVmlhbGEKMzQx
OTMgTU9OVFBFTExJRVIgQ0VERVggNSAJClTpbC4gMzMgKDApNCA2NyA1NCA4NCA1NQpGYXggIDMz
ICgwKTQgNjcgNTQgODQgMTQKYmxhbmNoZXRAYWJlcy5mcgoKCi0tLS0tLS0tLS0tLS0tMDUwODA2
MDAwODA3MDkwMjA3MDEwNzAxCkNvbnRlbnQtVHlwZTogdGV4dC9odG1sOyBjaGFyc2V0PUlTTy04
ODU5LTEKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogN2JpdAoKPGh0bWw+CiAgPGhlYWQ+Cgog
ICAgPG1ldGEgaHR0cC1lcXVpdj0iY29udGVudC10eXBlIiBjb250ZW50PSJ0ZXh0L2h0bWw7IGNo
YXJzZXQ9SVNPLTg4NTktMSI+CiAgPC9oZWFkPgogIDxib2R5IGJnY29sb3I9IiNGRkZGRkYiIHRl
eHQ9IiMwMDAwMDAiPgogICAgPGZvbnQgc2l6ZT0iLTEiPkhpIGFsbCw8YnI+CiAgICAgIDxicj4K
ICAgICAgSSBjcmVhdGVkIDMgY2x1c3RlcnMgaW4gdW5pcXVlIGRhdGFjZW50ZXIuIEkgaW5zdGFs
bGVkIDwvZm9udD48Zm9udAogICAgICBzaXplPSItMSI+PGZvbnQgc2l6ZT0iLTEiPm15IGhvc3Rz
IDwvZm9udD50byB0aGUgZmlyc3Qgb25lIGFmdGVyCiAgICAgIGFjdGl2YXRpbmcgdGhlIGdsdXN0
ZXIgc2VydmljZSBpbiB0aGUgY2x1c3RlciB0YWIuIEEgZXhwZWN0ZWQKICAgICAgb3RvcGkgaW5z
dGFsbGVkIHRoZW4gdGhlIHZkc20tZ2x1c3RlciBycG0gYW5kIGV2ZXJ5dGhpbmcgd2VyZSBvawog
ICAgICBmb3IgdGhpcyBmaXJzdCBjbHVzdGVyLiA8YnI+CiAgICAgIFRoZSBvdGhlciBvbmVzIHdl
cmVuJ3QgaW5pdGlhbGx5IGdsdXN0ZXIgcmVhZHkgYW5kIEkgd2FudGVkIHRvCiAgICAgIGFjdGl2
YXRlIHRoZSBzZXJ2aWNlIGFmdGVyIGluc3RhbGxpbmcgdGhlIGhvc3QgKHNvIHRoZXkgd2VyZQog
ICAgICB3aXRob3V0IHZkc20tZ2x1c3RlciBwYWNrYWdlKS4gQnV0IGNoZWNraW5nIHRoYXQgaXRl
bSBkaWRuJ3QgZG8KICAgICAgYW55dGhpbmcgZm9yIHRoZXNlIGhvc3RzLCBzbyB0aGF0IEkgaGFk
IHRvIG1hbnVhbGx5IGluc3RhbGwKICAgICAgdmRzbS1nbHVzdGVyIHBhY2thZ2UuIFRoZW4sIHdo
ZW4gY3JlYXRpbmcgYSB2b2x1bWUsIHRoZSBVSSB0b2xkIG1lCiAgICAgIHRoYXQgaG9zdHMgY291
bGRuJ3QgY29tbXVuaWNhdGUuIFNvIEkgaGFkIHRvIG1hbnVhbGx5IHByb2JlIHRoZW0uCiAgICAg
IFRoaXMgbGVhZHMgbWUgdG8gdGhhdCBxdWVzdGlvbiA6IGlzIGl0IGFuIGV4cGVjdGVkIGJlaGF2
aW91cj8gVGhlCiAgICAgIHdob2xlIGdsdXN0ZXIgam9iIChpbnN0YWxsaW5nIGFwcHJvcHJpYXRl
ZCBwYWNrYWdlIGFuZCBwcm9iaW5nCiAgICAgIHBlZXJzIGluIHRoZSBjbHVzdGVyKSBzaG91bGQg
YmUgZG9uZSB0aGFua3MgdG8gdGhlIFVJIGNsdXN0ZXIgdGFiCiAgICAgICJnbHVzdGVyIHNlcnZp
Y2UiLjxicj4KICAgICAgQSBsYXN0IHF1ZXN0aW9uIDogd2h5IGlzbid0IGl0IHBvc3NpYmxlIHRv
IHByb2JlIGhvc3Qgb24gZGlmZmVyZW50CiAgICAgIGNsdXN0ZXJzIGluIHRoZSBzYW1lIGRhdGFj
ZW50ZXIsIGNvdWxkIGJlIHZlcnkgdXNlZnVsLjxicj4KICAgIDwvZm9udD4KICAgIDxwcmUgY2xh
c3M9Im1vei1zaWduYXR1cmUiIGNvbHM9IjcyIj4tLSAKTmF0aGFuYSZldW1sO2wgQmxhbmNoZXQK
ClN1cGVydmlzaW9uIHImZWFjdXRlO3NlYXUKUCZvY2lyYztsZSBleHBsb2l0YXRpb24gZXQgbWFp
bnRlbmFuY2UKRCZlYWN1dGU7cGFydGVtZW50IGRlcyBzeXN0JmVncmF2ZTttZXMgZCdpbmZvcm1h
dGlvbgoyMjcgYXZlbnVlIFByb2Zlc3NldXItSmVhbi1Mb3Vpcy1WaWFsYQozNDE5MyBNT05UUEVM
TElFUiBDRURFWCA1IAkKVCZlYWN1dGU7bC4gMzMgKDApNCA2NyA1NCA4NCA1NQpGYXggIDMzICgw
KTQgNjcgNTQgODQgMTQKPGEgY2xhc3M9Im1vei10eHQtbGluay1hYmJyZXZpYXRlZCIgaHJlZj0i
bWFpbHRvOmJsYW5jaGV0QGFiZXMuZnIiPmJsYW5jaGV0QGFiZXMuZnI8L2E+IDwvcHJlPgogIDwv
Ym9keT4KPC9odG1sPgoKLS0tLS0tLS0tLS0tLS0wNTA4MDYwMDA4MDcwOTAyMDcwMTA3MDEtLQo=
--===============8344636356672490087==--
From kmayilsa at redhat.com Mon Jun 2 09:42:43 2014
Content-Type: multipart/mixed; boundary="===============6052319508222056043=="
MIME-Version: 1.0
From: Kanagaraj
To: users at ovirt.org
Subject: Re: [ovirt-users] probing peers in gluster after installing hosts
Date: Mon, 02 Jun 2014 19:12:36 +0530
Message-ID: <538C7F4C.2050108@redhat.com>
In-Reply-To: 538C5EE3.1000808@abes.fr
--===============6052319508222056043==
Content-Type: text/plain; charset="utf-8"
MIME-Version: 1.0
Content-Transfer-Encoding: quoted-printable
This is a multi-part message in MIME format.
--------------060009080107030600040909
Content-Type: text/plain; charset=3DISO-8859-1; format=3Dflowed
Content-Transfer-Encoding: 8bit
- selecting the 'enable gluster service' in later stage(after the hosts =
are added) doesn't do anything. As you said, this could be a nice =
feature though.
- 'gluster peer probe' is used to form a logical cluster. I don't think =
having the hosts from different clusters to form a gluster-cluster is =
the right way.
Thanks,
Kanagaraj
On 06/02/2014 04:54 PM, Nathana=C3=ABl Blanchet wrote:
> Hi all,
>
> I created 3 clusters in unique datacenter. I installed my hosts to the =
> first one after activating the gluster service in the cluster tab. A =
> expected otopi installed then the vdsm-gluster rpm and everything were =
> ok for this first cluster.
> The other ones weren't initially gluster ready and I wanted to =
> activate the service after installing the host (so they were without =
> vdsm-gluster package). But checking that item didn't do anything for =
> these hosts, so that I had to manually install vdsm-gluster package. =
> Then, when creating a volume, the UI told me that hosts couldn't =
> communicate. So I had to manually probe them. This leads me to that =
> question : is it an expected behaviour? The whole gluster job =
> (installing appropriated package and probing peers in the cluster) =
> should be done thanks to the UI cluster tab "gluster service".
> A last question : why isn't it possible to probe host on different =
> clusters in the same datacenter, could be very useful.
> -- =
> Nathana=C3=ABl Blanchet
>
> Supervision r=C3=A9seau
> P=C3=B4le exploitation et maintenance
> D=C3=A9partement des syst=C3=A8mes d'information
> 227 avenue Professeur-Jean-Louis-Viala
> 34193 MONTPELLIER CEDEX 5 =
> T=C3=A9l. 33 (0)4 67 54 84 55
> Fax 33 (0)4 67 54 84 14
> blanchet(a)abes.fr =
>
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
--------------060009080107030600040909
Content-Type: text/html; charset=3DISO-8859-1
Content-Transfer-Encoding: 7bit
- selecting the 'enable gluster service' in later stage(after the
hosts are added) doesn't do anything. As you said, this could be a
nice feature though.
- 'gluster peer probe' is used to form a logical cluster. I don't
think having the hosts from different clusters to form a
gluster-cluster is the right way.
Thanks,
Kanagaraj
On 06/02/2014 04:54 PM, Nathanaël
Blanchet wrote:
Hi all,
I created 3 clusters in unique datacenter. I installed my hosts to the first one
after activating the gluster service in the cluster tab. A
expected otopi installed then the vdsm-gluster rpm and
everything were ok for this first cluster.
The other ones weren't initially gluster ready and I wanted to
activate the service after installing the host (so they were
without vdsm-gluster package). But checking that item didn't do
anything for these hosts, so that I had to manually install
vdsm-gluster package. Then, when creating a volume, the UI told
me that hosts couldn't communicate. So I had to manually probe
them. This leads me to that question : is it an expected
behaviour? The whole gluster job (installing appropriated
package and probing peers in the cluster) should be done thanks
to the UI cluster tab "gluster service".
A last question : why isn't it possible to probe host on
different clusters in the same datacenter, could be very useful.
-- =
Nathanaël Blanchet
Supervision réseau
Pôle exploitation et maintenance
Département des systèmes d'information
227 avenue Professeur-Jean-Louis-Viala
34193 MONTPELLIER CEDEX 5 =
Tél. 33 (0)4 67 54 84 55
Fax 33 (0)4 67 54 84 14
blanchet(a)abes.fr
_______________________________________________
Users mailing list
Use=
rs(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--------------060009080107030600040909--
--===============6052319508222056043==
Content-Type: multipart/alternative
MIME-Version: 1.0
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="attachment.bin"
VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t
LS0wNjAwMDkwODAxMDcwMzA2MDAwNDA5MDkKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy
c2V0PUlTTy04ODU5LTE7IGZvcm1hdD1mbG93ZWQKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzog
OGJpdAoKLSBzZWxlY3RpbmcgdGhlICdlbmFibGUgZ2x1c3RlciBzZXJ2aWNlJyBpbiBsYXRlciBz
dGFnZShhZnRlciB0aGUgaG9zdHMgCmFyZSBhZGRlZCkgZG9lc24ndCBkbyBhbnl0aGluZy4gQXMg
eW91IHNhaWQsIHRoaXMgY291bGQgYmUgYSBuaWNlIApmZWF0dXJlIHRob3VnaC4KLSAnZ2x1c3Rl
ciBwZWVyIHByb2JlJyBpcyB1c2VkIHRvIGZvcm0gYSBsb2dpY2FsIGNsdXN0ZXIuIEkgZG9uJ3Qg
dGhpbmsgCmhhdmluZyB0aGUgaG9zdHMgZnJvbSBkaWZmZXJlbnQgY2x1c3RlcnMgdG8gZm9ybSBh
IGdsdXN0ZXItY2x1c3RlciBpcyAKdGhlIHJpZ2h0IHdheS4KClRoYW5rcywKS2FuYWdhcmFqCgpP
biAwNi8wMi8yMDE0IDA0OjU0IFBNLCBOYXRoYW5h62wgQmxhbmNoZXQgd3JvdGU6Cj4gSGkgYWxs
LAo+Cj4gSSBjcmVhdGVkIDMgY2x1c3RlcnMgaW4gdW5pcXVlIGRhdGFjZW50ZXIuIEkgaW5zdGFs
bGVkIG15IGhvc3RzIHRvIHRoZSAKPiBmaXJzdCBvbmUgYWZ0ZXIgYWN0aXZhdGluZyB0aGUgZ2x1
c3RlciBzZXJ2aWNlIGluIHRoZSBjbHVzdGVyIHRhYi4gQSAKPiBleHBlY3RlZCBvdG9waSBpbnN0
YWxsZWQgdGhlbiB0aGUgdmRzbS1nbHVzdGVyIHJwbSBhbmQgZXZlcnl0aGluZyB3ZXJlIAo+IG9r
IGZvciB0aGlzIGZpcnN0IGNsdXN0ZXIuCj4gVGhlIG90aGVyIG9uZXMgd2VyZW4ndCBpbml0aWFs
bHkgZ2x1c3RlciByZWFkeSBhbmQgSSB3YW50ZWQgdG8gCj4gYWN0aXZhdGUgdGhlIHNlcnZpY2Ug
YWZ0ZXIgaW5zdGFsbGluZyB0aGUgaG9zdCAoc28gdGhleSB3ZXJlIHdpdGhvdXQgCj4gdmRzbS1n
bHVzdGVyIHBhY2thZ2UpLiBCdXQgY2hlY2tpbmcgdGhhdCBpdGVtIGRpZG4ndCBkbyBhbnl0aGlu
ZyBmb3IgCj4gdGhlc2UgaG9zdHMsIHNvIHRoYXQgSSBoYWQgdG8gbWFudWFsbHkgaW5zdGFsbCB2
ZHNtLWdsdXN0ZXIgcGFja2FnZS4gCj4gVGhlbiwgd2hlbiBjcmVhdGluZyBhIHZvbHVtZSwgdGhl
IFVJIHRvbGQgbWUgdGhhdCBob3N0cyBjb3VsZG4ndCAKPiBjb21tdW5pY2F0ZS4gU28gSSBoYWQg
dG8gbWFudWFsbHkgcHJvYmUgdGhlbS4gVGhpcyBsZWFkcyBtZSB0byB0aGF0IAo+IHF1ZXN0aW9u
IDogaXMgaXQgYW4gZXhwZWN0ZWQgYmVoYXZpb3VyPyBUaGUgd2hvbGUgZ2x1c3RlciBqb2IgCj4g
KGluc3RhbGxpbmcgYXBwcm9wcmlhdGVkIHBhY2thZ2UgYW5kIHByb2JpbmcgcGVlcnMgaW4gdGhl
IGNsdXN0ZXIpIAo+IHNob3VsZCBiZSBkb25lIHRoYW5rcyB0byB0aGUgVUkgY2x1c3RlciB0YWIg
ImdsdXN0ZXIgc2VydmljZSIuCj4gQSBsYXN0IHF1ZXN0aW9uIDogd2h5IGlzbid0IGl0IHBvc3Np
YmxlIHRvIHByb2JlIGhvc3Qgb24gZGlmZmVyZW50IAo+IGNsdXN0ZXJzIGluIHRoZSBzYW1lIGRh
dGFjZW50ZXIsIGNvdWxkIGJlIHZlcnkgdXNlZnVsLgo+IC0tIAo+IE5hdGhhbmHrbCBCbGFuY2hl
dAo+Cj4gU3VwZXJ2aXNpb24gculzZWF1Cj4gUPRsZSBleHBsb2l0YXRpb24gZXQgbWFpbnRlbmFu
Y2UKPiBE6XBhcnRlbWVudCBkZXMgc3lzdOhtZXMgZCdpbmZvcm1hdGlvbgo+IDIyNyBhdmVudWUg
UHJvZmVzc2V1ci1KZWFuLUxvdWlzLVZpYWxhCj4gMzQxOTMgTU9OVFBFTExJRVIgQ0VERVggNSAJ
Cj4gVOlsLiAzMyAoMCk0IDY3IDU0IDg0IDU1Cj4gRmF4ICAzMyAoMCk0IDY3IDU0IDg0IDE0Cj4g
YmxhbmNoZXRAYWJlcy5mciAgCj4KPgo+IF9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f
X19fX19fX19fX19fX19fCj4gVXNlcnMgbWFpbGluZyBsaXN0Cj4gVXNlcnNAb3ZpcnQub3JnCj4g
aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzCgoKLS0tLS0tLS0t
LS0tLS0wNjAwMDkwODAxMDcwMzA2MDAwNDA5MDkKQ29udGVudC1UeXBlOiB0ZXh0L2h0bWw7IGNo
YXJzZXQ9SVNPLTg4NTktMQpDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA3Yml0Cgo8aHRtbD4K
ICA8aGVhZD4KICAgIDxtZXRhIGNvbnRlbnQ9InRleHQvaHRtbDsgY2hhcnNldD1JU08tODg1OS0x
IgogICAgICBodHRwLWVxdWl2PSJDb250ZW50LVR5cGUiPgogIDwvaGVhZD4KICA8Ym9keSBiZ2Nv
bG9yPSIjRkZGRkZGIiB0ZXh0PSIjMDAwMDAwIj4KICAgIC0gc2VsZWN0aW5nIHRoZSAnZW5hYmxl
IGdsdXN0ZXIgc2VydmljZScgaW4gbGF0ZXIgc3RhZ2UoYWZ0ZXIgdGhlCiAgICBob3N0cyBhcmUg
YWRkZWQpIGRvZXNuJ3QgZG8gYW55dGhpbmcuIEFzIHlvdSBzYWlkLCB0aGlzIGNvdWxkIGJlIGEK
ICAgIG5pY2UgZmVhdHVyZSB0aG91Z2guPGJyPgogICAgLSAnZ2x1c3RlciBwZWVyIHByb2JlJyBp
cyB1c2VkIHRvIGZvcm0gYSBsb2dpY2FsIGNsdXN0ZXIuIEkgZG9uJ3QKICAgIHRoaW5rIGhhdmlu
ZyB0aGUgaG9zdHMgZnJvbSBkaWZmZXJlbnQgY2x1c3RlcnMgdG8gZm9ybSBhCiAgICBnbHVzdGVy
LWNsdXN0ZXIgaXMgdGhlIHJpZ2h0IHdheS48YnI+CiAgICA8YnI+CiAgICBUaGFua3MsPGJyPgog
ICAgS2FuYWdhcmFqPGJyPgogICAgPGJyPgogICAgPGRpdiBjbGFzcz0ibW96LWNpdGUtcHJlZml4
Ij5PbiAwNi8wMi8yMDE0IDA0OjU0IFBNLCBOYXRoYW5hJmV1bWw7bAogICAgICBCbGFuY2hldCB3
cm90ZTo8YnI+CiAgICA8L2Rpdj4KICAgIDxibG9ja3F1b3RlIGNpdGU9Im1pZDo1MzhDNUVFMy4x
MDAwODA4QGFiZXMuZnIiIHR5cGU9ImNpdGUiPgogICAgICA8bWV0YSBodHRwLWVxdWl2PSJjb250
ZW50LXR5cGUiIGNvbnRlbnQ9InRleHQvaHRtbDsKICAgICAgICBjaGFyc2V0PUlTTy04ODU5LTEi
PgogICAgICA8Zm9udCBzaXplPSItMSI+SGkgYWxsLDxicj4KICAgICAgICA8YnI+CiAgICAgICAg
SSBjcmVhdGVkIDMgY2x1c3RlcnMgaW4gdW5pcXVlIGRhdGFjZW50ZXIuIEkgaW5zdGFsbGVkIDwv
Zm9udD48Zm9udAogICAgICAgIHNpemU9Ii0xIj48Zm9udCBzaXplPSItMSI+bXkgaG9zdHMgPC9m
b250PnRvIHRoZSBmaXJzdCBvbmUKICAgICAgICBhZnRlciBhY3RpdmF0aW5nIHRoZSBnbHVzdGVy
IHNlcnZpY2UgaW4gdGhlIGNsdXN0ZXIgdGFiLiBBCiAgICAgICAgZXhwZWN0ZWQgb3RvcGkgaW5z
dGFsbGVkIHRoZW4gdGhlIHZkc20tZ2x1c3RlciBycG0gYW5kCiAgICAgICAgZXZlcnl0aGluZyB3
ZXJlIG9rIGZvciB0aGlzIGZpcnN0IGNsdXN0ZXIuIDxicj4KICAgICAgICBUaGUgb3RoZXIgb25l
cyB3ZXJlbid0IGluaXRpYWxseSBnbHVzdGVyIHJlYWR5IGFuZCBJIHdhbnRlZCB0bwogICAgICAg
IGFjdGl2YXRlIHRoZSBzZXJ2aWNlIGFmdGVyIGluc3RhbGxpbmcgdGhlIGhvc3QgKHNvIHRoZXkg
d2VyZQogICAgICAgIHdpdGhvdXQgdmRzbS1nbHVzdGVyIHBhY2thZ2UpLiBCdXQgY2hlY2tpbmcg
dGhhdCBpdGVtIGRpZG4ndCBkbwogICAgICAgIGFueXRoaW5nIGZvciB0aGVzZSBob3N0cywgc28g
dGhhdCBJIGhhZCB0byBtYW51YWxseSBpbnN0YWxsCiAgICAgICAgdmRzbS1nbHVzdGVyIHBhY2th
Z2UuIFRoZW4sIHdoZW4gY3JlYXRpbmcgYSB2b2x1bWUsIHRoZSBVSSB0b2xkCiAgICAgICAgbWUg
dGhhdCBob3N0cyBjb3VsZG4ndCBjb21tdW5pY2F0ZS4gU28gSSBoYWQgdG8gbWFudWFsbHkgcHJv
YmUKICAgICAgICB0aGVtLiBUaGlzIGxlYWRzIG1lIHRvIHRoYXQgcXVlc3Rpb24gOiBpcyBpdCBh
biBleHBlY3RlZAogICAgICAgIGJlaGF2aW91cj8gVGhlIHdob2xlIGdsdXN0ZXIgam9iIChpbnN0
YWxsaW5nIGFwcHJvcHJpYXRlZAogICAgICAgIHBhY2thZ2UgYW5kIHByb2JpbmcgcGVlcnMgaW4g
dGhlIGNsdXN0ZXIpIHNob3VsZCBiZSBkb25lIHRoYW5rcwogICAgICAgIHRvIHRoZSBVSSBjbHVz
dGVyIHRhYiAiZ2x1c3RlciBzZXJ2aWNlIi48YnI+CiAgICAgICAgQSBsYXN0IHF1ZXN0aW9uIDog
d2h5IGlzbid0IGl0IHBvc3NpYmxlIHRvIHByb2JlIGhvc3Qgb24KICAgICAgICBkaWZmZXJlbnQg
Y2x1c3RlcnMgaW4gdGhlIHNhbWUgZGF0YWNlbnRlciwgY291bGQgYmUgdmVyeSB1c2VmdWwuPGJy
PgogICAgICA8L2ZvbnQ+CiAgICAgIDxwcmUgY2xhc3M9Im1vei1zaWduYXR1cmUiIGNvbHM9Ijcy
Ij4tLSAKTmF0aGFuYSZldW1sO2wgQmxhbmNoZXQKClN1cGVydmlzaW9uIHImZWFjdXRlO3NlYXUK
UCZvY2lyYztsZSBleHBsb2l0YXRpb24gZXQgbWFpbnRlbmFuY2UKRCZlYWN1dGU7cGFydGVtZW50
IGRlcyBzeXN0JmVncmF2ZTttZXMgZCdpbmZvcm1hdGlvbgoyMjcgYXZlbnVlIFByb2Zlc3NldXIt
SmVhbi1Mb3Vpcy1WaWFsYQozNDE5MyBNT05UUEVMTElFUiBDRURFWCA1IAkKVCZlYWN1dGU7bC4g
MzMgKDApNCA2NyA1NCA4NCA1NQpGYXggIDMzICgwKTQgNjcgNTQgODQgMTQKPGEgbW96LWRvLW5v
dC1zZW5kPSJ0cnVlIiBjbGFzcz0ibW96LXR4dC1saW5rLWFiYnJldmlhdGVkIiBocmVmPSJtYWls
dG86YmxhbmNoZXRAYWJlcy5mciI+YmxhbmNoZXRAYWJlcy5mcjwvYT4gPC9wcmU+CiAgICAgIDxi
cj4KICAgICAgPGZpZWxkc2V0IGNsYXNzPSJtaW1lQXR0YWNobWVudEhlYWRlciI+PC9maWVsZHNl
dD4KICAgICAgPGJyPgogICAgICA8cHJlIHdyYXA9IiI+X19fX19fX19fX19fX19fX19fX19fX19f
X19fX19fX19fX19fX19fX19fX19fX18KVXNlcnMgbWFpbGluZyBsaXN0CjxhIGNsYXNzPSJtb3ot
dHh0LWxpbmstYWJicmV2aWF0ZWQiIGhyZWY9Im1haWx0bzpVc2Vyc0BvdmlydC5vcmciPlVzZXJz
QG92aXJ0Lm9yZzwvYT4KPGEgY2xhc3M9Im1vei10eHQtbGluay1mcmVldGV4dCIgaHJlZj0iaHR0
cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIj5odHRwOi8vbGlzdHMu
b3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E+CjwvcHJlPgogICAgPC9ibG9ja3F1
b3RlPgogICAgPGJyPgogIDwvYm9keT4KPC9odG1sPgoKLS0tLS0tLS0tLS0tLS0wNjAwMDkwODAx
MDcwMzA2MDAwNDA5MDktLQo=
--===============6052319508222056043==--
From jvdwege at xs4all.nl Mon Jun 2 14:43:23 2014
Content-Type: multipart/mixed; boundary="===============0392176272027982590=="
MIME-Version: 1.0
From: Joop
To: users at ovirt.org
Subject: Re: [ovirt-users] probing peers in gluster after installing hosts
Date: Mon, 02 Jun 2014 20:43:00 +0200
Message-ID: <538CC5B4.90105@xs4all.nl>
In-Reply-To: 538C5EE3.1000808@abes.fr
--===============0392176272027982590==
Content-Type: text/plain; charset="utf-8"
MIME-Version: 1.0
Content-Transfer-Encoding: quoted-printable
This is a multi-part message in MIME format.
--------------020202010309000408030402
Content-Type: text/plain; charset=3DISO-8859-1; format=3Dflowed
Content-Transfer-Encoding: 8bit
Nathana=C3=ABl Blanchet wrote:
> Hi all,
>
> I created 3 clusters in unique datacenter. I installed my hosts to the =
> first one after activating the gluster service in the cluster tab. A =
> expected otopi installed then the vdsm-gluster rpm and everything were =
> ok for this first cluster.
> The other ones weren't initially gluster ready and I wanted to =
> activate the service after installing the host (so they were without =
> vdsm-gluster package). But checking that item didn't do anything for =
> these hosts, so that I had to manually install vdsm-gluster package. =
> Then, when creating a volume, the UI told me that hosts couldn't =
> communicate. So I had to manually probe them. This leads me to that =
> question : is it an expected behaviour? The whole gluster job =
> (installing appropriated package and probing peers in the cluster) =
> should be done thanks to the UI cluster tab "gluster service".
> A last question : why isn't it possible to probe host on different =
> clusters in the same datacenter, could be very useful.
After checking the checkbox for gluster services you'll need to migrated =
all vms from a host and put it into maintenance then use the re-install =
link and the needed packages will be downloaded and installed and a peer =
probe will be done. After that reactivate the host and proceed to the =
next one. One caveat found: chkconfig glusterd on isn't executed. You'll =
need to do that by hand and also start the service or restart the server =
while in maintenance mode.
Joop
--------------020202010309000408030402
Content-Type: text/html; charset=3DISO-8859-1
Content-Transfer-Encoding: 7bit
Nathanaël Blanchet wrote:
Hi all,
I created 3 clusters in unique datacenter. I installed my hosts to the first one after
activating the gluster service in the cluster tab. A expected otopi
installed then the vdsm-gluster rpm and everything were ok for this
first cluster.
The other ones weren't initially gluster ready and I wanted to activate
the service after installing the host (so they were without
vdsm-gluster package). But checking that item didn't do anything for
these hosts, so that I had to manually install vdsm-gluster package.
Then, when creating a volume, the UI told me that hosts couldn't
communicate. So I had to manually probe them. This leads me to that
question : is it an expected behaviour? The whole gluster job
(installing appropriated package and probing peers in the cluster)
should be done thanks to the UI cluster tab "gluster service".
A last question : why isn't it possible to probe host on different
clusters in the same datacenter, could be very useful.
After checking the checkbox for gluster services you'll need to
migrated all vms from a host and put it into maintenance then use the
re-install link and the needed packages will be downloaded and
installed and a peer probe will be done. After that reactivate the host
and proceed to the next one. One caveat found: chkconfig glusterd on
isn't executed. You'll need to do that by hand and also start the
service or restart the server while in maintenance mode.
Joop
--------------020202010309000408030402--
--===============0392176272027982590==
Content-Type: multipart/alternative
MIME-Version: 1.0
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="attachment.bin"
VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t
LS0wMjAyMDIwMTAzMDkwMDA0MDgwMzA0MDIKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy
c2V0PUlTTy04ODU5LTE7IGZvcm1hdD1mbG93ZWQKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzog
OGJpdAoKTmF0aGFuYetsIEJsYW5jaGV0IHdyb3RlOgo+IEhpIGFsbCwKPgo+IEkgY3JlYXRlZCAz
IGNsdXN0ZXJzIGluIHVuaXF1ZSBkYXRhY2VudGVyLiBJIGluc3RhbGxlZCBteSBob3N0cyB0byB0
aGUgCj4gZmlyc3Qgb25lIGFmdGVyIGFjdGl2YXRpbmcgdGhlIGdsdXN0ZXIgc2VydmljZSBpbiB0
aGUgY2x1c3RlciB0YWIuIEEgCj4gZXhwZWN0ZWQgb3RvcGkgaW5zdGFsbGVkIHRoZW4gdGhlIHZk
c20tZ2x1c3RlciBycG0gYW5kIGV2ZXJ5dGhpbmcgd2VyZSAKPiBvayBmb3IgdGhpcyBmaXJzdCBj
bHVzdGVyLgo+IFRoZSBvdGhlciBvbmVzIHdlcmVuJ3QgaW5pdGlhbGx5IGdsdXN0ZXIgcmVhZHkg
YW5kIEkgd2FudGVkIHRvIAo+IGFjdGl2YXRlIHRoZSBzZXJ2aWNlIGFmdGVyIGluc3RhbGxpbmcg
dGhlIGhvc3QgKHNvIHRoZXkgd2VyZSB3aXRob3V0IAo+IHZkc20tZ2x1c3RlciBwYWNrYWdlKS4g
QnV0IGNoZWNraW5nIHRoYXQgaXRlbSBkaWRuJ3QgZG8gYW55dGhpbmcgZm9yIAo+IHRoZXNlIGhv
c3RzLCBzbyB0aGF0IEkgaGFkIHRvIG1hbnVhbGx5IGluc3RhbGwgdmRzbS1nbHVzdGVyIHBhY2th
Z2UuIAo+IFRoZW4sIHdoZW4gY3JlYXRpbmcgYSB2b2x1bWUsIHRoZSBVSSB0b2xkIG1lIHRoYXQg
aG9zdHMgY291bGRuJ3QgCj4gY29tbXVuaWNhdGUuIFNvIEkgaGFkIHRvIG1hbnVhbGx5IHByb2Jl
IHRoZW0uIFRoaXMgbGVhZHMgbWUgdG8gdGhhdCAKPiBxdWVzdGlvbiA6IGlzIGl0IGFuIGV4cGVj
dGVkIGJlaGF2aW91cj8gVGhlIHdob2xlIGdsdXN0ZXIgam9iIAo+IChpbnN0YWxsaW5nIGFwcHJv
cHJpYXRlZCBwYWNrYWdlIGFuZCBwcm9iaW5nIHBlZXJzIGluIHRoZSBjbHVzdGVyKSAKPiBzaG91
bGQgYmUgZG9uZSB0aGFua3MgdG8gdGhlIFVJIGNsdXN0ZXIgdGFiICJnbHVzdGVyIHNlcnZpY2Ui
Lgo+IEEgbGFzdCBxdWVzdGlvbiA6IHdoeSBpc24ndCBpdCBwb3NzaWJsZSB0byBwcm9iZSBob3N0
IG9uIGRpZmZlcmVudCAKPiBjbHVzdGVycyBpbiB0aGUgc2FtZSBkYXRhY2VudGVyLCBjb3VsZCBi
ZSB2ZXJ5IHVzZWZ1bC4KQWZ0ZXIgY2hlY2tpbmcgdGhlIGNoZWNrYm94IGZvciBnbHVzdGVyIHNl
cnZpY2VzIHlvdSdsbCBuZWVkIHRvIG1pZ3JhdGVkIAphbGwgdm1zIGZyb20gYSBob3N0IGFuZCBw
dXQgaXQgaW50byBtYWludGVuYW5jZSB0aGVuICB1c2UgdGhlIHJlLWluc3RhbGwgCmxpbmsgYW5k
IHRoZSBuZWVkZWQgcGFja2FnZXMgd2lsbCBiZSBkb3dubG9hZGVkIGFuZCBpbnN0YWxsZWQgYW5k
IGEgcGVlciAKcHJvYmUgd2lsbCBiZSBkb25lLiBBZnRlciB0aGF0IHJlYWN0aXZhdGUgdGhlIGhv
c3QgYW5kIHByb2NlZWQgdG8gdGhlIApuZXh0IG9uZS4gT25lIGNhdmVhdCBmb3VuZDogY2hrY29u
ZmlnIGdsdXN0ZXJkIG9uIGlzbid0IGV4ZWN1dGVkLiBZb3UnbGwgCm5lZWQgdG8gZG8gdGhhdCBi
eSBoYW5kIGFuZCBhbHNvIHN0YXJ0IHRoZSBzZXJ2aWNlIG9yIHJlc3RhcnQgdGhlIHNlcnZlciAK
d2hpbGUgaW4gbWFpbnRlbmFuY2UgbW9kZS4KCkpvb3AKCgotLS0tLS0tLS0tLS0tLTAyMDIwMjAx
MDMwOTAwMDQwODAzMDQwMgpDb250ZW50LVR5cGU6IHRleHQvaHRtbDsgY2hhcnNldD1JU08tODg1
OS0xCkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDdiaXQKCjwhRE9DVFlQRSBodG1sIFBVQkxJ
QyAiLS8vVzNDLy9EVEQgSFRNTCA0LjAxIFRyYW5zaXRpb25hbC8vRU4iPgo8aHRtbD4KPGhlYWQ+
CiAgPG1ldGEgY29udGVudD0idGV4dC9odG1sO2NoYXJzZXQ9SVNPLTg4NTktMSIgaHR0cC1lcXVp
dj0iQ29udGVudC1UeXBlIj4KPC9oZWFkPgo8Ym9keSBiZ2NvbG9yPSIjZmZmZmZmIiB0ZXh0PSIj
MDAwMDAwIj4KTmF0aGFuYSZldW1sO2wgQmxhbmNoZXQgd3JvdGU6CjxibG9ja3F1b3RlIGNpdGU9
Im1pZDo1MzhDNUVFMy4xMDAwODA4QGFiZXMuZnIiIHR5cGU9ImNpdGUiPgogIDxtZXRhIGh0dHAt
ZXF1aXY9ImNvbnRlbnQtdHlwZSIgY29udGVudD0idGV4dC9odG1sOyAiPgogIDxmb250IHNpemU9
Ii0xIj5IaSBhbGwsPGJyPgogIDxicj4KSSBjcmVhdGVkIDMgY2x1c3RlcnMgaW4gdW5pcXVlIGRh
dGFjZW50ZXIuIEkgaW5zdGFsbGVkIDwvZm9udD48Zm9udAogc2l6ZT0iLTEiPjxmb250IHNpemU9
Ii0xIj5teSBob3N0cyA8L2ZvbnQ+dG8gdGhlIGZpcnN0IG9uZSBhZnRlcgphY3RpdmF0aW5nIHRo
ZSBnbHVzdGVyIHNlcnZpY2UgaW4gdGhlIGNsdXN0ZXIgdGFiLiBBIGV4cGVjdGVkIG90b3BpCmlu
c3RhbGxlZCB0aGVuIHRoZSB2ZHNtLWdsdXN0ZXIgcnBtIGFuZCBldmVyeXRoaW5nIHdlcmUgb2sg
Zm9yIHRoaXMKZmlyc3QgY2x1c3Rlci4gPGJyPgpUaGUgb3RoZXIgb25lcyB3ZXJlbid0IGluaXRp
YWxseSBnbHVzdGVyIHJlYWR5IGFuZCBJIHdhbnRlZCB0byBhY3RpdmF0ZQp0aGUgc2VydmljZSBh
ZnRlciBpbnN0YWxsaW5nIHRoZSBob3N0IChzbyB0aGV5IHdlcmUgd2l0aG91dAp2ZHNtLWdsdXN0
ZXIgcGFja2FnZSkuIEJ1dCBjaGVja2luZyB0aGF0IGl0ZW0gZGlkbid0IGRvIGFueXRoaW5nIGZv
cgp0aGVzZSBob3N0cywgc28gdGhhdCBJIGhhZCB0byBtYW51YWxseSBpbnN0YWxsIHZkc20tZ2x1
c3RlciBwYWNrYWdlLgpUaGVuLCB3aGVuIGNyZWF0aW5nIGEgdm9sdW1lLCB0aGUgVUkgdG9sZCBt
ZSB0aGF0IGhvc3RzIGNvdWxkbid0CmNvbW11bmljYXRlLiBTbyBJIGhhZCB0byBtYW51YWxseSBw
cm9iZSB0aGVtLiBUaGlzIGxlYWRzIG1lIHRvIHRoYXQKcXVlc3Rpb24gOiBpcyBpdCBhbiBleHBl
Y3RlZCBiZWhhdmlvdXI/IFRoZSB3aG9sZSBnbHVzdGVyIGpvYgooaW5zdGFsbGluZyBhcHByb3By
aWF0ZWQgcGFja2FnZSBhbmQgcHJvYmluZyBwZWVycyBpbiB0aGUgY2x1c3RlcikKc2hvdWxkIGJl
IGRvbmUgdGhhbmtzIHRvIHRoZSBVSSBjbHVzdGVyIHRhYiAiZ2x1c3RlciBzZXJ2aWNlIi48YnI+
CkEgbGFzdCBxdWVzdGlvbiA6IHdoeSBpc24ndCBpdCBwb3NzaWJsZSB0byBwcm9iZSBob3N0IG9u
IGRpZmZlcmVudApjbHVzdGVycyBpbiB0aGUgc2FtZSBkYXRhY2VudGVyLCBjb3VsZCBiZSB2ZXJ5
IHVzZWZ1bC48YnI+CiAgPC9mb250PjwvYmxvY2txdW90ZT4KQWZ0ZXIgY2hlY2tpbmcgdGhlIGNo
ZWNrYm94IGZvciBnbHVzdGVyIHNlcnZpY2VzIHlvdSdsbCBuZWVkIHRvCm1pZ3JhdGVkIGFsbCB2
bXMgZnJvbSBhIGhvc3QgYW5kIHB1dCBpdCBpbnRvIG1haW50ZW5hbmNlIHRoZW4mbmJzcDsgdXNl
IHRoZQpyZS1pbnN0YWxsIGxpbmsgYW5kIHRoZSBuZWVkZWQgcGFja2FnZXMgd2lsbCBiZSBkb3du
bG9hZGVkIGFuZAppbnN0YWxsZWQgYW5kIGEgcGVlciBwcm9iZSB3aWxsIGJlIGRvbmUuIEFmdGVy
IHRoYXQgcmVhY3RpdmF0ZSB0aGUgaG9zdAphbmQgcHJvY2VlZCB0byB0aGUgbmV4dCBvbmUuIE9u
ZSBjYXZlYXQgZm91bmQ6IGNoa2NvbmZpZyBnbHVzdGVyZCBvbgppc24ndCBleGVjdXRlZC4gWW91
J2xsIG5lZWQgdG8gZG8gdGhhdCBieSBoYW5kIGFuZCBhbHNvIHN0YXJ0IHRoZQpzZXJ2aWNlIG9y
IHJlc3RhcnQgdGhlIHNlcnZlciB3aGlsZSBpbiBtYWludGVuYW5jZSBtb2RlLjxicj4KPGJyPgpK
b29wPGJyPgo8YnI+CjwvYm9keT4KPC9odG1sPgoKLS0tLS0tLS0tLS0tLS0wMjAyMDIwMTAzMDkw
MDA0MDgwMzA0MDItLQo=
--===============0392176272027982590==--