Using gluster on other hosts?
------=_Part_5951093_1160316627.1420655829032 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi I would like to see if anyone has good suggestion. I have two physical hosts with 1GB connections to switched networks. The ho= sts also have 10GB interface connected directly using Twinax cable like cop= per crossover cable.=C2=A0 The idea was to use the 10GB as a "private netwo= rk" for GlusterFS till the day we want to grow out of this 2 node setup. GlusterFS was setup with the 10GB ports using non-routable IPs and hostname= s in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2 192.168.1.2.=C2=A0 = I'm following example from community.redhat.com/blog/2014/10/up-and-running= -with-ovirt-3-5/ , Currently I'm only using Gluster volume on node1, but `g= luster probe peer` test worked fine with node2 through the 10GB connection. oVirt engine was setup on physical host1 with hosted engine.=C2=A0 Now, whe= n I try to create new Gluster storage domain, I can only see the host "node= 1" available.=20 Is there anyway I can setup oVirt on node1 and node2, while using "gfs1" an= d "gfs2" for GlusterFS? or some way to take advantage of the 10GB connectio= n? ThanksW ------=_Part_5951093_1160316627.1420655829032 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"color:#000; background-color:#fff; font-family:He= lveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;fo= nt-size:16px"><div id=3D"yui_3_16_0_1_1420578468148_131800">Hi</div><div di= r=3D"ltr" id=3D"yui_3_16_0_1_1420578468148_131799"><br></div><div dir=3D"lt= r">I would like to see if anyone has good suggestion.</div><div id=3D"yui_3= _16_0_1_1420578468148_133155" dir=3D"ltr"><br></div><div id=3D"yui_3_16_0_1= _1420578468148_132431" dir=3D"ltr">I have two physical hosts with 1GB conne= ctions to switched networks. The hosts also have 10GB interface connected d= irectly using Twinax cable like copper crossover cable. The idea was = to use the 10GB as a "private network" for GlusterFS till the day we want t= o grow out of this 2 node setup.<br></div><div id=3D"yui_3_16_0_1_142057846= 8148_133145"><br></div><div dir=3D"ltr" id=3D"yui_3_16_0_1_1420578468148_13= 3144">GlusterFS was setup with the 10GB ports using non-routable IPs and ho= stnames in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2 192.168.1.2.&= nbsp; I'm following example from <a id=3D"yui_3_16_0_1_1420578468148_133153= " href=3D"http://community.redhat.com/blog/2014/10/up-and-running-with-ovir= t-3-5/">community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/</a= the host "node1" available. <br></div><div id=3D"yui_3_16_0_1_142057846814= 8_133151" style=3D"" class=3D"" dir=3D"ltr"><br></div><div id=3D"yui_3_16_0= _1_1420578468148_133150" style=3D"" class=3D"" dir=3D"ltr">Is there anyway = I can setup oVirt on node1 and node2, while using "gfs1" and "gfs2" for Glu= sterFS? or some way to take advantage of the 10GB connection?<br></div><div= id=3D"yui_3_16_0_1_1420578468148_131852" style=3D"" class=3D"" dir=3D"ltr"=
This is a multi-part message in MIME format. --------------060906080607010101090105 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit On 01/08/2015 12:07 AM, Will K wrote:
If I understand right, you have 2 interfaces on each of your hosts, and you want oVirt to communicate via 1 interface and glusterfs to use other? While adding the hosts to oVirt you could use ip1 and then.while creating the volume, add the brick using the other ip address. For instance, gluster volume create <volname> 192.168.1.2:/bricks/b1 Currently, there's no way to specify the IP address to use while adding a brick from oVirt UI (we're working on this for 3.6), but you could do this from the gluster CLI commands. This would then be detected in the oVirt UI.
--------------060906080607010101090105 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit <html> <head> <meta content="text/html; charset=ISO-8859-1" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <br> <div class="moz-cite-prefix">On 01/08/2015 12:07 AM, Will K wrote:<br> </div> <blockquote cite="mid:359985466.5951094.1420655829175.JavaMail.yahoo@jws10637.mail.bf1.yahoo.com" type="cite"> <div style="color:#000; background-color:#fff; font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:16px"> <div id="yui_3_16_0_1_1420578468148_131800">Hi</div> <div dir="ltr" id="yui_3_16_0_1_1420578468148_131799"><br> </div> <div dir="ltr">I would like to see if anyone has good suggestion.</div> <div id="yui_3_16_0_1_1420578468148_133155" dir="ltr"><br> </div> <div id="yui_3_16_0_1_1420578468148_132431" dir="ltr">I have two physical hosts with 1GB connections to switched networks. The hosts also have 10GB interface connected directly using Twinax cable like copper crossover cable. The idea was to use the 10GB as a "private network" for GlusterFS till the day we want to grow out of this 2 node setup.<br> </div> <div id="yui_3_16_0_1_1420578468148_133145"><br> </div> <div dir="ltr" id="yui_3_16_0_1_1420578468148_133144">GlusterFS was setup with the 10GB ports using non-routable IPs and hostnames in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2 192.168.1.2. I'm following example from <a moz-do-not-send="true" id="yui_3_16_0_1_1420578468148_133153" href="http://community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/">community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/</a> , Currently I'm only using Gluster volume on node1, but `gluster probe peer` test worked fine with node2 through the 10GB connection.<br> </div> <div id="yui_3_16_0_1_1420578468148_132429" style="" class="" dir="ltr"><br> </div> <div id="yui_3_16_0_1_1420578468148_132427" style="" class="" dir="ltr">oVirt engine was setup on physical host1 with hosted engine. Now, when I try to create new Gluster storage domain, I can only see the host "node1" available. <br> </div> <div id="yui_3_16_0_1_1420578468148_133151" style="" class="" dir="ltr"><br> </div> <div id="yui_3_16_0_1_1420578468148_133150" style="" class="" dir="ltr">Is there anyway I can setup oVirt on node1 and node2, while using "gfs1" and "gfs2" for GlusterFS? or some way to take advantage of the 10GB connection?<br> </div> </div> </blockquote> <br> If I understand right, you have 2 interfaces on each of your hosts, and you want oVirt to communicate via 1 interface and glusterfs to use other?<br> <br> While adding the hosts to oVirt you could use ip1 and then.while creating the volume, add the brick using the other ip address. <br> For instance, gluster volume create <volname> 192.168.1.2:/bricks/b1 <br> <br> Currently, there's no way to specify the IP address to use while adding a brick from oVirt UI (we're working on this for 3.6), but you could do this from the gluster CLI commands. This would then be detected in the oVirt UI.<br> <br> <br> <blockquote cite="mid:359985466.5951094.1420655829175.JavaMail.yahoo@jws10637.mail.bf1.yahoo.com" type="cite"> <div style="color:#000; background-color:#fff; font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:16px"> <div id="yui_3_16_0_1_1420578468148_131852" style="" class="" dir="ltr"><br> </div> <div id="yui_3_16_0_1_1420578468148_133160" style="" class="" dir="ltr">Thanks</div> <div style="" class="" dir="ltr">W<br style="" class=""> </div> </div> <br> <fieldset class="mimeAttachmentHeader"></fieldset> <br> <pre wrap="">_______________________________________________ Users mailing list <a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a> <a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a> </pre> </blockquote> <br> </body> </html> --------------060906080607010101090105--
</div><div id=3D"yui_3_16_0_1_1420731722326_24183" dir=3D"ltr"><br></div><=
------=_Part_234546_1808245352.1420733510294 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable That's what I did, but didn't work for me. 1. use the 192.168.x interface to setup gluster. I used hostname in /etc/ho= sts.2. setup oVirt using the switched network hostnames, let's say 10.10.10= .x3. oVirt and all that comes up fine.4. When try to create a storage domai= n, it only shows the 10.10.10.x hostnames available. Tried to add a brick and I would get something like=C2=A0=C2=A0=C2=A0 Host = gfs2 is not in 'Peer in Cluster' state=C2=A0 (while node2 is the hostname a= nd gfs2 is the 192.168 name) Ran command `gluster probe peer gfs2` or `gluster probe peer 192.168.x.x` d= idn't work=C2=A0=C2=A0=C2=A0 peer probe: failed: Probe returned with unknow= n errno 107 Ran probe again with the switched network hostname or IP worked fine. May b= e it is not possible with current GlusterFS version?=C2=A0=20 http://www.gluster.org/community/documentation/index.php/Features/SplitNetw= ork Will=20 On Thursday, January 8, 2015 3:43 AM, Sahina Bose <sabose@redhat.com> = wrote: =20 =20 On 01/08/2015 12:07 AM, Will K wrote: =20 Hi=20 I would like to see if anyone has good suggestion.=20 I have two physical hosts with 1GB connections to switched networks. The = hosts also have 10GB interface connected directly using Twinax cable like c= opper crossover cable.=C2=A0 The idea was to use the 10GB as a "private net= work" for GlusterFS till the day we want to grow out of this 2 node setup. =20 GlusterFS was setup with the 10GB ports using non-routable IPs and hostna= mes in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2 192.168.1.2.=C2= =A0 I'm following example from community.redhat.com/blog/2014/10/up-and-run= ning-with-ovirt-3-5/ , Currently I'm only using Gluster volume on node1, bu= t `gluster probe peer` test worked fine with node2 through the 10GB connect= ion. =20 oVirt engine was setup on physical host1 with hosted engine.=C2=A0 Now, w= hen I try to create new Gluster storage domain, I can only see the host "no= de1" available.=20 =20 Is there anyway I can setup oVirt on node1 and node2, while using "gfs1" = and "gfs2" for GlusterFS? or some way to take advantage of the 10GB connect= ion? =20 =20 If I understand right, you have 2 interfaces on each of your hosts, and yo= u want oVirt to communicate via 1 interface and glusterfs to use other? =20 While adding the hosts to oVirt you could use ip1 and then.while creating = the volume, add the brick using the other ip address.=20 For instance, gluster volume create <volname> 192.168.1.2:/bricks/b1=20 =20 Currently, there's no way to specify the IP address to use while adding a = brick from oVirt UI (we're working on this for 3.6), but you could do this = from the gluster CLI commands. This would then be detected in the oVirt UI. =20 =20 =20 =20 Thanks W =20 =20 _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users=20 =20 =20 ------=_Part_234546_1808245352.1420733510294 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <html><body><div style=3D"color:#000; background-color:#fff; font-family:He= lveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;fo= nt-size:16px"><div id=3D"yui_3_16_0_1_1420731722326_24172">That's what I di= d, but didn't work for me.</div><div id=3D"yui_3_16_0_1_1420731722326_23314= "><br></div><div id=3D"yui_3_16_0_1_1420731722326_23315" dir=3D"ltr">1. use= the 192.168.x interface to setup gluster. I used hostname in /etc/hosts.</= div><div id=3D"yui_3_16_0_1_1420731722326_23556" dir=3D"ltr">2. setup oVirt= using the switched network hostnames, let's say 10.10.10.x</div><div id=3D= "yui_3_16_0_1_1420731722326_23557" dir=3D"ltr">3. oVirt and all that comes = up fine.</div><div id=3D"yui_3_16_0_1_1420731722326_23558" dir=3D"ltr">4. W= hen try to create a storage domain, it only shows the 10.10.10.x hostnames = available.</div><div id=3D"yui_3_16_0_1_1420731722326_23559" dir=3D"ltr"><b= r></div><div id=3D"yui_3_16_0_1_1420731722326_24161" dir=3D"ltr"><br></div>= <div id=3D"yui_3_16_0_1_1420731722326_24174" dir=3D"ltr">Tried to add a bri= ck and I would get something like</div><div id=3D"yui_3_16_0_1_142073172232= 6_24181" dir=3D"ltr"> Host gfs2 is not in 'Peer in Cluste= r' state (while node2 is the hostname and gfs2 is the 192.168 name)</= div><div id=3D"yui_3_16_0_1_1420731722326_24182" dir=3D"ltr"><br></div><div= id=3D"yui_3_16_0_1_1420731722326_24797" dir=3D"ltr">Ran command `gluster p= robe peer gfs2` or `gluster probe peer 192.168.x.x` didn't work</div><div i= d=3D"yui_3_16_0_1_1420731722326_24799" dir=3D"ltr"> peer = probe: failed: Probe returned with unknown errno 107</div><div id=3D"yui_3_= 16_0_1_1420731722326_25534" dir=3D"ltr"><br></div><div id=3D"yui_3_16_0_1_1= 420731722326_25535" dir=3D"ltr">Ran probe again with the switched network h= ostname or IP worked fine. May be it is not possible with current GlusterFS= version? <br></div><div id=3D"yui_3_16_0_1_1420731722326_27037" dir= =3D"ltr"><a id=3D"yui_3_16_0_1_1420731722326_27036" href=3D"http://www.glus= ter.org/community/documentation/index.php/Features/SplitNetwork">http://www= .gluster.org/community/documentation/index.php/Features/SplitNetwork</a><br= div id=3D"yui_3_16_0_1_1420731722326_23313"><br><span></span></div><div id= =3D"yui_3_16_0_1_1420731722326_27835" dir=3D"ltr"><span>Will</span></div> <= div class=3D"qtdSeparateBR"><br><br></div><div style=3D"display: block;" cl= ass=3D"yahoo_quoted"> <div style=3D"font-family: HelveticaNeue, Helvetica N= eue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;"> <div s= tyle=3D"font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucid= a Grande, sans-serif; font-size: 16px;"> <div dir=3D"ltr"> <font face=3D"Ar= ial" size=3D"2"> On Thursday, January 8, 2015 3:43 AM, Sahina Bose <sabo= se@redhat.com> wrote:<br> </font> </div> <br><br> <div class=3D"y_msg_c= ontainer"><div id=3D"yiv9327153920"><div> <br clear=3D"none"> <div class=3D"yiv9327153920moz-cite-prefix">On 01/08/2015 12:07 AM, Wil= l K wrote:<br clear=3D"none"> </div> <blockquote type=3D"cite"> <div style=3D"color:#000;background-color:#fff;font-family:HelveticaN= eue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:= 16px;"> <div id=3D"yiv9327153920yui_3_16_0_1_1420578468148_131800">Hi</div> <div dir=3D"ltr" id=3D"yiv9327153920yui_3_16_0_1_1420578468148_1317= 99"><br clear=3D"none"> </div> <div dir=3D"ltr">I would like to see if anyone has good suggestion.</div> <div dir=3D"ltr" id=3D"yiv9327153920yui_3_16_0_1_1420578468148_1331= 55"><br clear=3D"none"> </div> <div dir=3D"ltr" id=3D"yiv9327153920yui_3_16_0_1_1420578468148_1324= 31">I have two physical hosts with 1GB connections to switched networks. The hosts also have 10GB interface connected directly using Twinax cable like copper crossover cable. The idea was to use the 10GB as a "private network" for GlusterFS till the day we want to grow out of this 2 node setup.<br clear=3D"none"> </div> <div id=3D"yiv9327153920yui_3_16_0_1_1420578468148_133145"><br clea= r=3D"none"> </div> <div dir=3D"ltr" id=3D"yiv9327153920yui_3_16_0_1_1420578468148_1331= 44">GlusterFS was setup with the 10GB ports using non-routable IPs and hostnames in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2 192.168.1.2. I'm following example from <a rel=3D"nofo= llow" shape=3D"rect" id=3D"yiv9327153920yui_3_16_0_1_1420578468148_133153" = target=3D"_blank" href=3D"http://community.redhat.com/blog/2014/10/up-and-r= unning-with-ovirt-3-5/">community.redhat.com/blog/2014/10/up-and-running-wi= th-ovirt-3-5/</a> , Currently I'm only using Gluster volume on node1, but `gluster probe peer` test worked fine with node2 through the 10GB connection.<br clear=3D"none"> </div> <div class=3D"yiv9327153920" dir=3D"ltr" id=3D"yiv9327153920yui_3_1= 6_0_1_1420578468148_132429" style=3D""><br clear=3D"none"> </div> <div class=3D"yiv9327153920" dir=3D"ltr" id=3D"yiv9327153920yui_3_1= 6_0_1_1420578468148_132427" style=3D"">oVirt engine was setup on physical h= ost1 with hosted engine. Now, when I try to create new Gluster storage domai= n, I can only see the host "node1" available. <br clear=3D"none"> </div> <div class=3D"yiv9327153920" dir=3D"ltr" id=3D"yiv9327153920yui_3_1= 6_0_1_1420578468148_133151" style=3D""><br clear=3D"none"> </div> <div class=3D"yiv9327153920" dir=3D"ltr" id=3D"yiv9327153920yui_3_1= 6_0_1_1420578468148_133150" style=3D"">Is there anyway I can setup oVirt on= node1 and node2, while using "gfs1" and "gfs2" for GlusterFS? or some way to take advantage of the 10GB connection?<br clear=3D"none"> </div> </div> </blockquote> <br clear=3D"none"> If I understand right, you have 2 interfaces on each of your hosts, and you want oVirt to communicate via 1 interface and glusterfs to use other?<br clear=3D"none"> <br clear=3D"none"> While adding the hosts to oVirt you could use ip1 and then.while creating the volume, add the brick using the other ip address. <br clea= r=3D"none"> For instance, gluster volume create <volname> 192.168.1.2:/bricks/b1 <br clear=3D"none"> <br clear=3D"none"> Currently, there's no way to specify the IP address to use while adding a brick from oVirt UI (we're working on this for 3.6), but you could do this from the gluster CLI commands. This would then be detected in the oVirt UI.<div class=3D"yiv9327153920yqt6792848451" id= =3D"yiv9327153920yqtfd09444"><br clear=3D"none"> <br clear=3D"none"> <br clear=3D"none"> </div><blockquote type=3D"cite"><div class=3D"yiv9327153920yqt679284845= 1" id=3D"yiv9327153920yqtfd00291"> </div><div style=3D"color:#000;background-color:#fff;font-family:Helv= eticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font= -size:16px;"><div class=3D"yiv9327153920yqt6792848451" id=3D"yiv9327153920y= qtfd24136"> <div class=3D"yiv9327153920" dir=3D"ltr" id=3D"yiv9327153920yui_3_1= 6_0_1_1420578468148_131852" style=3D""><br clear=3D"none"> </div> <div class=3D"yiv9327153920" dir=3D"ltr" id=3D"yiv9327153920yui_3_1= 6_0_1_1420578468148_133160" style=3D"">Thanks</div> </div><div class=3D"yiv9327153920" dir=3D"ltr" style=3D""><div clas= s=3D"yiv9327153920yqt6792848451" id=3D"yiv9327153920yqtfd62376">W</div><br = class=3D"yiv9327153920" style=3D"" clear=3D"none"> </div> </div> <br clear=3D"none"> <fieldset class=3D"yiv9327153920mimeAttachmentHeader"></fieldset> <br clear=3D"none"> <pre>_______________________________________________ Users mailing list <a rel=3D"nofollow" shape=3D"rect" class=3D"yiv9327153920moz-txt-link-abbre= viated" ymailto=3D"mailto:Users@ovirt.org" target=3D"_blank" href=3D"mailto= :Users@ovirt.org">Users@ovirt.org</a> <a rel=3D"nofollow" shape=3D"rect" class=3D"yiv9327153920moz-txt-link-freet= ext" target=3D"_blank" href=3D"http://lists.ovirt.org/mailman/listinfo/user= s">http://lists.ovirt.org/mailman/listinfo/users</a><div class=3D"yiv932715= 3920yqt6792848451" id=3D"yiv9327153920yqtfd41340"> </div></pre><div class=3D"yiv9327153920yqt6792848451" id=3D"yiv9327153920yq= tfd57425"> </div></blockquote><div class=3D"yiv9327153920yqt6792848451" id=3D"yiv9= 327153920yqtfd63256"> <br clear=3D"none"> </div></div></div><br><br></div> </div> </div> </div> </div></body></ht= ml> ------=_Part_234546_1808245352.1420733510294--
This is a multi-part message in MIME format. --------------080504040204070206050806 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 01/08/2015 09:41 PM, Will K wrote:
Which version of glusterfs do you have? Kaushal, will this work in glusterfs3.6 and above?
--------------080504040204070206050806 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=UTF-8" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <br> <div class="moz-cite-prefix">On 01/08/2015 09:41 PM, Will K wrote:<br> </div> <blockquote cite="mid:659925230.234547.1420733510302.JavaMail.yahoo@jws106117.mail.bf1.yahoo.com" type="cite"> <div style="color:#000; background-color:#fff; font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:16px"> <div id="yui_3_16_0_1_1420731722326_24172">That's what I did, but didn't work for me.</div> <div id="yui_3_16_0_1_1420731722326_23314"><br> </div> <div id="yui_3_16_0_1_1420731722326_23315" dir="ltr">1. use the 192.168.x interface to setup gluster. I used hostname in /etc/hosts.</div> <div id="yui_3_16_0_1_1420731722326_23556" dir="ltr">2. setup oVirt using the switched network hostnames, let's say 10.10.10.x</div> <div id="yui_3_16_0_1_1420731722326_23557" dir="ltr">3. oVirt and all that comes up fine.</div> <div id="yui_3_16_0_1_1420731722326_23558" dir="ltr">4. When try to create a storage domain, it only shows the 10.10.10.x hostnames available.</div> <div id="yui_3_16_0_1_1420731722326_23559" dir="ltr"><br> </div> <div id="yui_3_16_0_1_1420731722326_24161" dir="ltr"><br> </div> <div id="yui_3_16_0_1_1420731722326_24174" dir="ltr">Tried to add a brick and I would get something like</div> <div id="yui_3_16_0_1_1420731722326_24181" dir="ltr"> Host gfs2 is not in 'Peer in Cluster' state (while node2 is the hostname and gfs2 is the 192.168 name)</div> </div> </blockquote> <br> <br> Which version of glusterfs do you have?<br> <br> Kaushal, will this work in glusterfs3.6 and above?<br> <br> <br> <blockquote cite="mid:659925230.234547.1420733510302.JavaMail.yahoo@jws106117.mail.bf1.yahoo.com" type="cite"> <div style="color:#000; background-color:#fff; font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:16px"> <div id="yui_3_16_0_1_1420731722326_24182" dir="ltr"><br> </div> <div id="yui_3_16_0_1_1420731722326_24797" dir="ltr">Ran command `gluster probe peer gfs2` or `gluster probe peer 192.168.x.x` didn't work</div> <div id="yui_3_16_0_1_1420731722326_24799" dir="ltr"> peer probe: failed: Probe returned with unknown errno 107</div> <div id="yui_3_16_0_1_1420731722326_25534" dir="ltr"><br> </div> <div id="yui_3_16_0_1_1420731722326_25535" dir="ltr">Ran probe again with the switched network hostname or IP worked fine. May be it is not possible with current GlusterFS version? <br> </div> <div id="yui_3_16_0_1_1420731722326_27037" dir="ltr"><a moz-do-not-send="true" id="yui_3_16_0_1_1420731722326_27036" href="http://www.gluster.org/community/documentation/index.php/Features/SplitNetwork">http://www.gluster.org/community/documentation/index.php/Features/SplitNetwork</a><br> </div> <div id="yui_3_16_0_1_1420731722326_24183" dir="ltr"><br> </div> <div id="yui_3_16_0_1_1420731722326_23313"><br> <span></span></div> <div id="yui_3_16_0_1_1420731722326_27835" dir="ltr"><span>Will</span></div> <div class="qtdSeparateBR"><br> <br> </div> <div style="display: block;" class="yahoo_quoted"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;"> <div style="font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;"> <div dir="ltr"> <font face="Arial" size="2"> On Thursday, January 8, 2015 3:43 AM, Sahina Bose <a class="moz-txt-link-rfc2396E" href="mailto:sabose@redhat.com"><sabose@redhat.com></a> wrote:<br> </font> </div> <br> <br> <div class="y_msg_container"> <div id="yiv9327153920"> <div> <br clear="none"> <div class="yiv9327153920moz-cite-prefix">On 01/08/2015 12:07 AM, Will K wrote:<br clear="none"> </div> <blockquote type="cite"> <div style="color:#000;background-color:#fff;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:16px;"> <div id="yiv9327153920yui_3_16_0_1_1420578468148_131800">Hi</div> <div dir="ltr" id="yiv9327153920yui_3_16_0_1_1420578468148_131799"><br clear="none"> </div> <div dir="ltr">I would like to see if anyone has good suggestion.</div> <div dir="ltr" id="yiv9327153920yui_3_16_0_1_1420578468148_133155"><br clear="none"> </div> <div dir="ltr" id="yiv9327153920yui_3_16_0_1_1420578468148_132431">I have two physical hosts with 1GB connections to switched networks. The hosts also have 10GB interface connected directly using Twinax cable like copper crossover cable. The idea was to use the 10GB as a "private network" for GlusterFS till the day we want to grow out of this 2 node setup.<br clear="none"> </div> <div id="yiv9327153920yui_3_16_0_1_1420578468148_133145"><br clear="none"> </div> <div dir="ltr" id="yiv9327153920yui_3_16_0_1_1420578468148_133144">GlusterFS was setup with the 10GB ports using non-routable IPs and hostnames in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2 192.168.1.2. I'm following example from <a moz-do-not-send="true" rel="nofollow" shape="rect" id="yiv9327153920yui_3_16_0_1_1420578468148_133153" target="_blank" href="http://community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/">community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/</a> , Currently I'm only using Gluster volume on node1, but `gluster probe peer` test worked fine with node2 through the 10GB connection.<br clear="none"> </div> <div class="yiv9327153920" dir="ltr" id="yiv9327153920yui_3_16_0_1_1420578468148_132429" style=""><br clear="none"> </div> <div class="yiv9327153920" dir="ltr" id="yiv9327153920yui_3_16_0_1_1420578468148_132427" style="">oVirt engine was setup on physical host1 with hosted engine. Now, when I try to create new Gluster storage domain, I can only see the host "node1" available. <br clear="none"> </div> <div class="yiv9327153920" dir="ltr" id="yiv9327153920yui_3_16_0_1_1420578468148_133151" style=""><br clear="none"> </div> <div class="yiv9327153920" dir="ltr" id="yiv9327153920yui_3_16_0_1_1420578468148_133150" style="">Is there anyway I can setup oVirt on node1 and node2, while using "gfs1" and "gfs2" for GlusterFS? or some way to take advantage of the 10GB connection?<br clear="none"> </div> </div> </blockquote> <br clear="none"> If I understand right, you have 2 interfaces on each of your hosts, and you want oVirt to communicate via 1 interface and glusterfs to use other?<br clear="none"> <br clear="none"> While adding the hosts to oVirt you could use ip1 and then.while creating the volume, add the brick using the other ip address. <br clear="none"> For instance, gluster volume create <volname> 192.168.1.2:/bricks/b1 <br clear="none"> <br clear="none"> Currently, there's no way to specify the IP address to use while adding a brick from oVirt UI (we're working on this for 3.6), but you could do this from the gluster CLI commands. This would then be detected in the oVirt UI. <div class="yiv9327153920yqt6792848451" id="yiv9327153920yqtfd09444"><br clear="none"> <br clear="none"> <br clear="none"> </div> <blockquote type="cite"> <div class="yiv9327153920yqt6792848451" id="yiv9327153920yqtfd00291"> </div> <div style="color:#000;background-color:#fff;font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:16px;"> <div class="yiv9327153920yqt6792848451" id="yiv9327153920yqtfd24136"> <div class="yiv9327153920" dir="ltr" id="yiv9327153920yui_3_16_0_1_1420578468148_131852" style=""><br clear="none"> </div> <div class="yiv9327153920" dir="ltr" id="yiv9327153920yui_3_16_0_1_1420578468148_133160" style="">Thanks</div> </div> <div class="yiv9327153920" dir="ltr" style=""> <div class="yiv9327153920yqt6792848451" id="yiv9327153920yqtfd62376">W</div> <br class="yiv9327153920" style="" clear="none"> </div> </div> <br clear="none"> <fieldset class="yiv9327153920mimeAttachmentHeader"></fieldset> <br clear="none"> <pre>_______________________________________________ Users mailing list <a moz-do-not-send="true" rel="nofollow" shape="rect" class="yiv9327153920moz-txt-link-abbreviated" ymailto="mailto:Users@ovirt.org" target="_blank" href="mailto:Users@ovirt.org">Users@ovirt.org</a> <a moz-do-not-send="true" rel="nofollow" shape="rect" class="yiv9327153920moz-txt-link-freetext" target="_blank" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a><div class="yiv9327153920yqt6792848451" id="yiv9327153920yqtfd41340"> </div></pre> <div class="yiv9327153920yqt6792848451" id="yiv9327153920yqtfd57425"> </div> </blockquote> <div class="yiv9327153920yqt6792848451" id="yiv9327153920yqtfd63256"> <br clear="none"> </div> </div> </div> <br> <br> </div> </div> </div> </div> </div> </blockquote> <br> </body> </html> --------------080504040204070206050806--
Hey Will, It seems to me you are trying manage GlusterFS from oVirt, and trying to get your multi-network setup to work. As Sahina mentioned already, this is not currently possible as oVirt doesn't have the required support. If you want to make this work right now, I suggest you manage GlusterFS manually. You could do the following, - Install GlusterFS on both the hosts and setup a GlusterFS trusted storage pool using the 'gluster peer probe' commands. Run 'gluster peer probe gfs2' from node1 (and the reverse just for safety) - Create a GlusterFS volume, 'gluster volume create <VOLUMENAME> gfs1:<BRICKPATH> gfs2:<BRICKPATH>; and start it, 'gluster volume start <VOLUMENAME>'. After this you'll have GlusterFS setup on the particular network and you'll have volume ready to be added as a oVirt storage domain. - Now setup oVirt on the nodes with the node* network. - Add the gfs* network to oVirt. I'm not sure if this would be required, but you can try it anyway. - Add the created GlusterFS volume as a storage domain using a gfs* address. You should now be ready to begin using the new storage domain. If you would want to expand the volume later, you will need to do it manually with an explicit 'gluster volume add-brick' command. You could possible add the GlusterFS cluster to the oVirt interface, just so you can get stats and monitoring. But even then you shouldn't use the oVirt interface to do any management tasks. Multi-network support for GlusterFS within oVirt is an upcoming feature, and Sahina can give you more details on when to expect it to be available. Thanks, Kaushal ----- Original Message -----
On 01/09/2015 01:13 PM, Kaushal M wrote:
To enable, oVirt to use the node1 interface, is it possible to peer probe using node1 and node2 interface in steps above - i.e "gluster peer probe node2" (This is essentially what happens when a host is added with host address node1 or node2) and then create a GlusterFS volume from CLI using the command you mentioned above?
That should work, provided the names being used resolve correctly and to the same values everywhere. But I'd suggest that a manual peer probe is done using the alternative names, before creating the volume. This way Gluster explicitly knows all the names/addresses, and should not cause any troubles. But as I said before, after doing the manual operations, I'd suggest avoiding doing any management actions from the oVirt interface; as it still doesn't know how to handle multiple networks with Gluster. ~kaushal ----- Original Message -----
participants (3)
-
Kaushal M -
Sahina Bose -
Will K