9:37 p.m.
------=_Part_5951093_1160316627.1420655829032
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Hi
I would like to see if anyone has good suggestion.
I have two physical hosts with 1GB connections to switched networks. The ho=
sts also have 10GB interface connected directly using Twinax cable like cop=
per crossover cable.=C2=A0 The idea was to use the 10GB as a "private netwo=
rk" for GlusterFS till the day we want to grow out of this 2 node setup.
GlusterFS was setup with the 10GB ports using non-routable IPs and hostname=
s in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2 192.168.1.2.=C2=A0 =
I'm following example from community.redhat.com/blog/2014/10/up-and-running=
-with-ovirt-3-5/ , Currently I'm only using Gluster volume on node1, but `g=
luster probe peer` test worked fine with node2 through the 10GB connection.
oVirt engine was setup on physical host1 with hosted engine.=C2=A0 Now, whe=
n I try to create new Gluster storage domain, I can only see the host "node=
1" available.=20
Is there anyway I can setup oVirt on node1 and node2, while using "gfs1" an=
d "gfs2" for GlusterFS? or some way to take advantage of the 10GB connectio=
n?
ThanksW
------=_Part_5951093_1160316627.1420655829032
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<html><body><div style=3D"color:#000; background-color:#fff;
font-family:He=
lveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;fo=
nt-size:16px"><div
id=3D"yui_3_16_0_1_1420578468148_131800">Hi</div><div di=
r=3D"ltr"
id=3D"yui_3_16_0_1_1420578468148_131799"><br></div><div
dir=3D"lt=
r">I would like to see if anyone has good suggestion.</div><div
id=3D"yui_3=
_16_0_1_1420578468148_133155" dir=3D"ltr"><br></div><div
id=3D"yui_3_16_0_1=
_1420578468148_132431" dir=3D"ltr">I have two physical hosts with 1GB
conne=
ctions to switched networks. The hosts also have 10GB interface connected d=
irectly using Twinax cable like copper crossover cable. The idea was =
to use the 10GB as a "private network" for GlusterFS till the day we want t=
o grow out of this 2 node setup.<br></div><div
id=3D"yui_3_16_0_1_142057846=
8148_133145"><br></div><div dir=3D"ltr"
id=3D"yui_3_16_0_1_1420578468148_13=
3144">GlusterFS was setup with the 10GB ports using non-routable IPs and ho=
stnames in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2 192.168.1.2.&=
nbsp; I'm following example from <a id=3D"yui_3_16_0_1_1420578468148_133153=
" href=3D"http://community.redhat.com/blog/2014/10/up-and-running-with...
t-3-5/">community.redhat.com/blog/2014/10/up-and-running-with-ovi...
, Currently I'm only using Gluster volume on node1, but `gluster
probe pe=
er` test worked fine with node2 through the 10GB
connection.<br></div><div =
id=3D"yui_3_16_0_1_1420578468148_132429" style=3D""
class=3D"" dir=3D"ltr">=
<br></div><div id=3D"yui_3_16_0_1_1420578468148_132427"
style=3D"" class=3D=
"" dir=3D"ltr">oVirt engine was setup on physical host1 with hosted
engine.=
Now, when I try to create new Gluster storage domain, I can only see=
the host "node1" available. <br></div><div
id=3D"yui_3_16_0_1_142057846814=
8_133151" style=3D"" class=3D""
dir=3D"ltr"><br></div><div id=3D"yui_3_16_0=
_1_1420578468148_133150" style=3D"" class=3D""
dir=3D"ltr">Is there anyway =
I can setup oVirt on node1 and node2, while using "gfs1" and "gfs2"
for Glu=
sterFS? or some way to take advantage of the 10GB
connection?<br></div><div=
id=3D"yui_3_16_0_1_1420578468148_131852" style=3D""
class=3D"" dir=3D"ltr"=
<br></div><div
id=3D"yui_3_16_0_1_1420578468148_133160" style=3D"" class=
=3D"" dir=3D"ltr">Thanks</div><div
style=3D"" class=3D"" dir=3D"ltr">W<br s=
tyle=3D""
class=3D""></div></div></body></html>
------=_Part_5951093_1160316627.1420655829032--
11:43 a.m.
This is a multi-part message in MIME format.
--------------060906080607010101090105
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
On 01/08/2015 12:07 AM, Will K wrote:
Hi
I would like to see if anyone has good suggestion.
I have two physical hosts with 1GB connections to switched networks.
The hosts also have 10GB interface connected directly using Twinax
cable like copper crossover cable. The idea was to use the 10GB as a
"private network" for GlusterFS till the day we want to grow out of
this 2 node setup.
GlusterFS was setup with the 10GB ports using non-routable IPs and
hostnames in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2
192.168.1.2. I'm following example from
community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/
<http://community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/>
, Currently I'm only using Gluster volume on node1, but `gluster probe
peer` test worked fine with node2 through the 10GB connection.
oVirt engine was setup on physical host1 with hosted engine. Now,
when I try to create new Gluster storage domain, I can only see the
host "node1" available.
Is there anyway I can setup oVirt on node1 and node2, while using
"gfs1" and "gfs2" for GlusterFS? or some way to take advantage of the
10GB connection?
If I understand right, you have 2 interfaces on each of your hosts, and
you want oVirt to communicate via 1 interface and glusterfs to use other?
While adding the hosts to oVirt you could use ip1 and then.while
creating the volume, add the brick using the other ip address.
For instance, gluster volume create <volname> 192.168.1.2:/bricks/b1
Currently, there's no way to specify the IP address to use while adding
a brick from oVirt UI (we're working on this for 3.6), but you could do
this from the gluster CLI commands. This would then be detected in the
oVirt UI.
Thanks
W
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--------------060906080607010101090105
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
<html>
<head>
<meta content="text/html; charset=ISO-8859-1"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<br>
<div class="moz-cite-prefix">On 01/08/2015 12:07 AM, Will K
wrote:<br>
</div>
<blockquote
cite="mid:359985466.5951094.1420655829175.JavaMail.yahoo@jws10637.mail.bf1.yahoo.com"
type="cite">
<div style="color:#000; background-color:#fff;
font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial,
Lucida Grande, sans-serif;font-size:16px">
<div id="yui_3_16_0_1_1420578468148_131800">Hi</div>
<div dir="ltr"
id="yui_3_16_0_1_1420578468148_131799"><br>
</div>
<div dir="ltr">I would like to see if anyone has good
suggestion.</div>
<div id="yui_3_16_0_1_1420578468148_133155"
dir="ltr"><br>
</div>
<div id="yui_3_16_0_1_1420578468148_132431" dir="ltr">I
have two
physical hosts with 1GB connections to switched networks. The
hosts also have 10GB interface connected directly using Twinax
cable like copper crossover cable. The idea was to use the
10GB as a "private network" for GlusterFS till the day we want
to grow out of this 2 node setup.<br>
</div>
<div id="yui_3_16_0_1_1420578468148_133145"><br>
</div>
<div dir="ltr"
id="yui_3_16_0_1_1420578468148_133144">GlusterFS
was setup with the 10GB ports using non-routable IPs and
hostnames in /etc/hosts, for example, gfs1 192.168.1.1 and
gfs2 192.168.1.2. I'm following example from <a
moz-do-not-send="true"
id="yui_3_16_0_1_1420578468148_133153"
href="http://community.redhat.com/blog/2014/10/up-and-running-with-o...
, Currently I'm only using Gluster volume on node1, but
`gluster probe peer` test worked fine with node2 through the
10GB connection.<br>
</div>
<div id="yui_3_16_0_1_1420578468148_132429" style=""
class=""
dir="ltr"><br>
</div>
<div id="yui_3_16_0_1_1420578468148_132427" style=""
class=""
dir="ltr">oVirt engine was setup on physical host1 with hosted
engine. Now, when I try to create new Gluster storage domain,
I can only see the host "node1" available. <br>
</div>
<div id="yui_3_16_0_1_1420578468148_133151" style=""
class=""
dir="ltr"><br>
</div>
<div id="yui_3_16_0_1_1420578468148_133150" style=""
class=""
dir="ltr">Is there anyway I can setup oVirt on node1 and
node2, while using "gfs1" and "gfs2" for GlusterFS? or some
way to take advantage of the 10GB connection?<br>
</div>
</div>
</blockquote>
<br>
If I understand right, you have 2 interfaces on each of your hosts,
and you want oVirt to communicate via 1 interface and glusterfs to
use other?<br>
<br>
While adding the hosts to oVirt you could use ip1 and then.while
creating the volume, add the brick using the other ip address. <br>
For instance, gluster volume create <volname>
192.168.1.2:/bricks/b1 <br>
<br>
Currently, there's no way to specify the IP address to use while
adding a brick from oVirt UI (we're working on this for 3.6), but
you could do this from the gluster CLI commands. This would then be
detected in the oVirt UI.<br>
<br>
<br>
<blockquote
cite="mid:359985466.5951094.1420655829175.JavaMail.yahoo@jws10637.mail.bf1.yahoo.com"
type="cite">
<div style="color:#000; background-color:#fff;
font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial,
Lucida Grande, sans-serif;font-size:16px">
<div id="yui_3_16_0_1_1420578468148_131852" style=""
class=""
dir="ltr"><br>
</div>
<div id="yui_3_16_0_1_1420578468148_133160" style=""
class=""
dir="ltr">Thanks</div>
<div style="" class="" dir="ltr">W<br
style="" class="">
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated"
href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a class="moz-txt-link-freetext"
href="http://lists.ovirt.org/mailman/listinfo/users">http://...
</pre>
</blockquote>
<br>
</body>
</html>
--------------060906080607010101090105--
7:11 p.m.
------=_Part_234546_1808245352.1420733510294
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
That's what I did, but didn't work for me.
1. use the 192.168.x interface to setup gluster. I used hostname in /etc/ho=
sts.2. setup oVirt using the switched network hostnames, let's say 10.10.10=
.x3. oVirt and all that comes up fine.4. When try to create a storage domai=
n, it only shows the 10.10.10.x hostnames available.
Tried to add a brick and I would get something like=C2=A0=C2=A0=C2=A0 Host =
gfs2 is not in 'Peer in Cluster' state=C2=A0 (while node2 is the hostname a=
nd gfs2 is the 192.168 name)
Ran command `gluster probe peer gfs2` or `gluster probe peer 192.168.x.x` d=
idn't work=C2=A0=C2=A0=C2=A0 peer probe: failed: Probe returned with unknow=
n errno 107
Ran probe again with the switched network hostname or IP worked fine. May b=
e it is not possible with current GlusterFS version?=C2=A0=20
http://www.gluster.org/community/documentation/index.php/Features/SplitNetw=
ork
Will=20
On Thursday, January 8, 2015 3:43 AM, Sahina Bose <sabose(a)redhat.com> =
wrote:
=20
=20
On 01/08/2015 12:07 AM, Will K wrote:
=20
Hi=20
I would like to see if anyone has good suggestion.=20
I have two physical hosts with 1GB connections to switched networks. The =
hosts also have 10GB interface connected directly using Twinax cable like c=
opper crossover cable.=C2=A0 The idea was to use the 10GB as a "private net=
work" for GlusterFS till the day we want to grow out of this 2 node setup.
=20
GlusterFS was setup with the 10GB ports using non-routable IPs and hostna=
mes in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2 192.168.1.2.=C2=
=A0 I'm following example from community.redhat.com/blog/2014/10/up-and-run=
ning-with-ovirt-3-5/ , Currently I'm only using Gluster volume on node1, bu=
t `gluster probe peer` test worked fine with node2 through the 10GB connect=
ion.
=20
oVirt engine was setup on physical host1 with hosted engine.=C2=A0 Now, w=
hen I try to create new Gluster storage domain, I can only see the host "no=
de1" available.=20
=20
Is there anyway I can setup oVirt on node1 and node2, while using "gfs1" =
and "gfs2" for GlusterFS? or some way to take advantage of the 10GB connect=
ion?
=20
=20
If I understand right, you have 2 interfaces on each of your hosts, and yo=
u want oVirt to communicate via 1 interface and glusterfs to use other?
=20
While adding the hosts to oVirt you could use ip1 and then.while creating =
the volume, add the brick using the other ip address.=20
For instance, gluster volume create <volname> 192.168.1.2:/bricks/b1=20
=20
Currently, there's no way to specify the IP address to use while adding a =
brick from oVirt UI (we're working on this for 3.6), but you could do this =
from the gluster CLI commands. This would then be detected in the oVirt UI.
=20
=20
=20
=20
Thanks W
=20
=20
_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users=20
=20
=20
------=_Part_234546_1808245352.1420733510294
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<html><body><div style=3D"color:#000; background-color:#fff;
font-family:He=
lveticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;fo=
nt-size:16px"><div
id=3D"yui_3_16_0_1_1420731722326_24172">That's what I di=
d, but didn't work for me.</div><div
id=3D"yui_3_16_0_1_1420731722326_23314=
"><br></div><div id=3D"yui_3_16_0_1_1420731722326_23315"
dir=3D"ltr">1. use=
the 192.168.x interface to setup gluster. I used hostname in /etc/hosts.</=
div><div id=3D"yui_3_16_0_1_1420731722326_23556"
dir=3D"ltr">2. setup oVirt=
using the switched network hostnames, let's say 10.10.10.x</div><div id=3D=
"yui_3_16_0_1_1420731722326_23557" dir=3D"ltr">3. oVirt and all
that comes =
up fine.</div><div id=3D"yui_3_16_0_1_1420731722326_23558"
dir=3D"ltr">4. W=
hen try to create a storage domain, it only shows the 10.10.10.x hostnames =
available.</div><div id=3D"yui_3_16_0_1_1420731722326_23559"
dir=3D"ltr"><b=
r></div><div id=3D"yui_3_16_0_1_1420731722326_24161"
dir=3D"ltr"><br></div>=
<div id=3D"yui_3_16_0_1_1420731722326_24174" dir=3D"ltr">Tried
to add a bri=
ck and I would get something like</div><div
id=3D"yui_3_16_0_1_142073172232=
6_24181" dir=3D"ltr"> Host gfs2 is not in
'Peer in Cluste=
r' state (while node2 is the hostname and gfs2 is the 192.168 name)</=
div><div id=3D"yui_3_16_0_1_1420731722326_24182"
dir=3D"ltr"><br></div><div=
id=3D"yui_3_16_0_1_1420731722326_24797" dir=3D"ltr">Ran command
`gluster p=
robe peer gfs2` or `gluster probe peer 192.168.x.x` didn't work</div><div i=
d=3D"yui_3_16_0_1_1420731722326_24799"
dir=3D"ltr"> peer =
probe: failed: Probe returned with unknown errno 107</div><div
id=3D"yui_3_=
16_0_1_1420731722326_25534" dir=3D"ltr"><br></div><div
id=3D"yui_3_16_0_1_1=
420731722326_25535" dir=3D"ltr">Ran probe again with the switched
network h=
ostname or IP worked fine. May be it is not possible with current GlusterFS=
version? <br></div><div
id=3D"yui_3_16_0_1_1420731722326_27037" dir=
=3D"ltr"><a id=3D"yui_3_16_0_1_1420731722326_27036"
href=3D"http://www.glus=
ter.org/community/documentation/index.php/Features/SplitNetwork">...
.gluster.org/community/documentation/index.php/Features/SplitNetwork</a><br=
</div><div id=3D"yui_3_16_0_1_1420731722326_24183"
dir=3D"ltr"><br></div><=
div
id=3D"yui_3_16_0_1_1420731722326_23313"><br><span></span></div><div
id=
=3D"yui_3_16_0_1_1420731722326_27835"
dir=3D"ltr"><span>Will</span></div> <=
div class=3D"qtdSeparateBR"><br><br></div><div
style=3D"display: block;" cl=
ass=3D"yahoo_quoted"> <div style=3D"font-family: HelveticaNeue,
Helvetica N=
eue, Helvetica, Arial, Lucida Grande, sans-serif; font-size: 16px;"> <div s=
tyle=3D"font-family: HelveticaNeue, Helvetica Neue, Helvetica, Arial, Lucid=
a Grande, sans-serif; font-size: 16px;"> <div dir=3D"ltr">
<font face=3D"Ar=
ial" size=3D"2"> On Thursday, January 8, 2015 3:43 AM, Sahina Bose
<sabo=
se(a)redhat.com&gt; wrote:<br> </font> </div> <br><br>
<div class=3D"y_msg_c=
ontainer"><div id=3D"yiv9327153920"><div>
<br clear=3D"none">
<div class=3D"yiv9327153920moz-cite-prefix">On 01/08/2015 12:07 AM,
Wil=
l K wrote:<br clear=3D"none">
</div>
<blockquote type=3D"cite">
<div style=3D"color:#000;background-color:#fff;font-family:HelveticaN=
eue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font-size:=
16px;">
<div
id=3D"yiv9327153920yui_3_16_0_1_1420578468148_131800">Hi</div>
<div dir=3D"ltr"
id=3D"yiv9327153920yui_3_16_0_1_1420578468148_1317=
99"><br clear=3D"none">
</div>
<div dir=3D"ltr">I would like to see if anyone has good
suggestion.</div>
<div dir=3D"ltr"
id=3D"yiv9327153920yui_3_16_0_1_1420578468148_1331=
55"><br clear=3D"none">
</div>
<div dir=3D"ltr"
id=3D"yiv9327153920yui_3_16_0_1_1420578468148_1324=
31">I have two
physical hosts with 1GB connections to switched networks. The
hosts also have 10GB interface connected directly using Twinax
cable like copper crossover cable. The idea was to use the
10GB as a "private network" for GlusterFS till the day we want
to grow out of this 2 node setup.<br clear=3D"none">
</div>
<div id=3D"yiv9327153920yui_3_16_0_1_1420578468148_133145"><br
clea=
r=3D"none">
</div>
<div dir=3D"ltr"
id=3D"yiv9327153920yui_3_16_0_1_1420578468148_1331=
44">GlusterFS
was setup with the 10GB ports using non-routable IPs and
hostnames in /etc/hosts, for example, gfs1 192.168.1.1 and
gfs2 192.168.1.2. I'm following example from <a
rel=3D"nofo=
llow" shape=3D"rect"
id=3D"yiv9327153920yui_3_16_0_1_1420578468148_133153" =
target=3D"_blank"
href=3D"http://community.redhat.com/blog/2014/10/up-and-r=
unning-with-ovirt-3-5/">community.redhat.com/blog/2014/10/up-and-...
th-ovirt-3-5/</a>
, Currently I'm only using Gluster volume on node1, but
`gluster probe peer` test worked fine with node2 through the
10GB connection.<br clear=3D"none">
</div>
<div class=3D"yiv9327153920" dir=3D"ltr"
id=3D"yiv9327153920yui_3_1=
6_0_1_1420578468148_132429" style=3D""><br
clear=3D"none">
</div>
<div class=3D"yiv9327153920" dir=3D"ltr"
id=3D"yiv9327153920yui_3_1=
6_0_1_1420578468148_132427" style=3D"">oVirt engine was setup on
physical h=
ost1 with hosted
engine. Now, when I try to create new Gluster storage domai=
n,
I can only see the host "node1" available. <br
clear=3D"none">
</div>
<div class=3D"yiv9327153920" dir=3D"ltr"
id=3D"yiv9327153920yui_3_1=
6_0_1_1420578468148_133151" style=3D""><br
clear=3D"none">
</div>
<div class=3D"yiv9327153920" dir=3D"ltr"
id=3D"yiv9327153920yui_3_1=
6_0_1_1420578468148_133150" style=3D"">Is there anyway I can setup oVirt
on=
node1 and
node2, while using "gfs1" and "gfs2" for GlusterFS? or some
way to take advantage of the 10GB connection?<br
clear=3D"none">
</div>
</div>
</blockquote>
<br clear=3D"none">
If I understand right, you have 2 interfaces on each of your hosts,
and you want oVirt to communicate via 1 interface and glusterfs to
use other?<br clear=3D"none">
<br clear=3D"none">
While adding the hosts to oVirt you could use ip1 and then.while
creating the volume, add the brick using the other ip address. <br clea=
r=3D"none">
For instance, gluster volume create <volname>
192.168.1.2:/bricks/b1 <br clear=3D"none">
<br clear=3D"none">
Currently, there's no way to specify the IP address to use while
adding a brick from oVirt UI (we're working on this for 3.6), but
you could do this from the gluster CLI commands. This would then be
detected in the oVirt UI.<div class=3D"yiv9327153920yqt6792848451" id=
=3D"yiv9327153920yqtfd09444"><br clear=3D"none">
<br clear=3D"none">
<br clear=3D"none">
</div><blockquote type=3D"cite"><div
class=3D"yiv9327153920yqt679284845=
1" id=3D"yiv9327153920yqtfd00291">
</div><div
style=3D"color:#000;background-color:#fff;font-family:Helv=
eticaNeue, Helvetica Neue, Helvetica, Arial, Lucida Grande, sans-serif;font=
-size:16px;"><div class=3D"yiv9327153920yqt6792848451"
id=3D"yiv9327153920y=
qtfd24136">
<div class=3D"yiv9327153920" dir=3D"ltr"
id=3D"yiv9327153920yui_3_1=
6_0_1_1420578468148_131852" style=3D""><br
clear=3D"none">
</div>
<div class=3D"yiv9327153920" dir=3D"ltr"
id=3D"yiv9327153920yui_3_1=
6_0_1_1420578468148_133160" style=3D"">Thanks</div>
</div><div class=3D"yiv9327153920" dir=3D"ltr"
style=3D""><div clas=
s=3D"yiv9327153920yqt6792848451"
id=3D"yiv9327153920yqtfd62376">W</div><br =
class=3D"yiv9327153920" style=3D"" clear=3D"none">
</div>
</div>
<br clear=3D"none">
<fieldset
class=3D"yiv9327153920mimeAttachmentHeader"></fieldset>
<br clear=3D"none">
<pre>_______________________________________________
Users mailing list
<a rel=3D"nofollow" shape=3D"rect"
class=3D"yiv9327153920moz-txt-link-abbre=
viated" ymailto=3D"mailto:Users@ovirt.org" target=3D"_blank"
href=3D"mailto=
:Users@ovirt.org">Users@ovirt.org</a>
<a rel=3D"nofollow" shape=3D"rect"
class=3D"yiv9327153920moz-txt-link-freet=
ext" target=3D"_blank"
href=3D"http://lists.ovirt.org/mailman/listinfo/user=
s">http://lists.ovirt.org/mailman/listinfo/users</a><div
class=3D"yiv932715=
3920yqt6792848451" id=3D"yiv9327153920yqtfd41340">
</div></pre><div class=3D"yiv9327153920yqt6792848451"
id=3D"yiv9327153920yq=
tfd57425">
</div></blockquote><div class=3D"yiv9327153920yqt6792848451"
id=3D"yiv9=
327153920yqtfd63256">
<br clear=3D"none">
</div></div></div><br><br></div> </div>
</div> </div> </div></body></ht=
ml>
------=_Part_234546_1808245352.1420733510294--
8:40 a.m.
This is a multi-part message in MIME format.
--------------080504040204070206050806
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
On 01/08/2015 09:41 PM, Will K wrote:
That's what I did, but didn't work for me.
1. use the 192.168.x interface to setup gluster. I used hostname in
/etc/hosts.
2. setup oVirt using the switched network hostnames, let's say 10.10.10.x
3. oVirt and all that comes up fine.
4. When try to create a storage domain, it only shows the 10.10.10.x
hostnames available.
Tried to add a brick and I would get something like
Host gfs2 is not in 'Peer in Cluster' state (while node2 is the
hostname and gfs2 is the 192.168 name)
Which version of glusterfs do you have?
Kaushal, will this work in glusterfs3.6 and above?
Ran command `gluster probe peer gfs2` or `gluster probe peer
192.168.x.x` didn't work
peer probe: failed: Probe returned with unknown errno 107
Ran probe again with the switched network hostname or IP worked fine.
May be it is not possible with current GlusterFS version?
http://www.gluster.org/community/documentation/index.php/Features/SplitNe...
Will
On Thursday, January 8, 2015 3:43 AM, Sahina Bose <sabose(a)redhat.com>
wrote:
On 01/08/2015 12:07 AM, Will K wrote:
> Hi
>
> I would like to see if anyone has good suggestion.
>
> I have two physical hosts with 1GB connections to switched networks.
> The hosts also have 10GB interface connected directly using Twinax
> cable like copper crossover cable. The idea was to use the 10GB as a
> "private network" for GlusterFS till the day we want to grow out of
> this 2 node setup.
>
> GlusterFS was setup with the 10GB ports using non-routable IPs and
> hostnames in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2
> 192.168.1.2. I'm following example from
> community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/
> <http://community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/>
> , Currently I'm only using Gluster volume on node1, but `gluster
> probe peer` test worked fine with node2 through the 10GB connection.
>
> oVirt engine was setup on physical host1 with hosted engine. Now,
> when I try to create new Gluster storage domain, I can only see the
> host "node1" available.
>
> Is there anyway I can setup oVirt on node1 and node2, while using
> "gfs1" and "gfs2" for GlusterFS? or some way to take advantage of
the
> 10GB connection?
If I understand right, you have 2 interfaces on each of your hosts,
and you want oVirt to communicate via 1 interface and glusterfs to use
other?
While adding the hosts to oVirt you could use ip1 and then.while
creating the volume, add the brick using the other ip address.
For instance, gluster volume create <volname> 192.168.1.2:/bricks/b1
Currently, there's no way to specify the IP address to use while
adding a brick from oVirt UI (we're working on this for 3.6), but you
could do this from the gluster CLI commands. This would then be
detected in the oVirt UI.
>
> Thanks
> W
>
>
>
> _______________________________________________
> Users mailing list
> Users(a)ovirt.org <mailto:Users@ovirt.org>
> http://lists.ovirt.org/mailman/listinfo/users
--------------080504040204070206050806
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta content="text/html; charset=UTF-8"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<br>
<div class="moz-cite-prefix">On 01/08/2015 09:41 PM, Will K
wrote:<br>
</div>
<blockquote
cite="mid:659925230.234547.1420733510302.JavaMail.yahoo@jws106117.mail.bf1.yahoo.com"
type="cite">
<div style="color:#000; background-color:#fff;
font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial,
Lucida Grande, sans-serif;font-size:16px">
<div id="yui_3_16_0_1_1420731722326_24172">That's what I did,
but didn't work for me.</div>
<div id="yui_3_16_0_1_1420731722326_23314"><br>
</div>
<div id="yui_3_16_0_1_1420731722326_23315" dir="ltr">1.
use the
192.168.x interface to setup gluster. I used hostname in
/etc/hosts.</div>
<div id="yui_3_16_0_1_1420731722326_23556" dir="ltr">2.
setup
oVirt using the switched network hostnames, let's say
10.10.10.x</div>
<div id="yui_3_16_0_1_1420731722326_23557" dir="ltr">3.
oVirt
and all that comes up fine.</div>
<div id="yui_3_16_0_1_1420731722326_23558" dir="ltr">4.
When try
to create a storage domain, it only shows the 10.10.10.x
hostnames available.</div>
<div id="yui_3_16_0_1_1420731722326_23559"
dir="ltr"><br>
</div>
<div id="yui_3_16_0_1_1420731722326_24161"
dir="ltr"><br>
</div>
<div id="yui_3_16_0_1_1420731722326_24174"
dir="ltr">Tried to
add a brick and I would get something like</div>
<div id="yui_3_16_0_1_1420731722326_24181" dir="ltr">
Host
gfs2 is not in 'Peer in Cluster' state (while node2 is the
hostname and gfs2 is the 192.168 name)</div>
</div>
</blockquote>
<br>
<br>
Which version of glusterfs do you have?<br>
<br>
Kaushal, will this work in glusterfs3.6 and above?<br>
<br>
<br>
<blockquote
cite="mid:659925230.234547.1420733510302.JavaMail.yahoo@jws106117.mail.bf1.yahoo.com"
type="cite">
<div style="color:#000; background-color:#fff;
font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial,
Lucida Grande, sans-serif;font-size:16px">
<div id="yui_3_16_0_1_1420731722326_24182"
dir="ltr"><br>
</div>
<div id="yui_3_16_0_1_1420731722326_24797" dir="ltr">Ran
command
`gluster probe peer gfs2` or `gluster probe peer 192.168.x.x`
didn't work</div>
<div id="yui_3_16_0_1_1420731722326_24799" dir="ltr">
peer
probe: failed: Probe returned with unknown errno 107</div>
<div id="yui_3_16_0_1_1420731722326_25534"
dir="ltr"><br>
</div>
<div id="yui_3_16_0_1_1420731722326_25535" dir="ltr">Ran
probe
again with the switched network hostname or IP worked fine.
May be it is not possible with current GlusterFS version? <br>
</div>
<div id="yui_3_16_0_1_1420731722326_27037"
dir="ltr"><a
moz-do-not-send="true"
id="yui_3_16_0_1_1420731722326_27036"
href="http://www.gluster.org/community/documentation/index.php/Featu...
</div>
<div id="yui_3_16_0_1_1420731722326_24183"
dir="ltr"><br>
</div>
<div id="yui_3_16_0_1_1420731722326_23313"><br>
<span></span></div>
<div id="yui_3_16_0_1_1420731722326_27835"
dir="ltr"><span>Will</span></div>
<div class="qtdSeparateBR"><br>
<br>
</div>
<div style="display: block;" class="yahoo_quoted">
<div style="font-family: HelveticaNeue, Helvetica Neue,
Helvetica, Arial, Lucida Grande, sans-serif; font-size:
16px;">
<div style="font-family: HelveticaNeue, Helvetica Neue,
Helvetica, Arial, Lucida Grande, sans-serif; font-size:
16px;">
<div dir="ltr"> <font face="Arial"
size="2"> On Thursday,
January 8, 2015 3:43 AM, Sahina Bose
<a class="moz-txt-link-rfc2396E"
href="mailto:sabose@redhat.com"><sabose@redhat.com></a>
wrote:<br>
</font> </div>
<br>
<br>
<div class="y_msg_container">
<div id="yiv9327153920">
<div> <br clear="none">
<div class="yiv9327153920moz-cite-prefix">On
01/08/2015 12:07 AM, Will K wrote:<br clear="none">
</div>
<blockquote type="cite">
<div
style="color:#000;background-color:#fff;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida Grande,
sans-serif;font-size:16px;">
<div
id="yiv9327153920yui_3_16_0_1_1420578468148_131800">Hi</div>
<div dir="ltr"
id="yiv9327153920yui_3_16_0_1_1420578468148_131799"><br
clear="none">
</div>
<div dir="ltr">I would like to see if anyone has
good suggestion.</div>
<div dir="ltr"
id="yiv9327153920yui_3_16_0_1_1420578468148_133155"><br
clear="none">
</div>
<div dir="ltr"
id="yiv9327153920yui_3_16_0_1_1420578468148_132431">I
have two physical hosts with 1GB connections
to switched networks. The hosts also have 10GB
interface connected directly using Twinax
cable like copper crossover cable. The idea
was to use the 10GB as a "private network" for
GlusterFS till the day we want to grow out of
this 2 node setup.<br clear="none">
</div>
<div
id="yiv9327153920yui_3_16_0_1_1420578468148_133145"><br
clear="none">
</div>
<div dir="ltr"
id="yiv9327153920yui_3_16_0_1_1420578468148_133144">GlusterFS
was setup with the 10GB ports using
non-routable IPs and hostnames in /etc/hosts,
for example, gfs1 192.168.1.1 and gfs2
192.168.1.2. I'm following example from <a
moz-do-not-send="true" rel="nofollow"
shape="rect"
id="yiv9327153920yui_3_16_0_1_1420578468148_133153"
target="_blank"
href="http://community.redhat.com/blog/2014/10/up-and-running-with-o...
, Currently I'm only using Gluster volume on
node1, but `gluster probe peer` test worked
fine with node2 through the 10GB connection.<br
clear="none">
</div>
<div class="yiv9327153920" dir="ltr"
id="yiv9327153920yui_3_16_0_1_1420578468148_132429"
style=""><br clear="none">
</div>
<div class="yiv9327153920" dir="ltr"
id="yiv9327153920yui_3_16_0_1_1420578468148_132427"
style="">oVirt engine was setup on physical
host1 with hosted engine. Now, when I try to
create new Gluster storage domain, I can only
see the host "node1" available. <br
clear="none">
</div>
<div class="yiv9327153920" dir="ltr"
id="yiv9327153920yui_3_16_0_1_1420578468148_133151"
style=""><br clear="none">
</div>
<div class="yiv9327153920" dir="ltr"
id="yiv9327153920yui_3_16_0_1_1420578468148_133150"
style="">Is there anyway I can setup oVirt on
node1 and node2, while using "gfs1" and
"gfs2"
for GlusterFS? or some way to take advantage
of the 10GB connection?<br clear="none">
</div>
</div>
</blockquote>
<br clear="none">
If I understand right, you have 2 interfaces on each
of your hosts, and you want oVirt to communicate via
1 interface and glusterfs to use other?<br
clear="none">
<br clear="none">
While adding the hosts to oVirt you could use ip1
and then.while creating the volume, add the brick
using the other ip address. <br clear="none">
For instance, gluster volume create <volname>
192.168.1.2:/bricks/b1 <br clear="none">
<br clear="none">
Currently, there's no way to specify the IP address
to use while adding a brick from oVirt UI (we're
working on this for 3.6), but you could do this from
the gluster CLI commands. This would then be
detected in the oVirt UI.
<div class="yiv9327153920yqt6792848451"
id="yiv9327153920yqtfd09444"><br
clear="none">
<br clear="none">
<br clear="none">
</div>
<blockquote type="cite">
<div class="yiv9327153920yqt6792848451"
id="yiv9327153920yqtfd00291"> </div>
<div
style="color:#000;background-color:#fff;font-family:HelveticaNeue,
Helvetica Neue, Helvetica, Arial, Lucida Grande,
sans-serif;font-size:16px;">
<div class="yiv9327153920yqt6792848451"
id="yiv9327153920yqtfd24136">
<div class="yiv9327153920" dir="ltr"
id="yiv9327153920yui_3_16_0_1_1420578468148_131852"
style=""><br clear="none">
</div>
<div class="yiv9327153920" dir="ltr"
id="yiv9327153920yui_3_16_0_1_1420578468148_133160"
style="">Thanks</div>
</div>
<div class="yiv9327153920" dir="ltr"
style="">
<div class="yiv9327153920yqt6792848451"
id="yiv9327153920yqtfd62376">W</div>
<br class="yiv9327153920" style=""
clear="none">
</div>
</div>
<br clear="none">
<fieldset
class="yiv9327153920mimeAttachmentHeader"></fieldset>
<br clear="none">
<pre>_______________________________________________
Users mailing list
<a moz-do-not-send="true" rel="nofollow" shape="rect"
class="yiv9327153920moz-txt-link-abbreviated"
ymailto="mailto:Users@ovirt.org" target="_blank"
href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a moz-do-not-send="true" rel="nofollow" shape="rect"
class="yiv9327153920moz-txt-link-freetext" target="_blank"
href="http://lists.ovirt.org/mailman/listinfo/users">http://...
class="yiv9327153920yqt6792848451" id="yiv9327153920yqtfd41340">
</div></pre>
<div class="yiv9327153920yqt6792848451"
id="yiv9327153920yqtfd57425"> </div>
</blockquote>
<div class="yiv9327153920yqt6792848451"
id="yiv9327153920yqtfd63256"> <br
clear="none">
</div>
</div>
</div>
<br>
<br>
</div>
</div>
</div>
</div>
</div>
</blockquote>
<br>
</body>
</html>
--------------080504040204070206050806--
10:43 a.m.
Hey Will,
It seems to me you are trying manage GlusterFS from oVirt, and trying to get your
multi-network setup to work. As Sahina mentioned already, this is not currently possible
as oVirt doesn't have the required support.
If you want to make this work right now, I suggest you manage GlusterFS manually. You
could do the following,
- Install GlusterFS on both the hosts and setup a GlusterFS trusted storage pool using the
'gluster peer probe' commands. Run 'gluster peer probe gfs2' from node1
(and the reverse just for safety)
- Create a GlusterFS volume, 'gluster volume create <VOLUMENAME>
gfs1:<BRICKPATH> gfs2:<BRICKPATH>; and start it, 'gluster volume start
<VOLUMENAME>'.
After this you'll have GlusterFS setup on the particular network and you'll have
volume ready to be added as a oVirt storage domain.
- Now setup oVirt on the nodes with the node* network.
- Add the gfs* network to oVirt. I'm not sure if this would be required, but you can
try it anyway.
- Add the created GlusterFS volume as a storage domain using a gfs* address.
You should now be ready to begin using the new storage domain.
If you would want to expand the volume later, you will need to do it manually with an
explicit 'gluster volume add-brick' command.
You could possible add the GlusterFS cluster to the oVirt interface, just so you can get
stats and monitoring. But even then you shouldn't use the oVirt interface to do any
management tasks.
Multi-network support for GlusterFS within oVirt is an upcoming feature, and Sahina can
give you more details on when to expect it to be available.
Thanks,
Kaushal
----- Original Message -----
From: "Sahina Bose" <sabose(a)redhat.com>
To: "Will K" <yetanotherwill(a)yahoo.com>, users(a)ovirt.org, "Kaushal
M" <kaushal(a)redhat.com>
Sent: Friday, 9 January, 2015 11:10:48 AM
Subject: Re: [ovirt-users] Using gluster on other hosts?
On 01/08/2015 09:41 PM, Will K wrote:
> That's what I did, but didn't work for me.
>
> 1. use the 192.168.x interface to setup gluster. I used hostname in
> /etc/hosts.
> 2. setup oVirt using the switched network hostnames, let's say 10.10.10.x
> 3. oVirt and all that comes up fine.
> 4. When try to create a storage domain, it only shows the 10.10.10.x
> hostnames available.
>
>
> Tried to add a brick and I would get something like
> Host gfs2 is not in 'Peer in Cluster' state (while node2 is the
> hostname and gfs2 is the 192.168 name)
Which version of glusterfs do you have?
Kaushal, will this work in glusterfs3.6 and above?
>
> Ran command `gluster probe peer gfs2` or `gluster probe peer
> 192.168.x.x` didn't work
> peer probe: failed: Probe returned with unknown errno 107
>
> Ran probe again with the switched network hostname or IP worked fine.
> May be it is not possible with current GlusterFS version?
> http://www.gluster.org/community/documentation/index.php/Features/SplitNe...
>
>
> Will
>
>
> On Thursday, January 8, 2015 3:43 AM, Sahina Bose <sabose(a)redhat.com>
> wrote:
>
>
>
> On 01/08/2015 12:07 AM, Will K wrote:
>> Hi
>>
>> I would like to see if anyone has good suggestion.
>>
>> I have two physical hosts with 1GB connections to switched networks.
>> The hosts also have 10GB interface connected directly using Twinax
>> cable like copper crossover cable. The idea was to use the 10GB as a
>> "private network" for GlusterFS till the day we want to grow out of
>> this 2 node setup.
>>
>> GlusterFS was setup with the 10GB ports using non-routable IPs and
>> hostnames in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2
>> 192.168.1.2. I'm following example from
>> community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/
>> <http://community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/>
>> , Currently I'm only using Gluster volume on node1, but `gluster
>> probe peer` test worked fine with node2 through the 10GB connection.
>>
>> oVirt engine was setup on physical host1 with hosted engine. Now,
>> when I try to create new Gluster storage domain, I can only see the
>> host "node1" available.
>>
>> Is there anyway I can setup oVirt on node1 and node2, while using
>> "gfs1" and "gfs2" for GlusterFS? or some way to take
advantage of the
>> 10GB connection?
>
> If I understand right, you have 2 interfaces on each of your hosts,
> and you want oVirt to communicate via 1 interface and glusterfs to use
> other?
>
> While adding the hosts to oVirt you could use ip1 and then.while
> creating the volume, add the brick using the other ip address.
> For instance, gluster volume create <volname> 192.168.1.2:/bricks/b1
>
> Currently, there's no way to specify the IP address to use while
> adding a brick from oVirt UI (we're working on this for 3.6), but you
> could do this from the gluster CLI commands. This would then be
> detected in the oVirt UI.
>
>
>
>>
>> Thanks
>> W
>>
>>
>>
>> _______________________________________________
>> Users mailing list
>> Users(a)ovirt.org <mailto:Users@ovirt.org>
>> http://lists.ovirt.org/mailman/listinfo/users
>
>
>
11:17 a.m.
On 01/09/2015 01:13 PM, Kaushal M wrote:
Hey Will,
It seems to me you are trying manage GlusterFS from oVirt, and trying to get your
multi-network setup to work. As Sahina mentioned already, this is not currently possible
as oVirt doesn't have the required support.
If you want to make this work right now, I suggest you manage GlusterFS manually. You
could do the following,
- Install GlusterFS on both the hosts and setup a GlusterFS trusted storage pool using
the 'gluster peer probe' commands. Run 'gluster peer probe gfs2' from
node1 (and the reverse just for safety)
- Create a GlusterFS volume, 'gluster volume create <VOLUMENAME>
gfs1:<BRICKPATH> gfs2:<BRICKPATH>; and start it, 'gluster volume start
<VOLUMENAME>'.
After this you'll have GlusterFS setup on the particular network and you'll have
volume ready to be added as a oVirt storage domain.
To enable, oVirt to use the node1 interface, is it possible to peer
probe using node1 and node2 interface in steps above - i.e "gluster peer
probe node2" (This is essentially what happens when a host is added with
host address node1 or node2)
and then create a GlusterFS volume from CLI using the command you
mentioned above?
- Now setup oVirt on the nodes with the node* network.
- Add the gfs* network to oVirt. I'm not sure if this would be required, but you can
try it anyway.
- Add the created GlusterFS volume as a storage domain using a gfs* address.
You should now be ready to begin using the new storage domain.
If you would want to expand the volume later, you will need to do it manually with an
explicit 'gluster volume add-brick' command.
You could possible add the GlusterFS cluster to the oVirt interface, just so you can get
stats and monitoring. But even then you shouldn't use the oVirt interface to do any
management tasks.
Multi-network support for GlusterFS within oVirt is an upcoming feature, and Sahina can
give you more details on when to expect it to be available.
Thanks,
Kaushal
----- Original Message -----
> From: "Sahina Bose" <sabose(a)redhat.com>
> To: "Will K" <yetanotherwill(a)yahoo.com>, users(a)ovirt.org,
"Kaushal M" <kaushal(a)redhat.com>
> Sent: Friday, 9 January, 2015 11:10:48 AM
> Subject: Re: [ovirt-users] Using gluster on other hosts?
>
>
> On 01/08/2015 09:41 PM, Will K wrote:
>> That's what I did, but didn't work for me.
>>
>> 1. use the 192.168.x interface to setup gluster. I used hostname in
>> /etc/hosts.
>> 2. setup oVirt using the switched network hostnames, let's say 10.10.10.x
>> 3. oVirt and all that comes up fine.
>> 4. When try to create a storage domain, it only shows the 10.10.10.x
>> hostnames available.
>>
>>
>> Tried to add a brick and I would get something like
>> Host gfs2 is not in 'Peer in Cluster' state (while node2 is the
>> hostname and gfs2 is the 192.168 name)
>
> Which version of glusterfs do you have?
>
> Kaushal, will this work in glusterfs3.6 and above?
>
>
>> Ran command `gluster probe peer gfs2` or `gluster probe peer
>> 192.168.x.x` didn't work
>> peer probe: failed: Probe returned with unknown errno 107
>>
>> Ran probe again with the switched network hostname or IP worked fine.
>> May be it is not possible with current GlusterFS version?
>> http://www.gluster.org/community/documentation/index.php/Features/SplitNe...
>>
>>
>> Will
>>
>>
>> On Thursday, January 8, 2015 3:43 AM, Sahina Bose <sabose(a)redhat.com>
>> wrote:
>>
>>
>>
>> On 01/08/2015 12:07 AM, Will K wrote:
>>> Hi
>>>
>>> I would like to see if anyone has good suggestion.
>>>
>>> I have two physical hosts with 1GB connections to switched networks.
>>> The hosts also have 10GB interface connected directly using Twinax
>>> cable like copper crossover cable. The idea was to use the 10GB as a
>>> "private network" for GlusterFS till the day we want to grow out
of
>>> this 2 node setup.
>>>
>>> GlusterFS was setup with the 10GB ports using non-routable IPs and
>>> hostnames in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2
>>> 192.168.1.2. I'm following example from
>>> community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/
>>>
<http://community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/>
>>> , Currently I'm only using Gluster volume on node1, but `gluster
>>> probe peer` test worked fine with node2 through the 10GB connection.
>>>
>>> oVirt engine was setup on physical host1 with hosted engine. Now,
>>> when I try to create new Gluster storage domain, I can only see the
>>> host "node1" available.
>>>
>>> Is there anyway I can setup oVirt on node1 and node2, while using
>>> "gfs1" and "gfs2" for GlusterFS? or some way to take
advantage of the
>>> 10GB connection?
>> If I understand right, you have 2 interfaces on each of your hosts,
>> and you want oVirt to communicate via 1 interface and glusterfs to use
>> other?
>>
>> While adding the hosts to oVirt you could use ip1 and then.while
>> creating the volume, add the brick using the other ip address.
>> For instance, gluster volume create <volname> 192.168.1.2:/bricks/b1
>>
>> Currently, there's no way to specify the IP address to use while
>> adding a brick from oVirt UI (we're working on this for 3.6), but you
>> could do this from the gluster CLI commands. This would then be
>> detected in the oVirt UI.
>>
>>
>>
>>> Thanks
>>> W
>>>
>>>
>>>
>>> _______________________________________________
>>> Users mailing list
>>> Users(a)ovirt.org <mailto:Users@ovirt.org>
>>> http://lists.ovirt.org/mailman/listinfo/users
>>
>>
>
11:48 a.m.
That should work, provided the names being used resolve correctly and to the same values
everywhere.
But I'd suggest that a manual peer probe is done using the alternative names, before
creating the volume. This way Gluster explicitly knows all the names/addresses, and should
not cause any troubles.
But as I said before, after doing the manual operations, I'd suggest avoiding doing
any management actions from the oVirt interface; as it still doesn't know how to
handle multiple networks with Gluster.
~kaushal
----- Original Message -----
From: "Sahina Bose" <sabose(a)redhat.com>
To: "Kaushal M" <kaushal(a)redhat.com>
Cc: "Will K" <yetanotherwill(a)yahoo.com>, users(a)ovirt.org
Sent: Friday, 9 January, 2015 1:47:17 PM
Subject: Re: [ovirt-users] Using gluster on other hosts?
On 01/09/2015 01:13 PM, Kaushal M wrote:
> Hey Will,
>
> It seems to me you are trying manage GlusterFS from oVirt, and trying to
> get your multi-network setup to work. As Sahina mentioned already, this is
> not currently possible as oVirt doesn't have the required support.
>
> If you want to make this work right now, I suggest you manage GlusterFS
> manually. You could do the following,
>
> - Install GlusterFS on both the hosts and setup a GlusterFS trusted storage
> pool using the 'gluster peer probe' commands. Run 'gluster peer probe
> gfs2' from node1 (and the reverse just for safety)
> - Create a GlusterFS volume, 'gluster volume create <VOLUMENAME>
> gfs1:<BRICKPATH> gfs2:<BRICKPATH>; and start it, 'gluster volume
start
> <VOLUMENAME>'.
> After this you'll have GlusterFS setup on the particular network and you'll
> have volume ready to be added as a oVirt storage domain.
To enable, oVirt to use the node1 interface, is it possible to peer
probe using node1 and node2 interface in steps above - i.e "gluster peer
probe node2" (This is essentially what happens when a host is added with
host address node1 or node2)
and then create a GlusterFS volume from CLI using the command you
mentioned above?
> - Now setup oVirt on the nodes with the node* network.
> - Add the gfs* network to oVirt. I'm not sure if this would be required,
> but you can try it anyway.
> - Add the created GlusterFS volume as a storage domain using a gfs*
> address.
>
> You should now be ready to begin using the new storage domain.
>
> If you would want to expand the volume later, you will need to do it
> manually with an explicit 'gluster volume add-brick' command.
>
> You could possible add the GlusterFS cluster to the oVirt interface, just
> so you can get stats and monitoring. But even then you shouldn't use the
> oVirt interface to do any management tasks.
>
> Multi-network support for GlusterFS within oVirt is an upcoming feature,
> and Sahina can give you more details on when to expect it to be available.
>
> Thanks,
> Kaushal
>
>
> ----- Original Message -----
>> From: "Sahina Bose" <sabose(a)redhat.com>
>> To: "Will K" <yetanotherwill(a)yahoo.com>, users(a)ovirt.org,
"Kaushal M"
>> <kaushal(a)redhat.com>
>> Sent: Friday, 9 January, 2015 11:10:48 AM
>> Subject: Re: [ovirt-users] Using gluster on other hosts?
>>
>>
>> On 01/08/2015 09:41 PM, Will K wrote:
>>> That's what I did, but didn't work for me.
>>>
>>> 1. use the 192.168.x interface to setup gluster. I used hostname in
>>> /etc/hosts.
>>> 2. setup oVirt using the switched network hostnames, let's say
10.10.10.x
>>> 3. oVirt and all that comes up fine.
>>> 4. When try to create a storage domain, it only shows the 10.10.10.x
>>> hostnames available.
>>>
>>>
>>> Tried to add a brick and I would get something like
>>> Host gfs2 is not in 'Peer in Cluster' state (while node2 is
the
>>> hostname and gfs2 is the 192.168 name)
>>
>> Which version of glusterfs do you have?
>>
>> Kaushal, will this work in glusterfs3.6 and above?
>>
>>
>>> Ran command `gluster probe peer gfs2` or `gluster probe peer
>>> 192.168.x.x` didn't work
>>> peer probe: failed: Probe returned with unknown errno 107
>>>
>>> Ran probe again with the switched network hostname or IP worked fine.
>>> May be it is not possible with current GlusterFS version?
>>>
http://www.gluster.org/community/documentation/index.php/Features/SplitNe...
>>>
>>>
>>> Will
>>>
>>>
>>> On Thursday, January 8, 2015 3:43 AM, Sahina Bose <sabose(a)redhat.com>
>>> wrote:
>>>
>>>
>>>
>>> On 01/08/2015 12:07 AM, Will K wrote:
>>>> Hi
>>>>
>>>> I would like to see if anyone has good suggestion.
>>>>
>>>> I have two physical hosts with 1GB connections to switched networks.
>>>> The hosts also have 10GB interface connected directly using Twinax
>>>> cable like copper crossover cable. The idea was to use the 10GB as a
>>>> "private network" for GlusterFS till the day we want to grow
out of
>>>> this 2 node setup.
>>>>
>>>> GlusterFS was setup with the 10GB ports using non-routable IPs and
>>>> hostnames in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2
>>>> 192.168.1.2. I'm following example from
>>>> community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/
>>>>
<http://community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/>
>>>> , Currently I'm only using Gluster volume on node1, but `gluster
>>>> probe peer` test worked fine with node2 through the 10GB connection.
>>>>
>>>> oVirt engine was setup on physical host1 with hosted engine. Now,
>>>> when I try to create new Gluster storage domain, I can only see the
>>>> host "node1" available.
>>>>
>>>> Is there anyway I can setup oVirt on node1 and node2, while using
>>>> "gfs1" and "gfs2" for GlusterFS? or some way to take
advantage of the
>>>> 10GB connection?
>>> If I understand right, you have 2 interfaces on each of your hosts,
>>> and you want oVirt to communicate via 1 interface and glusterfs to use
>>> other?
>>>
>>> While adding the hosts to oVirt you could use ip1 and then.while
>>> creating the volume, add the brick using the other ip address.
>>> For instance, gluster volume create <volname> 192.168.1.2:/bricks/b1
>>>
>>> Currently, there's no way to specify the IP address to use while
>>> adding a brick from oVirt UI (we're working on this for 3.6), but you
>>> could do this from the gluster CLI commands. This would then be
>>> detected in the oVirt UI.
>>>
>>>
>>>
>>>> Thanks
>>>> W
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Users mailing list
>>>> Users(a)ovirt.org <mailto:Users@ovirt.org>
>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>
>>>
>>
3605
days inactive
3607
days old
6 comments
3 participants
participants (3)
-
Kaushal M -
Sahina Bose -
Will K