Re: [ovirt-users] Using gluster on other hosts?

9 Jan 2015


      This is a multi-part message in MIME format.
--------------080504040204070206050806
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit


On 01/08/2015 09:41 PM, Will K wrote:
...
That's what I did, but didn't work for me.
1. use the 192.168.x interface to setup gluster. I used hostname in 
/etc/hosts.
2. setup oVirt using the switched network hostnames, let's say 10.10.10.x
3. oVirt and all that comes up fine.
4. When try to create a storage domain, it only shows the 10.10.10.x 
hostnames available.
Tried to add a brick and I would get something like
    Host gfs2 is not in 'Peer in Cluster' state  (while node2 is the 
hostname and gfs2 is the 192.168 name)
Which version of glusterfs do you have?

Kaushal, will this work in glusterfs3.6 and above?
...
Ran command `gluster probe peer gfs2` or `gluster probe peer 
192.168.x.x` didn't work
    peer probe: failed: Probe returned with unknown errno 107
Ran probe again with the switched network hostname or IP worked fine. 
May be it is not possible with current GlusterFS version?
http://www.gluster.org/community/documentation/index.php/Features/SplitNetwo...
Will
On Thursday, January 8, 2015 3:43 AM, Sahina Bose <sabose@redhat.com> 
wrote:
On 01/08/2015 12:07 AM, Will K wrote:
...
Hi
I would like to see if anyone has good suggestion.
I have two physical hosts with 1GB connections to switched networks. 
The hosts also have 10GB interface connected directly using Twinax 
cable like copper crossover cable.  The idea was to use the 10GB as a 
"private network" for GlusterFS till the day we want to grow out of 
this 2 node setup.
GlusterFS was setup with the 10GB ports using non-routable IPs and 
hostnames in /etc/hosts, for example, gfs1 192.168.1.1 and gfs2 
192.168.1.2.  I'm following example from 
community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/ 
<http://community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/> 
, Currently I'm only using Gluster volume on node1, but `gluster 
probe peer` test worked fine with node2 through the 10GB connection.
oVirt engine was setup on physical host1 with hosted engine.  Now, 
when I try to create new Gluster storage domain, I can only see the 
host "node1" available.
Is there anyway I can setup oVirt on node1 and node2, while using 
"gfs1" and "gfs2" for GlusterFS? or some way to take advantage of the 
10GB connection?
If I understand right, you have 2 interfaces on each of your hosts, 
and you want oVirt to communicate via 1 interface and glusterfs to use 
other?
While adding the hosts to oVirt you could use ip1 and then.while 
creating the volume, add the brick using the other ip address.
For instance, gluster volume create <volname> 192.168.1.2:/bricks/b1
Currently, there's no way to specify the IP address to use while 
adding a brick from oVirt UI (we're working on this for 3.6), but you 
could do this from the gluster CLI commands. This would then be 
detected in the oVirt UI.
...
Thanks
W
_______________________________________________
Users mailing list
Users@ovirt.org  <mailto:Users@ovirt.org>
http://lists.ovirt.org/mailman/listinfo/users
--------------080504040204070206050806
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: 8bit

<html>
  <head>
    <meta content="text/html; charset=UTF-8" http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <br>
    <div class="moz-cite-prefix">On 01/08/2015 09:41 PM, Will K wrote:<br>
    </div>
    <blockquote
cite="mid:659925230.234547.1420733510302.JavaMail.yahoo@jws106117.mail.bf1.yahoo.com"
      type="cite">
      <div style="color:#000; background-color:#fff;
        font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial,
        Lucida Grande, sans-serif;font-size:16px">
        <div id="yui_3_16_0_1_1420731722326_24172">That's what I did,
          but didn't work for me.</div>
        <div id="yui_3_16_0_1_1420731722326_23314"><br>
        </div>
        <div id="yui_3_16_0_1_1420731722326_23315" dir="ltr">1. use the
          192.168.x interface to setup gluster. I used hostname in
          /etc/hosts.</div>
        <div id="yui_3_16_0_1_1420731722326_23556" dir="ltr">2. setup
          oVirt using the switched network hostnames, let's say
          10.10.10.x</div>
        <div id="yui_3_16_0_1_1420731722326_23557" dir="ltr">3. oVirt
          and all that comes up fine.</div>
        <div id="yui_3_16_0_1_1420731722326_23558" dir="ltr">4. When try
          to create a storage domain, it only shows the 10.10.10.x
          hostnames available.</div>
        <div id="yui_3_16_0_1_1420731722326_23559" dir="ltr"><br>
        </div>
        <div id="yui_3_16_0_1_1420731722326_24161" dir="ltr"><br>
        </div>
        <div id="yui_3_16_0_1_1420731722326_24174" dir="ltr">Tried to
          add a brick and I would get something like</div>
        <div id="yui_3_16_0_1_1420731722326_24181" dir="ltr">    Host
          gfs2 is not in 'Peer in Cluster' state  (while node2 is the
          hostname and gfs2 is the 192.168 name)</div>
      </div>
    </blockquote>
    <br>
    <br>
    Which version of glusterfs do you have?<br>
    <br>
    Kaushal, will this work in glusterfs3.6 and above?<br>
    <br>
    <br>
    <blockquote
cite="mid:659925230.234547.1420733510302.JavaMail.yahoo@jws106117.mail.bf1.yahoo.com"
      type="cite">
      <div style="color:#000; background-color:#fff;
        font-family:HelveticaNeue, Helvetica Neue, Helvetica, Arial,
        Lucida Grande, sans-serif;font-size:16px">
        <div id="yui_3_16_0_1_1420731722326_24182" dir="ltr"><br>
        </div>
        <div id="yui_3_16_0_1_1420731722326_24797" dir="ltr">Ran command
          `gluster probe peer gfs2` or `gluster probe peer 192.168.x.x`
          didn't work</div>
        <div id="yui_3_16_0_1_1420731722326_24799" dir="ltr">    peer
          probe: failed: Probe returned with unknown errno 107</div>
        <div id="yui_3_16_0_1_1420731722326_25534" dir="ltr"><br>
        </div>
        <div id="yui_3_16_0_1_1420731722326_25535" dir="ltr">Ran probe
          again with the switched network hostname or IP worked fine.
          May be it is not possible with current GlusterFS version?  <br>
        </div>
        <div id="yui_3_16_0_1_1420731722326_27037" dir="ltr"><a
            moz-do-not-send="true" id="yui_3_16_0_1_1420731722326_27036"
href="http://www.gluster.org/community/documentation/index.php/Features/SplitNetwork">http://www.gluster.org/community/documentation/index.php/Features/SplitNetwork</a><br>
        </div>
        <div id="yui_3_16_0_1_1420731722326_24183" dir="ltr"><br>
        </div>
        <div id="yui_3_16_0_1_1420731722326_23313"><br>
          <span></span></div>
        <div id="yui_3_16_0_1_1420731722326_27835" dir="ltr"><span>Will</span></div>
        <div class="qtdSeparateBR"><br>
          <br>
        </div>
        <div style="display: block;" class="yahoo_quoted">
          <div style="font-family: HelveticaNeue, Helvetica Neue,
            Helvetica, Arial, Lucida Grande, sans-serif; font-size:
            16px;">
            <div style="font-family: HelveticaNeue, Helvetica Neue,
              Helvetica, Arial, Lucida Grande, sans-serif; font-size:
              16px;">
              <div dir="ltr"> <font face="Arial" size="2"> On Thursday,
                  January 8, 2015 3:43 AM, Sahina Bose
                  <a class="moz-txt-link-rfc2396E" href="mailto:sabose@redhat.com"><sabose@redhat.com></a> wrote:<br>
                </font> </div>
              <br>
              <br>
              <div class="y_msg_container">
                <div id="yiv9327153920">
                  <div> <br clear="none">
                    <div class="yiv9327153920moz-cite-prefix">On
                      01/08/2015 12:07 AM, Will K wrote:<br clear="none">
                    </div>
                    <blockquote type="cite">
                      <div
                        style="color:#000;background-color:#fff;font-family:HelveticaNeue,
                        Helvetica Neue, Helvetica, Arial, Lucida Grande,
                        sans-serif;font-size:16px;">
                        <div
                          id="yiv9327153920yui_3_16_0_1_1420578468148_131800">Hi</div>
                        <div dir="ltr"
                          id="yiv9327153920yui_3_16_0_1_1420578468148_131799"><br
                            clear="none">
                        </div>
                        <div dir="ltr">I would like to see if anyone has
                          good suggestion.</div>
                        <div dir="ltr"
                          id="yiv9327153920yui_3_16_0_1_1420578468148_133155"><br
                            clear="none">
                        </div>
                        <div dir="ltr"
                          id="yiv9327153920yui_3_16_0_1_1420578468148_132431">I
                          have two physical hosts with 1GB connections
                          to switched networks. The hosts also have 10GB
                          interface connected directly using Twinax
                          cable like copper crossover cable.  The idea
                          was to use the 10GB as a "private network" for
                          GlusterFS till the day we want to grow out of
                          this 2 node setup.<br clear="none">
                        </div>
                        <div
                          id="yiv9327153920yui_3_16_0_1_1420578468148_133145"><br
                            clear="none">
                        </div>
                        <div dir="ltr"
                          id="yiv9327153920yui_3_16_0_1_1420578468148_133144">GlusterFS

                          was setup with the 10GB ports using
                          non-routable IPs and hostnames in /etc/hosts,
                          for example, gfs1 192.168.1.1 and gfs2
                          192.168.1.2.  I'm following example from <a
                            moz-do-not-send="true" rel="nofollow"
                            shape="rect"
                            id="yiv9327153920yui_3_16_0_1_1420578468148_133153"
                            target="_blank"
href="http://community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/">community.redhat.com/blog/2014/10/up-and-running-with-ovirt-3-5/</a>
                          , Currently I'm only using Gluster volume on
                          node1, but `gluster probe peer` test worked
                          fine with node2 through the 10GB connection.<br
                            clear="none">
                        </div>
                        <div class="yiv9327153920" dir="ltr"
                          id="yiv9327153920yui_3_16_0_1_1420578468148_132429"
                          style=""><br clear="none">
                        </div>
                        <div class="yiv9327153920" dir="ltr"
                          id="yiv9327153920yui_3_16_0_1_1420578468148_132427"
                          style="">oVirt engine was setup on physical
                          host1 with hosted engine.  Now, when I try to
                          create new Gluster storage domain, I can only
                          see the host "node1" available. <br
                            clear="none">
                        </div>
                        <div class="yiv9327153920" dir="ltr"
                          id="yiv9327153920yui_3_16_0_1_1420578468148_133151"
                          style=""><br clear="none">
                        </div>
                        <div class="yiv9327153920" dir="ltr"
                          id="yiv9327153920yui_3_16_0_1_1420578468148_133150"
                          style="">Is there anyway I can setup oVirt on
                          node1 and node2, while using "gfs1" and "gfs2"
                          for GlusterFS? or some way to take advantage
                          of the 10GB connection?<br clear="none">
                        </div>
                      </div>
                    </blockquote>
                    <br clear="none">
                    If I understand right, you have 2 interfaces on each
                    of your hosts, and you want oVirt to communicate via
                    1 interface and glusterfs to use other?<br
                      clear="none">
                    <br clear="none">
                    While adding the hosts to oVirt you could use ip1
                    and then.while creating the volume, add the brick
                    using the other ip address. <br clear="none">
                    For instance, gluster volume create <volname>
                    192.168.1.2:/bricks/b1 <br clear="none">
                    <br clear="none">
                    Currently, there's no way to specify the IP address
                    to use while adding a brick from oVirt UI (we're
                    working on this for 3.6), but you could do this from
                    the gluster CLI commands. This would then be
                    detected in the oVirt UI.
                    <div class="yiv9327153920yqt6792848451"
                      id="yiv9327153920yqtfd09444"><br clear="none">
                      <br clear="none">
                      <br clear="none">
                    </div>
                    <blockquote type="cite">
                      <div class="yiv9327153920yqt6792848451"
                        id="yiv9327153920yqtfd00291"> </div>
                      <div
                        style="color:#000;background-color:#fff;font-family:HelveticaNeue,
                        Helvetica Neue, Helvetica, Arial, Lucida Grande,
                        sans-serif;font-size:16px;">
                        <div class="yiv9327153920yqt6792848451"
                          id="yiv9327153920yqtfd24136">
                          <div class="yiv9327153920" dir="ltr"
                            id="yiv9327153920yui_3_16_0_1_1420578468148_131852"
                            style=""><br clear="none">
                          </div>
                          <div class="yiv9327153920" dir="ltr"
                            id="yiv9327153920yui_3_16_0_1_1420578468148_133160"
                            style="">Thanks</div>
                        </div>
                        <div class="yiv9327153920" dir="ltr" style="">
                          <div class="yiv9327153920yqt6792848451"
                            id="yiv9327153920yqtfd62376">W</div>
                          <br class="yiv9327153920" style=""
                            clear="none">
                        </div>
                      </div>
                      <br clear="none">
                      <fieldset
                        class="yiv9327153920mimeAttachmentHeader"></fieldset>
                      <br clear="none">
                      <pre>_______________________________________________
Users mailing list
<a moz-do-not-send="true" rel="nofollow" shape="rect" class="yiv9327153920moz-txt-link-abbreviated" ymailto="mailto:Users@ovirt.org" target="_blank" href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a moz-do-not-send="true" rel="nofollow" shape="rect" class="yiv9327153920moz-txt-link-freetext" target="_blank" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a><div class="yiv9327153920yqt6792848451" id="yiv9327153920yqtfd41340">
</div></pre>
                      <div class="yiv9327153920yqt6792848451"
                        id="yiv9327153920yqtfd57425"> </div>
                    </blockquote>
                    <div class="yiv9327153920yqt6792848451"
                      id="yiv9327153920yqtfd63256"> <br clear="none">
                    </div>
                  </div>
                </div>
                <br>
                <br>
              </div>
            </div>
          </div>
        </div>
      </div>
    </blockquote>
    <br>
  </body>
</html>

--------------080504040204070206050806--