Re: [ovirt-users] Help understanding Gluster in oVirt

4 Mar 2015

      This is a multi-part message in MIME format.
--------------060306000905020403020700
Content-Type: text/plain; charset=windows-1252; format=flowed
Content-Transfer-Encoding: 8bit

I have setup an environment with 8 glustefs nodes in 
distributed+replicated mode. Instead of CTDB, I'm using keepalived. It 
works pretty well.

On 02/04/2015 04:14 PM, Donny Davis wrote:
...
I have two nodes running the hosted engine and gluster setup for 
replicate between them. Mounting to localhost seems to be working so 
far. I have live migrated the engine, pulled the plug on a running 
node, and rebooted each node to ensure it all works properly. I have 
had few issues with this setup. I didnt like ctdb because it adds 
another layer of complexity that is unnecessary for MY setup.
Node1 gluster drive on sdb
Node2 gluster drive on sdb
Both replicate and are the same make and model drive.
ovirt-ha running on both for hosted-engine
This setup is for hosted engine only, my actual storage for VMs and 
what not do not run in this fashion.
Hope This helps
Donny D
*From:*users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] *On 
Behalf Of *Groten, Ryan
*Sent:* Wednesday, February 4, 2015 10:11 AM
*To:* Sahina Bose; users@ovirt.org
*Subject:* Re: [ovirt-users] Help understanding Gluster in oVirt
Nope in fact I followed the guide and found CTDB works quite well.  I 
am just trying to figure out the benefit because that would be another 
component to consider in the architecture.
*From:*Sahina Bose [mailto:sabose@redhat.com]
*Sent:* Tuesday, February 03, 2015 4:09 AM
*To:* Groten, Ryan; users@ovirt.org <mailto:users@ovirt.org>
*Subject:* Re: [ovirt-users] Help understanding Gluster in oVirt
On 01/28/2015 08:59 AM, Groten, Ryan wrote:
I was planning on making a Gluster Data domain to test, and found
    some great information on this page:
    http://community.redhat.com/blog/2014/05/ovirt-3-4-glusterized/
The article the author uses the CTDB service for VIP failover.  Is
    it possible/recommended to not do this, and just create a gluster
    volume on all the hosts in a cluster, then create the Gluster data
    domain as localhost:<gluster_vol>?
Theoretically, it should work - if you make sure that you have a 
replica 3 gluster volume spread across 3 nodes, and these 3 nodes are 
your compute nodes as well - you should be fine without CTDB setup for 
failover and mounting as localhost.
But I've not tried this to recommend it. Maybe if others have tried 
it, they can chime in?
Btw, is there any reason you do not want to set up CTDB?
Thanks,
Ryan
ThTh
_______________________________________________
Users mailing list
Users@ovirt.org  <mailto:Users@ovirt.org>
http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--------------060306000905020403020700
Content-Type: text/html; charset=windows-1252
Content-Transfer-Encoding: 8bit

<html>
  <head>
    <meta content="text/html; charset=windows-1252"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    I have setup an environment with 8 glustefs nodes in
    distributed+replicated mode. <tt>Instead of CTDB, I'm using
      keepalived. It works pretty well.</tt><br>
    <br>
    <div class="moz-cite-prefix">On 02/04/2015 04:14 PM, Donny Davis
      wrote:<br>
    </div>
    <blockquote cite="mid:002b01d040a6$7432cee0$5c986ca0$@cloudspin.me"
      type="cite">
      <meta http-equiv="Content-Type" content="text/html;
        charset=windows-1252">
      <meta name="Generator" content="Microsoft Word 14 (filtered
        medium)">
      <style><!--
/* Font Definitions */
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
	{font-family:Tahoma;
	panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
	{font-family:Consolas;
	panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
	{font-family:"Century Gothic";
	panose-1:2 11 5 2 2 2 2 2 2 4;}
@font-face
	{font-family:"Century Gothic \, sans-serif";}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:12.0pt;
	font-family:"Times New Roman","serif";
	color:black;}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:purple;
	text-decoration:underline;}
pre
	{mso-style-priority:99;
	mso-style-link:"HTML Preformatted Char";
	margin:0in;
	margin-bottom:.0001pt;
	font-size:10.0pt;
	font-family:"Courier New";
	color:black;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
	{mso-style-priority:99;
	mso-style-link:"Balloon Text Char";
	margin:0in;
	margin-bottom:.0001pt;
	font-size:8.0pt;
	font-family:"Tahoma","sans-serif";
	color:black;}
span.HTMLPreformattedChar
	{mso-style-name:"HTML Preformatted Char";
	mso-style-priority:99;
	mso-style-link:"HTML Preformatted";
	font-family:Consolas;
	color:black;}
span.EmailStyle19
	{mso-style-type:personal;
	font-family:"Century Gothic","sans-serif";
	color:windowtext;}
span.EmailStyle20
	{mso-style-type:personal;
	font-family:"Century Gothic","sans-serif";
	color:blue;}
span.EmailStyle21
	{mso-style-type:personal-reply;
	font-family:"Calibri","sans-serif";
	color:#1F497D;}
span.BalloonTextChar
	{mso-style-name:"Balloon Text Char";
	mso-style-priority:99;
	mso-style-link:"Balloon Text";
	font-family:"Tahoma","sans-serif";
	color:black;}
.MsoChpDefault
	{mso-style-type:export-only;
	font-size:10.0pt;}
@page WordSection1
	{size:8.5in 11.0in;
	margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
	{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
      <div class="WordSection1">
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I
            have two nodes running the hosted engine and gluster setup
            for replicate between them. Mounting to localhost seems to
            be working so far. I have live migrated the engine, pulled
            the plug on a running node, and rebooted each node to ensure
            it all works properly. I have had few issues with this
            setup. I didnt like ctdb because it adds another layer of
            complexity that is unnecessary for MY setup.<o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Node1
            gluster drive on sdb <o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Node2
            gluster drive on sdb<o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Both
            replicate and are the same make and model drive. <o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">ovirt-ha
            running on both for hosted-engine<o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">This
            setup is for hosted engine only, my actual storage for VMs
            and what not do not run in this fashion. <o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hope
            This helps<o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Donny
            D<o:p></o:p></span></p>
        <p class="MsoNormal"><span
style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
        <div>
          <div style="border:none;border-top:solid #B5C4DF
            1.0pt;padding:3.0pt 0in 0in 0in">
            <p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">
                <a class="moz-txt-link-abbreviated" href="mailto:users-bounces@ovirt.org">users-bounces@ovirt.org</a> [<a class="moz-txt-link-freetext" href="mailto:users-bounces@ovirt.org">mailto:users-bounces@ovirt.org</a>]
                <b>On Behalf Of </b>Groten, Ryan<br>
                <b>Sent:</b> Wednesday, February 4, 2015 10:11 AM<br>
                <b>To:</b> Sahina Bose; <a class="moz-txt-link-abbreviated" href="mailto:users@ovirt.org">users@ovirt.org</a><br>
                <b>Subject:</b> Re: [ovirt-users] Help understanding
                Gluster in oVirt<o:p></o:p></span></p>
          </div>
        </div>
        <p class="MsoNormal"><o:p> </o:p></p>
        <p class="MsoNormal"><span
            style="font-size:10.0pt;font-family:"Century
            Gothic","sans-serif";color:blue">Nope in fact
            I followed the guide and found CTDB works quite well.  I am
            just trying to figure out the benefit because that would be
            another component to consider in the architecture.<o:p></o:p></span></p>
        <p class="MsoNormal"><a moz-do-not-send="true"
            name="_MailEndCompose"></a><span
            style="font-size:10.0pt;font-family:"Century
            Gothic","sans-serif";color:blue"><o:p> </o:p></span></p>
        <div>
          <div style="border:none;border-top:solid #B5C4DF
            1.0pt;padding:3.0pt 0in 0in 0in">
            <p class="MsoNormal"><b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">From:</span></b><span
style="font-size:10.0pt;font-family:"Tahoma","sans-serif";color:windowtext">
                Sahina Bose [<a moz-do-not-send="true"
                  href="mailto:sabose@redhat.com">mailto:sabose@redhat.com</a>]
                <br>
                <b>Sent:</b> Tuesday, February 03, 2015 4:09 AM<br>
                <b>To:</b> Groten, Ryan; <a moz-do-not-send="true"
                  href="mailto:users@ovirt.org">users@ovirt.org</a><br>
                <b>Subject:</b> Re: [ovirt-users] Help understanding
                Gluster in oVirt<o:p></o:p></span></p>
          </div>
        </div>
        <p class="MsoNormal"><o:p> </o:p></p>
        <p class="MsoNormal"><o:p> </o:p></p>
        <div>
          <p class="MsoNormal">On 01/28/2015 08:59 AM, Groten, Ryan
            wrote:<o:p></o:p></p>
        </div>
        <blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
          <p class="MsoNormal"><span
              style="font-size:10.0pt;font-family:"Century Gothic
              \, sans-serif"">I was planning on making a Gluster
              Data domain to test, and found some great information on
              this page: <a moz-do-not-send="true"
                href="http://community.redhat.com/blog/2014/05/ovirt-3-4-glusterized/">http://community.redhat.com/blog/2014/05/ovirt-3-4-glusterized/</a></span><o:p></o:p></p>
          <p class="MsoNormal"><span
              style="font-size:10.0pt;font-family:"Century Gothic
              \, sans-serif"">The article the author uses the CTDB
              service for VIP failover.  Is it possible/recommended to
              not do this, and just create a gluster volume on all the
              hosts in a cluster, then create the Gluster data domain as
              localhost:<gluster_vol>?</span><o:p></o:p></p>
        </blockquote>
        <p class="MsoNormal" style="margin-bottom:12.0pt"><br>
          Theoretically, it should work - if you make sure that you have
          a replica 3 gluster volume spread across 3 nodes, and these 3
          nodes are your compute nodes as well - you should be fine
          without CTDB setup for failover and mounting as localhost.<br>
          <br>
          But I've not tried this to recommend it. Maybe if others have
          tried it, they can chime in?<br>
          <br>
          Btw, is there any reason you do not want to set up CTDB?<br>
          <br>
          <o:p></o:p></p>
        <p class="MsoNormal"><span
            style="font-size:10.0pt;font-family:"Century Gothic \,
            sans-serif""> </span><o:p></o:p></p>
        <p class="MsoNormal"><span
            style="font-size:10.0pt;font-family:"Century Gothic \,
            sans-serif"">Thanks,</span><o:p></o:p></p>
        <p class="MsoNormal"><span
            style="font-size:10.0pt;font-family:"Century Gothic \,
            sans-serif"">Ryan</span><o:p></o:p></p>
        <p class="MsoNormal" style="margin-bottom:12.0pt">ThTh<br>
          <br>
          <o:p></o:p></p>
        <pre>_______________________________________________<o:p></o:p></pre>
        <pre>Users mailing list<o:p></o:p></pre>
        <pre><a moz-do-not-send="true" href="mailto:Users@ovirt.org">Users@ovirt.org</a><o:p></o:p></pre>
        <pre><a moz-do-not-send="true" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a><o:p></o:p></pre>
        <p class="MsoNormal"><o:p> </o:p></p>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
Users mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a>
<a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a>
</pre>
    </blockquote>
    <br>
  </body>
</html>

--------------060306000905020403020700--

Re: [ovirt-users] Help understanding Gluster in oVirt

Eduardo Ramos