This is a multi-part message in MIME format. --------------030607090108040002060307 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit [+ Nir, ovirt-users] Nir, Do you know of possible reasons for vdsm error while creating metadata file? Operations from the mount point seem to work. thanks sahina On 10/21/2015 05:37 AM, Brett Stevens wrote:

Hi Sahina.

Thanks for helping.

1. Tried the "optimize-for-virt" got a few info messages as expected. 2. tried new domain. I still get Error while executing action AddGlusterFsStorageDomain: Error creating a storage domain's metadata.

If I manually mount the volume (mount -tglusterfs sjcstorage04:/vmstore01 /tmp/mnt/) and check, I find that it mounts fine. looking into the mount it seems to create the volume metadata ( or partially, at least) as I see the domain dir. in this case, __DIRECT_IO_TEST__e2e1b4eb-abbe-4427-887c-ee8f4d3f9060.

I just dont get it, this has been across many builds and tests. If everyone else can mount gluster. I must be doing something fundamentally wrong, though I don't know what,

thanks

Brett Stevens

On Tue, Oct 20, 2015 at 4:38 PM, Sahina Bose <sabose@redhat.com <mailto:sabose@redhat.com>> wrote:

On 10/20/2015 10:13 AM, Ravishankar N wrote:

...

Hi Sahina,

Would you have any pointers on this? Brett is not able to attach gluster replicate volumes for storage using ovirt (distribute works fine though). Would VDSM logs help? Step-15 below has the error he is getting.

Regards, Ravi

On 10/20/2015 09:14 AM, Brett Stevens wrote:

...

Hi Ravi.

Tried again with the latest 3.6 release candidate. I still have the exact same problems. cannot add a glusterfs domain, (this happens on simple 2 brick replicas as well as our desired 3 replica 1 arbiter volumes and distribute seems ok) yet if I ssh into the given host and issue the command, mount -t glusterfs ..... it mounts fine. Its also worth noting that I can create simple replica gluster I can provide logs again if you like, but I thought that given I'm the only one with this issue, it would be worth checking on my workflow first, I must be missing a step somewhere.

The following steps are assuming Im building a simple 2 brick replica using tcp

1 build generic host from centos 7 repo. 2 add ovirt36 repo rpm 3 install ovirt-engine-setup 4 yum update, reboot 5 selinux to disabled (would like to set this up later, but removed for clarity) 6 firewalld off 7 engine setup 8 login to console , change dc name and cluster name 9 add hosts to a virt only compute cluster ( i switch off auto firewall config for simplicity at the moment) 10 create a gluster cluster and add hosts 11 assume networking is all fine so far its the simple ovirtmgmt and a single storage net all hosts are pingable on all interfaces 12 create brick dirs in /export/testshare/brick01 on both hosts 13 chown -R 36:36 /export/ and check ls -lad 14 from gui create volume use all defaults just add brick paths to gui ok, creates volume no problems, use gui to start volume (also have used gluster cli from host consoles)

Please click on "Optimize for virt store" on the created volume (calling this even after starting the volume should be ok) This is the only obvious missing step - but I'm thrown off by the fact that distribute volume works for you.

...

...

15 go to storage / add new domain. select gluserfs, name it, take the default "use host" (its always the first in the compute cluster as you would expect) leave all other defaults as is. click ok and get "Error while executing action Add Storage Connection: Internal Engine Error" 16 check mount by ssh to the "use host" login and run mount -t glusterfs host:/volume /rhvs-......../mnt and it will mount fine.

Is SELinux disabled on all the gluster nodes as well? Is firewalld disabled on all gluster nodes too?

...

...

again, the same result if I use an arbiter brick, or not. The only gluster volume that works for me is distribute.

to recap, I have the following status

can manually mount glusterfs replica and distribute type volumes on vhost server can create domain using nfs (but backed by gluster volume) both replica and distribute type volumes via ovirt gui cab create domain using distribute type gluster volume in ovirt gui cannot create domain using 2 node replicate type gluster volume in ovirt gui cannot create domain using4 node replicate type gluster volume in ovirt gui cannot create domain using 3 node replicate with arbiter 1 type gluster volume in ovirt gui

could this be a version mismatch problem? I'm using only centos repo and ovirt repos to build these hosts

thanks

Brett Stevens

--------------030607090108040002060307 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=utf-8" http-equiv="Content-Type"> </head> <body text="#000000" bgcolor="#FFFFFF"> [+ Nir, ovirt-users]<br> <br> Nir,<br> <br> Do you know of possible reasons for vdsm error while creating metadata file? Operations from the mount point seem to work.<br> <br> thanks<br> sahina<br> <br> <br> <div class="moz-cite-prefix">On 10/21/2015 05:37 AM, Brett Stevens wrote:<br> </div> <blockquote cite="mid:CAK02sjsK8WRzZv6n=j2zda0pFKvu21V0vAvR9RXGvWYxQBrLww@mail.gmail.com" type="cite"> <div dir="ltr">Hi Sahina. <div><br> </div> <div>Thanks for helping. </div> <div><br> </div> <div>1. Tried the "optimize-for-virt" got a few info messages as expected.</div> <div>2. tried new domain. I still get <span style="color:rgb(0,0,0);font-family:'Arial Unicode MS',Arial,sans-serif;line-height:21.6667px">Error while executing action AddGlusterFsStorageDomain: Error creating a storage domain's metadata.</span></div> <div><span style="color:rgb(0,0,0);font-family:'Arial Unicode MS',Arial,sans-serif;line-height:21.6667px"><br> </span></div> <div><span style="color:rgb(0,0,0);font-family:'Arial Unicode MS',Arial,sans-serif;line-height:21.6667px">If I  manually mount the volume (</span>mount -tglusterfs sjcstorage04:/vmstore01 /tmp/mnt/) <span style="color:rgb(0,0,0);font-family:'Arial Unicode MS',Arial,sans-serif;line-height:21.6667px">and check, I find that it mounts fine. </span></div> <div><span style="color:rgb(0,0,0);font-family:'Arial Unicode MS',Arial,sans-serif;line-height:21.6667px">looking into the mount it seems to create the volume metadata ( or partially, at least) as  I see the domain dir. in this case, </span><span class="">__DIRECT_IO_TEST__</span><span class="">  </span><span class="">e2e1b4eb-abbe-4427-887c-ee8f4d3f9060.</span></div> <div><span class=""><br> </span></div> <div><span class="">I just dont get it, this has been across many builds and tests. If everyone else can mount gluster. I must be doing something fundamentally wrong, though I don't know what,</span></div> <div><span class=""><br> </span></div> <div><span class="">thanks</span></div> <div><span class=""><br> </span></div> <div><span class="">Brett Stevens</span></div> </div> <div class="gmail_extra"><br> <div class="gmail_quote">On Tue, Oct 20, 2015 at 4:38 PM, Sahina Bose <span dir="ltr"><<a moz-do-not-send="true" href="mailto:sabose@redhat.com" target="_blank">sabose@redhat.com</a>></span> wrote:<br> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div text="#000000" bgcolor="#FFFFFF"><span class=""> <br> <br> <div>On 10/20/2015 10:13 AM, Ravishankar N wrote:<br> </div> <blockquote type="cite"> Hi Sahina,<br> <br> Would you have any pointers on this? Brett is not able to attach gluster replicate volumes for storage using ovirt (distribute works fine though). Would VDSM logs help? Step-15 below has the error he is getting.<br> <br> Regards,<br> Ravi<br> <div><br> On 10/20/2015 09:14 AM, Brett Stevens wrote:<br> </div> <blockquote type="cite"> <div dir="ltr">Hi Ravi. <div><br> </div> <div>Tried again with the latest 3.6 release candidate. I still have the exact same problems. cannot add a glusterfs domain, (this happens on simple 2 brick replicas as well as our desired 3 replica 1 arbiter volumes and distribute seems ok) yet if I ssh into the given host and issue the command, mount -t glusterfs ..... it mounts fine. Its also worth noting that I can create simple replica gluster</div> <div>I can provide logs again if you like, but I thought that given I'm the only one with this issue, it would be worth checking on my workflow first, I must be missing a step somewhere.</div> <div><br> </div> <div>The following steps are assuming Im building a simple 2 brick replica using tcp </div> <div><br> </div> <div>1 build generic host from centos 7 repo.</div> <div>2 add ovirt36 repo rpm</div> <div>3 install ovirt-engine-setup </div> <div>4 yum update, reboot</div> <div>5 selinux to disabled (would like to set this up later, but removed for clarity)</div> <div>6 firewalld off</div> <div>7 engine setup</div> <div>8 login to console , change dc name and cluster name</div> <div>9 add hosts to a virt only compute cluster ( i switch off auto firewall config for simplicity at the moment)</div> <div>10 create a gluster cluster and add hosts </div> <div>11  assume networking is all fine so far its the simple ovirtmgmt and a single storage net all hosts are pingable on all interfaces </div> <div>12 create brick dirs in /export/testshare/brick01 on both hosts</div> <div>13 chown -R 36:36 /export/ and check ls -lad</div> <div>14 from gui create volume use all defaults just add brick paths to gui ok, creates volume no problems, use gui to start volume (also have used gluster cli from host consoles)</div> </div> </blockquote> </blockquote> <br> </span> Please click on  "Optimize for virt store" on the created volume (calling this even after starting the volume should be ok)<br> This is the only obvious missing step - but I'm thrown off by the fact that distribute volume works for you.<span class=""><br> <br> <blockquote type="cite"> <blockquote type="cite"> <div dir="ltr"> <div>15 go to storage / add new domain. select gluserfs, name it, take the default "use host" (its always the first in the compute cluster as you would expect) leave all other defaults as is. click ok and get "<span>Error while executing action Add Storage Connection: Internal Engine Error"</span></div> <div>16 check mount by ssh to the "use host" login and run mount -t glusterfs host:/volume /rhvs-......../mnt and it will mount fine.</div> </div> </blockquote> </blockquote> <br> </span> Is SELinux disabled on all the gluster nodes as well? Is firewalld disabled on all gluster nodes too?<span class=""><br> <br> <br> <blockquote type="cite"> <blockquote type="cite"> <div dir="ltr"> <div><br> </div> <div>again, the same result if I use an arbiter brick, or not. The only gluster volume that works for me is distribute. <br> </div> <div><br> </div> <div>to recap, I have the following status</div> <div><br> </div> <div>can manually mount glusterfs replica and distribute type volumes on vhost server</div> <div>can create domain using nfs (but backed by gluster volume) both replica and distribute type volumes via ovirt gui </div> <div>cab create domain using distribute type gluster volume in ovirt gui</div> <div>cannot create domain using 2 node replicate type gluster volume in ovirt gui </div> <div>cannot create domain using4 node replicate type gluster volume in ovirt gui <br> </div> <div>cannot create domain using 3 node replicate  with arbiter 1 type gluster volume in ovirt gui <br> </div> <div><br> </div> <div><br> </div> <div>could this be a version mismatch problem?  I'm using only centos repo and ovirt repos to build these hosts</div> <div><br> </div> <div><br> </div> <div>thanks</div> <div><br> </div> <div>Brett Stevens</div> <div><br> </div> </div> </blockquote> <br> </blockquote> <br> </span></div> </blockquote> </div> <br> </div> </blockquote> <br> </body> </html> --------------030607090108040002060307--