7:40 a.m.
This is a multi-part message in MIME format.
--------------030607090108040002060307
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
[+ Nir, ovirt-users]
Nir,
Do you know of possible reasons for vdsm error while creating metadata
file? Operations from the mount point seem to work.
thanks
sahina
On 10/21/2015 05:37 AM, Brett Stevens wrote:
Hi Sahina.
Thanks for helping.
1. Tried the "optimize-for-virt" got a few info messages as expected.
2. tried new domain. I still get Error while executing action
AddGlusterFsStorageDomain: Error creating a storage domain's metadata.
If I manually mount the volume (mount -tglusterfs
sjcstorage04:/vmstore01 /tmp/mnt/) and check, I find that it mounts fine.
looking into the mount it seems to create the volume metadata ( or
partially, at least) as I see the domain dir. in this case,
__DIRECT_IO_TEST__e2e1b4eb-abbe-4427-887c-ee8f4d3f9060.
I just dont get it, this has been across many builds and tests. If
everyone else can mount gluster. I must be doing something
fundamentally wrong, though I don't know what,
thanks
Brett Stevens
On Tue, Oct 20, 2015 at 4:38 PM, Sahina Bose <sabose(a)redhat.com
<mailto:sabose@redhat.com>> wrote:
On 10/20/2015 10:13 AM, Ravishankar N wrote:
> Hi Sahina,
>
> Would you have any pointers on this? Brett is not able to attach
> gluster replicate volumes for storage using ovirt (distribute
> works fine though). Would VDSM logs help? Step-15 below has the
> error he is getting.
>
> Regards,
> Ravi
>
> On 10/20/2015 09:14 AM, Brett Stevens wrote:
>> Hi Ravi.
>>
>> Tried again with the latest 3.6 release candidate. I still have
>> the exact same problems. cannot add a glusterfs domain, (this
>> happens on simple 2 brick replicas as well as our desired 3
>> replica 1 arbiter volumes and distribute seems ok) yet if I ssh
>> into the given host and issue the command, mount -t glusterfs
>> ..... it mounts fine. Its also worth noting that I can create
>> simple replica gluster
>> I can provide logs again if you like, but I thought that given
>> I'm the only one with this issue, it would be worth checking on
>> my workflow first, I must be missing a step somewhere.
>>
>> The following steps are assuming Im building a simple 2 brick
>> replica using tcp
>>
>> 1 build generic host from centos 7 repo.
>> 2 add ovirt36 repo rpm
>> 3 install ovirt-engine-setup
>> 4 yum update, reboot
>> 5 selinux to disabled (would like to set this up later, but
>> removed for clarity)
>> 6 firewalld off
>> 7 engine setup
>> 8 login to console , change dc name and cluster name
>> 9 add hosts to a virt only compute cluster ( i switch off auto
>> firewall config for simplicity at the moment)
>> 10 create a gluster cluster and add hosts
>> 11 assume networking is all fine so far its the simple
>> ovirtmgmt and a single storage net all hosts are pingable on all
>> interfaces
>> 12 create brick dirs in /export/testshare/brick01 on both hosts
>> 13 chown -R 36:36 /export/ and check ls -lad
>> 14 from gui create volume use all defaults just add brick paths
>> to gui ok, creates volume no problems, use gui to start volume
>> (also have used gluster cli from host consoles)
Please click on "Optimize for virt store" on the created volume
(calling this even after starting the volume should be ok)
This is the only obvious missing step - but I'm thrown off by the
fact that distribute volume works for you.
>> 15 go to storage / add new domain. select gluserfs, name it,
>> take the default "use host" (its always the first in the compute
>> cluster as you would expect) leave all other defaults as is.
>> click ok and get "Error while executing action Add Storage
>> Connection: Internal Engine Error"
>> 16 check mount by ssh to the "use host" login and run mount -t
>> glusterfs host:/volume /rhvs-......../mnt and it will mount fine.
Is SELinux disabled on all the gluster nodes as well? Is firewalld
disabled on all gluster nodes too?
>>
>> again, the same result if I use an arbiter brick, or not. The
>> only gluster volume that works for me is distribute.
>>
>> to recap, I have the following status
>>
>> can manually mount glusterfs replica and distribute type volumes
>> on vhost server
>> can create domain using nfs (but backed by gluster volume) both
>> replica and distribute type volumes via ovirt gui
>> cab create domain using distribute type gluster volume in ovirt gui
>> cannot create domain using 2 node replicate type gluster volume
>> in ovirt gui
>> cannot create domain using4 node replicate type gluster volume
>> in ovirt gui
>> cannot create domain using 3 node replicate with arbiter 1 type
>> gluster volume in ovirt gui
>>
>>
>> could this be a version mismatch problem? I'm using only centos
>> repo and ovirt repos to build these hosts
>>
>>
>> thanks
>>
>> Brett Stevens
>>
>
--------------030607090108040002060307
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta content="text/html; charset=utf-8"
http-equiv="Content-Type">
</head>
<body text="#000000" bgcolor="#FFFFFF">
[+ Nir, ovirt-users]<br>
<br>
Nir,<br>
<br>
Do you know of possible reasons for vdsm error while creating
metadata file? Operations from the mount point seem to work.<br>
<br>
thanks<br>
sahina<br>
<br>
<br>
<div class="moz-cite-prefix">On 10/21/2015 05:37 AM, Brett Stevens
wrote:<br>
</div>
<blockquote
cite="mid:CAK02sjsK8WRzZv6n=j2zda0pFKvu21V0vAvR9RXGvWYxQBrLww@mail.gmail.com"
type="cite">
<div dir="ltr">Hi Sahina.
<div><br>
</div>
<div>Thanks for helping. </div>
<div><br>
</div>
<div>1. Tried the "optimize-for-virt" got a few info messages as
expected.</div>
<div>2. tried new domain. I still get <span
style="color:rgb(0,0,0);font-family:'Arial Unicode
MS',Arial,sans-serif;line-height:21.6667px">Error while
executing action AddGlusterFsStorageDomain: Error creating a
storage domain's metadata.</span></div>
<div><span style="color:rgb(0,0,0);font-family:'Arial Unicode
MS',Arial,sans-serif;line-height:21.6667px"><br>
</span></div>
<div><span style="color:rgb(0,0,0);font-family:'Arial Unicode
MS',Arial,sans-serif;line-height:21.6667px">If I manually
mount the volume (</span>mount -tglusterfs
sjcstorage04:/vmstore01 /tmp/mnt/) <span
style="color:rgb(0,0,0);font-family:'Arial Unicode
MS',Arial,sans-serif;line-height:21.6667px">and check, I
find that it mounts fine. </span></div>
<div><span style="color:rgb(0,0,0);font-family:'Arial Unicode
MS',Arial,sans-serif;line-height:21.6667px">looking into the
mount it seems to create the volume metadata ( or partially,
at least) as I see the domain dir. in this case, </span><span
class="">__DIRECT_IO_TEST__</span><span
class=""> </span><span
class="">e2e1b4eb-abbe-4427-887c-ee8f4d3f9060.</span></div>
<div><span class=""><br>
</span></div>
<div><span class="">I just dont get it, this has been
across
many builds and tests. If everyone else can mount gluster. I
must be doing something fundamentally wrong, though I don't
know what,</span></div>
<div><span class=""><br>
</span></div>
<div><span class="">thanks</span></div>
<div><span class=""><br>
</span></div>
<div><span class="">Brett Stevens</span></div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Tue, Oct 20, 2015 at 4:38 PM, Sahina
Bose <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:sabose@redhat.com"
target="_blank">sabose(a)redhat.com</a>&gt;</span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF"><span
class=""> <br>
<br>
<div>On 10/20/2015 10:13 AM, Ravishankar N wrote:<br>
</div>
<blockquote type="cite"> Hi Sahina,<br>
<br>
Would you have any pointers on this? Brett is not able
to attach gluster replicate volumes for storage using
ovirt (distribute works fine though). Would VDSM logs
help? Step-15 below has the error he is getting.<br>
<br>
Regards,<br>
Ravi<br>
<div><br>
On 10/20/2015 09:14 AM, Brett Stevens wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">Hi Ravi.
<div><br>
</div>
<div>Tried again with the latest 3.6 release
candidate. I still have the exact same problems.
cannot add a glusterfs domain, (this happens on
simple 2 brick replicas as well as our desired 3
replica 1 arbiter volumes and distribute seems
ok) yet if I ssh into the given host and issue
the command, mount -t glusterfs ..... it mounts
fine. Its also worth noting that I can create
simple replica gluster</div>
<div>I can provide logs again if you like, but I
thought that given I'm the only one with this
issue, it would be worth checking on my workflow
first, I must be missing a step somewhere.</div>
<div><br>
</div>
<div>The following steps are assuming Im building
a simple 2 brick replica using tcp </div>
<div><br>
</div>
<div>1 build generic host from centos 7 repo.</div>
<div>2 add ovirt36 repo rpm</div>
<div>3 install ovirt-engine-setup </div>
<div>4 yum update, reboot</div>
<div>5 selinux to disabled (would like to set this
up later, but removed for clarity)</div>
<div>6 firewalld off</div>
<div>7 engine setup</div>
<div>8 login to console , change dc name and
cluster name</div>
<div>9 add hosts to a virt only compute cluster (
i switch off auto firewall config for simplicity
at the moment)</div>
<div>10 create a gluster cluster and add hosts </div>
<div>11 assume networking is all fine so far its
the simple ovirtmgmt and a single storage net
all hosts are pingable on all interfaces </div>
<div>12 create brick dirs in
/export/testshare/brick01 on both hosts</div>
<div>13 chown -R 36:36 /export/ and check ls -lad</div>
<div>14 from gui create volume use all defaults
just add brick paths to gui ok, creates volume
no problems, use gui to start volume (also have
used gluster cli from host consoles)</div>
</div>
</blockquote>
</blockquote>
<br>
</span> Please click on "Optimize for virt store" on the
created volume (calling this even after starting the
volume should be ok)<br>
This is the only obvious missing step - but I'm thrown off
by the fact that distribute volume works for you.<span
class=""><br>
<br>
<blockquote type="cite">
<blockquote type="cite">
<div dir="ltr">
<div>15 go to storage / add new domain. select
gluserfs, name it, take the default "use host"
(its always the first in the compute cluster as
you would expect) leave all other defaults as
is. click ok and get "<span>Error while
executing action Add Storage Connection:
Internal Engine Error"</span></div>
<div>16 check mount by ssh to the "use host" login
and run mount -t glusterfs host:/volume
/rhvs-......../mnt and it will mount fine.</div>
</div>
</blockquote>
</blockquote>
<br>
</span> Is SELinux disabled on all the gluster nodes as
well? Is firewalld disabled on all gluster nodes too?<span
class=""><br>
<br>
<br>
<blockquote type="cite">
<blockquote type="cite">
<div dir="ltr">
<div><br>
</div>
<div>again, the same result if I use an arbiter
brick, or not. The only gluster volume that
works for me is distribute. <br>
</div>
<div><br>
</div>
<div>to recap, I have the following status</div>
<div><br>
</div>
<div>can manually mount glusterfs replica and
distribute type volumes on vhost server</div>
<div>can create domain using nfs (but backed by
gluster volume) both replica and distribute type
volumes via ovirt gui </div>
<div>cab create domain using distribute type
gluster volume in ovirt gui</div>
<div>cannot create domain using 2 node replicate
type gluster volume in ovirt gui </div>
<div>cannot create domain using4 node replicate
type gluster volume in ovirt gui <br>
</div>
<div>cannot create domain using 3 node replicate
with arbiter 1 type gluster volume in ovirt
gui <br>
</div>
<div><br>
</div>
<div><br>
</div>
<div>could this be a version mismatch problem?
I'm using only centos repo and ovirt repos to
build these hosts</div>
<div><br>
</div>
<div><br>
</div>
<div>thanks</div>
<div><br>
</div>
<div>Brett Stevens</div>
<div><br>
</div>
</div>
</blockquote>
<br>
</blockquote>
<br>
</span></div>
</blockquote>
</div>
<br>
</div>
</blockquote>
<br>
</body>
</html>
--------------030607090108040002060307--
3356
days inactive
3356
days old
0 comments
1 participants
participants (1)
-
Sahina Bose