11 Oct
2015
11 Oct
'15
6:43 p.m.
--=_96b09eee02d72544a4bd8a6df3818a5b
Content-Transfer-Encoding: 7bit
Content-Type: text/plain; charset=US-ASCII
Hi
Recently, i built a small oVirt platform with 2 dedicated servers and
GlusterFS to synch the VM storage.
oVirt Setup is simple:
ovirt01 : Host Agent (VDSM) + oVirt Engine
ovirt02 : Host Agent (VDSM)
Version :
ovirt-release35-005-1.noarch
ovirt-engine-3.5.4.2-1.el7.centos.noarch
vdsm-4.16.26-0.el7.centos.x86_64
vdsm-gluster-4.16.26-0.el7.centos.noarch
glusterfs-server-3.7.4-2.el7.x86_64
GlusterFS Setup is simple, 2 bricks in replicate mode.
It was done in shell; not using oVirt GUI, and then it was added in
STORAGE as a new DOMAIN; Type:DATA GlusterFS V3
# gluster volume info
Volume Name: ovirt
Type: Replicate
Volume ID: 043d2d36-dc2c-4f75-9d28-96dbac25d07c
Status: Started
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: ovirt01:/gluster/ovirt
Brick2: ovirt02:/gluster/ovirt
Options Reconfigured:
performance.readdir-ahead: on
nfs.disable: true
auth.allow: IP_A, IP_B
network.ping-timeout: 10
storage.owner-uid: 36
storage.owner-gid: 36
server.allow-insecure: on
the data are reachable on the 2 nodes through a moint point that oVirt
created when i configured the Storage with the GUI:
localhost:/ovirt 306G 216G 78G 74%
/rhev/data-center/mnt/glusterSD/localhost:_ovirt
I created 7 VM on this shared storage and all is working fine. I can do
Live migration; all is working.
But when i check /var/log/ovirt/engine.log on ovirt01, there are error
in loop every 2 seconds:
2015-10-11 17:29:50,971 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand]
(DefaultQuartzScheduler_Worker-29) [34dbe5cf] START,
GlusterVolumesListVDSCommand(HostName = ovirt02, HostId =
65a5bb5d-721f-4a4b-9e77-c4b9162c0aa6), log id: 41443b77
2015-10-11 17:29:50,998 WARN
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturnForXmlRpc]
(DefaultQuartzScheduler_Worker-29) [34dbe5cf] Could not add brick
ovirt02:/gluster/ovirt to volume 043d2d36-dc2c-4f75-9d28-96dbac25d07c -
server uuid 3c340e59-334f-4aa6-ad61-af2acaf3cad6 not found in cluster
fb976d4f-de13-449b-93e8-600fcb59d4e6
2015-10-11 17:29:50,999 INFO
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand]
(DefaultQuartzScheduler_Worker-29) [34dbe5cf] FINISH,
GlusterVolumesListVDSCommand, return:
{043d2d36-dc2c-4f75-9d28-96dbac25d07c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@200ae0d1},
log id: 41443b77
2015-10-11 17:29:51,001 WARN
[org.ovirt.engine.core.bll.gluster.GlusterSyncJob]
(DefaultQuartzScheduler_Worker-29) [34dbe5cf] Volume ovirt contains a
apparently corrupt brick(s). Hence will not add it to engine at this
point.
I played a lot with oVirt at first it was running on a single node; in
Local Datacenter; then i added a second node, move the first host to a
new datacenter; migrated the images VM etc; with some pain at some very
moment and now all looks fine but i prefer to double check.
So, i want to know if there is a real issue with ovirt/gluster setup
that i don't see, any info are welcome because i'm a bit worried to see
these message in LOOP on the log.
Thanks in advance;
Regards
Nico
--=_96b09eee02d72544a4bd8a6df3818a5b
Content-Transfer-Encoding: quoted-printable
Content-Type: text/html; charset=UTF-8
<html><head><meta http-equiv=3D"Content-Type" content=3D"text/html; charset=
=3DUTF-8" /></head><body style=3D'font-size: 10pt; font-family: Verdana,Gen=
eva,sans-serif'>
<p class=3D"p1"><span class=3D"s1">Hi</span></p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1">Recently, i built a small oVirt platform=
with 2 dedicated servers and GlusterFS to synch the VM storage.</span=
></p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1">oVirt Setup is simple:</span></p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1">ovirt01 : Host Agent (VDSM) =
+ oVirt Engine </span></p>
<p class=3D"p1"><span class=3D"s1">ovirt02 : Host Agent (VDSM)</span>=
</p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1">Version : </span></p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1">ovirt-release35-005-1.noarch</span></p>
<p class=3D"p1"><span class=3D"s1">ovirt-engine-3.5.4.2-1.el7.centos.noarch=
</span></p>
<p class=3D"p1"><span class=3D"s1">vdsm-4.16.26-0.el7.centos.x86_64</span><=
/p>
<p class=3D"p1"><span class=3D"s1">vdsm-gluster-4.16.26-0.el7.centos.noarch=
</span></p>
<p class=3D"p1"><span class=3D"s1">glusterfs-server-3.7.4-2.el7.x86_64</spa=
n></p>
<p class=3D"p2"> </p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1">GlusterFS Setup is simple, 2 bricks in r=
eplicate mode.</span></p>
<p class=3D"p1"><span class=3D"s1">It was done in shell; not using oV=
irt GUI, and then it was added in STORAGE as a new DOMAIN; Type:DATA Gluste=
rFS V3</span></p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1"># gluster volume info</span></p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1">Volume Name: ovirt</span></p>
<p class=3D"p1"><span class=3D"s1">Type: Replicate</span></p>
<p class=3D"p1"><span class=3D"s1">Volume ID: 043d2d36-dc2c-4f75-9d28-96dba=
c25d07c</span></p>
<p class=3D"p1"><span class=3D"s1">Status: Started</span></p>
<p class=3D"p1"><span class=3D"s1">Number of Bricks: 1 x 2 =3D 2</span></p>
<p class=3D"p1"><span class=3D"s1">Transport-type: tcp</span></p>
<p class=3D"p1"><span class=3D"s1">Bricks:</span></p>
<p class=3D"p1"><span class=3D"s1">Brick1: ovirt01:/gluster/ovirt</span></p=
>
<p class=3D"p1"><span class=3D"s1">Brick2: ovirt02:/gluster/ovirt</span></p=
>
<p class=3D"p1"><span class=3D"s1">Options Reconfigured:</span></p>
<p class=3D"p1"><span class=3D"s1">performance.readdir-ahead: on</span></p>
<p class=3D"p1"><span class=3D"s1">nfs.disable: true</span></p>
<p class=3D"p1"><span class=3D"s1">auth.allow: IP_A, IP_B</span></p>
<p class=3D"p1"><span class=3D"s1">network.ping-timeout: 10</span></p>
<p class=3D"p1"><span class=3D"s1">storage.owner-uid: 36</span></p>
<p class=3D"p1"><span class=3D"s1">storage.owner-gid: 36</span></p>
<p class=3D"p1"><span class=3D"s1">server.allow-insecure: on</span></p>
<p class=3D"p2"> </p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1">the data are reachable on the 2 nodes th=
rough a moint point that oVirt created when i configured the Storage with t=
he GUI:</span></p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1">localhost:/ovirt &n=
bsp; 306G 216G 78G 74=
% /rhev/data-center/mnt/glusterSD/localhost:_ovirt</span></p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1">I created 7 VM on this shared storage an=
d all is working fine. I can do Live migration; all is working.</span></p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1">But when i check /var/log/ovirt/engine=
=2Elog on ovirt01, there are error in loop every 2 seconds:</span></p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1">2015-10-11 17:29:50,971 INFO [org=
=2Eovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (Defau=
ltQuartzScheduler_Worker-29) [34dbe5cf] START, GlusterVolumesListVDSCommand=
(HostName =3D ovirt02, HostId =3D 65a5bb5d-721f-4a4b-9e77-c4b9162c0aa6), lo=
g id: 41443b77</span></p>
<p class=3D"p1"><span class=3D"s1">2015-10-11 17:29:50,998 WARN [org=
=2Eovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturnForXmlRpc] (=
DefaultQuartzScheduler_Worker-29) [34dbe5cf] Could not add brick ovirt02:/g=
luster/ovirt to volume 043d2d36-dc2c-4f75-9d28-96dbac25d07c - server uuid 3=
c340e59-334f-4aa6-ad61-af2acaf3cad6 not found in cluster fb976d4f-de13-449b=
-93e8-600fcb59d4e6</span></p>
<p class=3D"p1"><span class=3D"s1">2015-10-11 17:29:50,999 INFO [org=
=2Eovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (Defau=
ltQuartzScheduler_Worker-29) [34dbe5cf] FINISH, GlusterVolumesListVDSComman=
d, return: {043d2d36-dc2c-4f75-9d28-96dbac25d07c=3Dorg.ovirt.engine.core.co=
mmon.businessentities.gluster.GlusterVolumeEntity@200ae0d1}, log id: 41443b=
77</span></p>
<p class=3D"p1"><span class=3D"s1">2015-10-11 17:29:51,001 WARN [org=
=2Eovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Wo=
rker-29) [34dbe5cf] Volume ovirt contains a apparently corrupt brick(s). He=
nce will not add it to engine at this point.</span></p>
<p class=3D"p2"> </p>
<p class=3D"p2"><span class=3D"s1"></span>I played a lot with oVirt at firs=
t it was running on a single node; in Local Datacenter; then i added a seco=
nd node, move the first host to a new datacenter; migrated the images VM et=
c; with some pain at some very moment and now all looks fine but i prefer t=
o double check.</p>
<p class=3D"p1"><span class=3D"s1">So, i want to know if there is a real is=
sue with ovirt/gluster setup that i don’t see, any info are welcome b=
ecause i’m a bit worried to see these message in LOOP on the log.</sp=
an></p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1">Thanks in advance;</span></p>
<p class=3D"p2"> </p>
<p class=3D"p1"><span class=3D"s1">Regards</span></p>
<p class=3D"p1"><span class=3D"s1">Nico</span></p>
<div> </div>
</body></html>
--=_96b09eee02d72544a4bd8a6df3818a5b--