<html><head><meta http-equiv="Content-Type" content="text/html; charset=UTF-8" /></head><body style='font-size: 10pt; font-family: Verdana,Geneva,sans-serif'>
<p class="p1"><span class="s1">Hi</span></p>
<p class="p2"> </p>
<p class="p1"><span class="s1">Recently, i built a small oVirt platform with 2 dedicated servers and GlusterFS to synch the VM storage.</span></p>
<p class="p2"> </p>
<p class="p1"><span class="s1">oVirt Setup is simple:</span></p>
<p class="p2"> </p>
<p class="p1"><span class="s1">ovirt01 : Host Agent (VDSM) + oVirt Engine </span></p>
<p class="p1"><span class="s1">ovirt02 : Host Agent (VDSM)</span></p>
<p class="p2"> </p>
<p class="p1"><span class="s1">Version : </span></p>
<p class="p2"> </p>
<p class="p1"><span class="s1">ovirt-release35-005-1.noarch</span></p>
<p class="p1"><span class="s1">ovirt-engine-3.5.4.2-1.el7.centos.noarch</span></p>
<p class="p1"><span class="s1">vdsm-4.16.26-0.el7.centos.x86_64</span></p>
<p class="p1"><span class="s1">vdsm-gluster-4.16.26-0.el7.centos.noarch</span></p>
<p class="p1"><span class="s1">glusterfs-server-3.7.4-2.el7.x86_64</span></p>
<p class="p2"> </p>
<p class="p2"> </p>
<p class="p1"><span class="s1">GlusterFS Setup is simple, 2 bricks in replicate mode.</span></p>
<p class="p1"><span class="s1">It was done in shell; not using oVirt GUI, and then it was added in STORAGE as a new DOMAIN; Type:DATA GlusterFS V3</span></p>
<p class="p2"> </p>
<p class="p1"><span class="s1"># gluster volume info</span></p>
<p class="p2"> </p>
<p class="p1"><span class="s1">Volume Name: ovirt</span></p>
<p class="p1"><span class="s1">Type: Replicate</span></p>
<p class="p1"><span class="s1">Volume ID: 043d2d36-dc2c-4f75-9d28-96dbac25d07c</span></p>
<p class="p1"><span class="s1">Status: Started</span></p>
<p class="p1"><span class="s1">Number of Bricks: 1 x 2 = 2</span></p>
<p class="p1"><span class="s1">Transport-type: tcp</span></p>
<p class="p1"><span class="s1">Bricks:</span></p>
<p class="p1"><span class="s1">Brick1: ovirt01:/gluster/ovirt</span></p>
<p class="p1"><span class="s1">Brick2: ovirt02:/gluster/ovirt</span></p>
<p class="p1"><span class="s1">Options Reconfigured:</span></p>
<p class="p1"><span class="s1">performance.readdir-ahead: on</span></p>
<p class="p1"><span class="s1">nfs.disable: true</span></p>
<p class="p1"><span class="s1">auth.allow: IP_A, IP_B</span></p>
<p class="p1"><span class="s1">network.ping-timeout: 10</span></p>
<p class="p1"><span class="s1">storage.owner-uid: 36</span></p>
<p class="p1"><span class="s1">storage.owner-gid: 36</span></p>
<p class="p1"><span class="s1">server.allow-insecure: on</span></p>
<p class="p2"> </p>
<p class="p2"> </p>
<p class="p1"><span class="s1">the data are reachable on the 2 nodes through a moint point that oVirt created when i configured the Storage with the GUI:</span></p>
<p class="p2"> </p>
<p class="p1"><span class="s1">localhost:/ovirt 306G 216G 78G 74% /rhev/data-center/mnt/glusterSD/localhost:_ovirt</span></p>
<p class="p2"> </p>
<p class="p1"><span class="s1">I created 7 VM on this shared storage and all is working fine. I can do Live migration; all is working.</span></p>
<p class="p2"> </p>
<p class="p1"><span class="s1">But when i check /var/log/ovirt/engine.log on ovirt01, there are error in loop every 2 seconds:</span></p>
<p class="p2"> </p>
<p class="p1"><span class="s1">2015-10-11 17:29:50,971 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [34dbe5cf] START, GlusterVolumesListVDSCommand(HostName = ovirt02, HostId = 65a5bb5d-721f-4a4b-9e77-c4b9162c0aa6), log id: 41443b77</span></p>
<p class="p1"><span class="s1">2015-10-11 17:29:50,998 WARN [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturnForXmlRpc] (DefaultQuartzScheduler_Worker-29) [34dbe5cf] Could not add brick ovirt02:/gluster/ovirt to volume 043d2d36-dc2c-4f75-9d28-96dbac25d07c - server uuid 3c340e59-334f-4aa6-ad61-af2acaf3cad6 not found in cluster fb976d4f-de13-449b-93e8-600fcb59d4e6</span></p>
<p class="p1"><span class="s1">2015-10-11 17:29:50,999 INFO [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListVDSCommand] (DefaultQuartzScheduler_Worker-29) [34dbe5cf] FINISH, GlusterVolumesListVDSCommand, return: {043d2d36-dc2c-4f75-9d28-96dbac25d07c=org.ovirt.engine.core.common.businessentities.gluster.GlusterVolumeEntity@200ae0d1}, log id: 41443b77</span></p>
<p class="p1"><span class="s1">2015-10-11 17:29:51,001 WARN [org.ovirt.engine.core.bll.gluster.GlusterSyncJob] (DefaultQuartzScheduler_Worker-29) [34dbe5cf] Volume ovirt contains a apparently corrupt brick(s). Hence will not add it to engine at this point.</span></p>
<p class="p2"> </p>
<p class="p2"><span class="s1"></span>I played a lot with oVirt at first it was running on a single node; in Local Datacenter; then i added a second node, move the first host to a new datacenter; migrated the images VM etc; with some pain at some very moment and now all looks fine but i prefer to double check.</p>
<p class="p1"><span class="s1">So, i want to know if there is a real issue with ovirt/gluster setup that i don’t see, any info are welcome because i’m a bit worried to see these message in LOOP on the log.</span></p>
<p class="p2"> </p>
<p class="p1"><span class="s1">Thanks in advance;</span></p>
<p class="p2"> </p>
<p class="p1"><span class="s1">Regards</span></p>
<p class="p1"><span class="s1">Nico</span></p>
<div> </div>
</body></html>