Ovirt 3.6.6 on Centos 7.2 not using native gluster (gfapi)

30 May 2016

      This is a multi-part message in MIME format.
--------------AF66DE8F49B7941B791B002E
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit

Hello,

I set up 8 Hosts and self-hosted-engine running HA on 3 of them from
gluster replica 3 Volume. HA is working, I can set one host of the 3
configured for hosted-engine to maintenance and engine migrates to other
host. I did the hosted-engine --deploy with type gluster and my gluster
hosted storage is accessed as glusterfs.mydomain.de:/engine

I set up another gluster volume (distributed replicated 4x2=8) as Data
storage for my virtual machines which is accessible as
glusterfs.mydomain.de:/gv0.  ISO and Export Volume are defined from NFS
Server.

When I set up a VM on the gluster storage I expected it to run with
native gluster support. However if I dumpxml the libvirt machine
definition I've something like that in it's config:

[...]

    <disk type='file' device='disk' snapshot='no'>
      <driver name='qemu' type='raw' cache='none' error_policy='stop'
io='threads'/>
      <source
file='/rhev/data-center/00000001-0001-0001-0001-0000000000b9/5d99af76-33b5-47d8-99da-1f32413c7bb0/images/011ab08e-71af-4d5b-a6a8-9b843a10329e/3f71d6c7-9b6d-4872-abc6-01a2b3329656'/>
      <backingStore/>
      <target dev='vda' bus='virtio'/>
      <serial>011ab08e-71af-4d5b-a6a8-9b843a10329e</serial>
      <boot order='1'/>
      <alias name='virtio-disk0'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06'
function='0x0'/>
    </disk>

I expected to have something like this:
<disk type='network' device='disk'>
    <driver name='qemu' type='raw' cache='none' error_policy='stop'
io='threads'/>
          <source protocol='gluster'
name='gv0/5d99af76-33b5-47d8-99da-1f32413c7bb0/images/011ab08e-71af-4d5b-a6a8-9b843a10329e/3f71d6c7-9b6d-4872-abc6-01a2b3329656'>
          <host name='glusterfs.mydomain.de'/>
          </source>
  [...]

All hosts have vdsm-gluster gluster installed:
[root@microcloud21 libvirt]# yum list installed | grep vdsm-*
vdsm.noarch                           4.17.28-0.el7.centos       @ovirt-3.6
vdsm-cli.noarch                       4.17.28-0.el7.centos       @ovirt-3.6
vdsm-gluster.noarch                   4.17.28-0.el7.centos       @ovirt-3.6
vdsm-hook-hugepages.noarch            4.17.28-0.el7.centos       @ovirt-3.6
vdsm-hook-vmfex-dev.noarch            4.17.28-0.el7.centos       @ovirt-3.6
vdsm-infra.noarch                     4.17.28-0.el7.centos       @ovirt-3.6
vdsm-jsonrpc.noarch                   4.17.28-0.el7.centos       @ovirt-3.6
vdsm-python.noarch                    4.17.28-0.el7.centos       @ovirt-3.6
vdsm-xmlrpc.noarch                    4.17.28-0.el7.centos       @ovirt-3.6
vdsm-yajsonrpc.noarch                 4.17.28-0.el7.centos       @ovirt-3.6

How do I get my most wanted feature native gluster support running ?

-- 

*Ralf Schenk*
fon +49 (0) 24 05 / 40 83 70
fax +49 (0) 24 05 / 40 83 759
mail *rs@databay.de* <mailto:rs@databay.de>

*Databay AG*
Jens-Otto-Krag-Straße 11
D-52146 Würselen
*www.databay.de* <http://www.databay.de>

Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE 210844202
Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch Yavari, Dipl.-Kfm.
Philipp Hermanns
Aufsichtsratsvorsitzender: Klaus Scholzen (RA)

------------------------------------------------------------------------

--------------AF66DE8F49B7941B791B002E
Content-Type: multipart/related;
 boundary="------------0AF6A7E1F21AB119CC361D8D"

--------------0AF6A7E1F21AB119CC361D8D
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit

<html>
  <head>

    <meta http-equiv="content-type" content="text/html; charset=utf-8">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <p>Hello,<br>
    </p>
    <p>I set up 8 Hosts and self-hosted-engine running HA on 3 of them
      from gluster replica 3 Volume. HA is working, I can set one host
      of the 3 configured for hosted-engine to maintenance and engine
      migrates to other host. I did the hosted-engine --deploy with type
      gluster and my gluster hosted storage is accessed as
      glusterfs.mydomain.de:/engine<br>
    </p>
    <p>I set up another gluster volume (distributed replicated 4x2=8) as
      Data storage for my virtual machines which is accessible as
      glusterfs.mydomain.de:/gv0.  ISO and Export Volume are defined
      from NFS Server.</p>
    <p>When I set up a VM on the gluster storage I expected it to run
      with native gluster support. However if I dumpxml the libvirt
      machine definition I've something like that in it's config:</p>
    <p>[...]<br>
    </p>
    <p><tt>    <disk type='file' device='disk' snapshot='no'></tt><tt><br>
      </tt><tt>      <driver name='qemu' type='raw' cache='none'
        error_policy='stop' io='threads'/></tt><tt><br>
      </tt><tt>      <source
file='/rhev/data-center/00000001-0001-0001-0001-0000000000b9/5d99af76-33b5-47d8-99da-1f32413c7bb0/images/011ab08e-71af-4d5b-a6a8-9b843a10329e/3f71d6c7-9b6d-4872-abc6-01a2b3329656'/></tt><tt><br>
      </tt><tt>      <backingStore/></tt><tt><br>
      </tt><tt>      <target dev='vda' bus='virtio'/></tt><tt><br>
      </tt><tt>     
        <serial>011ab08e-71af-4d5b-a6a8-9b843a10329e</serial></tt><tt><br>
      </tt><tt>      <boot order='1'/></tt><tt><br>
      </tt><tt>      <alias name='virtio-disk0'/></tt><tt><br>
      </tt><tt>      <address type='pci' domain='0x0000' bus='0x00'
        slot='0x06' function='0x0'/></tt><tt><br>
      </tt><tt>    </disk></tt><br>
      <br>
    </p>
    I expected to have something like this:<br>
    <tt><disk type='network' device='disk'></tt><tt><br>
    </tt><tt>    <driver name='qemu' type='raw' cache='none'
      error_policy='stop' io='threads'/></tt><tt><br>
    </tt><tt>          <source protocol='gluster'
name='gv0/5d99af76-33b5-47d8-99da-1f32413c7bb0/images/011ab08e-71af-4d5b-a6a8-9b843a10329e/3f71d6c7-9b6d-4872-abc6-01a2b3329656'></tt><tt><br>
    </tt><tt>          <host name='glusterfs.mydomain.de'/></tt><tt><br>
    </tt><tt>          </source></tt><tt><br>
    </tt><tt>  [...]</tt><tt><br>
    </tt><br>
    All hosts have vdsm-gluster gluster installed:<br>
    <tt>[root@microcloud21 libvirt]# yum list installed | grep vdsm-*</tt><tt><br>
    </tt><tt>vdsm.noarch                          
      4.17.28-0.el7.centos       @ovirt-3.6</tt><tt><br>
    </tt><tt>vdsm-cli.noarch                      
      4.17.28-0.el7.centos       @ovirt-3.6</tt><tt><br>
    </tt><tt>vdsm-gluster.noarch                  
      4.17.28-0.el7.centos       @ovirt-3.6</tt><tt><br>
    </tt><tt>vdsm-hook-hugepages.noarch           
      4.17.28-0.el7.centos       @ovirt-3.6</tt><tt><br>
    </tt><tt>vdsm-hook-vmfex-dev.noarch           
      4.17.28-0.el7.centos       @ovirt-3.6</tt><tt><br>
    </tt><tt>vdsm-infra.noarch                    
      4.17.28-0.el7.centos       @ovirt-3.6</tt><tt><br>
    </tt><tt>vdsm-jsonrpc.noarch                  
      4.17.28-0.el7.centos       @ovirt-3.6</tt><tt><br>
    </tt><tt>vdsm-python.noarch                   
      4.17.28-0.el7.centos       @ovirt-3.6</tt><tt><br>
    </tt><tt>vdsm-xmlrpc.noarch                   
      4.17.28-0.el7.centos       @ovirt-3.6</tt><tt><br>
    </tt><tt>vdsm-yajsonrpc.noarch                
      4.17.28-0.el7.centos       @ovirt-3.6</tt><tt><br>
    </tt><br>
    How do I get my most wanted feature native gluster support running ?<br>
    <br>
    <div class="moz-signature">-- <br>
      <p>
      </p>
      <table border="0" cellpadding="0" cellspacing="0">
        <tbody>
          <tr>
            <td colspan="3"><img
                src="cid:part1.B7BA9679.E32DEC3A@databay.de" height="30"
                border="0" width="151"></td>
          </tr>
          <tr>
            <td valign="top"> <font face="Verdana, Arial, sans-serif"
                size="-1"><br>
                <b>Ralf Schenk</b><br>
                fon +49 (0) 24 05 / 40 83 70<br>
                fax +49 (0) 24 05 / 40 83 759<br>
                mail <a href="mailto:rs@databay.de"><font
                    color="#FF0000"><b>rs@databay.de</b></font></a><br>
              </font> </td>
            <td width="30"> </td>
            <td valign="top"> <font face="Verdana, Arial, sans-serif"
                size="-1"><br>
                <b>Databay AG</b><br>
                Jens-Otto-Krag-Straße 11<br>
                D-52146 Würselen<br>
                <a href="http://www.databay.de"><font color="#FF0000"><b>www.databay.de</b></font></a>
              </font> </td>
          </tr>
          <tr>
            <td colspan="3" valign="top"> <font face="Verdana, Arial,
                sans-serif" size="1"><br>
                Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE
                210844202<br>
                Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch
                Yavari, Dipl.-Kfm. Philipp Hermanns<br>
                Aufsichtsratsvorsitzender: Klaus Scholzen (RA) </font>
            </td>
          </tr>
        </tbody>
      </table>
      <hr color="#000000" noshade="noshade" size="1" width="100%">
    </div>
  </body>
</html>

--------------0AF6A7E1F21AB119CC361D8D
Content-Type: image/gif;
 name="logo_databay_email.gif"
Content-Transfer-Encoding: base64
Content-ID: <part1.B7BA9679.E32DEC3A@databay.de>
Content-Disposition: inline;
 filename="logo_databay_email.gif"

R0lGODlhlwAeAMQAAObm5v9QVf/R0oKBgfDw8NfX105MTLi3t/r6+sfHx/+rrf98gC0sLP8L
EhIQEKalpf/g4ZmYmHd2dmppaf8uNP/y8v8cIv+Ym//AwkE/P46NjRwbG11cXP8ABwUDA///
/yH5BAAAAAAALAAAAACXAB4AAAX/4CeOYnUJZKqubOu+cCzPNA0tVnfVfO//wGAKk+t0Ap+K
QMFUYCDCqHRKJVUWDaPRUsFktZ1G4AKtms9o1gKsFVS+7I5ll67bpd647hPQawNld4KDMQJF
bA07F35aFBiEkJEpfXEBjx8KjI0Vkp2DEIdaCySgFBShbEgrCQOtrq+uEQcALQewrQUjEbe8
rgkkD7y5KhMZB3drqSoVFQhdlHGXKQYe1dbX2BvHKwzY1RMiAN7j1xEjBeTmKeIeD3cYCxRf
FigvChRxFJwkBBvk5A7cpZhAjgGCDwn+kfslgto4CSoSehh2BwEEBQvowDAUR0EKdArHZTg4
4oDCXBFC/3qj9SEluZEpHnjYQFIGgpo1KgSasYjNKBImrzF4NaFbNgIjCGRQeIyVKwneOLzS
cLCAg38OWI4Y4GECgQcSOEwYcADnh6/FNjAwoGFYAQ0atI4AAFeEFwsLFLiJUQEfGH0kNGAD
x8+oNQdIRQg+7NCaOhIgD8sVgYADNsPVGI5YWjRqzQTdHDDIYHRDLokaUhCglkFEJi0NKJhl
0RP2TsvXUg88KiLBVWsZrF6DmMKlNYMqglqTik1guN8OBgAgkGCpB+L9ugK4iSCBvwEfECw1
kILrBpa1jVCQIQBRvbP+rlEcQVAoSevWyv6uhpwE12uEkQAAZucpVw1xIsjkgf8B863mQVYt
eQATCZYJZJ5WBfij2wfpHcEeHGG8Z+BMszVWDXkfKLhceJhBSAJ+1ThH32AfRFZNayNAtUFi
wFSTSwEHJIYAAQU84IADwyjIEALU9MchG+vFgIF7W2GDI2T7HfjBgNcgKQKMHmwjgnCSpeCb
ULRkdxhF1CDY40RjgmUAA/v1J5FAKW2gGSZscBFDMraNgJs1AYpAAGYP5jJoNQ4Y4Gh8jpFg
HH9mgbmWo1l6oA4C3Ygp6UwEIFBfNRtkMIBlKMLnAXgAXLWhXXH85EIFqMhGGZgDEKArABGA
ed0HI4bk5qgnprCYSt88B6dqS0FEEAMPJDCdCJYViur/B1BlwGMJqDTwnhqxJgUpo0ceOQ4D
0yEakpMm/jqCRMgWm2I1j824Y6vLvuuPjHnqOJkIgP6xzwp5sCFNsCFp88Gxh11lrjfDcNrc
CEx64/CD3iAHlQcMUEQXvcA+qBkBB4Q2X1CusjBlJdKMYAKI6g28MbKN5hJsBAXknHOwutn4
oFYqkpqAzjnPbE0u1PxmwAQGXLWBbvhuIIEGEnRjlAHO4SvhbCNAkwoGzEBwgV9U0lfu2WiX
OkDEGaCdKgl0nk2YkWdPOCDabvaGdkAftL1LlgwCM+7Tq11V71IO7LkM2XE0YAHMYMhqqK6U
V165CpaHukLmiXFO8XSVzzakX+UH6TrmAajPNxfqByTQec41AeBPvSwIALkmAnuiexCsca3C
BajgfsROuxcPA8kHQJX4DAIwjnsAvhsvfXHWKEwDAljg7sj03L9wwAQTxOWD2AE0YP75eCkw
cPfs+xACADs=
--------------0AF6A7E1F21AB119CC361D8D--

--------------AF66DE8F49B7941B791B002E--

Ralf Schenk

Yaniv Kaul

Ralf Schenk

Yaniv Kaul

tags

participants (2)