oVirt 4.1.5 Finally GlusterFS via lbgfapi
This is a multi-part message in MIME format. --------------B58437AC11A9A7397FEA7AA8 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Dear List, finally its there : Ovirt VM's can use native gluster via libgfapi. I was able to start a vm on gluster after setting "engine-config -s LibgfApiSupported=true" This was the disk definition as seen by "virsh -r dumxml myvm" on the host <disk type='network' device='disk' snapshot='no'> <driver name='qemu' type='raw' cache='none' error_policy='stop' io='threads'/> <source protocol='gluster' name='gv0/5d99af76-33b5-47d8-99da-1f32413c7bb0/images/9c007b27-0ab7-4474-9317-a294fd04c65f/ba2dfe7f-bdcf-4680-878d-7d71272f3ffb'> <host name='mygluster.domain.de' port='0'/> </source> <backingStore/> <target dev='sda' bus='scsi'/> <serial>9c007b27-0ab7-4474-9317-a294fd04c65f</serial> <boot order='1'/> <alias name='scsi0-0-0-0'/> <address type='drive' controller='0' bus='0' target='0' unit='0'/> </disk> Responsiveness of VM is much better (already seen when Updateng OS Packages). But I'm not able to migrate the mashine live to another host in the cluster. Manager only states "Migration failed" I did this already years ago without management interface by only using libvirt commands on gluster. Why this is still not working ? Since gluster is a networked protocol I can't see any reason for it. I followed all the bugs like https://bugzilla.redhat.com/show_bug.cgi?id=1022961 since last year and saw them being worked on. Now I'm really disappointed. Running something like MySQL in a VM via gluster via FUSE is crap. :-( Not being able to migrate machines in an ovirt cluster is crap, too if one wants to stay current. A few VM's on my OVirt are running for ~200 days now while constantly upgrading to latest Ovirt Release. That needs live migration of course. Bye -- *Ralf Schenk* fon +49 (0) 24 05 / 40 83 70 fax +49 (0) 24 05 / 40 83 759 mail *rs@databay.de* <mailto:rs@databay.de> *Databay AG* Jens-Otto-Krag-Straße 11 D-52146 Würselen *www.databay.de* <http://www.databay.de> Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE 210844202 Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch Yavari, Dipl.-Kfm. Philipp Hermanns Aufsichtsratsvorsitzender: Wilhelm Dohmen ------------------------------------------------------------------------ --------------B58437AC11A9A7397FEA7AA8 Content-Type: multipart/related; boundary="------------DA582FD96C8238EF6DE4331D" --------------DA582FD96C8238EF6DE4331D Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </head> <body text="#000000" bgcolor="#FFFFFF"> <p><font face="Helvetica, Arial, sans-serif">Dear List,</font></p> <p><font face="Helvetica, Arial, sans-serif">finally its there : Ovirt VM's can use native gluster via libgfapi. I was able to start a vm on gluster after setting "engine-config -s LibgfApiSupported=true"</font></p> <p><font face="Helvetica, Arial, sans-serif">This was the disk definition as seen by "virsh -r dumxml myvm" on the host<br> </font></p> <p><tt> <disk type='network' device='disk' snapshot='no'><br> <driver name='qemu' type='raw' cache='none' error_policy='stop' io='threads'/><br> <source protocol='gluster' name='gv0/5d99af76-33b5-47d8-99da-1f32413c7bb0/images/9c007b27-0ab7-4474-9317-a294fd04c65f/ba2dfe7f-bdcf-4680-878d-7d71272f3ffb'><br> <host name='mygluster.domain.de' port='0'/><br> </source><br> <backingStore/><br> <target dev='sda' bus='scsi'/><br> <serial>9c007b27-0ab7-4474-9317-a294fd04c65f</serial><br> <boot order='1'/><br> <alias name='scsi0-0-0-0'/><br> <address type='drive' controller='0' bus='0' target='0' unit='0'/><br> </disk><br> </tt></p> <p>Responsiveness of VM is much better (already seen when Updateng OS Packages). <br> </p> <p>But I'm not able to migrate the mashine live to another host in the cluster. Manager only states "Migration failed"<br> </p> <p>I did this already years ago without management interface by only using libvirt commands on gluster. Why this is still not working ? <br> </p> <p>Since gluster is a networked protocol I can't see any reason for it.</p> <p>I followed all the bugs like <a class="moz-txt-link-freetext" href="https://bugzilla.redhat.com/show_bug.cgi?id=1022961">https://bugzilla.redhat.com/show_bug.cgi?id=1022961</a> since last year and saw them being worked on. <br> </p> <p>Now I'm really disappointed. Running something like MySQL in a VM via gluster via FUSE is crap. :-( <br> </p> <p>Not being able to migrate machines in an ovirt cluster is crap, too if one wants to stay current. A few VM's on my OVirt are running for ~200 days now while constantly upgrading to latest Ovirt Release. That needs live migration of course.</p> <p>Bye<br> </p> <p><br> </p> <p>-- <br> </p> <div class="moz-signature"> <p> </p> <table cellspacing="0" cellpadding="0" border="0"> <tbody> <tr> <td colspan="3"><img src="cid:part1.F9AADFA9.9AED5F9A@databay.de" height="30" width="151" border="0"></td> </tr> <tr> <td valign="top"> <font size="-1" face="Verdana, Arial, sans-serif"><br> <b>Ralf Schenk</b><br> fon +49 (0) 24 05 / 40 83 70<br> fax +49 (0) 24 05 / 40 83 759<br> mail <a href="mailto:rs@databay.de"><font color="#FF0000"><b>rs@databay.de</b></font></a><br> </font> </td> <td width="30"> </td> <td valign="top"> <font size="-1" face="Verdana, Arial, sans-serif"><br> <b>Databay AG</b><br> Jens-Otto-Krag-Straße 11<br> D-52146 Würselen<br> <a href="http://www.databay.de"><font color="#FF0000"><b>www.databay.de</b></font></a> </font> </td> </tr> <tr> <td colspan="3" valign="top"> <font size="1" face="Verdana, Arial, sans-serif"><br> Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE 210844202<br> Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch Yavari, Dipl.-Kfm. Philipp Hermanns<br> Aufsichtsratsvorsitzender: Wilhelm Dohmen </font> </td> </tr> </tbody> </table> <hr noshade="noshade" size="1" color="#000000" width="100%"> </div> </body> </html> --------------DA582FD96C8238EF6DE4331D Content-Type: image/gif; name="njflcbkljmdeehnc.gif" Content-Transfer-Encoding: base64 Content-ID: <part1.F9AADFA9.9AED5F9A@databay.de> Content-Disposition: inline; filename="njflcbkljmdeehnc.gif" R0lGODlhlwAeAMQAAObm5v9QVf/R0oKBgfDw8NfX105MTLi3t/r6+sfHx/+rrf98gC0sLP8L EhIQEKalpf/g4ZmYmHd2dmppaf8uNP/y8v8cIv+Ym//AwkE/P46NjRwbG11cXP8ABwUDA/// /yH5BAAAAAAALAAAAACXAB4AAAX/4CeOYnUJZKqubOu+cCzPNA0tVnfVfO//wGAKk+t0Ap+K QMFUYCDCqHRKJVUWDaPRUsFktZ1G4AKtms9o1gKsFVS+7I5ll67bpd647hPQawNld4KDMQJF bA07F35aFBiEkJEpfXEBjx8KjI0Vkp2DEIdaCySgFBShbEgrCQOtrq+uEQcALQewrQUjEbe8 rgkkD7y5KhMZB3drqSoVFQhdlHGXKQYe1dbX2BvHKwzY1RMiAN7j1xEjBeTmKeIeD3cYCxRf FigvChRxFJwkBBvk5A7cpZhAjgGCDwn+kfslgto4CSoSehh2BwEEBQvowDAUR0EKdArHZTg4 4oDCXBFC/3qj9SEluZEpHnjYQFIGgpo1KgSasYjNKBImrzF4NaFbNgIjCGRQeIyVKwneOLzS cLCAg38OWI4Y4GECgQcSOEwYcADnh6/FNjAwoGFYAQ0atI4AAFeEFwsLFLiJUQEfGH0kNGAD x8+oNQdIRQg+7NCaOhIgD8sVgYADNsPVGI5YWjRqzQTdHDDIYHRDLokaUhCglkFEJi0NKJhl 0RP2TsvXUg88KiLBVWsZrF6DmMKlNYMqglqTik1guN8OBgAgkGCpB+L9ugK4iSCBvwEfECw1 kILrBpa1jVCQIQBRvbP+rlEcQVAoSevWyv6uhpwE12uEkQAAZucpVw1xIsjkgf8B863mQVYt eQATCZYJZJ5WBfij2wfpHcEeHGG8Z+BMszVWDXkfKLhceJhBSAJ+1ThH32AfRFZNayNAtUFi wFSTSwEHJIYAAQU84IADwyjIEALU9MchG+vFgIF7W2GDI2T7HfjBgNcgKQKMHmwjgnCSpeCb ULRkdxhF1CDY40RjgmUAA/v1J5FAKW2gGSZscBFDMraNgJs1AYpAAGYP5jJoNQ4Y4Gh8jpFg HH9mgbmWo1l6oA4C3Ygp6UwEIFBfNRtkMIBlKMLnAXgAXLWhXXH85EIFqMhGGZgDEKArABGA ed0HI4bk5qgnprCYSt88B6dqS0FEEAMPJDCdCJYViur/B1BlwGMJqDTwnhqxJgUpo0ceOQ4D 0yEakpMm/jqCRMgWm2I1j824Y6vLvuuPjHnqOJkIgP6xzwp5sCFNsCFp88Gxh11lrjfDcNrc CEx64/CD3iAHlQcMUEQXvcA+qBkBB4Q2X1CusjBlJdKMYAKI6g28MbKN5hJsBAXknHOwutn4 oFYqkpqAzjnPbE0u1PxmwAQGXLWBbvhuIIEGEnRjlAHO4SvhbCNAkwoGzEBwgV9U0lfu2WiX OkDEGaCdKgl0nk2YkWdPOCDabvaGdkAftL1LlgwCM+7Tq11V71IO7LkM2XE0YAHMYMhqqK6U V165CpaHukLmiXFO8XSVzzakX+UH6TrmAajPNxfqByTQec41AeBPvSwIALkmAnuiexCsca3C BajgfsROuxcPA8kHQJX4DAIwjnsAvhsvfXHWKEwDAljg7sj03L9wwAQTxOWD2AE0YP75eCkw cPfs+xACADs= --------------DA582FD96C8238EF6DE4331D-- --------------B58437AC11A9A7397FEA7AA8--
Hello, nice to hear it worked for you. Attached you find the vdsm.log (from migration source) including the error and engine.log which looks ok. Hostnames/IP-Adresses are correct and use the ovirtmgmt Network. I checked (on both hosts): [root@microcloud22 glusterfs]# gluster volume get gv0 storage.owner-uid Option Value ------ ----- storage.owner-uid 36 [root@microcloud22 glusterfs]# gluster volume get gv0 storage.owner-gid Option Value ------ ----- storage.owner-gid 36 [root@microcloud22 glusterfs]# gluster volume get gv0 server.allow-insecure Option Value ------ ----- server.allow-insecure on and /etc/glusterd root@microcloud22 glusterfs]# cat /etc/glusterfs/glusterd.vol volume management type mgmt/glusterd option working-directory /var/lib/glusterd option transport-type socket option transport.socket.keepalive-time 10 option transport.socket.keepalive-interval 2 option transport.socket.read-fail-log off option ping-timeout 0 option event-threads 1 option rpc-auth-allow-insecure on # option transport.address-family inet6 # option base-port 49152 end-volume Bye Am 24.08.2017 um 15:25 schrieb Denis Chaplygin:
-- *Ralf Schenk* fon +49 (0) 24 05 / 40 83 70 fax +49 (0) 24 05 / 40 83 759 mail *rs@databay.de* <mailto:rs@databay.de> *Databay AG* Jens-Otto-Krag-Straße 11 D-52146 Würselen *www.databay.de* <http://www.databay.de> Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE 210844202 Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch Yavari, Dipl.-Kfm. Philipp Hermanns Aufsichtsratsvorsitzender: Wilhelm Dohmen ------------------------------------------------------------------------
Hello! On Thu, Aug 24, 2017 at 3:55 PM, Ralf Schenk <rs@databay.de> wrote:
Yes, most interesting part was in the vdsm log. Do you have anything interesting in gluster logs? And another one - can you try to run that vm (or some new vm with drives on the same SD) on the migration target host? Will it start?
On Thu, Aug 24, 2017 at 3:07 PM, Ralf Schenk <rs@databay.de> wrote:
[snip]
Based on official announcement here, it is a known problem: http://lists.ovirt.org/pipermail/users/2017-August/083771.html " Due to a known issue [6], using this will break live storage migration. This is expected to be fixed soon. If you do not use live storage migration you can give it a try. ... [6] https://bugzilla.redhat.com/show_bug.cgi?id=1306562 " I see that it is currently in ASSIGNED state with high priority and severity HIH, Gianluca
This is a multi-part message in MIME format. --------------CD22EF565BE0BA5CAAE23187 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Hello, I don't want to migrate a "storage domain" but a VM from Host to Host. Live migration of a storage domain migrates all the contents of a storage domain to another one, as I unterstand. Bye Am 24.08.2017 um 15:55 schrieb Gianluca Cecchi:
-- *Ralf Schenk* fon +49 (0) 24 05 / 40 83 70 fax +49 (0) 24 05 / 40 83 759 mail *rs@databay.de* <mailto:rs@databay.de> *Databay AG* Jens-Otto-Krag-Straße 11 D-52146 Würselen *www.databay.de* <http://www.databay.de> Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE 210844202 Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch Yavari, Dipl.-Kfm. Philipp Hermanns Aufsichtsratsvorsitzender: Wilhelm Dohmen ------------------------------------------------------------------------ --------------CD22EF565BE0BA5CAAE23187 Content-Type: multipart/related; boundary="------------E079D45EB869E201764E15F0" --------------E079D45EB869E201764E15F0 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> </head> <body text="#000000" bgcolor="#FFFFFF"> <p>Hello,</p> <p>I don't want to migrate a "storage domain" but a VM from Host to Host. Live migration of a storage domain migrates all the contents of a storage domain to another one, as I unterstand.<br> </p> <p>Bye<br> </p> <br> <div class="moz-cite-prefix">Am 24.08.2017 um 15:55 schrieb Gianluca Cecchi:<br> </div> <blockquote type="cite" cite="mid:CAG2kNCyM8oYmAFdOwb+1k5dkb7CfPwyBhh0d4i99DFB8z0NnsA@mail.gmail.com"> <div dir="ltr"><br> <div class="gmail_extra"><br> <div class="gmail_quote">On Thu, Aug 24, 2017 at 3:07 PM, Ralf Schenk <span dir="ltr"><<a href="mailto:rs@databay.de" target="_blank" moz-do-not-send="true">rs@databay.de</a>></span> wrote:<br> <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"> <div bgcolor="#FFFFFF"> <p><font face="Helvetica, Arial, sans-serif">Dear List,</font></p> <p><font face="Helvetica, Arial, sans-serif">finally its there : Ovirt VM's can use native gluster via libgfapi. I was able to start a vm on gluster after setting "engine-config -s LibgfApiSupported=true"</font></p> </div> </blockquote> <div><br> </div> <div>[snip] </div> <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"> <div bgcolor="#FFFFFF"> <p>But I'm not able to migrate the mashine live to another host in the cluster. Manager only states "Migration failed"<br> </p> <p>I did this already years ago without management interface by only using libvirt commands on gluster. Why this is still not working ? <br> </p> <p>Since gluster is a networked protocol I can't see any reason for it.</p> <p>I followed all the bugs like <a class="gmail-m_9148957272111669338moz-txt-link-freetext" href="https://bugzilla.redhat.com/show_bug.cgi?id=1022961" target="_blank" moz-do-not-send="true">https://bugzilla.redhat.com/<wbr>show_bug.cgi?id=1022961</a> since last year and saw them being worked on. <br> </p> </div> </blockquote> <div><br> </div> <div>Based on official announcement here, it is a known problem:</div> </div> </div> <div class="gmail_extra"><a href="http://lists.ovirt.org/pipermail/users/2017-August/083771.html" moz-do-not-send="true">http://lists.ovirt.org/pipermail/users/2017-August/083771.html</a><br> </div> <div class="gmail_extra"><br> </div> <div class="gmail_extra">"</div> <div class="gmail_extra"> <div class="gmail_extra">Due to a known issue [6], using this will break live storage migration.</div> <div class="gmail_extra">This is expected to be fixed soon. If you do not use live storage</div> <div class="gmail_extra">migration you can give it a try.</div> <div class="gmail_extra"><br> </div> <div class="gmail_extra">...</div> <div class="gmail_extra"><br> </div> <div class="gmail_extra">[6] <a href="https://bugzilla.redhat.com/show_bug.cgi?id=1306562" moz-do-not-send="true">https://bugzilla.redhat.com/show_bug.cgi?id=1306562</a><br> </div> <div class="gmail_extra">"</div> <div class="gmail_extra">I see that it is currently in ASSIGNED state with high priority and severity</div> <div class="gmail_extra"><br> </div> <div class="gmail_extra">HIH,</div> <div class="gmail_extra">Gianluca</div> <div class="gmail_extra"><br> </div> </div> </div> </blockquote> <br> <div class="moz-signature">-- <br> <p> </p> <table cellspacing="0" cellpadding="0" border="0"> <tbody> <tr> <td colspan="3"><img src="cid:part5.A8248672.8294524A@databay.de" height="30" width="151" border="0"></td> </tr> <tr> <td valign="top"> <font size="-1" face="Verdana, Arial, sans-serif"><br> <b>Ralf Schenk</b><br> fon +49 (0) 24 05 / 40 83 70<br> fax +49 (0) 24 05 / 40 83 759<br> mail <a href="mailto:rs@databay.de"><font color="#FF0000"><b>rs@databay.de</b></font></a><br> </font> </td> <td width="30"> </td> <td valign="top"> <font size="-1" face="Verdana, Arial, sans-serif"><br> <b>Databay AG</b><br> Jens-Otto-Krag-Straße 11<br> D-52146 Würselen<br> <a href="http://www.databay.de"><font color="#FF0000"><b>www.databay.de</b></font></a> </font> </td> </tr> <tr> <td colspan="3" valign="top"> <font size="1" face="Verdana, Arial, sans-serif"><br> Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE 210844202<br> Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch Yavari, Dipl.-Kfm. Philipp Hermanns<br> Aufsichtsratsvorsitzender: Wilhelm Dohmen </font> </td> </tr> </tbody> </table> <hr noshade="noshade" size="1" color="#000000" width="100%"> </div> </body> </html> --------------E079D45EB869E201764E15F0 Content-Type: image/gif; name="amohnmkcbelmbpfg.gif" Content-Transfer-Encoding: base64 Content-ID: <part5.A8248672.8294524A@databay.de> Content-Disposition: inline; filename="amohnmkcbelmbpfg.gif" R0lGODlhlwAeAMQAAObm5v9QVf/R0oKBgfDw8NfX105MTLi3t/r6+sfHx/+rrf98gC0sLP8L EhIQEKalpf/g4ZmYmHd2dmppaf8uNP/y8v8cIv+Ym//AwkE/P46NjRwbG11cXP8ABwUDA/// /yH5BAAAAAAALAAAAACXAB4AAAX/4CeOYnUJZKqubOu+cCzPNA0tVnfVfO//wGAKk+t0Ap+K QMFUYCDCqHRKJVUWDaPRUsFktZ1G4AKtms9o1gKsFVS+7I5ll67bpd647hPQawNld4KDMQJF bA07F35aFBiEkJEpfXEBjx8KjI0Vkp2DEIdaCySgFBShbEgrCQOtrq+uEQcALQewrQUjEbe8 rgkkD7y5KhMZB3drqSoVFQhdlHGXKQYe1dbX2BvHKwzY1RMiAN7j1xEjBeTmKeIeD3cYCxRf FigvChRxFJwkBBvk5A7cpZhAjgGCDwn+kfslgto4CSoSehh2BwEEBQvowDAUR0EKdArHZTg4 4oDCXBFC/3qj9SEluZEpHnjYQFIGgpo1KgSasYjNKBImrzF4NaFbNgIjCGRQeIyVKwneOLzS cLCAg38OWI4Y4GECgQcSOEwYcADnh6/FNjAwoGFYAQ0atI4AAFeEFwsLFLiJUQEfGH0kNGAD x8+oNQdIRQg+7NCaOhIgD8sVgYADNsPVGI5YWjRqzQTdHDDIYHRDLokaUhCglkFEJi0NKJhl 0RP2TsvXUg88KiLBVWsZrF6DmMKlNYMqglqTik1guN8OBgAgkGCpB+L9ugK4iSCBvwEfECw1 kILrBpa1jVCQIQBRvbP+rlEcQVAoSevWyv6uhpwE12uEkQAAZucpVw1xIsjkgf8B863mQVYt eQATCZYJZJ5WBfij2wfpHcEeHGG8Z+BMszVWDXkfKLhceJhBSAJ+1ThH32AfRFZNayNAtUFi wFSTSwEHJIYAAQU84IADwyjIEALU9MchG+vFgIF7W2GDI2T7HfjBgNcgKQKMHmwjgnCSpeCb ULRkdxhF1CDY40RjgmUAA/v1J5FAKW2gGSZscBFDMraNgJs1AYpAAGYP5jJoNQ4Y4Gh8jpFg HH9mgbmWo1l6oA4C3Ygp6UwEIFBfNRtkMIBlKMLnAXgAXLWhXXH85EIFqMhGGZgDEKArABGA ed0HI4bk5qgnprCYSt88B6dqS0FEEAMPJDCdCJYViur/B1BlwGMJqDTwnhqxJgUpo0ceOQ4D 0yEakpMm/jqCRMgWm2I1j824Y6vLvuuPjHnqOJkIgP6xzwp5sCFNsCFp88Gxh11lrjfDcNrc CEx64/CD3iAHlQcMUEQXvcA+qBkBB4Q2X1CusjBlJdKMYAKI6g28MbKN5hJsBAXknHOwutn4 oFYqkpqAzjnPbE0u1PxmwAQGXLWBbvhuIIEGEnRjlAHO4SvhbCNAkwoGzEBwgV9U0lfu2WiX OkDEGaCdKgl0nk2YkWdPOCDabvaGdkAftL1LlgwCM+7Tq11V71IO7LkM2XE0YAHMYMhqqK6U V165CpaHukLmiXFO8XSVzzakX+UH6TrmAajPNxfqByTQec41AeBPvSwIALkmAnuiexCsca3C BajgfsROuxcPA8kHQJX4DAIwjnsAvhsvfXHWKEwDAljg7sj03L9wwAQTxOWD2AE0YP75eCkw cPfs+xACADs= --------------E079D45EB869E201764E15F0-- --------------CD22EF565BE0BA5CAAE23187--
participants (3)
-
Denis Chaplygin -
Gianluca Cecchi -
Ralf Schenk