This is a multi-part message in MIME format. --------------0CC9A5CD7BA82A048CB9D135 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Hello, don't waste time on it. I reinstalled ovirt-hosted-engine-ha.noarch an then after some time engine magically started. I'm now adding hosts to the engine and will deploy two other instances of the engine on two other hosts to get it highly available. So far my gluster seems usable inside the engine and the hosts. If its interesing for you: I also setup up HA nfs-ganesha on the hosts to provide NFS Shares to multiple VM's (will be php-fpm Backends to Nginx) in an efficient way. I also tested and benchmarked (only sysbench) using one host as MDS for pNFS with gluster FSAL. So I'm able to mount my gluster via "mount ... type nfs4 -o minorversion=1" an am rewarded with pnfs=LAYOUT_NFSV4_1_FILES in "/proc/self/mountstats". I can see good network distribution and connections to multiple servers of the cluster when benchmarking an NFS mount. What I don't understand: Engine and also setup seem to have a problem with my type 6 bond. That type proved to be best in glusterfs and nfs performance and distribution over my 2 network-interfaces. Additionally I'm loosing my IPMI on shared LAN if I use a type 4 802.3ad Bond. Thats what i have: eth0___bond0_________br0 (192.168.252.x) for VMs/Hosts eth1__/ \__bond0.10_ovirtmgmt (172.16.252.x, VLAN 10) for Gluster, NFS, Migration, Management Is this ok ? Thanks a lot for your effort. I hope that I can give back something to the community by actively using the mailing-list. Bye Am 18.05.2016 um 16:36 schrieb Simone Tiraboschi:

Really really strange, adding Martin here.

On Wed, May 18, 2016 at 4:32 PM, Ralf Schenk <rs@databay.de <mailto:rs@databay.de>> wrote:

Hello,

When I restart (systemctl restart ovirt-ha-broker ovirt-ha-agent) broker seems to fail: (from journalctl -xe)

-- Unit ovirt-ha-agent.service has begun starting up. May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: Traceback (most recent call last): May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File "/usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker", line 25, in <module> May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: broker.Broker().run() May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/broker.py", line 56, in run May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: self._initialize_logging(options.daemon) May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/broker.py", line 131, in _initialize_logging May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: level=logging.DEBUG) May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File "/usr/lib64/python2.7/logging/__init__.py", line 1529, in basicConfig May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: hdlr = FileHandler(filename, mode) May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File "/usr/lib64/python2.7/logging/__init__.py", line 902, in __init__ May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: StreamHandler.__init__(self, self._open()) May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File "/usr/lib64/python2.7/logging/__init__.py", line 925, in _open May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: stream = open(self.baseFilename, self.mode) May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: IOError: [Errno 6] No such device or address: '/dev/stdout' May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: Traceback (most recent call last): May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File "/usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent", line 25, in <module> May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: agent.Agent().run() May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 77, in run May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: self._initialize_logging(options.daemon) May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 159, in _initialize_logging May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: level=logging.DEBUG) May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File "/usr/lib64/python2.7/logging/__init__.py", line 1529, in basicConfig May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: hdlr = FileHandler(filename, mode) May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File "/usr/lib64/python2.7/logging/__init__.py", line 902, in __init__ May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: StreamHandler.__init__(self, self._open()) May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File "/usr/lib64/python2.7/logging/__init__.py", line 925, in _open May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: stream = open(self.baseFilename, self.mode) May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: IOError: [Errno 6] No such device or address: '/dev/stdout' May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-broker.service: main process exited, code=exited, status=1/FAILURE May 18 16:26:19 microcloud21 systemd[1]: Unit ovirt-ha-broker.service entered failed state. May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-broker.service failed. May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-agent.service: main process exited, code=exited, status=1/FAILURE May 18 16:26:19 microcloud21 systemd[1]: Unit ovirt-ha-agent.service entered failed state. May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-agent.service failed. May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-broker.service holdoff time over, scheduling restart.

Of course /dev/stdout exists:

[root@microcloud21 ~]# ls -al /dev/stdout lrwxrwxrwx 1 root root 15 May 18 12:29 /dev/stdout -> /proc/self/fd/1

-- *Ralf Schenk* fon +49 (0) 24 05 / 40 83 70 fax +49 (0) 24 05 / 40 83 759 mail *rs@databay.de* <mailto:rs@databay.de> *Databay AG* Jens-Otto-Krag-Straße 11 D-52146 Würselen *www.databay.de* <http://www.databay.de> Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE 210844202 Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch Yavari, Dipl.-Kfm. Philipp Hermanns Aufsichtsratsvorsitzender: Klaus Scholzen (RA) ------------------------------------------------------------------------ --------------0CC9A5CD7BA82A048CB9D135 Content-Type: multipart/related; boundary="------------69E1DCACD77B617618016FDF" --------------69E1DCACD77B617618016FDF Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=utf-8" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <p>Hello,</p> <p>don't waste time on it. I reinstalled ovirt-hosted-engine-ha.noarch an then after some time engine magically started. I'm now adding hosts to the engine and will deploy two other instances of the engine on two other hosts to get it highly available. So far my gluster seems usable inside the engine and the hosts. <br> </p> <p>If its interesing for you:  I also setup up HA nfs-ganesha on the hosts to provide NFS Shares to multiple VM's (will be php-fpm Backends to Nginx) in an efficient way. I also tested and benchmarked (only sysbench) using one host as MDS for pNFS with gluster FSAL. So I'm able to mount my gluster via "mount ... type nfs4 -o minorversion=1" an am rewarded with pnfs=LAYOUT_NFSV4_1_FILES in "/proc/self/mountstats". I can see good network distribution and connections to multiple servers of the cluster when benchmarking an NFS mount.</p> <p>What I don't understand: Engine and also setup seem to have a problem with my type 6 bond. That type proved to be best in glusterfs and nfs performance and distribution over my 2 network-interfaces. Additionally I'm loosing my IPMI on shared LAN if I use a type 4 802.3ad Bond.<br> </p> <p>Thats what i have:</p> <p><tt>eth0___bond0_________br0 (192.168.252.x) for VMs/Hosts</tt><tt><br> </tt><tt>eth1__/           \__bond0.10_ovirtmgmt (172.16.252.x, VLAN 10) for Gluster, NFS, Migration, Management</tt><br> </p> <p>Is this ok ?<br> </p> <p>Thanks a lot for your effort. I hope that I can give back something to the community by actively using the mailing-list.</p> <p>Bye<br> </p> <div class="moz-cite-prefix">Am 18.05.2016 um 16:36 schrieb Simone Tiraboschi:<br> </div> <blockquote cite="mid:CAN8-ONr-48CYUXhTNs571DQu=_jCN3uOXUhDBKPSGyTdVzZw0w@mail.gmail.com" type="cite">Really really strange, <div>adding Martin here.</div> <div><br> </div> <div><br> </div> <div class="gmail_extra"><br> <div class="gmail_quote">On Wed, May 18, 2016 at 4:32 PM, Ralf Schenk <span dir="ltr"><<a moz-do-not-send="true" href="mailto:rs@databay.de" target="_blank">rs@databay.de</a>></span> wrote:<br> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div bgcolor="#FFFFFF" text="#000000"> <p>Hello,</p> <p>When I restart (systemctl restart ovirt-ha-broker ovirt-ha-agent) broker seems to fail: (from journalctl -xe)<br> </p> <p><tt>-- Unit ovirt-ha-agent.service has begun starting up.</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: Traceback (most recent call last):</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File "/usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker", line 25, in <module></tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: broker.Broker().run()</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/broker.py", line 56, in run</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: self._initialize_logging(options.daemon)</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/broker.py", line 131, in _initialize_logging</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: level=logging.DEBUG)</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File "/usr/lib64/python2.7/logging/__init__.py", line 1529, in basicConfig</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: hdlr = FileHandler(filename, mode)</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File "/usr/lib64/python2.7/logging/__init__.py", line 902, in __init__</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: StreamHandler.__init__(self, self._open())</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File "/usr/lib64/python2.7/logging/__init__.py", line 925, in _open</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: stream = open(self.baseFilename, self.mode)</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: IOError: [Errno 6] No such device or address: '/dev/stdout'</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: Traceback (most recent call last):</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File "/usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent", line 25, in <module></tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: agent.Agent().run()</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 77, in run</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: self._initialize_logging(options.daemon)</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 159, in _initialize_logging</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: level=logging.DEBUG)</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File "/usr/lib64/python2.7/logging/__init__.py", line 1529, in basicConfig</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: hdlr = FileHandler(filename, mode)</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File "/usr/lib64/python2.7/logging/__init__.py", line 902, in __init__</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: StreamHandler.__init__(self, self._open())</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File "/usr/lib64/python2.7/logging/__init__.py", line 925, in _open</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: stream = open(self.baseFilename, self.mode)</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: IOError: [Errno 6] No such device or address: '/dev/stdout'</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-broker.service: main process exited, code=exited, status=1/FAILURE</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 systemd[1]: Unit ovirt-ha-broker.service entered failed state.</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-broker.service failed.</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-agent.service: main process exited, code=exited, status=1/FAILURE</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 systemd[1]: Unit ovirt-ha-agent.service entered failed state.</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-agent.service failed.</tt><tt><br> </tt><tt>May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-broker.service holdoff time over, scheduling restart.</tt><tt><br> </tt></p> <p>Of course /dev/stdout exists:</p> <p><tt>[root@microcloud21 ~]# ls -al /dev/stdout</tt><tt><br> </tt><tt>lrwxrwxrwx 1 root root 15 May 18 12:29 /dev/stdout -> /proc/self/fd/1</tt><tt><br> </tt></p> </div> </blockquote> </div> </div> </blockquote> <br> <div class="moz-signature">-- <br> <p> </p> <table border="0" cellpadding="0" cellspacing="0"> <tbody> <tr> <td colspan="3"><img src="cid:part2.29C79524.2BD951A4@databay.de" height="30" border="0" width="151"></td> </tr> <tr> <td valign="top"> <font face="Verdana, Arial, sans-serif" size="-1"><br> <b>Ralf Schenk</b><br> fon +49 (0) 24 05 / 40 83 70<br> fax +49 (0) 24 05 / 40 83 759<br> mail <a href="mailto:rs@databay.de"><font color="#FF0000"><b>rs@databay.de</b></font></a><br> </font> </td> <td width="30"> </td> <td valign="top"> <font face="Verdana, Arial, sans-serif" size="-1"><br> <b>Databay AG</b><br> Jens-Otto-Krag-Straße 11<br> D-52146 Würselen<br> <a href="http://www.databay.de"><font color="#FF0000"><b>www.databay.de</b></font></a> </font> </td> </tr> <tr> <td colspan="3" valign="top"> <font face="Verdana, Arial, sans-serif" size="1"><br> Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE 210844202<br> Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch Yavari, Dipl.-Kfm. Philipp Hermanns<br> Aufsichtsratsvorsitzender: Klaus Scholzen (RA) </font> </td> </tr> </tbody> </table> <hr color="#000000" noshade="noshade" size="1" width="100%"> </div> </body> </html> --------------69E1DCACD77B617618016FDF Content-Type: image/gif; name="logo_databay_email.gif" Content-Transfer-Encoding: base64 Content-ID: <part2.29C79524.2BD951A4@databay.de> Content-Disposition: inline; filename="logo_databay_email.gif" R0lGODlhlwAeAMQAAObm5v9QVf/R0oKBgfDw8NfX105MTLi3t/r6+sfHx/+rrf98gC0sLP8L EhIQEKalpf/g4ZmYmHd2dmppaf8uNP/y8v8cIv+Ym//AwkE/P46NjRwbG11cXP8ABwUDA/// /yH5BAAAAAAALAAAAACXAB4AAAX/4CeOYnUJZKqubOu+cCzPNA0tVnfVfO//wGAKk+t0Ap+K QMFUYCDCqHRKJVUWDaPRUsFktZ1G4AKtms9o1gKsFVS+7I5ll67bpd647hPQawNld4KDMQJF bA07F35aFBiEkJEpfXEBjx8KjI0Vkp2DEIdaCySgFBShbEgrCQOtrq+uEQcALQewrQUjEbe8 rgkkD7y5KhMZB3drqSoVFQhdlHGXKQYe1dbX2BvHKwzY1RMiAN7j1xEjBeTmKeIeD3cYCxRf FigvChRxFJwkBBvk5A7cpZhAjgGCDwn+kfslgto4CSoSehh2BwEEBQvowDAUR0EKdArHZTg4 4oDCXBFC/3qj9SEluZEpHnjYQFIGgpo1KgSasYjNKBImrzF4NaFbNgIjCGRQeIyVKwneOLzS cLCAg38OWI4Y4GECgQcSOEwYcADnh6/FNjAwoGFYAQ0atI4AAFeEFwsLFLiJUQEfGH0kNGAD x8+oNQdIRQg+7NCaOhIgD8sVgYADNsPVGI5YWjRqzQTdHDDIYHRDLokaUhCglkFEJi0NKJhl 0RP2TsvXUg88KiLBVWsZrF6DmMKlNYMqglqTik1guN8OBgAgkGCpB+L9ugK4iSCBvwEfECw1 kILrBpa1jVCQIQBRvbP+rlEcQVAoSevWyv6uhpwE12uEkQAAZucpVw1xIsjkgf8B863mQVYt eQATCZYJZJ5WBfij2wfpHcEeHGG8Z+BMszVWDXkfKLhceJhBSAJ+1ThH32AfRFZNayNAtUFi wFSTSwEHJIYAAQU84IADwyjIEALU9MchG+vFgIF7W2GDI2T7HfjBgNcgKQKMHmwjgnCSpeCb ULRkdxhF1CDY40RjgmUAA/v1J5FAKW2gGSZscBFDMraNgJs1AYpAAGYP5jJoNQ4Y4Gh8jpFg HH9mgbmWo1l6oA4C3Ygp6UwEIFBfNRtkMIBlKMLnAXgAXLWhXXH85EIFqMhGGZgDEKArABGA ed0HI4bk5qgnprCYSt88B6dqS0FEEAMPJDCdCJYViur/B1BlwGMJqDTwnhqxJgUpo0ceOQ4D 0yEakpMm/jqCRMgWm2I1j824Y6vLvuuPjHnqOJkIgP6xzwp5sCFNsCFp88Gxh11lrjfDcNrc CEx64/CD3iAHlQcMUEQXvcA+qBkBB4Q2X1CusjBlJdKMYAKI6g28MbKN5hJsBAXknHOwutn4 oFYqkpqAzjnPbE0u1PxmwAQGXLWBbvhuIIEGEnRjlAHO4SvhbCNAkwoGzEBwgV9U0lfu2WiX OkDEGaCdKgl0nk2YkWdPOCDabvaGdkAftL1LlgwCM+7Tq11V71IO7LkM2XE0YAHMYMhqqK6U V165CpaHukLmiXFO8XSVzzakX+UH6TrmAajPNxfqByTQec41AeBPvSwIALkmAnuiexCsca3C BajgfsROuxcPA8kHQJX4DAIwjnsAvhsvfXHWKEwDAljg7sj03L9wwAQTxOWD2AE0YP75eCkw cPfs+xACADs= --------------69E1DCACD77B617618016FDF-- --------------0CC9A5CD7BA82A048CB9D135--