12:17 p.m.
This is a multi-part message in MIME format.
--------------0CC9A5CD7BA82A048CB9D135
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
Hello,
don't waste time on it. I reinstalled ovirt-hosted-engine-ha.noarch an
then after some time engine magically started. I'm now adding hosts to
the engine and will deploy two other instances of the engine on two
other hosts to get it highly available. So far my gluster seems usable
inside the engine and the hosts.
If its interesing for you: I also setup up HA nfs-ganesha on the hosts
to provide NFS Shares to multiple VM's (will be php-fpm Backends to
Nginx) in an efficient way. I also tested and benchmarked (only
sysbench) using one host as MDS for pNFS with gluster FSAL. So I'm able
to mount my gluster via "mount ... type nfs4 -o minorversion=1" an am
rewarded with pnfs=LAYOUT_NFSV4_1_FILES in "/proc/self/mountstats". I
can see good network distribution and connections to multiple servers of
the cluster when benchmarking an NFS mount.
What I don't understand: Engine and also setup seem to have a problem
with my type 6 bond. That type proved to be best in glusterfs and nfs
performance and distribution over my 2 network-interfaces. Additionally
I'm loosing my IPMI on shared LAN if I use a type 4 802.3ad Bond.
Thats what i have:
eth0___bond0_________br0 (192.168.252.x) for VMs/Hosts
eth1__/ \__bond0.10_ovirtmgmt (172.16.252.x, VLAN 10) for
Gluster, NFS, Migration, Management
Is this ok ?
Thanks a lot for your effort. I hope that I can give back something to
the community by actively using the mailing-list.
Bye
Am 18.05.2016 um 16:36 schrieb Simone Tiraboschi:
Really really strange,
adding Martin here.
On Wed, May 18, 2016 at 4:32 PM, Ralf Schenk <rs(a)databay.de
<mailto:rs@databay.de>> wrote:
Hello,
When I restart (systemctl restart ovirt-ha-broker ovirt-ha-agent)
broker seems to fail: (from journalctl -xe)
-- Unit ovirt-ha-agent.service has begun starting up.
May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: Traceback
(most recent call last):
May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File
"/usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker", line 25, in
<module>
May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]:
broker.Broker().run()
May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/broker.py",
line 56, in run
May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]:
self._initialize_logging(options.daemon)
May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/broker.py",
line 131, in _initialize_logging
May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]:
level=logging.DEBUG)
May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File
"/usr/lib64/python2.7/logging/__init__.py", line 1529, in basicConfig
May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: hdlr =
FileHandler(filename, mode)
May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File
"/usr/lib64/python2.7/logging/__init__.py", line 902, in __init__
May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]:
StreamHandler.__init__(self, self._open())
May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: File
"/usr/lib64/python2.7/logging/__init__.py", line 925, in _open
May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: stream =
open(self.baseFilename, self.mode)
May 18 16:26:19 microcloud21 ovirt-ha-broker[2429]: IOError:
[Errno 6] No such device or address: '/dev/stdout'
May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: Traceback (most
recent call last):
May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File
"/usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent", line 25, in
<module>
May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: agent.Agent().run()
May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py",
line 77, in run
May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]:
self._initialize_logging(options.daemon)
May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py",
line 159, in _initialize_logging
May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]:
level=logging.DEBUG)
May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File
"/usr/lib64/python2.7/logging/__init__.py", line 1529, in basicConfig
May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: hdlr =
FileHandler(filename, mode)
May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File
"/usr/lib64/python2.7/logging/__init__.py", line 902, in __init__
May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]:
StreamHandler.__init__(self, self._open())
May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: File
"/usr/lib64/python2.7/logging/__init__.py", line 925, in _open
May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: stream =
open(self.baseFilename, self.mode)
May 18 16:26:19 microcloud21 ovirt-ha-agent[2430]: IOError: [Errno
6] No such device or address: '/dev/stdout'
May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-broker.service:
main process exited, code=exited, status=1/FAILURE
May 18 16:26:19 microcloud21 systemd[1]: Unit
ovirt-ha-broker.service entered failed state.
May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-broker.service
failed.
May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-agent.service:
main process exited, code=exited, status=1/FAILURE
May 18 16:26:19 microcloud21 systemd[1]: Unit
ovirt-ha-agent.service entered failed state.
May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-agent.service
failed.
May 18 16:26:19 microcloud21 systemd[1]: ovirt-ha-broker.service
holdoff time over, scheduling restart.
Of course /dev/stdout exists:
[root@microcloud21 ~]# ls -al /dev/stdout
lrwxrwxrwx 1 root root 15 May 18 12:29 /dev/stdout -> /proc/self/fd/1
--
*Ralf Schenk*
fon +49 (0) 24 05 / 40 83 70
fax +49 (0) 24 05 / 40 83 759
mail *rs(a)databay.de* <mailto:rs@databay.de>
*Databay AG*
Jens-Otto-Krag-Straße 11
D-52146 Würselen
*www.databay.de* <http://www.databay.de>
Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE 210844202
Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch Yavari, Dipl.-Kfm.
Philipp Hermanns
Aufsichtsratsvorsitzender: Klaus Scholzen (RA)
------------------------------------------------------------------------
--------------0CC9A5CD7BA82A048CB9D135
Content-Type: multipart/related;
boundary="------------69E1DCACD77B617618016FDF"
--------------69E1DCACD77B617618016FDF
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta content="text/html; charset=utf-8"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p>Hello,</p>
<p>don't waste time on it. I reinstalled
ovirt-hosted-engine-ha.noarch an then after some time engine
magically started. I'm now adding hosts to the engine and will
deploy two other instances of the engine on two other hosts to get
it highly available. So far my gluster seems usable inside the
engine and the hosts. <br>
</p>
<p>If its interesing for you: I also setup up HA nfs-ganesha on the
hosts to provide NFS Shares to multiple VM's (will be php-fpm
Backends to Nginx) in an efficient way. I also tested and
benchmarked (only sysbench) using one host as MDS for pNFS with
gluster FSAL. So I'm able to mount my gluster via "mount ... type
nfs4 -o minorversion=1" an am rewarded with
pnfs=LAYOUT_NFSV4_1_FILES in "/proc/self/mountstats". I can see
good network distribution and connections to multiple servers of
the cluster when benchmarking an NFS mount.</p>
<p>What I don't understand: Engine and also setup seem to have a
problem with my type 6 bond. That type proved to be best in
glusterfs and nfs performance and distribution over my 2
network-interfaces. Additionally I'm loosing my IPMI on shared LAN
if I use a type 4 802.3ad Bond.<br>
</p>
<p>Thats what i have:</p>
<p><tt>eth0___bond0_________br0 (192.168.252.x) for
VMs/Hosts</tt><tt><br>
</tt><tt>eth1__/ \__bond0.10_ovirtmgmt (172.16.252.x,
VLAN 10) for Gluster, NFS, Migration, Management</tt><br>
</p>
<p>Is this ok ?<br>
</p>
<p>Thanks a lot for your effort. I hope that I can give back
something to the community by actively using the mailing-list.</p>
<p>Bye<br>
</p>
<div class="moz-cite-prefix">Am 18.05.2016 um 16:36 schrieb Simone
Tiraboschi:<br>
</div>
<blockquote
cite="mid:CAN8-ONr-48CYUXhTNs571DQu=_jCN3uOXUhDBKPSGyTdVzZw0w@mail.gmail.com"
type="cite">Really really strange,
<div>adding Martin here.</div>
<div><br>
</div>
<div><br>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Wed, May 18, 2016 at 4:32 PM, Ralf
Schenk <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:rs@databay.de"
target="_blank">rs(a)databay.de</a>&gt;</span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<p>Hello,</p>
<p>When I restart (systemctl restart ovirt-ha-broker
ovirt-ha-agent) broker seems to fail: (from journalctl
-xe)<br>
</p>
<p><tt>-- Unit ovirt-ha-agent.service has begun starting
up.</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-broker[2429]: Traceback (most recent call
last):</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-broker[2429]: File
"/usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker",
line 25, in <module></tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-broker[2429]:
broker.Broker().run()</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-broker[2429]: File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/broker.py",
line 56, in run</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-broker[2429]:
self._initialize_logging(options.daemon)</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-broker[2429]: File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/broker.py",
line 131, in _initialize_logging</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-broker[2429]:
level=logging.DEBUG)</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-broker[2429]: File
"/usr/lib64/python2.7/logging/__init__.py", line 1529,
in basicConfig</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-broker[2429]: hdlr = FileHandler(filename,
mode)</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-broker[2429]: File
"/usr/lib64/python2.7/logging/__init__.py", line 902,
in __init__</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-broker[2429]: StreamHandler.__init__(self,
self._open())</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-broker[2429]: File
"/usr/lib64/python2.7/logging/__init__.py", line 925,
in _open</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-broker[2429]: stream =
open(self.baseFilename, self.mode)</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-broker[2429]: IOError: [Errno 6] No such
device or address: '/dev/stdout'</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-agent[2430]: Traceback (most recent call
last):</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-agent[2430]: File
"/usr/share/ovirt-hosted-engine-ha/ovirt-ha-agent",
line 25, in <module></tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-agent[2430]:
agent.Agent().run()</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-agent[2430]: File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py",
line 77, in run</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-agent[2430]:
self._initialize_logging(options.daemon)</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-agent[2430]: File
"/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py",
line 159, in _initialize_logging</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-agent[2430]:
level=logging.DEBUG)</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-agent[2430]: File
"/usr/lib64/python2.7/logging/__init__.py", line 1529,
in basicConfig</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-agent[2430]: hdlr = FileHandler(filename,
mode)</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-agent[2430]: File
"/usr/lib64/python2.7/logging/__init__.py", line 902,
in __init__</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-agent[2430]: StreamHandler.__init__(self,
self._open())</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-agent[2430]: File
"/usr/lib64/python2.7/logging/__init__.py", line 925,
in _open</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-agent[2430]: stream = open(self.baseFilename,
self.mode)</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21
ovirt-ha-agent[2430]: IOError: [Errno 6] No such
device or address: '/dev/stdout'</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21 systemd[1]:
ovirt-ha-broker.service: main process exited,
code=exited, status=1/FAILURE</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21 systemd[1]: Unit
ovirt-ha-broker.service entered failed
state.</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21 systemd[1]:
ovirt-ha-broker.service failed.</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21 systemd[1]:
ovirt-ha-agent.service: main process exited,
code=exited, status=1/FAILURE</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21 systemd[1]: Unit
ovirt-ha-agent.service entered failed
state.</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21 systemd[1]:
ovirt-ha-agent.service failed.</tt><tt><br>
</tt><tt>May 18 16:26:19 microcloud21 systemd[1]:
ovirt-ha-broker.service holdoff time over, scheduling
restart.</tt><tt><br>
</tt></p>
<p>Of course /dev/stdout exists:</p>
<p><tt>[root@microcloud21 ~]# ls -al
/dev/stdout</tt><tt><br>
</tt><tt>lrwxrwxrwx 1 root root 15 May 18 12:29
/dev/stdout -> /proc/self/fd/1</tt><tt><br>
</tt></p>
</div>
</blockquote>
</div>
</div>
</blockquote>
<br>
<div class="moz-signature">-- <br>
<p>
</p>
<table border="0" cellpadding="0"
cellspacing="0">
<tbody>
<tr>
<td colspan="3"><img
src="cid:part2.29C79524.2BD951A4@databay.de"
height="30"
border="0" width="151"></td>
</tr>
<tr>
<td valign="top"> <font face="Verdana, Arial,
sans-serif"
size="-1"><br>
<b>Ralf Schenk</b><br>
fon +49 (0) 24 05 / 40 83 70<br>
fax +49 (0) 24 05 / 40 83 759<br>
mail <a href="mailto:rs@databay.de"><font
color="#FF0000"><b>rs(a)databay.de</b></font></a><br>
</font> </td>
<td width="30"> </td>
<td valign="top"> <font face="Verdana, Arial,
sans-serif"
size="-1"><br>
<b>Databay AG</b><br>
Jens-Otto-Krag-Straße 11<br>
D-52146 Würselen<br>
<a href="http://www.databay.de"><font
color="#FF0000"><b>www.databay.de</b></font></a>
</font> </td>
</tr>
<tr>
<td colspan="3" valign="top"> <font
face="Verdana, Arial,
sans-serif" size="1"><br>
Sitz/Amtsgericht Aachen • HRB:8437 • USt-IdNr.: DE
210844202<br>
Vorstand: Ralf Schenk, Dipl.-Ing. Jens Conze, Aresch
Yavari, Dipl.-Kfm. Philipp Hermanns<br>
Aufsichtsratsvorsitzender: Klaus Scholzen (RA) </font>
</td>
</tr>
</tbody>
</table>
<hr color="#000000" noshade="noshade" size="1"
width="100%">
</div>
</body>
</html>
--------------69E1DCACD77B617618016FDF
Content-Type: image/gif;
name="logo_databay_email.gif"
Content-Transfer-Encoding: base64
Content-ID: <part2.29C79524.2BD951A4(a)databay.de>
Content-Disposition: inline;
filename="logo_databay_email.gif"
R0lGODlhlwAeAMQAAObm5v9QVf/R0oKBgfDw8NfX105MTLi3t/r6+sfHx/+rrf98gC0sLP8L
EhIQEKalpf/g4ZmYmHd2dmppaf8uNP/y8v8cIv+Ym//AwkE/P46NjRwbG11cXP8ABwUDA///
/yH5BAAAAAAALAAAAACXAB4AAAX/4CeOYnUJZKqubOu+cCzPNA0tVnfVfO//wGAKk+t0Ap+K
QMFUYCDCqHRKJVUWDaPRUsFktZ1G4AKtms9o1gKsFVS+7I5ll67bpd647hPQawNld4KDMQJF
bA07F35aFBiEkJEpfXEBjx8KjI0Vkp2DEIdaCySgFBShbEgrCQOtrq+uEQcALQewrQUjEbe8
rgkkD7y5KhMZB3drqSoVFQhdlHGXKQYe1dbX2BvHKwzY1RMiAN7j1xEjBeTmKeIeD3cYCxRf
FigvChRxFJwkBBvk5A7cpZhAjgGCDwn+kfslgto4CSoSehh2BwEEBQvowDAUR0EKdArHZTg4
4oDCXBFC/3qj9SEluZEpHnjYQFIGgpo1KgSasYjNKBImrzF4NaFbNgIjCGRQeIyVKwneOLzS
cLCAg38OWI4Y4GECgQcSOEwYcADnh6/FNjAwoGFYAQ0atI4AAFeEFwsLFLiJUQEfGH0kNGAD
x8+oNQdIRQg+7NCaOhIgD8sVgYADNsPVGI5YWjRqzQTdHDDIYHRDLokaUhCglkFEJi0NKJhl
0RP2TsvXUg88KiLBVWsZrF6DmMKlNYMqglqTik1guN8OBgAgkGCpB+L9ugK4iSCBvwEfECw1
kILrBpa1jVCQIQBRvbP+rlEcQVAoSevWyv6uhpwE12uEkQAAZucpVw1xIsjkgf8B863mQVYt
eQATCZYJZJ5WBfij2wfpHcEeHGG8Z+BMszVWDXkfKLhceJhBSAJ+1ThH32AfRFZNayNAtUFi
wFSTSwEHJIYAAQU84IADwyjIEALU9MchG+vFgIF7W2GDI2T7HfjBgNcgKQKMHmwjgnCSpeCb
ULRkdxhF1CDY40RjgmUAA/v1J5FAKW2gGSZscBFDMraNgJs1AYpAAGYP5jJoNQ4Y4Gh8jpFg
HH9mgbmWo1l6oA4C3Ygp6UwEIFBfNRtkMIBlKMLnAXgAXLWhXXH85EIFqMhGGZgDEKArABGA
ed0HI4bk5qgnprCYSt88B6dqS0FEEAMPJDCdCJYViur/B1BlwGMJqDTwnhqxJgUpo0ceOQ4D
0yEakpMm/jqCRMgWm2I1j824Y6vLvuuPjHnqOJkIgP6xzwp5sCFNsCFp88Gxh11lrjfDcNrc
CEx64/CD3iAHlQcMUEQXvcA+qBkBB4Q2X1CusjBlJdKMYAKI6g28MbKN5hJsBAXknHOwutn4
oFYqkpqAzjnPbE0u1PxmwAQGXLWBbvhuIIEGEnRjlAHO4SvhbCNAkwoGzEBwgV9U0lfu2WiX
OkDEGaCdKgl0nk2YkWdPOCDabvaGdkAftL1LlgwCM+7Tq11V71IO7LkM2XE0YAHMYMhqqK6U
V165CpaHukLmiXFO8XSVzzakX+UH6TrmAajPNxfqByTQec41AeBPvSwIALkmAnuiexCsca3C
BajgfsROuxcPA8kHQJX4DAIwjnsAvhsvfXHWKEwDAljg7sj03L9wwAQTxOWD2AE0YP75eCkw
cPfs+xACADs=
--------------69E1DCACD77B617618016FDF--
--------------0CC9A5CD7BA82A048CB9D135--