[ovirt-users] Hosted Engine-Setup issue additional host

--_000_BFAB40933B3367488CE6299BAF8592D1010C9C2A4AB2SOCRATESasl_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi All, after a successful setup of hosted-engine on the first node I'm having trou= ble completing it on an additional node. The Setup fails with: --------------------------------- [ INFO ] Waiting for the host to become operational in the engine. This ma= y take several minutes... [ INFO ] Still waiting for VDSM host to become operational... [ INFO ] The VDSM Host is now operational [ INFO ] Enabling and starting HA services [ ERROR ] Failed to execute stage 'Closing up': Command '/bin/systemctl' fa= iled to execute [ INFO ] Stage: Clean up [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answer= s/answers-20150426080028.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination --------------------------------- After that the node is added to the cluster and is operational from the GUI= , but the hosted engine broker and agent fail to start with error messages= : ---------------------------------- [root@ovirt-node2 ~]# systemctl status ovirt-ha-agent.service -l ovirt-ha-agent.service - oVirt Hosted Engine High Availability Monitoring A= gent Loaded: loaded (/usr/lib/systemd/system/ovirt-ha-agent.service; enabled) Active: failed (Result: exit-code) since Sun 2015-04-26 08:00:28 CDT; 20= min ago Process: 5373 ExecStart=3D/usr/lib/systemd/systemd-ovirt-ha-agent start (= code=3Dexited, status=3D1/FAILURE) Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-agent[5373]: hd= lr =3D FileHandler(filename, mode) Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-agent[5373]: Fi= le "/usr/lib64/python2.7/logging/__init__.py", line 902, in __init__ Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-agent[5373]: St= reamHandler.__init__(self, self._open()) Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-agent[5373]: Fi= le "/usr/lib64/python2.7/logging/__init__.py", line 925, in _open Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-agent[5373]: st= ream =3D open(self.baseFilename, self.mode) Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-agent[5373]: IO= Error: [Errno 6] No such device or address: '/dev/stdout' Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-agent[5373]: [F= AILED] Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd[1]: ovirt-ha-agent.servi= ce: control process exited, code=3Dexited status=3D1 Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd[1]: Failed to start oVir= t Hosted Engine High Availability Monitoring Agent. Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd[1]: Unit ovirt-ha-agent.= service entered failed state. ------------------------------------- And ------------------------------------- [root@ovirt-node2 ~]# systemctl status ovirt-ha-broker ovirt-ha-broker.service - oVirt Hosted Engine High Availability Communicati= ons Broker Loaded: loaded (/usr/lib/systemd/system/ovirt-ha-broker.service; enabled= ) Active: failed (Result: exit-code) since Sun 2015-04-26 08:00:28 CDT; 21= min ago Process: 5359 ExecStart=3D/usr/lib/systemd/systemd-ovirt-ha-broker start = (code=3Dexited, status=3D1/FAILURE) Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-broker[5359]: h= dlr =3D FileHandler(filename, mode) Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-broker[5359]: F= ile "/usr/lib64/python2.7/logging/__init__.py", line ...it__ Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-broker[5359]: S= treamHandler.__init__(self, self._open()) Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-broker[5359]: F= ile "/usr/lib64/python2.7/logging/__init__.py", line ...open Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-broker[5359]: s= tream =3D open(self.baseFilename, self.mode) Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-broker[5359]: I= OError: [Errno 6] No such device or address: '/dev/stdout' Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-broker[5359]: [= FAILED] Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd[1]: ovirt-ha-broker.serv= ice: control process exited, code=3Dexited status=3D1 Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd[1]: Failed to start oVir= t Hosted Engine High Availability Communications Broker. Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd[1]: Unit ovirt-ha-broker= .service entered failed state. ---------------------------------------- The system is a CentOS 7 Setup with SeLinux switched off, no firewall or ip= tables. How can I find out which version of ovirt I'm running exactly ? I'= ve had a lock at the logs and read through old bug reports. Thank you, Sven --_000_BFAB40933B3367488CE6299BAF8592D1010C9C2A4AB2SOCRATESasl_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:= //www.w3.org/TR/REC-html40"><head><meta http-equiv=3DContent-Type content= =3D"text/html; charset=3Dus-ascii"><meta name=3DGenerator content=3D"Micros= oft Word 15 (filtered medium)"><style><!-- /* Font Definitions */ @font-face {font-family:"Cambria Math"; panose-1:2 4 5 3 5 4 6 3 2 4;} @font-face {font-family:Calibri; panose-1:2 15 5 2 2 2 4 3 2 4;} /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {margin:0cm; margin-bottom:.0001pt; font-size:11.0pt; font-family:"Calibri",sans-serif; mso-fareast-language:EN-US;} a:link, span.MsoHyperlink {mso-style-priority:99; color:#0563C1; text-decoration:underline;} a:visited, span.MsoHyperlinkFollowed {mso-style-priority:99; color:#954F72; text-decoration:underline;} span.E-MailFormatvorlage17 {mso-style-type:personal-compose; font-family:"Calibri",sans-serif; color:windowtext;} .MsoChpDefault {mso-style-type:export-only; font-family:"Calibri",sans-serif; mso-fareast-language:EN-US;} @page WordSection1 {size:612.0pt 792.0pt; margin:70.85pt 70.85pt 2.0cm 70.85pt;} div.WordSection1 {page:WordSection1;} --></style><!--[if gte mso 9]><xml> <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" /> </xml><![endif]--><!--[if gte mso 9]><xml> <o:shapelayout v:ext=3D"edit"> <o:idmap v:ext=3D"edit" data=3D"1" /> </o:shapelayout></xml><![endif]--></head><body lang=3DDE link=3D"#0563C1" v= link=3D"#954F72"><div class=3DWordSection1><p class=3DMsoNormal><span lang= =3DEN-US>Hi All,<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-= US><o:p>&nbsp;</o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>afte= r a successful setup of hosted-engine on the first node I&#8217;m having tr= ouble completing it on an additional node. The Setup fails with:<o:p></o:p>= </span></p><p class=3DMsoNormal><span lang=3DEN-US>------------------------= ---------<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>[ IN= FO&nbsp; ] Waiting for the host to become operational in the engine. This m= ay take several minutes...<o:p></o:p></span></p><p class=3DMsoNormal><span = lang=3DEN-US>[ INFO&nbsp; ] Still waiting for VDSM host to become operation= al...<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>[ INFO&n= bsp; ] The VDSM Host is now operational<o:p></o:p></span></p><p class=3DMso= Normal><span lang=3DEN-US>[ INFO&nbsp; ] Enabling and starting HA services<= o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>[ ERROR ] Fail= ed to execute stage 'Closing up': Command '/bin/systemctl' failed to execut= e<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>[ INFO&nbsp;= ] Stage: Clean up<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DE= N-US>[ INFO&nbsp; ] Generating answer file '/var/lib/ovirt-hosted-engine-se= tup/answers/answers-20150426080028.conf'<o:p></o:p></span></p><p class=3DMs= oNormal><span lang=3DEN-US>[ INFO&nbsp; ] Stage: Pre-termination<o:p></o:p>= </span></p><p class=3DMsoNormal><span lang=3DEN-US>[ INFO&nbsp; ] Stage: Te= rmination<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>----= -----------------------------<o:p></o:p></span></p><p class=3DMsoNormal><sp= an lang=3DEN-US>After that the node is added to the cluster and is operatio= nal from the GUI, but the hosted&nbsp; engine broker and agent fail to star= t with error messages: <o:p></o:p></span></p><p class=3DMsoNormal><span lan= g=3DEN-US>----------------------------------<o:p></o:p></span></p><p class= =3DMsoNormal><span lang=3DEN-US>[root@ovirt-node2 ~]# systemctl status ovir= t-ha-agent.service -l<o:p></o:p></span></p><p class=3DMsoNormal><span lang= =3DEN-US>ovirt-ha-agent.service - oVirt Hosted Engine High Availability Mon= itoring Agent<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>= &nbsp;&nbsp; Loaded: loaded (/usr/lib/systemd/system/ovirt-ha-agent.service= ; enabled)<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>&nb= sp;&nbsp; Active: failed (Result: exit-code) since Sun 2015-04-26 08:00:28 = CDT; 20min ago<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US= tart (code=3Dexited, status=3D1/FAILURE)<o:p></o:p></span></p><p class=3DMs= oNormal><span lang=3DEN-US><o:p>&nbsp;</o:p></span></p><p class=3DMsoNormal= t-ha-agent[5373]: hdlr =3D FileHandler(filename, mode)<o:p></o:p></span></p= sl.local systemd-ovirt-ha-agent[5373]: File &quot;/usr/lib64/python2.7/logg= ing/__init__.py&quot;, line 902, in __init__<o:p></o:p></span></p><p class= =3DMsoNormal><span lang=3DEN-US>Apr 26 08:00:28 ovirt-node2.mgmt.asl.local = systemd-ovirt-ha-agent[5373]: StreamHandler.__init__(self, self._open())<o:= p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>Apr 26 08:00:28 = ovirt-node2.mgmt.asl.local systemd-ovirt-ha-agent[5373]: File &quot;/usr/li= b64/python2.7/logging/__init__.py&quot;, line 925, in _open<o:p></o:p></spa= n></p><p class=3DMsoNormal><span lang=3DEN-US>Apr 26 08:00:28 ovirt-node2.m= gmt.asl.local systemd-ovirt-ha-agent[5373]: stream =3D open(self.baseFilena= me, self.mode)<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US= OError: [Errno 6] No such device or address: '/dev/stdout'<o:p></o:p></span= mt.asl.local systemd-ovirt-ha-agent[5373]: [FAILED]<o:p></o:p></span></p><p= class=3DMsoNormal><span lang=3DEN-US>Apr 26 08:00:28 ovirt-node2.mgmt.asl.= local systemd[1]: ovirt-ha-agent.service: control process exited, code=3Dex= ited status=3D1<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-U= S>Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd[1]: Failed to start oV= irt Hosted Engine High Availability Monitoring Agent.<o:p></o:p></span></p>= <p class=3DMsoNormal><span lang=3DEN-US>Apr 26 08:00:28 ovirt-node2.mgmt.as= l.local systemd[1]: Unit ovirt-ha-agent.service entered failed state.<o:p><= /o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>-------------------= ------------------<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DE= N-US>And <o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>----= ---------------------------------<o:p></o:p></span></p><p class=3DMsoNormal= o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>ovirt-ha-broke= r.service - oVirt Hosted Engine High Availability Communications Broker<o:p= ed: loaded (/usr/lib/systemd/system/ovirt-ha-broker.service; enabled)<o:p><= /o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>&nbsp;&nbsp; Active= : failed (Result: exit-code) since Sun 2015-04-26 08:00:28 CDT; 21min ago<o= :p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>&nbsp; Process:= 5359 ExecStart=3D/usr/lib/systemd/systemd-ovirt-ha-broker start (code=3Dex= ited, status=3D1/FAILURE)<o:p></o:p></span></p><p class=3DMsoNormal><span l= ang=3DEN-US><o:p>&nbsp;</o:p></span></p><p class=3DMsoNormal><span lang=3DE= N-US>Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-broker[535= 9]: hdlr =3D FileHandler(filename, mode)<o:p></o:p></span></p><p class=3DMs= oNormal><span lang=3DEN-US>Apr 26 08:00:28 ovirt-node2.mgmt.asl.local syste= md-ovirt-ha-broker[5359]: File &quot;/usr/lib64/python2.7/logging/__init__.= py&quot;, line ...it__<o:p></o:p></span></p><p class=3DMsoNormal><span lang= =3DEN-US>Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt-ha-broker= [5359]: StreamHandler.__init__(self, self._open())<o:p></o:p></span></p><p = class=3DMsoNormal><span lang=3DEN-US>Apr 26 08:00:28 ovirt-node2.mgmt.asl.l= ocal systemd-ovirt-ha-broker[5359]: File &quot;/usr/lib64/python2.7/logging= /__init__.py&quot;, line ...open<o:p></o:p></span></p><p class=3DMsoNormal>= <span lang=3DEN-US>Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd-ovirt= -ha-broker[5359]: stream =3D open(self.baseFilename, self.mode)<o:p></o:p><= /span></p><p class=3DMsoNormal><span lang=3DEN-US>Apr 26 08:00:28 ovirt-nod= e2.mgmt.asl.local systemd-ovirt-ha-broker[5359]: IOError: [Errno 6] No such= device or address: '/dev/stdout'<o:p></o:p></span></p><p class=3DMsoNormal= t-ha-broker[5359]: [FAILED]<o:p></o:p></span></p><p class=3DMsoNormal><span= lang=3DEN-US>Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd[1]: ovirt-= ha-broker.service: control process exited, code=3Dexited status=3D1<o:p></o= :p></span></p><p class=3DMsoNormal><span lang=3DEN-US>Apr 26 08:00:28 ovirt= -node2.mgmt.asl.local systemd[1]: Failed to start oVirt Hosted Engine High = Availability Communications Broker.<o:p></o:p></span></p><p class=3DMsoNorm= al><span lang=3DEN-US>Apr 26 08:00:28 ovirt-node2.mgmt.asl.local systemd[1]= : Unit ovirt-ha-broker.service entered failed state.<o:p></o:p></span></p><= p class=3DMsoNormal><span lang=3DEN-US>------------------------------------= ----<o:p></o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US><o:p>&nbs= p;</o:p></span></p><p class=3DMsoNormal><span lang=3DEN-US>The system is a = CentOS 7 Setup with SeLinux switched off, no firewall or iptables.&nbsp; Ho= w can I find out which version of ovirt I&#8217;m running exactly ? I&#8217= ;ve had a lock at the logs and read through old bug reports.<o:p></o:p></sp= an></p><p class=3DMsoNormal><span lang=3DEN-US><o:p>&nbsp;</o:p></span></p>= <p class=3DMsoNormal><span lang=3DEN-US>Thank you, <o:p></o:p></span></p><p= class=3DMsoNormal><span lang=3DEN-US><o:p>&nbsp;</o:p></span></p><p class= =3DMsoNormal><span lang=3DEN-US>Sven <o:p></o:p></span></p></div></body></h= tml>= --_000_BFAB40933B3367488CE6299BAF8592D1010C9C2A4AB2SOCRATESasl_--