Re: [Users] Error adding second host to self-hosted-engine

6 Apr 2014

      --_c98e2d14-f6ef-4327-87fb-e010fc3fa969_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Hi all=2C
while going through the logs I found the following in engine.log:

2014-04-06 07:54:48=2C788 INFO  [org.ovirt.engine.core.bll.InstallerMessage=
s] (VdsDeploy) Installation 172.16.100.2: Retrieving installation logs to: =
'/var/log/ovirt-engi
ne/host-deploy/ovirt-20140406075448-172.16.100.2-2325b258.log'
2014-04-06 07:54:48=2C793 INFO  [org.ovirt.engine.core.dal.dbbroker.auditlo=
ghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2325b258=2C Call St=
ack: null=2C Custom Even
t ID: -1=2C Message: Installing Host hosted_engine_2. Retrieving installati=
on logs to: '/var/log/ovirt-engine/host-deploy/ovirt-20140406075448-172.16.=
100.2-2325b258.log'.
2014-04-06 07:54:49=2C140 INFO  [org.ovirt.engine.core.bll.InstallerMessage=
s] (VdsDeploy) Installation 172.16.100.2: Stage: Termination
2014-04-06 07:54:49=2C238 INFO  [org.ovirt.engine.core.dal.dbbroker.auditlo=
ghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2325b258=2C Call St=
ack: null=2C Custom Even
t ID: -1=2C Message: Installing Host hosted_engine_2. Stage: Termination.
2014-04-06 07:54:49=2C239 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (VdsD=
eploy) Error during deploy dialog: java.io.IOException: Pipe closed
        at java.io.PipedInputStream.read(PipedInputStream.java:308) [rt.jar=
:1.7.0_51]
        at java.io.PipedInputStream.read(PipedInputStream.java:378) [rt.jar=
:1.7.0_51]
        at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:283) [rt.j=
ar:1.7.0_51]
        at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325) [rt.ja=
r:1.7.0_51]
        at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177) [rt.jar:1.=
7.0_51]
        at java.io.InputStreamReader.read(InputStreamReader.java:184) [rt.j=
ar:1.7.0_51]
        at java.io.BufferedReader.fill(BufferedReader.java:154) [rt.jar:1.7=
.0_51]
        at java.io.BufferedReader.readLine(BufferedReader.java:317) [rt.jar=
:1.7.0_51]
        at java.io.BufferedReader.readLine(BufferedReader.java:382) [rt.jar=
:1.7.0_51]
        at org.ovirt.otopi.dialog.MachineDialogParser.nextEvent(MachineDial=
ogParser.java:355) [otopi.jar:]
        at org.ovirt.otopi.dialog.MachineDialogParser.nextEvent(MachineDial=
ogParser.java:405) [otopi.jar:]
        at org.ovirt.engine.core.bll.VdsDeploy._threadMain(VdsDeploy.java:7=
49) [bll.jar:]
        at org.ovirt.engine.core.bll.VdsDeploy.access$1800(VdsDeploy.java:8=
0) [bll.jar:]
        at org.ovirt.engine.core.bll.VdsDeploy$45.run(VdsDeploy.java:897) [=
bll.jar:]
        at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51]

2014-04-06 07:54:49=2C245 ERROR [org.ovirt.engine.core.bll.VdsDeploy] (org.=
ovirt.thread.pool-6-thread-39) [2325b258] Error during host 172.16.100.2 in=
stall: java.io.IOExc
eption: Pipe closed
        at java.io.PipedInputStream.read(PipedInputStream.java:308) [rt.jar=
:1.7.0_51]
        at java.io.PipedInputStream.read(PipedInputStream.java:378) [rt.jar=
:1.7.0_51]
        at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:283) [rt.j=
ar:1.7.0_51]
        at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:325) [rt.ja=
r:1.7.0_51]
        at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177) [rt.jar:1.=
7.0_51]
        at java.io.InputStreamReader.read(InputStreamReader.java:184) [rt.j=
ar:1.7.0_51]
        at java.io.BufferedReader.fill(BufferedReader.java:154) [rt.jar:1.7=
.0_51]
        at java.io.BufferedReader.readLine(BufferedReader.java:317) [rt.jar=
:1.7.0_51]
        at java.io.BufferedReader.readLine(BufferedReader.java:382) [rt.jar=
:1.7.0_51]
        at org.ovirt.otopi.dialog.MachineDialogParser.nextEvent(MachineDial=
ogParser.java:355) [otopi.jar:]
        at org.ovirt.otopi.dialog.MachineDialogParser.nextEvent(MachineDial=
ogParser.java:405) [otopi.jar:]
        at org.ovirt.engine.core.bll.VdsDeploy._threadMain(VdsDeploy.java:7=
49) [bll.jar:]
        at org.ovirt.engine.core.bll.VdsDeploy.access$1800(VdsDeploy.java:8=
0) [bll.jar:]
        at org.ovirt.engine.core.bll.VdsDeploy$45.run(VdsDeploy.java:897) [=
bll.jar:]
        at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51]

2014-04-06 07:54:49=2C249 ERROR [org.ovirt.engine.core.bll.InstallerMessage=
s] (org.ovirt.thread.pool-6-thread-39) [2325b258] Installation 172.16.100.2=
: Pipe closed

and then a little search turned out an abandoned effort at http://gerrit.ov=
irt.org/#/c/21460/

Since those "unexpectedly closed pipes" seem to be not so easily reproducib=
le=2C should I simply retry? =3B>

Many thanks=2C
Giuseppe

From: giuseppe.ragusa@hotmail.com
To: users@ovirt.org
Subject: Error adding second host to self-hosted-engine
Date: Sun=2C 6 Apr 2014 08:18:36 +0200

=0A=
=0A=
=0A=
Hi all=2C
while reinstalling from scratch on CentOS 6.5 (using oVirt 3.4.0 GA plus la=
test snapshot using a GlusterFS-based NFS storage domain for the self-hoste=
d Engine and a pure GlusterFS domain for the datacenter) the adding of the =
second node (already part of a 3.5.0beta5 GlusterFS cluster) failed at the =
end with:

[ INFO  ] Engine replied: DB Up!Welcome to Health Status!
[ INFO  ] Waiting for the host to become operational in the engine. This ma=
y take several minutes...
[ ERROR ] The VDSM host was found in a failed state. Please check engine an=
d bootstrap installation logs.
[ ERROR ] Unable to add hosted_engine_2 to the manager
[ INFO  ] Enabling and starting HA services
          Hosted Engine successfully set up
[ INFO  ] Stage: Clean up
[ INFO  ] Stage: Pre-termination
[ INFO  ] Stage: Termination

I'm attaching full logs both from the second node and from the engine VM=3B=
 the node was being installed using /etc/ovirt-hosted-engine/answers.conf c=
opied from the first node as config-append file.

Many thanks in advance for any hint/suggestion.

Regards=2C
Giuseppe

 		 	   		   		 	   		  =

--_c98e2d14-f6ef-4327-87fb-e010fc3fa969_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<style><!--
.hmmessage P
{
margin:0px=3B
padding:0px
}
body.hmmessage
{
font-size: 12pt=3B
font-family:Calibri
}
--></style></head>
<body class=3D'hmmessage'><div dir=3D'ltr'>Hi all=2C<br>while going through=
 the logs I found the following in engine.log:<br><br>2014-04-06 07:54:48=
=2C788 INFO =3B [org.ovirt.engine.core.bll.InstallerMessages] (VdsDeplo=
y) Installation 172.16.100.2: Retrieving installation logs to: '/var/log/ov=
irt-engi<br>ne/host-deploy/ovirt-20140406075448-172.16.100.2-2325b258.log'<=
br>2014-04-06 07:54:48=2C793 INFO =3B [org.ovirt.engine.core.dal.dbbrok=
er.auditloghandling.AuditLogDirector] (VdsDeploy) Correlation ID: 2325b258=
=2C Call Stack: null=2C Custom Even<br>t ID: -1=2C Message: Installing Host=
 hosted_engine_2. Retrieving installation logs to: '/var/log/ovirt-engine/h=
ost-deploy/ovirt-20140406075448-172.16.100.2-2325b258.log'.<br>2014-04-06 0=
7:54:49=2C140 INFO =3B [org.ovirt.engine.core.bll.InstallerMessages] (V=
dsDeploy) Installation 172.16.100.2: Stage: Termination<br>2014-04-06 07:54=
:49=2C238 INFO =3B [org.ovirt.engine.core.dal.dbbroker.auditloghandling=
.AuditLogDirector] (VdsDeploy) Correlation ID: 2325b258=2C Call Stack: null=
=2C Custom Even<br>t ID: -1=2C Message: Installing Host hosted_engine_2. St=
age: Termination.<br>2014-04-06 07:54:49=2C239 ERROR [org.ovirt.engine.core=
.bll.VdsDeploy] (VdsDeploy) Error during deploy dialog: java.io.IOException=
: Pipe closed<br> =3B =3B =3B =3B =3B =3B =3B a=
t java.io.PipedInputStream.read(PipedInputStream.java:308) [rt.jar:1.7.0_51=
]<br> =3B =3B =3B =3B =3B =3B =3B at java.io.Pi=
pedInputStream.read(PipedInputStream.java:378) [rt.jar:1.7.0_51]<br> =
=3B =3B =3B =3B =3B =3B =3B at sun.nio.cs.StreamDec=
oder.readBytes(StreamDecoder.java:283) [rt.jar:1.7.0_51]<br> =3B =
=3B =3B =3B =3B =3B =3B at sun.nio.cs.StreamDecoder.imp=
lRead(StreamDecoder.java:325) [rt.jar:1.7.0_51]<br> =3B =3B =3B=
 =3B =3B =3B =3B at sun.nio.cs.StreamDecoder.read(StreamDec=
oder.java:177) [rt.jar:1.7.0_51]<br> =3B =3B =3B =3B =
=3B =3B =3B at java.io.InputStreamReader.read(InputStreamReader.jav=
a:184) [rt.jar:1.7.0_51]<br> =3B =3B =3B =3B =3B =
=3B =3B at java.io.BufferedReader.fill(BufferedReader.java:154) [rt.jar=
:1.7.0_51]<br> =3B =3B =3B =3B =3B =3B =3B at j=
ava.io.BufferedReader.readLine(BufferedReader.java:317) [rt.jar:1.7.0_51]<b=
r> =3B =3B =3B =3B =3B =3B =3B at java.io.Buffe=
redReader.readLine(BufferedReader.java:382) [rt.jar:1.7.0_51]<br> =3B&n=
bsp=3B =3B =3B =3B =3B =3B at org.ovirt.otopi.dialog.Ma=
chineDialogParser.nextEvent(MachineDialogParser.java:355) [otopi.jar:]<br>&=
nbsp=3B =3B =3B =3B =3B =3B =3B at org.ovirt.otopi.=
dialog.MachineDialogParser.nextEvent(MachineDialogParser.java:405) [otopi.j=
ar:]<br> =3B =3B =3B =3B =3B =3B =3B at org.ovi=
rt.engine.core.bll.VdsDeploy._threadMain(VdsDeploy.java:749) [bll.jar:]<br>=
 =3B =3B =3B =3B =3B =3B =3B at org.ovirt.engin=
e.core.bll.VdsDeploy.access$1800(VdsDeploy.java:80) [bll.jar:]<br> =3B&=
nbsp=3B =3B =3B =3B =3B =3B at org.ovirt.engine.core.bl=
l.VdsDeploy$45.run(VdsDeploy.java:897) [bll.jar:]<br> =3B =3B =
=3B =3B =3B =3B =3B at java.lang.Thread.run(Thread.java:744=
) [rt.jar:1.7.0_51]<br><br>2014-04-06 07:54:49=2C245 ERROR [org.ovirt.engin=
e.core.bll.VdsDeploy] (org.ovirt.thread.pool-6-thread-39) [2325b258] Error =
during host 172.16.100.2 install: java.io.IOExc<br>eption: Pipe closed<br>&=
nbsp=3B =3B =3B =3B =3B =3B =3B at java.io.PipedInp=
utStream.read(PipedInputStream.java:308) [rt.jar:1.7.0_51]<br> =3B =
=3B =3B =3B =3B =3B =3B at java.io.PipedInputStream.rea=
d(PipedInputStream.java:378) [rt.jar:1.7.0_51]<br> =3B =3B =3B&=
nbsp=3B =3B =3B =3B at sun.nio.cs.StreamDecoder.readBytes(Strea=
mDecoder.java:283) [rt.jar:1.7.0_51]<br> =3B =3B =3B =3B&nb=
sp=3B =3B =3B at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.ja=
va:325) [rt.jar:1.7.0_51]<br> =3B =3B =3B =3B =3B =
=3B =3B at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:177) [rt.ja=
r:1.7.0_51]<br> =3B =3B =3B =3B =3B =3B =3B at =
java.io.InputStreamReader.read(InputStreamReader.java:184) [rt.jar:1.7.0_51=
]<br> =3B =3B =3B =3B =3B =3B =3B at java.io.Bu=
fferedReader.fill(BufferedReader.java:154) [rt.jar:1.7.0_51]<br> =3B&nb=
sp=3B =3B =3B =3B =3B =3B at java.io.BufferedReader.rea=
dLine(BufferedReader.java:317) [rt.jar:1.7.0_51]<br> =3B =3B =
=3B =3B =3B =3B =3B at java.io.BufferedReader.readLine(Buff=
eredReader.java:382) [rt.jar:1.7.0_51]<br> =3B =3B =3B =3B&=
nbsp=3B =3B =3B at org.ovirt.otopi.dialog.MachineDialogParser.nextE=
vent(MachineDialogParser.java:355) [otopi.jar:]<br> =3B =3B =3B=
 =3B =3B =3B =3B at org.ovirt.otopi.dialog.MachineDialogPar=
ser.nextEvent(MachineDialogParser.java:405) [otopi.jar:]<br> =3B =
=3B =3B =3B =3B =3B =3B at org.ovirt.engine.core.bll.Vd=
sDeploy._threadMain(VdsDeploy.java:749) [bll.jar:]<br> =3B =3B =
=3B =3B =3B =3B =3B at org.ovirt.engine.core.bll.VdsDeploy.=
access$1800(VdsDeploy.java:80) [bll.jar:]<br> =3B =3B =3B =
=3B =3B =3B =3B at org.ovirt.engine.core.bll.VdsDeploy$45.run(V=
dsDeploy.java:897) [bll.jar:]<br> =3B =3B =3B =3B =3B&n=
bsp=3B =3B at java.lang.Thread.run(Thread.java:744) [rt.jar:1.7.0_51]<b=
r><br>2014-04-06 07:54:49=2C249 ERROR [org.ovirt.engine.core.bll.InstallerM=
essages] (org.ovirt.thread.pool-6-thread-39) [2325b258] Installation 172.16=
.100.2: Pipe closed<br><br>and then a little search turned out an abandoned=
 effort at http://gerrit.ovirt.org/#/c/21460/<br><br>Since those "unexpecte=
dly closed pipes" seem to be not so easily reproducible=2C should I simply =
retry? =3B>=3B<br><br>Many thanks=2C<br>Giuseppe<br><br><div><hr id=3D"st=
opSpelling">From: giuseppe.ragusa@hotmail.com<br>To: users@ovirt.org<br>Sub=
ject: Error adding second host to self-hosted-engine<br>Date: Sun=2C 6 Apr =
2014 08:18:36 +0200<br><br>=0A=
=0A=
<style><!--=0A=
.ExternalClass .ecxhmmessage P {=0A=
padding:0px=3B=0A=
}=0A=
=0A=
.ExternalClass body.ecxhmmessage {=0A=
font-size:12pt=3B=0A=
font-family:Calibri=3B=0A=
}=0A=
=0A=
--></style>=0A=
<div dir=3D"ltr">Hi all=2C<br>while reinstalling from scratch on CentOS 6.5=
 (using oVirt 3.4.0 GA plus latest snapshot using a GlusterFS-based NFS sto=
rage domain for the self-hosted Engine and a pure GlusterFS domain for the =
datacenter) the adding of the second node (already part of a 3.5.0beta5 Glu=
sterFS cluster) failed at the end with:<br><br>[ INFO =3B ] Engine repl=
ied: DB Up!Welcome to Health Status!<br>[ INFO =3B ] Waiting for the ho=
st to become operational in the engine. This may take several minutes...<br=
...
[ ERROR ] The VDSM host was found in a failed state. Please check engine a=
nd bootstrap installation logs.<br>[ ERROR ] Unable to add hosted_engine_2 =
to the manager<br>[ INFO =3B ] Enabling and starting HA services<br>&nb=
sp=3B =3B =3B =3B =3B =3B =3B =3B =3B Hoste=
d Engine successfully set up<br>[ INFO =3B ] Stage: Clean up<br>[ INFO&=
nbsp=3B ] Stage: Pre-termination<br>[ INFO =3B ] Stage: Termination<br>=
<br><br>I'm attaching full logs both from the second node and from the engi=
ne VM=3B the node was being installed using /etc/ovirt-hosted-engine/answer=
s.conf copied from the first node as config-append file.<br><br>Many thanks=
 in advance for any hint/suggestion.<br><br>Regards=2C<br>Giuseppe<br><br> =
        	   		  </div></div> 		 	   		  </div></body>
</html>=
--_c98e2d14-f6ef-4327-87fb-e010fc3fa969_--

Re: [Users] Error adding second host to self-hosted-engine

Giuseppe Ragusa