<div dir="ltr"><div class="gmail_default" style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Oct 23, 2017 at 9:38 PM, Roy Golan <span dir="ltr"><<a href="mailto:rgolan@redhat.com" target="_blank">rgolan@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><br><br><div class="gmail_quote"><div dir="ltr">On Mon, 23 Oct 2017 at 21:51 Martin Perina <<a href="mailto:mperina@redhat.com" target="_blank">mperina@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Mon, Oct 23, 2017 at 6:21 PM, Yaniv Kaul <span dir="ltr"><<a href="mailto:ykaul@redhat.com" target="_blank">ykaul@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">I'm failing to install hosts on o-s-t on Master.<div>What worries me is not that I'm failing (though it is a bit of a surprise, perhaps something I've done?), but that there are no logs around it.</div></div></blockquote></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><br><div>Please see my response below, but which logs are you </div><div>missing? <br></div></div></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><br></div><div>/var/log/ovirt-engine/host-<wbr>deploy is empty and so is /var/log/ovirt-engine/ansible.</div></div></blockquote></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><br><div>Logs for both part of host installation (host-deploy and ansible) are</div> <div>in /var/log/ovirt-engine/host-<wbr>deploy, but they are created once each part successfully started.<br></div></div></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><br></div><div><br></div><div>All I'm seeing:</div><div><span class="m_8568114508731165536m_-2910215704418962989m_-839070756673954777gmail-drawer-pf-notification-message">Host lago-basic-suite-master-host-0 installation failed. Unexpected connection termination.</span><br></div><div><br></div><div>Server.log:</div><div><div>2017-10-23 12:16:33,041-04 WARN [org.apache.sshd.client.<wbr>session.ClientSessionImpl] (sshd-SshClient[346b54f3]-<wbr>nio2-thread-2) Exception caught: java.io.IOException: Connection timed out</div><div> at sun.nio.ch.FileDispatcherImpl.<wbr>write0(Native Method) [rt.jar:1.8.0_151]</div><div> at sun.nio.ch.SocketDispatcher.<wbr>write(SocketDispatcher.java:<wbr>47) [rt.jar:1.8.0_151]</div><div> at sun.nio.ch.IOUtil.<wbr>writeFromNativeBuffer(IOUtil.<wbr>java:93) [rt.jar:1.8.0_151]</div><div> at sun.nio.ch.IOUtil.write(<wbr>IOUtil.java:65) [rt.jar:1.8.0_151]</div><div> at <a href="http://sun.nio.ch" target="_blank">sun.nio.ch</a>.<wbr>UnixAsynchronousSocketChannelI<wbr>mpl.finishWrite(<wbr>UnixAsynchronousSocketChannelI<wbr>mpl.java:582) [rt.jar:1.8.0_151]</div><div> at <a href="http://sun.nio.ch" target="_blank">sun.nio.ch</a>.<wbr>UnixAsynchronousSocketChannelI<wbr>mpl.finish(<wbr>UnixAsynchronousSocketChannelI<wbr>mpl.java:190) [rt.jar:1.8.0_151]</div><div> at <a href="http://sun.nio.ch" target="_blank">sun.nio.ch</a>.<wbr>UnixAsynchronousSocketChannelI<wbr>mpl.onEvent(<wbr>UnixAsynchronousSocketChannelI<wbr>mpl.java:213) [rt.jar:1.8.0_151]</div><div> at sun.nio.ch.EPollPort$<wbr>EventHandlerTask.run(<wbr>EPollPort.java:293) [rt.jar:1.8.0_151]</div><div> at java.lang.Thread.run(Thread.<wbr>java:748) [rt.jar:1.8.0_151]</div></div><div><br></div><div><br></div><div>Engine.log:</div><div><br></div><div><div>2017-10-23 12:16:33,046-04 DEBUG [org.ovirt.engine.core.uutils.<wbr>ssh.SSHClient] (EE-ManagedThreadFactory-<wbr>engine-Thread-1) [83a00e1] Executed: 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_<wbr>TMPDIR}" mktemp -d -t ovirt-XXXXX</div><div>XXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALO</div><div>G/customization=bool:True'</div><div>2017-10-23 12:16:33,056-04 ERROR [org.ovirt.engine.core.bll.<wbr>hostdeploy.VdsDeployBase] (VdsDeploy) [83a00e1] Error during deploy dialog</div></div></div></blockquote></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><br><div>So this means that SSH connection to the host using which the host deploy should be started failed. The reason is above in server.log, that SSH connection timed out. This error appears even before host-deploy is executed, that's we don't have any host-deploy log created.<br></div> </div></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>2017-10-23 12:16:33,057-04 DEBUG [org.ovirt.engine.core.uutils.<wbr>ssh.SSHDialog] (EE-ManagedThreadFactory-<wbr>engine-Thread-1) [83a00e1] execute leave</div><div>2017-10-23 12:16:33,057-04 ERROR [org.ovirt.engine.core.bll.<wbr>hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-<wbr>engine-Thread-1) [83a00e1] Error during host lago-basic-suite-master-host-0 install</div><div>2017-10-23 12:16:33,065-04 ERROR [org.ovirt.engine.core.dal.<wbr>dbbroker.auditloghandling.<wbr>AuditLogDirector] (EE-ManagedThreadFactory-<wbr>engine-Thread-1) [83a00e1] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(<wbr>511), An error has occurred during installation of Host lago-basic-suite-master-host-<wbr>0: Unexpected connection termination.</div></div></div></blockquote></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><br><div>Here is an ERROR event in audit_log for above issue.<br><br></div></div></div></div></div></blockquote><div>perhaps reposync was stalling the rpm installation/download and this triggered the ssh timeout?</div></div></div></blockquote><div><br><div style="font-family:arial,helvetica,sans-serif;display:inline" class="gmail_default">As the host-deploy log hasn't been created, I'd say that this is the initial connection timeout, so engine couldn't connect to the host at all. We would need to investigate the host if it was some firewall issues or sshd was not running or something else.<br></div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_quote"><div> <br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><div></div> </div></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>2017-10-23 12:16:33,065-04 ERROR [org.ovirt.engine.core.bll.<wbr>hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-<wbr>engine-Thread-1) [83a00e1] Error during host lago-basic-suite-master-host-0 install, preferring first exception: Unexpected connection termination</div><div>2017-10-23 12:16:33,065-04 ERROR [org.ovirt.engine.core.bll.<wbr>hostdeploy.<wbr>InstallVdsInternalCommand] (EE-ManagedThreadFactory-<wbr>engine-Thread-1) [83a00e1] Host installation failed for host 'c4138375-aa53-4c36-8907-<wbr>306803ae4282', 'lago-basic-suite-master-host-<wbr>0': Unexpected connection termination</div></div><div><br></div></div>
<br>______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org" target="_blank">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/devel</a><br></blockquote></div></div></div>
______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org" target="_blank">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/devel</a></blockquote></div></div>
</blockquote></div><br></div></div>