<div dir="ltr"><br><br><div class="gmail_quote"><div dir="ltr">On Mon, 23 Oct 2017 at 21:51 Martin Perina <<a href="mailto:mperina@redhat.com">mperina@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Mon, Oct 23, 2017 at 6:21 PM, Yaniv Kaul <span dir="ltr"><<a href="mailto:ykaul@redhat.com" target="_blank">ykaul@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">I'm failing to install hosts on o-s-t on Master.<div>What worries me is not that I'm failing (though it is a bit of a surprise, perhaps something I've done?), but that there are no logs around it.</div></div></blockquote></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><br><div style="font-family:arial,helvetica,sans-serif;display:inline" class="gmail_default">Please see my response below, but which logs are you </div><div style="font-family:arial,helvetica,sans-serif;display:inline" class="gmail_default">missing? <br></div></div></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><br></div><div>/var/log/ovirt-engine/host-deploy is empty and so is /var/log/ovirt-engine/ansible.</div></div></blockquote></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><br><div style="font-family:arial,helvetica,sans-serif;display:inline" class="gmail_default">Logs for both part of host installation (host-deploy and ansible) are</div> <div style="font-family:arial,helvetica,sans-serif;display:inline" class="gmail_default">in /var/log/ovirt-engine/host-deploy, but they are created once each part successfully started.<br></div></div></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><br></div><div><br></div><div>All I'm seeing:</div><div><span class="m_-2910215704418962989m_-839070756673954777gmail-drawer-pf-notification-message">Host lago-basic-suite-master-host-0 installation failed. Unexpected connection termination.</span><br></div><div><br></div><div>Server.log:</div><div><div>2017-10-23 12:16:33,041-04 WARN [org.apache.sshd.client.session.ClientSessionImpl] (sshd-SshClient[346b54f3]-nio2-thread-2) Exception caught: java.io.IOException: Connection timed out</div><div> at sun.nio.ch.FileDispatcherImpl.write0(Native Method) [rt.jar:1.8.0_151]</div><div> at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:47) [rt.jar:1.8.0_151]</div><div> at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:93) [rt.jar:1.8.0_151]</div><div> at sun.nio.ch.IOUtil.write(IOUtil.java:65) [rt.jar:1.8.0_151]</div><div> at <a href="http://sun.nio.ch" target="_blank">sun.nio.ch</a>.UnixAsynchronousSocketChannelImpl.finishWrite(UnixAsynchronousSocketChannelImpl.java:582) [rt.jar:1.8.0_151]</div><div> at <a href="http://sun.nio.ch" target="_blank">sun.nio.ch</a>.UnixAsynchronousSocketChannelImpl.finish(UnixAsynchronousSocketChannelImpl.java:190) [rt.jar:1.8.0_151]</div><div> at <a href="http://sun.nio.ch" target="_blank">sun.nio.ch</a>.UnixAsynchronousSocketChannelImpl.onEvent(UnixAsynchronousSocketChannelImpl.java:213) [rt.jar:1.8.0_151]</div><div> at sun.nio.ch.EPollPort$EventHandlerTask.run(EPollPort.java:293) [rt.jar:1.8.0_151]</div><div> at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_151]</div></div><div><br></div><div><br></div><div>Engine.log:</div><div><br></div><div><div>2017-10-23 12:16:33,046-04 DEBUG [org.ovirt.engine.core.uutils.ssh.SSHClient] (EE-ManagedThreadFactory-engine-Thread-1) [83a00e1] Executed: 'umask 0077; MYTMP="$(TMPDIR="${OVIRT_TMPDIR}" mktemp -d -t ovirt-XXXXX</div><div>XXXXX)"; trap "chmod -R u+rwX \"${MYTMP}\" > /dev/null 2>&1; rm -fr \"${MYTMP}\" > /dev/null 2>&1" 0; tar --warning=no-timestamp -C "${MYTMP}" -x && "${MYTMP}"/ovirt-host-deploy DIALOG/dialect=str:machine DIALO</div><div>G/customization=bool:True'</div><div>2017-10-23 12:16:33,056-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (VdsDeploy) [83a00e1] Error during deploy dialog</div></div></div></blockquote></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><br><div style="font-family:arial,helvetica,sans-serif;display:inline" class="gmail_default">So this means that SSH connection to the host using which the host deploy should be started failed. The reason is above in server.log, that SSH connection timed out. This error appears even before host-deploy is executed, that's we don't have any host-deploy log created.<br></div> </div></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>2017-10-23 12:16:33,057-04 DEBUG [org.ovirt.engine.core.uutils.ssh.SSHDialog] (EE-ManagedThreadFactory-engine-Thread-1) [83a00e1] execute leave</div><div>2017-10-23 12:16:33,057-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-1) [83a00e1] Error during host lago-basic-suite-master-host-0 install</div><div>2017-10-23 12:16:33,065-04 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-1) [83a00e1] EVENT_ID: VDS_INSTALL_IN_PROGRESS_ERROR(511), An error has occurred during installation of Host lago-basic-suite-master-host-0: Unexpected connection termination.</div></div></div></blockquote></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><br><div style="font-family:arial,helvetica,sans-serif;display:inline" class="gmail_default">Here is an ERROR event in audit_log for above issue.<br><br></div></div></div></div></div></blockquote><div>perhaps reposync was stalling the rpm installation/download and this triggered the ssh timeout? <br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><div><div style="font-family:arial,helvetica,sans-serif;display:inline" class="gmail_default"></div> </div></div></div></div><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>2017-10-23 12:16:33,065-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.VdsDeployBase] (EE-ManagedThreadFactory-engine-Thread-1) [83a00e1] Error during host lago-basic-suite-master-host-0 install, preferring first exception: Unexpected connection termination</div><div>2017-10-23 12:16:33,065-04 ERROR [org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand] (EE-ManagedThreadFactory-engine-Thread-1) [83a00e1] Host installation failed for host 'c4138375-aa53-4c36-8907-306803ae4282', 'lago-basic-suite-master-host-0': Unexpected connection termination</div></div><div><br></div></div>
<br>_______________________________________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org" target="_blank">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/devel</a><br></blockquote></div></div></div>
_______________________________________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org" target="_blank">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/devel</a></blockquote></div></div>