<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">Try restarting vdsmd from the shell, “systemctl restart vdsmd”.<div class=""><br class=""></div><div class=""><br class=""><div><blockquote type="cite" class=""><hr style="border:none;border-top:solid #B5C4DF 1.0pt;padding:0 0 0 0;margin:10px 0 5px 0;" class=""><span style="margin: -1.3px 0.0px 0.0px 0.0px" id="RwhHeaderAttributes" class=""><font face="Helvetica" size="4" color="#000000" style="font: 13.0px Helvetica; color: #000000" class=""><b class="">From:</b> Artem Tambovskiy <<a href="mailto:artem.tambovskiy@gmail.com" class="">artem.tambovskiy@gmail.com</a>></font></span><br class="">
<span style="margin: -1.3px 0.0px 0.0px 0.0px" class=""><font face="Helvetica" size="4" color="#000000" style="font: 13.0px Helvetica; color: #000000" class=""><b class="">Subject:</b> [ovirt-users] Non-responsive host, VM's are still running - how to resolve?</font></span><br class="">
<span style="margin: -1.3px 0.0px 0.0px 0.0px" class=""><font face="Helvetica" size="4" color="#000000" style="font: 13.0px Helvetica; color: #000000" class=""><b class="">Date:</b> November 14, 2017 at 11:23:32 AM CST</font></span><br class="">
<span style="margin: -1.3px 0.0px 0.0px 0.0px" class=""><font face="Helvetica" size="4" color="#000000" style="font: 13.0px Helvetica; color: #000000" class=""><b class="">To:</b> users</font></span><br class="">
<br class="Apple-interchange-newline"><div class=""><div dir="ltr" class="">Apparently, i lost the host which was running hosted-engine and another 4 VM's exactly during migration of second host from bare-metal to second host in the cluster. For some reason first host entered the "Non reponsive" state. The interesting thing is that hosted-engine and all other VM's up and running, so its like a communication problem between hosted-engine and host. <div class=""><br class=""></div><div class="">The engine.log at hosted-engine is full of following messages:</div><div class=""><br class=""></div><div class=""><div class="">2017-11-14 17:06:43,158Z INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to ovirt2/<a href="http://80.239.162.106/" class="">80.239.162.106</a></div><div class="">2017-11-14 17:06:43,159Z ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetAllVmStatsVDSCommand] (DefaultQuartzScheduler9) [50938c3] Command 'GetAllVmStatsVDSCommand(HostName = <a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>, VdsIdVDSCommandParametersBase:{runAsync='true', hostId='3970247c-69eb-4bd8-b263-9100703a8243'})' execution failed: java.net.NoRouteToHostException: No route to host</div><div class="">2017-11-14 17:06:43,159Z INFO [org.ovirt.engine.core.vdsbroker.monitoring.PollVmStatsRefresher] (DefaultQuartzScheduler9) [50938c3] Failed to fetch vms info for host '<a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>' - skipping VMs monitoring.</div><div class="">2017-11-14 17:06:45,929Z INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to ovirt2/<a href="http://80.239.162.106/" class="">80.239.162.106</a></div><div class="">2017-11-14 17:06:45,930Z ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler2) [6080f1cc] Command 'GetCapabilitiesVDSCommand(HostName = <a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='3970247c-69eb-4bd8-b263-9100703a8243', vds='Host[<a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>,3970247c-69eb-4bd8-b263-9100703a8243]'})' execution failed: java.net.NoRouteToHostException: No route to host</div><div class="">2017-11-14 17:06:45,930Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler2) [6080f1cc] Failure to refresh host '<a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>' runtime info: java.net.NoRouteToHostException: No route to host</div><div class="">2017-11-14 17:06:48,933Z INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to ovirt2/<a href="http://80.239.162.106/" class="">80.239.162.106</a></div><div class="">2017-11-14 17:06:48,934Z ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler6) [1a64dfea] Command 'GetCapabilitiesVDSCommand(HostName = <a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='3970247c-69eb-4bd8-b263-9100703a8243', vds='Host[<a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>,3970247c-69eb-4bd8-b263-9100703a8243]'})' execution failed: java.net.NoRouteToHostException: No route to host</div><div class="">2017-11-14 17:06:48,934Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler6) [1a64dfea] Failure to refresh host '<a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>' runtime info: java.net.NoRouteToHostException: No route to host</div><div class="">2017-11-14 17:06:50,931Z INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to ovirt2/<a href="http://80.239.162.106/" class="">80.239.162.106</a></div><div class="">2017-11-14 17:06:50,932Z ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SpmStatusVDSCommand] (DefaultQuartzScheduler4) [6b19d168] Command 'SpmStatusVDSCommand(HostName = <a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>, SpmStatusVDSCommandParameters:{runAsync='true', hostId='3970247c-69eb-4bd8-b263-9100703a8243', storagePoolId='5a044257-02ec-0382-0243-0000000001f2'})' execution failed: java.net.NoRouteToHostException: No route to host</div><div class="">2017-11-14 17:06:50,939Z INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to ovirt2/<a href="http://80.239.162.106/" class="">80.239.162.106</a></div><div class="">2017-11-14 17:06:50,940Z ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand] (DefaultQuartzScheduler4) [6b19d168] IrsBroker::Failed::GetStoragePoolInfoVDS</div><div class="">2017-11-14 17:06:50,940Z ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.GetStoragePoolInfoVDSCommand] (DefaultQuartzScheduler4) [6b19d168] Command 'GetStoragePoolInfoVDSCommand( GetStoragePoolInfoVDSCommandParameters:{runAsync='true', storagePoolId='5a044257-02ec-0382-0243-0000000001f2', ignoreFailoverLimit='true'})' execution failed: IRSProtocolException: </div><div class="">2017-11-14 17:06:51,937Z INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to ovirt2/<a href="http://80.239.162.106/" class="">80.239.162.106</a></div><div class="">2017-11-14 17:06:51,938Z ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler7) [7f23a3bd] Command 'GetCapabilitiesVDSCommand(HostName = <a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='3970247c-69eb-4bd8-b263-9100703a8243', vds='Host[<a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>,3970247c-69eb-4bd8-b263-9100703a8243]'})' execution failed: java.net.NoRouteToHostException: No route to host</div><div class="">2017-11-14 17:06:51,938Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler7) [7f23a3bd] Failure to refresh host '<a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>' runtime info: java.net.NoRouteToHostException: No route to host</div><div class="">2017-11-14 17:06:54,941Z INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [] Connecting to ovirt2/<a href="http://80.239.162.106/" class="">80.239.162.106</a></div><div class="">2017-11-14 17:06:54,942Z ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler2) [7a769f6c] Command 'GetCapabilitiesVDSCommand(HostName = <a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='3970247c-69eb-4bd8-b263-9100703a8243', vds='Host[<a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>,3970247c-69eb-4bd8-b263-9100703a8243]'})' execution failed: java.net.NoRouteToHostException: No route to host</div><div class="">2017-11-14 17:06:54,942Z ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (DefaultQuartzScheduler2) [7a769f6c] Failure to refresh host '<a href="http://ovirt2.telia.ru/" class="">ovirt2.telia.ru</a>' runtime info: java.net.NoRouteToHostException: No route to host</div></div><div class=""><br class=""></div><div class="">Its a bit weird, since I can ping and login via ssh to the host from hosted-engine with no problem. I have added second host to the cluster, but it not running hosted-engine. Any suggestion for the further steps? Just reboot the host and hope for the best?</div><div class=""><br class=""></div><div class="">Regards,</div><div class="">Artem</div></div>
_______________________________________________<br class="">Users mailing list<br class=""><a href="mailto:Users@ovirt.org" class="">Users@ovirt.org</a><br class="">http://lists.ovirt.org/mailman/listinfo/users<br class=""></div></blockquote></div><br class=""></div></body></html>