[ovirt-users] node unresponsive after reboot

[Piotr Kliczewski]

Cam,

Please provide engine and failing vdsm logs.

Thanks,
Piotr

On Sun, May 1, 2016 at 4:05 PM, Cam Mac <iucounu at gmail.com> wrote:
> Hi,
>
> I have a two node + engine ovirt setup, and I was having problems
> doing a live migration between nodes. I looked in the vdsm logs and
> noticed selinux errors, so I checked the selinux config, and both the
> ovirt-engine host and one of the nodes had selinux disabled. So I
> thought I would enable it on these two hosts, as it is officially
> supported anyway. I started with the node, and put it into maintenance
> mode, which interestingly, migrated the VMs off to the other node
> without issue. After modifying the selinux config, I then rebooted
> that node, which came back up. I then tried to activate the node but
> it fails and marks it as unresponsive.
>
> ----------8<----------
>
> 2016-04-28 16:34:31,326 INFO
> [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp
> Reactor) [29acb18b] Connecting to
> kvm-ldn-02/172.16.23.12
> 2016-04-28 16:34:31,327 ERROR
> [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand]
> (DefaultQuartzScheduler_Worker-32) [ac322cb] Command
> 'GetCapabilitiesVDSCommand(HostName = kvm-ldn-02,
> VdsIdAndVdsVDSCommandParametersBase:{runAsync='true',
> hostId='b12c0b80-d64d-42fd-8a55-94f92b9ca3aa',
> vds='Host[kvm-ldn-02,b12c0b80-d64d-42fd-8a55-94f92b9ca3aa]'})'
> execution failed:
> org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection
> failed
> 2016-04-28 16:34:31,327 ERROR
> [org.ovirt.engine.core.vdsbroker.HostMonitoring]
> (DefaultQuartzScheduler_Worker-32) [ac322cb] Failure to refresh Vds
> runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException:
> Connection failed
> 2016-04-28 16:34:31,327 ERROR
> [org.ovirt.engine.core.vdsbroker.HostMonitoring]
> (DefaultQuartzScheduler_Worker-32) [ac322cb] Exception:
> org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
> org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection
> failed
>         at
> org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:157)
> [vdsbroker.jar:]
>         at
> org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:120)
> [vdsbroker.jar:]
>         at
> org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65)
> [vdsbroker.jar:]
>         at
> org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33)
> [dal.jar:]
>         at
> org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:467)
> [vdsbroker.jar:]
>         at
> org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:652)
> [vdsbroker.jar:]
>         at
> org.ovirt.engine.core.vdsbroker.HostMonitoring.refreshVdsRunTimeInfo(HostMonitoring.java:119)
> [vdsbroker.jar:]
>         at
> org.ovirt.engine.core.vdsbroker.HostMonitoring.refresh(HostMonitoring.java:84)
> [vdsbroker.jar:]
>         at
> org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:227)
> [vdsbroker.jar:]
>         at sun.reflect.GeneratedMethodAccessor120.invoke(Unknown
> Source) [:1.8.0_71]
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [rt.jar:1.8.0_71]
>         at java.lang.reflect.Method.invoke(Method.java:497)
> [rt.jar:1.8.0_71]
>         at
> org.ovirt.engine.core.utils.timer.JobWrapper.invokeMethod(JobWrapper.java:81)
> [scheduler.jar:]
>         at
> org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:52)
> [scheduler.jar:]
>         at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
> [quartz.jar:]
>         at
> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
> [quartz.jar:]
> Caused by: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException:
> Connection failed
>         at
> org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:157)
> [vdsm-jsonrpc-java-client.jar:]
>         at
> org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:114)
> [vdsm-jsonrpc-java-client.jar:]
>         at
> org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:73)
> [vdsm-jsonrpc-java-client.jar:]
>         at
> org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:68)
> [vdsbroker.jar:]
>         at
> org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:268)
> [vdsbroker.jar:]
>         at
> org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15)
> [vdsbroker.jar:]
>         at
> org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:110)
> [vdsbroker.jar:]
>         ... 14 more
>
> ----------8<----------
>
> Any ideas?
>
> Thanks for any help,
>
> Cam
>
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>