<div dir="ltr"><div><div><div><div>To update the thread here after some offline discussion with Piotr, the problem was that vdsmd had stopped running and wasn't able to start. It wasn't reported in the logs that I could see, but I noticed it after trying to restart it at Piotr's suggestion, after running a 'systemctl'. A 'journalctl -xe' reported:<br><br>[root@kvm-ldn-02 vdsm]# journalctl -xe<br>-- Unit vdsmd.service has failed.<br>-- <br>-- The result is failed.<br>May 05 15:15:15 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: vdsm: Running check_is_configured<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> sasldblistusers2[19047]: DIGEST-MD5 common mech free<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: Error:<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: One of the modules is not configured to work with VDSM. <br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: To configure the module use the following: <br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: 'vdsm-tool configure [--module module-name]'.<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: If all modules are not configured try to use:<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: 'vdsm-tool configure --force'<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: (The force flag will stop the module's service and start it<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: afterwards automatically to load the new configuration.)<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: Current revision of multipath.conf detected, preserving <br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: libvirt is already configured for vdsm<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: Modules sebool are not configured <br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: vdsm: stopped during execute check_is_configured task (task returned with error code 1).<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> systemd[1]: vdsmd.service: control process exited, code=exited status=1<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> systemd[1]: Failed to start Virtual Desktop Server Manager.<br>-- Subject: Unit vdsmd.service has failed<br>-- Defined-By: systemd<br>-- Support: <a href="http://lists.freedesktop.org/mailman/listinfo/systemd-devel">http://lists.freedesktop.org/mailman/listinfo/systemd-devel</a><br>-- <br><br></div>So I ran a 'vdsm-tool configure --module sebool', and then I was able to start vdsmd and mom-vdsm. This fixed the connectivity issue and the node is now back online.<br><br></div>Many thanks to Piotr for all his help.<br><br></div>Cheers,<br><br></div>Cam<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, May 2, 2016 at 3:35 PM, Cam Mac <span dir="ltr"><<a href="mailto:iucounu@gmail.com" target="_blank">iucounu@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Piotr,<div><br></div><div>Attached are the vdsm log, the engine log and the supervdsm log. I've attached them as a .tgz. </div><div><br></div><div>I noticed it is complaining about configuring an interface in one of the node logs. It shows as up in the engine web GUI though (and on the command line).</div><div><br></div><div>Thanks for the help.</div><span class="HOEnZb"><font color="#888888"><div><br></div><div>-Cam</div></font></span></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Mon, May 2, 2016 at 1:38 PM, Piotr Kliczewski <span dir="ltr"><<a href="mailto:piotr.kliczewski@gmail.com" target="_blank">piotr.kliczewski@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Cam,<br>
<br>
Please provide engine and failing vdsm logs.<br>
<br>
Thanks,<br>
Piotr<br>
<div><div><br>
On Sun, May 1, 2016 at 4:05 PM, Cam Mac <<a href="mailto:iucounu@gmail.com" target="_blank">iucounu@gmail.com</a>> wrote:<br>
> Hi,<br>
><br>
> I have a two node + engine ovirt setup, and I was having problems<br>
> doing a live migration between nodes. I looked in the vdsm logs and<br>
> noticed selinux errors, so I checked the selinux config, and both the<br>
> ovirt-engine host and one of the nodes had selinux disabled. So I<br>
> thought I would enable it on these two hosts, as it is officially<br>
> supported anyway. I started with the node, and put it into maintenance<br>
> mode, which interestingly, migrated the VMs off to the other node<br>
> without issue. After modifying the selinux config, I then rebooted<br>
> that node, which came back up. I then tried to activate the node but<br>
> it fails and marks it as unresponsive.<br>
><br>
> ----------8<----------<br>
><br>
> 2016-04-28 16:34:31,326 INFO<br>
> [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp<br>
> Reactor) [29acb18b] Connecting to<br>
> kvm-ldn-02/<a href="http://172.16.23.12" rel="noreferrer" target="_blank">172.16.23.12</a><br>
> 2016-04-28 16:34:31,327 ERROR<br>
> [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand]<br>
> (DefaultQuartzScheduler_Worker-32) [ac322cb] Command<br>
> 'GetCapabilitiesVDSCommand(HostName = kvm-ldn-02,<br>
> VdsIdAndVdsVDSCommandParametersBase:{runAsync='true',<br>
> hostId='b12c0b80-d64d-42fd-8a55-94f92b9ca3aa',<br>
> vds='Host[kvm-ldn-02,b12c0b80-d64d-42fd-8a55-94f92b9ca3aa]'})'<br>
> execution failed:<br>
> org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection<br>
> failed<br>
> 2016-04-28 16:34:31,327 ERROR<br>
> [org.ovirt.engine.core.vdsbroker.HostMonitoring]<br>
> (DefaultQuartzScheduler_Worker-32) [ac322cb] Failure to refresh Vds<br>
> runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException:<br>
> Connection failed<br>
> 2016-04-28 16:34:31,327 ERROR<br>
> [org.ovirt.engine.core.vdsbroker.HostMonitoring]<br>
> (DefaultQuartzScheduler_Worker-32) [ac322cb] Exception:<br>
> org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:<br>
> org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection<br>
> failed<br>
> at<br>
> org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:157)<br>
> [vdsbroker.jar:]<br>
> at<br>
> org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:120)<br>
> [vdsbroker.jar:]<br>
> at<br>
> org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65)<br>
> [vdsbroker.jar:]<br>
> at<br>
> org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33)<br>
> [dal.jar:]<br>
> at<br>
> org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:467)<br>
> [vdsbroker.jar:]<br>
> at<br>
> org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:652)<br>
> [vdsbroker.jar:]<br>
> at<br>
> org.ovirt.engine.core.vdsbroker.HostMonitoring.refreshVdsRunTimeInfo(HostMonitoring.java:119)<br>
> [vdsbroker.jar:]<br>
> at<br>
> org.ovirt.engine.core.vdsbroker.HostMonitoring.refresh(HostMonitoring.java:84)<br>
> [vdsbroker.jar:]<br>
> at<br>
> org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:227)<br>
> [vdsbroker.jar:]<br>
> at sun.reflect.GeneratedMethodAccessor120.invoke(Unknown<br>
> Source) [:1.8.0_71]<br>
> at<br>
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)<br>
> [rt.jar:1.8.0_71]<br>
> at java.lang.reflect.Method.invoke(Method.java:497)<br>
> [rt.jar:1.8.0_71]<br>
> at<br>
> org.ovirt.engine.core.utils.timer.JobWrapper.invokeMethod(JobWrapper.java:81)<br>
> [scheduler.jar:]<br>
> at<br>
> org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:52)<br>
> [scheduler.jar:]<br>
> at org.quartz.core.JobRunShell.run(JobRunShell.java:213)<br>
> [quartz.jar:]<br>
> at<br>
> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)<br>
> [quartz.jar:]<br>
> Caused by: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException:<br>
> Connection failed<br>
> at<br>
> org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:157)<br>
> [vdsm-jsonrpc-java-client.jar:]<br>
> at<br>
> org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:114)<br>
> [vdsm-jsonrpc-java-client.jar:]<br>
> at<br>
> org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:73)<br>
> [vdsm-jsonrpc-java-client.jar:]<br>
> at<br>
> org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:68)<br>
> [vdsbroker.jar:]<br>
> at<br>
> org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:268)<br>
> [vdsbroker.jar:]<br>
> at<br>
> org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15)<br>
> [vdsbroker.jar:]<br>
> at<br>
> org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:110)<br>
> [vdsbroker.jar:]<br>
> ... 14 more<br>
><br>
> ----------8<----------<br>
><br>
> Any ideas?<br>
><br>
> Thanks for any help,<br>
><br>
> Cam<br>
><br>
</div></div>> _______________________________________________<br>
> Users mailing list<br>
> <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
> <a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
><br>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>