<div dir="ltr"><div><div><div><div>To update the thread here after some offline discussion with Piotr, the problem was that vdsmd had stopped running and wasn&#39;t able to start. It wasn&#39;t reported in the logs that I could see, but I noticed it after trying to restart it at Piotr&#39;s suggestion, after running a &#39;systemctl&#39;. A &#39;journalctl -xe&#39; reported:<br><br>[root@kvm-ldn-02 vdsm]# journalctl -xe<br>-- Unit vdsmd.service has failed.<br>-- <br>-- The result is failed.<br>May 05 15:15:15 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: vdsm: Running check_is_configured<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> sasldblistusers2[19047]: DIGEST-MD5 common mech free<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: Error:<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: One of the modules is not configured to work with VDSM. <br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: To configure the module use the following: <br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: &#39;vdsm-tool configure [--module module-name]&#39;.<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: If all modules are not configured try to use:<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: &#39;vdsm-tool configure --force&#39;<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: (The force flag will stop the module&#39;s service and start it<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: afterwards automatically to load the new configuration.)<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: Current revision of multipath.conf detected, preserving <br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: libvirt is already configured for vdsm<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: Modules sebool are not configured <br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> vdsmd_init_common.sh[18999]: vdsm: stopped during execute check_is_configured task (task returned with error code 1).<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> systemd[1]: vdsmd.service: control process exited, code=exited status=1<br>May 05 15:15:16 <a href="http://kvm-ldn-02.ldn.org">kvm-ldn-02.ldn.org</a> systemd[1]: Failed to start Virtual Desktop Server Manager.<br>-- Subject: Unit vdsmd.service has failed<br>-- Defined-By: systemd<br>-- Support: <a href="http://lists.freedesktop.org/mailman/listinfo/systemd-devel">http://lists.freedesktop.org/mailman/listinfo/systemd-devel</a><br>-- <br><br></div>So I ran a &#39;vdsm-tool configure --module sebool&#39;, and then I was able to start vdsmd and mom-vdsm. This fixed the connectivity issue and the node is now back online.<br><br></div>Many thanks to Piotr for all his help.<br><br></div>Cheers,<br><br></div>Cam<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, May 2, 2016 at 3:35 PM, Cam Mac <span dir="ltr">&lt;<a href="mailto:iucounu@gmail.com" target="_blank">iucounu@gmail.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Piotr,<div><br></div><div>Attached are the vdsm log, the engine log and the supervdsm log. I&#39;ve attached them as a .tgz. </div><div><br></div><div>I noticed it is complaining about configuring an interface in one of the node logs. It shows as up in the engine web GUI though (and on the command line).</div><div><br></div><div>Thanks for the help.</div><span class="HOEnZb"><font color="#888888"><div><br></div><div>-Cam</div></font></span></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Mon, May 2, 2016 at 1:38 PM, Piotr Kliczewski <span dir="ltr">&lt;<a href="mailto:piotr.kliczewski@gmail.com" target="_blank">piotr.kliczewski@gmail.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Cam,<br>
<br>
Please provide engine and failing vdsm logs.<br>
<br>
Thanks,<br>
Piotr<br>
<div><div><br>
On Sun, May 1, 2016 at 4:05 PM, Cam Mac &lt;<a href="mailto:iucounu@gmail.com" target="_blank">iucounu@gmail.com</a>&gt; wrote:<br>
&gt; Hi,<br>
&gt;<br>
&gt; I have a two node + engine ovirt setup, and I was having problems<br>
&gt; doing a live migration between nodes. I looked in the vdsm logs and<br>
&gt; noticed selinux errors, so I checked the selinux config, and both the<br>
&gt; ovirt-engine host and one of the nodes had selinux disabled. So I<br>
&gt; thought I would enable it on these two hosts, as it is officially<br>
&gt; supported anyway. I started with the node, and put it into maintenance<br>
&gt; mode, which interestingly, migrated the VMs off to the other node<br>
&gt; without issue. After modifying the selinux config, I then rebooted<br>
&gt; that node, which came back up. I then tried to activate the node but<br>
&gt; it fails and marks it as unresponsive.<br>
&gt;<br>
&gt; ----------8&lt;----------<br>
&gt;<br>
&gt; 2016-04-28 16:34:31,326 INFO<br>
&gt; [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp<br>
&gt; Reactor) [29acb18b] Connecting to<br>
&gt; kvm-ldn-02/<a href="http://172.16.23.12" rel="noreferrer" target="_blank">172.16.23.12</a><br>
&gt; 2016-04-28 16:34:31,327 ERROR<br>
&gt; [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand]<br>
&gt; (DefaultQuartzScheduler_Worker-32) [ac322cb] Command<br>
&gt; &#39;GetCapabilitiesVDSCommand(HostName = kvm-ldn-02,<br>
&gt; VdsIdAndVdsVDSCommandParametersBase:{runAsync=&#39;true&#39;,<br>
&gt; hostId=&#39;b12c0b80-d64d-42fd-8a55-94f92b9ca3aa&#39;,<br>
&gt; vds=&#39;Host[kvm-ldn-02,b12c0b80-d64d-42fd-8a55-94f92b9ca3aa]&#39;})&#39;<br>
&gt; execution failed:<br>
&gt; org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection<br>
&gt; failed<br>
&gt; 2016-04-28 16:34:31,327 ERROR<br>
&gt; [org.ovirt.engine.core.vdsbroker.HostMonitoring]<br>
&gt; (DefaultQuartzScheduler_Worker-32) [ac322cb] Failure to refresh Vds<br>
&gt; runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException:<br>
&gt; Connection failed<br>
&gt; 2016-04-28 16:34:31,327 ERROR<br>
&gt; [org.ovirt.engine.core.vdsbroker.HostMonitoring]<br>
&gt; (DefaultQuartzScheduler_Worker-32) [ac322cb] Exception:<br>
&gt; org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:<br>
&gt; org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection<br>
&gt; failed<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:157)<br>
&gt; [vdsbroker.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:120)<br>
&gt; [vdsbroker.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65)<br>
&gt; [vdsbroker.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33)<br>
&gt; [dal.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:467)<br>
&gt; [vdsbroker.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:652)<br>
&gt; [vdsbroker.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.vdsbroker.HostMonitoring.refreshVdsRunTimeInfo(HostMonitoring.java:119)<br>
&gt; [vdsbroker.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.vdsbroker.HostMonitoring.refresh(HostMonitoring.java:84)<br>
&gt; [vdsbroker.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:227)<br>
&gt; [vdsbroker.jar:]<br>
&gt;         at sun.reflect.GeneratedMethodAccessor120.invoke(Unknown<br>
&gt; Source) [:1.8.0_71]<br>
&gt;         at<br>
&gt; sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)<br>
&gt; [rt.jar:1.8.0_71]<br>
&gt;         at java.lang.reflect.Method.invoke(Method.java:497)<br>
&gt; [rt.jar:1.8.0_71]<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.utils.timer.JobWrapper.invokeMethod(JobWrapper.java:81)<br>
&gt; [scheduler.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:52)<br>
&gt; [scheduler.jar:]<br>
&gt;         at org.quartz.core.JobRunShell.run(JobRunShell.java:213)<br>
&gt; [quartz.jar:]<br>
&gt;         at<br>
&gt; org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)<br>
&gt; [quartz.jar:]<br>
&gt; Caused by: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException:<br>
&gt; Connection failed<br>
&gt;         at<br>
&gt; org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:157)<br>
&gt; [vdsm-jsonrpc-java-client.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:114)<br>
&gt; [vdsm-jsonrpc-java-client.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:73)<br>
&gt; [vdsm-jsonrpc-java-client.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.&lt;init&gt;(FutureMap.java:68)<br>
&gt; [vdsbroker.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:268)<br>
&gt; [vdsbroker.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15)<br>
&gt; [vdsbroker.jar:]<br>
&gt;         at<br>
&gt; org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:110)<br>
&gt; [vdsbroker.jar:]<br>
&gt;         ... 14 more<br>
&gt;<br>
&gt; ----------8&lt;----------<br>
&gt;<br>
&gt; Any ideas?<br>
&gt;<br>
&gt; Thanks for any help,<br>
&gt;<br>
&gt; Cam<br>
&gt;<br>
</div></div>&gt; _______________________________________________<br>
&gt; Users mailing list<br>
&gt; <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
&gt; <a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
&gt;<br>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>