[ovirt-users] node unresponsive after reboot

Campbell McLeay campbell.mcleay at framestore.com
Thu May 5 11:40:45 UTC 2016 

No problem Piotr, I will send you the full logs shortly.

Thanks,

Campbell

On 5 May 2016 at 11:37, Piotr Kliczewski <piotr.kliczewski at gmail.com> wrote:
> Cam,
>
> It is really hard to understand partial logs. Please send me directly
> full logs and I will analyze.
>
> Thanks,
> Piotr
>
> On Mon, May 2, 2016 at 4:35 PM, Cam Mac <iucounu at gmail.com> wrote:
>> Hi Piotr,
>>
>> Attached are the vdsm log, the engine log and the supervdsm log. I've
>> attached them as a .tgz.
>>
>> I noticed it is complaining about configuring an interface in one of the
>> node logs. It shows as up in the engine web GUI though (and on the command
>> line).
>>
>> Thanks for the help.
>>
>> -Cam
>>
>> On Mon, May 2, 2016 at 1:38 PM, Piotr Kliczewski
>> <piotr.kliczewski at gmail.com> wrote:
>>>
>>> Cam,
>>>
>>> Please provide engine and failing vdsm logs.
>>>
>>> Thanks,
>>> Piotr
>>>
>>> On Sun, May 1, 2016 at 4:05 PM, Cam Mac <iucounu at gmail.com> wrote:
>>> > Hi,
>>> >
>>> > I have a two node + engine ovirt setup, and I was having problems
>>> > doing a live migration between nodes. I looked in the vdsm logs and
>>> > noticed selinux errors, so I checked the selinux config, and both the
>>> > ovirt-engine host and one of the nodes had selinux disabled. So I
>>> > thought I would enable it on these two hosts, as it is officially
>>> > supported anyway. I started with the node, and put it into maintenance
>>> > mode, which interestingly, migrated the VMs off to the other node
>>> > without issue. After modifying the selinux config, I then rebooted
>>> > that node, which came back up. I then tried to activate the node but
>>> > it fails and marks it as unresponsive.
>>> >
>>> > ----------8<----------
>>> >
>>> > 2016-04-28 16:34:31,326 INFO
>>> > [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp
>>> > Reactor) [29acb18b] Connecting to
>>> > kvm-ldn-02/172.16.23.12
>>> > 2016-04-28 16:34:31,327 ERROR
>>> > [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand]
>>> > (DefaultQuartzScheduler_Worker-32) [ac322cb] Command
>>> > 'GetCapabilitiesVDSCommand(HostName = kvm-ldn-02,
>>> > VdsIdAndVdsVDSCommandParametersBase:{runAsync='true',
>>> > hostId='b12c0b80-d64d-42fd-8a55-94f92b9ca3aa',
>>> > vds='Host[kvm-ldn-02,b12c0b80-d64d-42fd-8a55-94f92b9ca3aa]'})'
>>> > execution failed:
>>> > org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection
>>> > failed
>>> > 2016-04-28 16:34:31,327 ERROR
>>> > [org.ovirt.engine.core.vdsbroker.HostMonitoring]
>>> > (DefaultQuartzScheduler_Worker-32) [ac322cb] Failure to refresh Vds
>>> > runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException:
>>> > Connection failed
>>> > 2016-04-28 16:34:31,327 ERROR
>>> > [org.ovirt.engine.core.vdsbroker.HostMonitoring]
>>> > (DefaultQuartzScheduler_Worker-32) [ac322cb] Exception:
>>> > org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
>>> > org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection
>>> > failed
>>> >         at
>>> >
>>> > org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:157)
>>> > [vdsbroker.jar:]
>>> >         at
>>> >
>>> > org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:120)
>>> > [vdsbroker.jar:]
>>> >         at
>>> >
>>> > org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65)
>>> > [vdsbroker.jar:]
>>> >         at
>>> > org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33)
>>> > [dal.jar:]
>>> >         at
>>> >
>>> > org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:467)
>>> > [vdsbroker.jar:]
>>> >         at
>>> >
>>> > org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:652)
>>> > [vdsbroker.jar:]
>>> >         at
>>> >
>>> > org.ovirt.engine.core.vdsbroker.HostMonitoring.refreshVdsRunTimeInfo(HostMonitoring.java:119)
>>> > [vdsbroker.jar:]
>>> >         at
>>> >
>>> > org.ovirt.engine.core.vdsbroker.HostMonitoring.refresh(HostMonitoring.java:84)
>>> > [vdsbroker.jar:]
>>> >         at
>>> > org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:227)
>>> > [vdsbroker.jar:]
>>> >         at sun.reflect.GeneratedMethodAccessor120.invoke(Unknown
>>> > Source) [:1.8.0_71]
>>> >         at
>>> >
>>> > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>> > [rt.jar:1.8.0_71]
>>> >         at java.lang.reflect.Method.invoke(Method.java:497)
>>> > [rt.jar:1.8.0_71]
>>> >         at
>>> >
>>> > org.ovirt.engine.core.utils.timer.JobWrapper.invokeMethod(JobWrapper.java:81)
>>> > [scheduler.jar:]
>>> >         at
>>> > org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:52)
>>> > [scheduler.jar:]
>>> >         at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
>>> > [quartz.jar:]
>>> >         at
>>> >
>>> > org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
>>> > [quartz.jar:]
>>> > Caused by: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException:
>>> > Connection failed
>>> >         at
>>> >
>>> > org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:157)
>>> > [vdsm-jsonrpc-java-client.jar:]
>>> >         at
>>> >
>>> > org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:114)
>>> > [vdsm-jsonrpc-java-client.jar:]
>>> >         at
>>> > org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:73)
>>> > [vdsm-jsonrpc-java-client.jar:]
>>> >         at
>>> >
>>> > org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:68)
>>> > [vdsbroker.jar:]
>>> >         at
>>> >
>>> > org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:268)
>>> > [vdsbroker.jar:]
>>> >         at
>>> >
>>> > org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15)
>>> > [vdsbroker.jar:]
>>> >         at
>>> >
>>> > org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:110)
>>> > [vdsbroker.jar:]
>>> >         ... 14 more
>>> >
>>> > ----------8<----------
>>> >
>>> > Any ideas?
>>> >
>>> > Thanks for any help,
>>> >
>>> > Cam
>>> >
>>> > _______________________________________________
>>> > Users mailing list
>>> > Users at ovirt.org
>>> > http://lists.ovirt.org/mailman/listinfo/users
>>> >
>>
>>
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users



-- 
Campbell McLeay · Senior Systems Administrator

London · New York · Los Angeles · Montréal
T  +44 (0)20 7344 8000
19-23 Wells Street, London W1T 3PQ
Twitter · Facebook · framestore.com

More information about the Users mailing list