[ OST Failure Report ] [ oVirt Master (vdsm) ] [ 08-03-2019 ] [ 002_bootstrap.verify_add_hosts ]

Hi, We are failing vdsm project on master branch with test 002_bootstrap.verify_add_hosts CQ identified this patch as the root cause: https://gerrit.ovirt.org/#/c/97381/ - virt: In FIPS mode, use SASL auth instead of qemu passwords Can you please take a look? build logs: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13317/artifac... <error> host: 2019-03-07 17:37:38,839-0500 ERROR (MainThread) [vds] Exception raised (vdsmd:159) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 157, in run serve_clients(log) File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 103, in serve_clients from vdsm.clientIF import clientIF # must import after config is read File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py", line 64, in <module> from vdsm.virt import vm File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 81, in <module> from vdsm.virt import saslpasswd2 ImportError: cannot import name saslpasswd2 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping threads (vdsmd:161) 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping <MonitorObserver(mpathlistener, started daemon 139815311881984)> (vdsmd:164) engine: 2019-03-07 17:37:47,780-05 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Command 'G etCapabilitiesAsyncVDSCommand(HostName = lago-basic-suite-master-host-1, VdsIdAndVdsVDSCommandParametersBase:{hostId='5d685bce-ada7-4730-975c-45d30afc0a8b', vds='Host[lago-b asic-suite-master-host-1,5d685bce-ada7-4730-975c-45d30afc0a8b]'})' execution failed: java.net.ConnectException: Connection refused 2019-03-07 17:37:47,780-05 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Exception: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:172) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVdsCommandWithNetworkEvent(VdsBrokerCommand.java:135) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:111) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65) [vdsbroker.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.DefaultVdsCommandExecutor.execute(DefaultVdsCommandExecutor.java:14) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:396) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand$$super(Unknown Source) [vdsbroker.jar:] at sun.reflect.GeneratedMethodAccessor252.invoke(Unknown Source) [:1.8.0_201] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at org.jboss.weld.interceptor.proxy.TerminalAroundInvokeInvocationContext.proceedInternal(TerminalAroundInvokeInvocationContext.java:51) [weld-core-impl-3.0.5.Final. jar:3.0.5.Final] at org.jboss.weld.interceptor.proxy.AroundInvokeInvocationContext.proceed(AroundInvokeInvocationContext.java:78) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at org.ovirt.engine.core.common.di.interceptor.LoggingInterceptor.apply(LoggingInterceptor.java:12) [common.jar:] at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) [:1.8.0_201] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at org.jboss.weld.interceptor.reader.SimpleInterceptorInvocation$SimpleMethodInvocation.invoke(SimpleInterceptorInvocation.java:73) [weld-core-impl-3.0.5.Final.jar:3 .0.5.Final] at org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeAroundInvoke(InterceptorMethodHandler.java:84) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeInterception(InterceptorMethodHandler.java:72) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.invoke(InterceptorMethodHandler.java:56) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:79) [weld-core-impl-3.0. 5.Final.jar:3.0.5.Final] at org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:68) [weld-core-impl-3.0. 5.Final.jar:3.0.5.Final] at org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand(Unknown Source) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:779) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring.refreshCapabilities(HostMonitoring.java:189) [vdsbroker.jar:] </error>

Hmm... Looking into it... Tomo On 19/03/08 10:05, Dafna Ron wrote:
Hi,
We are failing vdsm project on master branch with test 002_bootstrap.verify_add_hosts
CQ identified this patch as the root cause:
https://gerrit.ovirt.org/#/c/97381/ - virt: In FIPS mode, use SASL auth instead of qemu passwords
Can you please take a look?
build logs: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13317/artifac...
<error>
host:
2019-03-07 17:37:38,839-0500 ERROR (MainThread) [vds] Exception raised (vdsmd:159) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 157, in run serve_clients(log) File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 103, in serve_clients from vdsm.clientIF import clientIF # must import after config is read File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py", line 64, in <module> from vdsm.virt import vm File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 81, in <module> from vdsm.virt import saslpasswd2 ImportError: cannot import name saslpasswd2 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping threads (vdsmd:161) 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping <MonitorObserver(mpathlistener, started daemon 139815311881984)> (vdsmd:164)
engine:
2019-03-07 17:37:47,780-05 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Command 'G etCapabilitiesAsyncVDSCommand(HostName = lago-basic-suite-master-host-1, VdsIdAndVdsVDSCommandParametersBase:{hostId='5d685bce-ada7-4730-975c-45d30afc0a8b', vds='Host[lago-b asic-suite-master-host-1,5d685bce-ada7-4730-975c-45d30afc0a8b]'})' execution failed: java.net.ConnectException: Connection refused 2019-03-07 17:37:47,780-05 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Exception: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:172) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVdsCommandWithNetworkEvent(VdsBrokerCommand.java:135) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:111) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65) [vdsbroker.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.DefaultVdsCommandExecutor.execute(DefaultVdsCommandExecutor.java:14) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:396) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand$$super(Unknown Source) [vdsbroker.jar:] at sun.reflect.GeneratedMethodAccessor252.invoke(Unknown Source) [:1.8.0_201] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at org.jboss.weld.interceptor.proxy.TerminalAroundInvokeInvocationContext.proceedInternal(TerminalAroundInvokeInvocationContext.java:51) [weld-core-impl-3.0.5.Final. jar:3.0.5.Final] at org.jboss.weld.interceptor.proxy.AroundInvokeInvocationContext.proceed(AroundInvokeInvocationContext.java:78) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at org.ovirt.engine.core.common.di.interceptor.LoggingInterceptor.apply(LoggingInterceptor.java:12) [common.jar:] at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) [:1.8.0_201] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at org.jboss.weld.interceptor.reader.SimpleInterceptorInvocation$SimpleMethodInvocation.invoke(SimpleInterceptorInvocation.java:73) [weld-core-impl-3.0.5.Final.jar:3 .0.5.Final] at org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeAroundInvoke(InterceptorMethodHandler.java:84) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeInterception(InterceptorMethodHandler.java:72) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.invoke(InterceptorMethodHandler.java:56) [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:79) [weld-core-impl-3.0. 5.Final.jar:3.0.5.Final] at org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:68) [weld-core-impl-3.0. 5.Final.jar:3.0.5.Final] at org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand(Unknown Source) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:779) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring.refreshCapabilities(HostMonitoring.java:189) [vdsbroker.jar:]
</error>

Thanks Tomasz :) On Fri, Mar 8, 2019 at 10:19 AM Tomasz Baranski <tbaransk@redhat.com> wrote:
Hmm... Looking into it...
Tomo
On 19/03/08 10:05, Dafna Ron wrote:
Hi,
We are failing vdsm project on master branch with test 002_bootstrap.verify_add_hosts
CQ identified this patch as the root cause:
https://gerrit.ovirt.org/#/c/97381/ - virt: In FIPS mode, use SASL auth instead of qemu passwords
Can you please take a look?
build logs:
https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13317/artifac...
<error>
host:
2019-03-07 17:37:38,839-0500 ERROR (MainThread) [vds] Exception raised (vdsmd:159) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 157, in run serve_clients(log) File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 103, in serve_clients from vdsm.clientIF import clientIF # must import after config is
read
File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py", line 64, in <module> from vdsm.virt import vm File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 81, in <module> from vdsm.virt import saslpasswd2 ImportError: cannot import name saslpasswd2 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping threads (vdsmd:161) 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping <MonitorObserver(mpathlistener, started daemon 139815311881984)> (vdsmd:164)
engine:
2019-03-07 17:37:47,780-05 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Command 'G etCapabilitiesAsyncVDSCommand(HostName = lago-basic-suite-master-host-1,
VdsIdAndVdsVDSCommandParametersBase:{hostId='5d685bce-ada7-4730-975c-45d30afc0a8b',
vds='Host[lago-b asic-suite-master-host-1,5d685bce-ada7-4730-975c-45d30afc0a8b]'})' execution failed: java.net.ConnectException: Connection refused 2019-03-07 17:37:47,780-05 DEBUG
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Exception: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:172)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVdsCommandWithNetworkEvent(VdsBrokerCommand.java:135)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:111)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65)
[vdsbroker.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.DefaultVdsCommandExecutor.execute(DefaultVdsCommandExecutor.java:14)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:396)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand$$super(Unknown
Source) [vdsbroker.jar:] at sun.reflect.GeneratedMethodAccessor252.invoke(Unknown Source) [:1.8.0_201] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at
org.jboss.weld.interceptor.proxy.TerminalAroundInvokeInvocationContext.proceedInternal(TerminalAroundInvokeInvocationContext.java:51)
[weld-core-impl-3.0.5.Final. jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.AroundInvokeInvocationContext.proceed(AroundInvokeInvocationContext.java:78)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.ovirt.engine.core.common.di.interceptor.LoggingInterceptor.apply(LoggingInterceptor.java:12)
[common.jar:] at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) [:1.8.0_201] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at
org.jboss.weld.interceptor.reader.SimpleInterceptorInvocation$SimpleMethodInvocation.invoke(SimpleInterceptorInvocation.java:73)
[weld-core-impl-3.0.5.Final.jar:3 .0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeAroundInvoke(InterceptorMethodHandler.java:84)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeInterception(InterceptorMethodHandler.java:72)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.invoke(InterceptorMethodHandler.java:56)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:79)
[weld-core-impl-3.0. 5.Final.jar:3.0.5.Final] at
org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:68)
[weld-core-impl-3.0. 5.Final.jar:3.0.5.Final] at
org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand(Unknown
Source) [vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:779)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring.refreshCapabilities(HostMonitoring.java:189)
[vdsbroker.jar:]
</error>

Fix: https://gerrit.ovirt.org/98371 T. On 19/03/08 10:21, Dafna Ron wrote:
Thanks Tomasz :)
On Fri, Mar 8, 2019 at 10:19 AM Tomasz Baranski <tbaransk@redhat.com> wrote:
Hmm... Looking into it...
Tomo
On 19/03/08 10:05, Dafna Ron wrote:
Hi,
We are failing vdsm project on master branch with test 002_bootstrap.verify_add_hosts
CQ identified this patch as the root cause:
https://gerrit.ovirt.org/#/c/97381/ - virt: In FIPS mode, use SASL auth instead of qemu passwords
Can you please take a look?
build logs:
https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13317/artifac...
<error>
host:
2019-03-07 17:37:38,839-0500 ERROR (MainThread) [vds] Exception raised (vdsmd:159) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 157, in run serve_clients(log) File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 103, in serve_clients from vdsm.clientIF import clientIF # must import after config is
read
File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py", line 64, in <module> from vdsm.virt import vm File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 81, in <module> from vdsm.virt import saslpasswd2 ImportError: cannot import name saslpasswd2 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping threads (vdsmd:161) 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping <MonitorObserver(mpathlistener, started daemon 139815311881984)> (vdsmd:164)
engine:
2019-03-07 17:37:47,780-05 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Command 'G etCapabilitiesAsyncVDSCommand(HostName = lago-basic-suite-master-host-1,
VdsIdAndVdsVDSCommandParametersBase:{hostId='5d685bce-ada7-4730-975c-45d30afc0a8b',
vds='Host[lago-b asic-suite-master-host-1,5d685bce-ada7-4730-975c-45d30afc0a8b]'})' execution failed: java.net.ConnectException: Connection refused 2019-03-07 17:37:47,780-05 DEBUG
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Exception: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:172)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVdsCommandWithNetworkEvent(VdsBrokerCommand.java:135)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:111)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65)
[vdsbroker.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) [dal.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.DefaultVdsCommandExecutor.execute(DefaultVdsCommandExecutor.java:14)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:396)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand$$super(Unknown
Source) [vdsbroker.jar:] at sun.reflect.GeneratedMethodAccessor252.invoke(Unknown Source) [:1.8.0_201] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at
org.jboss.weld.interceptor.proxy.TerminalAroundInvokeInvocationContext.proceedInternal(TerminalAroundInvokeInvocationContext.java:51)
[weld-core-impl-3.0.5.Final. jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.AroundInvokeInvocationContext.proceed(AroundInvokeInvocationContext.java:78)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.ovirt.engine.core.common.di.interceptor.LoggingInterceptor.apply(LoggingInterceptor.java:12)
[common.jar:] at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) [:1.8.0_201] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at
org.jboss.weld.interceptor.reader.SimpleInterceptorInvocation$SimpleMethodInvocation.invoke(SimpleInterceptorInvocation.java:73)
[weld-core-impl-3.0.5.Final.jar:3 .0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeAroundInvoke(InterceptorMethodHandler.java:84)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeInterception(InterceptorMethodHandler.java:72)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.invoke(InterceptorMethodHandler.java:56)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:79)
[weld-core-impl-3.0. 5.Final.jar:3.0.5.Final] at
org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:68)
[weld-core-impl-3.0. 5.Final.jar:3.0.5.Final] at
org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand(Unknown
Source) [vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:779)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring.refreshCapabilities(HostMonitoring.java:189)
[vdsbroker.jar:]
</error>

thanks. I'll monitor On Fri, Mar 8, 2019 at 11:39 AM Tomasz Baranski <tbaransk@redhat.com> wrote:
Fix: https://gerrit.ovirt.org/98371
T.
Thanks Tomasz :)
On Fri, Mar 8, 2019 at 10:19 AM Tomasz Baranski <tbaransk@redhat.com> wrote:
Hmm... Looking into it...
Tomo
On 19/03/08 10:05, Dafna Ron wrote:
Hi,
We are failing vdsm project on master branch with test 002_bootstrap.verify_add_hosts
CQ identified this patch as the root cause:
https://gerrit.ovirt.org/#/c/97381/ - virt: In FIPS mode, use SASL auth instead of qemu passwords
Can you please take a look?
build logs:
https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13317/artifac...
<error>
host:
2019-03-07 17:37:38,839-0500 ERROR (MainThread) [vds] Exception
raised
(vdsmd:159) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 157, in run serve_clients(log) File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 103, in serve_clients from vdsm.clientIF import clientIF # must import after config is read File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py", line 64, in <module> from vdsm.virt import vm File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 81, in <module> from vdsm.virt import saslpasswd2 ImportError: cannot import name saslpasswd2 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping
On 19/03/08 10:21, Dafna Ron wrote: threads
(vdsmd:161) 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping <MonitorObserver(mpathlistener, started daemon 139815311881984)> (vdsmd:164)
engine:
2019-03-07 17:37:47,780-05 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Command 'G etCapabilitiesAsyncVDSCommand(HostName = lago-basic-suite-master-host-1,
VdsIdAndVdsVDSCommandParametersBase:{hostId='5d685bce-ada7-4730-975c-45d30afc0a8b',
vds='Host[lago-b asic-suite-master-host-1,5d685bce-ada7-4730-975c-45d30afc0a8b]'})' execution failed: java.net.ConnectException: Connection refused 2019-03-07 17:37:47,780-05 DEBUG
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Exception: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:172)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVdsCommandWithNetworkEvent(VdsBrokerCommand.java:135)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:111)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65)
[vdsbroker.jar:] at
org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31)
[dal.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.DefaultVdsCommandExecutor.execute(DefaultVdsCommandExecutor.java:14)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:396)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand$$super(Unknown
Source) [vdsbroker.jar:] at sun.reflect.GeneratedMethodAccessor252.invoke(Unknown Source) [:1.8.0_201] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at
org.jboss.weld.interceptor.proxy.TerminalAroundInvokeInvocationContext.proceedInternal(TerminalAroundInvokeInvocationContext.java:51)
[weld-core-impl-3.0.5.Final. jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.AroundInvokeInvocationContext.proceed(AroundInvokeInvocationContext.java:78)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.ovirt.engine.core.common.di.interceptor.LoggingInterceptor.apply(LoggingInterceptor.java:12)
[common.jar:] at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) [:1.8.0_201] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at
org.jboss.weld.interceptor.reader.SimpleInterceptorInvocation$SimpleMethodInvocation.invoke(SimpleInterceptorInvocation.java:73)
[weld-core-impl-3.0.5.Final.jar:3 .0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeAroundInvoke(InterceptorMethodHandler.java:84)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeInterception(InterceptorMethodHandler.java:72)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.invoke(InterceptorMethodHandler.java:56)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:79)
[weld-core-impl-3.0. 5.Final.jar:3.0.5.Final] at
org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:68)
[weld-core-impl-3.0. 5.Final.jar:3.0.5.Final] at
org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand(Unknown
Source) [vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:779)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring.refreshCapabilities(HostMonitoring.java:189)
[vdsbroker.jar:]
</error>

the patch itself failed CQ: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13327/ On Fri, Mar 8, 2019 at 11:43 AM Dafna Ron <dron@redhat.com> wrote:
thanks. I'll monitor
On Fri, Mar 8, 2019 at 11:39 AM Tomasz Baranski <tbaransk@redhat.com> wrote:
Fix: https://gerrit.ovirt.org/98371
T.
Thanks Tomasz :)
On Fri, Mar 8, 2019 at 10:19 AM Tomasz Baranski <tbaransk@redhat.com> wrote:
Hmm... Looking into it...
Tomo
On 19/03/08 10:05, Dafna Ron wrote:
Hi,
We are failing vdsm project on master branch with test 002_bootstrap.verify_add_hosts
CQ identified this patch as the root cause:
https://gerrit.ovirt.org/#/c/97381/ - virt: In FIPS mode, use SASL auth instead of qemu passwords
Can you please take a look?
build logs:
https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13317/artifac...
<error>
host:
2019-03-07 17:37:38,839-0500 ERROR (MainThread) [vds] Exception
raised
(vdsmd:159) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 157, in run serve_clients(log) File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 103, in serve_clients from vdsm.clientIF import clientIF # must import after config is read File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py", line 64, in <module> from vdsm.virt import vm File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 81, in <module> from vdsm.virt import saslpasswd2 ImportError: cannot import name saslpasswd2 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping
On 19/03/08 10:21, Dafna Ron wrote: threads
(vdsmd:161) 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping <MonitorObserver(mpathlistener, started daemon 139815311881984)> (vdsmd:164)
engine:
2019-03-07 17:37:47,780-05 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Command 'G etCapabilitiesAsyncVDSCommand(HostName = lago-basic-suite-master-host-1,
VdsIdAndVdsVDSCommandParametersBase:{hostId='5d685bce-ada7-4730-975c-45d30afc0a8b',
vds='Host[lago-b asic-suite-master-host-1,5d685bce-ada7-4730-975c-45d30afc0a8b]'})' execution failed: java.net.ConnectException: Connection refused 2019-03-07 17:37:47,780-05 DEBUG
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Exception: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:172)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVdsCommandWithNetworkEvent(VdsBrokerCommand.java:135)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:111)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65)
[vdsbroker.jar:] at
org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31)
[dal.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.DefaultVdsCommandExecutor.execute(DefaultVdsCommandExecutor.java:14)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:396)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand$$super(Unknown
Source) [vdsbroker.jar:] at sun.reflect.GeneratedMethodAccessor252.invoke(Unknown Source) [:1.8.0_201] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at
org.jboss.weld.interceptor.proxy.TerminalAroundInvokeInvocationContext.proceedInternal(TerminalAroundInvokeInvocationContext.java:51)
[weld-core-impl-3.0.5.Final. jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.AroundInvokeInvocationContext.proceed(AroundInvokeInvocationContext.java:78)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.ovirt.engine.core.common.di.interceptor.LoggingInterceptor.apply(LoggingInterceptor.java:12)
[common.jar:] at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) [:1.8.0_201] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at
org.jboss.weld.interceptor.reader.SimpleInterceptorInvocation$SimpleMethodInvocation.invoke(SimpleInterceptorInvocation.java:73)
[weld-core-impl-3.0.5.Final.jar:3 .0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeAroundInvoke(InterceptorMethodHandler.java:84)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeInterception(InterceptorMethodHandler.java:72)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.invoke(InterceptorMethodHandler.java:56)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:79)
[weld-core-impl-3.0. 5.Final.jar:3.0.5.Final] at
org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:68)
[weld-core-impl-3.0. 5.Final.jar:3.0.5.Final] at
org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand(Unknown
Source) [vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:779)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring.refreshCapabilities(HostMonitoring.java:189)
[vdsbroker.jar:]
</error>

The failure is on migrate_vm logs: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13327/artifac... engine 2019-03-08 12:30:03,062-05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [] EVENT_ID: VDS_ BROKER_COMMAND_FAILURE(10,802), VDSM lago-basic-suite-master-host-0 command Get Host Capabilities failed: Recovering from crash or Initializing 2019-03-08 12:30:03,063-05 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [] Unable to RefreshCapabili ties: VDSRecoveringException: Recovering from crash or Initializing 2019-03-08 12:30:03,063-05 DEBUG [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [] Exception: org.ovirt.engi ne.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:40) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand$GetCapabilitiesVDSCommandCallback.onFailure(GetCapabilitiesAsyncVDSCommand.java:58) [vdsb roker.jar:] at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.lambda$processResponse$0(JsonRpcClient.java:186) [vdsm-jsonrpc-java-client.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_201] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [rt.jar:1.8.0_201] at org.glassfish.enterprise.concurrent.internal.ManagedFutureTask.run(ManagedFutureTask.java:141) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$101(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:532) [javax .enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_201] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_201] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_201] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78) vdsm: 2019-03-08 12:31:46,401-0500 ERROR (jsonrpc/1) [api] FINISH create error=Error creating the requested VM (api:131) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 124, in method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 231, in create "Host runs in FIPS mode but SASL authentication for VNC " CannotCreateVM: Error creating the requested VM On Fri, Mar 8, 2019 at 6:59 PM Dafna Ron <dron@redhat.com> wrote:
the patch itself failed CQ: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13327/
On Fri, Mar 8, 2019 at 11:43 AM Dafna Ron <dron@redhat.com> wrote:
thanks. I'll monitor
On Fri, Mar 8, 2019 at 11:39 AM Tomasz Baranski <tbaransk@redhat.com> wrote:
Fix: https://gerrit.ovirt.org/98371
T.
Thanks Tomasz :)
On Fri, Mar 8, 2019 at 10:19 AM Tomasz Baranski <tbaransk@redhat.com> wrote:
Hmm... Looking into it...
Tomo
On 19/03/08 10:05, Dafna Ron wrote:
Hi,
We are failing vdsm project on master branch with test 002_bootstrap.verify_add_hosts
CQ identified this patch as the root cause:
https://gerrit.ovirt.org/#/c/97381/ - virt: In FIPS mode, use SASL auth instead of qemu passwords
Can you please take a look?
build logs:
https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13317/artifac...
<error>
host:
2019-03-07 17:37:38,839-0500 ERROR (MainThread) [vds] Exception
raised
(vdsmd:159) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 157, in run serve_clients(log) File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 103, in serve_clients from vdsm.clientIF import clientIF # must import after config is read File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py", line 64, in <module> from vdsm.virt import vm File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 81, in <module> from vdsm.virt import saslpasswd2 ImportError: cannot import name saslpasswd2 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping
On 19/03/08 10:21, Dafna Ron wrote: threads
(vdsmd:161) 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping <MonitorObserver(mpathlistener, started daemon 139815311881984)> (vdsmd:164)
engine:
2019-03-07 17:37:47,780-05 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Command 'G etCapabilitiesAsyncVDSCommand(HostName = lago-basic-suite-master-host-1,
VdsIdAndVdsVDSCommandParametersBase:{hostId='5d685bce-ada7-4730-975c-45d30afc0a8b',
vds='Host[lago-b asic-suite-master-host-1,5d685bce-ada7-4730-975c-45d30afc0a8b]'})' execution failed: java.net.ConnectException: Connection refused 2019-03-07 17:37:47,780-05 DEBUG
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Exception: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:172)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVdsCommandWithNetworkEvent(VdsBrokerCommand.java:135)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:111)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65)
[vdsbroker.jar:] at
org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31)
[dal.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.DefaultVdsCommandExecutor.execute(DefaultVdsCommandExecutor.java:14)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:396)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand$$super(Unknown
Source) [vdsbroker.jar:] at sun.reflect.GeneratedMethodAccessor252.invoke(Unknown Source) [:1.8.0_201] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at
org.jboss.weld.interceptor.proxy.TerminalAroundInvokeInvocationContext.proceedInternal(TerminalAroundInvokeInvocationContext.java:51)
[weld-core-impl-3.0.5.Final. jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.AroundInvokeInvocationContext.proceed(AroundInvokeInvocationContext.java:78)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.ovirt.engine.core.common.di.interceptor.LoggingInterceptor.apply(LoggingInterceptor.java:12)
[common.jar:] at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) [:1.8.0_201] at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.8.0_201] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_201] at
org.jboss.weld.interceptor.reader.SimpleInterceptorInvocation$SimpleMethodInvocation.invoke(SimpleInterceptorInvocation.java:73)
[weld-core-impl-3.0.5.Final.jar:3 .0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeAroundInvoke(InterceptorMethodHandler.java:84)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeInterception(InterceptorMethodHandler.java:72)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.invoke(InterceptorMethodHandler.java:56)
[weld-core-impl-3.0.5.Final.jar:3.0.5.Final] at
org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:79)
[weld-core-impl-3.0. 5.Final.jar:3.0.5.Final] at
org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:68)
[weld-core-impl-3.0. 5.Final.jar:3.0.5.Final] at
org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand(Unknown
Source) [vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:779)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring.refreshCapabilities(HostMonitoring.java:189)
[vdsbroker.jar:]
</error>

Hmm... Do you know what this test is supposed to check? The failure is expected in specific conditions: empty password in the libvirt XML and no SASL configured. Tomo On 19/03/08 07:04, Dafna Ron wrote:
The failure is on migrate_vm
logs: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13327/artifac...
engine
2019-03-08 12:30:03,062-05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [] EVENT_ID: VDS_ BROKER_COMMAND_FAILURE(10,802), VDSM lago-basic-suite-master-host-0 command Get Host Capabilities failed: Recovering from crash or Initializing 2019-03-08 12:30:03,063-05 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [] Unable to RefreshCapabili ties: VDSRecoveringException: Recovering from crash or Initializing 2019-03-08 12:30:03,063-05 DEBUG [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [] Exception: org.ovirt.engi ne.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:40) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand$GetCapabilitiesVDSCommandCallback.onFailure(GetCapabilitiesAsyncVDSCommand.java:58) [vdsb roker.jar:] at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.lambda$processResponse$0(JsonRpcClient.java:186) [vdsm-jsonrpc-java-client.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_201] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [rt.jar:1.8.0_201] at org.glassfish.enterprise.concurrent.internal.ManagedFutureTask.run(ManagedFutureTask.java:141) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$101(ManagedScheduledThreadPoolExecutor.java:383) [javax.enterprise.concurrent-1.0.jar:] at org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:532) [javax .enterprise.concurrent-1.0.jar:] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_201] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_201] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_201] at org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) [javax.enterprise.concurrent-1.0.jar:] at org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78)
vdsm:
2019-03-08 12:31:46,401-0500 ERROR (jsonrpc/1) [api] FINISH create error=Error creating the requested VM (api:131) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 124, in method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 231, in create "Host runs in FIPS mode but SASL authentication for VNC " CannotCreateVM: Error creating the requested VM
On Fri, Mar 8, 2019 at 6:59 PM Dafna Ron <dron@redhat.com> wrote:
the patch itself failed CQ: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13327/
On Fri, Mar 8, 2019 at 11:43 AM Dafna Ron <dron@redhat.com> wrote:
thanks. I'll monitor
On Fri, Mar 8, 2019 at 11:39 AM Tomasz Baranski <tbaransk@redhat.com> wrote:
Fix: https://gerrit.ovirt.org/98371
T.
Thanks Tomasz :)
On Fri, Mar 8, 2019 at 10:19 AM Tomasz Baranski <tbaransk@redhat.com> wrote:
Hmm... Looking into it...
Tomo
On 19/03/08 10:05, Dafna Ron wrote: > Hi, > > We are failing vdsm project on master branch with test > 002_bootstrap.verify_add_hosts > > CQ identified this patch as the root cause: > > https://gerrit.ovirt.org/#/c/97381/ - virt: In FIPS mode, use SASL auth > instead of qemu passwords > > Can you please take a look? > > build logs: >
https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13317/artifac...
> > <error> > > host: > > 2019-03-07 17:37:38,839-0500 ERROR (MainThread) [vds] Exception raised > (vdsmd:159) > Traceback (most recent call last): > File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 157, in run > serve_clients(log) > File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 103, in > serve_clients > from vdsm.clientIF import clientIF # must import after config is read > File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py", line 64, in > <module> > from vdsm.virt import vm > File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 81, in > <module> > from vdsm.virt import saslpasswd2 > ImportError: cannot import name saslpasswd2 > 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping
On 19/03/08 10:21, Dafna Ron wrote: threads
> (vdsmd:161) > 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping > <MonitorObserver(mpathlistener, started daemon 139815311881984)> (vdsmd:164) > > engine: > > 2019-03-07 17:37:47,780-05 ERROR >
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Command 'G > etCapabilitiesAsyncVDSCommand(HostName = lago-basic-suite-master-host-1, >
VdsIdAndVdsVDSCommandParametersBase:{hostId='5d685bce-ada7-4730-975c-45d30afc0a8b',
> vds='Host[lago-b > asic-suite-master-host-1,5d685bce-ada7-4730-975c-45d30afc0a8b]'})' > execution failed: java.net.ConnectException: Connection refused > 2019-03-07 17:37:47,780-05 DEBUG >
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand]
> (EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Exception: > org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: > java.net.ConnectException: Connection refused > at >
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:172)
> [vdsbroker.jar:] > at >
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVdsCommandWithNetworkEvent(VdsBrokerCommand.java:135)
> [vdsbroker.jar:] > at >
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:111)
> [vdsbroker.jar:] > at >
org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65)
> [vdsbroker.jar:] > at > org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) > [dal.jar:] > at >
org.ovirt.engine.core.vdsbroker.vdsbroker.DefaultVdsCommandExecutor.execute(DefaultVdsCommandExecutor.java:14)
> [vdsbroker.jar:] > at >
org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:396)
> [vdsbroker.jar:] > at >
org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand$$super(Unknown
> Source) [vdsbroker.jar:] > at sun.reflect.GeneratedMethodAccessor252.invoke(Unknown Source) > [:1.8.0_201] > at >
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [rt.jar:1.8.0_201] > at java.lang.reflect.Method.invoke(Method.java:498) > [rt.jar:1.8.0_201] > at >
org.jboss.weld.interceptor.proxy.TerminalAroundInvokeInvocationContext.proceedInternal(TerminalAroundInvokeInvocationContext.java:51)
> [weld-core-impl-3.0.5.Final. > jar:3.0.5.Final] > at >
org.jboss.weld.interceptor.proxy.AroundInvokeInvocationContext.proceed(AroundInvokeInvocationContext.java:78)
> [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] > at >
org.ovirt.engine.core.common.di.interceptor.LoggingInterceptor.apply(LoggingInterceptor.java:12)
> [common.jar:] > at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) > [:1.8.0_201] > at >
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [rt.jar:1.8.0_201] > at java.lang.reflect.Method.invoke(Method.java:498) > [rt.jar:1.8.0_201] > at >
org.jboss.weld.interceptor.reader.SimpleInterceptorInvocation$SimpleMethodInvocation.invoke(SimpleInterceptorInvocation.java:73)
> [weld-core-impl-3.0.5.Final.jar:3 > .0.5.Final] > at >
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeAroundInvoke(InterceptorMethodHandler.java:84)
> [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] > at >
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeInterception(InterceptorMethodHandler.java:72)
> [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] > at >
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.invoke(InterceptorMethodHandler.java:56)
> [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] > at >
org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:79)
> [weld-core-impl-3.0. > 5.Final.jar:3.0.5.Final] > at >
org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:68)
> [weld-core-impl-3.0. > 5.Final.jar:3.0.5.Final] > at >
org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand(Unknown
> Source) [vdsbroker.jar:] > at >
org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:779)
> [vdsbroker.jar:] > at >
org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring.refreshCapabilities(HostMonitoring.java:189)
> [vdsbroker.jar:] > > </error>

the recent failure is in migrate vm which is testing migration. you can download the ost project and review the test cases for more details: https://gerrit.ovirt.org/#/admin/projects/ovirt-system-tests you can also test your patches with ost in Jenkins's manual tests job: https://jenkins.ovirt.org/job/ovirt-system-tests_manual/ please ping me offline if you have any questions on how to test your changes with ost. Thanks, Dafna On Mon, Mar 11, 2019 at 9:09 AM Tomasz Baranski <tbaransk@redhat.com> wrote:
Hmm...
Do you know what this test is supposed to check? The failure is expected in specific conditions: empty password in the libvirt XML and no SASL configured.
Tomo
On 19/03/08 07:04, Dafna Ron wrote:
The failure is on migrate_vm
logs:
https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13327/artifac...
engine
2019-03-08 12:30:03,062-05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [] EVENT_ID: VDS_ BROKER_COMMAND_FAILURE(10,802), VDSM lago-basic-suite-master-host-0
command
Get Host Capabilities failed: Recovering from crash or Initializing 2019-03-08 12:30:03,063-05 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [] Unable to RefreshCapabili ties: VDSRecoveringException: Recovering from crash or Initializing 2019-03-08 12:30:03,063-05 DEBUG [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (EE-ManagedThreadFactory-engineScheduled-Thread-93) [] Exception: org.ovirt.engi ne.core.vdsbroker.vdsbroker.VDSRecoveringException: Recovering from crash or Initializing at
org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:40)
[vdsbroker.jar:] at
org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand$GetCapabilitiesVDSCommandCallback.onFailure(GetCapabilitiesAsyncVDSCommand.java:58)
[vdsb roker.jar:] at
org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.lambda$processResponse$0(JsonRpcClient.java:186)
[vdsm-jsonrpc-java-client.jar:] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_201] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [rt.jar:1.8.0_201] at
org.glassfish.enterprise.concurrent.internal.ManagedFutureTask.run(ManagedFutureTask.java:141)
[javax.enterprise.concurrent-1.0.jar:] at
org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$101(ManagedScheduledThreadPoolExecutor.java:383)
[javax.enterprise.concurrent-1.0.jar:] at
org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:532)
[javax .enterprise.concurrent-1.0.jar:] at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
[rt.jar:1.8.0_201] at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
[rt.jar:1.8.0_201] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_201] at
org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250)
[javax.enterprise.concurrent-1.0.jar:] at
org.jboss.as.ee.concurrent.service.ElytronManagedThreadFactory$ElytronManagedThread.run(ElytronManagedThreadFactory.java:78)
vdsm:
2019-03-08 12:31:46,401-0500 ERROR (jsonrpc/1) [api] FINISH create error=Error creating the requested VM (api:131) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 124,
method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 231, in create "Host runs in FIPS mode but SASL authentication for VNC " CannotCreateVM: Error creating the requested VM
On Fri, Mar 8, 2019 at 6:59 PM Dafna Ron <dron@redhat.com> wrote:
the patch itself failed CQ: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13327/
On Fri, Mar 8, 2019 at 11:43 AM Dafna Ron <dron@redhat.com> wrote:
thanks. I'll monitor
On Fri, Mar 8, 2019 at 11:39 AM Tomasz Baranski <tbaransk@redhat.com> wrote:
Fix: https://gerrit.ovirt.org/98371
T.
On 19/03/08 10:21, Dafna Ron wrote:
Thanks Tomasz :)
On Fri, Mar 8, 2019 at 10:19 AM Tomasz Baranski < tbaransk@redhat.com> wrote:
> Hmm... > Looking into it... > > Tomo > > On 19/03/08 10:05, Dafna Ron wrote: > > Hi, > > > > We are failing vdsm project on master branch with test > > 002_bootstrap.verify_add_hosts > > > > CQ identified this patch as the root cause: > > > > https://gerrit.ovirt.org/#/c/97381/ - virt: In FIPS mode, use SASL auth > > instead of qemu passwords > > > > Can you please take a look? > > > > build logs: > > >
https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/13317/artifac...
> > > > <error> > > > > host: > > > > 2019-03-07 17:37:38,839-0500 ERROR (MainThread) [vds] Exception raised > > (vdsmd:159) > > Traceback (most recent call last): > > File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 157, in run > > serve_clients(log) > > File "/usr/lib/python2.7/site-packages/vdsm/vdsmd.py", line 103, in > > serve_clients > > from vdsm.clientIF import clientIF # must import after config is > read > > File "/usr/lib/python2.7/site-packages/vdsm/clientIF.py",
in line
> > <module> > > from vdsm.virt import vm > > File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 81, in > > <module> > > from vdsm.virt import saslpasswd2 > > ImportError: cannot import name saslpasswd2 > > 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping
64, in threads
> > (vdsmd:161) > > 2019-03-07 17:37:38,841-0500 INFO (MainThread) [vds] Stopping > > <MonitorObserver(mpathlistener, started daemon 139815311881984)> > (vdsmd:164) > > > > engine: > > > > 2019-03-07 17:37:47,780-05 ERROR > > >
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand]
> > (EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Command 'G > > etCapabilitiesAsyncVDSCommand(HostName = lago-basic-suite-master-host-1, > > >
VdsIdAndVdsVDSCommandParametersBase:{hostId='5d685bce-ada7-4730-975c-45d30afc0a8b',
> > vds='Host[lago-b > > asic-suite-master-host-1,5d685bce-ada7-4730-975c-45d30afc0a8b]'})' > > execution failed: java.net.ConnectException: Connection refused > > 2019-03-07 17:37:47,780-05 DEBUG > > >
[org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesAsyncVDSCommand]
> > (EE-ManagedThreadFactory-engineScheduled-Thread-28) [] Exception: > > org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: > > java.net.ConnectException: Connection refused > > at > > >
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:172)
> > [vdsbroker.jar:] > > at > > >
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVdsCommandWithNetworkEvent(VdsBrokerCommand.java:135)
> > [vdsbroker.jar:] > > at > > >
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:111)
> > [vdsbroker.jar:] > > at > > >
org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65)
> > [vdsbroker.jar:] > > at > >
org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31)
> > [dal.jar:] > > at > > >
org.ovirt.engine.core.vdsbroker.vdsbroker.DefaultVdsCommandExecutor.execute(DefaultVdsCommandExecutor.java:14)
> > [vdsbroker.jar:] > > at > > >
org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:396)
> > [vdsbroker.jar:] > > at > > >
org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand$$super(Unknown
> > Source) [vdsbroker.jar:] > > at sun.reflect.GeneratedMethodAccessor252.invoke(Unknown Source) > > [:1.8.0_201] > > at > > >
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > [rt.jar:1.8.0_201] > > at java.lang.reflect.Method.invoke(Method.java:498) > > [rt.jar:1.8.0_201] > > at > > >
org.jboss.weld.interceptor.proxy.TerminalAroundInvokeInvocationContext.proceedInternal(TerminalAroundInvokeInvocationContext.java:51)
> > [weld-core-impl-3.0.5.Final. > > jar:3.0.5.Final] > > at > > >
org.jboss.weld.interceptor.proxy.AroundInvokeInvocationContext.proceed(AroundInvokeInvocationContext.java:78)
> > [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] > > at > > >
org.ovirt.engine.core.common.di.interceptor.LoggingInterceptor.apply(LoggingInterceptor.java:12)
> > [common.jar:] > > at sun.reflect.GeneratedMethodAccessor61.invoke(Unknown Source) > > [:1.8.0_201] > > at > > >
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > [rt.jar:1.8.0_201] > > at java.lang.reflect.Method.invoke(Method.java:498) > > [rt.jar:1.8.0_201] > > at > > >
org.jboss.weld.interceptor.reader.SimpleInterceptorInvocation$SimpleMethodInvocation.invoke(SimpleInterceptorInvocation.java:73)
> > [weld-core-impl-3.0.5.Final.jar:3 > > .0.5.Final] > > at > > >
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeAroundInvoke(InterceptorMethodHandler.java:84)
> > [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] > > at > > >
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.executeInterception(InterceptorMethodHandler.java:72)
> > [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] > > at > > >
org.jboss.weld.interceptor.proxy.InterceptorMethodHandler.invoke(InterceptorMethodHandler.java:56)
> > [weld-core-impl-3.0.5.Final.jar:3.0.5.Final] > > at > > >
org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:79)
> > [weld-core-impl-3.0. > > 5.Final.jar:3.0.5.Final] > > at > > >
org.jboss.weld.bean.proxy.CombinedInterceptorAndDecoratorStackMethodHandler.invoke(CombinedInterceptorAndDecoratorStackMethodHandler.java:68)
> > [weld-core-impl-3.0. > > 5.Final.jar:3.0.5.Final] > > at > > >
org.ovirt.engine.core.vdsbroker.ResourceManager$Proxy$_$$_WeldSubclass.runVdsCommand(Unknown
> > Source) [vdsbroker.jar:] > > at > > >
org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:779)
> > [vdsbroker.jar:] > > at > > >
org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring.refreshCapabilities(HostMonitoring.java:189)
> > [vdsbroker.jar:] > > > > </error> >
participants (2)
-
Dafna Ron
-
Tomasz Baranski