<div dir="ltr"><div><div><div><div><div><div><div><div><div>Hi,<br><br></div>I see some issues in the communication between host0 and the the engine.<br></div>Vdsm returned the answer to call getSpmStatus and then got an SSL error. [1]<br></div><br>After that, the engine tried to send to the same host0 connectStorageServer requests that failed.<br></div>The process of attaching the storage domain failed because the host was not connected to the NFS server.<br></div>I think the engine should not have tried to attach the storage domain if connectStorageServer request failed.<br></div>Can you open a bug on this ?<br><br></div>Regardless, the SSL error and communication issue should be investigated further by infra team.<br><br></div>Regards,<br><br></div>Fred<br><div><div><div><div><div><div><div><div><pre>[1]<br>jsonrpc.Executor/5::DEBUG::2017-01-19 12:13:48,711::__init__::555::jsonrpc.JsonRpcServer::(_handle_request) Return &#39;StoragePool.getSpmStatus&#39; in bridge with {&#39;spmId&#39;: 1, &#39;spmStatus&#39;: &#39;SPM&#39;, &#39;spmLver&#39;: 2L}
jsonrpc.Executor/5::INFO::2017-01-19 12:13:48,711::__init__::513::jsonrpc.JsonRpcServer::(_serveRequest) RPC call StoragePool.getSpmStatus succeeded in 0.00 seconds
JsonRpc (StompReactor)::ERROR::2017-01-19 12:13:49,449::betterAsyncore::113::vds.dispatcher::(recv) SSL error during reading data: unexpected eof<br><br>[2]<br>2017-01-19 12:13:49,455 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStorageServerVDSCommand] (org.ovirt.thread.pool-6-thread-5) [4a2c0e44] Command &#39;ConnectStorageServerVDSCommand(HostName = lago-basic-suite-4-0-host0,<br>StorageServerConnectionManagementVDSParameters:{runAsync=&#39;true&#39;, hostId=&#39;4c4d9ad9-32a1-406a-93da-1710e069c690&#39;, storagePoolId=&#39;00000000-0000-0000-0000-000000000000&#39;, storageType=&#39;NFS&#39;, connectionList=&#39;[StorageServerConnections:{id=&#39;da9131c8-1cd9-46bb-b7ea-f83228e04d3f&#39;, <br>connection=&#39;192.168.201.4:/exports/nfs/iso&#39;, iqn=&#39;null&#39;, vfsType=&#39;null&#39;, mountOptions=&#39;null&#39;, nfsVersion=&#39;V3&#39;, nfsRetrans=&#39;null&#39;, nfsTimeo=&#39;null&#39;, iface=&#39;null&#39;, netIfaceName=&#39;null&#39;}]&#39;})&#39; execution failed: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues<br><br></pre><br></div></div></div></div></div></div></div></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Jan 23, 2017 at 4:35 PM, Shlomo Ben David <span dir="ltr">&lt;<a href="mailto:sbendavi@redhat.com" target="_blank">sbendavi@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi,<div><br></div><div>Job [1] failed with the following errors (logs [2]):</div><div><br></div><div><pre style="color:rgb(0,0,0)">{&quot;jsonrpc&quot;: &quot;2.0&quot;, &quot;id&quot;: &quot;669e1306-3206-4a64-a33f-<wbr>d18176531ff8&quot;, &quot;error&quot;: {&quot;message&quot;: &quot;Storage domain does not exist: (u&#39;ab6c9588-d957-4be3-9862-<wbr>d2596db463d9&#39;,)&quot;, &quot;code&quot;: 358}}�
2017-01-19 12:13:51,619 DEBUG [org.ovirt.vdsm.jsonrpc.<wbr>client.internal.<wbr>ResponseWorker] (ResponseWorker) [3a116b94] Message received: {&quot;jsonrpc&quot;: &quot;2.0&quot;, &quot;id&quot;: &quot;669e1306-3206-4a64-a33f-<wbr>d18176531ff8&quot;, &quot;error&quot;: {&quot;message&quot;: &quot;Storage domain does not exist: (u&#39;ab6c9588-d957-4be3-9862-<wbr>d2596db463d9&#39;,)&quot;, &quot;code&quot;: 358}}
2017-01-19 12:13:51,620 ERROR [org.ovirt.engine.core.<wbr>vdsbroker.irsbroker.<wbr>AttachStorageDomainVDSCommand] (default task-27) [6a6480a4] Failed in &#39;AttachStorageDomainVDS&#39; method
2017-01-19 12:13:51,624 ERROR [org.ovirt.engine.core.dal.<wbr>dbbroker.auditloghandling.<wbr>AuditLogDirector] (default task-27) [6a6480a4] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM command failed: Storage domain does not exist: (u&#39;ab6c9588-d957-4be3-9862-<wbr>d2596db463d9&#39;,)
2017-01-19 12:13:51,624 ERROR [org.ovirt.engine.core.<wbr>vdsbroker.irsbroker.<wbr>AttachStorageDomainVDSCommand] (default task-27) [6a6480a4] Command &#39;<wbr>AttachStorageDomainVDSCommand( AttachStorageDomainVDSCommandP<wbr>arameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;fc33da6d-5da7-<wbr>4005-a693-f170437c176c&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;ab6c9588-<wbr>d957-4be3-9862-d2596db463d9&#39;})<wbr>&#39; execution failed: IRSGenericException: IRSErrorException: Failed to AttachStorageDomainVDS, error = Storage domain does not exist: (u&#39;ab6c9588-d957-4be3-9862-<wbr>d2596db463d9&#39;,), code = 358
2017-01-19 12:13:51,632 DEBUG [org.ovirt.engine.core.utils.<wbr>timer.FixedDelayJobListener] (DefaultQuartzScheduler10) [] Rescheduling DEFAULT.org.ovirt.engine.core.<wbr>vdsbroker.irsbroker.<wbr>IrsProxyData.<wbr>hostsStorageConnectionsAndPool<wbr>MetadataRefresh#-<wbr>9223372036854775793 as there is no unfired trigger.
2017-01-19 12:13:51,624 DEBUG [org.ovirt.engine.core.<wbr>vdsbroker.irsbroker.<wbr>AttachStorageDomainVDSCommand] (default task-27) [6a6480a4] Exception: org.ovirt.engine.core.<wbr>vdsbroker.irsbroker.<wbr>IrsOperationFailedNoFailoverEx<wbr>ception: IRSGenericException: IRSErrorException: Failed to AttachStorageDomainVDS, error = Storage domain does not exist: (u&#39;ab6c9588-d957-4be3-9862-<wbr>d2596db463d9&#39;,), code = 358
        at org.ovirt.engine.core.<wbr>vdsbroker.irsbroker.<wbr>AttachStorageDomainVDSCommand.<wbr>createDefaultConcreteException<wbr>(<wbr>AttachStorageDomainVDSCommand.<wbr>java:25) [vdsbroker.jar:]
        at org.ovirt.engine.core.<wbr>vdsbroker.vdsbroker.<wbr>BrokerCommandBase.<wbr>createException(<wbr>BrokerCommandBase.java:222) [vdsbroker.jar:]
        at org.ovirt.engine.core.<wbr>vdsbroker.vdsbroker.<wbr>BrokerCommandBase.<wbr>proceedProxyReturnValue(<wbr>BrokerCommandBase.java:192) [vdsbroker.jar:]
        at org.ovirt.engine.core.<wbr>vdsbroker.irsbroker.<wbr>AttachStorageDomainVDSCommand.<wbr>executeIrsBrokerCommand(<wbr>AttachStorageDomainVDSCommand.<wbr>java:18) [vdsbroker.jar:]
        at org.ovirt.engine.core.<wbr>vdsbroker.irsbroker.<wbr>IrsBrokerCommand.lambda$<wbr>executeVDSCommand$0(<wbr>IrsBrokerCommand.java:161) [vdsbroker.jar:]
        at org.ovirt.engine.core.<wbr>vdsbroker.irsbroker.<wbr>IrsProxyData.<wbr>runInControlledConcurrency(<wbr>IrsProxyData.java:248) [vdsbroker.jar:]
        at org.ovirt.engine.core.<wbr>vdsbroker.irsbroker.<wbr>IrsBrokerCommand.<wbr>executeVDSCommand(<wbr>IrsBrokerCommand.java:158) [vdsbroker.jar:]
        at org.ovirt.engine.core.<wbr>vdsbroker.VDSCommandBase.<wbr>executeCommand(VDSCommandBase.<wbr>java:73) [vdsbroker.jar:]
        at org.ovirt.engine.core.dal.<wbr>VdcCommandBase.execute(<wbr>VdcCommandBase.java:33) [dal.jar:]
        at org.ovirt.engine.core.<wbr>vdsbroker.ResourceManager.<wbr>runVdsCommand(ResourceManager.<wbr>java:451) [vdsbroker.jar:]
        at org.ovirt.engine.core.bll.<wbr>VDSBrokerFrontendImpl.<wbr>runVdsCommand(<wbr>VDSBrokerFrontendImpl.java:33) [bll.jar:]
        at org.ovirt.engine.core.bll.<wbr>CommandBase.runVdsCommand(<wbr>CommandBase.java:2171) [bll.jar:]
        at org.ovirt.engine.core.bll.<wbr>storage.<wbr>StorageHandlingCommandBase.<wbr>runVdsCommand(<wbr>StorageHandlingCommandBase.<wbr>java:657) [bll.jar:]
        at org.ovirt.engine.core.bll.<wbr>storage.domain.<wbr>AttachStorageDomainToPoolComma<wbr>nd.executeCommand(<wbr>AttachStorageDomainToPoolComma<wbr>nd.java:152) [bll.jar:]
        at org.ovirt.engine.core.bll.<wbr>CommandBase.<wbr>executeWithoutTransaction(<wbr>CommandBase.java:1305) [bll.jar:]
        at org.ovirt.engine.core.bll.<wbr>CommandBase.<wbr>executeActionInTransactionScop<wbr>e(CommandBase.java:1447) [bll.jar:]
        at org.ovirt.engine.core.bll.<wbr>CommandBase.runInTransaction(<wbr>CommandBase.java:2075) [bll.jar:]
        at org.ovirt.engine.core.utils.<wbr>transaction.<wbr>TransactionSupport.<wbr>executeInSuppressed(<wbr>TransactionSupport.java:166) [utils.jar:]
        at org.ovirt.engine.core.utils.<wbr>transaction.<wbr>TransactionSupport.<wbr>executeInScope(<wbr>TransactionSupport.java:105) [utils.jar:]
        at org.ovirt.engine.core.bll.<wbr>CommandBase.execute(<wbr>CommandBase.java:1490) [bll.jar:]
        at org.ovirt.engine.core.bll.<wbr>CommandBase.executeAction(<wbr>CommandBase.java:398) [bll.jar:]
        at org.ovirt.engine.core.bll.<wbr>Backend.runAction(Backend.<wbr>java:493) [bll.jar:]
        at org.ovirt.engine.core.bll.<wbr>Backend.runActionImpl(Backend.<wbr>java:475) [bll.jar:]
        at org.ovirt.engine.core.bll.<wbr>Backend.runAction(Backend.<wbr>java:428) [bll.jar:]
        at sun.reflect.<wbr>GeneratedMethodAccessor217.<wbr>invoke(Unknown Source) [:1.8.0_111]
        at sun.reflect.<wbr>DelegatingMethodAccessorImpl.<wbr>invoke(<wbr>DelegatingMethodAccessorImpl.<wbr>java:43) [rt.jar:1.8.0_111]
        at java.lang.reflect.Method.<wbr>invoke(Method.java:498) [rt.jar:1.8.0_111]
        at org.jboss.as.ee.component.<wbr>ManagedReferenceMethodIntercep<wbr>tor.processInvocation(<wbr>ManagedReferenceMethodIntercep<wbr>tor.java:52)
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.invocation.<wbr>InterceptorContext$Invocation.<wbr>proceed(InterceptorContext.<wbr>java:437)
        at org.jboss.as.weld.ejb.<wbr>Jsr299BindingsInterceptor.<wbr>delegateInterception(<wbr>Jsr299BindingsInterceptor.<wbr>java:70) [wildfly-weld-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.as.weld.ejb.<wbr>Jsr299BindingsInterceptor.<wbr>doMethodInterception(<wbr>Jsr299BindingsInterceptor.<wbr>java:80) [wildfly-weld-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.as.weld.ejb.<wbr>Jsr299BindingsInterceptor.<wbr>processInvocation(<wbr>Jsr299BindingsInterceptor.<wbr>java:93) [wildfly-weld-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.as.ee.component.<wbr>interceptors.<wbr>UserInterceptorFactory$1.<wbr>processInvocation(<wbr>UserInterceptorFactory.java:<wbr>63)
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.invocation.<wbr>InterceptorContext$Invocation.<wbr>proceed(InterceptorContext.<wbr>java:437)
        at org.ovirt.engine.core.bll.<wbr>interceptors.<wbr>CorrelationIdTrackerIntercepto<wbr>r.aroundInvoke(<wbr>CorrelationIdTrackerIntercepto<wbr>r.java:13) [bll.jar:]
        at sun.reflect.<wbr>GeneratedMethodAccessor63.<wbr>invoke(Unknown Source) [:1.8.0_111]
        at sun.reflect.<wbr>DelegatingMethodAccessorImpl.<wbr>invoke(<wbr>DelegatingMethodAccessorImpl.<wbr>java:43) [rt.jar:1.8.0_111]
        at java.lang.reflect.Method.<wbr>invoke(Method.java:498) [rt.jar:1.8.0_111]
        at org.jboss.as.ee.component.<wbr>ManagedReferenceLifecycleMetho<wbr>dInterceptor.<wbr>processInvocation(<wbr>ManagedReferenceLifecycleMetho<wbr>dInterceptor.java:89)
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.as.ejb3.component.<wbr>invocationmetrics.<wbr>ExecutionTimeInterceptor.<wbr>processInvocation(<wbr>ExecutionTimeInterceptor.java:<wbr>43) [wildfly-ejb3-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.invocation.<wbr>InterceptorContext$Invocation.<wbr>proceed(InterceptorContext.<wbr>java:437)
        at org.jboss.weld.ejb.<wbr>AbstractEJBRequestScopeActivat<wbr>ionInterceptor.aroundInvoke(<wbr>AbstractEJBRequestScopeActivat<wbr>ionInterceptor.java:73) [weld-core-impl-2.3.5.Final.<wbr>jar:2.3.5.Final]
        at org.jboss.as.weld.ejb.<wbr>EjbRequestScopeActivationInter<wbr>ceptor.processInvocation(<wbr>EjbRequestScopeActivationInter<wbr>ceptor.java:83) [wildfly-weld-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.as.ee.concurrent.<wbr>ConcurrentContextInterceptor.<wbr>processInvocation(<wbr>ConcurrentContextInterceptor.<wbr>java:45) [wildfly-ee-10.1.0.Final.jar:<wbr>10.1.0.Final]
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.invocation.<wbr>InitialInterceptor.<wbr>processInvocation(<wbr>InitialInterceptor.java:21)
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.invocation.<wbr>ChainedInterceptor.<wbr>processInvocation(<wbr>ChainedInterceptor.java:61)
        at org.jboss.as.ee.component.<wbr>interceptors.<wbr>ComponentDispatcherInterceptor<wbr>.processInvocation(<wbr>ComponentDispatcherInterceptor<wbr>.java:52)
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.as.ejb3.component.<wbr>singleton.<wbr>SingletonComponentInstanceAsso<wbr>ciationInterceptor.<wbr>processInvocation(<wbr>SingletonComponentInstanceAsso<wbr>ciationInterceptor.java:53) [wildfly-ejb3-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.as.ejb3.tx.<wbr>CMTTxInterceptor.invokeInNoTx(<wbr>CMTTxInterceptor.java:263) [wildfly-ejb3-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.as.ejb3.tx.<wbr>CMTTxInterceptor.supports(<wbr>CMTTxInterceptor.java:374) [wildfly-ejb3-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.as.ejb3.tx.<wbr>CMTTxInterceptor.<wbr>processInvocation(<wbr>CMTTxInterceptor.java:243) [wildfly-ejb3-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.as.ejb3.component.<wbr>interceptors.<wbr>CurrentInvocationContextInterc<wbr>eptor.processInvocation(<wbr>CurrentInvocationContextInterc<wbr>eptor.java:41) [wildfly-ejb3-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.as.ejb3.component.<wbr>invocationmetrics.<wbr>WaitTimeInterceptor.<wbr>processInvocation(<wbr>WaitTimeInterceptor.java:47) [wildfly-ejb3-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.as.ejb3.security.<wbr>SecurityContextInterceptor.<wbr>processInvocation(<wbr>SecurityContextInterceptor.<wbr>java:100) [wildfly-ejb3-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.as.ejb3.deployment.<wbr>processors.<wbr>StartupAwaitInterceptor.<wbr>processInvocation(<wbr>StartupAwaitInterceptor.java:<wbr>22) [wildfly-ejb3-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.as.ejb3.component.<wbr>interceptors.<wbr>ShutDownInterceptorFactory$1.<wbr>processInvocation(<wbr>ShutDownInterceptorFactory.<wbr>java:64) [wildfly-ejb3-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.as.ejb3.component.<wbr>interceptors.<wbr>LoggingInterceptor.<wbr>processInvocation(<wbr>LoggingInterceptor.java:67) [wildfly-ejb3-10.1.0.Final.<wbr>jar:10.1.0.Final]
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.as.ee.component.<wbr>NamespaceContextInterceptor.<wbr>processInvocation(<wbr>NamespaceContextInterceptor.<wbr>java:50)
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.invocation.<wbr>ContextClassLoaderInterceptor.<wbr>processInvocation(<wbr>ContextClassLoaderInterceptor.<wbr>java:64)
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.invocation.<wbr>InterceptorContext.run(<wbr>InterceptorContext.java:356)
        at org.wildfly.security.manager.<wbr>WildFlySecurityManager.<wbr>doChecked(<wbr>WildFlySecurityManager.java:<wbr>636)
        at org.jboss.invocation.<wbr>AccessCheckingInterceptor.<wbr>processInvocation(<wbr>AccessCheckingInterceptor.<wbr>java:61)
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.invocation.<wbr>InterceptorContext.run(<wbr>InterceptorContext.java:356)
        at org.jboss.invocation.<wbr>PrivilegedWithCombinerIntercep<wbr>tor.processInvocation(<wbr>PrivilegedWithCombinerIntercep<wbr>tor.java:80)
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.invocation.<wbr>ChainedInterceptor.<wbr>processInvocation(<wbr>ChainedInterceptor.java:61)
        at org.jboss.as.ee.component.<wbr>ViewService$View.invoke(<wbr>ViewService.java:198)
        at org.jboss.as.ee.component.<wbr>ViewDescription$1.<wbr>processInvocation(<wbr>ViewDescription.java:185)
        at org.jboss.invocation.<wbr>InterceptorContext.proceed(<wbr>InterceptorContext.java:340)
        at org.jboss.invocation.<wbr>ChainedInterceptor.<wbr>processInvocation(<wbr>ChainedInterceptor.java:61)
        at org.jboss.as.ee.component.<wbr>ProxyInvocationHandler.invoke(<wbr>ProxyInvocationHandler.java:<wbr>73)
        at org.ovirt.engine.core.common.<wbr>interfaces.BackendLocal$$$<wbr>view4.runAction(Unknown Source) [common.jar:]
        at org.ovirt.engine.api.restapi.<wbr>resource.BackendResource.<wbr>doAction(BackendResource.java:<wbr>250)
        at org.ovirt.engine.api.restapi.<wbr>resource.<wbr>AbstractBackendCollectionResou<wbr>rce.doCreateEntity(<wbr>AbstractBackendCollectionResou<wbr>rce.java:229)
        at org.ovirt.engine.api.restapi.<wbr>resource.<wbr>AbstractBackendCollectionResou<wbr>rce.performCreate(<wbr>AbstractBackendCollectionResou<wbr>rce.java:143)
        at org.ovirt.engine.api.restapi.<wbr>resource.<wbr>AbstractBackendCollectionResou<wbr>rce.performCreate(<wbr>AbstractBackendCollectionResou<wbr>rce.java:133)
        at org.ovirt.engine.api.restapi.<wbr>resource.<wbr>AbstractBackendCollectionResou<wbr>rce.performCreate(<wbr>AbstractBackendCollectionResou<wbr>rce.java:152)
        at org.ovirt.engine.api.restapi.<wbr>resource.<wbr>BackendAttachedStorageDomainsR<wbr>esource.add(<wbr>BackendAttachedStorageDomainsR<wbr>esource.java:63)
        at org.ovirt.engine.api.v3.<wbr>V3Server.adaptAdd(V3Server.<wbr>java:166)
        at org.ovirt.engine.api.v3.<wbr>servers.<wbr>V3AttachedStorageDomainsServer<wbr>.add(<wbr>V3AttachedStorageDomainsServer<wbr>.java:41)
        at sun.reflect.<wbr>NativeMethodAccessorImpl.<wbr>invoke0(Native Method) [rt.jar:1.8.0_111]
        at sun.reflect.<wbr>NativeMethodAccessorImpl.<wbr>invoke(<wbr>NativeMethodAccessorImpl.java:<wbr>62) [rt.jar:1.8.0_111]
        at sun.reflect.<wbr>DelegatingMethodAccessorImpl.<wbr>invoke(<wbr>DelegatingMethodAccessorImpl.<wbr>java:43) [rt.jar:1.8.0_111]
        at java.lang.reflect.Method.<wbr>invoke(Method.java:498) [rt.jar:1.8.0_111]
        at org.jboss.resteasy.core.<wbr>MethodInjectorImpl.invoke(<wbr>MethodInjectorImpl.java:139) [resteasy-jaxrs-3.0.19.Final.<wbr>jar:3.0.19.Final]
        at org.jboss.resteasy.core.<wbr>ResourceMethodInvoker.<wbr>invokeOnTarget(<wbr>ResourceMethodInvoker.java:<wbr>295) [resteasy-jaxrs-3.0.19.Final.<wbr>jar:3.0.19.Final]
        at org.jboss.resteasy.core.<wbr>ResourceMethodInvoker.invoke(<wbr>ResourceMethodInvoker.java:<wbr>249) [resteasy-jaxrs-3.0.19.Final.<wbr>jar:3.0.19.Final]
        at org.jboss.resteasy.core.<wbr>ResourceLocatorInvoker.<wbr>invokeOnTargetObject(<wbr>ResourceLocatorInvoker.java:<wbr>138) [resteasy-jaxrs-3.0.19.Final.<wbr>jar:3.0.19.Final]
        at org.jboss.resteasy.core.<wbr>ResourceLocatorInvoker.invoke(<wbr>ResourceLocatorInvoker.java:<wbr>107) [resteasy-jaxrs-3.0.19.Final.<wbr>jar:3.0.19.Final]
        at org.jboss.resteasy.core.<wbr>ResourceLocatorInvoker.<wbr>invokeOnTargetObject(<wbr>ResourceLocatorInvoker.java:<wbr>133) [resteasy-jaxrs-3.0.19.Final.<wbr>jar:3.0.19.Final]
        at org.jboss.resteasy.core.<wbr>ResourceLocatorInvoker.invoke(<wbr>ResourceLocatorInvoker.java:<wbr>107) [resteasy-jaxrs-3.0.19.Final.<wbr>jar:3.0.19.Final]
        at org.jboss.resteasy.core.<wbr>ResourceLocatorInvoker.<wbr>invokeOnTargetObject(<wbr>ResourceLocatorInvoker.java:<wbr>133) [resteasy-jaxrs-3.0.19.Final.<wbr>jar:3.0.19.Final]
        at org.jboss.resteasy.core.<wbr>ResourceLocatorInvoker.invoke(<wbr>ResourceLocatorInvoker.java:<wbr>101) [resteasy-jaxrs-3.0.19.Final.<wbr>jar:3.0.19.Final]
        at org.jboss.resteasy.core.<wbr>SynchronousDispatcher.invoke(<wbr>SynchronousDispatcher.java:<wbr>402) [resteasy-jaxrs-3.0.19.Final.<wbr>jar:3.0.19.Final]
        at org.jboss.resteasy.core.<wbr>SynchronousDispatcher.invoke(<wbr>SynchronousDispatcher.java:<wbr>209) [resteasy-jaxrs-3.0.19.Final.<wbr>jar:3.0.19.Final]
        at org.jboss.resteasy.plugins.<wbr>server.servlet.<wbr>ServletContainerDispatcher.<wbr>service(<wbr>ServletContainerDispatcher.<wbr>java:221) [resteasy-jaxrs-3.0.19.Final.<wbr>jar:3.0.19.Final]
        at org.jboss.resteasy.plugins.<wbr>server.servlet.<wbr>HttpServletDispatcher.service(<wbr>HttpServletDispatcher.java:56) [resteasy-jaxrs-3.0.19.Final.<wbr>jar:3.0.19.Final]
        at org.jboss.resteasy.plugins.<wbr>server.servlet.<wbr>HttpServletDispatcher.service(<wbr>HttpServletDispatcher.java:51) [resteasy-jaxrs-3.0.19.Final.<wbr>jar:3.0.19.Final]
        at javax.servlet.http.<wbr>HttpServlet.service(<wbr>HttpServlet.java:790) [jboss-servlet-api_3.1_spec-1.<wbr>0.0.Final.jar:1.0.0.Final]
        at io.undertow.servlet.handlers.<wbr>ServletHandler.handleRequest(<wbr>ServletHandler.java:85)
        at io.undertow.servlet.handlers.<wbr>FilterHandler.handleRequest(<wbr>FilterHandler.java:81)
        at io.undertow.servlet.handlers.<wbr>security.<wbr>ServletSecurityRoleHandler.<wbr>handleRequest(<wbr>ServletSecurityRoleHandler.<wbr>java:62)
        at io.undertow.servlet.handlers.<wbr>ServletDispatchingHandler.<wbr>handleRequest(<wbr>ServletDispatchingHandler.<wbr>java:36)
        at io.undertow.server.handlers.<wbr>PredicateHandler.<wbr>handleRequest(<wbr>PredicateHandler.java:43)
        at io.undertow.server.handlers.<wbr>PredicateHandler.<wbr>handleRequest(<wbr>PredicateHandler.java:43)
        at io.undertow.server.handlers.<wbr>PredicateHandler.<wbr>handleRequest(<wbr>PredicateHandler.java:43)
        at io.undertow.servlet.handlers.<wbr>ServletInitialHandler.<wbr>dispatchRequest(<wbr>ServletInitialHandler.java:<wbr>274)
        at io.undertow.servlet.handlers.<wbr>ServletInitialHandler.<wbr>dispatchToPath(<wbr>ServletInitialHandler.java:<wbr>209)
        at io.undertow.servlet.spec.<wbr>RequestDispatcherImpl.<wbr>forwardImpl(<wbr>RequestDispatcherImpl.java:<wbr>221)
        at io.undertow.servlet.spec.<wbr>RequestDispatcherImpl.<wbr>forwardImplSetup(<wbr>RequestDispatcherImpl.java:<wbr>147)
        at io.undertow.servlet.spec.<wbr>RequestDispatcherImpl.forward(<wbr>RequestDispatcherImpl.java:<wbr>111)
        at org.ovirt.engine.api.restapi.<wbr>invocation.VersionFilter.<wbr>doFilter(VersionFilter.java:<wbr>139)
        at org.ovirt.engine.api.restapi.<wbr>invocation.VersionFilter.<wbr>doFilter(VersionFilter.java:<wbr>68)
        at io.undertow.servlet.core.<wbr>ManagedFilter.doFilter(<wbr>ManagedFilter.java:61)
        at io.undertow.servlet.handlers.<wbr>FilterHandler$FilterChainImpl.<wbr>doFilter(FilterHandler.java:<wbr>131)
        at org.ovirt.engine.api.restapi.<wbr>invocation.CurrentFilter.<wbr>doFilter(CurrentFilter.java:<wbr>84)
        at org.ovirt.engine.api.restapi.<wbr>invocation.CurrentFilter.<wbr>doFilter(CurrentFilter.java:<wbr>63)
        at io.undertow.servlet.core.<wbr>ManagedFilter.doFilter(<wbr>ManagedFilter.java:61)
        at io.undertow.servlet.handlers.<wbr>FilterHandler$FilterChainImpl.<wbr>doFilter(FilterHandler.java:<wbr>131)
        at org.ovirt.engine.core.aaa.<wbr>filters.<wbr>RestApiSessionMgmtFilter.<wbr>doFilter(<wbr>RestApiSessionMgmtFilter.java:<wbr>78) [aaa.jar:]
        at io.undertow.servlet.core.<wbr>ManagedFilter.doFilter(<wbr>ManagedFilter.java:61)
        at io.undertow.servlet.handlers.<wbr>FilterHandler$FilterChainImpl.<wbr>doFilter(FilterHandler.java:<wbr>131)
        at org.ovirt.engine.core.aaa.<wbr>filters.EnforceAuthFilter.<wbr>doFilter(EnforceAuthFilter.<wbr>java:39) [aaa.jar:]
        at io.undertow.servlet.core.<wbr>ManagedFilter.doFilter(<wbr>ManagedFilter.java:61)
        at io.undertow.servlet.handlers.<wbr>FilterHandler$FilterChainImpl.<wbr>doFilter(FilterHandler.java:<wbr>131)
        at org.ovirt.engine.core.aaa.<wbr>filters.<wbr>SsoRestApiNegotiationFilter.<wbr>doFilter(<wbr>SsoRestApiNegotiationFilter.<wbr>java:91) [aaa.jar:]
        at io.undertow.servlet.core.<wbr>ManagedFilter.doFilter(<wbr>ManagedFilter.java:61)
        at io.undertow.servlet.handlers.<wbr>FilterHandler$FilterChainImpl.<wbr>doFilter(FilterHandler.java:<wbr>131)
        at org.ovirt.engine.core.aaa.<wbr>filters.SsoRestApiAuthFilter.<wbr>doFilter(SsoRestApiAuthFilter.<wbr>java:47) [aaa.jar:]
        at io.undertow.servlet.core.<wbr>ManagedFilter.doFilter(<wbr>ManagedFilter.java:61)
        at io.undertow.servlet.handlers.<wbr>FilterHandler$FilterChainImpl.<wbr>doFilter(FilterHandler.java:<wbr>131)
        at org.ovirt.engine.core.aaa.<wbr>filters.<wbr>SessionValidationFilter.<wbr>doFilter(<wbr>SessionValidationFilter.java:<wbr>59) [aaa.jar:]
        at io.undertow.servlet.core.<wbr>ManagedFilter.doFilter(<wbr>ManagedFilter.java:61)
        at io.undertow.servlet.handlers.<wbr>FilterHandler$FilterChainImpl.<wbr>doFilter(FilterHandler.java:<wbr>131)
        at org.ovirt.engine.core.aaa.<wbr>filters.<wbr>RestApiSessionValidationFilter<wbr>.doFilter(<wbr>RestApiSessionValidationFilter<wbr>.java:35) [aaa.jar:]
        at io.undertow.servlet.core.<wbr>ManagedFilter.doFilter(<wbr>ManagedFilter.java:61)
        at io.undertow.servlet.handlers.<wbr>FilterHandler$FilterChainImpl.<wbr>doFilter(FilterHandler.java:<wbr>131)
        at org.ovirt.engine.api.restapi.<wbr>security.CSRFProtectionFilter.<wbr>doFilter(CSRFProtectionFilter.<wbr>java:111)
        at org.ovirt.engine.api.restapi.<wbr>security.CSRFProtectionFilter.<wbr>doFilter(CSRFProtectionFilter.<wbr>java:102)
        at io.undertow.servlet.core.<wbr>ManagedFilter.doFilter(<wbr>ManagedFilter.java:61)
        at io.undertow.servlet.handlers.<wbr>FilterHandler$FilterChainImpl.<wbr>doFilter(FilterHandler.java:<wbr>131)
        at org.ovirt.engine.api.restapi.<wbr>security.CORSSupportFilter.<wbr>doFilter(CORSSupportFilter.<wbr>java:183)
        at io.undertow.servlet.core.<wbr>ManagedFilter.doFilter(<wbr>ManagedFilter.java:61)
        at io.undertow.servlet.handlers.<wbr>FilterHandler$FilterChainImpl.<wbr>doFilter(FilterHandler.java:<wbr>131)
        at io.undertow.servlet.handlers.<wbr>FilterHandler.handleRequest(<wbr>FilterHandler.java:84)
        at io.undertow.servlet.handlers.<wbr>security.<wbr>ServletSecurityRoleHandler.<wbr>handleRequest(<wbr>ServletSecurityRoleHandler.<wbr>java:62)
        at io.undertow.servlet.handlers.<wbr>ServletDispatchingHandler.<wbr>handleRequest(<wbr>ServletDispatchingHandler.<wbr>java:36)
        at org.wildfly.extension.<wbr>undertow.security.<wbr>SecurityContextAssociationHand<wbr>ler.handleRequest(<wbr>SecurityContextAssociationHand<wbr>ler.java:78)
        at io.undertow.server.handlers.<wbr>PredicateHandler.<wbr>handleRequest(<wbr>PredicateHandler.java:43)
        at io.undertow.servlet.handlers.<wbr>security.<wbr>SSLInformationAssociationHandl<wbr>er.handleRequest(<wbr>SSLInformationAssociationHandl<wbr>er.java:131)
        at io.undertow.servlet.handlers.<wbr>security.<wbr>ServletAuthenticationCallHandl<wbr>er.handleRequest(<wbr>ServletAuthenticationCallHandl<wbr>er.java:57)
        at io.undertow.server.handlers.<wbr>PredicateHandler.<wbr>handleRequest(<wbr>PredicateHandler.java:43)
        at io.undertow.security.handlers.<wbr>AuthenticationConstraintHandle<wbr>r.handleRequest(<wbr>AuthenticationConstraintHandle<wbr>r.java:53)
        at io.undertow.security.handlers.<wbr>AbstractConfidentialityHandler<wbr>.handleRequest(<wbr>AbstractConfidentialityHandler<wbr>.java:46)
        at io.undertow.servlet.handlers.<wbr>security.<wbr>ServletConfidentialityConstrai<wbr>ntHandler.handleRequest(<wbr>ServletConfidentialityConstrai<wbr>ntHandler.java:64)
        at io.undertow.servlet.handlers.<wbr>security.<wbr>ServletSecurityConstraintHandl<wbr>er.handleRequest(<wbr>ServletSecurityConstraintHandl<wbr>er.java:59)
        at io.undertow.security.handlers.<wbr>AuthenticationMechanismsHandle<wbr>r.handleRequest(<wbr>AuthenticationMechanismsHandle<wbr>r.java:60)
        at io.undertow.servlet.handlers.<wbr>security.<wbr>CachedAuthenticatedSessionHand<wbr>ler.handleRequest(<wbr>CachedAuthenticatedSessionHand<wbr>ler.java:77)
        at io.undertow.security.handlers.<wbr>NotificationReceiverHandler.<wbr>handleRequest(<wbr>NotificationReceiverHandler.<wbr>java:50)
        at io.undertow.security.handlers.<wbr>AbstractSecurityContextAssocia<wbr>tionHandler.handleRequest(<wbr>AbstractSecurityContextAssocia<wbr>tionHandler.java:43)
        at io.undertow.server.handlers.<wbr>PredicateHandler.<wbr>handleRequest(<wbr>PredicateHandler.java:43)
        at org.wildfly.extension.<wbr>undertow.security.jacc.<wbr>JACCContextIdHandler.<wbr>handleRequest(<wbr>JACCContextIdHandler.java:61)
        at io.undertow.server.handlers.<wbr>PredicateHandler.<wbr>handleRequest(<wbr>PredicateHandler.java:43)
        at io.undertow.server.handlers.<wbr>PredicateHandler.<wbr>handleRequest(<wbr>PredicateHandler.java:43)
        at io.undertow.servlet.handlers.<wbr>ServletInitialHandler.<wbr>handleFirstRequest(<wbr>ServletInitialHandler.java:<wbr>292)
        at io.undertow.servlet.handlers.<wbr>ServletInitialHandler.access$<wbr>100(ServletInitialHandler.<wbr>java:81)
        at io.undertow.servlet.handlers.<wbr>ServletInitialHandler$2.call(<wbr>ServletInitialHandler.java:<wbr>138)
        at io.undertow.servlet.handlers.<wbr>ServletInitialHandler$2.call(<wbr>ServletInitialHandler.java:<wbr>135)
        at io.undertow.servlet.core.<wbr>ServletRequestContextThreadSet<wbr>upAction$1.call(<wbr>ServletRequestContextThreadSet<wbr>upAction.java:48)
        at io.undertow.servlet.core.<wbr>ContextClassLoaderSetupAction$<wbr>1.call(<wbr>ContextClassLoaderSetupAction.<wbr>java:43)
        at io.undertow.servlet.api.<wbr>LegacyThreadSetupActionWrapper<wbr>$1.call(<wbr>LegacyThreadSetupActionWrapper<wbr>.java:44)
        at io.undertow.servlet.api.<wbr>LegacyThreadSetupActionWrapper<wbr>$1.call(<wbr>LegacyThreadSetupActionWrapper<wbr>.java:44)
        at io.undertow.servlet.api.<wbr>LegacyThreadSetupActionWrapper<wbr>$1.call(<wbr>LegacyThreadSetupActionWrapper<wbr>.java:44)
        at io.undertow.servlet.api.<wbr>LegacyThreadSetupActionWrapper<wbr>$1.call(<wbr>LegacyThreadSetupActionWrapper<wbr>.java:44)
        at io.undertow.servlet.handlers.<wbr>ServletInitialHandler.<wbr>dispatchRequest(<wbr>ServletInitialHandler.java:<wbr>272)
        at io.undertow.servlet.handlers.<wbr>ServletInitialHandler.access$<wbr>000(ServletInitialHandler.<wbr>java:81)
        at io.undertow.servlet.handlers.<wbr>ServletInitialHandler$1.<wbr>handleRequest(<wbr>ServletInitialHandler.java:<wbr>104)
        at io.undertow.server.Connectors.<wbr>executeRootHandler(Connectors.<wbr>java:202)
        at io.undertow.server.<wbr>HttpServerExchange$1.run(<wbr>HttpServerExchange.java:805)
        at java.util.concurrent.<wbr>ThreadPoolExecutor.runWorker(<wbr>ThreadPoolExecutor.java:1142) [rt.jar:1.8.0_111]
        at java.util.concurrent.<wbr>ThreadPoolExecutor$Worker.run(<wbr>ThreadPoolExecutor.java:617) [rt.jar:1.8.0_111]
        at java.lang.Thread.run(Thread.<wbr>java:745) [rt.jar:1.8.0_111]
</pre></div><div><br></div><div>[1] - <a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_4.0/3718/" target="_blank">http://jenkins.ovirt.org/<wbr>job/test-repo_ovirt_<wbr>experimental_4.0/3718/</a></div><div>[2] - <a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_4.0/3718/artifact/exported-artifacts/basic_suite_4.0.sh-el7/exported-artifacts/test_logs/basic-suite-4.0/post-002_bootstrap.py/" target="_blank">http://jenkins.ovirt.org/<wbr>job/test-repo_ovirt_<wbr>experimental_4.0/3718/<wbr>artifact/exported-artifacts/<wbr>basic_suite_4.0.sh-el7/<wbr>exported-artifacts/test_logs/<wbr>basic-suite-4.0/post-002_<wbr>bootstrap.py/</a></div><div><br></div><div><br clear="all"><div><div class="m_-2392552054272199132gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div>Best Regards,</div><div dir="ltr"><br></div><div dir="ltr">Shlomi Ben-David | Software Engineer <span style="font-size:small">| </span><span style="font-size:12.8px">Red Hat ISRAEL</span></div><div>RHCSA | <span style="font-size:small">RHCE</span><span style="font-size:small"> </span><span style="font-size:12.8px"> </span></div><div dir="ltr">IRC: shlomibendavid <span style="font-size:small">(on #rhev-integ, #rhev-dev, #rhev-ci)</span><br><br>OPEN SOURCE - 1 4 011 &amp;&amp; 011 4 1<br></div></div></div></div></div></div></div></div></div></div></div></div>
</div></div>
<br>______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/devel</a><br></blockquote></div><br></div>