I suspect you've missed the relevant exception:{"jsonrpc": "2.0", "id": "05aaf760-b3b7-47b5-8bd7-034e899b7400", "error": {"message": "General Exception: (\"'portMirroring'\",)", "code": 100}}� 2017-12-12 13:27:48,142-05 DEBUG [org.ovirt.vdsm.jsonrpc.client.internal. ResponseWorker] (ResponseWorker) [] Message received: {"jsonrpc": "2.0", "id": "05aaf760-b3b7-47b5-8bd7- 034e899b7400", "error": {"message": "General Exception: (\"'portMirroring'\",)", "code": 100}} 2017-12-12 13:27:48,142-05 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker. HotUnplugNicVDSCommand] (default task-12) [4c4b50dc] Failed in 'HotUnplugNicVDS' method 2017-12-12 13:27:48,150-05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling. AuditLogDirector] (default task-12) [4c4b50dc] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10, 802), VDSM lago-basic-suite-master-host-0 command HotUnplugNicVDS failed: General Exception: ("'portMirroring'",) 2017-12-12 13:27:48,150-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker. HotUnplugNicVDSCommand] (default task-12) [4c4b50dc] Command 'org.ovirt.engine.core. vdsbroker.vdsbroker. HotUnplugNicVDSCommand' return value 'StatusOnlyReturn [status=Status [code=100, message=General Exception: ("'portMirroring'",)]]' 2017-12-12 13:27:48,150-05 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker. HotUnplugNicVDSCommand] (default task-12) [4c4b50dc] HostName = lago-basic-suite-master-host-0 2017-12-12 13:27:48,150-05 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker. HotUnplugNicVDSCommand] (default task-12) [4c4b50dc] Command 'HotUnplugNicVDSCommand( HostName = lago-basic-suite-master-host- 0, VmNicDeviceVDSParameters:{ hostId='cf1d46b2-4594-4076- 9d24-6f75220f0c97', vm.vm_name='vm0', nic='VmNic:{id='4487559e-7e47- 4ab7-a6fe-1ae32fb34336', vnicProfileId='623c894e-234c- 4f1b-899e-275be6864f75', speed='1000', type='3', macAddress='00:1a:4a:16:01:03' , linked='true', vmId='90124564-04f7-4607-a222- 503c42262844', vmTemplateId='null'}', vmDevice='VmDevice:{id=' VmDeviceId:{deviceId=' 4487559e-7e47-4ab7-a6fe- 1ae32fb34336', vmId='90124564-04f7-4607-a222- 503c42262844'}', device='bridge', type='INTERFACE', specParams='[inbound={}, outbound={}]', address='{slot=0x0a, bus=0x00, domain=0x0000, type=pci, function=0x0}', managed='true', plugged='true', readOnly='false', deviceAlias='net2', customProperties='[]', snapshotId='null', logicalName='null', hostDevice='null'}'})' execution failed: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = General Exception: ("'portMirroring'",), code = 100 2017-12-12 13:27:48,150-05 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker. HotUnplugNicVDSCommand] (default task-12) [4c4b50dc] Exception: org.ovirt.engine.core. vdsbroker.vdsbroker. VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotUnplugNicVDS, error = General Exception: ("'portMirroring'",), code = 100 at org.ovirt.engine.core.vdsbroker.vdsbroker. VdsBrokerCommand. createDefaultConcreteException (VdsBrokerCommand.java:81) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker. BrokerCommandBase. createException( BrokerCommandBase.java:224) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker. BrokerCommandBase. proceedProxyReturnValue( BrokerCommandBase.java:194) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker. HotUnplugNicVDSCommand. executeVdsBrokerCommand( HotUnplugNicVDSCommand.java: 14) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker. VdsBrokerCommand. executeVDSCommand( VdsBrokerCommand.java:112) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VDSCommandBase. executeCommand(VDSCommandBase. java:73) [vdsbroker.jar:] ...(I did not look into the VDSM log to see what failed there)
Y.On Tue, Dec 12, 2017 at 9:51 PM, Dafna Ron <dron@redhat.com> wrote:Hi,
We have a failure on test 098_ovirt_provider_ovn.use_ovn
_provider but I am not sure how the reported patch is related to the failure.
Link and headline of suspected patches:
https://gerrit.ovirt.org/#/c/85147/ - virt: Fix flipped condition in hotunplugNic
Link to Job:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-teste r/4371
Link to all logs:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-teste r/4371/artifact
(Relevant) error snippet from the log:
<error>
from junit:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packa ges/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packa ges/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packa ges/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packa ges/ovirtlago/testlib.py", line 78, in wrapper prefix.virt_env.engine_vm().ge t_api(api_ver=4), *args, **kwargs File "/usr/lib/python2.7/site-packa ges/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt -master_change-queue-tester/ ovirt-system-tests/basic- suite-master/test-scenarios/ 098_ovirt_provider_ovn.py", line 435, in use_ovn_provider _remove_iface_from_vm(api, VM0_NAME, IFACE_NAME) File "/home/jenkins/workspace/ovirt -master_change-queue-tester/ ovirt-system-tests/basic- suite-master/test-scenarios/ 098_ovirt_provider_ovn.py", line 388, in _remove_iface_from_vm nic_service.deactivate() File "/usr/lib64/python2.7/site-pac kages/ovirtsdk4/services.py", line 29110, in deactivate return self._internal_action(action, 'deactivate', None, headers, query, wait) File "/usr/lib64/python2.7/site-pac kages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-pac kages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-pac kages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-pac kages/ovirtsdk4/service.py", line 132, in _check_fault self._raise_error(response, body) File "/usr/lib64/python2.7/site-pac kages/ovirtsdk4/service.py", line 118, in _raise_error raise error 'Fault reason is "Operation Failed". Fault detail is "[General Exception]". HTTP response code is 400.\n-------------------- >> begin captured logging << --------------------\nrequests .packages.urllib3.connectionpo ol: INFO: * Starting new HTTPS connection (1): 192.168.202.4\npy.warnings: WARNING: * Unverified HTTPS request is being made. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.or g/en/latest/security.html\nreq DEBUG: "POST /v2.0/tokens/ HTTP/1.1" 200 None\nrequests.packages.urllibuests.packages.urllib3.connect ionpool: 3.connectionpool: INFO: * Starting new HTTPS connection (1): 192.168.202.4\nrequests.packag es.urllib3.connectionpool: DEBUG: "GET /v2.0/networks/ HTTP/1.1" 200 None\nrequests.packages.urllib 3.connectionpool: INFO: * Starting new HTTPS connection (1): 192.168.202.4\nrequests.packag es.urllib3.connectionpool: DEBUG: "GET /v2.0/ports/ HTTP/1.1" 200 None\nrequests.packages.urllib 3.connectionpool: INFO: * Starting new HTTPS connection (1): 192.168.202.4\nrequests.packag es.urllib3.connectionpool: DEBUG: "GET /v2.0/subnets/ HTTP/1.1" 200 None\nrequests.packages.urllib 3.connectionpool: INFO: * Starting new HTTPS connection (1): 192.168.202.4\nrequests.packag es.urllib3.connectionpool: DEBUG: "POST /v2.0/networks/ HTTP/1.1" 201 None\nrequests.packages.urllib 3.connectionpool: INFO: * Starting new HTTPS connection (1): 192.168.202.4\nrequests.packag es.urllib3.connectionpool: DEBUG: "POST /v2.0/subnets/ HTTP/1.1" 201 None\nrequests.packages.urllib 3.connectionpool: INFO: * Starting new HTTPS connection (1): 192.168.202.4\nrequests.packag es.urllib3.connectionpool: DEBUG: "POST /v2.0/ports/ HTTP/1.1" 201 None\nrequests.packages.urllib 3.connectionpool: INFO: * Starting new HTTPS connection (1): 192.168.202.4\nrequests.packag es.urllib3.connectionpool: DEBUG: "GET /v2.0/networks/ HTTP/1.1" 200 None\nrequests.packages.urllib 3.connectionpool: INFO: * Starting new HTTPS connection (1): 192.168.202.4\nrequests.packag es.urllib3.connectionpool: DEBUG: "GET /v2.0/ports/ HTTP/1.1" 200 None\nrequests.packages.urllib 3.connectionpool: INFO: * Starting new HTTPS connection (1): 192.168.202.4\nrequests.packag es.urllib3.connectionpool: DEBUG: "GET /v2.0/subnets/ HTTP/1.1" 200 None\n--------------------- >> end captured logging << ---------------------' >From engine: 2017-12-12 13:00:57,490-05 DEBUG [org.ovirt.engine.core.aaa.fil ters.SsoRestApiNegotiationFilt er] (default task-6) [] SsoRestApiNegotiationFilter Not performing Negotiate Auth 2017-12-12 13:00:57,548-05 DEBUG [org.ovirt.engine.core.common. di.interceptor.DebugLoggingInt erceptor] (default task-6) [cdcdc9bf-0da4-4d64-953a-2c8e5 9587e2b] method: runQuery, params: [Search, SearchParameters:{refresh='fal se', filtered='false', searchType='Provider', searchPattern='Providers: type=OPENSTACK_NETWORK', caseSensitive='false', from='0', max='2147483647'}], timeElapsed: 44ms 2017-12-12 13:00:57,586-05 DEBUG [org.ovirt.engine.core.dal.dbb roker.DbFacadeUtils] (default task-6) [cdcdc9bf-0da4-4d64-953a-2c8e5 9587e2b] Failed to decrypt password: javax.crypto.BadPaddingExcepti on: Decryption error at sun.security.rsa.RSAPadding.un padV15(RSAPadding.java:380) [rt.jar:1.8.0_151] at sun.security.rsa.RSAPadding.un pad(RSAPadding.java:291) [rt.jar:1.8.0_151] at com.sun.crypto.provider.RSACip her.doFinal(RSACipher.java: 363) [sunjce_provider.jar:1.8.0_151 ] at com.sun.crypto.provider.RSACip her.engineDoFinal(RSACipher. java:389) [sunjce_provider.jar:1.8.0_151 ] at javax.crypto.Cipher.doFinal(Ci pher.java:2165) [jce.jar:1.8.0_151] at org.ovirt.engine.core.utils.cr ypt.EngineEncryptionUtils.decr ypt(EngineEncryptionUtils.java :179) [utils.jar:] at org.ovirt.engine.core.dal.dbbr oker.DbFacadeUtils.decryptPass word(DbFacadeUtils.java:35) [dal.jar:] at org.ovirt.engine.core.dao.prov ider.ProviderDaoImpl$ProviderR owMapper.mapRow(ProviderDaoImp l.java:137) [dal.jar:] at org.ovirt.engine.core.dao.prov ider.ProviderDaoImpl$ProviderR owMapper.mapRow(ProviderDaoImp l.java:119) [dal.jar:] at org.springframework.jdbc.core. RowMapperResultSetExtractor.ex tractData(RowMapperResultSetEx tractor.java:93) [spring-jdbc.jar:4.3.9.RELEASE ] at org.springframework.jdbc.core. RowMapperResultSetExtractor.ex tractData(RowMapperResultSetEx tractor.java:60) [spring-jdbc.jar:4.3.9.RELEASE ] at org.springframework.jdbc.core. JdbcTemplate$1QueryStatementCa llback.doInStatement( JdbcTemplate.java:463) [spring-jdbc.jar:4.3.9.RELEASE ] at org.springframework.jdbc.core. JdbcTemplate.execute(JdbcTempl ate.java:408) [spring-jdbc.jar:4.3.9.RELEASE ] at org.springframework.jdbc.core. JdbcTemplate.query(JdbcTemplat e.java:474) [spring-jdbc.jar:4.3.9.RELEASE ] at org.springframework.jdbc.core. JdbcTemplate.query(JdbcTemplat e.java:484) [spring-jdbc.jar:4.3.9.RELEASE ] at org.ovirt.engine.core.dao.prov ider.ProviderDaoImpl.getAllWit hQuery(ProviderDaoImpl.java: 189) [dal.jar:] at org.ovirt.engine.core.bll.Sear chQuery.genericSearch(SearchQu ery.java:343) [bll.jar:] at org.ovirt.engine.core.bll.Sear chQuery.searchProviders(Search Query.java:414) [bll.jar:] at org.ovirt.engine.core.bll.Sear chQuery.executeQueryCommand(Se archQuery.java:219) [bll.jar:] at org.ovirt.engine.core.bll.Quer iesCommandBase.executeCommand( QueriesCommandBase.java:106) [bll.jar:] at org.ovirt.engine.core.dal.VdcC ommandBase.execute(VdcCommandB ase.java:33) [dal.jar:] at org.ovirt.engine.core.bll.exec utor.DefaultBackendQueryExecut or.execute(DefaultBackendQuery Executor.java:14) [bll.jar:] at org.ovirt.engine.core.bll.Back end.runQueryImpl(Backend.java: 579) [bll.jar:] at org.ovirt.engine.core.bll.Back end.runQuery(Backend.java:548) [bll.jar:] at sun.reflect.NativeMethodAccess orImpl.invoke0(Native Method) [rt.jar:1.8.0_151] at sun.reflect.NativeMethodAccess orImpl.invoke(NativeMethodAcce ssorImpl.java:62) [rt.jar:1.8.0_151] at sun.reflect.DelegatingMethodAc cessorImpl.invoke(DelegatingMe thodAccessorImpl.java:43) [rt.jar:1.8.0_151] at java.lang.reflect.Method.invok e(Method.java:498) [rt.jar:1.8.0_151] at org.jboss.as.ee.component.Mana gedReferenceMethodInterceptor. processInvocation(ManagedRefer enceMethodInterceptor.java:52) at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:422) at org.jboss.invocation.Intercept orContext$Invocation.proceed( InterceptorContext.java:509) at org.jboss.as.weld.ejb.Delegati ngInterceptorInvocationContext .proceed(DelegatingInterceptor InvocationContext.java:92) [wildfly-weld-ejb-11.0.0.Final .jar:11.0.0.Final] at org.jboss.weld.interceptor.pro xy.WeldInvocationContext.inter ceptorChainCompleted(WeldInvoc ationContext.java:98) [weld-core-impl-2.4.3.Final.ja r:2.4.3.Final] at org.jboss.weld.interceptor.pro xy.WeldInvocationContext.proce ed(WeldInvocationContext.java: 117) [weld-core-impl-2.4.3.Final.ja r:2.4.3.Final] at org.ovirt.engine.core.common.d i.interceptor.LoggingIntercept or.apply(LoggingInterceptor. java:12) [common.jar:] at sun.reflect.GeneratedMethodAcc essor69.invoke(Unknown Source) [:1.8.0_151] at sun.reflect.DelegatingMethodAc cessorImpl.invoke(DelegatingMe thodAccessorImpl.java:43) [rt.jar:1.8.0_151] at java.lang.reflect.Method.invok e(Method.java:498) [rt.jar:1.8.0_151] at org.jboss.weld.interceptor.rea der.SimpleInterceptorInvocatio n$SimpleMethodInvocation. invoke(SimpleInterceptorInvoca tion.java:73) [weld-core-impl-2.4.3.Final.ja r:2.4.3.Final] at org.jboss.weld.interceptor.pro xy.WeldInvocationContext.invok eNext(WeldInvocationContext. java:83) [weld-core-impl-2.4.3.Final.ja r:2.4.3.Final] at org.jboss.weld.interceptor.pro xy.WeldInvocationContext.proce ed(WeldInvocationContext.java: 115) [weld-core-impl-2.4.3.Final.ja r:2.4.3.Final] at org.jboss.weld.bean.Intercepto rImpl.intercept(InterceptorImp l.java:108) [weld-core-impl-2.4.3.Final.ja r:2.4.3.Final] at org.jboss.as.weld.ejb.Delegati ngInterceptorInvocationContext .proceed(DelegatingInterceptor InvocationContext.java:82) [wildfly-weld-ejb-11.0.0.Final .jar:11.0.0.Final] at org.jboss.as.weld.interceptors .EjbComponentInterceptorSuppor t.delegateInterception(EjbComp onentInterceptorSupport.java: 60) at org.jboss.as.weld.interceptors .Jsr299BindingsInterceptor.del egateInterception(Jsr299Bindin gsInterceptor.java:76) at org.jboss.as.weld.interceptors .Jsr299BindingsInterceptor.doM ethodInterception(Jsr299Bindin gsInterceptor.java:88) at org.jboss.as.weld.interceptors .Jsr299BindingsInterceptor.pro cessInvocation(Jsr299BindingsI nterceptor.java:101) at org.jboss.as.ee.component.inte rceptors.UserInterceptorFactor y$1.processInvocation(UserInte rceptorFactory.java:63) at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:422) at org.jboss.invocation.Intercept orContext$Invocation.proceed( InterceptorContext.java:509) at org.ovirt.engine.core.bll.inte rceptors.CorrelationIdTrackerI nterceptor.aroundInvoke(Correl ationIdTrackerInterceptor. java:13) [bll.jar:] at sun.reflect.GeneratedMethodAcc essor66.invoke(Unknown Source) [:1.8.0_151] at sun.reflect.DelegatingMethodAc cessorImpl.invoke(DelegatingMe thodAccessorImpl.java:43) [rt.jar:1.8.0_151] at java.lang.reflect.Method.invok e(Method.java:498) [rt.jar:1.8.0_151] at org.jboss.as.ee.component.Mana gedReferenceLifecycleMethodInt erceptor.processInvocation(Man agedReferenceLifecycleMethodIn terceptor.java:89) at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ejb3.component.in vocationmetrics.ExecutionTimeI nterceptor.processInvocation(E xecutionTimeInterceptor.java:4 3) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ee.concurrent.Con currentContextInterceptor.proc essInvocation(ConcurrentContex tInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:1 1.0.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:422) at org.jboss.invocation.InitialIn terceptor.processInvocation(In itialInterceptor.java:40) at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:422) at org.jboss.invocation.ChainedIn terceptor.processInvocation(Ch ainedInterceptor.java:53) at org.jboss.as.ee.component.inte rceptors.ComponentDispatcherIn terceptor.processInvocation(Co mponentDispatcherInterceptor. java:52) at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ejb3.component.si ngleton.SingletonComponentInst anceAssociationInterceptor.pro cessInvocation(SingletonCompon entInstanceAssociationIntercep tor.java:53) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ejb3.tx.CMTTxInte rceptor.invokeInNoTx(CMTTxInte rceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInte rceptor.supports(CMTTxIntercep tor.java:379) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInte rceptor.processInvocation(CMTT xInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:422) at org.jboss.invocation.Intercept orContext$Invocation.proceed( InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJB RequestScopeActivationIntercep