<div dir="ltr"><div><div>Hi, <br><br></div>We have a failure that seems to be random and happening in several projects. <br><br></div><div>from what I can see, we are failing due to a timing issue in the test itself because we are querying the vm after its been destroyed in engine. <br></div><div>looking at engine, I can see that the vm was actually shut down, <br></div><div><br></div><div>I would like to disable this test until we can fix the issue since it already failed about 7 different patches from different projects. <br><br><br><br></div><div><b style="font-weight:normal" id="gmail-docs-internal-guid-e8ba4241-6309-9190-8198-2fd1ee461d4a"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to Job:</span></p><b><a href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6521/">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6521/</a></b><br><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to all logs:</span></p><b><a href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6521/artifact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/post-004_basic_sanity.py/">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6521/artifact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/post-004_basic_sanity.py/</a></b><br><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">(Relevant) error snippet from the log: </span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">&lt;error&gt;</span></p><br></b></div><div><b style="font-weight:normal" id="gmail-docs-internal-guid-e8ba4241-6309-9190-8198-2fd1ee461d4a">engine: <br><br><b>018-03-23 14:44:14,156-04 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] Failed to destroy VM &#39;7020944f-cd26-4c31-b381-0ce6be733fd7&#39; because VM does not exist, ignoring<br>2018-03-23 14:44:14,156-04 INFO  [org.ovirt.engine.core.vdsbroker.vdsbroker.DestroyVDSCommand] (ForkJoinPool-1-worker-5) [] FINISH, DestroyVDSCommand, log id: 646766a<br>2018-03-23 14:44:14,156-04 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (ForkJoinPool-1-worker-5) [] method: runVdsCommand, params: [Destroy, DestroyVmVDSCommandParameters:{hostId=&#39;c40b11df-7053-437e-8acc-c5<br>e91c1694bc&#39;, vmId=&#39;7020944f-cd26-4c31-b381-0ce6be733fd7&#39;, secondsToWait=&#39;0&#39;, gracefully=&#39;false&#39;, reason=&#39;&#39;, ignoreNoVm=&#39;true&#39;}], timeElapsed: 14ms<br>2018-03-23 14:44:14,156-04 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (ForkJoinPool-1-worker-5) [] method: getVmManager, params: [7020944f-cd26-4c31-b381-0ce6be733fd7], timeElapsed: 0ms<br>2018-03-23 14:44:14,156-04 INFO  [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-5) [] VM &#39;7020944f-cd26-4c31-b381-0ce6be733fd7&#39;(vm2) moved from &#39;Up&#39; --&gt; &#39;Down&#39;<br>2018-03-23 14:44:14,156-04 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (ForkJoinPool-1-worker-5) [] method: getVmManager, params: [7020944f-cd26-4c31-b381-0ce6be733fd7], timeElapsed: 0ms<br>2018-03-23 14:44:14,177-04 INFO  [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-4) [a463501f-f01a-4048-93ca-02647308394b] EVENT_ID: USER_STOP_VM(33), VM vm2 powered off by admin@internal-authz (Host: <br>lago-basic-suite-master-host-0).<br><br></b></b></div><div><b style="font-weight:normal" id="gmail-docs-internal-guid-e8ba4241-6309-9190-8198-2fd1ee461d4a"><b>vdsm: <br><br>2018-03-23 14:44:14,024-0400 INFO  (libvirt/events) [virt.vm] (vmId=&#39;7020944f-cd26-4c31-b381-0ce6be733fd7&#39;) Changed state to Down: Admin shut down from the engine (code=6) (vm:1684)<br>2018-03-23 14:44:14,028-0400 INFO  (jsonrpc/1) [api.virt] FINISH destroy return={&#39;status&#39;: {&#39;message&#39;: &#39;Machine destroyed&#39;, &#39;code&#39;: 0}} from=::ffff:192.168.201.4,53454, flow_id=a463501f-f01a-4048-93ca-02647308394b, vmId=7020944f-cd26-4c31<br>-b381-0ce6be733fd7 (api:52)<br>2018-03-23 14:44:14,028-0400 INFO  (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call VM.destroy succeeded in 1.72 seconds (__init__:311)<br>2018-03-23 14:44:14,031-0400 INFO  (periodic/2) [Executor] Worker was discarded (executor:305)<br>2018-03-23 14:44:14,033-0400 INFO  (libvirt/events) [virt.vm] (vmId=&#39;7020944f-cd26-4c31-b381-0ce6be733fd7&#39;) Stopping connection (guestagent:440)<br>2018-03-23 14:44:14,033-0400 ERROR (libvirt/events) [vds] Error running VM callback (clientIF:666)<br>Traceback (most recent call last):<br>  File &quot;/usr/lib/python2.7/site-packages/vdsm/clientIF.py&quot;, line 629, in dispatchLibvirtEvents<br>    v.onLibvirtLifecycleEvent(event, detail, None)<br>AttributeError: &#39;NoneType&#39; object has no attribute &#39;onLibvirtLifecycleEvent&#39;<br>2018-03-23 14:44:14,078-0400 INFO  (jsonrpc/4) [api.virt] START destroy(gracefulAttempts=1) from=::ffff:192.168.201.4,53454, vmId=7020944f-cd26-4c31-b381-0ce6be733fd7 (api:46)<br>2018-03-23 14:44:14,078-0400 INFO  (jsonrpc/4) [api] FINISH destroy error=Virtual machine does not exist: {&#39;vmId&#39;: u&#39;7020944f-cd26-4c31-b381-0ce6be733fd7&#39;} (api:127)<br>2018-03-23 14:44:14,079-0400 INFO  (jsonrpc/4) [api.virt] FINISH destroy return={&#39;status&#39;: {&#39;message&#39;: &quot;Virtual machine does not exist: {&#39;vmId&#39;: u&#39;7020944f-cd26-4c31-b381-0ce6be733fd7&#39;}&quot;, &#39;code&#39;: 1}} from=::ffff:192.168.201.4,53454, vmId=<br>7020944f-cd26-4c31-b381-0ce6be733fd7 (api:52)<br><br></b></b></div><div><b style="font-weight:normal" id="gmail-docs-internal-guid-e8ba4241-6309-9190-8198-2fd1ee461d4a"><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">&lt;/error&gt;</span></p></b><br class="gmail-Apple-interchange-newline"></div></div>