<div dir="ltr"><div><div><div>Hi, <br><br></div>We had a failure for 007_sd_reattach.deactivate_storage_domain because of running tasks on the storage domain. <br><br></div>we have an open bug for this re-coring race on ost: <br><a href="https://bugzilla.redhat.com/show_bug.cgi?id=1538228">https://bugzilla.redhat.com/show_bug.cgi?id=1538228</a> <br><br></div>Please note the change reported does not seem to be related to the failure and I have re-triggered it. <br><br><b style="font-weight:normal" id="gmail-docs-internal-guid-e8ba4241-d24f-2e2b-d7f5-5637ddb3a934"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link and headline of suspected patches: <br></span></p><p style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><b>Patch is not related</b><br></span></p><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to Job:</span></p><a href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866</a><br><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to all logs:</span></p><a href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866/artifacts">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866/artifacts</a><br><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">(Relevant) error snippet from the log: </span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">&lt;error&gt;</span></p><br>2018-02-26 07:03:39,691-05 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] SqlCall for procedure [GetAsyncTasksByEntityId] compiled<br>2018-02-26 07:03:39,692-05 WARN  [org.ovirt.engine.core.bll.storage.domain.DeactivateStorageDomainWithOvfUpdateCommand] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] There are running tasks: &#39;AsyncTask:{commandId=&#39;c455f212-4cb1-46e8-a2b5-61816c7e8b79&#39;, rootCommandId=&#39;c455f212-4cb1-46e8-a2b5-61816c7e8b79&#39;, storagePoolId=&#39;c0a3f481-4598-4b0a-aabc-4acc67cd45b5&#39;, taskId=&#39;5b342d74-4726-4430-924a-2fb9d1ab9201&#39;, vdsmTaskId=&#39;477aee46-f8d7-4676-bf33-3035e61e5ca9&#39;, stepId=&#39;null&#39;, taskType=&#39;downloadImageFromStream&#39;, status=&#39;running&#39;}<br>AsyncTask:{commandId=&#39;d2128202-bb95-4c29-80df-c5a822aad457&#39;, rootCommandId=&#39;d2128202-bb95-4c29-80df-c5a822aad457&#39;, storagePoolId=&#39;c0a3f481-4598-4b0a-aabc-4acc67cd45b5&#39;, taskId=&#39;fe3a6031-ebce-463c-bba7-5c78ddda0f18&#39;, vdsmTaskId=&#39;6ef057d6-6034-477b-ae01-bb87beb68584&#39;, stepId=&#39;null&#39;, taskType=&#39;downloadImageFromStream&#39;, status=&#39;running&#39;}&#39;<br>2018-02-26 07:03:39,692-05 WARN  [org.ovirt.engine.core.bll.storage.domain.DeactivateStorageDomainWithOvfUpdateCommand] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] Validation of action &#39;DeactivateStorageDomainWithOvfUpdate&#39; failed for user admin@internal-authz. Reasons: VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__DEACTIVATE,ERROR_CANNOT_DEACTIVATE_DOMAIN_WITH_TASKS<br>2018-02-26 07:03:39,693-05 INFO  [org.ovirt.engine.core.bll.storage.domain.DeactivateStorageDomainWithOvfUpdateCommand] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] Lock freed to object &#39;EngineLock:{exclusiveLocks=&#39;[167d2b72-445d-424c-ac1e-f3c8d6e8aeca=STORAGE]&#39;, sharedLocks=&#39;[c0a3f481-4598-4b0a-aabc-4acc67cd45b5=POOL]&#39;}&#39;<br>2018-02-26 07:03:39,693-05 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] method: runAction, params: [DeactivateStorageDomainWithOvfUpdate, DeactivateStorageDomainWithOvfUpdateParameters:{commandId=&#39;f64e5c4b-51b3-4b90-97d6-b6b2544d9874&#39;, user=&#39;null&#39;, commandType=&#39;Unknown&#39;}], timeElapsed: 63ms<br>2018-02-26 07:03:39,698-05 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-9) [] Operation Failed: [Cannot deactivate Storage while there are running tasks on this Storage.<br>-Please wait until tasks will finish and try again.]<br>2018-02-26 07:03:40,659-05 DEBUG [org.ovirt.engine.core.utils.timer.FixedDelayJobListener] (DefaultQuartzScheduler6) [] Rescheduling DEFAULT.org.ovirt.engine.core.bll.gluster.GlusterServiceSyncJob.refreshGlusterServices#-9223372036854775801 as there is no unfired trigger.<br>2018-02-26 07:03:40,660-05 DEBUG [org.ovirt.engine.core.utils.timer.FixedDelayJobListener] (DefaultQuartzScheduler1) [] Rescheduling DEFAULT.org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshLightWeightData#-9223372036854775795 as there is no unfired trigger.<br>2018-02-26 07:03:40,764-05 INFO  [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (EE-ManagedThreadFactory-engineScheduled-Thread-81) [] Polling and updating Async Tasks: 6 tasks, 4 tasks to poll now<br>2018-02-26 07:03:40,767-05 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksStatusesVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-81) [] START, SPMGetAllTasksStatusesVDSCommand( IrsBaseVDSCommandParameters:{storagePoolId=&#39;c0a3f481-4598-4b0a-aabc-4acc67cd45b5&#39;, ignoreFailoverLimit=&#39;false&#39;}), log id: 226c225f<br><br><br><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:rgb(0,0,0);background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">&lt;/error&gt;</span></p><br></b></div>