Hi,

We had a failure for 007_sd_reattach.deactivate_storage_domain because of running tasks on the storage domain.

we have an open bug for this re-coring race on ost:
https://bugzilla.redhat.com/show_bug.cgi?id=1538228

Please note the change reported does not seem to be related to the failure and I have re-triggered it.

Link and headline of suspected patches:

Patch is not related


Link to Job:

http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866

Link to all logs:

http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866/artifacts

(Relevant) error snippet from the log:

<error>


2018-02-26 07:03:39,691-05 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] SqlCall for procedure [GetAsyncTasksByEntityId] compiled
2018-02-26 07:03:39,692-05 WARN  [org.ovirt.engine.core.bll.storage.domain.DeactivateStorageDomainWithOvfUpdateCommand] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] There are running tasks: 'AsyncTask:{commandId='c455f212-4cb1-46e8-a2b5-61816c7e8b79', rootCommandId='c455f212-4cb1-46e8-a2b5-61816c7e8b79', storagePoolId='c0a3f481-4598-4b0a-aabc-4acc67cd45b5', taskId='5b342d74-4726-4430-924a-2fb9d1ab9201', vdsmTaskId='477aee46-f8d7-4676-bf33-3035e61e5ca9', stepId='null', taskType='downloadImageFromStream', status='running'}
AsyncTask:{commandId='d2128202-bb95-4c29-80df-c5a822aad457', rootCommandId='d2128202-bb95-4c29-80df-c5a822aad457', storagePoolId='c0a3f481-4598-4b0a-aabc-4acc67cd45b5', taskId='fe3a6031-ebce-463c-bba7-5c78ddda0f18', vdsmTaskId='6ef057d6-6034-477b-ae01-bb87beb68584', stepId='null', taskType='downloadImageFromStream', status='running'}'
2018-02-26 07:03:39,692-05 WARN  [org.ovirt.engine.core.bll.storage.domain.DeactivateStorageDomainWithOvfUpdateCommand] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] Validation of action 'DeactivateStorageDomainWithOvfUpdate' failed for user admin@internal-authz. Reasons: VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__DEACTIVATE,ERROR_CANNOT_DEACTIVATE_DOMAIN_WITH_TASKS
2018-02-26 07:03:39,693-05 INFO  [org.ovirt.engine.core.bll.storage.domain.DeactivateStorageDomainWithOvfUpdateCommand] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] Lock freed to object 'EngineLock:{exclusiveLocks='[167d2b72-445d-424c-ac1e-f3c8d6e8aeca=STORAGE]', sharedLocks='[c0a3f481-4598-4b0a-aabc-4acc67cd45b5=POOL]'}'
2018-02-26 07:03:39,693-05 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] method: runAction, params: [DeactivateStorageDomainWithOvfUpdate, DeactivateStorageDomainWithOvfUpdateParameters:{commandId='f64e5c4b-51b3-4b90-97d6-b6b2544d9874', user='null', commandType='Unknown'}], timeElapsed: 63ms
2018-02-26 07:03:39,698-05 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-9) [] Operation Failed: [Cannot deactivate Storage while there are running tasks on this Storage.
-Please wait until tasks will finish and try again.]
2018-02-26 07:03:40,659-05 DEBUG [org.ovirt.engine.core.utils.timer.FixedDelayJobListener] (DefaultQuartzScheduler6) [] Rescheduling DEFAULT.org.ovirt.engine.core.bll.gluster.GlusterServiceSyncJob.refreshGlusterServices#-9223372036854775801 as there is no unfired trigger.
2018-02-26 07:03:40,660-05 DEBUG [org.ovirt.engine.core.utils.timer.FixedDelayJobListener] (DefaultQuartzScheduler1) [] Rescheduling DEFAULT.org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshLightWeightData#-9223372036854775795 as there is no unfired trigger.
2018-02-26 07:03:40,764-05 INFO  [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (EE-ManagedThreadFactory-engineScheduled-Thread-81) [] Polling and updating Async Tasks: 6 tasks, 4 tasks to poll now
2018-02-26 07:03:40,767-05 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksStatusesVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-81) [] START, SPMGetAllTasksStatusesVDSCommand( IrsBaseVDSCommandParameters:{storagePoolId='c0a3f481-4598-4b0a-aabc-4acc67cd45b5', ignoreFailoverLimit='false'}), log id: 226c225f


</error>