[ OST Failure Report ] [ oVirt Master (ovirt-hosted-engine-setup) ] [ 26-02-2018 ] [ 007_sd_reattach.deactivate_storage_domain ]

Hi, We had a failure for 007_sd_reattach.deactivate_storage_domain because of running tasks on the storage domain. we have an open bug for this re-coring race on ost: https://bugzilla.redhat.com/show_bug.cgi?id=1538228 Please note the change reported does not seem to be related to the failure and I have re-triggered it. *Link and headline of suspected patches: Patch is not relatedLink to Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866 <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866>Link to all logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866/artifacts <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866/artifacts>(Relevant) error snippet from the log: <error>2018-02-26 07:03:39,691-05 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] SqlCall for procedure [GetAsyncTasksByEntityId] compiled2018-02-26 07:03:39,692-05 WARN [org.ovirt.engine.core.bll.storage.domain.DeactivateStorageDomainWithOvfUpdateCommand] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] There are running tasks: 'AsyncTask:{commandId='c455f212-4cb1-46e8-a2b5-61816c7e8b79', rootCommandId='c455f212-4cb1-46e8-a2b5-61816c7e8b79', storagePoolId='c0a3f481-4598-4b0a-aabc-4acc67cd45b5', taskId='5b342d74-4726-4430-924a-2fb9d1ab9201', vdsmTaskId='477aee46-f8d7-4676-bf33-3035e61e5ca9', stepId='null', taskType='downloadImageFromStream', status='running'}AsyncTask:{commandId='d2128202-bb95-4c29-80df-c5a822aad457', rootCommandId='d2128202-bb95-4c29-80df-c5a822aad457', storagePoolId='c0a3f481-4598-4b0a-aabc-4acc67cd45b5', taskId='fe3a6031-ebce-463c-bba7-5c78ddda0f18', vdsmTaskId='6ef057d6-6034-477b-ae01-bb87beb68584', stepId='null', taskType='downloadImageFromStream', status='running'}'2018-02-26 07:03:39,692-05 WARN [org.ovirt.engine.core.bll.storage.domain.DeactivateStorageDomainWithOvfUpdateCommand] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] Validation of action 'DeactivateStorageDomainWithOvfUpdate' failed for user admin@internal-authz. Reasons: VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__DEACTIVATE,ERROR_CANNOT_DEACTIVATE_DOMAIN_WITH_TASKS2018-02-26 07:03:39,693-05 INFO [org.ovirt.engine.core.bll.storage.domain.DeactivateStorageDomainWithOvfUpdateCommand] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] Lock freed to object 'EngineLock:{exclusiveLocks='[167d2b72-445d-424c-ac1e-f3c8d6e8aeca=STORAGE]', sharedLocks='[c0a3f481-4598-4b0a-aabc-4acc67cd45b5=POOL]'}'2018-02-26 07:03:39,693-05 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] method: runAction, params: [DeactivateStorageDomainWithOvfUpdate, DeactivateStorageDomainWithOvfUpdateParameters:{commandId='f64e5c4b-51b3-4b90-97d6-b6b2544d9874', user='null', commandType='Unknown'}], timeElapsed: 63ms2018-02-26 07:03:39,698-05 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-9) [] Operation Failed: [Cannot deactivate Storage while there are running tasks on this Storage.-Please wait until tasks will finish and try again.]2018-02-26 07:03:40,659-05 DEBUG [org.ovirt.engine.core.utils.timer.FixedDelayJobListener] (DefaultQuartzScheduler6) [] Rescheduling DEFAULT.org.ovirt.engine.core.bll.gluster.GlusterServiceSyncJob.refreshGlusterServices#-9223372036854775801 as there is no unfired trigger.2018-02-26 07:03:40,660-05 DEBUG [org.ovirt.engine.core.utils.timer.FixedDelayJobListener] (DefaultQuartzScheduler1) [] Rescheduling DEFAULT.org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshLightWeightData#-9223372036854775795 as there is no unfired trigger.2018-02-26 07:03:40,764-05 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (EE-ManagedThreadFactory-engineScheduled-Thread-81) [] Polling and updating Async Tasks: 6 tasks, 4 tasks to poll now2018-02-26 07:03:40,767-05 DEBUG [org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksStatusesVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-81) [] START, SPMGetAllTasksStatusesVDSCommand( IrsBaseVDSCommandParameters:{storagePoolId='c0a3f481-4598-4b0a-aabc-4acc67cd45b5', ignoreFailoverLimit='false'}), log id: 226c225f</error>*
participants (1)
-
Dafna Ron