5:35 a.m.
Hi,
We had a failure for 007_sd_reattach.deactivate_storage_domain because of
running tasks on the storage domain.
we have an open bug for this re-coring race on ost:
https://bugzilla.redhat.com/show_bug.cgi?id=1538228
Please note the change reported does not seem to be related to the failure
and I have re-triggered it.
*Link and headline of suspected patches: Patch is not relatedLink to
Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866>Link to
all
logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866/a...
<http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5866/artifa...
error snippet from the log: <error>2018-02-26 07:03:39,691-05 DEBUG
[org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall]
(default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] SqlCall for
procedure [GetAsyncTasksByEntityId] compiled2018-02-26 07:03:39,692-05
WARN
[org.ovirt.engine.core.bll.storage.domain.DeactivateStorageDomainWithOvfUpdateCommand]
(default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] There are running
tasks: 'AsyncTask:{commandId='c455f212-4cb1-46e8-a2b5-61816c7e8b79',
rootCommandId='c455f212-4cb1-46e8-a2b5-61816c7e8b79',
storagePoolId='c0a3f481-4598-4b0a-aabc-4acc67cd45b5',
taskId='5b342d74-4726-4430-924a-2fb9d1ab9201',
vdsmTaskId='477aee46-f8d7-4676-bf33-3035e61e5ca9', stepId='null',
taskType='downloadImageFromStream',
status='running'}AsyncTask:{commandId='d2128202-bb95-4c29-80df-c5a822aad457',
rootCommandId='d2128202-bb95-4c29-80df-c5a822aad457',
storagePoolId='c0a3f481-4598-4b0a-aabc-4acc67cd45b5',
taskId='fe3a6031-ebce-463c-bba7-5c78ddda0f18',
vdsmTaskId='6ef057d6-6034-477b-ae01-bb87beb68584', stepId='null',
taskType='downloadImageFromStream', status='running'}'2018-02-26
07:03:39,692-05 WARN
[org.ovirt.engine.core.bll.storage.domain.DeactivateStorageDomainWithOvfUpdateCommand]
(default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] Validation of
action 'DeactivateStorageDomainWithOvfUpdate' failed for user
admin@internal-authz. Reasons:
VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__DEACTIVATE,ERROR_CANNOT_DEACTIVATE_DOMAIN_WITH_TASKS2018-02-26
07:03:39,693-05 INFO
[org.ovirt.engine.core.bll.storage.domain.DeactivateStorageDomainWithOvfUpdateCommand]
(default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] Lock freed to
object
'EngineLock:{exclusiveLocks='[167d2b72-445d-424c-ac1e-f3c8d6e8aeca=STORAGE]',
sharedLocks='[c0a3f481-4598-4b0a-aabc-4acc67cd45b5=POOL]'}'2018-02-26
07:03:39,693-05 DEBUG
[org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor]
(default task-9) [bebde602-3277-4ec4-be4f-7d60969080ec] method: runAction,
params: [DeactivateStorageDomainWithOvfUpdate,
DeactivateStorageDomainWithOvfUpdateParameters:{commandId='f64e5c4b-51b3-4b90-97d6-b6b2544d9874',
user='null', commandType='Unknown'}], timeElapsed: 63ms2018-02-26
07:03:39,698-05 ERROR
[org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default
task-9) [] Operation Failed: [Cannot deactivate Storage while there are
running tasks on this Storage.-Please wait until tasks will finish and try
again.]2018-02-26 07:03:40,659-05 DEBUG
[org.ovirt.engine.core.utils.timer.FixedDelayJobListener]
(DefaultQuartzScheduler6) [] Rescheduling
DEFAULT.org.ovirt.engine.core.bll.gluster.GlusterServiceSyncJob.refreshGlusterServices#-9223372036854775801
as there is no unfired trigger.2018-02-26 07:03:40,660-05 DEBUG
[org.ovirt.engine.core.utils.timer.FixedDelayJobListener]
(DefaultQuartzScheduler1) [] Rescheduling
DEFAULT.org.ovirt.engine.core.bll.gluster.GlusterSyncJob.refreshLightWeightData#-9223372036854775795
as there is no unfired trigger.2018-02-26 07:03:40,764-05 INFO
[org.ovirt.engine.core.bll.tasks.AsyncTaskManager]
(EE-ManagedThreadFactory-engineScheduled-Thread-81) [] Polling and updating
Async Tasks: 6 tasks, 4 tasks to poll now2018-02-26 07:03:40,767-05 DEBUG
[org.ovirt.engine.core.vdsbroker.irsbroker.SPMGetAllTasksStatusesVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-81) [] START,
SPMGetAllTasksStatusesVDSCommand(
IrsBaseVDSCommandParameters:{storagePoolId='c0a3f481-4598-4b0a-aabc-4acc67cd45b5',
ignoreFailoverLimit='false'}), log id: 226c225f</error>*