Re: [Users] Unable to delete a snapshot

Hi, With our oVirt 3.3, I created a snapshot 3 weeks ago on a VM I've properly shutdown. It ran so far. Today, after having shut it down properly, I'm trying to delete the snapshot and I get an error : "Failed to delete snapshot 'blahblahbla' for VM 'myVM'." The disk is thin provisionned, accessed via virtIO, nothing special. The log below comes from the manager. I hope someone could help us because this server is quite serious. Thank you. 2014-01-06 10:10:58,826 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp--127.0.0.1-8702-8) Lock Acquired to object EngineLock [exclu siveLocks= key: cb953dc1-c796-457a-99a1-0e54f1c0c338 value: VM , sharedLocks= ] 2014-01-06 10:10:58,837 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp--127.0.0.1-8702-8) Running command: RemoveSnapshotCommand internal: false. Entities affected : ID: cb953dc1-c796-457a-99a1-0e54f1c0c338 Type: VM 2014-01-06 10:10:58,840 INFO [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (ajp--127.0.0.1-8702-8) Lock freed to object EngineLock [exclusiveLocks= key: cb953dc1-c796-457a-99a1-0e54f1c0c338 value: VM , sharedLocks= ] 2014-01-06 10:10:58,844 INFO [org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand] (ajp--127.0.0.1-8702-8) Running command: RemoveSnapshotSingleDiskCommand internal: true. Entities affected : ID: 00000000-0000-0000-0000-000000000000 Type: Storage 2014-01-06 10:10:58,848 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MergeSnapshotsVDSCommand] (ajp--127.0.0.1-8702-8) START, MergeSnapshotsVDSCommand( storagePoolId = 5849b030-626e-47cb-ad90-3ce782d831b3, ignoreFailoverLimit = false, storageDomainId = 11a077c7-658b-49bb-8596-a785109c24c9, imageGroupId = 69220da6-eeed-4435-aad0-7aa33f3a0d21, imageId = 506085b6-40e0-4176-a4df-9102857f51f2, imageId2 = c50561d9-c3ba-4366-b2bc-49bbfaa4cd23, vmId = cb953dc1-c796-457a-99a1-0e54f1c0c338, postZero = false), log id: 22d6503b 2014-01-06 10:10:59,511 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MergeSnapshotsVDSCommand] (ajp--127.0.0.1-8702-8) FINISH, MergeSnapshotsVDSCommand, log id: 22d6503b 2014-01-06 10:10:59,518 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (ajp--127.0.0.1-8702-8) CommandAsyncTask::Adding CommandMultiAsyncTasks object for command b402868f-b7f9-4c0e-a6fd-bdc51ff49952 2014-01-06 10:10:59,519 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (ajp--127.0.0.1-8702-8) CommandMultiAsyncTasks::AttachTask: Attaching task 6caec3bc-fc66-42be-a642-7733fc033103 to command b402868f-b7f9-4c0e-a6fd-bdc51ff49952. 2014-01-06 10:10:59,525 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (ajp--127.0.0.1-8702-8) Adding task 6caec3bc-fc66-42be-a642-7733fc033103 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters), polling hasn't started yet.. 2014-01-06 10:10:59,530 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (ajp--127.0.0.1-8702-8) Correlation ID: 3b3e6fb1, Job ID: 53867ef7-d767-45d2-b446-e5d3f5584a19, Call Stack: null, Custom Event ID: -1, Message: Snapshot 'Maj 47 60 vers 5.2.3' deletion for VM 'uc-674' was initiated by necarnot. 2014-01-06 10:10:59,532 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (ajp--127.0.0.1-8702-8) BaseAsyncTask::StartPollingTask: Starting to poll task 6caec3bc-fc66-42be-a642-7733fc033103. 2014-01-06 10:11:01,811 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-20) Polling and updating Async Tasks: 2 tasks, 1 tasks to poll now 2014-01-06 10:11:01,824 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-20) Failed in HSMGetAllTasksStatusesVDS method 2014-01-06 10:11:01,825 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-20) Error code GeneralException and error message VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = '506085b6-40e0-4176-a4df-9102857f51f2' 2014-01-06 10:11:01,826 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-20) SPMAsyncTask::PollTask: Polling task 6caec3bc-fc66-42be-a642-7733fc033103 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) returned status finished, result 'cleanSuccess'. 2014-01-06 10:11:01,829 ERROR [org.ovirt.engine.core.bll.SPMAsyncTask] (DefaultQuartzScheduler_Worker-20) BaseAsyncTask::LogEndTaskFailure: Task 6caec3bc-fc66-42be-a642-7733fc033103 (Parent Command RemoveSnapshot, Parameters Type org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended with failure:^M -- Result: cleanSuccess^M -- Message: VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = '506085b6-40e0-4176-a4df-9102857f51f2',^M -- Exception: VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = '506085b6-40e0-4176-a4df-9102857f51f2' 2014-01-06 10:11:01,832 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-20) CommandAsyncTask::EndActionIfNecessary: All tasks of command b402868f-b7f9-4c0e-a6fd-bdc51ff49952 has ended -> executing EndAction 2014-01-06 10:11:01,833 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (DefaultQuartzScheduler_Worker-20) CommandAsyncTask::EndAction: Ending action for 1 tasks (command ID: b402868f-b7f9-4c0e-a6fd-bdc51ff49952): calling EndAction . 2014-01-06 10:11:01,834 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-6-thread-27) CommandAsyncTask::EndCommandAction [within thread] context: Attempting to EndAction RemoveSnapshot, executionIndex: 0 2014-01-06 10:11:01,839 ERROR [org.ovirt.engine.core.bll.RemoveSnapshotCommand] (pool-6-thread-27) [3b3e6fb1] Ending command with failure: org.ovirt.engine.core.bll.RemoveSnapshotCommand 2014-01-06 10:11:01,844 ERROR [org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand] (pool-6-thread-27) [33fa2a5d] Ending command with failure: org.ovirt.engine.core.bll.RemoveSnapshotSingleDiskCommand 2014-01-06 10:11:01,848 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-6-thread-27) Correlation ID: 3b3e6fb1, Job ID: 53867ef7-d767-45d2-b446-e5d3f5584a19, Call Stack: null, Custom Event ID: -1, Message: Failed to delete snapshot 'Maj 47 60 vers 5.2.3' for VM 'uc-674'. 2014-01-06 10:11:01,850 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-6-thread-27) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveSnapshot completed, handling the result. 2014-01-06 10:11:01,851 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-6-thread-27) CommandAsyncTask::HandleEndActionResult [within thread]: EndAction for action type RemoveSnapshot succeeded, clearing tasks. 2014-01-06 10:11:01,853 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-6-thread-27) SPMAsyncTask::ClearAsyncTask: Attempting to clear task 6caec3bc-fc66-42be-a642-7733fc033103 2014-01-06 10:11:01,853 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-6-thread-27) START, SPMClearTaskVDSCommand( storagePoolId = 5849b030-626e-47cb-ad90-3ce782d831b3, ignoreFailoverLimit = false, taskId = 6caec3bc-fc66-42be-a642-7733fc033103), log id: 424e7cf 2014-01-06 10:11:01,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-6-thread-27) START, HSMClearTaskVDSCommand(HostName = serv-vm-adm9, HostId = ba48edd4-c528-4832-bda4-4ab66245df24, taskId=6caec3bc-fc66-42be-a642-7733fc033103), log id: 12eec929 2014-01-06 10:11:01,884 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (pool-6-thread-27) FINISH, HSMClearTaskVDSCommand, log id: 12eec929 2014-01-06 10:11:01,885 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (pool-6-thread-27) FINISH, SPMClearTaskVDSCommand, log id: 424e7cf 2014-01-06 10:11:01,886 INFO [org.ovirt.engine.core.bll.SPMAsyncTask] (pool-6-thread-27) BaseAsyncTask::RemoveTaskFromDB: Removed task 6caec3bc-fc66-42be-a642-7733fc033103 from DataBase 2014-01-06 10:11:01,887 INFO [org.ovirt.engine.core.bll.CommandAsyncTask] (pool-6-thread-27) CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity b402868f-b7f9-4c0e-a6fd-bdc51ff49952 2014-01-06 10:11:07,703 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-9) Setting new tasks map. The map contains now 1 tasks 2014-01-06 10:12:07,703 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-99) Setting new tasks map. The map contains now 0 tasks 2014-01-06 10:12:07,704 INFO [org.ovirt.engine.core.bll.AsyncTaskManager] (DefaultQuartzScheduler_Worker-99) Cleared all tasks of pool 5849b030-626e-47cb-ad90-3ce782d831b3.