Any attempts to export my VM error out. Last night the disk images got 'unregistered' from oVirt and I had to rescan the storage domain to find them again. Now I'm just trying to get a backup of the VM.
The snapshots off of the old disks are still listed, but I don't know if the lvm slices are still real or if that is even what is wrong.
steps I followed ->
Halt VM
Click Export
leave things unchecked and click OK
oVirt version:
ovirt-engine-4.0.3-1.el7.centos.noarch
ovirt-engine-backend-4.0.3-1.el7.centos.noarch
ovirt-engine-cli-3.6.9.2-1.el7.noarch
ovirt-engine-dashboard-1.0.3-1.el7.centos.noarch
ovirt-engine-dbscripts-4.0.3-1.el7.centos.noarch
ovirt-engine-dwh-4.0.2-1.el7.centos.noarch
ovirt-engine-dwh-setup-4.0.2-1.el7.centos.noarch
ovirt-engine-extension-aaa-jdbc-1.1.0-1.el7.noarch
ovirt-engine-extension-aaa-ldap-1.2.1-1.el7.noarch
ovirt-engine-extension-aaa-ldap-setup-1.2.1-1.el7.noarch
ovirt-engine-extensions-api-impl-4.0.3-1.el7.centos.noarch
ovirt-engine-lib-4.0.3-1.el7.centos.noarch
ovirt-engine-restapi-4.0.3-1.el7.centos.noarch
ovirt-engine-sdk-python-3.6.9.1-1.el7.noarch
ovirt-engine-setup-4.0.3-1.el7.centos.noarch
ovirt-engine-setup-base-4.0.3-1.el7.centos.noarch
ovirt-engine-setup-plugin-ovirt-engine-4.0.3-1.el7.centos. noarch
ovirt-engine-setup-plugin-ovirt-engine-common-4.0.3-1.el7. centos.noarch
ovirt-engine-setup-plugin-vmconsole-proxy-helper-4.0.3-1. el7.centos.noarch
ovirt-engine-setup-plugin-websocket-proxy-4.0.3-1.el7.centos .noarch
ovirt-engine-tools-4.0.3-1.el7.centos.noarch
ovirt-engine-tools-backup-4.0.3-1.el7.centos.noarch
ovirt-engine-userportal-4.0.3-1.el7.centos.noarch
ovirt-engine-vmconsole-proxy-helper-4.0.3-1.el7.centos.noarc h
ovirt-engine-webadmin-portal-4.0.3-1.el7.centos.noarch
ovirt-engine-websocket-proxy-4.0.3-1.el7.centos.noarch
ovirt-engine-wildfly-10.0.0-1.el7.x86_64
ovirt-engine-wildfly-overlay-10.0.0-1.el7.noarch
ovirt-guest-agent-common-1.0.12-4.el7.noarch
ovirt-host-deploy-1.5.1-1.el7.centos.noarch
ovirt-host-deploy-java-1.5.1-1.el7.centos.noarch
ovirt-imageio-common-0.3.0-1.el7.noarch
ovirt-imageio-proxy-0.3.0-0.201606191345.git9f3d6d4.el7.cent os.noarch
ovirt-imageio-proxy-setup-0.3.0-0.201606191345.git9f3d6d4.el 7.centos.noarch
ovirt-image-uploader-4.0.0-1.el7.centos.noarch
ovirt-iso-uploader-4.0.0-1.el7.centos.noarch
ovirt-setup-lib-1.0.2-1.el7.centos.noarch
ovirt-vmconsole-1.0.4-1.el7.centos.noarch
ovirt-vmconsole-proxy-1.0.4-1.el7.centos.noarch
log snippet:
2017-02-16 11:34:44,959 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSComm and] (default task-28) [] START, GetVmsInfoVDSCommand( GetVmsInfoVDSCommandParameters :{runAsync='true', storagePoolId='00000001-0001-0 001-0001-0000000001a5', ignoreFailoverLimit='false', storageDomainId='13127103-3f59 -418a-90f1-5b1ade8526b1', vmIdList='null'}), log id: 3c406c84
2017-02-16 11:34:45,967 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSComm and] (default task-28) [] FINISH, GetVmsInfoVDSCommand, log id: 3c406c84
2017-02-16 11:34:46,178 INFO [org.ovirt.engine.core.bll.exportimport.ExportVmCommand] (default task-24) [50b27eef] Lock Acquired to object 'EngineLock:{exclusiveLocks='[ ba806b93-b6fe-4873-99ec-55bb34 c12e5f=<VM, ACTION_TYPE_FAILED_OBJECT_LOCK ED>]', sharedLocks='null'}'
2017-02-16 11:34:46,221 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSComm and] (default task-24) [50b27eef] START, GetVmsInfoVDSCommand( GetVmsInfoVDSCommandParameters :{runAsync='true', storagePoolId='00000001-0001-0 001-0001-0000000001a5', ignoreFailoverLimit='false', storageDomainId='13127103-3f59 -418a-90f1-5b1ade8526b1', vmIdList='null'}), log id: 61bfd908
2017-02-16 11:34:47,227 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSComm and] (default task-24) [50b27eef] FINISH, GetVmsInfoVDSCommand, log id: 61bfd908
2017-02-16 11:34:47,242 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSComm and] (default task-24) [50b27eef] START, GetVmsInfoVDSCommand( GetVmsInfoVDSCommandParameters :{runAsync='true', storagePoolId='00000001-0001-0 001-0001-0000000001a5', ignoreFailoverLimit='false', storageDomainId='13127103-3f59 -418a-90f1-5b1ade8526b1', vmIdList='null'}), log id: 7cd19381
2017-02-16 11:34:47,276 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVmsInfoVDSComm and] (default task-24) [50b27eef] FINISH, GetVmsInfoVDSCommand, log id: 7cd19381
2017-02-16 11:34:47,294 INFO [org.ovirt.engine.core.bll.exportimport.ExportVmCommand] (org.ovirt.thread.pool-8-threa d-39) [50b27eef] Running command: ExportVmCommand internal: false. Entities affected : ID: 13127103-3f59-418a-90f1-5b1ade 8526b1 Type: StorageAction group IMPORT_EXPORT_VM with role type ADMIN
2017-02-16 11:34:47,296 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-threa d-39) [50b27eef] START, SetVmStatusVDSCommand( SetVmStatusVDSCommandParameter s:{runAsync='true', vmId='ba806b93-b6fe-4873-99ec- 55bb34c12e5f', status='ImageLocked', exitStatus='Normal'}), log id: 61f2f832
2017-02-16 11:34:47,299 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-threa d-39) [50b27eef] FINISH, SetVmStatusVDSCommand, log id: 61f2f832
2017-02-16 11:34:47,301 INFO [org.ovirt.engine.core.bll.exportimport.ExportVmCommand] (org.ovirt.thread.pool-8-threa d-39) [50b27eef] Lock freed to object 'EngineLock:{exclusiveLocks='[ ba806b93-b6fe-4873-99ec-55bb34 c12e5f=<VM, ACTION_TYPE_FAILED_OBJECT_LOCK ED>]', sharedLocks='null'}'
2017-02-16 11:34:47,339 INFO [org.ovirt.engine.core.bll.storage.disk.image.CopyImageGroup Command] (org.ovirt.thread.pool-8-threa d-39) [a12f549] Running command: CopyImageGroupCommand internal: true. Entities affected : ID: 13127103-3f59-418a-90f1-5b1ade 8526b1 Type: Storage
2017-02-16 11:34:47,356 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDS Command] (org.ovirt.thread.pool-8-threa d-39) [a12f549] START, MoveImageGroupVDSCommand( MoveImageGroupVDSCommandParame ters:{runAsync='true', storagePoolId='00000001-0001-0 001-0001-0000000001a5', ignoreFailoverLimit='false', storageDomainId='a89a626f-3f6b -452b-840e-ce0fee6f6461', imageGroupId='e17ebd7c-0763-42 b2-b344-5ad7f9cf448e', dstDomainId='13127103-3f59-418 a-90f1-5b1ade8526b1', vmId='ba806b93-b6fe-4873-99ec- 55bb34c12e5f', op='Copy', postZero='false', force='false'}), log id: 1ee1f0ae
2017-02-16 11:34:48,211 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDS Command] (org.ovirt.thread.pool-8-threa d-39) [a12f549] FINISH, MoveImageGroupVDSCommand, log id: 1ee1f0ae
2017-02-16 11:34:48,216 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-threa d-39) [a12f549] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command '0b807437-17fe-4773-a539-09dde e3df215'
2017-02-16 11:34:48,216 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-threa d-39) [a12f549] CommandMultiAsyncTasks::attach Task: Attaching task '3132106a-ce35-4b12-9a72-812e4 15eff7f' to command '0b807437-17fe-4773-a539-09dde e3df215'.
2017-02-16 11:34:48,225 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-threa d-39) [a12f549] Adding task '3132106a-ce35-4b12-9a72-812e4 15eff7f' (Parent Command 'ExportVm', Parameters Type 'org.ovirt.engine.core.common. asynctasks.AsyncTaskParameters '), polling hasn't started yet..
2017-02-16 11:34:48,256 INFO [org.ovirt.engine.core.bll.storage.disk.image.CopyImageGroup Command] (org.ovirt.thread.pool-8-threa d-39) [8887fd8] Running command: CopyImageGroupCommand internal: true. Entities affected : ID: 13127103-3f59-418a-90f1-5b1ade 8526b1 Type: Storage
2017-02-16 11:34:48,271 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDS Command] (org.ovirt.thread.pool-8-threa d-39) [8887fd8] START, MoveImageGroupVDSCommand( MoveImageGroupVDSCommandParame ters:{runAsync='true', storagePoolId='00000001-0001-0 001-0001-0000000001a5', ignoreFailoverLimit='false', storageDomainId='a89a626f-3f6b -452b-840e-ce0fee6f6461', imageGroupId='b4c4b53e-3813-49 59-a145-16f1dfcf1838', dstDomainId='13127103-3f59-418 a-90f1-5b1ade8526b1', vmId='ba806b93-b6fe-4873-99ec- 55bb34c12e5f', op='Copy', postZero='false', force='false'}), log id: 74c9d14e
2017-02-16 11:34:48,354 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFet cher] (DefaultQuartzScheduler4) [2004a741] Fetched 1 VMs from VDS '627314c4-7861-4ded-8257-22023 a6a748d'
2017-02-16 11:34:49,369 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.MoveImageGroupVDS Command] (org.ovirt.thread.pool-8-threa d-39) [8887fd8] FINISH, MoveImageGroupVDSCommand, log id: 74c9d14e
2017-02-16 11:34:49,373 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-threa d-39) [8887fd8] CommandMultiAsyncTasks::attach Task: Attaching task '112fb772-a497-4788-829f-190d6 d008d95' to command '0b807437-17fe-4773-a539-09dde e3df215'.
2017-02-16 11:34:49,390 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-threa d-39) [8887fd8] Adding task '112fb772-a497-4788-829f-190d6 d008d95' (Parent Command 'ExportVm', Parameters Type 'org.ovirt.engine.core.common. asynctasks.AsyncTaskParameters '), polling hasn't started yet..
2017-02-16 11:34:49,410 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLo gDirector] (org.ovirt.thread.pool-8-threa d-39) [8887fd8] Correlation ID: 50b27eef, Job ID: 276e8e51-cbed-43bb-bcfa-984246 7e978b, Call Stack: null, Custom Event ID: -1, Message: Starting export Vm ecf-sat6.fnal.gov to RITM0524722
2017-02-16 11:34:49,411 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-threa d-39) [8887fd8] BaseAsyncTask::startPollingTas k: Starting to poll task '3132106a-ce35-4b12-9a72-812e4 15eff7f'.
2017-02-16 11:34:49,411 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-threa d-39) [8887fd8] BaseAsyncTask::startPollingTas k: Starting to poll task '112fb772-a497-4788-829f-190d6 d008d95'.
2017-02-16 11:34:50,302 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler4) [2004a741] Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now
2017-02-16 11:34:50,361 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksSta tusesVDSCommand] (DefaultQuartzScheduler4) [2004a741] Failed in 'HSMGetAllTasksStatusesVDS' method
2017-02-16 11:34:50,365 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLo gDirector] (DefaultQuartzScheduler4) [2004a741] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM slam-vmnode-03.fnal.gov command failed: Could not acquire resource. Probably resource factory threw an exception.: ()
2017-02-16 11:34:50,365 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksSta tusesVDSCommand] (DefaultQuartzScheduler4) [2004a741] Failed in 'HSMGetAllTasksStatusesVDS' method
2017-02-16 11:34:50,368 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLo gDirector] (DefaultQuartzScheduler4) [2004a741] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM slam-vmnode-03.fnal.gov command failed: Could not acquire resource. Probably resource factory threw an exception.: ()
2017-02-16 11:34:50,368 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler4) [2004a741] SPMAsyncTask::PollTask: Polling task '3132106a-ce35-4b12-9a72-812e4 15eff7f' (Parent Command 'ExportVm', Parameters Type 'org.ovirt.engine.core.common. asynctasks.AsyncTaskParameters ') returned status 'finished', result 'cleanSuccess'.
2017-02-16 11:34:50,371 ERROR [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler4) [2004a741] BaseAsyncTask::logEndTaskFailu re: Task '3132106a-ce35-4b12-9a72-812e4 15eff7f' (Parent Command 'ExportVm', Parameters Type 'org.ovirt.engine.core.common. asynctasks.AsyncTaskParameters ') ended with failure:
-- Result: 'cleanSuccess'
-- Message: 'VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Could not acquire resource. Probably resource factory threw an exception.: (), code = 100',
-- Exception: 'VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Could not acquire resource. Probably resource factory threw an exception.: (), code = 100'
2017-02-16 11:34:50,374 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler4) [2004a741] Task with DB Task ID 'ae5bd098-51e8-4415-b0f7-0f3ef 010ec7b' and VDSM Task ID '112fb772-a497-4788-829f-190d6 d008d95' is in state Polling. End action for command 0b807437-17fe-4773-a539-09ddee 3df215 will proceed when all the entity's tasks are completed.
2017-02-16 11:34:50,374 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler4) [2004a741] SPMAsyncTask::PollTask: Polling task '112fb772-a497-4788-829f-190d6 d008d95' (Parent Command 'ExportVm', Parameters Type 'org.ovirt.engine.core.common. asynctasks.AsyncTaskParameters ') returned status 'finished', result 'cleanSuccess'.
2017-02-16 11:34:50,377 ERROR [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler4) [2004a741] BaseAsyncTask::logEndTaskFailu re: Task '112fb772-a497-4788-829f-190d6 d008d95' (Parent Command 'ExportVm', Parameters Type 'org.ovirt.engine.core.common. asynctasks.AsyncTaskParameters ') ended with failure:
-- Result: 'cleanSuccess'
-- Message: 'VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Could not acquire resource. Probably resource factory threw an exception.: (), code = 100',
-- Exception: 'VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Could not acquire resource. Probably resource factory threw an exception.: (), code = 100'
2017-02-16 11:34:50,379 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler4) [2004a741] CommandAsyncTask::endActionIfN ecessary: All tasks of command '0b807437-17fe-4773-a539-09dde e3df215' has ended -> executing 'endAction'
2017-02-16 11:34:50,379 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler4) [2004a741] CommandAsyncTask::endAction: Ending action for '2' tasks (command ID: '0b807437-17fe-4773-a539-09dde e3df215'): calling endAction '.
2017-02-16 11:34:50,380 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-threa d-41) [2004a741] CommandAsyncTask::endCommandAc tion [within thread] context: Attempting to endAction 'ExportVm', executionIndex: '0'
2017-02-16 11:34:50,495 ERROR [org.ovirt.engine.core.bll.exportimport.ExportVmCommand] (org.ovirt.thread.pool-8-threa d-41) [2004a741] Ending command 'org.ovirt.engine.core.bll.exp ortimport.ExportVmCommand' with failure.
2017-02-16 11:34:50,507 ERROR [org.ovirt.engine.core.bll.storage.disk.image.CopyImageGroup Command] (org.ovirt.thread.pool-8-threa d-41) [a12f549] Ending command 'org.ovirt.engine.core.bll.sto rage.disk.image.CopyImageGroup Command' with failure.
2017-02-16 11:34:50,529 ERROR [org.ovirt.engine.core.bll.storage.disk.image.CopyImageGroup Command] (org.ovirt.thread.pool-8-threa d-41) [8887fd8] Ending command 'org.ovirt.engine.core.bll.sto rage.disk.image.CopyImageGroup Command' with failure.
2017-02-16 11:34:50,534 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-threa d-41) [] START, SetVmStatusVDSCommand( SetVmStatusVDSCommandParameter s:{runAsync='true', vmId='ba806b93-b6fe-4873-99ec- 55bb34c12e5f', status='Down', exitStatus='Normal'}), log id: 28c5e88c
2017-02-16 11:34:50,536 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-threa d-41) [] FINISH, SetVmStatusVDSCommand, log id: 28c5e88c
2017-02-16 11:34:50,549 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLo gDirector] (org.ovirt.thread.pool-8-threa d-41) [] Correlation ID: 50b27eef, Job ID: 276e8e51-cbed-43bb-bcfa-984246 7e978b, Call Stack: null, Custom Event ID: -1, Message: Failed to export Vm ecf-sat6.fnal.gov to RITM0524722
2017-02-16 11:34:50,549 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-threa d-41) [] CommandAsyncTask::HandleEndAct ionResult [within thread]: endAction for action type 'ExportVm' completed, handling the result.
2017-02-16 11:34:50,549 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-threa d-41) [] CommandAsyncTask::HandleEndAct ionResult [within thread]: endAction for action type 'ExportVm' succeeded, clearing tasks.
2017-02-16 11:34:50,549 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-threa d-41) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task '3132106a-ce35-4b12-9a72-812e4 15eff7f'
2017-02-16 11:34:50,551 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCo mmand] (org.ovirt.thread.pool-8-threa d-41) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParam eters:{runAsync='true', storagePoolId='00000001-0001-0 001-0001-0000000001a5', ignoreFailoverLimit='false', taskId='3132106a-ce35-4b12-9a7 2-812e415eff7f'}), log id: 675799a2
2017-02-16 11:34:50,552 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCo mmand] (org.ovirt.thread.pool-8-threa d-41) [] START, HSMClearTaskVDSCommand(HostNam e = slam-vmnode-03.fnal.gov, HSMTaskGuidBaseVDSCommandParam eters:{runAsync='true', hostId='eacb0ca6-794a-4c94-8dc 8-00a8a6d88042', taskId='3132106a-ce35-4b12-9a7 2-812e415eff7f'}), log id: 2d8fe4d0
2017-02-16 11:34:50,554 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmsStatisticsFet cher] (DefaultQuartzScheduler6) [77b1baeb] Fetched 0 VMs from VDS 'eacb0ca6-794a-4c94-8dc8-00a8a 6d88042'
2017-02-16 11:34:51,560 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCo mmand] (org.ovirt.thread.pool-8-threa d-41) [] FINISH, HSMClearTaskVDSCommand, log id: 2d8fe4d0
2017-02-16 11:34:51,560 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCo mmand] (org.ovirt.thread.pool-8-threa d-41) [] FINISH, SPMClearTaskVDSCommand, log id: 675799a2
2017-02-16 11:34:51,564 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-threa d-41) [] BaseAsyncTask::removeTaskFromD B: Removed task '3132106a-ce35-4b12-9a72-812e4 15eff7f' from DataBase