<div dir="ltr">Hi Pat.  I&#39;d like to help you investigate this issue further.  Could you send a snippet of the vdsm.log on slam-vmnode-03 that covers the time period during this failure?  Engine is reporting that vdsm has likely thrown an exception while acquiring locks associated with the VM disk you are exporting.<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Feb 16, 2017 at 12:40 PM, Pat Riehecky <span dir="ltr">&lt;<a href="mailto:riehecky@fnal.gov" target="_blank">riehecky@fnal.gov</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Any attempts to export my VM error out.  Last night the disk images got &#39;unregistered&#39; from oVirt and I had to rescan the storage domain to find them again.  Now I&#39;m just trying to get a backup of the VM.<br>
<br>
The snapshots off of the old disks are still listed, but I don&#39;t know if the lvm slices are still real or if that is even what is wrong.<br>
<br>
steps I followed -&gt;<br>
Halt VM<br>
Click Export<br>
leave things unchecked and click OK<br>
<br>
oVirt version:<br>
ovirt-engine-4.0.3-1.el7.cento<wbr>s.noarch<br>
ovirt-engine-backend-4.0.3-1.e<wbr>l7.centos.noarch<br>
ovirt-engine-cli-3.6.9.2-1.el7<wbr>.noarch<br>
ovirt-engine-dashboard-1.0.3-1<wbr>.el7.centos.noarch<br>
ovirt-engine-dbscripts-4.0.3-1<wbr>.el7.centos.noarch<br>
ovirt-engine-dwh-4.0.2-1.el7.c<wbr>entos.noarch<br>
ovirt-engine-dwh-setup-4.0.2-1<wbr>.el7.centos.noarch<br>
ovirt-engine-extension-aaa-jdb<wbr>c-1.1.0-1.el7.noarch<br>
ovirt-engine-extension-aaa-lda<wbr>p-1.2.1-1.el7.noarch<br>
ovirt-engine-extension-aaa-lda<wbr>p-setup-1.2.1-1.el7.noarch<br>
ovirt-engine-extensions-api-im<wbr>pl-4.0.3-1.el7.centos.noarch<br>
ovirt-engine-lib-4.0.3-1.el7.c<wbr>entos.noarch<br>
ovirt-engine-restapi-4.0.3-1.e<wbr>l7.centos.noarch<br>
ovirt-engine-sdk-python-3.6.9.<wbr>1-1.el7.noarch<br>
ovirt-engine-setup-4.0.3-1.el7<wbr>.centos.noarch<br>
ovirt-engine-setup-base-4.0.3-<wbr>1.el7.centos.noarch<br>
ovirt-engine-setup-plugin-ovir<wbr>t-engine-4.0.3-1.el7.centos.<wbr>noarch<br>
ovirt-engine-setup-plugin-ovir<wbr>t-engine-common-4.0.3-1.el7.<wbr>centos.noarch<br>
ovirt-engine-setup-plugin-vmco<wbr>nsole-proxy-helper-4.0.3-1.<wbr>el7.centos.noarch<br>
ovirt-engine-setup-plugin-webs<wbr>ocket-proxy-4.0.3-1.el7.centos<wbr>.noarch<br>
ovirt-engine-tools-4.0.3-1.el7<wbr>.centos.noarch<br>
ovirt-engine-tools-backup-4.0.<wbr>3-1.el7.centos.noarch<br>
ovirt-engine-userportal-4.0.3-<wbr>1.el7.centos.noarch<br>
ovirt-engine-vmconsole-proxy-h<wbr>elper-4.0.3-1.el7.centos.noarc<wbr>h<br>
ovirt-engine-webadmin-portal-4<wbr>.0.3-1.el7.centos.noarch<br>
ovirt-engine-websocket-proxy-4<wbr>.0.3-1.el7.centos.noarch<br>
ovirt-engine-wildfly-10.0.0-1.<wbr>el7.x86_64<br>
ovirt-engine-wildfly-overlay-1<wbr>0.0.0-1.el7.noarch<br>
ovirt-guest-agent-common-1.0.1<wbr>2-4.el7.noarch<br>
ovirt-host-deploy-1.5.1-1.el7.<wbr>centos.noarch<br>
ovirt-host-deploy-java-1.5.1-1<wbr>.el7.centos.noarch<br>
ovirt-imageio-common-0.3.0-1.e<wbr>l7.noarch<br>
ovirt-imageio-proxy-0.3.0-0.20<wbr>1606191345.git9f3d6d4.el7.cent<wbr>os.noarch<br>
ovirt-imageio-proxy-setup-0.3.<wbr>0-0.201606191345.git9f3d6d4.el<wbr>7.centos.noarch<br>
ovirt-image-uploader-4.0.0-1.e<wbr>l7.centos.noarch<br>
ovirt-iso-uploader-4.0.0-1.el7<wbr>.centos.noarch<br>
ovirt-setup-lib-1.0.2-1.el7.ce<wbr>ntos.noarch<br>
ovirt-vmconsole-1.0.4-1.el7.ce<wbr>ntos.noarch<br>
ovirt-vmconsole-proxy-1.0.4-1.<wbr>el7.centos.noarch<br>
<br>
<br>
<br>
<br>
log snippet:<br>
2017-02-16 11:34:44,959 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.GetVmsInfoVDSComm<wbr>and] (default task-28) [] START, GetVmsInfoVDSCommand( GetVmsInfoVDSCommandParameters<wbr>:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0<wbr>001-0001-0000000001a5&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;13127103-3f59<wbr>-418a-90f1-5b1ade8526b1&#39;, vmIdList=&#39;null&#39;}), log id: 3c406c84<br>
2017-02-16 11:34:45,967 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.GetVmsInfoVDSComm<wbr>and] (default task-28) [] FINISH, GetVmsInfoVDSCommand, log id: 3c406c84<br>
2017-02-16 11:34:46,178 INFO [org.ovirt.engine.core.bll.exp<wbr>ortimport.ExportVmCommand] (default task-24) [50b27eef] Lock Acquired to object &#39;EngineLock:{exclusiveLocks=&#39;[<wbr>ba806b93-b6fe-4873-99ec-55bb34<wbr>c12e5f=&lt;VM, ACTION_TYPE_FAILED_OBJECT_LOCK<wbr>ED&gt;]&#39;, sharedLocks=&#39;null&#39;}&#39;<br>
2017-02-16 11:34:46,221 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.GetVmsInfoVDSComm<wbr>and] (default task-24) [50b27eef] START, GetVmsInfoVDSCommand( GetVmsInfoVDSCommandParameters<wbr>:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0<wbr>001-0001-0000000001a5&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;13127103-3f59<wbr>-418a-90f1-5b1ade8526b1&#39;, vmIdList=&#39;null&#39;}), log id: 61bfd908<br>
2017-02-16 11:34:47,227 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.GetVmsInfoVDSComm<wbr>and] (default task-24) [50b27eef] FINISH, GetVmsInfoVDSCommand, log id: 61bfd908<br>
2017-02-16 11:34:47,242 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.GetVmsInfoVDSComm<wbr>and] (default task-24) [50b27eef] START, GetVmsInfoVDSCommand( GetVmsInfoVDSCommandParameters<wbr>:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0<wbr>001-0001-0000000001a5&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;13127103-3f59<wbr>-418a-90f1-5b1ade8526b1&#39;, vmIdList=&#39;null&#39;}), log id: 7cd19381<br>
2017-02-16 11:34:47,276 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.GetVmsInfoVDSComm<wbr>and] (default task-24) [50b27eef] FINISH, GetVmsInfoVDSCommand, log id: 7cd19381<br>
2017-02-16 11:34:47,294 INFO [org.ovirt.engine.core.bll.exp<wbr>ortimport.ExportVmCommand] (org.ovirt.thread.pool-8-threa<wbr>d-39) [50b27eef] Running command: ExportVmCommand internal: false. Entities affected :  ID: 13127103-3f59-418a-90f1-5b1ade<wbr>8526b1 Type: StorageAction group IMPORT_EXPORT_VM with role type ADMIN<br>
2017-02-16 11:34:47,296 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-threa<wbr>d-39) [50b27eef] START, SetVmStatusVDSCommand( SetVmStatusVDSCommandParameter<wbr>s:{runAsync=&#39;true&#39;, vmId=&#39;ba806b93-b6fe-4873-99ec-<wbr>55bb34c12e5f&#39;, status=&#39;ImageLocked&#39;, exitStatus=&#39;Normal&#39;}), log id: 61f2f832<br>
2017-02-16 11:34:47,299 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-threa<wbr>d-39) [50b27eef] FINISH, SetVmStatusVDSCommand, log id: 61f2f832<br>
2017-02-16 11:34:47,301 INFO [org.ovirt.engine.core.bll.exp<wbr>ortimport.ExportVmCommand] (org.ovirt.thread.pool-8-threa<wbr>d-39) [50b27eef] Lock freed to object &#39;EngineLock:{exclusiveLocks=&#39;[<wbr>ba806b93-b6fe-4873-99ec-55bb34<wbr>c12e5f=&lt;VM, ACTION_TYPE_FAILED_OBJECT_LOCK<wbr>ED&gt;]&#39;, sharedLocks=&#39;null&#39;}&#39;<br>
2017-02-16 11:34:47,339 INFO [org.ovirt.engine.core.bll.sto<wbr>rage.disk.image.CopyImageGroup<wbr>Command] (org.ovirt.thread.pool-8-threa<wbr>d-39) [a12f549] Running command: CopyImageGroupCommand internal: true. Entities affected :  ID: 13127103-3f59-418a-90f1-5b1ade<wbr>8526b1 Type: Storage<br>
2017-02-16 11:34:47,356 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.MoveImageGroupVDS<wbr>Command] (org.ovirt.thread.pool-8-threa<wbr>d-39) [a12f549] START, MoveImageGroupVDSCommand( MoveImageGroupVDSCommandParame<wbr>ters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0<wbr>001-0001-0000000001a5&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;a89a626f-3f6b<wbr>-452b-840e-ce0fee6f6461&#39;, imageGroupId=&#39;e17ebd7c-0763-42<wbr>b2-b344-5ad7f9cf448e&#39;, dstDomainId=&#39;13127103-3f59-418<wbr>a-90f1-5b1ade8526b1&#39;, vmId=&#39;ba806b93-b6fe-4873-99ec-<wbr>55bb34c12e5f&#39;, op=&#39;Copy&#39;, postZero=&#39;false&#39;, force=&#39;false&#39;}), log id: 1ee1f0ae<br>
2017-02-16 11:34:48,211 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.MoveImageGroupVDS<wbr>Command] (org.ovirt.thread.pool-8-threa<wbr>d-39) [a12f549] FINISH, MoveImageGroupVDSCommand, log id: 1ee1f0ae<br>
2017-02-16 11:34:48,216 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.CommandAsyncTask] (org.ovirt.thread.pool-8-threa<wbr>d-39) [a12f549] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command &#39;0b807437-17fe-4773-a539-09dde<wbr>e3df215&#39;<br>
2017-02-16 11:34:48,216 INFO [<a href="http://org.ovirt.engine.core.bll.Com">org.ovirt.engine.core.bll.Com</a><wbr>mandMultiAsyncTasks] (org.ovirt.thread.pool-8-threa<wbr>d-39) [a12f549] CommandMultiAsyncTasks::attach<wbr>Task: Attaching task &#39;3132106a-ce35-4b12-9a72-812e4<wbr>15eff7f&#39; to command &#39;0b807437-17fe-4773-a539-09dde<wbr>e3df215&#39;.<br>
2017-02-16 11:34:48,225 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.AsyncTaskManager] (org.ovirt.thread.pool-8-threa<wbr>d-39) [a12f549] Adding task &#39;3132106a-ce35-4b12-9a72-812e4<wbr>15eff7f&#39; (Parent Command &#39;ExportVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.<wbr>asynctasks.AsyncTaskParameters<wbr>&#39;), polling hasn&#39;t started yet..<br>
2017-02-16 11:34:48,256 INFO [org.ovirt.engine.core.bll.sto<wbr>rage.disk.image.CopyImageGroup<wbr>Command] (org.ovirt.thread.pool-8-threa<wbr>d-39) [8887fd8] Running command: CopyImageGroupCommand internal: true. Entities affected :  ID: 13127103-3f59-418a-90f1-5b1ade<wbr>8526b1 Type: Storage<br>
2017-02-16 11:34:48,271 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.MoveImageGroupVDS<wbr>Command] (org.ovirt.thread.pool-8-threa<wbr>d-39) [8887fd8] START, MoveImageGroupVDSCommand( MoveImageGroupVDSCommandParame<wbr>ters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0<wbr>001-0001-0000000001a5&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;a89a626f-3f6b<wbr>-452b-840e-ce0fee6f6461&#39;, imageGroupId=&#39;b4c4b53e-3813-49<wbr>59-a145-16f1dfcf1838&#39;, dstDomainId=&#39;13127103-3f59-418<wbr>a-90f1-5b1ade8526b1&#39;, vmId=&#39;ba806b93-b6fe-4873-99ec-<wbr>55bb34c12e5f&#39;, op=&#39;Copy&#39;, postZero=&#39;false&#39;, force=&#39;false&#39;}), log id: 74c9d14e<br>
2017-02-16 11:34:48,354 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.monitoring.VmsStatisticsFet<wbr>cher] (DefaultQuartzScheduler4) [2004a741] Fetched 1 VMs from VDS &#39;627314c4-7861-4ded-8257-22023<wbr>a6a748d&#39;<br>
2017-02-16 11:34:49,369 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.MoveImageGroupVDS<wbr>Command] (org.ovirt.thread.pool-8-threa<wbr>d-39) [8887fd8] FINISH, MoveImageGroupVDSCommand, log id: 74c9d14e<br>
2017-02-16 11:34:49,373 INFO [<a href="http://org.ovirt.engine.core.bll.Com">org.ovirt.engine.core.bll.Com</a><wbr>mandMultiAsyncTasks] (org.ovirt.thread.pool-8-threa<wbr>d-39) [8887fd8] CommandMultiAsyncTasks::attach<wbr>Task: Attaching task &#39;112fb772-a497-4788-829f-190d6<wbr>d008d95&#39; to command &#39;0b807437-17fe-4773-a539-09dde<wbr>e3df215&#39;.<br>
2017-02-16 11:34:49,390 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.AsyncTaskManager] (org.ovirt.thread.pool-8-threa<wbr>d-39) [8887fd8] Adding task &#39;112fb772-a497-4788-829f-190d6<wbr>d008d95&#39; (Parent Command &#39;ExportVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.<wbr>asynctasks.AsyncTaskParameters<wbr>&#39;), polling hasn&#39;t started yet..<br>
2017-02-16 11:34:49,410 INFO [org.ovirt.engine.core.dal.dbb<wbr>roker.auditloghandling.AuditLo<wbr>gDirector] (org.ovirt.thread.pool-8-threa<wbr>d-39) [8887fd8] Correlation ID: 50b27eef, Job ID: 276e8e51-cbed-43bb-bcfa-984246<wbr>7e978b, Call Stack: null, Custom Event ID: -1, Message: Starting export Vm <a href="http://ecf-sat6.fnal.gov" rel="noreferrer" target="_blank">ecf-sat6.fnal.gov</a> to RITM0524722<br>
2017-02-16 11:34:49,411 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.SPMAsyncTask] (org.ovirt.thread.pool-8-threa<wbr>d-39) [8887fd8] BaseAsyncTask::startPollingTas<wbr>k: Starting to poll task &#39;3132106a-ce35-4b12-9a72-812e4<wbr>15eff7f&#39;.<br>
2017-02-16 11:34:49,411 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.SPMAsyncTask] (org.ovirt.thread.pool-8-threa<wbr>d-39) [8887fd8] BaseAsyncTask::startPollingTas<wbr>k: Starting to poll task &#39;112fb772-a497-4788-829f-190d6<wbr>d008d95&#39;.<br>
2017-02-16 11:34:50,302 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.AsyncTaskManager] (DefaultQuartzScheduler4) [2004a741] Polling and updating Async Tasks: 2 tasks, 2 tasks to poll now<br>
2017-02-16 11:34:50,361 ERROR [org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.HSMGetAllTasksSta<wbr>tusesVDSCommand] (DefaultQuartzScheduler4) [2004a741] Failed in &#39;HSMGetAllTasksStatusesVDS&#39; method<br>
2017-02-16 11:34:50,365 ERROR [org.ovirt.engine.core.dal.dbb<wbr>roker.auditloghandling.AuditLo<wbr>gDirector] (DefaultQuartzScheduler4) [2004a741] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM <a href="http://slam-vmnode-03.fnal.gov" rel="noreferrer" target="_blank">slam-vmnode-03.fnal.gov</a> command failed: Could not acquire resource. Probably resource factory threw an exception.: ()<br>
2017-02-16 11:34:50,365 ERROR [org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.HSMGetAllTasksSta<wbr>tusesVDSCommand] (DefaultQuartzScheduler4) [2004a741] Failed in &#39;HSMGetAllTasksStatusesVDS&#39; method<br>
2017-02-16 11:34:50,368 ERROR [org.ovirt.engine.core.dal.dbb<wbr>roker.auditloghandling.AuditLo<wbr>gDirector] (DefaultQuartzScheduler4) [2004a741] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM <a href="http://slam-vmnode-03.fnal.gov" rel="noreferrer" target="_blank">slam-vmnode-03.fnal.gov</a> command failed: Could not acquire resource. Probably resource factory threw an exception.: ()<br>
2017-02-16 11:34:50,368 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.SPMAsyncTask] (DefaultQuartzScheduler4) [2004a741] SPMAsyncTask::PollTask: Polling task &#39;3132106a-ce35-4b12-9a72-812e4<wbr>15eff7f&#39; (Parent Command &#39;ExportVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.<wbr>asynctasks.AsyncTaskParameters<wbr>&#39;) returned status &#39;finished&#39;, result &#39;cleanSuccess&#39;.<br>
2017-02-16 11:34:50,371 ERROR [org.ovirt.engine.core.bll.tas<wbr>ks.SPMAsyncTask] (DefaultQuartzScheduler4) [2004a741] BaseAsyncTask::logEndTaskFailu<wbr>re: Task &#39;3132106a-ce35-4b12-9a72-812e4<wbr>15eff7f&#39; (Parent Command &#39;ExportVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.<wbr>asynctasks.AsyncTaskParameters<wbr>&#39;) ended with failure:<br>
-- Result: &#39;cleanSuccess&#39;<br>
-- Message: &#39;VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Could not acquire resource. Probably resource factory threw an exception.: (), code = 100&#39;,<br>
-- Exception: &#39;VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Could not acquire resource. Probably resource factory threw an exception.: (), code = 100&#39;<br>
2017-02-16 11:34:50,374 INFO [<a href="http://org.ovirt.engine.core.bll.Com">org.ovirt.engine.core.bll.Com</a><wbr>mandMultiAsyncTasks] (DefaultQuartzScheduler4) [2004a741] Task with DB Task ID &#39;ae5bd098-51e8-4415-b0f7-0f3ef<wbr>010ec7b&#39; and VDSM Task ID &#39;112fb772-a497-4788-829f-190d6<wbr>d008d95&#39; is in state Polling. End action for command 0b807437-17fe-4773-a539-09ddee<wbr>3df215 will proceed when all the entity&#39;s tasks are completed.<br>
2017-02-16 11:34:50,374 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.SPMAsyncTask] (DefaultQuartzScheduler4) [2004a741] SPMAsyncTask::PollTask: Polling task &#39;112fb772-a497-4788-829f-190d6<wbr>d008d95&#39; (Parent Command &#39;ExportVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.<wbr>asynctasks.AsyncTaskParameters<wbr>&#39;) returned status &#39;finished&#39;, result &#39;cleanSuccess&#39;.<br>
2017-02-16 11:34:50,377 ERROR [org.ovirt.engine.core.bll.tas<wbr>ks.SPMAsyncTask] (DefaultQuartzScheduler4) [2004a741] BaseAsyncTask::logEndTaskFailu<wbr>re: Task &#39;112fb772-a497-4788-829f-190d6<wbr>d008d95&#39; (Parent Command &#39;ExportVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.<wbr>asynctasks.AsyncTaskParameters<wbr>&#39;) ended with failure:<br>
-- Result: &#39;cleanSuccess&#39;<br>
-- Message: &#39;VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Could not acquire resource. Probably resource factory threw an exception.: (), code = 100&#39;,<br>
-- Exception: &#39;VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = Could not acquire resource. Probably resource factory threw an exception.: (), code = 100&#39;<br>
2017-02-16 11:34:50,379 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.CommandAsyncTask] (DefaultQuartzScheduler4) [2004a741] CommandAsyncTask::endActionIfN<wbr>ecessary: All tasks of command &#39;0b807437-17fe-4773-a539-09dde<wbr>e3df215&#39; has ended -&gt; executing &#39;endAction&#39;<br>
2017-02-16 11:34:50,379 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.CommandAsyncTask] (DefaultQuartzScheduler4) [2004a741] CommandAsyncTask::endAction: Ending action for &#39;2&#39; tasks (command ID: &#39;0b807437-17fe-4773-a539-09dde<wbr>e3df215&#39;): calling endAction &#39;.<br>
2017-02-16 11:34:50,380 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.CommandAsyncTask] (org.ovirt.thread.pool-8-threa<wbr>d-41) [2004a741] CommandAsyncTask::endCommandAc<wbr>tion [within thread] context: Attempting to endAction &#39;ExportVm&#39;, executionIndex: &#39;0&#39;<br>
2017-02-16 11:34:50,495 ERROR [org.ovirt.engine.core.bll.exp<wbr>ortimport.ExportVmCommand] (org.ovirt.thread.pool-8-threa<wbr>d-41) [2004a741] Ending command &#39;org.ovirt.engine.core.bll.exp<wbr>ortimport.ExportVmCommand&#39; with failure.<br>
2017-02-16 11:34:50,507 ERROR [org.ovirt.engine.core.bll.sto<wbr>rage.disk.image.CopyImageGroup<wbr>Command] (org.ovirt.thread.pool-8-threa<wbr>d-41) [a12f549] Ending command &#39;org.ovirt.engine.core.bll.sto<wbr>rage.disk.image.CopyImageGroup<wbr>Command&#39; with failure.<br>
2017-02-16 11:34:50,529 ERROR [org.ovirt.engine.core.bll.sto<wbr>rage.disk.image.CopyImageGroup<wbr>Command] (org.ovirt.thread.pool-8-threa<wbr>d-41) [8887fd8] Ending command &#39;org.ovirt.engine.core.bll.sto<wbr>rage.disk.image.CopyImageGroup<wbr>Command&#39; with failure.<br>
2017-02-16 11:34:50,534 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] START, SetVmStatusVDSCommand( SetVmStatusVDSCommandParameter<wbr>s:{runAsync=&#39;true&#39;, vmId=&#39;ba806b93-b6fe-4873-99ec-<wbr>55bb34c12e5f&#39;, status=&#39;Down&#39;, exitStatus=&#39;Normal&#39;}), log id: 28c5e88c<br>
2017-02-16 11:34:50,536 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.SetVmStatusVDSCommand] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] FINISH, SetVmStatusVDSCommand, log id: 28c5e88c<br>
2017-02-16 11:34:50,549 ERROR [org.ovirt.engine.core.dal.dbb<wbr>roker.auditloghandling.AuditLo<wbr>gDirector] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] Correlation ID: 50b27eef, Job ID: 276e8e51-cbed-43bb-bcfa-984246<wbr>7e978b, Call Stack: null, Custom Event ID: -1, Message: Failed to export Vm <a href="http://ecf-sat6.fnal.gov" rel="noreferrer" target="_blank">ecf-sat6.fnal.gov</a> to RITM0524722<br>
2017-02-16 11:34:50,549 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.CommandAsyncTask] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] CommandAsyncTask::HandleEndAct<wbr>ionResult [within thread]: endAction for action type &#39;ExportVm&#39; completed, handling the result.<br>
2017-02-16 11:34:50,549 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.CommandAsyncTask] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] CommandAsyncTask::HandleEndAct<wbr>ionResult [within thread]: endAction for action type &#39;ExportVm&#39; succeeded, clearing tasks.<br>
2017-02-16 11:34:50,549 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.SPMAsyncTask] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task &#39;3132106a-ce35-4b12-9a72-812e4<wbr>15eff7f&#39;<br>
2017-02-16 11:34:50,551 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.SPMClearTaskVDSCo<wbr>mmand] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParam<wbr>eters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0<wbr>001-0001-0000000001a5&#39;, ignoreFailoverLimit=&#39;false&#39;, taskId=&#39;3132106a-ce35-4b12-9a7<wbr>2-812e415eff7f&#39;}), log id: 675799a2<br>
2017-02-16 11:34:50,552 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.HSMClearTaskVDSCo<wbr>mmand] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] START, HSMClearTaskVDSCommand(HostNam<wbr>e = <a href="http://slam-vmnode-03.fnal.gov" rel="noreferrer" target="_blank">slam-vmnode-03.fnal.gov</a>, HSMTaskGuidBaseVDSCommandParam<wbr>eters:{runAsync=&#39;true&#39;, hostId=&#39;eacb0ca6-794a-4c94-8dc<wbr>8-00a8a6d88042&#39;, taskId=&#39;3132106a-ce35-4b12-9a7<wbr>2-812e415eff7f&#39;}), log id: 2d8fe4d0<br>
2017-02-16 11:34:50,554 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.monitoring.VmsStatisticsFet<wbr>cher] (DefaultQuartzScheduler6) [77b1baeb] Fetched 0 VMs from VDS &#39;eacb0ca6-794a-4c94-8dc8-00a8a<wbr>6d88042&#39;<br>
2017-02-16 11:34:51,560 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.HSMClearTaskVDSCo<wbr>mmand] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] FINISH, HSMClearTaskVDSCommand, log id: 2d8fe4d0<br>
2017-02-16 11:34:51,560 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.SPMClearTaskVDSCo<wbr>mmand] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] FINISH, SPMClearTaskVDSCommand, log id: 675799a2<br>
2017-02-16 11:34:51,564 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.SPMAsyncTask] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] BaseAsyncTask::removeTaskFromD<wbr>B: Removed task &#39;3132106a-ce35-4b12-9a72-812e4<wbr>15eff7f&#39; from DataBase<br>
2017-02-16 11:34:51,564 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.SPMAsyncTask] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task &#39;112fb772-a497-4788-829f-190d6<wbr>d008d95&#39;<br>
2017-02-16 11:34:51,566 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.SPMClearTaskVDSCo<wbr>mmand] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParam<wbr>eters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0<wbr>001-0001-0000000001a5&#39;, ignoreFailoverLimit=&#39;false&#39;, taskId=&#39;112fb772-a497-4788-829<wbr>f-190d6d008d95&#39;}), log id: 6b4cf8ff<br>
2017-02-16 11:34:51,567 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.HSMClearTaskVDSCo<wbr>mmand] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] START, HSMClearTaskVDSCommand(HostNam<wbr>e = <a href="http://slam-vmnode-03.fnal.gov" rel="noreferrer" target="_blank">slam-vmnode-03.fnal.gov</a>, HSMTaskGuidBaseVDSCommandParam<wbr>eters:{runAsync=&#39;true&#39;, hostId=&#39;eacb0ca6-794a-4c94-8dc<wbr>8-00a8a6d88042&#39;, taskId=&#39;112fb772-a497-4788-829<wbr>f-190d6d008d95&#39;}), log id: 6f2df357<br>
2017-02-16 11:34:51,608 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.HSMClearTaskVDSCo<wbr>mmand] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] FINISH, HSMClearTaskVDSCommand, log id: 6f2df357<br>
2017-02-16 11:34:51,608 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.irsbroker.SPMClearTaskVDSCo<wbr>mmand] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] FINISH, SPMClearTaskVDSCommand, log id: 6b4cf8ff<br>
2017-02-16 11:34:51,611 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.SPMAsyncTask] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] BaseAsyncTask::removeTaskFromD<wbr>B: Removed task &#39;112fb772-a497-4788-829f-190d6<wbr>d008d95&#39; from DataBase<br>
2017-02-16 11:34:51,611 INFO [org.ovirt.engine.core.bll.tas<wbr>ks.CommandAsyncTask] (org.ovirt.thread.pool-8-threa<wbr>d-41) [] CommandAsyncTask::HandleEndAct<wbr>ionResult [within thread]: Removing CommandMultiAsyncTasks object for entity &#39;0b807437-17fe-4773-a539-09dde<wbr>e3df215&#39;<span class="HOEnZb"><font color="#888888"><br>
<br>
<br>
-- <br>
Pat Riehecky<br>
<br>
Fermi National Accelerator Laboratory<br>
<a href="http://www.fnal.gov" rel="noreferrer" target="_blank">www.fnal.gov</a><br>
<a href="http://www.scientificlinux.org" rel="noreferrer" target="_blank">www.scientificlinux.org</a><br>
<br>
______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
</font></span></blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr">Adam Litke</div></div>
</div>