<p dir="ltr">Hi Cristian,<br>
We already seen this before and have a bug for it:<br>
<a href="https://bugzilla.redhat.com/show_bug.cgi?id=1201268">https://bugzilla.redhat.com/show_bug.cgi?id=1201268</a><br></p>
<p dir="ltr">Thanks,<br>
Raz Tamir</p>
<div class="gmail_quote">On Jan 26, 2016 16:02, &quot;Cristian Mammoli&quot; &lt;<a href="mailto:c.mammoli@apra.it">c.mammoli@apra.it</a>&gt; wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Hi, I tried this script <a href="https://github.com/wefixit-AT/oVirtBackup" rel="noreferrer" target="_blank">https://github.com/wefixit-AT/oVirtBackup</a><br>
which basically does:<br>
Snapshot a vm<br>
clone the snapshot<br>
delete the snapshot<br>
export the clone to export domain<br>
delete the clone<br>
<br>
It worked fine for 4 vms then exited with error:<br>
Message: VDSM kvm02 command failed: low level Image copy failed<br>
VDSM command failed: Image does not exist in domain: u&#39;image=a651c514-a81b-4cfc-a9bc-0bc4caf51568, domain=239c7309-7e4c-4545-8137-6bf1d43cad71&#39;<br>
<br>
Now I&#39;m not able to clone snapshots anymore, not even manually everytime I get the same error:<br>
This is engine.log when I snapshot the vm:<br>
<br>
2016-01-26 14:58:32,984 WARN [org.ovirt.engine.core.bll.scheduling.policyunits.EvenGuestDistributionBalancePolicyUnit] (DefaultQuartzScheduler_Worker-46) [5de5361] There is no host with less than 8 running guests<br>
2016-01-26 14:58:32,985 WARN [org.ovirt.engine.core.bll.scheduling.policyunits.CpuAndMemoryBalancingPolicyUnit] (DefaultQuartzScheduler_Worker-46) [5de5361] All hosts are over-utilized, can&#39;t balance the cluster &#39;Default&#39; using the primary method<br>
2016-01-26 14:58:38,685 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (default task-1) [5b009390] Lock Acquired to object &#39;EngineLock:{exclusiveLocks=&#39;[4e683012-8895-43da-b3e1-6d6271f4d829=&lt;VM, ACTION_TYPE_FAILED_SNAPSHOT_IS_BEING_TAKEN_FOR_VM$VmName hpserver&gt;]&#39;, sharedLocks=&#39;null&#39;}&#39;<br>
2016-01-26 14:58:39,007 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-12) [5b009390] Running command: CreateAllSnapshotsFromVmCommand internal: false. Entities affected :  ID: 4e683012-8895-43da-b3e1-6d6271f4d829 Type: VMAction group MANIPULATE_VM_SNAPSHOTS with role type USER<br>
2016-01-26 14:58:39,028 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-12) [217c647e] Running command: CreateSnapshotCommand internal: true. Entities affected :  ID: 00000000-0000-0000-0000-000000000000 Type: Storage<br>
2016-01-26 14:58:39,074 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) [217c647e] START, CreateSnapshotVDSCommand( CreateSnapshotVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;42e212c1-f669-43e1-8f90-20baf0c3f58c&#39;, imageSizeInBytes=&#39;37580963840&#39;, volumeFormat=&#39;COW&#39;, newImageId=&#39;5d8f7880-9125-4c91-ba04-532901d1d805&#39;, newImageDescription=&#39;&#39;, imageInitialSizeInBytes=&#39;0&#39;, imageId=&#39;449e8b88-ab34-4cf8-bc91-00128c35dc65&#39;, sourceImageGroupId=&#39;42e212c1-f669-43e1-8f90-20baf0c3f58c&#39;}), log id: 1113aa14<br>
2016-01-26 14:58:39,078 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) [217c647e] -- executeIrsBrokerCommand: calling &#39;createVolume&#39; with two new parameters: description and UUID<br>
2016-01-26 14:58:40,351 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) [217c647e] FINISH, CreateSnapshotVDSCommand, return: 5d8f7880-9125-4c91-ba04-532901d1d805, log id: 1113aa14<br>
2016-01-26 14:58:40,360 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-12) [217c647e] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command &#39;8f3ccf29-3056-4ab0-bc11-b987814fe5fd&#39;<br>
2016-01-26 14:58:40,360 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-12) [217c647e] CommandMultiAsyncTasks::AttachTask: Attaching task &#39;293a6312-8c4f-4c89-a3f7-2f9f0557a9b8&#39; to command &#39;8f3ccf29-3056-4ab0-bc11-b987814fe5fd&#39;.<br>
2016-01-26 14:58:40,382 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-12) [217c647e] Adding task &#39;293a6312-8c4f-4c89-a3f7-2f9f0557a9b8&#39; (Parent Command &#39;CreateAllSnapshotsFromVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;), polling hasn&#39;t started yet..<br>
2016-01-26 14:58:40,420 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-12) [2adcf7fc] Running command: CreateSnapshotCommand internal: true. Entities affected :  ID: 00000000-0000-0000-0000-000000000000 Type: Storage<br>
2016-01-26 14:58:40,434 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) [2adcf7fc] START, CreateSnapshotVDSCommand( CreateSnapshotVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;dd1f13d8-4fb1-4f48-b7b6-cb912c0c1437&#39;, imageSizeInBytes=&#39;108447924224&#39;, volumeFormat=&#39;COW&#39;, newImageId=&#39;88a9ab18-7d4c-42f0-9067-0241b64cb7d0&#39;, newImageDescription=&#39;&#39;, imageInitialSizeInBytes=&#39;0&#39;, imageId=&#39;0856943c-c714-43a5-8f26-087143131d74&#39;, sourceImageGroupId=&#39;dd1f13d8-4fb1-4f48-b7b6-cb912c0c1437&#39;}), log id: 5b8489d6<br>
2016-01-26 14:58:40,436 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) [2adcf7fc] -- executeIrsBrokerCommand: calling &#39;createVolume&#39; with two new parameters: description and UUID<br>
2016-01-26 14:58:41,267 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) [2adcf7fc] FINISH, CreateSnapshotVDSCommand, return: 88a9ab18-7d4c-42f0-9067-0241b64cb7d0, log id: 5b8489d6<br>
2016-01-26 14:58:41,288 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-12) [2adcf7fc] CommandMultiAsyncTasks::AttachTask: Attaching task &#39;010eec77-3b20-483c-bdd3-e9a8912f7ba5&#39; to command &#39;8f3ccf29-3056-4ab0-bc11-b987814fe5fd&#39;.<br>
2016-01-26 14:58:41,425 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-12) [2adcf7fc] Adding task &#39;010eec77-3b20-483c-bdd3-e9a8912f7ba5&#39; (Parent Command &#39;CreateAllSnapshotsFromVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;), polling hasn&#39;t started yet..<br>
2016-01-26 14:58:41,499 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-12) [a3e8512] Running command: CreateSnapshotCommand internal: true. Entities affected :  ID: 00000000-0000-0000-0000-000000000000 Type: Storage<br>
2016-01-26 14:58:41,613 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) [a3e8512] START, CreateSnapshotVDSCommand( CreateSnapshotVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;d98b8313-de2f-477a-94f8-78026497612b&#39;, imageSizeInBytes=&#39;108447924224&#39;, volumeFormat=&#39;COW&#39;, newImageId=&#39;dbbae52f-a408-41a4-8e6c-0c1919df5c93&#39;, newImageDescription=&#39;&#39;, imageInitialSizeInBytes=&#39;0&#39;, imageId=&#39;dd30f129-e8d0-4155-9c63-6ac1ee76fa8e&#39;, sourceImageGroupId=&#39;d98b8313-de2f-477a-94f8-78026497612b&#39;}), log id: 7e1deb44<br>
2016-01-26 14:58:41,620 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) [a3e8512] -- executeIrsBrokerCommand: calling &#39;createVolume&#39; with two new parameters: description and UUID<br>
2016-01-26 14:58:43,843 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CreateSnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-12) [a3e8512] FINISH, CreateSnapshotVDSCommand, return: dbbae52f-a408-41a4-8e6c-0c1919df5c93, log id: 7e1deb44<br>
2016-01-26 14:58:43,852 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (org.ovirt.thread.pool-8-thread-12) [a3e8512] CommandMultiAsyncTasks::AttachTask: Attaching task &#39;9f0ac94f-deb9-4662-824b-f7144c869af0&#39; to command &#39;8f3ccf29-3056-4ab0-bc11-b987814fe5fd&#39;.<br>
2016-01-26 14:58:43,871 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-12) [a3e8512] Adding task &#39;9f0ac94f-deb9-4662-824b-f7144c869af0&#39; (Parent Command &#39;CreateAllSnapshotsFromVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;), polling hasn&#39;t started yet..<br>
2016-01-26 14:58:43,986 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-12) [a3e8512] Correlation ID: 5b009390, Job ID: b76122a8-a780-47e4-9c63-eac6b7f8b6e4, Call Stack: null, Custom Event ID: -1, Message: Snapshot &#39;test_snap&#39; creation for VM &#39;hpserver&#39; was initiated by rfocesq@omme.net@<a href="http://omme.net" rel="noreferrer" target="_blank">omme.net</a>.<br>
2016-01-26 14:58:43,987 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) [a3e8512] BaseAsyncTask::startPollingTask: Starting to poll task &#39;293a6312-8c4f-4c89-a3f7-2f9f0557a9b8&#39;.<br>
2016-01-26 14:58:43,987 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) [a3e8512] BaseAsyncTask::startPollingTask: Starting to poll task &#39;010eec77-3b20-483c-bdd3-e9a8912f7ba5&#39;.<br>
2016-01-26 14:58:43,987 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-12) [a3e8512] BaseAsyncTask::startPollingTask: Starting to poll task &#39;9f0ac94f-deb9-4662-824b-f7144c869af0&#39;.<br>
2016-01-26 14:58:46,992 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-2) [4c17fe49] Polling and updating Async Tasks: 3 tasks, 3 tasks to poll now<br>
2016-01-26 14:58:48,951 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-2) [4c17fe49] SPMAsyncTask::PollTask: Polling task &#39;010eec77-3b20-483c-bdd3-e9a8912f7ba5&#39; (Parent Command &#39;CreateAllSnapshotsFromVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) returned status &#39;finished&#39;, result &#39;success&#39;.<br>
2016-01-26 14:58:48,960 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-2) [4c17fe49] BaseAsyncTask::onTaskEndSuccess: Task &#39;010eec77-3b20-483c-bdd3-e9a8912f7ba5&#39; (Parent Command &#39;CreateAllSnapshotsFromVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) ended successfully.<br>
2016-01-26 14:58:48,965 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-2) [4c17fe49] Task with DB Task ID &#39;05694254-0fcc-4e77-95ac-ec4f4482c6f8&#39; and VDSM Task ID &#39;9f0ac94f-deb9-4662-824b-f7144c869af0&#39; is in state Polling. End action for command 8f3ccf29-3056-4ab0-bc11-b987814fe5fd will proceed when all the entity&#39;s tasks are completed.<br>
2016-01-26 14:58:48,965 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-2) [4c17fe49] SPMAsyncTask::PollTask: Polling task &#39;9f0ac94f-deb9-4662-824b-f7144c869af0&#39; (Parent Command &#39;CreateAllSnapshotsFromVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) returned status &#39;running&#39;.<br>
2016-01-26 14:58:48,965 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-2) [4c17fe49] SPMAsyncTask::PollTask: Polling task &#39;293a6312-8c4f-4c89-a3f7-2f9f0557a9b8&#39; (Parent Command &#39;CreateAllSnapshotsFromVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) returned status &#39;finished&#39;, result &#39;success&#39;.<br>
2016-01-26 14:58:48,971 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-2) [4c17fe49] BaseAsyncTask::onTaskEndSuccess: Task &#39;293a6312-8c4f-4c89-a3f7-2f9f0557a9b8&#39; (Parent Command &#39;CreateAllSnapshotsFromVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) ended successfully.<br>
2016-01-26 14:58:48,972 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-2) [4c17fe49] Task with DB Task ID &#39;05694254-0fcc-4e77-95ac-ec4f4482c6f8&#39; and VDSM Task ID &#39;9f0ac94f-deb9-4662-824b-f7144c869af0&#39; is in state Polling. End action for command 8f3ccf29-3056-4ab0-bc11-b987814fe5fd will proceed when all the entity&#39;s tasks are completed.<br>
2016-01-26 14:58:48,972 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-2) [4c17fe49] Finished polling Tasks, will poll again in 10 seconds.<br>
2016-01-26 14:59:00,359 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-41) [] BaseAsyncTask::onTaskEndSuccess: Task &#39;010eec77-3b20-483c-bdd3-e9a8912f7ba5&#39; (Parent Command &#39;CreateAllSnapshotsFromVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) ended successfully.<br>
2016-01-26 14:59:00,360 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-41) [] Task with DB Task ID &#39;05694254-0fcc-4e77-95ac-ec4f4482c6f8&#39; and VDSM Task ID &#39;9f0ac94f-deb9-4662-824b-f7144c869af0&#39; is in state Polling. End action for command 8f3ccf29-3056-4ab0-bc11-b987814fe5fd will proceed when all the entity&#39;s tasks are completed.<br>
2016-01-26 14:59:00,361 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-41) [] SPMAsyncTask::PollTask: Polling task &#39;9f0ac94f-deb9-4662-824b-f7144c869af0&#39; (Parent Command &#39;CreateAllSnapshotsFromVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) returned status &#39;finished&#39;, result &#39;success&#39;.<br>
2016-01-26 14:59:00,368 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-41) [] BaseAsyncTask::onTaskEndSuccess: Task &#39;9f0ac94f-deb9-4662-824b-f7144c869af0&#39; (Parent Command &#39;CreateAllSnapshotsFromVm&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) ended successfully.<br>
2016-01-26 14:59:00,389 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-41) [] CommandAsyncTask::endActionIfNecessary: All tasks of command &#39;8f3ccf29-3056-4ab0-bc11-b987814fe5fd&#39; has ended -&gt; executing &#39;endAction&#39;<br>
2016-01-26 14:59:00,389 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-41) [] CommandAsyncTask::endAction: Ending action for &#39;3&#39; tasks (command ID: &#39;8f3ccf29-3056-4ab0-bc11-b987814fe5fd&#39;): calling endAction &#39;.<br>
2016-01-26 14:59:00,390 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-25) [] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction &#39;CreateAllSnapshotsFromVm&#39;, executionIndex: &#39;0&#39;<br>
2016-01-26 14:59:00,541 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-25) [] Ending command &#39;org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand&#39; successfully.<br>
2016-01-26 14:59:00,647 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-25) [] START, SnapshotVDSCommand(HostName = kvm01, SnapshotVDSCommandParameters:{runAsync=&#39;true&#39;, hostId=&#39;f18a051d-b893-41f7-9e97-0037abc7180d&#39;, vmId=&#39;4e683012-8895-43da-b3e1-6d6271f4d829&#39;}), log id: 459fcd47<br>
2016-01-26 14:59:05,465 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (org.ovirt.thread.pool-8-thread-25) [] FINISH, SnapshotVDSCommand, log id: 459fcd47<br>
2016-01-26 14:59:05,483 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-25) [2adcf7fc] Ending command &#39;org.ovirt.engine.core.bll.CreateSnapshotCommand&#39; successfully.<br>
2016-01-26 14:59:05,506 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-25) [2adcf7fc] START, GetImageInfoVDSCommand( GetImageInfoVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;dd1f13d8-4fb1-4f48-b7b6-cb912c0c1437&#39;, imageId=&#39;88a9ab18-7d4c-42f0-9067-0241b64cb7d0&#39;}), log id: 17bd1fc<br>
2016-01-26 14:59:06,562 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-25) [2adcf7fc] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.storage.DiskImage@ce4f3490, log id: 17bd1fc<br>
2016-01-26 14:59:06,607 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-25) [a3e8512] Ending command &#39;org.ovirt.engine.core.bll.CreateSnapshotCommand&#39; successfully.<br>
2016-01-26 14:59:06,626 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-25) [a3e8512] START, GetImageInfoVDSCommand( GetImageInfoVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;d98b8313-de2f-477a-94f8-78026497612b&#39;, imageId=&#39;dbbae52f-a408-41a4-8e6c-0c1919df5c93&#39;}), log id: 6e1489cb<br>
2016-01-26 14:59:08,023 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-25) [a3e8512] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.storage.DiskImage@3294df55, log id: 6e1489cb<br>
2016-01-26 14:59:08,077 INFO [org.ovirt.engine.core.bll.CreateSnapshotCommand] (org.ovirt.thread.pool-8-thread-25) [217c647e] Ending command &#39;org.ovirt.engine.core.bll.CreateSnapshotCommand&#39; successfully.<br>
2016-01-26 14:59:08,092 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-25) [217c647e] START, GetImageInfoVDSCommand( GetImageInfoVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;42e212c1-f669-43e1-8f90-20baf0c3f58c&#39;, imageId=&#39;5d8f7880-9125-4c91-ba04-532901d1d805&#39;}), log id: 1dae9b25<br>
2016-01-26 14:59:08,388 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-8-thread-25) [217c647e] FINISH, GetImageInfoVDSCommand, return: org.ovirt.engine.core.common.businessentities.storage.DiskImage@4bd18557, log id: 1dae9b25<br>
2016-01-26 14:59:08,419 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-25) [] Lock freed to object &#39;EngineLock:{exclusiveLocks=&#39;[4e683012-8895-43da-b3e1-6d6271f4d829=&lt;VM, ACTION_TYPE_FAILED_SNAPSHOT_IS_BEING_TAKEN_FOR_VM$VmName hpserver&gt;]&#39;, sharedLocks=&#39;null&#39;}&#39;<br>
2016-01-26 14:59:08,503 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-25) [] Correlation ID: 5b009390, Job ID: b76122a8-a780-47e4-9c63-eac6b7f8b6e4, Call Stack: null, Custom Event ID: -1, Message: Snapshot &#39;test_snap&#39; creation for VM &#39;hpserver&#39; has been completed.<br>
2016-01-26 14:59:08,504 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-25) [] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type &#39;CreateAllSnapshotsFromVm&#39; completed, handling the result.<br>
2016-01-26 14:59:08,504 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-25) [] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type &#39;CreateAllSnapshotsFromVm&#39; succeeded, clearing tasks.<br>
2016-01-26 14:59:08,510 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-25) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task &#39;010eec77-3b20-483c-bdd3-e9a8912f7ba5&#39;<br>
2016-01-26 14:59:08,513 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-25) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, taskId=&#39;010eec77-3b20-483c-bdd3-e9a8912f7ba5&#39;}), log id: 14a34aa3<br>
2016-01-26 14:59:08,514 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-25) [] START, HSMClearTaskVDSCommand(HostName = kvm02, HSMTaskGuidBaseVDSCommandParameters:{runAsync=&#39;true&#39;, hostId=&#39;572aa833-37fb-4c4b-9576-9d367def2d04&#39;, taskId=&#39;010eec77-3b20-483c-bdd3-e9a8912f7ba5&#39;}), log id: 3c0fbdc7<br>
2016-01-26 14:59:08,959 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-25) [] FINISH, HSMClearTaskVDSCommand, log id: 3c0fbdc7<br>
2016-01-26 14:59:08,960 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-25) [] FINISH, SPMClearTaskVDSCommand, log id: 14a34aa3<br>
2016-01-26 14:59:08,973 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-25) [] BaseAsyncTask::removeTaskFromDB: Removed task &#39;010eec77-3b20-483c-bdd3-e9a8912f7ba5&#39; from DataBase<br>
2016-01-26 14:59:08,974 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-25) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task &#39;9f0ac94f-deb9-4662-824b-f7144c869af0&#39;<br>
2016-01-26 14:59:08,976 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-25) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, taskId=&#39;9f0ac94f-deb9-4662-824b-f7144c869af0&#39;}), log id: b2a607c<br>
2016-01-26 14:59:08,977 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-25) [] START, HSMClearTaskVDSCommand(HostName = kvm02, HSMTaskGuidBaseVDSCommandParameters:{runAsync=&#39;true&#39;, hostId=&#39;572aa833-37fb-4c4b-9576-9d367def2d04&#39;, taskId=&#39;9f0ac94f-deb9-4662-824b-f7144c869af0&#39;}), log id: 3c0d79bc<br>
2016-01-26 14:59:10,001 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-25) [] FINISH, HSMClearTaskVDSCommand, log id: 3c0d79bc<br>
2016-01-26 14:59:10,002 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-25) [] FINISH, SPMClearTaskVDSCommand, log id: b2a607c<br>
2016-01-26 14:59:10,012 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-25) [] BaseAsyncTask::removeTaskFromDB: Removed task &#39;9f0ac94f-deb9-4662-824b-f7144c869af0&#39; from DataBase<br>
2016-01-26 14:59:10,012 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-25) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task &#39;293a6312-8c4f-4c89-a3f7-2f9f0557a9b8&#39;<br>
2016-01-26 14:59:10,014 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-25) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, taskId=&#39;293a6312-8c4f-4c89-a3f7-2f9f0557a9b8&#39;}), log id: 63c6b6df<br>
2016-01-26 14:59:12,174 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-25) [] START, HSMClearTaskVDSCommand(HostName = kvm02, HSMTaskGuidBaseVDSCommandParameters:{runAsync=&#39;true&#39;, hostId=&#39;572aa833-37fb-4c4b-9576-9d367def2d04&#39;, taskId=&#39;293a6312-8c4f-4c89-a3f7-2f9f0557a9b8&#39;}), log id: 593cc157<br>
2016-01-26 14:59:12,573 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-6) [] START, FullListVDSCommand(HostName = , FullListVDSCommandParameters:{runAsync=&#39;true&#39;, hostId=&#39;f18a051d-b893-41f7-9e97-0037abc7180d&#39;, vds=&#39;Host[,f18a051d-b893-41f7-9e97-0037abc7180d]&#39;, vmIds=&#39;[4e683012-8895-43da-b3e1-6d6271f4d829]&#39;}), log id: 3672e426<br>
2016-01-26 14:59:12,575 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-25) [] FINISH, HSMClearTaskVDSCommand, log id: 593cc157<br>
2016-01-26 14:59:12,575 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-25) [] FINISH, SPMClearTaskVDSCommand, log id: 63c6b6df<br>
2016-01-26 14:59:12,585 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-25) [] BaseAsyncTask::removeTaskFromDB: Removed task &#39;293a6312-8c4f-4c89-a3f7-2f9f0557a9b8&#39; from DataBase<br>
2016-01-26 14:59:12,586 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-25) [] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity &#39;8f3ccf29-3056-4ab0-bc11-b987814fe5fd&#39;<br>
2016-01-26 14:59:13,652 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVDSCommand] (DefaultQuartzScheduler_Worker-6) [] FINISH, FullListVDSCommand, return: [{acpiEnable=true, emulatedMachine=pc-i440fx-rhel7.2.0, afterMigrationStatus=, tabletEnable=true, pid=32651, memGuaranteedSize=1024, transparentHugePages=true, displaySecurePort=-1, spiceSslCipherSuite=DEFAULT, cpuType=SandyBridge, smp=1, guestNumaNodes=[Ljava.lang.Object;@3c99c1b9, hypervEnable=true, numaTune={nodeset=0,1, mode=interleave}, custom={device_88ae2b1a-bcd6-4252-abc8-5dd81e315394device_9b763617-eb2b-44ec-b227-397ca7a14d40device_af2dd0fa-cdaf-42f5-8483-a2f6a2ad4a47=VmDevice:{id=&#39;VmDeviceId:{deviceId=&#39;af2dd0fa-cdaf-42f5-8483-a2f6a2ad4a47&#39;, vmId=&#39;4e683012-8895-43da-b3e1-6d6271f4d829&#39;}&#39;, device=&#39;unix&#39;, type=&#39;CHANNEL&#39;, bootOrder=&#39;0&#39;, specParams=&#39;[]&#39;, address=&#39;{bus=0, controller=0, type=virtio-serial, port=2}&#39;, managed=&#39;false&#39;, plugged=&#39;true&#39;, readOnly=&#39;false&#39;, deviceAlias=&#39;channel1&#39;, customProperties=&#39;[]&#39;, snapshotId=&#39;null&#39;, logicalName=&#39;null&#39;, usingScsiReservation=&#39;false&#39;}, device_88ae2b1a-bcd6-4252-abc8-5dd81e315394=VmDevice:{id=&#39;VmDeviceId:{deviceId=&#39;88ae2b1a-bcd6-4252-abc8-5dd81e315394&#39;, vmId=&#39;4e683012-8895-43da-b3e1-6d6271f4d829&#39;}&#39;, device=&#39;unix&#39;, type=&#39;CHANNEL&#39;, bootOrder=&#39;0&#39;, specParams=&#39;[]&#39;, address=&#39;{bus=0, controller=0, type=virtio-serial, port=1}&#39;, managed=&#39;false&#39;, plugged=&#39;true&#39;, readOnly=&#39;false&#39;, deviceAlias=&#39;channel0&#39;, customProperties=&#39;[]&#39;, snapshotId=&#39;null&#39;, logicalName=&#39;null&#39;, usingScsiReservation=&#39;false&#39;}, device_88ae2b1a-bcd6-4252-abc8-5dd81e315394device_9b763617-eb2b-44ec-b227-397ca7a14d40=VmDevice:{id=&#39;VmDeviceId:{deviceId=&#39;9b763617-eb2b-44ec-b227-397ca7a14d40&#39;, vmId=&#39;4e683012-8895-43da-b3e1-6d6271f4d829&#39;}&#39;, device=&#39;ide&#39;, type=&#39;CONTROLLER&#39;, bootOrder=&#39;0&#39;, specParams=&#39;[]&#39;, address=&#39;{slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}&#39;, managed=&#39;false&#39;, plugged=&#39;true&#39;, readOnly=&#39;false&#39;, deviceAlias=&#39;ide0&#39;, customProperties=&#39;[]&#39;, snapshotId=&#39;null&#39;, logicalName=&#39;null&#39;, usingScsiReservation=&#39;false&#39;}}, vmType=kvm, memSize=2048, smpCoresPerSocket=1, vmName=hpserver, nice=0, status=Up, maxMemSize=20480, bootMenuEnable=false, guestDiskMapping={}, vmId=4e683012-8895-43da-b3e1-6d6271f4d829, displayIp=0, displayPort=5914, smartcardEnable=false, spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, maxMemSlots=16, nicModel=rtl8139,pv, keyboardLayout=it, kvmEnable=true, devices=[Ljava.lang.Object;@214fa7db, timeOffset=14401, maxVCpus=16, clientIp=, statusTime=5328205390, display=vnc}], log id: 3672e426<br>
2016-01-26 14:59:13,658 INFO [org.ovirt.engine.core.vdsbroker.VmsMonitoring] (DefaultQuartzScheduler_Worker-6) [] Received a memballoon Device without an address when processing VM 4e683012-8895-43da-b3e1-6d6271f4d829 devices, skipping device: {target=2097152, alias=balloon0, specParams={model=none}, deviceType=balloon, device=memballoon, type=balloon}<br>
2016-01-26 14:59:13,658 INFO [org.ovirt.engine.core.vdsbroker.VmsMonitoring] (DefaultQuartzScheduler_Worker-6) [] Received a vnc Device without an address when processing VM 4e683012-8895-43da-b3e1-6d6271f4d829 devices, skipping device: {specParams={displayIp=0}, deviceType=graphics, deviceId=333c2dc5-837e-4fd3-b311-e0a7eb5ed45f, device=vnc, type=graphics, port=5914}<br>
2016-01-26 14:59:13,659 ERROR [org.ovirt.engine.core.vdsbroker.VmsMonitoring] (DefaultQuartzScheduler_Worker-6) [] VM &#39;4e683012-8895-43da-b3e1-6d6271f4d829&#39; managed non pluggable device was removed unexpectedly from libvirt: &#39;VmDevice:{id=&#39;VmDeviceId:{deviceId=&#39;333c2dc5-837e-4fd3-b311-e0a7eb5ed45f&#39;, vmId=&#39;4e683012-8895-43da-b3e1-6d6271f4d829&#39;}&#39;, device=&#39;vnc&#39;, type=&#39;GRAPHICS&#39;, bootOrder=&#39;0&#39;, specParams=&#39;[]&#39;, address=&#39;&#39;, managed=&#39;true&#39;, plugged=&#39;false&#39;, readOnly=&#39;false&#39;, deviceAlias=&#39;&#39;, customProperties=&#39;[]&#39;, snapshotId=&#39;null&#39;, logicalName=&#39;null&#39;, usingScsiReservation=&#39;false&#39;}&#39;<br>
<br>
<br>
And this when I clone the snapshot:<br>
2016-01-26 15:00:14,932 INFO [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (default task-20) [30049735] Lock Acquired to object &#39;EngineLock:{exclusiveLocks=&#39;[4e683012-8895-43da-b3e1-6d6271f4d829=&lt;VM, ACTION_TYPE_FAILED_OBJECT_LOCKED&gt;, test_clone=&lt;VM_NAME, ACTION_TYPE_FAILED_OBJECT_LOCKED&gt;]&#39;, sharedLocks=&#39;null&#39;}&#39;<br>
2016-01-26 15:00:15,511 INFO [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (default task-20) [] Running command: AddVmFromSnapshotCommand internal: false. Entities affected :  ID: 00000002-0002-0002-0002-0000000000ca Type: VdsGroupsAction group CREATE_VM with role type USER,  ID: 239c7309-7e4c-4545-8137-6bf1d43cad71 Type: StorageAction group CREATE_DISK with role type USER,  ID: 239c7309-7e4c-4545-8137-6bf1d43cad71 Type: StorageAction group CREATE_DISK with role type USER,  ID: 239c7309-7e4c-4545-8137-6bf1d43cad71 Type: StorageAction group CREATE_DISK with role type USER,  ID: 4e683012-8895-43da-b3e1-6d6271f4d829 Type: VMAction group CREATE_VM with role type USER<br>
2016-01-26 15:00:15,607 INFO [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (default task-20) [] Locking VM(id = &#39;fa0f7dca-19d3-4f55-82c9-b81b235d913a&#39;) with compensation.<br>
2016-01-26 15:00:15,610 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-20) [] START, SetVmStatusVDSCommand( SetVmStatusVDSCommandParameters:{runAsync=&#39;true&#39;, vmId=&#39;fa0f7dca-19d3-4f55-82c9-b81b235d913a&#39;, status=&#39;ImageLocked&#39;, exitStatus=&#39;Normal&#39;}), log id: 6a218716<br>
2016-01-26 15:00:15,614 INFO [org.ovirt.engine.core.vdsbroker.SetVmStatusVDSCommand] (default task-20) [] FINISH, SetVmStatusVDSCommand, log id: 6a218716<br>
2016-01-26 15:00:15,617 INFO [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (default task-20) [] Lock freed to object &#39;EngineLock:{exclusiveLocks=&#39;[4e683012-8895-43da-b3e1-6d6271f4d829=&lt;VM, ACTION_TYPE_FAILED_OBJECT_LOCKED&gt;, test_clone=&lt;VM_NAME, ACTION_TYPE_FAILED_OBJECT_LOCKED&gt;]&#39;, sharedLocks=&#39;null&#39;}&#39;<br>
2016-01-26 15:00:15,661 INFO [org.ovirt.engine.core.bll.CopyImageGroupCommand] (default task-20) [1a40e7c1] Running command: CopyImageGroupCommand internal: true. Entities affected :  ID: 239c7309-7e4c-4545-8137-6bf1d43cad71 Type: Storage<br>
2016-01-26 15:00:15,697 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [1a40e7c1] START, CopyImageVDSCommand( CopyImageVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;dd1f13d8-4fb1-4f48-b7b6-cb912c0c1437&#39;, imageId=&#39;0856943c-c714-43a5-8f26-087143131d74&#39;, dstImageGroupId=&#39;9a1bd54c-a55a-4edc-b1a4-0d6fcfed8bdc&#39;, vmId=&#39;fa0f7dca-19d3-4f55-82c9-b81b235d913a&#39;, dstImageId=&#39;58da4129-eb0f-476e-b060-94cb2740ab8d&#39;, imageDescription=&#39;&#39;, dstStorageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, copyVolumeType=&#39;LeafVol&#39;, volumeFormat=&#39;RAW&#39;, preallocate=&#39;Preallocated&#39;, postZero=&#39;false&#39;, force=&#39;false&#39;}), log id: 54b72148<br>
2016-01-26 15:00:15,699 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [1a40e7c1] -- executeIrsBrokerCommand: calling &#39;copyImage&#39; with two new parameters: description and UUID. Parameters:<br>
2016-01-26 15:00:15,699 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [1a40e7c1] ++ sdUUID=239c7309-7e4c-4545-8137-6bf1d43cad71<br>
2016-01-26 15:00:15,699 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [1a40e7c1] ++ spUUID=00000001-0001-0001-0001-000000000296<br>
2016-01-26 15:00:15,699 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [1a40e7c1] ++ vmGUID=fa0f7dca-19d3-4f55-82c9-b81b235d913a<br>
2016-01-26 15:00:15,699 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [1a40e7c1] ++ srcImageGUID=dd1f13d8-4fb1-4f48-b7b6-cb912c0c1437<br>
2016-01-26 15:00:15,699 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [1a40e7c1] ++ srcVolUUID=0856943c-c714-43a5-8f26-087143131d74<br>
2016-01-26 15:00:15,699 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [1a40e7c1] ++ dstImageGUID=9a1bd54c-a55a-4edc-b1a4-0d6fcfed8bdc<br>
2016-01-26 15:00:15,699 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [1a40e7c1] ++ dstVolUUID=58da4129-eb0f-476e-b060-94cb2740ab8d<br>
2016-01-26 15:00:15,699 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [1a40e7c1] ++ descr=<br>
2016-01-26 15:00:15,699 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [1a40e7c1] ++ dstSdUUID=239c7309-7e4c-4545-8137-6bf1d43cad71<br>
2016-01-26 15:00:17,619 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [1a40e7c1] FINISH, CopyImageVDSCommand, return: bf3ef9aa-5099-47b6-b954-9a6902eb17c9, log id: 54b72148<br>
2016-01-26 15:00:17,632 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (default task-20) [1a40e7c1] CommandAsyncTask::Adding CommandMultiAsyncTasks object for command &#39;aaac9162-4be3-473f-91f4-491c8eedb4ad&#39;<br>
2016-01-26 15:00:17,632 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (default task-20) [1a40e7c1] CommandMultiAsyncTasks::AttachTask: Attaching task &#39;bf3ef9aa-5099-47b6-b954-9a6902eb17c9&#39; to command &#39;aaac9162-4be3-473f-91f4-491c8eedb4ad&#39;.<br>
2016-01-26 15:00:17,668 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (default task-20) [1a40e7c1] Adding task &#39;bf3ef9aa-5099-47b6-b954-9a6902eb17c9&#39; (Parent Command &#39;AddVmFromSnapshot&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;), polling hasn&#39;t started yet..<br>
2016-01-26 15:00:17,872 INFO [org.ovirt.engine.core.bll.CopyImageGroupCommand] (default task-20) [388cd805] Running command: CopyImageGroupCommand internal: true. Entities affected :  ID: 239c7309-7e4c-4545-8137-6bf1d43cad71 Type: Storage<br>
2016-01-26 15:00:17,928 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [388cd805] START, CopyImageVDSCommand( CopyImageVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;d98b8313-de2f-477a-94f8-78026497612b&#39;, imageId=&#39;dd30f129-e8d0-4155-9c63-6ac1ee76fa8e&#39;, dstImageGroupId=&#39;3f83427e-d3a9-4d0a-a176-aa713fbab255&#39;, vmId=&#39;fa0f7dca-19d3-4f55-82c9-b81b235d913a&#39;, dstImageId=&#39;31f56d0e-cf73-464d-ad9a-8a6b75c68563&#39;, imageDescription=&#39;&#39;, dstStorageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, copyVolumeType=&#39;LeafVol&#39;, volumeFormat=&#39;RAW&#39;, preallocate=&#39;Preallocated&#39;, postZero=&#39;false&#39;, force=&#39;false&#39;}), log id: 3e52cd55<br>
2016-01-26 15:00:17,930 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [388cd805] -- executeIrsBrokerCommand: calling &#39;copyImage&#39; with two new parameters: description and UUID. Parameters:<br>
2016-01-26 15:00:17,931 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [388cd805] ++ sdUUID=239c7309-7e4c-4545-8137-6bf1d43cad71<br>
2016-01-26 15:00:17,931 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [388cd805] ++ spUUID=00000001-0001-0001-0001-000000000296<br>
2016-01-26 15:00:17,931 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [388cd805] ++ vmGUID=fa0f7dca-19d3-4f55-82c9-b81b235d913a<br>
2016-01-26 15:00:17,931 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [388cd805] ++ srcImageGUID=d98b8313-de2f-477a-94f8-78026497612b<br>
2016-01-26 15:00:17,931 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [388cd805] ++ srcVolUUID=dd30f129-e8d0-4155-9c63-6ac1ee76fa8e<br>
2016-01-26 15:00:17,931 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [388cd805] ++ dstImageGUID=3f83427e-d3a9-4d0a-a176-aa713fbab255<br>
2016-01-26 15:00:17,931 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [388cd805] ++ dstVolUUID=31f56d0e-cf73-464d-ad9a-8a6b75c68563<br>
2016-01-26 15:00:17,931 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [388cd805] ++ descr=<br>
2016-01-26 15:00:17,931 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [388cd805] ++ dstSdUUID=239c7309-7e4c-4545-8137-6bf1d43cad71<br>
2016-01-26 15:00:18,975 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-88) [50bfaa54] Setting new tasks map. The map contains now 1 tasks<br>
2016-01-26 15:00:19,707 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [388cd805] FINISH, CopyImageVDSCommand, return: 8347d2c2-1907-431c-baeb-b885ba6f200d, log id: 3e52cd55<br>
2016-01-26 15:00:19,729 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (default task-20) [388cd805] CommandMultiAsyncTasks::AttachTask: Attaching task &#39;8347d2c2-1907-431c-baeb-b885ba6f200d&#39; to command &#39;aaac9162-4be3-473f-91f4-491c8eedb4ad&#39;.<br>
2016-01-26 15:00:19,768 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (default task-20) [388cd805] Adding task &#39;8347d2c2-1907-431c-baeb-b885ba6f200d&#39; (Parent Command &#39;AddVmFromSnapshot&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;), polling hasn&#39;t started yet..<br>
2016-01-26 15:00:19,886 INFO [org.ovirt.engine.core.bll.CopyImageGroupCommand] (default task-20) [66941705] Running command: CopyImageGroupCommand internal: true. Entities affected :  ID: 239c7309-7e4c-4545-8137-6bf1d43cad71 Type: Storage<br>
2016-01-26 15:00:19,932 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [66941705] START, CopyImageVDSCommand( CopyImageVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;42e212c1-f669-43e1-8f90-20baf0c3f58c&#39;, imageId=&#39;449e8b88-ab34-4cf8-bc91-00128c35dc65&#39;, dstImageGroupId=&#39;b06a9ad5-62ca-478e-9f0c-278feca4eda3&#39;, vmId=&#39;fa0f7dca-19d3-4f55-82c9-b81b235d913a&#39;, dstImageId=&#39;136257df-c62b-421b-a12a-dea765b16721&#39;, imageDescription=&#39;&#39;, dstStorageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, copyVolumeType=&#39;LeafVol&#39;, volumeFormat=&#39;RAW&#39;, preallocate=&#39;Preallocated&#39;, postZero=&#39;false&#39;, force=&#39;false&#39;}), log id: 70cc5e38<br>
2016-01-26 15:00:19,935 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [66941705] -- executeIrsBrokerCommand: calling &#39;copyImage&#39; with two new parameters: description and UUID. Parameters:<br>
2016-01-26 15:00:19,935 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [66941705] ++ sdUUID=239c7309-7e4c-4545-8137-6bf1d43cad71<br>
2016-01-26 15:00:19,935 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [66941705] ++ spUUID=00000001-0001-0001-0001-000000000296<br>
2016-01-26 15:00:19,936 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [66941705] ++ vmGUID=fa0f7dca-19d3-4f55-82c9-b81b235d913a<br>
2016-01-26 15:00:19,936 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [66941705] ++ srcImageGUID=42e212c1-f669-43e1-8f90-20baf0c3f58c<br>
2016-01-26 15:00:19,936 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [66941705] ++ srcVolUUID=449e8b88-ab34-4cf8-bc91-00128c35dc65<br>
2016-01-26 15:00:19,936 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [66941705] ++ dstImageGUID=b06a9ad5-62ca-478e-9f0c-278feca4eda3<br>
2016-01-26 15:00:19,936 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [66941705] ++ dstVolUUID=136257df-c62b-421b-a12a-dea765b16721<br>
2016-01-26 15:00:19,936 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [66941705] ++ descr=<br>
2016-01-26 15:00:19,936 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [66941705] ++ dstSdUUID=239c7309-7e4c-4545-8137-6bf1d43cad71<br>
2016-01-26 15:00:23,635 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.CopyImageVDSCommand] (default task-20) [66941705] FINISH, CopyImageVDSCommand, return: b910d97d-a091-4648-8840-e870651745c7, log id: 70cc5e38<br>
2016-01-26 15:00:23,654 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (default task-20) [66941705] CommandMultiAsyncTasks::AttachTask: Attaching task &#39;b910d97d-a091-4648-8840-e870651745c7&#39; to command &#39;aaac9162-4be3-473f-91f4-491c8eedb4ad&#39;.<br>
2016-01-26 15:00:23,676 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (default task-20) [66941705] Adding task &#39;b910d97d-a091-4648-8840-e870651745c7&#39; (Parent Command &#39;AddVmFromSnapshot&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;), polling hasn&#39;t started yet..<br>
2016-01-26 15:00:23,780 INFO [org.ovirt.engine.core.bll.AddGraphicsDeviceCommand] (default task-20) [2cab3adb] Running command: AddGraphicsDeviceCommand internal: true. Entities affected :  ID: fa0f7dca-19d3-4f55-82c9-b81b235d913a Type: VMAction group EDIT_VM_PROPERTIES with role type USER<br>
2016-01-26 15:00:23,871 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-20) [2cab3adb] Correlation ID: 30049735, Job ID: fe7f7d93-4a22-4bfe-baae-bc2357dc01e9, Call Stack: null, Custom Event ID: -1, Message: VM test_clone creation was initiated by rfocesq@omme.net@<a href="http://omme.net" rel="noreferrer" target="_blank">omme.net</a>.<br>
2016-01-26 15:00:23,871 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (default task-20) [2cab3adb] BaseAsyncTask::startPollingTask: Starting to poll task &#39;bf3ef9aa-5099-47b6-b954-9a6902eb17c9&#39;.<br>
2016-01-26 15:00:23,872 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (default task-20) [2cab3adb] BaseAsyncTask::startPollingTask: Starting to poll task &#39;8347d2c2-1907-431c-baeb-b885ba6f200d&#39;.<br>
2016-01-26 15:00:23,872 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (default task-20) [2cab3adb] BaseAsyncTask::startPollingTask: Starting to poll task &#39;b910d97d-a091-4648-8840-e870651745c7&#39;.<br>
2016-01-26 15:00:30,393 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-95) [76980f69] Polling and updating Async Tasks: 3 tasks, 3 tasks to poll now<br>
2016-01-26 15:00:31,835 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-95) [76980f69] Failed in &#39;HSMGetAllTasksStatusesVDS&#39; method<br>
2016-01-26 15:00:31,846 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-95) [76980f69] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM kvm02 command failed: low level Image copy failed<br>
2016-01-26 15:00:31,847 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-95) [76980f69] SPMAsyncTask::PollTask: Polling task &#39;8347d2c2-1907-431c-baeb-b885ba6f200d&#39; (Parent Command &#39;AddVmFromSnapshot&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) returned status &#39;cleaning&#39;.<br>
2016-01-26 15:00:31,847 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-95) [76980f69] SPMAsyncTask::PollTask: Polling task &#39;bf3ef9aa-5099-47b6-b954-9a6902eb17c9&#39; (Parent Command &#39;AddVmFromSnapshot&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) returned status &#39;finished&#39;, result &#39;cleanSuccess&#39;.<br>
2016-01-26 15:00:31,855 ERROR [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-95) [76980f69] BaseAsyncTask::logEndTaskFailure: Task &#39;bf3ef9aa-5099-47b6-b954-9a6902eb17c9&#39; (Parent Command &#39;AddVmFromSnapshot&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) ended with failure:<br>
-- Result: &#39;cleanSuccess&#39;<br>
-- Message: &#39;VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = low level Image copy failed, code = 261&#39;,<br>
-- Exception: &#39;VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = low level Image copy failed, code = 261&#39;<br>
2016-01-26 15:00:31,857 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-95) [76980f69] Task with DB Task ID &#39;a773241b-1473-4d42-97b3-bc077d2973fd&#39; and VDSM Task ID &#39;8347d2c2-1907-431c-baeb-b885ba6f200d&#39; is in state Polling. End action for command aaac9162-4be3-473f-91f4-491c8eedb4ad will proceed when all the entity&#39;s tasks are completed.<br>
2016-01-26 15:00:31,857 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-95) [76980f69] SPMAsyncTask::PollTask: Polling task &#39;b910d97d-a091-4648-8840-e870651745c7&#39; (Parent Command &#39;AddVmFromSnapshot&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) returned status &#39;running&#39;.<br>
2016-01-26 15:00:31,857 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (DefaultQuartzScheduler_Worker-95) [76980f69] Finished polling Tasks, will poll again in 10 seconds.<br>
2016-01-26 15:00:33,309 WARN [org.ovirt.engine.core.bll.scheduling.policyunits.EvenGuestDistributionBalancePolicyUnit] (DefaultQuartzScheduler_Worker-65) [50bfaa54] There is no host with less than 8 running guests<br>
2016-01-26 15:00:33,310 WARN [org.ovirt.engine.core.bll.scheduling.policyunits.CpuAndMemoryBalancingPolicyUnit] (DefaultQuartzScheduler_Worker-65) [50bfaa54] All hosts are over-utilized, can&#39;t balance the cluster &#39;Default&#39; using the primary method<br>
2016-01-26 15:00:42,877 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-21) [2c031c31] Failed in &#39;HSMGetAllTasksStatusesVDS&#39; method<br>
2016-01-26 15:00:42,888 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) [2c031c31] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM kvm02 command failed: low level Image copy failed<br>
2016-01-26 15:00:42,889 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-21) [2c031c31] Failed in &#39;HSMGetAllTasksStatusesVDS&#39; method<br>
2016-01-26 15:00:42,898 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) [2c031c31] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM kvm02 command failed: low level Image copy failed<br>
2016-01-26 15:00:42,898 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (DefaultQuartzScheduler_Worker-21) [2c031c31] Failed in &#39;HSMGetAllTasksStatusesVDS&#39; method<br>
2016-01-26 15:00:42,905 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-21) [2c031c31] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM kvm02 command failed: low level Image copy failed<br>
2016-01-26 15:00:42,906 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-21) [2c031c31] SPMAsyncTask::PollTask: Polling task &#39;8347d2c2-1907-431c-baeb-b885ba6f200d&#39; (Parent Command &#39;AddVmFromSnapshot&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) returned status &#39;finished&#39;, result &#39;cleanSuccess&#39;.<br>
2016-01-26 15:00:42,916 ERROR [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-21) [2c031c31] BaseAsyncTask::logEndTaskFailure: Task &#39;8347d2c2-1907-431c-baeb-b885ba6f200d&#39; (Parent Command &#39;AddVmFromSnapshot&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) ended with failure:<br>
-- Result: &#39;cleanSuccess&#39;<br>
-- Message: &#39;VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = low level Image copy failed, code = 261&#39;,<br>
-- Exception: &#39;VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = low level Image copy failed, code = 261&#39;<br>
2016-01-26 15:00:42,916 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-21) [2c031c31] Task with DB Task ID &#39;8c4d9c72-995a-47b6-b8b4-08ce70dbca2e&#39; and VDSM Task ID &#39;b910d97d-a091-4648-8840-e870651745c7&#39; is in state Polling. End action for command aaac9162-4be3-473f-91f4-491c8eedb4ad will proceed when all the entity&#39;s tasks are completed.<br>
2016-01-26 15:00:42,922 ERROR [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-21) [2c031c31] BaseAsyncTask::logEndTaskFailure: Task &#39;bf3ef9aa-5099-47b6-b954-9a6902eb17c9&#39; (Parent Command &#39;AddVmFromSnapshot&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) ended with failure:<br>
-- Result: &#39;cleanSuccess&#39;<br>
-- Message: &#39;VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = low level Image copy failed, code = 261&#39;,<br>
-- Exception: &#39;VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = low level Image copy failed, code = 261&#39;<br>
2016-01-26 15:00:42,922 INFO [org.ovirt.engine.core.bll.CommandMultiAsyncTasks] (DefaultQuartzScheduler_Worker-21) [2c031c31] Task with DB Task ID &#39;8c4d9c72-995a-47b6-b8b4-08ce70dbca2e&#39; and VDSM Task ID &#39;b910d97d-a091-4648-8840-e870651745c7&#39; is in state Polling. End action for command aaac9162-4be3-473f-91f4-491c8eedb4ad will proceed when all the entity&#39;s tasks are completed.<br>
2016-01-26 15:00:42,922 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-21) [2c031c31] SPMAsyncTask::PollTask: Polling task &#39;b910d97d-a091-4648-8840-e870651745c7&#39; (Parent Command &#39;AddVmFromSnapshot&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) returned status &#39;finished&#39;, result &#39;cleanSuccess&#39;.<br>
2016-01-26 15:00:42,930 ERROR [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (DefaultQuartzScheduler_Worker-21) [2c031c31] BaseAsyncTask::logEndTaskFailure: Task &#39;b910d97d-a091-4648-8840-e870651745c7&#39; (Parent Command &#39;AddVmFromSnapshot&#39;, Parameters Type &#39;org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters&#39;) ended with failure:<br>
-- Result: &#39;cleanSuccess&#39;<br>
-- Message: &#39;VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = low level Image copy failed, code = 261&#39;,<br>
-- Exception: &#39;VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = low level Image copy failed, code = 261&#39;<br>
2016-01-26 15:00:42,959 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-21) [2c031c31] CommandAsyncTask::endActionIfNecessary: All tasks of command &#39;aaac9162-4be3-473f-91f4-491c8eedb4ad&#39; has ended -&gt; executing &#39;endAction&#39;<br>
2016-01-26 15:00:42,959 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (DefaultQuartzScheduler_Worker-21) [2c031c31] CommandAsyncTask::endAction: Ending action for &#39;3&#39; tasks (command ID: &#39;aaac9162-4be3-473f-91f4-491c8eedb4ad&#39;): calling endAction &#39;.<br>
2016-01-26 15:00:42,960 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-46) [2c031c31] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction &#39;AddVmFromSnapshot&#39;, executionIndex: &#39;0&#39;<br>
2016-01-26 15:00:43,014 ERROR [org.ovirt.engine.core.bll.AddVmFromSnapshotCommand] (org.ovirt.thread.pool-8-thread-46) [30049735] Ending command &#39;org.ovirt.engine.core.bll.AddVmFromSnapshotCommand&#39; with failure.<br>
2016-01-26 15:00:43,036 ERROR [org.ovirt.engine.core.bll.CopyImageGroupCommand] (org.ovirt.thread.pool-8-thread-46) [388cd805] Ending command &#39;org.ovirt.engine.core.bll.CopyImageGroupCommand&#39; with failure.<br>
2016-01-26 15:00:43,049 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-46) [7c5a150a] Running command: RemoveImageCommand internal: true. Entities affected :  ID: 00000000-0000-0000-0000-000000000000 Type: Storage<br>
2016-01-26 15:00:43,093 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-46) [7c5a150a] START, DeleteImageGroupVDSCommand( DeleteImageGroupVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;3f83427e-d3a9-4d0a-a176-aa713fbab255&#39;, postZeros=&#39;false&#39;, forceDelete=&#39;false&#39;}), log id: 5be417ac<br>
2016-01-26 15:00:44,592 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-46) [7c5a150a] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM command failed: Image does not exist in domain: u&#39;image=3f83427e-d3a9-4d0a-a176-aa713fbab255, domain=239c7309-7e4c-4545-8137-6bf1d43cad71&#39;<br>
2016-01-26 15:00:44,592 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-46) [7c5a150a] Command &#39;DeleteImageGroupVDSCommand( DeleteImageGroupVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;3f83427e-d3a9-4d0a-a176-aa713fbab255&#39;, postZeros=&#39;false&#39;, forceDelete=&#39;false&#39;})&#39; execution failed: IRSGenericException: IRSErrorException: Image does not exist in domain: u&#39;image=3f83427e-d3a9-4d0a-a176-aa713fbab255, domain=239c7309-7e4c-4545-8137-6bf1d43cad71&#39;<br>
2016-01-26 15:00:44,592 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-46) [7c5a150a] FINISH, DeleteImageGroupVDSCommand, log id: 5be417ac<br>
2016-01-26 15:00:44,593 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-46) [7c5a150a] Disk &#39;3f83427e-d3a9-4d0a-a176-aa713fbab255&#39; doesn&#39;t exist on storage domain &#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, rolling forward<br>
2016-01-26 15:00:44,790 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-46) [7c5a150a] Removed task &#39;0797d4de-2df6-4283-8952-c9d186d2b010&#39; from DataBase<br>
2016-01-26 15:00:44,808 ERROR [org.ovirt.engine.core.bll.CopyImageGroupCommand] (org.ovirt.thread.pool-8-thread-46) [1a40e7c1] Ending command &#39;org.ovirt.engine.core.bll.CopyImageGroupCommand&#39; with failure.<br>
2016-01-26 15:00:44,821 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-46) [1a177c73] Running command: RemoveImageCommand internal: true. Entities affected :  ID: 00000000-0000-0000-0000-000000000000 Type: Storage<br>
2016-01-26 15:00:44,869 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-46) [1a177c73] START, DeleteImageGroupVDSCommand( DeleteImageGroupVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;9a1bd54c-a55a-4edc-b1a4-0d6fcfed8bdc&#39;, postZeros=&#39;false&#39;, forceDelete=&#39;false&#39;}), log id: 475a2763<br>
2016-01-26 15:00:46,268 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-46) [1a177c73] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM command failed: Image does not exist in domain: u&#39;image=9a1bd54c-a55a-4edc-b1a4-0d6fcfed8bdc, domain=239c7309-7e4c-4545-8137-6bf1d43cad71&#39;<br>
2016-01-26 15:00:46,269 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-46) [1a177c73] Command &#39;DeleteImageGroupVDSCommand( DeleteImageGroupVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;9a1bd54c-a55a-4edc-b1a4-0d6fcfed8bdc&#39;, postZeros=&#39;false&#39;, forceDelete=&#39;false&#39;})&#39; execution failed: IRSGenericException: IRSErrorException: Image does not exist in domain: u&#39;image=9a1bd54c-a55a-4edc-b1a4-0d6fcfed8bdc, domain=239c7309-7e4c-4545-8137-6bf1d43cad71&#39;<br>
2016-01-26 15:00:46,269 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-46) [1a177c73] FINISH, DeleteImageGroupVDSCommand, log id: 475a2763<br>
2016-01-26 15:00:46,270 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-46) [1a177c73] Disk &#39;9a1bd54c-a55a-4edc-b1a4-0d6fcfed8bdc&#39; doesn&#39;t exist on storage domain &#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, rolling forward<br>
2016-01-26 15:00:46,476 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-46) [1a177c73] Removed task &#39;b4d1eaf2-6955-41cc-a813-39da5faeca41&#39; from DataBase<br>
2016-01-26 15:00:46,492 ERROR [org.ovirt.engine.core.bll.CopyImageGroupCommand] (org.ovirt.thread.pool-8-thread-46) [66941705] Ending command &#39;org.ovirt.engine.core.bll.CopyImageGroupCommand&#39; with failure.<br>
2016-01-26 15:00:46,502 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-46) [4a3987be] Running command: RemoveImageCommand internal: true. Entities affected :  ID: 00000000-0000-0000-0000-000000000000 Type: Storage<br>
2016-01-26 15:00:46,540 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-46) [4a3987be] START, DeleteImageGroupVDSCommand( DeleteImageGroupVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;b06a9ad5-62ca-478e-9f0c-278feca4eda3&#39;, postZeros=&#39;false&#39;, forceDelete=&#39;false&#39;}), log id: 5ec9b85c<br>
2016-01-26 15:00:47,792 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-46) [4a3987be] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM command failed: Image does not exist in domain: u&#39;image=b06a9ad5-62ca-478e-9f0c-278feca4eda3, domain=239c7309-7e4c-4545-8137-6bf1d43cad71&#39;<br>
2016-01-26 15:00:47,793 ERROR [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-46) [4a3987be] Command &#39;DeleteImageGroupVDSCommand( DeleteImageGroupVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, storageDomainId=&#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, imageGroupId=&#39;b06a9ad5-62ca-478e-9f0c-278feca4eda3&#39;, postZeros=&#39;false&#39;, forceDelete=&#39;false&#39;})&#39; execution failed: IRSGenericException: IRSErrorException: Image does not exist in domain: u&#39;image=b06a9ad5-62ca-478e-9f0c-278feca4eda3, domain=239c7309-7e4c-4545-8137-6bf1d43cad71&#39;<br>
2016-01-26 15:00:47,793 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.DeleteImageGroupVDSCommand] (org.ovirt.thread.pool-8-thread-46) [4a3987be] FINISH, DeleteImageGroupVDSCommand, log id: 5ec9b85c<br>
2016-01-26 15:00:47,793 INFO [org.ovirt.engine.core.bll.RemoveImageCommand] (org.ovirt.thread.pool-8-thread-46) [4a3987be] Disk &#39;b06a9ad5-62ca-478e-9f0c-278feca4eda3&#39; doesn&#39;t exist on storage domain &#39;239c7309-7e4c-4545-8137-6bf1d43cad71&#39;, rolling forward<br>
2016-01-26 15:00:47,953 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (org.ovirt.thread.pool-8-thread-46) [4a3987be] Removed task &#39;fb467301-4397-49db-a200-d623916c8f37&#39; from DataBase<br>
2016-01-26 15:00:48,037 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-46) [] Correlation ID: 30049735, Call Stack: null, Custom Event ID: -1, Message: Failed to complete VM test_clone creation.<br>
2016-01-26 15:00:48,037 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-46) [] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type &#39;AddVmFromSnapshot&#39; completed, handling the result.<br>
2016-01-26 15:00:48,037 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-46) [] CommandAsyncTask::HandleEndActionResult [within thread]: endAction for action type &#39;AddVmFromSnapshot&#39; succeeded, clearing tasks.<br>
2016-01-26 15:00:48,043 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-46) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task &#39;8347d2c2-1907-431c-baeb-b885ba6f200d&#39;<br>
2016-01-26 15:00:48,045 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-46) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, taskId=&#39;8347d2c2-1907-431c-baeb-b885ba6f200d&#39;}), log id: 29d50ec8<br>
2016-01-26 15:00:48,742 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-46) [] START, HSMClearTaskVDSCommand(HostName = kvm02, HSMTaskGuidBaseVDSCommandParameters:{runAsync=&#39;true&#39;, hostId=&#39;572aa833-37fb-4c4b-9576-9d367def2d04&#39;, taskId=&#39;8347d2c2-1907-431c-baeb-b885ba6f200d&#39;}), log id: 415f863f<br>
2016-01-26 15:00:49,762 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-46) [] FINISH, HSMClearTaskVDSCommand, log id: 415f863f<br>
2016-01-26 15:00:49,763 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-46) [] FINISH, SPMClearTaskVDSCommand, log id: 29d50ec8<br>
2016-01-26 15:00:49,769 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-46) [] BaseAsyncTask::removeTaskFromDB: Removed task &#39;8347d2c2-1907-431c-baeb-b885ba6f200d&#39; from DataBase<br>
2016-01-26 15:00:49,770 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-46) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task &#39;bf3ef9aa-5099-47b6-b954-9a6902eb17c9&#39;<br>
2016-01-26 15:00:49,771 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-46) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, taskId=&#39;bf3ef9aa-5099-47b6-b954-9a6902eb17c9&#39;}), log id: 543d8586<br>
2016-01-26 15:00:49,772 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-46) [] START, HSMClearTaskVDSCommand(HostName = kvm02, HSMTaskGuidBaseVDSCommandParameters:{runAsync=&#39;true&#39;, hostId=&#39;572aa833-37fb-4c4b-9576-9d367def2d04&#39;, taskId=&#39;bf3ef9aa-5099-47b6-b954-9a6902eb17c9&#39;}), log id: 35bd0ad7<br>
2016-01-26 15:00:50,792 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-46) [] FINISH, HSMClearTaskVDSCommand, log id: 35bd0ad7<br>
2016-01-26 15:00:50,793 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-46) [] FINISH, SPMClearTaskVDSCommand, log id: 543d8586<br>
2016-01-26 15:00:50,800 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-46) [] BaseAsyncTask::removeTaskFromDB: Removed task &#39;bf3ef9aa-5099-47b6-b954-9a6902eb17c9&#39; from DataBase<br>
2016-01-26 15:00:50,800 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-46) [] SPMAsyncTask::ClearAsyncTask: Attempting to clear task &#39;b910d97d-a091-4648-8840-e870651745c7&#39;<br>
2016-01-26 15:00:50,802 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-46) [] START, SPMClearTaskVDSCommand( SPMTaskGuidBaseVDSCommandParameters:{runAsync=&#39;true&#39;, storagePoolId=&#39;00000001-0001-0001-0001-000000000296&#39;, ignoreFailoverLimit=&#39;false&#39;, taskId=&#39;b910d97d-a091-4648-8840-e870651745c7&#39;}), log id: 1ded2669<br>
2016-01-26 15:00:50,803 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-46) [] START, HSMClearTaskVDSCommand(HostName = kvm02, HSMTaskGuidBaseVDSCommandParameters:{runAsync=&#39;true&#39;, hostId=&#39;572aa833-37fb-4c4b-9576-9d367def2d04&#39;, taskId=&#39;b910d97d-a091-4648-8840-e870651745c7&#39;}), log id: 60352414<br>
2016-01-26 15:00:51,824 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-46) [] FINISH, HSMClearTaskVDSCommand, log id: 60352414<br>
2016-01-26 15:00:51,824 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.SPMClearTaskVDSCommand] (org.ovirt.thread.pool-8-thread-46) [] FINISH, SPMClearTaskVDSCommand, log id: 1ded2669<br>
2016-01-26 15:00:51,847 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (org.ovirt.thread.pool-8-thread-46) [] BaseAsyncTask::removeTaskFromDB: Removed task &#39;b910d97d-a091-4648-8840-e870651745c7&#39; from DataBase<br>
2016-01-26 15:00:51,848 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (org.ovirt.thread.pool-8-thread-46) [] CommandAsyncTask::HandleEndActionResult [within thread]: Removing CommandMultiAsyncTasks object for entity &#39;aaac9162-4be3-473f-91f4-491c8eedb4ad&#39;<br>
<br>
<br>
_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
</blockquote></div>