[ovirt-users] Snapshot deletion failure

[Nir Soffer]

On Fri, Jun 24, 2016 at 11:39 AM, Vinzenz Feenstra <vfeenstr at redhat.com> wrote:
>
>> On Jun 24, 2016, at 9:10 AM, nicolas at devels.es wrote:
>>
>> Hi,
>>
>> We're trying to delete an auto-generated live snapshot that has been created after migrating an online VM's storage to a different domain. oVirt version is 3.6.6 and VDSM version is 4.17.28. Most relevant log lines are:
>>
>>    2016-06-24 07:50:36,252 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MergeVDSCommand] (pool-7-thread-10) [799a22e3] Failed in 'MergeVDS' method
>>    2016-06-24 07:50:36,256 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (pool-7-thread-10) [799a22e3] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM host2.domain.com command failed: Merge failed
>>    2016-06-24 07:50:36,256 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.MergeVDSCommand] (pool-7-thread-10) [799a22e3] Command 'MergeVDSCommand(HostName = host2.domain.com, MergeVDSCommandParameters:{runAsync='true', hostId='c31dca1a-e5bc-43f6-940f-6397e3ddbee4', vmId='7083832a-a1a2-42b7-961f-2e9c0dcd7e18', storagePoolId='fa155d43-4e68-486f-9f9d-ae3e3916cc4f', storageDomainId='9339780c-3667-4fef-aa13-9bec08957c5f', imageGroupId='65a0b0d4-5c96-4dd9-a31b-4d08e40a46a5', imageId='9eec9e8f-38db-4abf-b1c4-92fa9383f8b1', baseImageId='568b2f77-0ddf-4349-a45c-36fcb0edecb6', topImageId='9eec9e8f-38db-4abf-b1c4-92fa9383f8b1', bandwidth='0'})' execution failed: VDSGenericException: VDSErrorException: Failed to MergeVDS, error = Merge failed, code = 52
>>    2016-06-24 07:50:36,256 ERROR [org.ovirt.engine.core.bll.MergeCommand] (pool-7-thread-10) [799a22e3] Engine exception thrown while sending merge command: org.ovirt.engine.core.common.errors.EngineException: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to MergeVDS, error = Merge failed, code = 52 (Failed with error mergeErr and code 52)
>>
>> I'm attaching relevant logs (both for ovirt-engine and SPM's vdsm).
>>
>> What could be the reason for this error?
>
> @Nir,
>
> that looks like some issue in VDSM please have a look
>
> jsonrpc.Executor/3::ERROR::2016-06-24 07:50:36,216::vm::4955::virt.vm::(merge) vmId=`7083832a-a1a2-42b7-961f-2e9c0dcd7e18`::Live merge failed (job: 3ea68e36-6d99-4af9-a54e-4c5b06df6a0f)
> Traceback (most recent call last):
>   File "/usr/share/vdsm/virt/vm.py", line 4951, in merge
>     flags)
>   File "/usr/share/vdsm/virt/virdomain.py", line 68, in f
>     ret = attr(*args, **kwargs)
>   File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 124, in wrapper
>     ret = f(*args, **kwargs)
>   File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 1313, in wrapper
>     return func(inst, *args, **kwargs)
>   File "/usr/lib64/python2.7/site-packages/libvirt.py", line 668, in blockCommit
>     if ret == -1: raise libvirtError ('virDomainBlockCommit() failed', dom=self)
> libvirtError: block copy still active: disk 'vda' already in active block job

This means there was a previous attempt to merge, and the block job
did not complete yet.

Engine should detect that there is an active block job and wait until
it completes.

This is probably engine bug, please file a bug and attach complete vdsm and
engine logs.

Ala, can you look at this?

Nir