Hi,

 

I have been trying to get a backup solution working for my VM’s, and have somehow managed to break the snapshot on one of my VM’s. I’m still fairly new to oVirt, we’re migrating from VMware. I have had this cluster running since May.

 

The cluster:

We are running oVirt on CentOS 7, with Hosted Engine.

oVirt 4.3.5.4-1.el7 (according to the Help->About in the Admin Console)

Hardware is 5 x Dell M620 Blades (300Gb internal storage for host OS) with ISCSI storage for the VM’s (Dell M3660i), 10GB Network throughout.

 

The VM in question is allocated 50Gb  of storage and there is 461GB free in the storage domain.

 

So I’ve been playing with bareos 18.2.5 with the ovirt plugin found here https://github.com/eurotux/bareos-contrib/tree/master/fd-plugins/ovirt-plugin

 

I got bareos hooked up to ovirt. It created a snapshot, downloaded it, then at the end it failed to remove the snapshot. I though it may have been because I was looking round bareos while it was doing the backup. Went into oVirt deleted the snapshot no issues. Re ran the backup job in bareos, leaving bareos alone this time. The backup job failed again being unable to remove the snapshot. So I figured I’d go in and delete it, but I get an error saying “Cannot remove Snapshot: The following disks are locked: VM-NAME_vmdisk1. Please try again in a few minutes.”. In the Admin console if I expand the disks on the snapshot it shows that the image is locked. And before you ask the bareos user is setup as a SuperUser. If I go to the Events from the menu on the left of the admin console I can see that (Sorry Names/IP’s changed to protect the guilty):

 

Sep 10, 2019, 10:42:39 AM Image Download with disk VM-NAME_vmdisk1 succeeded.

Sep 10, 2019, 10:42:38 AM VDSM hyper2 command TeardownImageVDS failed: Cannot deactivate Logical Volume: ('General Storage Exception: ("5 [] [\'  Logical volume 46a9dfd4-4871-46b2-a740-8fe430c70b4b/bbe315b9-e797-4cf8-b18b-6afeb33589cc in use.\', \'  Logical volume 46a9dfd4-4871-46b2-a740-8fe430c70b4b/d3dfa2c2-45fa-4081-98c5-890dd7a5990a in use.\']\\n46a9dfd4-4871-46b2-a740-8fe430c70b4b/[\'bbe315b9-e797-4cf8-b18b-6afeb33589cc\', \'d3dfa2c2-45fa-4081-98c5-890dd7a5990a\']",)',)

Sep 10, 2019, 10:22:09 AM Image Download with disk VM-NAME_vmdisk1 was initiated by bareos@internal-authz.

Sep 10, 2019, 10:21:55 AM Snapshot 'VM-NAME-backup-1f952494-8245-479e-8d1d-9503d6fe8f9f' creation for VM 'VM-NAME' has been completed.

Sep 10, 2019, 10:21:36 AM Snapshot 'VM-NAME-backup-1f952494-8245-479e-8d1d-9503d6fe8f9f' creation for VM 'VM-NAME' was initiated by bareos@internal-authz.

Sep 10, 2019, 10:21:36 AM Backup of virtual machine 'VM-NAME using snapshot 'VM-NAME-backup-1f952494-8245-479e-8d1d-9503d6fe8f9f' is starting.

Sep 10, 2019, 10:21:36 AM User bareos@internal-authz connecting from '10.*******' using session '****************' logged in.

 

 

To me it looks like bareos tried to delete the snapshot whilst it was still downloading it, which failed as expected.

 

Does anyone know how to fix/recover from this?

 

If you need log files, please could you tell me which ones?

 

Regards,

 

Peter Smith