4:39 p.m.
Hi,
I am encountering the following error every hour in the ovirt-engine.log file and I can
also see the same in the oVirt engine UI
---------------------------------------
2021-04-05 01:49:20,072-04 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-76) [7dd3eb3d] Command
'SetVolumeDescriptionVDSCommand(
SetVolumeDescriptionVDSCommandParameters:{storagePoolId='dfe84316-bbdb-11ea-beb6-00163e1ab088',
ignoreFailoverLimit='false',
storageDomainId='9ed31575-9cc4-4b05-a5d9-23d21d6e915e',
imageGroupId='2af73aad-5079-4583-824c-a93b20b93835',
imageId='ad5a523c-fdc1-49dd-900b-73f801564f1d'})' execution failed:
IRSGenericException: IRSErrorException: Failed to SetVolumeDescriptionVDS, error = Error
while updating volume meta data:
("(u'/rhev/data-center/mnt/glusterSD192.168.0.4:_data1/9ed31575-9cc4-4b05-a5d9-23d21d6e915e/images/2af73aad-5079-4583-824c-a93b20b93835/ad5a523c-fdc1-49dd-900b-73f801564f1d',)[Errno
17] File exists",), code = 208
2021-04-05 02:49:14,333-04 ERROR [org.ovirt.engine.core.bll.gluster.GlusterGeoRepSyncJob]
(DefaultQuartzScheduler3) [2bf694b9] VDS error Command execution failed: rc=2
out='geo-replication command failed\n' err=''
2021-04-05 02:49:20,332-04 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-5) [6b6dd1af] Command
'SetVolumeDescriptionVDSCommand(
SetVolumeDescriptionVDSCommandParameters:{storagePoolId='dfe84316-bbdb-11ea-beb6-00163e1ab088',
ignoreFailoverLimit='false',
storageDomainId='9ed31575-9cc4-4b05-a5d9-23d21d6e915e',
imageGroupId='2af73aad-5079-4583-824c-a93b20b93835',
imageId='ad5a523c-fdc1-49dd-900b-73f801564f1d'})' execution failed:
IRSGenericException: IRSErrorException: Failed to SetVolumeDescriptionVDS, error = Error
while updating volume meta data:
("(u'/rhev/data-center/mnt/glusterSD/192.168.0.4:_data1/9ed31575-9cc4-4b05-a5d9-23d21d6e915e/images/2af73aad-5079-4583-824c-a93b20b93835/ad5a523c-fdc1-49dd-900b-73f801564f1d',)[Errno
17] File exists",), code = 208
---------------------------------------
I looked up the mentioned error codes but not sure if these are the correct ones:
https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.3/...
---------------------------------------
17 > VDS_MAINTENANCE_FAILED > Error > Failed to switch Host ${VdsName} to
Maintenance mode.
208 > PROVIDER_UPDATE_FAILED > Error > Failed to update provider
${ProviderName}. (User: ${UserName})
---------------------------------------
From the Engine UI's event tab I can see:
---------------------------------------
Failed to update VMs/Templates OVF data for Storage Domain data1 in Data Center Default.
Failed to update OVF disks 2af73aad-5079-4583-824c-a93b20b93835, OVF data isn't
updated on those OVF stores (Data Center Default, Storage Domain data1).
VDSM command SetVolumeDescriptionVDS failed: Error while updating volume meta data:
("(u'/rhev/data-center/mnt/glusterSD/192.168.0.4:_data1/9ed31575-9cc4-4b05-a5d9-23d21d6e915e/images/2af73aad-5079-4583-824c-a93b20b93835/ad5a523c-fdc1-49dd-900b-73f801564f1d',)[Errno
17] File exists",)
---------------------------------------
I know the error belongs to the "data1" storage domain and this is a 12 node
Distributed Replicate volume (Replicat 3) HCI.
If I try to update the OVF using the UI I get the following log entries in the engine
---------------------------------------
2021-04-05 03:20:03,101-04 WARN [org.ovirt.engine.core.dal.job.ExecutionMessageDirector]
(default task-1183) [6761980f-dcf6-400e-bfd8-fd2c70e7569a] The message key
'UpdateOvfStoreForStorageDomain' is missing from
'bundles/ExecutionMessages'
2021-04-05 03:20:03,178-04 INFO
[org.ovirt.engine.core.bll.storage.domain.UpdateOvfStoreForStorageDomainCommand] (default
task-1183) [6761980f-dcf6-400e-bfd8-fd2c70e7569a] Lock Acquired to object
'EngineLock:{exclusiveLocks='[9ed31575-9cc4-4b05-a5d9-23d21d6e915e=STORAGE]',
sharedLocks=''}'
2021-04-05 03:20:03,204-04 INFO
[org.ovirt.engine.core.bll.storage.domain.UpdateOvfStoreForStorageDomainCommand] (default
task-1183) [6761980f-dcf6-400e-bfd8-fd2c70e7569a] Running command:
UpdateOvfStoreForStorageDomainCommand internal: false. Entities affected : ID:
9ed31575-9cc4-4b05-a5d9-23d21d6e915e Type: StorageAction group MANIPULATE_STORAGE_DOMAIN
with role type ADMIN
2021-04-05 03:20:03,505-04 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-62) [13f4ac4f] Failed in
'SetVolumeDescriptionVDS' method
2021-04-05 03:20:03,512-04 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engineScheduled-Thread-62) [13f4ac4f] EVENT_ID:
IRS_BROKER_COMMAND_FAILURE(10,803), VDSM command SetVolumeDescriptionVDS failed: Error
while updating volume meta data:
("(u'/rhev/data-center/mnt/glusterSD/192.168.0.4:_data1/9ed31575-9cc4-4b05-a5d9-23d21d6e915e/images/2af73aad-5079-4583-824c-a93b20b93835/ad5a523c-fdc1-49dd-900b-73f801564f1d',)[Errno
17] File exists",)
2021-04-05 03:20:03,513-04 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.SetVolumeDescriptionVDSCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-62) [13f4ac4f] Command
'SetVolumeDescriptionVDSCommand(
SetVolumeDescriptionVDSCommandParameters:{storagePoolId='dfe84316-bbdb-11ea-beb6-00163e1ab088',
ignoreFailoverLimit='false',
storageDomainId='9ed31575-9cc4-4b05-a5d9-23d21d6e915e',
imageGroupId='2af73aad-5079-4583-824c-a93b20b93835',
imageId='ad5a523c-fdc1-49dd-900b-73f801564f1d'})' execution failed:
IRSGenericException: IRSErrorException: Failed to SetVolumeDescriptionVDS, error = Error
while updating volume meta data:
("(u'/rhev/data-center/mnt/glusterSD/192.168.0.4:_data1/9ed31575-9cc4-4b05-a5d9-23d21d6e915e/images/2af73aad-5079-4583-824c-a93b20b93835/ad5a523c-fdc1-49dd-900b-73f801564f1d',)[Errno
17] File exists",), code = 208
2021-04-05 03:20:03,538-04 WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engineScheduled-Thread-62) [13f4ac4f] EVENT_ID:
UPDATE_FOR_OVF_STORES_FAILED(1,016), Failed to update OVF disks
2af73aad-5079-4583-824c-a93b20b93835, OVF data isn't updated on those OVF stores (Data
Center Default, Storage Domain data1).
2021-04-05 03:20:03,513-04 WARN
[org.ovirt.engine.core.bll.storage.ovfstore.ProcessOvfUpdateForStorageDomainCommand]
(EE-ManagedThreadFactory-engineScheduled-Thread-62) [13f4ac4f] failed to update domain
'9ed31575-9cc4-4b05-a5d9-23d21d6e915e' ovf store disk
'2af73aad-5079-4583-824c-a93b20b93835'
2021-04-05 03:20:03,558-04 WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engineScheduled-Thread-62) [13f4ac4f] EVENT_ID:
UPDATE_OVF_FOR_STORAGE_DOMAIN_FAILED(190), Failed to update VMs/Templates OVF data for
Storage Domain data1 in Data Center Default.
---------------------------------------
Any ideas on how to overcome this issue?
Thanks,
Adrian