New subject: Failed to import the Hosted Engine Storage Domain

Saturday, 7 January 2023

Hi,

the following error message is periodically logged to engine.log when 
oVirt tries to import the Hosted Engine Storage Domain (NFS):

Validation of action 'AddExistingFileStorageDomain' failed for user 
SYSTEM. Reasons: 
VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__ADD,ERROR_CANNOT_ADD_EXISTING_STORAGE_DOMAIN_CONNECTION_DATA_ILLEGAL

I've redeployed my Engine VM while upgrading to oVirt 4.5. 
Unfortunately, the Engine VM and Hosted Engine Storage Domain are both 
missing from the oVirt GUI and oVirt is unable to import them 
apparently. (FWIW, there are several other Storage Domains already 
configured that work perfectly fine.)

Is there any way to manually add the Hosted Engine Storage Domain?
I'm also fine with adding the entry manually to the PostgreSQL database 
if this would be feasible. (Just point me to the right direction so I 
don't mess up my oVirt setup.)

Below are some log messages and errors I've collected from vdsm.log and 
engine.log.

vdsm.log

2023-01-06 21:15:10,803+0100 INFO  (jsonrpc/0) [vdsm.api] FINISH 
getStorageDomainInfo return={'info': {'uuid': 
'49d7aab9-1e45-4ef0-9657-1247983f129e', 'type': 'NFS',
'class': 'Data', 
'name': 'hosted_storage', 'role': 'Master',
'pool': 
['c87a1ad0-8dcd-11ed-b48a-00163e352102'], 'version': '5',
'block_size': 
512, 'alignment': 1048576, 'remotePath': 
'10.1.2.3:/mnt/vol2/vm/engine'}} from=::ffff:192.168.0.30,43146, 
flow_id=4ba364c1, task_id=43840eb6-8b9e-4637-bd0f-261a899d374e (api:37)

engine.log

2023-01-06 21:16:28,042+01 INFO  
[org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] 
(EE-ManagedThreadFactory-engine-Thread-1342) [] FINISH, 
HSMGetStorageDomainInfoVDSCommand, return: 
<StorageDomainStatic:{name='hosted_storage', 
id='49d7aab9-1e45-4ef0-9657-1247983f129e'}, 
c87a1ad0-8dcd-11ed-b48a-00163e352102>, log id: 5344c976
2023-01-06 21:16:28,046+01 INFO  
[org.ovirt.engine.core.bll.storage.domain.ImportHostedEngineStorageDomainCommand] 
(EE-ManagedThreadFactory-engine-Thread-1342) [1728fc85] Running command: 
ImportHostedEngineStorageDomainCommand internal: true.
2023-01-06 21:16:28,086+01 INFO  
[org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] 
(EE-ManagedThreadFactory-engine-Thread-1342) [1d6e287c] START, 
HSMGetStorageDomainInfoVDSCommand(HostName = hv05.example.com, 
HSMGetStorageDomainInfoVDSCommandParameters:{hostId='4fa6fe39-9254-4264-8a57-4b0a29c645e7',

storageDomainId='49d7aab9-1e45-4ef0-9657-1247983f129e'}), log id: 
759c4a73
2023-01-06 21:16:28,095+01 INFO  
[org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetStorageDomainInfoVDSCommand] 
(EE-ManagedThreadFactory-engine-Thread-1342) [1d6e287c] FINISH, 
HSMGetStorageDomainInfoVDSCommand, return: 
<StorageDomainStatic:{name='hosted_storage', 
id='49d7aab9-1e45-4ef0-9657-1247983f129e'}, 
c87a1ad0-8dcd-11ed-b48a-00163e352102>, log id: 759c4a73
2023-01-06 21:16:28,095+01 WARN  
[org.ovirt.engine.core.bll.storage.domain.AddExistingFileStorageDomainCommand] 
(EE-ManagedThreadFactory-engine-Thread-1342) [1d6e287c] Validation of 
action 'AddExistingFileStorageDomain' failed for user SYSTEM. Reasons: 
VAR__TYPE__STORAGE__DOMAIN,VAR__ACTION__ADD,ERROR_CANNOT_ADD_EXISTING_STORAGE_DOMAIN_CONNECTION_DATA_ILLEGAL
2023-01-06 21:16:28,096+01 INFO  
[org.ovirt.engine.core.bll.storage.domain.AddExistingFileStorageDomainCommand] 
(EE-ManagedThreadFactory-engine-Thread-1342) [1d6e287c] Lock freed to 
object 
'EngineLock:{exclusiveLocks='[49d7aab9-1e45-4ef0-9657-1247983f129e=STORAGE]',

sharedLocks=''}'
2023-01-06 21:16:28,097+01 INFO  
[org.ovirt.engine.core.bll.CommandCompensator] 
(EE-ManagedThreadFactory-engine-Thread-1342) [1d6e287c] Command 
[id=b0a331fe-5ad5-40b0-b7ce-2d01d0276e4b]: Compensating 
DELETED_OR_UPDATED_ENTITY of 
org.ovirt.engine.core.common.businessentities.StorageServerConnections; 
snapshot: id=c346dafe-09db-4058-ae1c-9b609911a1af.
2023-01-06 21:16:28,100+01 ERROR 
[org.ovirt.engine.core.bll.storage.domain.ImportHostedEngineStorageDomainCommand] 
(EE-ManagedThreadFactory-engine-Thread-1342) [1d6e287c] Transaction 
rolled-back for command 
'org.ovirt.engine.core.bll.storage.domain.ImportHostedEngineStorageDomainCommand'.

The (new) Engine VM is running on CentOS Stream 8 (using the Engine 
Appliance from the rpm) and all oVirt nodes/hosts are running on CentOS 
Stream 9.

Ciao
- Frank

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

Failed to import the Hosted Engine Storage Domain