[ovirt-users] The Hosted Engine Storage Domain doesn't exist. It should be imported into the setup.

Sun Mar 19 10:55:38 UTC 2017

On Sat, Mar 18, 2017 at 12:25 PM, Paolo Margara <paolo.margara at polito.it> wrote:
> Hi list,
>
> I'm working on a system running on oVirt 3.6 and the Engine is reporting
> the warning "The Hosted Engine Storage Domain doesn't exist. It should
> be imported into the setup." repeatedly in the Events tab into the Admin
> Portal.
>
> I've read into the list that Hosted Engine Storage Domain should be
> imported automatically into the setup during the upgrade to 3.6
> (original setup was on 3.5), but this not happened while the
> HostedEngine is correctly visible into the VM tab after the upgrade.

Was the upgrade to 3.6 successful and clean?

>
> The Hosted Engine Storage Domain is on a dedicated gluster volume but
> considering that, if I remember correctly, oVirt 3.5 at that time did
> not support gluster as a backend for the HostedEngine at that time I had
> installed the engine using gluster's NFS server using
> 'localhost:/hosted-engine' as a mount point.
>
> Currently on every nodes I can read into the log of the
> ovirt-hosted-engine-ha agent the following lines:
>
> MainThread::INFO::2017-03-17
> 14:04:17,773::hosted_engine::462::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
> Current state EngineUp (score: 3400)
> MainThread::INFO::2017-03-17
> 14:04:17,774::hosted_engine::467::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
> Best remote host virtnode-0-1 (id: 2
> , score: 3400)
> MainThread::INFO::2017-03-17
> 14:04:27,956::hosted_engine::613::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_vdsm)
> Initializing VDSM
> MainThread::INFO::2017-03-17
> 14:04:28,055::hosted_engine::658::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
> Connecting the storage
> MainThread::INFO::2017-03-17
> 14:04:28,078::storage_server::218::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Connecting storage server
> MainThread::INFO::2017-03-17
> 14:04:28,278::storage_server::222::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Connecting storage server
> MainThread::INFO::2017-03-17
> 14:04:28,398::storage_server::230::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Refreshing the storage domain
> MainThread::INFO::2017-03-17
> 14:04:28,822::hosted_engine::685::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
> Preparing images
> MainThread::INFO::2017-03-17
> 14:04:28,822::image::126::ovirt_hosted_engine_ha.lib.image.Image::(prepare_images)
> Preparing images
> MainThread::INFO::2017-03-17
> 14:04:29,308::hosted_engine::688::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
> Reloading vm.conf from the
>  shared storage domain
> MainThread::INFO::2017-03-17
> 14:04:29,309::config::206::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
> Trying to get a fresher copy
> of vm configuration from the OVF_STORE
> MainThread::WARNING::2017-03-17
> 14:04:29,567::ovf_store::104::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan)
> Unable to find OVF_STORE
> MainThread::ERROR::2017-03-17
> 14:04:29,691::config::235::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
> Unable to get vm.conf from O
> VF_STORE, falling back to initial vm.conf

This is normal at your current state.

>
> ...and the following lines into the logfile engine.log inside the Hosted
> Engine:
>
> 2017-03-16 07:36:28,087 INFO
> [org.ovirt.engine.core.bll.ImportHostedEngineStorageDomainCommand]
> (org.ovirt.thread.pool-8-thread-38) [236d315c] Lock Acquired to object
> 'EngineLock:{exclusiveLocks='[]', sharedLocks='null'}'
> 2017-03-16 07:36:28,115 WARN
> [org.ovirt.engine.core.bll.ImportHostedEngineStorageDomainCommand]
> (org.ovirt.thread.pool-8-thread-38) [236d315c] CanDoAction of action
> 'ImportHostedEngineStorageDomain' failed for user SYSTEM. Reasons:
> VAR__ACTION__ADD,VAR__TYPE__STORAGE__DOMAIN,ACTION_TYPE_FAILED_STORAGE_DOMAIN_NOT_EXIST

That's the thing to debug. Did you check vdsm logs on the hosts, near
the time this happens?

> 2017-03-16 07:36:28,116 INFO
> [org.ovirt.engine.core.bll.ImportHostedEngineStorageDomainCommand]
> (org.ovirt.thread.pool-8-thread-38) [236d315c] Lock freed to object
> 'EngineLock:{exclusiveLocks='[]', sharedLocks='null'}'
>
> How can I safely import the Hosted Engine Storage Domain into my setup?
> In this situation is safe to upgrade to oVirt 4.0?

I'd first try to solve this.

What OS do you have on your hosts? Are they all upgraded to 3.6?