[ovirt-users] hosted engine won't come up

Nir Soffer nsoffer at redhat.com
Tue Apr 26 14:43:54 UTC 2016


On Tue, Apr 26, 2016 at 1:33 AM, Pat Riehecky <riehecky at fnal.gov> wrote:
> I've just done a clean install of the 3.6 hosted engine (decided to wipe out
> my previous system)
>
> The install went in just fine, no errors I saw, but I'm getting interesting
> errors in the ovirt-hosted-engine-ha agent.log
>
> I have no idea what to do about these errors....
>
> -----
> MainThread::INFO::2016-04-25
> 22:28:33,842::hosted_engine::462::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
> Current state EngineUp (score: 3400)
> MainThread::INFO::2016-04-25
> 22:28:43,896::hosted_engine::613::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_vdsm)
> Initializing VDSM
> MainThread::INFO::2016-04-25
> 22:28:43,953::hosted_engine::658::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
> Connecting the storage
> MainThread::INFO::2016-04-25
> 22:28:43,954::storage_server::207::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Connecting storage server
> MainThread::INFO::2016-04-25
> 22:28:43,954::storage_server::219::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Refreshing the storage domain
> MainThread::INFO::2016-04-25
> 22:28:44,064::hosted_engine::685::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
> Preparing images
> MainThread::INFO::2016-04-25
> 22:28:44,064::image::126::ovirt_hosted_engine_ha.lib.image.Image::(prepare_images)
> Preparing images
> MainThread::INFO::2016-04-25
> 22:28:45,070::hosted_engine::688::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
> Reloading vm.conf from the shared storage domain
> MainThread::INFO::2016-04-25
> 22:28:45,071::config::205::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
> Trying to get a fresher copy of vm configuration from the OVF_STORE
> MainThread::WARNING::2016-04-25
> 22:28:45,658::ovf_store::104::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan)
> Unable to find OVF_STORE
> MainThread::ERROR::2016-04-25
> 22:28:45,658::config::234::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
> Unable to get vm.conf from OVF_STORE, falling back to initial vm.conf
> MainThread::INFO::2016-04-25
> 22:28:45,744::hosted_engine::462::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
> Current state EngineUp (score: 3400)
> MainThread::INFO::2016-04-25
> 22:28:55,796::hosted_engine::613::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_vdsm)
> Initializing VDSM
> MainThread::INFO::2016-04-25
> 22:28:55,855::hosted_engine::658::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
> Connecting the storage
> MainThread::INFO::2016-04-25
> 22:28:55,856::storage_server::207::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Connecting storage server
> MainThread::INFO::2016-04-25
> 22:28:55,856::storage_server::219::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Refreshing the storage domain
> MainThread::INFO::2016-04-25
> 22:28:55,967::hosted_engine::685::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
> Preparing images
> MainThread::INFO::2016-04-25
> 22:28:55,967::image::126::ovirt_hosted_engine_ha.lib.image.Image::(prepare_images)
> Preparing images
> MainThread::INFO::2016-04-25
> 22:28:56,987::hosted_engine::688::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
> Reloading vm.conf from the shared storage domain
> MainThread::INFO::2016-04-25
> 22:28:56,988::config::205::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
> Trying to get a fresher copy of vm configuration from the OVF_STORE
> MainThread::WARNING::2016-04-25
> 22:28:57,572::ovf_store::104::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan)
> Unable to find OVF_STORE
> MainThread::ERROR::2016-04-25
> 22:28:57,573::config::234::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
> Unable to get vm.conf from OVF_STORE, falling back to initial vm.conf
> MainThread::INFO::2016-04-25
> 22:28:57,661::hosted_engine::462::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(start_monitoring)
> Current state EngineUp (score: 3400)
> MainThread::INFO::2016-04-25
> 22:29:07,711::states::421::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(consume)
> Engine vm running on localhost
> MainThread::INFO::2016-04-25
> 22:29:07,716::hosted_engine::613::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_vdsm)
> Initializing VDSM
> MainThread::INFO::2016-04-25
> 22:29:07,774::hosted_engine::658::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
> Connecting the storage
> MainThread::INFO::2016-04-25
> 22:29:07,774::storage_server::207::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Connecting storage server
> MainThread::INFO::2016-04-25
> 22:29:07,775::storage_server::219::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)
> Refreshing the storage domain
> MainThread::INFO::2016-04-25
> 22:29:07,883::hosted_engine::685::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
> Preparing images
> MainThread::INFO::2016-04-25
> 22:29:07,883::image::126::ovirt_hosted_engine_ha.lib.image.Image::(prepare_images)
> Preparing images
> MainThread::INFO::2016-04-25
> 22:29:08,893::hosted_engine::688::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)
> Reloading vm.conf from the shared storage domain
> MainThread::INFO::2016-04-25
> 22:29:08,894::config::205::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
> Trying to get a fresher copy of vm configuration from the OVF_STORE
> MainThread::WARNING::2016-04-25
> 22:29:09,486::ovf_store::104::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan)
> Unable to find OVF_STORE
> MainThread::ERROR::2016-04-25
> 22:29:09,486::config::234::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)
> Unable to get vm.conf from OVF_STORE, falling back to initial vm.conf
> -----
>
> # vdsClient -s 0 getStorageDomainsList
> 81f19871-4d91-4698-a97d-36452bfae281
> # vgdisplay
>   WARNING: duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy is being used from
> both devices /dev/mapper/36000402001f45bbe7eecc5f800000000 and /dev/sdh
>   Found duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy: using
> /dev/mapper/36000402001f45bbe7eecc5f800000000 not /dev/sdh
>   Using duplicate PV /dev/mapper/36000402001f45bbe7eecc5f800000000 from
> subsystem DM, ignoring /dev/sdh

According to Zdenek, this looks like major configuration issue.

Can you share the output of:

lsblk
pvscan --cache
pvs -vvvv

We see similar errors in this bug:
https://bugzilla.redhat.com/show_bug.cgi?id=1303940

Nir

>   WARNING: duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy is being used from
> both devices /dev/mapper/36000402001f45bbe7eecc5f800000000 and /dev/sdg
>   Found duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy: using
> /dev/mapper/36000402001f45bbe7eecc5f800000000 not /dev/sdg
>   Using duplicate PV /dev/mapper/36000402001f45bbe7eecc5f800000000 from
> subsystem DM, ignoring /dev/sdg
>   WARNING: duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy is being used from
> both devices /dev/mapper/36000402001f45bbe7eecc5f800000000 and /dev/sdd
>   Found duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy: using
> /dev/mapper/36000402001f45bbe7eecc5f800000000 not /dev/sdd
>   Using duplicate PV /dev/mapper/36000402001f45bbe7eecc5f800000000 from
> subsystem DM, ignoring /dev/sdd
>   WARNING: duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy is being used from
> both devices /dev/mapper/36000402001f45bbe7eecc5f800000000 and /dev/sdc
>   Found duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy: using
> /dev/mapper/36000402001f45bbe7eecc5f800000000 not /dev/sdc
>   Using duplicate PV /dev/mapper/36000402001f45bbe7eecc5f800000000 from
> subsystem DM, ignoring /dev/sdc
>   --- Volume group ---
>   VG Name               81f19871-4d91-4698-a97d-36452bfae281
>   System ID
>   Format                lvm2
>   Metadata Areas        2
>   Metadata Sequence No  23
>   VG Access             read/write
>   VG Status             resizable
>   MAX LV                0
>   Cur LV                10
>   Open LV               3
>   Max PV                0
>   Cur PV                1
>   Act PV                1
>   VG Size               60.00 GiB
>   PE Size               128.00 MiB
>   Total PE              480
>   Alloc PE / Size       441 / 55.12 GiB
>   Free  PE / Size       39 / 4.88 GiB
>   VG UUID               3M7kuh-FjyR-WMPL-ztl0-h1cK-EwQb-32ASCD
> # lvs
>   WARNING: duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy is being used from
> both devices /dev/mapper/36000402001f45bbe7eecc5f800000000 and /dev/sdh
>   Found duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy: using
> /dev/mapper/36000402001f45bbe7eecc5f800000000 not /dev/sdh
>   Using duplicate PV /dev/mapper/36000402001f45bbe7eecc5f800000000 from
> subsystem DM, ignoring /dev/sdh
>   WARNING: duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy is being used from
> both devices /dev/mapper/36000402001f45bbe7eecc5f800000000 and /dev/sdg
>   Found duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy: using
> /dev/mapper/36000402001f45bbe7eecc5f800000000 not /dev/sdg
>   Using duplicate PV /dev/mapper/36000402001f45bbe7eecc5f800000000 from
> subsystem DM, ignoring /dev/sdg
>   WARNING: duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy is being used from
> both devices /dev/mapper/36000402001f45bbe7eecc5f800000000 and /dev/sdd
>   Found duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy: using
> /dev/mapper/36000402001f45bbe7eecc5f800000000 not /dev/sdd
>   Using duplicate PV /dev/mapper/36000402001f45bbe7eecc5f800000000 from
> subsystem DM, ignoring /dev/sdd
>   WARNING: duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy is being used from
> both devices /dev/mapper/36000402001f45bbe7eecc5f800000000 and /dev/sdc
>   Found duplicate PV xpHUtx05gHRcq1U33Mu1NMGLXVOtqnmy: using
> /dev/mapper/36000402001f45bbe7eecc5f800000000 not /dev/sdc
>   Using duplicate PV /dev/mapper/36000402001f45bbe7eecc5f800000000 from
> subsystem DM, ignoring /dev/sdc
>   LV VG                                   Attr       LSize   Pool Origin
> Data%  Meta%  Move Log Cpy%Sync Convert
>   0593a3b8-1d75-4be3-b65b-ce9a164d0309 81f19871-4d91-4698-a97d-36452bfae281
> -wi-ao---- 128.00m
>   07c72aa5-7fd0-4159-b83e-4d078ae9c351 81f19871-4d91-4698-a97d-36452bfae281
> -wi-a----- 1.00g
>   93cf12c5-d5e6-4ea6-bee7-de64ee52d7a5 81f19871-4d91-4698-a97d-36452bfae281
> -wi-a----- 128.00m
>   c4244bdd-80c5-4f68-83c2-9494d9d05723 81f19871-4d91-4698-a97d-36452bfae281
> -wi-ao---- 50.00g
>   ids 81f19871-4d91-4698-a97d-36452bfae281 -wi-ao---- 128.00m
>   inbox 81f19871-4d91-4698-a97d-36452bfae281 -wi-a----- 128.00m
>   leases 81f19871-4d91-4698-a97d-36452bfae281 -wi-a----- 2.00g
>   master 81f19871-4d91-4698-a97d-36452bfae281 -wi-a----- 1.00g
>   metadata 81f19871-4d91-4698-a97d-36452bfae281 -wi-a----- 512.00m
>   outbox 81f19871-4d91-4698-a97d-36452bfae281 -wi-a----- 128.00m
> # rpm -qa |grep ovirt
> ovirt-engine-sdk-python-3.6.3.0-1.el7
> ovirt-vmconsole-1.0.0-1.el7
> ovirt-vmconsole-host-1.0.0-1.el7
> libgovirt-0.3.3-1.el7_2.1
> ovirt-setup-lib-1.0.1-1.el7
> ovirt-hosted-engine-setup-1.3.4.0-1.el7
> ovirt-host-deploy-1.4.1-1.el7
> ovirt-hosted-engine-ha-1.3.5.1-1.el7
> # rpm -qa |grep vdsm
> vdsm-jsonrpc-4.17.23.2-0.el7
> vdsm-4.17.23.2-0.el7
> vdsm-python-4.17.23.2-0.el7
> vdsm-xmlrpc-4.17.23.2-0.el7
> vdsm-yajsonrpc-4.17.23.2-0.el7
> vdsm-hook-vmfex-dev-4.17.23.2-0.el7
> vdsm-cli-4.17.23.2-0.el7
> vdsm-infra-4.17.23.2-0.el7
>
>
> --
> Pat Riehecky
> Scientific Linux developer
>
> Fermi National Accelerator Laboratory
> www.fnal.gov
> www.scientificlinux.org
>
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users



More information about the Users mailing list