<div dir="ltr">Hi,<div>I was able to resolve the issue by reinstalling the hosts via "Install/Reinstall" in the engine. I set the hosted engine to deploy, I did that on all three hosts and it seems to be working fine now.</div><div>Thanks<br><br><div class="gmail_quote"><div dir="ltr">On Wed, Feb 8, 2017 at 2:59 AM Yedidyah Bar David <<a href="mailto:didi@redhat.com">didi@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">On Wed, Feb 8, 2017 at 2:31 AM, Todd Punderson <<a href="mailto:punderstorm93@gmail.com" class="gmail_msg" target="_blank">punderstorm93@gmail.com</a>> wrote:<br class="gmail_msg">
> Seeing issues with my hosted engine, it seems it's unable to extract vm.conf<br class="gmail_msg">
> from storage. My ovirt-hosted-engine-ha/agent.log is full of this repeating<br class="gmail_msg">
> over and over. This is happening on all 3 of my hosts. My storage is<br class="gmail_msg">
> glusterfs on the hosts themselves.<br class="gmail_msg">
><br class="gmail_msg">
> Hopefully this is enough info to get started.<br class="gmail_msg">
><br class="gmail_msg">
> Thanks!<br class="gmail_msg">
><br class="gmail_msg">
> MainThread::INFO::2017-02-07<br class="gmail_msg">
> 19:27:33,063::hosted_engine::612::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_vdsm)<br class="gmail_msg">
> Initializing VDSM<br class="gmail_msg">
> MainThread::INFO::2017-02-07<br class="gmail_msg">
> 19:27:35,455::hosted_engine::639::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)<br class="gmail_msg">
> Connecting the storage<br class="gmail_msg">
> MainThread::INFO::2017-02-07<br class="gmail_msg">
> 19:27:35,456::storage_server::219::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)<br class="gmail_msg">
> Connecting storage server<br class="gmail_msg">
> MainThread::INFO::2017-02-07<br class="gmail_msg">
> 19:27:40,169::storage_server::226::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)<br class="gmail_msg">
> Connecting storage server<br class="gmail_msg">
> MainThread::INFO::2017-02-07<br class="gmail_msg">
> 19:27:40,202::storage_server::233::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server)<br class="gmail_msg">
> Refreshing the storage domain<br class="gmail_msg">
> MainThread::INFO::2017-02-07<br class="gmail_msg">
> 19:27:40,418::hosted_engine::666::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)<br class="gmail_msg">
> Preparing images<br class="gmail_msg">
> MainThread::INFO::2017-02-07<br class="gmail_msg">
> 19:27:40,419::image::126::ovirt_hosted_engine_ha.lib.image.Image::(prepare_images)<br class="gmail_msg">
> Preparing images<br class="gmail_msg">
> MainThread::INFO::2017-02-07<br class="gmail_msg">
> 19:27:43,370::hosted_engine::669::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_storage_images)<br class="gmail_msg">
> Reloading vm.conf from the shared storage domain<br class="gmail_msg">
> MainThread::INFO::2017-02-07<br class="gmail_msg">
> 19:27:43,371::config::206::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)<br class="gmail_msg">
> Trying to get a fresher copy of vm configuration from the OVF_STORE<br class="gmail_msg">
> MainThread::INFO::2017-02-07<br class="gmail_msg">
> 19:27:45,968::ovf_store::103::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan)<br class="gmail_msg">
> Found OVF_STORE: imgUUID:3e14c1b5-5ade-4827-aad4-66c59824acd2,<br class="gmail_msg">
> volUUID:3cbeeb3b-f755-4d42-a654-8dab34213792<br class="gmail_msg">
> MainThread::INFO::2017-02-07<br class="gmail_msg">
> 19:27:46,257::ovf_store::103::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(scan)<br class="gmail_msg">
> Found OVF_STORE: imgUUID:9b49968b-5a62-4ab2-a2c5-b94bc0b2d3ce,<br class="gmail_msg">
> volUUID:8f4d69c5-73a7-4e8c-a58f-909b55efec7d<br class="gmail_msg">
> MainThread::INFO::2017-02-07<br class="gmail_msg">
> 19:27:46,355::ovf_store::112::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)<br class="gmail_msg">
> Extracting Engine VM OVF from the OVF_STORE<br class="gmail_msg">
> MainThread::INFO::2017-02-07<br class="gmail_msg">
> 19:27:46,366::ovf_store::119::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)<br class="gmail_msg">
> OVF_STORE volume path:<br class="gmail_msg">
> /rhev/data-center/mnt/glusterSD/ovirt01-gluster.doonga.org:_engine/536cd721-4396-4029-b1ea-8ce84738137e/images/9b49968b-5a62-4ab2-a2c5-b94bc0b2d3ce/8f4d69c5-73a7-4e8c-a58f-909b55efec7d<br class="gmail_msg">
> MainThread::ERROR::2017-02-07<br class="gmail_msg">
> 19:27:46,389::ovf_store::124::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)<br class="gmail_msg">
> Unable to extract HEVM OVF<br class="gmail_msg">
> MainThread::ERROR::2017-02-07<br class="gmail_msg">
> 19:27:46,390::config::235::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine.config::(refresh_local_conf_file)<br class="gmail_msg">
> Unable to get vm.conf from OVF_STORE, falling back to initial vm.conf<br class="gmail_msg">
<br class="gmail_msg">
Can you please attach the output of:<br class="gmail_msg">
<br class="gmail_msg">
sudo -u vdsm dd<br class="gmail_msg">
if=/rhev/data-center/mnt/glusterSD/ovirt01-gluster.doonga.org:_engine/536cd721-4396-4029-b1ea-8ce84738137e/images/9b49968b-5a62-4ab2-a2c5-b94bc0b2d3ce/8f4d69c5-73a7-4e8c-a58f-909b55efec7d<br class="gmail_msg">
| tar -tvf -<br class="gmail_msg">
<br class="gmail_msg">
Thanks.<br class="gmail_msg">
<br class="gmail_msg">
Did everything work well in 4.0? How did you upgrade?<br class="gmail_msg">
<br class="gmail_msg">
Best,<br class="gmail_msg">
--<br class="gmail_msg">
Didi<br class="gmail_msg">
</blockquote></div></div></div>