8:39 a.m.
This is a multi-part message in MIME format.
--------------DB00ED00F6B934BF3B5014CE
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
On 11/24/2016 06:56 PM, Simone Tiraboschi wrote:
On Thu, Nov 24, 2016 at 2:08 PM, knarra <knarra(a)redhat.com
<mailto:knarra@redhat.com>> wrote:
On 11/24/2016 06:15 PM, Simone Tiraboschi wrote:
>
>
> On Thu, Nov 24, 2016 at 1:26 PM, knarra <knarra(a)redhat.com
> <mailto:knarra@redhat.com>> wrote:
>
> Hi,
>
> I have three nodes with glusterfs as storage domain. For
> some reason i see that vm.conf from
> /var/run/ovirt-hosted-engine-ha is missing and due to this on
> one of my host i see that Hosted Engine HA : Not Active. Once
> i copy the file from some other node and restart
> ovirt-ha-broker and ovirt-ha-agent services everything works
> fine. But then this happens again. Can some please help me
> identify why this happens. Below is the log i see in
> ovirt-ha-agent.logs.
>
>
> https://paste.fedoraproject.org/489120/79990345/
> <https://paste.fedoraproject.org/489120/79990345/>
>
>
> Once the engine correctly imported the hosted-engine storage
> domain, a couple of OVF_STORE volumes will appear there.
> Every modification to the engine VM configuration will be written
> by the engine into that OVF_STORE, so all the ovirt-ha-agent
> running on the hosted-engine hosts will be able to re-start the
> engine VM with a coherent configuration.
>
> Till the engine imports the hosted-engine storage domain,
> ovirt-ha-agent will fall back to the initial vm.conf.
>
> In you case the OVF_STORE volume is there,
> but the agent fails extracting the engine VM configuration:
> MainThread::INFO::2016-11-24
>
17:55:04,914::ovf_store::112::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
> Extracting Engine VM OVF from the OVF_STORE
> MainThread::INFO::2016-11-24
>
17:55:04,919::ovf_store::119::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
> OVF_STORE volume path:
>
/rhev/data-center/mnt/glusterSD/10.70.36.79:_engine/27f054c3-c245-4039-b42a-c28b37043016/images/fdf49778-9a06-49c6-bf7a-a0f12425911c/8c954add-6bcf-47f8-ac2e-4c85fc3f8699
> MainThread::ERROR::2016-11-24
>
17:55:04,928::ovf_store::124::ovirt_hosted_engine_ha.lib.ovf.ovf_store.OVFStore::(getEngineVMOVF)
> Unable to extract HEVM OVF
>
> So it tries to rollback to the initial vm.conf, but also that one
> seams to miss some values and so the agent is failing:
> MainThread::ERROR::2016-11-24
> 17:55:04,974::agent::205::ovirt_hosted_engine_ha.agent.agent.Agent::(_run_agent)
> Error: ''Configuration value not found:
> file=/var/run/ovirt-hosted-engine-ha/vm.conf, key=memSize'' -
> trying to restart agent
>
> Both of the issue seams storage related, could yuo please share
> your gluster logs?
>
>
> Thanks
>
> kasturi
>
>
Hi Simone,
Below [1] is the link for the sosreports on the first two
hosts. The third host has some issue. Once it is up will give the
sosreport from there as well.
And the host where you see the initial issue was the third one?
It is on the first
host.
[1]
http://rhsqe-repo.lab.eng.blr.redhat.com/sosreports/HC/vm_conf/
<http://rhsqe-repo.lab.eng.blr.redhat.com/sosreports/HC/vm_conf/>
Thanks
kasturi
--------------DB00ED00F6B934BF3B5014CE
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta content="text/html; charset=utf-8"
http-equiv="Content-Type">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<div class="moz-cite-prefix">On 11/24/2016 06:56 PM, Simone
Tiraboschi wrote:<br>
</div>
<blockquote
cite="mid:CAN8-ONoLO_bReAa=OMseF_HqV=eV1eBrYYt7n+YapC5joTw9qg@mail.gmail.com"
type="cite">
<div dir="ltr"><br>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Thu, Nov 24, 2016 at 2:08 PM,
knarra <span dir="ltr"><<a
moz-do-not-send="true"
href="mailto:knarra@redhat.com"
target="_blank">knarra(a)redhat.com</a>&gt;</span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<div>
<div class="h5">
<div class="m_-6170493833456119351moz-cite-prefix">On
11/24/2016 06:15 PM, Simone Tiraboschi wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr"><br>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Thu, Nov 24, 2016
at 1:26 PM, knarra <span
dir="ltr"><<a
moz-do-not-send="true"
href="mailto:knarra@redhat.com"
target="_blank">knarra(a)redhat.com</a>&gt;</span>
wrote:<br>
<blockquote class="gmail_quote"
style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">Hi,<br>
<br>
I have three nodes with glusterfs as
storage domain. For some reason i see that
vm.conf from
/var/run/ovirt-hosted-engine-h<wbr>a is
missing and due to this on one of my host
i see that Hosted Engine HA : Not Active.
Once i copy the file from some other node
and restart ovirt-ha-broker and
ovirt-ha-agent services everything works
fine. But then this happens again. Can
some please help me identify why this
happens. Below is the log i see in
ovirt-ha-agent.logs.<br>
<br>
<br>
<a moz-do-not-send="true"
href="https://paste.fedoraproject.org/489120/79990345/"
rel="noreferrer"
target="_blank">https://paste.fedoraproject.or<wbr>g/489120/79990345/</a><br>
<br>
</blockquote>
<div><br>
</div>
Once the engine correctly imported the
hosted-engine storage domain, a couple of
OVF_STORE volumes will appear there.<br>
Every modification to the engine VM
configuration will be written by the engine
into that OVF_STORE, so all the
ovirt-ha-agent running on the hosted-engine
hosts will be able to re-start the engine VM
with a coherent configuration.<br>
<br>
Till the engine imports the hosted-engine
storage domain, ovirt-ha-agent will fall
back to the initial vm.conf.<br>
<br>
In you case the OVF_STORE volume is there,<br>
but the agent fails extracting the engine VM
configuration:<br>
MainThread::<a moz-do-not-send="true"
class="m_-6170493833456119351moz-txt-link-freetext">INFO::2016-11-24</a>
17:55:04,914::ovf_store::112::<wbr>ovirt_hosted_engine_ha.lib.<wbr>ovf.ovf_store.OVFStore::(<wbr>getEngineVMOVF)
Extracting Engine VM OVF from the OVF_STORE<br>
MainThread::<a moz-do-not-send="true"
class="m_-6170493833456119351moz-txt-link-freetext">INFO::2016-11-24</a>
17:55:04,919::ovf_store::119::<wbr>ovirt_hosted_engine_ha.lib.<wbr>ovf.ovf_store.OVFStore::(<wbr>getEngineVMOVF)
OVF_STORE volume path:
/rhev/data-center/mnt/<wbr>glusterSD/10.70.36.79:_engine/<wbr>27f054c3-c245-4039-b42a-<wbr>c28b37043016/images/fdf49778-<wbr>9a06-49c6-bf7a-a0f12425911c/<wbr>8c954add-6bcf-47f8-ac2e-<wbr>4c85fc3f8699<br>
MainThread::ERROR::2016-11-24
17:55:04,928::ovf_store::124::<wbr>ovirt_hosted_engine_ha.lib.<wbr>ovf.ovf_store.OVFStore::(<wbr>getEngineVMOVF)
Unable to extract HEVM OVF<br>
<br>
So it tries to rollback to the initial
vm.conf, but also that one seams to miss
some values and so the agent is failing:<br>
MainThread::ERROR::2016-11-24
17:55:04,974::agent::205::<wbr>ovirt_hosted_engine_ha.agent.<wbr>agent.Agent::(_run_agent)
Error: ''Configuration value not found:
file=/var/run/ovirt-hosted-<wbr>engine-ha/vm.conf,
key=memSize'' - trying to restart agent<br>
<br>
Both of the issue seams storage related,
could yuo please share your gluster logs?<br>
<br>
<blockquote class="gmail_quote"
style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex"> <br>
Thanks<br>
<br>
kasturi<br>
<br>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
</div>
</div>
<p>Hi Simone,</p>
<p> Below [1] is the link for the sosreports on the
first two hosts. The third host has some issue. Once
it is up will give the sosreport from there as well.</p>
</div>
</blockquote>
<div><br>
</div>
<div>And the host where you see the initial issue was the
third one? <br>
</div>
</div>
</div>
</div>
</blockquote>
It is on the first host.<br>
<blockquote
cite="mid:CAN8-ONoLO_bReAa=OMseF_HqV=eV1eBrYYt7n+YapC5joTw9qg@mail.gmail.com"
type="cite">
<div dir="ltr">
<div class="gmail_extra">
<div class="gmail_quote">
<div> </div>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<p>[1] <a moz-do-not-send="true"
class="m_-6170493833456119351moz-txt-link-freetext"
href="http://rhsqe-repo.lab.eng.blr.redhat.com/sosreports/HC/vm_conf...
target="_blank">http://rhsqe-repo.lab.eng.blr.<wbr>red...
<p>Thanks</p>
<p>kasturi<br>
</p>
</div>
</blockquote>
</div>
<br>
</div>
</div>
</blockquote>
<p><br>
</p>
</body>
</html>
--------------DB00ED00F6B934BF3B5014CE--