<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Wed, May 31, 2017 at 4:18 PM, Sandro Bonazzola <span dir="ltr">&lt;<a href="mailto:sbonazzo@redhat.com" target="_blank">sbonazzo@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">The hosted engine fails to start due to:<div><br></div><div><div>Traceback (most recent call last):</div><div>  File &quot;/usr/share/vdsm/virt/vm.py&quot;, line 714, in _startUnderlyingVm</div><div>    self._run()</div><div>  File &quot;/usr/share/vdsm/virt/vm.py&quot;, line 2026, in _run</div><div>    self._connection.createXML(<wbr>domxml, flags),</div><div>  File &quot;/usr/lib/python2.7/site-<wbr>packages/vdsm/<wbr>libvirtconnection.py&quot;, line 123, in wrapper</div><div>    ret = f(*args, **kwargs)</div><div>  File &quot;/usr/lib/python2.7/site-<wbr>packages/vdsm/utils.py&quot;, line 917, in wrapper</div><div>    return func(inst, *args, **kwargs)</div><div>  File &quot;/usr/lib64/python2.7/site-<wbr>packages/libvirt.py&quot;, line 3782, in createXML</div><div>    if ret is None:raise libvirtError(&#39;<wbr>virDomainCreateXML() failed&#39;, conn=self)</div><div>libvirtError: Cannot get interface MTU on &#39;None&#39;: No such device</div></div><div><br></div><div>The Hosted Engine VM has been configured with:</div><div><div>                &lt;interface address=&quot;None&quot; type=&quot;bridge&quot;&gt;</div><div>                        &lt;mac address=&quot;00:1a:4a:16:01:75&quot;/&gt;</div><div>                        &lt;model type=&quot;virtio&quot;/&gt;</div><div>                        &lt;source bridge=&quot;storage&quot;/&gt;</div><div>                        &lt;link state=&quot;up&quot;/&gt;</div><div>                &lt;/interface&gt;</div></div><div><br></div></div></blockquote><div><br></div><div><br></div><div>also:</div><div><div>                &lt;interface address=&quot;None&quot; type=&quot;bridge&quot;&gt;</div><div>                        &lt;mac address=&quot;00:16:3e:21:57:02&quot;/&gt;</div><div>                        &lt;model type=&quot;virtio&quot;/&gt;</div><div>                        &lt;source bridge=&quot;None&quot;/&gt;</div><div>                        &lt;link state=&quot;up&quot;/&gt;</div><div>                &lt;/interface&gt;</div></div><div><br></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div></div><div>Not sure how you got there.</div><div>Can you share steps you did before having this issue?</div><div><br></div></div><div class="gmail-HOEnZb"><div class="gmail-h5"><div class="gmail_extra"><br><div class="gmail_quote">On Wed, May 31, 2017 at 4:04 PM, Rizwan Qureshi <span dir="ltr">&lt;<a href="mailto:rqureshi@connexin.co.uk" target="_blank">rqureshi@connexin.co.uk</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">





<div lang="EN-US">
<div class="gmail-m_3301627426783417484m_9218006902247570575WordSection1">
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Hi Sandro,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">PFA the sos report and vdsm logs.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:11pt;font-family:Calibri,sans-serif">From:</span></b><span style="font-size:11pt;font-family:Calibri,sans-serif"> Sandro Bonazzola [mailto:<a href="mailto:sbonazzo@redhat.com" target="_blank">sbonazzo@redhat.com</a>]
<br>
<b>Sent:</b> Wednesday, May 31, 2017 11:04 AM<br>
<b>To:</b> Rizwan Qureshi &lt;<a href="mailto:rqureshi@connexin.co.uk" target="_blank">rqureshi@connexin.co.uk</a>&gt;; Martin Sivak &lt;<a href="mailto:msivak@redhat.com" target="_blank">msivak@redhat.com</a>&gt;<br>
<b>Cc:</b> Michal Skrivanek &lt;<a href="mailto:mskrivan@redhat.com" target="_blank">mskrivan@redhat.com</a>&gt;; <a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a></span></p><div><div class="gmail-m_3301627426783417484h5"><br>
<b>Subject:</b> Re: [ovirt-users] Engine Down Score is 0<u></u><u></u></div></div><p></p>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div><div><div class="gmail-m_3301627426783417484h5">
<p class="MsoNormal">On Wed, May 31, 2017 at 11:10 AM, Rizwan Qureshi &lt;<a href="mailto:rqureshi@connexin.co.uk" target="_blank">rqureshi@connexin.co.uk</a>&gt; wrote:<u></u><u></u></p>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Hi Sandro,</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Thanks for your response.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">We have tried that already but the VM shuts down after the –vm-start executes.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Also, apologies for wrong information bfore. We have 3 dedicated hosts not 1.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Please see below the output of –vm-status command:</span><u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">Can you please share sos report or at least vdsm logs from the hosts?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Need to understand what happened to the vm.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div></div><blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0in 0in 0in 6pt;margin-left:4.8pt;margin-right:0in">
<div>
<div><div><div class="gmail-m_3301627426783417484h5">
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">--== Host 1 status ==--</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Status up-to-date                  : True</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Hostname                      <wbr>     :
<a href="http://vmhost1.le1.uk.cxn-network.net" target="_blank">vmhost1.le1.uk.cxn-network.net</a></span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Host ID                            : 1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Engine status                      : {&quot;reason&quot;: &quot;bad vm status&quot;, &quot;health&quot;: &quot;bad&quot;, &quot;vm&quot;: &quot;down&quot;, &quot;detail&quot;: &quot;down&quot;}</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Score                         <wbr>     : 0</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">stopped                       <wbr>     : False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Local maintenance                  : False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">crc32                         <wbr>     : 37a4ce89</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Host timestamp                     : 76387</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Extra metadata (valid at timestamp):</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        metadata_parse_version=1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        metadata_feature_version=1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        timestamp=76387 (Wed May 31 10:04:47 2017)</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        host-id=1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        score=0</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        maintenance=False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        state=EngineUnexpectedlyDown</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        stopped=False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        timeout=Thu Jan  1 22:17:00 1970</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">--== Host 2 status ==--</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Status up-to-date                  : True</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Hostname                           :
<a href="http://vmhost2.le1.uk.cxn-network.net" target="_blank">vmhost2.le1.uk.cxn-network.net</a></span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Host ID                            : 2</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Engine status                      : {&quot;reason&quot;: &quot;bad vm status&quot;, &quot;health&quot;: &quot;bad&quot;, &quot;vm&quot;: &quot;down&quot;, &quot;detail&quot;: &quot;down&quot;}</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Score                         <wbr>     : 0</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">stopped                            : False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Local maintenance                  : False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">crc32                         <wbr>     : 937b5542</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Host timestamp                     : 76069</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Extra metadata (valid at timestamp):</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        metadata_parse_version=1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        metadata_feature_version=1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        timestamp=76069 (Wed May 31 10:04:51 2017)</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        host-id=2</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        score=0</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        maintenance=False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        state=EngineUnexpectedlyDown</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        stopped=False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        timeout=Thu Jan  1 22:17:49 1970</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">--== Host 3 status ==--</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Status up-to-date                  : True</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Hostname                      <wbr>     :
<a href="http://vmhost3.le1.uk.cxn-network.net" target="_blank">vmhost3.le1.uk.cxn-network.net</a></span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Host ID                            : 3</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Engine status                      : {&quot;reason&quot;: &quot;bad vm status&quot;, &quot;health&quot;: &quot;bad&quot;, &quot;vm&quot;: &quot;down&quot;, &quot;detail&quot;: &quot;down&quot;}</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Score                         <wbr>     : 0</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">stopped                       <wbr>     : False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Local maintenance                  : False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">crc32                         <wbr>     : 8ffac898</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Host timestamp                     : 76212</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">Extra metadata (valid at timestamp):</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        metadata_parse_version=1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        metadata_feature_version=1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        timestamp=76212 (Wed May 31 10:04:55 2017)</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        host-id=3</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        score=0</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        maintenance=False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        state=EngineUnexpectedlyDown</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        stopped=False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif">        timeout=Thu Jan  1 22:16:58 1970</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11pt;font-family:Calibri,sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><b><span style="font-size:11pt;font-family:Calibri,sans-serif">From:</span></b><span style="font-size:11pt;font-family:Calibri,sans-serif"> Sandro Bonazzola [mailto:<a href="mailto:sbonazzo@redhat.com" target="_blank">sbonazzo@redhat.com</a>]
<br>
<b>Sent:</b> Wednesday, May 31, 2017 7:52 AM<br>
<b>To:</b> Rizwan Qureshi &lt;<a href="mailto:rqureshi@connexin.co.uk" target="_blank">rqureshi@connexin.co.uk</a>&gt;; Michal Skrivanek &lt;<a href="mailto:mskrivan@redhat.com" target="_blank">mskrivan@redhat.com</a>&gt;<br>
<b>Cc:</b> <a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a><br>
<b>Subject:</b> Re: [ovirt-users] Engine Down Score is 0</span><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
</div></div><div>
<p class="MsoNormal"> <u></u><u></u></p>
<div><div><div class="gmail-m_3301627426783417484h5">
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<p class="MsoNormal">On Tue, May 30, 2017 at 6:32 PM, Rizwan Qureshi &lt;<a href="mailto:rqureshi@connexin.co.uk" target="_blank">rqureshi@connexin.co.uk</a>&gt; wrote:<u></u><u></u></p>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0in 0in 0in 6pt;margin:5pt 0in 5pt 4.8pt">
<div>
<div>
<p class="MsoNormal">Hello Ovirt Users,<u></u><u></u></p>
<p class="MsoNormal">I am new to ovirt.
<u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Hi, welcome ot oVirt community!<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0in 0in 0in 6pt;margin:5pt 0in 5pt 4.8pt">
<div>
<div>
<p class="MsoNormal">Just trying to fix the issue with the engine which seems to be down and hence all our VMs which we are very much dependent upon are not working.
<u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Other VMs shouldn&#39;t be affected by an unavailability of the engine, they should keep going if already started.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0in 0in 0in 6pt;margin:5pt 0in 5pt 4.8pt">
<div>
<div>
<p class="MsoNormal">Tried googling the log snippet but to no avail. Hoping to get some help from you guys.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">I am completely blank and don’t know whats wrong with it.</span><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">We have 3 Dell servers. One for Engine and the other two for nodes. Please see the log snippet from the engine server agent.log. Please let me know if more information is needed
 to debug the issue.<u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">So you have only 1 host dedicated to running hosted engine?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0in 0in 0in 6pt;margin:5pt 0in 5pt 4.8pt">
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:21:51,649::hosted_engine::6<wbr>12::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(_initialize_vdsm) Initializing VDSM<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:21:53,820::hosted_engine::6<wbr>39::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(_initialize_storage_images) Connecting the storage<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:21:53,821::storage_server::<wbr>219::<a href="http://ovirt_hosted_engine_ha.li">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.StorageServer<wbr>::(connect_storage_server) Connecting storage server<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:21:58,134::storage_server::<wbr>226::<a href="http://ovirt_hosted_engine_ha.li">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.StorageServer<wbr>::(connect_storage_server) Connecting storage server<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:21:58,142::storage_server::<wbr>233::<a href="http://ovirt_hosted_engine_ha.li">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.StorageServer<wbr>::(connect_storage_server) Refreshing the storage domain<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:21:58,258::hosted_engine::6<wbr>66::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(_initialize_storage_images) Preparing images<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:21:58,258::image::126::ovir<wbr>t_hosted_engine_ha.lib.image.<wbr>Image::(prepare_images) Preparing images<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:00,637::hosted_engine::6<wbr>69::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(_initialize_storage_images) Reloading vm.conf from the shared
 storage domain<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:00,638::config::206::ovi<wbr>rt_hosted_engine_ha.agent.host<wbr>ed_engine.HostedEngine.config:<wbr>:(refresh_local_conf_file) Trying to get a fresher copy of
 vm configuration from the OVF_STORE<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:02,838::ovf_store::103::<wbr>ovirt_hosted_engine_ha.lib.ovf<wbr>.ovf_store.OVFStore::(scan) Found OVF_STORE: imgUUID:f4d55192-a2c8-4c2b-8e6<wbr>c-46a49c30967c,
 volUUID:0ae2c43f-5883-4354-a33<wbr>f-e68e21ae3733<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:02,977::ovf_store::103::<wbr>ovirt_hosted_engine_ha.lib.ovf<wbr>.ovf_store.OVFStore::(scan) Found OVF_STORE: imgUUID:4ef3bd37-e48d-44a8-b90<wbr>6-5353de1a32cc,
 volUUID:d63b9f36-c5f1-4ddc-9d4<wbr>a-e01f22023e73<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:03,032::ovf_store::112::<wbr>ovirt_hosted_engine_ha.lib.ovf<wbr>.ovf_store.OVFStore::(getEngin<wbr>eVMOVF) Extracting Engine VM OVF from the OVF_STORE<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:03,033::ovf_store::119::<wbr>ovirt_hosted_engine_ha.lib.ovf<wbr>.ovf_store.OVFStore::(getEngin<wbr>eVMOVF) OVF_STORE volume path: /rhev/data-center/mnt/nas1.le1<wbr>.uk.cxn-network.net:_oVirt/4f9<wbr>e46d7-594e-473c-b0c5-1770c5773<wbr>a2e/images/4ef3bd37-e48d-44a8-<wbr>b906-5353de1a32cc/d63b9f36-<wbr>c5f1-4ddc-9d4a-e01f22023e73<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:03,044::config::226::ovi<wbr>rt_hosted_engine_ha.agent.host<wbr>ed_engine.HostedEngine.config:<wbr>:(refresh_local_conf_file) Found an OVF for HE VM, trying
 to convert<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:03,046::config::231::ovi<wbr>rt_hosted_engine_ha.agent.host<wbr>ed_engine.HostedEngine.config:<wbr>:(refresh_local_conf_file) Got vm.conf from OVF_STORE<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:03,082::states::672::ovi<wbr>rt_hosted_engine_ha.agent.host<wbr>ed_engine.HostedEngine::(score<wbr>) Score is 0 due to unexpected vm shutdown at Tue May 30 17:18:38
 2017<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:03,082::hosted_engine::4<wbr>61::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(start_monitoring) Current state EngineUnexpectedlyDown (score:
 0)<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:03,082::hosted_engine::4<wbr>66::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(start_monitoring) Best remote host
<a href="http://vmhost2.le1.uk.cxn-network.net" target="_blank">vmhost2.le1.uk.cxn-network.net</a> (id: 2, score: 0)<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:13,135::hosted_engine::6<wbr>12::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(_initialize_vdsm) Initializing VDSM<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:15,305::hosted_engine::6<wbr>39::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(_initialize_storage_images) Connecting the storage<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:15,306::storage_server::<wbr>219::<a href="http://ovirt_hosted_engine_ha.li">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.StorageServer<wbr>::(connect_storage_server) Connecting storage server<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:19,618::storage_server::<wbr>226::<a href="http://ovirt_hosted_engine_ha.li">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.StorageServer<wbr>::(connect_storage_server) Connecting storage server<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:19,626::storage_server::<wbr>233::<a href="http://ovirt_hosted_engine_ha.li">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.StorageServer<wbr>::(connect_storage_server) Refreshing the storage domain<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:19,742::hosted_engine::6<wbr>66::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(_initialize_storage_images) Preparing images<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:19,742::image::126::ovir<wbr>t_hosted_engine_ha.lib.image.<wbr>Image::(prepare_images) Preparing images<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:22,140::hosted_engine::6<wbr>69::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(_initialize_storage_images) Reloading vm.conf from the shared
 storage domain<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:22,140::config::206::ovi<wbr>rt_hosted_engine_ha.agent.host<wbr>ed_engine.HostedEngine.config:<wbr>:(refresh_local_conf_file) Trying to get a fresher copy of
 vm configuration from the OVF_STORE<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,333::ovf_store::103::<wbr>ovirt_hosted_engine_ha.lib.ovf<wbr>.ovf_store.OVFStore::(scan) Found OVF_STORE: imgUUID:f4d55192-a2c8-4c2b-8e6<wbr>c-46a49c30967c,
 volUUID:0ae2c43f-5883-4354-a33<wbr>f-e68e21ae3733<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,472::ovf_store::103::<wbr>ovirt_hosted_engine_ha.lib.ovf<wbr>.ovf_store.OVFStore::(scan) Found OVF_STORE: imgUUID:4ef3bd37-e48d-44a8-b90<wbr>6-5353de1a32cc,
 volUUID:d63b9f36-c5f1-4ddc-9d4<wbr>a-e01f22023e73<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,519::ovf_store::112::<wbr>ovirt_hosted_engine_ha.lib.ovf<wbr>.ovf_store.OVFStore::(getEngin<wbr>eVMOVF) Extracting Engine VM OVF from the OVF_STORE<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,520::ovf_store::119::<wbr>ovirt_hosted_engine_ha.lib.ovf<wbr>.ovf_store.OVFStore::(getEngin<wbr>eVMOVF) OVF_STORE volume path: /rhev/data-center/mnt/nas1.le1<wbr>.uk.cxn-network.net:_oVirt/4f9<wbr>e46d7-594e-473c-b0c5-1770c5773<wbr>a2e/images/4ef3bd37-e48d-44a8-<wbr>b906-5353de1a32cc/d63b9f36-<wbr>c5f1-4ddc-9d4a-e01f22023e73<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,531::config::226::ovi<wbr>rt_hosted_engine_ha.agent.host<wbr>ed_engine.HostedEngine.config:<wbr>:(refresh_local_conf_file) Found an OVF for HE VM, trying
 to convert<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,533::config::231::ovi<wbr>rt_hosted_engine_ha.agent.host<wbr>ed_engine.HostedEngine.config:<wbr>:(refresh_local_conf_file) Got vm.conf from OVF_STORE<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,568::states::672::ovi<wbr>rt_hosted_engine_ha.agent.host<wbr>ed_engine.HostedEngine::(score<wbr>) Score is 0 due to unexpected vm shutdown at Tue May 30 17:18:39
 2017<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,568::hosted_engine::4<wbr>61::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(start_monitoring) Current state EngineUnexpectedlyDown (score:
 0)<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,568::hosted_engine::4<wbr>66::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(start_monitoring) Best remote host
<a href="http://vmhost2.le1.uk.cxn-network.net" target="_blank">vmhost2.le1.uk.cxn-network.net</a> (id: 2, score: 0)<u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Looks like hosted engine has been turned off at Tue May 30 17:18:38 2017 without moving to maintenance before doing it.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Above logs are timed 2017-05-30 17:22:24, so 4 minutes after the shutdown.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">The agent should have already restarted it in a few minutes after above logs.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Next time, if you need to urgently bring it up again you can use:<u></u><u></u></p>
</div>
<div>
<div style="border:1pt solid rgb(204,204,204);padding:8pt">
<pre style="margin-bottom:8.5pt;background:whitesmoke;word-break:break-all;box-sizing:border-box;word-wrap:break-word;border-radius:4px;overflow:auto"><code><span style="font-family:Consolas;color:rgb(51,51,51)">hosted-engine ---vm-start</span></code><u></u><u></u></pre>
</div>
</div>
<div>
<p class="MsoNormal">as described in <a href="http://www.ovirt.org/documentation/self-hosted/chap-Troubleshooting/" target="_blank">http://www.ovirt.org/docume<wbr>ntation/self-hosted/chap-<wbr>Troubleshooting/</a><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<blockquote style="border-top:none;border-right:none;border-bottom:none;border-left:1pt solid rgb(204,204,204);padding:0in 0in 0in 6pt;margin:5pt 0in 5pt 4.8pt">
<div>
<div>
<p class="MsoNormal"><span lang="EN-GB">--</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">Best Regards,</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">Rizwan Qureshi</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">VoIP Admin</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">Ph: 01482xxxxxxx</span><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12pt"><br>
______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><u></u><u></u></p>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<u></u><u></u></p>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<p class="MsoNormal">--
<u></u><u></u></p>
</div>
</div>
</div></div><div>
<div>
<div>
<div>
<div>
<div>
<div><div><div class="gmail-m_3301627426783417484h5">
<div>
<div>
<p style="margin:0in 0in 0.0001pt"><b><span style="font-size:10.5pt;font-family:Arial,sans-serif;color:black;text-transform:uppercase">SANDRO BONAZZOLA</span></b><u></u><u></u></p>
<p style="margin-bottom:3pt"><span style="font-size:7.5pt;font-family:Arial,sans-serif;color:black;text-transform:uppercase">ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&amp;D</span><u></u><u></u></p>
<p style="margin:0in 0in 0.0001pt"><span style="font-size:7.5pt;font-family:Arial,sans-serif;color:rgb(153,153,153)"><a href="https://www.redhat.com/" target="_blank"><span style="color:rgb(0,136,206)">Red Hat EMEA</span></a></span><u></u><u></u></p>
</div>
</div>
</div></div><table class="gmail-m_3301627426783417484m_9218006902247570575MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:0.75pt">
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u><u></u></span></a></p>
</td>
<td style="padding:0.75pt">
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:Arial,sans-serif;color:black"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none"><b><u><span style="color:rgb(204,0,0)">TRIED.
 TESTED. TRUSTED.</span></u></b></span><span style="font-size:12pt;font-family:&quot;Times New Roman&quot;,serif;color:windowtext;text-decoration:none"><u></u><u></u></span></a></span></p>
</div>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none"> <u></u><u></u></span></a></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div><span>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none"><br>
<br clear="all">
<u></u><u></u></span></a></p>
<div>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u> <u></u></span></a></p>
</div>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none">--
<u></u><u></u></span></a></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p style="margin:0in 0in 0.0001pt"><b><span style="font-size:10.5pt;font-family:Arial,sans-serif;color:black;text-transform:uppercase"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none">SANDRO BONAZZOLA<u></u><u></u></span></a></span></b></p>
<p style="margin-right:0in;margin-bottom:3pt;margin-left:0in">
<span style="font-size:7.5pt;font-family:Arial,sans-serif;color:black;text-transform:uppercase"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none">ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&amp;D<u></u><u></u></span></a></span></p>
<p style="margin:0in 0in 0.0001pt"><span style="font-size:7.5pt;font-family:Arial,sans-serif;color:rgb(153,153,153)"><a href="https://red.ht/sig" target="_blank"><span style="color:rgb(153,153,153);text-decoration:none"><u><span style="color:rgb(0,136,206)">Red Hat EMEA</span></u><u></u><u></u></span></a></span></p>
<table class="gmail-m_3301627426783417484m_9218006902247570575MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:0.75pt">
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:Arial,sans-serif;color:black"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none"><span style="color:blue"><img border="0" width="90" style="width: 0.9375in;" id="gmail-m_3301627426783417484m_9218006902247570575_x0000_i1025"></span><u></u><u></u></span></a></span></p>
</td>
<td style="padding:0.75pt">
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:Arial,sans-serif;color:black"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none"><b><u><span style="color:rgb(204,0,0)">TRIED. TESTED. TRUSTED.</span></u></b><u></u><u></u></span></a></span></p>
</div>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u> <u></u></span></a></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</span></div>
</div>
</div>
</div>

</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail-m_3301627426783417484gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><span>SANDRO</span> <span>BONAZZOLA</span></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><span>ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&amp;D</span></p><p style="font-family:overpass,sans-serif;margin:0px;font-size:10px;color:rgb(153,153,153)"><a href="https://www.redhat.com/" style="color:rgb(0,136,206);margin:0px" target="_blank">Red Hat <span>EMEA</span></a></p><table border="0" style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium"><tbody><tr><td width="100px"><a href="https://red.ht/sig" target="_blank"><img src="https://www.redhat.com/profiles/rh/themes/redhatdotcom/img/logo-red-hat-black.png" width="90" height="auto"></a></td><td style="font-size:10px"><div><a href="https://redhat.com/trusted" style="color:rgb(204,0,0);font-weight:bold" target="_blank">TRIED. TESTED. TRUSTED.</a></div></td></tr></tbody></table></div></div></div></div></div></div></div>
</div>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><span>SANDRO</span> <span>BONAZZOLA</span></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><span>ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&amp;D</span></p><p style="font-family:overpass,sans-serif;margin:0px;font-size:10px;color:rgb(153,153,153)"><a href="https://www.redhat.com/" style="color:rgb(0,136,206);margin:0px" target="_blank">Red Hat <span>EMEA</span></a></p><table border="0" style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium"><tbody><tr><td width="100px"><a href="https://red.ht/sig" target="_blank"><img src="https://www.redhat.com/profiles/rh/themes/redhatdotcom/img/logo-red-hat-black.png" width="90" height="auto"></a></td><td style="font-size:10px"><div><a href="https://redhat.com/trusted" style="color:rgb(204,0,0);font-weight:bold" target="_blank">TRIED. TESTED. TRUSTED.</a></div></td></tr></tbody></table></div></div></div></div></div></div></div>
</div></div>