<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Wed, May 31, 2017 at 6:08 PM, Rizwan Qureshi <span dir="ltr"><<a href="mailto:rqureshi@connexin.co.uk" target="_blank">rqureshi@connexin.co.uk</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div lang="EN-US" link="blue" vlink="purple">
<div class="m_8998916143560390657WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Hi Sandro,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">We upgraded from 3.6 to 4.0 but it was still working after the upgrade. It broke when we did a restart.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Any ideas how to fix this?</span></p></div></div></blockquote><div><br></div><div>Simone, Martin, can you help here?</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-US" link="blue" vlink="purple"><div class="m_8998916143560390657WordSection1"><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Also, in case we can’t make it work can we save the VMs and reload them after a fresh install of ovirt?</span></p></div></div></blockquote><div><br></div><div>VMs shouldn't be affected, you should be able to re-add existing data domain to the reinstalled engine.</div><div>Tal, can you confirm?</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-US" link="blue" vlink="purple"><div class="m_8998916143560390657WordSection1"><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> We don’t want to lose the data that is on the VMs. Is there anyay to
recover the data in the VMs?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Thanks,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"><u></u> <u></u></span></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Sandro Bonazzola [mailto:<a href="mailto:sbonazzo@redhat.com" target="_blank">sbonazzo@redhat.com</a>]
<br>
<b>Sent:</b> Wednesday, May 31, 2017 3:19 PM<br>
<b>To:</b> Rizwan Qureshi <<a href="mailto:rqureshi@connexin.co.uk" target="_blank">rqureshi@connexin.co.uk</a>>; Francesco Romani <<a href="mailto:fromani@redhat.com" target="_blank">fromani@redhat.com</a>>; Michal Skrivanek <<a href="mailto:mskrivan@redhat.com" target="_blank">mskrivan@redhat.com</a>>; Simone Tiraboschi <<a href="mailto:stirabos@redhat.com" target="_blank">stirabos@redhat.com</a>>; Martin Sivak <<a href="mailto:msivak@redhat.com" target="_blank">msivak@redhat.com</a>></span></p><div><div class="h5"><br>
<b>Cc:</b> <a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a><br>
<b>Subject:</b> Re: [ovirt-users] Engine Down Score is 0<u></u><u></u></div></div><p></p><div><div class="h5">
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Wed, May 31, 2017 at 4:18 PM, Sandro Bonazzola <<a href="mailto:sbonazzo@redhat.com" target="_blank">sbonazzo@redhat.com</a>> wrote:<u></u><u></u></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<p class="MsoNormal">The hosted engine fails to start due to:<u></u><u></u></p>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<div>
<p class="MsoNormal">Traceback (most recent call last):<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> File "/usr/share/vdsm/virt/vm.py", line 714, in _startUnderlyingVm<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> self._run()<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> File "/usr/share/vdsm/virt/vm.py", line 2026, in _run<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> self._connection.createXML(<wbr>domxml, flags),<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> File "/usr/lib/python2.7/site-<wbr>packages/vdsm/<wbr>libvirtconnection.py", line 123, in wrapper<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> ret = f(*args, **kwargs)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> File "/usr/lib/python2.7/site-<wbr>packages/vdsm/utils.py", line 917, in wrapper<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> return func(inst, *args, **kwargs)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> File "/usr/lib64/python2.7/site-<wbr>packages/libvirt.py", line 3782, in createXML<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> if ret is None:raise libvirtError('<wbr>virDomainCreateXML() failed', conn=self)<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">libvirtError: Cannot get interface MTU on 'None': No such device<u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">The Hosted Engine VM has been configured with:<u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal"> <interface address="None" type="bridge"><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <mac address="00:1a:4a:16:01:75"/><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <model type="virtio"/><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <source bridge="storage"/><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <link state="up"/><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> </interface><u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal">also:<u></u><u></u></p>
</div>
<div>
<div>
<p class="MsoNormal"> <interface address="None" type="bridge"><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <mac address="00:16:3e:21:57:02"/><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <model type="virtio"/><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <source bridge="None"/><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <link state="up"/><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> </interface><u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal">Not sure how you got there.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Can you share steps you did before having this issue?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
</div>
</div>
<div>
<div>
<div>
<p class="MsoNormal"><u></u> <u></u></p>
<div>
<p class="MsoNormal">On Wed, May 31, 2017 at 4:04 PM, Rizwan Qureshi <<a href="mailto:rqureshi@connexin.co.uk" target="_blank">rqureshi@connexin.co.uk</a>> wrote:<u></u><u></u></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in">
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Hi Sandro,</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">PFA the sos report and vdsm logs.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Sandro Bonazzola [mailto:<a href="mailto:sbonazzo@redhat.com" target="_blank">sbonazzo@redhat.com</a>]
<br>
<b>Sent:</b> Wednesday, May 31, 2017 11:04 AM<br>
<b>To:</b> Rizwan Qureshi <<a href="mailto:rqureshi@connexin.co.uk" target="_blank">rqureshi@connexin.co.uk</a>>; Martin Sivak <<a href="mailto:msivak@redhat.com" target="_blank">msivak@redhat.com</a>><br>
<b>Cc:</b> Michal Skrivanek <<a href="mailto:mskrivan@redhat.com" target="_blank">mskrivan@redhat.com</a>>;
<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a></span><u></u><u></u></p>
<div>
<div>
<p class="MsoNormal"><br>
<b>Subject:</b> Re: [ovirt-users] Engine Down Score is 0<u></u><u></u></p>
</div>
</div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<div>
<div>
<p class="MsoNormal">On Wed, May 31, 2017 at 11:10 AM, Rizwan Qureshi <<a href="mailto:rqureshi@connexin.co.uk" target="_blank">rqureshi@connexin.co.uk</a>> wrote:<u></u><u></u></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Hi Sandro,</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Thanks for your response.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">We have tried that already but the VM shuts down after the –vm-start executes.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Also, apologies for wrong information bfore. We have 3 dedicated hosts not 1.</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Please see below the output of –vm-status command:</span><u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Can you please share sos report or at least vdsm logs from the hosts?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Need to understand what happened to the vm.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">--== Host 1 status ==--</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Status up-to-date : True</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Hostname <wbr> :
<a href="http://vmhost1.le1.uk.cxn-network.net" target="_blank">vmhost1.le1.uk.cxn-network.net</a></span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Host ID : 1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Engine status : {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "down"}</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Score <wbr> : 0</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">stopped <wbr> : False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Local maintenance : False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">crc32 <wbr> : 37a4ce89</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Host timestamp : 76387</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Extra metadata (valid at timestamp):</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> metadata_parse_version=1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> metadata_feature_version=1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> timestamp=76387 (Wed May 31 10:04:47 2017)</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> host-id=1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> score=0</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> maintenance=False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> state=EngineUnexpectedlyDown</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> stopped=False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> timeout=Thu Jan 1 22:17:00 1970</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">--== Host 2 status ==--</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Status up-to-date : True</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Hostname :
<a href="http://vmhost2.le1.uk.cxn-network.net" target="_blank">vmhost2.le1.uk.cxn-network.net</a></span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Host ID : 2</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Engine status : {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "down"}</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Score <wbr> : 0</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">stopped : False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Local maintenance : False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">crc32 <wbr> : 937b5542</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Host timestamp : 76069</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Extra metadata (valid at timestamp):</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> metadata_parse_version=1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> metadata_feature_version=1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> timestamp=76069 (Wed May 31 10:04:51 2017)</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> host-id=2</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> score=0</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> maintenance=False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> state=EngineUnexpectedlyDown</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> stopped=False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> timeout=Thu Jan 1 22:17:49 1970</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">--== Host 3 status ==--</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Status up-to-date : True</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Hostname <wbr> :
<a href="http://vmhost3.le1.uk.cxn-network.net" target="_blank">vmhost3.le1.uk.cxn-network.net</a></span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Host ID : 3</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Engine status : {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "down"}</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Score <wbr> : 0</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">stopped <wbr> : False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Local maintenance : False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">crc32 <wbr> : 8ffac898</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Host timestamp : 76212</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">Extra metadata (valid at timestamp):</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> metadata_parse_version=1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> metadata_feature_version=1</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> timestamp=76212 (Wed May 31 10:04:55 2017)</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> host-id=3</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> score=0</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> maintenance=False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> state=EngineUnexpectedlyDown</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> stopped=False</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> timeout=Thu Jan 1 22:16:58 1970</span><u></u><u></u></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> </span><u></u><u></u></p>
<p class="MsoNormal"><b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Sandro Bonazzola [mailto:<a href="mailto:sbonazzo@redhat.com" target="_blank">sbonazzo@redhat.com</a>]
<br>
<b>Sent:</b> Wednesday, May 31, 2017 7:52 AM<br>
<b>To:</b> Rizwan Qureshi <<a href="mailto:rqureshi@connexin.co.uk" target="_blank">rqureshi@connexin.co.uk</a>>; Michal Skrivanek <<a href="mailto:mskrivan@redhat.com" target="_blank">mskrivan@redhat.com</a>><br>
<b>Cc:</b> <a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a><br>
<b>Subject:</b> Re: [ovirt-users] Engine Down Score is 0</span><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
<div>
<p class="MsoNormal">On Tue, May 30, 2017 at 6:32 PM, Rizwan Qureshi <<a href="mailto:rqureshi@connexin.co.uk" target="_blank">rqureshi@connexin.co.uk</a>> wrote:<u></u><u></u></p>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal">Hello Ovirt Users,<u></u><u></u></p>
<p class="MsoNormal">I am new to ovirt.
<u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Hi, welcome ot oVirt community!<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal">Just trying to fix the issue with the engine which seems to be down and hence all our VMs which we are very much dependent upon are not working.
<u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Other VMs shouldn't be affected by an unavailability of the engine, they should keep going if already started.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal">Tried googling the log snippet but to no avail. Hoping to get some help from you guys.<u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">I am completely blank and don’t know whats wrong with it.</span><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">We have 3 Dell servers. One for Engine and the other two for nodes. Please see the log snippet from the engine server agent.log. Please let me know if more information is needed
to debug the issue.<u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">So you have only 1 host dedicated to running hosted engine?<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:21:51,649::hosted_engine::<wbr>612::ovirt_hosted_engine_ha.<wbr>agent.hosted_engine.<wbr>HostedEngine::(_initialize_<wbr>vdsm) Initializing VDSM<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:21:53,820::hosted_engine::<wbr>639::ovirt_hosted_engine_ha.<wbr>agent.hosted_engine.<wbr>HostedEngine::(_initialize_<wbr>storage_images) Connecting the storage<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:21:53,821::storage_server::<wbr>219::<a href="http://ovirt_hosted_engine_ha.li" target="_blank">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.<wbr>StorageServer::(connect_<wbr>storage_server)
Connecting storage server<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:21:58,134::storage_server::<wbr>226::<a href="http://ovirt_hosted_engine_ha.li" target="_blank">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.<wbr>StorageServer::(connect_<wbr>storage_server)
Connecting storage server<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:21:58,142::storage_server::<wbr>233::<a href="http://ovirt_hosted_engine_ha.li" target="_blank">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.<wbr>StorageServer::(connect_<wbr>storage_server)
Refreshing the storage domain<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:21:58,258::hosted_engine::<wbr>666::ovirt_hosted_engine_ha.<wbr>agent.hosted_engine.<wbr>HostedEngine::(_initialize_<wbr>storage_images) Preparing images<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:21:58,258::image::126::<wbr>ovirt_hosted_engine_ha.lib.<wbr>image.Image::(prepare_images) Preparing images<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:00,637::hosted_engine::<wbr>669::ovirt_hosted_engine_ha.<wbr>agent.hosted_engine.<wbr>HostedEngine::(_initialize_<wbr>storage_images) Reloading vm.conf from the shared
storage domain<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:00,638::config::206::<wbr>ovirt_hosted_engine_ha.agent.<wbr>hosted_engine.HostedEngine.<wbr>config::(refresh_local_conf_<wbr>file) Trying to get a fresher copy of
vm configuration from the OVF_STORE<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:02,838::ovf_store::103::<wbr>ovirt_hosted_engine_ha.lib.<wbr>ovf.ovf_store.OVFStore::(scan) Found OVF_STORE: imgUUID:f4d55192-a2c8-4c2b-<wbr>8e6c-46a49c30967c,
volUUID:0ae2c43f-5883-4354-<wbr>a33f-e68e21ae3733<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:02,977::ovf_store::103::<wbr>ovirt_hosted_engine_ha.lib.<wbr>ovf.ovf_store.OVFStore::(scan) Found OVF_STORE: imgUUID:4ef3bd37-e48d-44a8-<wbr>b906-5353de1a32cc,
volUUID:d63b9f36-c5f1-4ddc-<wbr>9d4a-e01f22023e73<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:03,032::ovf_store::112::<wbr>ovirt_hosted_engine_ha.lib.<wbr>ovf.ovf_store.OVFStore::(<wbr>getEngineVMOVF) Extracting Engine VM OVF from the OVF_STORE<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:03,033::ovf_store::119::<wbr>ovirt_hosted_engine_ha.lib.<wbr>ovf.ovf_store.OVFStore::(<wbr>getEngineVMOVF) OVF_STORE volume path: /rhev/data-center/mnt/nas1.<wbr>le1.uk.cxn-network.net:_oVirt/<wbr>4f9e46d7-594e-473c-b0c5-<wbr>1770c5773a2e/images/4ef3bd37-<wbr>e48d-44a8-b906-5353de1a32cc/<wbr>d63b9f36-c5f1-4ddc-9d4a-<wbr>e01f22023e73<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:03,044::config::226::<wbr>ovirt_hosted_engine_ha.agent.<wbr>hosted_engine.HostedEngine.<wbr>config::(refresh_local_conf_<wbr>file) Found an OVF for HE VM, trying
to convert<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:03,046::config::231::<wbr>ovirt_hosted_engine_ha.agent.<wbr>hosted_engine.HostedEngine.<wbr>config::(refresh_local_conf_<wbr>file) Got vm.conf from OVF_STORE<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:03,082::states::672::<wbr>ovirt_hosted_engine_ha.agent.<wbr>hosted_engine.HostedEngine::(<wbr>score) Score is 0 due to unexpected vm shutdown at Tue May 30 17:18:38
2017<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:03,082::hosted_engine::<wbr>461::ovirt_hosted_engine_ha.<wbr>agent.hosted_engine.<wbr>HostedEngine::(start_<wbr>monitoring) Current state EngineUnexpectedlyDown (score:
0)<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:03,082::hosted_engine::<wbr>466::ovirt_hosted_engine_ha.<wbr>agent.hosted_engine.<wbr>HostedEngine::(start_<wbr>monitoring) Best remote host
<a href="http://vmhost2.le1.uk.cxn-network.net" target="_blank">vmhost2.le1.uk.cxn-network.net</a> (id: 2, score: 0)<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:13,135::hosted_engine::<wbr>612::ovirt_hosted_engine_ha.<wbr>agent.hosted_engine.<wbr>HostedEngine::(_initialize_<wbr>vdsm) Initializing VDSM<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:15,305::hosted_engine::<wbr>639::ovirt_hosted_engine_ha.<wbr>agent.hosted_engine.<wbr>HostedEngine::(_initialize_<wbr>storage_images) Connecting the storage<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:15,306::storage_server::<wbr>219::<a href="http://ovirt_hosted_engine_ha.li" target="_blank">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.<wbr>StorageServer::(connect_<wbr>storage_server)
Connecting storage server<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:19,618::storage_server::<wbr>226::<a href="http://ovirt_hosted_engine_ha.li" target="_blank">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.<wbr>StorageServer::(connect_<wbr>storage_server)
Connecting storage server<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:19,626::storage_server::<wbr>233::<a href="http://ovirt_hosted_engine_ha.li" target="_blank">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.<wbr>StorageServer::(connect_<wbr>storage_server)
Refreshing the storage domain<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:19,742::hosted_engine::<wbr>666::ovirt_hosted_engine_ha.<wbr>agent.hosted_engine.<wbr>HostedEngine::(_initialize_<wbr>storage_images) Preparing images<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:19,742::image::126::<wbr>ovirt_hosted_engine_ha.lib.<wbr>image.Image::(prepare_images) Preparing images<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:22,140::hosted_engine::<wbr>669::ovirt_hosted_engine_ha.<wbr>agent.hosted_engine.<wbr>HostedEngine::(_initialize_<wbr>storage_images) Reloading vm.conf from the shared
storage domain<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:22,140::config::206::<wbr>ovirt_hosted_engine_ha.agent.<wbr>hosted_engine.HostedEngine.<wbr>config::(refresh_local_conf_<wbr>file) Trying to get a fresher copy of
vm configuration from the OVF_STORE<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,333::ovf_store::103::<wbr>ovirt_hosted_engine_ha.lib.<wbr>ovf.ovf_store.OVFStore::(scan) Found OVF_STORE: imgUUID:f4d55192-a2c8-4c2b-<wbr>8e6c-46a49c30967c,
volUUID:0ae2c43f-5883-4354-<wbr>a33f-e68e21ae3733<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,472::ovf_store::103::<wbr>ovirt_hosted_engine_ha.lib.<wbr>ovf.ovf_store.OVFStore::(scan) Found OVF_STORE: imgUUID:4ef3bd37-e48d-44a8-<wbr>b906-5353de1a32cc,
volUUID:d63b9f36-c5f1-4ddc-<wbr>9d4a-e01f22023e73<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,519::ovf_store::112::<wbr>ovirt_hosted_engine_ha.lib.<wbr>ovf.ovf_store.OVFStore::(<wbr>getEngineVMOVF) Extracting Engine VM OVF from the OVF_STORE<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,520::ovf_store::119::<wbr>ovirt_hosted_engine_ha.lib.<wbr>ovf.ovf_store.OVFStore::(<wbr>getEngineVMOVF) OVF_STORE volume path: /rhev/data-center/mnt/nas1.<wbr>le1.uk.cxn-network.net:_oVirt/<wbr>4f9e46d7-594e-473c-b0c5-<wbr>1770c5773a2e/images/4ef3bd37-<wbr>e48d-44a8-b906-5353de1a32cc/<wbr>d63b9f36-c5f1-4ddc-9d4a-<wbr>e01f22023e73<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,531::config::226::<wbr>ovirt_hosted_engine_ha.agent.<wbr>hosted_engine.HostedEngine.<wbr>config::(refresh_local_conf_<wbr>file) Found an OVF for HE VM, trying
to convert<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,533::config::231::<wbr>ovirt_hosted_engine_ha.agent.<wbr>hosted_engine.HostedEngine.<wbr>config::(refresh_local_conf_<wbr>file) Got vm.conf from OVF_STORE<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,568::states::672::<wbr>ovirt_hosted_engine_ha.agent.<wbr>hosted_engine.HostedEngine::(<wbr>score) Score is 0 due to unexpected vm shutdown at Tue May 30 17:18:39
2017<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,568::hosted_engine::<wbr>461::ovirt_hosted_engine_ha.<wbr>agent.hosted_engine.<wbr>HostedEngine::(start_<wbr>monitoring) Current state EngineUnexpectedlyDown (score:
0)<u></u><u></u></p>
<p class="MsoNormal">MainThread::INFO::2017-05-30 17:22:24,568::hosted_engine::<wbr>466::ovirt_hosted_engine_ha.<wbr>agent.hosted_engine.<wbr>HostedEngine::(start_<wbr>monitoring) Best remote host
<a href="http://vmhost2.le1.uk.cxn-network.net" target="_blank">vmhost2.le1.uk.cxn-network.net</a> (id: 2, score: 0)<u></u><u></u></p>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Looks like hosted engine has been turned off at Tue May 30 17:18:38 2017 without moving to maintenance before doing it.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Above logs are timed 2017-05-30 17:22:24, so 4 minutes after the shutdown.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">The agent should have already restarted it in a few minutes after above logs.<u></u><u></u></p>
</div>
<div>
<p class="MsoNormal">Next time, if you need to urgently bring it up again you can use:<u></u><u></u></p>
</div>
<div>
<div style="border:solid #cccccc 1.0pt;padding:8.0pt 8.0pt 8.0pt 8.0pt">
<pre style="margin-bottom:8.5pt;background:whitesmoke;word-break:break-all;box-sizing:border-box;word-wrap:break-word;border-radius:4px;overflow:auto"><code><span style="font-family:Consolas;color:#333333">hosted-engine ---vm-start</span></code><u></u><u></u></pre>
</div>
</div>
<div>
<p class="MsoNormal">as described in <a href="http://www.ovirt.org/documentation/self-hosted/chap-Troubleshooting/" target="_blank">http://www.ovirt.org/<wbr>documentation/self-hosted/<wbr>chap-Troubleshooting/</a><u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<blockquote style="border:none;border-left:solid #cccccc 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span lang="EN-GB">--</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">Best Regards,</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">Rizwan Qureshi</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">VoIP Admin</span><u></u><u></u></p>
<p class="MsoNormal"><span lang="EN-GB">Ph: 01482xxxxxxx</span><u></u><u></u></p>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><br>
______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/users</a><u></u><u></u></p>
</blockquote>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<u></u><u></u></p>
<div>
<p class="MsoNormal"> <u></u><u></u></p>
</div>
<p class="MsoNormal">--
<u></u><u></u></p>
</div>
</div>
</div>
</div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p style="margin:0in;margin-bottom:.0001pt"><b><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black;text-transform:uppercase">SANDRO BONAZZOLA</span></b><u></u><u></u></p>
<p style="margin-bottom:3.0pt"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:black;text-transform:uppercase">ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D</span><u></u><u></u></p>
<p style="margin:0in;margin-bottom:.0001pt"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#999999"><a href="https://www.redhat.com/" target="_blank"><span style="color:#0088ce">Red Hat EMEA</span></a></span><u></u><u></u></p>
</div>
</div>
</div>
</div>
<table class="m_8998916143560390657MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt"></td>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:black"><a href="https://red.ht/sig" target="_blank"><b><span style="color:#cc0000">TRIED. TESTED. TRUSTED.</span></b></a></span><u></u><u></u></p>
</div>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none"> </span></a><u></u><u></u></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none"><br>
<br clear="all">
</span></a><u></u><u></u></p>
<div>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none"> </span></a><u></u><u></u></p>
</div>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none">--
</span></a><u></u><u></u></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p style="margin:0in;margin-bottom:.0001pt"><b><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black;text-transform:uppercase"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none">SANDRO BONAZZOLA</span></a></span></b><u></u><u></u></p>
<p style="margin-bottom:3.0pt"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:black;text-transform:uppercase"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none">ASSOCIATE MANAGER, SOFTWARE ENGINEERING,
EMEA ENG VIRTUALIZATION R&D</span></a></span><u></u><u></u></p>
<p style="margin:0in;margin-bottom:.0001pt"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#999999"><a href="https://red.ht/sig" target="_blank"><span style="color:#0088ce">Red Hat EMEA</span></a></span><u></u><u></u></p>
<table class="m_8998916143560390657MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Arial",sans-serif;color:black"><a href="https://red.ht/sig" target="_blank"><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:windowtext;text-decoration:none"><u></u><u></u></span></a></span></p>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:black"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none"><b><u><span style="color:#cc0000">TRIED.
TESTED. TRUSTED.</span></u></b></span><span style="font-size:12.0pt;font-family:"Times New Roman",serif;color:windowtext;text-decoration:none"><u></u><u></u></span></a></span></p>
</div>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none"> <u></u><u></u></span></a></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none"><br>
<br clear="all">
<u></u><u></u></span></a></p>
<div>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u> <u></u></span></a></p>
</div>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none">--
<u></u><u></u></span></a></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p style="margin:0in;margin-bottom:.0001pt"><b><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black;text-transform:uppercase"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none">SANDRO BONAZZOLA<u></u><u></u></span></a></span></b></p>
<p style="margin-right:0in;margin-bottom:3.0pt;margin-left:0in">
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:black;text-transform:uppercase"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none">ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D<u></u><u></u></span></a></span></p>
<p style="margin:0in;margin-bottom:.0001pt"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#999999"><a href="https://red.ht/sig" target="_blank"><span style="color:#999999;text-decoration:none"><u><span style="color:#0088ce">Red Hat EMEA</span></u><u></u><u></u></span></a></span></p>
<table class="m_8998916143560390657MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Arial",sans-serif;color:black"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none"><span style="color:blue"><img border="0" width="90" style="width:.9375in" id="m_8998916143560390657_x0000_i1025"></span><u></u><u></u></span></a></span></p>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:black"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none"><b><u><span style="color:#cc0000">TRIED. TESTED. TRUSTED.</span></u></b><u></u><u></u></span></a></span></p>
</div>
</td>
</tr>
</tbody>
</table>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none"><br>
<br clear="all">
<u></u><u></u></span></a></p>
<div>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u> <u></u></span></a></p>
</div>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none">--
<u></u><u></u></span></a></p>
<div>
<div>
<div>
<div>
<div>
<div>
<div>
<p style="margin:0in;margin-bottom:.0001pt"><b><span style="font-size:10.5pt;font-family:"Arial",sans-serif;color:black;text-transform:uppercase"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none">SANDRO BONAZZOLA<u></u><u></u></span></a></span></b></p>
<p style="margin-right:0in;margin-bottom:3.0pt;margin-left:0in">
<span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:black;text-transform:uppercase"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none">ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D<u></u><u></u></span></a></span></p>
<p style="margin:0in;margin-bottom:.0001pt"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:#999999"><a href="https://red.ht/sig" target="_blank"><span style="color:#999999;text-decoration:none"><u><span style="color:#0088ce">Red Hat EMEA</span></u><u></u><u></u></span></a></span></p>
<table class="m_8998916143560390657MsoNormalTable" border="0" cellpadding="0">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Arial",sans-serif;color:black"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none"><span style="color:blue"><img border="0" width="90" style="width:.9375in" id="m_8998916143560390657_x0000_i1026"></span><u></u><u></u></span></a></span></p>
</td>
<td style="padding:.75pt .75pt .75pt .75pt">
<div>
<p class="MsoNormal"><span style="font-size:7.5pt;font-family:"Arial",sans-serif;color:black"><a href="https://red.ht/sig" target="_blank"><span style="color:black;text-decoration:none"><b><u><span style="color:#cc0000">TRIED. TESTED. TRUSTED.</span></u></b><u></u><u></u></span></a></span></p>
</div>
</td>
</tr>
</tbody>
</table>
<p class="MsoNormal"><a href="https://red.ht/sig" target="_blank"><span style="color:windowtext;text-decoration:none"><u></u> <u></u></span></a></p>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div></div></div>
</div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><span>SANDRO</span> <span>BONAZZOLA</span></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><span>ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D</span></p><p style="font-family:overpass,sans-serif;margin:0px;font-size:10px;color:rgb(153,153,153)"><a href="https://www.redhat.com/" style="color:rgb(0,136,206);margin:0px" target="_blank">Red Hat <span>EMEA</span></a></p><table border="0" style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium"><tbody><tr><td width="100px"><a href="https://red.ht/sig" target="_blank"><img src="https://www.redhat.com/profiles/rh/themes/redhatdotcom/img/logo-red-hat-black.png" width="90" height="auto"></a></td><td style="font-size:10px"><div><a href="https://redhat.com/trusted" style="color:rgb(204,0,0);font-weight:bold" target="_blank">TRIED. TESTED. TRUSTED.</a></div></td></tr></tbody></table></div></div></div></div></div></div></div>
</div></div>