<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Oct 10, 2016 at 11:27 AM, Susinthiran Sithamparanathan <span dir="ltr">&lt;<a href="mailto:chesusin@gmail.com" target="_blank">chesusin@gmail.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div>Hi,<br></div><div>all the logs are now at <a href="https://my.owndrive.com/index.php/s/3Dcyho9bqo7oZs8" target="_blank">https://my.owndrive.com/index.<wbr>php/s/3Dcyho9bqo7oZs8</a><br></div><div><br>I did a quick debug in the VM and i think we are getting closer to the root cause:<br><a href="https://paste.fedoraproject.org/447579/14760912/" target="_blank">https://paste.fedoraproject.<wbr>org/447579/14760912/</a><br><br></div>It seems the SSL/TLS certs are all missing. Now i wonder which RPM package does contain these so that i can try to reinstall it.<br><br></div><div>Appreciate your help so far!<br></div><div><br></div></div></blockquote><div><br></div><div>OK, the issue on the host is just here:</div><div><div>MainThread::DEBUG::2016-10-10 11:18:34,169::brokerlink::282::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(_communicate) Full response: success {&quot;reason&quot;: &quot;failed liveliness check&quot;, &quot;health&quot;: &quot;bad&quot;, &quot;vm&quot;: &quot;up&quot;, &quot;detail&quot;: &quot;up&quot;}</div><div>MainThread::DEBUG::2016-10-10 11:18:34,169::brokerlink::255::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(_checked_communicate) Successful response from socket</div><div>MainThread::DEBUG::2016-10-10 11:18:34,170::brokerlink::151::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(get_monitor_status) Success, status {&quot;reason&quot;: &quot;failed liveliness check&quot;, &quot;health&quot;: &quot;bad&quot;, &quot;vm&quot;: &quot;up&quot;, &quot;detail&quot;: &quot;up&quot;}</div></div><div><br></div><div>the engine VM goes up but the engine no and so after a certain amount of time it tries again with a reboot.</div><div>We should definitively add a more explicit log entry there!</div><div><br></div><div>Now the point is just why your engine is not starting.</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div></div><br><div><br></div></div><div class="gmail_extra"><div><div class="gmail-h5"><br><div class="gmail_quote">On Mon, Oct 10, 2016 at 10:17 AM, Simone Tiraboschi <span dir="ltr">&lt;<a href="mailto:stirabos@redhat.com" target="_blank">stirabos@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><span>On Mon, Oct 10, 2016 at 10:13 AM, Yedidyah Bar David <span dir="ltr">&lt;<a href="mailto:didi@redhat.com" target="_blank">didi@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span>On Mon, Oct 10, 2016 at 10:56 AM, Simone Tiraboschi &lt;<a href="mailto:stirabos@redhat.com" target="_blank">stirabos@redhat.com</a>&gt; wrote:<br>
&gt;<br>
&gt;<br>
&gt; On Sun, Oct 9, 2016 at 5:13 PM, Susinthiran Sithamparanathan<br>
&gt; &lt;<a href="mailto:chesusin@gmail.com" target="_blank">chesusin@gmail.com</a>&gt; wrote:<br>
&gt;&gt;<br>
&gt;&gt; Sure, here it is: <a href="https://my.owndrive.com/index.php/s/MFoFyKJVLjzezey" rel="noreferrer" target="_blank">https://my.owndrive.com/index.<wbr>php/s/MFoFyKJVLjzezey</a><br>
&gt;&gt;<br>
&gt;<br>
&gt; The agent is periodically restarting the engine VM but from the logs I don&#39;t<br>
&gt; see why.<br>
<br>
</span>Also it keeps doing:<br>
<br></blockquote><div><br></div></span><div>Yes, this is fine: by design ovirt-ha-agent periodically (about 30-40 seconds) reconnects the hosted-engine storage domain.</div><div><div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
MainThread::INFO::2016-10-09<br>
17:06:01,025::hosted_engine::6<wbr>12::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(_initialize_vdsm)<br>
Initializing VDSM<br>
MainThread::INFO::2016-10-09<br>
17:06:05,118::hosted_engine::6<wbr>39::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(_initialize_storage_images)<br>
Connecting the storage<br>
MainThread::INFO::2016-10-09<br>
17:06:05,131::storage_server::<wbr>218::<a href="http://ovirt_hosted_engine_ha.li" target="_blank">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.StorageServer<wbr>::(connect_storage_server)<br>
Connecting storage server<br>
MainThread::INFO::2016-10-09<br>
17:06:13,459::storage_server::<wbr>225::<a href="http://ovirt_hosted_engine_ha.li" target="_blank">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.StorageServer<wbr>::(connect_storage_server)<br>
Connecting storage server<br>
MainThread::INFO::2016-10-09<br>
17:06:13,496::storage_server::<wbr>232::<a href="http://ovirt_hosted_engine_ha.li" target="_blank">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.StorageServer<wbr>::(connect_storage_server)<br>
Refreshing the storage domain<br>
MainThread::INFO::2016-10-09<br>
17:06:13,737::hosted_engine::6<wbr>66::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(_initialize_storage_images)<br>
Preparing images<br>
MainThread::INFO::2016-10-09<br>
17:06:13,737::image::126::ovir<wbr>t_hosted_engine_ha.lib.image.I<wbr>mage::(prepare_images)<br>
Preparing images<br>
<br>
Does this make sense, Simone?<br>
<br>
Please check/share also /var/log/vdsm/* . Thanks.<br>
<div><div><br>
&gt; Can you please set the agent in debug mode and share again its logs?<br>
&gt;<br>
&gt; You have to edit /etc/ovirt-hosted-engine-ha/ag<wbr>ent-log.conf changing from<br>
&gt;<br>
&gt; [logger_root]<br>
&gt; level=INFO<br>
&gt;<br>
&gt; to<br>
&gt; [logger_root]<br>
&gt; level=DEBUG<br>
&gt;<br>
&gt; and then restart ovirt-ha-agent.<br>
&gt;<br>
&gt;<br>
&gt;&gt;<br>
&gt;&gt; On Sun, Oct 9, 2016 at 3:19 PM, Doron Fediuck &lt;<a href="mailto:dfediuck@redhat.com" target="_blank">dfediuck@redhat.com</a>&gt; wrote:<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; Can you please provide the HA agent logs?<br>
&gt;&gt;&gt;<br>
&gt;&gt;&gt; On Sun, Oct 9, 2016 at 1:57 PM, Susinthiran Sithamparanathan<br>
&gt;&gt;&gt; &lt;<a href="mailto:chesusin@gmail.com" target="_blank">chesusin@gmail.com</a>&gt; wrote:<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt; Hi,<br>
&gt;&gt;&gt;&gt; i&#39;ve been discussing this issue over at IRC (#ovirt on <a href="http://irc.oftc.net" rel="noreferrer" target="_blank">irc.oftc.net</a>))<br>
&gt;&gt;&gt;&gt; and was suggested to send an email with logs the ML.<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt; The problem i have is that the HE is a loop getting up and down ( ( i<br>
&gt;&gt;&gt;&gt; assume it&#39;s the HA trying to get it up) after upgrade to oVirt 4. I have a<br>
&gt;&gt;&gt;&gt; couple of VMs i use daily with SPICE and remoteviewer and i hope to get them<br>
&gt;&gt;&gt;&gt; up and running again. Due to this, i&#39;ve put it in global maintenance mode.<br>
&gt;&gt;&gt;&gt; I&#39;m attaching the server log in the hope of getting some help and can<br>
&gt;&gt;&gt;&gt; provide more details if needed to debug the issue further.<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt; The log is too big for fpaste so it&#39;s to be found here:<br>
&gt;&gt;&gt;&gt; <a href="https://my.owndrive.com/index.php/s/Gk4De1jy9fWmFa8" rel="noreferrer" target="_blank">https://my.owndrive.com/index.<wbr>php/s/Gk4De1jy9fWmFa8</a> as well as attached<br>
&gt;&gt;&gt;&gt; here.<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt; Thanks!<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt; --<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt; Susinthiran Sithamparanathan<br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;&gt; ______________________________<wbr>_________________<br>
&gt;&gt;&gt;&gt; Users mailing list<br>
&gt;&gt;&gt;&gt; <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
&gt;&gt;&gt;&gt; <a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
&gt;&gt;&gt;&gt;<br>
&gt;&gt;&gt;<br>
&gt;&gt;<br>
&gt;&gt;<br>
&gt;&gt;<br>
&gt;&gt; --<br>
&gt;&gt;<br>
&gt;&gt; Susinthiran Sithamparanathan<br>
&gt;&gt;<br>
&gt;&gt; ______________________________<wbr>_________________<br>
&gt;&gt; Users mailing list<br>
&gt;&gt; <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
&gt;&gt; <a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
&gt;&gt;<br>
&gt;<br>
&gt;<br>
&gt; ______________________________<wbr>_________________<br>
&gt; Users mailing list<br>
&gt; <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
&gt; <a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
&gt;<br>
<br>
<br>
<br>
--<br>
</div></div>Didi<br>
</blockquote></div></div></div><br></div></div>
</blockquote></div><br><br clear="all"><br></div></div><span class="gmail-HOEnZb"><font color="#888888">-- <br><div><div dir="ltr"><br>Susinthiran Sithamparanathan</div></div>
</font></span></div>
</blockquote></div><br></div></div>