<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Oct 10, 2016 at 11:27 AM, Susinthiran Sithamparanathan <span dir="ltr"><<a href="mailto:chesusin@gmail.com" target="_blank">chesusin@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div>Hi,<br></div><div>all the logs are now at <a href="https://my.owndrive.com/index.php/s/3Dcyho9bqo7oZs8" target="_blank">https://my.owndrive.com/index.<wbr>php/s/3Dcyho9bqo7oZs8</a><br></div><div><br>I did a quick debug in the VM and i think we are getting closer to the root cause:<br><a href="https://paste.fedoraproject.org/447579/14760912/" target="_blank">https://paste.fedoraproject.<wbr>org/447579/14760912/</a><br><br></div>It seems the SSL/TLS certs are all missing. Now i wonder which RPM package does contain these so that i can try to reinstall it.<br><br></div><div>Appreciate your help so far!<br></div><div><br></div></div></blockquote><div><br></div><div>OK, the issue on the host is just here:</div><div><div>MainThread::DEBUG::2016-10-10 11:18:34,169::brokerlink::282::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(_communicate) Full response: success {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "up"}</div><div>MainThread::DEBUG::2016-10-10 11:18:34,169::brokerlink::255::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(_checked_communicate) Successful response from socket</div><div>MainThread::DEBUG::2016-10-10 11:18:34,170::brokerlink::151::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(get_monitor_status) Success, status {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "up"}</div></div><div><br></div><div>the engine VM goes up but the engine no and so after a certain amount of time it tries again with a reboot.</div><div>We should definitively add a more explicit log entry there!</div><div><br></div><div>Now the point is just why your engine is not starting.</div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div></div><br><div><br></div></div><div class="gmail_extra"><div><div class="gmail-h5"><br><div class="gmail_quote">On Mon, Oct 10, 2016 at 10:17 AM, Simone Tiraboschi <span dir="ltr"><<a href="mailto:stirabos@redhat.com" target="_blank">stirabos@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><span>On Mon, Oct 10, 2016 at 10:13 AM, Yedidyah Bar David <span dir="ltr"><<a href="mailto:didi@redhat.com" target="_blank">didi@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span>On Mon, Oct 10, 2016 at 10:56 AM, Simone Tiraboschi <<a href="mailto:stirabos@redhat.com" target="_blank">stirabos@redhat.com</a>> wrote:<br>
><br>
><br>
> On Sun, Oct 9, 2016 at 5:13 PM, Susinthiran Sithamparanathan<br>
> <<a href="mailto:chesusin@gmail.com" target="_blank">chesusin@gmail.com</a>> wrote:<br>
>><br>
>> Sure, here it is: <a href="https://my.owndrive.com/index.php/s/MFoFyKJVLjzezey" rel="noreferrer" target="_blank">https://my.owndrive.com/index.<wbr>php/s/MFoFyKJVLjzezey</a><br>
>><br>
><br>
> The agent is periodically restarting the engine VM but from the logs I don't<br>
> see why.<br>
<br>
</span>Also it keeps doing:<br>
<br></blockquote><div><br></div></span><div>Yes, this is fine: by design ovirt-ha-agent periodically (about 30-40 seconds) reconnects the hosted-engine storage domain.</div><div><div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
MainThread::INFO::2016-10-09<br>
17:06:01,025::hosted_engine::6<wbr>12::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(_initialize_vdsm)<br>
Initializing VDSM<br>
MainThread::INFO::2016-10-09<br>
17:06:05,118::hosted_engine::6<wbr>39::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(_initialize_storage_images)<br>
Connecting the storage<br>
MainThread::INFO::2016-10-09<br>
17:06:05,131::storage_server::<wbr>218::<a href="http://ovirt_hosted_engine_ha.li" target="_blank">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.StorageServer<wbr>::(connect_storage_server)<br>
Connecting storage server<br>
MainThread::INFO::2016-10-09<br>
17:06:13,459::storage_server::<wbr>225::<a href="http://ovirt_hosted_engine_ha.li" target="_blank">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.StorageServer<wbr>::(connect_storage_server)<br>
Connecting storage server<br>
MainThread::INFO::2016-10-09<br>
17:06:13,496::storage_server::<wbr>232::<a href="http://ovirt_hosted_engine_ha.li" target="_blank">ovirt_hosted_engine_ha.li</a><wbr>b.storage_server.StorageServer<wbr>::(connect_storage_server)<br>
Refreshing the storage domain<br>
MainThread::INFO::2016-10-09<br>
17:06:13,737::hosted_engine::6<wbr>66::ovirt_hosted_engine_ha.age<wbr>nt.hosted_engine.HostedEngine:<wbr>:(_initialize_storage_images)<br>
Preparing images<br>
MainThread::INFO::2016-10-09<br>
17:06:13,737::image::126::ovir<wbr>t_hosted_engine_ha.lib.image.I<wbr>mage::(prepare_images)<br>
Preparing images<br>
<br>
Does this make sense, Simone?<br>
<br>
Please check/share also /var/log/vdsm/* . Thanks.<br>
<div><div><br>
> Can you please set the agent in debug mode and share again its logs?<br>
><br>
> You have to edit /etc/ovirt-hosted-engine-ha/ag<wbr>ent-log.conf changing from<br>
><br>
> [logger_root]<br>
> level=INFO<br>
><br>
> to<br>
> [logger_root]<br>
> level=DEBUG<br>
><br>
> and then restart ovirt-ha-agent.<br>
><br>
><br>
>><br>
>> On Sun, Oct 9, 2016 at 3:19 PM, Doron Fediuck <<a href="mailto:dfediuck@redhat.com" target="_blank">dfediuck@redhat.com</a>> wrote:<br>
>>><br>
>>> Can you please provide the HA agent logs?<br>
>>><br>
>>> On Sun, Oct 9, 2016 at 1:57 PM, Susinthiran Sithamparanathan<br>
>>> <<a href="mailto:chesusin@gmail.com" target="_blank">chesusin@gmail.com</a>> wrote:<br>
>>>><br>
>>>> Hi,<br>
>>>> i've been discussing this issue over at IRC (#ovirt on <a href="http://irc.oftc.net" rel="noreferrer" target="_blank">irc.oftc.net</a>))<br>
>>>> and was suggested to send an email with logs the ML.<br>
>>>><br>
>>>> The problem i have is that the HE is a loop getting up and down ( ( i<br>
>>>> assume it's the HA trying to get it up) after upgrade to oVirt 4. I have a<br>
>>>> couple of VMs i use daily with SPICE and remoteviewer and i hope to get them<br>
>>>> up and running again. Due to this, i've put it in global maintenance mode.<br>
>>>> I'm attaching the server log in the hope of getting some help and can<br>
>>>> provide more details if needed to debug the issue further.<br>
>>>><br>
>>>> The log is too big for fpaste so it's to be found here:<br>
>>>> <a href="https://my.owndrive.com/index.php/s/Gk4De1jy9fWmFa8" rel="noreferrer" target="_blank">https://my.owndrive.com/index.<wbr>php/s/Gk4De1jy9fWmFa8</a> as well as attached<br>
>>>> here.<br>
>>>><br>
>>>><br>
>>>> Thanks!<br>
>>>><br>
>>>><br>
>>>> --<br>
>>>><br>
>>>> Susinthiran Sithamparanathan<br>
>>>><br>
>>>> ______________________________<wbr>_________________<br>
>>>> Users mailing list<br>
>>>> <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
>>>> <a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
>>>><br>
>>><br>
>><br>
>><br>
>><br>
>> --<br>
>><br>
>> Susinthiran Sithamparanathan<br>
>><br>
>> ______________________________<wbr>_________________<br>
>> Users mailing list<br>
>> <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
>> <a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
>><br>
><br>
><br>
> ______________________________<wbr>_________________<br>
> Users mailing list<br>
> <a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
> <a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
><br>
<br>
<br>
<br>
--<br>
</div></div>Didi<br>
</blockquote></div></div></div><br></div></div>
</blockquote></div><br><br clear="all"><br></div></div><span class="gmail-HOEnZb"><font color="#888888">-- <br><div><div dir="ltr"><br>Susinthiran Sithamparanathan</div></div>
</font></span></div>
</blockquote></div><br></div></div>