<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Jan 11, 2017 at 10:53 AM, Piotr Kliczewski <span dir="ltr"><<a href="mailto:piotr.kliczewski@gmail.com" target="_blank">piotr.kliczewski@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5">On Wed, Jan 11, 2017 at 9:29 AM, Yaniv Kaul <<a href="mailto:ykaul@redhat.com">ykaul@redhat.com</a>> wrote:<br>
><br>
><br>
> On Wed, Jan 11, 2017 at 10:26 AM, Francesco Romani <<a href="mailto:fromani@redhat.com">fromani@redhat.com</a>><br>
> wrote:<br>
>><br>
>> Hi all<br>
>><br>
>><br>
>> On 01/11/2017 08:52 AM, Eyal Edri wrote:<br>
>><br>
>> Adding Tomas from Virt.<br>
>><br>
>> On Tue, Jan 10, 2017 at 10:54 AM, Piotr Kliczewski<br>
>> <<a href="mailto:piotr.kliczewski@gmail.com">piotr.kliczewski@gmail.com</a>> wrote:<br>
>>><br>
>>> On Tue, Jan 10, 2017 at 9:29 AM, Daniel Belenky <<a href="mailto:dbelenky@redhat.com">dbelenky@redhat.com</a>><br>
>>> wrote:<br>
>>> > Hi all,<br>
>>> ><br>
>>> > test-repo_ovirt_experimental_<wbr>master (link to Jenkins) job failed on<br>
>>> > basic_sanity scenario.<br>
>>> > The job was triggered by <a href="https://gerrit.ovirt.org/#/c/69845/" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/#/c/<wbr>69845/</a><br>
>>> ><br>
>>> > From looking at the logs, it seems that the reason is VDSM.<br>
>>> ><br>
>>> > In the VDSM log, i see the following error:<br>
>>> ><br>
>>> > 2017-01-09 16:47:41,331 ERROR (JsonRpc (StompReactor)) [vds.dispatcher]<br>
>>> > SSL<br>
>>> > error receiving from <yajsonrpc.betterAsyncore.<wbr>Dispatcher connected<br>
>>> > ('::1',<br>
>>> > 34942, 0, 0) at 0x36b95f0>: unexpected eof (betterAsyncore:119)<br>
>><br>
>><br>
>> Daniel, could you please remind me the jenkins link? I see something<br>
>> suspicious on the Vdsm log.<br>
><br>
><br>
> Please use my live system:<br>
> ssh <a href="mailto:mini@ykaul-mini.tlv.redhat.com">mini@ykaul-mini.tlv.redhat.com</a> (qum5net)<br>
> then run a console to the VM:<br>
> lagocli --prefix-path /dev/shm/run/current shell engine<br>
><br>
> (or 'host0' for the host)<br>
><br>
>> Most notably, Vdsm received SIGTERM. Is this expected and part of the<br>
>> test?<br>
><br>
><br>
> It's not.<br>
><br>
><br>
>><br>
>><br>
>><br>
>>> ><br>
>>><br>
>>> This issue means that the client closed connection while vdsm was<br>
>>> replying. It can happen at any time<br>
>>> when the client is not nice with the connection. As you can see the<br>
>>> client connected locally '::1'.<br>
>>><br>
>>> ><br>
>>> > Also, when looking at the MOM logs, I see the the following:<br>
>>> ><br>
>>> > 2017-01-09 16:43:39,508 - mom.vdsmInterface - ERROR - Cannot connect to<br>
>>> > VDSM! [Errno 111] Connection refused<br>
>>> ><br>
>>><br>
>>> Looking at the log at this time vdsm had no open socket.<br>
>><br>
>><br>
>><br>
>> Correct, but IIRC we have a race on startup - that's the reason why MOM<br>
>> retries to connect. After the new try, MOM seems to behave<br>
>> correctly:<br>
>><br>
>> 2017-01-09 16:44:05,672 - mom.RPCServer - INFO - ping()<br>
>> 2017-01-09 16:44:05,673 - mom.RPCServer - INFO - getStatistics()<br>
><br>
><br>
> But there are multiple other disconnections, without anything in mom log:<br>
><br>
> [root@lago-basic-suite-master-<wbr>host0 vdsm]# grep SSL /var/log/vdsm/vdsm.log<br>
> |grep "::1"<br>
> 2017-01-11 02:29:46,310 ERROR (JsonRpc (StompReactor)) [vds.dispatcher] SSL<br>
> error receiving from <yajsonrpc.betterAsyncore.<wbr>Dispatcher connected ('::1',<br>
> 49046, 0, 0) at 0x39bf1b8>: unexpected eof (betterAsyncore:119)<br>
> 2017-01-11 02:29:51,089 ERROR (JsonRpc (StompReactor)) [vds.dispatcher] SSL<br>
> error receiving from <yajsonrpc.betterAsyncore.<wbr>Dispatcher connected ('::1',<br>
> 49048, 0, 0) at 0x39d1ea8>: unexpected eof (betterAsyncore:119)<br>
> 2017-01-11 02:29:51,392 ERROR (JsonRpc (StompReactor)) [vds.dispatcher] SSL<br>
> error receiving from <yajsonrpc.betterAsyncore.<wbr>Dispatcher connected ('::1',<br>
> 49050, 0, 0) at 0x39d1710>: unexpected eof (betterAsyncore:119)<br>
> 2017-01-11 02:29:51,700 ERROR (JsonRpc (StompReactor)) [vds.dispatcher] SSL<br>
> error receiving from <yajsonrpc.betterAsyncore.<wbr>Dispatcher connected ('::1',<br>
> 49052, 0, 0) at 0x39d1128>: unexpected eof (betterAsyncore:119)<br>
> 2017-01-11 02:29:52,008 ERROR (JsonRpc (StompReactor)) [vds.dispatcher] SSL<br>
> error receiving from <yajsonrpc.betterAsyncore.<wbr>Dispatcher connected ('::1',<br>
> 49054, 0, 0) at 0x39d1128>: unexpected eof (betterAsyncore:119)<br>
> 2017-01-11 02:37:34,019 ERROR (JsonRpc (StompReactor)) [vds.dispatcher] SSL<br>
> error receiving from <yajsonrpc.betterAsyncore.<wbr>Dispatcher connected ('::1',<br>
> 49032, 0, 0) at 0x380cef0>: unexpected eof (betterAsyncore:119)<br>
><br>
<br>
</div></div>If there is no hosted engine this could be only mom. This is<br>
indication of connection closure.<br></blockquote><div><br></div><div>There is no hosted-engine, although the services are installed (since we've installed the Cockpit stuff) - but not working.</div><div>Y.</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div class="HOEnZb"><div class="h5"><br>
><br>
>><br>
>><br>
>><br>
>> --<br>
>> Francesco Romani<br>
>> Red Hat Engineering Virtualization R & D<br>
>> IRC: fromani<br>
>><br>
>><br>
>> ______________________________<wbr>_________________<br>
>> Devel mailing list<br>
>> <a href="mailto:Devel@ovirt.org">Devel@ovirt.org</a><br>
>> <a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/devel</a><br>
><br>
><br>
><br>
> ______________________________<wbr>_________________<br>
> Devel mailing list<br>
> <a href="mailto:Devel@ovirt.org">Devel@ovirt.org</a><br>
> <a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/devel</a><br>
</div></div></blockquote></div><br></div></div>