<div dir="auto"><div><br><div class="gmail_extra"><br><div class="gmail_quote">On Dec 2, 2016 2:11 PM, "Anton Marchukov" <<a href="mailto:amarchuk@redhat.com">amarchuk@redhat.com</a>> wrote:<br type="attribution"><blockquote class="quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hello Martin.<div><br></div><div>Do by outdated you mean the old libvirt? If so that is that livirt available in CentOS 7.2? There is no 7.3 yet.</div></div></blockquote></div></div></div><div dir="auto"><br></div><div dir="auto">Right, this is the issue. </div><div dir="auto">Y. </div><div dir="auto"><br></div><div dir="auto"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><font color="#888888"><div><br></div><div>Anton.</div></font></div><div class="elided-text"><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Dec 2, 2016 at 1:07 PM, Martin Polednik <span dir="ltr"><<a href="mailto:mpolednik@redhat.com" target="_blank">mpolednik@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="m_3873929572442477785HOEnZb"><div class="m_3873929572442477785h5">On 02/12/16 10:55 +0100, Anton Marchukov wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Hello All.<br>
<br>
Engine log can be viewed here:<br>
<br>
<a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/3838/artifact/exported-artifacts/basic_suite_master.sh-el7/exported-artifacts/test_logs/basic-suite-master/post-004_basic_sanity.py/lago-basic-suite-master-engine/_var_log_ovirt-engine/engine.log" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/t<wbr>est-repo_ovirt_experimental_ma<wbr>ster/3838/artifact/exported-ar<wbr>tifacts/basic_suite_master.sh-<wbr>el7/exported-artifacts/test_lo<wbr>gs/basic-suite-master/post-004<wbr>_basic_sanity.py/lago-basic-<wbr>suite-master-engine/_var_log_o<wbr>virt-engine/engine.log</a><br>
<br>
I see the following exception there:<br>
<br>
2016-12-02 04:29:24,030-05 DEBUG<br>
[org.ovirt.vdsm.jsonrpc.client<wbr>.internal.ResponseWorker]<br>
(ResponseWorker) [83b6b5d] Message received: {"jsonrpc": "2.0", "id":<br>
"ec254aad-441b-47e7-a644-aebdd<wbr>cc1d62c", "result": true}<br>
2016-12-02 04:29:24,030-05 ERROR<br>
[org.ovirt.vdsm.jsonrpc.client<wbr>.JsonRpcClient] (ResponseWorker)<br>
[83b6b5d] Not able to update response for<br>
"ec254aad-441b-47e7-a644-aebdd<wbr>cc1d62c"<br>
2016-12-02 04:29:24,041-05 DEBUG<br>
[org.ovirt.engine.core.utils.t<wbr>imer.FixedDelayJobListener]<br>
(DefaultQuartzScheduler3) [47a31d72] Rescheduling<br>
DEFAULT.org.ovirt.engine.core.<wbr>bll.gluster.GlusterSyncJob.ref<wbr>reshLightWeightData#-922337203<wbr>6854775775<br>
as there is no unfired trigger.<br>
2016-12-02 04:29:24,024-05 DEBUG<br>
[org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.PollVDSCommand] (default<br>
task-12) [d932871a-af4f-4fc9-9ee5-f7a01<wbr>26a7b85] Exception:<br>
org.ovirt.engine.core.vdsbroke<wbr>r.vdsbroker.VDSNetworkExceptio<wbr>n:<br>
VDSGenericException: VDSNetworkException: Timeout during xml-rpc call<br>
at org.ovirt.engine.core.vdsbroke<wbr>r.vdsbroker.FutureVDSCommand.g<wbr>et(FutureVDSCommand.java:73)<br>
[vdsbroker.jar:]<br>
<br>
....<br>
<br>
2016-12-02 04:29:24,042-05 ERROR<br>
[org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.PollVDSCommand] (default<br>
task-12) [d932871a-af4f-4fc9-9ee5-f7a01<wbr>26a7b85] Timeout waiting for<br>
VDSM response: Internal timeout occured<br>
2016-12-02 04:29:24,044-05 DEBUG<br>
[org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.GetCapabilitiesVD<wbr>SCommand]<br>
(default task-12) [d932871a-af4f-4fc9-9ee5-f7a01<wbr>26a7b85] START,<br>
GetCapabilitiesVDSCommand(Host<wbr>Name = lago-basic-suite-master-host0,<br>
VdsIdAndVdsVDSCommandParameter<wbr>sBase:{runAsync='true',<br>
hostId='5eb7019e-28a3-4f93-918<wbr>8-685b6c64a2f5',<br>
vds='Host[lago-basic-suite-mas<wbr>ter-host0,5eb7019e-28a3-4f93-9<wbr>188-685b6c64a2f5]'}),<br>
log id: 58f448b8<br>
2016-12-02 04:29:24,044-05 DEBUG<br>
[org.ovirt.vdsm.jsonrpc.client<wbr>.reactors.stomp.impl.Message] (default<br>
task-12) [d932871a-af4f-4fc9-9ee5-f7a01<wbr>26a7b85] SEND<br>
destination:jms.topic.vdsm_req<wbr>uests<br>
reply-to:jms.topic.vdsm_respon<wbr>ses<br>
content-length:105<br>
<br>
<br>
Please note that this runs on localhost with local bridge. So it is not<br>
likely to be network itself.<br>
</blockquote>
<br></div></div>
The main issue I see is that the VM run command has actually failed<br>
due to libvirt no accepting /dev/urandom as RNG source[1]. This was<br>
done as engine patch and according to git log, posted around Mon Nov<br>
28. Also adding Jakub - this should either not happen from engine's<br>
point of view or the lago host is outdated.<br>
<br>
[1]<br>
<a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/3838/artifact/exported-artifacts/basic_suite_master.sh-el7/exported-artifacts/test_logs/basic-suite-master/post-004_basic_sanity.py/lago-basic-suite-master-host0/_var_log_vdsm/vdsm.log" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/t<wbr>est-repo_ovirt_experimental_ma<wbr>ster/3838/artifact/exported-ar<wbr>tifacts/basic_suite_master.sh-<wbr>el7/exported-artifacts/test_lo<wbr>gs/basic-suite-master/post-004<wbr>_basic_sanity.py/lago-basic-<wbr>suite-master-host0/_var_log_vd<wbr>sm/vdsm.log</a><div class="m_3873929572442477785HOEnZb"><div class="m_3873929572442477785h5"><br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
Anton.<br>
<br>
On Fri, Dec 2, 2016 at 10:43 AM, Anton Marchukov <<a href="mailto:amarchuk@redhat.com" target="_blank">amarchuk@redhat.com</a>><br>
wrote:<br>
<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
FYI. Experimental flow for master currently fails to run a VM. The tests<br>
times out while waiting for 180 seconds:<br>
<br>
<a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/t<wbr>est-repo_ovirt_experimental_</a><br>
master/3838/testReport/(root)/<wbr>004_basic_sanity/vm_run/<br>
<br>
This is reproducible over 23 runs of this happened tonight, sounds like a<br>
regression to me:<br>
<br>
<a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/t<wbr>est-repo_ovirt_experimental_ma<wbr>ster/</a><br>
<br>
I will update here with additional information once I find it.<br>
<br>
Last successful run was with this patch:<br>
<br>
<a href="https://gerrit.ovirt.org/#/c/66416/" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/#/c/6<wbr>6416/</a> (vdsm: API: move vm parameters fixup<br>
in a method)<br>
<br>
Known to start failing around this patch:<br>
<br>
<a href="https://gerrit.ovirt.org/#/c/67647/" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/#/c/6<wbr>7647/</a> (vdsmapi: fix a typo in string<br>
formatting)<br>
<br>
Please notes that we do not have gating implemented yet, so everything<br>
that was merged in between those patches might have caused this (not<br>
necessary in vdsm project).<br>
<br>
Anton.<br>
--<br>
Anton Marchukov<br>
Senior Software Engineer - RHEV CI - Red Hat<br>
<br>
<br>
</blockquote>
<br>
<br>
-- <br>
Anton Marchukov<br>
Senior Software Engineer - RHEV CI - Red Hat<br>
</blockquote>
<br>
</div></div><div class="m_3873929572442477785HOEnZb"><div class="m_3873929572442477785h5"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org" target="_blank">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/devel</a><br>
</blockquote>
<br>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="m_3873929572442477785gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><span><font color="#888888"><div>Anton Marchukov<br>Senior Software Engineer - <span><span><font color="#888888"><span><span><font color="#888888"><span><span><font color="#888888">RHEV CI - </font></span></span></font></span></span>Red Hat</font></span></span><br><br></div></font></span></div></div></div></div>
</div>
</div><br>______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/devel</a><br></blockquote></div><br></div></div></div>