<div dir="ltr">Actually it appears that this failure is not engine related (tried reverting my patches from saturday but still received similar errors with lago in the <span style="font-size:17.6px">[ add_secondary_storag</span><wbr style="font-size:17.6px"><span style="font-size:17.6px">e_domains] test</span>).<div>But when running the current engine master with VDSM cutoff before the time of failure, it passed <a href="http://jenkins.ovirt.org/job/ovirt-system-tests_manual/229/">http://jenkins.ovirt.org/job/ovirt-system-tests_manual/229/</a></div><div><br></div><div>This was the VDSM commit that *worked* </div><table class="gmail-pane" style="box-sizing:border-box;font-family:helvetica,arial,sans-serif;font-size:14px;line-height:1.4em;color:rgb(51,51,51);width:1355.45px;border-collapse:collapse;border:none"><tbody style="box-sizing:border-box"><tr class="gmail-pane" style="box-sizing:border-box"><td colspan="2" class="gmail-changeset" style="box-sizing:border-box;font-family:helvetica,arial,sans-serif;line-height:1.4em;vertical-align:middle;padding:4px 4px 3px"><a name="5c8aff6177bdaa81ee11c20d417c9bb10e651fb8" style="box-sizing:border-box"></a><div class="gmail-changeset-message" style="box-sizing:border-box;border:1px solid rgb(204,204,187);background:rgb(238,238,221);padding:4px"><b style="box-sizing:border-box">Commit 5c8aff6177bdaa81ee11c20d417c9bb10e651fb8 by <a href="http://jenkins.ovirt.org/user/fromani@redhat.com/" style="box-sizing:border-box;color:rgb(92,53,102)">Francesco Romani</a></b></div></td></tr></tbody></table></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Apr 10, 2017 at 11:08 AM, Michal Skrivanek <span dir="ltr">&lt;<a href="mailto:michal.skrivanek@redhat.com" target="_blank">michal.skrivanek@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><span class=""><br>
&gt; On 9 Apr 2017, at 09:42, Barak Korren &lt;<a href="mailto:bkorren@redhat.com">bkorren@redhat.com</a>&gt; wrote:<br>
&gt;<br>
&gt; On 9 April 2017 at 10:39, Yaniv Kaul &lt;<a href="mailto:ykaul@redhat.com">ykaul@redhat.com</a>&gt; wrote:<br>
&gt;&gt; 1. The error:<br>
&gt;&gt; 2017-04-08 14:12:11,376-04 ERROR<br>
&gt;&gt; [org.ovirt.vdsm.jsonrpc.<wbr>client.JsonRpcClient] (ResponseWorker) [] Not able<br>
&gt;&gt; to update response for &quot;fc0cef3f-d8fa-4074-b315-<wbr>e36cc2f63fa1&quot;<br>
&gt;&gt;<br>
&gt;&gt; Is still seen, not sure why.<br>
&gt;&gt;<br>
&gt;&gt; 2. MOM is not available (unrelated, but still a bug)<br>
&gt;&gt;<br>
&gt;&gt; 3. New error I have not seen in the past on host1<br>
&gt;&gt; (<a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/6257/artifact/exported-artifacts/basic-suit-master-el7/test_logs/basic-suite-master/post-002_bootstrap.py/lago-basic-suite-master-host1/_var_log/vdsm/vdsm.log" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/<wbr>test-repo_ovirt_experimental_<wbr>master/6257/artifact/exported-<wbr>artifacts/basic-suit-master-<wbr>el7/test_logs/basic-suite-<wbr>master/post-002_bootstrap.py/<wbr>lago-basic-suite-master-host1/<wbr>_var_log/vdsm/vdsm.log</a><br>
&gt;&gt; ) :<br>
&gt;&gt;<br>
&gt;&gt; 2017-04-08 14:12:22,208-0400 WARN  (jsonrpc/6) [storage.LVM] lvm pvs failed:<br>
&gt;&gt; 5 [] [&#39;  Failed to find physical volume<br>
&gt;&gt; &quot;/dev/mapper/<wbr>360014050eacbb3c8b21428fb6683f<wbr>074&quot;.&#39;] (lvm:325)<br>
&gt;&gt;<br>
&gt;&gt; 4. New warning:<br>
&gt;&gt; 2017-04-08 14:13:17,327-0400 WARN  (check/loop) [storage.asyncutils] Call<br>
&gt;&gt; &lt;bound method DirectioChecker._check of &lt;DirectioChecker<br>
&gt;&gt; /dev/0eb0f05c-0507-4f02-ba13-<wbr>b8d865538d7a/metadata running<br>
&gt;&gt; next_check=4295183.36 at 0x2fb9190&gt;&gt; delayed by 1.43 seconds<br>
&gt;&gt; (asyncutils:138)<br>
&gt;&gt;<br>
&gt;&gt;<br>
&gt;&gt; Do we know when it began?<br>
&gt;<br>
&gt; Yes. I linked to the patch that seems to have started this.<br>
<br>
</span>This should be easy to revert<br>
Working on it<br>
Then we’ll see what exactly is the culprit<br>
<span class="im HOEnZb"><br>
&gt;<br>
&gt;<br>
&gt;<br>
&gt; --<br>
&gt; Barak Korren<br>
&gt; <a href="mailto:bkorren@redhat.com">bkorren@redhat.com</a><br>
&gt; RHCE, RHCi, RHV-DevOps Team<br>
&gt; <a href="https://ifireball.wordpress.com/" rel="noreferrer" target="_blank">https://ifireball.wordpress.<wbr>com/</a><br>
</span><div class="HOEnZb"><div class="h5">&gt; ______________________________<wbr>_________________<br>
&gt; Devel mailing list<br>
&gt; <a href="mailto:Devel@ovirt.org">Devel@ovirt.org</a><br>
&gt; <a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/devel</a><br>
&gt;<br>
&gt;<br>
<br>
______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/devel</a></div></div></blockquote></div><br></div>