<div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote">On Thu, May 11, 2017 at 7:34 PM, Anton Marchukov <span dir="ltr"><<a href="mailto:amarchuk@redhat.com" target="_blank">amarchuk@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hello All.<div><br></div><div>We checked the OST and so far it looks like it is correct for master. It does use the latest SDK4 version built by the job triggered as part of the fix [1]. It is visible at console log [2]:<br></div><div><br></div><div><pre class="gmail-m_-6650049972975585349gmail-console-output" style="box-sizing:border-box;white-space:pre-wrap;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:14px"><span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:50:44</b> </span>[basic_suit_el7] Updated:
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:50:44</b> </span>[basic_suit_el7] python-ovirt-engine-sdk4.x86_<wbr>64 0:4.2.0-1.a0.<wbr>20170511git210c375.el7.centos </pre></div></div></blockquote><div><br></div><div>This is incorrect version. The correct one is:<br><br> <a id="gmail-ygtvlabelel18" class="gmail-ygtvlabel" href="http://jenkins.ovirt.org/job/python-ovirt-engine-sdk4_master_build-artifacts-el7-x86_64/71/artifact/exported-artifacts/python-ovirt-engine-sdk4-4.2.0-1.a0.20170511gitcd0adb4.el7.centos.x86_64.rpm" target="_self">python-ovirt-engine-sdk4-4.2.0-1.a0.20170511gitcd0adb4.el7.centos.x86_64.rpm</a><br><br></div><div>From this build:<br><br> <a href="http://jenkins.ovirt.org/job/python-ovirt-engine-sdk4_master_build-artifacts-el7-x86_64/71/">http://jenkins.ovirt.org/job/python-ovirt-engine-sdk4_master_build-artifacts-el7-x86_64/71/</a><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><pre class="gmail-m_-6650049972975585349gmail-console-output" style="box-sizing:border-box;white-space:pre-wrap;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:14px"><br></pre>Also checking the fix at [1] I see that according to the stacktrace from [2] we fail at send():</div><div><br></div><div><pre class="gmail-m_-6650049972975585349gmail-console-output" style="box-sizing:border-box;white-space:pre-wrap;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:14px"><span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] <span style="box-sizing:border-box;color:rgb(205,0,0)">Error while running thread
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] Traceback (most recent call last):
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] File "/usr/lib/python2.7/site-<wbr>packages/lago/utils.py", line 58, in _ret_via_queue
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] queue.put({'return': func()})
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] File "/home/jenkins/workspace/test-<wbr>repo_ovirt_experimental_<wbr>master/ovirt-system-tests/<wbr>basic-suite-master/test-<wbr>scenarios/002_bootstrap.py", line 327, in _add_host_4
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] name=CLUSTER_NAME,
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] File "/usr/lib64/python2.7/site-<wbr>packages/ovirtsdk4/services.<wbr>py", line 8726, in add
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] return self._internal_add(host, headers, query, wait)
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] File "/usr/lib64/python2.7/site-<wbr>packages/ovirtsdk4/service.py"<wbr>, line 211, in _internal_add
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] context = self._connection.send(request)
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] File "/usr/lib64/python2.7/site-<wbr>packages/ovirtsdk4/__init__.<wbr>py", line 300, in send
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] sys.exc_info()[2]
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] File "/usr/lib64/python2.7/site-<wbr>packages/ovirtsdk4/__init__.<wbr>py", line 295, in send
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] return self.__send(request)
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] File "/usr/lib64/python2.7/site-<wbr>packages/ovirtsdk4/__init__.<wbr>py", line 413, in __send
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] self._multi.add_handle(curl)
<span class="gmail-m_-6650049972975585349gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">15:56:58</b> </span>[basic_suit_el7] Error: ('Error while sending HTTP request', error('cannot add/remove handle - multi_perform() already running',))</span></pre><pre class="gmail-m_-6650049972975585349gmail-console-output" style="box-sizing:border-box;white-space:pre-wrap;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:14px"><br></pre></div>While at the fix [1] I see the lock is added to wait() method while according to the stacktrace we have we fail at send() method and as I see the wait() is executed by _internal_add() later. So that code added at [1] is not executed yet.</div></blockquote><div><br></div><div>The send() method already has a lock.<br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><br></div><div>Do we have any other fix that we have missed? Just want to make sure we track the correct gerrit fix through our system.</div></div></blockquote><div><br></div><div>This patch should be correct fix.<br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><br></div><div>Anton.<br><div><br></div><div>[1] <a href="https://gerrit.ovirt.org/#/c/76713/" target="_blank">https://gerrit.ovirt.org/#<wbr>/c/76713/</a></div><div>[2] <a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/6643/consoleFull" target="_blank">http://jenkins.ovirt.org/<wbr>job/test-repo_ovirt_<wbr>experimental_master/6643/<wbr>consoleFull</a></div><div><br></div><div><br></div></div></div><div class="gmail_extra"><br><div class="gmail_quote"><span class="gmail-">On Thu, May 11, 2017 at 5:31 PM, Eyal Edri <span dir="ltr"><<a href="mailto:eedri@redhat.com" target="_blank">eedri@redhat.com</a>></span> wrote:<br></span><div><div class="gmail-h5"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">We are aware of this failure.<div>Initially it was a bug in SDK4 and was (probably) fixed by Ondra,</div><div>But now we have another bug in repoman which takes an older SDK version instead of latest.</div><div><br></div><div>We're working on a fix as we speak.</div></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="gmail-m_-6650049972975585349h5">On Thu, May 11, 2017 at 6:26 PM, Nir Soffer <span dir="ltr"><<a href="mailto:nsoffer@redhat.com" target="_blank">nsoffer@redhat.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div class="gmail-m_-6650049972975585349h5"><div dir="ltr">I got this failure in 4.1 build[1], which should not be relevant to<div>the tested patch[2] - is this a known issue?<div><br></div><div><pre class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-console-output" style="box-sizing:border-box;white-space:pre-wrap;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:16px"><span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span><span style="box-sizing:border-box;color:rgb(0,205,205)"> # add_hosts: </span>
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span><span style="box-sizing:border-box;color:rgb(205,0,0)">Error while running thread
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span>Traceback (most recent call last):
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span> File "/usr/lib/python2.7/site-packa<wbr>ges/lago/utils.py", line 58, in _ret_via_queue
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span> queue.put({'return': func()})
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span> File "/home/jenkins/workspace/ovirt<wbr>-system-tests_manual/ovirt-sys<wbr>tem-tests/basic-suite-4.1/test<wbr>-scenarios/002_bootstrap.py", line 320, in _add_host_4
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span> name=CLUSTER_NAME,
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span> File "/usr/lib64/python2.7/site-pac<wbr>kages/ovirtsdk4/services.py", line 8726, in add
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span> return self._internal_add(host, headers, query, wait)
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span> File "/usr/lib64/python2.7/site-pac<wbr>kages/ovirtsdk4/service.py", line 211, in _internal_add
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span> context = self._connection.send(request)
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span> File "/usr/lib64/python2.7/site-pac<wbr>kages/ovirtsdk4/__init__.py", line 300, in send
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span> sys.exc_info()[2]
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span> File "/usr/lib64/python2.7/site-pac<wbr>kages/ovirtsdk4/__init__.py", line 295, in send
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span> return self.__send(request)
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span> File "/usr/lib64/python2.7/site-pac<wbr>kages/ovirtsdk4/__init__.py", line 413, in __send
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span> self._multi.add_handle(curl)
<span class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">13:31:47</b> </span>Error: ('Error while sending HTTP request', error('cannot add/remove handle - multi_perform() already running',))</span>
</pre><br class="gmail-m_-6650049972975585349m_1352450990502511968m_432563712520754776inbox-inbox-Apple-interchange-newline"></div></div><div>[1] <a href="http://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-tests_manual/374/console" target="_blank">http://jenkins.ovirt.org/v<wbr>iew/oVirt%20system%20tests/job<wbr>/ovirt-system-tests_manual/374<wbr>/console</a></div><div>[2] <a href="https://gerrit.ovirt.org/76645" target="_blank">https://gerrit.ovirt.org/7<wbr>6645</a></div><span class="gmail-m_-6650049972975585349m_1352450990502511968HOEnZb"><font color="#888888"><div><br></div><div>Nir</div></font></span></div>
<br></div></div>______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org" target="_blank">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/devel</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail-m_-6650049972975585349m_1352450990502511968gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><p style="font-family:overpass,sans-serif;margin:0px;padding:0px;font-size:14px;text-transform:uppercase;font-weight:bold"><font color="#cc0000">Eyal edri</font></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><br></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">ASSOCIATE MANAGER</p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">RHV DevOps</p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">EMEA VIRTUALIZATION R&D</p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><br></p><p style="font-family:overpass,sans-serif;margin:0px;font-size:10px;color:rgb(153,153,153)"><a href="https://www.redhat.com/" style="color:rgb(0,136,206);margin:0px" target="_blank">Red Hat EMEA</a></p><table style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium" border="0"><tbody><tr><td width="100px"><a href="https://red.ht/sig" style="color:rgb(17,85,204)" target="_blank"><img width="90" height="auto"></a></td><td style="font-size:10px"><a href="https://redhat.com/trusted" style="color:rgb(204,0,0);font-weight:bold" target="_blank">TRIED. TESTED. TRUSTED.</a></td></tr></tbody></table></div><div>phone: <a href="tel:+972%209-769-2018" value="+97297692018" target="_blank">+972-9-7692018</a><br>irc: eedri (on #tlv #rhev-dev #rhev-integ)</div></div></div></div></div></div></div></div></div>
</div>
</blockquote></div></div></div><br><br clear="all"><span class="gmail-"><div><br></div>-- <br><div class="gmail-m_-6650049972975585349gmail_signature"><div dir="ltr"><div><div dir="ltr"><span><font color="#888888"><div>Anton Marchukov<br>Senior Software Engineer - <span><span><font color="#888888"><span><span><font color="#888888"><span><span><font color="#888888">RHEV CI - </font></span></span></font></span></span>Red Hat</font></span></span><br><br></div></font></span></div></div></div></div>
</span></div>
</blockquote></div><br></div></div>