<div dir="ltr">I've gotten more reports about this timeout still happening on VDSM check-patch.<div>As the test itself is run in mock, all the environment is deleted after the job run so there isn't an affected environment to log in and check out. The node itself doesn't even have openvswitch installed on it. Can I provide some more info to get this moving?</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Mar 28, 2018 at 9:50 AM, Edward Haas <span dir="ltr"><<a href="mailto:ehaas@redhat.com" target="_blank">ehaas@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>What I find very strange is that there are multiple threads that execute the same line (or perhaps I do not interpret the gdb output correctly).<br><br></div>Can I get access to such a slave to debug this?<br></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Mar 28, 2018 at 10:12 AM, Dan Kenigsberg <span dir="ltr"><<a href="mailto:danken@redhat.com" target="_blank">danken@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">We still have no guess regarding what made this pop up. I can confirm that this happens quite often, on different slaves. E.g<br><a href="http://jenkins.ovirt.org/job/vdsm_master_check-patch-el7-x86_64/22648/console" target="_blank">http://jenkins.ovirt.org/job/v<wbr>dsm_master_check-patch-el7-x86<wbr>_64/22648/console</a><br>where the command <br><pre class="m_783118937992958834m_-2532391477990634820gmail-console-output">'/usr/bin/ovs-vsctl', '--oneline', '--format=json', '--', 'add-br', 'vdsmbr_test', '--', 'list', 'Bridge'</pre>gets stuck.<div><div class="m_783118937992958834h5"><br><br><br><div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Mar 26, 2018 at 7:20 PM, Dafna Ron <span dir="ltr"><<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div><div>Adding Gal. <br><br></div>Gal, can this be related to the timeout you added? <br><br></div>thanks, <br></div>Dafna<br><br></div><div class="m_783118937992958834m_-2532391477990634820gmail-HOEnZb"><div class="m_783118937992958834m_-2532391477990634820gmail-h5"><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Mar 26, 2018 at 2:24 PM, Eyal Edri <span dir="ltr"><<a href="mailto:eedri@redhat.com" target="_blank">eedri@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Not sure its an infra issue, but adding Evgheni to help if needed.</div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223h5">On Mon, Mar 26, 2018 at 3:48 PM, Shani Leviim <span dir="ltr"><<a href="mailto:sleviim@redhat.com" target="_blank">sleviim@redhat.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div><div class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223h5"><div dir="ltr"><div style="font-family:tahoma,sans-serif;font-size:small"><pre class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-console-output"><span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>Hi,<br></b></span></pre><pre class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-console-output"><span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>I'm trying to verify an ovirt-4.2 patch on vdsm, but the ci keep failing due to a timeout on </b></span><br><b>network.ovs_driver_test.TestOv<wbr>sApiBase<span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"> test [1]. </span></b><br></pre><pre class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-console-output"><b>That heppen for both jobs 166 and 167 (I've tryied to retrigger). <br>(Links below).<br><br>Can you please assist?<br>Thanks!</b><br></pre><pre class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-console-output"></pre><pre class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-console-output"><span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b><br><a href="http://jenkins.ovirt.org/job/vdsm_4.2_check-patch-el7-x86_64/166/consoleFull" target="_blank">http://jenkins.ovirt.org/job/v<wbr>dsm_4.2_check-patch-el7-x86_64<wbr>/166/consoleFull</a><br><a href="http://jenkins.ovirt.org/job/vdsm_4.2_check-patch-el7-x86_64/167/console" target="_blank">http://jenkins.ovirt.org/job/v<wbr>dsm_4.2_check-patch-el7-x86_64<wbr>/167/console</a><br><br>[1]<br><br>08:22:55</b> </span>network.ovs_driver_test.TestOv<wbr>sApiBase
<span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>08:22:55</b> </span> test_execute_a_single_command OK
<span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>08:26:56</b> </span> test_execute_a_transaction ______________________________<wbr>_____ summary ______________________________<wbr>______
<span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>08:26:56</b> </span> pylint: commands succeeded
<span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>08:26:56</b> </span> congratulations :)
<span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>08:30:53</b> </span>
<span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>08:30:53</b> </span>==============================<wbr>==============================<wbr>============
<span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>08:30:53</b> </span>= Watched process timed out =
<span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>08:30:53</b> </span>==============================<wbr>==============================<wbr>============
<span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>08:30:53</b> </span>
<span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>08:30:53</b> </span>[Thread debugging using libthread_db enabled]
<span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>08:30:53</b> </span>Using host libthread_db library "/lib64/libthread_db.so.1".
<span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>08:30:54</b> </span>0x00007f6a10ca6a3d in poll () at ../sysdeps/unix/syscall-templa<wbr>te.S:81
<span class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail-timestamp"><b>08:30:54</b> </span>81 T_PSEUDO (SYSCALL_SYMBOL, SYSCALL_NAME, SYSCALL_NARGS)</pre><br clear="all"></div><div><div class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803m_-7298599516500280763gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><span style="font-family:tahoma,sans-serif"><b>Regards,<br></b></span></div><span style="font-family:tahoma,sans-serif"><b>Shani Leviim<br></b></span></div></div></div></div></div>
</div>
<br></div></div>______________________________<wbr>_________________<br>
Infra mailing list<br>
<a href="mailto:Infra@ovirt.org" target="_blank">Infra@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/infra</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="m_783118937992958834m_-2532391477990634820gmail-m_-1004077642715666223m_-1745879714016925803gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><p style="font-family:overpass,sans-serif;margin:0px;padding:0px;font-size:14px;text-transform:uppercase;font-weight:bold"><font color="#cc0000">Eyal edri</font></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><br></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">MANAGER</p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">RHV DevOps</p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">EMEA VIRTUALIZATION R&D</p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><br></p><p style="font-family:overpass,sans-serif;margin:0px;font-size:10px;color:rgb(153,153,153)"><a href="https://www.redhat.com/" style="color:rgb(0,136,206);margin:0px" target="_blank">Red Hat EMEA</a></p><table style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium" border="0"><tbody><tr><td width="100px"><a href="https://red.ht/sig" style="color:rgb(17,85,204)" target="_blank"><img width="90" height="auto"></a></td><td style="font-size:10px"><a href="https://redhat.com/trusted" style="color:rgb(204,0,0);font-weight:bold" target="_blank">TRIED. TESTED. TRUSTED.</a></td></tr></tbody></table></div><div>phone: <a href="tel:+972%209-769-2018" value="+97297692018" target="_blank">+972-9-7692018</a><br>irc: eedri (on #tlv #rhev-dev #rhev-integ)</div></div></div></div></div></div></div></div></div></div></div>
</div>
<br>______________________________<wbr>_________________<br>
Infra mailing list<br>
<a href="mailto:Infra@ovirt.org" target="_blank">Infra@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/infra</a><br>
<br></blockquote></div><br></div>
</div></div></blockquote></div><br></div></div></div></div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div style="font-size:small">Regards,</div><div style="font-size:small">Evgheni Dereveanchin</div></div></div>
</div>