<div dir="ltr">It seems that there was one job that timed out while performing a cleanup [<a href="http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/50/console">1</a>], and ever since every build that tries to use VMs fail.<div>I've cleaned the faulty host.</div><div>I've enqueued the specific change that was dropped out of the cq to be tested again.</div><div><br></div><div>[1] <a href="http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/50/console">http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/50/console</a><br></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Oct 9, 2017 at 1:50 PM, Daniel Belenky <span dir="ltr"><<a href="mailto:dbelenky@redhat.com" target="_blank">dbelenky@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">It seems like a cleanup issue from the previous job that ran on that specific node. I'll try to figure out what happened there.</div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="h5">On Mon, Oct 9, 2017 at 1:16 PM, Dafna Ron <span dir="ltr"><<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="h5">
<div text="#000000" bgcolor="#FFFFFF">
<p>Hi, <br>
</p>
<p>We have a CQ failure with the error:<br>
</p>
<pre class="m_6526843075428601266m_8205509097583305205console-output" style="box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;margin:0px;color:rgb(51,51,51);font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><span style="box-sizing:border-box;color:rgb(205,0,0)">error: [Errno 98] Address already in use</span></pre>
<div class="m_6526843075428601266m_8205509097583305205moz-forward-container"><br>
<br>
<b style="font-weight:normal" id="m_6526843075428601266m_8205509097583305205docs-internal-guid-5859b7a1-00a0-8514-3fa8-2359db2018e0">
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to suspected patches: </span>This
failure is pointing to: <a class="m_6526843075428601266m_8205509097583305205moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/81704/" target="_blank">https://gerrit.ovirt.org/#/c/8<wbr>1704/</a> <br>
</p>
<br>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to Job: <a class="m_6526843075428601266m_8205509097583305205moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt-master_change-queue-teste<wbr>r/3055/</a></span></p>
<br>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to all logs:</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">
</span></p>
<a class="m_6526843075428601266m_8205509097583305205moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/consoleFull" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt-master_change-queue-teste<wbr>r/3055/consoleFull</a><br>
<a class="m_6526843075428601266m_8205509097583305205moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/artifact/" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt-master_change-queue-teste<wbr>r/3055/artifact/</a><br>
<br>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">(Relevant) error snippet from the log: </span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><error></span></p>
<br>
</b><br>
<pre class="m_6526843075428601266m_8205509097583305205console-output" style="box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;margin:0px;color:rgb(51,51,51);font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] <span style="box-sizing:border-box;color:rgb(0,205,205)">@ Deploy oVirt environment: </span><span style="box-sizing:border-box;color:rgb(205,0,0)">ERROR</span> (in 0:00:00)
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] <span style="box-sizing:border-box;color:rgb(205,0,0)">Error occured, aborting
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] Traceback (most recent call last):
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/cmd.py", line 362, in do_run
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] self.cli_plugins[args.ovirtver<wbr>b].do_run(args)
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] File "/usr/lib/python2.7/site-packa<wbr>ges/lago/plugins/cli.py", line 184, in do_run
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] self._do_run(**vars(args))
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] File "/usr/lib/python2.7/site-packa<wbr>ges/lago/utils.py", line 501, in wrapper
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] return func(*args, **kwargs)
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] File "/usr/lib/python2.7/site-packa<wbr>ges/lago/utils.py", line 512, in wrapper
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] return func(*args, prefix=prefix, **kwargs)
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/cmd.py", line 166, in do_deploy
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] prefix.deploy()
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] File "/usr/lib/python2.7/site-packa<wbr>ges/lago/log_utils.py", line 636, in wrapper
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] return func(*args, **kwargs)
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/reposetup.py", line 111, in wrapper
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] with utils.repo_server_context(args<wbr>[0]):
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] File "/usr/lib64/python2.7/contextl<wbr>ib.py", line 17, in __enter__
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] return self.gen.next()
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/utils.py", line 100, in repo_server_context
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] root_dir=prefix.paths.internal<wbr>_repo(),
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/utils.py", line 76, in _create_http_server
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] generate_request_handler(root_<wbr>dir),
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] File "/usr/lib64/python2.7/SocketSe<wbr>rver.py", line 419, in __init__
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] self.server_bind()
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] File "/usr/lib64/python2.7/BaseHTTP<wbr>Server.py", line 108, in server_bind
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] SocketServer.TCPServer.server_<wbr>bind(self)
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] File "/usr/lib64/python2.7/SocketSe<wbr>rver.py", line 430, in server_bind
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] self.socket.bind(self.server_a<wbr>ddress)
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] File "/usr/lib64/python2.7/socket.p<wbr>y", line 224, in meth
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] return getattr(self._sock,name)(*args<wbr>)
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] error: [Errno 98] Address already in use</span>
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] + res=1
<span class="m_6526843075428601266m_8205509097583305205timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">08:36:38</b> </span>[upgrade-from-prevrelease-suit<wbr>] + cd -</pre>
<b style="font-weight:normal" id="m_6526843075428601266m_8205509097583305205docs-internal-guid-5859b7a1-00a0-8514-3fa8-2359db2018e0">
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"></error></span></p>
</b><br class="m_6526843075428601266m_8205509097583305205Apple-interchange-newline">
<br>
<br>
thank you. <br>
Dafna<br>
<br>
<br>
<br>
-------- Forwarded Message --------
<table class="m_6526843075428601266m_8205509097583305205moz-email-headers-table" border="0" cellspacing="0" cellpadding="0">
<tbody>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap>Subject:
</th>
<td>[CQ]: 81704, 6 (ovirt-hosted-engine-setup) failed
"ovirt-master" system tests</td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap>Date: </th>
<td>Mon, 9 Oct 2017 10:05:39 +0000 (UTC)</td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap>From: </th>
<td>oVirt Jenkins <a class="m_6526843075428601266m_8205509097583305205moz-txt-link-rfc2396E" href="mailto:jenkins@ovirt.org" target="_blank"><jenkins@ovirt.org></a></td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap>To: </th>
<td><a class="m_6526843075428601266m_8205509097583305205moz-txt-link-abbreviated" href="mailto:infra@ovirt.org" target="_blank">infra@ovirt.org</a></td>
</tr>
</tbody>
</table>
<br>
<br>
<pre>Change 81704,6 (ovirt-hosted-engine-setup) is probably the reason behind recent
system test failures in the "ovirt-master" change queue and needs to be fixed.
This change had been removed from the testing queue. Artifacts build from this
change will not be released until it is fixed.
For further details about the change see:
<a class="m_6526843075428601266m_8205509097583305205moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/81704/6" target="_blank">https://gerrit.ovirt.org/#/c/8<wbr>1704/6</a>
For failed test results see:
<a class="m_6526843075428601266m_8205509097583305205moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt-master_change-queue-teste<wbr>r/3055/</a>
______________________________<wbr>_________________
Infra mailing list
<a class="m_6526843075428601266m_8205509097583305205moz-txt-link-abbreviated" href="mailto:Infra@ovirt.org" target="_blank">Infra@ovirt.org</a>
<a class="m_6526843075428601266m_8205509097583305205moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/infra" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/infra</a>
</pre>
</div>
</div>
<br></div></div>______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org" target="_blank">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/devel</a><span class="HOEnZb"><font color="#888888"><br></font></span></blockquote></div><span class="HOEnZb"><font color="#888888"><br><br clear="all"><div><br></div>-- <br><div class="m_6526843075428601266gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><span>DANIEL</span> <span>BELENKY</span></p><p style="margin:0px;padding:0px"></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><span>RHV DEVOPS</span></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">EMEA VIRTUALIZATION R&D</p><table style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium" border="0"><tbody><tr><td width="100px"><a href="https://red.ht/sig" target="_blank"><img src="https://www.redhat.com/files/brand/email/sig-redhat.png" width="90" height="auto"></a></td></tr></tbody></table></div></div></div></div></div></div></div></div></div></div></div>
</font></span></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><span>DANIEL</span> <span>BELENKY</span></p><p style="margin:0px;padding:0px"></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><span>RHV DEVOPS</span></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">EMEA VIRTUALIZATION R&D</p><table style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium" border="0"><tbody><tr><td width="100px"><a href="https://red.ht/sig" target="_blank"><img src="https://www.redhat.com/files/brand/email/sig-redhat.png" width="90" height="auto"></a></td></tr></tbody></table></div></div></div></div></div></div></div></div></div></div></div>
</div>