[CQ]: 81704, 6 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests

Change 81704,6 (ovirt-hosted-engine-setup) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/81704/6 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/

This is a multi-part message in MIME format. --------------F063EB2865FC8DADE581FA1E Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit Hi, We have a CQ failure with the error: error: [Errno 98] Address already in use * Link to suspected patches: This failure is pointing to: https://gerrit.ovirt.org/#/c/81704/ Link to Job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/ Link to all logs: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/consoleFu... http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/artifact/ (Relevant) error snippet from the log: <error> * *08:36:38* [upgrade-from-prevrelease-suit] @ Deploy oVirt environment: ERROR (in 0:00:00) *08:36:38* [upgrade-from-prevrelease-suit] Error occured, aborting *08:36:38* [upgrade-from-prevrelease-suit] Traceback (most recent call last): *08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 362, in do_run *08:36:38* [upgrade-from-prevrelease-suit] self.cli_plugins[args.ovirtverb].do_run(args) *08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 184, in do_run *08:36:38* [upgrade-from-prevrelease-suit] self._do_run(**vars(args)) *08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 501, in wrapper *08:36:38* [upgrade-from-prevrelease-suit] return func(*args, **kwargs) *08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 512, in wrapper *08:36:38* [upgrade-from-prevrelease-suit] return func(*args, prefix=prefix, **kwargs) *08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 166, in do_deploy *08:36:38* [upgrade-from-prevrelease-suit] prefix.deploy() *08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/log_utils.py", line 636, in wrapper *08:36:38* [upgrade-from-prevrelease-suit] return func(*args, **kwargs) *08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/reposetup.py", line 111, in wrapper *08:36:38* [upgrade-from-prevrelease-suit] with utils.repo_server_context(args[0]): *08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ *08:36:38* [upgrade-from-prevrelease-suit] return self.gen.next() *08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/utils.py", line 100, in repo_server_context *08:36:38* [upgrade-from-prevrelease-suit] root_dir=prefix.paths.internal_repo(), *08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/utils.py", line 76, in _create_http_server *08:36:38* [upgrade-from-prevrelease-suit] generate_request_handler(root_dir), *08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__ *08:36:38* [upgrade-from-prevrelease-suit] self.server_bind() *08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in server_bind *08:36:38* [upgrade-from-prevrelease-suit] SocketServer.TCPServer.server_bind(self) *08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind *08:36:38* [upgrade-from-prevrelease-suit] self.socket.bind(self.server_address) *08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/socket.py", line 224, in meth *08:36:38* [upgrade-from-prevrelease-suit] return getattr(self._sock,name)(*args) *08:36:38* [upgrade-from-prevrelease-suit] error: [Errno 98] Address already in use *08:36:38* [upgrade-from-prevrelease-suit] + res=1 *08:36:38* [upgrade-from-prevrelease-suit] + cd - * </error> * thank you. Dafna -------- Forwarded Message -------- Subject: [CQ]: 81704, 6 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests Date: Mon, 9 Oct 2017 10:05:39 +0000 (UTC) From: oVirt Jenkins <jenkins@ovirt.org> To: infra@ovirt.org Change 81704,6 (ovirt-hosted-engine-setup) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/81704/6 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/ _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra --------------F063EB2865FC8DADE581FA1E Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=windows-1252"> </head> <body text="#000000" bgcolor="#FFFFFF"> <p>Hi, <br> </p> <p>We have a CQ failure with the error:<br> </p> <pre class="console-output" style="box-sizing: border-box; white-space: pre-wrap; word-wrap: break-word; margin: 0px; color: rgb(51, 51, 51); font-size: 14px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;"><span style="box-sizing: border-box; color: rgb(205, 0, 0);">error: [Errno 98] Address already in use</span></pre> <div class="moz-forward-container"><br> <br> <b style="font-weight:normal;" id="docs-internal-guid-5859b7a1-00a0-8514-3fa8-2359db2018e0"> <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link to suspected patches: </span>This failure is pointing to: <a class="moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/81704/">https://gerrit.ovirt.org/#/c/81704/</a> <br> </p> <br> <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link to Job: <a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/</a></span></p> <br> <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link to all logs:</span></p> <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;"> </span></p> <a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/consoleFull">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/consoleFull</a><br> <a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/artifact/">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/artifact/</a><br> <br> <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">(Relevant) error snippet from the log: </span></p> <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;"><error></span></p> <br> </b><br> <pre class="console-output" style="box-sizing: border-box; white-space: pre-wrap; word-wrap: break-word; margin: 0px; color: rgb(51, 51, 51); font-size: 14px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;"><span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] <span style="box-sizing: border-box; color: rgb(0, 205, 205);">@ Deploy oVirt environment: </span><span style="box-sizing: border-box; color: rgb(205, 0, 0);">ERROR</span> (in 0:00:00) <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] <span style="box-sizing: border-box; color: rgb(205, 0, 0);">Error occured, aborting <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] Traceback (most recent call last): <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 362, in do_run <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] self.cli_plugins[args.ovirtverb].do_run(args) <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 184, in do_run <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] self._do_run(**vars(args)) <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 501, in wrapper <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] return func(*args, **kwargs) <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 512, in wrapper <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] return func(*args, prefix=prefix, **kwargs) <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 166, in do_deploy <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] prefix.deploy() <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/log_utils.py", line 636, in wrapper <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] return func(*args, **kwargs) <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/reposetup.py", line 111, in wrapper <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] with utils.repo_server_context(args[0]): <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] return self.gen.next() <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/utils.py", line 100, in repo_server_context <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] root_dir=prefix.paths.internal_repo(), <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/utils.py", line 76, in _create_http_server <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] generate_request_handler(root_dir), <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__ <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] self.server_bind() <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in server_bind <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] SocketServer.TCPServer.server_bind(self) <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] self.socket.bind(self.server_address) <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/socket.py", line 224, in meth <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] return getattr(self._sock,name)(*args) <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] error: [Errno 98] Address already in use</span> <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] + res=1 <span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] + cd -</pre> <b style="font-weight:normal;" id="docs-internal-guid-5859b7a1-00a0-8514-3fa8-2359db2018e0"> <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;"></error></span></p> </b><br class="Apple-interchange-newline"> <br> <br> thank you. <br> Dafna<br> <br> <br> <br> -------- Forwarded Message -------- <table class="moz-email-headers-table" border="0" cellspacing="0" cellpadding="0"> <tbody> <tr> <th valign="BASELINE" align="RIGHT" nowrap="nowrap">Subject: </th> <td>[CQ]: 81704, 6 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests</td> </tr> <tr> <th valign="BASELINE" align="RIGHT" nowrap="nowrap">Date: </th> <td>Mon, 9 Oct 2017 10:05:39 +0000 (UTC)</td> </tr> <tr> <th valign="BASELINE" align="RIGHT" nowrap="nowrap">From: </th> <td>oVirt Jenkins <a class="moz-txt-link-rfc2396E" href="mailto:jenkins@ovirt.org"><jenkins@ovirt.org></a></td> </tr> <tr> <th valign="BASELINE" align="RIGHT" nowrap="nowrap">To: </th> <td><a class="moz-txt-link-abbreviated" href="mailto:infra@ovirt.org">infra@ovirt.org</a></td> </tr> </tbody> </table> <br> <br> <pre>Change 81704,6 (ovirt-hosted-engine-setup) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: <a class="moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/81704/6">https://gerrit.ovirt.org/#/c/81704/6</a> For failed test results see: <a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/</a> _______________________________________________ Infra mailing list <a class="moz-txt-link-abbreviated" href="mailto:Infra@ovirt.org">Infra@ovirt.org</a> <a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/infra">http://lists.ovirt.org/mailman/listinfo/infra</a> </pre> </div> </body> </html> --------------F063EB2865FC8DADE581FA1E--

It seems like a cleanup issue from the previous job that ran on that specific node. I'll try to figure out what happened there. On Mon, Oct 9, 2017 at 1:16 PM, Dafna Ron <dron@redhat.com> wrote:
Hi,
We have a CQ failure with the error:
error: [Errno 98] Address already in use
* Link to suspected patches: This failure is pointing to: https://gerrit.ovirt.org/#/c/81704/ <https://gerrit.ovirt.org/#/c/81704/> Link to Job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/ <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/> Link to all logs: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/consoleFu... <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/consoleFull> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/artifact/ <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/artifact/> (Relevant) error snippet from the log: <error> *
*08:36:38* [upgrade-from-prevrelease-suit] @ Deploy oVirt environment: ERROR (in 0:00:00)*08:36:38* [upgrade-from-prevrelease-suit] Error occured, aborting*08:36:38* [upgrade-from-prevrelease-suit] Traceback (most recent call last):*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 362, in do_run*08:36:38* [upgrade-from-prevrelease-suit] self.cli_plugins[args.ovirtverb].do_run(args)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 184, in do_run*08:36:38* [upgrade-from-prevrelease-suit] self._do_run(**vars(args))*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 501, in wrapper*08:36:38* [upgrade-from-prevrelease-suit] return func(*args, **kwargs)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 512, in wrapper*08:36:38* [upgrade-from-prevrelease-suit] return func(*args, prefix=prefix, **kwargs)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 166, in do_deploy*08:36:38* [upgrade-from-prevrelease-suit] prefix.deploy()*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/log_utils.py", line 636, in wrapper*08:36:38* [upgrade-from-prevrelease-suit] return func(*args, **kwargs)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/reposetup.py", line 111, in wrapper*08:36:38* [upgrade-from-prevrelease-suit] with utils.repo_server_context(args[0]):*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__*08:36:38* [upgrade-from-prevrelease-suit] return self.gen.next()*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/utils.py", line 100, in repo_server_context*08:36:38* [upgrade-from-prevrelease-suit] root_dir=prefix.paths.internal_repo(),*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/utils.py", line 76, in _create_http_server*08:36:38* [upgrade-from-prevrelease-suit] generate_request_handler(root_dir),*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__*08:36:38* [upgrade-from-prevrelease-suit] self.server_bind()*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in server_bind*08:36:38* [upgrade-from-prevrelease-suit] SocketServer.TCPServer.server_bind(self)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind*08:36:38* [upgrade-from-prevrelease-suit] self.socket.bind(self.server_address)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/socket.py", line 224, in meth*08:36:38* [upgrade-from-prevrelease-suit] return getattr(self._sock,name)(*args)*08:36:38* [upgrade-from-prevrelease-suit] error: [Errno 98] Address already in use*08:36:38* [upgrade-from-prevrelease-suit] + res=1*08:36:38* [upgrade-from-prevrelease-suit] + cd -
* </error> *
thank you. Dafna
-------- Forwarded Message -------- Subject: [CQ]: 81704, 6 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests Date: Mon, 9 Oct 2017 10:05:39 +0000 (UTC) From: oVirt Jenkins <jenkins@ovirt.org> <jenkins@ovirt.org> To: infra@ovirt.org
Change 81704,6 (ovirt-hosted-engine-setup) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed.
This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed.
For further details about the change see:https://gerrit.ovirt.org/#/c/81704/6
For failed test results see:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/ _______________________________________________ Infra mailing listInfra@ovirt.orghttp://lists.ovirt.org/mailman/listinfo/infra
_______________________________________________ Devel mailing list Devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/devel
-- DANIEL BELENKY RHV DEVOPS EMEA VIRTUALIZATION R&D <https://red.ht/sig>

It seems that there was one job that timed out while performing a cleanup [1 <http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/50/console>], and ever since every build that tries to use VMs fail. I've cleaned the faulty host. I've enqueued the specific change that was dropped out of the cq to be tested again. [1] http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/50/con... On Mon, Oct 9, 2017 at 1:50 PM, Daniel Belenky <dbelenky@redhat.com> wrote:
It seems like a cleanup issue from the previous job that ran on that specific node. I'll try to figure out what happened there.
On Mon, Oct 9, 2017 at 1:16 PM, Dafna Ron <dron@redhat.com> wrote:
Hi,
We have a CQ failure with the error:
error: [Errno 98] Address already in use
* Link to suspected patches: This failure is pointing to: https://gerrit.ovirt.org/#/c/81704/ <https://gerrit.ovirt.org/#/c/81704/> Link to Job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/ <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/> Link to all logs: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/consoleFu... <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/consoleFull> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/artifact/ <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/artifact/> (Relevant) error snippet from the log: <error> *
*08:36:38* [upgrade-from-prevrelease-suit] @ Deploy oVirt environment: ERROR (in 0:00:00)*08:36:38* [upgrade-from-prevrelease-suit] Error occured, aborting*08:36:38* [upgrade-from-prevrelease-suit] Traceback (most recent call last):*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 362, in do_run*08:36:38* [upgrade-from-prevrelease-suit] self.cli_plugins[args.ovirtverb].do_run(args)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 184, in do_run*08:36:38* [upgrade-from-prevrelease-suit] self._do_run(**vars(args))*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 501, in wrapper*08:36:38* [upgrade-from-prevrelease-suit] return func(*args, **kwargs)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 512, in wrapper*08:36:38* [upgrade-from-prevrelease-suit] return func(*args, prefix=prefix, **kwargs)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 166, in do_deploy*08:36:38* [upgrade-from-prevrelease-suit] prefix.deploy()*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/log_utils.py", line 636, in wrapper*08:36:38* [upgrade-from-prevrelease-suit] return func(*args, **kwargs)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/reposetup.py", line 111, in wrapper*08:36:38* [upgrade-from-prevrelease-suit] with utils.repo_server_context(args[0]):*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__*08:36:38* [upgrade-from-prevrelease-suit] return self.gen.next()*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/utils.py", line 100, in repo_server_context*08:36:38* [upgrade-from-prevrelease-suit] root_dir=prefix.paths.internal_repo(),*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/utils.py", line 76, in _create_http_server*08:36:38* [upgrade-from-prevrelease-suit] generate_request_handler(root_dir),*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__*08:36:38* [upgrade-from-prevrelease-suit] self.server_bind()*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in server_bind*08:36:38* [upgrade-from-prevrelease-suit] SocketServer.TCPServer.server_bind(self)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind*08:36:38* [upgrade-from-prevrelease-suit] self.socket.bind(self.server_address)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/socket.py", line 224, in meth*08:36:38* [upgrade-from-prevrelease-suit] return getattr(self._sock,name)(*args)*08:36:38* [upgrade-from-prevrelease-suit] error: [Errno 98] Address already in use*08:36:38* [upgrade-from-prevrelease-suit] + res=1*08:36:38* [upgrade-from-prevrelease-suit] + cd -
* </error> *
thank you. Dafna
-------- Forwarded Message -------- Subject: [CQ]: 81704, 6 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests Date: Mon, 9 Oct 2017 10:05:39 +0000 (UTC) From: oVirt Jenkins <jenkins@ovirt.org> <jenkins@ovirt.org> To: infra@ovirt.org
Change 81704,6 (ovirt-hosted-engine-setup) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed.
This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed.
For further details about the change see:https://gerrit.ovirt.org/#/c/81704/6
For failed test results see:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/ _______________________________________________ Infra mailing listInfra@ovirt.orghttp://lists.ovirt.org/mailman/listinfo/infra
_______________________________________________ Devel mailing list Devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/devel
--
DANIEL BELENKY
RHV DEVOPS
EMEA VIRTUALIZATION R&D <https://red.ht/sig>
-- DANIEL BELENKY RHV DEVOPS EMEA VIRTUALIZATION R&D <https://red.ht/sig>

The HE setup is failing because one patch [1] was merged sooner than another needed patch [2]. In the time between, the setup does not work. With the patch [2], the he-basic suite passes: http://jenkins.ovirt.org/job/ovirt-system-tests_manual/1330/ Andrej [1] - https://gerrit.ovirt.org/#/c/78081/ [2] - https://gerrit.ovirt.org/#/c/81704/ On 9 October 2017 at 13:41, Daniel Belenky <dbelenky@redhat.com> wrote:
It seems that there was one job that timed out while performing a cleanup [ 1 <http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/50/console>], and ever since every build that tries to use VMs fail. I've cleaned the faulty host. I've enqueued the specific change that was dropped out of the cq to be tested again.
[1] http://jenkins.ovirt.org/job/ovirt-system-tests_he- basic-suite-master/50/console
On Mon, Oct 9, 2017 at 1:50 PM, Daniel Belenky <dbelenky@redhat.com> wrote:
It seems like a cleanup issue from the previous job that ran on that specific node. I'll try to figure out what happened there.
On Mon, Oct 9, 2017 at 1:16 PM, Dafna Ron <dron@redhat.com> wrote:
Hi,
We have a CQ failure with the error:
error: [Errno 98] Address already in use
* Link to suspected patches: This failure is pointing to: https://gerrit.ovirt.org/#/c/81704/ <https://gerrit.ovirt.org/#/c/81704/> Link to Job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/ <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/> Link to all logs: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/consoleFu... <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/consoleFull> http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/artifact/ <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/artifact/> (Relevant) error snippet from the log: <error> *
*08:36:38* [upgrade-from-prevrelease-suit] @ Deploy oVirt environment: ERROR (in 0:00:00)*08:36:38* [upgrade-from-prevrelease-suit] Error occured, aborting*08:36:38* [upgrade-from-prevrelease-suit] Traceback (most recent call last):*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 362, in do_run*08:36:38* [upgrade-from-prevrelease-suit] self.cli_plugins[args.ovirtverb].do_run(args)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 184, in do_run*08:36:38* [upgrade-from-prevrelease-suit] self._do_run(**vars(args))*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 501, in wrapper*08:36:38* [upgrade-from-prevrelease-suit] return func(*args, **kwargs)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 512, in wrapper*08:36:38* [upgrade-from-prevrelease-suit] return func(*args, prefix=prefix, **kwargs)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 166, in do_deploy*08:36:38* [upgrade-from-prevrelease-suit] prefix.deploy()*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/log_utils.py", line 636, in wrapper*08:36:38* [upgrade-from-prevrelease-suit] return func(*args, **kwargs)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/reposetup.py", line 111, in wrapper*08:36:38* [upgrade-from-prevrelease-suit] with utils.repo_server_context(args[0]):*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__*08:36:38* [upgrade-from-prevrelease-suit] return self.gen.next()*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/utils.py", line 100, in repo_server_context*08:36:38* [upgrade-from-prevrelease-suit] root_dir=prefix.paths.internal_repo(),*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/utils.py", line 76, in _create_http_server*08:36:38* [upgrade-from-prevrelease-suit] generate_request_handler(root_dir),*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__*08:36:38* [upgrade-from-prevrelease-suit] self.server_bind()*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in server_bind*08:36:38* [upgrade-from-prevrelease-suit] SocketServer.TCPServer.server_bind(self)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind*08:36:38* [upgrade-from-prevrelease-suit] self.socket.bind(self.server_address)*08:36:38* [upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/socket.py", line 224, in meth*08:36:38* [upgrade-from-prevrelease-suit] return getattr(self._sock,name)(*args)*08:36:38* [upgrade-from-prevrelease-suit] error: [Errno 98] Address already in use*08:36:38* [upgrade-from-prevrelease-suit] + res=1*08:36:38* [upgrade-from-prevrelease-suit] + cd -
* </error> *
thank you. Dafna
-------- Forwarded Message -------- Subject: [CQ]: 81704, 6 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests Date: Mon, 9 Oct 2017 10:05:39 +0000 (UTC) From: oVirt Jenkins <jenkins@ovirt.org> <jenkins@ovirt.org> To: infra@ovirt.org
Change 81704,6 (ovirt-hosted-engine-setup) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed.
This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed.
For further details about the change see:https://gerrit.ovirt.org/#/c/81704/6
For failed test results see:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/ _______________________________________________ Infra mailing listInfra@ovirt.orghttp://lists.ovirt.org/mailman/listinfo/infra
_______________________________________________ Devel mailing list Devel@ovirt.org http://lists.ovirt.org/mailman/listinfo/devel
--
DANIEL BELENKY
RHV DEVOPS
EMEA VIRTUALIZATION R&D <https://red.ht/sig>
--
DANIEL BELENKY
RHV DEVOPS
EMEA VIRTUALIZATION R&D <https://red.ht/sig>
participants (4)
-
Andrej Krejcir
-
Dafna Ron
-
Daniel Belenky
-
oVirt Jenkins