Failure in CQ testing
by Dafna Ron
This is a multi-part message in MIME format.
--------------F063EB2865FC8DADE581FA1E
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: 7bit
Hi,
We have a CQ failure with the error:
error: [Errno 98] Address already in use
*
Link to suspected patches: This failure is pointing to:
https://gerrit.ovirt.org/#/c/81704/
Link to Job:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/
Link to all logs:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/consol...
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/artifact/
(Relevant) error snippet from the log:
<error>
*
*08:36:38* [upgrade-from-prevrelease-suit] @ Deploy oVirt environment: ERROR (in 0:00:00)
*08:36:38* [upgrade-from-prevrelease-suit] Error occured, aborting *08:36:38* [upgrade-from-prevrelease-suit]
Traceback (most recent call last): *08:36:38*
[upgrade-from-prevrelease-suit] File
"/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 362, in do_run
*08:36:38* [upgrade-from-prevrelease-suit]
self.cli_plugins[args.ovirtverb].do_run(args) *08:36:38*
[upgrade-from-prevrelease-suit] File
"/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 184, in
do_run *08:36:38* [upgrade-from-prevrelease-suit]
self._do_run(**vars(args)) *08:36:38* [upgrade-from-prevrelease-suit]
File "/usr/lib/python2.7/site-packages/lago/utils.py", line 501, in
wrapper *08:36:38* [upgrade-from-prevrelease-suit] return func(*args,
**kwargs) *08:36:38* [upgrade-from-prevrelease-suit] File
"/usr/lib/python2.7/site-packages/lago/utils.py", line 512, in wrapper
*08:36:38* [upgrade-from-prevrelease-suit] return func(*args,
prefix=prefix, **kwargs) *08:36:38* [upgrade-from-prevrelease-suit] File
"/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 166, in
do_deploy *08:36:38* [upgrade-from-prevrelease-suit] prefix.deploy()
*08:36:38* [upgrade-from-prevrelease-suit] File
"/usr/lib/python2.7/site-packages/lago/log_utils.py", line 636, in
wrapper *08:36:38* [upgrade-from-prevrelease-suit] return func(*args,
**kwargs) *08:36:38* [upgrade-from-prevrelease-suit] File
"/usr/lib/python2.7/site-packages/ovirtlago/reposetup.py", line 111, in
wrapper *08:36:38* [upgrade-from-prevrelease-suit] with
utils.repo_server_context(args[0]): *08:36:38*
[upgrade-from-prevrelease-suit] File
"/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ *08:36:38*
[upgrade-from-prevrelease-suit] return self.gen.next() *08:36:38*
[upgrade-from-prevrelease-suit] File
"/usr/lib/python2.7/site-packages/ovirtlago/utils.py", line 100, in
repo_server_context *08:36:38* [upgrade-from-prevrelease-suit]
root_dir=prefix.paths.internal_repo(), *08:36:38*
[upgrade-from-prevrelease-suit] File
"/usr/lib/python2.7/site-packages/ovirtlago/utils.py", line 76, in
_create_http_server *08:36:38* [upgrade-from-prevrelease-suit]
generate_request_handler(root_dir), *08:36:38*
[upgrade-from-prevrelease-suit] File
"/usr/lib64/python2.7/SocketServer.py", line 419, in __init__ *08:36:38*
[upgrade-from-prevrelease-suit] self.server_bind() *08:36:38*
[upgrade-from-prevrelease-suit] File
"/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in server_bind
*08:36:38* [upgrade-from-prevrelease-suit]
SocketServer.TCPServer.server_bind(self) *08:36:38*
[upgrade-from-prevrelease-suit] File
"/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind
*08:36:38* [upgrade-from-prevrelease-suit]
self.socket.bind(self.server_address) *08:36:38*
[upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/socket.py",
line 224, in meth *08:36:38* [upgrade-from-prevrelease-suit] return
getattr(self._sock,name)(*args) *08:36:38*
[upgrade-from-prevrelease-suit] error: [Errno 98] Address already in use
*08:36:38* [upgrade-from-prevrelease-suit] + res=1
*08:36:38* [upgrade-from-prevrelease-suit] + cd -
*
</error>
*
thank you.
Dafna
-------- Forwarded Message --------
Subject: [CQ]: 81704, 6 (ovirt-hosted-engine-setup) failed
"ovirt-master" system tests
Date: Mon, 9 Oct 2017 10:05:39 +0000 (UTC)
From: oVirt Jenkins <jenkins(a)ovirt.org>
To: infra(a)ovirt.org
Change 81704,6 (ovirt-hosted-engine-setup) is probably the reason behind recent
system test failures in the "ovirt-master" change queue and needs to be fixed.
This change had been removed from the testing queue. Artifacts build from this
change will not be released until it is fixed.
For further details about the change see:
https://gerrit.ovirt.org/#/c/81704/6
For failed test results see:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/
_______________________________________________
Infra mailing list
Infra(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra
--------------F063EB2865FC8DADE581FA1E
Content-Type: text/html; charset=windows-1252
Content-Transfer-Encoding: 7bit
<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=windows-1252">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>Hi, <br>
</p>
<p>We have a CQ failure with the error:<br>
</p>
<pre class="console-output" style="box-sizing: border-box; white-space: pre-wrap; word-wrap: break-word; margin: 0px; color: rgb(51, 51, 51); font-size: 14px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;"><span style="box-sizing: border-box; color: rgb(205, 0, 0);">error: [Errno 98] Address already in use</span></pre>
<div class="moz-forward-container"><br>
<br>
<b style="font-weight:normal;"
id="docs-internal-guid-5859b7a1-00a0-8514-3fa8-2359db2018e0">
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link to suspected patches: </span>This
failure is pointing to: <a class="moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/81704/">https://gerrit.ovirt.org/#/c/81704/</a> <br>
</p>
<br>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link to Job: <a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/</a></span></p>
<br>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link to all logs:</span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">
</span></p>
<a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/consol...">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/consol...</a><br>
<a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/artifact/">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/artifact/</a><br>
<br>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">(Relevant) error snippet from the log: </span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;"><error></span></p>
<br>
</b><br>
<pre class="console-output" style="box-sizing: border-box; white-space: pre-wrap; word-wrap: break-word; margin: 0px; color: rgb(51, 51, 51); font-size: 14px; font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;"><span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] <span style="box-sizing: border-box; color: rgb(0, 205, 205);">@ Deploy oVirt environment: </span><span style="box-sizing: border-box; color: rgb(205, 0, 0);">ERROR</span> (in 0:00:00)
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] <span style="box-sizing: border-box; color: rgb(205, 0, 0);">Error occured, aborting
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] Traceback (most recent call last):
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 362, in do_run
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] self.cli_plugins[args.ovirtverb].do_run(args)
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 184, in do_run
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] self._do_run(**vars(args))
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 501, in wrapper
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] return func(*args, **kwargs)
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 512, in wrapper
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] return func(*args, prefix=prefix, **kwargs)
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 166, in do_deploy
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] prefix.deploy()
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/lago/log_utils.py", line 636, in wrapper
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] return func(*args, **kwargs)
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/reposetup.py", line 111, in wrapper
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] with utils.repo_server_context(args[0]):
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] return self.gen.next()
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/utils.py", line 100, in repo_server_context
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] root_dir=prefix.paths.internal_repo(),
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/utils.py", line 76, in _create_http_server
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] generate_request_handler(root_dir),
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] self.server_bind()
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in server_bind
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] SocketServer.TCPServer.server_bind(self)
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] self.socket.bind(self.server_address)
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] File "/usr/lib64/python2.7/socket.py", line 224, in meth
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] return getattr(self._sock,name)(*args)
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] error: [Errno 98] Address already in use</span>
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] + res=1
<span class="timestamp" style="box-sizing: border-box;"><b style="box-sizing: border-box;">08:36:38</b> </span>[upgrade-from-prevrelease-suit] + cd -</pre>
<b style="font-weight:normal;"
id="docs-internal-guid-5859b7a1-00a0-8514-3fa8-2359db2018e0">
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;"></error></span></p>
</b><br class="Apple-interchange-newline">
<br>
<br>
thank you. <br>
Dafna<br>
<br>
<br>
<br>
-------- Forwarded Message --------
<table class="moz-email-headers-table" border="0" cellspacing="0"
cellpadding="0">
<tbody>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">Subject:
</th>
<td>[CQ]: 81704, 6 (ovirt-hosted-engine-setup) failed
"ovirt-master" system tests</td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">Date: </th>
<td>Mon, 9 Oct 2017 10:05:39 +0000 (UTC)</td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">From: </th>
<td>oVirt Jenkins <a class="moz-txt-link-rfc2396E" href="mailto:jenkins@ovirt.org"><jenkins(a)ovirt.org></a></td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">To: </th>
<td><a class="moz-txt-link-abbreviated" href="mailto:infra@ovirt.org">infra(a)ovirt.org</a></td>
</tr>
</tbody>
</table>
<br>
<br>
<pre>Change 81704,6 (ovirt-hosted-engine-setup) is probably the reason behind recent
system test failures in the "ovirt-master" change queue and needs to be fixed.
This change had been removed from the testing queue. Artifacts build from this
change will not be released until it is fixed.
For further details about the change see:
<a class="moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/81704/6">https://gerrit.ovirt.org/#/c/81704/6</a>
For failed test results see:
<a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3055/</a>
_______________________________________________
Infra mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Infra@ovirt.org">Infra(a)ovirt.org</a>
<a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/infra">http://lists.ovirt.org/mailman/listinfo/infra</a>
</pre>
</div>
</body>
</html>
--------------F063EB2865FC8DADE581FA1E--
7 years, 1 month
integration of gluster collectd metrics to ovirt metrics store.
by Venkata R Edara
Hello All,
I am looking to integrate the collectd gluster plugin to ovirt metric
engine , we have gluster metrics which are collected using tendrl
collectd plugin.
I am looking for the guide so that I can integrate gluster metrics to
metrics store of ovirt. I would like to know how to get started on this.
-Thanks
Venkata R Edara
7 years, 1 month
Failure in job for ovirt-hosted-engine-ha in upgrade-from-release-suite-master
by Dafna Ron
This is a multi-part message in MIME format.
--------------FB0C108F633E80F1A67E0288
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: 7bit
Hi,
We had a failure in CQ.
The logs are not reporting any failed OST tests, however, I can see that
the upgrade from release suite has failed to deploy because of "address
already in use" error.
**
*Link to suspected patches:**https://gerrit.ovirt.org/#/c/82585/3*
**
**
*Link to Job:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3038*
***
Link to all logs:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3038/artifact
**
Log error:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3038/artifa...
(Relevant) error snippet from the log:
<error>
*
File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind
self.socket.bind(self.server_address)
File "/usr/lib64/python2.7/socket.py", line 224, in meth
return getattr(self._sock,name)(*args)
error: [Errno 98] Address already in use
**
*This is the full trace error: *
***
https://pastebin.com/ExHRk6pG
</error>
*
-------- Forwarded Message --------
Subject: [CQ]: 82585, 3 (ovirt-hosted-engine-ha) failed "ovirt-master"
system tests
Date: Fri, 6 Oct 2017 13:42:41 +0000 (UTC)
From: oVirt Jenkins <jenkins(a)ovirt.org>
To: infra(a)ovirt.org
Change 82585,3 (ovirt-hosted-engine-ha) is probably the reason behind recent
system test failures in the "ovirt-master" change queue and needs to be fixed.
This change had been removed from the testing queue. Artifacts build from this
change will not be released until it is fixed.
For further details about the change see:
https://gerrit.ovirt.org/#/c/82585/3
For failed test results see:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3038/
_______________________________________________
Infra mailing list
Infra(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra
--------------FB0C108F633E80F1A67E0288
Content-Type: text/html; charset=windows-1252
Content-Transfer-Encoding: 7bit
<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=windows-1252">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>Hi, <br>
</p>
<p>We had a failure in CQ. <br>
</p>
<p>The logs are not reporting any failed OST tests, however, I can
see that the upgrade from release suite has failed to deploy
because of "address already in use" error. <br>
</p>
<p><b style="font-weight:normal;"
id="docs-internal-guid-5859b7a1-f215-e368-c91b-30c1e8e4de27">
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link to suspected patches:</span><b>
</b><a class="moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/82585/3">https://gerrit.ovirt.org/#/c/82585/3</a></p>
</b></p>
<p><b style="font-weight:normal;"
id="docs-internal-guid-5859b7a1-f215-e368-c91b-30c1e8e4de27">
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link to Job: <a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3038">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3038</a></span></p>
</b><b style="font-weight:normal;"
id="docs-internal-guid-5859b7a1-f215-e368-c91b-30c1e8e4de27"><br>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Link to all logs: <a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3038/artifact">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3038/artifact</a></span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">
</span></p>
</b><b style="font-weight:normal;"
id="docs-internal-guid-5859b7a1-f215-e368-c91b-30c1e8e4de27">
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">Log error: <a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3038/artifa...">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3038/artifa...</a>
</span></p>
<br>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;">(Relevant) error snippet from the log: </span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;"><error></span></p>
</b></p>
<pre style="color: rgb(0, 0, 0); font-style: normal; font-variant-ligatures: normal; font-variant-caps: normal; font-weight: normal; letter-spacing: normal; orphans: 2; text-align: start; text-indent: 0px; text-transform: none; widows: 2; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration-style: initial; text-decoration-color: initial;"> File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind
self.socket.bind(self.server_address)
File "/usr/lib64/python2.7/socket.py", line 224, in meth
return getattr(self._sock,name)(*args)
error: [Errno 98] Address already in use</pre>
<p><b style="font-weight:normal;"
id="docs-internal-guid-5859b7a1-f215-e368-c91b-30c1e8e4de27">
<p>This is the full trace error: </p>
</b><b style="font-weight:normal;"
id="docs-internal-guid-5859b7a1-f215-e368-c91b-30c1e8e4de27">
<p><a class="moz-txt-link-freetext" href="https://pastebin.com/ExHRk6pG">https://pastebin.com/ExHRk6pG</a><br>
</p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt;"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap;"></error></span></p>
</b></p>
<div class="moz-forward-container"><br>
<br>
-------- Forwarded Message --------
<table class="moz-email-headers-table" border="0" cellspacing="0"
cellpadding="0">
<tbody>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">Subject:
</th>
<td>[CQ]: 82585, 3 (ovirt-hosted-engine-ha) failed
"ovirt-master" system tests</td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">Date: </th>
<td>Fri, 6 Oct 2017 13:42:41 +0000 (UTC)</td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">From: </th>
<td>oVirt Jenkins <a class="moz-txt-link-rfc2396E" href="mailto:jenkins@ovirt.org"><jenkins(a)ovirt.org></a></td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">To: </th>
<td><a class="moz-txt-link-abbreviated" href="mailto:infra@ovirt.org">infra(a)ovirt.org</a></td>
</tr>
</tbody>
</table>
<br>
<br>
<pre>Change 82585,3 (ovirt-hosted-engine-ha) is probably the reason behind recent
system test failures in the "ovirt-master" change queue and needs to be fixed.
This change had been removed from the testing queue. Artifacts build from this
change will not be released until it is fixed.
For further details about the change see:
<a class="moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/82585/3">https://gerrit.ovirt.org/#/c/82585/3</a>
For failed test results see:
<a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3038/">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3038/</a>
_______________________________________________
Infra mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Infra@ovirt.org">Infra(a)ovirt.org</a>
<a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/infra">http://lists.ovirt.org/mailman/listinfo/infra</a>
</pre>
</div>
</body>
</html>
--------------FB0C108F633E80F1A67E0288--
7 years, 1 month
CQ failure due to ovirt-guest-agent_master_build-artifacts-el7-x86_64/
by Dafna Ron
This is a multi-part message in MIME format.
--------------3ED320903537230311100551
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: 7bit
Hi,
CQ is reporting failure due to failed build of
ovirt-guest-agent_master_build-artifacts-el7-x86_64
first failure for guest agent was reported here:
http://jenkins.ovirt.org/job/ovirt-guest-agent_master_build-artifacts-el7...
Latest failure is here:
http://jenkins.ovirt.org/job/ovirt-guest-agent_master_build-artifacts-el7...
Can you please take a look at ovirt-guest-agent? I am not sure but it
seems there is a missing driver: http://pastebin.test.redhat.com/522129
Thanks,
Dafna
-------- Forwarded Message --------
Subject: [CQ]: 82550, 2 (ovirt-guest-agent) failed "ovirt-master"
system tests, but isn't the failure root cause
Date: Thu, 5 Oct 2017 14:23:24 +0000 (UTC)
From: oVirt Jenkins <jenkins(a)ovirt.org>
To: infra(a)ovirt.org
A system test invoked by the "ovirt-master" change queue including change
82550,2 (ovirt-guest-agent) failed. However, this change seems not to be the
root cause for this failure. Change 82562,1 (ovirt-guest-agent) that this
change depends on or is based on, was detected as the cause of the testing
failures.
This change had been removed from the testing queue. Artifacts built from this
change will not be released until either change 82562,1 (ovirt-guest-agent) is
fixed and this change is updated to refer to or rebased on the fixed version,
or this change is modified to no longer depend on it.
For further details about the change see:
https://gerrit.ovirt.org/#/c/82550/2
For further details about the change that seems to be the root cause behind the
testing failures see:
https://gerrit.ovirt.org/#/c/82562/1
For failed test results see:
http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3020/
_______________________________________________
Infra mailing list
Infra(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/infra
--------------3ED320903537230311100551
Content-Type: text/html; charset=windows-1252
Content-Transfer-Encoding: 7bit
<html>
<head>
<meta http-equiv="content-type" content="text/html; charset=windows-1252">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>Hi, <br>
</p>
<p>CQ is reporting failure due to failed build of ovirt-guest-agent_master_build-artifacts-el7-x86_64<br>
</p>
<p>first failure for guest agent was reported here:
<a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-guest-agent_master_build-artifacts-el7...">http://jenkins.ovirt.org/job/ovirt-guest-agent_master_build-artifacts-el7...</a><br>
</p>
<div class="moz-forward-container">Latest failure is here:
<a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-guest-agent_master_build-artifacts-el7...">http://jenkins.ovirt.org/job/ovirt-guest-agent_master_build-artifacts-el7...</a><br>
<br>
Can you please take a look at ovirt-guest-agent? I am not sure but
it seems there is a missing driver:
<a class="moz-txt-link-freetext" href="http://pastebin.test.redhat.com/522129">http://pastebin.test.redhat.com/522129</a><br>
<br>
Thanks, <br>
Dafna<br>
<br>
<br>
-------- Forwarded Message --------
<table class="moz-email-headers-table" border="0" cellspacing="0"
cellpadding="0">
<tbody>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">Subject:
</th>
<td>[CQ]: 82550, 2 (ovirt-guest-agent) failed "ovirt-master"
system tests, but isn't the failure root cause</td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">Date: </th>
<td>Thu, 5 Oct 2017 14:23:24 +0000 (UTC)</td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">From: </th>
<td>oVirt Jenkins <a class="moz-txt-link-rfc2396E" href="mailto:jenkins@ovirt.org"><jenkins(a)ovirt.org></a></td>
</tr>
<tr>
<th valign="BASELINE" align="RIGHT" nowrap="nowrap">To: </th>
<td><a class="moz-txt-link-abbreviated" href="mailto:infra@ovirt.org">infra(a)ovirt.org</a></td>
</tr>
</tbody>
</table>
<br>
<br>
<pre>A system test invoked by the "ovirt-master" change queue including change
82550,2 (ovirt-guest-agent) failed. However, this change seems not to be the
root cause for this failure. Change 82562,1 (ovirt-guest-agent) that this
change depends on or is based on, was detected as the cause of the testing
failures.
This change had been removed from the testing queue. Artifacts built from this
change will not be released until either change 82562,1 (ovirt-guest-agent) is
fixed and this change is updated to refer to or rebased on the fixed version,
or this change is modified to no longer depend on it.
For further details about the change see:
<a class="moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/82550/2">https://gerrit.ovirt.org/#/c/82550/2</a>
For further details about the change that seems to be the root cause behind the
testing failures see:
<a class="moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/82562/1">https://gerrit.ovirt.org/#/c/82562/1</a>
For failed test results see:
<a class="moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3020/">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/3020/</a>
_______________________________________________
Infra mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Infra@ovirt.org">Infra(a)ovirt.org</a>
<a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/infra">http://lists.ovirt.org/mailman/listinfo/infra</a>
</pre>
</div>
</body>
</html>
--------------3ED320903537230311100551--
7 years, 1 month
Unable to add host in oVirt 4.2 (clean install)
by Marek Libra
Since Andrej ran in similar issue today, I'm posting for others:
When installing oVirt 4.2 first alpha release from scratch on fresh Centos
7 minimal, adding host failed. Unfortunately, I don't have log messages
anymore, but I remember last errors were misleadingly related to ovn (no
matter the ovn was not configured on the engine).
The issue was resolved by manual installation of python-netaddr package on
the host. Subsequently, adding the host in webadmin passed.
What package should require the python-netaddr? ovirt-provider-ovn-driver?
I hope it helps,
Marek
7 years, 1 month
Ansible Help Requested
by Phillip Bailey
Hi all,
I'm working on the new Cockpit hosted engine wizard and could use some
input from all of you. One goal of this project is to move away from
reliance on the existing OTOPI-based tools and towards an ansible-based
approach.
The items below are things we'd like to do using ansible, if possible. If
any of you have existing plays or suggestions for the best way to use
ansible to solve these problems, please let me know.
Thanks!
1. Verify provided storage settings for all allowable storage types.
2. Verify compatibility of selected CPU type for the engine VM with the
host's CPU
-Phillip Bailey
7 years, 1 month
Re: [ovirt-devel] [Qemu-block] qemu-img: Check failed: No space left on device
by Stefan Hajnoczi
On Tue, Sep 26, 2017 at 04:31:22PM +0200, Nicolas Ecarnot wrote:
> Le 21/09/2017 à 16:31, Stefan Hajnoczi a écrit :
> > On Tue, Sep 19, 2017 at 12:09:06PM +0200, Nicolas Ecarnot wrote:
> > > Hello,
> > >
> > > First post here, so maybe I should introduce myself :
> > > - I'm a sysadmin for decades and currently managing 4 oVirt clusters, made
> > > out of tens of hypervisors, all are CentOS 7.2+ based.
> > > - I'm very happy with this solution we choose especially because it is based
> > > on qemu-kvm (open source, reliable, documented).
> > >
> > > On one VM, we experienced the following :
> > > - oVirt/vdsm is detecting an issue on the image
> > > - following this hints https://access.redhat.com/solutions/1173623, I
> > > managed to detect one error and fix it
> > > - the VM is now running perfectly
> > >
> > > On two other VMs, we experienced a similar situation, except the check stage
> > > is showing something like 14000+ errors, and the relevant logs are :
> > >
> > > Repairing refcount block 14 is outside image
> > > ERROR could not resize image: Invalid argument
> > > ERROR cluster 425984 refcount=0 reference=1
> > > ERROR cluster 425985 refcount=0 reference=1
> > > [... repeating the previous line 7000+ times...]
> > > ERROR cluster 457166 refcount=0 reference=1
> > > Rebuilding refcount structure
> > > ERROR writing refblock: No space left on device
> > > qemu-img: Check failed: No space left on device
> >
> > Please run strace qemu-img info /the/relevant/logical/volume/path. It
Sorry, "qemu-img info" should be your "qemu-img check" command.
> > will print all the syscalls that qemu-img makes. That way we'll be able
> > to verify that the ENOSPC error is coming from a pwritev syscall.
> I did but I'm not skilled enough to ensure where the ENOSPC error is coming
> from.
>
> Is your question meaning the reads and/or the writes may come from or go to
> places outside the expected boundaries?
I was interested in the syscall (probably pwritev or similar) related to
the following output from qemu-img check:
ERROR writing refblock: No space left on device
Feel free to post your strace log so we can analyze it.
> > > You surely know that oVirt/RHEV is storing its qcow2 images in dedicated
> > > logical volumes.
> > >
> > > pvs/vgs/lvs are all showing there is plenty of space available, so I
> > > understand that I don't understand what "No space left on device" means.
> >
> > After you have the strace data you can look at the file offset from the
> > failing pwritev syscall and check that it's really within the LV.
> >
> > I think there is no fancy thin provisioning going on at the LVM level
> > with oVirt, but if there is then perhaps a write within the LV could
> > still result in an ENOSPC error. It would be worth confirming that
> > these are class "thick" LVs.
>
> I think there is no such thin prov. at the LVM level, but I wouldn't swear.
> Don't you mind if I forward your question to the oVirt mailing-list?
Sure, feel free to CC other mailing lists. I have added oVirt devel.
Stefan
7 years, 1 month
OST Failure he-basic
by Dominik Holler
Hi all,
OST he-basic is currently failing [1] during setup "hosted-engine"
during Connecting Storage Pool with the message
Failed to execute stage 'Misc configuration': 'functools.partial' object has no attribute 'getAllTasksStatuses'
Since the lago-he-basic-suite-master-engine VM is inaccessible after
the problem, I have no idea how to locate the problem.
Dominik
[1]
http://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-tes...
7 years, 1 month
Missing ovirtmgmt (was: Change in ovirt-system-tests[master]: he: Run hosted-engine --vm-status)
by Yedidyah Bar David
Hi all,
On Sun, Oct 1, 2017 at 10:15 AM, Code Review <gerrit(a)ovirt.org> wrote:
> Jenkins CI posted comments on this change.
>
> View Change
>
> Patch set 1:Continuous-Integration -1
>
> Build Failed
>
> http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x8...
> : FAILURE
Above was triggered by [1].
It failed with [2]:
TASK [ovirt-provider-ovn-driver : Configure OVN for oVirt] *********************
fatal: [lago-he-basic-suite-master-host1]: FAILED! => {"changed":
true, "cmd": ["vdsm-tool", "ovn-config", "192.168.200.99",
"ovirtmgmt"], "delta": "0:00:00.623565", "end": "2017-10-01
03:15:11.179717", "failed": true, "msg": "non-zero return code", "rc":
1, "start": "2017-10-01 03:15:10.556152", "stderr": "Traceback (most
recent call last):\n File \"/usr/bin/vdsm-tool\", line 219, in main\n
return tool_command[cmd][\"command\"](*args)\n File
\"/usr/lib/python2.7/site-packages/vdsm/tool/ovn_config.py\", line 58,
in ovn_config\n ip_address =
get_ip_addr(get_network(network_caps(), net_name))\n File
\"/usr/lib/python2.7/site-packages/vdsm/tool/ovn_config.py\", line 79,
in get_network\n raise
NetworkNotFoundError(net_name)\nNetworkNotFoundError: ovirtmgmt",
"stderr_lines": ["Traceback (most recent call last):", " File
\"/usr/bin/vdsm-tool\", line 219, in main", " return
tool_command[cmd][\"command\"](*args)", " File
\"/usr/lib/python2.7/site-packages/vdsm/tool/ovn_config.py\", line 58,
in ovn_config", " ip_address =
get_ip_addr(get_network(network_caps(), net_name))", " File
\"/usr/lib/python2.7/site-packages/vdsm/tool/ovn_config.py\", line 79,
in get_network", " raise NetworkNotFoundError(net_name)",
"NetworkNotFoundError: ovirtmgmt"], "stdout": "", "stdout_lines": []}
Meaning, 'ovirtmgmt' is missing.
In host-deploy [3] of this host, I see that the engine asked
host-deploy to configure ovirtmgmt:
2017-10-01 03:14:36,036-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:SEND ### Customization phase, use
'install' to proceed
2017-10-01 03:14:36,036-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:SEND ### COMMAND>
2017-10-01 03:14:36,036-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:SEND **%QHidden: FALSE
2017-10-01 03:14:36,037-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:SEND ***Q:STRING
CUSTOMIZATION_COMMAND
2017-10-01 03:14:36,037-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:SEND **%QEnd:
CUSTOMIZATION_COMMAND
2017-10-01 03:14:36,038-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:RECEIVE env-query -k
HOSTED_ENGINE_CONFIG/bridge
2017-10-01 03:14:36,038-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:SEND **%QStart:
HOSTED_ENGINE_CONFIG/bridge
2017-10-01 03:14:36,039-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:SEND ###
2017-10-01 03:14:36,039-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:SEND ### Please specify value for
'HOSTED_ENGINE_CONFIG/bridge':
2017-10-01 03:14:36,039-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:SEND ### Response is VALUE
HOSTED_ENGINE_CONFIG/bridge=type:value or ABORT
HOSTED_ENGINE_CONFIG/bridge
2017-10-01 03:14:36,039-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:SEND ***Q:VALUE
HOSTED_ENGINE_CONFIG/bridge
2017-10-01 03:14:36,039-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:SEND **%QEnd:
HOSTED_ENGINE_CONFIG/bridge
2017-10-01 03:14:36,040-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:RECEIVE VALUE
HOSTED_ENGINE_CONFIG/bridge=str:ovirtmgmt
2017-10-01 03:14:36,040-0400 DEBUG otopi.plugins.otopi.dialog.machine
dialog.__logString:204 DIALOG:SEND **%QStart:
CUSTOMIZATION_COMMAND
However, AFAIU this was deprecated quite a long time ago [4], and does
not appear in other runs, e.g. the latest succeeded run of the same
job [5][6]. Also, I can't see in engine log there [7] how ovirtmgmt
was created (if at all).
I now see a difference between them:
The successful one [7] passed to ansible:
--extra-vars=host_deploy_ovn_central=null
And the failed one [8] passed:
--extra-vars=host_deploy_ovn_central=192.168.200.99
So perhaps this was caused by a recent change related to OVN? Although
I looked at engine git log and can't find anything.
Thanks,
[1] https://gerrit.ovirt.org/82403
[2] http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x8...
[3] http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x8...
[4] https://gerrit.ovirt.org/70833
[5] http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x8...
[6] http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x8...
[7] http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x8...
[8] http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x8...
>
> To view, visit change 82403. To unsubscribe, visit settings.
>
> Gerrit-Project: ovirt-system-tests
> Gerrit-Branch: master
> Gerrit-MessageType: comment
> Gerrit-Change-Id: I46f453c7e86ce0e3a7282aca4d56f23363d1683b
> Gerrit-Change-Number: 82403
> Gerrit-PatchSet: 1
> Gerrit-Owner: Yedidyah Bar David <didi(a)redhat.com>
> Gerrit-Reviewer: Jenkins CI
> Gerrit-Comment-Date: Sun, 01 Oct 2017 07:15:31 +0000
> Gerrit-HasComments: No
--
Didi
7 years, 1 month
