<div dir="ltr">We still see this issue on the upgrade suite from latest release to master [1].<div>I don't see any evidence in "/var/log/messages" [2] that "ovirt-imageio-proxy" was started twice.</div><div><br></div><div>[1] <a href="http://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/ovirt-master_change-queue-tester/runs/4153/nodes/123/steps/241/log/?start=0">http://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/ovirt-master_change-queue-tester/runs/4153/nodes/123/steps/241/log/?start=0</a></div><div><br></div><div>[2] <a href="http://jenkins.ovirt.org/view/Change%20queue%20jobs/job/ovirt-master_change-queue-tester/4153/artifact/exported-artifacts/upgrade-from-release-suit-master-el7/test_logs/upgrade-from-release-suite-master/post-001_initialize_engine.py/lago-upgrade-from-release-suite-master-engine/_var_log/messages/*view*/">http://jenkins.ovirt.org/view/Change%20queue%20jobs/job/ovirt-master_change-queue-tester/4153/artifact/exported-artifacts/upgrade-from-release-suit-master-el7/test_logs/upgrade-from-release-suite-master/post-001_initialize_engine.py/lago-upgrade-from-release-suite-master-engine/_var_log/messages/*view*/</a> </div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Nov 24, 2017 at 8:16 PM, Dafna Ron <span dir="ltr"><<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
<div class="m_2700312605936236023moz-cite-prefix">there were two different patches
reported as failing cq today with the ovirt-imageio-proxy service
failing to start. <br>
<br>
Here is the latest failure:
<a class="m_2700312605936236023moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4130/artifact" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt-master_change-queue-<wbr>tester/4130/artifact</a><div><div class="h5"><br>
<br>
<br>
<br>
On 11/23/2017 03:39 PM, Allon Mureinik wrote:<br>
</div></div></div><div><div class="h5">
<blockquote type="cite">
<div dir="ltr">
<div class="gmail_default" style="font-family:monospace,monospace">Daniel/Nir?</div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Thu, Nov 23, 2017 at 5:29 PM, Dafna
Ron <span dir="ltr"><<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
<p>Hi, <br>
</p>
<p>We have a failing on test 001_initialize_engine.test_ini<wbr>tialize_engine.
<br>
</p>
<p>This is failing with error Failed to start service
'ovirt-imageio-proxy</p>
<p><br>
</p>
<p><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
</b></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link and headline ofto suspected patches:
</span></b></p>
<b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
</b><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">build: Make resulting RPMs architecture-specific - <a class="m_2700312605936236023m_-1653390000056412231moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/84534/" target="_blank">https://gerrit.ovirt.org/#/c/8<wbr>4534/</a>
</span></p>
<br>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to Job:</span></p>
<a class="m_2700312605936236023m_-1653390000056412231moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4055" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt-master_change-queue-teste<wbr>r/4055</a></b>
<p><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><br>
</b></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to all logs:</span></b></p>
<b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">
</span></p>
</b>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><a class="m_2700312605936236023m_-1653390000056412231moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4055/artifact/" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt-master_change-queue-teste<wbr>r/4055/artifact/</a></span></p>
<p><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
</b></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><a class="m_2700312605936236023m_-1653390000056412231moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4055/artifact/exported-artifacts/upgrade-from-release-suit-master-el7/test_logs/upgrade-from-release-suite-master/post-001_initialize_engine.py/lago-upgrade-from-release-suite-master-engine/_var_log/messages/*view*/" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt-master_change-queue-teste<wbr>r/4055/artifact/exported-artif<wbr>acts/upgrade-from-release-<wbr>suit-master-el7/test_logs/<wbr>upgrade-from-release-suite-<wbr>master/post-001_initialize_<wbr>engine.py/lago-upgrade-from-<wbr>release-suite-master-engine/_<wbr>var_log/messages/*view*/</a></span></b></p>
<b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">
</span></p>
<br>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">(Relevant) error snippet from the log: </span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><error></span></p>
<br>
</b>from lago log: <br>
<pre style="box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;margin:0px;color:rgb(51,51,51);font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial">Failed to start service 'ovirt-imageio-proxy
messages logs:
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Starting Session 8 of user root.
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: Traceback (most recent call last):
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/bin/ovirt-imageio-proxy"<wbr>, line 85, in <module>
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: status = image_proxy.main(args, config)
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_imageio_proxy/image_<wbr>proxy.py", line 21, in main
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: image_server.start(config)
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_imageio_proxy/server<wbr>.py", line 45, in start
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: WSGIRequestHandler)
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/SocketSe<wbr>rver.py", line 419, in __init__
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: self.server_bind()
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/wsgiref/<wbr>simple_server.py", line 48, in server_bind
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: HTTPServer.server_bind(self)
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/BaseHTTP<wbr>Server.py", line 108, in server_bind
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: SocketServer.TCPServer.server_<wbr>bind(self)
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/SocketSe<wbr>rver.py", line 430, in server_bind
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: self.socket.bind(self.server_a<wbr>ddress)
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/socket.p<wbr>y", line 224, in meth
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: return getattr(self._sock,name)(*args<wbr>)
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: socket.error: [Errno 98] Address already in use
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: ovirt-imageio-proxy.service: main process exited, code=exited, status=1/FAILURE
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Failed to start oVirt ImageIO Proxy.
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Unit ovirt-imageio-proxy.service entered failed state.
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: ovirt-imageio-proxy.service failed.
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: ovirt-imageio-proxy.service holdoff time over, scheduling restart.
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Starting oVirt ImageIO Proxy...
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: Traceback (most recent call last):
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/bin/ovirt-imageio-proxy"<wbr>, line 85, in <module>
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: status = image_proxy.main(args, config)
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_imageio_proxy/image_<wbr>proxy.py", line 21, in main
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: image_server.start(config)
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/lib/python2.7/site-packa<wbr>ges/ovirt_imageio_proxy/server<wbr>.py", line 45, in start
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: WSGIRequestHandler)
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/SocketSe<wbr>rver.py", line 419, in __init__
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: self.server_bind()
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/wsgiref/<wbr>simple_server.py", line 48, in server_bind
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: HTTPServer.server_bind(self)
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/BaseHTTP<wbr>Server.py", line 108, in server_bind
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: SocketServer.TCPServer.server_<wbr>bind(self)
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/SocketSe<wbr>rver.py", line 430, in server_bind
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: self.socket.bind(self.server_a<wbr>ddress)
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/socket.p<wbr>y", line 224, in meth
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: return getattr(self._sock,name)(*args<wbr>)
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: socket.error: [Errno 98] Address already in use
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: ovirt-imageio-proxy.service: main process exited, code=exited, status=1/FAILURE
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Failed to start oVirt ImageIO Proxy.
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Unit ovirt-imageio-proxy.service entered failed state.
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: ovirt-imageio-proxy.service failed.
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: ovirt-imageio-proxy.service holdoff time over, scheduling restart.
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: start request repeated too quickly for ovirt-imageio-proxy.service
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Failed to start oVirt ImageIO Proxy.
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Unit ovirt-imageio-proxy.service entered failed state.
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: ovirt-imageio-proxy.service failed.</pre>
<p><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
</b></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"></error></span></b></p>
<b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
</b><br class="m_2700312605936236023m_-1653390000056412231Apple-interchange-newline">
</div>
<br>
______________________________<wbr>_________________<br>
Infra mailing list<br>
<a href="mailto:Infra@ovirt.org" target="_blank">Infra@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/infra</a><br>
<br>
</blockquote>
</div>
<br>
</div>
</blockquote>
<p><br>
</p>
</div></div></div>
<br>______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/devel</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><font face="overpass, sans-serif" color="#000000" size="2"><span style="text-transform:uppercase"><b>GAL bEN HAIM</b></span></font><div><span style="color:rgb(0,0,0);font-family:overpass,sans-serif;text-transform:uppercase"><font size="2">RHV DEVOPS</font></span><br></div></div></div>
</div>