<div dir="ltr">We still see this issue on the upgrade suite from latest release to master [1].<div>I don&#39;t see any evidence in &quot;/var/log/messages&quot; [2] that &quot;ovirt-imageio-proxy&quot; was started twice.</div><div><br></div><div>[1] <a href="http://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/ovirt-master_change-queue-tester/runs/4153/nodes/123/steps/241/log/?start=0">http://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/ovirt-master_change-queue-tester/runs/4153/nodes/123/steps/241/log/?start=0</a></div><div><br></div><div>[2] <a href="http://jenkins.ovirt.org/view/Change%20queue%20jobs/job/ovirt-master_change-queue-tester/4153/artifact/exported-artifacts/upgrade-from-release-suit-master-el7/test_logs/upgrade-from-release-suite-master/post-001_initialize_engine.py/lago-upgrade-from-release-suite-master-engine/_var_log/messages/*view*/">http://jenkins.ovirt.org/view/Change%20queue%20jobs/job/ovirt-master_change-queue-tester/4153/artifact/exported-artifacts/upgrade-from-release-suit-master-el7/test_logs/upgrade-from-release-suite-master/post-001_initialize_engine.py/lago-upgrade-from-release-suite-master-engine/_var_log/messages/*view*/</a>  </div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Nov 24, 2017 at 8:16 PM, Dafna Ron <span dir="ltr">&lt;<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
  
    
  
  <div text="#000000" bgcolor="#FFFFFF">
    <div class="m_2700312605936236023moz-cite-prefix">there were two different patches
      reported as failing cq today with the ovirt-imageio-proxy service
      failing to start. <br>
      <br>
      Here is the latest failure:
<a class="m_2700312605936236023moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4130/artifact" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt-master_change-queue-<wbr>tester/4130/artifact</a><div><div class="h5"><br>
      <br>
      <br>
      <br>
      On 11/23/2017 03:39 PM, Allon Mureinik wrote:<br>
    </div></div></div><div><div class="h5">
    <blockquote type="cite">
      <div dir="ltr">
        <div class="gmail_default" style="font-family:monospace,monospace">Daniel/Nir?</div>
      </div>
      <div class="gmail_extra"><br>
        <div class="gmail_quote">On Thu, Nov 23, 2017 at 5:29 PM, Dafna
          Ron <span dir="ltr">&lt;<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a>&gt;</span>
          wrote:<br>
          <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
            <div text="#000000" bgcolor="#FFFFFF">
              <p>Hi, <br>
              </p>
              <p>We have a failing on test 001_initialize_engine.test_ini<wbr>tialize_engine.
                <br>
              </p>
              <p>This is failing with error Failed to start service
                &#39;ovirt-imageio-proxy</p>
              <p><br>
              </p>
              <p><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
                </b></p>
              <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link and headline ofto suspected patches: 
</span></b></p>
              <b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
              </b><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
                <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">build: Make resulting RPMs architecture-specific - <a class="m_2700312605936236023m_-1653390000056412231moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/84534/" target="_blank">https://gerrit.ovirt.org/#/c/8<wbr>4534/</a>
</span></p>
                <br>
                <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to Job:</span></p>
                <a class="m_2700312605936236023m_-1653390000056412231moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4055" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt-master_change-queue-teste<wbr>r/4055</a></b>
              <p><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><br>
                </b></p>
              <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to all logs:</span></b></p>
              <b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
                <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">
</span></p>
              </b>
              <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><a class="m_2700312605936236023m_-1653390000056412231moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4055/artifact/" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt-master_change-queue-teste<wbr>r/4055/artifact/</a></span></p>
              <p><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
                </b></p>
              <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><a class="m_2700312605936236023m_-1653390000056412231moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4055/artifact/exported-artifacts/upgrade-from-release-suit-master-el7/test_logs/upgrade-from-release-suite-master/post-001_initialize_engine.py/lago-upgrade-from-release-suite-master-engine/_var_log/messages/*view*/" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt-master_change-queue-teste<wbr>r/4055/artifact/exported-artif<wbr>acts/upgrade-from-release-<wbr>suit-master-el7/test_logs/<wbr>upgrade-from-release-suite-<wbr>master/post-001_initialize_<wbr>engine.py/lago-upgrade-from-<wbr>release-suite-master-engine/_<wbr>var_log/messages/*view*/</a></span></b></p>
              <b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
                <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">
</span></p>
                <br>
                <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">(Relevant) error snippet from the log: </span></p>
                <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">&lt;error&gt;</span></p>
                <br>
              </b>from lago log: <br>
              <pre style="box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;margin:0px;color:rgb(51,51,51);font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial">Failed to start service &#39;ovirt-imageio-proxy

messages logs: 

Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Starting Session 8 of user root.
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: Traceback (most recent call last):
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/bin/ovirt-imageio-proxy&quot;<wbr>, line 85, in &lt;module&gt;
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: status = image_proxy.main(args, config)
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/lib/python2.7/site-packa<wbr>ges/ovirt_imageio_proxy/image_<wbr>proxy.py&quot;, line 21, in main
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: image_server.start(config)
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/lib/python2.7/site-packa<wbr>ges/ovirt_imageio_proxy/server<wbr>.py&quot;, line 45, in start
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: WSGIRequestHandler)
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/lib64/python2.7/SocketSe<wbr>rver.py&quot;, line 419, in __init__
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: self.server_bind()
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/lib64/python2.7/wsgiref/<wbr>simple_server.py&quot;, line 48, in server_bind
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: HTTPServer.server_bind(self)
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/lib64/python2.7/BaseHTTP<wbr>Server.py&quot;, line 108, in server_bind
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: SocketServer.TCPServer.server_<wbr>bind(self)
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/lib64/python2.7/SocketSe<wbr>rver.py&quot;, line 430, in server_bind
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: self.socket.bind(self.server_a<wbr>ddress)
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/lib64/python2.7/socket.p<wbr>y&quot;, line 224, in meth
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: return getattr(self._sock,name)(*args<wbr>)
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: socket.error: [Errno 98] Address already in use
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: ovirt-imageio-proxy.service: main process exited, code=exited, status=1/FAILURE
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Failed to start oVirt ImageIO Proxy.
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Unit ovirt-imageio-proxy.service entered failed state.
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: ovirt-imageio-proxy.service failed.
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: ovirt-imageio-proxy.service holdoff time over, scheduling restart.
Nov 23 07:30:47 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Starting oVirt ImageIO Proxy...
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: Traceback (most recent call last):
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/bin/ovirt-imageio-proxy&quot;<wbr>, line 85, in &lt;module&gt;
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: status = image_proxy.main(args, config)
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/lib/python2.7/site-packa<wbr>ges/ovirt_imageio_proxy/image_<wbr>proxy.py&quot;, line 21, in main
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: image_server.start(config)
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/lib/python2.7/site-packa<wbr>ges/ovirt_imageio_proxy/server<wbr>.py&quot;, line 45, in start
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: WSGIRequestHandler)
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/lib64/python2.7/SocketSe<wbr>rver.py&quot;, line 419, in __init__
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: self.server_bind()
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/lib64/python2.7/wsgiref/<wbr>simple_server.py&quot;, line 48, in server_bind
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: HTTPServer.server_bind(self)
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/lib64/python2.7/BaseHTTP<wbr>Server.py&quot;, line 108, in server_bind
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: SocketServer.TCPServer.server_<wbr>bind(self)
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/lib64/python2.7/SocketSe<wbr>rver.py&quot;, line 430, in server_bind
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: self.socket.bind(self.server_a<wbr>ddress)
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: File &quot;/usr/lib64/python2.7/socket.p<wbr>y&quot;, line 224, in meth
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: return getattr(self._sock,name)(*args<wbr>)
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine ovirt-imageio-proxy: socket.error: [Errno 98] Address already in use
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: ovirt-imageio-proxy.service: main process exited, code=exited, status=1/FAILURE
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Failed to start oVirt ImageIO Proxy.
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Unit ovirt-imageio-proxy.service entered failed state.
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: ovirt-imageio-proxy.service failed.
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: ovirt-imageio-proxy.service holdoff time over, scheduling restart.
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: start request repeated too quickly for ovirt-imageio-proxy.service
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Failed to start oVirt ImageIO Proxy.
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: Unit ovirt-imageio-proxy.service entered failed state.
Nov 23 07:30:48 lago-upgrade-from-release-suit<wbr>e-master-engine systemd: ovirt-imageio-proxy.service failed.</pre>
              <p><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
                </b></p>
              <p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">&lt;/error&gt;</span></b></p>
              <b style="font-weight:normal" id="m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
              </b><br class="m_2700312605936236023m_-1653390000056412231Apple-interchange-newline">
            </div>
            <br>
            ______________________________<wbr>_________________<br>
            Infra mailing list<br>
            <a href="mailto:Infra@ovirt.org" target="_blank">Infra@ovirt.org</a><br>
            <a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/infra</a><br>
            <br>
          </blockquote>
        </div>
        <br>
      </div>
    </blockquote>
    <p><br>
    </p>
  </div></div></div>

<br>______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/devel</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><font face="overpass, sans-serif" color="#000000" size="2"><span style="text-transform:uppercase"><b>GAL bEN HAIM</b></span></font><div><span style="color:rgb(0,0,0);font-family:overpass,sans-serif;text-transform:uppercase"><font size="2">RHV DEVOPS</font></span><br></div></div></div>
</div>