<div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Wed, Nov 29, 2017 at 1:00 PM, Dafna Ron <span dir="ltr"><<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
<div class="m_1232156828274802567moz-cite-prefix">this is the plugin info from steup log
but I don't see anything more than we have seen except a timeout.
<br>
<br>
<a class="m_1232156828274802567moz-txt-link-freetext" href="https://pastebin.com/QVtNRNWV" target="_blank">https://pastebin.com/QVtNRNWV</a><br>
<br>
<a class="m_1232156828274802567moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4194/artifact/exported-artifacts/upgrade-from-release-suit-master-el7/test_logs/upgrade-from-release-suite-master/post-001_initialize_engine.py/lago-upgrade-from-release-suite-master-engine/_var_log/ovirt-engine/setup/ovirt-engine-setup-20171128123116-mmjen3.log" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt-master_change-queue-<wbr>tester/4194/artifact/exported-<wbr>artifacts/upgrade-from-<wbr>release-suit-master-el7/test_<wbr>logs/upgrade-from-release-<wbr>suite-master/post-001_<wbr>initialize_engine.py/lago-<wbr>upgrade-from-release-suite-<wbr>master-engine/_var_log/ovirt-<wbr>engine/setup/ovirt-engine-<wbr>setup-20171128123116-mmjen3.<wbr>log</a><br>
<br>
Didi, is there anywhere else I should look? <br></div></div></blockquote><div><br></div><div>Sadly, as already replied, not yet. Hopefully next time...<br></div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div text="#000000" bgcolor="#FFFFFF"><div class="m_1232156828274802567moz-cite-prefix"><div><div class="h5">
<br>
<br>
On 11/29/2017 10:18 AM, Nir Soffer wrote:<br>
</div></div></div><div><div class="h5">
<blockquote type="cite">
<div dir="ltr">Do we have more info from Didi's debug plugin now?<br>
<br>
<div class="gmail_quote">
<div dir="ltr">On Wed, Nov 29, 2017 at 12:07 PM Dafna Ron <<a href="mailto:dron@redhat.com" target="_blank">dron@redhat.com</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
<pre style="color:rgb(0,0,0);font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial;word-wrap:break-word;white-space:pre-wrap"><b style="font-weight:normal" id="m_1232156828274802567m_-7963892763381824284docs-internal-guid-5859b7a1-0736-c7fc-29c0-3a6e4e1d9a66"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Hi,
</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">
</span></p></b><b style="font-weight:normal" id="m_1232156828274802567m_-7963892763381824284docs-internal-guid-5859b7a1-0736-c7fc-29c0-3a6e4e1d9a66"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">We have failed cq with ovirt-imageio failing to start on upgrade suite<b>. </b>I can still only see errors<b> </b>in the messages log.
</span></p></b><b style="font-weight:normal" id="m_1232156828274802567m_-7963892763381824284docs-internal-guid-5859b7a1-0736-c7fc-29c0-3a6e4e1d9a66"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">I'm writing the reported patch but I don't think it has anything to do with this issue.
</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">
</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link and headline of suspected patches: </span></p>restapi: Enable update to no default network provider of cluster - <a class="m_1232156828274802567m_-7963892763381824284moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/84814/" target="_blank">https://gerrit.ovirt.org/#/c/<wbr>84814/</a>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">
</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to Job:</span></p><a class="m_1232156828274802567m_-7963892763381824284moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4194/" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt-master_change-queue-<wbr>tester/4194/</a>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to all logs:</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">
</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><a class="m_1232156828274802567m_-7963892763381824284moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4194/artifact/" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt-master_change-queue-<wbr>tester/4194/artifact/</a></span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">
</span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><a class="m_1232156828274802567m_-7963892763381824284moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4194/testReport/junit/%28root%29/001_initialize_engine/test_initialize_engine/" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt-master_change-queue-<wbr>tester/4194/testReport/junit/(<wbr>root)/001_initialize_engine/<wbr>test_initialize_engine/</a></span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">
</span></p></b><b style="font-weight:normal" id="m_1232156828274802567m_-7963892763381824284docs-internal-guid-5859b7a1-0736-c7fc-29c0-3a6e4e1d9a66"><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><a class="m_1232156828274802567m_-7963892763381824284moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4194/artifact/exported-artifacts/upgrade-from-release-suit-master-el7/test_logs/upgrade-from-release-suite-master/post-001_initialize_engine.py/lago-upgrade-from-release-suite-master-engine/_var_log/messages/*view*/" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt-master_change-queue-<wbr>tester/4194/artifact/exported-<wbr>artifacts/upgrade-from-<wbr>release-suit-master-el7/test_<wbr>logs/upgrade-from-release-<wbr>suite-master/post-001_<wbr>initialize_engine.py/lago-<wbr>upgrade-from-release-suite-<wbr>master-engine/_var_log/<wbr>messages/*view*/</a>
</span></p>
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">(Relevant) error snippet from the log: </span></p><p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><error></span></p>
</b>From messages log
<b style="font-weight:normal" id="m_1232156828274802567m_-7963892763381824284docs-internal-guid-5859b7a1-0736-c7fc-29c0-3a6e4e1d9a66">
Nov 28 12:32:13 lago-upgrade-from-release-<wbr>suite-master-engine systemd: Started oVirt Engine.
Nov 28 12:32:13 lago-upgrade-from-release-<wbr>suite-master-engine systemd: Reloading.
Nov 28 12:32:13 lago-upgrade-from-release-<wbr>suite-master-engine systemd: Configuration file /usr/lib/systemd/system/<wbr>ebtables.service is marked executable. Please remove executable permission bits. Proceeding anyway.
Nov 28 12:32:13 lago-upgrade-from-release-<wbr>suite-master-engine systemd: Starting oVirt Engine Data Warehouse...
Nov 28 12:32:13 lago-upgrade-from-release-<wbr>suite-master-engine systemd: Started oVirt Engine Data Warehouse.
Nov 28 12:32:13 lago-upgrade-from-release-<wbr>suite-master-engine systemd: Reloading.
Nov 28 12:32:13 lago-upgrade-from-release-<wbr>suite-master-engine systemd: Configuration file /usr/lib/systemd/system/<wbr>ebtables.service is marked executable. Please remove executable permission bits. Proceeding anyway.
Nov 28 12:32:13 lago-upgrade-from-release-<wbr>suite-master-engine systemd: Starting oVirt ImageIO Proxy...
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: Traceback (most recent call last):
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/bin/ovirt-imageio-proxy"<wbr>, line 85, in <module>
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: status = image_proxy.main(args, config)
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/lib/python2.7/site-<wbr>packages/ovirt_imageio_proxy/<wbr>image_proxy.py", line 21, in main
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: image_server.start(config)
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/lib/python2.7/site-<wbr>packages/ovirt_imageio_proxy/<wbr>server.py", line 45, in start
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: WSGIRequestHandler)
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/<wbr>SocketServer.py", line 419, in __init__
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: self.server_bind()
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/wsgiref/<wbr>simple_server.py", line 48, in server_bind
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: HTTPServer.server_bind(self)
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/<wbr>BaseHTTPServer.py", line 108, in server_bind
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: SocketServer.TCPServer.server_<wbr>bind(self)
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/<wbr>SocketServer.py", line 430, in server_bind
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: self.socket.bind(self.server_<wbr>address)
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/socket.<wbr>py", line 224, in meth
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: return getattr(self._sock,name)(*<wbr>args)
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: socket.error: [Errno 98] Address already in use
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine systemd: ovirt-imageio-proxy.service: main process exited, code=exited, status=1/FAILURE
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine systemd: Failed to start oVirt ImageIO Proxy.
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine systemd: Unit ovirt-imageio-proxy.service entered failed state.
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine systemd: ovirt-imageio-proxy.service failed.
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine systemd: ovirt-imageio-proxy.service holdoff time over, scheduling restart.
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine systemd: Starting oVirt ImageIO Proxy...
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: Traceback (most recent call last):
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/bin/ovirt-imageio-proxy"<wbr>, line 85, in <module>
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: status = image_proxy.main(args, config)
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/lib/python2.7/site-<wbr>packages/ovirt_imageio_proxy/<wbr>image_proxy.py", line 21, in main
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: image_server.start(config)
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/lib/python2.7/site-<wbr>packages/ovirt_imageio_proxy/<wbr>server.py", line 45, in start
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: WSGIRequestHandler)
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/<wbr>SocketServer.py", line 419, in __init__
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: self.server_bind()
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/wsgiref/<wbr>simple_server.py", line 48, in server_bind
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: HTTPServer.server_bind(self)
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/<wbr>BaseHTTPServer.py", line 108, in server_bind
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: SocketServer.TCPServer.server_<wbr>bind(self)
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/<wbr>SocketServer.py", line 430, in server_bind
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: self.socket.bind(self.server_<wbr>address)
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/socket.<wbr>py", line 224, in meth
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: return getattr(self._sock,name)(*<wbr>args)
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine ovirt-imageio-proxy: socket.error: [Errno 98] Address already in use
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine systemd: ovirt-imageio-proxy.service: main process exited, code=exited, status=1/FAILURE
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine systemd: Failed to start oVirt ImageIO Proxy.
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine systemd: Unit ovirt-imageio-proxy.service entered failed state.
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine systemd: ovirt-imageio-proxy.service failed.
Nov 28 12:32:14 lago-upgrade-from-release-<wbr>suite-master-engine systemd: ovirt-imageio-proxy.service holdoff time over, scheduling restart.
<p dir="ltr" style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"></error></span></p></b>
</pre>
</div>
______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org" target="_blank">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/devel</a></blockquote>
</div>
</div>
</blockquote>
<p><br>
</p>
</div></div></div>
</blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature" data-smartmail="gmail_signature">Didi<br></div>
</div></div>