<div dir="ltr">This issue is caused when calling to "lago ovirt serve" (which starts the repo server) as a subprocess, and not making sure to kill it when it's not needed anymore (or on failure).<div><br></div><div>In the past, VDSM's check patch was coded like this, but we fixed it. Could be that the same bug exists in another suite.</div><div><div><br></div></div><div><span style="font-size:12.8px">Evgheni, can you specify a slave that had this issue?</span></div></div><div class="gmail_extra"><br><div class="gmail_quote">On Fri, Oct 20, 2017 at 3:44 PM, Evgheni Dereveanchin <span dir="ltr"><<a href="mailto:ederevea@redhat.com" target="_blank">ederevea@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">I agree with Barak - checked the slave that was failing and there was a process still listening to port 8585. <div>The slave was put offline the slave but attempting to run the job on a different one caused the exact same error.</div><div>As more slaves are affected this may be a lago bug. No changes were made on slaves this week.</div></div><div class="gmail_extra"><div><div class="h5"><br><div class="gmail_quote">On Fri, Oct 20, 2017 at 10:46 AM, Barak Korren <span dir="ltr"><<a href="mailto:bkorren@redhat.com" target="_blank">bkorren@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">looks like there might be a lago localrepo process process left up on the slave from a previous run<br></div><div class="gmail_extra"><div><div class="m_-4629791105643128795h5"><br><div class="gmail_quote">On 20 October 2017 at 11:26, Eyal Edri <span dir="ltr"><<a href="mailto:eedri@redhat.com" target="_blank">eedri@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Evgheni,<div>Was there any change recently to Lago slaves? </div></div><div class="gmail_extra"><div><div class="m_-4629791105643128795m_3709929313445117411h5"><br><div class="gmail_quote">On Fri, Oct 20, 2017 at 11:05 AM, Piotr Kliczewski <span dir="ltr"><<a href="mailto:piotr.kliczewski@gmail.com" target="_blank">piotr.kliczewski@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">I attempted to run manual OST twice and both failed with below issue.<br>
Can someone take a look?<br>
<br>
Thanks,<br>
Piotr<br>
<br>
2017-10-20 07:59:12,485::log_utils.py::__<wbr>exit__::607::ovirtlago.prefix:<wbr>:DEBUG::<br>
File "/usr/lib/python2.7/site-packa<wbr>ges/lago/log_utils.py", line 636,<br>
in wrapper<br>
return func(*args, **kwargs)<br>
File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/reposetup.py", line<br>
111, in wrapper<br>
with utils.repo_server_context(args<wbr>[0]):<br>
File "/usr/lib64/python2.7/contextl<wbr>ib.py", line 17, in __enter__<br>
return self.gen.next()<br>
File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/utils.py", line<br>
100, in repo_server_context<br>
root_dir=prefix.paths.internal<wbr>_repo(),<br>
File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/utils.py", line 76,<br>
in _create_http_server<br>
generate_request_handler(root_<wbr>dir),<br>
File "/usr/lib64/python2.7/SocketSe<wbr>rver.py", line 419, in __init__<br>
self.server_bind()<br>
File "/usr/lib64/python2.7/BaseHTTP<wbr>Server.py", line 108, in server_bind<br>
SocketServer.TCPServer.server_<wbr>bind(self)<br>
File "/usr/lib64/python2.7/SocketSe<wbr>rver.py", line 430, in server_bind<br>
self.socket.bind(self.server_a<wbr>ddress)<br>
File "/usr/lib64/python2.7/socket.p<wbr>y", line 224, in meth<br>
return getattr(self._sock,name)(*args<wbr>)<br>
<br>
2017-10-20 07:59:12,485::cmd.py::do_run::<wbr>365::root::ERROR::Error<br>
occured, aborting<br>
Traceback (most recent call last):<br>
File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/cmd.py", line 362, in do_run<br>
self.cli_plugins[args.ovirtver<wbr>b].do_run(args)<br>
File "/usr/lib/python2.7/site-packa<wbr>ges/lago/plugins/cli.py", line<br>
184, in do_run<br>
self._do_run(**vars(args))<br>
File "/usr/lib/python2.7/site-packa<wbr>ges/lago/utils.py", line 501, in wrapper<br>
return func(*args, **kwargs)<br>
File "/usr/lib/python2.7/site-packa<wbr>ges/lago/utils.py", line 512, in wrapper<br>
return func(*args, prefix=prefix, **kwargs)<br>
File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/cmd.py", line 166,<br>
in do_deploy<br>
prefix.deploy()<br>
File "/usr/lib/python2.7/site-packa<wbr>ges/lago/log_utils.py", line 636,<br>
in wrapper<br>
return func(*args, **kwargs)<br>
File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/reposetup.py", line<br>
111, in wrapper<br>
with utils.repo_server_context(args<wbr>[0]):<br>
File "/usr/lib64/python2.7/contextl<wbr>ib.py", line 17, in __enter__<br>
return self.gen.next()<br>
File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/utils.py", line<br>
100, in repo_server_context<br>
root_dir=prefix.paths.internal<wbr>_repo(),<br>
File "/usr/lib/python2.7/site-packa<wbr>ges/ovirtlago/utils.py", line 76,<br>
in _create_http_server<br>
generate_request_handler(root_<wbr>dir),<br>
File "/usr/lib64/python2.7/SocketSe<wbr>rver.py", line 419, in __init__<br>
self.server_bind()<br>
File "/usr/lib64/python2.7/BaseHTTP<wbr>Server.py", line 108, in server_bind<br>
SocketServer.TCPServer.server_<wbr>bind(self)<br>
File "/usr/lib64/python2.7/SocketSe<wbr>rver.py", line 430, in server_bind<br>
self.socket.bind(self.server_a<wbr>ddress)<br>
File "/usr/lib64/python2.7/socket.p<wbr>y", line 224, in meth<br>
return getattr(self._sock,name)(*args<wbr>)<br>
error: [Errno 98] Address already in use<br>
______________________________<wbr>_________________<br>
Infra mailing list<br>
<a href="mailto:Infra@ovirt.org" target="_blank">Infra@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/infra</a><br>
<br>
<br>
</blockquote></div><br><br clear="all"><div><br></div></div></div>-- <br><div class="m_-4629791105643128795m_3709929313445117411m_3700354406148393654gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><p style="font-family:overpass,sans-serif;margin:0px;padding:0px;font-size:14px;text-transform:uppercase;font-weight:bold"><font color="#cc0000">Eyal edri</font></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><br></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">MANAGER</p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">RHV DevOps</p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">EMEA VIRTUALIZATION R&D</p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><br></p><p style="font-family:overpass,sans-serif;margin:0px;font-size:10px;color:rgb(153,153,153)"><a href="https://www.redhat.com/" style="color:rgb(0,136,206);margin:0px" target="_blank">Red Hat EMEA</a></p><table style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium" border="0"><tbody><tr><td width="100px"><a href="https://red.ht/sig" style="color:rgb(17,85,204)" target="_blank"><img src="https://www.redhat.com/profiles/rh/themes/redhatdotcom/img/logo-red-hat-black.png" width="90" height="auto"></a></td><td style="font-size:10px"><a href="https://redhat.com/trusted" style="color:rgb(204,0,0);font-weight:bold" target="_blank">TRIED. TESTED. TRUSTED.</a></td></tr></tbody></table></div><div>phone: <a href="tel:+972%209-769-2018" value="+97297692018" target="_blank">+972-9-7692018</a><br>irc: eedri (on #tlv #rhev-dev #rhev-integ)</div></div></div></div></div></div></div></div></div></div></div>
</div>
<br>______________________________<wbr>_________________<br>
Infra mailing list<br>
<a href="mailto:Infra@ovirt.org" target="_blank">Infra@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/infra</a><br>
<br></blockquote></div><br><br clear="all"><br>-- <br></div></div><span class="m_-4629791105643128795HOEnZb"><font color="#888888"><div class="m_-4629791105643128795m_3709929313445117411gmail_signature" data-smartmail="gmail_signature">Barak Korren<br>RHV DevOps team , RHCE, RHCi<br>Red Hat EMEA<br><a href="http://redhat.com" target="_blank">redhat.com</a> | TRIED. TESTED. TRUSTED. | <a href="http://redhat.com/trusted" target="_blank">redhat.com/trusted</a></div>
</font></span></div>
</blockquote></div><br><br clear="all"><div><br></div></div></div><span class="HOEnZb"><font color="#888888">-- <br><div class="m_-4629791105643128795gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div style="font-size:small">Regards,</div><div style="font-size:small">Evgheni Dereveanchin</div></div></div>
</font></span></div>
</blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><font face="overpass, sans-serif" color="#000000" size="2"><span style="text-transform:uppercase"><b>GAL bEN HAIM</b></span></font><div><span style="color:rgb(0,0,0);font-family:overpass,sans-serif;text-transform:uppercase"><font size="2">RHV DEVOPS</font></span><br></div></div></div>
</div>