<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<div class="moz-cite-prefix">I opened a bug for this issue: <br>
<br>
<a class="moz-txt-link-freetext" href="https://bugzilla.redhat.com/show_bug.cgi?id=1517764">https://bugzilla.redhat.com/show_bug.cgi?id=1517764</a><br>
<br>
<br>
On 11/26/2017 05:24 PM, Nir Soffer wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAMRbyysUB62Onui+3MtSDcJRAm2SoHNd_jp3=Yy9hWgZnCATug@mail.gmail.com">
<div dir="ltr">I think we need to check and report which process
is listening on a port
<div>when starting a server on that port fail.
<div>
<div><br>
</div>
<div>Didi, do you think we can integrate this in the deploy
code, or this</div>
<div>should be implemented in each server?</div>
<div><br>
</div>
<div>Maybe when deployment fails, the deploy code can report
all the</div>
<div>listening sockets and the processes bound to these
sockets?</div>
<div><br>
</div>
<div>Nir</div>
<br>
<div class="gmail_quote">
<div dir="ltr">On Sun, Nov 26, 2017 at 7:11 PM Gal Ben
Haim <<a href="mailto:gbenhaim@redhat.com"
moz-do-not-send="true">gbenhaim@redhat.com</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr">The failure is not consistent.</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">On Sun, Nov 26, 2017 at 5:33
PM, Yaniv Kaul <span dir="ltr"><<a
href="mailto:ykaul@redhat.com" target="_blank"
moz-do-not-send="true">ykaul@redhat.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0
.8ex;border-left:1px #ccc solid;padding-left:1ex">
<div dir="ltr"><br>
<div class="gmail_extra"><br>
<div class="gmail_quote"><span>On Sun, Nov 26,
2017 at 4:53 PM, Gal Ben Haim <span
dir="ltr"><<a
href="mailto:gbenhaim@redhat.com"
target="_blank" moz-do-not-send="true">gbenhaim@redhat.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote"
style="margin:0 0 0 .8ex;border-left:1px
#ccc solid;padding-left:1ex">
<div dir="ltr">We still see this issue
on the upgrade suite from latest
release to master [1].
<div>I don't see any evidence in
"/var/log/messages" [2] that
"ovirt-imageio-proxy" was started
twice.</div>
</div>
</blockquote>
<div><br>
</div>
</span>
<div>Since it's not a registered port and a
high port, could it be used by something
else (what are the odds though ?</div>
<div>Is it consistent?</div>
<span class="m_-3471807290991743346HOEnZb"><font
color="#888888">
<div>Y.</div>
</font></span>
<div>
<div class="m_-3471807290991743346h5">
<div> </div>
<blockquote class="gmail_quote"
style="margin:0 0 0
.8ex;border-left:1px #ccc
solid;padding-left:1ex">
<div dir="ltr">
<div><br>
</div>
<div>[1] <a
href="http://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/ovirt-master_change-queue-tester/runs/4153/nodes/123/steps/241/log/?start=0"
target="_blank"
moz-do-not-send="true">http://jenkins.ovirt.org/blue/rest/organizations/jenkins/pipelines/ovirt-master_change-queue-tester/runs/4153/nodes/123/steps/241/log/?start=0</a></div>
<div><br>
</div>
<div>[2] <a
href="http://jenkins.ovirt.org/view/Change%20queue%20jobs/job/ovirt-master_change-queue-tester/4153/artifact/exported-artifacts/upgrade-from-release-suit-master-el7/test_logs/upgrade-from-release-suite-master/post-001_initialize_engine.py/lago-upgrade-from-release-suite-master-engine/_var_log/messages/*view*/"
target="_blank"
moz-do-not-send="true">http://jenkins.ovirt.org/view/Change%20queue%20jobs/job/ovirt-master_change-queue-tester/4153/artifact/exported-artifacts/upgrade-from-release-suit-master-el7/test_logs/upgrade-from-release-suite-master/post-001_initialize_engine.py/lago-upgrade-from-release-suite-master-engine/_var_log/messages/*view*/</a> </div>
</div>
<div class="gmail_extra"><br>
<div class="gmail_quote">
<div>
<div
class="m_-3471807290991743346m_-7429676041098110157h5">On
Fri, Nov 24, 2017 at 8:16 PM,
Dafna Ron <span dir="ltr"><<a
href="mailto:dron@redhat.com" target="_blank" moz-do-not-send="true">dron@redhat.com</a>></span>
wrote:<br>
</div>
</div>
<blockquote class="gmail_quote"
style="margin:0 0 0
.8ex;border-left:1px #ccc
solid;padding-left:1ex">
<div>
<div
class="m_-3471807290991743346m_-7429676041098110157h5">
<div text="#000000"
bgcolor="#FFFFFF">
<div
class="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023moz-cite-prefix">there
were two different
patches reported as
failing cq today with
the ovirt-imageio-proxy
service failing to
start. <br>
<br>
Here is the latest
failure:
<a
class="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023moz-txt-link-freetext"
href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4130/artifact"
target="_blank"
moz-do-not-send="true">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4130/artifact</a>
<div>
<div
class="m_-3471807290991743346m_-7429676041098110157m_212727575502667410h5"><br>
<br>
<br>
<br>
On 11/23/2017 03:39
PM, Allon Mureinik
wrote:<br>
</div>
</div>
</div>
<div>
<div
class="m_-3471807290991743346m_-7429676041098110157m_212727575502667410h5">
<blockquote
type="cite">
<div dir="ltr">
<div
style="font-family:monospace,monospace">Daniel/Nir?</div>
</div>
<div
class="gmail_extra"><br>
<div
class="gmail_quote">On
Thu, Nov 23,
2017 at 5:29 PM,
Dafna Ron <span
dir="ltr"><<a
href="mailto:dron@redhat.com" target="_blank" moz-do-not-send="true">dron@redhat.com</a>></span>
wrote:<br>
<blockquote
class="gmail_quote"
style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div
text="#000000"
bgcolor="#FFFFFF">
<p>Hi, <br>
</p>
<p>We have a
failing on
test
001_initialize_engine.test_initialize_engine.
<br>
</p>
<p>This is
failing with
error Failed
to start
service
'ovirt-imageio-proxy</p>
<p><br>
</p>
<p><b
style="font-weight:normal"
id="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
</b></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><b
style="font-weight:normal"
id="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link and headline ofto suspected patches:
</span></b></p>
<b
style="font-weight:normal"
id="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
</b><b
style="font-weight:normal"
id="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">build: Make resulting RPMs architecture-specific - <a class="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231moz-txt-link-freetext" href="https://gerrit.ovirt.org/#/c/84534/" target="_blank" moz-do-not-send="true">https://gerrit.ovirt.org/#/c/84534/</a>
</span></p>
<br>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to Job:</span></p>
<a
class="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231moz-txt-link-freetext"
href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4055"
target="_blank" moz-do-not-send="true">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4055</a></b>
<p><b
style="font-weight:normal"
id="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><br>
</b></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><b
style="font-weight:normal"
id="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">Link to all logs:</span></b></p>
<b
style="font-weight:normal"
id="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">
</span></p>
</b>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><a class="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4055/artifact/" target="_blank" moz-do-not-send="true">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4055/artifact/</a></span></p>
<p><b
style="font-weight:normal"
id="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
</b></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><b
style="font-weight:normal"
id="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><a class="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231moz-txt-link-freetext" href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4055/artifact/exported-artifacts/upgrade-from-release-suit-master-el7/test_logs/upgrade-from-release-suite-master/post-001_initialize_engine.py/lago-upgrade-from-release-suite-master-engine/_var_log/messages/*view*/" target="_blank" moz-do-not-send="true">http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/4055/artifact/exported-artifacts/upgrade-from-release-suit-master-el7/test_logs/upgrade-from-release-suite-master/post-001_initialize_engine.py/lago-upgrade-from-release-suite-master-engine/_var_log/messages/*view*/</a></span></b></p>
<b
style="font-weight:normal"
id="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">
</span></p>
<br>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap">(Relevant) error snippet from the log: </span></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"><error></span></p>
<br>
</b>from lago
log: <br>
<pre style="box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;margin:0px;color:rgb(51,51,51);font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:normal;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial">Failed to start service 'ovirt-imageio-proxy
messages logs:
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine systemd: Starting Session 8 of user root.
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: Traceback (most recent call last):
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/bin/ovirt-imageio-proxy", line 85, in <module>
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: status = image_proxy.main(args, config)
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/lib/python2.7/site-packages/ovirt_imageio_proxy/image_proxy.py", line 21, in main
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: image_server.start(config)
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/lib/python2.7/site-packages/ovirt_imageio_proxy/server.py", line 45, in start
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: WSGIRequestHandler)
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: self.server_bind()
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/wsgiref/simple_server.py", line 48, in server_bind
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: HTTPServer.server_bind(self)
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in server_bind
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: SocketServer.TCPServer.server_bind(self)
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: self.socket.bind(self.server_address)
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/socket.py", line 224, in meth
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: return getattr(self._sock,name)(*args)
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: socket.error: [Errno 98] Address already in use
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine systemd: ovirt-imageio-proxy.service: main process exited, code=exited, status=1/FAILURE
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine systemd: Failed to start oVirt ImageIO Proxy.
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine systemd: Unit ovirt-imageio-proxy.service entered failed state.
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine systemd: ovirt-imageio-proxy.service failed.
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine systemd: ovirt-imageio-proxy.service holdoff time over, scheduling restart.
Nov 23 07:30:47 lago-upgrade-from-release-suite-master-engine systemd: Starting oVirt ImageIO Proxy...
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: Traceback (most recent call last):
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/bin/ovirt-imageio-proxy", line 85, in <module>
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: status = image_proxy.main(args, config)
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/lib/python2.7/site-packages/ovirt_imageio_proxy/image_proxy.py", line 21, in main
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: image_server.start(config)
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/lib/python2.7/site-packages/ovirt_imageio_proxy/server.py", line 45, in start
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: WSGIRequestHandler)
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/SocketServer.py", line 419, in __init__
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: self.server_bind()
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/wsgiref/simple_server.py", line 48, in server_bind
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: HTTPServer.server_bind(self)
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/BaseHTTPServer.py", line 108, in server_bind
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: SocketServer.TCPServer.server_bind(self)
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/SocketServer.py", line 430, in server_bind
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: self.socket.bind(self.server_address)
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: File "/usr/lib64/python2.7/socket.py", line 224, in meth
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: return getattr(self._sock,name)(*args)
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine ovirt-imageio-proxy: socket.error: [Errno 98] Address already in use
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine systemd: ovirt-imageio-proxy.service: main process exited, code=exited, status=1/FAILURE
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine systemd: Failed to start oVirt ImageIO Proxy.
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine systemd: Unit ovirt-imageio-proxy.service entered failed state.
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine systemd: ovirt-imageio-proxy.service failed.
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine systemd: ovirt-imageio-proxy.service holdoff time over, scheduling restart.
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine systemd: start request repeated too quickly for ovirt-imageio-proxy.service
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine systemd: Failed to start oVirt ImageIO Proxy.
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine systemd: Unit ovirt-imageio-proxy.service entered failed state.
Nov 23 07:30:48 lago-upgrade-from-release-suite-master-engine systemd: ovirt-imageio-proxy.service failed.</pre>
<p><b
style="font-weight:normal"
id="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
</b></p>
<p dir="ltr"
style="line-height:1.38;margin-top:0pt;margin-bottom:0pt"><b
style="font-weight:normal"
id="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7"><span style="font-size:11pt;font-family:Arial;color:#000000;background-color:transparent;font-weight:400;font-style:normal;font-variant:normal;text-decoration:none;vertical-align:baseline;white-space:pre-wrap"></error></span></b></p>
<b
style="font-weight:normal"
id="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231docs-internal-guid-5859b7a1-e975-9a0d-3b01-8de053cdfef7">
</b><br
class="m_-3471807290991743346m_-7429676041098110157m_212727575502667410m_2700312605936236023m_-1653390000056412231Apple-interchange-newline">
</div>
<br>
_______________________________________________<br>
Infra mailing
list<br>
<a
href="mailto:Infra@ovirt.org"
target="_blank" moz-do-not-send="true">Infra@ovirt.org</a><br>
<a
href="http://lists.ovirt.org/mailman/listinfo/infra"
rel="noreferrer" target="_blank" moz-do-not-send="true">http://lists.ovirt.org/mailman/listinfo/infra</a><br>
<br>
</blockquote>
</div>
<br>
</div>
</blockquote>
<p><br>
</p>
</div>
</div>
</div>
<br>
</div>
</div>
<span>_______________________________________________<br>
Devel mailing list<br>
<a
href="mailto:Devel@ovirt.org"
target="_blank"
moz-do-not-send="true">Devel@ovirt.org</a><br>
<a
href="http://lists.ovirt.org/mailman/listinfo/devel"
rel="noreferrer"
target="_blank"
moz-do-not-send="true">http://lists.ovirt.org/mailman/listinfo/devel</a><br>
</span></blockquote>
</div>
<span
class="m_-3471807290991743346m_-7429676041098110157HOEnZb"><font
color="#888888"><br>
<br clear="all">
<div><br>
</div>
-- <br>
<div
class="m_-3471807290991743346m_-7429676041098110157m_212727575502667410gmail_signature"
data-smartmail="gmail_signature">
<div dir="ltr"><font
color="#000000" size="2"
face="overpass,
sans-serif"><span
style="text-transform:uppercase"><b>GAL
bEN HAIM</b></span></font>
<div><span
style="color:rgb(0,0,0);font-family:overpass,sans-serif;text-transform:uppercase"><font
size="2">RHV DEVOPS</font></span><br>
</div>
</div>
</div>
</font></span></div>
<br>
_______________________________________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org"
target="_blank"
moz-do-not-send="true">Devel@ovirt.org</a><br>
<a
href="http://lists.ovirt.org/mailman/listinfo/devel"
rel="noreferrer" target="_blank"
moz-do-not-send="true">http://lists.ovirt.org/mailman/listinfo/devel</a><br>
</blockquote>
</div>
</div>
</div>
<br>
</div>
</div>
</blockquote>
</div>
<br>
<br clear="all">
<div><br>
</div>
-- <br>
<div class="m_-3471807290991743346gmail_signature"
data-smartmail="gmail_signature">
<div dir="ltr"><font color="#000000" size="2"
face="overpass, sans-serif"><span
style="text-transform:uppercase"><b>GAL bEN
HAIM</b></span></font>
<div><span
style="color:rgb(0,0,0);font-family:overpass,sans-serif;text-transform:uppercase"><font
size="2">RHV DEVOPS</font></span><br>
</div>
</div>
</div>
</div>
_______________________________________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org" target="_blank"
moz-do-not-send="true">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel"
rel="noreferrer" target="_blank"
moz-do-not-send="true">http://lists.ovirt.org/mailman/listinfo/devel</a></blockquote>
</div>
</div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<br>
<pre wrap="">_______________________________________________
Devel mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Devel@ovirt.org">Devel@ovirt.org</a>
<a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/devel">http://lists.ovirt.org/mailman/listinfo/devel</a></pre>
</blockquote>
<p><br>
</p>
</body>
</html>