<div dir="ltr">Evgheni, <div>Do we have a way to detect which slaves are out of space and reprovision them or increase their size? </div></div><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Feb 27, 2018 at 12:59 PM, Sandro Bonazzola <span dir="ltr"><<a href="mailto:sbonazzo@redhat.com" target="_blank">sbonazzo@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><br><div class="gmail_extra"><br><div class="gmail_quote"><span class="">2018-02-26 0:53 GMT+01:00 oVirt Jenkins <span dir="ltr"><<a href="mailto:jenkins@ovirt.org" target="_blank">jenkins@ovirt.org</a>></span>:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Change 88094,2 (ovirt-engine) is probably the reason behind recent system test<br>
failures in the "ovirt-master" change queue and needs to be fixed.<br>
<br></blockquote><div><br></div></span><div>No, this is caused by multiple failure in jenkins jobs:</div><div><br></div><div><a href="http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-el7-x86_64/6699/" target="_blank">http://jenkins.ovirt.org/job/<wbr>ovirt-engine_master_build-<wbr>artifacts-el7-x86_64/6699/</a><br></div><div><pre class="m_2069415867583350616gmail-console-output" style="box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;margin:0px;color:rgb(51,51,51);font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><span class="m_2069415867583350616gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">19:22:46</b> </span>Failed to start postfix.service: Connection timed out
<span class="m_2069415867583350616gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">19:22:46</b> </span>See system logs and 'systemctl status postfix.service' for details.
<span class="m_2069415867583350616gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">19:22:46</b> </span>+ failed=true</pre><pre class="m_2069415867583350616gmail-console-output" style="box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;margin:0px;color:rgb(51,51,51);font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><br></pre><pre class="m_2069415867583350616gmail-console-output" style="box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;margin:0px;color:rgb(51,51,51);font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial">looks like infrastructure issue, slave not starting postfix service.</pre><pre class="m_2069415867583350616gmail-console-output" style="box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;margin:0px;color:rgb(51,51,51);font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><br></pre><br></div><div><a href="http://jenkins.ovirt.org/job/vdsm_master_check-merged-el7-x86_64/3231/" target="_blank">http://jenkins.ovirt.org/job/<wbr>vdsm_master_check-merged-el7-<wbr>x86_64/3231/</a><br></div><div><pre class="m_2069415867583350616gmail-console-output" style="box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;margin:0px;color:rgb(51,51,51);font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><span class="m_2069415867583350616gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">18:20:28</b> </span>+ chown -R jenkins:jenkins /home/jenkins/workspace/vdsm_<wbr>master_check-merged-el7-x86_<wbr>64/exported-artifacts
<span class="m_2069415867583350616gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">18:20:28</b> </span>chown: changing ownership of '/home/jenkins/workspace/vdsm_<wbr>master_check-merged-el7-x86_<wbr>64/exported-artifacts/<wbr>functional_tests_stdout.el7.<wbr>log': Operation not permitted</pre><br></div><div>Looks like a dirty slave</div><div><br></div><div><a href="http://jenkins.ovirt.org/job/vdsm_master_build-artifacts-fc27-s390x/207" target="_blank">http://jenkins.ovirt.org/job/<wbr>vdsm_master_build-artifacts-<wbr>fc27-s390x/207</a><br></div><div><pre class="m_2069415867583350616gmail-console-output" style="box-sizing:border-box;white-space:pre-wrap;word-wrap:break-word;margin:0px;color:rgb(51,51,51);font-size:14px;font-style:normal;font-variant-ligatures:normal;font-variant-caps:normal;font-weight:400;letter-spacing:normal;text-align:start;text-indent:0px;text-transform:none;word-spacing:0px;text-decoration-style:initial;text-decoration-color:initial"><span class="m_2069415867583350616gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">22:15:04</b> </span>Error Summary
<span class="m_2069415867583350616gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">22:15:04</b> </span>-------------
<span class="m_2069415867583350616gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">22:15:04</b> </span>Disk Requirements:
<span class="m_2069415867583350616gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">22:15:04</b> </span> At least 163MB more space needed on the / filesystem.</pre><br></div><div>Not enough space on the slave.</div><span class=""><div><br></div><div><br></div><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
This change had been removed from the testing queue. Artifacts build from this<br>
change will not be released until it is fixed.<br>
<br>
For further details about the change see:<br>
<a href="https://gerrit.ovirt.org/#/c/88094/2" rel="noreferrer" target="_blank">https://gerrit.ovirt.org/#/c/8<wbr>8094/2</a><br>
<br>
For failed test results see:<br>
<a href="http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/5860/" rel="noreferrer" target="_blank">http://jenkins.ovirt.org/job/o<wbr>virt-master_change-queue-teste<wbr>r/5860/</a><br>
______________________________<wbr>_________________<br>
Infra mailing list<br>
<a href="mailto:Infra@ovirt.org" target="_blank">Infra@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/infra</a><br>
</blockquote></span></div><span class="HOEnZb"><font color="#888888"><br><br clear="all"><div><br></div>-- <br><div class="m_2069415867583350616gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><span>SANDRO</span> <span>BONAZZOLA</span></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><span>ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D</span></p><p style="font-family:overpass,sans-serif;margin:0px;font-size:10px;color:rgb(153,153,153)"><a href="https://www.redhat.com/" style="color:rgb(0,136,206);margin:0px" target="_blank">Red Hat <span>EMEA</span></a></p><table border="0" style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium"><tbody><tr><td width="100px"><a href="https://red.ht/sig" target="_blank"><img src="https://www.redhat.com/profiles/rh/themes/redhatdotcom/img/logo-red-hat-black.png" width="90" height="auto"></a></td><td style="font-size:10px"><div><a href="https://redhat.com/trusted" style="color:rgb(204,0,0);font-weight:bold" target="_blank">TRIED. TESTED. TRUSTED.</a></div></td></tr></tbody></table><br></div></div></div></div></div></div></div></div></div></div></div></div></div>
</font></span></div></div>
<br>______________________________<wbr>_________________<br>
Infra mailing list<br>
<a href="mailto:Infra@ovirt.org">Infra@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/infra" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/infra</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><p style="font-family:overpass,sans-serif;margin:0px;padding:0px;font-size:14px;text-transform:uppercase;font-weight:bold"><font color="#cc0000">Eyal edri</font></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><br></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">MANAGER</p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">RHV DevOps</p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase">EMEA VIRTUALIZATION R&D</p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><br></p><p style="font-family:overpass,sans-serif;margin:0px;font-size:10px;color:rgb(153,153,153)"><a href="https://www.redhat.com/" style="color:rgb(0,136,206);margin:0px" target="_blank">Red Hat EMEA</a></p><table border="0" style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium"><tbody><tr><td width="100px"><a href="https://red.ht/sig" style="color:rgb(17,85,204)" target="_blank"><img src="https://www.redhat.com/profiles/rh/themes/redhatdotcom/img/logo-red-hat-black.png" width="90" height="auto"></a></td><td style="font-size:10px"><a href="https://redhat.com/trusted" style="color:rgb(204,0,0);font-weight:bold" target="_blank">TRIED. TESTED. TRUSTED.</a></td></tr></tbody></table></div><div>phone: +972-9-7692018<br>irc: eedri (on #tlv #rhev-dev #rhev-integ)</div></div></div></div></div></div></div></div></div></div></div>
</div>