<div dir="ltr"><div><div><div><div>We made the PPC64 build_artifacts jobs not invoke deploy to experimental a long while ago.<br><br></div>We did this because we have a race condition between the build_artifacts jobs for a given commit for different platforms. This can and does cause various issues, but having the Fedora build invoke deploy-to-experimental and OST before the EL7 build is done is mostly harmless.<br><br></div>With PPC64 the issue is that when PPC finishes building before x86_64 we end up with 'noarch' packages in the repos that are newer then the equivalent x86_64. This in turn causes the experimental repos to be broken and OST to fail until the x86_64 build is done.<br><br></div>Fixing this will require creating some sort of a synchronization mechanism between the build artifacts jobs. This is not easy to do unfortunately.<br><br></div>I made a ticket for us to track various possible solutions:<br><a href="https://ovirt-jira.atlassian.net/browse/OVIRT-1315">https://ovirt-jira.atlassian.net/browse/OVIRT-1315</a><br><div><div><div><div><div><div><div><div class="gmail_extra"><br><div class="gmail_quote">On 11 April 2017 at 14:59, Sandro Bonazzola <span dir="ltr"><<a href="mailto:sbonazzo@redhat.com" target="_blank">sbonazzo@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">The x86_64 job[1] has a downstream project[2] taking care of deploying the build to the repos <br clear="all"><div>while the ppc64le[3] hasn't.</div><div><br></div><div>Result is that ovirt-master-snapshot is not receiving updates for ppc64le and is currently failing repository closure:</div><div><br></div><div><pre class="gmail-m_4958615984937289294gmail-console-output" style="box-sizing:border-box;white-space:pre-wrap;margin-top:0px;margin-bottom:0px;color:rgb(51,51,51);font-size:14px"><span class="gmail-m_4958615984937289294gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">00:02:47.636</b> </span>Error: Package: vdsm-gluster-4.20.0-612.<wbr>git378d837.el7.centos.noarch (ovirt-master-snapshot)
<span class="gmail-m_4958615984937289294gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">00:02:47.637</b> </span> Requires: vdsm = 4.20.0-612.git378d837.el7.<wbr>centos
<span class="gmail-m_4958615984937289294gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">00:02:47.637</b> </span> Installing: vdsm-4.18.999-925.git195c44e.<wbr>el7.centos.ppc64le (ovirt-master-snapshot)
<span class="gmail-m_4958615984937289294gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">00:02:47.637</b> </span> vdsm = 4.18.999-925.git195c44e.el7.<wbr>centos
<span class="gmail-m_4958615984937289294gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">00:02:47.637</b> </span>Error: Package: vdsm-hook-ethtool-options-4.<wbr>20.0-612.git378d837.el7.<wbr>centos.noarch (ovirt-master-snapshot)
<span class="gmail-m_4958615984937289294gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">00:02:47.637</b> </span> Requires: vdsm = 4.20.0-612.git378d837.el7.<wbr>centos
<span class="gmail-m_4958615984937289294gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">00:02:47.637</b> </span> Installing: vdsm-4.18.999-925.git195c44e.<wbr>el7.centos.ppc64le (ovirt-master-snapshot)
<span class="gmail-m_4958615984937289294gmail-timestamp" style="box-sizing:border-box"><b style="box-sizing:border-box">00:02:47.637</b> </span> vdsm = 4.18.999-925.git195c44e.el7.<wbr>centos</pre></div><div><br></div><div>Please fix vdsm job for triggering deploy-to-ovirt_experimental_<wbr>master</div><div><br></div><div>[1] <a href="http://jenkins.ovirt.org/job/vdsm_master_build-artifacts-el7-x86_64/" target="_blank">http://jenkins.ovirt.org/<wbr>job/vdsm_master_build-<wbr>artifacts-el7-x86_64/</a></div><div>[2] <a href="http://jenkins.ovirt.org/job/deploy-to-ovirt_experimental_master/" target="_blank">http://jenkins.ovirt.org/<wbr>job/deploy-to-ovirt_<wbr>experimental_master/</a></div><div>[3] <a href="http://jenkins.ovirt.org/job/vdsm_master_build-artifacts-el7-ppc64le/" target="_blank">http://jenkins.ovirt.org/<wbr>job/vdsm_master_build-<wbr>artifacts-el7-ppc64le/</a></div><span class="gmail-HOEnZb"><font color="#888888"><div><br></div>-- <br><div class="gmail-m_4958615984937289294gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-weight:bold;margin:0px;padding:0px;font-size:14px;text-transform:uppercase"><span>SANDRO</span> <span>BONAZZOLA</span></p><p style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:10px;margin:0px 0px 4px;text-transform:uppercase"><span>ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D</span></p><p style="font-family:overpass,sans-serif;margin:0px;font-size:10px;color:rgb(153,153,153)"><a href="https://www.redhat.com/" style="color:rgb(0,136,206);margin:0px" target="_blank">Red Hat <span>EMEA</span></a></p><table style="color:rgb(0,0,0);font-family:overpass,sans-serif;font-size:medium" border="0"><tbody><tr><td width="100px"><a href="https://red.ht/sig" target="_blank"><img src="https://www.redhat.com/profiles/rh/themes/redhatdotcom/img/logo-red-hat-black.png" width="90" height="auto"></a></td><td style="font-size:10px"><div><a href="https://redhat.com/trusted" style="color:rgb(204,0,0);font-weight:bold" target="_blank">TRIED. TESTED. TRUSTED.</a></div></td></tr></tbody></table></div></div></div></div></div></div></div>
</font></span></div>
</blockquote></div><br><br clear="all"><br>-- <br><div class="gmail_signature">Barak Korren<br><a href="mailto:bkorren@redhat.com" target="_blank">bkorren@redhat.com</a><br>RHCE, RHCi, RHV-DevOps Team<br><a href="https://ifireball.wordpress.com/" target="_blank">https://ifireball.wordpress.com/</a></div>
</div></div></div></div></div></div></div></div></div>