From nsoffer at redhat.com Tue Sep 8 08:45:19 2020 Content-Type: multipart/mixed; boundary="===============5703332247130432944==" MIME-Version: 1.0 From: Nir Soffer To: infra at ovirt.org Subject: Re: [CI] Builds broken by "Status code: 403 for http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm" Date: Tue, 08 Sep 2020 11:44:44 +0300 Message-ID: In-Reply-To: CAMRbyys0EFmxrrUhVFOH705tWEnG5=CBZwFx6SQeH0G6RzUxkw@mail.gmail.com --===============5703332247130432944== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On Mon, Sep 7, 2020 at 2:30 PM Nir Soffer wrote: > > This is the second time, last time there was an issue during a nightly jo= b that > left the master snapshot repo broken. This is still broken today. In the past sending mail to infra-support created a bug, and someone was handling issue quickly. This seems to be broken now. We depend on http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.r= pm for development and CI. When the rpm is missing, CI jobs fail, and developers cannot update their setup. Please fix it as soon as possible. > I have 3 failure builds: > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7744/ > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7751/ > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7755/ > > All seems to fail in: > > [2020-09-07T10:00:56.163Z] + dnf install -y > http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm > [2020-09-07T10:01:08.524Z] Status code: 403 for > http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm (IP: > 66.187.230.40) > > Checking manually show: > > $ curl https://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm > > > 403 Forbidden > >

Forbidden

You don't have permission to access /pub/yum-repo/ovirt-release-master= .rpm > on this server.

> > > Looking at: > https://resources.ovirt.org/pub/yum-repo/ > > ovirt-elease-master.rpm does not exist. > > So we have 2 issues: > - The file does not exist > - We return "403 Forbidden" instead of "404 Not Found" --===============5703332247130432944==-- From lveyde at redhat.com Tue Sep 8 08:55:46 2020 Content-Type: multipart/mixed; boundary="===============1980423973824255176==" MIME-Version: 1.0 From: Lev Veyde To: infra at ovirt.org Subject: Re: [CI] Builds broken by "Status code: 403 for http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm" Date: Tue, 08 Sep 2020 11:53:41 +0300 Message-ID: In-Reply-To: CAMRbyysZB_Jsm=2c8fgMn-F-R6ynWrZwP6HvSCJnGWFChA-0hw@mail.gmail.com --===============1980423973824255176== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hi Nir, It looks like the CI job broke it again, breaking 4.2, 4.3 and master snapshot release RPM. I guess it's the same issue we had last time. Thanks in advance, On Tue, Sep 8, 2020 at 11:45 AM Nir Soffer wrote: > On Mon, Sep 7, 2020 at 2:30 PM Nir Soffer wrote: > > > > This is the second time, last time there was an issue during a nightly > job that > > left the master snapshot repo broken. > > This is still broken today. > > In the past sending mail to infra-support created a bug, and someone > was handling > issue quickly. This seems to be broken now. > > We depend on > http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm > for development and CI. When the rpm is missing, CI jobs fail, and > developers cannot > update their setup. > > Please fix it as soon as possible. > > > I have 3 failure builds: > > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7744/ > > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7751/ > > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7755/ > > > > All seems to fail in: > > > > [2020-09-07T10:00:56.163Z] + dnf install -y > > http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm > > [2020-09-07T10:01:08.524Z] Status code: 403 for > > http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm (IP: > > 66.187.230.40) > > > > Checking manually show: > > > > $ curl https://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm > > > > > > 403 Forbidden > > > >

Forbidden

> >

You don't have permission to access > /pub/yum-repo/ovirt-release-master.rpm > > on this server.

> > > > > > Looking at: > > https://resources.ovirt.org/pub/yum-repo/ > > > > ovirt-elease-master.rpm does not exist. > > > > So we have 2 issues: > > - The file does not exist > > - We return "403 Forbidden" instead of "404 Not Found" > > -- = Lev Veyde Senior Software Engineer, RHCE | RHCVA | MCITP Red Hat Israel lev(a)redhat.com | lveyde(a)redhat.com TRIED. TESTED. TRUSTED. --===============1980423973824255176== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+SGnCoE5pciw8ZGl2Pjxicj48L2Rpdj48ZGl2Pkl0IGxvb2tzIGxpa2Ug dGhlIENJIGpvYiBicm9rZSBpdCBhZ2FpbiwgYnJlYWtpbmcgNC4yLCA0LjMgYW5kIG1hc3RlciBz bmFwc2hvdCByZWxlYXNlIFJQTS48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PkkgZ3Vlc3MgaXQm IzM5O3MgdGhlIHNhbWUgaXNzdWUgd2UgaGFkIGxhc3QgdGltZS48L2Rpdj48ZGl2Pjxicj48L2Rp dj48ZGl2PlRoYW5rcyBpbiBhZHZhbmNlLDwvZGl2PjwvZGl2Pjxicj48ZGl2IGNsYXNzPSJnbWFp bF9xdW90ZSI+PGRpdiBkaXI9Imx0ciIgY2xhc3M9ImdtYWlsX2F0dHIiPk9uIFR1ZSwgU2VwIDgs IDIwMjAgYXQgMTE6NDUgQU0gTmlyIFNvZmZlciAmbHQ7PGEgaHJlZj0ibWFpbHRvOm5zb2ZmZXJA cmVkaGF0LmNvbSI+bnNvZmZlckByZWRoYXQuY29tPC9hPiZndDsgd3JvdGU6PGJyPjwvZGl2Pjxi bG9ja3F1b3RlIGNsYXNzPSJnbWFpbF9xdW90ZSIgc3R5bGU9Im1hcmdpbjowcHggMHB4IDBweCAw LjhleDtib3JkZXItbGVmdDoxcHggc29saWQgcmdiKDIwNCwyMDQsMjA0KTtwYWRkaW5nLWxlZnQ6 MWV4Ij5PbiBNb24sIFNlcCA3LCAyMDIwIGF0IDI6MzAgUE0gTmlyIFNvZmZlciAmbHQ7PGEgaHJl Zj0ibWFpbHRvOm5zb2ZmZXJAcmVkaGF0LmNvbSIgdGFyZ2V0PSJfYmxhbmsiPm5zb2ZmZXJAcmVk aGF0LmNvbTwvYT4mZ3Q7IHdyb3RlOjxicj4KJmd0Ozxicj4KJmd0OyBUaGlzIGlzIHRoZSBzZWNv bmQgdGltZSwgbGFzdCB0aW1lIHRoZXJlIHdhcyBhbiBpc3N1ZSBkdXJpbmcgYSBuaWdodGx5IGpv YiB0aGF0PGJyPgomZ3Q7IGxlZnQgdGhlIG1hc3RlciBzbmFwc2hvdCByZXBvIGJyb2tlbi48YnI+ Cjxicj4KVGhpcyBpcyBzdGlsbCBicm9rZW4gdG9kYXkuPGJyPgo8YnI+CkluIHRoZSBwYXN0IHNl bmRpbmcgbWFpbCB0byBpbmZyYS1zdXBwb3J0IGNyZWF0ZWQgYSBidWcsIGFuZCBzb21lb25lPGJy Pgp3YXMgaGFuZGxpbmc8YnI+Cmlzc3VlIHF1aWNrbHkuIFRoaXMgc2VlbXMgdG8gYmUgYnJva2Vu IG5vdy48YnI+Cjxicj4KV2UgZGVwZW5kIG9uIDxhIGhyZWY9Imh0dHA6Ly9yZXNvdXJjZXMub3Zp cnQub3JnL3B1Yi95dW0tcmVwby9vdmlydC1yZWxlYXNlLW1hc3Rlci5ycG0iIHJlbD0ibm9yZWZl cnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9yZXNvdXJjZXMub3ZpcnQub3JnL3B1Yi95dW0t cmVwby9vdmlydC1yZWxlYXNlLW1hc3Rlci5ycG08L2E+PGJyPgpmb3IgZGV2ZWxvcG1lbnQgYW5k IENJLiBXaGVuIHRoZSBycG0gaXMgbWlzc2luZywgQ0kgam9icyBmYWlsLCBhbmQ8YnI+CmRldmVs b3BlcnMgY2Fubm90PGJyPgp1cGRhdGUgdGhlaXIgc2V0dXAuPGJyPgo8YnI+ClBsZWFzZSBmaXgg aXQgYXMgc29vbiBhcyBwb3NzaWJsZS48YnI+Cjxicj4KJmd0OyBJIGhhdmUgMyBmYWlsdXJlIGJ1 aWxkczo8YnI+CiZndDsgPGEgaHJlZj0iaHR0cHM6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3Zp cnQtZW5naW5lX3N0YW5kYXJkLWNoZWNrLXBhdGNoLzc3NDQvIiByZWw9Im5vcmVmZXJyZXIiIHRh cmdldD0iX2JsYW5rIj5odHRwczovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1lbmdpbmVf c3RhbmRhcmQtY2hlY2stcGF0Y2gvNzc0NC88L2E+PGJyPgomZ3Q7IDxhIGhyZWY9Imh0dHBzOi8v amVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LWVuZ2luZV9zdGFuZGFyZC1jaGVjay1wYXRjaC83 NzUxLyIgcmVsPSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly9qZW5raW5zLm92 aXJ0Lm9yZy9qb2Ivb3ZpcnQtZW5naW5lX3N0YW5kYXJkLWNoZWNrLXBhdGNoLzc3NTEvPC9hPjxi cj4KJmd0OyA8YSBocmVmPSJodHRwczovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1lbmdp bmVfc3RhbmRhcmQtY2hlY2stcGF0Y2gvNzc1NS8iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJf YmxhbmsiPmh0dHBzOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LWVuZ2luZV9zdGFuZGFy ZC1jaGVjay1wYXRjaC83NzU1LzwvYT48YnI+CiZndDs8YnI+CiZndDsgQWxsIHNlZW1zIHRvIGZh aWwgaW46PGJyPgomZ3Q7PGJyPgomZ3Q7IFsyMDIwLTA5LTA3VDEwOjAwOjU2LjE2M1pdICsgZG5m IGluc3RhbGwgLXk8YnI+CiZndDsgPGEgaHJlZj0iaHR0cDovL3Jlc291cmNlcy5vdmlydC5vcmcv cHViL3l1bS1yZXBvL292aXJ0LXJlbGVhc2UtbWFzdGVyLnJwbSIgcmVsPSJub3JlZmVycmVyIiB0 YXJnZXQ9Il9ibGFuayI+aHR0cDovL3Jlc291cmNlcy5vdmlydC5vcmcvcHViL3l1bS1yZXBvL292 aXJ0LXJlbGVhc2UtbWFzdGVyLnJwbTwvYT48YnI+CiZndDsgWzIwMjAtMDktMDdUMTA6MDE6MDgu NTI0Wl0gU3RhdHVzIGNvZGU6IDQwMyBmb3I8YnI+CiZndDsgPGEgaHJlZj0iaHR0cDovL3Jlc291 cmNlcy5vdmlydC5vcmcvcHViL3l1bS1yZXBvL292aXJ0LXJlbGVhc2UtbWFzdGVyLnJwbSIgcmVs PSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL3Jlc291cmNlcy5vdmlydC5vcmcv cHViL3l1bS1yZXBvL292aXJ0LXJlbGVhc2UtbWFzdGVyLnJwbTwvYT4gKElQOjxicj4KJmd0OyA2 Ni4xODcuMjMwLjQwKTxicj4KJmd0Ozxicj4KJmd0OyBDaGVja2luZyBtYW51YWxseSBzaG93Ojxi cj4KJmd0Ozxicj4KJmd0OyAkIGN1cmwgPGEgaHJlZj0iaHR0cHM6Ly9yZXNvdXJjZXMub3ZpcnQu b3JnL3B1Yi95dW0tcmVwby9vdmlydC1yZWxlYXNlLW1hc3Rlci5ycG0iIHJlbD0ibm9yZWZlcnJl ciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8vcmVzb3VyY2VzLm92aXJ0Lm9yZy9wdWIveXVtLXJl cG8vb3ZpcnQtcmVsZWFzZS1tYXN0ZXIucnBtPC9hPjxicj4KJmd0OyAmbHQ7IURPQ1RZUEUgSFRN TCBQVUJMSUMgJnF1b3Q7LS8vSUVURi8vRFREIEhUTUwgMi4wLy9FTiZxdW90OyZndDs8YnI+CiZn dDsgJmx0O2h0bWwmZ3Q7Jmx0O2hlYWQmZ3Q7PGJyPgomZ3Q7ICZsdDt0aXRsZSZndDs0MDMgRm9y YmlkZGVuJmx0Oy90aXRsZSZndDs8YnI+CiZndDsgJmx0Oy9oZWFkJmd0OyZsdDtib2R5Jmd0Ozxi cj4KJmd0OyAmbHQ7aDEmZ3Q7Rm9yYmlkZGVuJmx0Oy9oMSZndDs8YnI+CiZndDsgJmx0O3AmZ3Q7 WW91IGRvbiYjMzk7dCBoYXZlIHBlcm1pc3Npb24gdG8gYWNjZXNzIC9wdWIveXVtLXJlcG8vb3Zp cnQtcmVsZWFzZS1tYXN0ZXIucnBtPGJyPgomZ3Q7IG9uIHRoaXMgc2VydmVyLiZsdDsvcCZndDs8 YnI+CiZndDsgJmx0Oy9ib2R5Jmd0OyZsdDsvaHRtbCZndDs8YnI+CiZndDs8YnI+CiZndDsgTG9v a2luZyBhdDo8YnI+CiZndDsgPGEgaHJlZj0iaHR0cHM6Ly9yZXNvdXJjZXMub3ZpcnQub3JnL3B1 Yi95dW0tcmVwby8iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8vcmVz b3VyY2VzLm92aXJ0Lm9yZy9wdWIveXVtLXJlcG8vPC9hPjxicj4KJmd0Ozxicj4KJmd0OyBvdmly dC1lbGVhc2UtbWFzdGVyLnJwbSBkb2VzIG5vdCBleGlzdC48YnI+CiZndDs8YnI+CiZndDsgU28g d2UgaGF2ZSAyIGlzc3Vlczo8YnI+CiZndDsgLSBUaGUgZmlsZSBkb2VzIG5vdCBleGlzdDxicj4K Jmd0OyAtIFdlIHJldHVybiAmcXVvdDs0MDMgRm9yYmlkZGVuJnF1b3Q7IGluc3RlYWQgb2YgJnF1 b3Q7NDA0IE5vdCBGb3VuZCZxdW90Ozxicj4KPGJyPgo8L2Jsb2NrcXVvdGU+PC9kaXY+PGJyIGNs ZWFyPSJhbGwiPjxkaXY+PGJyPjwvZGl2Pi0tIDxicj48ZGl2IGRpcj0ibHRyIiBjbGFzcz0iZ21h aWxfc2lnbmF0dXJlIj48ZGl2IGRpcj0ibHRyIj48ZGl2PjxkaXYgZGlyPSJsdHIiPjxkaXY+PGRp diBkaXI9Imx0ciI+PGRpdj48ZGl2IGRpcj0ibHRyIj48ZGl2PjxkaXYgZGlyPSJsdHIiPjxkaXY+ PGJyPjxkaXY+PHAgc3R5bGU9ImZvbnQtd2VpZ2h0OmJvbGQ7bWFyZ2luOjBweDtwYWRkaW5nOjBw eDtmb250LXNpemU6MTRweDt0ZXh0LXRyYW5zZm9ybTp1cHBlcmNhc2UiPjxzcGFuPkxldjwvc3Bh bj4gPHNwYW4+VmV5ZGU8L3NwYW4+PC9wPgo8cCBzdHlsZT0iZm9udC13ZWlnaHQ6bm9ybWFsO2Zv bnQtc2l6ZToxMHB4O21hcmdpbjowcHggMHB4IDRweDt0ZXh0LXRyYW5zZm9ybTp1cHBlcmNhc2Ui PjxzcGFuPlNlbmlvciBTb2Z0d2FyZSBFbmdpbmVlcjwvc3Bhbj48c3BhbiBzdHlsZT0iY29sb3I6 cmdiKDIwNCwyMDQsMjA0KSI+LCA8c3BhbiBzdHlsZT0iZm9udC13ZWlnaHQ6bm9ybWFsO2NvbG9y OnJnYigxNzAsMTcwLDE3MCk7bWFyZ2luOjBweCI+UkhDRSB8IFJIQ1ZBIHwgTUNJVFA8L3NwYW4+ PC9zcGFuPjwvcD4KPHAgc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbDttYXJnaW46MHB4O2ZvbnQt c2l6ZToxMHB4O2NvbG9yOnJnYigxNTMsMTUzLDE1MykiPjxhIGhyZWY9Imh0dHBzOi8vd3d3LnJl ZGhhdC5jb20iIHN0eWxlPSJjb2xvcjpyZ2IoMCwxMzYsMjA2KTtmb250LXNpemU6MTBweDttYXJn aW46MHB4O3RleHQtZGVjb3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5Om92ZXJwYXNzLHNhbnMtc2Vy aWYiIHRhcmdldD0iX2JsYW5rIj5SZWQgSGF0IDxzcGFuPklzcmFlbDxicj48YnI+PC9zcGFuPjwv YT48L3A+CgoKPHAgc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbDttYXJnaW46MHB4IDBweCA2cHg7 Zm9udC1zaXplOjEwcHg7Y29sb3I6cmdiKDE1MywxNTMsMTUzKSI+PHNwYW4gc3R5bGU9Im1hcmdp bjowcHg7cGFkZGluZzowcHgiPgo8YSBocmVmPSJtYWlsdG86bGV2QHJlZGhhdC5jb20iIHN0eWxl PSJjb2xvcjpyZ2IoMCwxMzYsMjA2KTtmb250LXNpemU6MTBweDttYXJnaW46MHB4O3RleHQtZGVj b3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5Om92ZXJwYXNzLHNhbnMtc2VyaWYiIHRhcmdldD0iX2Js YW5rIj5sZXZAcmVkaGF0LmNvbTwvYT4gfCA8L3NwYW4+PHNwYW4+PHNwYW4gc3R5bGU9Im1hcmdp bjowcHg7cGFkZGluZzowcHgiPjxhIGhyZWY9Im1haWx0bzpsdmV5ZGVAcmVkaGF0LmNvbSIgc3R5 bGU9ImNvbG9yOnJnYigwLDEzNiwyMDYpO2ZvbnQtc2l6ZToxMHB4O21hcmdpbjowcHg7dGV4dC1k ZWNvcmF0aW9uOm5vbmU7Zm9udC1mYW1pbHk6b3ZlcnBhc3Msc2Fucy1zZXJpZiIgdGFyZ2V0PSJf YmxhbmsiPmx2ZXlkZUByZWRoYXQuY29tPC9hPjwvc3Bhbj48L3NwYW4+Cgo8L3A+CjxhIGhyZWY9 Imh0dHBzOi8vcmVkLmh0L3NpZyIgdGFyZ2V0PSJfYmxhbmsiPiA8aW1nIHdpZHRoPSI5MCIgaGVp Z2h0PSJhdXRvIiBzcmM9Imh0dHBzOi8vd3d3LnJlZGhhdC5jb20vcHJvZmlsZXMvcmgvdGhlbWVz L3JlZGhhdGRvdGNvbS9pbWcvbG9nby1yZWQtaGF0LWJsYWNrLnBuZyI+PC9hPiAKCjxkaXY+PGEg c3R5bGU9InRleHQtZGVjb3JhdGlvbjpub25lO2NvbG9yOnJnYigyMDQsMCwwKTtmb250LXdlaWdo dDpib2xkIiBocmVmPSJodHRwczovL3JlZGhhdC5jb20vdHJ1c3RlZCIgdGFyZ2V0PSJfYmxhbmsi PlRSSUVELiBURVNURUQuIFRSVVNURUQuPC9hPjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2 PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2Pgo= --===============1980423973824255176==-- From eyonasi at redhat.com Tue Sep 8 09:14:14 2020 Content-Type: multipart/mixed; boundary="===============0160827588383632598==" MIME-Version: 1.0 From: Ehud Yonasi To: infra at ovirt.org Subject: Re: [ovirt-devel] Re: [CI] Builds broken by "Status code: 403 for http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm" Date: Tue, 08 Sep 2020 12:13:50 +0300 Message-ID: In-Reply-To: CANB6pM7fpGtt2WeaoD4Sjcuwn+9hJod3U4KXdQDMOary6mFajw@mail.gmail.com --===============0160827588383632598== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hey, I am looking into this. Will update with the results I will find. On Tue, Sep 8, 2020 at 12:00 PM Lev Veyde wrote: > Hi Nir, > > It looks like the CI job broke it again, breaking 4.2, 4.3 and master > snapshot release RPM. > > I guess it's the same issue we had last time. > > Thanks in advance, > > On Tue, Sep 8, 2020 at 11:45 AM Nir Soffer wrote: > >> On Mon, Sep 7, 2020 at 2:30 PM Nir Soffer wrote: >> > >> > This is the second time, last time there was an issue during a nightly >> job that >> > left the master snapshot repo broken. >> >> This is still broken today. >> >> In the past sending mail to infra-support created a bug, and someone >> was handling >> issue quickly. This seems to be broken now. >> >> We depend on >> http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm >> for development and CI. When the rpm is missing, CI jobs fail, and >> developers cannot >> update their setup. >> >> Please fix it as soon as possible. >> >> > I have 3 failure builds: >> > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7744/ >> > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7751/ >> > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7755/ >> > >> > All seems to fail in: >> > >> > [2020-09-07T10:00:56.163Z] + dnf install -y >> > http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm >> > [2020-09-07T10:01:08.524Z] Status code: 403 for >> > http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm (IP: >> > 66.187.230.40) >> > >> > Checking manually show: >> > >> > $ curl >> https://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm >> > >> > >> > 403 Forbidden >> > >> >

Forbidden

>> >

You don't have permission to access >> /pub/yum-repo/ovirt-release-master.rpm >> > on this server.

>> > >> > >> > Looking at: >> > https://resources.ovirt.org/pub/yum-repo/ >> > >> > ovirt-elease-master.rpm does not exist. >> > >> > So we have 2 issues: >> > - The file does not exist >> > - We return "403 Forbidden" instead of "404 Not Found" >> >> > > -- > > Lev Veyde > > Senior Software Engineer, RHCE | RHCVA | MCITP > > Red Hat Israel > > > > lev(a)redhat.com | lveyde(a)redhat.com > > TRIED. TESTED. TRUSTED. > _______________________________________________ > Devel mailing list -- devel(a)ovirt.org > To unsubscribe send an email to devel-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/devel(a)ovirt.org/message/B7VMLC7JK= YSU2LI6TRMEAJCXXM3NLSSG/ > --===============0160827588383632598== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGRpdiBjbGFzcz0iZ21haWxfZGVmYXVsdCIgc3R5bGU9ImZvbnQtZmFt aWx5Omdlb3JnaWEsc2VyaWYiPkhleSw8L2Rpdj48ZGl2IGNsYXNzPSJnbWFpbF9kZWZhdWx0IiBz dHlsZT0iZm9udC1mYW1pbHk6Z2VvcmdpYSxzZXJpZiI+PGJyPjwvZGl2PjxkaXYgY2xhc3M9Imdt YWlsX2RlZmF1bHQiIHN0eWxlPSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj5JIGFtIGxvb2tp bmcgaW50byB0aGlzLiA8YnI+PC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZGVmYXVsdCIgc3R5bGU9 ImZvbnQtZmFtaWx5Omdlb3JnaWEsc2VyaWYiPldpbGwgdXBkYXRlIHdpdGggdGhlIHJlc3VsdHMg SSB3aWxsIGZpbmQuIDxicj48L2Rpdj48L2Rpdj48YnI+PGRpdiBjbGFzcz0iZ21haWxfcXVvdGUi PjxkaXYgZGlyPSJsdHIiIGNsYXNzPSJnbWFpbF9hdHRyIj5PbiBUdWUsIFNlcCA4LCAyMDIwIGF0 IDEyOjAwIFBNIExldiBWZXlkZSAmbHQ7PGEgaHJlZj0ibWFpbHRvOmx2ZXlkZUByZWRoYXQuY29t Ij5sdmV5ZGVAcmVkaGF0LmNvbTwvYT4mZ3Q7IHdyb3RlOjxicj48L2Rpdj48YmxvY2txdW90ZSBj bGFzcz0iZ21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46MHB4IDBweCAwcHggMC44ZXg7Ym9yZGVy LWxlZnQ6MXB4IHNvbGlkIHJnYigyMDQsMjA0LDIwNCk7cGFkZGluZy1sZWZ0OjFleCI+PGRpdiBk aXI9Imx0ciI+SGnCoE5pciw8ZGl2Pjxicj48L2Rpdj48ZGl2Pkl0IGxvb2tzIGxpa2UgdGhlIENJ IGpvYiBicm9rZSBpdCBhZ2FpbiwgYnJlYWtpbmcgNC4yLCA0LjMgYW5kIG1hc3RlciBzbmFwc2hv dCByZWxlYXNlIFJQTS48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PkkgZ3Vlc3MgaXQmIzM5O3Mg dGhlIHNhbWUgaXNzdWUgd2UgaGFkIGxhc3QgdGltZS48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2 PlRoYW5rcyBpbiBhZHZhbmNlLDwvZGl2PjwvZGl2Pjxicj48ZGl2IGNsYXNzPSJnbWFpbF9xdW90 ZSI+PGRpdiBkaXI9Imx0ciIgY2xhc3M9ImdtYWlsX2F0dHIiPk9uIFR1ZSwgU2VwIDgsIDIwMjAg YXQgMTE6NDUgQU0gTmlyIFNvZmZlciAmbHQ7PGEgaHJlZj0ibWFpbHRvOm5zb2ZmZXJAcmVkaGF0 LmNvbSIgdGFyZ2V0PSJfYmxhbmsiPm5zb2ZmZXJAcmVkaGF0LmNvbTwvYT4mZ3Q7IHdyb3RlOjxi cj48L2Rpdj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46MHB4 IDBweCAwcHggMC44ZXg7Ym9yZGVyLWxlZnQ6MXB4IHNvbGlkIHJnYigyMDQsMjA0LDIwNCk7cGFk ZGluZy1sZWZ0OjFleCI+T24gTW9uLCBTZXAgNywgMjAyMCBhdCAyOjMwIFBNIE5pciBTb2ZmZXIg Jmx0OzxhIGhyZWY9Im1haWx0bzpuc29mZmVyQHJlZGhhdC5jb20iIHRhcmdldD0iX2JsYW5rIj5u c29mZmVyQHJlZGhhdC5jb208L2E+Jmd0OyB3cm90ZTo8YnI+CiZndDs8YnI+CiZndDsgVGhpcyBp cyB0aGUgc2Vjb25kIHRpbWUsIGxhc3QgdGltZSB0aGVyZSB3YXMgYW4gaXNzdWUgZHVyaW5nIGEg bmlnaHRseSBqb2IgdGhhdDxicj4KJmd0OyBsZWZ0IHRoZSBtYXN0ZXIgc25hcHNob3QgcmVwbyBi cm9rZW4uPGJyPgo8YnI+ClRoaXMgaXMgc3RpbGwgYnJva2VuIHRvZGF5Ljxicj4KPGJyPgpJbiB0 aGUgcGFzdCBzZW5kaW5nIG1haWwgdG8gaW5mcmEtc3VwcG9ydCBjcmVhdGVkIGEgYnVnLCBhbmQg c29tZW9uZTxicj4Kd2FzIGhhbmRsaW5nPGJyPgppc3N1ZSBxdWlja2x5LiBUaGlzIHNlZW1zIHRv IGJlIGJyb2tlbiBub3cuPGJyPgo8YnI+CldlIGRlcGVuZCBvbiA8YSBocmVmPSJodHRwOi8vcmVz b3VyY2VzLm92aXJ0Lm9yZy9wdWIveXVtLXJlcG8vb3ZpcnQtcmVsZWFzZS1tYXN0ZXIucnBtIiBy ZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5odHRwOi8vcmVzb3VyY2VzLm92aXJ0Lm9y Zy9wdWIveXVtLXJlcG8vb3ZpcnQtcmVsZWFzZS1tYXN0ZXIucnBtPC9hPjxicj4KZm9yIGRldmVs b3BtZW50IGFuZCBDSS4gV2hlbiB0aGUgcnBtIGlzIG1pc3NpbmcsIENJIGpvYnMgZmFpbCwgYW5k PGJyPgpkZXZlbG9wZXJzIGNhbm5vdDxicj4KdXBkYXRlIHRoZWlyIHNldHVwLjxicj4KPGJyPgpQ bGVhc2UgZml4IGl0IGFzIHNvb24gYXMgcG9zc2libGUuPGJyPgo8YnI+CiZndDsgSSBoYXZlIDMg ZmFpbHVyZSBidWlsZHM6PGJyPgomZ3Q7IDxhIGhyZWY9Imh0dHBzOi8vamVua2lucy5vdmlydC5v cmcvam9iL292aXJ0LWVuZ2luZV9zdGFuZGFyZC1jaGVjay1wYXRjaC83NzQ0LyIgcmVsPSJub3Jl ZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3Zp cnQtZW5naW5lX3N0YW5kYXJkLWNoZWNrLXBhdGNoLzc3NDQvPC9hPjxicj4KJmd0OyA8YSBocmVm PSJodHRwczovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1lbmdpbmVfc3RhbmRhcmQtY2hl Y2stcGF0Y2gvNzc1MS8iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8v amVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LWVuZ2luZV9zdGFuZGFyZC1jaGVjay1wYXRjaC83 NzUxLzwvYT48YnI+CiZndDsgPGEgaHJlZj0iaHR0cHM6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Iv b3ZpcnQtZW5naW5lX3N0YW5kYXJkLWNoZWNrLXBhdGNoLzc3NTUvIiByZWw9Im5vcmVmZXJyZXIi IHRhcmdldD0iX2JsYW5rIj5odHRwczovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1lbmdp bmVfc3RhbmRhcmQtY2hlY2stcGF0Y2gvNzc1NS88L2E+PGJyPgomZ3Q7PGJyPgomZ3Q7IEFsbCBz ZWVtcyB0byBmYWlsIGluOjxicj4KJmd0Ozxicj4KJmd0OyBbMjAyMC0wOS0wN1QxMDowMDo1Ni4x NjNaXSArIGRuZiBpbnN0YWxsIC15PGJyPgomZ3Q7IDxhIGhyZWY9Imh0dHA6Ly9yZXNvdXJjZXMu b3ZpcnQub3JnL3B1Yi95dW0tcmVwby9vdmlydC1yZWxlYXNlLW1hc3Rlci5ycG0iIHJlbD0ibm9y ZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9yZXNvdXJjZXMub3ZpcnQub3JnL3B1Yi95 dW0tcmVwby9vdmlydC1yZWxlYXNlLW1hc3Rlci5ycG08L2E+PGJyPgomZ3Q7IFsyMDIwLTA5LTA3 VDEwOjAxOjA4LjUyNFpdIFN0YXR1cyBjb2RlOiA0MDMgZm9yPGJyPgomZ3Q7IDxhIGhyZWY9Imh0 dHA6Ly9yZXNvdXJjZXMub3ZpcnQub3JnL3B1Yi95dW0tcmVwby9vdmlydC1yZWxlYXNlLW1hc3Rl ci5ycG0iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9yZXNvdXJjZXMu b3ZpcnQub3JnL3B1Yi95dW0tcmVwby9vdmlydC1yZWxlYXNlLW1hc3Rlci5ycG08L2E+IChJUDo8 YnI+CiZndDsgNjYuMTg3LjIzMC40MCk8YnI+CiZndDs8YnI+CiZndDsgQ2hlY2tpbmcgbWFudWFs bHkgc2hvdzo8YnI+CiZndDs8YnI+CiZndDsgJCBjdXJsIDxhIGhyZWY9Imh0dHBzOi8vcmVzb3Vy Y2VzLm92aXJ0Lm9yZy9wdWIveXVtLXJlcG8vb3ZpcnQtcmVsZWFzZS1tYXN0ZXIucnBtIiByZWw9 Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5odHRwczovL3Jlc291cmNlcy5vdmlydC5vcmcv cHViL3l1bS1yZXBvL292aXJ0LXJlbGVhc2UtbWFzdGVyLnJwbTwvYT48YnI+CiZndDsgJmx0OyFE T0NUWVBFIEhUTUwgUFVCTElDICZxdW90Oy0vL0lFVEYvL0RURCBIVE1MIDIuMC8vRU4mcXVvdDsm Z3Q7PGJyPgomZ3Q7ICZsdDtodG1sJmd0OyZsdDtoZWFkJmd0Ozxicj4KJmd0OyAmbHQ7dGl0bGUm Z3Q7NDAzIEZvcmJpZGRlbiZsdDsvdGl0bGUmZ3Q7PGJyPgomZ3Q7ICZsdDsvaGVhZCZndDsmbHQ7 Ym9keSZndDs8YnI+CiZndDsgJmx0O2gxJmd0O0ZvcmJpZGRlbiZsdDsvaDEmZ3Q7PGJyPgomZ3Q7 ICZsdDtwJmd0O1lvdSBkb24mIzM5O3QgaGF2ZSBwZXJtaXNzaW9uIHRvIGFjY2VzcyAvcHViL3l1 bS1yZXBvL292aXJ0LXJlbGVhc2UtbWFzdGVyLnJwbTxicj4KJmd0OyBvbiB0aGlzIHNlcnZlci4m bHQ7L3AmZ3Q7PGJyPgomZ3Q7ICZsdDsvYm9keSZndDsmbHQ7L2h0bWwmZ3Q7PGJyPgomZ3Q7PGJy PgomZ3Q7IExvb2tpbmcgYXQ6PGJyPgomZ3Q7IDxhIGhyZWY9Imh0dHBzOi8vcmVzb3VyY2VzLm92 aXJ0Lm9yZy9wdWIveXVtLXJlcG8vIiByZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5o dHRwczovL3Jlc291cmNlcy5vdmlydC5vcmcvcHViL3l1bS1yZXBvLzwvYT48YnI+CiZndDs8YnI+ CiZndDsgb3ZpcnQtZWxlYXNlLW1hc3Rlci5ycG0gZG9lcyBub3QgZXhpc3QuPGJyPgomZ3Q7PGJy PgomZ3Q7IFNvIHdlIGhhdmUgMiBpc3N1ZXM6PGJyPgomZ3Q7IC0gVGhlIGZpbGUgZG9lcyBub3Qg ZXhpc3Q8YnI+CiZndDsgLSBXZSByZXR1cm4gJnF1b3Q7NDAzIEZvcmJpZGRlbiZxdW90OyBpbnN0 ZWFkIG9mICZxdW90OzQwNCBOb3QgRm91bmQmcXVvdDs8YnI+Cjxicj4KPC9ibG9ja3F1b3RlPjwv ZGl2PjxiciBjbGVhcj0iYWxsIj48ZGl2Pjxicj48L2Rpdj4tLSA8YnI+PGRpdiBkaXI9Imx0ciI+ PGRpdiBkaXI9Imx0ciI+PGRpdj48ZGl2IGRpcj0ibHRyIj48ZGl2PjxkaXYgZGlyPSJsdHIiPjxk aXY+PGRpdiBkaXI9Imx0ciI+PGRpdj48ZGl2IGRpcj0ibHRyIj48ZGl2Pjxicj48ZGl2PjxwIHN0 eWxlPSJmb250LXdlaWdodDpib2xkO21hcmdpbjowcHg7cGFkZGluZzowcHg7Zm9udC1zaXplOjE0 cHg7dGV4dC10cmFuc2Zvcm06dXBwZXJjYXNlIj48c3Bhbj5MZXY8L3NwYW4+IDxzcGFuPlZleWRl PC9zcGFuPjwvcD4KPHAgc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbDtmb250LXNpemU6MTBweDtt YXJnaW46MHB4IDBweCA0cHg7dGV4dC10cmFuc2Zvcm06dXBwZXJjYXNlIj48c3Bhbj5TZW5pb3Ig U29mdHdhcmUgRW5naW5lZXI8L3NwYW4+PHNwYW4gc3R5bGU9ImNvbG9yOnJnYigyMDQsMjA0LDIw NCkiPiwgPHNwYW4gc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbDtjb2xvcjpyZ2IoMTcwLDE3MCwx NzApO21hcmdpbjowcHgiPlJIQ0UgfCBSSENWQSB8IE1DSVRQPC9zcGFuPjwvc3Bhbj48L3A+Cjxw IHN0eWxlPSJmb250LXdlaWdodDpub3JtYWw7bWFyZ2luOjBweDtmb250LXNpemU6MTBweDtjb2xv cjpyZ2IoMTUzLDE1MywxNTMpIj48YSBocmVmPSJodHRwczovL3d3dy5yZWRoYXQuY29tIiBzdHls ZT0iY29sb3I6cmdiKDAsMTM2LDIwNik7Zm9udC1zaXplOjEwcHg7bWFyZ2luOjBweDt0ZXh0LWRl Y29yYXRpb246bm9uZTtmb250LWZhbWlseTpvdmVycGFzcyxzYW5zLXNlcmlmIiB0YXJnZXQ9Il9i bGFuayI+UmVkIEhhdCA8c3Bhbj5Jc3JhZWw8YnI+PGJyPjwvc3Bhbj48L2E+PC9wPgoKCjxwIHN0 eWxlPSJmb250LXdlaWdodDpub3JtYWw7bWFyZ2luOjBweCAwcHggNnB4O2ZvbnQtc2l6ZToxMHB4 O2NvbG9yOnJnYigxNTMsMTUzLDE1MykiPjxzcGFuIHN0eWxlPSJtYXJnaW46MHB4O3BhZGRpbmc6 MHB4Ij4KPGEgaHJlZj0ibWFpbHRvOmxldkByZWRoYXQuY29tIiBzdHlsZT0iY29sb3I6cmdiKDAs MTM2LDIwNik7Zm9udC1zaXplOjEwcHg7bWFyZ2luOjBweDt0ZXh0LWRlY29yYXRpb246bm9uZTtm b250LWZhbWlseTpvdmVycGFzcyxzYW5zLXNlcmlmIiB0YXJnZXQ9Il9ibGFuayI+bGV2QHJlZGhh dC5jb208L2E+IHwgPC9zcGFuPjxzcGFuPjxzcGFuIHN0eWxlPSJtYXJnaW46MHB4O3BhZGRpbmc6 MHB4Ij48YSBocmVmPSJtYWlsdG86bHZleWRlQHJlZGhhdC5jb20iIHN0eWxlPSJjb2xvcjpyZ2Io MCwxMzYsMjA2KTtmb250LXNpemU6MTBweDttYXJnaW46MHB4O3RleHQtZGVjb3JhdGlvbjpub25l O2ZvbnQtZmFtaWx5Om92ZXJwYXNzLHNhbnMtc2VyaWYiIHRhcmdldD0iX2JsYW5rIj5sdmV5ZGVA cmVkaGF0LmNvbTwvYT48L3NwYW4+PC9zcGFuPgoKPC9wPgo8YSBocmVmPSJodHRwczovL3JlZC5o dC9zaWciIHRhcmdldD0iX2JsYW5rIj4gPGltZyBzcmM9Imh0dHBzOi8vd3d3LnJlZGhhdC5jb20v cHJvZmlsZXMvcmgvdGhlbWVzL3JlZGhhdGRvdGNvbS9pbWcvbG9nby1yZWQtaGF0LWJsYWNrLnBu ZyIgd2lkdGg9IjkwIiBoZWlnaHQ9ImF1dG8iPjwvYT4gCgo8ZGl2PjxhIHN0eWxlPSJ0ZXh0LWRl Y29yYXRpb246bm9uZTtjb2xvcjpyZ2IoMjA0LDAsMCk7Zm9udC13ZWlnaHQ6Ym9sZCIgaHJlZj0i aHR0cHM6Ly9yZWRoYXQuY29tL3RydXN0ZWQiIHRhcmdldD0iX2JsYW5rIj5UUklFRC4gVEVTVEVE LiBUUlVTVEVELjwvYT48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48 L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj4KX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX188YnI+CkRldmVsIG1haWxpbmcgbGlzdCAtLSA8YSBo cmVmPSJtYWlsdG86ZGV2ZWxAb3ZpcnQub3JnIiB0YXJnZXQ9Il9ibGFuayI+ZGV2ZWxAb3ZpcnQu b3JnPC9hPjxicj4KVG8gdW5zdWJzY3JpYmUgc2VuZCBhbiBlbWFpbCB0byA8YSBocmVmPSJtYWls dG86ZGV2ZWwtbGVhdmVAb3ZpcnQub3JnIiB0YXJnZXQ9Il9ibGFuayI+ZGV2ZWwtbGVhdmVAb3Zp cnQub3JnPC9hPjxicj4KUHJpdmFjeSBTdGF0ZW1lbnQ6IDxhIGhyZWY9Imh0dHBzOi8vd3d3Lm92 aXJ0Lm9yZy9wcml2YWN5LXBvbGljeS5odG1sIiByZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2Js YW5rIj5odHRwczovL3d3dy5vdmlydC5vcmcvcHJpdmFjeS1wb2xpY3kuaHRtbDwvYT48YnI+Cm9W aXJ0IENvZGUgb2YgQ29uZHVjdDogPGEgaHJlZj0iaHR0cHM6Ly93d3cub3ZpcnQub3JnL2NvbW11 bml0eS9hYm91dC9jb21tdW5pdHktZ3VpZGVsaW5lcy8iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0 PSJfYmxhbmsiPmh0dHBzOi8vd3d3Lm92aXJ0Lm9yZy9jb21tdW5pdHkvYWJvdXQvY29tbXVuaXR5 LWd1aWRlbGluZXMvPC9hPjxicj4KTGlzdCBBcmNoaXZlczogPGEgaHJlZj0iaHR0cHM6Ly9saXN0 cy5vdmlydC5vcmcvYXJjaGl2ZXMvbGlzdC9kZXZlbEBvdmlydC5vcmcvbWVzc2FnZS9CN1ZNTEM3 SktZU1UyTEk2VFJNRUFKQ1hYTTNOTFNTRy8iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxh bmsiPmh0dHBzOi8vbGlzdHMub3ZpcnQub3JnL2FyY2hpdmVzL2xpc3QvZGV2ZWxAb3ZpcnQub3Jn L21lc3NhZ2UvQjdWTUxDN0pLWVNVMkxJNlRSTUVBSkNYWE0zTkxTU0cvPC9hPjxicj4KPC9ibG9j a3F1b3RlPjwvZGl2Pgo= --===============0160827588383632598==-- From eyonasi at redhat.com Tue Sep 8 10:15:01 2020 Content-Type: multipart/mixed; boundary="===============3884013325901257572==" MIME-Version: 1.0 From: Ehud Yonasi To: infra at ovirt.org Subject: Re: [ovirt-devel] Re: [CI] Builds broken by "Status code: 403 for http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm" Date: Tue, 08 Sep 2020 13:14:34 +0300 Message-ID: In-Reply-To: CAC3Yk1+3n1Ri7ezuYiia6ZL596A36qorney2L4XbFE6YGPTAzg@mail.gmail.com --===============3884013325901257572== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable I found out the root cause was because of space issues in the nightly publisher run. The 3 ovirt publishers ran in together and the jenkins dir did not have that capacity. Currently, I am restoring the ovirt-master snapshot and then 4.3 + 4.2, plus sent a patch [1] to ensure they will not run in parallel. [1]: https://gerrit.ovirt.org/111160 On Tue, Sep 8, 2020 at 12:13 PM Ehud Yonasi wrote: > Hey, > > I am looking into this. > Will update with the results I will find. > > On Tue, Sep 8, 2020 at 12:00 PM Lev Veyde wrote: > >> Hi Nir, >> >> It looks like the CI job broke it again, breaking 4.2, 4.3 and master >> snapshot release RPM. >> >> I guess it's the same issue we had last time. >> >> Thanks in advance, >> >> On Tue, Sep 8, 2020 at 11:45 AM Nir Soffer wrote: >> >>> On Mon, Sep 7, 2020 at 2:30 PM Nir Soffer wrote: >>> > >>> > This is the second time, last time there was an issue during a nightly >>> job that >>> > left the master snapshot repo broken. >>> >>> This is still broken today. >>> >>> In the past sending mail to infra-support created a bug, and someone >>> was handling >>> issue quickly. This seems to be broken now. >>> >>> We depend on >>> http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm >>> for development and CI. When the rpm is missing, CI jobs fail, and >>> developers cannot >>> update their setup. >>> >>> Please fix it as soon as possible. >>> >>> > I have 3 failure builds: >>> > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7744/ >>> > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7751/ >>> > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7755/ >>> > >>> > All seems to fail in: >>> > >>> > [2020-09-07T10:00:56.163Z] + dnf install -y >>> > http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm >>> > [2020-09-07T10:01:08.524Z] Status code: 403 for >>> > http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm (IP: >>> > 66.187.230.40) >>> > >>> > Checking manually show: >>> > >>> > $ curl >>> https://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm >>> > >>> > >>> > 403 Forbidden >>> > >>> >

Forbidden

>>> >

You don't have permission to access >>> /pub/yum-repo/ovirt-release-master.rpm >>> > on this server.

>>> > >>> > >>> > Looking at: >>> > https://resources.ovirt.org/pub/yum-repo/ >>> > >>> > ovirt-elease-master.rpm does not exist. >>> > >>> > So we have 2 issues: >>> > - The file does not exist >>> > - We return "403 Forbidden" instead of "404 Not Found" >>> >>> >> >> -- >> >> Lev Veyde >> >> Senior Software Engineer, RHCE | RHCVA | MCITP >> >> Red Hat Israel >> >> >> >> lev(a)redhat.com | lveyde(a)redhat.com >> >> TRIED. TESTED. TRUSTED. >> _______________________________________________ >> Devel mailing list -- devel(a)ovirt.org >> To unsubscribe send an email to devel-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/privacy-policy.html >> oVirt Code of Conduct: >> https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: >> https://lists.ovirt.org/archives/list/devel(a)ovirt.org/message/B7VMLC7J= KYSU2LI6TRMEAJCXXM3NLSSG/ >> > --===============3884013325901257572== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGRpdiBjbGFzcz0iZ21haWxfZGVmYXVsdCIgc3R5bGU9ImZvbnQtZmFt aWx5Omdlb3JnaWEsc2VyaWYiPkkgZm91bmQgb3V0IHRoZSByb290IGNhdXNlIHdhcyBiZWNhdXNl IG9mIHNwYWNlIGlzc3VlcyBpbiB0aGUgbmlnaHRseSBwdWJsaXNoZXIgcnVuLjwvZGl2PjxkaXYg Y2xhc3M9ImdtYWlsX2RlZmF1bHQiIHN0eWxlPSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj48 YnI+PC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZGVmYXVsdCIgc3R5bGU9ImZvbnQtZmFtaWx5Omdl b3JnaWEsc2VyaWYiPlRoZSAzIG92aXJ0IHB1Ymxpc2hlcnMgcmFuIGluIHRvZ2V0aGVyIGFuZCB0 aGUgamVua2lucyBkaXIgZGlkIG5vdCBoYXZlIHRoYXQgY2FwYWNpdHkuPC9kaXY+PGRpdiBjbGFz cz0iZ21haWxfZGVmYXVsdCIgc3R5bGU9ImZvbnQtZmFtaWx5Omdlb3JnaWEsc2VyaWYiPjxicj48 L2Rpdj48ZGl2IGNsYXNzPSJnbWFpbF9kZWZhdWx0IiBzdHlsZT0iZm9udC1mYW1pbHk6Z2Vvcmdp YSxzZXJpZiI+Q3VycmVudGx5LCBJIGFtIHJlc3RvcmluZyB0aGUgb3ZpcnQtbWFzdGVyIHNuYXBz aG90IGFuZCB0aGVuIDQuMyArIDQuMiwgcGx1cyBzZW50IGEgcGF0Y2ggWzFdIHRvIGVuc3VyZSB0 aGV5IHdpbGwgbm90IHJ1biBpbiBwYXJhbGxlbC48L2Rpdj48ZGl2IGNsYXNzPSJnbWFpbF9kZWZh dWx0IiBzdHlsZT0iZm9udC1mYW1pbHk6Z2VvcmdpYSxzZXJpZiI+PGJyPjwvZGl2PjxkaXYgY2xh c3M9ImdtYWlsX2RlZmF1bHQiIHN0eWxlPSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj5bMV06 IDxhIGhyZWY9Imh0dHBzOi8vZ2Vycml0Lm92aXJ0Lm9yZy8xMTExNjAiPmh0dHBzOi8vZ2Vycml0 Lm92aXJ0Lm9yZy8xMTExNjA8L2E+PC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZGVmYXVsdCIgc3R5 bGU9ImZvbnQtZmFtaWx5Omdlb3JnaWEsc2VyaWYiPjxicj48L2Rpdj48L2Rpdj48YnI+PGRpdiBj bGFzcz0iZ21haWxfcXVvdGUiPjxkaXYgZGlyPSJsdHIiIGNsYXNzPSJnbWFpbF9hdHRyIj5PbiBU dWUsIFNlcCA4LCAyMDIwIGF0IDEyOjEzIFBNIEVodWQgWW9uYXNpICZsdDs8YSBocmVmPSJtYWls dG86ZXlvbmFzaUByZWRoYXQuY29tIj5leW9uYXNpQHJlZGhhdC5jb208L2E+Jmd0OyB3cm90ZTo8 YnI+PC9kaXY+PGJsb2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjBw eCAwcHggMHB4IDAuOGV4O2JvcmRlci1sZWZ0OjFweCBzb2xpZCByZ2IoMjA0LDIwNCwyMDQpO3Bh ZGRpbmctbGVmdDoxZXgiPjxkaXYgZGlyPSJsdHIiPjxkaXYgY2xhc3M9ImdtYWlsX2RlZmF1bHQi IHN0eWxlPSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj5IZXksPC9kaXY+PGRpdiBjbGFzcz0i Z21haWxfZGVmYXVsdCIgc3R5bGU9ImZvbnQtZmFtaWx5Omdlb3JnaWEsc2VyaWYiPjxicj48L2Rp dj48ZGl2IGNsYXNzPSJnbWFpbF9kZWZhdWx0IiBzdHlsZT0iZm9udC1mYW1pbHk6Z2VvcmdpYSxz ZXJpZiI+SSBhbSBsb29raW5nIGludG8gdGhpcy4gPGJyPjwvZGl2PjxkaXYgY2xhc3M9ImdtYWls X2RlZmF1bHQiIHN0eWxlPSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj5XaWxsIHVwZGF0ZSB3 aXRoIHRoZSByZXN1bHRzIEkgd2lsbCBmaW5kLiA8YnI+PC9kaXY+PC9kaXY+PGJyPjxkaXYgY2xh c3M9ImdtYWlsX3F1b3RlIj48ZGl2IGRpcj0ibHRyIiBjbGFzcz0iZ21haWxfYXR0ciI+T24gVHVl LCBTZXAgOCwgMjAyMCBhdCAxMjowMCBQTSBMZXYgVmV5ZGUgJmx0OzxhIGhyZWY9Im1haWx0bzps dmV5ZGVAcmVkaGF0LmNvbSIgdGFyZ2V0PSJfYmxhbmsiPmx2ZXlkZUByZWRoYXQuY29tPC9hPiZn dDsgd3JvdGU6PGJyPjwvZGl2PjxibG9ja3F1b3RlIGNsYXNzPSJnbWFpbF9xdW90ZSIgc3R5bGU9 Im1hcmdpbjowcHggMHB4IDBweCAwLjhleDtib3JkZXItbGVmdDoxcHggc29saWQgcmdiKDIwNCwy MDQsMjA0KTtwYWRkaW5nLWxlZnQ6MWV4Ij48ZGl2IGRpcj0ibHRyIj5IacKgTmlyLDxkaXY+PGJy PjwvZGl2PjxkaXY+SXQgbG9va3MgbGlrZSB0aGUgQ0kgam9iIGJyb2tlIGl0IGFnYWluLCBicmVh a2luZyA0LjIsIDQuMyBhbmQgbWFzdGVyIHNuYXBzaG90IHJlbGVhc2UgUlBNLjwvZGl2PjxkaXY+ PGJyPjwvZGl2PjxkaXY+SSBndWVzcyBpdCYjMzk7cyB0aGUgc2FtZSBpc3N1ZSB3ZSBoYWQgbGFz dCB0aW1lLjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+VGhhbmtzIGluIGFkdmFuY2UsPC9kaXY+ PC9kaXY+PGJyPjxkaXYgY2xhc3M9ImdtYWlsX3F1b3RlIj48ZGl2IGRpcj0ibHRyIiBjbGFzcz0i Z21haWxfYXR0ciI+T24gVHVlLCBTZXAgOCwgMjAyMCBhdCAxMTo0NSBBTSBOaXIgU29mZmVyICZs dDs8YSBocmVmPSJtYWlsdG86bnNvZmZlckByZWRoYXQuY29tIiB0YXJnZXQ9Il9ibGFuayI+bnNv ZmZlckByZWRoYXQuY29tPC9hPiZndDsgd3JvdGU6PGJyPjwvZGl2PjxibG9ja3F1b3RlIGNsYXNz PSJnbWFpbF9xdW90ZSIgc3R5bGU9Im1hcmdpbjowcHggMHB4IDBweCAwLjhleDtib3JkZXItbGVm dDoxcHggc29saWQgcmdiKDIwNCwyMDQsMjA0KTtwYWRkaW5nLWxlZnQ6MWV4Ij5PbiBNb24sIFNl cCA3LCAyMDIwIGF0IDI6MzAgUE0gTmlyIFNvZmZlciAmbHQ7PGEgaHJlZj0ibWFpbHRvOm5zb2Zm ZXJAcmVkaGF0LmNvbSIgdGFyZ2V0PSJfYmxhbmsiPm5zb2ZmZXJAcmVkaGF0LmNvbTwvYT4mZ3Q7 IHdyb3RlOjxicj4KJmd0Ozxicj4KJmd0OyBUaGlzIGlzIHRoZSBzZWNvbmQgdGltZSwgbGFzdCB0 aW1lIHRoZXJlIHdhcyBhbiBpc3N1ZSBkdXJpbmcgYSBuaWdodGx5IGpvYiB0aGF0PGJyPgomZ3Q7 IGxlZnQgdGhlIG1hc3RlciBzbmFwc2hvdCByZXBvIGJyb2tlbi48YnI+Cjxicj4KVGhpcyBpcyBz dGlsbCBicm9rZW4gdG9kYXkuPGJyPgo8YnI+CkluIHRoZSBwYXN0IHNlbmRpbmcgbWFpbCB0byBp bmZyYS1zdXBwb3J0IGNyZWF0ZWQgYSBidWcsIGFuZCBzb21lb25lPGJyPgp3YXMgaGFuZGxpbmc8 YnI+Cmlzc3VlIHF1aWNrbHkuIFRoaXMgc2VlbXMgdG8gYmUgYnJva2VuIG5vdy48YnI+Cjxicj4K V2UgZGVwZW5kIG9uIDxhIGhyZWY9Imh0dHA6Ly9yZXNvdXJjZXMub3ZpcnQub3JnL3B1Yi95dW0t cmVwby9vdmlydC1yZWxlYXNlLW1hc3Rlci5ycG0iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJf YmxhbmsiPmh0dHA6Ly9yZXNvdXJjZXMub3ZpcnQub3JnL3B1Yi95dW0tcmVwby9vdmlydC1yZWxl YXNlLW1hc3Rlci5ycG08L2E+PGJyPgpmb3IgZGV2ZWxvcG1lbnQgYW5kIENJLiBXaGVuIHRoZSBy cG0gaXMgbWlzc2luZywgQ0kgam9icyBmYWlsLCBhbmQ8YnI+CmRldmVsb3BlcnMgY2Fubm90PGJy Pgp1cGRhdGUgdGhlaXIgc2V0dXAuPGJyPgo8YnI+ClBsZWFzZSBmaXggaXQgYXMgc29vbiBhcyBw b3NzaWJsZS48YnI+Cjxicj4KJmd0OyBJIGhhdmUgMyBmYWlsdXJlIGJ1aWxkczo8YnI+CiZndDsg PGEgaHJlZj0iaHR0cHM6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtZW5naW5lX3N0YW5k YXJkLWNoZWNrLXBhdGNoLzc3NDQvIiByZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5o dHRwczovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1lbmdpbmVfc3RhbmRhcmQtY2hlY2st cGF0Y2gvNzc0NC88L2E+PGJyPgomZ3Q7IDxhIGhyZWY9Imh0dHBzOi8vamVua2lucy5vdmlydC5v cmcvam9iL292aXJ0LWVuZ2luZV9zdGFuZGFyZC1jaGVjay1wYXRjaC83NzUxLyIgcmVsPSJub3Jl ZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3Zp cnQtZW5naW5lX3N0YW5kYXJkLWNoZWNrLXBhdGNoLzc3NTEvPC9hPjxicj4KJmd0OyA8YSBocmVm PSJodHRwczovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1lbmdpbmVfc3RhbmRhcmQtY2hl Y2stcGF0Y2gvNzc1NS8iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8v amVua2lucy5vdmlydC5vcmcvam9iL292aXJ0LWVuZ2luZV9zdGFuZGFyZC1jaGVjay1wYXRjaC83 NzU1LzwvYT48YnI+CiZndDs8YnI+CiZndDsgQWxsIHNlZW1zIHRvIGZhaWwgaW46PGJyPgomZ3Q7 PGJyPgomZ3Q7IFsyMDIwLTA5LTA3VDEwOjAwOjU2LjE2M1pdICsgZG5mIGluc3RhbGwgLXk8YnI+ CiZndDsgPGEgaHJlZj0iaHR0cDovL3Jlc291cmNlcy5vdmlydC5vcmcvcHViL3l1bS1yZXBvL292 aXJ0LXJlbGVhc2UtbWFzdGVyLnJwbSIgcmVsPSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+ aHR0cDovL3Jlc291cmNlcy5vdmlydC5vcmcvcHViL3l1bS1yZXBvL292aXJ0LXJlbGVhc2UtbWFz dGVyLnJwbTwvYT48YnI+CiZndDsgWzIwMjAtMDktMDdUMTA6MDE6MDguNTI0Wl0gU3RhdHVzIGNv ZGU6IDQwMyBmb3I8YnI+CiZndDsgPGEgaHJlZj0iaHR0cDovL3Jlc291cmNlcy5vdmlydC5vcmcv cHViL3l1bS1yZXBvL292aXJ0LXJlbGVhc2UtbWFzdGVyLnJwbSIgcmVsPSJub3JlZmVycmVyIiB0 YXJnZXQ9Il9ibGFuayI+aHR0cDovL3Jlc291cmNlcy5vdmlydC5vcmcvcHViL3l1bS1yZXBvL292 aXJ0LXJlbGVhc2UtbWFzdGVyLnJwbTwvYT4gKElQOjxicj4KJmd0OyA2Ni4xODcuMjMwLjQwKTxi cj4KJmd0Ozxicj4KJmd0OyBDaGVja2luZyBtYW51YWxseSBzaG93Ojxicj4KJmd0Ozxicj4KJmd0 OyAkIGN1cmwgPGEgaHJlZj0iaHR0cHM6Ly9yZXNvdXJjZXMub3ZpcnQub3JnL3B1Yi95dW0tcmVw by9vdmlydC1yZWxlYXNlLW1hc3Rlci5ycG0iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxh bmsiPmh0dHBzOi8vcmVzb3VyY2VzLm92aXJ0Lm9yZy9wdWIveXVtLXJlcG8vb3ZpcnQtcmVsZWFz ZS1tYXN0ZXIucnBtPC9hPjxicj4KJmd0OyAmbHQ7IURPQ1RZUEUgSFRNTCBQVUJMSUMgJnF1b3Q7 LS8vSUVURi8vRFREIEhUTUwgMi4wLy9FTiZxdW90OyZndDs8YnI+CiZndDsgJmx0O2h0bWwmZ3Q7 Jmx0O2hlYWQmZ3Q7PGJyPgomZ3Q7ICZsdDt0aXRsZSZndDs0MDMgRm9yYmlkZGVuJmx0Oy90aXRs ZSZndDs8YnI+CiZndDsgJmx0Oy9oZWFkJmd0OyZsdDtib2R5Jmd0Ozxicj4KJmd0OyAmbHQ7aDEm Z3Q7Rm9yYmlkZGVuJmx0Oy9oMSZndDs8YnI+CiZndDsgJmx0O3AmZ3Q7WW91IGRvbiYjMzk7dCBo YXZlIHBlcm1pc3Npb24gdG8gYWNjZXNzIC9wdWIveXVtLXJlcG8vb3ZpcnQtcmVsZWFzZS1tYXN0 ZXIucnBtPGJyPgomZ3Q7IG9uIHRoaXMgc2VydmVyLiZsdDsvcCZndDs8YnI+CiZndDsgJmx0Oy9i b2R5Jmd0OyZsdDsvaHRtbCZndDs8YnI+CiZndDs8YnI+CiZndDsgTG9va2luZyBhdDo8YnI+CiZn dDsgPGEgaHJlZj0iaHR0cHM6Ly9yZXNvdXJjZXMub3ZpcnQub3JnL3B1Yi95dW0tcmVwby8iIHJl bD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8vcmVzb3VyY2VzLm92aXJ0Lm9y Zy9wdWIveXVtLXJlcG8vPC9hPjxicj4KJmd0Ozxicj4KJmd0OyBvdmlydC1lbGVhc2UtbWFzdGVy LnJwbSBkb2VzIG5vdCBleGlzdC48YnI+CiZndDs8YnI+CiZndDsgU28gd2UgaGF2ZSAyIGlzc3Vl czo8YnI+CiZndDsgLSBUaGUgZmlsZSBkb2VzIG5vdCBleGlzdDxicj4KJmd0OyAtIFdlIHJldHVy biAmcXVvdDs0MDMgRm9yYmlkZGVuJnF1b3Q7IGluc3RlYWQgb2YgJnF1b3Q7NDA0IE5vdCBGb3Vu ZCZxdW90Ozxicj4KPGJyPgo8L2Jsb2NrcXVvdGU+PC9kaXY+PGJyIGNsZWFyPSJhbGwiPjxkaXY+ PGJyPjwvZGl2Pi0tIDxicj48ZGl2IGRpcj0ibHRyIj48ZGl2IGRpcj0ibHRyIj48ZGl2PjxkaXYg ZGlyPSJsdHIiPjxkaXY+PGRpdiBkaXI9Imx0ciI+PGRpdj48ZGl2IGRpcj0ibHRyIj48ZGl2Pjxk aXYgZGlyPSJsdHIiPjxkaXY+PGJyPjxkaXY+PHAgc3R5bGU9ImZvbnQtd2VpZ2h0OmJvbGQ7bWFy Z2luOjBweDtwYWRkaW5nOjBweDtmb250LXNpemU6MTRweDt0ZXh0LXRyYW5zZm9ybTp1cHBlcmNh c2UiPjxzcGFuPkxldjwvc3Bhbj4gPHNwYW4+VmV5ZGU8L3NwYW4+PC9wPgo8cCBzdHlsZT0iZm9u dC13ZWlnaHQ6bm9ybWFsO2ZvbnQtc2l6ZToxMHB4O21hcmdpbjowcHggMHB4IDRweDt0ZXh0LXRy YW5zZm9ybTp1cHBlcmNhc2UiPjxzcGFuPlNlbmlvciBTb2Z0d2FyZSBFbmdpbmVlcjwvc3Bhbj48 c3BhbiBzdHlsZT0iY29sb3I6cmdiKDIwNCwyMDQsMjA0KSI+LCA8c3BhbiBzdHlsZT0iZm9udC13 ZWlnaHQ6bm9ybWFsO2NvbG9yOnJnYigxNzAsMTcwLDE3MCk7bWFyZ2luOjBweCI+UkhDRSB8IFJI Q1ZBIHwgTUNJVFA8L3NwYW4+PC9zcGFuPjwvcD4KPHAgc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1h bDttYXJnaW46MHB4O2ZvbnQtc2l6ZToxMHB4O2NvbG9yOnJnYigxNTMsMTUzLDE1MykiPjxhIGhy ZWY9Imh0dHBzOi8vd3d3LnJlZGhhdC5jb20iIHN0eWxlPSJjb2xvcjpyZ2IoMCwxMzYsMjA2KTtm b250LXNpemU6MTBweDttYXJnaW46MHB4O3RleHQtZGVjb3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5 Om92ZXJwYXNzLHNhbnMtc2VyaWYiIHRhcmdldD0iX2JsYW5rIj5SZWQgSGF0IDxzcGFuPklzcmFl bDxicj48YnI+PC9zcGFuPjwvYT48L3A+CgoKPHAgc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbDtt YXJnaW46MHB4IDBweCA2cHg7Zm9udC1zaXplOjEwcHg7Y29sb3I6cmdiKDE1MywxNTMsMTUzKSI+ PHNwYW4gc3R5bGU9Im1hcmdpbjowcHg7cGFkZGluZzowcHgiPgo8YSBocmVmPSJtYWlsdG86bGV2 QHJlZGhhdC5jb20iIHN0eWxlPSJjb2xvcjpyZ2IoMCwxMzYsMjA2KTtmb250LXNpemU6MTBweDtt YXJnaW46MHB4O3RleHQtZGVjb3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5Om92ZXJwYXNzLHNhbnMt c2VyaWYiIHRhcmdldD0iX2JsYW5rIj5sZXZAcmVkaGF0LmNvbTwvYT4gfCA8L3NwYW4+PHNwYW4+ PHNwYW4gc3R5bGU9Im1hcmdpbjowcHg7cGFkZGluZzowcHgiPjxhIGhyZWY9Im1haWx0bzpsdmV5 ZGVAcmVkaGF0LmNvbSIgc3R5bGU9ImNvbG9yOnJnYigwLDEzNiwyMDYpO2ZvbnQtc2l6ZToxMHB4 O21hcmdpbjowcHg7dGV4dC1kZWNvcmF0aW9uOm5vbmU7Zm9udC1mYW1pbHk6b3ZlcnBhc3Msc2Fu cy1zZXJpZiIgdGFyZ2V0PSJfYmxhbmsiPmx2ZXlkZUByZWRoYXQuY29tPC9hPjwvc3Bhbj48L3Nw YW4+Cgo8L3A+CjxhIGhyZWY9Imh0dHBzOi8vcmVkLmh0L3NpZyIgdGFyZ2V0PSJfYmxhbmsiPiA8 aW1nIHNyYz0iaHR0cHM6Ly93d3cucmVkaGF0LmNvbS9wcm9maWxlcy9yaC90aGVtZXMvcmVkaGF0 ZG90Y29tL2ltZy9sb2dvLXJlZC1oYXQtYmxhY2sucG5nIiB3aWR0aD0iOTAiIGhlaWdodD0iYXV0 byI+PC9hPiAKCjxkaXY+PGEgc3R5bGU9InRleHQtZGVjb3JhdGlvbjpub25lO2NvbG9yOnJnYigy MDQsMCwwKTtmb250LXdlaWdodDpib2xkIiBocmVmPSJodHRwczovL3JlZGhhdC5jb20vdHJ1c3Rl ZCIgdGFyZ2V0PSJfYmxhbmsiPlRSSUVELiBURVNURUQuIFRSVVNURUQuPC9hPjwvZGl2PjwvZGl2 PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2Pjwv ZGl2PjwvZGl2PgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f Xzxicj4KRGV2ZWwgbWFpbGluZyBsaXN0IC0tIDxhIGhyZWY9Im1haWx0bzpkZXZlbEBvdmlydC5v cmciIHRhcmdldD0iX2JsYW5rIj5kZXZlbEBvdmlydC5vcmc8L2E+PGJyPgpUbyB1bnN1YnNjcmli ZSBzZW5kIGFuIGVtYWlsIHRvIDxhIGhyZWY9Im1haWx0bzpkZXZlbC1sZWF2ZUBvdmlydC5vcmci IHRhcmdldD0iX2JsYW5rIj5kZXZlbC1sZWF2ZUBvdmlydC5vcmc8L2E+PGJyPgpQcml2YWN5IFN0 YXRlbWVudDogPGEgaHJlZj0iaHR0cHM6Ly93d3cub3ZpcnQub3JnL3ByaXZhY3ktcG9saWN5Lmh0 bWwiIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8vd3d3Lm92aXJ0Lm9y Zy9wcml2YWN5LXBvbGljeS5odG1sPC9hPjxicj4Kb1ZpcnQgQ29kZSBvZiBDb25kdWN0OiA8YSBo cmVmPSJodHRwczovL3d3dy5vdmlydC5vcmcvY29tbXVuaXR5L2Fib3V0L2NvbW11bml0eS1ndWlk ZWxpbmVzLyIgcmVsPSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly93d3cub3Zp cnQub3JnL2NvbW11bml0eS9hYm91dC9jb21tdW5pdHktZ3VpZGVsaW5lcy88L2E+PGJyPgpMaXN0 IEFyY2hpdmVzOiA8YSBocmVmPSJodHRwczovL2xpc3RzLm92aXJ0Lm9yZy9hcmNoaXZlcy9saXN0 L2RldmVsQG92aXJ0Lm9yZy9tZXNzYWdlL0I3Vk1MQzdKS1lTVTJMSTZUUk1FQUpDWFhNM05MU1NH LyIgcmVsPSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly9saXN0cy5vdmlydC5v cmcvYXJjaGl2ZXMvbGlzdC9kZXZlbEBvdmlydC5vcmcvbWVzc2FnZS9CN1ZNTEM3SktZU1UyTEk2 VFJNRUFKQ1hYTTNOTFNTRy88L2E+PGJyPgo8L2Jsb2NrcXVvdGU+PC9kaXY+CjwvYmxvY2txdW90 ZT48L2Rpdj4K --===============3884013325901257572==-- From nsoffer at redhat.com Tue Sep 8 11:44:31 2020 Content-Type: multipart/mixed; boundary="===============4468852456631733421==" MIME-Version: 1.0 From: Nir Soffer To: infra at ovirt.org Subject: Re: [ovirt-devel] Re: [CI] Builds broken by "Status code: 403 for http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm" Date: Tue, 08 Sep 2020 14:42:17 +0300 Message-ID: In-Reply-To: CAC3Yk1KP605PaDqS8jCqynX3sq+mmNujACsR1OPX6o01ypGLjA@mail.gmail.com --===============4468852456631733421== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On Tue, Sep 8, 2020 at 1:14 PM Ehud Yonasi wrote: > I found out the root cause was because of space issues in the nightly > publisher run. > > The 3 ovirt publishers ran in together and the jenkins dir did not have > that capacity. > > Currently, I am restoring the ovirt-master snapshot and then 4.3 + 4.2, > Thanks! > plus sent a patch [1] to ensure they will not run in parallel. > > [1]: https://gerrit.ovirt.org/111160 > I probably don't understand the change, but it seems that all jobs will run now at 00:00? I think we need to work on a better mechanism for updating the repository. For example, we can have a symlink the to current repo: current -> 200908143754 200908143754/ repo files... 200908143830/ repo files... When creating a new repo, create a new directory. Update the "current" symlink only if creating the new repo succeeded. Then delete the previous respo. With this the cases when the entire repo or some files are missing are not possible. On Tue, Sep 8, 2020 at 12:13 PM Ehud Yonasi wrote: > >> Hey, >> >> I am looking into this. >> Will update with the results I will find. >> >> On Tue, Sep 8, 2020 at 12:00 PM Lev Veyde wrote: >> >>> Hi Nir, >>> >>> It looks like the CI job broke it again, breaking 4.2, 4.3 and master >>> snapshot release RPM. >>> >>> I guess it's the same issue we had last time. >>> >>> Thanks in advance, >>> >>> On Tue, Sep 8, 2020 at 11:45 AM Nir Soffer wrote: >>> >>>> On Mon, Sep 7, 2020 at 2:30 PM Nir Soffer wrote: >>>> > >>>> > This is the second time, last time there was an issue during a >>>> nightly job that >>>> > left the master snapshot repo broken. >>>> >>>> This is still broken today. >>>> >>>> In the past sending mail to infra-support created a bug, and someone >>>> was handling >>>> issue quickly. This seems to be broken now. >>>> >>>> We depend on >>>> http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm >>>> for development and CI. When the rpm is missing, CI jobs fail, and >>>> developers cannot >>>> update their setup. >>>> >>>> Please fix it as soon as possible. >>>> >>>> > I have 3 failure builds: >>>> > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7744/ >>>> > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7751/ >>>> > https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7755/ >>>> > >>>> > All seems to fail in: >>>> > >>>> > [2020-09-07T10:00:56.163Z] + dnf install -y >>>> > http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm >>>> > [2020-09-07T10:01:08.524Z] Status code: 403 for >>>> > http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm (IP: >>>> > 66.187.230.40) >>>> > >>>> > Checking manually show: >>>> > >>>> > $ curl >>>> https://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm >>>> > >>>> > >>>> > 403 Forbidden >>>> > >>>> >

Forbidden

>>>> >

You don't have permission to access >>>> /pub/yum-repo/ovirt-release-master.rpm >>>> > on this server.

>>>> > >>>> > >>>> > Looking at: >>>> > https://resources.ovirt.org/pub/yum-repo/ >>>> > >>>> > ovirt-elease-master.rpm does not exist. >>>> > >>>> > So we have 2 issues: >>>> > - The file does not exist >>>> > - We return "403 Forbidden" instead of "404 Not Found" >>>> >>>> >>> >>> -- >>> >>> Lev Veyde >>> >>> Senior Software Engineer, RHCE | RHCVA | MCITP >>> >>> Red Hat Israel >>> >>> >>> >>> lev(a)redhat.com | lveyde(a)redhat.com >>> >>> TRIED. TESTED. TRUSTED. >>> _______________________________________________ >>> Devel mailing list -- devel(a)ovirt.org >>> To unsubscribe send an email to devel-leave(a)ovirt.org >>> Privacy Statement: https://www.ovirt.org/privacy-policy.html >>> oVirt Code of Conduct: >>> https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives: >>> https://lists.ovirt.org/archives/list/devel(a)ovirt.org/message/B7VMLC7= JKYSU2LI6TRMEAJCXXM3NLSSG/ >>> >> --===============4468852456631733421== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGRpdiBkaXI9Imx0ciI+T24gVHVlLCBTZXAgOCwgMjAyMCBhdCAxOjE0 IFBNIEVodWQgWW9uYXNpICZsdDs8YSBocmVmPSJtYWlsdG86ZXlvbmFzaUByZWRoYXQuY29tIj5l eW9uYXNpQHJlZGhhdC5jb208L2E+Jmd0OyB3cm90ZTo8YnI+PC9kaXY+PGRpdiBjbGFzcz0iZ21h aWxfcXVvdGUiPjxibG9ja3F1b3RlIGNsYXNzPSJnbWFpbF9xdW90ZSIgc3R5bGU9Im1hcmdpbjow cHggMHB4IDBweCAwLjhleDtib3JkZXItbGVmdDoxcHggc29saWQgcmdiKDIwNCwyMDQsMjA0KTtw YWRkaW5nLWxlZnQ6MWV4Ij48ZGl2IGRpcj0ibHRyIj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTpn ZW9yZ2lhLHNlcmlmIj5JIGZvdW5kIG91dCB0aGUgcm9vdCBjYXVzZSB3YXMgYmVjYXVzZSBvZiBz cGFjZSBpc3N1ZXMgaW4gdGhlIG5pZ2h0bHkgcHVibGlzaGVyIHJ1bi48L2Rpdj48ZGl2IHN0eWxl PSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj48YnI+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1m YW1pbHk6Z2VvcmdpYSxzZXJpZiI+VGhlIDMgb3ZpcnQgcHVibGlzaGVycyByYW4gaW4gdG9nZXRo ZXIgYW5kIHRoZSBqZW5raW5zIGRpciBkaWQgbm90IGhhdmUgdGhhdCBjYXBhY2l0eS48L2Rpdj48 ZGl2IHN0eWxlPSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj48YnI+PC9kaXY+PGRpdiBzdHls ZT0iZm9udC1mYW1pbHk6Z2VvcmdpYSxzZXJpZiI+Q3VycmVudGx5LCBJIGFtIHJlc3RvcmluZyB0 aGUgb3ZpcnQtbWFzdGVyIHNuYXBzaG90IGFuZCB0aGVuIDQuMyArIDQuMiwgPC9kaXY+PC9kaXY+ PC9ibG9ja3F1b3RlPjxkaXY+PGJyPjwvZGl2PjxkaXY+VGhhbmtzITwvZGl2PjxkaXY+wqA8L2Rp dj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46MHB4IDBweCAw cHggMC44ZXg7Ym9yZGVyLWxlZnQ6MXB4IHNvbGlkIHJnYigyMDQsMjA0LDIwNCk7cGFkZGluZy1s ZWZ0OjFleCI+PGRpdiBkaXI9Imx0ciI+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6Z2VvcmdpYSxz ZXJpZiI+cGx1cyBzZW50IGEgcGF0Y2ggWzFdIHRvIGVuc3VyZSB0aGV5IHdpbGwgbm90IHJ1biBp biBwYXJhbGxlbC48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj48 YnI+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6Z2VvcmdpYSxzZXJpZiI+WzFdOiA8YSBo cmVmPSJodHRwczovL2dlcnJpdC5vdmlydC5vcmcvMTExMTYwIiB0YXJnZXQ9Il9ibGFuayI+aHR0 cHM6Ly9nZXJyaXQub3ZpcnQub3JnLzExMTE2MDwvYT48L2Rpdj48L2Rpdj48L2Jsb2NrcXVvdGU+ PGRpdj48YnI+PC9kaXY+PGRpdj5JIHByb2JhYmx5wqBkb24mIzM5O3QgdW5kZXJzdGFuZCB0aGUg Y2hhbmdlLCBidXQgaXQgc2VlbXPCoHRoYXQgYWxsIGpvYnM8L2Rpdj48ZGl2PndpbGwgcnVuIG5v dyBhdCAwMDowMD88L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PkkgdGhpbmsgd2UgbmVlZCB0byB3 b3JrIG9uIGEgYmV0dGVyIG1lY2hhbmlzbSBmb3IgdXBkYXRpbmcgdGhlIHJlcG9zaXRvcnkuPC9k aXY+PGRpdj5Gb3IgZXhhbXBsZSwgd2UgY2FuIGhhdmUgYSBzeW1saW5rIHRoZSB0byBjdXJyZW50 IHJlcG86PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5jdXJyZW50IC0mZ3Q7wqAyMDA5MDgxNDM3 NTQ8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PjIwMDkwODE0Mzc1NC88YnI+PC9kaXY+PGRpdj7C oCDCoCByZXBvIGZpbGVzLi4uPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj4yMDA5MDgxNDM4MzAv PGJyPjwvZGl2PjxkaXY+wqAgwqAgcmVwbyBmaWxlcy4uLjwvZGl2PjxkaXY+PGJyPjwvZGl2Pjxk aXY+V2hlbiBjcmVhdGluZyBhIG5ldyByZXBvLCBjcmVhdGUgYSBuZXcgZGlyZWN0b3J5LiBVcGRh dGUgdGhlICZxdW90O2N1cnJlbnQmcXVvdDsgc3ltbGluayBvbmx5PC9kaXY+PGRpdj5pZiBjcmVh dGluZyB0aGUgbmV3IHJlcG8gc3VjY2VlZGVkLiBUaGVuIGRlbGV0ZSB0aGUgcHJldmlvdXMgcmVz cG8uPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5XaXRoIHRoaXMgdGhlIGNhc2VzwqB3aGVuIHRo ZSBlbnRpcmUgcmVwbyBvciBzb21lIGZpbGVzIGFyZSBtaXNzaW5nIGFyZSBub3QgcG9zc2libGUu PC9kaXY+PGRpdj48YnI+PC9kaXY+PGJsb2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1b3RlIiBzdHls ZT0ibWFyZ2luOjBweCAwcHggMHB4IDAuOGV4O2JvcmRlci1sZWZ0OjFweCBzb2xpZCByZ2IoMjA0 LDIwNCwyMDQpO3BhZGRpbmctbGVmdDoxZXgiPjxkaXYgY2xhc3M9ImdtYWlsX3F1b3RlIj48ZGl2 IGRpcj0ibHRyIiBjbGFzcz0iZ21haWxfYXR0ciI+T24gVHVlLCBTZXAgOCwgMjAyMCBhdCAxMjox MyBQTSBFaHVkIFlvbmFzaSAmbHQ7PGEgaHJlZj0ibWFpbHRvOmV5b25hc2lAcmVkaGF0LmNvbSIg dGFyZ2V0PSJfYmxhbmsiPmV5b25hc2lAcmVkaGF0LmNvbTwvYT4mZ3Q7IHdyb3RlOjxicj48L2Rp dj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46MHB4IDBweCAw cHggMC44ZXg7Ym9yZGVyLWxlZnQ6MXB4IHNvbGlkIHJnYigyMDQsMjA0LDIwNCk7cGFkZGluZy1s ZWZ0OjFleCI+PGRpdiBkaXI9Imx0ciI+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6Z2VvcmdpYSxz ZXJpZiI+SGV5LDwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5Omdlb3JnaWEsc2VyaWYiPjxi cj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj5JIGFtIGxvb2tp bmcgaW50byB0aGlzLiA8YnI+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6Z2VvcmdpYSxz ZXJpZiI+V2lsbCB1cGRhdGUgd2l0aCB0aGUgcmVzdWx0cyBJIHdpbGwgZmluZC4gPGJyPjwvZGl2 PjwvZGl2Pjxicj48ZGl2IGNsYXNzPSJnbWFpbF9xdW90ZSI+PGRpdiBkaXI9Imx0ciIgY2xhc3M9 ImdtYWlsX2F0dHIiPk9uIFR1ZSwgU2VwIDgsIDIwMjAgYXQgMTI6MDAgUE0gTGV2IFZleWRlICZs dDs8YSBocmVmPSJtYWlsdG86bHZleWRlQHJlZGhhdC5jb20iIHRhcmdldD0iX2JsYW5rIj5sdmV5 ZGVAcmVkaGF0LmNvbTwvYT4mZ3Q7IHdyb3RlOjxicj48L2Rpdj48YmxvY2txdW90ZSBjbGFzcz0i Z21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46MHB4IDBweCAwcHggMC44ZXg7Ym9yZGVyLWxlZnQ6 MXB4IHNvbGlkIHJnYigyMDQsMjA0LDIwNCk7cGFkZGluZy1sZWZ0OjFleCI+PGRpdiBkaXI9Imx0 ciI+SGnCoE5pciw8ZGl2Pjxicj48L2Rpdj48ZGl2Pkl0IGxvb2tzIGxpa2UgdGhlIENJIGpvYiBi cm9rZSBpdCBhZ2FpbiwgYnJlYWtpbmcgNC4yLCA0LjMgYW5kIG1hc3RlciBzbmFwc2hvdCByZWxl YXNlIFJQTS48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PkkgZ3Vlc3MgaXQmIzM5O3MgdGhlIHNh bWUgaXNzdWUgd2UgaGFkIGxhc3QgdGltZS48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PlRoYW5r cyBpbiBhZHZhbmNlLDwvZGl2PjwvZGl2Pjxicj48ZGl2IGNsYXNzPSJnbWFpbF9xdW90ZSI+PGRp diBkaXI9Imx0ciIgY2xhc3M9ImdtYWlsX2F0dHIiPk9uIFR1ZSwgU2VwIDgsIDIwMjAgYXQgMTE6 NDUgQU0gTmlyIFNvZmZlciAmbHQ7PGEgaHJlZj0ibWFpbHRvOm5zb2ZmZXJAcmVkaGF0LmNvbSIg dGFyZ2V0PSJfYmxhbmsiPm5zb2ZmZXJAcmVkaGF0LmNvbTwvYT4mZ3Q7IHdyb3RlOjxicj48L2Rp dj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46MHB4IDBweCAw cHggMC44ZXg7Ym9yZGVyLWxlZnQ6MXB4IHNvbGlkIHJnYigyMDQsMjA0LDIwNCk7cGFkZGluZy1s ZWZ0OjFleCI+T24gTW9uLCBTZXAgNywgMjAyMCBhdCAyOjMwIFBNIE5pciBTb2ZmZXIgJmx0Ozxh IGhyZWY9Im1haWx0bzpuc29mZmVyQHJlZGhhdC5jb20iIHRhcmdldD0iX2JsYW5rIj5uc29mZmVy QHJlZGhhdC5jb208L2E+Jmd0OyB3cm90ZTo8YnI+CiZndDs8YnI+CiZndDsgVGhpcyBpcyB0aGUg c2Vjb25kIHRpbWUsIGxhc3QgdGltZSB0aGVyZSB3YXMgYW4gaXNzdWUgZHVyaW5nIGEgbmlnaHRs eSBqb2IgdGhhdDxicj4KJmd0OyBsZWZ0IHRoZSBtYXN0ZXIgc25hcHNob3QgcmVwbyBicm9rZW4u PGJyPgo8YnI+ClRoaXMgaXMgc3RpbGwgYnJva2VuIHRvZGF5Ljxicj4KPGJyPgpJbiB0aGUgcGFz dCBzZW5kaW5nIG1haWwgdG8gaW5mcmEtc3VwcG9ydCBjcmVhdGVkIGEgYnVnLCBhbmQgc29tZW9u ZTxicj4Kd2FzIGhhbmRsaW5nPGJyPgppc3N1ZSBxdWlja2x5LiBUaGlzIHNlZW1zIHRvIGJlIGJy b2tlbiBub3cuPGJyPgo8YnI+CldlIGRlcGVuZCBvbiA8YSBocmVmPSJodHRwOi8vcmVzb3VyY2Vz Lm92aXJ0Lm9yZy9wdWIveXVtLXJlcG8vb3ZpcnQtcmVsZWFzZS1tYXN0ZXIucnBtIiByZWw9Im5v cmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5odHRwOi8vcmVzb3VyY2VzLm92aXJ0Lm9yZy9wdWIv eXVtLXJlcG8vb3ZpcnQtcmVsZWFzZS1tYXN0ZXIucnBtPC9hPjxicj4KZm9yIGRldmVsb3BtZW50 IGFuZCBDSS4gV2hlbiB0aGUgcnBtIGlzIG1pc3NpbmcsIENJIGpvYnMgZmFpbCwgYW5kPGJyPgpk ZXZlbG9wZXJzIGNhbm5vdDxicj4KdXBkYXRlIHRoZWlyIHNldHVwLjxicj4KPGJyPgpQbGVhc2Ug Zml4IGl0IGFzIHNvb24gYXMgcG9zc2libGUuPGJyPgo8YnI+CiZndDsgSSBoYXZlIDMgZmFpbHVy ZSBidWlsZHM6PGJyPgomZ3Q7IDxhIGhyZWY9Imh0dHBzOi8vamVua2lucy5vdmlydC5vcmcvam9i L292aXJ0LWVuZ2luZV9zdGFuZGFyZC1jaGVjay1wYXRjaC83NzQ0LyIgcmVsPSJub3JlZmVycmVy IiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtZW5n aW5lX3N0YW5kYXJkLWNoZWNrLXBhdGNoLzc3NDQvPC9hPjxicj4KJmd0OyA8YSBocmVmPSJodHRw czovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1lbmdpbmVfc3RhbmRhcmQtY2hlY2stcGF0 Y2gvNzc1MS8iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8vamVua2lu cy5vdmlydC5vcmcvam9iL292aXJ0LWVuZ2luZV9zdGFuZGFyZC1jaGVjay1wYXRjaC83NzUxLzwv YT48YnI+CiZndDsgPGEgaHJlZj0iaHR0cHM6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQt ZW5naW5lX3N0YW5kYXJkLWNoZWNrLXBhdGNoLzc3NTUvIiByZWw9Im5vcmVmZXJyZXIiIHRhcmdl dD0iX2JsYW5rIj5odHRwczovL2plbmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1lbmdpbmVfc3Rh bmRhcmQtY2hlY2stcGF0Y2gvNzc1NS88L2E+PGJyPgomZ3Q7PGJyPgomZ3Q7IEFsbCBzZWVtcyB0 byBmYWlsIGluOjxicj4KJmd0Ozxicj4KJmd0OyBbMjAyMC0wOS0wN1QxMDowMDo1Ni4xNjNaXSAr IGRuZiBpbnN0YWxsIC15PGJyPgomZ3Q7IDxhIGhyZWY9Imh0dHA6Ly9yZXNvdXJjZXMub3ZpcnQu b3JnL3B1Yi95dW0tcmVwby9vdmlydC1yZWxlYXNlLW1hc3Rlci5ycG0iIHJlbD0ibm9yZWZlcnJl ciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9yZXNvdXJjZXMub3ZpcnQub3JnL3B1Yi95dW0tcmVw by9vdmlydC1yZWxlYXNlLW1hc3Rlci5ycG08L2E+PGJyPgomZ3Q7IFsyMDIwLTA5LTA3VDEwOjAx OjA4LjUyNFpdIFN0YXR1cyBjb2RlOiA0MDMgZm9yPGJyPgomZ3Q7IDxhIGhyZWY9Imh0dHA6Ly9y ZXNvdXJjZXMub3ZpcnQub3JnL3B1Yi95dW0tcmVwby9vdmlydC1yZWxlYXNlLW1hc3Rlci5ycG0i IHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6Ly9yZXNvdXJjZXMub3ZpcnQu b3JnL3B1Yi95dW0tcmVwby9vdmlydC1yZWxlYXNlLW1hc3Rlci5ycG08L2E+IChJUDo8YnI+CiZn dDsgNjYuMTg3LjIzMC40MCk8YnI+CiZndDs8YnI+CiZndDsgQ2hlY2tpbmcgbWFudWFsbHkgc2hv dzo8YnI+CiZndDs8YnI+CiZndDsgJCBjdXJsIDxhIGhyZWY9Imh0dHBzOi8vcmVzb3VyY2VzLm92 aXJ0Lm9yZy9wdWIveXVtLXJlcG8vb3ZpcnQtcmVsZWFzZS1tYXN0ZXIucnBtIiByZWw9Im5vcmVm ZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5odHRwczovL3Jlc291cmNlcy5vdmlydC5vcmcvcHViL3l1 bS1yZXBvL292aXJ0LXJlbGVhc2UtbWFzdGVyLnJwbTwvYT48YnI+CiZndDsgJmx0OyFET0NUWVBF IEhUTUwgUFVCTElDICZxdW90Oy0vL0lFVEYvL0RURCBIVE1MIDIuMC8vRU4mcXVvdDsmZ3Q7PGJy PgomZ3Q7ICZsdDtodG1sJmd0OyZsdDtoZWFkJmd0Ozxicj4KJmd0OyAmbHQ7dGl0bGUmZ3Q7NDAz IEZvcmJpZGRlbiZsdDsvdGl0bGUmZ3Q7PGJyPgomZ3Q7ICZsdDsvaGVhZCZndDsmbHQ7Ym9keSZn dDs8YnI+CiZndDsgJmx0O2gxJmd0O0ZvcmJpZGRlbiZsdDsvaDEmZ3Q7PGJyPgomZ3Q7ICZsdDtw Jmd0O1lvdSBkb24mIzM5O3QgaGF2ZSBwZXJtaXNzaW9uIHRvIGFjY2VzcyAvcHViL3l1bS1yZXBv L292aXJ0LXJlbGVhc2UtbWFzdGVyLnJwbTxicj4KJmd0OyBvbiB0aGlzIHNlcnZlci4mbHQ7L3Am Z3Q7PGJyPgomZ3Q7ICZsdDsvYm9keSZndDsmbHQ7L2h0bWwmZ3Q7PGJyPgomZ3Q7PGJyPgomZ3Q7 IExvb2tpbmcgYXQ6PGJyPgomZ3Q7IDxhIGhyZWY9Imh0dHBzOi8vcmVzb3VyY2VzLm92aXJ0Lm9y Zy9wdWIveXVtLXJlcG8vIiByZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5odHRwczov L3Jlc291cmNlcy5vdmlydC5vcmcvcHViL3l1bS1yZXBvLzwvYT48YnI+CiZndDs8YnI+CiZndDsg b3ZpcnQtZWxlYXNlLW1hc3Rlci5ycG0gZG9lcyBub3QgZXhpc3QuPGJyPgomZ3Q7PGJyPgomZ3Q7 IFNvIHdlIGhhdmUgMiBpc3N1ZXM6PGJyPgomZ3Q7IC0gVGhlIGZpbGUgZG9lcyBub3QgZXhpc3Q8 YnI+CiZndDsgLSBXZSByZXR1cm4gJnF1b3Q7NDAzIEZvcmJpZGRlbiZxdW90OyBpbnN0ZWFkIG9m ICZxdW90OzQwNCBOb3QgRm91bmQmcXVvdDs8YnI+Cjxicj4KPC9ibG9ja3F1b3RlPjwvZGl2Pjxi ciBjbGVhcj0iYWxsIj48ZGl2Pjxicj48L2Rpdj4tLSA8YnI+PGRpdiBkaXI9Imx0ciI+PGRpdiBk aXI9Imx0ciI+PGRpdj48ZGl2IGRpcj0ibHRyIj48ZGl2PjxkaXYgZGlyPSJsdHIiPjxkaXY+PGRp diBkaXI9Imx0ciI+PGRpdj48ZGl2IGRpcj0ibHRyIj48ZGl2Pjxicj48ZGl2PjxwIHN0eWxlPSJm b250LXdlaWdodDpib2xkO21hcmdpbjowcHg7cGFkZGluZzowcHg7Zm9udC1zaXplOjE0cHg7dGV4 dC10cmFuc2Zvcm06dXBwZXJjYXNlIj48c3Bhbj5MZXY8L3NwYW4+IDxzcGFuPlZleWRlPC9zcGFu PjwvcD4KPHAgc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbDtmb250LXNpemU6MTBweDttYXJnaW46 MHB4IDBweCA0cHg7dGV4dC10cmFuc2Zvcm06dXBwZXJjYXNlIj48c3Bhbj5TZW5pb3IgU29mdHdh cmUgRW5naW5lZXI8L3NwYW4+PHNwYW4gc3R5bGU9ImNvbG9yOnJnYigyMDQsMjA0LDIwNCkiPiwg PHNwYW4gc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbDtjb2xvcjpyZ2IoMTcwLDE3MCwxNzApO21h cmdpbjowcHgiPlJIQ0UgfCBSSENWQSB8IE1DSVRQPC9zcGFuPjwvc3Bhbj48L3A+CjxwIHN0eWxl PSJmb250LXdlaWdodDpub3JtYWw7bWFyZ2luOjBweDtmb250LXNpemU6MTBweDtjb2xvcjpyZ2Io MTUzLDE1MywxNTMpIj48YSBocmVmPSJodHRwczovL3d3dy5yZWRoYXQuY29tIiBzdHlsZT0iY29s b3I6cmdiKDAsMTM2LDIwNik7Zm9udC1zaXplOjEwcHg7bWFyZ2luOjBweDt0ZXh0LWRlY29yYXRp b246bm9uZTtmb250LWZhbWlseTpvdmVycGFzcyxzYW5zLXNlcmlmIiB0YXJnZXQ9Il9ibGFuayI+ UmVkIEhhdCA8c3Bhbj5Jc3JhZWw8YnI+PGJyPjwvc3Bhbj48L2E+PC9wPgoKCjxwIHN0eWxlPSJm b250LXdlaWdodDpub3JtYWw7bWFyZ2luOjBweCAwcHggNnB4O2ZvbnQtc2l6ZToxMHB4O2NvbG9y OnJnYigxNTMsMTUzLDE1MykiPjxzcGFuIHN0eWxlPSJtYXJnaW46MHB4O3BhZGRpbmc6MHB4Ij4K PGEgaHJlZj0ibWFpbHRvOmxldkByZWRoYXQuY29tIiBzdHlsZT0iY29sb3I6cmdiKDAsMTM2LDIw Nik7Zm9udC1zaXplOjEwcHg7bWFyZ2luOjBweDt0ZXh0LWRlY29yYXRpb246bm9uZTtmb250LWZh bWlseTpvdmVycGFzcyxzYW5zLXNlcmlmIiB0YXJnZXQ9Il9ibGFuayI+bGV2QHJlZGhhdC5jb208 L2E+IHwgPC9zcGFuPjxzcGFuPjxzcGFuIHN0eWxlPSJtYXJnaW46MHB4O3BhZGRpbmc6MHB4Ij48 YSBocmVmPSJtYWlsdG86bHZleWRlQHJlZGhhdC5jb20iIHN0eWxlPSJjb2xvcjpyZ2IoMCwxMzYs MjA2KTtmb250LXNpemU6MTBweDttYXJnaW46MHB4O3RleHQtZGVjb3JhdGlvbjpub25lO2ZvbnQt ZmFtaWx5Om92ZXJwYXNzLHNhbnMtc2VyaWYiIHRhcmdldD0iX2JsYW5rIj5sdmV5ZGVAcmVkaGF0 LmNvbTwvYT48L3NwYW4+PC9zcGFuPgoKPC9wPgo8YSBocmVmPSJodHRwczovL3JlZC5odC9zaWci IHRhcmdldD0iX2JsYW5rIj4gPGltZyBzcmM9Imh0dHBzOi8vd3d3LnJlZGhhdC5jb20vcHJvZmls ZXMvcmgvdGhlbWVzL3JlZGhhdGRvdGNvbS9pbWcvbG9nby1yZWQtaGF0LWJsYWNrLnBuZyIgd2lk dGg9IjkwIiBoZWlnaHQ9ImF1dG8iPjwvYT4gCgo8ZGl2PjxhIHN0eWxlPSJ0ZXh0LWRlY29yYXRp b246bm9uZTtjb2xvcjpyZ2IoMjA0LDAsMCk7Zm9udC13ZWlnaHQ6Ym9sZCIgaHJlZj0iaHR0cHM6 Ly9yZWRoYXQuY29tL3RydXN0ZWQiIHRhcmdldD0iX2JsYW5rIj5UUklFRC4gVEVTVEVELiBUUlVT VEVELjwvYT48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48 L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj4KX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX188YnI+CkRldmVsIG1haWxpbmcgbGlzdCAtLSA8YSBocmVmPSJt YWlsdG86ZGV2ZWxAb3ZpcnQub3JnIiB0YXJnZXQ9Il9ibGFuayI+ZGV2ZWxAb3ZpcnQub3JnPC9h Pjxicj4KVG8gdW5zdWJzY3JpYmUgc2VuZCBhbiBlbWFpbCB0byA8YSBocmVmPSJtYWlsdG86ZGV2 ZWwtbGVhdmVAb3ZpcnQub3JnIiB0YXJnZXQ9Il9ibGFuayI+ZGV2ZWwtbGVhdmVAb3ZpcnQub3Jn PC9hPjxicj4KUHJpdmFjeSBTdGF0ZW1lbnQ6IDxhIGhyZWY9Imh0dHBzOi8vd3d3Lm92aXJ0Lm9y Zy9wcml2YWN5LXBvbGljeS5odG1sIiByZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5o dHRwczovL3d3dy5vdmlydC5vcmcvcHJpdmFjeS1wb2xpY3kuaHRtbDwvYT48YnI+Cm9WaXJ0IENv ZGUgb2YgQ29uZHVjdDogPGEgaHJlZj0iaHR0cHM6Ly93d3cub3ZpcnQub3JnL2NvbW11bml0eS9h Ym91dC9jb21tdW5pdHktZ3VpZGVsaW5lcy8iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxh bmsiPmh0dHBzOi8vd3d3Lm92aXJ0Lm9yZy9jb21tdW5pdHkvYWJvdXQvY29tbXVuaXR5LWd1aWRl bGluZXMvPC9hPjxicj4KTGlzdCBBcmNoaXZlczogPGEgaHJlZj0iaHR0cHM6Ly9saXN0cy5vdmly dC5vcmcvYXJjaGl2ZXMvbGlzdC9kZXZlbEBvdmlydC5vcmcvbWVzc2FnZS9CN1ZNTEM3SktZU1Uy TEk2VFJNRUFKQ1hYTTNOTFNTRy8iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0 dHBzOi8vbGlzdHMub3ZpcnQub3JnL2FyY2hpdmVzL2xpc3QvZGV2ZWxAb3ZpcnQub3JnL21lc3Nh Z2UvQjdWTUxDN0pLWVNVMkxJNlRSTUVBSkNYWE0zTkxTU0cvPC9hPjxicj4KPC9ibG9ja3F1b3Rl PjwvZGl2Pgo8L2Jsb2NrcXVvdGU+PC9kaXY+CjwvYmxvY2txdW90ZT48L2Rpdj48L2Rpdj4K --===============4468852456631733421==-- From eyonasi at redhat.com Tue Sep 8 13:02:27 2020 Content-Type: multipart/mixed; boundary="===============4615807663379787287==" MIME-Version: 1.0 From: Ehud Yonasi To: infra at ovirt.org Subject: Re: [ovirt-devel] Re: [CI] Builds broken by "Status code: 403 for http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm" Date: Tue, 08 Sep 2020 16:02:01 +0300 Message-ID: In-Reply-To: CAMRbyys1Hcwbgty2wigp-x8Ozk72+GE7xYdPysBov0L_wx7-nA@mail.gmail.com --===============4615807663379787287== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Hey Nir, Yeah, we need to work on a better mechanism. I will create a ticket and discuss it in the infra meeting. Currently, the ovirt release master rpm is back, and soon the 4.3 + 4.2 will be restored. Thanks for the report! On Tue, Sep 8, 2020 at 2:42 PM Nir Soffer wrote: > On Tue, Sep 8, 2020 at 1:14 PM Ehud Yonasi wrote: > >> I found out the root cause was because of space issues in the nightly >> publisher run. >> >> The 3 ovirt publishers ran in together and the jenkins dir did not have >> that capacity. >> >> Currently, I am restoring the ovirt-master snapshot and then 4.3 + 4.2, >> > > Thanks! > > >> plus sent a patch [1] to ensure they will not run in parallel. >> >> [1]: https://gerrit.ovirt.org/111160 >> > > I probably don't understand the change, but it seems that all jobs > will run now at 00:00? > > I think we need to work on a better mechanism for updating the repository. > For example, we can have a symlink the to current repo: > > current -> 200908143754 > > 200908143754/ > repo files... > > 200908143830/ > repo files... > > When creating a new repo, create a new directory. Update the "current" > symlink only > if creating the new repo succeeded. Then delete the previous respo. > > With this the cases when the entire repo or some files are missing are not > possible. > > On Tue, Sep 8, 2020 at 12:13 PM Ehud Yonasi wrote: >> >>> Hey, >>> >>> I am looking into this. >>> Will update with the results I will find. >>> >>> On Tue, Sep 8, 2020 at 12:00 PM Lev Veyde wrote: >>> >>>> Hi Nir, >>>> >>>> It looks like the CI job broke it again, breaking 4.2, 4.3 and master >>>> snapshot release RPM. >>>> >>>> I guess it's the same issue we had last time. >>>> >>>> Thanks in advance, >>>> >>>> On Tue, Sep 8, 2020 at 11:45 AM Nir Soffer wrot= e: >>>> >>>>> On Mon, Sep 7, 2020 at 2:30 PM Nir Soffer wrot= e: >>>>> > >>>>> > This is the second time, last time there was an issue during a >>>>> nightly job that >>>>> > left the master snapshot repo broken. >>>>> >>>>> This is still broken today. >>>>> >>>>> In the past sending mail to infra-support created a bug, and someone >>>>> was handling >>>>> issue quickly. This seems to be broken now. >>>>> >>>>> We depend on >>>>> http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm >>>>> for development and CI. When the rpm is missing, CI jobs fail, and >>>>> developers cannot >>>>> update their setup. >>>>> >>>>> Please fix it as soon as possible. >>>>> >>>>> > I have 3 failure builds: >>>>> > >>>>> https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7744/ >>>>> > >>>>> https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7751/ >>>>> > >>>>> https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/7755/ >>>>> > >>>>> > All seems to fail in: >>>>> > >>>>> > [2020-09-07T10:00:56.163Z] + dnf install -y >>>>> > http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm >>>>> > [2020-09-07T10:01:08.524Z] Status code: 403 for >>>>> > http://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm >>>>> (IP: >>>>> > 66.187.230.40) >>>>> > >>>>> > Checking manually show: >>>>> > >>>>> > $ curl >>>>> https://resources.ovirt.org/pub/yum-repo/ovirt-release-master.rpm >>>>> > >>>>> > >>>>> > 403 Forbidden >>>>> > >>>>> >

Forbidden

>>>>> >

You don't have permission to access >>>>> /pub/yum-repo/ovirt-release-master.rpm >>>>> > on this server.

>>>>> > >>>>> > >>>>> > Looking at: >>>>> > https://resources.ovirt.org/pub/yum-repo/ >>>>> > >>>>> > ovirt-elease-master.rpm does not exist. >>>>> > >>>>> > So we have 2 issues: >>>>> > - The file does not exist >>>>> > - We return "403 Forbidden" instead of "404 Not Found" >>>>> >>>>> >>>> >>>> -- >>>> >>>> Lev Veyde >>>> >>>> Senior Software Engineer, RHCE | RHCVA | MCITP >>>> >>>> Red Hat Israel >>>> >>>> >>>> >>>> lev(a)redhat.com | lveyde(a)redhat.com >>>> >>>> TRIED. TESTED. TRUSTED. >>>> _______________________________________________ >>>> Devel mailing list -- devel(a)ovirt.org >>>> To unsubscribe send an email to devel-leave(a)ovirt.org >>>> Privacy Statement: https://www.ovirt.org/privacy-policy.html >>>> oVirt Code of Conduct: >>>> https://www.ovirt.org/community/about/community-guidelines/ >>>> List Archives: >>>> https://lists.ovirt.org/archives/list/devel(a)ovirt.org/message/B7VMLC= 7JKYSU2LI6TRMEAJCXXM3NLSSG/ >>>> >>> --===============4615807663379787287== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGRpdiBjbGFzcz0iZ21haWxfZGVmYXVsdCIgc3R5bGU9ImZvbnQtZmFt aWx5Omdlb3JnaWEsc2VyaWYiPkhleSBOaXIsPC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZGVmYXVs dCIgc3R5bGU9ImZvbnQtZmFtaWx5Omdlb3JnaWEsc2VyaWYiPjxicj48L2Rpdj48ZGl2IGNsYXNz PSJnbWFpbF9kZWZhdWx0IiBzdHlsZT0iZm9udC1mYW1pbHk6Z2VvcmdpYSxzZXJpZiI+WWVhaCwg d2UgbmVlZCB0byB3b3JrIG9uIGEgYmV0dGVyIG1lY2hhbmlzbS7CoCBJIHdpbGwgY3JlYXRlIGEg dGlja2V0IGFuZCBkaXNjdXNzIGl0IGluIHRoZSBpbmZyYSBtZWV0aW5nLjwvZGl2PjxkaXYgY2xh c3M9ImdtYWlsX2RlZmF1bHQiIHN0eWxlPSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj48YnI+ PC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZGVmYXVsdCIgc3R5bGU9ImZvbnQtZmFtaWx5Omdlb3Jn aWEsc2VyaWYiPkN1cnJlbnRseSwgdGhlIG92aXJ0IHJlbGVhc2UgbWFzdGVyIHJwbSBpcyBiYWNr LCBhbmQgc29vbiB0aGUgNC4zICsgNC4yIHdpbGwgYmUgcmVzdG9yZWQuPC9kaXY+PGRpdiBjbGFz cz0iZ21haWxfZGVmYXVsdCIgc3R5bGU9ImZvbnQtZmFtaWx5Omdlb3JnaWEsc2VyaWYiPjxicj48 L2Rpdj48ZGl2IGNsYXNzPSJnbWFpbF9kZWZhdWx0IiBzdHlsZT0iZm9udC1mYW1pbHk6Z2Vvcmdp YSxzZXJpZiI+VGhhbmtzIGZvciB0aGUgcmVwb3J0ITwvZGl2PjwvZGl2Pjxicj48ZGl2IGNsYXNz PSJnbWFpbF9xdW90ZSI+PGRpdiBkaXI9Imx0ciIgY2xhc3M9ImdtYWlsX2F0dHIiPk9uIFR1ZSwg U2VwIDgsIDIwMjAgYXQgMjo0MiBQTSBOaXIgU29mZmVyICZsdDs8YSBocmVmPSJtYWlsdG86bnNv ZmZlckByZWRoYXQuY29tIj5uc29mZmVyQHJlZGhhdC5jb208L2E+Jmd0OyB3cm90ZTo8YnI+PC9k aXY+PGJsb2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjBweCAwcHgg MHB4IDAuOGV4O2JvcmRlci1sZWZ0OjFweCBzb2xpZCByZ2IoMjA0LDIwNCwyMDQpO3BhZGRpbmct bGVmdDoxZXgiPjxkaXYgZGlyPSJsdHIiPjxkaXYgZGlyPSJsdHIiPk9uIFR1ZSwgU2VwIDgsIDIw MjAgYXQgMToxNCBQTSBFaHVkIFlvbmFzaSAmbHQ7PGEgaHJlZj0ibWFpbHRvOmV5b25hc2lAcmVk aGF0LmNvbSIgdGFyZ2V0PSJfYmxhbmsiPmV5b25hc2lAcmVkaGF0LmNvbTwvYT4mZ3Q7IHdyb3Rl Ojxicj48L2Rpdj48ZGl2IGNsYXNzPSJnbWFpbF9xdW90ZSI+PGJsb2NrcXVvdGUgY2xhc3M9Imdt YWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjBweCAwcHggMHB4IDAuOGV4O2JvcmRlci1sZWZ0OjFw eCBzb2xpZCByZ2IoMjA0LDIwNCwyMDQpO3BhZGRpbmctbGVmdDoxZXgiPjxkaXYgZGlyPSJsdHIi PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5Omdlb3JnaWEsc2VyaWYiPkkgZm91bmQgb3V0IHRoZSBy b290IGNhdXNlIHdhcyBiZWNhdXNlIG9mIHNwYWNlIGlzc3VlcyBpbiB0aGUgbmlnaHRseSBwdWJs aXNoZXIgcnVuLjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5Omdlb3JnaWEsc2VyaWYiPjxi cj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj5UaGUgMyBvdmly dCBwdWJsaXNoZXJzIHJhbiBpbiB0b2dldGhlciBhbmQgdGhlIGplbmtpbnMgZGlyIGRpZCBub3Qg aGF2ZSB0aGF0IGNhcGFjaXR5LjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5Omdlb3JnaWEs c2VyaWYiPjxicj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj5D dXJyZW50bHksIEkgYW0gcmVzdG9yaW5nIHRoZSBvdmlydC1tYXN0ZXIgc25hcHNob3QgYW5kIHRo ZW4gNC4zICsgNC4yLCA8L2Rpdj48L2Rpdj48L2Jsb2NrcXVvdGU+PGRpdj48YnI+PC9kaXY+PGRp dj5UaGFua3MhPC9kaXY+PGRpdj7CoDwvZGl2PjxibG9ja3F1b3RlIGNsYXNzPSJnbWFpbF9xdW90 ZSIgc3R5bGU9Im1hcmdpbjowcHggMHB4IDBweCAwLjhleDtib3JkZXItbGVmdDoxcHggc29saWQg cmdiKDIwNCwyMDQsMjA0KTtwYWRkaW5nLWxlZnQ6MWV4Ij48ZGl2IGRpcj0ibHRyIj48ZGl2IHN0 eWxlPSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj5wbHVzIHNlbnQgYSBwYXRjaCBbMV0gdG8g ZW5zdXJlIHRoZXkgd2lsbCBub3QgcnVuIGluIHBhcmFsbGVsLjwvZGl2PjxkaXYgc3R5bGU9ImZv bnQtZmFtaWx5Omdlb3JnaWEsc2VyaWYiPjxicj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWls eTpnZW9yZ2lhLHNlcmlmIj5bMV06IDxhIGhyZWY9Imh0dHBzOi8vZ2Vycml0Lm92aXJ0Lm9yZy8x MTExNjAiIHRhcmdldD0iX2JsYW5rIj5odHRwczovL2dlcnJpdC5vdmlydC5vcmcvMTExMTYwPC9h PjwvZGl2PjwvZGl2PjwvYmxvY2txdW90ZT48ZGl2Pjxicj48L2Rpdj48ZGl2PkkgcHJvYmFibHnC oGRvbiYjMzk7dCB1bmRlcnN0YW5kIHRoZSBjaGFuZ2UsIGJ1dCBpdCBzZWVtc8KgdGhhdCBhbGwg am9iczwvZGl2PjxkaXY+d2lsbCBydW4gbm93IGF0IDAwOjAwPzwvZGl2PjxkaXY+PGJyPjwvZGl2 PjxkaXY+SSB0aGluayB3ZSBuZWVkIHRvIHdvcmsgb24gYSBiZXR0ZXIgbWVjaGFuaXNtIGZvciB1 cGRhdGluZyB0aGUgcmVwb3NpdG9yeS48L2Rpdj48ZGl2PkZvciBleGFtcGxlLCB3ZSBjYW4gaGF2 ZSBhIHN5bWxpbmsgdGhlIHRvIGN1cnJlbnQgcmVwbzo8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2 PmN1cnJlbnQgLSZndDvCoDIwMDkwODE0Mzc1NDwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+MjAw OTA4MTQzNzU0Lzxicj48L2Rpdj48ZGl2PsKgIMKgIHJlcG8gZmlsZXMuLi48L2Rpdj48ZGl2Pjxi cj48L2Rpdj48ZGl2PjIwMDkwODE0MzgzMC88YnI+PC9kaXY+PGRpdj7CoCDCoCByZXBvIGZpbGVz Li4uPC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5XaGVuIGNyZWF0aW5nIGEgbmV3IHJlcG8sIGNy ZWF0ZSBhIG5ldyBkaXJlY3RvcnkuIFVwZGF0ZSB0aGUgJnF1b3Q7Y3VycmVudCZxdW90OyBzeW1s aW5rIG9ubHk8L2Rpdj48ZGl2PmlmIGNyZWF0aW5nIHRoZSBuZXcgcmVwbyBzdWNjZWVkZWQuIFRo ZW4gZGVsZXRlIHRoZSBwcmV2aW91cyByZXNwby48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2Pldp dGggdGhpcyB0aGUgY2FzZXPCoHdoZW4gdGhlIGVudGlyZSByZXBvIG9yIHNvbWUgZmlsZXMgYXJl IG1pc3NpbmcgYXJlIG5vdCBwb3NzaWJsZS48L2Rpdj48ZGl2Pjxicj48L2Rpdj48YmxvY2txdW90 ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46MHB4IDBweCAwcHggMC44ZXg7Ym9y ZGVyLWxlZnQ6MXB4IHNvbGlkIHJnYigyMDQsMjA0LDIwNCk7cGFkZGluZy1sZWZ0OjFleCI+PGRp diBjbGFzcz0iZ21haWxfcXVvdGUiPjxkaXYgZGlyPSJsdHIiIGNsYXNzPSJnbWFpbF9hdHRyIj5P biBUdWUsIFNlcCA4LCAyMDIwIGF0IDEyOjEzIFBNIEVodWQgWW9uYXNpICZsdDs8YSBocmVmPSJt YWlsdG86ZXlvbmFzaUByZWRoYXQuY29tIiB0YXJnZXQ9Il9ibGFuayI+ZXlvbmFzaUByZWRoYXQu Y29tPC9hPiZndDsgd3JvdGU6PGJyPjwvZGl2PjxibG9ja3F1b3RlIGNsYXNzPSJnbWFpbF9xdW90 ZSIgc3R5bGU9Im1hcmdpbjowcHggMHB4IDBweCAwLjhleDtib3JkZXItbGVmdDoxcHggc29saWQg cmdiKDIwNCwyMDQsMjA0KTtwYWRkaW5nLWxlZnQ6MWV4Ij48ZGl2IGRpcj0ibHRyIj48ZGl2IHN0 eWxlPSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj5IZXksPC9kaXY+PGRpdiBzdHlsZT0iZm9u dC1mYW1pbHk6Z2VvcmdpYSxzZXJpZiI+PGJyPjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5 Omdlb3JnaWEsc2VyaWYiPkkgYW0gbG9va2luZyBpbnRvIHRoaXMuIDxicj48L2Rpdj48ZGl2IHN0 eWxlPSJmb250LWZhbWlseTpnZW9yZ2lhLHNlcmlmIj5XaWxsIHVwZGF0ZSB3aXRoIHRoZSByZXN1 bHRzIEkgd2lsbCBmaW5kLiA8YnI+PC9kaXY+PC9kaXY+PGJyPjxkaXYgY2xhc3M9ImdtYWlsX3F1 b3RlIj48ZGl2IGRpcj0ibHRyIiBjbGFzcz0iZ21haWxfYXR0ciI+T24gVHVlLCBTZXAgOCwgMjAy MCBhdCAxMjowMCBQTSBMZXYgVmV5ZGUgJmx0OzxhIGhyZWY9Im1haWx0bzpsdmV5ZGVAcmVkaGF0 LmNvbSIgdGFyZ2V0PSJfYmxhbmsiPmx2ZXlkZUByZWRoYXQuY29tPC9hPiZndDsgd3JvdGU6PGJy PjwvZGl2PjxibG9ja3F1b3RlIGNsYXNzPSJnbWFpbF9xdW90ZSIgc3R5bGU9Im1hcmdpbjowcHgg MHB4IDBweCAwLjhleDtib3JkZXItbGVmdDoxcHggc29saWQgcmdiKDIwNCwyMDQsMjA0KTtwYWRk aW5nLWxlZnQ6MWV4Ij48ZGl2IGRpcj0ibHRyIj5IacKgTmlyLDxkaXY+PGJyPjwvZGl2PjxkaXY+ SXQgbG9va3MgbGlrZSB0aGUgQ0kgam9iIGJyb2tlIGl0IGFnYWluLCBicmVha2luZyA0LjIsIDQu MyBhbmQgbWFzdGVyIHNuYXBzaG90IHJlbGVhc2UgUlBNLjwvZGl2PjxkaXY+PGJyPjwvZGl2Pjxk aXY+SSBndWVzcyBpdCYjMzk7cyB0aGUgc2FtZSBpc3N1ZSB3ZSBoYWQgbGFzdCB0aW1lLjwvZGl2 PjxkaXY+PGJyPjwvZGl2PjxkaXY+VGhhbmtzIGluIGFkdmFuY2UsPC9kaXY+PC9kaXY+PGJyPjxk aXYgY2xhc3M9ImdtYWlsX3F1b3RlIj48ZGl2IGRpcj0ibHRyIiBjbGFzcz0iZ21haWxfYXR0ciI+ T24gVHVlLCBTZXAgOCwgMjAyMCBhdCAxMTo0NSBBTSBOaXIgU29mZmVyICZsdDs8YSBocmVmPSJt YWlsdG86bnNvZmZlckByZWRoYXQuY29tIiB0YXJnZXQ9Il9ibGFuayI+bnNvZmZlckByZWRoYXQu Y29tPC9hPiZndDsgd3JvdGU6PGJyPjwvZGl2PjxibG9ja3F1b3RlIGNsYXNzPSJnbWFpbF9xdW90 ZSIgc3R5bGU9Im1hcmdpbjowcHggMHB4IDBweCAwLjhleDtib3JkZXItbGVmdDoxcHggc29saWQg cmdiKDIwNCwyMDQsMjA0KTtwYWRkaW5nLWxlZnQ6MWV4Ij5PbiBNb24sIFNlcCA3LCAyMDIwIGF0 IDI6MzAgUE0gTmlyIFNvZmZlciAmbHQ7PGEgaHJlZj0ibWFpbHRvOm5zb2ZmZXJAcmVkaGF0LmNv bSIgdGFyZ2V0PSJfYmxhbmsiPm5zb2ZmZXJAcmVkaGF0LmNvbTwvYT4mZ3Q7IHdyb3RlOjxicj4K Jmd0Ozxicj4KJmd0OyBUaGlzIGlzIHRoZSBzZWNvbmQgdGltZSwgbGFzdCB0aW1lIHRoZXJlIHdh cyBhbiBpc3N1ZSBkdXJpbmcgYSBuaWdodGx5IGpvYiB0aGF0PGJyPgomZ3Q7IGxlZnQgdGhlIG1h c3RlciBzbmFwc2hvdCByZXBvIGJyb2tlbi48YnI+Cjxicj4KVGhpcyBpcyBzdGlsbCBicm9rZW4g dG9kYXkuPGJyPgo8YnI+CkluIHRoZSBwYXN0IHNlbmRpbmcgbWFpbCB0byBpbmZyYS1zdXBwb3J0 IGNyZWF0ZWQgYSBidWcsIGFuZCBzb21lb25lPGJyPgp3YXMgaGFuZGxpbmc8YnI+Cmlzc3VlIHF1 aWNrbHkuIFRoaXMgc2VlbXMgdG8gYmUgYnJva2VuIG5vdy48YnI+Cjxicj4KV2UgZGVwZW5kIG9u IDxhIGhyZWY9Imh0dHA6Ly9yZXNvdXJjZXMub3ZpcnQub3JnL3B1Yi95dW0tcmVwby9vdmlydC1y ZWxlYXNlLW1hc3Rlci5ycG0iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHA6 Ly9yZXNvdXJjZXMub3ZpcnQub3JnL3B1Yi95dW0tcmVwby9vdmlydC1yZWxlYXNlLW1hc3Rlci5y cG08L2E+PGJyPgpmb3IgZGV2ZWxvcG1lbnQgYW5kIENJLiBXaGVuIHRoZSBycG0gaXMgbWlzc2lu ZywgQ0kgam9icyBmYWlsLCBhbmQ8YnI+CmRldmVsb3BlcnMgY2Fubm90PGJyPgp1cGRhdGUgdGhl aXIgc2V0dXAuPGJyPgo8YnI+ClBsZWFzZSBmaXggaXQgYXMgc29vbiBhcyBwb3NzaWJsZS48YnI+ Cjxicj4KJmd0OyBJIGhhdmUgMyBmYWlsdXJlIGJ1aWxkczo8YnI+CiZndDsgPGEgaHJlZj0iaHR0 cHM6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtZW5naW5lX3N0YW5kYXJkLWNoZWNrLXBh dGNoLzc3NDQvIiByZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5odHRwczovL2plbmtp bnMub3ZpcnQub3JnL2pvYi9vdmlydC1lbmdpbmVfc3RhbmRhcmQtY2hlY2stcGF0Y2gvNzc0NC88 L2E+PGJyPgomZ3Q7IDxhIGhyZWY9Imh0dHBzOi8vamVua2lucy5vdmlydC5vcmcvam9iL292aXJ0 LWVuZ2luZV9zdGFuZGFyZC1jaGVjay1wYXRjaC83NzUxLyIgcmVsPSJub3JlZmVycmVyIiB0YXJn ZXQ9Il9ibGFuayI+aHR0cHM6Ly9qZW5raW5zLm92aXJ0Lm9yZy9qb2Ivb3ZpcnQtZW5naW5lX3N0 YW5kYXJkLWNoZWNrLXBhdGNoLzc3NTEvPC9hPjxicj4KJmd0OyA8YSBocmVmPSJodHRwczovL2pl bmtpbnMub3ZpcnQub3JnL2pvYi9vdmlydC1lbmdpbmVfc3RhbmRhcmQtY2hlY2stcGF0Y2gvNzc1 NS8iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8vamVua2lucy5vdmly dC5vcmcvam9iL292aXJ0LWVuZ2luZV9zdGFuZGFyZC1jaGVjay1wYXRjaC83NzU1LzwvYT48YnI+ CiZndDs8YnI+CiZndDsgQWxsIHNlZW1zIHRvIGZhaWwgaW46PGJyPgomZ3Q7PGJyPgomZ3Q7IFsy MDIwLTA5LTA3VDEwOjAwOjU2LjE2M1pdICsgZG5mIGluc3RhbGwgLXk8YnI+CiZndDsgPGEgaHJl Zj0iaHR0cDovL3Jlc291cmNlcy5vdmlydC5vcmcvcHViL3l1bS1yZXBvL292aXJ0LXJlbGVhc2Ut bWFzdGVyLnJwbSIgcmVsPSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cDovL3Jlc291 cmNlcy5vdmlydC5vcmcvcHViL3l1bS1yZXBvL292aXJ0LXJlbGVhc2UtbWFzdGVyLnJwbTwvYT48 YnI+CiZndDsgWzIwMjAtMDktMDdUMTA6MDE6MDguNTI0Wl0gU3RhdHVzIGNvZGU6IDQwMyBmb3I8 YnI+CiZndDsgPGEgaHJlZj0iaHR0cDovL3Jlc291cmNlcy5vdmlydC5vcmcvcHViL3l1bS1yZXBv L292aXJ0LXJlbGVhc2UtbWFzdGVyLnJwbSIgcmVsPSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFu ayI+aHR0cDovL3Jlc291cmNlcy5vdmlydC5vcmcvcHViL3l1bS1yZXBvL292aXJ0LXJlbGVhc2Ut bWFzdGVyLnJwbTwvYT4gKElQOjxicj4KJmd0OyA2Ni4xODcuMjMwLjQwKTxicj4KJmd0Ozxicj4K Jmd0OyBDaGVja2luZyBtYW51YWxseSBzaG93Ojxicj4KJmd0Ozxicj4KJmd0OyAkIGN1cmwgPGEg aHJlZj0iaHR0cHM6Ly9yZXNvdXJjZXMub3ZpcnQub3JnL3B1Yi95dW0tcmVwby9vdmlydC1yZWxl YXNlLW1hc3Rlci5ycG0iIHJlbD0ibm9yZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8v cmVzb3VyY2VzLm92aXJ0Lm9yZy9wdWIveXVtLXJlcG8vb3ZpcnQtcmVsZWFzZS1tYXN0ZXIucnBt PC9hPjxicj4KJmd0OyAmbHQ7IURPQ1RZUEUgSFRNTCBQVUJMSUMgJnF1b3Q7LS8vSUVURi8vRFRE IEhUTUwgMi4wLy9FTiZxdW90OyZndDs8YnI+CiZndDsgJmx0O2h0bWwmZ3Q7Jmx0O2hlYWQmZ3Q7 PGJyPgomZ3Q7ICZsdDt0aXRsZSZndDs0MDMgRm9yYmlkZGVuJmx0Oy90aXRsZSZndDs8YnI+CiZn dDsgJmx0Oy9oZWFkJmd0OyZsdDtib2R5Jmd0Ozxicj4KJmd0OyAmbHQ7aDEmZ3Q7Rm9yYmlkZGVu Jmx0Oy9oMSZndDs8YnI+CiZndDsgJmx0O3AmZ3Q7WW91IGRvbiYjMzk7dCBoYXZlIHBlcm1pc3Np b24gdG8gYWNjZXNzIC9wdWIveXVtLXJlcG8vb3ZpcnQtcmVsZWFzZS1tYXN0ZXIucnBtPGJyPgom Z3Q7IG9uIHRoaXMgc2VydmVyLiZsdDsvcCZndDs8YnI+CiZndDsgJmx0Oy9ib2R5Jmd0OyZsdDsv aHRtbCZndDs8YnI+CiZndDs8YnI+CiZndDsgTG9va2luZyBhdDo8YnI+CiZndDsgPGEgaHJlZj0i aHR0cHM6Ly9yZXNvdXJjZXMub3ZpcnQub3JnL3B1Yi95dW0tcmVwby8iIHJlbD0ibm9yZWZlcnJl ciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8vcmVzb3VyY2VzLm92aXJ0Lm9yZy9wdWIveXVtLXJl cG8vPC9hPjxicj4KJmd0Ozxicj4KJmd0OyBvdmlydC1lbGVhc2UtbWFzdGVyLnJwbSBkb2VzIG5v dCBleGlzdC48YnI+CiZndDs8YnI+CiZndDsgU28gd2UgaGF2ZSAyIGlzc3Vlczo8YnI+CiZndDsg LSBUaGUgZmlsZSBkb2VzIG5vdCBleGlzdDxicj4KJmd0OyAtIFdlIHJldHVybiAmcXVvdDs0MDMg Rm9yYmlkZGVuJnF1b3Q7IGluc3RlYWQgb2YgJnF1b3Q7NDA0IE5vdCBGb3VuZCZxdW90Ozxicj4K PGJyPgo8L2Jsb2NrcXVvdGU+PC9kaXY+PGJyIGNsZWFyPSJhbGwiPjxkaXY+PGJyPjwvZGl2Pi0t IDxicj48ZGl2IGRpcj0ibHRyIj48ZGl2IGRpcj0ibHRyIj48ZGl2PjxkaXYgZGlyPSJsdHIiPjxk aXY+PGRpdiBkaXI9Imx0ciI+PGRpdj48ZGl2IGRpcj0ibHRyIj48ZGl2PjxkaXYgZGlyPSJsdHIi PjxkaXY+PGJyPjxkaXY+PHAgc3R5bGU9ImZvbnQtd2VpZ2h0OmJvbGQ7bWFyZ2luOjBweDtwYWRk aW5nOjBweDtmb250LXNpemU6MTRweDt0ZXh0LXRyYW5zZm9ybTp1cHBlcmNhc2UiPjxzcGFuPkxl djwvc3Bhbj4gPHNwYW4+VmV5ZGU8L3NwYW4+PC9wPgo8cCBzdHlsZT0iZm9udC13ZWlnaHQ6bm9y bWFsO2ZvbnQtc2l6ZToxMHB4O21hcmdpbjowcHggMHB4IDRweDt0ZXh0LXRyYW5zZm9ybTp1cHBl cmNhc2UiPjxzcGFuPlNlbmlvciBTb2Z0d2FyZSBFbmdpbmVlcjwvc3Bhbj48c3BhbiBzdHlsZT0i Y29sb3I6cmdiKDIwNCwyMDQsMjA0KSI+LCA8c3BhbiBzdHlsZT0iZm9udC13ZWlnaHQ6bm9ybWFs O2NvbG9yOnJnYigxNzAsMTcwLDE3MCk7bWFyZ2luOjBweCI+UkhDRSB8IFJIQ1ZBIHwgTUNJVFA8 L3NwYW4+PC9zcGFuPjwvcD4KPHAgc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbDttYXJnaW46MHB4 O2ZvbnQtc2l6ZToxMHB4O2NvbG9yOnJnYigxNTMsMTUzLDE1MykiPjxhIGhyZWY9Imh0dHBzOi8v d3d3LnJlZGhhdC5jb20iIHN0eWxlPSJjb2xvcjpyZ2IoMCwxMzYsMjA2KTtmb250LXNpemU6MTBw eDttYXJnaW46MHB4O3RleHQtZGVjb3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5Om92ZXJwYXNzLHNh bnMtc2VyaWYiIHRhcmdldD0iX2JsYW5rIj5SZWQgSGF0IDxzcGFuPklzcmFlbDxicj48YnI+PC9z cGFuPjwvYT48L3A+CgoKPHAgc3R5bGU9ImZvbnQtd2VpZ2h0Om5vcm1hbDttYXJnaW46MHB4IDBw eCA2cHg7Zm9udC1zaXplOjEwcHg7Y29sb3I6cmdiKDE1MywxNTMsMTUzKSI+PHNwYW4gc3R5bGU9 Im1hcmdpbjowcHg7cGFkZGluZzowcHgiPgo8YSBocmVmPSJtYWlsdG86bGV2QHJlZGhhdC5jb20i IHN0eWxlPSJjb2xvcjpyZ2IoMCwxMzYsMjA2KTtmb250LXNpemU6MTBweDttYXJnaW46MHB4O3Rl eHQtZGVjb3JhdGlvbjpub25lO2ZvbnQtZmFtaWx5Om92ZXJwYXNzLHNhbnMtc2VyaWYiIHRhcmdl dD0iX2JsYW5rIj5sZXZAcmVkaGF0LmNvbTwvYT4gfCA8L3NwYW4+PHNwYW4+PHNwYW4gc3R5bGU9 Im1hcmdpbjowcHg7cGFkZGluZzowcHgiPjxhIGhyZWY9Im1haWx0bzpsdmV5ZGVAcmVkaGF0LmNv bSIgc3R5bGU9ImNvbG9yOnJnYigwLDEzNiwyMDYpO2ZvbnQtc2l6ZToxMHB4O21hcmdpbjowcHg7 dGV4dC1kZWNvcmF0aW9uOm5vbmU7Zm9udC1mYW1pbHk6b3ZlcnBhc3Msc2Fucy1zZXJpZiIgdGFy Z2V0PSJfYmxhbmsiPmx2ZXlkZUByZWRoYXQuY29tPC9hPjwvc3Bhbj48L3NwYW4+Cgo8L3A+Cjxh IGhyZWY9Imh0dHBzOi8vcmVkLmh0L3NpZyIgdGFyZ2V0PSJfYmxhbmsiPiA8aW1nIHNyYz0iaHR0 cHM6Ly93d3cucmVkaGF0LmNvbS9wcm9maWxlcy9yaC90aGVtZXMvcmVkaGF0ZG90Y29tL2ltZy9s b2dvLXJlZC1oYXQtYmxhY2sucG5nIiB3aWR0aD0iOTAiIGhlaWdodD0iYXV0byI+PC9hPiAKCjxk aXY+PGEgc3R5bGU9InRleHQtZGVjb3JhdGlvbjpub25lO2NvbG9yOnJnYigyMDQsMCwwKTtmb250 LXdlaWdodDpib2xkIiBocmVmPSJodHRwczovL3JlZGhhdC5jb20vdHJ1c3RlZCIgdGFyZ2V0PSJf YmxhbmsiPlRSSUVELiBURVNURUQuIFRSVVNURUQuPC9hPjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2 PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2Pgpf X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXzxicj4KRGV2ZWwg bWFpbGluZyBsaXN0IC0tIDxhIGhyZWY9Im1haWx0bzpkZXZlbEBvdmlydC5vcmciIHRhcmdldD0i X2JsYW5rIj5kZXZlbEBvdmlydC5vcmc8L2E+PGJyPgpUbyB1bnN1YnNjcmliZSBzZW5kIGFuIGVt YWlsIHRvIDxhIGhyZWY9Im1haWx0bzpkZXZlbC1sZWF2ZUBvdmlydC5vcmciIHRhcmdldD0iX2Js YW5rIj5kZXZlbC1sZWF2ZUBvdmlydC5vcmc8L2E+PGJyPgpQcml2YWN5IFN0YXRlbWVudDogPGEg aHJlZj0iaHR0cHM6Ly93d3cub3ZpcnQub3JnL3ByaXZhY3ktcG9saWN5Lmh0bWwiIHJlbD0ibm9y ZWZlcnJlciIgdGFyZ2V0PSJfYmxhbmsiPmh0dHBzOi8vd3d3Lm92aXJ0Lm9yZy9wcml2YWN5LXBv bGljeS5odG1sPC9hPjxicj4Kb1ZpcnQgQ29kZSBvZiBDb25kdWN0OiA8YSBocmVmPSJodHRwczov L3d3dy5vdmlydC5vcmcvY29tbXVuaXR5L2Fib3V0L2NvbW11bml0eS1ndWlkZWxpbmVzLyIgcmVs PSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly93d3cub3ZpcnQub3JnL2NvbW11 bml0eS9hYm91dC9jb21tdW5pdHktZ3VpZGVsaW5lcy88L2E+PGJyPgpMaXN0IEFyY2hpdmVzOiA8 YSBocmVmPSJodHRwczovL2xpc3RzLm92aXJ0Lm9yZy9hcmNoaXZlcy9saXN0L2RldmVsQG92aXJ0 Lm9yZy9tZXNzYWdlL0I3Vk1MQzdKS1lTVTJMSTZUUk1FQUpDWFhNM05MU1NHLyIgcmVsPSJub3Jl ZmVycmVyIiB0YXJnZXQ9Il9ibGFuayI+aHR0cHM6Ly9saXN0cy5vdmlydC5vcmcvYXJjaGl2ZXMv bGlzdC9kZXZlbEBvdmlydC5vcmcvbWVzc2FnZS9CN1ZNTEM3SktZU1UyTEk2VFJNRUFKQ1hYTTNO TFNTRy88L2E+PGJyPgo8L2Jsb2NrcXVvdGU+PC9kaXY+CjwvYmxvY2txdW90ZT48L2Rpdj4KPC9i bG9ja3F1b3RlPjwvZGl2PjwvZGl2Pgo8L2Jsb2NrcXVvdGU+PC9kaXY+Cg== --===============4615807663379787287==--