CI failures due to oVirt proxy getting forbidden access to CentOS mirrors

Hi, we are experiencing build failures due to *08:49:10* # /usr/bin/yum --installroot /var/lib/mock/epel-8-x86_64-6c17b26f3795335ce1ac45b0dcdbc9d5-bootstrap-8304/root/ --releasever 8 install dnf dnf-plugins-core distribution-gpg-keys --setopt=tsflags=nocontexts <https://jenkins.ovirt.org/job/ovirt-appliance_master_build-artifacts-el8-x86_64/708/console#L859>*08:49:10* Failed to set locale, defaulting to C <https://jenkins.ovirt.org/job/ovirt-appliance_master_build-artifacts-el8-x86_64/708/console#L860>*08:49:10* http://mirror.centos.org/centos-8/8/AppStream/x86_64/os/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden <https://jenkins.ovirt.org/job/ovirt-appliance_master_build-artifacts-el8-x86_64/708/console#L861>*08:49:10* Trying other mirror. ... *08:49:10* failure: repodata/repomd.xml from centos-appstream-el8: [Errno 256] No more mirrors to try. <https://jenkins.ovirt.org/job/ovirt-appliance_master_build-artifacts-el8-x86_64/708/console#L901>*08:49:10* http://mirror.centos.org/centos-8/8/AppStream/x86_64/os/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden (see https://jenkins.ovirt.org/job/ovirt-appliance_master_build-artifacts-el8-x86...) I checked our squid logs on proxy01.phx.ovirt.org and I see: 1623395369.584 1 38.145.50.116 TCP_DENIED/403 4148 GET http://mirror.centos.org/centos-8/8/AppStream/x86_64/os/repodata/repomd.xml - HIER_NONE/- text/html Apparently there's no option in oVirt CI system to turn off the proxy since mock_runner is always called with --try-proxy option. Anyone that can look into this? -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo@redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

Tracked on https://ovirt-jira.atlassian.net/browse/OVIRT-3097 Il giorno ven 11 giu 2021 alle ore 09:40 Sandro Bonazzola < sbonazzo@redhat.com> ha scritto:
Hi, we are experiencing build failures due to
*08:49:10* # /usr/bin/yum --installroot /var/lib/mock/epel-8-x86_64-6c17b26f3795335ce1ac45b0dcdbc9d5-bootstrap-8304/root/ --releasever 8 install dnf dnf-plugins-core distribution-gpg-keys --setopt=tsflags=nocontexts
<https://jenkins.ovirt.org/job/ovirt-appliance_master_build-artifacts-el8-x86_64/708/console#L859>*08:49:10* Failed to set locale, defaulting to C
<https://jenkins.ovirt.org/job/ovirt-appliance_master_build-artifacts-el8-x86_64/708/console#L860>*08:49:10* http://mirror.centos.org/centos-8/8/AppStream/x86_64/os/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden
<https://jenkins.ovirt.org/job/ovirt-appliance_master_build-artifacts-el8-x86_64/708/console#L861>*08:49:10* Trying other mirror.
...
*08:49:10* failure: repodata/repomd.xml from centos-appstream-el8: [Errno 256] No more mirrors to try.
<https://jenkins.ovirt.org/job/ovirt-appliance_master_build-artifacts-el8-x86_64/708/console#L901>*08:49:10* http://mirror.centos.org/centos-8/8/AppStream/x86_64/os/repodata/repomd.xml: [Errno 14] HTTP Error 403 - Forbidden
(see https://jenkins.ovirt.org/job/ovirt-appliance_master_build-artifacts-el8-x86...)
I checked our squid logs on proxy01.phx.ovirt.org and I see:
1623395369.584 1 38.145.50.116 TCP_DENIED/403 4148 GET http://mirror.centos.org/centos-8/8/AppStream/x86_64/os/repodata/repomd.xml - HIER_NONE/- text/html
Apparently there's no option in oVirt CI system to turn off the proxy since mock_runner is always called with --try-proxy option.
Anyone that can look into this?
--
Sandro Bonazzola
MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV
Red Hat EMEA <https://www.redhat.com/>
sbonazzo@redhat.com <https://www.redhat.com/>
*Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*
-- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo@redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours. <https://mojo.redhat.com/docs/DOC-1199578>*
participants (1)
-
Sandro Bonazzola