Potential CentosStream 9 resilientstorage repo issues

Good Morning! I wanted to report that I think there are issues with CentOS Stream 9 ResilientStorage repos (added by package "ovirt-release-ovirt45" and also enabled in the hosted-engine appliance) that causes anything related to DNF and this repo to fail as captured below. Digging in, it looks like centos.org is advertising a metalink.xml (at least for my Toronto, Ontario location) that is timetamped 1747062205 (Monday, May 12, 2025 3:03:25 PM GMT). Mirrors are not in good shape: * centos.org themselves are advertising a repomd.xml for ResilientStorage with timestamp 1747752818 (Tuesday, May 20, 2025 2:53:38 PM) * ca.mirrors.cicku.me are advertising an identical repomd.xml of centos.org * mirror.cpsc.ucalgary.ca is advertisting a 0-byte repomd.xml * mirrors.lug.mtu.edu is advertising an old repomd.xml of timestamp 1744645925 (Monday, April 14, 2025 3:52:05 PM) The SHA512 sum of all published repomd.xml files does not match metalink, therefore all mirrors fail. I haven't tried to exclude the repo from the HE but I wanted to post a note here in case someone else is running into this. I anticipate that Centos.org will fix this at some point, but based on dates it could be that this has been broken for ~3 days already (2025-May-20 2:53PM GMT). I am not sure where to post to raise awareness with CentOS.org or the group responsible for the ResilientStorage repo. If someone knows please let me know - or if someone on the oVirt team could notify a contact, I would be obliged if you could let them know. Thank you kindly, Dan > Errors during downloading metadata for repository 'resilientstorage': - Downloading successful, but checksum doesn't match. Calculated: 87c76b87fe36bfa60fcd8edbc52934559d8af59850efa3f0c04904e0a757d35d9d9bc0edb6114126971709afa4670d77d2de501c949a4f5e5b6144409f7efa77(sha512) Expected: 17ef9ff2c8fc04667ed55a33dc02476a59e236e7da7f19d86c586e2fbab75fa1bd7b1e68d1a1ad4657e84c2791f5f0bf78f30be53db8b5eb7fc83227c819185f(sha512) - Downloading successful, but checksum doesn't match. Calculated: 45c8d2dfc4fe245817d3f5ce5be99505a841b1d328ef14c12ba3b789277bf271a2e36cb981ce66cd0c30f652670504f40907dc05aa8bc9858d506b1989093846(sha512) Expected: 17ef9ff2c8fc04667ed55a33dc02476a59e236e7da7f19d86c586e2fbab75fa1bd7b1e68d1a1ad4657e84c2791f5f0bf78f30be53db8b5eb7fc83227c819185f(sha512) Error: Failed to download metadata for repo 'resilientstorage': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried [devops@l51amew9]$

Hi Dan, We've noticed this also indeed. And I pinged some people @ Fedora (which are the ones maintaining the mirrorlist). Also created a infra ticket for it: https://pagure.io/fedora-infrastructure/issue/12571 Hope they fix it asap indeed! Jean-Louis On 23/05/2025 16:35, lmd@gto.net wrote: > Good Morning! > I wanted to report that I think there are issues with CentOS Stream 9 ResilientStorage repos (added by package "ovirt-release-ovirt45" and also enabled in the hosted-engine appliance) that causes anything related to DNF and this repo to fail as captured below. > > Digging in, it looks like centos.org is advertising a metalink.xml (at least for my Toronto, Ontario location) that is timetamped 1747062205 (Monday, May 12, 2025 3:03:25 PM GMT). > > Mirrors are not in good shape: > * centos.org themselves are advertising a repomd.xml for ResilientStorage with timestamp 1747752818 (Tuesday, May 20, 2025 2:53:38 PM) > * ca.mirrors.cicku.me are advertising an identical repomd.xml of centos.org > * mirror.cpsc.ucalgary.ca is advertisting a 0-byte repomd.xml > * mirrors.lug.mtu.edu is advertising an old repomd.xml of timestamp 1744645925 (Monday, April 14, 2025 3:52:05 PM) > > The SHA512 sum of all published repomd.xml files does not match metalink, therefore all mirrors fail. I haven't tried to exclude the repo from the HE but I wanted to post a note here in case someone else is running into this. > > I anticipate that Centos.org will fix this at some point, but based on dates it could be that this has been broken for ~3 days already (2025-May-20 2:53PM GMT). > > I am not sure where to post to raise awareness with CentOS.org or the group responsible for the ResilientStorage repo. If someone knows please let me know - or if someone on the oVirt team could notify a contact, I would be obliged if you could let them know. > > Thank you kindly, > Dan > > >> Errors during downloading metadata for repository 'resilientstorage': > - Downloading successful, but checksum doesn't match. Calculated: 87c76b87fe36bfa60fcd8edbc52934559d8af59850efa3f0c04904e0a757d35d9d9bc0edb6114126971709afa4670d77d2de501c949a4f5e5b6144409f7efa77(sha512) Expected: 17ef9ff2c8fc04667ed55a33dc02476a59e236e7da7f19d86c586e2fbab75fa1bd7b1e68d1a1ad4657e84c2791f5f0bf78f30be53db8b5eb7fc83227c819185f(sha512) > - Downloading successful, but checksum doesn't match. Calculated: 45c8d2dfc4fe245817d3f5ce5be99505a841b1d328ef14c12ba3b789277bf271a2e36cb981ce66cd0c30f652670504f40907dc05aa8bc9858d506b1989093846(sha512) Expected: 17ef9ff2c8fc04667ed55a33dc02476a59e236e7da7f19d86c586e2fbab75fa1bd7b1e68d1a1ad4657e84c2791f5f0bf78f30be53db8b5eb7fc83227c819185f(sha512) > Error: Failed to download metadata for repo 'resilientstorage': Cannot download repomd.xml: Cannot download repodata/repomd.xml: All mirrors were tried > [devops@l51amew9]$ > _______________________________________________ > Users mailing list -- users@ovirt.org > To unsubscribe send an email to users-leave@ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/TKXKK6DJCQS2TDV4XHCTVJQTIFPQNB57/

Hi Jean-Louis, That's great! Thank you confirming and opening a ticket. Here's hoping they can figure out what is happening and fix it up in short order. Thanks again and I hope you have a good weekend, Dan

Just a note that I was able to successfully work around this in the meantime by specifying the baseurl (pointed towards centos.org) and commenting out the mirror on the hosted-engine VM (SSH into it) during the Ansible 'he_pause_before_engine_setup' pause. Just in case someone else comes across this and is looking for a technique that might be helpful for a temporary workaround. Dan In /etc/yum.repos.d/centos-addon.repo: [resilientstorage] name=CentOS Stream $releasever - ResilientStorage #metalink=https://mirrors.centos.org/metalink?repo=centos-resilientstorage-$stream&arch=$basearch&protocol=https,http baseurl=https://mirror.stream.centos.org/$stream/ResilientStorage/$basearch/os/ gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial gpgcheck=1 repo_gpgcheck=0 metadata_expire=6h countme=1 enabled=1

This was fixed this morning btw! On 23/05/2025 20:32, lmd@gto.net wrote:
Just a note that I was able to successfully work around this in the meantime by specifying the baseurl (pointed towards centos.org) and commenting out the mirror on the hosted-engine VM (SSH into it) during the Ansible 'he_pause_before_engine_setup' pause.
Just in case someone else comes across this and is looking for a technique that might be helpful for a temporary workaround.
Dan
In /etc/yum.repos.d/centos-addon.repo:
[resilientstorage] name=CentOS Stream $releasever - ResilientStorage #metalink=https://mirrors.centos.org/metalink?repo=centos-resilientstorage-$stream&arch=$basearch&protocol=https,http baseurl=https://mirror.stream.centos.org/$stream/ResilientStorage/$basearch/os/ gpgkey=file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial gpgcheck=1 repo_gpgcheck=0 metadata_expire=6h countme=1 enabled=1 _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/F6QCYJ2NER6YWW...
participants (2)
-
Jean-Louis Dupond
-
lmd@gto.net