[JIRA] (OVIRT-2040) CQ failure due to yum cleanup

CQ failure due to yum cleanup ----------------------------- Key: OVIRT-2040 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2040 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Dafna Ron Assignee: Dafna Ron Labels: ost_failures, ost_infra, ost_infra_mirrors Change 91366,3 (ovirt-engine) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/91366/3 the actual failure seems to be in the epel 7 repo: From job: 08:23:55 [basic-suit] + lago ovirt reposetup --reposync-yum-config /home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tests/basic-suite-master/reposync-config.repo --custom-source=conf:/home/jenkins/workspace/ovirt-master_change-queue-tester/ovirt-system-tests/extra_sources 08:23:55 [basic-suit] @ Create prefix internal repo: 08:23:55 [basic-suit] # Syncing remote repos locally (this might take some time): 08:23:55 [basic-suit] * Running reposync: 08:24:27 [basic-suit] - repo: epel-el7: failed, re-running. 08:24:27 [basic-suit] - removing conflicting RPM: /var/lib/lago/epel-el7/Packages/a/ansible-2.5.2-1.el7.noarch.rpm 08:24:27 [basic-suit] - repo: epel-el7: failed. clearing cache and re-running. 08:24:32 [basic-suit] - reposync command failed for repoid: epel-el7 08:24:32 [basic-suit] stdout: 08:24:32 [basic-suit] ovirt-master-tested-el7 | 3.0 kB 00:00 08:24:32 [basic-suit] centos-base-el7 | 4.2 kB 00:00 08:24:32 [basic-suit] centos-extras-el7 | 3.4 kB 00:00 08:24:32 [basic-suit] centos-opstools-testing-el7 | 3.4 kB 00:00 08:24:32 [basic-suit] centos-ovirt-4.2-el7 | 3.4 kB 00:00 08:24:32 [basic-suit] centos-qemu-ev-release-el7 | 3.4 kB 00:00 08:24:32 [basic-suit] centos-sclo-rh-release-el7 | 3.0 kB 00:00 08:24:32 [basic-suit] centos-updates-el7 | 3.4 kB 00:00 08:24:32 [basic-suit] epel-el7 | 4.1 kB 00:00 08:24:32 [basic-suit] glusterfs-3.12-el7 | 3.4 kB 00:00 08:24:32 [basic-suit] ovirt-master-snapshot-static-el7 | 3.0 kB 00:00 08:24:32 [basic-suit] centos-ovirt-common-el7 | 3.4 kB 00:00 08:24:32 [basic-suit] (1/8): centos-ovirt-4.2-el7/primary_db | 195 kB 00:00 08:24:32 [basic-suit] (2/8): centos-qemu-ev-release-el7/primary_db | 38 kB 00:00 08:24:32 [basic-suit] (3/8): centos-opstools-testing-el7/primary_db | 304 kB 00:00 08:24:32 [basic-suit] (4/8): glusterfs-3.12-el7/primary_db | 95 kB 00:00 08:24:32 [basic-suit] (5/8): centos-ovirt-common-el7/primary_db | 116 kB 00:00 08:24:32 [basic-suit] (6/8): ovirt-master-snapshot-static-el7/primary_db | 5.0 kB 00:00 08:24:32 [basic-suit] (7/8): ovirt-master-tested-el7/primary_db | 1.4 MB 00:00 08:24:32 [basic-suit] (8/8): centos-sclo-rh-rele 42% [======- ] 0.0 B/s | 2.3 MB --:-- ETA (8/8): centos-sclo-rh-rele 52% [======== ] 569 kB/s | 2.8 MB 00:04 ETA (8/8): centos-sclo-rh-rele 72% [===========- ] 745 kB/s | 3.9 MB 00:02 ETA (8/8): centos-sclo-rh-release-el7/primary_db | 3.3 MB 00:01 08:24:32 [basic-suit] ansible-2.5.2-1.el7.noarch.rpm FAILED 08:24:32 [basic-suit] ansible-2.5.2-1.el7.noarch 0% [ ] 0.0 B/s | 0 B --:-- ETA ansible-2.5.2-1.el7.noarch: [Errno 256] No more mirrors to try. 08:24:32 [basic-suit] 08:24:32 [basic-suit] stderr: 08:24:32 [basic-suit] Not using downloaded centos-extras-el7/repomd.xml because it is older than what we have: 08:24:32 [basic-suit] Current : Sun May 20 14:00:41 2018 08:24:32 [basic-suit] Downloaded: Sat May 19 10:32:34 2018 08:24:32 [basic-suit] Not using downloaded centos-updates-el7/repomd.xml because it is older than what we have: 08:24:32 [basic-suit] Current : Sun May 20 14:00:41 2018 08:24:32 [basic-suit] Downloaded: Sun May 20 00:41:21 2018 08:24:32 [basic-suit] Not using downloaded epel-el7/repomd.xml because it is older than what we have: 08:24:32 [basic-suit] Current : Sat May 19 23:30:39 2018 08:24:32 [basic-suit] Downloaded: Sat May 19 12:42:45 2018 08:24:32 [basic-suit] 08:24:32 [basic-suit] * Running reposync: ERROR (in 0:00:38) 08:24:32 [basic-suit] # Syncing remote repos locally (this might take some time): ERROR (in 0:00:38) 08:24:32 [basic-suit] @ Create prefix internal repo: ERROR (in 0:00:38) 08:24:32 [basic-suit] Error occured, aborting 08:24:32 [basic-suit] Traceback (most recent call last): 08:24:32 [basic-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 362, in do_run 08:24:32 [basic-suit] self.cli_plugins[args.ovirtverb].do_run(args) 08:24:32 [basic-suit] File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 184, in do_run 08:24:32 [basic-suit] self._do_run(**vars(args)) 08:24:32 [basic-suit] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 505, in wrapper 08:24:32 [basic-suit] return func(*args, **kwargs) 08:24:32 [basic-suit] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 516, in wrapper 08:24:32 [basic-suit] return func(*args, prefix=prefix, **kwargs) 08:24:32 [basic-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/cmd.py", line 158, in do_ovirt_reposetup 08:24:32 [basic-suit] repoman_config=repoman_config, 08:24:32 [basic-suit] File "/usr/lib/python2.7/site-packages/lago/log_utils.py", line 636, in wrapper 08:24:32 [basic-suit] return func(*args, **kwargs) 08:24:32 [basic-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/prefix.py", line 141, in prepare_repo 08:24:32 [basic-suit] repos, 08:24:32 [basic-suit] File "/usr/lib/python2.7/site-packages/ovirtlago/reposetup.py", line 230, in sync_rpm_repository 08:24:32 [basic-suit] ).format(repo) 08:24:32 [basic-suit] RuntimeError: Failed to run reposync 3 times for repoid: epel-el7, aborting. 08:24:33 [basic-suit] + on_exit 08:24:33 [basic-suit] + logger.info 'Dumping lago env status' 08:24:33 [basic-suit] + logger.log INFO 'Dumping lago env status' 08:24:33 [basic-suit] + set +x Local query or repo: [dron@dron ovirt-system-tests]$ repoquery --repofrompath=testrepo,http://download.fedoraproject.org/pub/epel/7/x86_64 --repoid=testrepo --query --all ansible-2.5.2-1.el7.noarch Repository google-chrome is listed more than once in the configuration Repository google-talkplugin is listed more than once in the configuration Can't download or revert repomd.xml for testrepo