[JIRA] (OVIRT-2814) reposync fails syncing repos on completely
unrelated paths (concurrency issue?)
by Anton Marchukov (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2814?page=com.atlassian.jir... ]
Anton Marchukov updated OVIRT-2814:
-----------------------------------
Resolution: Fixed
Status: Done (was: To Do)
Working now, seems like a temporary issue.
> reposync fails syncing repos on completely unrelated paths (concurrency issue?)
> -------------------------------------------------------------------------------
>
> Key: OVIRT-2814
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2814
> Project: oVirt - virtualization made easy
> Issue Type: By-EMAIL
> Reporter: Sandro Bonazzola
> Assignee: infra
>
> About job
> https://jenkins.ovirt.org/job/system-sync_mirrors-centos-kvm-common-el7-x...
> As you can see below
> 05:35:07 ++ reposync --config=jenkins/data/mirrors-reposync.conf
> --repoid=centos-kvm-common-el7 --arch=x86_64
> --cachedir=/home/jenkins/mirrors_cache
> --download_path=/var/www/html/repos/yum/centos-kvm-common-el7/base
> --norepopath --newest-only --urls --quiet
> the sync is related to "/var/www/html/repos/yum/centos-kvm-common-el7/base"
> using as cache directory "/home/jenkins/mirrors_cache"
> but in "/home/jenkins/mirrors_cache" there's
> "/home/jenkins/mirrors_cache/fedora-base-fc29":
> 05:35:16 Traceback (most recent call last):
> 05:35:16 File "/usr/bin/reposync", line 373, in <module>
> 05:35:16 main()
> 05:35:16 File "/usr/bin/reposync", line 185, in main
> 05:35:16 my.doRepoSetup()
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/__init__.py", line
> 681, in doRepoSetup
> 05:35:16 return self._getRepos(thisrepo, True)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/__init__.py", line
> 721, in _getRepos
> 05:35:16 self._repos.doSetup(thisrepo)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157,
> in doSetup
> 05:35:16 self.retrieveAllMD()
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88,
> in retrieveAllMD
> 05:35:16 dl = repo._async and repo._commonLoadRepoXML(repo)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 1468, in _commonLoadRepoXML
> 05:35:16 local = self.cachedir + '/repomd.xml'
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 777, in <lambda>
> 05:35:16 cachedir = property(lambda self: self._dirGetAttr('cachedir'))
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 760, in _dirGetAttr
> 05:35:16 self.dirSetup()
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 738, in dirSetup
> 05:35:16 self._dirSetupMkdir_p(dir)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 715, in _dirSetupMkdir_p
> 05:35:16 raise Errors.RepoError, msg
> 05:35:16 yum.Errors.RepoError: Error making cache directory:
> /home/jenkins/mirrors_cache/fedora-base-fc29 error was: [Errno 17] File
> exists: '/home/jenkins/mirrors_cache/fedora-base-fc29'
> this looks like a concurrency issue, a lock should be used in order to
> prevent two instances to use the same cache directory at the same time or
> use separate cache directories for different repos.
> --
> Sandro Bonazzola
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100114)
5 years, 1 month
[JIRA] (OVIRT-2818) Manual OST's basic suite runs are broken on
libvirt ipv6 issue
by Anton Marchukov (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2818?page=com.atlassian.jir... ]
Anton Marchukov reassigned OVIRT-2818:
--------------------------------------
Assignee: Evgheni Dereveanchin (was: infra)
> Manual OST's basic suite runs are broken on libvirt ipv6 issue
> --------------------------------------------------------------
>
> Key: OVIRT-2818
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2818
> Project: oVirt - virtualization made easy
> Issue Type: By-EMAIL
> Reporter: Marcin Sobczyk
> Assignee: Evgheni Dereveanchin
>
> Hi,
> trying to run OST's basic suite fails with an error:
> *10:51:19* @ Start Prefix: *10:51:19* # Start nets: *10:51:19* *
> Create network lago-basic-suite-master-net-storage: *10:51:34* *
> Create network lago-basic-suite-master-net-storage: ERROR (in
> 0:00:15)*10:51:34* # Start nets: ERROR (in 0:00:15)*10:51:34* @
> Start Prefix: ERROR (in 0:00:15)*10:51:34* Error occured,
> aborting*10:51:34* Traceback (most recent call last):*10:51:34* File
> "/usr/lib/python2.7/site-packages/lago/cmd.py", line 969, in
> main*10:51:34* cli_plugins[args.verb].do_run(args)*10:51:34*
> File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 184,
> in do_run*10:51:34* self._do_run(**vars(args))*10:51:34* File
> "/usr/lib/python2.7/site-packages/lago/utils.py", line 573, in
> wrapper*10:51:34* return func(*args, **kwargs)*10:51:34* File
> "/usr/lib/python2.7/site-packages/lago/utils.py", line 584, in
> wrapper*10:51:34* return func(*args, prefix=prefix,
> **kwargs)*10:51:34* File
> "/usr/lib/python2.7/site-packages/lago/cmd.py", line 271, in
> do_start*10:51:34* prefix.start(vm_names=vm_names)*10:51:34*
> File "/usr/lib/python2.7/site-packages/lago/sdk_utils.py", line 50, in
> wrapped*10:51:34* return func(*args, **kwargs)*10:51:34* File
> "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1323, in
> start*10:51:34* self.virt_env.start(vm_names=vm_names)*10:51:34*
> File "/usr/lib/python2.7/site-packages/lago/virt.py", line 341, in
> start*10:51:34* net.start()*10:51:34* File
> "/usr/lib/python2.7/site-packages/lago/providers/libvirt/network.py",
> line 115, in start*10:51:34* net =
> self.libvirt_con.networkCreateXML(self._libvirt_xml())*10:51:34*
> File "/usr/lib64/python2.7/site-packages/libvirt.py", line 4216, in
> networkCreateXML*10:51:34* if ret is None:raise
> libvirtError('virNetworkCreateXML() failed', conn=self)*10:51:34*
> libvirtError: COMMAND_FAILED: INVALID_IPV: 'ipv6' is not a valid
> backend or is unavailable
> Example run:
> https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-te...
> Regards, Marcin
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100113)
5 years, 1 month
[JIRA] (OVIRT-2818) Manual OST's basic suite runs are broken on
libvirt ipv6 issue
by Marcin Sobczyk (oVirt JIRA)
Marcin Sobczyk created OVIRT-2818:
-------------------------------------
Summary: Manual OST's basic suite runs are broken on libvirt ipv6 issue
Key: OVIRT-2818
URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2818
Project: oVirt - virtualization made easy
Issue Type: By-EMAIL
Reporter: Marcin Sobczyk
Assignee: infra
Hi,
trying to run OST's basic suite fails with an error:
*10:51:19* @ Start Prefix: *10:51:19* # Start nets: *10:51:19* *
Create network lago-basic-suite-master-net-storage: *10:51:34* *
Create network lago-basic-suite-master-net-storage: ERROR (in
0:00:15)*10:51:34* # Start nets: ERROR (in 0:00:15)*10:51:34* @
Start Prefix: ERROR (in 0:00:15)*10:51:34* Error occured,
aborting*10:51:34* Traceback (most recent call last):*10:51:34* File
"/usr/lib/python2.7/site-packages/lago/cmd.py", line 969, in
main*10:51:34* cli_plugins[args.verb].do_run(args)*10:51:34*
File "/usr/lib/python2.7/site-packages/lago/plugins/cli.py", line 184,
in do_run*10:51:34* self._do_run(**vars(args))*10:51:34* File
"/usr/lib/python2.7/site-packages/lago/utils.py", line 573, in
wrapper*10:51:34* return func(*args, **kwargs)*10:51:34* File
"/usr/lib/python2.7/site-packages/lago/utils.py", line 584, in
wrapper*10:51:34* return func(*args, prefix=prefix,
**kwargs)*10:51:34* File
"/usr/lib/python2.7/site-packages/lago/cmd.py", line 271, in
do_start*10:51:34* prefix.start(vm_names=vm_names)*10:51:34*
File "/usr/lib/python2.7/site-packages/lago/sdk_utils.py", line 50, in
wrapped*10:51:34* return func(*args, **kwargs)*10:51:34* File
"/usr/lib/python2.7/site-packages/lago/prefix.py", line 1323, in
start*10:51:34* self.virt_env.start(vm_names=vm_names)*10:51:34*
File "/usr/lib/python2.7/site-packages/lago/virt.py", line 341, in
start*10:51:34* net.start()*10:51:34* File
"/usr/lib/python2.7/site-packages/lago/providers/libvirt/network.py",
line 115, in start*10:51:34* net =
self.libvirt_con.networkCreateXML(self._libvirt_xml())*10:51:34*
File "/usr/lib64/python2.7/site-packages/libvirt.py", line 4216, in
networkCreateXML*10:51:34* if ret is None:raise
libvirtError('virNetworkCreateXML() failed', conn=self)*10:51:34*
libvirtError: COMMAND_FAILED: INVALID_IPV: 'ipv6' is not a valid
backend or is unavailable
Example run:
https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-te...
Regards, Marcin
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100113)
5 years, 1 month
[JIRA] (OVIRT-2814) reposync fails syncing repos on completely
unrelated paths (concurrency issue?)
by Barak Korren (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2814?page=com.atlassian.jir... ]
Barak Korren commented on OVIRT-2814:
-------------------------------------
ticket is from 5 days ago, last run seems to have passed: https://jenkins.ovirt.org/job/system-sync_mirrors-centos-kvm-common-el7-x...
> reposync fails syncing repos on completely unrelated paths (concurrency issue?)
> -------------------------------------------------------------------------------
>
> Key: OVIRT-2814
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2814
> Project: oVirt - virtualization made easy
> Issue Type: By-EMAIL
> Reporter: Sandro Bonazzola
> Assignee: infra
>
> About job
> https://jenkins.ovirt.org/job/system-sync_mirrors-centos-kvm-common-el7-x...
> As you can see below
> 05:35:07 ++ reposync --config=jenkins/data/mirrors-reposync.conf
> --repoid=centos-kvm-common-el7 --arch=x86_64
> --cachedir=/home/jenkins/mirrors_cache
> --download_path=/var/www/html/repos/yum/centos-kvm-common-el7/base
> --norepopath --newest-only --urls --quiet
> the sync is related to "/var/www/html/repos/yum/centos-kvm-common-el7/base"
> using as cache directory "/home/jenkins/mirrors_cache"
> but in "/home/jenkins/mirrors_cache" there's
> "/home/jenkins/mirrors_cache/fedora-base-fc29":
> 05:35:16 Traceback (most recent call last):
> 05:35:16 File "/usr/bin/reposync", line 373, in <module>
> 05:35:16 main()
> 05:35:16 File "/usr/bin/reposync", line 185, in main
> 05:35:16 my.doRepoSetup()
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/__init__.py", line
> 681, in doRepoSetup
> 05:35:16 return self._getRepos(thisrepo, True)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/__init__.py", line
> 721, in _getRepos
> 05:35:16 self._repos.doSetup(thisrepo)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157,
> in doSetup
> 05:35:16 self.retrieveAllMD()
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88,
> in retrieveAllMD
> 05:35:16 dl = repo._async and repo._commonLoadRepoXML(repo)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 1468, in _commonLoadRepoXML
> 05:35:16 local = self.cachedir + '/repomd.xml'
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 777, in <lambda>
> 05:35:16 cachedir = property(lambda self: self._dirGetAttr('cachedir'))
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 760, in _dirGetAttr
> 05:35:16 self.dirSetup()
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 738, in dirSetup
> 05:35:16 self._dirSetupMkdir_p(dir)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 715, in _dirSetupMkdir_p
> 05:35:16 raise Errors.RepoError, msg
> 05:35:16 yum.Errors.RepoError: Error making cache directory:
> /home/jenkins/mirrors_cache/fedora-base-fc29 error was: [Errno 17] File
> exists: '/home/jenkins/mirrors_cache/fedora-base-fc29'
> this looks like a concurrency issue, a lock should be used in order to
> prevent two instances to use the same cache directory at the same time or
> use separate cache directories for different repos.
> --
> Sandro Bonazzola
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100113)
5 years, 1 month
[JIRA] (OVIRT-2814) reposync fails syncing repos on completely
unrelated paths (concurrency issue?)
by Eyal Edri (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2814?page=com.atlassian.jir... ]
Eyal Edri commented on OVIRT-2814:
----------------------------------
Is there anything we can/should do to fix this or next runs should work?
> reposync fails syncing repos on completely unrelated paths (concurrency issue?)
> -------------------------------------------------------------------------------
>
> Key: OVIRT-2814
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2814
> Project: oVirt - virtualization made easy
> Issue Type: By-EMAIL
> Reporter: Sandro Bonazzola
> Assignee: infra
>
> About job
> https://jenkins.ovirt.org/job/system-sync_mirrors-centos-kvm-common-el7-x...
> As you can see below
> 05:35:07 ++ reposync --config=jenkins/data/mirrors-reposync.conf
> --repoid=centos-kvm-common-el7 --arch=x86_64
> --cachedir=/home/jenkins/mirrors_cache
> --download_path=/var/www/html/repos/yum/centos-kvm-common-el7/base
> --norepopath --newest-only --urls --quiet
> the sync is related to "/var/www/html/repos/yum/centos-kvm-common-el7/base"
> using as cache directory "/home/jenkins/mirrors_cache"
> but in "/home/jenkins/mirrors_cache" there's
> "/home/jenkins/mirrors_cache/fedora-base-fc29":
> 05:35:16 Traceback (most recent call last):
> 05:35:16 File "/usr/bin/reposync", line 373, in <module>
> 05:35:16 main()
> 05:35:16 File "/usr/bin/reposync", line 185, in main
> 05:35:16 my.doRepoSetup()
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/__init__.py", line
> 681, in doRepoSetup
> 05:35:16 return self._getRepos(thisrepo, True)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/__init__.py", line
> 721, in _getRepos
> 05:35:16 self._repos.doSetup(thisrepo)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157,
> in doSetup
> 05:35:16 self.retrieveAllMD()
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88,
> in retrieveAllMD
> 05:35:16 dl = repo._async and repo._commonLoadRepoXML(repo)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 1468, in _commonLoadRepoXML
> 05:35:16 local = self.cachedir + '/repomd.xml'
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 777, in <lambda>
> 05:35:16 cachedir = property(lambda self: self._dirGetAttr('cachedir'))
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 760, in _dirGetAttr
> 05:35:16 self.dirSetup()
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 738, in dirSetup
> 05:35:16 self._dirSetupMkdir_p(dir)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 715, in _dirSetupMkdir_p
> 05:35:16 raise Errors.RepoError, msg
> 05:35:16 yum.Errors.RepoError: Error making cache directory:
> /home/jenkins/mirrors_cache/fedora-base-fc29 error was: [Errno 17] File
> exists: '/home/jenkins/mirrors_cache/fedora-base-fc29'
> this looks like a concurrency issue, a lock should be used in order to
> prevent two instances to use the same cache directory at the same time or
> use separate cache directories for different repos.
> --
> Sandro Bonazzola
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100113)
5 years, 1 month
[JIRA] (OVIRT-2814) reposync fails syncing repos on completely
unrelated paths (concurrency issue?)
by Barak Korren (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2814?page=com.atlassian.jir... ]
Barak Korren commented on OVIRT-2814:
-------------------------------------
{code}
this looks like a concurrency issue, a lock should be used in order to
prevent two instances to use the same cache directory at the same time or
use separate cache directories for different repos.
{code}
As you can see in the path name - it is unique for the repo, and there is only one update job per repo that does not run concurrently. So the last sentence you wrote above holds.
This might be a cleanup issues, where some failure scenario leaves some lock files behind.
> reposync fails syncing repos on completely unrelated paths (concurrency issue?)
> -------------------------------------------------------------------------------
>
> Key: OVIRT-2814
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2814
> Project: oVirt - virtualization made easy
> Issue Type: By-EMAIL
> Reporter: Sandro Bonazzola
> Assignee: infra
>
> About job
> https://jenkins.ovirt.org/job/system-sync_mirrors-centos-kvm-common-el7-x...
> As you can see below
> 05:35:07 ++ reposync --config=jenkins/data/mirrors-reposync.conf
> --repoid=centos-kvm-common-el7 --arch=x86_64
> --cachedir=/home/jenkins/mirrors_cache
> --download_path=/var/www/html/repos/yum/centos-kvm-common-el7/base
> --norepopath --newest-only --urls --quiet
> the sync is related to "/var/www/html/repos/yum/centos-kvm-common-el7/base"
> using as cache directory "/home/jenkins/mirrors_cache"
> but in "/home/jenkins/mirrors_cache" there's
> "/home/jenkins/mirrors_cache/fedora-base-fc29":
> 05:35:16 Traceback (most recent call last):
> 05:35:16 File "/usr/bin/reposync", line 373, in <module>
> 05:35:16 main()
> 05:35:16 File "/usr/bin/reposync", line 185, in main
> 05:35:16 my.doRepoSetup()
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/__init__.py", line
> 681, in doRepoSetup
> 05:35:16 return self._getRepos(thisrepo, True)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/__init__.py", line
> 721, in _getRepos
> 05:35:16 self._repos.doSetup(thisrepo)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157,
> in doSetup
> 05:35:16 self.retrieveAllMD()
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88,
> in retrieveAllMD
> 05:35:16 dl = repo._async and repo._commonLoadRepoXML(repo)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 1468, in _commonLoadRepoXML
> 05:35:16 local = self.cachedir + '/repomd.xml'
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 777, in <lambda>
> 05:35:16 cachedir = property(lambda self: self._dirGetAttr('cachedir'))
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 760, in _dirGetAttr
> 05:35:16 self.dirSetup()
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 738, in dirSetup
> 05:35:16 self._dirSetupMkdir_p(dir)
> 05:35:16 File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line
> 715, in _dirSetupMkdir_p
> 05:35:16 raise Errors.RepoError, msg
> 05:35:16 yum.Errors.RepoError: Error making cache directory:
> /home/jenkins/mirrors_cache/fedora-base-fc29 error was: [Errno 17] File
> exists: '/home/jenkins/mirrors_cache/fedora-base-fc29'
> this looks like a concurrency issue, a lock should be used in order to
> prevent two instances to use the same cache directory at the same time or
> use separate cache directories for different repos.
> --
> Sandro Bonazzola
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100113)
5 years, 1 month
Build failed in Jenkins:
system-sync_mirrors-fedora-base-fc29-x86_64 #1042
by jenkins＠jenkins.phx.ovirt.org
See <http://jenkins.ovirt.org/job/system-sync_mirrors-fedora-base-fc29-x86_64/...>
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-fedora-base-fc29-x86_64/ws/>
No credentials specified
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
Pruning obsolete local branches
Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git
> git --version # timeout=10
> git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1f145374e47ff750588b8786a324f5465b7e5b89 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1f145374e47ff750588b8786a324f5465b7e5b89
Commit message: "update el7 repo snapshots to latest versions"
> git rev-list --no-walk 1f145374e47ff750588b8786a324f5465b7e5b89 # timeout=10
[system-sync_mirrors-fedora-base-fc29-x86_64] $ /bin/bash -xe /tmp/jenkins4353531081623420207.sh
+ jenkins/scripts/mirror_mgr.sh resync_yum_mirror fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf
+ MIRRORS_MP_BASE=/var/www/html/repos
+ MIRRORS_HTTP_BASE=http://mirrors.phx.ovirt.org/repos
+ MIRRORS_CACHE=/home/jenkins/mirrors_cache
+ MAX_LOCK_ATTEMPTS=120
+ LOCK_WAIT_INTERVAL=5
+ LOCK_BASE=/home/jenkins
+ OLD_MD_TO_KEEP=100
+ HTTP_SELINUX_TYPE=httpd_sys_content_t
+ HTTP_FILE_MODE=644
+ main resync_yum_mirror fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf
+ local command=resync_yum_mirror
+ command_args=("${@:2}")
+ local command_args
+ cmd_resync_yum_mirror fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf
+ local repo_name=fedora-base-fc29
+ local repo_archs=x86_64
+ local reposync_conf=jenkins/data/mirrors-reposync.conf
+ local sync_needed
+ mkdir -p /home/jenkins/mirrors_cache
+ verify_repo_fs fedora-base-fc29 yum
+ local repo_name=fedora-base-fc29
+ local repo_type=yum
+ sudo install -o jenkins -d /var/www/html/repos/yum /var/www/html/repos/yum/fedora-base-fc29 /var/www/html/repos/yum/fedora-base-fc29/base
+ check_yum_sync_needed fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf sync_needed
+ local repo_name=fedora-base-fc29
+ local repo_archs=x86_64
+ local reposync_conf=jenkins/data/mirrors-reposync.conf
+ local p_sync_needed=sync_needed
+ local reposync_out
+ echo 'Checking if mirror needs a resync'
Checking if mirror needs a resync
+ rm -rf /home/jenkins/mirrors_cache/fedora-base-fc29
++ IFS=,
++ echo x86_64
+ for arch in '$(IFS=,; echo $repo_archs)'
++ run_reposync fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf --urls --quiet
++ local repo_name=fedora-base-fc29
++ local repo_arch=x86_64
++ local reposync_conf=jenkins/data/mirrors-reposync.conf
++ extra_args=("${@:4}")
++ local extra_args
++ reposync --config=jenkins/data/mirrors-reposync.conf --repoid=fedora-base-fc29 --arch=x86_64 --cachedir=/home/jenkins/mirrors_cache --download_path=/var/www/html/repos/yum/fedora-base-fc29/base --norepopath --newest-only --urls --quiet
Traceback (most recent call last):
File "/usr/bin/reposync", line 373, in <module>
main()
File "/usr/bin/reposync", line 185, in main
my.doRepoSetup()
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup
return self._getRepos(thisrepo, True)
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos
self._repos.doSetup(thisrepo)
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup
self.retrieveAllMD()
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD
dl = repo._async and repo._commonLoadRepoXML(repo)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1482, in _commonLoadRepoXML
result = self._getFileRepoXML(local, text)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1259, in _getFileRepoXML
size=102400) # setting max size as 100K
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1042, in _getFile
raise e
yum.Errors.NoMoreMirrorsRepoError: failure: repodata/repomd.xml from mock-copr-fc28: [Errno 256] No more mirrors to try.
https://copr-be.cloud.fedoraproject.org/results/@mock/mock/fedora-28-x86_...: [Errno 14] HTTPS Error 404 - Not Found
+ reposync_out=
Build step 'Execute shell' marked build as failure
5 years, 1 month
Build failed in Jenkins:
system-sync_mirrors-fedora-base-fc30-x86_64 #489
by jenkins＠jenkins.phx.ovirt.org
See <http://jenkins.ovirt.org/job/system-sync_mirrors-fedora-base-fc30-x86_64/...>
------------------------------------------
Started by timer
Running as SYSTEM
[EnvInject] - Loading node environment variables.
Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-fedora-base-fc30-x86_64/ws/>
No credentials specified
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
Pruning obsolete local branches
Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git
> git --version # timeout=10
> git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 1f145374e47ff750588b8786a324f5465b7e5b89 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 1f145374e47ff750588b8786a324f5465b7e5b89
Commit message: "update el7 repo snapshots to latest versions"
> git rev-list --no-walk 1f145374e47ff750588b8786a324f5465b7e5b89 # timeout=10
[system-sync_mirrors-fedora-base-fc30-x86_64] $ /bin/bash -xe /tmp/jenkins1113649927665442449.sh
+ jenkins/scripts/mirror_mgr.sh resync_yum_mirror fedora-base-fc30 x86_64 jenkins/data/mirrors-reposync.conf
+ MIRRORS_MP_BASE=/var/www/html/repos
+ MIRRORS_HTTP_BASE=http://mirrors.phx.ovirt.org/repos
+ MIRRORS_CACHE=/home/jenkins/mirrors_cache
+ MAX_LOCK_ATTEMPTS=120
+ LOCK_WAIT_INTERVAL=5
+ LOCK_BASE=/home/jenkins
+ OLD_MD_TO_KEEP=100
+ HTTP_SELINUX_TYPE=httpd_sys_content_t
+ HTTP_FILE_MODE=644
+ main resync_yum_mirror fedora-base-fc30 x86_64 jenkins/data/mirrors-reposync.conf
+ local command=resync_yum_mirror
+ command_args=("${@:2}")
+ local command_args
+ cmd_resync_yum_mirror fedora-base-fc30 x86_64 jenkins/data/mirrors-reposync.conf
+ local repo_name=fedora-base-fc30
+ local repo_archs=x86_64
+ local reposync_conf=jenkins/data/mirrors-reposync.conf
+ local sync_needed
+ mkdir -p /home/jenkins/mirrors_cache
+ verify_repo_fs fedora-base-fc30 yum
+ local repo_name=fedora-base-fc30
+ local repo_type=yum
+ sudo install -o jenkins -d /var/www/html/repos/yum /var/www/html/repos/yum/fedora-base-fc30 /var/www/html/repos/yum/fedora-base-fc30/base
+ check_yum_sync_needed fedora-base-fc30 x86_64 jenkins/data/mirrors-reposync.conf sync_needed
+ local repo_name=fedora-base-fc30
+ local repo_archs=x86_64
+ local reposync_conf=jenkins/data/mirrors-reposync.conf
+ local p_sync_needed=sync_needed
+ local reposync_out
+ echo 'Checking if mirror needs a resync'
Checking if mirror needs a resync
+ rm -rf /home/jenkins/mirrors_cache/fedora-base-fc30
++ IFS=,
++ echo x86_64
+ for arch in '$(IFS=,; echo $repo_archs)'
++ run_reposync fedora-base-fc30 x86_64 jenkins/data/mirrors-reposync.conf --urls --quiet
++ local repo_name=fedora-base-fc30
++ local repo_arch=x86_64
++ local reposync_conf=jenkins/data/mirrors-reposync.conf
++ extra_args=("${@:4}")
++ local extra_args
++ reposync --config=jenkins/data/mirrors-reposync.conf --repoid=fedora-base-fc30 --arch=x86_64 --cachedir=/home/jenkins/mirrors_cache --download_path=/var/www/html/repos/yum/fedora-base-fc30/base --norepopath --newest-only --urls --quiet
Traceback (most recent call last):
File "/usr/bin/reposync", line 373, in <module>
main()
File "/usr/bin/reposync", line 185, in main
my.doRepoSetup()
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup
return self._getRepos(thisrepo, True)
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos
self._repos.doSetup(thisrepo)
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup
self.retrieveAllMD()
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD
dl = repo._async and repo._commonLoadRepoXML(repo)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1482, in _commonLoadRepoXML
result = self._getFileRepoXML(local, text)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1259, in _getFileRepoXML
size=102400) # setting max size as 100K
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1042, in _getFile
raise e
yum.Errors.NoMoreMirrorsRepoError: failure: repodata/repomd.xml from mock-copr-fc28: [Errno 256] No more mirrors to try.
https://copr-be.cloud.fedoraproject.org/results/@mock/mock/fedora-28-x86_...: [Errno 14] HTTPS Error 404 - Not Found
+ reposync_out=
Build step 'Execute shell' marked build as failure
5 years, 1 month