[JIRA] (OVIRT-2462) mirrors.phx.ovirt.org running out of memory
by sbonazzo (oVirt JIRA)
sbonazzo created OVIRT-2462:
-------------------------------
Summary: mirrors.phx.ovirt.org running out of memory
Key: OVIRT-2462
URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2462
Project: oVirt - virtualization made easy
Issue Type: By-EMAIL
Reporter: sbonazzo
Assignee: infra
Tried to investigate recent failures in mirror sync and found:
$ dmesg |grep Out
[18729195.412025] Out of memory: Kill process 920 (genpkgmetadata.) score
148 or sacrifice child
[18729196.088872] Out of memory: Kill process 920 (genpkgmetadata.) score
150 or sacrifice child
[18729197.392773] Out of memory: Kill process 920 (genpkgmetadata.) score
157 or sacrifice child
[18729197.701566] Out of memory: Kill process 920 (genpkgmetadata.) score
159 or sacrifice child
[18729222.032203] Out of memory: Kill process 920 (genpkgmetadata.) score
161 or sacrifice child
[18729308.634563] Out of memory: Kill process 920 (genpkgmetadata.) score
168 or sacrifice child
[18729309.348963] Out of memory: Kill process 920 (genpkgmetadata.) score
170 or sacrifice child
[18729600.748587] Out of memory: Kill process 920 (genpkgmetadata.) score
177 or sacrifice child
[18729645.237522] Out of memory: Kill process 920 (genpkgmetadata.) score
177 or sacrifice child
[19074457.347150] Out of memory: Kill process 19564 (genpkgmetadata.) score
282 or sacrifice child
[19074742.414741] Out of memory: Kill process 19564 (genpkgmetadata.) score
283 or sacrifice child
[19333411.219609] Out of memory: Kill process 1625 (genpkgmetadata.) score
293 or sacrifice child
[19392257.064747] Out of memory: Kill process 27017 (genpkgmetadata.) score
193 or sacrifice child
[19392258.005043] Out of memory: Kill process 27017 (genpkgmetadata.) score
196 or sacrifice child
Probably unrelated to the failures I was looking into, but still, this VM
needs more memory.
--
SANDRO BONAZZOLA
MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV
Red Hat EMEA <https://www.redhat.com/>
sbonazzo(a)redhat.com
<https://red.ht/sig>
<https://www.redhat.com/en/events/red-hat-open-source-day-italia?sc_cid=70...>
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100091)
6 years, 2 months
Build failed in Jenkins:
system-sync_mirrors-centos-updates-el7-x86_64 #1898
by jenkins＠jenkins.phx.ovirt.org
See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_6...>
Changes:
[Evgheni Dereveanchin] Add infra-puppet project
[Daniel Belenky] Added production gerrit to push-url-map
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_6...>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
Pruning obsolete local branches
Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git
> git --version # timeout=10
> git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision 413af376fd99c29234343410b36d8e533a8cc047 (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f 413af376fd99c29234343410b36d8e533a8cc047
Commit message: "Added production gerrit to push-url-map"
> git rev-list --no-walk 20e5adfc6d24588a2ba2c9be951dfa42a12523a7 # timeout=10
[system-sync_mirrors-centos-updates-el7-x86_64] $ /bin/bash -xe /tmp/jenkins6621508961944720822.sh
+ jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-updates-el7 x86_64 jenkins/data/mirrors-reposync.conf
Checking if mirror needs a resync
Traceback (most recent call last):
File "/usr/bin/reposync", line 343, in <module>
main()
File "/usr/bin/reposync", line 175, in main
my.doRepoSetup()
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup
return self._getRepos(thisrepo, True)
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos
self._repos.doSetup(thisrepo)
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup
self.retrieveAllMD()
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD
dl = repo._async and repo._commonLoadRepoXML(repo)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML
local = self.cachedir + '/repomd.xml'
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda>
cachedir = property(lambda self: self._dirGetAttr('cachedir'))
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr
self.dirSetup()
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup
self._dirSetupMkdir_p(dir)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p
raise Errors.RepoError, msg
yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-updates-el7/packages error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-updates-el7/packages'
Build step 'Execute shell' marked build as failure
6 years, 2 months
Build failed in Jenkins:
system-sync_mirrors-fedora-base-fcraw-x86_64 #806
by jenkins＠jenkins.phx.ovirt.org
See <http://jenkins.ovirt.org/job/system-sync_mirrors-fedora-base-fcraw-x86_64...>
------------------------------------------
[...truncated 38.49 MB...]
python3-cssselect-0.9.2-9.fc29.noarch: [Errno 256] No more mirrors to try.
cherokee-1.2.104-9.fc29.x86_64: [Errno 256] No more mirrors to try.
golang-github-gonum-graph-devel-0.9-12.20180611gitbde6d0f.fc29.noarch: [Errno 256] No more mirrors to try.
perl-Crypt-IDEA-1.10-13.fc29.x86_64: [Errno 256] No more mirrors to try.
springframework-beans-3.2.18-4.fc28.noarch: [Errno 256] No more mirrors to try.
python3-marshmallow-enum-1.4.1-4.fc29.noarch: [Errno 256] No more mirrors to try.
golang-github-matttproud-golang_protobuf_extensions-devel-0-0.19.20180618gitc12348c.fc29.noarch: [Errno 256] No more mirrors to try.
rubygem-pango-no-gi-3.2.9-1.fc29.x86_64: [Errno 256] No more mirrors to try.
mesa-libxatracker-devel-18.1.5-1.fc29.i686: [Errno 256] No more mirrors to try.
jboss-connector-1.7-api-1.0.0-9.fc29.noarch: [Errno 256] No more mirrors to try.
cudd-3.0.0-7.fc29.x86_64: [Errno 256] No more mirrors to try.
simple-ccsm-0.8.14.1-6.fc29.noarch: [Errno 256] No more mirrors to try.
openmeeg-2.4-0.4.rc4.fc29.x86_64: [Errno 256] No more mirrors to try.
7:texlive-options-svn39030-17.fc29.noarch: [Errno 256] No more mirrors to try.
nodejs-async-arrays-1.0.1-2.fc29.noarch: [Errno 256] No more mirrors to try.
google-noto-sans-telugu-ui-fonts-20161022-8.fc29.noarch: [Errno 256] No more mirrors to try.
libXcomp-3.5.99.16-2.fc29.x86_64: [Errno 256] No more mirrors to try.
k3d-devel-0.8.0.6-16.fc29.i686: [Errno 256] No more mirrors to try.
libsmi-0.4.8-23.fc29.i686: [Errno 256] No more mirrors to try.
libbluray-utils-1.0.2-4.fc29.x86_64: [Errno 256] No more mirrors to try.
1:NetworkManager-team-1.12.2-2.fc29.x86_64: [Errno 256] No more mirrors to try.
greenmail-javadoc-1.5.3-4.fc29.noarch: [Errno 256] No more mirrors to try.
3:libcacard-devel-2.6.0-1.fc29.x86_64: [Errno 256] No more mirrors to try.
rubygem-asciidoctor-doc-1.5.6.1-4.fc29.noarch: [Errno 256] No more mirrors to try.
libjson-rpc-cpp-server-1.1.0-5.fc29.x86_64: [Errno 256] No more mirrors to try.
sugar-imageviewer-63-5.fc29.noarch: [Errno 256] No more mirrors to try.
libatf-c++-0.20-12.fc29.x86_64: [Errno 256] No more mirrors to try.
perl-autobox-Junctions-0.002-7.fc29.noarch: [Errno 256] No more mirrors to try.
alsa-plugins-arcamav-1.1.6-4.fc29.x86_64: [Errno 256] No more mirrors to try.
7:texlive-invoice-doc-svn39397-17.fc29.noarch: [Errno 256] No more mirrors to try.
gtk-vnc-devel-0.8.0-1.fc29.i686: [Errno 256] No more mirrors to try.
guichan-0.8.2-18.fc29.i686: [Errno 256] No more mirrors to try.
R-affy-1.58.0-2.fc29.x86_64: [Errno 256] No more mirrors to try.
python3-piexif-1.0.13-4.fc29.noarch: [Errno 256] No more mirrors to try.
python3-oslo-versionedobjects-1.21.0-5.fc29.noarch: [Errno 256] No more mirrors to try.
7:texlive-bbm-doc-svn15878.0-17.fc29.noarch: [Errno 256] No more mirrors to try.
eclipse-nls-ml-4.7.0-4.fc29.noarch: [Errno 256] No more mirrors to try.
xfce4-whiskermenu-plugin-2.2.1-20.fc29.x86_64: [Errno 256] No more mirrors to try.
7:texlive-pst-gr3d-svn15878.1.34-17.fc29.noarch: [Errno 256] No more mirrors to try.
1:perl-Archive-Extract-tgz-Archive-Tar-IO-Zlib-0.80-7.fc29.noarch: [Errno 256] No more mirrors to try.
avr-libc-2.0.0-6.fc29.noarch: [Errno 256] No more mirrors to try.
7:texlive-coseoul-doc-svn23862.1.1-17.fc29.noarch: [Errno 256] No more mirrors to try.
libprelude-doc-4.1.0-6.fc29.noarch: [Errno 256] No more mirrors to try.
cloudcompare-2.9.1-2.fc29.x86_64: [Errno 256] No more mirrors to try.
python3-cloudpickle-0.3.1-4.fc29.noarch: [Errno 256] No more mirrors to try.
localizer-1.23-8.fc29.noarch: [Errno 256] No more mirrors to try.
blacs-openmpi-2.0.2-26.fc29.i686: [Errno 256] No more mirrors to try.
python2-musicbrainzngs-0.5-12.fc29.noarch: [Errno 256] No more mirrors to try.
gpsd-qt-3.17-5.fc29.x86_64: [Errno 256] No more mirrors to try.
qwt-doc-6.1.3-9.fc29.noarch: [Errno 256] No more mirrors to try.
lightsoff-3.28.0-2.fc29.x86_64: [Errno 256] No more mirrors to try.
thai-scalable-kinnari-fonts-0.6.5-2.fc29.noarch: [Errno 256] No more mirrors to try.
webalizer-2.23_08-11.fc29.x86_64: [Errno 256] No more mirrors to try.
7:texlive-spath3-doc-svn39794-17.fc29.noarch: [Errno 256] No more mirrors to try.
ipsilon-2.1.0-3.fc28.noarch: [Errno 256] No more mirrors to try.
perl-MDV-Packdrakeng-1.13-21.fc29.noarch: [Errno 256] No more mirrors to try.
gvrng-4.4-18.fc29.noarch: [Errno 256] No more mirrors to try.
rubygem-gssapi-doc-1.2.0-7.fc29.noarch: [Errno 256] No more mirrors to try.
7:texlive-courseoutline-doc-svn15878.1.0-17.fc29.noarch: [Errno 256] No more mirrors to try.
avahi-glib-devel-0.7-16.fc29.x86_64: [Errno 256] No more mirrors to try.
python-basemap-data-1.0.7-9.fc29.noarch: [Errno 256] No more mirrors to try.
librx-devel-1.5-32.fc29.i686: [Errno 256] No more mirrors to try.
easytag-nautilus-2.4.3-7.fc29.x86_64: [Errno 256] No more mirrors to try.
perl-Class-C3-XS-0.14-8.fc29.x86_64: [Errno 256] No more mirrors to try.
perl-Test-Perl-Critic-Policy-1.132-4.fc29.noarch: [Errno 256] No more mirrors to try.
lucene-7.1.0-3.fc29.noarch: [Errno 256] No more mirrors to try.
artemis-service-extensions-1.4.0-9.fc29.noarch: [Errno 256] No more mirrors to try.
airrac-doc-1.00.1-17.fc29.noarch: [Errno 256] No more mirrors to try.
golang-github-hashicorp-go-syslog-devel-0-0.13.20180612git42a2b57.fc29.noarch: [Errno 256] No more mirrors to try.
SDL_Pango-devel-0.1.2-27.fc29.i686: [Errno 256] No more mirrors to try.
mumble-plugins-1.2.19-10.fc29.x86_64: [Errno 256] No more mirrors to try.
woden-javadoc-1.0-0.18.M10.fc29.noarch: [Errno 256] No more mirrors to try.
golang-github-docker-spdystream-devel-0-0.18.20180609gitb2c3287.fc29.noarch: [Errno 256] No more mirrors to try.
python3-libkml-1.3.0-14.fc29.x86_64: [Errno 256] No more mirrors to try.
duckduckgo-0.008-12.fc29.noarch: [Errno 256] No more mirrors to try.
allegro-4.4.2-21.fc29.i686: [Errno 256] No more mirrors to try.
swami-libs-2.0.0-17.20110806svn386.fc29.i686: [Errno 256] No more mirrors to try.
dwgrep-0.3-6.fc29.x86_64: [Errno 256] No more mirrors to try.
python-oslo-policy-tests-1.14.0-7.fc29.noarch: [Errno 256] No more mirrors to try.
nextcloud-client-2.3.3-2.fc28.x86_64: [Errno 256] No more mirrors to try.
python3-mock-2.0.0-10.fc29.noarch: [Errno 256] No more mirrors to try.
7:texlive-lstbayes-doc-svn39183-17.fc29.noarch: [Errno 256] No more mirrors to try.
wpewebkit-2.21.2-1.fc29.x86_64: [Errno 256] No more mirrors to try.
7:texlive-bagpipe-doc-svn34393.3.02-17.fc29.noarch: [Errno 256] No more mirrors to try.
cockpit-bridge-175-1.fc29.x86_64: [Errno 256] No more mirrors to try.
golang-github-golang-appengine-devel-1.0.0-2.fc29.noarch: [Errno 256] No more mirrors to try.
contextkit-devel-0.5.41-18.fc29.x86_64: [Errno 256] No more mirrors to try.
golang-github-bep-inflect-unit-test-devel-0-0.6.gitb896c45.fc29.i686: [Errno 256] No more mirrors to try.
rubygem-flexmock-2.3.6-3.fc29.noarch: [Errno 256] No more mirrors to try.
sysprof-cli-3.28.1-3.fc29.x86_64: [Errno 256] No more mirrors to try.
mldonkey-3.1.6-4.fc27.x86_64: [Errno 256] No more mirrors to try.
perl-Net-Telnet-Cisco-1.11-4.fc29.noarch: [Errno 256] No more mirrors to try.
jenkins-matrix-auth-plugin-javadoc-1.2-3.fc24.noarch: [Errno 256] No more mirrors to try.
sxc-runtime-0.8-6.fc29.noarch: [Errno 256] No more mirrors to try.
xfce4-hamster-plugin-1.7-20.fc29.x86_64: [Errno 256] No more mirrors to try.
PolicyKit-olpc-1.7-10.fc29.noarch: [Errno 256] No more mirrors to try.
fawkes-plugin-clips-agent-1.0.1-18.fc29.x86_64: [Errno 256] No more mirrors to try.
python2-libdnf-0.17.0-2.fc29.x86_64: [Errno 256] No more mirrors to try.
qoauth-2.0.0-7.fc29.x86_64: [Errno 256] No more mirrors to try.
vdr-devel-2.4.0-2.fc29.x86_64: [Errno 256] No more mirrors to try.
owncloud-mysql-9.1.5-3.fc28.noarch: [Errno 256] No more mirrors to try.
python3-pyngus-2.2.4-2.fc29.noarch: [Errno 256] No more mirrors to try.
dnsenum-1.2.4.2-11.fc29.noarch: [Errno 256] No more mirrors to try.
nodejs-express-session-1.15.5-3.fc29.noarch: [Errno 256] No more mirrors to try.
rubygem-hashdiff-doc-0.3.2-4.fc29.noarch: [Errno 256] No more mirrors to try.
7:texlive-ntheorem-svn27609.1.33-17.fc29.noarch: [Errno 256] No more mirrors to try.
rubygem-cucumber-2.4.0-5.fc29.noarch: [Errno 256] No more mirrors to try.
xfce4-panel-4.13.3-20.fc29.x86_64: [Errno 256] No more mirrors to try.
rply-1.1.2-11.fc29.x86_64: [Errno 256] No more mirrors to try.
ocaml-mccs-1.1-11.8.fc29.x86_64: [Errno 256] No more mirrors to try.
nss_nis-3.0-7.fc29.x86_64: [Errno 256] No more mirrors to try.
hypre-openmpi-devel-2.14.0-4.fc29.i686: [Errno 256] No more mirrors to try.
compat-gdbm-devel-1.14.1-7.fc29.i686: [Errno 256] No more mirrors to try.
hicolor-icon-theme-0.17-3.fc29.noarch: [Errno 256] No more mirrors to try.
z80asm-1.8-14.fc29.x86_64: [Errno 256] No more mirrors to try.
lammps-openmpi-20180316-4.fc29.i686: [Errno 256] No more mirrors to try.
python2-pygatt-3.2.0-5.fc29.noarch: [Errno 256] No more mirrors to try.
apache-commons-parent-43-3.fc29.noarch: [Errno 256] No more mirrors to try.
tweak-3.02-7.fc29.x86_64: [Errno 256] No more mirrors to try.
dontpanic-1.02-2.fc29.x86_64: [Errno 256] No more mirrors to try.
libuninum-devel-2.7-23.fc29.x86_64: [Errno 256] No more mirrors to try.
mingw64-giflib-static-5.1.4-5.fc29.noarch: [Errno 256] No more mirrors to try.
1:libopensync-plugin-file-0.22-17.fc29.x86_64: [Errno 256] No more mirrors to try.
gstreamer-plugins-bad-free-extras-0.10.23-46.fc29.x86_64: [Errno 256] No more mirrors to try.
nodejs-got-6.7.1-10.fc29.noarch: [Errno 256] No more mirrors to try.
slang-devel-2.3.2-4.fc29.i686: [Errno 256] No more mirrors to try.
lensfun-0.3.2-18.fc29.i686: [Errno 256] No more mirrors to try.
7:texlive-fixltxhyph-svn25832.0.4-17.fc29.noarch: [Errno 256] No more mirrors to try.
patchutils-0.3.4-12.fc29.x86_64: [Errno 256] No more mirrors to try.
libpwiz-devel-3.0.10505-2.fc27.i686: [Errno 256] No more mirrors to try.
vim-syntastic-perl-3.9.0-2.fc29.noarch: [Errno 256] No more mirrors to try.
golang-github-goraft-raft-devel-0-0.16.git73f9c44.fc29.noarch: [Errno 256] No more mirrors to try.
sudo-devel-1.8.23-3.fc29.x86_64: [Errno 256] No more mirrors to try.
sage-devel-0.2.0-19.fc29.i686: [Errno 256] No more mirrors to try.
carbonate-1.0.1-4.fc29.noarch: [Errno 256] No more mirrors to try.
perl-PDF-Create-1.43-4.fc29.noarch: [Errno 256] No more mirrors to try.
rabbitvcs-nautilus-0.17.1-7.fc29.noarch: [Errno 256] No more mirrors to try.
python2-ansi-0.1.3-14.fc29.noarch: [Errno 256] No more mirrors to try.
coin-or-Cgl-0.59.9-8.fc29.i686: [Errno 256] No more mirrors to try.
systemtap-stap-exporter-4.0-0.20180810git.fc29.x86_64: [Errno 256] No more mirrors to try.
rubygem-trollop-doc-2.1.2-4.fc29.noarch: [Errno 256] No more mirrors to try.
gawk-abort-1.0.1-3.fc29.x86_64: [Errno 256] No more mirrors to try.
libdb-devel-5.3.28-33.fc29.x86_64: [Errno 256] No more mirrors to try.
python3-rpy-2.9.4-3.fc29.x86_64: [Errno 256] No more mirrors to try.
openwebbeans-jms-1.2.8-4.fc27.noarch: [Errno 256] No more mirrors to try.
mcollective-client-2.8.4-2.fc24.noarch: [Errno 256] No more mirrors to try.
python2-couchbase-2.3.5-4.fc29.x86_64: [Errno 256] No more mirrors to try.
glassfish-annotation-api-javadoc-1.2-14.fc29.noarch: [Errno 256] No more mirrors to try.
7:texlive-platex-svn45413-17.fc29.noarch: [Errno 256] No more mirrors to try.
mingw64-cmocka-static-1.1.0-6.fc29.noarch: [Errno 256] No more mirrors to try.
mingw64-gstreamer-plugins-good-0.10.31-17.fc29.noarch: [Errno 256] No more mirrors to try.
7:texlive-miama-doc-svn39837-17.fc29.noarch: [Errno 256] No more mirrors to try.
python3-uranium-3.3.0-4.fc29.noarch: [Errno 256] No more mirrors to try.
rubygem-fog-voxel-doc-0.1.0-6.fc29.noarch: [Errno 256] No more mirrors to try.
7:texlive-feynmp-auto-svn30223.1.1-17.fc29.noarch: [Errno 256] No more mirrors to try.
alsa-ucm-1.1.6-3.fc29.x86_64: [Errno 256] No more mirrors to try.
7:texlive-subfigure-svn15878.2.1.5-17.fc29.noarch: [Errno 256] No more mirrors to try.
libesmtp-devel-1.0.6-16.fc29.i686: [Errno 256] No more mirrors to try.
jaxb2-basics-annotate-javadoc-1.0.2-6.fc29.noarch: [Errno 256] No more mirrors to try.
flexiport-2.0.0-15.20120701git1b6103d.fc29.i686: [Errno 256] No more mirrors to try.
platform-devel-2.1.0.1-6.fc29.x86_64: [Errno 256] No more mirrors to try.
rubygem-test-unit-doc-3.2.8-201.fc29.noarch: [Errno 256] No more mirrors to try.
python3-ryu-4.27-1.fc29.noarch: [Errno 256] No more mirrors to try.
prelude-lml-4.1.0-4.fc29.x86_64: [Errno 256] No more mirrors to try.
python-os-win-doc-2.2.0-6.fc29.noarch: [Errno 256] No more mirrors to try.
fcitx-m17n-0.2.4-4.fc29.x86_64: [Errno 256] No more mirrors to try.
eclipse-nls-cs-4.7.0-4.fc29.noarch: [Errno 256] No more mirrors to try.
boost-signals-1.66.0-14.fc29.i686: [Errno 256] No more mirrors to try.
7:texlive-uml-doc-svn17476.0.11-17.fc29.noarch: [Errno 256] No more mirrors to try.
python3-certbot-dns-google-0.26.1-1.fc29.noarch: [Errno 256] No more mirrors to try.
7:texlive-titling-doc-svn15878.2.1d-17.fc29.noarch: [Errno 256] No more mirrors to try.
SuperLUMT-complex-3.1.0-17.fc29.x86_64: [Errno 256] No more mirrors to try.
remmina-devel-1.2.0-0.52.20180408.git.6b62986.fc29.x86_64: [Errno 256] No more mirrors to try.
hyphen-eu-0.20110620-13.fc29.noarch: [Errno 256] No more mirrors to try.
ocaml-zip-devel-1.06-13.fc29.i686: [Errno 256] No more mirrors to try.
vdirsyncer-doc-0.16.3-4.fc29.noarch: [Errno 256] No more mirrors to try.
python2-pyotp-2.2.6-3.fc29.noarch: [Errno 256] No more mirrors to try.
jackson-core-2.9.4-3.fc29.noarch: [Errno 256] No more mirrors to try.
irstlm-devel-6.00.05-7.fc29.x86_64: [Errno 256] No more mirrors to try.
7:texlive-typed-checklist-svn40389-17.fc29.noarch: [Errno 256] No more mirrors to try.
1:compiz-plugins-main-0.8.14-6.fc29.x86_64: [Errno 256] No more mirrors to try.
device-mapper-libs-1.02.150-1.fc29.i686: [Errno 256] No more mirrors to try.
libcss-devel-0.7.0-3.fc29.x86_64: [Errno 256] No more mirrors to try.
libgsignon-glib-devel-2.4.1-6.20180412.git0df5ad7.fc29.i686: [Errno 256] No more mirrors to try.
7:texlive-interpreter-doc-svn27232.1.2-17.fc29.noarch: [Errno 256] No more mirrors to try.
cairo-dock-libs-3.4.1-10.fc29.x86_64: [Errno 256] No more mirrors to try.
7:texlive-texapi-svn24237.1.04-17.fc29.noarch: [Errno 256] No more mirrors to try.
glassfish-jaxb-api-javadoc-2.2.12-9.fc29.noarch: [Errno 256] No more mirrors to try.
cone-devel-0.96.2-5.fc29.i686: [Errno 256] No more mirrors to try.
7:texlive-ccicons-svn30020.1.5-17.fc29.noarch: [Errno 256] No more mirrors to try.
libupnp-1.8.3-3.fc29.i686: [Errno 256] No more mirrors to try.
jboss-jms-1.1-api-1.0.1-17.fc29.noarch: [Errno 256] No more mirrors to try.
appstream-0.12.2-1.fc29.x86_64: [Errno 256] No more mirrors to try.
getdata-devel-0.10.0-7.fc29.x86_64: [Errno 256] No more mirrors to try.
gnuplot-common-5.0.6-10.fc29.x86_64: [Errno 256] No more mirrors to try.
cryptsetup-reencrypt-2.0.4-1.fc29.x86_64: [Errno 256] No more mirrors to try.
python2-rxjson-0.2-14.fc29.noarch: [Errno 256] No more mirrors to try.
mingw64-postgresql-static-10.3-2.fc29.noarch: [Errno 256] No more mirrors to try.
libstdc++-devel-8.2.1-2.fc29.i686: [Errno 256] No more mirrors to try.
deepin-gir-generator-1.0.3-1.fc29.x86_64: [Errno 256] No more mirrors to try.
openssl-pkcs11-0.4.8-1.fc29.x86_64: [Errno 256] No more mirrors to try.
apt-0.5.15lorg3.95-33.git522.fc29.i686: [Errno 256] No more mirrors to try.
libpcapnav-0.8-17.fc28.i686: [Errno 256] No more mirrors to try.
golang-github-jmespath-go-jmespath-devel-0.2.2-0.8.20180612gitbd40a43.fc29.noarch: [Errno 256] No more mirrors to try.
gpart-0.3-7.fc29.x86_64: [Errno 256] No more mirrors to try.
FreeSOLID-devel-2.1.1-31.fc29.x86_64: [Errno 256] No more mirrors to try.
bluebird-gtk3-theme-1.2-8.fc29.noarch: [Errno 256] No more mirrors to try.
R-xml2-1.2.0-4.fc29.x86_64: [Errno 256] No more mirrors to try.
libu2f-server-devel-1.0.1-13.fc29.i686: [Errno 256] No more mirrors to try.
packETH-1.7.2-11.fc29.x86_64: [Errno 256] No more mirrors to try.
culmus-david-clm-fonts-0.130-13.fc29.noarch: [Errno 256] No more mirrors to try.
perl-Data-Pageset-1.06-7.fc29.noarch: [Errno 256] No more mirrors to try.
audiocd-kio-devel-16.08.3-8.fc29.x86_64: [Errno 256] No more mirrors to try.
nodejs-lodash-keys-3.10.1-10.fc29.noarch: [Errno 256] No more mirrors to try.
fawkes-plugin-robotino-ir-pcl-1.0.1-18.fc29.x86_64: [Errno 256] No more mirrors to try.
jboss-jaspi-1.1-api-javadoc-1.0.0-5.fc29.noarch: [Errno 256] No more mirrors to try.
libzen-devel-0.4.37-3.fc29.x86_64: [Errno 256] No more mirrors to try.
7:texlive-forloop-svn15878.3.0-17.fc29.noarch: [Errno 256] No more mirrors to try.
holland-mysqldump-1.1.0-2.fc29.noarch: [Errno 256] No more mirrors to try.
rubygem-formatador-doc-0.2.5-6.fc29.noarch: [Errno 256] No more mirrors to try.
djvulibre-libs-3.5.27-10.fc29.x86_64: [Errno 256] No more mirrors to try.
blackbox-0.70.1-31.fc28.i686: [Errno 256] No more mirrors to try.
xen-licenses-4.11.0-1.fc29.x86_64: [Errno 256] No more mirrors to try.
drumstick0-0.5.0-23.fc29.x86_64: [Errno 256] No more mirrors to try.
mythes-sl-0.20130130-12.fc29.noarch: [Errno 256] No more mirrors to try.
python3-typed_ast-1.1.0-4.fc29.x86_64: [Errno 256] No more mirrors to try.
avalon-logkit-javadoc-2.1-30.fc29.noarch: [Errno 256] No more mirrors to try.
1:nginx-mod-mail-1.12.1-14.fc29.x86_64: [Errno 256] No more mirrors to try.
python2-flake8-3.5.0-6.fc29.noarch: [Errno 256] No more mirrors to try.
python3-PyPAM-0.5.0-39.fc29.x86_64: [Errno 256] No more mirrors to try.
wildfly-arquillian-container-domain-managed-1.0.2-6.fc29.noarch: [Errno 256] No more mirrors to try.
gtk-sharp3-devel-2.99.3-22.fc29.x86_64: [Errno 256] No more mirrors to try.
stapler-adjunct-timeline-1.4-9.fc29.noarch: [Errno 256] No more mirrors to try.
perl-Text-Aspell-0.09-33.fc29.x86_64: [Errno 256] No more mirrors to try.
7:texlive-changes-doc-svn41737-17.fc29.noarch: [Errno 256] No more mirrors to try.
freecol-manual-0.11.6-8.fc29.noarch: [Errno 256] No more mirrors to try.
holland-1.1.0-2.fc29.noarch: [Errno 256] No more mirrors to try.
libreport-newt-2.9.5-4.fc29.x86_64: [Errno 256] No more mirrors to try.
7:texlive-xii-lat-svn45805-17.fc29.noarch: [Errno 256] No more mirrors to try.
ocp-0.1.22-0.19.git849cc42.fc29.x86_64: [Errno 256] No more mirrors to try.
7:texlive-babel-russian-doc-svn45007-17.fc29.noarch: [Errno 256] No more mirrors to try.
python3-pycares-2.3.0-4.fc29.x86_64: [Errno 256] No more mirrors to try.
7:texlive-hepparticles-svn35723.2.0-17.fc29.noarch: [Errno 256] No more mirrors to try.
kf5-kfilemetadata-5.49.0-1.fc29.i686: [Errno 256] No more mirrors to try.
gtk+extra-devel-2.1.2-24.fc29.i686: [Errno 256] No more mirrors to try.
woff2-1.0.2-4.fc29.i686: [Errno 256] No more mirrors to try.
datanommer-0.2.0-13.fc29.noarch: [Errno 256] No more mirrors to try.
7:texlive-todonotes-doc-svn42423-17.fc29.noarch: [Errno 256] No more mirrors to try.
Build step 'Execute shell' marked build as failure
6 years, 2 months
