December 2018 - Infra - oVirt List Archives

[JIRA] (OVIRT-2624) gluster missing on mirror cause failure in vdsm build
by Barak Korren (oVirt JIRA) 13 Dec '18

13 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2624?page=com.atlassian.jira.… ] Barak Korren commented on OVIRT-2624: ------------------------------------- {quote} So I think in that case, not sure we need to open a ticket on it, only if it keeps failing. {quote} It happened before, I will happen again. Every time it does [~dron] or the infra-owner need to spen time debugging it. And its finally something we do have a solution for (As opposed to many other things we don't). So I think we better use it. > gluster missing on mirror cause failure in vdsm build > ----------------------------------------------------- > > Key: OVIRT-2624 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2624 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Priority: High > Labels: ost_failures, ost_infra > > We failed vdsm build because gluster is missing from local mirrors > {noformat} > python sudo yum yum-utils --setopt=tsflags=nocontexts > 18:09:41 Failed to set locale, defaulting to C > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > {noformat} > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/11977/ -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2624) gluster missing on mirror cause failure in vdsm build
by Eyal Edri (oVirt JIRA) 13 Dec '18

13 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2624?page=com.atlassian.jira.… ] Eyal Edri commented on OVIRT-2624: ---------------------------------- So I think in that case, not sure we need to open a ticket on it, only if it keeps failing. On Thu, Dec 13, 2018 at 1:04 PM Barak Korren (oVirt JIRA) < -- Eyal edri MANAGER RHV/CNV DevOps EMEA VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ) > gluster missing on mirror cause failure in vdsm build > ----------------------------------------------------- > > Key: OVIRT-2624 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2624 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Priority: High > Labels: ost_failures, ost_infra > > We failed vdsm build because gluster is missing from local mirrors > {noformat} > python sudo yum yum-utils --setopt=tsflags=nocontexts > 18:09:41 Failed to set locale, defaulting to C > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > {noformat} > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/11977/ -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2624) gluster missing on mirror cause failure in vdsm build
by Barak Korren (oVirt JIRA) 13 Dec '18

13 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2624?page=com.atlassian.jira.… ] Barak Korren commented on OVIRT-2624: ------------------------------------- That is the way it works - the system falls back to the upstream repo if the mirrors server is not available. Can a project like VDSM choose if he uses mirrors or not from the settings? Yes. All you need to do is set the repo id to something other then the mirror name. The reason we have mirrors is because we can occasionally fail if we don't. The reason for failed re is not the lack of mirror it's the unreliability of the upstream repo. The mirror is there to protect you from that. > gluster missing on mirror cause failure in vdsm build > ----------------------------------------------------- > > Key: OVIRT-2624 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2624 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Priority: High > Labels: ost_failures, ost_infra > > We failed vdsm build because gluster is missing from local mirrors > {noformat} > python sudo yum yum-utils --setopt=tsflags=nocontexts > 18:09:41 Failed to set locale, defaulting to C > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > {noformat} > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/11977/ -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

2 1

[oVirt Jenkins] ovirt-appliance_ovirt-4.3_build-artifacts-el7-x86_64 - Build # 26 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Dec '18

13 Dec '18

Project: http://jenkins.ovirt.org/job/ovirt-appliance_ovirt-4.3_build-artifacts-el7-… Build: http://jenkins.ovirt.org/job/ovirt-appliance_ovirt-4.3_build-artifacts-el7-… Build Number: 26 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #26 [Marcin Sobczyk] vdsm: Disable CI v1 for VDSM's ovirt-4.2 branch [Gal Ben Haim] Adding manifests for OC [Sandro Bonazzola] build: appliance for 4.3.0 alpha ----------------- Failed Tests: ----------------- No tests ran.

1 1

[JIRA] (OVIRT-2624) gluster missing on mirror cause failure in vdsm build
by Dafna Ron (oVirt JIRA) 13 Dec '18

13 Dec '18

Dafna Ron created OVIRT-2624: -------------------------------- Summary: gluster missing on mirror cause failure in vdsm build Key: OVIRT-2624 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2624 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Dafna Ron Assignee: infra Priority: High We failed vdsm build because gluster is missing from local mirrors {noformat} python sudo yum yum-utils --setopt=tsflags=nocontexts 18:09:41 Failed to set locale, defaulting to C 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable 18:09:41 Trying other mirror. 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable 18:09:41 Trying other mirror. 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable 18:09:41 Trying other mirror. 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable 18:09:41 Trying other mirror. 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable 18:09:41 Trying other mirror. 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable 18:09:41 Trying other mirror. 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable 18:09:41 Trying other mirror. {noformat} http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/11977/ -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

3 2

[JIRA] (OVIRT-2624) gluster missing on mirror cause failure in vdsm build
by Eyal Edri (oVirt JIRA) 13 Dec '18

13 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2624?page=com.atlassian.jira.… ] Eyal Edri commented on OVIRT-2624: ---------------------------------- Barak, Can we make the mirrors optional so it will fall back to the original repo? Can a project like VDSM choose if he uses mirrors or not from the settings? Ehud, please verify that we have gluster 3.12 mirrored for now, but we really need to think how to avoid failing on it if we don't have the mirror setup yet. On Thu, Dec 13, 2018 at 12:49 PM Dafna Ron (oVirt JIRA) < -- Eyal edri MANAGER RHV/CNV DevOps EMEA VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ) > gluster missing on mirror cause failure in vdsm build > ----------------------------------------------------- > > Key: OVIRT-2624 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2624 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Priority: High > Labels: ost_failures, ost_infra > > We failed vdsm build because gluster is missing from local mirrors > {noformat} > python sudo yum yum-utils --setopt=tsflags=nocontexts > 18:09:41 Failed to set locale, defaulting to C > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > 18:09:41 http://mirror.centos.org/centos/7/storage/x86_64/gluster-3.12/repodata/repo…: [Errno 14] HTTP Error 503 - Service Unavailable > 18:09:41 Trying other mirror. > {noformat} > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/11977/ -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[oVirt Jenkins] ovirt-node-ng-image_4.3_build-artifacts-el7-x86_64 - Build # 22 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Dec '18

13 Dec '18

Project: http://jenkins.ovirt.org/job/ovirt-node-ng-image_4.3_build-artifacts-el7-x8… Build: http://jenkins.ovirt.org/job/ovirt-node-ng-image_4.3_build-artifacts-el7-x8… Build Number: 22 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #22 [Sandro Bonazzola] build: prepare for 4.3.0 alpha release [Marcin Sobczyk] vdsm: Disable CI v1 for VDSM's ovirt-4.2 branch [Gal Ben Haim] Adding manifests for OC ----------------- Failed Tests: ----------------- No tests ran.

1 1

Build failed in Jenkins: system-sync_mirrors-centos-updates-el7-x86_64 #2219
by jenkins＠jenkins.phx.ovirt.org 13 Dec '18

13 Dec '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> Changes: [Marcin Sobczyk] ost: Add 'COVERAGE' option ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 176abf92c7f6ef0fb587732da7f1a3d7dc95ac79 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 176abf92c7f6ef0fb587732da7f1a3d7dc95ac79 Commit message: "ost: Add 'COVERAGE' option" > git rev-list --no-walk 1c9d41fe460d79698fc5dee58acd48a003fd81ae # timeout=10 [system-sync_mirrors-centos-updates-el7-x86_64] $ /bin/bash -xe /tmp/jenkins4465059835859182215.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-updates-el7 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-updates-el7 error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-updates-el7' Build step 'Execute shell' marked build as failure

1 1

Build failed in Jenkins: system-sync_mirrors-fedora-base-fc29-x86_64 #102
by jenkins＠jenkins.phx.ovirt.org 13 Dec '18

13 Dec '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-fedora-base-fc29-x86_64/10…> ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-fedora-base-fc29-x86_64/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 176abf92c7f6ef0fb587732da7f1a3d7dc95ac79 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 176abf92c7f6ef0fb587732da7f1a3d7dc95ac79 Commit message: "ost: Add 'COVERAGE' option" > git rev-list --no-walk 176abf92c7f6ef0fb587732da7f1a3d7dc95ac79 # timeout=10 [system-sync_mirrors-fedora-base-fc29-x86_64] $ /bin/bash -xe /tmp/jenkins4778672781902758028.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-kvm-common-el7 error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-kvm-common-el7' Build step 'Execute shell' marked build as failure

1 1

oVirt infra daily report - unstable production jobs - 672
by jenkins＠jenkins.phx.ovirt.org 13 Dec '18

13 Dec '18

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/672//artifact/exported-a… Cheers, Jenkins

1 0