- Infra - oVirt List Archives

[CQ]: 86372, 3 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86372,3 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86372/3 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9455/

1 0

[CQ]: 86244, 10 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86244,10 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86244/10 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9448/

1 0

[CQ]: 83900, 29 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 83900,29 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/83900/29 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9441/

1 0

[CQ]: 85883, 6 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 85883,6 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/85883/6 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9434/

1 0

[CQ]: 85771, 4 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 85771,4 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/85771/4 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9427/

1 0

[CQ]: 86411, 7 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86411,7 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86411/7 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9420/

1 0

[CQ]: 86479, 3 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86479,3 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86479/3 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9413/

1 0

[CQ]: 86480, 2 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86480,2 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86480/2 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9406/

1 0

[CQ]: 86437, 12 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86437,12 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86437/12 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9399/

1 0

[CQ]: 86635, 4 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86635,4 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86635/4 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9392/

1 0

[CQ]: 86490, 6 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86490,6 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86490/6 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9385/

1 0

[CQ]: 86549, 5 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86549,5 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86549/5 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9378/

1 0

[CQ]: 86663, 2 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86663,2 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86663/2 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9371/

1 0

[CQ]: 86572, 4 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86572,4 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86572/4 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9364/

1 0

[CQ]: 86636, 3 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86636,3 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86636/3 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9357/

1 0

Build failed in Jenkins: system-sync_mirrors-centos-updates-el7-x86_64 #1911
by jenkins＠jenkins.phx.ovirt.org 04 Sep '18

04 Sep '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision c9e3c53cb807ba71508f614c1deb34f9a4d68de8 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f c9e3c53cb807ba71508f614c1deb34f9a4d68de8 Commit message: "system-tests: drop sbonazzo from notified list" > git rev-list --no-walk c9e3c53cb807ba71508f614c1deb34f9a4d68de8 # timeout=10 [system-sync_mirrors-centos-updates-el7-x86_64] $ /bin/bash -xe /tmp/jenkins8987189213906534019.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-updates-el7 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-updates-el7/packages error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-updates-el7/packages' Build step 'Execute shell' marked build as failure

1 1

[CQ]: 86688, 2 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86688,2 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86688/2 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9350/

1 0

[CQ]: 86691, 2 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86691,2 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86691/2 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9343/

1 0

[CQ]: 86731, 3 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86731,3 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86731/3 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9336/

1 0

[CQ]: 86744, 1 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86744,1 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86744/1 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9329/

1 0

[CQ]: 86745, 1 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86745,1 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86745/1 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9322/

1 0

[CQ]: 86579, 21 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 04 Sep '18

04 Sep '18

A system test invoked by the "ovirt-master" change queue including change 86579,21 (ovirt-hosted-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change 86760,2 (ovirt-hosted-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 86760,2 (ovirt-hosted-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/86579/21 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9315/

1 0

[CQ]: 86760, 2 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests
by oVirt Jenkins 04 Sep '18

04 Sep '18

Change 86760,2 (ovirt-hosted-engine-setup) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/86760/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9305/

1 0

oVirt infra daily report - unstable production jobs - 572
by jenkins＠jenkins.phx.ovirt.org 04 Sep '18

04 Sep '18

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/572//artifact/exported-a… Cheers, Jenkins

1 0

[CQ]: 90796, 3 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests
by oVirt Jenkins 03 Sep '18

03 Sep '18

Change 90796,3 (ovirt-hosted-engine-setup) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/90796/3 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9297/

1 0

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-4.2 - Build # 439 - Failure!
by jenkins＠jenkins.phx.ovirt.org 03 Sep '18

03 Sep '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/439/ Build Number: 439 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #439 [Anton Marchukov] Removed /root/fluentd from collected artifacts. [Ehud Yonasi] docker_cleanup: Fixed race condition with containers ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: The response content type 'text/html; charset=iso-8859-1' isn't the expected XML -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7fa038aef0c8> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37037, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 208, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 130, in _check_fault body = self._internal_read_body(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 316, in _internal_read_body self._connection.check_xml_content_type(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 849, in check_xml_content_type response.headers File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 889, in _check_content_type raise Error(msg) Error: The response content type 'text/html; charset=iso-8859-1' isn't the expected XML --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 229, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 273, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 278, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37037, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 208, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 130, in _check_fault body = self._internal_read_body(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 316, in _internal_read_body self._connection.check_xml_content_type(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 849, in check_xml_content_type response.headers File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 889, in _check_content_type raise Error(msg) 'The response content type \'text/html; charset=iso-8859-1\' isn\'t the expected XML\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7fa038aef0c8>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4\n host_obj = host_service.get()\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37037, in get\n return self._internal_get(headers, query, wait)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get\n return future.wait() if wait else future\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait\n return self._code(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 208, in callback\n self._check_fault(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 130, in _check_fault\n body = self._internal_read_body(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 316, in _internal_read_body\n self._connection.check_xml_content_type(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 849, in check_xml_content_type\n response.headers\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 889, in _check_content_type\n raise Error(msg)\nError: The response content type \'text/html; charset=iso-8859-1\' isn\'t the expected XML\n--------------------- >> end captured logging << ---------------------'

1 2

[CQ]: 9e1fdd0 (ovirt-ansible-manageiq) failed "ovirt-4.2" system tests
by oVirt Jenkins 03 Sep '18

03 Sep '18

Change 9e1fdd0 (ovirt-ansible-manageiq) is probably the reason behind recent system test failures in the "ovirt-4.2" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://github.com/oVirt/ovirt-ansible-manageiq/commit/9e1fdd087daecbf2b201… For failed test results see: http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3037/

1 0

[JIRA] (OVIRT-2469) CQ Failure: can't install ovirt-host
by Ehud Yonasi (oVirt JIRA) 03 Sep '18

03 Sep '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2469?page=com.atlassian.jira.… ] Ehud Yonasi commented on OVIRT-2469: ------------------------------------ [~grosenth(a)redhat.com] will also fix the reposync issue on ovirt-4.2-official-el7: RuntimeError: Failed to run reposync 3 times for repoid: ovirt-4.2-official-el7, aborting. > CQ Failure: can't install ovirt-host > ------------------------------------- > > Key: OVIRT-2469 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2469 > Project: oVirt - virtualization made easy > Issue Type: Outage > Reporter: Ehud Yonasi > Assignee: infra > Labels: cq-issue-traking, ost_failures > > yum install ovirt-host returns a package that does not exist under tested repo which is: > ovirt-imageio-common = 1.4.4-0.el7 > [~grosenth(a)redhat.com] is working on a fix to the reposync config file which will include that package. > 1) http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3035//artifact/b… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100091)

1 0

Change in stdci-staging[master]: Revert "Change"
by review＠gerrit-staging.phx.ovirt.org 03 Sep '18

03 Sep '18

From Daniel Belenky <dbelenky(a)redhat.com>: Hello Jenkins CI, I'd like you to do a code review. Please visit https://gerrit-staging.phx.ovirt.org/211 to review the following change. Change subject: Revert "Change" ...................................................................... Revert "Change" This reverts commit 55fa1ba70a7675ae259b01721c9211961e638dc6. Change-Id: I069a5c15e921eb46769dfd2df98eff75d4708fb0 --- A automation/check-patch.yaml M change 2 files changed, 11 insertions(+), 1 deletion(-) git pull ssh://gerrit-staging.phx.ovirt.org:29418/stdci-staging refs/changes/11/211/1 -- To view, visit https://gerrit-staging.phx.ovirt.org/211 To unsubscribe, visit https://gerrit-staging.phx.ovirt.org/settings Gerrit-Project: stdci-staging Gerrit-Branch: master Gerrit-MessageType: newchange Gerrit-Change-Id: I069a5c15e921eb46769dfd2df98eff75d4708fb0 Gerrit-Change-Number: 211 Gerrit-PatchSet: 1 Gerrit-Owner: Daniel Belenky <dbelenky(a)redhat.com> Gerrit-Reviewer: Jenkins CI <infra(a)ovirt.org>

1 4

[CQ]: 93968, 5 (ovirt-hosted-engine-setup) failed "ovirt-master" system tests
by oVirt Jenkins 03 Sep '18

03 Sep '18

Change 93968,5 (ovirt-hosted-engine-setup) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/93968/5 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9293/

2 1

[CQ]: 94108,1 (ovirt-engine-sdk) failed "ovirt-4.2" system tests
by oVirt Jenkins 03 Sep '18

03 Sep '18

Change 94108,1 (ovirt-engine-sdk) is probably the reason behind recent system test failures in the "ovirt-4.2" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/94108/1 For failed test results see: http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3035/

2 1

[JIRA] (OVIRT-2469) CQ Failure: can't install ovirt-host
by Ehud Yonasi (oVirt JIRA) 03 Sep '18

03 Sep '18

Ehud Yonasi created OVIRT-2469: ---------------------------------- Summary: CQ Failure: can't install ovirt-host Key: OVIRT-2469 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2469 Project: oVirt - virtualization made easy Issue Type: Outage Reporter: Ehud Yonasi Assignee: infra yum install ovirt-host returns a package that does not exist under tested repo which is: ovirt-imageio-common = 1.4.4-0.el7 [~grosenth(a)redhat.com] is working on a fix to the reposync config file which will include that package. 1) http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3035//artifact/b… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100091)

1 0

Change in stdci-staging[master]: Add stuff to test other stuff
by review＠gerrit-staging.phx.ovirt.org 03 Sep '18

03 Sep '18

From Daniel Belenky <dbelenky(a)redhat.com>: Daniel Belenky has submitted this change and it was merged. ( https://gerrit-staging.phx.ovirt.org/156 ) Change subject: Add stuff to test other stuff ...................................................................... Add stuff to test other stuff Change-Id: If5c1f99a7cda70ee12576d6d482d81206e274a55 Signed-off-by: Daniel Belenky <dbelenky(a)redhat.com> --- A automation/check-patch.another-failed.sh A automation/check-patch.failed.sh M automation/check-patch.sh A stdci.yaml 4 files changed, 10 insertions(+), 0 deletions(-) Approvals: Daniel Belenky: Looks good to me, approved; Verified; Passed CI tests -- To view, visit https://gerrit-staging.phx.ovirt.org/156 To unsubscribe, visit https://gerrit-staging.phx.ovirt.org/settings Gerrit-Project: stdci-staging Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: If5c1f99a7cda70ee12576d6d482d81206e274a55 Gerrit-Change-Number: 156 Gerrit-PatchSet: 3 Gerrit-Owner: Daniel Belenky <dbelenky(a)redhat.com> Gerrit-Reviewer: Daniel Belenky <dbelenky(a)redhat.com> Gerrit-Reviewer: Jenkins CI <infra(a)ovirt.org>

1 0

Change in stdci-staging[master]: Add stuff to test other stuff
by review＠gerrit-staging.phx.ovirt.org 03 Sep '18

03 Sep '18

From Daniel Belenky <dbelenky(a)redhat.com>: Daniel Belenky has posted comments on this change. ( https://gerrit-staging.phx.ovirt.org/156 ) Change subject: Add stuff to test other stuff ...................................................................... Patch Set 3: Verified+1 Code-Review+2 Continuous-Integration+1 -- To view, visit https://gerrit-staging.phx.ovirt.org/156 To unsubscribe, visit https://gerrit-staging.phx.ovirt.org/settings Gerrit-Project: stdci-staging Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: If5c1f99a7cda70ee12576d6d482d81206e274a55 Gerrit-Change-Number: 156 Gerrit-PatchSet: 3 Gerrit-Owner: Daniel Belenky <dbelenky(a)redhat.com> Gerrit-Reviewer: Daniel Belenky <dbelenky(a)redhat.com> Gerrit-Reviewer: Jenkins CI <infra(a)ovirt.org> Gerrit-Comment-Date: Mon, 03 Sep 2018 11:36:14 +0000 Gerrit-HasComments: No

1 0

Build failed in Jenkins: system-sync_mirrors-centos-updates-el7-x86_64 #1909
by jenkins＠jenkins.phx.ovirt.org 03 Sep '18

03 Sep '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> Changes: [Sandro Bonazzola] system-tests: drop sbonazzo from notified list ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision c9e3c53cb807ba71508f614c1deb34f9a4d68de8 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f c9e3c53cb807ba71508f614c1deb34f9a4d68de8 Commit message: "system-tests: drop sbonazzo from notified list" > git rev-list --no-walk c3e22a7a5566ea8461869a9b35ab281957843371 # timeout=10 [system-sync_mirrors-centos-updates-el7-x86_64] $ /bin/bash -xe /tmp/jenkins1696619484813995751.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-updates-el7 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-updates-el7 error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-updates-el7' Build step 'Execute shell' marked build as failure

1 1

[JIRA] (OVIRT-2457) mirrors.phx running out of RAM/swap
by Evgheni Dereveanchin (oVirt JIRA) 03 Sep '18

03 Sep '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2457?page=com.atlassian.jira.… ] Evgheni Dereveanchin reassigned OVIRT-2457: ------------------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > mirrors.phx running out of RAM/swap > ----------------------------------- > > Key: OVIRT-2457 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2457 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Evgheni Dereveanchin > Assignee: Evgheni Dereveanchin > > Since we added monitoring it became obvious that the mirrors.phx system is running out of memory often and swapping which causes unneeded I/O load on our storage servers. Memory should be bumped, alternatively we should see if we can somehow bring memory usage down, for example decrease number of jenkins worker threads (currently there's 5) > $ free -m > {{ total used free shared buff/cache available}} > {{Mem: 3788 3568 102 1 117 18}} > {{Swap: 3968 3968 0}} -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100091)

1 0

Change in stdci-staging[master]: Change
by review＠gerrit-staging.phx.ovirt.org 03 Sep '18

03 Sep '18

From Daniel Belenky <dbelenky(a)redhat.com>: Daniel Belenky has submitted this change and it was merged. ( https://gerrit-staging.phx.ovirt.org/146 ) Change subject: Change ...................................................................... Change Change-Id: I34674ac03cad47669bfecee4c2b4407c0a9cc79d Signed-off-by: Daniel Belenky <dbelenky(a)redhat.com> --- D automation/check-patch.yaml M change 2 files changed, 1 insertion(+), 11 deletions(-) Approvals: Daniel Belenky: Looks good to me, approved; Verified; Passed CI tests -- To view, visit https://gerrit-staging.phx.ovirt.org/146 To unsubscribe, visit https://gerrit-staging.phx.ovirt.org/settings Gerrit-Project: stdci-staging Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I34674ac03cad47669bfecee4c2b4407c0a9cc79d Gerrit-Change-Number: 146 Gerrit-PatchSet: 4 Gerrit-Owner: Daniel Belenky <dbelenky(a)redhat.com> Gerrit-Reviewer: Daniel Belenky <dbelenky(a)redhat.com> Gerrit-Reviewer: Jenkins CI <infra(a)ovirt.org>

1 0

Change in stdci-staging[master]: Change
by review＠gerrit-staging.phx.ovirt.org 03 Sep '18

03 Sep '18

From Daniel Belenky <dbelenky(a)redhat.com>: Daniel Belenky has posted comments on this change. ( https://gerrit-staging.phx.ovirt.org/146 ) Change subject: Change ...................................................................... Patch Set 4: Verified+1 Code-Review+2 Continuous-Integration+1 -- To view, visit https://gerrit-staging.phx.ovirt.org/146 To unsubscribe, visit https://gerrit-staging.phx.ovirt.org/settings Gerrit-Project: stdci-staging Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I34674ac03cad47669bfecee4c2b4407c0a9cc79d Gerrit-Change-Number: 146 Gerrit-PatchSet: 4 Gerrit-Owner: Daniel Belenky <dbelenky(a)redhat.com> Gerrit-Reviewer: Daniel Belenky <dbelenky(a)redhat.com> Gerrit-Reviewer: Jenkins CI <infra(a)ovirt.org> Gerrit-Comment-Date: Mon, 03 Sep 2018 06:19:34 +0000 Gerrit-HasComments: No

1 0

Build failed in Jenkins: system-sync_mirrors-epel-el6-x86_64 #1826
by jenkins＠jenkins.phx.ovirt.org 03 Sep '18

03 Sep '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/1826/displ…> Changes: [Ehud Yonasi] docker_cleanup: Fixed race condition with containers ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision c3e22a7a5566ea8461869a9b35ab281957843371 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f c3e22a7a5566ea8461869a9b35ab281957843371 Commit message: "docker_cleanup: Fixed race condition with containers" > git rev-list --no-walk be2afca1084373dba01cdd0792cca733e26bf17f # timeout=10 [system-sync_mirrors-epel-el6-x86_64] $ /bin/bash -xe /tmp/jenkins1027534059792929377.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror epel-el6 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-updates-el7/packages error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-updates-el7/packages' Build step 'Execute shell' marked build as failure

1 1

Build failed in Jenkins: system-sync_mirrors-centos-updates-el7-x86_64 #1907
by jenkins＠jenkins.phx.ovirt.org 03 Sep '18

03 Sep '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> Changes: [Viktor Mihajlovski] Re-enable s390x jobs ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision be2afca1084373dba01cdd0792cca733e26bf17f (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f be2afca1084373dba01cdd0792cca733e26bf17f Commit message: "Re-enable s390x jobs" > git rev-list --no-walk 413af376fd99c29234343410b36d8e533a8cc047 # timeout=10 [system-sync_mirrors-centos-updates-el7-x86_64] $ /bin/bash -xe /tmp/jenkins8693072531183338453.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-updates-el7 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1474, in _commonLoadRepoXML if self._latestRepoXML(local): File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1443, in _latestRepoXML oxml = self._saveOldRepoXML(local) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1300, in _saveOldRepoXML shutil.copy2(local, old_local) File "/usr/lib64/python2.7/shutil.py", line 131, in copy2 copystat(src, dst) File "/usr/lib64/python2.7/shutil.py", line 98, in copystat os.utime(dst, (st.st_atime, st.st_mtime)) OSError: [Errno 2] No such file or directory: '/home/jenkins/mirrors_cache/centos-extras-el7/repomd.xml.old.tmp' Build step 'Execute shell' marked build as failure

1 1

oVirt infra daily report - unstable production jobs - 571
by jenkins＠jenkins.phx.ovirt.org 03 Sep '18

03 Sep '18

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/571//artifact/exported-a… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-4.2 - Build # 437 - Failure!
by jenkins＠jenkins.phx.ovirt.org 02 Sep '18

02 Sep '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/437/ Build Number: 437 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #437 [Anton Marchukov] Removed /root/fluentd from collected artifacts. ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: None != True after 900 seconds Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 229, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 273, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 278, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) AssertionError: None != True after 900 seconds

1 1

Build failed in Jenkins: system-sync_mirrors-epel-el6-x86_64 #1824
by jenkins＠jenkins.phx.ovirt.org 02 Sep '18

02 Sep '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/1824/displ…> ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 413af376fd99c29234343410b36d8e533a8cc047 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 413af376fd99c29234343410b36d8e533a8cc047 Commit message: "Added production gerrit to push-url-map" > git rev-list --no-walk 413af376fd99c29234343410b36d8e533a8cc047 # timeout=10 [system-sync_mirrors-epel-el6-x86_64] $ /bin/bash -xe /tmp/jenkins2734975479701061214.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror epel-el6 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1474, in _commonLoadRepoXML if self._latestRepoXML(local): File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1443, in _latestRepoXML oxml = self._saveOldRepoXML(local) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1300, in _saveOldRepoXML shutil.copy2(local, old_local) File "/usr/lib64/python2.7/shutil.py", line 131, in copy2 copystat(src, dst) File "/usr/lib64/python2.7/shutil.py", line 98, in copystat os.utime(dst, (st.st_atime, st.st_mtime)) OSError: [Errno 2] No such file or directory: '/home/jenkins/mirrors_cache/centos-extras-el7/repomd.xml.old.tmp' Build step 'Execute shell' marked build as failure

1 1

Change in stdci-staging[master]: change
by review＠gerrit-staging.phx.ovirt.org 02 Sep '18

02 Sep '18

From Daniel Belenky <dbelenky(a)redhat.com>: Daniel Belenky has submitted this change and it was merged. ( https://gerrit-staging.phx.ovirt.org/209 ) Change subject: change ...................................................................... change Change-Id: I45ebf9e061d466f1002ef93f959be70abca38f1a Signed-off-by: Daniel Belenky <dbelenky(a)redhat.com> --- M change 1 file changed, 1 insertion(+), 2 deletions(-) Approvals: Jenkins CI: Passed CI tests Daniel Belenky: Looks good to me, approved; Verified -- To view, visit https://gerrit-staging.phx.ovirt.org/209 To unsubscribe, visit https://gerrit-staging.phx.ovirt.org/settings Gerrit-Project: stdci-staging Gerrit-Branch: master Gerrit-MessageType: merged Gerrit-Change-Id: I45ebf9e061d466f1002ef93f959be70abca38f1a Gerrit-Change-Number: 209 Gerrit-PatchSet: 1 Gerrit-Owner: Daniel Belenky <dbelenky(a)redhat.com> Gerrit-Reviewer: Daniel Belenky <dbelenky(a)redhat.com> Gerrit-Reviewer: Jenkins CI <infra(a)ovirt.org>

1 0

Change in stdci-staging[master]: change
by review＠gerrit-staging.phx.ovirt.org 02 Sep '18

02 Sep '18

From Daniel Belenky <dbelenky(a)redhat.com>: Daniel Belenky has posted comments on this change. ( https://gerrit-staging.phx.ovirt.org/209 ) Change subject: change ...................................................................... Patch Set 1: Verified+1 Code-Review+2 -- To view, visit https://gerrit-staging.phx.ovirt.org/209 To unsubscribe, visit https://gerrit-staging.phx.ovirt.org/settings Gerrit-Project: stdci-staging Gerrit-Branch: master Gerrit-MessageType: comment Gerrit-Change-Id: I45ebf9e061d466f1002ef93f959be70abca38f1a Gerrit-Change-Number: 209 Gerrit-PatchSet: 1 Gerrit-Owner: Daniel Belenky <dbelenky(a)redhat.com> Gerrit-Reviewer: Daniel Belenky <dbelenky(a)redhat.com> Gerrit-Reviewer: Jenkins CI <infra(a)ovirt.org> Gerrit-Comment-Date: Sun, 02 Sep 2018 12:24:41 +0000 Gerrit-HasComments: No

1 0

Fwd: question on a problem in U/S CQ
by Ehud Yonasi 02 Sep '18

02 Sep '18

As Galit mentioned, there are errors regarding sql for instance: [ ERROR ] schema.sh: FATAL: Cannot execute sql command: --file=/usr/share/ovirt-engine/dbscripts/upgrade/04_03_0280_add_clean_traffic_gateway_into_nwfilters.sql [ ERROR ] Failed to execute stage 'Misc configuration': Engine schema refresh failed Can you please check if there is a regression? Thanks in advance! ---------- Forwarded message --------- From: Galit Rosenthal <grosenth(a)redhat.com> Date: Sun, Sep 2, 2018 at 2:01 PM Subject: Fwd: question on a problem in U/S CQ To: Ehud Yonasi <eyonasi(a)redhat.com> ---------- Forwarded message --------- From: Galit Rosenthal <grosenth(a)redhat.com> Date: Sun, Sep 2, 2018 at 12:20 PM Subject: question on a problem in U/S CQ To: Shirly Radco <sradco(a)redhat.com> Hi Shirly, Is this related to you the problem with the connection to DB? https://jenkins.ovirt.org/view/Change%20queue%20jobs/job/ovirt-master_chang… Regards, Galit -- GALIT ROSENTHAL SOFTWARE ENGINEER Red Hat <https://www.redhat.com/> galit(a)gmail.com T: 972-9-7692230 <https://red.ht/sig> -- GALIT ROSENTHAL SOFTWARE ENGINEER Red Hat <https://www.redhat.com/> galit(a)gmail.com T: 972-9-7692230 <https://red.ht/sig>

2 1

[JIRA] (OVIRT-2462) mirrors.phx.ovirt.org running out of memory
by Eyal Edri (oVirt JIRA) 02 Sep '18

02 Sep '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2462?page=com.atlassian.jira.… ] Eyal Edri reassigned OVIRT-2462: -------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > mirrors.phx.ovirt.org running out of memory > ------------------------------------------- > > Key: OVIRT-2462 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2462 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: sbonazzo > Assignee: Evgheni Dereveanchin > > Tried to investigate recent failures in mirror sync and found: > $ dmesg |grep Out > [18729195.412025] Out of memory: Kill process 920 (genpkgmetadata.) score > 148 or sacrifice child > [18729196.088872] Out of memory: Kill process 920 (genpkgmetadata.) score > 150 or sacrifice child > [18729197.392773] Out of memory: Kill process 920 (genpkgmetadata.) score > 157 or sacrifice child > [18729197.701566] Out of memory: Kill process 920 (genpkgmetadata.) score > 159 or sacrifice child > [18729222.032203] Out of memory: Kill process 920 (genpkgmetadata.) score > 161 or sacrifice child > [18729308.634563] Out of memory: Kill process 920 (genpkgmetadata.) score > 168 or sacrifice child > [18729309.348963] Out of memory: Kill process 920 (genpkgmetadata.) score > 170 or sacrifice child > [18729600.748587] Out of memory: Kill process 920 (genpkgmetadata.) score > 177 or sacrifice child > [18729645.237522] Out of memory: Kill process 920 (genpkgmetadata.) score > 177 or sacrifice child > [19074457.347150] Out of memory: Kill process 19564 (genpkgmetadata.) score > 282 or sacrifice child > [19074742.414741] Out of memory: Kill process 19564 (genpkgmetadata.) score > 283 or sacrifice child > [19333411.219609] Out of memory: Kill process 1625 (genpkgmetadata.) score > 293 or sacrifice child > [19392257.064747] Out of memory: Kill process 27017 (genpkgmetadata.) score > 193 or sacrifice child > [19392258.005043] Out of memory: Kill process 27017 (genpkgmetadata.) score > 196 or sacrifice child > Probably unrelated to the failures I was looking into, but still, this VM > needs more memory. > -- > SANDRO BONAZZOLA > MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV > Red Hat EMEA <https://www.redhat.com/> > sbonazzo(a)redhat.com > <https://red.ht/sig> > <https://www.redhat.com/en/events/red-hat-open-source-day-italia?sc_cid=701f…> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100091)

1 0

[JIRA] (OVIRT-2461) Repo for ovirt-hc-demo
by Eyal Edri (oVirt JIRA) 02 Sep '18

02 Sep '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2461?page=com.atlassian.jira.… ] Eyal Edri reassigned OVIRT-2461: -------------------------------- Assignee: Galit Rosenthal (was: infra) Why do we need a new repo for HC? [~gbenhaim(a)redhat.com] do we need a separate repo per suite the demo tool will support? > Repo for ovirt-hc-demo > ---------------------- > > Key: OVIRT-2461 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2461 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: sabose > Assignee: Galit Rosenthal > > Hi, > Similar to https://gerrit.ovirt.org/ovirt-demo-tool , we need a repo to > host the demo for oVirt-Gluster hyperconverged environment. > Request to create a repo - ovirt-hc-demo-tool > thanks > sahina -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100091)

1 0

Build failed in Jenkins: system-sync_mirrors-centos-updates-el7-x86_64 #1905
by jenkins＠jenkins.phx.ovirt.org 02 Sep '18

02 Sep '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 413af376fd99c29234343410b36d8e533a8cc047 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 413af376fd99c29234343410b36d8e533a8cc047 Commit message: "Added production gerrit to push-url-map" > git rev-list --no-walk 413af376fd99c29234343410b36d8e533a8cc047 # timeout=10 [system-sync_mirrors-centos-updates-el7-x86_64] $ /bin/bash -xe /tmp/jenkins7747053619512721450.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-updates-el7 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-updates-el7/packages error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-updates-el7/packages' Build step 'Execute shell' marked build as failure

1 1

[JIRA] (OVIRT-2459) Please add Joey Ma to CI whitelist
by Eyal Edri (oVirt JIRA) 02 Sep '18

02 Sep '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2459?page=com.atlassian.jira.… ] Eyal Edri updated OVIRT-2459: ----------------------------- Resolution: Fixed Status: Done (was: To Do) > Please add Joey Ma to CI whitelist > ---------------------------------- > > Key: OVIRT-2459 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2459 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Ondra Machacek > Assignee: infra > > Hi, > please add Joey Ma (majunjiev(a)gmail.com) to following projects CI whitelist: > - ovirt-engine-sdk > - ovirt-engine-sdk-java > - ovirt-engine-sdk-ruby > - ovirt-engine-api-model > - ovirt-engine-api-metamodel > He is contributor to all of these project also maintaning Go SDK project and oVirt Terraform provider. > Thanks, > Ondra -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100091)

1 0