- Infra - oVirt List Archives

[JIRA] (OVIRT-2764) send email on changequeue-status_master_standard-poll-upstream-sources failure
by danken (oVirt JIRA) 28 Jul '19

28 Jul '19

danken created OVIRT-2764: ----------------------------- Summary: send email on changequeue-status_master_standard-poll-upstream-sources failure Key: OVIRT-2764 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2764 Project: oVirt - virtualization made easy Issue Type: Task Components: Jenkins Master Reporter: danken Assignee: infra OVIRT-2755 has enabled the new periodic job. I'd like to receive an email when it fails. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100106)

1 0

[CQ]: 102021, 4 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 28 Jul '19

28 Jul '19

A system test invoked by the "ovirt-master" change queue including change 102021,4 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 102089,4 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 102089,4 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/102021/4 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/102089/4 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/15160/

1 0

[CQ]: 101828,5 (vdsm) failed "ovirt-master" system tests
by oVirt Jenkins 28 Jul '19

28 Jul '19

Change 101828,5 (vdsm) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/101828/5 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/15158/

1 0

Build failed in Jenkins: system-sync_mirrors-fedora-base-fc29-x86_64 #792
by jenkins＠jenkins.phx.ovirt.org 28 Jul '19

28 Jul '19

See <http://jenkins.ovirt.org/job/system-sync_mirrors-fedora-base-fc29-x86_64/79…> ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-fedora-base-fc29-x86_64/ws/> No credentials specified > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision d047bc68ad3f6481524ee83e67af273a61d3df44 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f d047bc68ad3f6481524ee83e67af273a61d3df44 Commit message: "ost: run manual and nightly jobs on containers." > git rev-list --no-walk d047bc68ad3f6481524ee83e67af273a61d3df44 # timeout=10 [system-sync_mirrors-fedora-base-fc29-x86_64] $ /bin/bash -xe /tmp/jenkins90034430250427851.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf + MIRRORS_MP_BASE=/var/www/html/repos + MIRRORS_HTTP_BASE=http://mirrors.phx.ovirt.org/repos + MIRRORS_CACHE=/home/jenkins/mirrors_cache + MAX_LOCK_ATTEMPTS=120 + LOCK_WAIT_INTERVAL=5 + LOCK_BASE=/home/jenkins + OLD_MD_TO_KEEP=100 + HTTP_SELINUX_TYPE=httpd_sys_content_t + HTTP_FILE_MODE=644 + main resync_yum_mirror fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf + local command=resync_yum_mirror + command_args=("${@:2}") + local command_args + cmd_resync_yum_mirror fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf + local repo_name=fedora-base-fc29 + local repo_archs=x86_64 + local reposync_conf=jenkins/data/mirrors-reposync.conf + local sync_needed + mkdir -p /home/jenkins/mirrors_cache + verify_repo_fs fedora-base-fc29 yum + local repo_name=fedora-base-fc29 + local repo_type=yum + sudo install -o jenkins -d /var/www/html/repos/yum /var/www/html/repos/yum/fedora-base-fc29 /var/www/html/repos/yum/fedora-base-fc29/base + check_yum_sync_needed fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf sync_needed + local repo_name=fedora-base-fc29 + local repo_archs=x86_64 + local reposync_conf=jenkins/data/mirrors-reposync.conf + local p_sync_needed=sync_needed + local reposync_out + echo 'Checking if mirror needs a resync' Checking if mirror needs a resync + rm -rf /home/jenkins/mirrors_cache/fedora-base-fc29 ++ IFS=, ++ echo x86_64 + for arch in '$(IFS=,; echo $repo_archs)' ++ run_reposync fedora-base-fc29 x86_64 jenkins/data/mirrors-reposync.conf --urls --quiet ++ local repo_name=fedora-base-fc29 ++ local repo_arch=x86_64 ++ local reposync_conf=jenkins/data/mirrors-reposync.conf ++ extra_args=("${@:4}") ++ local extra_args ++ reposync --config=jenkins/data/mirrors-reposync.conf --repoid=fedora-base-fc29 --arch=x86_64 --cachedir=/home/jenkins/mirrors_cache --download_path=/var/www/html/repos/yum/fedora-base-fc29/base --norepopath --newest-only --urls --quiet Traceback (most recent call last): File "/usr/bin/reposync", line 373, in <module> main() File "/usr/bin/reposync", line 185, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1468, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 777, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 760, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 738, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 715, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-kvm-common-el7/gen error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-kvm-common-el7/gen' + reposync_out= Build step 'Execute shell' marked build as failure

1 1

[oVirt Jenkins] ovirt-system-tests_compat-4.3-suite-master - Build # 144 - Failure!
by jenkins＠jenkins.phx.ovirt.org 28 Jul '19

28 Jul '19

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.3-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.3-suite-master/144/ Build Number: 144 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #144 [jenkins CI] Auto create ovirt-4.3-release ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.vdsm_recovery_43 Error Message: False != True after 180 seconds -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:0012d3c1-f5ce-4587-977d-9debfa6e2e19:Get ssh client for lago-compat-4-3-suite-master-host-1: lago.ssh: DEBUG: end task:0012d3c1-f5ce-4587-977d-9debfa6e2e19:Get ssh client for lago-compat-4-3-suite-master-host-1: lago.ssh: DEBUG: Running 92312e1e on lago-compat-4-3-suite-master-host-1: /usr/bin/systemctl status --lines=0 vdsmd lago.ssh: DEBUG: Command 92312e1e on lago-compat-4-3-suite-master-host-1 returned with 0 lago.ssh: DEBUG: Command 92312e1e on lago-compat-4-3-suite-master-host-1 output: ● vdsmd.service - Virtual Desktop Server Manager Loaded: loaded (/usr/lib/systemd/system/vdsmd.service; enabled; vendor preset: enabled) Active: active (running) since Fri 2019-07-26 21:11:18 EDT; 22min ago Process: 18081 ExecStopPost=/usr/libexec/vdsm/vdsmd_init_common.sh --post-stop (code=exited, status=0/SUCCESS) Process: 18330 ExecStartPre=/usr/libexec/vdsm/vdsmd_init_common.sh --pre-start (code=exited, status=0/SUCCESS) Main PID: 19523 (vdsmd) Tasks: 90 CGroup: /system.slice/vdsmd.service ├─ 8264 /usr/libexec/ioprocess --read-pipe-fd 58 --write-pipe-fd 57 --max-threads 10 --max-queued-requests 10 ├─ 8271 /usr/libexec/ioprocess --read-pipe-fd 67 --write-pipe-fd 66 --max-threads 10 --max-queued-requests 10 ├─ 8278 /usr/libexec/ioprocess --read-pipe-fd 81 --write-pipe-fd 77 --max-threads 10 --max-queued-requests 10 ├─19523 /usr/bin/python2 /usr/share/vdsm/vdsmd ├─29855 /usr/libexec/ioprocess --read-pipe-fd 66 --write-pipe-fd 65 --max-threads 10 --max-queued-requests 10 ├─29988 /usr/libexec/ioprocess --read-pipe-fd 81 --write-pipe-fd 80 --max-threads 10 --max-queued-requests 10 └─30062 /usr/libexec/ioprocess --read-pipe-fd 91 --write-pipe-fd 90 --max-threads 10 --max-queued-requests 10 lago.ssh: DEBUG: start task:29fa5efa-996a-46e6-976f-407f0aa618c6:Get ssh client for lago-compat-4-3-suite-master-host-1: lago.ssh: DEBUG: end task:29fa5efa-996a-46e6-976f-407f0aa618c6:Get ssh client for lago-compat-4-3-suite-master-host-1: lago.ssh: DEBUG: Running 92b411da on lago-compat-4-3-suite-master-host-1: /usr/bin/systemctl stop vdsmd lago.ssh: DEBUG: Command 92b411da on lago-compat-4-3-suite-master-host-1 returned with 0 lago.ssh: DEBUG: start task:41d3ddf0-cf9b-47d4-90d8-b4fa88b1164b:Get ssh client for lago-compat-4-3-suite-master-host-1: lago.ssh: DEBUG: end task:41d3ddf0-cf9b-47d4-90d8-b4fa88b1164b:Get ssh client for lago-compat-4-3-suite-master-host-1: lago.ssh: DEBUG: Running c5f04cda on lago-compat-4-3-suite-master-host-1: /usr/bin/systemctl status --lines=0 vdsmd lago.ssh: DEBUG: Command c5f04cda on lago-compat-4-3-suite-master-host-1 returned with 3 lago.ssh: DEBUG: Command c5f04cda on lago-compat-4-3-suite-master-host-1 output: ● vdsmd.service - Virtual Desktop Server Manager Loaded: loaded (/usr/lib/systemd/system/vdsmd.service; enabled; vendor preset: enabled) Active: activating (start-pre) since Fri 2019-07-26 21:35:10 EDT; 351ms ago Process: 8370 ExecStopPost=/usr/libexec/vdsm/vdsmd_init_common.sh --post-stop (code=exited, status=0/SUCCESS) Process: 19523 ExecStart=/usr/share/vdsm/daemonAdapter -0 /dev/null -1 /dev/null -2 /dev/null /usr/share/vdsm/vdsmd (code=exited, status=0/SUCCESS) Main PID: 19523 (code=exited, status=0/SUCCESS); : 8486 (vdsmd_init_comm) Tasks: 2 CGroup: /system.slice/vdsmd.service └─control ├─8486 /bin/sh /usr/libexec/vdsm/vdsmd_init_common.sh --pre-start └─8498 /usr/bin/python2 /usr/libexec/vdsm/wait_for_ipv4s lago.ssh: DEBUG: start task:e0527d05-8b28-4768-8fdb-6db7420510ea:Get ssh client for lago-compat-4-3-suite-master-host-1: lago.ssh: DEBUG: end task:e0527d05-8b28-4768-8fdb-6db7420510ea:Get ssh client for lago-compat-4-3-suite-master-host-1: lago.ssh: DEBUG: Running c66e6bce on lago-compat-4-3-suite-master-host-1: /usr/bin/systemctl start vdsmd lago.ssh: DEBUG: Command c66e6bce on lago-compat-4-3-suite-master-host-1 returned with 0 --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_compat-4.3-suite-master/ovirt-system-tests/compat-4.3-suite-master/test-scenarios/004_basic_sanity.py", line 753, in vdsm_recovery lambda: File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 282, in assert_true_within_short assert_equals_within_short(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 266, in assert_equals_within_short func, value, SHORT_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) 'False != True after 180 seconds\n-------------------- >> begin captured logging << --------------------\nlago.ssh: DEBUG: start task:0012d3c1-f5ce-4587-977d-9debfa6e2e19:Get ssh client for lago-compat-4-3-suite-master-host-1:\nlago.ssh: DEBUG: end task:0012d3c1-f5ce-4587-977d-9debfa6e2e19:Get ssh client for lago-compat-4-3-suite-master-host-1:\nlago.ssh: DEBUG: Running 92312e1e on lago-compat-4-3-suite-master-host-1: /usr/bin/systemctl status --lines=0 vdsmd\nlago.ssh: DEBUG: Command 92312e1e on lago-compat-4-3-suite-master-host-1 returned with 0\nlago.ssh: DEBUG: Command 92312e1e on lago-compat-4-3-suite-master-host-1 output:\n \xe2\x97\x8f vdsmd.service - Virtual Desktop Server Manager\n Loaded: loaded (/usr/lib/systemd/system/vdsmd.service; enabled; vendor preset: enabled)\n Active: active (running) since Fri 2019-07-26 21:11:18 EDT; 22min ago\n Process: 18081 ExecStopPost=/usr/libexec/vdsm/vdsmd_init_common.sh --post-stop (code=exited, status=0/SUCCESS)\n Process: 18330 ExecStartPre=/usr/libexec/vdsm/vdsmd_init_common.sh --pre-start (code=exited, status=0/SUCCESS)\n Main PID: 19523 (vdsmd)\n Tasks: 90\n CGroup: /system.slice/vdsmd.service\n \xe2\x94\x9c\xe2\x94\x80 8264 /usr/libexec/ioprocess --read-pipe-fd 58 --write-pipe-fd 57 --max-threads 10 --max-queued-requests 10\n \xe2\x94\x9c\xe2\x94\x80 8271 /usr/libexec/ioprocess --read-pipe-fd 67 --write-pipe-fd 66 --max-threads 10 --max-queued-requests 10\n \xe2\x94\x9c\xe2\x94\x80 8278 /usr/libexec/ioprocess --read-pipe-fd 81 --write-pipe-fd 77 --max-threads 10 --max-queued-requests 10\n \xe2\x94\x9c\xe2\x94\x8019523 /usr/bin/python2 /usr/share/vdsm/vdsmd\n \xe2\x94\x9c\xe2\x94\x8029855 /usr/libexec/ioprocess --read-pipe-fd 66 --write-pipe-fd 65 --max-threads 10 --max-queued-requests 10\n \xe2\x94\x9c\xe2\x94\x8029988 /usr/libexec/ioprocess --read-pipe-fd 81 --write-pipe-fd 80 --max-threads 10 --max-queued-requests 10\n \xe2\x94\x94\xe2\x94\x8030062 /usr/libexec/ioprocess --read-pipe-fd 91 --write-pipe-fd 90 --max-threads 10 --max-queued-requests 10\n\nlago.ssh: DEBUG: start task:29fa5efa-996a-46e6-976f-407f0aa618c6:Get ssh client for lago-compat-4-3-suite-master-host-1:\nlago.ssh: DEBUG: end task:29fa5efa-996a-46e6-976f-407f0aa618c6:Get ssh client for lago-compat-4-3-suite-master-host-1:\nlago.ssh: DEBUG: Running 92b411da on lago-compat-4-3-suite-master-host-1: /usr/bin/systemctl stop vdsmd\nlago.ssh: DEBUG: Command 92b411da on lago-compat-4-3-suite-master-host-1 returned with 0\nlago.ssh: DEBUG: start task:41d3ddf0-cf9b-47d4-90d8-b4fa88b1164b:Get ssh client for lago-compat-4-3-suite-master-host-1:\nlago.ssh: DEBUG: end task:41d3ddf0-cf9b-47d4-90d8-b4fa88b1164b:Get ssh client for lago-compat-4-3-suite-master-host-1:\nlago.ssh: DEBUG: Running c5f04cda on lago-compat-4-3-suite-master-host-1: /usr/bin/systemctl status --lines=0 vdsmd\nlago.ssh: DEBUG: Command c5f04cda on lago-compat-4-3-suite-master-host-1 returned with 3\nlago.ssh: DEBUG: Command c5f04cda on lago-compat-4-3-suite-master-host-1 output:\n \xe2\x97\x8f vdsmd.service - Virtual Desktop Server Manager\n Loaded: loaded (/usr/lib/systemd/system/vdsmd.service; enabled; vendor preset: enabled)\n Active: activating (start-pre) since Fri 2019-07-26 21:35:10 EDT; 351ms ago\n Process: 8370 ExecStopPost=/usr/libexec/vdsm/vdsmd_init_common.sh --post-stop (code=exited, status=0/SUCCESS)\n Process: 19523 ExecStart=/usr/share/vdsm/daemonAdapter -0 /dev/null -1 /dev/null -2 /dev/null /usr/share/vdsm/vdsmd (code=exited, status=0/SUCCESS)\n Main PID: 19523 (code=exited, status=0/SUCCESS); : 8486 (vdsmd_init_comm)\n Tasks: 2\n CGroup: /system.slice/vdsmd.service\n \xe2\x94\x94\xe2\x94\x80control\n \xe2\x94\x9c\xe2\x94\x808486 /bin/sh /usr/libexec/vdsm/vdsmd_init_common.sh --pre-start\n \xe2\x94\x94\xe2\x94\x808498 /usr/bin/python2 /usr/libexec/vdsm/wait_for_ipv4s\n\nlago.ssh: DEBUG: start task:e0527d05-8b28-4768-8fdb-6db7420510ea:Get ssh client for lago-compat-4-3-suite-master-host-1:\nlago.ssh: DEBUG: end task:e0527d05-8b28-4768-8fdb-6db7420510ea:Get ssh client for lago-compat-4-3-suite-master-host-1:\nlago.ssh: DEBUG: Running c66e6bce on lago-compat-4-3-suite-master-host-1: /usr/bin/systemctl start vdsmd\nlago.ssh: DEBUG: Command c66e6bce on lago-compat-4-3-suite-master-host-1 returned with 0\n--------------------- >> end captured logging << ---------------------'

1 1

oVirt infra daily report - unstable production jobs - 899
by jenkins＠jenkins.phx.ovirt.org 28 Jul '19

28 Jul '19

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/899//artifact/exported-a… Cheers, Jenkins

1 0

oVirt infra daily report - unstable production jobs - 898
by jenkins＠jenkins.phx.ovirt.org 27 Jul '19

27 Jul '19

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/898//artifact/exported-a… Cheers, Jenkins

1 0

[CQ]: 101840,4 (ovirt-engine) failed "ovirt-4.3" system tests
by oVirt Jenkins 26 Jul '19

26 Jul '19

Change 101840,4 (ovirt-engine) is probably the reason behind recent system test failures in the "ovirt-4.3" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/101840/4 For failed test results see: http://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/1578/

1 0

[CQ]: 102183,1 (vdsm) failed "ovirt-master" system tests
by oVirt Jenkins 26 Jul '19

26 Jul '19

Change 102183,1 (vdsm) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/102183/1 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/15150/

1 0

[CQ]: 102151, 3 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 26 Jul '19

26 Jul '19

A system test invoked by the "ovirt-master" change queue including change 102151,3 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 102089,4 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 102089,4 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/102151/3 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/102089/4 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/15148/

1 0