April 2020 - Infra - oVirt List Archives

[CQ]: 108152,3 (vdsm) failed "ovirt-master" system tests
by oVirt Jenkins 15 Apr '20

15 Apr '20

Change 108152,3 (vdsm) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/108152/3 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/23046/

1 0

Build failed in Jenkins: system-sync_mirrors-centos-updates-7.6-el7-x86_64 #525
by jenkins＠jenkins.phx.ovirt.org 15 Apr '20

15 Apr '20

See <https://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-7.6-el7-x8…> Changes: [Evgheni Dereveanchin] Only run mirror cleanup if a sync is needed ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <https://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-7.6-el7-x8…> No credentials specified > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress --prune http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 7ff2d84e95416ee1b17480ab34f3fc11f26a6646 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 7ff2d84e95416ee1b17480ab34f3fc11f26a6646 Commit message: "Only run mirror cleanup if a sync is needed" > git rev-list --no-walk f195db17ced7f624045b0028e6b1defab5655564 # timeout=10 [system-sync_mirrors-centos-updates-7.6-el7-x86_64] $ /bin/bash -xe /tmp/jenkins6640943638909043602.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-updates-7.6-el7 x86_64 jenkins/data/mirrors-reposync.conf + MIRRORS_MP_BASE=/var/www/html/repos + MIRRORS_HTTP_BASE=http://mirrors.phx.ovirt.org/repos + MIRRORS_CACHE=/home/jenkins/mirrors_cache + YUM_PATH=/yum/ + MIRRORS_BASE_PREFIX=/var/www/html/repos/yum/ + REPOQUERY_HTTP_BASE=http://mirrors.phx.ovirt.org/repos/yum/ + MAX_LOCK_ATTEMPTS=120 + LOCK_WAIT_INTERVAL=5 + LOCK_BASE=/home/jenkins + OLD_MD_TO_KEEP=100 + MAX_AGE=14 + HTTP_SELINUX_TYPE=httpd_sys_content_t + HTTP_FILE_MODE=644 + main resync_yum_mirror centos-updates-7.6-el7 x86_64 jenkins/data/mirrors-reposync.conf + local command=resync_yum_mirror + command_args=("${@:2}") + local command_args + cmd_resync_yum_mirror centos-updates-7.6-el7 x86_64 jenkins/data/mirrors-reposync.conf + local repo_name=centos-updates-7.6-el7 + local repo_archs=x86_64 + local reposync_conf=jenkins/data/mirrors-reposync.conf + local sync_needed + mkdir -p /home/jenkins/mirrors_cache + verify_repo_fs centos-updates-7.6-el7 yum + local repo_name=centos-updates-7.6-el7 + local repo_type=yum + sudo install -o jenkins -d /var/www/html/repos/yum /var/www/html/repos/yum/centos-updates-7.6-el7 /var/www/html/repos/yum/centos-updates-7.6-el7/base + check_yum_sync_needed centos-updates-7.6-el7 x86_64 jenkins/data/mirrors-reposync.conf sync_needed + local repo_name=centos-updates-7.6-el7 + local repo_archs=x86_64 + local reposync_conf=jenkins/data/mirrors-reposync.conf + local p_sync_needed=sync_needed + local reposync_out + echo 'Checking if mirror needs a resync' Checking if mirror needs a resync + rm -rf /home/jenkins/mirrors_cache/centos-updates-7.6-el7 ++ IFS=, ++ echo x86_64 + for arch in '$(IFS=,; echo $repo_archs)' ++ run_reposync centos-updates-7.6-el7 x86_64 jenkins/data/mirrors-reposync.conf --urls --quiet ++ local repo_name=centos-updates-7.6-el7 ++ local repo_arch=x86_64 ++ local reposync_conf=jenkins/data/mirrors-reposync.conf ++ extra_args=("${@:4}") ++ local extra_args ++ reposync --config=jenkins/data/mirrors-reposync.conf --repoid=centos-updates-7.6-el7 --arch=x86_64 --cachedir=/home/jenkins/mirrors_cache --download_path=/var/www/html/repos/yum/centos-updates-7.6-el7/base --norepopath --newest-only --urls --quiet Error setting up repositories: failure: repodata/65b728bb44786c3cfb7b7b8ac9eaf86217c43cdef1560c939dadb7860aaf042a-primary.sqlite.bz2 from centos-updates-7.6-el7: [Errno 256] No more mirrors to try. http://vault.centos.org/7.6.1810/updates/x86_64/repodata/65b728bb44786c3cfb…: [Errno 16] error setting timestamp on file /home/jenkins/mirrors_cache/centos-updates-7.6-el7/65b728bb44786c3cfb7b7b8ac9eaf86217c43cdef1560c939dadb7860aaf042a-primary.sqlite.bz2 from http://vault.centos.org/7.6.1810/updates/x86_64/repodata/65b728bb44786c3cfb…, OSError: [Errno 2] No such file or directory: '/home/jenkins/mirrors_cache/centos-updates-7.6-el7/65b728bb44786c3cfb7b7b8ac9eaf86217c43cdef1560c939dadb7860aaf042a-primary.sqlite.bz2' + reposync_out= Build step 'Execute shell' marked build as failure

1 1

[CQ]: 108220, 1 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 15 Apr '20

15 Apr '20

A system test invoked by the "ovirt-master" change queue including change 108220,1 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 108081,5 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 108081,5 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/108220/1 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/108081/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/23039/

1 0

[CQ]: 108218, 2 (ovirt-engine-sdk-java) failed "ovirt-master" system tests
by oVirt Jenkins 15 Apr '20

15 Apr '20

Change 108218,2 (ovirt-engine-sdk-java) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/108218/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/23028/

1 0

oVirt infra daily report - unstable production jobs - 1161
by jenkins＠jenkins.phx.ovirt.org 15 Apr '20

15 Apr '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1161//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] deploy-to-gated-dummy-master - Build #285 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 15 Apr '20

15 Apr '20

Build: https://jenkins.ovirt.org/job/deploy-to-gated-dummy-master/285/ Build Name: #285 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

[CQ]: 108182, 1 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 14 Apr '20

14 Apr '20

A system test invoked by the "ovirt-master" change queue including change 108182,1 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 108081,5 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 108081,5 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/108182/1 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/108081/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/23022/

1 0

[JIRA] (OVIRT-2907) libvirt ipv6 issue with pods on r430 nodes
by Evgheni Dereveanchin (oVirt JIRA) 14 Apr '20

14 Apr '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2907?page=com.atlassian.jira.… ] Evgheni Dereveanchin reassigned OVIRT-2907: ------------------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > libvirt ipv6 issue with pods on r430 nodes > ------------------------------------------ > > Key: OVIRT-2907 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2907 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: Evgheni Dereveanchin > > some pods running on r430 nodes are still causing removal of modules on the host which causes OST failures, specifically for HC suite which runs on these nodes: > https://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.3/lastFai… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100124)

1 0

[JIRA] (OVIRT-2907) libvirt ipv6 issue with pods on r430 nodes
by Evgheni Dereveanchin (oVirt JIRA) 14 Apr '20

14 Apr '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2907?page=com.atlassian.jira.… ] Evgheni Dereveanchin commented on OVIRT-2907: --------------------------------------------- r430 nodes are used by the {{ openshift-integ-tests-container-big }} pod spec on Jenkins. The same worker container is used so rmmod should be removed from them via global_setup: [https://gerrit.ovirt.org/#/c/106891/|https://gerrit.ovirt.org/#/c/106891/] So either some either kind of workloads is doing this (kubevirt SR-IOV lanes?) or there’s some other condition causing rmmod to not be deactivated. 4 out of 5 bare r430 metals were lacking modules last week. I reloaded them and today they were missing again so the root cause needs to be found as it’s some often-running pod. > libvirt ipv6 issue with pods on r430 nodes > ------------------------------------------ > > Key: OVIRT-2907 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2907 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: infra > > some pods running on r430 nodes are still causing removal of modules on the host which causes OST failures, specifically for HC suite which runs on these nodes: > https://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.3/lastFai… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100124)

1 0

[JIRA] (OVIRT-2907) libvirt ipv6 issue with pods on r430 nodes
by Evgheni Dereveanchin (oVirt JIRA) 14 Apr '20

14 Apr '20

Evgheni Dereveanchin created OVIRT-2907: ------------------------------------------- Summary: libvirt ipv6 issue with pods on r430 nodes Key: OVIRT-2907 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2907 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Evgheni Dereveanchin Assignee: infra some pods running on r430 nodes are still causing removal of modules on the host which causes OST failures, specifically for HC suite which runs on these nodes: https://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.3/lastFai… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100124)

1 0