- Infra - oVirt List Archives

oVirt infra daily report - unstable production jobs - 1671
by jenkins＠jenkins.phx.ovirt.org 07 Sep '21

07 Sep '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1671//artifact/exported… Cheers, Jenkins

1 0

Jenkins blocking issue sitting 2 weeks without update
by Sandro Bonazzola 06 Sep '21

06 Sep '21

Hi, anyone available to have a look at why jenkins is not honoring .packages and .req file for STDCI? The ticket I opened 2 weeks ago here https://issues.redhat.com/browse/CPDEVOPS-242 is silent even if marked with priority blocker. -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/> *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

1 0

Build failed in Jenkins: system-sync_mirrors-ovirt-master-epel-testing-el8-x86_64 #1567
by jenkins＠jenkins.phx.ovirt.org 06 Sep '21

06 Sep '21

See <https://jenkins.ovirt.org/job/system-sync_mirrors-ovirt-master-epel-testing…> Changes: ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <https://jenkins.ovirt.org/job/system-sync_mirrors-ovirt-master-epel-testing…> The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir <https://jenkins.ovirt.org/job/system-sync_mirrors-ovirt-master-epel-testing…> # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git --version # 'git version 1.8.3.1' > git fetch --tags --progress --prune http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 48b119776a538d52cd94a2780deb89d74358bf8e (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 48b119776a538d52cd94a2780deb89d74358bf8e # timeout=10 Commit message: "SubScript called from Main script cause main script to fail" > git rev-list --no-walk 48b119776a538d52cd94a2780deb89d74358bf8e # timeout=10 [system-sync_mirrors-ovirt-master-epel-testing-el8-x86_64] $ /bin/bash -xe /tmp/jenkins4034900478439395767.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror ovirt-master-epel-testing-el8 x86_64 jenkins/data/mirrors-reposync.conf + MIRRORS_MP_BASE=/var/www/html/repos + MIRRORS_HTTP_BASE=http://mirrors.phx.ovirt.org/repos + MIRRORS_CACHE=/home/jenkins/mirrors_cache + YUM_PATH=/yum/ + MIRRORS_BASE_PREFIX=/var/www/html/repos/yum/ + REPOQUERY_HTTP_BASE=http://mirrors.phx.ovirt.org/repos/yum/ + MAX_LOCK_ATTEMPTS=120 + LOCK_WAIT_INTERVAL=5 + LOCK_BASE=/home/jenkins + OLD_MD_TO_KEEP=100 + MAX_AGE=14 + HTTP_SELINUX_TYPE=httpd_sys_content_t + HTTP_FILE_MODE=644 + main resync_yum_mirror ovirt-master-epel-testing-el8 x86_64 jenkins/data/mirrors-reposync.conf + local command=resync_yum_mirror + command_args=("${@:2}") + local command_args + cmd_resync_yum_mirror ovirt-master-epel-testing-el8 x86_64 jenkins/data/mirrors-reposync.conf + local repo_name=ovirt-master-epel-testing-el8 + local repo_archs=x86_64 + local reposync_conf=jenkins/data/mirrors-reposync.conf + local sync_needed + mkdir -p /home/jenkins/mirrors_cache + verify_repo_fs ovirt-master-epel-testing-el8 yum + local repo_name=ovirt-master-epel-testing-el8 + local repo_type=yum + sudo install -o jenkins -d /var/www/html/repos/yum /var/www/html/repos/yum/ovirt-master-epel-testing-el8 /var/www/html/repos/yum/ovirt-master-epel-testing-el8/base + modify_reposync_conf ovirt-master-epel-testing-el8 jenkins/data/mirrors-reposync.conf + local repo_name=ovirt-master-epel-testing-el8 + local reposync_conf=jenkins/data/mirrors-reposync.conf + local tmp_file=reposync.tmp + awk -v RS= -v 'ORS=\n\n' /main/ jenkins/data/mirrors-reposync.conf + awk -v RS= -v 'ORS=\n\n' /ovirt-master-epel-testing-el8/ jenkins/data/mirrors-reposync.conf + mv reposync.tmp jenkins/data/mirrors-reposync.conf + check_yum_sync_needed ovirt-master-epel-testing-el8 x86_64 jenkins/data/mirrors-reposync.conf sync_needed + local repo_name=ovirt-master-epel-testing-el8 + local repo_archs=x86_64 + local reposync_conf=jenkins/data/mirrors-reposync.conf + local p_sync_needed=sync_needed + local reposync_out + echo 'Checking if mirror needs a resync' Checking if mirror needs a resync + rm -rf /home/jenkins/mirrors_cache/ovirt-master-epel-testing-el8 ++ IFS=, ++ echo x86_64 + for arch in '$(IFS=,; echo $repo_archs)' ++ run_reposync ovirt-master-epel-testing-el8 x86_64 jenkins/data/mirrors-reposync.conf --urls --quiet ++ local repo_name=ovirt-master-epel-testing-el8 ++ local repo_arch=x86_64 ++ local reposync_conf=jenkins/data/mirrors-reposync.conf ++ extra_args=("${@:4}") ++ local extra_args ++ reposync --config=jenkins/data/mirrors-reposync.conf --repoid=ovirt-master-epel-testing-el8 --arch=x86_64 --cachedir=/home/jenkins/mirrors_cache --download_path=/var/www/html/repos/yum/ovirt-master-epel-testing-el8/base --norepopath --urls --quiet Could not retrieve mirrorlist http://mirrors.fedoraproject.org/mirrorlist?repo=testing-epel8&arch=x86_64 error was 14: HTTP Error 503 - Service Unavailable Error setting up repositories: Cannot find a valid baseurl for repo: ovirt-master-epel-testing-el8 + reposync_out= Build step 'Execute shell' marked build as failure

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 819 - Failure!
by jenkins＠jenkins.phx.ovirt.org 06 Sep '21

06 Sep '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/81… Build Number: 819 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #819 [parthdhanjal] Updating max click version ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.verify_glance_import Error Message: False != True after 600 seconds Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 69, in wrapper return func(prefix.virt_env.engine_vm().get_api(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 1130, in verify_glance_import lambda: api.disks.get(disk_name).status.state == 'ok', File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) AssertionError: False != True after 600 seconds

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 817 - Failure!
by jenkins＠jenkins.phx.ovirt.org 06 Sep '21

06 Sep '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/81… Build Number: 817 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #817 [parthdhanjal] Updating max click version ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 694, in run_vms vm0_service.start(use_cloud_init=True, vm=vm_params) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 32520, in start return self._internal_action(action, 'start', None, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 134, in _check_fault self._raise_error(response, body.fault) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400.

1 1

oVirt infra daily report - unstable production jobs - 1670
by jenkins＠jenkins.phx.ovirt.org 06 Sep '21

06 Sep '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1670//artifact/exported… Cheers, Jenkins

1 0

Build failed in Jenkins: system-sync_mirrors-ovirt-master-epel-testing-el8-x86_64 #1564
by jenkins＠jenkins.phx.ovirt.org 05 Sep '21

05 Sep '21

See <https://jenkins.ovirt.org/job/system-sync_mirrors-ovirt-master-epel-testing…> Changes: ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <https://jenkins.ovirt.org/job/system-sync_mirrors-ovirt-master-epel-testing…> The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir <https://jenkins.ovirt.org/job/system-sync_mirrors-ovirt-master-epel-testing…> # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git --version # 'git version 1.8.3.1' > git fetch --tags --progress --prune http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 48b119776a538d52cd94a2780deb89d74358bf8e (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 48b119776a538d52cd94a2780deb89d74358bf8e # timeout=10 Commit message: "SubScript called from Main script cause main script to fail" > git rev-list --no-walk 48b119776a538d52cd94a2780deb89d74358bf8e # timeout=10 [system-sync_mirrors-ovirt-master-epel-testing-el8-x86_64] $ /bin/bash -xe /tmp/jenkins2698096933116544577.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror ovirt-master-epel-testing-el8 x86_64 jenkins/data/mirrors-reposync.conf + MIRRORS_MP_BASE=/var/www/html/repos + MIRRORS_HTTP_BASE=http://mirrors.phx.ovirt.org/repos + MIRRORS_CACHE=/home/jenkins/mirrors_cache + YUM_PATH=/yum/ + MIRRORS_BASE_PREFIX=/var/www/html/repos/yum/ + REPOQUERY_HTTP_BASE=http://mirrors.phx.ovirt.org/repos/yum/ + MAX_LOCK_ATTEMPTS=120 + LOCK_WAIT_INTERVAL=5 + LOCK_BASE=/home/jenkins + OLD_MD_TO_KEEP=100 + MAX_AGE=14 + HTTP_SELINUX_TYPE=httpd_sys_content_t + HTTP_FILE_MODE=644 + main resync_yum_mirror ovirt-master-epel-testing-el8 x86_64 jenkins/data/mirrors-reposync.conf + local command=resync_yum_mirror + command_args=("${@:2}") + local command_args + cmd_resync_yum_mirror ovirt-master-epel-testing-el8 x86_64 jenkins/data/mirrors-reposync.conf + local repo_name=ovirt-master-epel-testing-el8 + local repo_archs=x86_64 + local reposync_conf=jenkins/data/mirrors-reposync.conf + local sync_needed + mkdir -p /home/jenkins/mirrors_cache + verify_repo_fs ovirt-master-epel-testing-el8 yum + local repo_name=ovirt-master-epel-testing-el8 + local repo_type=yum + sudo install -o jenkins -d /var/www/html/repos/yum /var/www/html/repos/yum/ovirt-master-epel-testing-el8 /var/www/html/repos/yum/ovirt-master-epel-testing-el8/base + modify_reposync_conf ovirt-master-epel-testing-el8 jenkins/data/mirrors-reposync.conf + local repo_name=ovirt-master-epel-testing-el8 + local reposync_conf=jenkins/data/mirrors-reposync.conf + local tmp_file=reposync.tmp + awk -v RS= -v 'ORS=\n\n' /main/ jenkins/data/mirrors-reposync.conf + awk -v RS= -v 'ORS=\n\n' /ovirt-master-epel-testing-el8/ jenkins/data/mirrors-reposync.conf + mv reposync.tmp jenkins/data/mirrors-reposync.conf + check_yum_sync_needed ovirt-master-epel-testing-el8 x86_64 jenkins/data/mirrors-reposync.conf sync_needed + local repo_name=ovirt-master-epel-testing-el8 + local repo_archs=x86_64 + local reposync_conf=jenkins/data/mirrors-reposync.conf + local p_sync_needed=sync_needed + local reposync_out + echo 'Checking if mirror needs a resync' Checking if mirror needs a resync + rm -rf /home/jenkins/mirrors_cache/ovirt-master-epel-testing-el8 ++ IFS=, ++ echo x86_64 + for arch in '$(IFS=,; echo $repo_archs)' ++ run_reposync ovirt-master-epel-testing-el8 x86_64 jenkins/data/mirrors-reposync.conf --urls --quiet ++ local repo_name=ovirt-master-epel-testing-el8 ++ local repo_arch=x86_64 ++ local reposync_conf=jenkins/data/mirrors-reposync.conf ++ extra_args=("${@:4}") ++ local extra_args ++ reposync --config=jenkins/data/mirrors-reposync.conf --repoid=ovirt-master-epel-testing-el8 --arch=x86_64 --cachedir=/home/jenkins/mirrors_cache --download_path=/var/www/html/repos/yum/ovirt-master-epel-testing-el8/base --norepopath --urls --quiet Could not retrieve mirrorlist http://mirrors.fedoraproject.org/mirrorlist?repo=testing-epel8&arch=x86_64 error was 14: HTTP Error 503 - Service Unavailable Error setting up repositories: Cannot find a valid baseurl for repo: ovirt-master-epel-testing-el8 + reposync_out= Build step 'Execute shell' marked build as failure

1 1

[oVirt Jenkins] ovirt-release_4.3_build-artifacts-el7-x86_64 - Build # 1091 - Failure!
by jenkins＠jenkins.phx.ovirt.org 05 Sep '21

05 Sep '21

Project: https://jenkins.ovirt.org/job/ovirt-release_4.3_build-artifacts-el7-x86_64/ Build: https://jenkins.ovirt.org/job/ovirt-release_4.3_build-artifacts-el7-x86_64/… Build Number: 1091 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #1091 [Sandro Bonazzola] Revert "automation: install centos-release if missing" ----------------- Failed Tests: ----------------- No tests ran.

1 1

oVirt infra daily report - unstable production jobs - 1669
by jenkins＠jenkins.phx.ovirt.org 05 Sep '21

05 Sep '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1669//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 1474 - Failure!
by jenkins＠jenkins.phx.ovirt.org 04 Sep '21

04 Sep '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 1474 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #1474 [Michal Skrivanek] lagofy: introspect the running environment for UUID ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.test_004_basic_sanity.test_live_incremental_backup_vm2 Error Message: AssertionError: False != True after 600 seconds Stack Trace: engine_api = <ovirtsdk4.Connection object at 0x7fed2b61ad68> get_vm_service_for_vm = <function get_vm_service_for_vm.<locals>.service_for at 0x7fed2928a9d8> @order_by(_TEST_LIST) def test_live_incremental_backup_vm2(engine_api, get_vm_service_for_vm): vm2_service = _verify_vm_state( engine_api.system_service(), VM2_NAME, types.VmStatus.UP ) vm2_backups_service = vm2_service.backups_service() backup.perform_incremental_vm_backup( > engine_api, vm2_backups_service, DISK2_NAME, "live_vm_backup" ) basic-suite-master/test-scenarios/test_004_basic_sanity.py:1178: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ost_utils/ost_utils/storage_utils/backup.py:81: in perform_incremental_vm_backup correlation_id="full_" + correlation_id, ost_utils/ost_utils/storage_utils/backup.py:50: in perform_vm_backup allowed_exceptions=[sdk4.NotFoundError], ost_utils/ost_utils/assertions.py:105: in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) ost_utils/ost_utils/assertions.py:88: in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ func = <function perform_vm_backup.<locals>.<lambda> at 0x7fed28fd2620> value = True, timeout = 600 allowed_exceptions = [<class 'ovirtsdk4.NotFoundError'>], initial_wait = 0 error_message = 'False != True after 600 seconds' def assert_equals_within( func, value, timeout, allowed_exceptions=None, initial_wait=10, error_message=None, ): allowed_exceptions = allowed_exceptions or [] res = '<no-result-obtained>' with _EggTimer(timeout) as timer: while not timer.elapsed(): try: res = func() if res == value: return except Exception as exc: if _instance_of_any(exc, allowed_exceptions): time.sleep(3) continue LOGGER.exception("Unhandled exception in %s", func) raise if initial_wait == 0: time.sleep(3) else: time.sleep(initial_wait) initial_wait = 0 try: if error_message is None: error_message = '%s != %s after %s seconds' % (res, value, timeout) > raise AssertionError(error_message) E AssertionError: False != True after 600 seconds ost_utils/ost_utils/assertions.py:63: AssertionError

1 1