December 2020 - Infra - oVirt List Archives

Jenkins build became unstable: ovirt_4.2_publish-rpms_nightly #1214
by jenkins＠jenkins.phx.ovirt.org 08 Jan '21

08 Jan '21

See <https://jenkins.ovirt.org/job/ovirt_4.2_publish-rpms_nightly/1214/display/r…>

1 11

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_el7-nightly - Build # 64 - Failure!
by jenkins＠jenkins.phx.ovirt.org 02 Jan '21

02 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build Number: 64 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #64 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- No tests ran.

1 8

oVirt infra daily report - unstable production jobs - 1422
by jenkins＠jenkins.phx.ovirt.org 01 Jan '21

01 Jan '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1422//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 71 - Failure!
by jenkins＠jenkins.phx.ovirt.org 31 Dec '20

31 Dec '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/71/ Build Number: 71 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #71 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 694, in run_vms vm0_service.start(use_cloud_init=True, vm=vm_params) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 32520, in start return self._internal_action(action, 'start', None, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 134, in _check_fault self._raise_error(response, body.fault) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400.

1 1

oVirt infra daily report - unstable production jobs - 1421
by jenkins＠jenkins.phx.ovirt.org 31 Dec '20

31 Dec '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1421//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 68 - Failure!
by jenkins＠jenkins.phx.ovirt.org 30 Dec '20

30 Dec '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/68/ Build Number: 68 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #68 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 694, in run_vms vm0_service.start(use_cloud_init=True, vm=vm_params) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 32520, in start return self._internal_action(action, 'start', None, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 134, in _check_fault self._raise_error(response, body.fault) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400.

1 2

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_el7-nightly - Build # 40 - Failure!
by jenkins＠jenkins.phx.ovirt.org 30 Dec '20

30 Dec '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build Number: 40 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #40 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- No tests ran.

1 23

oVirt infra daily report - unstable production jobs - 1420
by jenkins＠jenkins.phx.ovirt.org 30 Dec '20

30 Dec '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1420//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_performance-suite-master - Build # 1683 - Failure!
by jenkins＠jenkins.phx.ovirt.org 29 Dec '20

29 Dec '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/1… Build Number: 1683 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #1683 [Galit Rosenthal] Remove params ovirtsdk from hc suite [Romain Arnaud] Fix warnings when running `pytest test/` ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 040_add_hosts_vms.verify_add_hosts Error Message: 1 hosts failed installation: lago-performance-suite-master-host-1: install_failed -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function verify_add_hosts_4.<locals>.<lambda> at 0x7fa70eb68bf8> Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 236, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda> lambda: _single_host_up(hosts_service, total_hosts) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up _check_problematic_hosts(hosts_service) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts raise RuntimeError(dump_hosts) RuntimeError: 1 hosts failed installation: lago-performance-suite-master-host-1: install_failed --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python3.6/unittest/case.py", line 60, in testPartExecutor yield File "/usr/lib64/python3.6/unittest/case.py", line 622, in run testMethod() File "/usr/lib/python3.6/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 144, in wrapped_test test() File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 62, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 298, in verify_add_hosts verify_add_hosts_4(api) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in verify_add_hosts_4 lambda: _single_host_up(hosts_service, total_hosts) File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 288, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 275, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 236, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda> lambda: _single_host_up(hosts_service, total_hosts) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up _check_problematic_hosts(hosts_service) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts raise RuntimeError(dump_hosts) 1 hosts failed installation: lago-performance-suite-master-host-1: install_failed -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function verify_add_hosts_4.<locals>.<lambda> at 0x7fa70eb68bf8> Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 236, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda> lambda: _single_host_up(hosts_service, total_hosts) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up _check_problematic_hosts(hosts_service) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts raise RuntimeError(dump_hosts) RuntimeError: 1 hosts failed installation: lago-performance-suite-master-host-1: install_failed --------------------- >> end captured logging << ---------------------

1 7

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 707 - Failure!
by jenkins＠jenkins.phx.ovirt.org 29 Dec '20

29 Dec '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 707 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #707 [Galit Rosenthal] Remove params ovirtsdk from hc suite [Romain Arnaud] Fix warnings when running `pytest test/` ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.test_002_bootstrap.test_verify_add_hosts Error Message: RuntimeError: 1 hosts failed installation: lago-basic-suite-master-host-1: install_failed Stack Trace: engine_api = <ovirtsdk4.Connection object at 0x7fc32e2d25c0> @order_by(_TEST_LIST) def test_verify_add_hosts(engine_api): hosts_service = engine_api.system_service().hosts_service() hosts_status = hosts_service.list(search='datacenter={}'.format(DC_NAME)) total_hosts = len(hosts_status) dump_hosts = _host_status_to_print(hosts_service, hosts_status) LOGGER.debug('Host status, verify_add_hosts:\n {}'.format(dump_hosts)) assertions.assert_true_within( lambda: _single_host_up(hosts_service, total_hosts), > timeout=constants.ADD_HOST_TIMEOUT ) ../basic-suite-master/test-scenarios/test_002_bootstrap.py:460: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ../ost_utils/ost_utils/assertions.py:88: in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) ../ost_utils/ost_utils/assertions.py:42: in assert_equals_within res = func() ../basic-suite-master/test-scenarios/test_002_bootstrap.py:459: in <lambda> lambda: _single_host_up(hosts_service, total_hosts), ../basic-suite-master/test-scenarios/test_002_bootstrap.py:231: in _single_host_up _check_problematic_hosts(hosts_service) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ hosts_service = <ovirtsdk4.services.HostsService object at 0x7fc32d6509b0> def _check_problematic_hosts(hosts_service): problematic_hosts = hosts_service.list(search='datacenter={} AND status != installing and status != initializing and status != up'.format(DC_NAME)) if len(problematic_hosts): dump_hosts = '%s hosts failed installation:\n' % len(problematic_hosts) for host in problematic_hosts: host_service = hosts_service.host_service(host.id) dump_hosts += '%s: %s\n' % (host.name, host_service.get().status) > raise RuntimeError(dump_hosts) E RuntimeError: 1 hosts failed installation: E lago-basic-suite-master-host-1: install_failed ../basic-suite-master/test-scenarios/test_002_bootstrap.py:240: RuntimeError

1 22

oVirt infra daily report - unstable production jobs - 1419
by jenkins＠jenkins.phx.ovirt.org 29 Dec '20

29 Dec '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1419//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 62 - Failure!
by jenkins＠jenkins.phx.ovirt.org 28 Dec '20

28 Dec '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/62/ Build Number: 62 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #62 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 694, in run_vms vm0_service.start(use_cloud_init=True, vm=vm_params) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 32520, in start return self._internal_action(action, 'start', None, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 134, in _check_fault self._raise_error(response, body.fault) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400.

1 1

oVirt infra daily report - unstable production jobs - 1418
by jenkins＠jenkins.phx.ovirt.org 28 Dec '20

28 Dec '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1418//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 60 - Failure!
by jenkins＠jenkins.phx.ovirt.org 27 Dec '20

27 Dec '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/60/ Build Number: 60 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #60 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 694, in run_vms vm0_service.start(use_cloud_init=True, vm=vm_params) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 32520, in start return self._internal_action(action, 'start', None, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 134, in _check_fault self._raise_error(response, body.fault) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400.

1 1

[oVirt Jenkins] cleanup-gated-dummy-master - Build #372 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 27 Dec '20

27 Dec '20

Build: https://jenkins.ovirt.org/job/cleanup-gated-dummy-master/372/ Build Name: #372 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

oVirt infra daily report - unstable production jobs - 1417
by jenkins＠jenkins.phx.ovirt.org 27 Dec '20

27 Dec '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1417//artifact/exported… Cheers, Jenkins

1 0

oVirt infra daily report - unstable production jobs - 1416
by jenkins＠jenkins.phx.ovirt.org 26 Dec '20

26 Dec '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1416//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 54 - Failure!
by jenkins＠jenkins.phx.ovirt.org 25 Dec '20

25 Dec '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/54/ Build Number: 54 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #54 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: False != True after 600 seconds Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 697, in run_vms _verify_vm_state(engine, vm_name, types.VmStatus.UP) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 102, in _verify_vm_state lambda: File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) AssertionError: False != True after 600 seconds

1 1

oVirt infra daily report - unstable production jobs - 1415
by jenkins＠jenkins.phx.ovirt.org 25 Dec '20

25 Dec '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1415//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-3076) mock_runner fails on automation/basic_suite_master.sh
by Yedidyah Bar David (oVirt JIRA) 24 Dec '20

24 Dec '20

Yedidyah Bar David created OVIRT-3076: ----------------------------------------- Summary: mock_runner fails on automation/basic_suite_master.sh Key: OVIRT-3076 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3076 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Yedidyah Bar David Assignee: infra Hi all, See e.g. [1][2][3]: 22:29:59 ERROR: Command failed: 22:29:59 # /bin/mount -n --bind /var/run/docker.sock /var/lib/mock/epel-7-x86_64-243a67eeccf40e93705fec68eb3d7680-1846418/root/var/run/docker.sock 22:29:59 22:29:59 mv: missing destination file operand after '/tmp/mock_logs.Z5WlIgD3/script' 22:29:59 Try 'mv --help' for more information. 22:29:59 rmdir: failed to remove './mock_logs.Wo5BsLbN': No such file or directory 22:29:59 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 22:29:59 @@ Wed Dec 23 20:29:59 UTC 2020 automation/basic_suite_master.sh chroot finished I am not sure it's a bug in mock_runner, or perhaps in above (basic_suite_master.sh), or elsewhere - it's a bit hard to understand from the logs. Thanks and best regards, [1] https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… [2] https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… [3] https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… -- Didi -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100153)

1 0

mock_runner fails on automation/basic_suite_master.sh
by Yedidyah Bar David 24 Dec '20

24 Dec '20

Hi all, See e.g. [1][2][3]: 22:29:59 ERROR: Command failed: 22:29:59 # /bin/mount -n --bind /var/run/docker.sock /var/lib/mock/epel-7-x86_64-243a67eeccf40e93705fec68eb3d7680-1846418/root/var/run/docker.sock 22:29:59 22:29:59 mv: missing destination file operand after '/tmp/mock_logs.Z5WlIgD3/script' 22:29:59 Try 'mv --help' for more information. 22:29:59 rmdir: failed to remove './mock_logs.Wo5BsLbN': No such file or directory 22:29:59 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 22:29:59 @@ Wed Dec 23 20:29:59 UTC 2020 automation/basic_suite_master.sh chroot finished I am not sure it's a bug in mock_runner, or perhaps in above (basic_suite_master.sh), or elsewhere - it's a bit hard to understand from the logs. Thanks and best regards, [1] https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… [2] https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… [3] https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… -- Didi

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 50 - Failure!
by jenkins＠jenkins.phx.ovirt.org 24 Dec '20

24 Dec '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/50/ Build Number: 50 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #50 [parthdhanjal] WIP: hc-4.3 fix [Romain Arnaud] Fix warnings when running `pytest test/` ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: False != True after 600 seconds Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 697, in run_vms _verify_vm_state(engine, vm_name, types.VmStatus.UP) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 102, in _verify_vm_state lambda: File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) AssertionError: False != True after 600 seconds

1 1

oVirt infra daily report - unstable production jobs - 1414
by jenkins＠jenkins.phx.ovirt.org 24 Dec '20

24 Dec '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1414//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_performance-suite-master - Build # 1681 - Failure!
by jenkins＠jenkins.phx.ovirt.org 23 Dec '20

23 Dec '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/1… Build Number: 1681 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #1681 [Galit Rosenthal] Remove OST from zuul ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 040_add_hosts_vms.verify_add_hosts Error Message: 1 hosts failed installation: lago-performance-suite-master-host-1: install_failed -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function verify_add_hosts_4.<locals>.<lambda> at 0x7f3a11942bf8> Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 236, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda> lambda: _single_host_up(hosts_service, total_hosts) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up _check_problematic_hosts(hosts_service) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts raise RuntimeError(dump_hosts) RuntimeError: 1 hosts failed installation: lago-performance-suite-master-host-1: install_failed --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python3.6/unittest/case.py", line 60, in testPartExecutor yield File "/usr/lib64/python3.6/unittest/case.py", line 622, in run testMethod() File "/usr/lib/python3.6/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 144, in wrapped_test test() File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 62, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 298, in verify_add_hosts verify_add_hosts_4(api) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in verify_add_hosts_4 lambda: _single_host_up(hosts_service, total_hosts) File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 288, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 275, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 236, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda> lambda: _single_host_up(hosts_service, total_hosts) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up _check_problematic_hosts(hosts_service) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts raise RuntimeError(dump_hosts) 1 hosts failed installation: lago-performance-suite-master-host-1: install_failed -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function verify_add_hosts_4.<locals>.<lambda> at 0x7f3a11942bf8> Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 236, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda> lambda: _single_host_up(hosts_service, total_hosts) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up _check_problematic_hosts(hosts_service) File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts raise RuntimeError(dump_hosts) RuntimeError: 1 hosts failed installation: lago-performance-suite-master-host-1: install_failed --------------------- >> end captured logging << ---------------------

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 45 - Failure!
by jenkins＠jenkins.phx.ovirt.org 23 Dec '20

23 Dec '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/45/ Build Number: 45 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #45 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 694, in run_vms vm0_service.start(use_cloud_init=True, vm=vm_params) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 32520, in start return self._internal_action(action, 'start', None, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 134, in _check_fault self._raise_error(response, body.fault) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400.

1 2