January 2021 - Infra - oVirt List Archives

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_el7-nightly - Build # 154 - Failure!
by jenkins＠jenkins.phx.ovirt.org 04 Feb '21

04 Feb '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build Number: 154 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #154 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- No tests ran.

1 19

Re: manual job does not use custom repo
by Yedidyah Bar David 01 Feb '21

01 Feb '21

On Sun, Jan 17, 2021 at 2:42 PM Yedidyah Bar David <didi(a)redhat.com> wrote: > > Hi all, > > Ran [1] for verifying [2]. Passed [3] as CUSTOM_REPOS. > > lago.log [4] shows that it did add it to internal_repo, but it was not > actually installed later. Perhaps something changed in local repos > handling or something like that? Now happened again, so I spent some more time looking. I tried this locally (on buri03) and it did work - passing '-s URL' to run_suite.sh did install/update packages from there. In CI it does not, e.g. [1]. I think that the problem is around here, inside global_setup.sh: *11:04:29* + sudo -nl firewall-cmd *11:04:29* ++ sudo -n firewall-cmd --query-service=ovirtlago *11:04:30* + [[ ! -n yes ]] *11:04:30* + known_hosts Meaning, there were no sudo permissions to run firewall-cmd, so it didn't add 8585, so later (in lago.log): + ADDR=192.168.200.1 + curl_res=0 + curl -f http://192.168.200.1:8585/default/el8/repodata/repomd.xml % Total % Received % Xferd Average Speed Time Time Time Current Dload Upload Total Spent Left Speed \r 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed to connect to 192.168.200.1 port 8585: Connection refused + curl_res=7 Since this seems like an infra issue, moving to infra list. Can someone have a look there? Thanks! Best regards, [1] https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… On Sun, Jan 17, 2021 at 2:42 PM Yedidyah Bar David <didi(a)redhat.com> wrote: > Hi all, > > Ran [1] for verifying [2]. Passed [3] as CUSTOM_REPOS. > > lago.log [4] shows that it did add it to internal_repo, but it was not > actually installed later. Perhaps something changed in local repos > handling or something like that? > > Thanks and best regards, > > [1] > https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… > > [2] https://github.com/oVirt/ovirt-ansible-collection/pull/202 > > [3] > https://jenkins.ovirt.org/job/oVirt_ovirt-ansible-collection_standard-check… > > [4] > https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… > -- > Didi > -- Didi

2 4

oVirt infra daily report - unstable production jobs - 1453
by jenkins＠jenkins.phx.ovirt.org 31 Jan '21

31 Jan '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1453//artifact/exported… Cheers, Jenkins

1 0

[CQ]: 113034, 16 (ovirt-system-tests) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 31 Jan '21

31 Jan '21

A system test invoked by the "ovirt-master" change queue including change 113034,16 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 113144,5 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 113144,5 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113034/16 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113144/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/27885/

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 165 - Failure!
by jenkins＠jenkins.phx.ovirt.org 31 Jan '21

31 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/16… Build Number: 165 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #165 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 694, in run_vms vm0_service.start(use_cloud_init=True, vm=vm_params) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 32520, in start return self._internal_action(action, 'start', None, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 134, in _check_fault self._raise_error(response, body.fault) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400.

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 828 - Failure!
by jenkins＠jenkins.phx.ovirt.org 30 Jan '21

30 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 828 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #828 [Sandro Bonazzola] common: yum: cq: switch to Gluster 8 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.test_005_network_by_label.test_assign_hosts_network_label Error Message: ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Cannot add Label. Operation can be performed only when Host status is Maintenance, Up, NonOperational.]". HTTP response code is 409. Stack Trace: engine_api = <ovirtsdk4.Connection object at 0x7f92b5c8eb00> def test_assign_hosts_network_label(engine_api): """ Assigns NETWORK_LABEL to first network interface of every host in cluster """ engine = engine_api.system_service() def _assign_host_network_label(host): host_service = engine.hosts_service().host_service(id=host.id) nics_service = host_service.nics_service() nics = sorted(nics_service.list(), key=lambda n: n.name) assert len(nics) >= 1 nic = nics[0] nic_service = nics_service.nic_service(id=nic.id) labels_service = nic_service.network_labels_service() return labels_service.add( NetworkLabel( id=NETWORK_LABEL, host_nic=nic ) ) hosts = test_utils.hosts_in_cluster_v4(engine, CLUSTER_NAME) vec = utils.func_vector(_assign_host_network_label, [(h,) for h in hosts]) vt = utils.VectorThread(vec) vt.start_all() > assert all(vt.join_all()) ../basic-suite-master/test-scenarios/test_005_network_by_label.py:81: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ../ost_utils/ost_utils/utils.py:106: in join_all six.reraise(*exc_info) /usr/lib/python3.6/site-packages/six.py:703: in reraise raise value ../ost_utils/ost_utils/utils.py:67: in _ret_via_queue queue.put({'return': func()}) ../basic-suite-master/test-scenarios/test_005_network_by_label.py:73: in _assign_host_network_label host_nic=nic /usr/lib64/python3.6/site-packages/ovirtsdk4/services.py:17439: in add return self._internal_add(label, headers, query, wait) /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:232: in _internal_add return future.wait() if wait else future /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:55: in wait return self._code(response) /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:229: in callback self._check_fault(response) /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:132: in _check_fault self._raise_error(response, body) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ response = <ovirtsdk4.http.Response object at 0x7f92b5c6a320> detail = <ovirtsdk4.types.Fault object at 0x7f92b5c67400> @staticmethod def _raise_error(response, detail=None): """ Creates and raises an error containing the details of the given HTTP response and fault. This method is intended for internal use by other components of the SDK. Refrain from using it directly, as backwards compatibility isn't guaranteed. """ fault = detail if isinstance(detail, types.Fault) else None msg = '' if fault: if fault.reason: if msg: msg += ' ' msg = msg + 'Fault reason is "%s".' % fault.reason if fault.detail: if msg: msg += ' ' msg = msg + 'Fault detail is "%s".' % fault.detail if response: if response.code: if msg: msg += ' ' msg = msg + 'HTTP response code is %s.' % response.code if response.message: if msg: msg += ' ' msg = msg + 'HTTP response message is "%s".' % response.message if isinstance(detail, six.string_types): if msg: msg += ' ' msg = msg + detail + '.' class_ = Error if response is not None: if response.code in [401, 403]: class_ = AuthError elif response.code == 404: class_ = NotFoundError error = class_(msg) error.code = response.code if response else None error.fault = fault > raise error E ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Cannot add Label. Operation can be performed only when Host status is Maintenance, Up, NonOperational.]". HTTP response code is 409. /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:118: Error

1 1

oVirt infra daily report - unstable production jobs - 1452
by jenkins＠jenkins.phx.ovirt.org 30 Jan '21

30 Jan '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1452//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 161 - Failure!
by jenkins＠jenkins.phx.ovirt.org 30 Jan '21

30 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/16… Build Number: 161 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #161 [parthdhanjal] WIP: hc-4.3 fix [Ehud Yonasi] psi: fix node label allocation for vms. ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 098_ovirt_provider_ovn.use_ovn_provider Error Message: Fault reason is "Operation Failed". Fault detail is "[Cannot add Network. The name of the logical network 'network_1' is already used by an existing logical network in the same data-center. -Please choose a different name.]". HTTP response code is 409. -------------------- >> begin captured logging << -------------------- urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:35357 py.warnings: WARNING: Unverified HTTPS request is being made to host '192.168.202.2'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings urllib3.connectionpool: DEBUG: https://192.168.202.2:35357 "POST /v2.0/tokens/ HTTP/1.1" 200 None urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696 py.warnings: WARNING: Unverified HTTPS request is being made to host '192.168.202.2'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings urllib3.connectionpool: DEBUG: https://192.168.202.2:9696 "GET /v2.0/networks/ HTTP/1.1" 200 None urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696 py.warnings: WARNING: Unverified HTTPS request is being made to host '192.168.202.2'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings urllib3.connectionpool: DEBUG: https://192.168.202.2:9696 "GET /v2.0/ports/ HTTP/1.1" 200 None urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696 py.warnings: WARNING: Unverified HTTPS request is being made to host '192.168.202.2'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings urllib3.connectionpool: DEBUG: https://192.168.202.2:9696 "GET /v2.0/subnets/ HTTP/1.1" 200 None urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696 py.warnings: WARNING: Unverified HTTPS request is being made to host '192.168.202.2'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings urllib3.connectionpool: DEBUG: https://192.168.202.2:9696 "POST /v2.0/networks/ HTTP/1.1" 201 None urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696 py.warnings: WARNING: Unverified HTTPS request is being made to host '192.168.202.2'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings urllib3.connectionpool: DEBUG: https://192.168.202.2:9696 "POST /v2.0/subnets/ HTTP/1.1" 201 None urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696 py.warnings: WARNING: Unverified HTTPS request is being made to host '192.168.202.2'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings urllib3.connectionpool: DEBUG: https://192.168.202.2:9696 "POST /v2.0/ports/ HTTP/1.1" 201 None urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696 py.warnings: WARNING: Unverified HTTPS request is being made to host '192.168.202.2'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings urllib3.connectionpool: DEBUG: https://192.168.202.2:9696 "GET /v2.0/networks/ HTTP/1.1" 200 None urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696 py.warnings: WARNING: Unverified HTTPS request is being made to host '192.168.202.2'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings urllib3.connectionpool: DEBUG: https://192.168.202.2:9696 "GET /v2.0/ports/ HTTP/1.1" 200 None urllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696 py.warnings: WARNING: Unverified HTTPS request is being made to host '192.168.202.2'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings urllib3.connectionpool: DEBUG: https://192.168.202.2:9696 "GET /v2.0/subnets/ HTTP/1.1" 200 None --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/098_ovirt_provider_ovn.py", line 461, in use_ovn_provider _import_network_to_ovirt(api, provider_id, network1_id, datacenter_id) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/098_ovirt_provider_ovn.py", line 347, in _import_network_to_ovirt id=datacenter_id File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 18492, in import_ return self._internal_action(action, 'import', None, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 134, in _check_fault self._raise_error(response, body.fault) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error 'Fault reason is "Operation Failed". Fault detail is "[Cannot add Network. The name of the logical network \'network_1\' is already used by an existing logical network in the same data-center.\n-Please choose a different name.]". HTTP response code is 409.\n-------------------- >> begin captured logging << --------------------\nurllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:35357\npy.warnings: WARNING: Unverified HTTPS request is being made to host \'192.168.202.2\'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings\n…: DEBUG: https://192.168.202.2:35357 "POST /v2.0/tokens/ HTTP/1.1" 200 None\nurllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696\npy.warnings: WARNING: Unverified HTTPS request is being made to host \'192.168.202.2\'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings\n…: DEBUG: https://192.168.202.2:9696 "GET /v2.0/networks/ HTTP/1.1" 200 None\nurllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696\npy.warnings: WARNING: Unverified HTTPS request is being made to host \'192.168.202.2\'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings\n…: DEBUG: https://192.168.202.2:9696 "GET /v2.0/ports/ HTTP/1.1" 200 None\nurllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696\npy.warnings: WARNING: Unverified HTTPS request is being made to host \'192.168.202.2\'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings\n…: DEBUG: https://192.168.202.2:9696 "GET /v2.0/subnets/ HTTP/1.1" 200 None\nurllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696\npy.warnings: WARNING: Unverified HTTPS request is being made to host \'192.168.202.2\'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings\n…: DEBUG: https://192.168.202.2:9696 "POST /v2.0/networks/ HTTP/1.1" 201 None\nurllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696\npy.warnings: WARNING: Unverified HTTPS request is being made to host \'192.168.202.2\'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings\n…: DEBUG: https://192.168.202.2:9696 "POST /v2.0/subnets/ HTTP/1.1" 201 None\nurllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696\npy.warnings: WARNING: Unverified HTTPS request is being made to host \'192.168.202.2\'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings\n…: DEBUG: https://192.168.202.2:9696 "POST /v2.0/ports/ HTTP/1.1" 201 None\nurllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696\npy.warnings: WARNING: Unverified HTTPS request is being made to host \'192.168.202.2\'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings\n…: DEBUG: https://192.168.202.2:9696 "GET /v2.0/networks/ HTTP/1.1" 200 None\nurllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696\npy.warnings: WARNING: Unverified HTTPS request is being made to host \'192.168.202.2\'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings\n…: DEBUG: https://192.168.202.2:9696 "GET /v2.0/ports/ HTTP/1.1" 200 None\nurllib3.connectionpool: DEBUG: Starting new HTTPS connection (1): 192.168.202.2:9696\npy.warnings: WARNING: Unverified HTTPS request is being made to host \'192.168.202.2\'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings\n…: DEBUG: https://192.168.202.2:9696 "GET /v2.0/subnets/ HTTP/1.1" 200 None\n--------------------- >> end captured logging << ---------------------'

1 2

oVirt infra daily report - unstable production jobs - 1451
by jenkins＠jenkins.phx.ovirt.org 29 Jan '21

29 Jan '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1451//artifact/exported… Cheers, Jenkins

1 0

planned Jenkins restart
by Evgheni Dereveanchin 29 Jan '21

29 Jan '21

Hi everyone, I'll be performing a planned Jenkins restart within the next hour. No new CI jobs will be scheduled during this maintenance period. I will inform you once it is back online. -- Regards, Evgheni Dereveanchin

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_el7-nightly - Build # 151 - Failure!
by jenkins＠jenkins.phx.ovirt.org 28 Jan '21

28 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build Number: 151 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #151 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- No tests ran.

1 2

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 816 - Failure!
by jenkins＠jenkins.phx.ovirt.org 28 Jan '21

28 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 816 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #816 [Galit Rosenthal] Move to bulk tests run ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.test_004_basic_sanity.test_check_snapshot_with_memory Error Message: ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Internal Engine Error]". HTTP response code is 400. Stack Trace: engine_api = <ovirtsdk4.Connection object at 0x7fc0610b1a58> @order_by(_TEST_LIST) def test_check_snapshot_with_memory(engine_api): engine = engine_api.system_service() vm_service = test_utils.get_vm_service(engine, VM0_NAME) assertions.assert_true_within_long( lambda: test_utils.get_snapshot(engine, VM0_NAME, SNAPSHOT_DESC_MEM).snapshot_status == types.SnapshotStatus.IN_PREVIEW ) > vm_service.start() ../basic-suite-master/test-scenarios/test_004_basic_sanity.py:733: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib64/python3.6/site-packages/ovirtsdk4/services.py:32605: in start return self._internal_action(action, 'start', None, headers, query, wait) /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:299: in _internal_action return future.wait() if wait else future /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:55: in wait return self._code(response) /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:296: in callback self._check_fault(response) /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:134: in _check_fault self._raise_error(response, body.fault) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ response = <ovirtsdk4.http.Response object at 0x7fc061151128> detail = <ovirtsdk4.types.Fault object at 0x7fc061151e80> @staticmethod def _raise_error(response, detail=None): """ Creates and raises an error containing the details of the given HTTP response and fault. This method is intended for internal use by other components of the SDK. Refrain from using it directly, as backwards compatibility isn't guaranteed. """ fault = detail if isinstance(detail, types.Fault) else None msg = '' if fault: if fault.reason: if msg: msg += ' ' msg = msg + 'Fault reason is "%s".' % fault.reason if fault.detail: if msg: msg += ' ' msg = msg + 'Fault detail is "%s".' % fault.detail if response: if response.code: if msg: msg += ' ' msg = msg + 'HTTP response code is %s.' % response.code if response.message: if msg: msg += ' ' msg = msg + 'HTTP response message is "%s".' % response.message if isinstance(detail, six.string_types): if msg: msg += ' ' msg = msg + detail + '.' class_ = Error if response is not None: if response.code in [401, 403]: class_ = AuthError elif response.code == 404: class_ = NotFoundError error = class_(msg) error.code = response.code if response else None error.fault = fault > raise error E ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Internal Engine Error]". HTTP response code is 400. /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:118: Error

1 6

oVirt infra daily report - unstable production jobs - 1450
by jenkins＠jenkins.phx.ovirt.org 28 Jan '21

28 Jan '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1450//artifact/exported… Cheers, Jenkins

1 0

[CQ]: 113056, 8 (ovirt-system-tests) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 28 Jan '21

28 Jan '21

A system test invoked by the "ovirt-master" change queue including change 113056,8 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 113144,5 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 113144,5 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113056/8 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113144/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/27879/

1 0

[CQ]: 113057, 7 (ovirt-system-tests) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 28 Jan '21

28 Jan '21

A system test invoked by the "ovirt-master" change queue including change 113057,7 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 113144,5 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 113144,5 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113057/7 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113144/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/27878/

1 0

[CQ]: 113058, 4 (ovirt-system-tests) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 28 Jan '21

28 Jan '21

A system test invoked by the "ovirt-master" change queue including change 113058,4 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 113144,5 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 113144,5 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113058/4 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113144/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/27877/

1 0

[CQ]: 113201, 1 (ovirt-system-tests) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 28 Jan '21

28 Jan '21

A system test invoked by the "ovirt-master" change queue including change 113201,1 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 113144,5 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 113144,5 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113201/1 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113144/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/27865/

1 0

[CQ]: 45b18ea (ovirt-web-ui) failed "ovirt-master" system tests
by oVirt Jenkins 28 Jan '21

28 Jan '21

Change 45b18ea (ovirt-web-ui) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://github.com/oVirt/ovirt-web-ui/commit/45b18ea20e007c55612276fcc0487e… For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/27859/

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_el7-nightly - Build # 136 - Failure!
by jenkins＠jenkins.phx.ovirt.org 27 Jan '21

27 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build Number: 136 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #136 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- No tests ran.

1 14

[oVirt Jenkins] cleanup-gated-dummy-master - Build #403 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 27 Jan '21

27 Jan '21

Build: https://jenkins.ovirt.org/job/cleanup-gated-dummy-master/403/ Build Name: #403 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 153 - Failure!
by jenkins＠jenkins.phx.ovirt.org 27 Jan '21

27 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/15… Build Number: 153 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #153 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: False != True after 600 seconds Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 697, in run_vms _verify_vm_state(engine, vm_name, types.VmStatus.UP) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 102, in _verify_vm_state lambda: File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) AssertionError: False != True after 600 seconds

1 2

oVirt infra daily report - unstable production jobs - 1449
by jenkins＠jenkins.phx.ovirt.org 27 Jan '21

27 Jan '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1449//artifact/exported… Cheers, Jenkins

1 0

[CQ]: 113033, 7 (ovirt-system-tests) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 27 Jan '21

27 Jan '21

A system test invoked by the "ovirt-master" change queue including change 113033,7 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 113144,5 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 113144,5 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113033/7 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113144/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/27834/

1 0

[CQ]: 113144, 5 (ovirt-system-tests) failed "ovirt-master" system tests
by oVirt Jenkins 27 Jan '21

27 Jan '21

Change 113144,5 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113144/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/27827/

1 0

[CQ]: a41b92f (ovirt-web-ui) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 27 Jan '21

27 Jan '21

A system test invoked by the "ovirt-master" change queue including change a41b92f (ovirt-web-ui) failed. However, this change seems not to be the root cause for this failure. Change c254c57 (ovirt-web-ui) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change c254c57 (ovirt-web-ui) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://github.com/oVirt/ovirt-web-ui/commit/a41b92f1e340480129c2cd5f6c9da5… For further details about the change that seems to be the root cause behind the testing failures see: https://github.com/oVirt/ovirt-web-ui/commit/c254c574f060ab5635ac918b657d6c… For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/27823/

1 0