January 2021 - Infra - oVirt List Archives

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_el7-nightly - Build # 100 - Failure!
by jenkins＠jenkins.phx.ovirt.org 18 Jan '21

18 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build Number: 100 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #100 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- No tests ran.

1 22

oVirt infra daily report - unstable production jobs - 1440
by jenkins＠jenkins.phx.ovirt.org 18 Jan '21

18 Jan '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1440//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 125 - Failure!
by jenkins＠jenkins.phx.ovirt.org 18 Jan '21

18 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/12… Build Number: 125 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #125 [parthdhanjal] WIP: hc-4.3 fix [Nikolas Komonen] Updated test path in test_decorate.py ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 694, in run_vms vm0_service.start(use_cloud_init=True, vm=vm_params) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 32520, in start return self._internal_action(action, 'start', None, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 134, in _check_fault self._raise_error(response, body.fault) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400.

1 2

oVirt infra daily report - unstable production jobs - 1439
by jenkins＠jenkins.phx.ovirt.org 17 Jan '21

17 Jan '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1439//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] cleanup-gated-dummy-master - Build #393 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 16 Jan '21

16 Jan '21

Build: https://jenkins.ovirt.org/job/cleanup-gated-dummy-master/393/ Build Name: #393 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 784 - Failure!
by jenkins＠jenkins.phx.ovirt.org 16 Jan '21

16 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 784 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #784 [Lucia Jelinkova] UI test: fix selecting list entity ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.test_007_sd_reattach.test_detach_storage_domain Error Message: ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Cannot detach Storage. Related operation is currently in progress. Please try again later.]". HTTP response code is 409. Stack Trace: engine_api = <ovirtsdk4.Connection object at 0x7f020c1f6748> @order_by(_TEST_LIST) def test_detach_storage_domain(engine_api): engine = engine_api.system_service() dc = test_utils.data_center_service(engine, DC_NAME) test_utils.get_attached_storage_domain( > dc, SD_SECOND_NFS_NAME, service=True).remove() ../basic-suite-master/test-scenarios/test_007_sd_reattach.py:77: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib64/python3.6/site-packages/ovirtsdk4/services.py:3462: in remove self._internal_remove(headers, query, wait) /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:271: in _internal_remove return future.wait() if wait else future /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:55: in wait return self._code(response) /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:268: in callback self._check_fault(response) /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:132: in _check_fault self._raise_error(response, body) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ response = <ovirtsdk4.http.Response object at 0x7f020c213240> detail = <ovirtsdk4.types.Fault object at 0x7f020c213518> @staticmethod def _raise_error(response, detail=None): """ Creates and raises an error containing the details of the given HTTP response and fault. This method is intended for internal use by other components of the SDK. Refrain from using it directly, as backwards compatibility isn't guaranteed. """ fault = detail if isinstance(detail, types.Fault) else None msg = '' if fault: if fault.reason: if msg: msg += ' ' msg = msg + 'Fault reason is "%s".' % fault.reason if fault.detail: if msg: msg += ' ' msg = msg + 'Fault detail is "%s".' % fault.detail if response: if response.code: if msg: msg += ' ' msg = msg + 'HTTP response code is %s.' % response.code if response.message: if msg: msg += ' ' msg = msg + 'HTTP response message is "%s".' % response.message if isinstance(detail, six.string_types): if msg: msg += ' ' msg = msg + detail + '.' class_ = Error if response is not None: if response.code in [401, 403]: class_ = AuthError elif response.code == 404: class_ = NotFoundError error = class_(msg) error.code = response.code if response else None error.fault = fault > raise error E ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Cannot detach Storage. Related operation is currently in progress. Please try again later.]". HTTP response code is 409. /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:118: Error

1 1

oVirt infra daily report - unstable production jobs - 1438
by jenkins＠jenkins.phx.ovirt.org 16 Jan '21

16 Jan '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1438//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 119 - Failure!
by jenkins＠jenkins.phx.ovirt.org 16 Jan '21

16 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/11… Build Number: 119 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #119 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 694, in run_vms vm0_service.start(use_cloud_init=True, vm=vm_params) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 32520, in start return self._internal_action(action, 'start', None, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 134, in _check_fault self._raise_error(response, body.fault) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400.

1 2

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 780 - Failure!
by jenkins＠jenkins.phx.ovirt.org 15 Jan '21

15 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 780 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #780 [Marcin Sobczyk] lagofy: Add 'run_linters' function ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.test_004_basic_sanity.test_live_storage_migration Error Message: AssertionError: False != True after 600 seconds Stack Trace: engine_api = <ovirtsdk4.Connection object at 0x7fd4288d57b8> @order_by(_TEST_LIST) def test_live_storage_migration(engine_api): engine = engine_api.system_service() disk_service = test_utils.get_disk_service(engine, DISK0_NAME) correlation_id = 'live_storage_migration' disk_service.move( async=False, filter=False, storage_domain=types.StorageDomain( name=SD_ISCSI_NAME ), query={'correlation_id': correlation_id} ) assertions.assert_true_within_long(lambda: test_utils.all_jobs_finished(engine, correlation_id)) # Assert that the disk is on the correct storage domain, # its status is OK and the snapshot created for the migration # has been merged assertions.assert_true_within_long( lambda: engine_api.follow_link(disk_service.get().storage_domains[0]).name == SD_ISCSI_NAME ) vm0_snapshots_service = test_utils.get_vm_snapshots_service(engine, VM0_NAME) assertions.assert_true_within_long( > lambda: len(vm0_snapshots_service.list()) == 1 ) ../basic-suite-master/test-scenarios/test_004_basic_sanity.py:755: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ../ost_utils/ost_utils/assertions.py:98: in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) ../ost_utils/ost_utils/assertions.py:83: in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ func = <function test_live_storage_migration.<locals>.<lambda> at 0x7fd429a56e18> value = True, timeout = 600, allowed_exceptions = [], initial_wait = 0 error_message = 'False != True after 600 seconds' def assert_equals_within( func, value, timeout, allowed_exceptions=None, initial_wait=10, error_message=None ): allowed_exceptions = allowed_exceptions or [] res = '<no-result-obtained>' with _EggTimer(timeout) as timer: while not timer.elapsed(): try: res = func() if res == value: return except Exception as exc: if _instance_of_any(exc, allowed_exceptions): time.sleep(3) continue LOGGER.exception("Unhandled exception in %s", func) raise if initial_wait == 0: time.sleep(3) else: time.sleep(initial_wait) initial_wait = 0 try: if error_message is None: error_message = '%s != %s after %s seconds' % (res, value, timeout) > raise AssertionError(error_message) E AssertionError: False != True after 600 seconds ../ost_utils/ost_utils/assertions.py:61: AssertionError

1 1

[JIRA] (OVIRT-3081) [FIRING:1] InstanceUnreachable shift-n06.phx.ovirt.org kubernetes-nodes-exporter (amd64 linux shift-n06.phx.ovirt.org true true primary vm ci)
by Alertmanager_Bot (oVirt JIRA) 15 Jan '21

15 Jan '21

Alertmanager_Bot created OVIRT-3081: --------------------------------------- Summary: [FIRING:1] InstanceUnreachable shift-n06.phx.ovirt.org kubernetes-nodes-exporter (amd64 linux shift-n06.phx.ovirt.org true true primary vm ci) Key: OVIRT-3081 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3081 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Alertmanager_Bot Assignee: infra Labels: - alertname = InstanceUnreachable - beta_kubernetes_io_arch = amd64 - beta_kubernetes_io_os = linux - instance = shift-n06.phx.ovirt.org - job = kubernetes-nodes-exporter - kubernetes_io_hostname = shift-n06.phx.ovirt.org - logging_infra_fluentd = true - node_role_kubernetes_io_compute = true - region = primary - type = vm - zone = ci Annotations: - description = shift-n06.phx.ovirt.org of job kubernetes-nodes-exporter has been possibly down for more than 10 minutes. Source: http://prometheus-0:9090/graph?g0.expr=up%7Bjob%3D%22kubernetes-nodes-expor… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100154)

1 0

oVirt infra daily report - unstable production jobs - 1437
by jenkins＠jenkins.phx.ovirt.org 15 Jan '21

15 Jan '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1437//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-3080) Add jbieren to jenkins-whitelist
by Johnny Bieren (oVirt JIRA) 15 Jan '21

15 Jan '21

Johnny Bieren created OVIRT-3080: ------------------------------------ Summary: Add jbieren to jenkins-whitelist Key: OVIRT-3080 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3080 Project: oVirt - virtualization made easy Issue Type: Task Reporter: Johnny Bieren Assignee: infra Hello, I am part of the Product CI/CD team that works with the jenkins repo hosted here. Please add me to the whitelist so I can make contributions -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100154)

1 0

[JIRA] (OVIRT-3079) [FIRING:1] InstanceUnreachable ovirt-srv24.phx.ovirt.org kubernetes-nodes-exporter (amd64 linux true sriov-nic ovirt-srv24.phx.ovirt.org true r430 true primary true bare-metal ci)
by Shlomi Zidmi (oVirt JIRA) 15 Jan '21

15 Jan '21

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3079?page=com.atlassian.jira.… ] Shlomi Zidmi updated OVIRT-3079: -------------------------------- Resolution: Fixed Status: Done (was: To Do) The server had to be restarted, therefore the alert > [FIRING:1] InstanceUnreachable ovirt-srv24.phx.ovirt.org kubernetes-nodes-exporter (amd64 linux true sriov-nic ovirt-srv24.phx.ovirt.org true r430 true primary true bare-metal ci) > ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-3079 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3079 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Alertmanager_Bot > Assignee: infra > Labels: ALERT{alertname="InstanceUnreachable",instance="ovirt-srv24.phx.ovirt.org",job="kubernetes-nodes-exporter"} > > Labels: > - alertname = InstanceUnreachable > - beta_kubernetes_io_arch = amd64 > - beta_kubernetes_io_os = linux > - deploy_sriov_passthrough_cni = true > - hardwareSupport = sriov-nic > - instance = ovirt-srv24.phx.ovirt.org > - job = kubernetes-nodes-exporter > - kubernetes_io_hostname = ovirt-srv24.phx.ovirt.org > - logging_infra_fluentd = true > - model = r430 > - node_role_kubernetes_io_compute = true > - region = primary > - sriov_nic = true > - type = bare-metal > - zone = ci > Annotations: > - description = ovirt-srv24.phx.ovirt.org of job kubernetes-nodes-exporter has been possibly down for more than 10 minutes. > Source: http://prometheus-0:9090/graph?g0.expr=up%7Bjob%3D%22kubernetes-nodes-expor… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100154)

1 0

[JIRA] (OVIRT-3079) [FIRING:1] InstanceUnreachable ovirt-srv24.phx.ovirt.org kubernetes-nodes-exporter (amd64 linux true sriov-nic ovirt-srv24.phx.ovirt.org true r430 true primary true bare-metal ci)
by Alertmanager_Bot (oVirt JIRA) 15 Jan '21

15 Jan '21

Alertmanager_Bot created OVIRT-3079: --------------------------------------- Summary: [FIRING:1] InstanceUnreachable ovirt-srv24.phx.ovirt.org kubernetes-nodes-exporter (amd64 linux true sriov-nic ovirt-srv24.phx.ovirt.org true r430 true primary true bare-metal ci) Key: OVIRT-3079 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3079 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Alertmanager_Bot Assignee: infra Labels: - alertname = InstanceUnreachable - beta_kubernetes_io_arch = amd64 - beta_kubernetes_io_os = linux - deploy_sriov_passthrough_cni = true - hardwareSupport = sriov-nic - instance = ovirt-srv24.phx.ovirt.org - job = kubernetes-nodes-exporter - kubernetes_io_hostname = ovirt-srv24.phx.ovirt.org - logging_infra_fluentd = true - model = r430 - node_role_kubernetes_io_compute = true - region = primary - sriov_nic = true - type = bare-metal - zone = ci Annotations: - description = ovirt-srv24.phx.ovirt.org of job kubernetes-nodes-exporter has been possibly down for more than 10 minutes. Source: http://prometheus-0:9090/graph?g0.expr=up%7Bjob%3D%22kubernetes-nodes-expor… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100154)

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 115 - Failure!
by jenkins＠jenkins.phx.ovirt.org 14 Jan '21

14 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/11… Build Number: 115 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #115 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 694, in run_vms vm0_service.start(use_cloud_init=True, vm=vm_params) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 32520, in start return self._internal_action(action, 'start', None, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 134, in _check_fault self._raise_error(response, body.fault) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400.

1 2

oVirt infra daily report - unstable production jobs - 1436
by jenkins＠jenkins.phx.ovirt.org 14 Jan '21

14 Jan '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1436//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_performance-suite-master - Build # 1705 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Jan '21

13 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/1… Build Number: 1705 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #1705 [Marcin Sobczyk] lagofy: Add 'run_linters' function [Romain Arnaud] Add files/dirs created by `pipenv sync` to `.gitignore` ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 040_add_hosts_vms.add_vms Error Message: Fault reason is "Operation Failed". Fault detail is "[Internal Engine Error]". HTTP response code is 400. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python3.6/unittest/case.py", line 60, in testPartExecutor yield File "/usr/lib64/python3.6/unittest/case.py", line 622, in run testMethod() File "/usr/lib/python3.6/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 144, in wrapped_test test() File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 62, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python3.6/site-packages/ovirtlago/testlib.py", line 81, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/home/jenkins/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 718, in add_vms max_user_vms=1, File "/usr/lib64/python3.6/site-packages/ovirtsdk4/services.py", line 36441, in add return self._internal_add(pool, headers, query, wait) File "/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py", line 232, in _internal_add return future.wait() if wait else future File "/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py", line 229, in callback self._check_fault(response) File "/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py", line 132, in _check_fault self._raise_error(response, body) File "/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Internal Engine Error]". HTTP response code is 400.

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 112 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Jan '21

13 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/11… Build Number: 112 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #112 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 694, in run_vms vm0_service.start(use_cloud_init=True, vm=vm_params) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 32520, in start return self._internal_action(action, 'start', None, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 134, in _check_fault self._raise_error(response, body.fault) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400.

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 772 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Jan '21

13 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 772 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #772 [Marcin Sobczyk] lagofy: Add 'run_linters' function [Romain Arnaud] Add files/dirs created by `pipenv sync` to `.gitignore` ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.test_004_basic_sanity.test_add_vm_pool Error Message: ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Internal Engine Error]". HTTP response code is 400. Stack Trace: engine_api = <ovirtsdk4.Connection object at 0x7fa8ed216e48> cirros_image_glance_template_name = 'CirrOS_0.5.1_glance_template' @order_by(_TEST_LIST) def test_add_vm_pool(engine_api, cirros_image_glance_template_name): engine = engine_api.system_service() pools_service = engine.vm_pools_service() pool_cluster = engine.clusters_service().list(search='name={}'.format(TEST_CLUSTER))[0] pool_template = engine.templates_service().list(search='name={}'.format( cirros_image_glance_template_name ))[0] with engine_utils.wait_for_event(engine, 302): pools_service.add( pool=types.VmPool( name=VMPOOL_NAME, cluster=pool_cluster, template=pool_template, > use_latest_template_version=True, ) ) ../basic-suite-master/test-scenarios/test_004_basic_sanity.py:1114: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib64/python3.6/site-packages/ovirtsdk4/services.py:36441: in add return self._internal_add(pool, headers, query, wait) /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:232: in _internal_add return future.wait() if wait else future /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:55: in wait return self._code(response) /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:229: in callback self._check_fault(response) /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:132: in _check_fault self._raise_error(response, body) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ response = <ovirtsdk4.http.Response object at 0x7fa8ed208898> detail = <ovirtsdk4.types.Fault object at 0x7fa8ee470470> @staticmethod def _raise_error(response, detail=None): """ Creates and raises an error containing the details of the given HTTP response and fault. This method is intended for internal use by other components of the SDK. Refrain from using it directly, as backwards compatibility isn't guaranteed. """ fault = detail if isinstance(detail, types.Fault) else None msg = '' if fault: if fault.reason: if msg: msg += ' ' msg = msg + 'Fault reason is "%s".' % fault.reason if fault.detail: if msg: msg += ' ' msg = msg + 'Fault detail is "%s".' % fault.detail if response: if response.code: if msg: msg += ' ' msg = msg + 'HTTP response code is %s.' % response.code if response.message: if msg: msg += ' ' msg = msg + 'HTTP response message is "%s".' % response.message if isinstance(detail, six.string_types): if msg: msg += ' ' msg = msg + detail + '.' class_ = Error if response is not None: if response.code in [401, 403]: class_ = AuthError elif response.code == 404: class_ = NotFoundError error = class_(msg) error.code = response.code if response else None error.fault = fault > raise error E ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Internal Engine Error]". HTTP response code is 400. /usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:118: Error

1 3

oVirt infra daily report - unstable production jobs - 1435
by jenkins＠jenkins.phx.ovirt.org 13 Jan '21

13 Jan '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1435//artifact/exported… Cheers, Jenkins

1 0

[CQ]: 112963, 1 (ovirt-guest-agent) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 13 Jan '21

13 Jan '21

A system test invoked by the "ovirt-master" change queue including change 112963,1 (ovirt-guest-agent) failed. However, this change seems not to be the root cause for this failure. Change 103257,5 (ovirt-guest-agent) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 103257,5 (ovirt-guest-agent) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/c/ovirt-guest-agent/+/#/c/112963/1 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/103257/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/27625/

1 0

[CQ]: 112963, 1 (ovirt-guest-agent) failed "ovirt-4.3" system tests, but isn't the failure root cause
by oVirt Jenkins 13 Jan '21

13 Jan '21

A system test invoked by the "ovirt-4.3" change queue including change 112963,1 (ovirt-guest-agent) failed. However, this change seems not to be the root cause for this failure. Change 105451,1 (ovirt-guest-agent) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 105451,1 (ovirt-guest-agent) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/c/ovirt-guest-agent/+/#/c/112963/1 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/105451/1 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/4227/

1 0

[JIRA] (OVIRT-3078) [FIRING:1] InstanceUnreachable ovirt-srv24.phx.ovirt.org kubernetes-nodes-exporter (amd64 linux true sriov-nic ovirt-srv24.phx.ovirt.org true r430 true primary true bare-metal ci)
by Shlomi Zidmi (oVirt JIRA) 13 Jan '21

13 Jan '21

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3078?page=com.atlassian.jira.… ] Shlomi Zidmi updated OVIRT-3078: -------------------------------- Resolution: Fixed Status: Done (was: To Do) Had to restart the node due to networking issues. > [FIRING:1] InstanceUnreachable ovirt-srv24.phx.ovirt.org kubernetes-nodes-exporter (amd64 linux true sriov-nic ovirt-srv24.phx.ovirt.org true r430 true primary true bare-metal ci) > ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-3078 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3078 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Alertmanager_Bot > Assignee: infra > Labels: ALERT{alertname="InstanceUnreachable",instance="ovirt-srv24.phx.ovirt.org",job="kubernetes-nodes-exporter"} > > Labels: > - alertname = InstanceUnreachable > - beta_kubernetes_io_arch = amd64 > - beta_kubernetes_io_os = linux > - deploy_sriov_passthrough_cni = true > - hardwareSupport = sriov-nic > - instance = ovirt-srv24.phx.ovirt.org > - job = kubernetes-nodes-exporter > - kubernetes_io_hostname = ovirt-srv24.phx.ovirt.org > - logging_infra_fluentd = true > - model = r430 > - node_role_kubernetes_io_compute = true > - region = primary > - sriov_nic = true > - type = bare-metal > - zone = ci > Annotations: > - description = ovirt-srv24.phx.ovirt.org of job kubernetes-nodes-exporter has been possibly down for more than 10 minutes. > Source: http://prometheus-0:9090/graph?g0.expr=up%7Bjob%3D%22kubernetes-nodes-expor… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100154)

1 0

[JIRA] (OVIRT-3078) [FIRING:1] InstanceUnreachable ovirt-srv24.phx.ovirt.org kubernetes-nodes-exporter (amd64 linux true sriov-nic ovirt-srv24.phx.ovirt.org true r430 true primary true bare-metal ci)
by Alertmanager_Bot (oVirt JIRA) 13 Jan '21

13 Jan '21

Alertmanager_Bot created OVIRT-3078: --------------------------------------- Summary: [FIRING:1] InstanceUnreachable ovirt-srv24.phx.ovirt.org kubernetes-nodes-exporter (amd64 linux true sriov-nic ovirt-srv24.phx.ovirt.org true r430 true primary true bare-metal ci) Key: OVIRT-3078 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3078 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Alertmanager_Bot Assignee: infra Labels: - alertname = InstanceUnreachable - beta_kubernetes_io_arch = amd64 - beta_kubernetes_io_os = linux - deploy_sriov_passthrough_cni = true - hardwareSupport = sriov-nic - instance = ovirt-srv24.phx.ovirt.org - job = kubernetes-nodes-exporter - kubernetes_io_hostname = ovirt-srv24.phx.ovirt.org - logging_infra_fluentd = true - model = r430 - node_role_kubernetes_io_compute = true - region = primary - sriov_nic = true - type = bare-metal - zone = ci Annotations: - description = ovirt-srv24.phx.ovirt.org of job kubernetes-nodes-exporter has been possibly down for more than 10 minutes. Source: http://prometheus-0:9090/graph?g0.expr=up%7Bjob%3D%22kubernetes-nodes-expor… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100154)

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 108 - Failure!
by jenkins＠jenkins.phx.ovirt.org 12 Jan '21

12 Jan '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/10… Build Number: 108 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #108 [parthdhanjal] WIP: hc-4.3 fix ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 694, in run_vms vm0_service.start(use_cloud_init=True, vm=vm_params) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 32520, in start return self._internal_action(action, 'start', None, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 299, in _internal_action return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 296, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 134, in _check_fault self._raise_error(response, body.fault) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400.

1 3