- Infra - oVirt List Archives

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 532 - Failure!
by jenkins＠jenkins.phx.ovirt.org 07 Nov '20

07 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/53… Build Number: 532 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #532 [Eitan Raviv] network: remove BZ1752282 workaround, run all tests ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.run_vms Error Message: False != True after 600 seconds Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 697, in run_vms _verify_vm_state(engine, vm_name, types.VmStatus.UP) File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 102, in _verify_vm_state lambda: File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) AssertionError: False != True after 600 seconds

1 1

oVirt infra daily report - unstable production jobs - 1367
by jenkins＠jenkins.phx.ovirt.org 07 Nov '20

07 Nov '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1367//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 554 - Failure!
by jenkins＠jenkins.phx.ovirt.org 06 Nov '20

06 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 554 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #554 [Eitan Raviv] network: remove workaround for BZ 1752282 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.004_basic_sanity.test_run_vms Error Message: Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. Stack Trace: assert_vm_is_alive = <function is_alive at 0x7f9b2785ded8> engine_api = <ovirtsdk4.Connection object at 0x7f9b267a0f50> management_gw_ip = '192.168.201.1' @order_by(_TEST_LIST) def test_run_vms(assert_vm_is_alive, engine_api, management_gw_ip): engine = engine_api.system_service() vm_params = types.Vm( initialization=types.Initialization( user_name=VM_USER_NAME, root_password=VM_PASSWORD ) ) vm_params.initialization.host_name = BACKUP_VM_NAME backup_vm_service = test_utils.get_vm_service(engine, BACKUP_VM_NAME) backup_vm_service.start(use_cloud_init=True, vm=vm_params) vm_params.initialization.host_name = VM2_NAME vm2_service = test_utils.get_vm_service(engine, VM2_NAME) vm2_service.start(use_cloud_init=True, vm=vm_params) # CirrOS cloud-init is different, networking doesn't work since it doesn't support the format oVirt is using vm_params.initialization.host_name = VM0_NAME # hostname seems to work, the others not vm_params.initialization.dns_search = 'lago.local' vm_params.initialization.domain = 'lago.local' vm_params.initialization.dns_servers = management_gw_ip vm0_service = test_utils.get_vm_service(engine, VM0_NAME) > vm0_service.start(use_cloud_init=True, vm=vm_params) ../basic-suite-master/test-scenarios/004_basic_sanity.py:754: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib64/python2.7/site-packages/ovirtsdk4/services.py:32520: in start return self._internal_action(action, 'start', None, headers, query, wait) /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:299: in _internal_action return future.wait() if wait else future /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:55: in wait return self._code(response) /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:296: in callback self._check_fault(response) /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:134: in _check_fault self._raise_error(response, body.fault) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ response = <ovirtsdk4.http.Response object at 0x7f9b2678f910> detail = <ovirtsdk4.types.Fault object at 0x7f9b2678f990> @staticmethod def _raise_error(response, detail=None): """ Creates and raises an error containing the details of the given HTTP response and fault. This method is intended for internal use by other components of the SDK. Refrain from using it directly, as backwards compatibility isn't guaranteed. """ fault = detail if isinstance(detail, types.Fault) else None msg = '' if fault: if fault.reason: if msg: msg += ' ' msg = msg + 'Fault reason is "%s".' % fault.reason if fault.detail: if msg: msg += ' ' msg = msg + 'Fault detail is "%s".' % fault.detail if response: if response.code: if msg: msg += ' ' msg = msg + 'HTTP response code is %s.' % response.code if response.message: if msg: msg += ' ' msg = msg + 'HTTP response message is "%s".' % response.message if isinstance(detail, six.string_types): if msg: msg += ' ' msg = msg + detail + '.' class_ = Error if response is not None: if response.code in [401, 403]: class_ = AuthError elif response.code == 404: class_ = NotFoundError error = class_(msg) error.code = response.code if response else None error.fault = fault > raise error E Error: Fault reason is "Operation Failed". Fault detail is "[Network error during communication with the Host.]". HTTP response code is 400. /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:118: Error

1 2

[oVirt Jenkins] ovirt-system-tests_upgrade-from-release-suite-4.3_nightly - Build # 487 - Failure!
by jenkins＠jenkins.phx.ovirt.org 06 Nov '20

06 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-release-suite… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-release-suite… Build Number: 487 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #487 [Eitan Raviv] network: remove workaround for BZ 1752282 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.vm_run Error Message: False != True after 600 seconds Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_upgrade-from-release-suite-4.3_nightly/ovirt-system-tests/upgrade-from-release-suite-4.3/test-scenarios-after-upgrade/004_basic_sanity.py", line 107, in vm_run lambda: api.vms.get(VM0_NAME).status.state == 'up', File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) AssertionError: False != True after 600 seconds

1 1

[oVirt Jenkins] cleanup-gated-dummy-master - Build #321 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 06 Nov '20

06 Nov '20

Build: https://jenkins.ovirt.org/job/cleanup-gated-dummy-master/321/ Build Name: #321 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

oVirt infra daily report - unstable production jobs - 1366
by jenkins＠jenkins.phx.ovirt.org 06 Nov '20

06 Nov '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1366//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-3053) [FIRING:1] LowDiskSpace_NodeExporter_v1_0 resources.ovirt.org:9100 ovirt-resources (/dev/mapper/resources_lvm-data ext4 /srv/resources)
by Alertmanager_Bot (oVirt JIRA) 05 Nov '20

05 Nov '20

Alertmanager_Bot created OVIRT-3053: --------------------------------------- Summary: [FIRING:1] LowDiskSpace_NodeExporter_v1_0 resources.ovirt.org:9100 ovirt-resources (/dev/mapper/resources_lvm-data ext4 /srv/resources) Key: OVIRT-3053 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3053 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Alertmanager_Bot Assignee: infra Labels: - alertname = LowDiskSpace_NodeExporter_v1_0 - device = /dev/mapper/resources_lvm-data - fstype = ext4 - instance = resources.ovirt.org:9100 - job = ovirt-resources - mountpoint = /srv/resources Annotations: - description = resources.ovirt.org:9100 of job ovirt-resources has less than 10% free disk space Source: http://prometheus-0:9090/graph?g0.expr=node_filesystem_free_bytes+%2F+node_… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0

[JIRA] (OVIRT-2850) Fedora 29 EOL
by Evgheni Dereveanchin (oVirt JIRA) 05 Nov '20

05 Nov '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2850?page=com.atlassian.jira.… ] Evgheni Dereveanchin updated OVIRT-2850: ---------------------------------------- Resolution: Done Status: Done (was: To Do) > Fedora 29 EOL > ------------- > > Key: OVIRT-2850 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2850 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Ehud Yonasi > Assignee: infra > > We need to prepare patches to remove it + mirrors, and let developers know to remove fc29 builds from CI. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 553 - Fixed!
by jenkins＠jenkins.phx.ovirt.org 05 Nov '20

05 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 553 Build Status: Fixed Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #552 [Eitan Raviv] network: remove workaround for BZ 1752282 Changes for Build #553 [Eitan Raviv] network: remove workaround for BZ 1752282 ----------------- Failed Tests: ----------------- All tests passed

1 0

[oVirt Jenkins] ovirt-system-tests_upgrade-from-release-suite-master_nightly - Build # 1 - Failure!
by jenkins＠jenkins.phx.ovirt.org 05 Nov '20

05 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-release-suite… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-release-suite… Build Number: 1 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- ----------------- Failed Tests: ----------------- No tests ran.

1 483

[oVirt Jenkins] ovirt-system-tests_upgrade-from-prevrelease-suite-master_nightly - Build # 1 - Failure!
by jenkins＠jenkins.phx.ovirt.org 05 Nov '20

05 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-prevrelease-s… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-prevrelease-s… Build Number: 1 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- ----------------- Failed Tests: ----------------- No tests ran.

1 483

oVirt infra daily report - unstable production jobs - 1365
by jenkins＠jenkins.phx.ovirt.org 05 Nov '20

05 Nov '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1365//artifact/exported… Cheers, Jenkins

1 0

[CQ]: 112012,5 (ovirt-system-tests) failed "ovirt-4.3" system tests
by oVirt Jenkins 04 Nov '20

04 Nov '20

Change 112012,5 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-4.3" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/112012/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/4047/

1 0

[CQ]: 112012, 5 (ovirt-system-tests) failed "ovirt-master" system tests
by oVirt Jenkins 04 Nov '20

04 Nov '20

Change 112012,5 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/112012/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26787/

1 0

[oVirt Jenkins] deploy-to-gated-ovirt-master - Build #591 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 04 Nov '20

04 Nov '20

Build: https://jenkins.ovirt.org/job/deploy-to-gated-ovirt-master/591/ Build Name: #591 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

check patch does not create artifacts and seems to hang
by Eitan Raviv 04 Nov '20

04 Nov '20

Hi, IIUC check-patch [1] has failed but there are no artifacts and check-patch [2] seems to hang for some hours. Could you please have a look? Thanks [1] https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/12989/ [2] https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/13034/

1 0

[oVirt Jenkins] ovirt-release_4.3_build-artifacts-el7-x86_64 - Build # 786 - Failure!
by jenkins＠jenkins.phx.ovirt.org 04 Nov '20

04 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-release_4.3_build-artifacts-el7-x86_64/ Build: https://jenkins.ovirt.org/job/ovirt-release_4.3_build-artifacts-el7-x86_64/… Build Number: 786 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #786 [Sandro Bonazzola] Revert "automation: install centos-release if missing" [Galit] Add dparth mail to hc-basic ----------------- Failed Tests: ----------------- No tests ran.

1 1

oVirt infra daily report - unstable production jobs - 1364
by jenkins＠jenkins.phx.ovirt.org 04 Nov '20

04 Nov '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1364//artifact/exported… Cheers, Jenkins

1 0

[CQ]: 112000,8 (ovirt-system-tests) failed "ovirt-4.3" system tests
by oVirt Jenkins 03 Nov '20

03 Nov '20

Change 112000,8 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-4.3" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/112000/8 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/4040/

1 0

[CQ]: 112000, 8 (ovirt-system-tests) failed "ovirt-master" system tests
by oVirt Jenkins 03 Nov '20

03 Nov '20

Change 112000,8 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/112000/8 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26774/

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 522 - Failure!
by jenkins＠jenkins.phx.ovirt.org 03 Nov '20

03 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/52… Build Number: 522 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #522 [hbraha] network: remove lago engine_ip call ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.disk_operations Error Message: False != True after 600 seconds -------------------- >> begin captured logging << -------------------- lago.utils: DEBUG: Error while running thread Thread-62 Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 508, in live_storage_migration testlib.assert_true_within_long(lambda: test_utils.all_jobs_finished(engine, correlation_id)) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) AssertionError: False != True after 600 seconds --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 932, in disk_operations vt.join_all() File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 508, in live_storage_migration testlib.assert_true_within_long(lambda: test_utils.all_jobs_finished(engine, correlation_id)) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) 'False != True after 600 seconds\n-------------------- >> begin captured logging << --------------------\nlago.utils: DEBUG: Error while running thread Thread-62\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue\n queue.put({\'return\': func()})\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper\n return func(get_test_prefix(), *args, **kwargs)\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper\n prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs\n File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 508, in live_storage_migration\n testlib.assert_true_within_long(lambda: test_utils.all_jobs_finished(engine, correlation_id))\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long\n assert_equals_within_long(func, True, allowed_exceptions)\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long\n func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within\n \'%s != %s after %s seconds\' % (res, value, timeout)\nAssertionError: False != True after 600 seconds\n--------------------- >> end captured logging << ---------------------'

1 1

[oVirt Jenkins] ovirt-system-tests_upgrade-from-release-suite-4.3_nightly - Build # 478 - Failure!
by jenkins＠jenkins.phx.ovirt.org 03 Nov '20

03 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-release-suite… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-release-suite… Build Number: 478 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #478 [hbraha] network: remove lago engine_ip call [Galit] Add dparth mail to hc-basic ----------------- Failed Tests: ----------------- No tests ran.

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 520 - Failure!
by jenkins＠jenkins.phx.ovirt.org 03 Nov '20

03 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/52… Build Number: 520 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #520 [hbraha] network: remove xfail from active bond test ----------------- Failed Tests: ----------------- No tests ran.

1 1

[CQ]: 111898,23 (ovirt-system-tests) failed "ovirt-4.3" system tests
by oVirt Jenkins 03 Nov '20

03 Nov '20

Change 111898,23 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-4.3" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111898/23 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/4036/

1 0

[CQ]: 111898, 23 (ovirt-system-tests) failed "ovirt-master" system tests
by oVirt Jenkins 03 Nov '20

03 Nov '20

Change 111898,23 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111898/23 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26766/

1 0

[oVirt Jenkins] deploy-to-gated-ovirt-master - Build #585 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 03 Nov '20

03 Nov '20

Build: https://jenkins.ovirt.org/job/deploy-to-gated-ovirt-master/585/ Build Name: #585 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

oVirt infra daily report - unstable production jobs - 1363
by jenkins＠jenkins.phx.ovirt.org 03 Nov '20

03 Nov '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1363//artifact/exported… Cheers, Jenkins

1 0

[CQ]: 111643,21 (ovirt-system-tests) failed "ovirt-4.3" system tests
by oVirt Jenkins 02 Nov '20

02 Nov '20

Change 111643,21 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-4.3" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111643/21 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/4029/

1 0

[CQ]: 111643, 21 (ovirt-system-tests) failed "ovirt-master" system tests
by oVirt Jenkins 02 Nov '20

02 Nov '20

Change 111643,21 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111643/21 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26752/

1 0

[oVirt Jenkins] deploy-to-gated-ovirt-master - Build #581 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Build: https://jenkins.ovirt.org/job/deploy-to-gated-ovirt-master/581/ Build Name: #581 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

[CQ]: 111913, 4 (ovirt-system-tests) failed "ovirt-4.3" system tests, but isn't the failure root cause
by oVirt Jenkins 02 Nov '20

02 Nov '20

A system test invoked by the "ovirt-4.3" change queue including change 111913,4 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 111946,2 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 111946,2 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/111913/4 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/111946/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/4026/

1 0

[CQ]: 111913, 4 (ovirt-system-tests) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 02 Nov '20

02 Nov '20

A system test invoked by the "ovirt-master" change queue including change 111913,4 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 111946,2 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 111946,2 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/111913/4 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/111946/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26733/

1 0

[oVirt Jenkins] deploy-to-gated-ovirt-4.3 - Build #584 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Build: https://jenkins.ovirt.org/job/deploy-to-gated-ovirt-4.3/584/ Build Name: #584 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Failed to run project_setup.sh for: #24751 vdsm [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on vm0144.workers-phx.ovirt.org.

1 0

[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Failed to run project_setup.sh for: #24752 vdsm [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on vm0141.workers-phx.ovirt.org.

1 0

[JIRA] (OVIRT-3051) [FIRING:1] LowDiskSpace_NodeExporter_v1_0 resources.ovirt.org:9100 ovirt-resources (/dev/mapper/resources_lvm-data ext4 /srv/resources)
by Shlomi Zidmi (oVirt JIRA) 02 Nov '20

02 Nov '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3051?page=com.atlassian.jira.… ] Shlomi Zidmi updated OVIRT-3051: -------------------------------- Resolution: Fixed Status: Done (was: To Do) This alert was fired before the cleanup occurred. Let's re-adjust the alert rule to wait for a longer period of time before firing the alert. > [FIRING:1] LowDiskSpace_NodeExporter_v1_0 resources.ovirt.org:9100 ovirt-resources (/dev/mapper/resources_lvm-data ext4 /srv/resources) > --------------------------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-3051 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3051 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Alertmanager_Bot > Assignee: infra > Labels: ALERT{alertname="LowDiskSpace_NodeExporter_v1_0",instance="resources.ovirt.org:9100",job="ovirt-resources"} > > Labels: > - alertname = LowDiskSpace_NodeExporter_v1_0 > - device = /dev/mapper/resources_lvm-data > - fstype = ext4 > - instance = resources.ovirt.org:9100 > - job = ovirt-resources > - mountpoint = /srv/resources > Annotations: > - description = resources.ovirt.org:9100 of job ovirt-resources has less than 10% free disk space > Source: http://prometheus-0:9090/graph?g0.expr=node_filesystem_free_bytes+%2F+node_… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0

[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Failed to run project_setup.sh for: #24737 vdsm [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on vm0141.workers-phx.ovirt.org.

1 0

[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Failed to run project_setup.sh for: #24733 vdsm [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on vm0144.workers-phx.ovirt.org.

1 0

[CQ]: 112002,1 (jenkins) failed "dummy-master" system tests
by oVirt Jenkins 02 Nov '20

02 Nov '20

Change 112002,1 (jenkins) is probably the reason behind recent system test failures in the "dummy-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/112002/1 For failed test results see: https://jenkins.ovirt.org/job/dummy-master_change-queue-tester/549/

1 0

[oVirt Jenkins] deploy-to-gated-dummy-master - Build #403 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Build: https://jenkins.ovirt.org/job/deploy-to-gated-dummy-master/403/ Build Name: #403 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Failed to run project_setup.sh for: #24732 vdsm [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on vm0144.workers-phx.ovirt.org.

1 0

[JENKINS] Failed to setup proejct vdsm_standard-check-patch
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Failed to run project_setup.sh for: #24729 vdsm [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on vm0141.workers-phx.ovirt.org.

1 0

[CQ]: 112002,1 (jenkins) failed "dummy-master" system tests
by oVirt Jenkins 02 Nov '20

02 Nov '20

Change 112002,1 (jenkins) is probably the reason behind recent system test failures in the "dummy-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/112002/1 For failed test results see: https://jenkins-staging.phx.ovirt.org/job/dummy-master_change-queue-tester/…

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 543 - Failure!
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 543 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #543 [hbraha] network: remove xfail from active bond test ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.100_basic_ui_sanity.test_login[firefox] Error Message: test setup failure Stack Trace: engine_fqdn = 'engine', engine_ip = '192.168.201.4' @pytest.fixture(scope="session") def hub_url(engine_fqdn, engine_ip): env_url = _env_hub_url() if env_url is not None: yield env_url else: backend = _grid_backend() if backend == "podman": if os_utils.on_centos(8) and os_utils.inside_mock(): pytest.skip("podman doesn't work in mock") hub_port = network_utils.find_free_port(4444, 4544) with podman.grid(engine_fqdn, engine_ip, hub_port=hub_port) as hub_url: yield hub_url elif backend == "docker": > with docker.grid(engine_fqdn, engine_ip) as hub_url: ../ost_utils/ost_utils/pytest/fixtures/selenium/__init__.py:76: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib64/python2.7/contextlib.py:17: in __enter__ return self.gen.next() ../ost_utils/ost_utils/selenium/docker.py:118: in grid with _network(network_name): /usr/lib64/python2.7/contextlib.py:17: in __enter__ return self.gen.next() ../ost_utils/ost_utils/selenium/docker.py:61: in _network shell(["docker", "network", "create", network_name]) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker', 'network', 'create', 'grid'], bytes_output = False kwargs = {}, process = <subprocess.Popen object at 0x7fc8801d7190>, out = '' err = 'Error response from daemon: network with name grid already exists ' def shell(args, bytes_output=False, **kwargs): process = subprocess.Popen(args, stdout=subprocess.PIPE, stderr=subprocess.PIPE, **kwargs) out, err = process.communicate() if not bytes_output: out = out.decode("utf-8") err = err.decode("utf-8") if process.returncode: > raise ShellError(process.returncode, out, err) E ShellError: Command failed with rc=1. Stdout: E E Stderr: E Error response from daemon: network with name grid already exists ../ost_utils/ost_utils/shell.py:51: ShellError

1 1

[oVirt Jenkins] ovirt-system-tests_upgrade-from-prevrelease-suite-4.3_nightly - Build # 476 - Failure!
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-prevrelease-s… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-prevrelease-s… Build Number: 476 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #476 [hbraha] network: remove xfail from active bond test ----------------- Failed Tests: ----------------- No tests ran.

1 1

[oVirt Jenkins] ovirt-system-tests_performance-suite-master - Build # 1628 - Failure!
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/1… Build Number: 1628 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #1628 [parthdhanjal] Updating gluster-inventory file ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 1000_analyze_postgresql.analyze_postgres Error Message: Failed to perform the postgres analysis. Exit code is 1 -------------------- >> begin captured logging << -------------------- lago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/../common/test-scenarios-files/analyze_postgresql.sh to lago-performance-suite-master-engine:/root: ?[0m?[0m lago.ssh: DEBUG: start task:8c5a6a6c-5e73-4189-8d00-0521d30b5f6d:Get ssh client for lago-performance-suite-master-engine: lago.ssh: DEBUG: end task:8c5a6a6c-5e73-4189-8d00-0521d30b5f6d:Get ssh client for lago-performance-suite-master-engine: lago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/../common/test-scenarios-files/analyze_postgresql.sh to lago-performance-suite-master-engine:/root: ?[32mSuccess?[0m (in 0:00:00) lago.ssh: DEBUG: start task:48f7a31c-2afe-493b-8aaf-7112c63109ac:Get ssh client for lago-performance-suite-master-engine: lago.ssh: DEBUG: end task:48f7a31c-2afe-493b-8aaf-7112c63109ac:Get ssh client for lago-performance-suite-master-engine: lago.ssh: DEBUG: Running dc1924fc on lago-performance-suite-master-engine: /root/analyze_postgresql.sh lago.ssh: DEBUG: Command dc1924fc on lago-performance-suite-master-engine returned with 1 lago.ssh: DEBUG: Command dc1924fc on lago-performance-suite-master-engine output: Last metadata expiration check: 0:10:09 ago on Sat 31 Oct 2020 11:00:48 PM EDT. pgdg-redhat-repo-42.0-11.noarch.rpm 8.5 kB/s | 11 kB 00:01 Dependencies resolved. ================================================================================ Package Architecture Version Repository Size ================================================================================ Installing: pgdg-redhat-repo noarch 42.0-11 @commandline 11 k Transaction Summary ================================================================================ Install 1 Package Total size: 11 k Installed size: 11 k Downloading Packages: Running transaction check Transaction check succeeded. Running transaction test Transaction test succeeded. Running transaction Preparing : 1/1 Installing : pgdg-redhat-repo-42.0-11.noarch 1/1 Verifying : pgdg-redhat-repo-42.0-11.noarch 1/1 Installed: pgdg-redhat-repo-42.0-11.noarch Complete! PostgreSQL common RPMs for RHEL/CentOS 8 - x86_ 172 kB/s | 449 kB 00:02 PostgreSQL 12 for RHEL/CentOS 8 - x86_64 199 kB/s | 335 kB 00:01 PostgreSQL 11 for RHEL/CentOS 8 - x86_64 318 kB/s | 517 kB 00:01 PostgreSQL 10 for RHEL/CentOS 8 - x86_64 226 kB/s | 370 kB 00:01 PostgreSQL 9.6 for RHEL/CentOS 8 - x86_64 232 kB/s | 359 kB 00:01 PostgreSQL 9.5 for RHEL/CentOS 8 - x86_64 197 kB/s | 314 kB 00:01 Dependencies resolved. ================================================================================ Package Arch Version Repository Size ================================================================================ Installing: pgbadger noarch 11.3-1.rhel8 pgdg-common 348 k pgcluu noarch 3.1-2.rhel8 pgdg-common 356 k Installing dependencies: perl-Text-CSV_XS x86_64 1.40-1.el8 epel-el8 145 k perl-UNIVERSAL-isa noarch 1.20171012-4.el8 epel-el8 24 k Transaction Summary ================================================================================ Install 4 Packages Total download size: 874 k Installed size: 3.5 M Downloading Packages: (1/4): perl-Text-CSV_XS-1.40-1.el8.x86_64.rpm 2.6 MB/s | 145 kB 00:00 (2/4): perl-UNIVERSAL-isa-1.20171012-4.el8.noar 571 kB/s | 24 kB 00:00 (3/4): pgbadger-11.3-1.rhel8.noarch.rpm 1.2 MB/s | 348 kB 00:00 (4/4): pgcluu-3.1-2.rhel8.noarch.rpm 980 kB/s | 356 kB 00:00 -------------------------------------------------------------------------------- Total 2.3 MB/s | 874 kB 00:00 PostgreSQL common RPMs for RHEL/CentOS 8 - x86_ 1.6 MB/s | 1.7 kB 00:00 Key imported successfully Extra Packages for Enterprise Linux 8 - x86_64 7.3 kB/s | 1.6 kB 00:00 Key imported successfully Running transaction check Transaction check succeeded. Running transaction test Transaction test succeeded. Running transaction Preparing : 1/1 Installing : perl-UNIVERSAL-isa-1.20171012-4.el8.noarch 1/4 Installing : perl-Text-CSV_XS-1.40-1.el8.x86_64 2/4 Installing : pgbadger-11.3-1.rhel8.noarch 3/4 Installing : pgcluu-3.1-2.rhel8.noarch 4/4 Running scriptlet: pgcluu-3.1-2.rhel8.noarch 4/4 Verifying : pgbadger-11.3-1.rhel8.noarch 1/4 Verifying : pgcluu-3.1-2.rhel8.noarch 2/4 Verifying : perl-Text-CSV_XS-1.40-1.el8.x86_64 3/4 Verifying : perl-UNIVERSAL-isa-1.20171012-4.el8.noarch 4/4 Installed: perl-Text-CSV_XS-1.40-1.el8.x86_64 perl-UNIVERSAL-isa-1.20171012-4.el8.noarch pgbadger-11.3-1.rhel8.noarch pgcluu-3.1-2.rhel8.noarch Complete! lago.ssh: DEBUG: Command dc1924fc on lago-performance-suite-master-engine errors: + pg_datadir=/var/lib/pgsql/data + pg_service=postgresql.service + pgdg= + scl_enable= ++ get_engine_pg_scl ++ engine_pg_scl_conf=(/etc/ovirt-engine/engine.conf.d/*scl-postgres*.conf) ++ local engine_pg_scl_conf ++ local res= ++ [[ -e /etc/ovirt-engine/engine.conf.d/*scl-postgres*.conf ]] ++ echo '' + engine_pg_scl= + [[ -n '' ]] ++ rpm -q postgresql + pgver=postgresql-12.1-2.module_el8.1.0+273+979c16e6.x86_64 + case "${pgver}" in + pgdg=https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/… + [[ -n https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/pgdg-… ]] + yum install -y https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/pgdg-… + yum install -y pgbadger pgcluu warning: /var/cache/dnf/pgdg-common-38b6c5045045f841/packages/pgbadger-11.3-1.rhel8.noarch.rpm: Header V4 DSA/SHA1 Signature, key ID 442df0f8: NOKEY Importing GPG key 0x442DF0F8: Userid : "PostgreSQL RPM Building Project <pgsqlrpms-hackers(a)pgfoundry.org>" Fingerprint: 68C9 E2B9 1A37 D136 FE74 D176 1F16 D2E1 442D F0F8 From : /etc/pki/rpm-gpg/RPM-GPG-KEY-PGDG warning: /var/cache/dnf/epel-el8-e791ead165840057/packages/perl-Text-CSV_XS-1.40-1.el8.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID 2f86d6a1: NOKEY Importing GPG key 0x2F86D6A1: Userid : "Fedora EPEL (8) <epel(a)fedoraproject.org>" Fingerprint: 94E2 79EB 8D8F 25B2 1810 ADF1 21EA 45AB 2F86 D6A1 From : https://dl.fedoraproject.org/pub/epel/RPM-GPG-KEY-EPEL-8 ++ su - postgres -c 'psql postgres postgres -t -c '\''show log_directory'\''' ++ sed 2d + pglogdir=' log' + pglogdir=log + cd /var/lib/pgsql/data/log/ ++ su - postgres -c 'psql postgres postgres -t -c '\''show log_filename'\''' ++ sed 2d + pglog=' postgresql-%m.log' ++ date +postgresql-%m.log + pglog=postgresql-10.log + mkdir pgbadger + pgbadger -f stderr postgresql-10.log --outdir pgbadger FATAL: logfile "postgresql-10.log" must exist! - Error at line 2410 --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/1000_analyze_postgresql.py", line 52, in analyze_postgres ' Exit code is %s' % result.code File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line 29, in eq_ raise AssertionError(msg or "%r != %r" % (a, b)) 'Failed to perform the postgres analysis. Exit code is 1\n-------------------- >> begin captured logging << --------------------\nlago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/../common/test-scenarios-files/analyze_postgresql.sh to lago-performance-suite-master-engine:/root: \x1b[0m\x1b[0m\nlago.ssh: DEBUG: start task:8c5a6a6c-5e73-4189-8d00-0521d30b5f6d:Get ssh client for lago-performance-suite-master-engine:\nlago.ssh: DEBUG: end task:8c5a6a6c-5e73-4189-8d00-0521d30b5f6d:Get ssh client for lago-performance-suite-master-engine:\nlago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/../common/test-scenarios-files/analyze_postgresql.sh to lago-performance-suite-master-engine:/root: \x1b[32mSuccess\x1b[0m (in 0:00:00)\nlago.ssh: DEBUG: start task:48f7a31c-2afe-493b-8aaf-7112c63109ac:Get ssh client for lago-performance-suite-master-engine:\nlago.ssh: DEBUG: end task:48f7a31c-2afe-493b-8aaf-7112c63109ac:Get ssh client for lago-performance-suite-master-engine:\nlago.ssh: DEBUG: Running dc1924fc on lago-performance-suite-master-engine: /root/analyze_postgresql.sh\nlago.ssh: DEBUG: Command dc1924fc on lago-performance-suite-master-engine returned with 1\nlago.ssh: DEBUG: Command dc1924fc on lago-performance-suite-master-engine output:\n Last metadata expiration check: 0:10:09 ago on Sat 31 Oct 2020 11:00:48 PM EDT.\npgdg-redhat-repo-42.0-11.noarch.rpm 8.5 kB/s | 11 kB 00:01 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling:\n pgdg-redhat-repo noarch 42.0-11 @commandline 11 k\n\nTransaction Summary\n================================================================================\nInstall 1 Package\n\nTotal size: 11 k\nInstalled size: 11 k\nDownloading Packages:\nRunning transaction check\nTransaction check succeeded.\nRunning transaction test\nTransaction test succeeded.\nRunning transaction\n Preparing : 1/1 \n Installing : pgdg-redhat-repo-42.0-11.noarch 1/1 \n Verifying : pgdg-redhat-repo-42.0-11.noarch 1/1 \n\nInstalled:\n pgdg-redhat-repo-42.0-11.noarch \n\nComplete!\nPostgreSQL common RPMs for RHEL/CentOS 8 - x86_ 172 kB/s | 449 kB 00:02 \nPostgreSQL 12 for RHEL/CentOS 8 - x86_64 199 kB/s | 335 kB 00:01 \nPostgreSQL 11 for RHEL/CentOS 8 - x86_64 318 kB/s | 517 kB 00:01 \nPostgreSQL 10 for RHEL/CentOS 8 - x86_64 226 kB/s | 370 kB 00:01 \nPostgreSQL 9.6 for RHEL/CentOS 8 - x86_64 232 kB/s | 359 kB 00:01 \nPostgreSQL 9.5 for RHEL/CentOS 8 - x86_64 197 kB/s | 314 kB 00:01 \nDependencies resolved.\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n pgbadger noarch 11.3-1.rhel8 pgdg-common 348 k\n pgcluu noarch 3.1-2.rhel8 pgdg-common 356 k\nInstalling dependencies:\n perl-Text-CSV_XS x86_64 1.40-1.el8 epel-el8 145 k\n perl-UNIVERSAL-isa noarch 1.20171012-4.el8 epel-el8 24 k\n\nTransaction Summary\n================================================================================\nInstall 4 Packages\n\nTotal download size: 874 k\nInstalled size: 3.5 M\nDownloading Packages:\n(1/4): perl-Text-CSV_XS-1.40-1.el8.x86_64.rpm 2.6 MB/s | 145 kB 00:00 \n(2/4): perl-UNIVERSAL-isa-1.20171012-4.el8.noar 571 kB/s | 24 kB 00:00 \n(3/4): pgbadger-11.3-1.rhel8.noarch.rpm 1.2 MB/s | 348 kB 00:00 \n(4/4): pgcluu-3.1-2.rhel8.noarch.rpm 980 kB/s | 356 kB 00:00 \n--------------------------------------------------------------------------------\nTotal 2.3 MB/s | 874 kB 00:00 \nPostgreSQL common RPMs for RHEL/CentOS 8 - x86_ 1.6 MB/s | 1.7 kB 00:00 \nKey imported successfully\nExtra Packages for Enterprise Linux 8 - x86_64 7.3 kB/s | 1.6 kB 00:00 \nKey imported successfully\nRunning transaction check\nTransaction check succeeded.\nRunning transaction test\nTransaction test succeeded.\nRunning transaction\n Preparing : 1/1 \n Installing : perl-UNIVERSAL-isa-1.20171012-4.el8.noarch 1/4 \n Installing : perl-Text-CSV_XS-1.40-1.el8.x86_64 2/4 \n Installing : pgbadger-11.3-1.rhel8.noarch 3/4 \n Installing : pgcluu-3.1-2.rhel8.noarch 4/4 \n Running scriptlet: pgcluu-3.1-2.rhel8.noarch 4/4 \n Verifying : pgbadger-11.3-1.rhel8.noarch 1/4 \n Verifying : pgcluu-3.1-2.rhel8.noarch 2/4 \n Verifying : perl-Text-CSV_XS-1.40-1.el8.x86_64 3/4 \n Verifying : perl-UNIVERSAL-isa-1.20171012-4.el8.noarch 4/4 \n\nInstalled:\n perl-Text-CSV_XS-1.40-1.el8.x86_64 perl-UNIVERSAL-isa-1.20171012-4.el8.noarch\n pgbadger-11.3-1.rhel8.noarch pgcluu-3.1-2.rhel8.noarch \n\nComplete!\n\nlago.ssh: DEBUG: Command dc1924fc on lago-performance-suite-master-engine errors:\n + pg_datadir=/var/lib/pgsql/data\n+ pg_service=postgresql.service\n+ pgdg=\n+ scl_enable=\n++ get_engine_pg_scl\n++ engine_pg_scl_conf=(/etc/ovirt-engine/engine.conf.d/*scl-postgres*.conf)\n++ local engine_pg_scl_conf\n++ local res=\n++ [[ -e /etc/ovirt-engine/engine.conf.d/*scl-postgres*.conf ]]\n++ echo \'\'\n+ engine_pg_scl=\n+ [[ -n \'\' ]]\n++ rpm -q postgresql\n+ pgver=postgresql-12.1-2.module_el8.1.0+273+979c16e6.x86_64\n+ case "${pgver}" in\n+ pgdg=https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/… [[ -n https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/pgdg-… ]]\n+ yum install -y https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/pgdg-… yum install -y pgbadger pgcluu\nwarning: /var/cache/dnf/pgdg-common-38b6c5045045f841/packages/pgbadger-11.3-1.rhel8.noarch.rpm: Header V4 DSA/SHA1 Signature, key ID 442df0f8: NOKEY\nImporting GPG key 0x442DF0F8:\n Userid : "PostgreSQL RPM Building Project <pgsqlrpms-hackers(a)pgfoundry.org>"\n Fingerprint: 68C9 E2B9 1A37 D136 FE74 D176 1F16 D2E1 442D F0F8\n From : /etc/pki/rpm-gpg/RPM-GPG-KEY-PGDG\nwarning: /var/cache/dnf/epel-el8-e791ead165840057/packages/perl-Text-CSV_XS-1.40-1.el8.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID 2f86d6a1: NOKEY\nImporting GPG key 0x2F86D6A1:\n Userid : "Fedora EPEL (8) <epel(a)fedoraproject.org>"\n Fingerprint: 94E2 79EB 8D8F 25B2 1810 ADF1 21EA 45AB 2F86 D6A1\n From : https://dl.fedoraproject.org/pub/epel/RPM-GPG-KEY-EPEL-8\n++ su - postgres -c \'psql postgres postgres -t -c \'\\\'\'show log_directory\'\\\'\'\'\n++ sed 2d\n+ pglogdir=\' log\'\n+ pglogdir=log\n+ cd /var/lib/pgsql/data/log/\n++ su - postgres -c \'psql postgres postgres -t -c \'\\\'\'show log_filename\'\\\'\'\'\n++ sed 2d\n+ pglog=\' postgresql-%m.log\'\n++ date +postgresql-%m.log\n+ pglog=postgresql-10.log\n+ mkdir pgbadger\n+ pgbadger -f stderr postgresql-10.log --outdir pgbadger\nFATAL: logfile "postgresql-10.log" must exist!\n - Error at line 2410\n\n--------------------- >> end captured logging << ---------------------'

1 1

oVirt infra daily report - unstable production jobs - 1362
by jenkins＠jenkins.phx.ovirt.org 02 Nov '20

02 Nov '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1362//artifact/exported… Cheers, Jenkins

1 0

[CQ]: 111946,2 (ovirt-system-tests) failed "ovirt-4.3" system tests
by oVirt Jenkins 01 Nov '20

01 Nov '20

Change 111946,2 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-4.3" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111946/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/4024/

1 0

[CQ]: 111946, 2 (ovirt-system-tests) failed "ovirt-master" system tests
by oVirt Jenkins 01 Nov '20

01 Nov '20

Change 111946,2 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111946/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26731/

1 0

[JIRA] (OVIRT-3052) [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://www.gtlib.gatech.edu/pub/oVirt/pub
by Alertmanager_Bot (oVirt JIRA) 01 Nov '20

01 Nov '20

Alertmanager_Bot created OVIRT-3052: --------------------------------------- Summary: [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://www.gtlib.gatech.edu/pub/oVirt/pub Key: OVIRT-3052 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3052 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Alertmanager_Bot Assignee: infra Labels: - alertname = MirrorIsOutOfSync - instance = web-ovirt-mirrorchecker.apps.ovirt.org:80 - job = oVirt-mirrors-health - url = http://www.gtlib.gatech.edu/pub/oVirt/pub Annotations: - description = http://www.gtlib.gatech.edu/pub/oVirt/pub (measured by oVirt-mirrors-health) has not been synced in the past two days. Source: http://prometheus-0:9090/graph?g0.expr=mirror_health_check+%3E+259200&g0.ta… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0