- Infra - oVirt List Archives

oVirt infra daily report - unstable production jobs - 1349
by jenkins＠jenkins.phx.ovirt.org 19 Oct '20

19 Oct '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1349//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-3046) automatically drop stale mirrors from mirrorlist
by Evgheni Dereveanchin (oVirt JIRA) 19 Oct '20

19 Oct '20

Evgheni Dereveanchin created OVIRT-3046: ------------------------------------------- Summary: automatically drop stale mirrors from mirrorlist Key: OVIRT-3046 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3046 Project: oVirt - virtualization made easy Issue Type: Improvement Reporter: Evgheni Dereveanchin Assignee: infra The mirrorlist is static currently and stale mirrors need to be removed manually. This ticket is to implement a script that will read mirrorchecker results and provide only fresh mirrors to end users. It can later be used to provide OVIRT-2971 as well -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0

[JIRA] (OVIRT-3045) Adding Terraform Provider to CI testing in OST
by Eli Mesika (oVirt JIRA) 19 Oct '20

19 Oct '20

Eli Mesika created OVIRT-3045: --------------------------------- Summary: Adding Terraform Provider to CI testing in OST Key: OVIRT-3045 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3045 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Eli Mesika Assignee: infra Hi We want to have CI testing on OST for the Terraform Provider repo [1] in order to fully test it for each change since it is used by the OCP installer We need that the created engine will be on latest upstream and will have 1 running host and an active storage domain We will create on this env only light VMs with 1 GB storage (not pre-allocated) We need that each PR on [1] will run OST and invoke our shell script that will do the test We need also permissions for the repo in which we put the script for : emesika(a)redhat.com gzaidman(a)redhat.com eslutsky(a)redhat.com We will need also to set OST suite for script dependencies like Go & Terraform Thanks Eli Mesika [1] https://github.com/oVirt/terraform-provider-ovirt -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 501 - Failure!
by jenkins＠jenkins.phx.ovirt.org 19 Oct '20

19 Oct '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 501 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #501 [Radoslaw Szwajkowski] UI test: Add PF4 selectors for Manage vGPU dialog ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.099_aaa-ldap.test_add_ldap_provider Error Message: ShellError: Command failed with rc=22. Stdout: Stderr: curl: (22) The requested URL returned error: 503 Service Unavailable Stack Trace: ansible_engine = <ost_utils.ansible._AnsibleModuleMapper object at 0x7f063382c1d0> ansible_machine_389ds = <ost_utils.ansible._AnsibleModuleMapper object at 0x7f063382c1d0> machine_389ds_ip = '192.168.201.4' engine_restart = <function restart at 0x7f063380dd70> def test_add_ldap_provider(ansible_engine, ansible_machine_389ds, machine_389ds_ip, engine_restart): answer_file_src = os.path.join( os.environ.get('SUITE'), 'aaa-ldap-answer-file.conf' ) with open(answer_file_src, 'r') as f: content = f.read() content = content.replace('@389DS_IP@', machine_389ds_ip) with tempfile.NamedTemporaryFile(mode='w') as temp: temp.write(content) temp.flush() os.fsync(temp.fileno()) ansible_engine.copy(src=temp.name, dest='/root/aaa-ldap-answer-file.conf') ansible_machine_389ds.systemd(name='dirsrv@lago', state='started') ansible_engine.shell( 'ovirt-engine-extension-aaa-ldap-setup ' '--config-append=/root/aaa-ldap-answer-file.conf ' '--log=/var/log/ovirt-engine-extension-aaa-ldap-setup.log' ) > engine_restart() ../basic-suite-master/test-scenarios/099_aaa-ldap.py:73: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ../ost_utils/ost_utils/pytest/fixtures/engine.py:165: in restart engine_download(health_url) ../ost_utils/ost_utils/pytest/fixtures/engine.py:140: in download return shell(args, bytes_output=True) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['curl', '-fsS', '-m', '10', '--resolve', 'engine:80:192.168.201.4', ...] bytes_output = True, kwargs = {} process = <subprocess.Popen object at 0x7f06401dbf50>, out = '' err = 'curl: (22) The requested URL returned error: 503 Service Unavailable\n' def shell(args, bytes_output=False, **kwargs): process = subprocess.Popen(args, stdout=subprocess.PIPE, stderr=subprocess.PIPE, **kwargs) out, err = process.communicate() if not bytes_output: out = out.decode("utf-8") err = err.decode("utf-8") if process.returncode: > raise ShellError(process.returncode, out, err) E ShellError: Command failed with rc=22. Stdout: E E Stderr: E curl: (22) The requested URL returned error: 503 Service Unavailable ../ost_utils/ost_utils/shell.py:51: ShellError

1 1

[oVirt Jenkins] ovirt-system-tests_upgrade-from-prevrelease-suite-4.3_nightly - Build # 434 - Failure!
by jenkins＠jenkins.phx.ovirt.org 19 Oct '20

19 Oct '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-prevrelease-s… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-prevrelease-s… Build Number: 434 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #434 [Radoslaw Szwajkowski] UI test: Add PF4 selectors for Manage vGPU dialog ----------------- Failed Tests: ----------------- No tests ran.

1 1

oVirt infra daily report - unstable production jobs - 1348
by jenkins＠jenkins.phx.ovirt.org 18 Oct '20

18 Oct '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1348//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-3044) [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://mirror.massclouds.com/ovirt
by Alertmanager_Bot (oVirt JIRA) 18 Oct '20

18 Oct '20

Alertmanager_Bot created OVIRT-3044: --------------------------------------- Summary: [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://mirror.massclouds.com/ovirt Key: OVIRT-3044 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3044 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Alertmanager_Bot Assignee: infra Labels: - alertname = MirrorIsOutOfSync - instance = web-ovirt-mirrorchecker.apps.ovirt.org:80 - job = oVirt-mirrors-health - url = http://mirror.massclouds.com/ovirt Annotations: - description = http://mirror.massclouds.com/ovirt (measured by oVirt-mirrors-health) has not been synced in the past two days. Source: http://prometheus-0:9090/graph?g0.expr=mirror_health_check+%3E+172800&g0.ta… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0

[oVirt Jenkins] ovirt-system-tests_upgrade-from-release-suite-4.3_nightly - Build # 431 - Failure!
by jenkins＠jenkins.phx.ovirt.org 18 Oct '20

18 Oct '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-release-suite… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-release-suite… Build Number: 431 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #431 [Radoslaw Szwajkowski] UI test: Add PF4 selectors for Manage vGPU dialog ----------------- Failed Tests: ----------------- No tests ran.

1 1

oVirt infra daily report - unstable production jobs - 1347
by jenkins＠jenkins.phx.ovirt.org 17 Oct '20

17 Oct '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1347//artifact/exported… Cheers, Jenkins

1 0

oVirt infra daily report - unstable production jobs - 1346
by jenkins＠jenkins.phx.ovirt.org 16 Oct '20

16 Oct '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1346//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-3043) [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://mirror.rackspace.com/ovirt
by Alertmanager_Bot (oVirt JIRA) 16 Oct '20

16 Oct '20

Alertmanager_Bot created OVIRT-3043: --------------------------------------- Summary: [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://mirror.rackspace.com/ovirt Key: OVIRT-3043 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3043 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Alertmanager_Bot Assignee: infra Labels: - alertname = MirrorIsOutOfSync - instance = web-ovirt-mirrorchecker.apps.ovirt.org:80 - job = oVirt-mirrors-health - url = http://mirror.rackspace.com/ovirt Annotations: - description = http://mirror.rackspace.com/ovirt (measured by oVirt-mirrors-health) has not been synced in the past two days. Source: http://prometheus-0:9090/graph?g0.expr=mirror_health_check+%3E+172800&g0.ta… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 492 - Failure!
by jenkins＠jenkins.phx.ovirt.org 16 Oct '20

16 Oct '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 492 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #492 [Radoslaw Szwajkowski] UI test: Add PF4 selectors for Manage vGPU dialog ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.002_bootstrap.test_verify_engine_backup Error Message: AssertionError: False != True after 600 seconds Stack Trace: ansible_engine = <ost_utils.ansible._AnsibleModuleMapper object at 0x7fa15b411e50> engine_api = <ovirtsdk4.Connection object at 0x7fa15b482110> @order_by(_TEST_LIST) def test_verify_engine_backup(ansible_engine, engine_api): ansible_engine.file( path='/var/log/ost-engine-backup', state='directory', mode='0755' ) engine = engine_api.system_service() with test_utils.TestEvent(engine, [9024, 9025]): #backup started event, completed ansible_engine.shell( > 'engine-backup ' '--mode=backup ' '--file=/var/log/ost-engine-backup/backup.tgz ' '--log=/var/log/ost-engine-backup/log.txt' ) ../basic-suite-master/test-scenarios/002_bootstrap.py:1246: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib64/python2.7/contextlib.py:35: in __exit__ self.gen.throw(type, value, traceback) ../ost_utils/ost_utils/engine_utils.py:44: in wait_for_event lambda: ../ost_utils/ost_utils/assertions.py:97: in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) ../ost_utils/ost_utils/assertions.py:82: in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ func = <function <lambda> at 0x7fa15a6d56e0>, value = True, timeout = 600 allowed_exceptions = [], initial_wait = 0 error_message = 'False != True after 600 seconds' def assert_equals_within( func, value, timeout, allowed_exceptions=None, initial_wait=10, error_message=None ): allowed_exceptions = allowed_exceptions or [] with _EggTimer(timeout) as timer: while not timer.elapsed(): try: res = func() if res == value: return except Exception as exc: if _instance_of_any(exc, allowed_exceptions): time.sleep(3) continue LOGGER.exception("Unhandled exception in %s", func) raise if initial_wait == 0: time.sleep(3) else: time.sleep(initial_wait) initial_wait = 0 try: if error_message is None: error_message = '%s != %s after %s seconds' % (res, value, timeout) > raise AssertionError(error_message) E AssertionError: False != True after 600 seconds ../ost_utils/ost_utils/assertions.py:60: AssertionError

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 468 - Failure!
by jenkins＠jenkins.phx.ovirt.org 16 Oct '20

16 Oct '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/46… Build Number: 468 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #468 [Radoslaw Szwajkowski] UI test: Add PF4 selectors for Manage vGPU dialog ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 005_network_by_label.assign_labeled_network Error Message: False != True after 180 seconds Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/005_network_by_label.py", line 149, in assign_labeled_network host_service, LABELED_NET_NAME)) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 282, in assert_true_within_short assert_equals_within_short(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 266, in assert_equals_within_short func, value, SHORT_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) AssertionError: False != True after 180 seconds

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 482 - Failure!
by jenkins＠jenkins.phx.ovirt.org 15 Oct '20

15 Oct '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 482 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #482 [hbraha] network: bond active slave test [Evgheni Dereveanchin] Change logic for module metadata detection ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.100_basic_ui_sanity.test_virtual_machines[firefox] Error Message: TimeoutException: Message: Wait until Manage vGPU dialog is displayed failed Stack Trace: ovirt_driver = <test_utils.navigation.driver.Driver object at 0x7fca7f1e4290> setup_virtual_machines = None save_screenshot = <function save at 0x7fca7f1d6aa0> save_page_source = <function save at 0x7fca75055488> def test_virtual_machines(ovirt_driver, setup_virtual_machines, save_screenshot, save_page_source): try: webadmin_menu = WebAdminLeftMenu(ovirt_driver) vm_list_view = webadmin_menu.open_vm_list_view() vms = vm_list_view.get_vms() assert 'vm0' in vms assert vm_list_view.is_new_button_enabled() is True assert vm_list_view.is_edit_button_enabled() is False assert vm_list_view.is_shutdown_button_enabled() is False assert vm_list_view.is_export_button_enabled() is False assert vm_list_view.is_migrate_button_enabled() is False vm_list_view.select_vm('vm0') assert vm_list_view.is_new_button_enabled() is True assert vm_list_view.is_edit_button_enabled() is True assert vm_list_view.is_shutdown_button_enabled() is True assert vm_list_view.is_export_button_enabled() is False assert vm_list_view.is_migrate_button_enabled() is True vm_list_view.poweroff() assert vm_list_view.is_new_button_enabled() is True assert vm_list_view.is_edit_button_enabled() is True assert vm_list_view.is_shutdown_button_enabled() is False assert vm_list_view.is_export_button_enabled() is True assert vm_list_view.is_migrate_button_enabled() is False vm_detail_view = vm_list_view.open_detail_view('vm0') assert vm_detail_view.get_name() == 'vm0' assert vm_detail_view.get_status() == 'Down' vm_list_view.run_once() # Waiting for Powering Up instead of Up to speed up the test execution vm_detail_view.wait_for_statuses(['Powering Up', 'Up']) vm_status = vm_detail_view.get_status() assert vm_status == 'Powering Up' or vm_status == 'Up' save_screenshot('vms-after-run-once') vm_detail_host_devices_tab = vm_detail_view.open_host_devices_tab() > vm_vgpu_dialog = vm_detail_host_devices_tab.open_manage_vgpu_dialog() ../basic-suite-master/test-scenarios/100_basic_ui_sanity.py:300: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ../basic-suite-master/test_utils/page_objects/VmDetailView.py:51: in open_manage_vgpu_dialog vm_vgpu_dialog.wait_for_displayed() ../basic-suite-master/test_utils/page_objects/Displayable.py:14: in wait_for_displayed self.ovirt_driver.wait_until('Wait until ' + self.get_displayable_name() + ' is displayed failed', self.is_displayed) ../basic-suite-master/test_utils/navigation/driver.py:282: in wait_until self._wait_until(message, testlib.SHORT_TIMEOUT, condition_method, *args) ../basic-suite-master/test_utils/navigation/driver.py:288: in _wait_until WebDriverWait(self.driver, timeout).until(ConditionClass(condition_method, *args), message) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ self = <selenium.webdriver.support.wait.WebDriverWait (session="2439723b-11fc-4659-bae4-5849fb651d8c")> method = <test_utils.navigation.driver.ConditionClass object at 0x7fca6f4d2f10> message = 'Wait until Manage vGPU dialog is displayed failed' def until(self, method, message=''): """Calls the method provided with the driver as an argument until the \ return value is not False.""" screen = None stacktrace = None end_time = time.time() + self._timeout while True: try: value = method(self._driver) if value: return value except self._ignored_exceptions as exc: screen = getattr(exc, 'screen', None) stacktrace = getattr(exc, 'stacktrace', None) time.sleep(self._poll) if time.time() > end_time: break > raise TimeoutException(message, screen, stacktrace) E TimeoutException: Message: Wait until Manage vGPU dialog is displayed failed ../.local/lib/python2.7/site-packages/selenium/webdriver/support/wait.py:80: TimeoutException

1 9

oVirt infra daily report - unstable production jobs - 1345
by jenkins＠jenkins.phx.ovirt.org 15 Oct '20

15 Oct '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1345//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-3042) git fetch fails - Network is unreachable (was: [CQ]: 111471,2 (ovirt-engine) failed "ovirt-master" system tests)
by Yedidyah Bar David (oVirt JIRA) 15 Oct '20

15 Oct '20

Yedidyah Bar David created OVIRT-3042: ----------------------------------------- Summary: git fetch fails - Network is unreachable (was: [CQ]: 111471,2 (ovirt-engine) failed "ovirt-master" system tests) Key: OVIRT-3042 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3042 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Yedidyah Bar David Assignee: infra On Thu, Oct 15, 2020 at 10:47 AM Radoslaw Szwajkowski <rszwajko(a)redhat.com> wrote: > > Fixed in https://gerrit.ovirt.org/#/c/111741/ It failed due to infra issue, adding infra-support and changing subject: https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/8460/console 10:42:37 stderr: fatal: unable to access 'https://gerrit.ovirt.org/ovirt-engine/': Failed to connect to 2600:1f18:26e2:3333::3333: Network is unreachable I think we already saw several other similar cases recently. Is anyone checking this? Is it a network issue? Routine maintenance? Something else? Perhaps we should patch our scripts to try a few times before failing. Thanks, -- Didi -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0

[JIRA] (OVIRT-3040) [FIRING:1] InstanceUnreachable ibm-srv03.ovirt.org kubernetes-nodes-exporter (amd64 linux ibm-srv03.ovirt.org true external bare-metal-external ci)
by Shlomi Zidmi (oVirt JIRA) 15 Oct '20

15 Oct '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3040?page=com.atlassian.jira.… ] Shlomi Zidmi commented on OVIRT-3040: ------------------------------------- Node is back online and reachable, however something went wrong with it yesterday and caused it to crash. I’m investigating what was the root cause for this. > [FIRING:1] InstanceUnreachable ibm-srv03.ovirt.org kubernetes-nodes-exporter (amd64 linux ibm-srv03.ovirt.org true external bare-metal-external ci) > --------------------------------------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-3040 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3040 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Alertmanager_Bot > Assignee: infra > Labels: ALERT{alertname="InstanceUnreachable",instance="ibm-srv03.ovirt.org",job="kubernetes-nodes-exporter"} > > Labels: > - alertname = InstanceUnreachable > - beta_kubernetes_io_arch = amd64 > - beta_kubernetes_io_os = linux > - instance = ibm-srv03.ovirt.org > - job = kubernetes-nodes-exporter > - kubernetes_io_hostname = ibm-srv03.ovirt.org > - node_role_kubernetes_io_compute = true > - region = external > - type = bare-metal-external > - zone = ci > Annotations: > - description = ibm-srv03.ovirt.org of job kubernetes-nodes-exporter has been possibly down for more than 10 minutes. > Source: http://prometheus-0:9090/graph?g0.expr=up%7Bjob%3D%22kubernetes-nodes-expor… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0

[CQ]: 111628, 8 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 15 Oct '20

15 Oct '20

A system test invoked by the "ovirt-master" change queue including change 111628,8 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 111471,2 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 111471,2 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/111628/8 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/111471/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26386/

1 0

[CQ]: 111184, 11 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 15 Oct '20

15 Oct '20

A system test invoked by the "ovirt-master" change queue including change 111184,11 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 111471,2 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 111471,2 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/111184/11 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/111471/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26384/

1 0

[oVirt Jenkins] ovirt-system-tests_upgrade-from-release-suite-4.3_nightly - Build # 420 - Failure!
by jenkins＠jenkins.phx.ovirt.org 14 Oct '20

14 Oct '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-release-suite… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-release-suite… Build Number: 420 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #420 No changes ----------------- Failed Tests: ----------------- No tests ran.

1 1

oVirt infra daily report - unstable production jobs - 1344
by jenkins＠jenkins.phx.ovirt.org 14 Oct '20

14 Oct '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1344//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-3041) review IOPS load on PHX storage servers
by Evgheni Dereveanchin (oVirt JIRA) 14 Oct '20

14 Oct '20

Evgheni Dereveanchin created OVIRT-3041: ------------------------------------------- Summary: review IOPS load on PHX storage servers Key: OVIRT-3041 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3041 Project: oVirt - virtualization made easy Issue Type: Task Reporter: Evgheni Dereveanchin Assignee: infra While looking at Grafana I stumbled upon strange IOPS load on our storage servers. Looks like /dev/sdc on both is seeing a constant flow of 500 write IOPS with few actual data traffic. Let's investigate this as this may be some VM putting extra load and maybe it is not feeling well. /dev/sda3 should be the storage0[1-2]-data1 storage domain according to the configuration document: https://ovirt-infra-docs.readthedocs.io/en/latest/Phoenix_Lab/Storage_Hosts… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0

[CQ]: 111471,2 (ovirt-engine) failed "ovirt-master" system tests
by oVirt Jenkins 14 Oct '20

14 Oct '20

Change 111471,2 (ovirt-engine) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111471/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26378/

1 0

[CQ]: 111681, 3 (ovirt-system-tests) failed "ovirt-master" system tests
by oVirt Jenkins 14 Oct '20

14 Oct '20

Change 111681,3 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111681/3 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26375/

1 0

[CQ]: 111681,3 (ovirt-system-tests) failed "ovirt-4.3" system tests
by oVirt Jenkins 14 Oct '20

14 Oct '20

Change 111681,3 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-4.3" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111681/3 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/3956/

1 0