- Infra - oVirt List Archives

[CQ]: 111009, 3 (ovirt-system-tests) failed "ovirt-master" system tests
by oVirt Jenkins 14 Sep '20

14 Sep '20

Change 111009,3 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111009/3 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/25765/

1 0

[oVirt Jenkins] deploy-to-gated-ovirt-4.3 - Build #502 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 14 Sep '20

14 Sep '20

Build: https://jenkins.ovirt.org/job/deploy-to-gated-ovirt-4.3/502/ Build Name: #502 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

[oVirt Jenkins] cleanup-gated-ovirt-master - Build #274 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 14 Sep '20

14 Sep '20

Build: https://jenkins.ovirt.org/job/cleanup-gated-ovirt-master/274/ Build Name: #274 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

oVirt infra daily report - unstable production jobs - 1313
by jenkins＠jenkins.phx.ovirt.org 14 Sep '20

14 Sep '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1313//artifact/exported… Cheers, Jenkins

1 0

oVirt infra daily report - unstable production jobs - 1312
by jenkins＠jenkins.phx.ovirt.org 13 Sep '20

13 Sep '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1312//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 376 - Failure!
by jenkins＠jenkins.phx.ovirt.org 12 Sep '20

12 Sep '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 376 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #376 [Milan Zamazal] basic: Disable smartcard temporarily ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.099_aaa-ldap_pytest.test_add_ldap_provider Error Message: ShellError: Command failed with rc=22. Stdout: Stderr: curl: (22) The requested URL returned error: 503 Service Unavailable Stack Trace: prefix = <ovirtlago.prefix.OvirtPrefix object at 0x7fec8f5de710> engine_restart = <function restart at 0x7fec8f4dede8> def test_add_ldap_provider(prefix, engine_restart): engine = prefix.virt_env.engine_vm() machine_389ds = prefix.virt_env.get_vm(HOSTNAME_389DS) answer_file_src = os.path.join( os.environ.get('SUITE'), 'aaa-ldap-answer-file.conf' ) with open(answer_file_src, 'r') as f: content = f.read() content = content.replace('@389DS_IP@', machine_389ds.ip()) with tempfile.NamedTemporaryFile(mode='w', delete=False) as temp: temp.write(content) engine.copy_to(temp.name, '/root/aaa-ldap-answer-file.conf') os.unlink(temp.name) result = machine_389ds.ssh( [ 'systemctl', 'start', 'dirsrv@lago', ], ) assert result.code == 0, \ 'Failed to start LDAP server. Exit code %s' % result.code result = engine.ssh( [ 'ovirt-engine-extension-aaa-ldap-setup', '--config-append=/root/aaa-ldap-answer-file.conf', '--log=/var/log/ovirt-engine-extension-aaa-ldap-setup.log', ], ) assert result.code == 0, \ 'aaa-ldap-setup failed. Exit code is %s' % result.code > engine_restart() ../basic-suite-master/test-scenarios/099_aaa-ldap_pytest.py:78: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ../ost_utils/ost_utils/pytest/fixtures/engine.py:165: in restart engine_download(health_url) ../ost_utils/ost_utils/pytest/fixtures/engine.py:140: in download return shell(args, bytes_output=True) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['curl', '-fsS', '-m', '10', '--resolve', 'engine:80:192.168.201.4', ...] bytes_output = True, kwargs = {} process = <subprocess.Popen object at 0x7fec91533350>, out = '' err = 'curl: (22) The requested URL returned error: 503 Service Unavailable\n' def shell(args, bytes_output=False, **kwargs): process = subprocess.Popen(args, stdout=subprocess.PIPE, stderr=subprocess.PIPE, **kwargs) out, err = process.communicate() if not bytes_output: out = out.decode("utf-8") err = err.decode("utf-8") if process.returncode: > raise ShellError(process.returncode, out, err) E ShellError: Command failed with rc=22. Stdout: E E Stderr: E curl: (22) The requested URL returned error: 503 Service Unavailable ../ost_utils/ost_utils/shell.py:51: ShellError

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 371 - Failure!
by jenkins＠jenkins.phx.ovirt.org 12 Sep '20

12 Sep '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 371 Build Status: Failure Triggered By: Started by user Parth Dhanjal ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #371 [Milan Zamazal] basic: Disable smartcard temporarily ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.002_bootstrap_pytest.test_verify_add_hosts Error Message: RuntimeError: 1 hosts failed installation: lago-basic-suite-master-host-0: install_failed Stack Trace: engine_api = <ovirtsdk4.Connection object at 0x7f1d8c97ddd0> @order_by(_TEST_LIST) def test_verify_add_hosts(engine_api): hosts_service = engine_api.system_service().hosts_service() hosts_status = hosts_service.list(search='datacenter={}'.format(DC_NAME)) total_hosts = len(hosts_status) dump_hosts = _host_status_to_print(hosts_service, hosts_status) LOGGER.debug('Host status, verify_add_hosts:\n {}'.format(dump_hosts)) testlib.assert_true_within( lambda: _single_host_up(hosts_service, total_hosts), > timeout=constants.ADD_HOST_TIMEOUT ) ../basic-suite-master/test-scenarios/002_bootstrap_pytest.py:467: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib/python2.7/site-packages/ovirtlago/testlib.py:278: in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) /usr/lib/python2.7/site-packages/ovirtlago/testlib.py:234: in assert_equals_within res = func() ../basic-suite-master/test-scenarios/002_bootstrap_pytest.py:466: in <lambda> lambda: _single_host_up(hosts_service, total_hosts), ../basic-suite-master/test-scenarios/002_bootstrap_pytest.py:238: in _single_host_up _check_problematic_hosts(hosts_service) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ hosts_service = <ovirtsdk4.services.HostsService object at 0x7f1d8c99e0d0> def _check_problematic_hosts(hosts_service): problematic_hosts = hosts_service.list(search='datacenter={} AND status != installing and status != initializing and status != up'.format(DC_NAME)) if len(problematic_hosts): dump_hosts = '%s hosts failed installation:\n' % len(problematic_hosts) for host in problematic_hosts: host_service = hosts_service.host_service(host.id) dump_hosts += '%s: %s\n' % (host.name, host_service.get().status) > raise RuntimeError(dump_hosts) E RuntimeError: 1 hosts failed installation: E lago-basic-suite-master-host-0: install_failed ../basic-suite-master/test-scenarios/002_bootstrap_pytest.py:247: RuntimeError

1 4

oVirt infra daily report - unstable production jobs - 1311
by jenkins＠jenkins.phx.ovirt.org 12 Sep '20

12 Sep '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1311//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 369 - Failure!
by jenkins＠jenkins.phx.ovirt.org 11 Sep '20

11 Sep '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 369 Build Status: Failure Triggered By: Started by user Parth Dhanjal ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #369 [Milan Zamazal] basic: Disable smartcard temporarily ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.002_bootstrap_pytest.test_verify_add_hosts Error Message: RuntimeError: 1 hosts failed installation: lago-basic-suite-master-host-0: install_failed Stack Trace: engine_api = <ovirtsdk4.Connection object at 0x7f34a5ef3dd0> @order_by(_TEST_LIST) def test_verify_add_hosts(engine_api): hosts_service = engine_api.system_service().hosts_service() hosts_status = hosts_service.list(search='datacenter={}'.format(DC_NAME)) total_hosts = len(hosts_status) dump_hosts = _host_status_to_print(hosts_service, hosts_status) LOGGER.debug('Host status, verify_add_hosts:\n {}'.format(dump_hosts)) testlib.assert_true_within( lambda: _single_host_up(hosts_service, total_hosts), > timeout=constants.ADD_HOST_TIMEOUT ) ../basic-suite-master/test-scenarios/002_bootstrap_pytest.py:467: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib/python2.7/site-packages/ovirtlago/testlib.py:278: in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) /usr/lib/python2.7/site-packages/ovirtlago/testlib.py:234: in assert_equals_within res = func() ../basic-suite-master/test-scenarios/002_bootstrap_pytest.py:466: in <lambda> lambda: _single_host_up(hosts_service, total_hosts), ../basic-suite-master/test-scenarios/002_bootstrap_pytest.py:238: in _single_host_up _check_problematic_hosts(hosts_service) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ hosts_service = <ovirtsdk4.services.HostsService object at 0x7f34a62680d0> def _check_problematic_hosts(hosts_service): problematic_hosts = hosts_service.list(search='datacenter={} AND status != installing and status != initializing and status != up'.format(DC_NAME)) if len(problematic_hosts): dump_hosts = '%s hosts failed installation:\n' % len(problematic_hosts) for host in problematic_hosts: host_service = hosts_service.host_service(host.id) dump_hosts += '%s: %s\n' % (host.name, host_service.get().status) > raise RuntimeError(dump_hosts) E RuntimeError: 1 hosts failed installation: E lago-basic-suite-master-host-0: install_failed ../basic-suite-master/test-scenarios/002_bootstrap_pytest.py:247: RuntimeError

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 366 - Failure!
by jenkins＠jenkins.phx.ovirt.org 11 Sep '20

11 Sep '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 366 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #366 [Milan Zamazal] basic: Disable smartcard temporarily ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.100_basic_ui_sanity_pytest.test_login[firefox] Error Message: test setup failure Stack Trace: engine_fqdn = 'engine', engine_ip = '192.168.201.4' @pytest.fixture(scope="session") def hub_url(engine_fqdn, engine_ip): env_url = _env_hub_url() if env_url is not None: yield env_url else: backend = _grid_backend() if backend == "podman": if os_utils.on_centos(8) and os_utils.inside_mock(): pytest.skip("podman doesn't work in mock") hub_port = network_utils.find_free_port(4444, 4544) with podman.grid(engine_fqdn, engine_ip, hub_port=hub_port) as hub_url: yield hub_url elif backend == "docker": > with docker.grid(engine_fqdn, engine_ip) as hub_url: ../ost_utils/ost_utils/pytest/fixtures/selenium/__init__.py:76: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib64/python2.7/contextlib.py:17: in __enter__ return self.gen.next() ../ost_utils/ost_utils/selenium/docker.py:118: in grid with _network(network_name): /usr/lib64/python2.7/contextlib.py:17: in __enter__ return self.gen.next() ../ost_utils/ost_utils/selenium/docker.py:61: in _network shell(["docker", "network", "create", network_name]) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ args = ['docker', 'network', 'create', 'grid'], bytes_output = False kwargs = {}, process = <subprocess.Popen object at 0x7f98b84743d0>, out = '' err = 'Error response from daemon: network with name grid already exists ' def shell(args, bytes_output=False, **kwargs): process = subprocess.Popen(args, stdout=subprocess.PIPE, stderr=subprocess.PIPE, **kwargs) out, err = process.communicate() if not bytes_output: out = out.decode("utf-8") err = err.decode("utf-8") if process.returncode: > raise ShellError(process.returncode, out, err) E ShellError: Command failed with rc=1. Stdout: E E Stderr: E Error response from daemon: network with name grid already exists ../ost_utils/ost_utils/shell.py:51: ShellError

1 1