July 2020 - Infra - oVirt List Archives

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 196 - Failure!
by jenkins＠jenkins.phx.ovirt.org 17 Jul '20

17 Jul '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 196 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #196 [Ehud Yonasi] fix el7 container label. ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.002_bootstrap_pytest.test_verify_add_hosts Error Message: RuntimeError: 1 hosts failed installation: lago-basic-suite-master-host-1: install_failed Stack Trace: api_v4 = <ovirtsdk4.Connection object at 0x7ffba7fe4e10> @order_by(_TEST_LIST) def test_verify_add_hosts(api_v4): hosts_service = api_v4.system_service().hosts_service() hosts_status = hosts_service.list(search='datacenter={}'.format(DC_NAME)) total_hosts = len(hosts_status) dump_hosts = _host_status_to_print(hosts_service, hosts_status) LOGGER.debug('Host status, verify_add_hosts:\n {}'.format(dump_hosts)) testlib.assert_true_within( lambda: _single_host_up(hosts_service, total_hosts), > timeout=constants.ADD_HOST_TIMEOUT ) ../basic-suite-master/test-scenarios/002_bootstrap_pytest.py:433: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib/python2.7/site-packages/ovirtlago/testlib.py:278: in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) /usr/lib/python2.7/site-packages/ovirtlago/testlib.py:234: in assert_equals_within res = func() ../basic-suite-master/test-scenarios/002_bootstrap_pytest.py:432: in <lambda> lambda: _single_host_up(hosts_service, total_hosts), ../basic-suite-master/test-scenarios/002_bootstrap_pytest.py:229: in _single_host_up _check_problematic_hosts(hosts_service) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ hosts_service = <ovirtsdk4.services.HostsService object at 0x7ffba813f850> def _check_problematic_hosts(hosts_service): problematic_hosts = hosts_service.list(search='datacenter={} AND status != installing and status != initializing and status != up'.format(DC_NAME)) if len(problematic_hosts): dump_hosts = '%s hosts failed installation:\n' % len(problematic_hosts) for host in problematic_hosts: host_service = hosts_service.host_service(host.id) dump_hosts += '%s: %s\n' % (host.name, host_service.get().status) > raise RuntimeError(dump_hosts) E RuntimeError: 1 hosts failed installation: E lago-basic-suite-master-host-1: install_failed ../basic-suite-master/test-scenarios/002_bootstrap_pytest.py:238: RuntimeError

1 1

oVirt infra daily report - unstable production jobs - 1255
by jenkins＠jenkins.phx.ovirt.org 17 Jul '20

17 Jul '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1255//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_upgrade-from-prevrelease-suite-4.3_nightly - Build # 150 - Failure!
by jenkins＠jenkins.phx.ovirt.org 16 Jul '20

16 Jul '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-prevrelease-s… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-prevrelease-s… Build Number: 150 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #150 [Marcin Sobczyk] ost-images: Use OST images when available ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.verify_add_hosts Error Message: 1 hosts failed installation: lago-upgrade-from-prevrelease-suite-4-3-host-0: install_failed -------------------- >> begin captured logging << -------------------- 002_bootstrap: DEBUG: Host status, verify_add_hosts: lago-upgrade-from-prevrelease-suite-4-3-host-0: installing ovirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7f8c245a9578> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/agent/workspace/ovirt-system-tests_upgrade-from-prevrelease-suite-4.3_nightly/ovirt-system-tests/upgrade-from-prevrelease-suite-4.3/test-scenarios-after-upgrade/002_bootstrap.py", line 227, in <lambda> lambda: _single_host_up(hosts_service, total_hosts), File "/home/jenkins/agent/workspace/ovirt-system-tests_upgrade-from-prevrelease-suite-4.3_nightly/ovirt-system-tests/upgrade-from-prevrelease-suite-4.3/test-scenarios-after-upgrade/002_bootstrap.py", line 98, in _single_host_up _check_problematic_hosts(hosts_service) File "/home/jenkins/agent/workspace/ovirt-system-tests_upgrade-from-prevrelease-suite-4.3_nightly/ovirt-system-tests/upgrade-from-prevrelease-suite-4.3/test-scenarios-after-upgrade/002_bootstrap.py", line 107, in _check_problematic_hosts raise RuntimeError(dump_hosts) RuntimeError: 1 hosts failed installation: lago-upgrade-from-prevrelease-suite-4-3-host-0: install_failed --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/home/jenkins/agent/workspace/ovirt-system-tests_upgrade-from-prevrelease-suite-4.3_nightly/ovirt-system-tests/upgrade-from-prevrelease-suite-4.3/test-scenarios-after-upgrade/002_bootstrap.py", line 228, in verify_add_hosts timeout=constants.ADD_HOST_TIMEOUT File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 278, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/agent/workspace/ovirt-system-tests_upgrade-from-prevrelease-suite-4.3_nightly/ovirt-system-tests/upgrade-from-prevrelease-suite-4.3/test-scenarios-after-upgrade/002_bootstrap.py", line 227, in <lambda> lambda: _single_host_up(hosts_service, total_hosts), File "/home/jenkins/agent/workspace/ovirt-system-tests_upgrade-from-prevrelease-suite-4.3_nightly/ovirt-system-tests/upgrade-from-prevrelease-suite-4.3/test-scenarios-after-upgrade/002_bootstrap.py", line 98, in _single_host_up _check_problematic_hosts(hosts_service) File "/home/jenkins/agent/workspace/ovirt-system-tests_upgrade-from-prevrelease-suite-4.3_nightly/ovirt-system-tests/upgrade-from-prevrelease-suite-4.3/test-scenarios-after-upgrade/002_bootstrap.py", line 107, in _check_problematic_hosts raise RuntimeError(dump_hosts) '1 hosts failed installation:\nlago-upgrade-from-prevrelease-suite-4-3-host-0: install_failed\n\n-------------------- >> begin captured logging << --------------------\n002_bootstrap: DEBUG: Host status, verify_add_hosts:\n lago-upgrade-from-prevrelease-suite-4-3-host-0: installing\n\novirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7f8c245a9578>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within\n res = func()\n File "/home/jenkins/agent/workspace/ovirt-system-tests_upgrade-from-prevrelease-suite-4.3_nightly/ovirt-system-tests/upgrade-from-prevrelease-suite-4.3/test-scenarios-after-upgrade/002_bootstrap.py", line 227, in <lambda>\n lambda: _single_host_up(hosts_service, total_hosts),\n File "/home/jenkins/agent/workspace/ovirt-system-tests_upgrade-from-prevrelease-suite-4.3_nightly/ovirt-system-tests/upgrade-from-prevrelease-suite-4.3/test-scenarios-after-upgrade/002_bootstrap.py", line 98, in _single_host_up\n _check_problematic_hosts(hosts_service)\n File "/home/jenkins/agent/workspace/ovirt-system-tests_upgrade-from-prevrelease-suite-4.3_nightly/ovirt-system-tests/upgrade-from-prevrelease-suite-4.3/test-scenarios-after-upgrade/002_bootstrap.py", line 107, in _check_problematic_hosts\n raise RuntimeError(dump_hosts)\nRuntimeError: 1 hosts failed installation:\nlago-upgrade-from-prevrelease-suite-4-3-host-0: install_failed\n\n--------------------- >> end captured logging << ---------------------'

1 1

oVirt infra daily report - unstable production jobs - 1254
by jenkins＠jenkins.phx.ovirt.org 16 Jul '20

16 Jul '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1254//artifact/exported… Cheers, Jenkins

1 0

Missing build-artifacts
by Yedidyah Bar David 16 Jul '20

16 Jul '20

Hi all, Any idea why [1] has no collected artifacts? I ran it to try to reproduce something similar to [2], using the same OST patch [3] - both as-is [1], for reproduction, and with a patched [4] engine [5], for verification. [5] passed, so I am happy with the verification. Former [1] failed, as expected, and at a reasonable point to be considered a reproduction (based on console output), but I can't be sure without some more logs. Going to mark the patch verified anyway, just wondering - mainly for the next time I'll want to use CI like that (which I do often). Thanks and best regards, [1] https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/10297/ [2] https://bugzilla.redhat.com/show_bug.cgi?id=1847963 [3] https://gerrit.ovirt.org/110302 [4] https://gerrit.ovirt.org/110284 [5] https://jenkins.ovirt.org/view/oVirt%20system%20tests/job/ovirt-system-test… -- Didi

1 0

[CQ]: 109378, 19 (ovirt-system-tests) failed "ovirt-master" system tests
by oVirt Jenkins 16 Jul '20

16 Jul '20

Change 109378,19 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/109378/19 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/24897/

1 0

[CQ]: 109378,19 (ovirt-system-tests) failed "ovirt-4.3" system tests
by oVirt Jenkins 16 Jul '20

16 Jul '20

Change 109378,19 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-4.3" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/109378/19 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/3685/

1 0

Build failed in Jenkins: system-mk_mirrors_index-yum #91868
by jenkins＠jenkins.phx.ovirt.org 16 Jul '20

16 Jul '20

See <https://jenkins.ovirt.org/job/system-mk_mirrors_index-yum/91868/display/red…> Changes: ------------------------------------------ Started by upstream project "system-sync_mirrors-centos-extras-7.6-el7-x86_64" build number 801 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <https://jenkins.ovirt.org/job/system-mk_mirrors_index-yum/ws/> No credentials specified > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress --prune http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10 ERROR: Error fetching remote repo 'origin' hudson.plugins.git.GitException: Failed to fetch from http://gerrit.ovirt.org/jenkins.git at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:909) at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1131) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1167) at hudson.scm.SCM.checkout(SCM.java:505) at hudson.model.AbstractProject.checkout(AbstractProject.java:1206) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499) at hudson.model.Run.execute(Run.java:1856) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:428) Caused by: hudson.plugins.git.GitException: Command "git fetch --tags --progress --prune http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/*" returned status code 128: stdout: stderr: fatal: unable to access 'http://gerrit.ovirt.org/jenkins.git/': Failed to connect to 2600:1f18:26e2:3333::3333: Network is unreachable at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2430) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:2044) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$500(CliGitAPIImpl.java:81) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:569) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:161) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:154) at hudson.remoting.UserRequest.perform(UserRequest.java:211) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:369) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to mirrors.phx.ovirt.org at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1788) at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356) at hudson.remoting.Channel.call(Channel.java:998) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146) at sun.reflect.GeneratedMethodAccessor933.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132) at com.sun.proxy.$Proxy90.execute(Unknown Source) at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:907) at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1131) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1167) at hudson.scm.SCM.checkout(SCM.java:505) at hudson.model.AbstractProject.checkout(AbstractProject.java:1206) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499) at hudson.model.Run.execute(Run.java:1856) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:428) ERROR: Error fetching remote repo 'origin'

1 1

[oVirt Jenkins] cleanup-gated-dummy-master - Build #208 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 15 Jul '20

15 Jul '20

Build: https://jenkins.ovirt.org/job/cleanup-gated-dummy-master/208/ Build Name: #208 Build Status: FAILURE Gerrit change: null - title: null - project: null - branch: null - author: null <null>

1 0

oVirt infra daily report - unstable production jobs - 1253
by jenkins＠jenkins.phx.ovirt.org 15 Jul '20

15 Jul '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1253//artifact/exported… Cheers, Jenkins

1 0