July 2021 - Infra - oVirt List Archives

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 1287 - Failure!
by jenkins＠jenkins.phx.ovirt.org 03 Jul '21

03 Jul '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 1287 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #1287 [Marcin Sobczyk] network: Add missing 'ansible_hosts' fixture ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.test_001_initialize_engine.test_initialize_engine Error Message: failed on setup with "ost_utils.ansible.module_mappers.AnsibleExecutionError: Error running ansible: rc=2, stdout=lago-basic-suite-master-engine | FAILED! => { "changed": false, "elapsed": 120, "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.2 port 22: No route to host" } lago-basic-suite-master-host-0 | FAILED! => { "changed": false, "elapsed": 120, "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.3 port 22: No route to host" } lago-basic-suite-master-host-1 | FAILED! => { "changed": false, "elapsed": 120, "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.4 port 22: No route to host" }" Stack Trace: ansible_vms_to_deploy = <ost_utils.ansible.module_mappers.ModuleMapper object at 0x7f2fb1959278> ansible_hosts = <ost_utils.ansible.module_mappers.ModuleMapper object at 0x7f2fb1959358> deploy_scripts = {'lago-basic-suite-master-engine': ['$OST_REPO_ROOT/common/deploy-scripts/setup_sar_stat.sh', '$OST_REPO_ROOT/common/d...t-1': ['$OST_REPO_ROOT/common/deploy-scripts/setup_sar_stat.sh', '$OST_REPO_ROOT/common/deploy-scripts/setup_host.sh']} working_dir = '/home/jenkins/workspace/ovirt-system-tests_basic-suite-master_nightly/ovirt-system-tests/deployment-basic-suite-master' request = <SubRequest 'deploy' for <Function test_initialize_engine>> run_scripts = <function run_scripts.<locals>.do_run_scripts at 0x7f2fb191a6a8> @pytest.fixture(scope="session", autouse=True) def deploy( ansible_vms_to_deploy, ansible_hosts, deploy_scripts, working_dir, request, run_scripts, ): if deployment_utils.is_deployed(working_dir): LOGGER.info("Environment already deployed") return LOGGER.info("Waiting for SSH on the VMs") > ansible_vms_to_deploy.wait_for_connection(timeout=120) ost_utils/ost_utils/pytest/fixtures/deployment.py:61: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ost_utils/ost_utils/ansible/module_mappers.py:110: in __call__ return _run_ansible_runner(self.config_builder) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ config_builder = <ost_utils.ansible.config_builder.ConfigBuilder object at 0x7f2fb19595f8> def _run_ansible_runner(config_builder): runner = ansible_runner.Runner(config=config_builder.prepare()) LOGGER.debug(f'_run_ansible_runner: before run: {runner}') runner.run() LOGGER.debug(f'_run_ansible_runner: after run: {runner}') if runner.status != 'successful': raise AnsibleExecutionError( rc=runner.rc, > stdout=runner.stdout.read() ) E ost_utils.ansible.module_mappers.AnsibleExecutionError: Error running ansible: rc=2, stdout=lago-basic-suite-master-engine | FAILED! => { E "changed": false, E "elapsed": 120, E "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.2 port 22: No route to host" E } E lago-basic-suite-master-host-0 | FAILED! => { E "changed": false, E "elapsed": 120, E "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.3 port 22: No route to host" E } E lago-basic-suite-master-host-1 | FAILED! => { E "changed": false, E "elapsed": 120, E "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.4 port 22: No route to host" E } ost_utils/ost_utils/ansible/module_mappers.py:48: AnsibleExecutionError

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 623 - Failure!
by jenkins＠jenkins.phx.ovirt.org 03 Jul '21

03 Jul '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/62… Build Number: 623 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #623 [parthdhanjal] Updating max click version ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.disk_operations Error Message: False != True after 600 seconds -------------------- >> begin captured logging << -------------------- lago.utils: DEBUG: Error while running thread Thread-63 Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 508, in live_storage_migration testlib.assert_true_within_long(lambda: test_utils.all_jobs_finished(engine, correlation_id)) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) AssertionError: False != True after 600 seconds --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 932, in disk_operations vt.join_all() File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue queue.put({'return': func()}) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 508, in live_storage_migration testlib.assert_true_within_long(lambda: test_utils.all_jobs_finished(engine, correlation_id)) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) 'False != True after 600 seconds\n-------------------- >> begin captured logging << --------------------\nlago.utils: DEBUG: Error while running thread Thread-63\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue\n queue.put({\'return\': func()})\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper\n return func(get_test_prefix(), *args, **kwargs)\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper\n prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs\n File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 508, in live_storage_migration\n testlib.assert_true_within_long(lambda: test_utils.all_jobs_finished(engine, correlation_id))\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long\n assert_equals_within_long(func, True, allowed_exceptions)\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long\n func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within\n \'%s != %s after %s seconds\' % (res, value, timeout)\nAssertionError: False != True after 600 seconds\n--------------------- >> end captured logging << ---------------------'

1 1

oVirt infra daily report - unstable production jobs - 1605
by jenkins＠jenkins.phx.ovirt.org 03 Jul '21

03 Jul '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1605//artifact/exported… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 1284 - Failure!
by jenkins＠jenkins.phx.ovirt.org 02 Jul '21

02 Jul '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 1284 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #1284 [Pavel Bar] backup: fix OST backup test due to change in VM backup behavior ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.test_001_initialize_engine.test_initialize_engine Error Message: failed on setup with "ost_utils.ansible.module_mappers.AnsibleExecutionError: Error running ansible: rc=2, stdout=lago-basic-suite-master-host-1 | FAILED! => { "changed": false, "elapsed": 120, "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.4 port 22: No route to host" } lago-basic-suite-master-host-0 | FAILED! => { "changed": false, "elapsed": 120, "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.3 port 22: No route to host" } lago-basic-suite-master-engine | FAILED! => { "changed": false, "elapsed": 120, "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.2 port 22: No route to host" }" Stack Trace: ansible_vms_to_deploy = <ost_utils.ansible.module_mappers.ModuleMapper object at 0x7f6262b9b0f0> deploy_scripts = {'lago-basic-suite-master-engine': ['$OST_REPO_ROOT/common/deploy-scripts/setup_sar_stat.sh', '$OST_REPO_ROOT/common/d...t-1': ['$OST_REPO_ROOT/common/deploy-scripts/setup_sar_stat.sh', '$OST_REPO_ROOT/common/deploy-scripts/setup_host.sh']} working_dir = '/home/jenkins/workspace/ovirt-system-tests_basic-suite-master_nightly/ovirt-system-tests/deployment-basic-suite-master' request = <SubRequest 'deploy' for <Function test_initialize_engine>> run_scripts = <function run_scripts.<locals>.do_run_scripts at 0x7f6262bbb268> @pytest.fixture(scope="session", autouse=True) def deploy( ansible_vms_to_deploy, deploy_scripts, working_dir, request, run_scripts, ): if deployment_utils.is_deployed(working_dir): LOGGER.info("Environment already deployed") return LOGGER.info("Waiting for SSH on the VMs") > ansible_vms_to_deploy.wait_for_connection(timeout=120) ost_utils/ost_utils/pytest/fixtures/deployment.py:59: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ost_utils/ost_utils/ansible/module_mappers.py:110: in __call__ return _run_ansible_runner(self.config_builder) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ config_builder = <ost_utils.ansible.config_builder.ConfigBuilder object at 0x7f6262b9b400> def _run_ansible_runner(config_builder): runner = ansible_runner.Runner(config=config_builder.prepare()) LOGGER.debug(f'_run_ansible_runner: before run: {runner}') runner.run() LOGGER.debug(f'_run_ansible_runner: after run: {runner}') if runner.status != 'successful': raise AnsibleExecutionError( rc=runner.rc, > stdout=runner.stdout.read() ) E ost_utils.ansible.module_mappers.AnsibleExecutionError: Error running ansible: rc=2, stdout=lago-basic-suite-master-host-1 | FAILED! => { E "changed": false, E "elapsed": 120, E "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.4 port 22: No route to host" E } E lago-basic-suite-master-host-0 | FAILED! => { E "changed": false, E "elapsed": 120, E "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.3 port 22: No route to host" E } E lago-basic-suite-master-engine | FAILED! => { E "changed": false, E "elapsed": 120, E "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.2 port 22: No route to host" E } ost_utils/ost_utils/ansible/module_mappers.py:48: AnsibleExecutionError

1 1

oVirt infra daily report - unstable production jobs - 1604
by jenkins＠jenkins.phx.ovirt.org 02 Jul '21

02 Jul '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1604//artifact/exported… Cheers, Jenkins

1 0

Build failed in Jenkins: system-sync_mirrors-mock-copr-el7-x86_64 #2340
by jenkins＠jenkins.phx.ovirt.org 01 Jul '21

01 Jul '21

See <https://jenkins.ovirt.org/job/system-sync_mirrors-mock-copr-el7-x86_64/2340…> Changes: ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <https://jenkins.ovirt.org/job/system-sync_mirrors-mock-copr-el7-x86_64/ws/> The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir <https://jenkins.ovirt.org/job/system-sync_mirrors-mock-copr-el7-x86_64/ws/j…> # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git --version # 'git version 1.8.3.1' > git fetch --tags --progress --prune http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10 ERROR: Error fetching remote repo 'origin' hudson.plugins.git.GitException: Failed to fetch from http://gerrit.ovirt.org/jenkins.git at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:1000) at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1241) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1301) at hudson.scm.SCM.checkout(SCM.java:505) at hudson.model.AbstractProject.checkout(AbstractProject.java:1211) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:636) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:508) at hudson.model.Run.execute(Run.java:1906) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:429) Caused by: hudson.plugins.git.GitException: Command "git fetch --tags --progress --prune http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/*" returned status code 128: stdout: stderr: fatal: unable to access 'http://gerrit.ovirt.org/jenkins.git/': Failed to connect to 2600:1f18:26e2:3333::3333: Network is unreachable at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2661) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:2086) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$500(CliGitAPIImpl.java:86) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:608) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:160) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:153) at hudson.remoting.UserRequest.perform(UserRequest.java:211) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:376) at hudson.remoting.InterceptingExecutorService.lambda$wrap$0(InterceptingExecutorService.java:78) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to mirrors.phx.ovirt.org at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1800) at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356) at hudson.remoting.Channel.call(Channel.java:1001) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:145) at sun.reflect.GeneratedMethodAccessor852.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:131) at com.sun.proxy.$Proxy117.execute(Unknown Source) at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:998) at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1241) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1301) at hudson.scm.SCM.checkout(SCM.java:505) at hudson.model.AbstractProject.checkout(AbstractProject.java:1211) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:636) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:508) at hudson.model.Run.execute(Run.java:1906) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:429) ERROR: Error fetching remote repo 'origin'

1 1

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_el7-nightly - Build # 610 - Failure!
by jenkins＠jenkins.phx.ovirt.org 01 Jul '21

01 Jul '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build Number: 610 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #610 [parthdhanjal] Updating max click version ----------------- Failed Tests: ----------------- No tests ran.

1 2