- Infra - oVirt List Archives

[CQ]: 111565, 2 (ovirt-engine-api-metamodel) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 05 Oct '20

05 Oct '20

A system test invoked by the "ovirt-master" change queue including change 111565,2 (ovirt-engine-api-metamodel) failed. However, this change seems not to be the root cause for this failure. Change 111144,2 (ovirt-engine-api- metamodel) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 111144,2 (ovirt-engine-api- metamodel) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/111565/2 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/111144/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26165/

1 0

oVirt infra daily report - unstable production jobs - 1334
by jenkins＠jenkins.phx.ovirt.org 04 Oct '20

04 Oct '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1334//artifact/exported… Cheers, Jenkins

1 0

[CQ]: 111559,1 (jenkins) failed "dummy-master" system tests
by oVirt Jenkins 04 Oct '20

04 Oct '20

Change 111559,1 (jenkins) is probably the reason behind recent system test failures in the "dummy-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111559/1 For failed test results see: https://jenkins-staging.phx.ovirt.org/job/dummy-master_change-queue-tester/…

1 0

oVirt infra daily report - unstable production jobs - 1333
by jenkins＠jenkins.phx.ovirt.org 03 Oct '20

03 Oct '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1333//artifact/exported… Cheers, Jenkins

1 0

Build failed in Jenkins: system-sync_mirrors-centos-extras-7.6-el7-x86_64 #1039
by jenkins＠jenkins.phx.ovirt.org 03 Oct '20

03 Oct '20

See <https://jenkins.ovirt.org/job/system-sync_mirrors-centos-extras-7.6-el7-x86…> Changes: ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <https://jenkins.ovirt.org/job/system-sync_mirrors-centos-extras-7.6-el7-x86…> No credentials specified > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git --version # 'git version 1.8.3.1' > git fetch --tags --progress --prune http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10 ERROR: Error fetching remote repo 'origin' hudson.plugins.git.GitException: Failed to fetch from http://gerrit.ovirt.org/jenkins.git at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:915) at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1141) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1177) at hudson.scm.SCM.checkout(SCM.java:505) at hudson.model.AbstractProject.checkout(AbstractProject.java:1206) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499) at hudson.model.Run.execute(Run.java:1880) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:428) Caused by: hudson.plugins.git.GitException: Command "git fetch --tags --progress --prune http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/*" returned status code 128: stdout: stderr: fatal: unable to access 'http://gerrit.ovirt.org/jenkins.git/': Could not resolve host: gerrit.ovirt.org; Unknown error at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2437) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:2051) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$500(CliGitAPIImpl.java:84) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:573) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:161) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:154) at hudson.remoting.UserRequest.perform(UserRequest.java:211) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:369) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to mirrors.phx.ovirt.org at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1788) at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356) at hudson.remoting.Channel.call(Channel.java:998) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146) at sun.reflect.GeneratedMethodAccessor732.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132) at com.sun.proxy.$Proxy84.execute(Unknown Source) at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:913) at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1141) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1177) at hudson.scm.SCM.checkout(SCM.java:505) at hudson.model.AbstractProject.checkout(AbstractProject.java:1206) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499) at hudson.model.Run.execute(Run.java:1880) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:428) ERROR: Error fetching remote repo 'origin'

1 1

Build failed in Jenkins: system-mk_mirrors_index-yum #100991
by jenkins＠jenkins.phx.ovirt.org 03 Oct '20

03 Oct '20

See <https://jenkins.ovirt.org/job/system-mk_mirrors_index-yum/100991/display/re…> Changes: ------------------------------------------ Started by upstream project "system-sync_mirrors-epel-el8-x86_64" build number 557 originally caused by: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <https://jenkins.ovirt.org/job/system-mk_mirrors_index-yum/ws/> No credentials specified > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git --version # 'git version 1.8.3.1' > git fetch --tags --progress --prune http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* # timeout=10 ERROR: Error fetching remote repo 'origin' hudson.plugins.git.GitException: Failed to fetch from http://gerrit.ovirt.org/jenkins.git at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:915) at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1141) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1177) at hudson.scm.SCM.checkout(SCM.java:505) at hudson.model.AbstractProject.checkout(AbstractProject.java:1206) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499) at hudson.model.Run.execute(Run.java:1880) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:428) Caused by: hudson.plugins.git.GitException: Command "git fetch --tags --progress --prune http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/*" returned status code 128: stdout: stderr: fatal: unable to access 'http://gerrit.ovirt.org/jenkins.git/': Could not resolve host: gerrit.ovirt.org; Unknown error at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2437) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:2051) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$500(CliGitAPIImpl.java:84) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:573) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:161) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$GitCommandMasterToSlaveCallable.call(RemoteGitImpl.java:154) at hudson.remoting.UserRequest.perform(UserRequest.java:211) at hudson.remoting.UserRequest.perform(UserRequest.java:54) at hudson.remoting.Request$2.run(Request.java:369) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:72) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Suppressed: hudson.remoting.Channel$CallSiteStackTrace: Remote call to mirrors.phx.ovirt.org at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1788) at hudson.remoting.UserRequest$ExceptionResponse.retrieve(UserRequest.java:356) at hudson.remoting.Channel.call(Channel.java:998) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:146) at sun.reflect.GeneratedMethodAccessor732.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:132) at com.sun.proxy.$Proxy84.execute(Unknown Source) at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:913) at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1141) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1177) at hudson.scm.SCM.checkout(SCM.java:505) at hudson.model.AbstractProject.checkout(AbstractProject.java:1206) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:574) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:499) at hudson.model.Run.execute(Run.java:1880) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:428) ERROR: Error fetching remote repo 'origin'

1 1

oVirt infra daily report - unstable production jobs - 1332
by jenkins＠jenkins.phx.ovirt.org 02 Oct '20

02 Oct '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1332//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-3030) [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://mirror.isoc.org.il/pub/ovirt
by Alertmanager_Bot (oVirt JIRA) 02 Oct '20

02 Oct '20

Alertmanager_Bot created OVIRT-3030: --------------------------------------- Summary: [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://mirror.isoc.org.il/pub/ovirt Key: OVIRT-3030 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3030 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Alertmanager_Bot Assignee: infra Labels: - alertname = MirrorIsOutOfSync - instance = web-ovirt-mirrorchecker.apps.ovirt.org:80 - job = oVirt-mirrors-health - url = http://mirror.isoc.org.il/pub/ovirt Annotations: - description = http://mirror.isoc.org.il/pub/ovirt (measured by oVirt-mirrors-health) has not been synced in the past two days. Source: http://prometheus-0:9090/graph?g0.expr=mirror_health_check+%3E+172800&g0.ta… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100148)

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 446 - Failure!
by jenkins＠jenkins.phx.ovirt.org 02 Oct '20

02 Oct '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 446 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #446 [Marcin Sobczyk] basic: Port '099_aaa-ldap' test module to ansible ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.004_basic_sanity.test_live_storage_migration Error Message: AssertionError: False != True after 600 seconds Stack Trace: api_v4 = <ovirtsdk4.Connection object at 0x7f80c8da1cd0> @order_by(_TEST_LIST) def test_live_storage_migration(api_v4): engine = api_v4.system_service() disk_service = test_utils.get_disk_service(engine, DISK0_NAME) correlation_id = 'live_storage_migration' disk_service.move( async=False, filter=False, storage_domain=types.StorageDomain( name=SD_ISCSI_NAME ), query={'correlation_id': correlation_id} ) testlib.assert_true_within_long(lambda: test_utils.all_jobs_finished(engine, correlation_id)) # Assert that the disk is on the correct storage domain, # its status is OK and the snapshot created for the migration # has been merged testlib.assert_true_within_long( lambda: api_v4.follow_link(disk_service.get().storage_domains[0]).name == SD_ISCSI_NAME ) vm0_snapshots_service = test_utils.get_vm_snapshots_service(engine, VM0_NAME) testlib.assert_true_within_long( > lambda: len(vm0_snapshots_service.list()) == 1 ) ../basic-suite-master/test-scenarios/004_basic_sanity.py:585: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib/python2.7/site-packages/ovirtlago/testlib.py:286: in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) /usr/lib/python2.7/site-packages/ovirtlago/testlib.py:273: in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ func = <function <lambda> at 0x7f80c8ce7b18>, value = True, timeout = 600 allowed_exceptions = [], initial_wait = 0 def assert_equals_within( func, value, timeout, allowed_exceptions=None, initial_wait=10 ): allowed_exceptions = allowed_exceptions or [] with utils.EggTimer(timeout) as timer: while not timer.elapsed(): try: res = func() if res == value: return except Exception as exc: if _instance_of_any(exc, allowed_exceptions): time.sleep(3) continue LOGGER.exception("Unhandled exception in %s", func) raise if initial_wait == 0: time.sleep(3) else: time.sleep(initial_wait) initial_wait = 0 try: raise AssertionError( > '%s != %s after %s seconds' % (res, value, timeout) ) E AssertionError: False != True after 600 seconds /usr/lib/python2.7/site-packages/ovirtlago/testlib.py:252: AssertionError

1 1

[oVirt Jenkins] ovirt-system-tests_performance-suite-master - Build # 1596 - Failure!
by jenkins＠jenkins.phx.ovirt.org 01 Oct '20

01 Oct '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/1… Build Number: 1596 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #1596 [Marcin Sobczyk] basic: Port '099_aaa-ldap' test module to ansible ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 040_add_hosts_vms.verify_add_hosts Error Message: 1 hosts failed installation: lago-performance-suite-master-host-0: install_failed -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7f0cd4e9e758> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda> lambda: _single_host_up(hosts_service, total_hosts) File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up _check_problematic_hosts(hosts_service) File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts raise RuntimeError(dump_hosts) RuntimeError: 1 hosts failed installation: lago-performance-suite-master-host-0: install_failed --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 298, in verify_add_hosts verify_add_hosts_4(api) File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in verify_add_hosts_4 lambda: _single_host_up(hosts_service, total_hosts) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda> lambda: _single_host_up(hosts_service, total_hosts) File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up _check_problematic_hosts(hosts_service) File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts raise RuntimeError(dump_hosts) '1 hosts failed installation:\nlago-performance-suite-master-host-0: install_failed\n\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7f0cd4e9e758>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within\n res = func()\n File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda>\n lambda: _single_host_up(hosts_service, total_hosts)\n File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up\n _check_problematic_hosts(hosts_service)\n File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts\n raise RuntimeError(dump_hosts)\nRuntimeError: 1 hosts failed installation:\nlago-performance-suite-master-host-0: install_failed\n\n--------------------- >> end captured logging << ---------------------'

1 2

oVirt infra daily report - unstable production jobs - 1331
by jenkins＠jenkins.phx.ovirt.org 01 Oct '20

01 Oct '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1331//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-2832) Add Fedora 31 support in the CI
by Sandro Bonazzola (oVirt JIRA) 01 Oct '20

01 Oct '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2832?page=com.atlassian.jira.… ] Sandro Bonazzola commented on OVIRT-2832: ----------------------------------------- As a side note, I think we should change our workflow here. “Done” with resolution “Won’t Do” seems pretty wrong here. “Closed” “Won’t do” would have made more sense. > Add Fedora 31 support in the CI > ------------------------------- > > Key: OVIRT-2832 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2832 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Nir Soffer > Assignee: infra > > Vdsm want to support only Fedora 31 at this point. > Having Fedora 31 available, we can simplify the code since we have > same versions of lvm and other packages in Fedora 31 and RHEL 8. > We need: > - mirrors for fedora 31 repos > - mock config for fedora 31 > Thanks, > Nir -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100147)

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 439 - Failure!
by jenkins＠jenkins.phx.ovirt.org 01 Oct '20

01 Oct '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 439 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #439 [Marcin Sobczyk] basic: Port '099_aaa-ldap' test module to ansible ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.002_bootstrap.test_verify_add_hosts Error Message: RuntimeError: 1 hosts failed installation: lago-basic-suite-master-host-0: install_failed Stack Trace: engine_api = <ovirtsdk4.Connection object at 0x7f1c503e7050> @order_by(_TEST_LIST) def test_verify_add_hosts(engine_api): hosts_service = engine_api.system_service().hosts_service() hosts_status = hosts_service.list(search='datacenter={}'.format(DC_NAME)) total_hosts = len(hosts_status) dump_hosts = _host_status_to_print(hosts_service, hosts_status) LOGGER.debug('Host status, verify_add_hosts:\n {}'.format(dump_hosts)) assertions.assert_true_within( lambda: _single_host_up(hosts_service, total_hosts), > timeout=constants.ADD_HOST_TIMEOUT ) ../basic-suite-master/test-scenarios/002_bootstrap.py:462: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ../ost_utils/ost_utils/assertions.py:87: in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) ../ost_utils/ost_utils/assertions.py:41: in assert_equals_within res = func() ../basic-suite-master/test-scenarios/002_bootstrap.py:461: in <lambda> lambda: _single_host_up(hosts_service, total_hosts), ../basic-suite-master/test-scenarios/002_bootstrap.py:233: in _single_host_up _check_problematic_hosts(hosts_service) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ hosts_service = <ovirtsdk4.services.HostsService object at 0x7f1c4bd64690> def _check_problematic_hosts(hosts_service): problematic_hosts = hosts_service.list(search='datacenter={} AND status != installing and status != initializing and status != up'.format(DC_NAME)) if len(problematic_hosts): dump_hosts = '%s hosts failed installation:\n' % len(problematic_hosts) for host in problematic_hosts: host_service = hosts_service.host_service(host.id) dump_hosts += '%s: %s\n' % (host.name, host_service.get().status) > raise RuntimeError(dump_hosts) E RuntimeError: 1 hosts failed installation: E lago-basic-suite-master-host-0: install_failed ../basic-suite-master/test-scenarios/002_bootstrap.py:242: RuntimeError

1 5

[JIRA] (OVIRT-2832) Add Fedora 31 support in the CI
by Evgheni Dereveanchin (oVirt JIRA) 01 Oct '20

01 Oct '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2832?page=com.atlassian.jira.… ] Evgheni Dereveanchin updated OVIRT-2832: ---------------------------------------- Issue Type: Improvement (was: By-EMAIL) > Add Fedora 31 support in the CI > ------------------------------- > > Key: OVIRT-2832 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2832 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Nir Soffer > Assignee: infra > > Vdsm want to support only Fedora 31 at this point. > Having Fedora 31 available, we can simplify the code since we have > same versions of lvm and other packages in Fedora 31 and RHEL 8. > We need: > - mirrors for fedora 31 repos > - mock config for fedora 31 > Thanks, > Nir -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100147)

1 0

[JIRA] (OVIRT-2832) Add Fedora 31 support in the CI
by Evgheni Dereveanchin (oVirt JIRA) 01 Oct '20

01 Oct '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2832?page=com.atlassian.jira.… ] Evgheni Dereveanchin updated OVIRT-2832: ---------------------------------------- Resolution: Won't Do Status: Done (was: To Do) Thanks for the update. Closing this request for now. Let's open a fresh one when we need Fedora again. > Add Fedora 31 support in the CI > ------------------------------- > > Key: OVIRT-2832 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2832 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Nir Soffer > Assignee: infra > > Vdsm want to support only Fedora 31 at this point. > Having Fedora 31 available, we can simplify the code since we have > same versions of lvm and other packages in Fedora 31 and RHEL 8. > We need: > - mirrors for fedora 31 repos > - mock config for fedora 31 > Thanks, > Nir -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100147)

1 0

[JIRA] (OVIRT-3029) git is slow today
by Dominik Holler (oVirt JIRA) 01 Oct '20

01 Oct '20

Dominik Holler created OVIRT-3029: ------------------------------------- Summary: git is slow today Key: OVIRT-3029 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3029 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Dominik Holler Assignee: infra Accessing gerrit.ovirt.org via git (ssh and http) is slow today. The slowness is if I work with git local, but also if CI wants to use git. This results into timeouts on CI, e.g. in https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/8246/consol… : 06:53:16 > git fetch --tags --progress https://gerrit.ovirt.org/ovirt-engine +refs/changes/65/111065/30:myhead # timeout=20 07:13:16 ERROR: Timeout after 20 minutes 07:13:55 ERROR: Error fetching remote repo 'origin' 07:13:55 hudson.plugins.git.GitException: Failed to fetch from https://gerrit.ovirt.org/ovirt-engine 07:13:55 at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:915) 07:13:55 at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1141) 07:13:55 at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1177) -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100147)

1 0

[JIRA] (OVIRT-3027) [FIRING:1] LowDiskSpace_NodeExporter_v1_0 templates.ovirt.org:9100 templates-server (/dev/mapper/templates-kubevirt xfs /var/www/html/kubevirt)
by Shlomi Zidmi (oVirt JIRA) 01 Oct '20

01 Oct '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3027?page=com.atlassian.jira.… ] Shlomi Zidmi commented on OVIRT-3027: ------------------------------------- The volume which stores all Kubevirt’s images on templates server is using 96GB out of 110GB possible. By looking at the following from Kubevirt’s repo: [https://github.com/kubevirt/common-templates/blob/master/automation/test.sh…] [https://github.com/kubevirt/common-templates/blob/master/automation/test.sh…] I can see the image “win01.img“ is not being used and is not listed with all other windows images. If that’s the case we can delete it and free up 25GB. [~accountid:557058:caa507e4-2696-4f45-8da5-d2585a4bb794] could you please confirm this? > [FIRING:1] LowDiskSpace_NodeExporter_v1_0 templates.ovirt.org:9100 templates-server (/dev/mapper/templates-kubevirt xfs /var/www/html/kubevirt) > ----------------------------------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-3027 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3027 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Alertmanager_Bot > Assignee: infra > Labels: ALERT{alertname="LowDiskSpace_NodeExporter_v1_0",instance="templates.ovirt.org:9100",job="templates-server"} > > Labels: > - alertname = LowDiskSpace_NodeExporter_v1_0 > - device = /dev/mapper/templates-kubevirt > - fstype = xfs > - instance = templates.ovirt.org:9100 > - job = templates-server > - mountpoint = /var/www/html/kubevirt > Annotations: > - description = templates.ovirt.org:9100 of job templates-server has less than 10% free disk space > Source: http://prometheus-0:9090/graph?g0.expr=node_filesystem_free_bytes+%2F+node_… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100147)

1 0

[JIRA] (OVIRT-3027) [FIRING:1] LowDiskSpace_NodeExporter_v1_0 templates.ovirt.org:9100 templates-server (/dev/mapper/templates-kubevirt xfs /var/www/html/kubevirt)
by Krapali Rai (oVirt JIRA) 30 Sep '20

30 Sep '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3027?page=com.atlassian.jira.… ] Krapali Rai updated OVIRT-3027: ------------------------------- Status: In Progress (was: To Do) > [FIRING:1] LowDiskSpace_NodeExporter_v1_0 templates.ovirt.org:9100 templates-server (/dev/mapper/templates-kubevirt xfs /var/www/html/kubevirt) > ----------------------------------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-3027 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3027 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Alertmanager_Bot > Assignee: infra > Labels: ALERT{alertname="LowDiskSpace_NodeExporter_v1_0",instance="templates.ovirt.org:9100",job="templates-server"} > > Labels: > - alertname = LowDiskSpace_NodeExporter_v1_0 > - device = /dev/mapper/templates-kubevirt > - fstype = xfs > - instance = templates.ovirt.org:9100 > - job = templates-server > - mountpoint = /var/www/html/kubevirt > Annotations: > - description = templates.ovirt.org:9100 of job templates-server has less than 10% free disk space > Source: http://prometheus-0:9090/graph?g0.expr=node_filesystem_free_bytes+%2F+node_… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100147)

1 0

[JIRA] (OVIRT-3028) [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://mirror.massclouds.com/ovirt
by Krapali Rai (oVirt JIRA) 30 Sep '20

30 Sep '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3028?page=com.atlassian.jira.… ] Krapali Rai updated OVIRT-3028: ------------------------------- Status: In Progress (was: To Do) > [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://mirror.massclouds.com/ovirt > ------------------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-3028 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3028 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Alertmanager_Bot > Assignee: infra > Labels: ALERT{alertname="MirrorIsOutOfSync",instance="web-ovirt-mirrorchecker.apps.ovirt.org:80",job="oVirt-mirrors-health",url="http://mirror.massclouds.com/ovirt"} > > Labels: > - alertname = MirrorIsOutOfSync > - instance = web-ovirt-mirrorchecker.apps.ovirt.org:80 > - job = oVirt-mirrors-health > - url = http://mirror.massclouds.com/ovirt > Annotations: > - description = http://mirror.massclouds.com/ovirt (measured by oVirt-mirrors-health) has not been synced in the past two days. > Source: http://prometheus-0:9090/graph?g0.expr=mirror_health_check+%3E+172800&g0.ta… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100147)

1 0

oVirt infra daily report - unstable production jobs - 1330
by jenkins＠jenkins.phx.ovirt.org 30 Sep '20

30 Sep '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1330//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-3028) [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://mirror.massclouds.com/ovirt
by Alertmanager_Bot (oVirt JIRA) 30 Sep '20

30 Sep '20

Alertmanager_Bot created OVIRT-3028: --------------------------------------- Summary: [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://mirror.massclouds.com/ovirt Key: OVIRT-3028 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3028 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Alertmanager_Bot Assignee: infra Labels: - alertname = MirrorIsOutOfSync - instance = web-ovirt-mirrorchecker.apps.ovirt.org:80 - job = oVirt-mirrors-health - url = http://mirror.massclouds.com/ovirt Annotations: - description = http://mirror.massclouds.com/ovirt (measured by oVirt-mirrors-health) has not been synced in the past two days. Source: http://prometheus-0:9090/graph?g0.expr=mirror_health_check+%3E+172800&g0.ta… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100147)

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 435 - Failure!
by jenkins＠jenkins.phx.ovirt.org 30 Sep '20

30 Sep '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 435 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #435 [Marcin Sobczyk] basic: Port '099_aaa-ldap' test module to ansible ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.002_bootstrap.test_verify_add_hosts Error Message: RuntimeError: 1 hosts failed installation: lago-basic-suite-master-host-0: install_failed Stack Trace: engine_api = <ovirtsdk4.Connection object at 0x7f19ddcbd050> @order_by(_TEST_LIST) def test_verify_add_hosts(engine_api): hosts_service = engine_api.system_service().hosts_service() hosts_status = hosts_service.list(search='datacenter={}'.format(DC_NAME)) total_hosts = len(hosts_status) dump_hosts = _host_status_to_print(hosts_service, hosts_status) LOGGER.debug('Host status, verify_add_hosts:\n {}'.format(dump_hosts)) assertions.assert_true_within( lambda: _single_host_up(hosts_service, total_hosts), > timeout=constants.ADD_HOST_TIMEOUT ) ../basic-suite-master/test-scenarios/002_bootstrap.py:462: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ../ost_utils/ost_utils/assertions.py:87: in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) ../ost_utils/ost_utils/assertions.py:41: in assert_equals_within res = func() ../basic-suite-master/test-scenarios/002_bootstrap.py:461: in <lambda> lambda: _single_host_up(hosts_service, total_hosts), ../basic-suite-master/test-scenarios/002_bootstrap.py:233: in _single_host_up _check_problematic_hosts(hosts_service) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ hosts_service = <ovirtsdk4.services.HostsService object at 0x7f19ddbb1690> def _check_problematic_hosts(hosts_service): problematic_hosts = hosts_service.list(search='datacenter={} AND status != installing and status != initializing and status != up'.format(DC_NAME)) if len(problematic_hosts): dump_hosts = '%s hosts failed installation:\n' % len(problematic_hosts) for host in problematic_hosts: host_service = hosts_service.host_service(host.id) dump_hosts += '%s: %s\n' % (host.name, host_service.get().status) > raise RuntimeError(dump_hosts) E RuntimeError: 1 hosts failed installation: E lago-basic-suite-master-host-0: install_failed ../basic-suite-master/test-scenarios/002_bootstrap.py:242: RuntimeError

1 3

[JIRA] (OVIRT-3027) [FIRING:1] LowDiskSpace_NodeExporter_v1_0 templates.ovirt.org:9100 templates-server (/dev/mapper/templates-kubevirt xfs /var/www/html/kubevirt)
by Alertmanager_Bot (oVirt JIRA) 30 Sep '20

30 Sep '20

Alertmanager_Bot created OVIRT-3027: --------------------------------------- Summary: [FIRING:1] LowDiskSpace_NodeExporter_v1_0 templates.ovirt.org:9100 templates-server (/dev/mapper/templates-kubevirt xfs /var/www/html/kubevirt) Key: OVIRT-3027 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3027 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Alertmanager_Bot Assignee: infra Labels: - alertname = LowDiskSpace_NodeExporter_v1_0 - device = /dev/mapper/templates-kubevirt - fstype = xfs - instance = templates.ovirt.org:9100 - job = templates-server - mountpoint = /var/www/html/kubevirt Annotations: - description = templates.ovirt.org:9100 of job templates-server has less than 10% free disk space Source: http://prometheus-0:9090/graph?g0.expr=node_filesystem_free_bytes+%2F+node_… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100147)

1 0

oVirt infra daily report - unstable production jobs - 1329
by jenkins＠jenkins.phx.ovirt.org 29 Sep '20

29 Sep '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1329//artifact/exported… Cheers, Jenkins

1 0

[CQ]: 111450,1 (ovirt-system-tests) failed "ovirt-4.3" system tests
by oVirt Jenkins 29 Sep '20

29 Sep '20

Change 111450,1 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-4.3" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111450/1 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/3912/

1 0