October 2020 - Infra - oVirt List Archives

[JIRA] (OVIRT-3030) [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://mirror.isoc.org.il/pub/ovirt
by Alertmanager_Bot (oVirt JIRA) 02 Oct '20

02 Oct '20

Alertmanager_Bot created OVIRT-3030: --------------------------------------- Summary: [FIRING:1] MirrorIsOutOfSync web-ovirt-mirrorchecker.apps.ovirt.org:80 oVirt-mirrors-health http://mirror.isoc.org.il/pub/ovirt Key: OVIRT-3030 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3030 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Alertmanager_Bot Assignee: infra Labels: - alertname = MirrorIsOutOfSync - instance = web-ovirt-mirrorchecker.apps.ovirt.org:80 - job = oVirt-mirrors-health - url = http://mirror.isoc.org.il/pub/ovirt Annotations: - description = http://mirror.isoc.org.il/pub/ovirt (measured by oVirt-mirrors-health) has not been synced in the past two days. Source: http://prometheus-0:9090/graph?g0.expr=mirror_health_check+%3E+172800&g0.ta… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100148)

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 446 - Failure!
by jenkins＠jenkins.phx.ovirt.org 02 Oct '20

02 Oct '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 446 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #446 [Marcin Sobczyk] basic: Port '099_aaa-ldap' test module to ansible ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.004_basic_sanity.test_live_storage_migration Error Message: AssertionError: False != True after 600 seconds Stack Trace: api_v4 = <ovirtsdk4.Connection object at 0x7f80c8da1cd0> @order_by(_TEST_LIST) def test_live_storage_migration(api_v4): engine = api_v4.system_service() disk_service = test_utils.get_disk_service(engine, DISK0_NAME) correlation_id = 'live_storage_migration' disk_service.move( async=False, filter=False, storage_domain=types.StorageDomain( name=SD_ISCSI_NAME ), query={'correlation_id': correlation_id} ) testlib.assert_true_within_long(lambda: test_utils.all_jobs_finished(engine, correlation_id)) # Assert that the disk is on the correct storage domain, # its status is OK and the snapshot created for the migration # has been merged testlib.assert_true_within_long( lambda: api_v4.follow_link(disk_service.get().storage_domains[0]).name == SD_ISCSI_NAME ) vm0_snapshots_service = test_utils.get_vm_snapshots_service(engine, VM0_NAME) testlib.assert_true_within_long( > lambda: len(vm0_snapshots_service.list()) == 1 ) ../basic-suite-master/test-scenarios/004_basic_sanity.py:585: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib/python2.7/site-packages/ovirtlago/testlib.py:286: in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) /usr/lib/python2.7/site-packages/ovirtlago/testlib.py:273: in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ func = <function <lambda> at 0x7f80c8ce7b18>, value = True, timeout = 600 allowed_exceptions = [], initial_wait = 0 def assert_equals_within( func, value, timeout, allowed_exceptions=None, initial_wait=10 ): allowed_exceptions = allowed_exceptions or [] with utils.EggTimer(timeout) as timer: while not timer.elapsed(): try: res = func() if res == value: return except Exception as exc: if _instance_of_any(exc, allowed_exceptions): time.sleep(3) continue LOGGER.exception("Unhandled exception in %s", func) raise if initial_wait == 0: time.sleep(3) else: time.sleep(initial_wait) initial_wait = 0 try: raise AssertionError( > '%s != %s after %s seconds' % (res, value, timeout) ) E AssertionError: False != True after 600 seconds /usr/lib/python2.7/site-packages/ovirtlago/testlib.py:252: AssertionError

1 1

[oVirt Jenkins] ovirt-system-tests_performance-suite-master - Build # 1596 - Failure!
by jenkins＠jenkins.phx.ovirt.org 02 Oct '20

02 Oct '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/1… Build Number: 1596 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #1596 [Marcin Sobczyk] basic: Port '099_aaa-ldap' test module to ansible ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 040_add_hosts_vms.verify_add_hosts Error Message: 1 hosts failed installation: lago-performance-suite-master-host-0: install_failed -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7f0cd4e9e758> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda> lambda: _single_host_up(hosts_service, total_hosts) File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up _check_problematic_hosts(hosts_service) File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts raise RuntimeError(dump_hosts) RuntimeError: 1 hosts failed installation: lago-performance-suite-master-host-0: install_failed --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 298, in verify_add_hosts verify_add_hosts_4(api) File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in verify_add_hosts_4 lambda: _single_host_up(hosts_service, total_hosts) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda> lambda: _single_host_up(hosts_service, total_hosts) File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up _check_problematic_hosts(hosts_service) File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts raise RuntimeError(dump_hosts) '1 hosts failed installation:\nlago-performance-suite-master-host-0: install_failed\n\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7f0cd4e9e758>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within\n res = func()\n File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda>\n lambda: _single_host_up(hosts_service, total_hosts)\n File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up\n _check_problematic_hosts(hosts_service)\n File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts\n raise RuntimeError(dump_hosts)\nRuntimeError: 1 hosts failed installation:\nlago-performance-suite-master-host-0: install_failed\n\n--------------------- >> end captured logging << ---------------------'

1 2

oVirt infra daily report - unstable production jobs - 1331
by jenkins＠jenkins.phx.ovirt.org 02 Oct '20

02 Oct '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1331//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-2832) Add Fedora 31 support in the CI
by Sandro Bonazzola (oVirt JIRA) 01 Oct '20

01 Oct '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2832?page=com.atlassian.jira.… ] Sandro Bonazzola commented on OVIRT-2832: ----------------------------------------- As a side note, I think we should change our workflow here. “Done” with resolution “Won’t Do” seems pretty wrong here. “Closed” “Won’t do” would have made more sense. > Add Fedora 31 support in the CI > ------------------------------- > > Key: OVIRT-2832 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2832 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Nir Soffer > Assignee: infra > > Vdsm want to support only Fedora 31 at this point. > Having Fedora 31 available, we can simplify the code since we have > same versions of lvm and other packages in Fedora 31 and RHEL 8. > We need: > - mirrors for fedora 31 repos > - mock config for fedora 31 > Thanks, > Nir -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100147)

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 439 - Failure!
by jenkins＠jenkins.phx.ovirt.org 01 Oct '20

01 Oct '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 439 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #439 [Marcin Sobczyk] basic: Port '099_aaa-ldap' test module to ansible ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: basic-suite-master.test-scenarios.002_bootstrap.test_verify_add_hosts Error Message: RuntimeError: 1 hosts failed installation: lago-basic-suite-master-host-0: install_failed Stack Trace: engine_api = <ovirtsdk4.Connection object at 0x7f1c503e7050> @order_by(_TEST_LIST) def test_verify_add_hosts(engine_api): hosts_service = engine_api.system_service().hosts_service() hosts_status = hosts_service.list(search='datacenter={}'.format(DC_NAME)) total_hosts = len(hosts_status) dump_hosts = _host_status_to_print(hosts_service, hosts_status) LOGGER.debug('Host status, verify_add_hosts:\n {}'.format(dump_hosts)) assertions.assert_true_within( lambda: _single_host_up(hosts_service, total_hosts), > timeout=constants.ADD_HOST_TIMEOUT ) ../basic-suite-master/test-scenarios/002_bootstrap.py:462: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ ../ost_utils/ost_utils/assertions.py:87: in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) ../ost_utils/ost_utils/assertions.py:41: in assert_equals_within res = func() ../basic-suite-master/test-scenarios/002_bootstrap.py:461: in <lambda> lambda: _single_host_up(hosts_service, total_hosts), ../basic-suite-master/test-scenarios/002_bootstrap.py:233: in _single_host_up _check_problematic_hosts(hosts_service) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ hosts_service = <ovirtsdk4.services.HostsService object at 0x7f1c4bd64690> def _check_problematic_hosts(hosts_service): problematic_hosts = hosts_service.list(search='datacenter={} AND status != installing and status != initializing and status != up'.format(DC_NAME)) if len(problematic_hosts): dump_hosts = '%s hosts failed installation:\n' % len(problematic_hosts) for host in problematic_hosts: host_service = hosts_service.host_service(host.id) dump_hosts += '%s: %s\n' % (host.name, host_service.get().status) > raise RuntimeError(dump_hosts) E RuntimeError: 1 hosts failed installation: E lago-basic-suite-master-host-0: install_failed ../basic-suite-master/test-scenarios/002_bootstrap.py:242: RuntimeError

1 5

[JIRA] (OVIRT-2832) Add Fedora 31 support in the CI
by Evgheni Dereveanchin (oVirt JIRA) 01 Oct '20

01 Oct '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2832?page=com.atlassian.jira.… ] Evgheni Dereveanchin updated OVIRT-2832: ---------------------------------------- Issue Type: Improvement (was: By-EMAIL) > Add Fedora 31 support in the CI > ------------------------------- > > Key: OVIRT-2832 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2832 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Nir Soffer > Assignee: infra > > Vdsm want to support only Fedora 31 at this point. > Having Fedora 31 available, we can simplify the code since we have > same versions of lvm and other packages in Fedora 31 and RHEL 8. > We need: > - mirrors for fedora 31 repos > - mock config for fedora 31 > Thanks, > Nir -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100147)

1 0

[JIRA] (OVIRT-2832) Add Fedora 31 support in the CI
by Evgheni Dereveanchin (oVirt JIRA) 01 Oct '20

01 Oct '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2832?page=com.atlassian.jira.… ] Evgheni Dereveanchin updated OVIRT-2832: ---------------------------------------- Resolution: Won't Do Status: Done (was: To Do) Thanks for the update. Closing this request for now. Let's open a fresh one when we need Fedora again. > Add Fedora 31 support in the CI > ------------------------------- > > Key: OVIRT-2832 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2832 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Nir Soffer > Assignee: infra > > Vdsm want to support only Fedora 31 at this point. > Having Fedora 31 available, we can simplify the code since we have > same versions of lvm and other packages in Fedora 31 and RHEL 8. > We need: > - mirrors for fedora 31 repos > - mock config for fedora 31 > Thanks, > Nir -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100147)

1 0

[JIRA] (OVIRT-3029) git is slow today
by Dominik Holler (oVirt JIRA) 01 Oct '20

01 Oct '20

Dominik Holler created OVIRT-3029: ------------------------------------- Summary: git is slow today Key: OVIRT-3029 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3029 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Dominik Holler Assignee: infra Accessing gerrit.ovirt.org via git (ssh and http) is slow today. The slowness is if I work with git local, but also if CI wants to use git. This results into timeouts on CI, e.g. in https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/8246/consol… : 06:53:16 > git fetch --tags --progress https://gerrit.ovirt.org/ovirt-engine +refs/changes/65/111065/30:myhead # timeout=20 07:13:16 ERROR: Timeout after 20 minutes 07:13:55 ERROR: Error fetching remote repo 'origin' 07:13:55 hudson.plugins.git.GitException: Failed to fetch from https://gerrit.ovirt.org/ovirt-engine 07:13:55 at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:915) 07:13:55 at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1141) 07:13:55 at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1177) -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100147)

1 0

[JIRA] (OVIRT-3027) [FIRING:1] LowDiskSpace_NodeExporter_v1_0 templates.ovirt.org:9100 templates-server (/dev/mapper/templates-kubevirt xfs /var/www/html/kubevirt)
by Shlomi Zidmi (oVirt JIRA) 01 Oct '20

01 Oct '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3027?page=com.atlassian.jira.… ] Shlomi Zidmi commented on OVIRT-3027: ------------------------------------- The volume which stores all Kubevirt’s images on templates server is using 96GB out of 110GB possible. By looking at the following from Kubevirt’s repo: [https://github.com/kubevirt/common-templates/blob/master/automation/test.sh…] [https://github.com/kubevirt/common-templates/blob/master/automation/test.sh…] I can see the image “win01.img“ is not being used and is not listed with all other windows images. If that’s the case we can delete it and free up 25GB. [~accountid:557058:caa507e4-2696-4f45-8da5-d2585a4bb794] could you please confirm this? > [FIRING:1] LowDiskSpace_NodeExporter_v1_0 templates.ovirt.org:9100 templates-server (/dev/mapper/templates-kubevirt xfs /var/www/html/kubevirt) > ----------------------------------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-3027 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3027 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Alertmanager_Bot > Assignee: infra > Labels: ALERT{alertname="LowDiskSpace_NodeExporter_v1_0",instance="templates.ovirt.org:9100",job="templates-server"} > > Labels: > - alertname = LowDiskSpace_NodeExporter_v1_0 > - device = /dev/mapper/templates-kubevirt > - fstype = xfs > - instance = templates.ovirt.org:9100 > - job = templates-server > - mountpoint = /var/www/html/kubevirt > Annotations: > - description = templates.ovirt.org:9100 of job templates-server has less than 10% free disk space > Source: http://prometheus-0:9090/graph?g0.expr=node_filesystem_free_bytes+%2F+node_… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100147)

1 0