- Devel - oVirt List Archives

planned Jenkins restart
by Evgheni Dereveanchin 02 Dec '20

02 Dec '20

Hi everyone, I'll be performing a planned Jenkins restart within the next hour. No new CI jobs will be scheduled during this maintenance period. I will inform you once it is back online. -- Regards, Evgheni Dereveanchin

2 2

Storage OST Failure
by Steven Rosenberg 02 Dec '20

02 Dec '20

Dear Personnel, It seems that the OST is failing due to a storage issue [1]. The failure is on the test_verify_and_remove_cloned_vm test which is not changed on the patch [2] . The engine log prints the error: 2020-12-01 13:07:48,297+01 ERROR [org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand] (default task-1) [] An error occurred while fetching unregistered disks from Storage Domain id '26d55c27-bf61-4f01-b5a3-d9a6a01c3e8a'2020-12-01 13:07:48,298+01 DEBUG [org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand] (default task-1) [] Skipping format update for domain '26d55c27-bf61-4f01-b5a3-d9a6a01c3e8a' (type 'ImportExport') and returns the following error: 2020-12-01 13:17:46,784+01 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-2) [] Operation Failed: [Cannot remove VM. The VM is performing an operation on a Snapshot. Please wait for the operation to finish, and try again.] Maybe there is a recent change causing a regression here? [1] https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/14137/ [2] https://github.com/oVirt/ovirt-system-tests/blob/master/basic-suite-master/… With Best Regards. Steven.

5 5

ovirt-engine has been tagged (ovirt-engine-4.4.4.3)
by Tal Nisan 02 Dec '20

02 Dec '20

1 0

[OST] Error updating ost images - packages with conflicts/broken deps
by Nir Soffer 30 Nov '20

30 Nov '20

Trying dnf update on ost system fails now with: $ sudo dnf update ... Error: Problem 1: package ost-images-el8-host-deps-installed-1-202011270303.x86_64 requires ost-images-el8-upgrade = 1-202011270303, but none of the providers can be installed - cannot install both ost-images-el8-upgrade-1-202011290315.x86_64 and ost-images-el8-upgrade-1-202011270303.x86_64 - cannot install the best update candidate for package ost-images-el8-upgrade-1-202011270303.x86_64 - cannot install the best update candidate for package ost-images-el8-host-deps-installed-1-202011270303.x86_64 Problem 2: package ost-images-el8-engine-deps-installed-1-202011270303.x86_64 requires ost-images-el8-upgrade = 1-202011270303, but none of the providers can be installed - cannot install both ost-images-el8-upgrade-1-202011290315.x86_64 and ost-images-el8-upgrade-1-202011270303.x86_64 - package ost-images-el8-engine-installed-1-202011290315.x86_64 requires ost-images-el8-upgrade = 1-202011290315, but none of the providers can be installed - cannot install the best update candidate for package ost-images-el8-engine-installed-1-202011270303.x86_64 - cannot install the best update candidate for package ost-images-el8-engine-deps-installed-1-202011270303.x86_64 Problem 3: problem with installed package ost-images-el8-host-deps-installed-1-202011270303.x86_64 - package ost-images-el8-host-deps-installed-1-202011270303.x86_64 requires ost-images-el8-upgrade = 1-202011270303, but none of the providers can be installed - cannot install both ost-images-el8-upgrade-1-202011290315.x86_64 and ost-images-el8-upgrade-1-202011270303.x86_64 - package ost-images-el8-host-installed-1-202011290315.x86_64 requires ost-images-el8-upgrade = 1-202011290315, but none of the providers can be installed - cannot install the best update candidate for package ost-images-el8-host-installed-1-202011270303.x86_64 (try to add '--allowerasing' to command line to replace conflicting packages or '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages) $ sudo dnf update --nobest works, but complains about: Skipping packages with conflicts: (add '--best --allowerasing' to command line to force their upgrade): ost-images-el8-upgrade x86_64 1-202011290315 ost-images 15 M Skipping packages with broken dependencies: ost-images-el8-engine-installed x86_64 1-202011290315 ost-images 1.0 G ost-images-el8-host-installed x86_64 1-202011290315 ost-images 518 M I have not tried to run ost with the updated packages yet. Nir

2 3

Planned gerrit.ovirt.org outage 24.11.2020 from 21:00 UTC
by Evgheni Dereveanchin 30 Nov '20

30 Nov '20

Hi everyone, I will be performing planned upgrades on gerrit.ovirt.org tonight. The following services will be unreachable for up to several hours: * gerrit.ovirt.org - code review service * jenkins.ovirt.org - continuous integration service Further announcements will be sent out once the outage window opens and closes. -- Regards, Evgheni Dereveanchin

3 7

Breaking change introduced in vdsm-jsonrpc-java-1.6.0
by Artur Socha 30 Nov '20

30 Nov '20

Hi, We have recently introduced the breaking change in vdsm-jsonrpc-java [1]. Reactive streams package has been replaced with java.util.concurrent.Flow (shipped with JDK). This change is released with vdsm-jsonrpc-java-1.6.0. This change had to be reflected in ovirt-engine as well (otherwise it would not compile). I was handled by this patch [2]. Unfortunately these two changes must be in sync. Please update vdsm-jsonrpc-java to 1.6.0 if you are already working on ovirt engine revision that includes [2]. [1] https://gerrit.ovirt.org/#/c/vdsm-jsonrpc-java/+/109916/ [2] https://gerrit.ovirt.org/#/c/ovirt-engine/+/112347/ Please accept my apologies for not letting you know earlier, ideally before these patches got merged. -- Artur Socha Senior Software Engineer, RHV Red Hat

1 0

Health check endpoint in the engine hanging forever on CheckDBConnection
by Marcin Sobczyk 27 Nov '20

27 Nov '20

Hi, I'm trying out (I think) the latest build of ovirt-engine in OST [1] and the basic suite fails when we do engine reconfiguration and then restart the service [2]. After restarting we wait on the health check endpoint status here [3]. This however ends with a timeout. I tried running manually: curl -D - http://engine/ovirt-engine/services/health and that command also hangs forever. In the engine log the last related entry seem to be: 2020-11-26 16:20:15,761+01 DEBUG [org.ovirt.engine.core.utils.servlet.LocaleFilter] (default task-7) [] Incoming locale 'en-US'. Filter determined locale to be 'en-US' 2020-11-26 16:20:15,761+01 DEBUG [org.ovirt.engine.core.services.HealthStatus] (default task-7) [] Health Status servlet: entry 2020-11-26 16:20:15,761+01 DEBUG [org.ovirt.engine.core.services.HealthStatus] (default task-7) [] Calling CheckDBConnection query Has anyone else also encountered that? Regards, Marcin [1] ovirt-engine-4.4.4.3-0.0.master.20201126133903.gitc2c805a2662.el8.noarch [2] https://github.com/oVirt/ovirt-system-tests/blob/3e2fc267b376a12eda131fa0e9… [3] https://github.com/oVirt/ovirt-system-tests/blob/3e2fc267b376a12eda131fa0e9…

4 5

ovirt-engine has been tagged (ovirt-engine-4.4.4.2)
by Tal Nisan 25 Nov '20

25 Nov '20

1 0

Failure on checkInterfaces: uncategorized SQLException
by Yedidyah Bar David 25 Nov '20

25 Nov '20

Hi all, I ran OST manually with suite he-basic-master, and it failed at a rather late stage (010_local_maintenance_cli. My changes were for 008_restart_he_vm, which passed). It failed because the hosted-engine VM was already on host-1, which wasn't expected. I spent quite some time trying to understand this, and I *think* the root cause was quite before that. engine.log: 2020-11-25 09:48:50,864+01 INFO [org.ovirt.engine.core.bll.network.host.HostSetupNetworksCommand] (EE-ManagedThreadFactory-engine-Thread-273) [2e1072c7] Host setup networks finished. Lock released. Monitoring can run now for host 'lago-he-basic-suite-master-host-0.lago.local' from data-center 'Default' 2020-11-25 09:48:50,866+01 INFO [org.ovirt.engine.core.bll.network.host.HostSetupNetworksCommand] (EE-ManagedThreadFactory-engine-Thread-273) [2e1072c7] Lock freed to object 'EngineLock:{exclusiveLocks='[HOST_NETWORKfba14f41-7ece-46ca-af65-7476e9fd2018=HOST_NETWORK]', sharedLocks=''}' 2020-11-25 09:48:50,923+01 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-273) [2e1072c7] EVENT_ID: PERSIST_NETWORK_ON_HOST_FINISHED(1,146), (1/2): Successfully applied changes for network(s) Labeled_Network on host lago-he-basic-suite-master-host-0.lago.local. (User: admin@internal-authz) 2020-11-25 09:48:53,883+01 INFO [org.ovirt.engine.core.bll.ConcurrentChildCommandsExecutionCallback] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-47) [2e1072c7] Command 'PropagateNetworksToClusterHosts' id: '6e61f53b-c2b7-4a35-a840-67076e6d66cb' child commands '[fe7f022e-c13b-4924-a6ea-cc56407e6969, ca990d6e-199b-473d-928d-0a7e6d8cf073]' executions were completed, status 'SUCCEEDED' 2020-11-25 09:48:54,891+01 INFO [org.ovirt.engine.core.bll.network.cluster.PropagateNetworksToClusterHostsCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-85) [2e1072c7] Ending command 'org.ovirt.engine.core.bll.network.cluster.PropagateNetworksToClusterHostsCommand' successfully. 2020-11-25 09:49:24,749+01 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-92) [] Failure on checkInterfaces on update runtime info for host 'lago-he-basic-suite-master-host-0.lago.local': PreparedStatementCallback; uncategorized SQLException for SQL [select * from getallnetworkbyclusterid(?, ?, ?)]; SQL state [null]; error code [0]; IJ031013: Interrupted attempting lock: org.jboss.jca.adapters.jdbc.local.LocalManagedConnection@7d88842; nested exception is java.sql.SQLException: IJ031013: Interrupted attempting lock: org.jboss.jca.adapters.jdbc.local.LocalManagedConnection@7d88842 2020-11-25 09:49:24,752+01 ERROR [org.ovirt.engine.core.vdsbroker.monitoring.HostMonitoring] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-92) [] ResourceManager::refreshVdsRunTimeInfo: host=lago-he-basic-suite-master-host-0.lago.local(fba14f41-7ece-46ca-af65-7476e9fd2018): PreparedStatementCallback; uncategorized SQLException for SQL [select * from getvdsdynamicbyvdsid(?)]; SQL state [null]; error code [0]; IJ031013: Interrupted attempting lock: org.jboss.jca.adapters.jdbc.local.LocalManagedConnection@7d88842; nested exception is java.sql.SQLException: IJ031013: Interrupted attempting lock: org.jboss.jca.adapters.jdbc.local.LocalManagedConnection@7d88842 2020-11-25 09:49:24,761+01 ERROR [org.ovirt.engine.core.vdsbroker.VdsManager] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-92) [] Timer update runtime info failed. Exception: SQLException: IJ031013: Interrupted attempting lock: org.jboss.jca.adapters.jdbc.local.LocalManagedConnection@7d88842 Any idea? -- Didi

1 1

VDSM CI patches stuck in queue for several hours
by Ales Musil 25 Nov '20

25 Nov '20

Hi, most of my patches lately are getting stuck in CI. For example [0] is hanging there for 17 hours waiting for a container that would be able to run nmstate functional tests. Can someone please take a look at that? Thanks, Ales [0] https://jenkins.ovirt.org/job/vdsm_standard-check-patch/25066/ -- Ales Musil Software Engineer - RHV Network Red Hat EMEA <https://www.redhat.com> amusil(a)redhat.com IM: amusil <https://red.ht/sig>

3 2