- Users - oVirt List Archives

Best performance for vcpu pinning
by martin.decker＠ora-solutions.net 16 Nov '22

16 Nov '22

Hello List, how can I achieve the best performance with vcpu pinning in KVM? Is it better to have 1:1 mapping between virtual and physical thread like this: <vcpupin vcpu='0' cpuset='0'/> <vcpupin vcpu='1' cpuset='1'/> <vcpupin vcpu='2' cpuset='2'/> <vcpupin vcpu='3' cpuset='3'/> <vcpupin vcpu='4' cpuset='4'/> <vcpupin vcpu='5' cpuset='5'/> <vcpupin vcpu='6' cpuset='6'/> <vcpupin vcpu='7' cpuset='7'/> Or is it better to allow each vCPU to run on any of the limited number of physical threads? e.g. <vcpupin vcpu='0' cpuset='0,1,2,3,4,5,6,7'/> <vcpupin vcpu='1' cpuset='0,1,2,3,4,5,6,7'/> <vcpupin vcpu='2' cpuset='0,1,2,3,4,5,6,7'/> <vcpupin vcpu='3' cpuset='0,1,2,3,4,5,6,7'/> <vcpupin vcpu='4' cpuset='0,1,2,3,4,5,6,7'/> <vcpupin vcpu='5' cpuset='0,1,2,3,4,5,6,7'/> <vcpupin vcpu='6' cpuset='0,1,2,3,4,5,6,7'/> <vcpupin vcpu='7' cpuset='0,1,2,3,4,5,6,7'/> The hypervisor host has 2 CPUs. Each CPU has 8 cores and each core 2 Threads. In total this are 32 threads. lscpu Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian CPU(s): 32 On-line CPU(s) list: 0-31 Thread(s) per core: 2 Core(s) per socket: 8 Socket(s): 2 NUMA node(s): 2 Vendor ID: GenuineIntel CPU family: 6 Model: 85 Model name: Intel(R) Xeon(R) Gold 6244 CPU @ 3.60GHz Stepping: 7 CPU MHz: 4213.731 CPU max MHz: 4400.0000 CPU min MHz: 1200.0000 BogoMIPS: 7200.00 Virtualization: VT-x L1d cache: 32K L1i cache: 32K L2 cache: 1024K L3 cache: 25344K NUMA node0 CPU(s): 0-7,16-23 NUMA node1 CPU(s): 8-15,24-31 I need to run 2 VMs on this host. One is for production and should have 24 vCPUs and the other one is for test and should have 8 vCPUs. Test VM workload should not impact Prod VM performance. Current configuration is: TEST: <vcpu placement='static' current='8'>128</vcpu> <iothreads>1</iothreads> <cputune> <vcpupin vcpu='0' cpuset='0'/> <vcpupin vcpu='1' cpuset='1'/> <vcpupin vcpu='2' cpuset='2'/> <vcpupin vcpu='3' cpuset='3'/> <vcpupin vcpu='4' cpuset='4'/> <vcpupin vcpu='5' cpuset='5'/> <vcpupin vcpu='6' cpuset='6'/> <vcpupin vcpu='7' cpuset='7'/> </cputune> <cpu mode='host-passthrough' check='none'> <topology sockets='16' cores='4' threads='2'/> <numa> <cell id='0' cpus='0-7' memory='134217728' unit='KiB'/> </numa> </cpu> PROD: <vcpu placement='static' current='24'>192</vcpu> <iothreads>1</iothreads> <cputune> <vcpupin vcpu='0' cpuset='8'/> <vcpupin vcpu='1' cpuset='9'/> <vcpupin vcpu='2' cpuset='10'/> <vcpupin vcpu='3' cpuset='11'/> <vcpupin vcpu='4' cpuset='12'/> <vcpupin vcpu='5' cpuset='13'/> <vcpupin vcpu='6' cpuset='14'/> <vcpupin vcpu='7' cpuset='15'/> <vcpupin vcpu='8' cpuset='16'/> <vcpupin vcpu='9' cpuset='17'/> <vcpupin vcpu='10' cpuset='18'/> <vcpupin vcpu='11' cpuset='19'/> <vcpupin vcpu='12' cpuset='20'/> <vcpupin vcpu='13' cpuset='21'/> <vcpupin vcpu='14' cpuset='22'/> <vcpupin vcpu='15' cpuset='23'/> <vcpupin vcpu='16' cpuset='24'/> <vcpupin vcpu='17' cpuset='25'/> <vcpupin vcpu='18' cpuset='26'/> <vcpupin vcpu='19' cpuset='27'/> <vcpupin vcpu='20' cpuset='28'/> <vcpupin vcpu='21' cpuset='29'/> <vcpupin vcpu='22' cpuset='30'/> <vcpupin vcpu='23' cpuset='31'/> </cputune> <cpu mode='host-passthrough' check='none'> <topology sockets='16' cores='6' threads='2'/> <numa> <cell id='0' cpus='0-23' memory='889192448' unit='KiB'/> </numa> </cpu> Versions are: ovirt-host-4.3.5 libvirt-5.7.0-28.el7.x86_64 Thanks in advance, Martin

4 4

VDSM <host> command DestroyVDS failed: General Exception: ("Found not_in_hw, expected ('???',)",)
by nicolas＠devels.es 16 Nov '22

16 Nov '22

Hi, We're running oVirt version 4.4.8, vdsm version 4.40.100.2 and from a couple days ago some of our hosts are reporting the following error: VDSM <host> command DestroyVDS failed: General Exception: ("Found not_in_hw, expected ('???',)",) Seems that nothing has stopped working, but this is an error that shows up in the event list each minute (x each host) and is annoying. Not all hosts report this error, just a couple of them. As a fact, we had to downgrade the libvirt version on our hosts to version 7.6.0-6 because we found a bug that wouldn't start web VNC consoles with versions > 8.x.x. Not sure if this has something to do with it. Could someone shed some light on what's happening and how to solve it? Logs can be downloaded from: https://drive.google.com/file/d/1ltP-kqNu08TvOgthU9_XSZiVDa0nTGxO/view?usp=… Thanks. Nicolas

1 0

ovirt 4.5.3.2 - remove snapshot and powerdown VM take the VM disk to unconsistent state
by Diego Ercolani 16 Nov '22

16 Nov '22

I think I encountered another bug in the engine: I needed to remove a snapshot, and while I was removing the snapshot guest went down. What happened is that the snapshot remove failed and left "inconsistent". I think there is some issue to address. Here are the relevant log (the engine.log (see 22/11/14 13:17:59)) and the log of node4 that was used by the engine. https://cloud.ssis.sm/index.php/s/CiEqMwwK5mGxBgg

2 2

Is iSCSI supposed to be this slow?
by fs3000＠pm.me 15 Nov '22

15 Nov '22

Hello all. I just installed ovirt node and the hosted engine on a single host. As the setup did not offer a option for local filesystems, I used a iscsi LUN on the same host. So the engine got installed there. That LUN is a on a nvme disk, the kind that reads higher than 3GB/s. Yet, on a vm, i cannot get more than 280MB/s. That's using virtio-scsi or virtio as the interface. Using SATA gives around 350MB/s. I tested with dd, like: Bechmarking writes: dd if=/dev/zero of=/root/test bs=1M count=7000 status=progress Bechmarking reads: dd if=/root/test of=/dev/null bs=1M status=progress Also with hdparm -t /dev/sda Is ISCSI supposed to be this slow? Again, this is on the same machine.

1 0

what happens to vms when a host shutdowns?
by Nathanaël Blanchet 15 Nov '22

15 Nov '22

Hi, We are installing UPS powerchute client on hypervisors. What is the default vms behaviour of running vms when an hypervisor is ordered to shutdown: do the vms live migrate or do they shutdown properly (even the restart on an other host because of HA) ? -- Nathanaël Blanchet Supervision réseau SIRE 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet(a)abes.fr

7 11

Remote logging for httpd
by eshwayri＠gmail.com 14 Nov '22

14 Nov '22

My relatively small lab system was generating ~10GB of httpd logging on a daily basis. Even with logrotate and compression, the activity level was just ludicrous. I don't remember this from earlier versions. I don't see any obvious errors in the log that explain this over-zealous behavior. I didn't want to suppress the logs completely, and the LogLevel is already on warn. I decided in the end to remote log to my central syslog server which stores the logs on an NFS mount from a FreeNAS (ZFS with compression) NAS. The compression will keep the actual disk space down, and since I am not all that worried about losing some logs, I went with sync=off and udp on the transit. Here are the changes I made to /etc/httpd/conf.d/ssl.conf in case someone else finds them useful. 48,49c48,51 < ErrorLog logs/ssl_error_log < TransferLog logs/ssl_access_log --- > #ErrorLog logs/ssl_error_log > ErrorLog "|/usr/bin/logger -t ssl-error -p local1.warn" > #TransferLog logs/ssl_access_log > TransferLog "|/usr/bin/logger -t ssl-access -p local1.warn" 203,206c205,212 < CustomLog logs/ssl_request_log \ < "%t %h %{SSL_PROTOCOL}x %{SSL_CIPHER}x \"%r\" %b" < < CustomLog logs/ovirt-requests-log "%t %h \"Correlation-Id: %{Correlation-Id}o\" \"Duration: %Dus\" \"%r\" %b" "expr=%{QUERY_STRING} !~ /username.*password|password.*username/" --- > #CustomLog logs/ssl_request_log \ > # "%t %h %{SSL_PROTOCOL}x %{SSL_CIPHER}x \"%r\" %b" > LogFormat "%t %h %{SSL_PROTOCOL}x %{SSL_CIPHER}x \"%r\" %b" ssl-request-format > CustomLog "|/usr/bin/logger -t ssl-requests -p local1.warn" ssl-request-format > > LogFormat "%t %h \"Correlation-Id: %{Correlation-Id}o\" \"Duration: %Dus\" \"%r\" %b" ovirt-requests-format > CustomLog "|/usr/bin/logger -t ovirt-requests -p local1.warn" ovirt-requests-format "expr=%{QUERY_STRING} !~ /username.*password|password.*username/" > #CustomLog logs/ovirt-requests-log "%t %h \"Correlation-Id: %{Correlation-Id}o\" \"Duration: %Dus\" \"%r\" %b" "expr=%{QUERY_STRING} !~ /username.*password|password.*username/" then blocked local logging to messages with local1.none in rsyslog.conf.

1 0

[USB PROBLEM] - Unable to active USB
by cedric＠mrtn.ovh 14 Nov '22

14 Nov '22

Hello, I try to mount an usb key on one virtual machine (running linux) by adding it to hosted devices. But I can't active USB in "Console" menu, the field Enable USB is greyed. How can I enable it ? Best regards.

1 0

deployment engine.ear fail on bll.jar
by Sergey Yudin 14 Nov '22

14 Nov '22

We have oVirt 4.1. hosted-engine failed to start on deploying engine.ear/bll.jar stage with null pointer exception. Is it possible to understand why bll.jar failes ? Server.log is: 2022-11-13 23:17:46,914+03 INFO [org.jboss.as] (MSC service thread 1-1) WFLYSRV0050: WildFly Full 10.1.0.Final (WildFly Core 2.2.0.Final) stopped in 46ms 2022-11-13 23:36:14,083+03 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 29) WFLYCLINF0001: Activating Infinispan subsystem. 2022-11-13 23:36:14,098+03 INFO [org.wildfly.extension.io] (ServerService Thread Pool -- 28) WFLYIO001: Worker 'default' has auto-configured to 8 core threads with 64 task threads based on your 4 available processors 2022-11-13 23:36:14,108+03 INFO [org.jboss.as.naming] (ServerService Thread Pool -- 33) WFLYNAM0001: Activating Naming Subsystem 2022-11-13 23:36:14,114+03 WARN [org.jboss.as.txn] (ServerService Thread Pool -- 37) WFLYTX0013: Node identifier property is set to the default value. Please make sure it is unique. 2022-11-13 23:36:14,146+03 INFO [org.jboss.as.connector] (MSC service thread 1-6) WFLYJCA0009: Starting JCA Subsystem (WildFly/IronJacamar 1.3.4.Final) 2022-11-13 23:36:14,161+03 INFO [org.jboss.as.security] (ServerService Thread Pool -- 36) WFLYSEC0002: Activating Security Subsystem 2022-11-13 23:36:14,181+03 INFO [org.jboss.as.connector.subsystems.datasources] (ServerService Thread Pool -- 24) WFLYJCA0005: Deploying non-JDBC-compliant driver class org.postgresql.Driver (version 9.2) 2022-11-13 23:36:14,191+03 INFO [org.jboss.as.connector.deployers.jdbc] (MSC service thread 1-1) WFLYJCA0018: Started Driver service with driver-name = postgresql 2022-11-13 23:36:14,197+03 INFO [org.jboss.as.security] (MSC service thread 1-1) WFLYSEC0001: Current PicketBox version=4.9.6.Final 2022-11-13 23:36:14,208+03 INFO [org.jboss.as.naming] (MSC service thread 1-2) WFLYNAM0003: Starting Naming Service 2022-11-13 23:36:14,386+03 INFO [org.wildfly.extension.undertow] (MSC service thread 1-2) WFLYUT0003: Undertow 1.4.0.Final starting 2022-11-13 23:36:14,641+03 INFO [org.wildfly.extension.undertow] (MSC service thread 1-8) WFLYUT0012: Started server default-server. 2022-11-13 23:36:14,652+03 INFO [org.wildfly.extension.undertow] (MSC service thread 1-1) WFLYUT0018: Host default-host starting 2022-11-13 23:36:14,663+03 INFO [org.jboss.as.ejb3] (MSC service thread 1-6) WFLYEJB0481: Strict pool slsb-strict-max-pool is using a max instance size of 64 (per class), which is derived from thread worker pool sizing. 2022-11-13 23:36:14,664+03 INFO [org.jboss.as.ejb3] (MSC service thread 1-6) WFLYEJB0482: Strict pool mdb-strict-max-pool is using a max instance size of 16 (per class), which is derived from the number of CPUs on this host. 2022-11-13 23:36:14,686+03 INFO [org.wildfly.extension.undertow] (MSC service thread 1-8) WFLYUT0006: Undertow AJP listener ajp listening on 127.0.0.1:8702 2022-11-13 23:36:14,721+03 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-3) WFLYJCA0098: Bound non-transactional data source: java:/ENGINEDataSourceNoJTA 2022-11-13 23:36:14,838+03 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-6) WFLYJCA0001: Bound data source [java:/DWHDataSource] 2022-11-13 23:36:14,859+03 INFO [org.jboss.as.connector.subsystems.datasources] (MSC service thread 1-1) WFLYJCA0001: Bound data source [java:/ENGINEDataSource] 2022-11-13 23:36:15,196+03 INFO [org.jboss.as.remoting] (MSC service thread 1-7) WFLYRMT0001: Listening on 127.0.0.1:8707 2022-11-13 23:36:15,245+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0027: Starting deployment of "ovirt-web-ui.war" (runtime-name: "ovirt-web-ui.war") 2022-11-13 23:36:15,247+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0027: Starting deployment of "restapi.war" (runtime-name: "restapi.war") 2022-11-13 23:36:15,248+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0027: Starting deployment of "engine.ear" (runtime-name: "engine.ear") 2022-11-13 23:36:15,255+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-7) WFLYSRV0027: Starting deployment of "apidoc.war" (runtime-name: "apidoc.war") 2022-11-13 23:36:15,266+03 INFO [org.jboss.as.server.deployment.scanner] (MSC service thread 1-5) WFLYDS0013: Started FileSystemDeploymentService for directory /var/lib/ovirt-engine/jboss_runtime/d eployments 2022-11-13 23:36:15,426+03 INFO [org.infinispan.factories.GlobalComponentRegistry] (MSC service thread 1-4) ISPN000128: Infinispan version: Infinispan 'Chakra' 8.2.4.Final 2022-11-13 23:36:15,520+03 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 41) ISPN000152: Passivation configured without an eviction policy bei ng selected. Only manually evicted entities will be passivated. 2022-11-13 23:36:15,521+03 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 41) ISPN000152: Passivation configured without an eviction policy bei ng selected. Only manually evicted entities will be passivated. 2022-11-13 23:36:15,522+03 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 44) ISPN000152: Passivation configured without an eviction policy bei ng selected. Only manually evicted entities will be passivated. 2022-11-13 23:36:15,523+03 INFO [org.infinispan.configuration.cache.EvictionConfigurationBuilder] (ServerService Thread Pool -- 44) ISPN000152: Passivation configured without an eviction policy bei ng selected. Only manually evicted entities will be passivated. 2022-11-13 23:36:16,481+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0207: Starting subdeployment (runtime-name: "services.war") 2022-11-13 23:36:16,481+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0207: Starting subdeployment (runtime-name: "webadmin.war") 2022-11-13 23:36:16,482+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0207: Starting subdeployment (runtime-name: "enginesso.war") 2022-11-13 23:36:16,482+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0207: Starting subdeployment (runtime-name: "root.war") 2022-11-13 23:36:16,482+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0207: Starting subdeployment (runtime-name: "docs.war") 2022-11-13 23:36:16,482+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0207: Starting subdeployment (runtime-name: "welcome.war") 2022-11-13 23:36:16,483+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0207: Starting subdeployment (runtime-name: "bll.jar") 2022-11-13 23:36:16,483+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-5) WFLYSRV0207: Starting subdeployment (runtime-name: "userportal.war") 2022-11-13 23:36:17,081+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 44) WFLYUT0021: Registered web context: /ovirt-engine/web-ui 2022-11-13 23:36:17,080+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 46) WFLYUT0021: Registered web context: /ovirt-engine/apidoc 2022-11-13 23:36:18,785+03 INFO [org.jboss.weld.deployer] (MSC service thread 1-8) WFLYWELD0003: Processing weld deployment engine.ear 2022-11-13 23:36:19,033+03 INFO [org.hibernate.validator.internal.util.Version] (MSC service thread 1-8) HV000001: Hibernate Validator 5.2.4.Final 2022-11-13 23:36:19,109+03 INFO [org.jboss.weld.deployer] (MSC service thread 1-7) WFLYWELD0003: Processing weld deployment root.war 2022-11-13 23:36:19,144+03 INFO [org.jboss.weld.deployer] (MSC service thread 1-6) WFLYWELD0003: Processing weld deployment services.war 2022-11-13 23:36:19,202+03 INFO [org.jboss.weld.deployer] (MSC service thread 1-5) WFLYWELD0003: Processing weld deployment enginesso.war 2022-11-13 23:36:19,207+03 INFO [org.jboss.weld.deployer] (MSC service thread 1-8) WFLYWELD0003: Processing weld deployment docs.war 2022-11-13 23:36:19,216+03 INFO [org.jboss.weld.deployer] (MSC service thread 1-3) WFLYWELD0003: Processing weld deployment welcome.war 2022-11-13 23:36:19,256+03 INFO [org.jboss.weld.deployer] (MSC service thread 1-4) WFLYWELD0003: Processing weld deployment userportal.war 2022-11-13 23:36:19,281+03 INFO [org.jboss.weld.deployer] (MSC service thread 1-2) WFLYWELD0003: Processing weld deployment webadmin.war 2022-11-13 23:36:19,286+03 INFO [org.jboss.weld.deployer] (MSC service thread 1-1) WFLYWELD0003: Processing weld deployment bll.jar 2022-11-13 23:36:19,294+03 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-1) WFLYEJB0473: JNDI bindings for session bean named 'LockManager' in deployment unit 'subdeployment "bll.jar" o f deployment "engine.ear"' are as follows: java:global/engine/bll/LockManager!org.ovirt.engine.core.utils.lock.LockManager java:app/bll/LockManager!org.ovirt.engine.core.utils.lock.LockManager java:module/LockManager!org.ovirt.engine.core.utils.lock.LockManager java:global/engine/bll/LockManager java:app/bll/LockManager java:module/LockManager 2022-11-13 23:36:19,294+03 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-1) WFLYEJB0473: JNDI bindings for session bean named 'Backend' in deployment unit 'subdeployment "bll.jar" of de ployment "engine.ear"' are as follows: java:global/engine/bll/Backend!org.ovirt.engine.core.common.interfaces.BackendLocal java:app/bll/Backend!org.ovirt.engine.core.common.interfaces.BackendLocal java:module/Backend!org.ovirt.engine.core.common.interfaces.BackendLocal java:global/engine/bll/Backend!org.ovirt.engine.core.bll.interfaces.BackendCommandObjectsHandler java:app/bll/Backend!org.ovirt.engine.core.bll.interfaces.BackendCommandObjectsHandler java:module/Backend!org.ovirt.engine.core.bll.interfaces.BackendCommandObjectsHandler java:global/engine/bll/Backend!org.ovirt.engine.core.bll.interfaces.BackendInternal java:app/bll/Backend!org.ovirt.engine.core.bll.interfaces.BackendInternal java:module/Backend!org.ovirt.engine.core.bll.interfaces.BackendInternal 2022-11-13 23:36:19,301+03 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-1) WFLYEJB0473: JNDI bindings for session bean named 'InitBackendServicesOnStartupBean' in deployment unit 'subd eployment "bll.jar" of deployment "engine.ear"' are as follows: java:global/engine/bll/InitBackendServicesOnStartupBean!org.ovirt.engine.core.bll.InitBackendServicesOnStartup java:app/bll/InitBackendServicesOnStartupBean!org.ovirt.engine.core.bll.InitBackendServicesOnStartup java:module/InitBackendServicesOnStartupBean!org.ovirt.engine.core.bll.InitBackendServicesOnStartup java:global/engine/bll/InitBackendServicesOnStartupBean java:app/bll/InitBackendServicesOnStartupBean java:module/InitBackendServicesOnStartupBean 2022-11-13 23:36:19,301+03 INFO [org.jboss.as.ejb3.deployment] (MSC service thread 1-1) WFLYEJB0473: JNDI bindings for session bean named 'MacPoolPerCluster' in deployment unit 'subdeployment "bll. jar" of deployment "engine.ear"' are as follows: java:global/engine/bll/MacPoolPerCluster!org.ovirt.engine.core.bll.network.macpool.MacPoolPerCluster java:app/bll/MacPoolPerCluster!org.ovirt.engine.core.bll.network.macpool.MacPoolPerCluster java:module/MacPoolPerCluster!org.ovirt.engine.core.bll.network.macpool.MacPoolPerCluster java:global/engine/bll/MacPoolPerCluster java:app/bll/MacPoolPerCluster java:module/MacPoolPerCluster 2022-11-13 23:36:19,368+03 INFO [org.jboss.weld.Version] (MSC service thread 1-1) WELD-000900: 2.3.5 (Final) 2022-11-13 23:36:26,032+03 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 48) RESTEASY002225: Deploying javax.ws.rs.core.Application: class org.ovirt.engine.api.v3.V3Ap plication 2022-11-13 23:36:26,033+03 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 48) RESTEASY002220: Adding singleton resource org.ovirt.engine.api.v3.servers.V3SystemServer f rom Application class org.ovirt.engine.api.v3.V3Application 2022-11-13 23:36:26,033+03 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 48) RESTEASY002210: Adding provider singleton org.ovirt.engine.api.v3.V3InvalidValueExceptionM apper from Application class org.ovirt.engine.api.v3.V3Application 2022-11-13 23:36:26,033+03 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 48) RESTEASY002210: Adding provider singleton org.ovirt.engine.api.v3.V3IOExceptionMapper from Application class org.ovirt.engine.api.v3.V3Application 2022-11-13 23:36:26,274+03 WARN [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 2) WELD-000167: Class org.ovirt.engine.core.dao.EngineSessionDaoImpl$EngineSessionParameterSource is annotated with @ Dependent but it does not declare an appropriate constructor therefore is not registered as a bean! 2022-11-13 23:36:26,274+03 WARN [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 3) WELD-000167: Class org.ovirt.engine.core.dao.AsyncTaskDaoImpl$AsyncTaskParameterSource is annotated with @Dependen t but it does not declare an appropriate constructor therefore is not registered as a bean! 2022-11-13 23:36:26,281+03 INFO [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 5) WELD-001125: Illegal bean type org.ovirt.engine.core.dao.GenericDao<org.ovirt.engine.core.common.businessentities. Provider<?>, org.ovirt.engine.core.compat.Guid> ignored on [EnhancedAnnotatedTypeImpl] public @Singleton @Named class org.ovirt.engine.core.dao.provider.ProviderDaoImpl 2022-11-13 23:36:26,282+03 INFO [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 5) WELD-001125: Illegal bean type org.ovirt.engine.core.dao.DefaultGenericDao<org.ovirt.engine.core.common.businessen tities.Provider<?>, org.ovirt.engine.core.compat.Guid> ignored on [EnhancedAnnotatedTypeImpl] public @Singleton @Named class org.ovirt.engine.core.dao.provider.ProviderDaoImpl 2022-11-13 23:36:26,282+03 INFO [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 5) WELD-001125: Illegal bean type interface org.ovirt.engine.core.dao.ReadDao<org.ovirt.engine.core.common.businessen tities.Provider<?>,class org.ovirt.engine.core.compat.Guid> ignored on [EnhancedAnnotatedTypeImpl] public @Singleton @Named class org.ovirt.engine.core.dao.provider.ProviderDaoImpl 2022-11-13 23:36:26,282+03 INFO [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 5) WELD-001125: Illegal bean type org.ovirt.engine.core.dao.SearchDao<org.ovirt.engine.core.common.businessentities.P rovider<?>> ignored on [EnhancedAnnotatedTypeImpl] public @Singleton @Named class org.ovirt.engine.core.dao.provider.ProviderDaoImpl 2022-11-13 23:36:26,283+03 INFO [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 5) WELD-001125: Illegal bean type interface org.ovirt.engine.core.dao.ModificationDao<org.ovirt.engine.core.common.bu sinessentities.Provider<?>,class org.ovirt.engine.core.compat.Guid> ignored on [EnhancedAnnotatedTypeImpl] public @Singleton @Named class org.ovirt.engine.core.dao.provider.ProviderDaoImpl 2022-11-13 23:36:26,283+03 INFO [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 5) WELD-001125: Illegal bean type class org.ovirt.engine.core.dao.DefaultReadDao<org.ovirt.engine.core.common.busines sentities.Provider<?>,class org.ovirt.engine.core.compat.Guid> ignored on [EnhancedAnnotatedTypeImpl] public @Singleton @Named class org.ovirt.engine.core.dao.provider.ProviderDaoImpl 2022-11-13 23:36:26,321+03 WARN [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 2) WELD-000167: Class org.ovirt.engine.core.dao.DbUserDaoImpl$DbUserMapSqlParameterSource is annotated with @Dependen t but it does not declare an appropriate constructor therefore is not registered as a bean! 2022-11-13 23:36:26,331+03 INFO [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 1) WELD-001125: Illegal bean type org.springframework.jdbc.core.RowMapper<org.ovirt.engine.core.common.businessentiti es.Provider<?>> ignored on [EnhancedAnnotatedTypeImpl] private static class org.ovirt.engine.core.dao.provider.ProviderDaoImpl$ProviderRowMapper 2022-11-13 23:36:26,333+03 WARN [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 1) WELD-000167: Class org.ovirt.engine.core.dao.BookmarkDaoImpl$BookmarkSqlParameterSource is annotated with @Depende nt but it does not declare an appropriate constructor therefore is not registered as a bean! 2022-11-13 23:36:26,446+03 INFO [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 4) WELD-001125: Illegal bean type java.util.Comparator<org.ovirt.engine.core.common.businessentities.network.NetworkI nterface<?>> ignored on [EnhancedAnnotatedTypeImpl] public class org.ovirt.engine.core.common.businessentities.comparators.InterfaceComparerByMAC 2022-11-13 23:36:26,672+03 INFO [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 3) WELD-001125: Illegal bean type class org.codehaus.jackson.map.deser.std.StdDeserializer<java.lang.Enum<?>> ignored on [EnhancedAnnotatedTypeImpl] public class org.ovirt.engine.core.utils.serialization.json.JsonEnumDeserializer 2022-11-13 23:36:26,673+03 INFO [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 3) WELD-001125: Illegal bean type org.codehaus.jackson.map.deser.std.StdScalarDeserializer<java.lang.Enum<?>> ignored on [EnhancedAnnotatedTypeImpl] public class org.ovirt.engine.core.utils.serialization.json.JsonEnumDeserializer 2022-11-13 23:36:26,673+03 INFO [org.jboss.weld.Bootstrap] (Weld Thread Pool -- 3) WELD-001125: Illegal bean type class org.codehaus.jackson.map.JsonDeserializer<java.lang.Enum<?>> ignored on [Enha ncedAnnotatedTypeImpl] public class org.ovirt.engine.core.utils.serialization.json.JsonEnumDeserializer 2022-11-13 23:36:26,988+03 WARN [org.jboss.as.weld] (Weld Thread Pool -- 1) WFLYWELD0052: Using deployment classloader to load proxy classes for module org.ovirt.engine.core.dal:main. Package-priva te access will not work. To fix this the module should declare dependencies on [org.jboss.weld.core, org.jboss.weld.spi] 2022-11-13 23:36:27,455+03 WARN [org.jboss.as.weld] (MSC service thread 1-1) WFLYWELD0052: Using deployment classloader to load proxy classes for module org.ovirt.engine.core.common:main. Package-p rivate access will not work. To fix this the module should declare dependencies on [org.jboss.weld.core, org.jboss.weld.spi] 2022-11-13 23:36:28,030+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 60) WFLYUT0021: Registered web context: /ovirt-engine/docs 2022-11-13 23:36:28,055+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 40) WFLYUT0021: Registered web context: / 2022-11-13 23:36:28,102+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 55) WFLYUT0021: Registered web context: /ovirt-engine/userportal 2022-11-13 23:36:28,135+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 47) WFLYUT0021: Registered web context: /ovirt-engine 2022-11-13 23:36:28,142+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 54) WFLYUT0021: Registered web context: /ovirt-engine/services 2022-11-13 23:36:28,370+03 INFO [org.springframework.beans.factory.xml.XmlBeanDefinitionReader] (ServerService Thread Pool -- 49) Loading XML bean definitions from class path resource [org/springfr amework/jdbc/support/sql-error-codes.xml] 2022-11-13 23:36:28,611+03 WARN [org.jboss.jca.core.connectionmanager.pool.strategy.OnePool] (ServerService Thread Pool -- 40) IJ000407: No lazy enlistment available for ENGINEDataSource 2022-11-13 23:36:28,675+03 INFO [org.springframework.jdbc.support.SQLErrorCodesFactory] (ServerService Thread Pool -- 49) SQLErrorCodes loaded: [DB2, Derby, H2, HSQL, Informix, MS-SQL, MySQL, Oracl e, PostgreSQL, Sybase, Hana] 2022-11-13 23:36:28,800+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 40) WFLYUT0021: Registered web context: /ovirt-engine/sso 2022-11-13 23:36:28,920+03 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 46) WFLYCLINF0002: Started dashboard cache from ovirt-engine container 2022-11-13 23:36:28,941+03 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 46) WFLYCLINF0002: Started inventory cache from ovirt-engine container 2022-11-13 23:36:28,952+03 WARN [org.jboss.jca.core.connectionmanager.pool.strategy.OnePool] (ServerService Thread Pool -- 46) IJ000407: No lazy enlistment available for DWHDataSource 2022-11-13 23:36:28,962+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 46) WFLYUT0021: Registered web context: /ovirt-engine/webadmin 2022-11-13 23:36:29,033+03 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 48) RESTEASY002225: Deploying javax.ws.rs.core.Application: class org.ovirt.engine.api.restapi .BackendApplication 2022-11-13 23:36:29,034+03 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 48) RESTEASY002210: Adding provider singleton org.ovirt.engine.api.restapi.resource.validation .MalformedIdExceptionMapper from Application class org.ovirt.engine.api.restapi.BackendApplication 2022-11-13 23:36:29,034+03 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 48) RESTEASY002210: Adding provider singleton org.ovirt.engine.api.restapi.resource.validation .JsonExceptionMapper from Application class org.ovirt.engine.api.restapi.BackendApplication 2022-11-13 23:36:29,034+03 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 48) RESTEASY002210: Adding provider singleton org.ovirt.engine.api.restapi.resource.validation .IOExceptionMapper from Application class org.ovirt.engine.api.restapi.BackendApplication 2022-11-13 23:36:29,034+03 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 48) RESTEASY002220: Adding singleton resource org.ovirt.engine.api.restapi.resource.BackendApi Resource from Application class org.ovirt.engine.api.restapi.BackendApplication 2022-11-13 23:36:29,034+03 INFO [org.jboss.resteasy.resteasy_jaxrs.i18n] (ServerService Thread Pool -- 48) RESTEASY002210: Adding provider singleton org.ovirt.engine.api.restapi.resource.validation .MappingExceptionMapper from Application class org.ovirt.engine.api.restapi.BackendApplication 2022-11-13 23:36:29,055+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 48) WFLYUT0021: Registered web context: /ovirt-engine/api 2022-11-13 23:36:29,584+03 INFO [org.quartz.impl.StdSchedulerFactory] (ServerService Thread Pool -- 49) Using default implementation for ThreadExecutor 2022-11-13 23:36:29,600+03 INFO [org.quartz.core.QuartzSchedulerThread] (ServerService Thread Pool -- 49) QuartzSchedulerThread Inheriting ContextClassLoader of thread: ServerService Thread Pool -- 49 2022-11-13 23:36:29,602+03 INFO [org.quartz.core.SchedulerSignalerImpl] (ServerService Thread Pool -- 49) Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl 2022-11-13 23:36:29,602+03 INFO [org.quartz.core.QuartzScheduler] (ServerService Thread Pool -- 49) Quartz Scheduler v.2.1.2 created. 2022-11-13 23:36:29,603+03 INFO [org.quartz.impl.jdbcjobstore.JobStoreCMT] (ServerService Thread Pool -- 49) JDBCJobStore threads will inherit ContextClassLoader of thread: ServerService Thread Poo l -- 49 2022-11-13 23:36:29,603+03 INFO [org.quartz.impl.jdbcjobstore.JobStoreCMT] (ServerService Thread Pool -- 49) Using db table-based data access locking (synchronization). 2022-11-13 23:36:29,605+03 INFO [org.quartz.impl.jdbcjobstore.JobStoreCMT] (ServerService Thread Pool -- 49) JobStoreCMT initialized. 2022-11-13 23:36:29,607+03 INFO [org.quartz.core.QuartzScheduler] (ServerService Thread Pool -- 49) Scheduler meta-data: Quartz Scheduler (v2.1.2) 'QuartzOvirtDBScheduler' with instanceId 'NON_CLUS TERED' Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally. NOT STARTED. Currently in standby mode. Number of jobs executed: 0 Using thread pool 'org.ovirt.engine.core.utils.timer.SchedulerThreadPool' - with 50 threads. Using job-store 'org.quartz.impl.jdbcjobstore.JobStoreCMT' - which supports persistence. and is not clustered. 2022-11-13 23:36:29,607+03 INFO [org.quartz.impl.StdSchedulerFactory] (ServerService Thread Pool -- 49) Quartz scheduler 'QuartzOvirtDBScheduler' initialized from an externally provided properties instance. 2022-11-13 23:36:29,607+03 INFO [org.quartz.impl.StdSchedulerFactory] (ServerService Thread Pool -- 49) Quartz scheduler version: 2.1.2 2022-11-13 23:36:29,772+03 INFO [org.quartz.impl.jdbcjobstore.JobStoreCMT] (ServerService Thread Pool -- 49) Freed 0 triggers from 'acquired' / 'blocked' state. 2022-11-13 23:36:29,810+03 INFO [org.quartz.impl.jdbcjobstore.JobStoreCMT] (ServerService Thread Pool -- 49) Recovering 0 jobs that were in-progress at the time of the last shut-down. 2022-11-13 23:36:29,811+03 INFO [org.quartz.impl.jdbcjobstore.JobStoreCMT] (ServerService Thread Pool -- 49) Recovery complete. 2022-11-13 23:36:29,811+03 INFO [org.quartz.impl.jdbcjobstore.JobStoreCMT] (ServerService Thread Pool -- 49) Removed 0 'complete' triggers. 2022-11-13 23:36:29,812+03 INFO [org.quartz.impl.jdbcjobstore.JobStoreCMT] (ServerService Thread Pool -- 49) Removed 0 stale fired job entries. 2022-11-13 23:36:29,816+03 INFO [org.quartz.core.QuartzScheduler] (ServerService Thread Pool -- 49) Scheduler QuartzOvirtDBScheduler_$_NON_CLUSTERED started. 2022-11-13 23:36:29,827+03 INFO [org.quartz.impl.StdSchedulerFactory] (ServerService Thread Pool -- 49) Using default implementation for ThreadExecutor 2022-11-13 23:36:29,828+03 INFO [org.quartz.core.SchedulerSignalerImpl] (ServerService Thread Pool -- 49) Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl 2022-11-13 23:36:29,828+03 INFO [org.quartz.core.QuartzScheduler] (ServerService Thread Pool -- 49) Quartz Scheduler v.2.1.2 created. 2022-11-13 23:36:29,828+03 INFO [org.quartz.simpl.RAMJobStore] (ServerService Thread Pool -- 49) RAMJobStore initialized. 2022-11-13 23:36:29,828+03 INFO [org.quartz.core.QuartzScheduler] (ServerService Thread Pool -- 49) Scheduler meta-data: Quartz Scheduler (v2.1.2) 'DefaultQuartzScheduler' with instanceId 'NON_CLUS TERED' Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally. NOT STARTED. Currently in standby mode. Number of jobs executed: 0 Using thread pool 'org.ovirt.engine.core.utils.timer.SchedulerThreadPool' - with 100 threads. Using job-store 'org.quartz.simpl.RAMJobStore' - which does not support persistence. and is not clustered. 2022-11-13 23:36:29,828+03 INFO [org.quartz.impl.StdSchedulerFactory] (ServerService Thread Pool -- 49) Quartz scheduler 'DefaultQuartzScheduler' initialized from default resource file in Quartz pa ckage: 'quartz.properties' 2022-11-13 23:36:29,828+03 INFO [org.quartz.impl.StdSchedulerFactory] (ServerService Thread Pool -- 49) Quartz scheduler version: 2.1.2 2022-11-13 23:36:29,828+03 INFO [org.quartz.core.QuartzScheduler] (ServerService Thread Pool -- 49) Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED started. 2022-11-13 23:36:29,848+03 INFO [org.jboss.as.clustering.infinispan] (ServerService Thread Pool -- 49) WFLYCLINF0002: Started timeout-base cache from ovirt-engine container 2022-11-13 23:36:33,874+03 ERROR [org.jboss.msc.service.fail] (ServerService Thread Pool -- 49) MSC000001: Failed to start service jboss.deployment.subunit."engine.ear"."bll.jar".component.InitBacke ndServicesOnStartupBean.START: org.jboss.msc.service.StartException in service jboss.deployment.subunit."engine.ear"."bll.jar".component.InitBackendServicesOnStartupBean.START: java.lang.IllegalStat eException: WFLYEE0042: Failed to construct component instance at org.jboss.as.ee.component.ComponentStartService$1.run(ComponentStartService.java:57) [wildfly-ee-10.1.0.Final.jar:10.1.0.Final] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [rt.jar:1.8.0_161] at java.util.concurrent.FutureTask.run(FutureTask.java:266) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [rt.jar:1.8.0_161] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [rt.jar:1.8.0_161] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_161] at org.jboss.threads.JBossThread.run(JBossThread.java:320) Caused by: java.lang.IllegalStateException: WFLYEE0042: Failed to construct component instance at org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:163) [wildfly-ee-10.1.0.Final.jar:10.1.0.Final] at org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:134) [wildfly-ee-10.1.0.Final.jar:10.1.0.Final] at org.jboss.as.ee.component.BasicComponent.createInstance(BasicComponent.java:88) [wildfly-ee-10.1.0.Final.jar:10.1.0.Final] at org.jboss.as.ejb3.component.singleton.SingletonComponent.getComponentInstance(SingletonComponent.java:124) at org.jboss.as.ejb3.component.singleton.SingletonComponent.start(SingletonComponent.java:138) at org.jboss.as.ee.component.ComponentStartService$1.run(ComponentStartService.java:54) [wildfly-ee-10.1.0.Final.jar:10.1.0.Final] ... 6 more Caused by: javax.ejb.EJBException: WFLYEJB0442: Unexpected Error at org.jboss.as.ejb3.tx.CMTTxInterceptor.handleExceptionInOurTx(CMTTxInterceptor.java:184) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:277) at org.jboss.as.ejb3.tx.CMTTxInterceptor.requiresNew(CMTTxInterceptor.java:349) at org.jboss.as.ejb3.tx.LifecycleCMTTxInterceptor.processInvocation(LifecycleCMTTxInterceptor.java:68) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.as.weld.injection.WeldInjectionContextInterceptor.processInvocation(WeldInjectionContextInterceptor.java:43) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.processInvocation(ConcurrentContextInterceptor.java:45) [wildfly-ee-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.invocation.ContextClassLoaderInterceptor.processInvocation(ContextClassLoaderInterceptor.java:64) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.as.ejb3.component.singleton.StartupCountDownInterceptor.processInvocation(StartupCountDownInterceptor.java:25) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.invocation.InterceptorContext.run(InterceptorContext.java:356) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.invocation.PrivilegedWithCombinerInterceptor.processInvocation(PrivilegedWithCombinerInterceptor.java:80) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:161) [wildfly-ee-10.1.0.Final.jar:10.1.0.Final] ... 11 more Caused by: java.lang.ExceptionInInitializerError at org.ovirt.engine.core.bll.InitBackendServicesOnStartupBean.create(InitBackendServicesOnStartupBean.java:64) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptor.java:96) [wildfly-ee-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doLifecycleInterception(Jsr299BindingsInterceptor.java:114) at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:103) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:83) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.as.weld.injection.WeldInjectionInterceptor.processInvocation(WeldInjectionInterceptor.java:53) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.as.ee.component.AroundConstructInterceptorFactory$1.processInvocation(AroundConstructInterceptorFactory.java:28) [wildfly-ee-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.as.weld.injection.WeldInterceptorInjectionInterceptor.processInvocation(WeldInterceptorInjectionInterceptor.java:56) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.as.weld.ejb.Jsr299BindingsCreateInterceptor.processInvocation(Jsr299BindingsCreateInterceptor.java:100) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) [wildfly-ee-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) [jboss-invocation-1.4.1.Final.jar:1.4.1.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInOurTx(CMTTxInterceptor.java:275) ... 29 more Caused by: org.jboss.weld.exceptions.WeldException: WELD-000049: Unable to invoke private void org.ovirt.engine.core.bll.tasks.CommandsRepository.handleUnmanagedCommands() on org.ovirt.engine.core.b ll.tasks.CommandsRepository@4837a568 at org.jboss.weld.injection.producer.DefaultLifecycleCallbackInvoker.invokeMethods(DefaultLifecycleCallbackInvoker.java:100) at org.jboss.weld.injection.producer.DefaultLifecycleCallbackInvoker.postConstruct(DefaultLifecycleCallbackInvoker.java:81) at org.jboss.weld.injection.producer.BasicInjectionTarget.postConstruct(BasicInjectionTarget.java:126) at org.jboss.weld.bean.ManagedBean.create(ManagedBean.java:162) at org.jboss.weld.context.AbstractContext.get(AbstractContext.java:96) at org.jboss.weld.bean.ContextualInstanceStrategy$DefaultContextualInstanceStrategy.get(ContextualInstanceStrategy.java:101) at org.jboss.weld.bean.ContextualInstanceStrategy$ApplicationScopedContextualInstanceStrategy.get(ContextualInstanceStrategy.java:141) at org.jboss.weld.bean.ContextualInstance.get(ContextualInstance.java:50) at org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:742) at org.jboss.weld.bean.builtin.InstanceImpl.getBeanInstance(InstanceImpl.java:189) at org.jboss.weld.bean.builtin.InstanceImpl.get(InstanceImpl.java:100) at org.ovirt.engine.core.di.Injector.get(Injector.java:45) at org.ovirt.engine.core.bll.tasks.CommandCoordinatorImpl.<init>(CommandCoordinatorImpl.java:53) at org.ovirt.engine.core.bll.tasks.CommandCoordinatorUtil.<clinit>(CommandCoordinatorUtil.java:34) ... 54 more Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_161] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_161] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_161] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_161] at org.jboss.weld.injection.producer.DefaultLifecycleCallbackInvoker.invokeMethods(DefaultLifecycleCallbackInvoker.java:98) ... 67 more Caused by: java.lang.NullPointerException at org.ovirt.engine.core.bll.CloneVmCommand.getSharedLocks(CloneVmCommand.java:106) at org.ovirt.engine.core.bll.CommandBase.buildLock(CommandBase.java:1970) at org.ovirt.engine.core.bll.CommandBase.acquireLockInternal(CommandBase.java:1932) at org.ovirt.engine.core.bll.CommandBase.acquireLockAsyncTask(CommandBase.java:1923) at org.ovirt.engine.core.bll.CommandBase.reacquireLocks(CommandBase.java:1911) at java.util.stream.ForEachOps$ForEachOp$OfRef.accept(ForEachOps.java:184) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) [rt.jar:1.8.0_161] at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:481) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:471) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp.evaluateSequential(ForEachOps.java:151) [rt.jar:1.8.0_161] at java.util.stream.ForEachOps$ForEachOp$OfRef.evaluateSequential(ForEachOps.java:174) [rt.jar:1.8.0_161] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) [rt.jar:1.8.0_161] at java.util.stream.ReferencePipeline.forEach(ReferencePipeline.java:418) [rt.jar:1.8.0_161] at org.ovirt.engine.core.bll.tasks.CommandsRepository.handleUnmanagedCommands(CommandsRepository.java:110) ... 72 more 2022-11-13 23:36:33,891+03 ERROR [org.jboss.as.controller.management-operation] (Controller Boot Thread) WFLYCTL0013: Operation ("deploy") failed - address: ([("deployment" => "engine.ear")]) - fail ure description: { "WFLYCTL0080: Failed services" => {"jboss.deployment.subunit.\"engine.ear\".\"bll.jar\".component.InitBackendServicesOnStartupBean.START" => "org.jboss.msc.service.StartException in service jbos s.deployment.subunit.\"engine.ear\".\"bll.jar\".component.InitBackendServicesOnStartupBean.START: java.lang.IllegalStateException: WFLYEE0042: Failed to construct component instance Caused by: java.lang.IllegalStateException: WFLYEE0042: Failed to construct component instance Caused by: javax.ejb.EJBException: WFLYEJB0442: Unexpected Error Caused by: java.lang.ExceptionInInitializerError Caused by: org.jboss.weld.exceptions.WeldException: WELD-000049: Unable to invoke private void org.ovirt.engine.core.bll.tasks.CommandsRepository.handleUnmanagedCommands() on org.ovirt.engine.co re.bll.tasks.CommandsRepository@4837a568 Caused by: java.lang.reflect.InvocationTargetException Caused by: java.lang.NullPointerException"}, "WFLYCTL0412: Required services that are not installed:" => ["jboss.deployment.subunit.\"engine.ear\".\"bll.jar\".component.InitBackendServicesOnStartupBean.START"], "WFLYCTL0180: Services with missing/unavailable dependencies" => undefined } 2022-11-13 23:36:34,350+03 INFO [org.jboss.as.server] (ServerService Thread Pool -- 25) WFLYSRV0010: Deployed "ovirt-web-ui.war" (runtime-name : "ovirt-web-ui.war") 2022-11-13 23:36:34,350+03 INFO [org.jboss.as.server] (ServerService Thread Pool -- 25) WFLYSRV0010: Deployed "apidoc.war" (runtime-name : "apidoc.war") 2022-11-13 23:36:34,350+03 INFO [org.jboss.as.server] (ServerService Thread Pool -- 25) WFLYSRV0010: Deployed "restapi.war" (runtime-name : "restapi.war") 2022-11-13 23:36:34,350+03 INFO [org.jboss.as.server] (ServerService Thread Pool -- 25) WFLYSRV0010: Deployed "engine.ear" (runtime-name : "engine.ear") 2022-11-13 23:36:34,358+03 INFO [org.jboss.as.controller] (Controller Boot Thread) WFLYCTL0183: Service status report WFLYCTL0186: Services which failed to start: service jboss.deployment.subunit."engine.ear"."bll.jar".component.InitBackendServicesOnStartupBean.START: org.jboss.msc.service.StartException in service jboss.deployment.subunit."engine.ear"."bll.jar".component.InitBackendServicesOnStartupBean.START: java.lang.IllegalStateException: WFLYEE0042: Failed to construct component instance 2022-11-13 23:36:34,704+03 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0060: Http management interface listening on http://127.0.0.1:8706/management 2022-11-13 23:36:34,704+03 INFO [org.jboss.as] (Controller Boot Thread) WFLYSRV0051: Admin console listening on http://127.0.0.1:8706 2022-11-13 23:36:34,704+03 ERROR [org.jboss.as] (Controller Boot Thread) WFLYSRV0026: WildFly Full 10.1.0.Final (WildFly Core 2.2.0.Final) started (with errors) in 26057ms - Started 1558 of 1843 ser vices (4 services failed or missing dependencies, 463 services are lazy, passive or on-demand) 2022-11-13 23:36:34,785+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 10) WFLYUT0022: Unregistered web context: /ovirt-engine/sso 2022-11-13 23:36:34,787+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 7) WFLYUT0022: Unregistered web context: /ovirt-engine/api 2022-11-13 23:36:34,788+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 9) WFLYUT0022: Unregistered web context: /ovirt-engine/services 2022-11-13 23:36:34,791+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 12) WFLYUT0022: Unregistered web context: /ovirt-engine/userportal 2022-11-13 23:36:34,794+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 20) WFLYUT0022: Unregistered web context: / 2022-11-13 23:36:34,799+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 16) WFLYUT0022: Unregistered web context: /ovirt-engine 2022-11-13 23:36:34,800+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 15) WFLYUT0022: Unregistered web context: /ovirt-engine/webadmin 2022-11-13 23:36:34,800+03 INFO [org.wildfly.extension.undertow] (ServerService Thread Pool -- 19) WFLYUT0022: Unregistered web context: /ovirt-engine/docs 2022-11-13 23:36:34,823+03 INFO [org.quartz.core.QuartzScheduler] (MSC service thread 1-4) Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED shutting down. 2022-11-13 23:36:34,823+03 INFO [org.quartz.core.QuartzScheduler] (MSC service thread 1-4) Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED paused. 2022-11-13 23:36:34,823+03 INFO [org.quartz.core.QuartzScheduler] (MSC service thread 1-4) Scheduler DefaultQuartzScheduler_$_NON_CLUSTERED shutdown complete. 2022-11-13 23:36:34,823+03 INFO [org.quartz.core.QuartzScheduler] (MSC service thread 1-4) Scheduler QuartzOvirtDBScheduler_$_NON_CLUSTERED shutting down. 2022-11-13 23:36:34,824+03 INFO [org.quartz.core.QuartzScheduler] (MSC service thread 1-4) Scheduler QuartzOvirtDBScheduler_$_NON_CLUSTERED paused. 2022-11-13 23:36:34,824+03 INFO [org.quartz.core.QuartzScheduler] (MSC service thread 1-4) Scheduler QuartzOvirtDBScheduler_$_NON_CLUSTERED shutdown complete. 2022-11-13 23:36:34,871+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-8) WFLYSRV0208: Stopped subdeployment (runtime-name: webadmin.war) in 118ms 2022-11-13 23:36:34,871+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-8) WFLYSRV0208: Stopped subdeployment (runtime-name: docs.war) in 118ms 2022-11-13 23:36:34,871+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-8) WFLYSRV0208: Stopped subdeployment (runtime-name: root.war) in 118ms 2022-11-13 23:36:34,871+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-2) WFLYSRV0208: Stopped subdeployment (runtime-name: bll.jar) in 118ms 2022-11-13 23:36:34,872+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-8) WFLYSRV0208: Stopped subdeployment (runtime-name: enginesso.war) in 118ms 2022-11-13 23:36:34,872+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-2) WFLYSRV0208: Stopped subdeployment (runtime-name: welcome.war) in 118ms 2022-11-13 23:36:34,872+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-8) WFLYSRV0208: Stopped subdeployment (runtime-name: userportal.war) in 119ms 2022-11-13 23:36:34,872+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-7) WFLYSRV0208: Stopped subdeployment (runtime-name: services.war) in 119ms 2022-11-13 23:36:34,873+03 INFO [org.jboss.as.server.deployment] (MSC service thread 1-7) WFLYSRV0028: Stopped deployment engine.ear (runtime-name: engine.ear) in 121ms 2022-11-13 23:36:34,930+03 WARN [org.jboss.as.controller] (DeploymentScanner-threads - 2) WFLYCTL0357: Notification of type deployment-undeployed is not described for the resource at the address [] 2022-11-13 23:36:34,931+03 INFO [org.jboss.as.server] (DeploymentScanner-threads - 2) WFLYSRV0009: Undeployed "engine.ear" (runtime-name: "engine.ear”) 2022-11-13 23:36:34,932+03 INFO [org.jboss.as.controller] (DeploymentScanner-threads - 2) WFLYCTL0183: Service status report WFLYCTL0184: New missing/unsatisfied dependencies: service jboss.deployment.subunit."engine.ear"."bll.jar".component.Backend.START (missing) dependents: [service jboss.deployment.subunit."engine.ear"."bll.jar".moduleDeploymentRuntimeInformatio nStart, service jboss.deployment.subunit."engine.ear"."bll.jar".deploymentCompleteService] service jboss.deployment.subunit."engine.ear"."bll.jar".component.InitBackendServicesOnStartupBean.START (missing) dependents: [service jboss.deployment.subunit."engine.ear"."bll.jar".moduleDe ploymentRuntimeInformationStart, service jboss.deployment.subunit."engine.ear"."bll.jar".deploymentCompleteService] service jboss.deployment.subunit."engine.ear"."bll.jar".component.LockManager.START (missing) dependents: [service jboss.deployment.subunit."engine.ear"."bll.jar".moduleDeploymentRuntimeInform ationStart, service jboss.deployment.subunit."engine.ear"."bll.jar".deploymentCompleteService] service jboss.deployment.subunit."engine.ear"."bll.jar".component.MacPoolPerCluster.START (missing) dependents: [service jboss.deployment.subunit."engine.ear"."bll.jar".moduleDeploymentRuntime InformationStart, service jboss.deployment.subunit."engine.ear"."bll.jar".deploymentCompleteService] service jboss.deployment.subunit."engine.ear"."bll.jar".deploymentCompleteService (missing) dependents: [service jboss.deployment.unit."engine.ear".deploymentCompleteService] service jboss.deployment.subunit."engine.ear"."bll.jar".moduleDeploymentRuntimeInformation (missing) dependents: [service jboss.deployment.subunit."engine.ear"."bll.jar".moduleDeploymentRuntim eInformationStart] service jboss.deployment.subunit."engine.ear"."docs.war".deploymentCompleteService (missing) dependents: [service jboss.deployment.unit."engine.ear".deploymentCompleteService] service jboss.deployment.subunit."engine.ear"."enginesso.war".deploymentCompleteService (missing) dependents: [service jboss.deployment.unit."engine.ear".deploymentCompleteService] service jboss.deployment.subunit."engine.ear"."root.war".deploymentCompleteService (missing) dependents: [service jboss.deployment.unit."engine.ear".deploymentCompleteService] service jboss.deployment.subunit."engine.ear"."services.war".deploymentCompleteService (missing) dependents: [service jboss.deployment.unit."engine.ear".deploymentCompleteService] service jboss.deployment.subunit."engine.ear"."userportal.war".deploymentCompleteService (missing) dependents: [service jboss.deployment.unit."engine.ear".deploymentCompleteService] service jboss.deployment.subunit."engine.ear"."webadmin.war".deploymentCompleteService (missing) dependents: [service jboss.deployment.unit."engine.ear".deploymentCompleteService] service jboss.deployment.subunit."engine.ear"."welcome.war".deploymentCompleteService (missing) dependents: [service jboss.deployment.unit."engine.ear".deploymentCompleteService] service jboss.naming.context.java.global.engine.bll."Backend!org.ovirt.engine.core.common.interfaces.BackendLocal" (missing) dependents: [service jboss.naming.context.java.module.restapi.resta pi.env."org.ovirt.engine.api.restapi.security.CORSSupportFilter".backend, service jboss.naming.context.java.module.restapi.restapi.env."org.ovirt.engine.api.restapi.invocation.CurrentFilter".backend ] WFLYCTL0186: Services which failed to start: service jboss.deployment.subunit."engine.ear"."bll.jar".component.InitBackendServicesOnStartupBean.START

1 0

novnc console - promise.js 404 error
by Alexandre Bezroutchko 12 Nov '22

12 Nov '22

Hello, I have deployed oVirt 4.5 on CentOS Stream 8 with self-hosted engine, in IPv6-only mode. I am trying to use noVNC console, from Firefox on MacOS. I have added engine's CA to the list of trusted CAs. I have noticed the webproxy only listens on IPv4 by default, I have tried to add the following configuration file and it made it listed on both IPv4 and IPv6: [root@mng41 ~]# cat /etc/ovirt-engine/ovirt-websocket-proxy.conf.d/20-ipv6.conf SOURCE_IS_IPV6=True Is this correct approach or there is a better way? I guess this should be part of the setup process... Anyway, it does not solve my issue. When I try to use noVNC console, I get the following error in the Firefox javascript console: Loading failed for the <script> with source “ https://mng41.gremwell.com/ovirt-engine/services/files/novnc/vendor/promise… ”. I also get the following message: Firefox can’t establish a connection to the server at wss:// mng41.gremwell.com:6100/ey... I have checked that the port is open and I see some traffic flowing between the browser and that port. In /var/log/ovirt-engine/engine.log I see: 2022-11-11 14:32:57,652+01 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (default task-11) [2d6aa0eb] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 7fb95436-da52-421a-a733-503181429929 Type: VMAction group CONNECT_TO_VM with role type USER 2022-11-11 14:32:57,657+01 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (default task-11) [2d6aa0eb] START, SetVmTicketVDSCommand(HostName = elon41.gremwell.com, SetVmTicketVDSCommandParameters:{hostId='f63b9132-fb54-4c24-b5b3-240c0a1896f9', vmId='7fb95436-da52-421a-a733-503181429929', protocol='VNC', ticket='47kRPdus', validTime='120', userName='admin', userId='af04127c-60d7-11ed-8ad9-00163e63cf1d', disconnectAction='LOCK_SCREEN', consoleDisconnectActionDelay='0'}), log id: 27745778 2022-11-11 14:32:57,688+01 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (default task-11) [2d6aa0eb] FINISH, SetVmTicketVDSCommand, return: , log id: 27745778 2022-11-11 14:32:57,716+01 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-11) [2d6aa0eb] EVENT_ID: VM_SET_TICKET(164), User admin@internal-authz initiated console session for VM test 2022-11-11 14:32:57,947+01 INFO [org.ovirt.engine.core.utils.servlet.ServletUtils] (default task-11) [] Can't read file '/usr/share/ovirt-engine/files/novnc/vendor/promise.js' for request '/ovirt-engine/services/files/novnc/vendor/promise.js' -- 404 Any ideas how to have this fixed? Best regards, Alex

1 1

Engine deploy fails - "Wait for the host to be up"
by simon＠justconnect.ie 11 Nov '22

11 Nov '22

I use ansible to build a 3 node HCI environment, or at least I did with 4.4.6. This fails every time with 4.5.2 - what broke? Has anyone any idea what changed and if there's a simple resolution? Kind Regards Simon...

2 3