- Users - oVirt List Archives

Engine status : unknown stale-data on single node
by Wood, Randall 01 Apr '20

01 Apr '20

I have a three node Ovirt cluster where one node has stale-data for the hosted engine, but the other two nodes do not: Output of `hosted-engine --vm-status` on a good node: ``` !! Cluster is in GLOBAL MAINTENANCE mode !! --== Host ovirt2.low.mdds.tcs-sec.com (id: 1) status ==-- conf_on_shared_storage : True Status up-to-date : True Hostname : ovirt2.low.mdds.tcs-sec.com Host ID : 1 Engine status : {"health": "good", "vm": "up", "detail": "Up"} Score : 3400 stopped : False Local maintenance : False crc32 : f91f57e4 local_conf_timestamp : 9915242 Host timestamp : 9915241 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=9915241 (Fri Mar 27 14:38:14 2020) host-id=1 score=3400 vm_conf_refresh_time=9915242 (Fri Mar 27 14:38:14 2020) conf_on_shared_storage=True maintenance=False state=GlobalMaintenance stopped=False --== Host ovirt1.low.mdds.tcs-sec.com (id: 2) status ==-- conf_on_shared_storage : True Status up-to-date : True Hostname : ovirt1.low.mdds.tcs-sec.com Host ID : 2 Engine status : {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"} Score : 3400 stopped : False Local maintenance : False crc32 : 48f9c0fc local_conf_timestamp : 9218845 Host timestamp : 9218845 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=9218845 (Fri Mar 27 14:38:22 2020) host-id=2 score=3400 vm_conf_refresh_time=9218845 (Fri Mar 27 14:38:22 2020) conf_on_shared_storage=True maintenance=False state=GlobalMaintenance stopped=False --== Host ovirt3.low.mdds.tcs-sec.com (id: 3) status ==-- conf_on_shared_storage : True Status up-to-date : False Hostname : ovirt3.low.mdds.tcs-sec.com Host ID : 3 Engine status : unknown stale-data Score : 3400 stopped : False Local maintenance : False crc32 : 620c8566 local_conf_timestamp : 1208310 Host timestamp : 1208310 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=1208310 (Mon Dec 16 21:14:24 2019) host-id=3 score=3400 vm_conf_refresh_time=1208310 (Mon Dec 16 21:14:24 2019) conf_on_shared_storage=True maintenance=False state=GlobalMaintenance stopped=False !! Cluster is in GLOBAL MAINTENANCE mode !! ``` I tried the steps in https://access.redhat.com/discussions/3511881, but `hosted-engine --vm-status` on the node with stale data shows: ``` The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable. ``` One the stale node, ovirt-ha-agent and ovirt-ha-broker are continually restarting. Since it seems the agent depends on the broker, the broker logs includes this snippet, repeating roughly every 3 seconds: ``` MainThread::INFO::2020-03-27 15:01:06,584::broker::47::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 2.3.6 started MainThread::INFO::2020-03-27 15:01:06,584::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/submonitors MainThread::INFO::2020-03-27 15:01:06,585::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health MainThread::INFO::2020-03-27 15:01:06,585::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain MainThread::INFO::2020-03-27 15:01:06,585::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network MainThread::INFO::2020-03-27 15:01:06,587::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine MainThread::INFO::2020-03-27 15:01:06,587::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free MainThread::INFO::2020-03-27 15:01:06,587::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor network MainThread::INFO::2020-03-27 15:01:06,588::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge MainThread::INFO::2020-03-27 15:01:06,588::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor storage-domain MainThread::INFO::2020-03-27 15:01:06,589::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine MainThread::INFO::2020-03-27 15:01:06,589::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health MainThread::INFO::2020-03-27 15:01:06,589::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge MainThread::INFO::2020-03-27 15:01:06,589::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load MainThread::INFO::2020-03-27 15:01:06,590::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load MainThread::INFO::2020-03-27 15:01:06,590::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free MainThread::INFO::2020-03-27 15:01:06,590::monitor::50::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Finished loading submonitors MainThread::INFO::2020-03-27 15:01:06,678::storage_backends::373::ovirt_hosted_engine_ha.lib.storage_backends::(connect) Connecting the storage MainThread::INFO::2020-03-27 15:01:06,678::storage_server::349::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server) Connecting storage server MainThread::INFO::2020-03-27 15:01:06,717::storage_server::356::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server) Connecting storage server MainThread::INFO::2020-03-27 15:01:06,732::storage_server::413::ovirt_hosted_engine_ha.lib.storage_server.StorageServer::(connect_storage_server) Refreshing the storage domain MainThread::WARNING::2020-03-27 15:01:08,940::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: [Errno 5] Input/output error: '/rhev/data-center/mnt/glusterSD/ovirt2:_engine/182a4a94-743f-4941-89c1-dc2008ae1cf5/ha_agent/hosted-engine.lockspace' ``` I restarted the stale node yesterday, but it still shows stale data from December of last year. What is the recommended way for me to try to recover from this? (This came to my attention when warnings concerning space on the /var/log partition began popping up.) Thank you, Randall

3 4

Re: Local network
by Tommaso - Shellrent 01 Apr '20

01 Apr '20

This is what i've got: *ovs-vsctl show* 03a038d4-e81c-45e0-94d1-6f18d6504f1f Bridge br-int fail_mode: secure Port "ovn-765f43-0" Interface "ovn-765f43-0" type: geneve options: {csum="true", key=flow, remote_ip="xxx.169.yy.6"} Port br-int Interface br-int type: internal Port "vnet1" Interface "vnet1" Port "ovn-b33f6e-0" Interface "ovn-b33f6e-0" type: geneve options: {csum="true", key=flow, remote_ip="xxx.169.yy.2"} Port "vnet3" Interface "vnet3" Port "ovn-8678d9-0" Interface "ovn-8678d9-0" type: geneve options: {csum="true", key=flow, remote_ip="xxx.169.yy.8"} Port "ovn-fdd090-0" Interface "ovn-fdd090-0" type: geneve options: {csum="true", key=flow, remote_ip="xxx.169.yy.4"} ovs_version: "2.11.0" I suppose that the vnic are: Port "vnet1" Interface "vnet1" Port "vnet3" Interface "vnet3" on the engine: *ovn-nbctl show* switch a1f30e99-3ab7-46a4-925d-287871905cab (ovirt-local_network_definitiva-d58aea97-bb20-4e8f-bcc3-5277754846bb) port b82f3479-b459-4c26-aff0-053d15c74ddd addresses: ["56:6f:96:b1:00:4c"] port 52f09a28-1645-45ff-9b84-1e53a81bb399 addresses: ["56:6f:96:b1:00:4b"] *ovn-sbctl show* Chassis "ab5bdfdd-8df4-4e9b-9ce9-565cfd513a4d" hostname: "pvt-41f18-002.serverlet.com" Encap geneve ip: "aaa.31.bbb.224" options: {csum="true"} Port_Binding "b82f3479-b459-4c26-aff0-053d15c74ddd" Port_Binding "52f09a28-1645-45ff-9b84-1e53a81bb399" Il 31/03/20 13:39, Staniforth, Paul ha scritto: > The engine runs the controller so ovn-sbctl won't work, on the hosts, > use ovs-vsctl show > > Paul S. > ------------------------------------------------------------------------ > *From:* Tommaso - Shellrent <tommaso(a)shellrent.com> > *Sent:* 31 March 2020 12:13 > *To:* Staniforth, Paul <P.Staniforth(a)leedsbeckett.ac.uk>; > users(a)ovirt.org <users(a)ovirt.org> > *Subject:* Re: [ovirt-users] Local network > > *Caution External Mail:* Do not click any links or open any > attachments unless you trust the sender and know that the content is safe. > > Hi. > > on engine all seems fine. > > on host the command "ovn-sbctl show" is stuck, and with a strace a se > the following error: > > > connect(5, {sa_family=AF_LOCAL, > sun_path="/var/run/openvswitch/ovnsb_db.sock"}, 37) = -1 ENOENT (No > such file or directory) > > > > > > > Il 31/03/20 11:18, Staniforth, Paul ha scritto: >> >> .Hello Tommaso, >> on your oVirt engine host run >> check the north bridge controller >> ovn-nbctl show >> this should show a software switch for each ovn logical network witch >> any ports that are active( in your case you should have 2) >> >> check the south bridge controller >> ovn-sbctl show >> this should show the software switch on each host with a geneve tunnel. >> >> on each host run >> ovs-vsctl show >> this should show the virtual switch with a geneve tunnel to each >> other host and a port for any active vnics >> >> Regards, >> Paul S. >> >> ------------------------------------------------------------------------ >> *From:* Tommaso - Shellrent <tommaso(a)shellrent.com> >> <mailto:tommaso@shellrent.com> >> *Sent:* 31 March 2020 09:27 >> *To:* users(a)ovirt.org <mailto:users@ovirt.org> <users(a)ovirt.org> >> <mailto:users@ovirt.org> >> *Subject:* [ovirt-users] Local network >> >> *Caution External Mail:* Do not click any links or open any >> attachments unless you trust the sender and know that the content is >> safe. >> >> Hi to all. >> >> I'm trying to connect two vm, on the same "local storage" host, >> with an internal isolated network. >> >> My setup; >> >> VM A: >> >> * eth0 with an external ip >> * eth1, with 1922.168.1.1/24 >> >> VM B >> >> * eth0 with an external ip >> * eth1, with 1922.168.1.2/24 >> >> the eth1 interfaces are connetter by a network created on external >> provider ovirt-network-ovn , whithout a subnet defined. >> >> Now, the external ip works fine, but the two vm cannot connect >> through the local network >> >> ping: ko >> arping: ko >> >> >> any idea to what to check? >> >> >> Regards >> >> -- >> -- >> Shellrent - Il primo hosting italiano Security First >> >> *Tommaso De Marchi* >> /COO - Chief Operating Officer/ >> Shellrent Srl >> Via dell'Edilizia, 19 - 36100 Vicenza >> Tel. 0444321155 <tel:+390444321155> | Fax 04441492177 >> >> To view the terms under which this email is distributed, please go to:- >> http://leedsbeckett.ac.uk/disclaimer/email/ > -- > -- > Shellrent - Il primo hosting italiano Security First > > *Tommaso De Marchi* > /COO - Chief Operating Officer/ > Shellrent Srl > Via dell'Edilizia, 19 - 36100 Vicenza > Tel. 0444321155 <tel:+390444321155> | Fax 04441492177 > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ -- -- Shellrent - Il primo hosting italiano Security First *Tommaso De Marchi* /COO - Chief Operating Officer/ Shellrent Srl Via dell'Edilizia, 19 - 36100 Vicenza Tel. 0444321155 <tel:+390444321155> | Fax 04441492177

2 2

How to install Ovirt Node without ISO
by raphael.garcia＠centralesupelec.fr 01 Apr '20

01 Apr '20

Hello Is it possible to install an Ovirt node on a CentOs 7 server without iso (CD or USB). Sorry for this newbie question.

5 5

Re: Local network
by Tommaso - Shellrent 31 Mar '20

31 Mar '20

Hi. on engine all seems fine. on host the command "ovn-sbctl show" is stuck, and with a strace a se the following error: connect(5, {sa_family=AF_LOCAL, sun_path="/var/run/openvswitch/ovnsb_db.sock"}, 37) = -1 ENOENT (No such file or directory) Il 31/03/20 11:18, Staniforth, Paul ha scritto: > > .Hello Tommaso, > on your oVirt engine host run > check the north bridge controller > ovn-nbctl show > this should show a software switch for each ovn logical network witch > any ports that are active( in your case you should have 2) > > check the south bridge controller > ovn-sbctl show > this should show the software switch on each host with a geneve tunnel. > > on each host run > ovs-vsctl show > this should show the virtual switch with a geneve tunnel to each other > host and a port for any active vnics > > Regards, > Paul S. > > ------------------------------------------------------------------------ > *From:* Tommaso - Shellrent <tommaso(a)shellrent.com> > *Sent:* 31 March 2020 09:27 > *To:* users(a)ovirt.org <users(a)ovirt.org> > *Subject:* [ovirt-users] Local network > > *Caution External Mail:* Do not click any links or open any > attachments unless you trust the sender and know that the content is safe. > > Hi to all. > > I'm trying to connect two vm, on the same "local storage" host, > with an internal isolated network. > > My setup; > > VM A: > > * eth0 with an external ip > * eth1, with 1922.168.1.1/24 > > VM B > > * eth0 with an external ip > * eth1, with 1922.168.1.2/24 > > the eth1 interfaces are connetter by a network created on external > provider ovirt-network-ovn , whithout a subnet defined. > > Now, the external ip works fine, but the two vm cannot connect through > the local network > > ping: ko > arping: ko > > > any idea to what to check? > > > Regards > > -- > -- > Shellrent - Il primo hosting italiano Security First > > *Tommaso De Marchi* > /COO - Chief Operating Officer/ > Shellrent Srl > Via dell'Edilizia, 19 - 36100 Vicenza > Tel. 0444321155 <tel:+390444321155> | Fax 04441492177 > > To view the terms under which this email is distributed, please go to:- > http://leedsbeckett.ac.uk/disclaimer/email/ -- -- Shellrent - Il primo hosting italiano Security First *Tommaso De Marchi* /COO - Chief Operating Officer/ Shellrent Srl Via dell'Edilizia, 19 - 36100 Vicenza Tel. 0444321155 <tel:+390444321155> | Fax 04441492177

2 1

Local network
by Tommaso - Shellrent 31 Mar '20

31 Mar '20

Hi to all. I'm trying to connect two vm, on the same "local storage" host, with an internal isolated network. My setup; VM A: * eth0 with an external ip * eth1, with 1922.168.1.1/24 VM B * eth0 with an external ip * eth1, with 1922.168.1.2/24 the eth1 interfaces are connetter by a network created on external provider ovirt-network-ovn , whithout a subnet defined. Now, the external ip works fine, but the two vm cannot connect through the local network ping: ko arping: ko any idea to what to check? Regards -- -- Shellrent - Il primo hosting italiano Security First *Tommaso De Marchi* /COO - Chief Operating Officer/ Shellrent Srl Via dell'Edilizia, 19 - 36100 Vicenza Tel. 0444321155 <tel:+390444321155> | Fax 04441492177

2 1

New HCI with gluster
by Ovirt User 30 Mar '20

30 Mar '20

I am performing a new install of 3 nodes ovnode1 - 3 disks,install on first two disks ovnode2 - 3 disks,install on first two disks ovnode3 - 3 disks,install on first two disks Storage network interfaces are configured with 192.168.xxx.10 no gateways configured for this network Data network interfaces are configured with 10.3.x.10 When i run the wizard it always fails. All 3 hosts are running the latest stable (4.3.9). I have attached the log files from the runs on these hosts

2 1

ovirt-guest-agent for CentOS 8
by Eduardo Mayoral 30 Mar '20

30 Mar '20

Hi, Just like many of you I am testing my first CentOS 8 VMs on top of ovirt. I am not finding the package ovirt-guest-agent.noarch . Closest I can find is qemu-guest-agent.x86_64 After installing and starting it, I do see information reported on the "Guest info" tab. Can anybody confirm if this is indeed the agent we should be using? Is there - or will there be - a more specific package for ovirt guests? Thanks! -- Eduardo Mayoral Jimeno Systems engineer, platform department. Arsys Internet. emayoral(a)arsys.es - +34 941 620 105 - ext 2153

6 7

install oVirt on Fedora31
by eldaeron＠mail.ru 30 Mar '20

30 Mar '20

Hello! Tell me, can I install oVirt on Fedora 31? I try to install "http://resources.ovirt.org/pub/yum-repo/ovirt-release42.rpm" but only "ovirt-4.2.repo" appears in "yum.repos.d". "ovirt-4.2-dependencies.repo" is missing. ok, I installed ovirt-release42.rpm on a virtual machine with centos7 and downloaded both files from it. but when I try to run "yum install ovirt-hosted-engine-setup" I get "Error: Failed to download metadata for repo 'ovirt-4.2': Cannot prepare internal mirrorlist: No URLs in mirrorlist" and "No match for argument: ovirt -hosted-engine-setup " sorry for my english, this is a translator :)

2 1

Debian guest Agent
by eevans＠digitaldatatechs.com 30 Mar '20

30 Mar '20

I am revisiting this as I have had no luck getting it resolved. I have 2 Debian servers, one is an email appliance and one is a virtual pbx. The guest agent works in the email appliance after following an article to get the agent to work properly, but the agent in the pbx has never worked. I have an exclamation point saying the guest agent needs to be installed. It is installed and running. I'm not sure why the agent is not checking in but any help would be appreciated. Thanks.

3 4

The problem with the launch and migration of VMs to other hosts in the cluster
by vad0s＠rambler.ru 30 Mar '20

30 Mar '20

2 1

HCI cluster single node error making template
by Gianluca Cecchi 30 Mar '20

30 Mar '20

Hello, I'm on 4.3.9 I have created a VM with 4vcpu, 16gb mem and a nic and a thin provisioned disk of 120Gb Installed nothing on it, only defined. Now I'm trying to make template from it but I get error. I leave the prefille value of raw for format Target storage domain has 900 Gb free, almost empty In events pane: Creation of Template ocp_node from VM ocp_node_template was initiated by admin@internal-authz. 3/25/20 12:42:35 PM Then I get error in events pane is: VDSM ovirt.example.local command HSMGetAllTasksStatusesVDS failed: low level Image copy failed: ("Command ['/usr/bin/qemu-img', 'convert', '-p', '-t', 'none', '-T', 'none', '-f', 'raw', u'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/61689cb2-fdce-41a5-a6d9-7d06aefeb636/30009efb-83ed-4b0d-b243-3160195ae46e', '-O', 'qcow2', '-o', 'compat=1.1', u'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/5642b52f-d7e8-48a8-adf9-f79022ce4594/982dd5cc-5f8f-41cb-b2e7-3cbdf2a656cf'] failed with rc=1 out='' err=bytearray(b'qemu-img: error while reading sector 18620412: No such file or directory\\n')",) 3/25/20 12:43:39 PM Is there a problem templating a thin provisioned disk in gluster? In vdsm.log 2020-03-25 12:42:40,331+0100 ERROR (tasks/9) [storage.Image] conversion failure for volume 30009efb-83ed-4b0d-b243-3160195ae46e (image:836) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/image.py", line 831, in copyCollapsed self._run_qemuimg_operation(operation) File "/usr/lib/python2.7/site-packages/vdsm/storage/image.py", line 98, in _run_qemuimg_operation operation.run() File "/usr/lib/python2.7/site-packages/vdsm/storage/qemuimg.py", line 343, in run for data in self._operation.watch(): File "/usr/lib/python2.7/site-packages/vdsm/storage/operation.py", line 106, in watch self._finalize(b"", err) File "/usr/lib/python2.7/site-packages/vdsm/storage/operation.py", line 179, in _finalize raise cmdutils.Error(self._cmd, rc, out, err) Error: Command ['/usr/bin/qemu-img', 'convert', '-p', '-t', 'none', '-T', 'none', '-f', 'raw', u'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/61689cb2-fdce-41a5-a6d9-7d06aefeb636/30009efb-83ed-4b0d-b243-3160195ae46e', '-O', 'raw', u'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/bb167b28-94fa-434c-8fb6-c4bedfc06c62/53d3ab96-e5d1-453a-9989-2f858e6a9e0a'] failed with rc=1 out='' err=bytearray(b'qemu-img: error while reading sector 22028283: No data available\n') 2020-03-25 12:42:40,331+0100 ERROR (tasks/9) [storage.Image] Unexpected error (image:849) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/image.py", line 837, in copyCollapsed raise se.CopyImageError(str(e)) CopyImageError: low level Image copy failed: ("Command ['/usr/bin/qemu-img', 'convert', '-p', '-t', 'none', '-T', 'none', '-f', 'raw', u'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/61689cb2-fdce-41a5-a6d9-7d06aefeb636/30009efb-83ed-4b0d-b243-3160195ae46e', '-O', 'raw', u'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/bb167b28-94fa-434c-8fb6-c4bedfc06c62/53d3ab96-e5d1-453a-9989-2f858e6a9e0a'] failed with rc=1 out='' err=bytearray(b'qemu-img: error while reading sector 22028283: No data available\\n')",) 2020-03-25 12:42:40,332+0100 ERROR (tasks/9) [storage.TaskManager.Task] (Task='48476954-310f-45b6-9e1b-921d94e5495b') Unexpected error (task:875) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in _run return fn(*args, **kargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 336, in run return self.cmd(*self.argslist, **self.argsdict) File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 79, in wrapper return method(self, *args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/sp.py", line 1633, in copyImage postZero, force, discard) File "/usr/lib/python2.7/site-packages/vdsm/storage/image.py", line 837, in copyCollapsed raise se.CopyImageError(str(e)) CopyImageError: low level Image copy failed: ("Command ['/usr/bin/qemu-img', 'convert', '-p', '-t', 'none', '-T', 'none', '-f', 'raw', u'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/61689cb2-fdce-41a5-a6d9-7d06aefeb636/30009efb-83ed-4b0d-b243-3160195ae46e', '-O', 'raw', u'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/bb167b28-94fa-434c-8fb6-c4bedfc06c62/53d3ab96-e5d1-453a-9989-2f858e6a9e0a'] failed with rc=1 out='' err=bytearray(b'qemu-img: error while reading sector 22028283: No data available\\n')",) 2020-03-25 12:42:40,384+0100 INFO (tasks/9) [storage.Volume] createVolumeRollback: repoPath=/rhev/data-center/9ce6ed92-6c6c-11ea-a971-00163e0acd5c sdUUID=81b97244-4b69-4d49-84c4-c822387adc6a imgUUID=bb167b28-94fa-434c-8fb6-c4bedfc06c62 volUUID=53d3ab96-e5d1-453a-9989-2f858e6a9e0a imageDir=/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/bb167b28-94fa-434c-8fb6-c4bedfc06c62 (volume:1119) 2020-03-25 12:42:40,387+0100 INFO (tasks/9) [storage.Volume] Request to delete volume 53d3ab96-e5d1-453a-9989-2f858e6a9e0a (fileVolume:555) ... 2020-03-25 12:43:38,161+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call VM.getStats succeede d in 0.00 seconds (__init__:312) 2020-03-25 12:43:39,778+0100 INFO (jsonrpc/4) [vdsm.api] START getAllTasksStatuses(spUUID=None, opt ions=None) from=::ffff:172.16.0.31,40506, task_id=1ec1f913-641c-44c4-8eb6-06a398af7b0c (api:48) 2020-03-25 12:43:39,778+0100 INFO (jsonrpc/4) [vdsm.api] FINISH getAllTasksStatuses return={'allTas ksStatus': {'013f3fc3-d9e8-4acd-8e95-aef4001255a1': {'code': 261, 'message': 'low level Image copy f ailed: ("Command [\'/usr/bin/qemu-img\', \'convert\', \'-p\', \'-t\', \'none\', \'-T\', \'none\', \' -f\', \'raw\', u\'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d4 9-84c4-c822387adc6a/images/61689cb2-fdce-41a5-a6d9-7d06aefeb636/30009efb-83ed-4b0d-b243-3160195ae46e \', \'-O\', \'qcow2\', \'-o\', \'compat=1.1\', u\'/rhev/data-center/mnt/glusterSD/ovirtst.example.st orage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/5642b52f-d7e8-48a8-adf9-f79022ce4594/982d d5cc-5f8f-41cb-b2e7-3cbdf2a656cf\'] failed with rc=1 out=\'\' err=bytearray(b\'qemu-img: error while reading sector 18620412: No such file or directory\\\\n\')",)', 'taskState': 'finished', 'taskResul t': 'cleanSuccess', 'taskID': '013f3fc3-d9e8-4acd-8e95-aef4001255a1'}, '48476954-310f-45b6-9e1b-921d 94e5495b': {'code': 261, 'message': 'low level Image copy failed: ("Command [\'/usr/bin/qemu-img\', \'convert\', \'-p\', \'-t\', \'none\', \'-T\', \'none\', \'-f\', \'raw\', u\'/rhev/data-center/mnt/g lusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/61689cb2-fdce- 41a5-a6d9-7d06aefeb636/30009efb-83ed-4b0d-b243-3160195ae46e\', \'-O\', \'raw\', u\'/rhev/data-center /mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/bb167b28-94fa-434c-8fb6-c4bedfc06c62/53d3ab96-e5d1-453a-9989-2f858e6a9e0a\'] failed with rc=1 out=\'\' err=bytearray(b\'qemu-img: error while reading sector 22028283: No data available\\\\n\')",)', 'taskState': 'finished', 'taskResult': 'cleanSuccess', 'taskID': '48476954-310f-45b6-9e1b-921d94e5495b'}}} from=::ffff:172.16.0.31,40506, task_id=1ec1f913-641c-44c4-8eb6-06a398af7b0c (api:54) 2020-03-25 12:43:39,778+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:312) 2020-03-25 12:43:39,851+0100 INFO (jsonrpc/0) [vdsm.api] START deleteImage(sdUUID=u'81b97244-4b69-4d49-84c4-c822387adc6a', spUUID=u'9ce6ed92-6c6c-11ea-a971-00163e0acd5c', imgUUID=u'bb167b28-94fa-434c-8fb6-c4bedfc06c62', postZero=u'false', force=u'false', discard=False) from=::ffff:172.16.0.31,40512, flow_id=3540fed2, task_id=5f048634-f07f-4643-8aeb-88a6c562f038 (api:48) 2020-03-25 12:43:39,856+0100 ERROR (jsonrpc/0) [storage.HSM] Empty or not found image bb167b28-94fa-434c-8fb6-c4bedfc06c62 in SD 81b97244-4b69-4d49-84c4-c822387adc6a. {u'2f48ba54-11a5-4fc3-a8da-eba41c345c0e': ImgsPar(imgs=(u'55d7c95e-8f54-41c8-8422-3daac542a917',), parent=None), u'54c43445-7066-423f-9c07-2082d1442c78': ImgsPar(imgs=(u'08238512-aa7a-4ebb-82e4-6831e8805516',), parent=None), u'30009efb-83ed-4b0d-b243-3160195ae46e': ImgsPar(imgs=(u'61689cb2-fdce-41a5-a6d9-7d06aefeb636',), parent=None)} (hsm:1507) 2020-03-25 12:43:39,856+0100 INFO (jsonrpc/0) [vdsm.api] FINISH deleteImage error=Image does not exist in domain: u'image=bb167b28-94fa-434c-8fb6-c4bedfc06c62, domain=81b97244-4b69-4d49-84c4-c822387adc6a' from=::ffff:172.16.0.31,40512, flow_id=3540fed2, task_id=5f048634-f07f-4643-8aeb-88a6c562f038 (api:52) 2020-03-25 12:43:39,856+0100 ERROR (jsonrpc/0) [storage.TaskManager.Task] (Task='5f048634-f07f-4643-8aeb-88a6c562f038') Unexpected error (task:875) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in _run return fn(*args, **kargs) File "<string>", line 2, in deleteImage File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 50, in method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 1508, in deleteImage raise se.ImageDoesNotExistInSD(imgUUID, sdUUID) ImageDoesNotExistInSD: Image does not exist in domain: u'image=bb167b28-94fa-434c-8fb6-c4bedfc06c62, domain=81b97244-4b69-4d49-84c4-c822387adc6a' 2020-03-25 12:43:39,856+0100 INFO (jsonrpc/0) [storage.TaskManager.Task] (Task='5f048634-f07f-4643-8aeb-88a6c562f038') aborting: Task is aborted: "Image does not exist in domain: u'image=bb167b28-94fa-434c-8fb6-c4bedfc06c62, domain=81b97244-4b69-4d49-84c4-c822387adc6a'" - code 268 (task:1181) 2020-03-25 12:43:39,857+0100 ERROR (jsonrpc/0) [storage.Dispatcher] FINISH deleteImage error=Image does not exist in domain: u'image=bb167b28-94fa-434c-8fb6-c4bedfc06c62, domain=81b97244-4b69-4d49-84c4-c822387adc6a' (dispatcher:83) engine.log 2020-03-25 12:43:39,778+01 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFac tory-engineScheduled-Thread-35) [] Task id '48476954-310f-45b6-9e1b-921d94e5495b' has passed pre-pol ling period time and should be polled. Pre-polling period is 60000 millis. 2020-03-25 12:43:39,778+01 INFO [org.ovirt.engine.core.bll.tasks.AsyncTaskManager] (EE-ManagedThrea dFactory-engineScheduled-Thread-35) [] Polling and updating Async Tasks: 2 tasks, 1 tasks to poll no w 2020-03-25 12:43:39,778+01 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFac tory-engineScheduled-Thread-35) [] Task id '48476954-310f-45b6-9e1b-921d94e5495b' has passed pre-pol ling period time and should be polled. Pre-polling period is 60000 millis. 2020-03-25 12:43:39,781+01 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-35) [] Failed in 'HSMGetAllTasksStatusesVDS' method 2020-03-25 12:43:39,784+01 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-35) [] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10,802), VDSM ovirt.example.com command HSMGetAllTasksStatusesVDS failed: low level Image copy failed: ("Command ['/usr/bin/qemu-img', 'convert', '-p', '-t', 'none', '-T', 'none', '-f', 'raw', u'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/61689cb2-fdce-41a5-a6d9-7d06aefeb636/30009efb-83ed-4b0d-b243-3160195ae46e', '-O', 'qcow2', '-o', 'compat=1.1', u'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/5642b52f-d7e8-48a8-adf9-f79022ce4594/982dd5cc-5f8f-41cb-b2e7-3cbdf2a656cf'] failed with rc=1 out='' err=bytearray(b'qemu-img: error while reading sector 18620412: No such file or directory\\n')",) 2020-03-25 12:43:39,784+01 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-35) [] Failed in 'HSMGetAllTasksStatusesVDS' method 2020-03-25 12:43:39,785+01 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-35) [] Task id '48476954-310f-45b6-9e1b-921d94e5495b' has passed pre-polling period time and should be polled. Pre-polling period is 60000 millis. 2020-03-25 12:43:39,785+01 INFO [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-35) [] SPMAsyncTask::PollTask: Polling task '48476954-310f-45b6-9e1b-921d94e5495b' (Parent Command 'CreateAllTemplateDisks', Parameters Type 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters') returned status 'finished', result 'cleanSuccess'. 2020-03-25 12:43:39,787+01 ERROR [org.ovirt.engine.core.bll.tasks.SPMAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-35) [] BaseAsyncTask::logEndTaskFailure: Task '48476954-310f-45b6-9e1b-921d94e5495b' (Parent Command 'CreateAllTemplateDisks', Parameters Type 'org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters') ended with failure: -- Result: 'cleanSuccess' -- Message: 'VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = low level Image copy failed: ("Command ['/usr/bin/qemu-img', 'convert', '-p', '-t', 'none', '-T', 'none', '-f', 'raw', u'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/61689cb2-fdce-41a5-a6d9-7d06aefeb636/30009efb-83ed-4b0d-b243-3160195ae46e', '-O', 'raw', u'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/bb167b28-94fa-434c-8fb6-c4bedfc06c62/53d3ab96-e5d1-453a-9989-2f858e6a9e0a'] failed with rc=1 out='' err=bytearray(b'qemu-img: error while reading sector 22028283: No data a vailable\\n')",), code = 261', -- Exception: 'VDSGenericException: VDSErrorException: Failed to HSMGetAllTasksStatusesVDS, error = low level Image copy failed: ("Command ['/usr/bin/qemu-img', 'convert', '-p', '-t', 'none', '-T', 'none', '-f', 'raw', u'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/61689cb2-fdce-41a5-a6d9-7d06aefeb636/30009efb-83ed-4b0d-b243-3160195ae46e', '-O', 'raw', u'/rhev/data-center/mnt/glusterSD/ovirtst.example.storage:_vmstore/81b97244-4b69-4d49-84c4-c822387adc6a/images/bb167b28-94fa-434c-8fb6-c4bedfc06c62/53d3ab96-e5d1-453a-9989-2f858e6a9e0a'] failed with rc=1 out='' err=bytearray(b'qemu-img: error while reading sector 22028283: No data available\\n')",), code = 261' 2020-03-25 12:43:39,793+01 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-35) [] CommandAsyncTask::endActionIfNecessary: All tasks of command '76c06966-36b5-4e06-9426-f3187c5a07b9' has ended -> executing 'endAction' 2020-03-25 12:43:39,793+01 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (EE-ManagedThreadFactory-engineScheduled-Thread-35) [] CommandAsyncTask::endAction: Ending action for '1' tasks (command ID: '76c06966-36b5-4e06-9426-f3187c5a07b9'): calling endAction '. 2020-03-25 12:43:39,793+01 INFO [org.ovirt.engine.core.bll.tasks.CommandAsyncTask] (EE-ManagedThreadFactory-engine-Thread-9168) [] CommandAsyncTask::endCommandAction [within thread] context: Attempting to endAction 'CreateAllTemplateDisks', 2020-03-25 12:43:39,805+01 ERROR [org.ovirt.engine.core.bll.storage.disk.CreateAllTemplateDisksCommand] (EE-ManagedThreadFactory-engine-Thread-9168) [76349650-8bc6-4769-a011-49d4c2324052] Ending command 'org.ovirt.engine.core.bll.storage.disk.CreateAllTemplateDisksCommand' with failure. 2020-03-25 12:43:39,810+01 ERROR [org.ovirt.engine.core.bll.storage.disk.image.CreateImageTemplateCommand] (EE-ManagedThreadFactory-engine-Thread-9168) [76349650-8bc6-4769-a011-49d4c2324052] Ending command 'org.ovirt.engine.core.bll.storage.disk.image.CreateImageTemplateCommand' with failure. ... Thanks, Gianluca

3 2

How to debug a failed Run Once launch
by Shareef Jalloq 30 Mar '20

30 Mar '20

Hi, I'm trying to create a Windows Server 2019 VM and having found the virtio-win package that needed to be installed am facing the next hurdle. I've followed the documentation and I'm using the Run Once option with the following boot options: Attach Floppy: virtio-win_servers_amd64.vfd Attach CD: Win 2029 ISO CD-ROM at top of Predefined Boot Sequence Clicking OK starts the VM but it immediately fails with a Failed Launching pop up. How do I go about debugging this? Shareef.

2 8

"engine-setup" 4.3.9 on fresh centos 7 install with PKI error
by edsonrichter＠hotmail.com 30 Mar '20

30 Mar '20

I'm newbie on oVirt - besides having many years on server administration, docker and vmware included. Installation is no mistery, but I'm stuck with error described below. I've just installed a new machine with Centos 7 with all updates: [root@mgmt ~]# uname -a Linux mgmt.simfrete.com 3.10.0-1062.12.1.el7.x86_64 #1 SMP Tue Feb 4 23:02:59 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux [root@mgmt ~]# cat /etc/redhat-release CentOS Linux release 7.7.1908 (Core) I've installed the repository: [root@mgmt ~]# sudo yum install https://resources.ovirt.org/pub/yum-repo/ovirt-release43.rpm -y and then the ovirt-engine: [root@mgmt ~]# yum install ovirt-engine -y Then, run the engine-setup with all defaults (exception fqdn = "mgmt.mydomain.com"). Everything runs smoothly, exception with I open the mamagement interface at "https://mgmt.mydomain.com/ovirt-engine" I get the error: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target In the log, I get 2020-03-23 02:20:23,883-03 ERROR [org.ovirt.engine.core.aaa.servlet.SsoPostLoginServlet] (default task-8) [] server_error: sun.security.validator.ValidatorException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target I don't know how to proceed from here. Would you please guide me how to fix this?

7 12

Error installing single hyperconverged host using CentOS7
by wodel youchi 29 Mar '20

29 Mar '20

Hi, I am using the latest version of oVirt 4.3.9 I am using nested KVM for a LAB. the CentOS is updated with the latest packages available. The goal of my LAB is to test DR on hypervonerged environment, Why using a CentOS host rather than the oVirt-node, because of the my Internet connection, which is not great, I find simple to just update the new packages on the host rather than update all of the host's image. I installed a CentOS host using the basic profile, then I added the oVirt repository and then installed the needed packages, and by the way the oVirt documentation on hyperconverged setup doesn't mention gluster-ansible-roles as a prerequisite. The Gluster phase is done correctly, but the deployment of the VM Engine fails every time at the same task : TASK [ovirt.hosted_engine_setup : Get local VM IP I repeated the deployment three times and I get the same result. Then I tested with ovirt-node and it worked fine. You can find the logs of my last attempt attached. Regards.

1 0

cannot manually migrate vm's
by eevans＠digitaldatatechs.com 29 Mar '20

29 Mar '20

I upgraded from 4.3.8 to 4.3.9. Before the migration, I could manually migrate vm's and also it would automatically load balance the hosts. Now I cannot manually migrate and I have one server with no vm's and 2 with several. If I put a host into maintenance mode, it will migrate the vm's off to other hosts, but before I noticed it would move vm's around to load balance and now it does not. Not sure if this is a bug or not. How it happens: When I right click on a vm and click migrate, the migrate screen flashes on screen then disappears. Same behavior if I highlight the vm and click the migrate button at the top of the vm screen. It's not critical, but something that needs corrected. Any help or advice is very much appreciated. Thanks.

3 19

Cinderlib db not contained in engine-backup
by Thomas Klute 29 Mar '20

29 Mar '20

Dear oVirt users, I just noticed that the ovirt_cinderlib database does not seem to be contained in the archive file created by engine-backup. Is it missing there? Or is there any other way to restore the data of the ovirt_cinderlib database in case a restore the engine-backup would be required? Best regards, Thomas

2 1

Re: vm console problem
by David David 29 Mar '20

29 Mar '20

I did as you said: copied from engine /etc/ovirt-engine/ca.pem onto my desktop into /etc/pki/ca-trust/source/anchors and then run update-ca-trust it didn’t help, still the same errors вс, 29 мар. 2020 г. в 10:47, David David <dd432690(a)gmail.com>: > I did as you said: > copied from engine /etc/ovirt-engine/ca.pem onto my desktop into > /etc/pki/ca-trust/source/anchors and then run update-ca-trust > it didn’t help, still the same errors > > > пт, 27 мар. 2020 г. в 21:56, Strahil Nikolov <hunter86_bg(a)yahoo.com>: > >> On March 27, 2020 12:23:10 PM GMT+02:00, David David <dd432690(a)gmail.com> >> wrote: >> >here is debug from opening console.vv by remote-viewer >> > >> >2020-03-27 14:09 GMT+04:00, Milan Zamazal <mzamazal(a)redhat.com>: >> >> David David <dd432690(a)gmail.com> writes: >> >> >> >>> yes i have >> >>> console.vv attached >> >> >> >> It looks the same as mine. >> >> >> >> There is a difference in our logs, you have >> >> >> >> Possible auth 19 >> >> >> >> while I have >> >> >> >> Possible auth 2 >> >> >> >> So I still suspect a wrong authentication method is used, but I don't >> >> have any idea why. >> >> >> >> Regards, >> >> Milan >> >> >> >>> 2020-03-26 21:38 GMT+04:00, Milan Zamazal <mzamazal(a)redhat.com>: >> >>>> David David <dd432690(a)gmail.com> writes: >> >>>> >> >>>>> copied from qemu server all certs except "cacrl" to my >> >desktop-station >> >>>>> into /etc/pki/ >> >>>> >> >>>> This is not needed, the CA certificate is included in console.vv >> >and no >> >>>> other certificate should be needed. >> >>>> >> >>>>> but remote-viewer is still didn't work >> >>>> >> >>>> The log looks like remote-viewer is attempting certificate >> >>>> authentication rather than password authentication. Do you have >> >>>> password in console.vv? It should look like: >> >>>> >> >>>> [virt-viewer] >> >>>> type=vnc >> >>>> host=192.168.122.2 >> >>>> port=5900 >> >>>> password=fxLazJu6BUmL >> >>>> # Password is valid for 120 seconds. >> >>>> ... >> >>>> >> >>>> Regards, >> >>>> Milan >> >>>> >> >>>>> 2020-03-26 2:22 GMT+04:00, Nir Soffer <nsoffer(a)redhat.com>: >> >>>>>> On Wed, Mar 25, 2020 at 12:45 PM David David <dd432690(a)gmail.com> >> >>>>>> wrote: >> >>>>>>> >> >>>>>>> ovirt 4.3.8.2-1.el7 >> >>>>>>> gtk-vnc2-1.0.0-1.fc31.x86_64 >> >>>>>>> remote-viewer version 8.0-3.fc31 >> >>>>>>> >> >>>>>>> can't open vm console by remote-viewer >> >>>>>>> vm has vnc console protocol >> >>>>>>> when click on console button to connect to a vm, the >> >remote-viewer >> >>>>>>> console disappear immediately >> >>>>>>> >> >>>>>>> remote-viewer debug in attachment >> >>>>>> >> >>>>>> You an issue with the certificates: >> >>>>>> >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.238: >> >>>>>> ../src/vncconnection.c Set credential 2 libvirt >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.239: >> >>>>>> ../src/vncconnection.c Searching for certs in /etc/pki >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.239: >> >>>>>> ../src/vncconnection.c Searching for certs in /root/.pki >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.239: >> >>>>>> ../src/vncconnection.c Failed to find certificate CA/cacert.pem >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.239: >> >>>>>> ../src/vncconnection.c No CA certificate provided, using GNUTLS >> >global >> >>>>>> trust >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.239: >> >>>>>> ../src/vncconnection.c Failed to find certificate CA/cacrl.pem >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.239: >> >>>>>> ../src/vncconnection.c Failed to find certificate >> >>>>>> libvirt/private/clientkey.pem >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.239: >> >>>>>> ../src/vncconnection.c Failed to find certificate >> >>>>>> libvirt/clientcert.pem >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.239: >> >>>>>> ../src/vncconnection.c Waiting for missing credentials >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.239: >> >>>>>> ../src/vncconnection.c Got all credentials >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.239: >> >>>>>> ../src/vncconnection.c No CA certificate provided; trying the >> >system >> >>>>>> trust store instead >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.240: >> >>>>>> ../src/vncconnection.c Using the system trust store and CRL >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.240: >> >>>>>> ../src/vncconnection.c No client cert or key provided >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.240: >> >>>>>> ../src/vncconnection.c No CA revocation list provided >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.241: >> >>>>>> ../src/vncconnection.c Handshake was blocking >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.243: >> >>>>>> ../src/vncconnection.c Handshake was blocking >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.251: >> >>>>>> ../src/vncconnection.c Handshake was blocking >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.298: >> >>>>>> ../src/vncconnection.c Handshake done >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.298: >> >>>>>> ../src/vncconnection.c Validating >> >>>>>> (remote-viewer:2721): gtk-vnc-DEBUG: 11:56:25.301: >> >>>>>> ../src/vncconnection.c Error: The certificate is not trusted >> >>>>>> >> >>>>>> Adding people that may know more about this. >> >>>>>> >> >>>>>> Nir >> >>>>>> >> >>>>>> >> >>>> >> >>>> >> >> >> >> >> >> Hello, >> >> You can try to take the engine's CA (maybe it's useless) and put it on >> your system in: >> /etc/pki/ca-trust/source/anchors (if it's EL7 or a Fedora) and then run >> update-ca-trust >> >> Best Regards, >> Strahil Nikolov >> >

1 0

Import storage domain with different storage type?
by Rik Theys 28 Mar '20

28 Mar '20

Hi, We have an oVirt environment with a FC storage domain. Multiple LUNs on a SAN are exported to the oVirt nodes and combined in a single FC storage domain. The SAN replicates the disks to another storage box that has iSCSI connectivity. Is it possible to - in case of disaster - import the existing, replicated, storage domain as an iSCSI domain and import/run the VM's from that domain? Or is import of a storage domain only possible if they are the same type? Does it also work if multiple LUNs are needed to form the storage domain? Are there any special actions that should be performed beyond the regular import action? Regards, Rik -- Rik Theys System Engineer KU Leuven - Dept. Elektrotechniek (ESAT) Kasteelpark Arenberg 10 bus 2440 - B-3001 Leuven-Heverlee +32(0)16/32.11.07 ---------------------------------------------------------------- <<Any errors in spelling, tact or fact are transmission errors>>

3 2

Doubts related to single HCI and storage network
by Gianluca Cecchi 28 Mar '20

28 Mar '20

Hello, I deployed HCI 4.3.9 with gluster and single node from the cockpit based interface. During install I specified the storage network, using 1) For the mgmt network and hostname of the hypervisor 172.16.0.30 ovirt.mydomain 2) for the storage network (even if not used in single host... but in case of future addition..) 10.50.50.11 ovirtst.mydomain.storage all went good. And system runs quite ok: I was able to deploy an OCP 4.3.8 cluster with 3 workers and 3 masters... a part from erratic "vm paused" messages for which I'm going to send a dedicated mail... I see in engine.log warning messages of this kind: 2020-03-27 00:32:08,655+01 WARN [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn] (DefaultQuartzScheduler2) [15cbd52e] Could not associate brick 'ovirtst.mydomain.storage:/gluster_bricks/engine/engine' of volume '40ad3b5b-4cc1-495a-815b-3c7e3436b15b' with correct network as no gluster network found in cluster '9cecfa02-6c6c-11ea-8a94-00163e0acd5c' I would have expected the setup to create a gluster network as it was part of the initial configuration.... could this be a subject for an RFE? What can I do to fix this warning? Thanks, Gianluca

3 6

vm console problem
by David David 27 Mar '20

27 Mar '20

ovirt 4.3.8.2-1.el7 gtk-vnc2-1.0.0-1.fc31.x86_64 remote-viewer version 8.0-3.fc31 can't open vm console by remote-viewer vm has vnc console protocol when click on console button to connect to a vm, the remote-viewer console disappear immediately remote-viewer debug in attachment

4 7

Speed Issues
by Christian Reiss 27 Mar '20

27 Mar '20

Hey folks, gluster related question. Having SSD in a RAID that can do 2 GB writes and Reads (actually above, but meh) in a 3-way HCI cluster connected with 10gbit connection things are pretty slow inside gluster. I have these settings: Options Reconfigured: cluster.server-quorum-type: server cluster.quorum-type: auto cluster.shd-max-threads: 8 features.shard: on features.shard-block-size: 64MB server.event-threads: 8 user.cifs: off cluster.shd-wait-qlength: 10000 cluster.locking-scheme: granular cluster.eager-lock: enable performance.low-prio-threads: 32 network.ping-timeout: 30 cluster.granular-entry-heal: enable storage.owner-gid: 36 storage.owner-uid: 36 cluster.choose-local: true client.event-threads: 16 performance.strict-o-direct: on network.remote-dio: enable performance.client-io-threads: on nfs.disable: on storage.fips-mode-rchecksum: on transport.address-family: inet cluster.readdir-optimize: on cluster.metadata-self-heal: on cluster.data-self-heal: on cluster.entry-self-heal: on cluster.data-self-heal-algorithm: full features.uss: enable features.show-snapshot-directory: on features.barrier: disable auto-delete: enable snap-activate-on-create: enable Writing inside the /gluster_bricks yields those 2GB/sec writes, Reading the same. Reading inside the /rhev/data-center/mnt/glusterSD/ dir reads go down to 366mb/sec while writes plummet to to 200mb/sec. Summed up: Writing into the SSD Raid in the lvm/xfs gluster brick directory is fast, writing into the mounted gluster dir is horribly slow. The above can be seen and repeated on all 3 servers. The network can do full 10gbit (tested with, among others: rsync, iperf3). Anyone with some idea on whats missing/ going on here? Thanks folks, as always stay safe and healthy! -- with kind regards, mit freundlichen Gruessen, Christian Reiss

7 20

bare-metal to self-hosted engine
by kim.kargaard＠noroff.no 27 Mar '20

27 Mar '20

Hi, We currently have an ovirt engine running on a server. The server has CentOS installed and the ovirt-engine installed, but is not a node that hosts VM's. I would like to move the ovirt-engine to a self-hosted engine and it seems like this articles is the one to follow: https://www.ovirt.org/documentation/self-hosted/chap-Migrating_from_Bare_Me… Am I correct that I can migrate from a bare-metal CentOS server engine to a self-hosted VM of the engine and is the documentation above the only documentation I will need to complete this process? Kind regards Kim

3 2

can't run VM
by garcialiang.anne＠gmail.com 27 Mar '20

27 Mar '20

Hi, I created VM on ovirt-engine. But I can't run this VM. The message is : 2020-03-26 21:28:02,745+01 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-147) [] EVENT_ID: USER_FAILED_RUN_VM(54), Failed to run VM VirtMachine due to a failed validation: [Cannot run VM. There is no host that satisfies current scheduling constraints. See below for details:, The host xxxxxxxxx did not satisfy internal filter Network because display network ovirtmgmt was missing.] (User: admin@internal-authz). Could you help me ? Thanks Anne

3 2

Orphaned ISO Storage Domain
by bob.franzke＠mdaemon.com 26 Mar '20

26 Mar '20

Greetings all, Full disclosure, complete OVIRT novice here. I inherited an OVIRT system and had a complete ovirt-engine back in December-January. Because of time and my inexperience with OVIRT, I had to resort to hiring consultants to rebuild my OVIRT engine from backups. That’s a situation I never want to repeat. Anyway, we were able to piece it together and at least get most functionality back. The previous setup had a ISO storage domain called ‘ISO-COLO’ that seems to have been hosted on the engine server itself. The engine hostname is ‘mydesktop’. We restored the engine from backups I had taken of the SQL DB and various support files using the built in OVIRT backup tool. So now when looking into the OVIRT console, I see the storage domain listed. It has a status of ‘inactive’ showing in the list of various storage domains we have setup for this. We tried to ‘activate’ it and it fails activation. The path listed for the domain is mydesktop:/gluster/colo-iso. On the host however there is no mountpoint that equates to that path: [root@mydesktop ~]# df -h Filesystem Size Used Avail Use% Mounted on devtmpfs 47G 0 47G 0% /dev tmpfs 47G 12K 47G 1% /dev/shm tmpfs 47G 131M 47G 1% /run tmpfs 47G 0 47G 0% /sys/fs/cgroup /dev/mapper/centos-root 50G 5.4G 45G 11% / /dev/sda2 1014M 185M 830M 19% /boot /dev/sda1 200M 12M 189M 6% /boot/efi /dev/mapper/centos-home 224G 15G 210G 7% /home tmpfs 9.3G 0 9.3G 0% /run/user/0 The original layout looked like this on the broken engine: [root@mydesktop ~]# df -h Filesystem Size Used Avail Use% Mounted on /dev/mapper/centos_mydesktop-root 50G 27G 20G 58% / devtmpfs 24G 0 24G 0% /dev tmpfs 24G 28K 24G 1% /dev/shm tmpfs 24G 42M 24G 1% /run tmpfs 24G 0 24G 0% /sys/fs/cgroup /dev/mapper/centos_mydesktop-home 25G 45M 24G 1% /home /dev/sdc1 1014M 307M 708M 31% /boot /dev/mapper/centos_mydesktop-gluster 177G 127G 42G 76% /gluster tmpfs 4.7G 0 4.7G 0% /run/user/0 So it seems the orphaned storage domain is just point to a path that does not exist on the new Engine host. Also noticed some of the hosts are trying to aces this storage domain and getting errors: The error message for connection mydesktop:/gluster/colo-iso returned by VDSM was: Problem while trying to mount target 3/17/2010:47:05 AM Failed to connect Host vm-host-colo-2 to the Storage Domains ISO-Colo. 3/17/2010:47:05 AM So it seems hosts are trying to be connected to this storage domain but cannot because its not there. Any of the files from the original path are not available so I am not even sure what we are missing if anything. So what are my options here. Destroy the current ISO domain and recreate it, or somehow provide the correct path on the engine server? Currently the storage space I can use is mounted with /home, which is a different path than the original one. Not sure if anything can be done with the disk layout at this point to correct this on the engine server itself to get the gluster path back. Right now we cannot attach CDs to VMs for booting. No choices show up for use when doing a ‘run once’ on an existing VM so I would like to get this working so I can fix a broken VM that I need to boot off of ISO media. Thanks in advance for any help you can provide.

1 0

oVirt 4.3.9 is now generally available
by Sandro Bonazzola 26 Mar '20

26 Mar '20

The oVirt Project is pleased to announce the general availability of oVirt 4.3.9 as of March 19th, 2020. This update is the ninth in a series of stabilization updates to the 4.3 series. This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 7.7 or later (but < 8) * CentOS Linux (or similar) 7.7 or later (but < 8) This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 7.7 or later (but < 8) * CentOS Linux (or similar) 7.7 or later (but < 8) * oVirt Node 4.3 (available for x86_64 only) See the release notes [1] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available - oVirt Node is already available[2] oVirt Node and Appliance have been updated including: - oVirt 4.3.9: http://www.ovirt.org/release/4.3.9/ - Including fixes for CVE-2019-17195 nimbus-jose-jwt: Uncaught exceptions while parsing a JWT <https://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2019-17195> (removed dependency on nimbus-jose-jwt) - Latest CentOS 7.7 updates including: - CentOS 7.7 Batch#5 (CentOS Errata not yet published) - CEBA-2020:0381 CentOS 7 NetworkManager BugFix Update <https://lists.centos.org/pipermail/centos-announce/2020-February/035627.html> - CEBA-2020:0384 CentOS 7 firewalld BugFix Update <https://lists.centos.org/pipermail/centos-announce/2020-February/035637.html> - CESA-2020:0703 Important CentOS 7 http-parser Security Update <https://lists.centos.org/pipermail/centos-announce/2020-March/035655.html> - CESA-2020:0375 Important CentOS 7 kernel Security Update <https://lists.centos.org/pipermail/centos-announce/2020-February/035620.html> - CEBA-2020:0373 CentOS 7 libguestfs BugFix Update <https://lists.centos.org/pipermail/centos-announce/2020-February/035625.html> - CEBA-2020:0367 CentOS 7 libvirt BugFix Update <https://lists.centos.org/pipermail/centos-announce/2020-February/035626.html> - CEBA-2020:0364 CentOS 7 net-snmp BugFix Update <https://lists.centos.org/pipermail/centos-announce/2020-February/035629.html> - CEBA-2020:0379 CentOS 7 sg3_utils BugFix Update <https://lists.centos.org/pipermail/centos-announce/2020-February/035624.html> - CESA-2020:0540 Important CentOS 7 sudo Security Update <https://lists.centos.org/pipermail/centos-announce/2020-February/035643.html> - CEBA-2020:0369 CentOS 7 systemd BugFix Update <https://lists.centos.org/pipermail/centos-announce/2020-February/035631.html> - CEBA-2020:0386 CentOS 7 postgresql BugFix Update <https://lists.centos.org/pipermail/centos-announce/2020-February/035630.html> - latest CentOS Virt, OpsTools and Storage SIG updates: - Ansible 2.9.6: https://github.com/ansible/ansible/blob/stable-2.9/changelogs/CHANGELOG-v2.… - Glusterfs 6.8: https://docs.gluster.org/en/latest/release-notes/6.8/ - Collectd 5.10.0: https://collectd.org/wiki/index.php/Version_5.10 Given the amount of security fixes provided by this release, upgrade is recommended as soon as practical. Additional Resources: * Read more about the oVirt 4.3.9 release highlights: http://www.ovirt.org/release/4.3.9/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.3.9/ [2] http://resources.ovirt.org/pub/ovirt-4.3/iso/ -- Sandro Bonazzola MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://www.redhat.com/>* <https://www.redhat.com/en/summit?sc_cid=7013a000002D2QxAAK>* *Red Hat respects your work life balance. Therefore there is no need to answer this email out of your office hours.*

2 2