- Users - oVirt List Archives

how fix ovirt-engine-4.2.0 to access engine by https
by du_hongyu＠yeah.net 10 Feb '19

10 Feb '19

Hi, I deloy ovirt-engine-4.2.0, I must access engine by https, but I want to access ovirt-engine by http. How to do fix engine or httpd? can you give me some advise? Regards Hongyu Du

1 0

Not receiving signup confirmation email
by Jonas Lindholm 10 Feb '19

10 Feb '19

Hi. I tried to signup 30 minutes ago with this email address but has still not received the signup confirmation email. /Jonas *********************************************************** CONFIDENTIALITY AND PRIVACY NOTICE: This e-mail and any attachments are for the exclusive and confidential use of the intended recipient and may constitute non-public information. Personal data in this email is governed by our Privacy Policy at http://business.nasdaq.com/privacy-statement unless explicitly excluded from it; please see the section in the policy entitled “Situations Where This Privacy Policy Does Not Apply” for circumstances where different privacy terms govern emailed personal data. If you received this e-mail in error, disclosing, copying, distributing or taking any action in reliance of this e-mail is strictly prohibited and may be unlawful. Instead, please notify us immediately by return e-mail and promptly delete this message and its attachments from your computer system. We do not waive any work product or other applicable legal privilege(s) by the transmission of this message. ***********************************************************

2 1

Upgrade from oVirt engine 3.6 to 4.0 - clean install of OS?
by jaherring＠usa.net 10 Feb '19

10 Feb '19

I have oVirt 3.6 running on CentOS 7 (one engine, two hosts). Upgrading to 4.0 seems to require a fresh, bare install of CentOS7 on the engine machine - is this a correct reading of the upgrade guide? It seems bizarre to me I have to wipe a perfectly fine running CentOS7 machine to do this - that seems so Microsoft. Say it isn't so...

3 3

Hosted Engine VM fails to start after upgrade from 4.2 to 4.3
by dbrandon.johnson＠gmail.com 10 Feb '19

10 Feb '19

I just upgraded an ovirt cluster (hosts and engine) from oVirt 4.2 to 4.3. After I finished upgrading the hosts from 4.2 to 4.3 engine stopped working and now it will not start. Looking at VDSM it is looking for a path that isn't getting mounted by the hosted engine when I try to connect storage and start the VM. VDSM log: https://paste.fedoraproject.org/paste/aOi4aDMMNmDqpD72SdcI0A the path that it is mounting at is: /rhev/data-center/mnt/glusterSD/hyper2-gluster.storage.open-tec.net:_engine and I think it is expecting /rhev/data-center/00000000-0000-0000-0000-000000000000 Any help on this would be appreciated.

4 3

HE doesn't install under nested virtualization
by Hetz Ben Hamo 08 Feb '19

08 Feb '19

I'm to setup an oVirt enviroment using virt-manager on Fedora 29 to record some videos. For that - I'm using nested virtualization. The problem - after it's setting the HE - it goes up and down like crazy (I defined the email setting to get all the messages) until it gives up. enclosed - a gzipped vdsm.log.

6 13

Is it possible to change the IP address of the Self Hosted Engine?
by Vinícius Ferrão 08 Feb '19

08 Feb '19

Hello, I’m aware that changing the DNS name of SHE is not a trivial thing. But what about the IP address? Can I just ssh to the engine, change it and reload the network? Thanks,

1 0

oVirt Cloud Init CentOS not setting password
by Robert Crawford 08 Feb '19

08 Feb '19

So I've checked the "Use CloudInit/Sysprep" and set the root user & password but it doesn't seem to apply. I can't login after setting it and also running "Run Once" as well.

4 7

Can not log to engine manager after creating a clone
by guillaume.pavese＠interact-iv.com 08 Feb '19

08 Feb '19

Hello, Fresh 4.3 Cluster : I imported a 4.2 export domain, copied the vm on the newly provisioned gluster Volume with VDO I then tried to create a clone of a 50GB thin provisionning vm anddisconnected This morning I can not log in Engine Manager even after rebooting hosted-engine : I get this message in UI and logs when I click "Administration Portal" 2019-02-08 09:40:51,706+01 ERROR [org.ovirt.engine.core.aaa.servlet.SsoPostLoginServlet] (default task-1) [] org.apache.commons.lang.SerializationException: org.codehaus.jackson.map.JsonMappingException: Can not deserialize instance of java.util.LinkedHashMap out of START_ARRAY token at [Source: java.io.StringReader@f832283; line: 724, column: 25] (through reference chain: org.ovirt.engine.core.common.action.CloneVmParameters["watchdog"]->org.ovirt.engine.core.common.businessentities.VmWatchdog["specParams"])

1 2

Open_vSwitch no key error after upgrading to 4.2.8
by Jayme 08 Feb '19

08 Feb '19

I upgraded oVirt to 4.2.8 and now I am spammed with the following message in all host syslog. How can I stop/fix this error? ovs-vsctl: ovs|00001|db_ctl_base|ERR|no key "odl_os_hostconfig_hostid" in Open_vSwitch record "." column external_ids

4 4

[ANN] oVirt 4.3.0 is now generally available
by Sandro Bonazzola 08 Feb '19

08 Feb '19

The oVirt Project is excited to announce the general availability of oVirt 4.3.0, as of February 4th, 2019 This release unleashes an altogether more powerful and flexible open source virtualization solution that encompasses over four hundreds individual changes and a wide range of enhancements across the engine, storage, network, user interface, and analytics on top of oVirt 4.2 series. What's new in oVirt 4.3.0? * Q35 chipset, support booting using UEFI and Secure Boot * Skylake-server and AMD EPYC support * New smbus driver in windows guest tools * Improved support for v2v * OVA export / import of Templates * Full support for live migration of High Performance VMs * Microsoft Failover clustering support (SCSI Persistent Reservation) for Direct LUN disks * Hundreds of bug fixes on top of oVirt 4.2 series * New VM portal details page (see a preview here: https://imgur.com/a/ExINpci) * New Cluster upgrade UI * OVN security groups * IPv6 (static host addresses) * Support of Neutron from RDO OpenStack 13 as external network provider * Support of using Skydive from RDO OpenStack 14 as Tech Preview * Support for 3.6 and 4.0 data centers, clusters and hosts were removed * Now using PostgreSQL 10 * New metrics support using rsyslog instead of fluentd This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 7.6 or later * CentOS Linux (or similar) 7.6 or later This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 7.6 or later * CentOS Linux (or similar) 7.6 or later * oVirt Node 4.3 (available for x86_64 only) Experimental tech preview for x86_64 and s390x architectures for Fedora 28 is also included. See the release notes [1] for installation / upgrade instructions and a list of new features and bugs fixed. If you’re managing more than one oVirt instance, OpenShift Origin or RDO we also recommend to try ManageIQ <http://manageiq.org/>. In such case, please ensure to take the qc2 image and not the ova image. Notes: - oVirt Appliance is already available for CentOS 7 and Fedora 28 - oVirt Node NG is already available for CentOS 7 and Fedora 28 [2] - oVirt Windows Guest Tools iso is already available [2] Additional Resources: * Read more about the oVirt 4.3.0 release highlights: http://www.ovirt.org/release/4.3.0/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.3.0/ [2] http://resources.ovirt.org/pub/ovirt-4.3/iso/ -- SANDRO BONAZZOLA MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig>

6 8

Retrieval of iSCSI targets failed.
by cbop.mail＠gmail.com 08 Feb '19

08 Feb '19

Hello! I was just trying to setup my first oVirt Server via Cockpit but it failed when I wanted to connect it to my iSCSI. These are the last lines of my vdsm.log: 2019-02-08 01:34:07,080+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:312) 2019-02-08 01:34:07,096+0100 INFO (jsonrpc/5) [api.host] START getAllVmIoTunePolicies() from=::1,36420 (api:48) 2019-02-08 01:34:07,096+0100 INFO (jsonrpc/5) [api.host] FINISH getAllVmIoTunePolicies return={'status': {'message': 'Done', 'code': 0}, 'io_tune_policies_dict': {'be244416-dc4b-4bee-b451-37c0517f19f7': {'policy': [], 'current_values': []}}} from=: :1,36420 (api:54) 2019-02-08 01:34:07,097+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmIoTunePolicies succeeded in 0.00 seconds (__init__:312) 2019-02-08 01:34:08,149+0100 INFO (jsonrpc/7) [vdsm.api] START discoverSendTargets(con={'ipv6_enabled': u'false', 'connection': u'20.20.20.20', 'password': '', 'port': u'3260', 'user': ''}, options=None) from=::ffff:192.168.122.144,35682, flow_id=6 a17a7b3-1dfa-424c-8978-652d73314daf, task_id=f8be43e7-9085-42bd-b526-c2adb9962cb4 (api:48) 2019-02-08 01:34:08,330+0100 INFO (jsonrpc/7) [vdsm.api] FINISH discoverSendTargets return={'fullTargets': ['20.20.20.20:3260,1 iqn.2019-02.eu.teamxenon:data', '20.20.20.20:3260,1 iqn.2019-02.eu.teamxenon:ovirt'], 'targets': ['iqn.2019-02.eu.teamxe non:data', 'iqn.2019-02.eu.teamxenon:ovirt']} from=::ffff:192.168.122.144,35682, flow_id=6a17a7b3-1dfa-424c-8978-652d73314daf, task_id=f8be43e7-9085-42bd-b526-c2adb9962cb4 (api:54) 2019-02-08 01:34:08,331+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call ISCSIConnection.discoverSendTargets succeeded in 0.18 seconds (__init__:312) 2019-02-08 01:34:10,739+0100 INFO (vmrecovery) [vdsm.api] START getConnectedStoragePoolsList(options=None) from=internal, task_id=0507616a-5b31-4d88-897f-0d2411674ce3 (api:48) 2019-02-08 01:34:10,739+0100 INFO (vmrecovery) [vdsm.api] FINISH getConnectedStoragePoolsList return={'poollist': []} from=internal, task_id=0507616a-5b31-4d88-897f-0d2411674ce3 (api:54) 2019-02-08 01:34:10,740+0100 INFO (vmrecovery) [vds] recovery: waiting for storage pool to go up (clientIF:709) As you can see it finds the targets but for some reason it fails. The initiator name should be configured correctly. My iSCSI is configured as the following: o- / ......................................................................................................................... [...] o- backstores .............................................................................................................. [...] | o- block .................................................................................................. [Storage Objects: 0] | o- fileio ................................................................................................. [Storage Objects: 4] | | o- code ......................................................... [/mnt/pool0/vdisks/code.img (200.0GiB) write-back activated] | | | o- alua ................................................................................................... [ALUA Groups: 1] | | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized] | | o- games ....................................................... [/mnt/pool1/vdisks/games.img (800.0GiB) write-back activated] | | | o- alua ................................................................................................... [ALUA Groups: 1] | | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized] | | o- music ....................................................... [/mnt/pool0/vdisks/music.img (400.0GiB) write-back activated] | | | o- alua ................................................................................................... [ALUA Groups: 1] | | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized] | | o- virtualization ................................................. [/mnt/pool0/vdisks/vm.img (100.0GiB) write-back activated] | | o- alua ................................................................................................... [ALUA Groups: 1] | | o- default_tg_pt_gp ....................................................................... [ALUA state: Active/optimized] | o- pscsi .................................................................................................. [Storage Objects: 0] | o- ramdisk ................................................................................................ [Storage Objects: 0] o- iscsi ............................................................................................................ [Targets: 2] | o- iqn.2019-02.eu.teamxenon:data ..................................................................................... [TPGs: 1] | | o- tpg1 ............................................................................................... [no-gen-acls, no-auth] | | o- acls .......................................................................................................... [ACLs: 2] | | | o- iqn.2019-02.eu.teamxenon:laptop ...................................................................... [Mapped LUNs: 3] | | | | o- mapped_lun0 ................................................................................. [lun0 fileio/code (rw)] | | | | o- mapped_lun1 ................................................................................ [lun1 fileio/music (rw)] | | | | o- mapped_lun2 ................................................................................ [lun2 fileio/games (rw)] | | | o- iqn.2019-02.eu.teamxenon:win10pro .................................................................... [Mapped LUNs: 3] | | | o- mapped_lun0 ................................................................................. [lun0 fileio/code (rw)] | | | o- mapped_lun1 ................................................................................ [lun1 fileio/music (rw)] | | | o- mapped_lun2 ................................................................................ [lun2 fileio/games (rw)] | | o- luns .......................................................................................................... [LUNs: 3] | | | o- lun0 .................................................... [fileio/code (/mnt/pool0/vdisks/code.img) (default_tg_pt_gp)] | | | o- lun1 .................................................. [fileio/music (/mnt/pool0/vdisks/music.img) (default_tg_pt_gp)] | | | o- lun2 .................................................. [fileio/games (/mnt/pool1/vdisks/games.img) (default_tg_pt_gp)] | | o- portals .................................................................................................... [Portals: 1] | | o- 0.0.0.0:3260 ..................................................................................................... [OK] | o- iqn.2019-02.eu.teamxenon:ovirt .................................................................................... [TPGs: 1] | o- tpg1 ............................................................................................... [no-gen-acls, no-auth] | o- acls .......................................................................................................... [ACLs: 1] | | o- iqn.2019-02.eu.teamxenon:ovirt ....................................................................... [Mapped LUNs: 1] | | o- mapped_lun0 ....................................................................... [lun0 fileio/virtualization (rw)] | o- luns .......................................................................................................... [LUNs: 1] | | o- lun0 ............................................ [fileio/virtualization (/mnt/pool0/vdisks/vm.img) (default_tg_pt_gp)] | o- portals .................................................................................................... [Portals: 1] | o- 0.0.0.0:3260 ..................................................................................................... [OK] o- loopback ......................................................................................................... [Targets: 0] o- srpt ............................................................................................................. [Targets: 0] I really don't know what the problem is and I haven't found an answer anywhere on the internet. I hope you can help me out. Roman

2 1

Network Performance Issues
by Bryan Sockel 08 Feb '19

08 Feb '19

Hi, I currently have a 4 node ovirt cluster running. Each node is configured with an active passive network setup, with each link being 10 GB. After looking over my performance metrics collected via observium. I am noticing the network traffic rarely exceeds 100 MB. I am noticing this across all four of my servers and my 2 storage arrays that are also connected via the same 10 GB links. What is the best way to trouble shoot this problem? Thanks

2 1

need network design advice for iSCSI
by John Florian 08 Feb '19

08 Feb '19

I have an existing 4.2 setup with 2 hosts, both with a quad-gbit NIC and a QNAP TS-569 Pro NAS with twin gbit NIC and five 7k2 drives. At present, the I have 5 VLANs, each with their own subnet as: 1. my "main" net (VLAN 1, 172.16.7.0/24) 2. ovirtmgmt (VLAN 100, 192.168.100.0/24) 3. four storage nets (VLANs 101-104, 192.168.101.0/24 - 192.168.104.0/24) On the NAS, I enslaved both NICs into a 802.3ad LAG and then bound an IP address for each of the four storage nets giving me: * bond0.101@bond0: 192.168.101.101 * bond0.102@bond0: 192.168.102.102 * bond0.103@bond0: 192.168.103.103 * bond0.104@bond0: 192.168.104.104 The hosts are similar, but with all four NICs enslaved into a 802.3ad LAG: Host 1: * bond0.101@bond0: 192.168.101.203 * bond0.102@bond0: 192.168.102.203 * bond0.103@bond0: 192.168.103.203 * bond0.104@bond0: 192.168.104.203 Host 2: * bond0.101@bond0: 192.168.101.204 * bond0.102@bond0: 192.168.102.204 * bond0.103@bond0: 192.168.103.204 * bond0.104@bond0: 192.168.104.204 I believe my performance could be better though. While running bonnie++ on a VM, the NAS reports top disk throughput around 70MB/s and the network (both NICs) topping out around 90MB/s. I suspect I'm being hurt by the load balancing across the NICs. I've played with various load balancing options for the LAGs (src-dst-ip and src-dst-mac) but with little difference in effect. Watching the resource monitor on the NAS, I can see that one NIC almost exclusive does transmits while the other is almost exclusively receives. Here's the bonnie report (my apologies to those reading plain-text here): Bonnie++ Benchmark results *Version 1.97* *Sequential Output* *Sequential Input* *Random Seeks* *Sequential Create* *Random Create* Size Per Char Block Rewrite Per Char Block Num Files Create Read Delete Create Read Delete K/sec % CPU K/sec % CPU K/sec % CPU K/sec % CPU K/sec % CPU /sec % CPU /sec % CPU /sec % CPU /sec % CPU /sec % CPU /sec % CPU /sec % CPU unamed 4G 267 97 75284 21 22775 8 718 97 43559 7 189.5 8 16 6789 60 +++++ +++ 24948 75 14792 86 +++++ +++ 18163 51 Latency 69048us 754ms 898ms 61246us 311ms 1126ms Latency 33937us 1132us 1299us 528us 22us 458us I keep seeing MPIO mentioned for iSCSI deployments and now I'm trying to get my head around how to best set that up or to even know if it would be helpful. I only have one switch (a Catalyst 3750g) in this small setup so fault tolerance at that level isn't a goal. So... what would the recommendation be? I've never done MPIO before but know where it's at in the web UI at least. -- John Florian

5 9

ovirt-node-4.3, deployment fails when moving hosted engine vm to gluster storage.
by feral 07 Feb '19

07 Feb '19

I have no idea what's wrong at this point. Very vanilla install of 3 nodes. Run the Hyperconverged wizard, completes fine. Run the engine deployment, takes hours, eventually fails with : [ INFO ] TASK [oVirt.hosted-engine-setup : Check engine VM health] [ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 120, "changed": true, "cmd": ["hosted-engine", "--vm-status", "--json"], "delta": "0:00:00.340985", "end": "2019-02-06 11:44:48.836431", "rc": 0, "start": "2019-02-06 11:44:48.495446", "stderr": "", "stderr_lines": [], "stdout": "{\"1\": {\"conf_on_shared_storage\": true, \"live-data\": true, \"extra\": \"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=12994 (Wed Feb 6 11:44:44 2019)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=12995 (Wed Feb 6 11:44:44 2019)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStop\\nstopped=False\\n\", \"hostname\": \"ovirt-431.localdomain\", \"host-id\": 1, \"engine-status\": {\"reason\": \"failed liveliness check\", \"health\": \"bad\", \"vm\": \"up\", \"detail\": \"Up\"}, \"score\": 3400, \"stopped\": false, \"maintenance\": false, \"crc32\": \"5474927a\", \"local_conf_timestamp\": 12995, \"host-ts\": 12994}, \"global_maintenance\": false}", "stdout_lines": ["{\"1\": {\"conf_on_shared_storage\": true, \"live-data\": true, \"extra\": \"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=12994 (Wed Feb 6 11:44:44 2019)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=12995 (Wed Feb 6 11:44:44 2019)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineStop\\nstopped=False\\n\", \"hostname\": \"ovirt-431.localdomain\", \"host-id\": 1, \"engine-status\": {\"reason\": \"failed liveliness check\", \"health\": \"bad\", \"vm\": \"up\", \"detail\": \"Up\"}, \"score\": 3400, \"stopped\": false, \"maintenance\": false, \"crc32\": \"5474927a\", \"local_conf_timestamp\": 12995, \"host-ts\": 12994}, \"global_maintenance\": false}"]} [ INFO ] TASK [oVirt.hosted-engine-setup : Check VM status at virt level] [ INFO ] changed: [localhost] [ INFO ] TASK [oVirt.hosted-engine-setup : debug] [ INFO ] ok: [localhost] [ INFO ] TASK [oVirt.hosted-engine-setup : Fail if engine VM is not running] [ INFO ] skipping: [localhost] [ INFO ] TASK [oVirt.hosted-engine-setup : Get target engine VM IP address] [ INFO ] changed: [localhost] [ INFO ] TASK [oVirt.hosted-engine-setup : Get VDSM's target engine VM stats] [ INFO ] changed: [localhost] [ INFO ] TASK [oVirt.hosted-engine-setup : Convert stats to JSON format] [ INFO ] ok: [localhost] [ INFO ] TASK [oVirt.hosted-engine-setup : Get target engine VM IP address from VDSM stats] [ INFO ] ok: [localhost] [ INFO ] TASK [oVirt.hosted-engine-setup : debug] [ INFO ] ok: [localhost] [ INFO ] TASK [oVirt.hosted-engine-setup : Fail if Engine IP is different from engine's he_fqdn resolved IP] [ INFO ] skipping: [localhost] [ INFO ] TASK [oVirt.hosted-engine-setup : Fail is for any other reason the engine didn't started] [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "The engine failed to start inside the engine VM; please check engine.log."} --------------------------------------------------- I can't check the engine.log as I can't connect to the VM once this failure occurs. I can ssh in prior to the VM being moved to gluster storage, but as soon as it starts doing so, the VM never comes back online. -- _____ Fact: 1. Ninjas are mammals. 2. Ninjas fight ALL the time. 3. The purpose of the ninja is to flip out and kill people.

2 6

oVirt users using Gluster: feedback needed
by Sandro Bonazzola 07 Feb '19

07 Feb '19

Hi, Gluster community opened a survey for the whole month of February 2019: https://www.gluster.org/gluster-community-survey-february-2019/ If you're using Gluster with oVirt please be sure to give gluster community feedback helping improve for next versions. Thanks, -- SANDRO BONAZZOLA MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig>

1 0

ovn bad gateway after update from 4.2.7 to 4.2.8
by Gianluca Cecchi 07 Feb '19

07 Feb '19

Hello, at this moment (about two days ago) I have updated only engine (external, not self hosted) from 4.2.7.5 to 4.2.8.2 As soon as I'm starting for the first time a VM with an ovn based nic I get what below in ovirt-provider-ovn.log In admin gui, if I try for example to start via "run once" I get: " Error while executing action Run VM once: Failed to communicate with the external provider, see log for additional details. " Any clue? Thanks, Gianluca 2019-01-29 17:23:20,554 root Starting server 2019-01-29 17:23:20,554 root Version: 1.2.18-1 2019-01-29 17:23:20,555 root Build date: 20190114151850 2019-01-29 17:23:20,555 root Githash: dae4c1d 2019-01-29 18:04:15,575 root Starting server 2019-01-29 18:04:15,576 root Version: 1.2.18-1 2019-01-29 18:04:15,576 root Build date: 20190114151850 2019-01-29 18:04:15,576 root Githash: dae4c1d 2019-02-01 14:26:58,316 root From: ::ffff:127.0.0.1:49582 Request: GET /v2.0/ports 2019-02-01 14:26:58,317 root HTTPSConnectionPool(host='engine-host', port=443): Max retries exceeded with url: /ovirt-engine/sso/oauth/token-info (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fe806166b90>: Failed to establish a new connection: [Errno -2] Name or service not known',)) Traceback (most recent call last): File "/usr/share/ovirt-provider-ovn/handlers/base_handler.py", line 134, in _handle_request method, path_parts, content File "/usr/share/ovirt-provider-ovn/handlers/selecting_handler.py", line 175, in handle_request return self.call_response_handler(handler, content, parameters) File "/usr/share/ovirt-provider-ovn/handlers/neutron.py", line 33, in call_response_handler TOKEN_HTTP_HEADER_FIELD_NAME, '')): File "/usr/share/ovirt-provider-ovn/auth/plugin_facade.py", line 31, in validate_token return auth.core.plugin.validate_token(token) File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/authorization_by_username.py", line 36, in validate_token return self._is_user_name(token, _admin_user_name()) File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/authorization_by_username.py", line 47, in _is_user_name timeout=AuthorizationByUserName._timeout()) File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 131, in get_token_info timeout=timeout File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 54, in wrapper response = func(*args, **kwargs) File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 47, in wrapper raise BadGateway(e) BadGateway: HTTPSConnectionPool(host='engine-host', port=443): Max retries exceeded with url: /ovirt-engine/sso/oauth/token-info (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fe806166b90>: Failed to establish a new connection: [Errno -2] Name or service not known',)) 2019-02-01 14:27:26,968 root From: ::ffff:127.0.0.1:49590 Request: GET /v2.0/ports 2019-02-01 14:27:26,969 root HTTPSConnectionPool(host='engine-host', port=443): Max retries exceeded with url: /ovirt-engine/sso/oauth/token-info (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fe80618df50>: Failed to establish a new connection: [Errno -2] Name or service not known',)) Traceback (most recent call last): File "/usr/share/ovirt-provider-ovn/handlers/base_handler.py", line 134, in _handle_request method, path_parts, content File "/usr/share/ovirt-provider-ovn/handlers/selecting_handler.py", line 175, in handle_request return self.call_response_handler(handler, content, parameters) File "/usr/share/ovirt-provider-ovn/handlers/neutron.py", line 33, in call_response_handler TOKEN_HTTP_HEADER_FIELD_NAME, '')): File "/usr/share/ovirt-provider-ovn/auth/plugin_facade.py", line 31, in validate_token return auth.core.plugin.validate_token(token) File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/authorization_by_username.py", line 36, in validate_token return self._is_user_name(token, _admin_user_name()) File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/authorization_by_username.py", line 47, in _is_user_name timeout=AuthorizationByUserName._timeout()) File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 131, in get_token_info timeout=timeout File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 54, in wrapper response = func(*args, **kwargs) File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 47, in wrapper raise BadGateway(e) BadGateway: HTTPSConnectionPool(host='engine-host', port=443): Max retries exceeded with url: /ovirt-engine/sso/oauth/token-info (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fe80618df50>: Failed to establish a new connection: [Errno -2] Name or service not known',)) 2019-02-01 14:29:17,412 root From: ::ffff:127.0.0.1:49616 Request: GET /v2.0/ports 2019-02-01 14:29:17,412 root HTTPSConnectionPool(host='engine-host', port=443): Max retries exceeded with url: /ovirt-engine/sso/oauth/token-info (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fe80618de50>: Failed to establish a new connection: [Errno -2] Name or service not known',)) Traceback (most recent call last): File "/usr/share/ovirt-provider-ovn/handlers/base_handler.py", line 134, in _handle_request method, path_parts, content File "/usr/share/ovirt-provider-ovn/handlers/selecting_handler.py", line 175, in handle_request return self.call_response_handler(handler, content, parameters) File "/usr/share/ovirt-provider-ovn/handlers/neutron.py", line 33, in call_response_handler TOKEN_HTTP_HEADER_FIELD_NAME, '')): File "/usr/share/ovirt-provider-ovn/auth/plugin_facade.py", line 31, in validate_token return auth.core.plugin.validate_token(token) File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/authorization_by_username.py", line 36, in validate_token return self._is_user_name(token, _admin_user_name()) File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/authorization_by_username.py", line 47, in _is_user_name timeout=AuthorizationByUserName._timeout()) File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 131, in get_token_info timeout=timeout File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 54, in wrapper response = func(*args, **kwargs) File "/usr/share/ovirt-provider-ovn/auth/plugins/ovirt/sso.py", line 47, in wrapper raise BadGateway(e) BadGateway: HTTPSConnectionPool(host='engine-host', port=443): Max retries exceeded with url: /ovirt-engine/sso/oauth/token-info (Caused by NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection object at 0x7fe80618de50>: Failed to establish a new connection: [Errno -2] Name or service not known',))

4 8

vm autostart and priorities
by Hetz Ben Hamo 07 Feb '19

07 Feb '19

Hi, I'm migrating my VM's to oVirt from ESXI and I've only got one left on the ESXi side - a VM which provides me DNS, mail and DHCP services. Without this VM's, I can't access the internet. The only issue that prevents me from migrating this VM to oVirt and "kill" the ESXi machine, is that I need to start this VM's upon oVirt node power up (auto start), so if the power goes down and comes back, I'll have my infrastructure up and running automatically within minutes. Is there a way to auto start specific VM's or better - start VM's based on specific orders upon boot of the nodes? I think it's a very important feature. Thanks

3 2

Re: ovirt upgrade 4.3 - dashboard is dispalyed 2x in top left corner menu
by Greg Sheremeta 07 Feb '19

07 Feb '19

On Thu, Feb 7, 2019 at 7:39 AM Martin Humaj <mhumaj(a)gmail.com> wrote: > Hi Greg, > > Thanks a lot for quick reply. > > yum update ovirt-engine-ui-extensions, fixed the issue > > The duplicate is gone. > Good to hear, thanks. For posterity, can you tell me if you did the update today or a couple days ago? And, are you using hosted engine? I want to make sure it's not still broken for everyone else :) > > martin > > On Thu, Feb 7, 2019 at 1:32 PM Greg Sheremeta <gshereme(a)redhat.com> wrote: > >> It should be fixed now. When did you update? >> >> Are you using hosted engine? >> >> On Thu, Feb 7, 2019, 6:36 AM <mhumaj(a)gmail.com> wrote: >> >>> After the upgrade to ovirt 4.3, I can see two entry for dashboard in top >>> left corner menu. Is there any way how to get rid of the duplicity? >>> >>> thanks >>> _______________________________________________ >>> Users mailing list -- users(a)ovirt.org >>> To unsubscribe send an email to users-leave(a)ovirt.org >>> Privacy Statement: https://www.ovirt.org/site/privacy-policy/ >>> oVirt Code of Conduct: >>> https://www.ovirt.org/community/about/community-guidelines/ >>> List Archives: >>> https://lists.ovirt.org/archives/list/users@ovirt.org/message/GN4ER4YD6KTQL… >>> >> -- GREG SHEREMETA SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX Red Hat NA <https://www.redhat.com/> gshereme(a)redhat.com IRC: gshereme <https://red.ht/sig>

2 2

qxl issue on OVirt 4.3.0
by Robert Crawford 07 Feb '19

07 Feb '19

On 4.3.0 with the 1809 CentOS image from the ISO Domain the VM Guest will fail to boot and freeze on initialized qxl 0.1.0

2 5

ovirt upgrade 4.3 - dashboard is dispalyed 2x in top left corner menu
by mhumaj＠gmail.com 07 Feb '19

07 Feb '19

After the upgrade to ovirt 4.3, I can see two entry for dashboard in top left corner menu. Is there any way how to get rid of the duplicity? thanks

2 1

Cluster upgrade
by Misak Khachatryan 07 Feb '19

07 Feb '19

Hi, I've successfully upgraded to 4.3, but when I'm trying to upgrade Cluster version I'm getting this: "Error while executing action: Cannot change Cluster Compatibility Version to higher version when there are active Hosts with lower version. -Please move Host virt2 with lower version to maintenance first." Any clues? Best regards, Misak Khachatryan

2 4

Gluster version on oVirt 4.3.0
by suporte＠logicworks.pt 07 Feb '19

07 Feb '19

Hi, What Glusterfs version should I use with oVirt 4.3.0 ? Thanks -- Jose Ferradeira http://www.logicworks.pt

3 2

oVirt + GlusterFS over FCoE
by Николаев Алексей 07 Feb '19

07 Feb '19

1 0

upgrade bug
by ada per 07 Feb '19

07 Feb '19

After upgrading my hosts from 4.2.7.1 to 4.2.8 the external networks stopped working! When im starting a VM using external network it does not boot up at all!!!!! The error message is: "VM is down with error. Exit message: unsupported configuration: filterref is not supported for network interfaces with virtualport type openvswitch" I rolled it back to 4.2.7.1 for 1 of my hosts just as a test and the VMs on that host can now bootup using external networks as they are supposed to!! Please advice as i would like to use the upgrade!!!

2 5

"Volume Option cluster.granular-entry-heal=enable could not be set" when using "Optimize for Virt store"
by Jorick Astrego 07 Feb '19

07 Feb '19

Hi again, When using the option "Optimize for Virt store", I get the following error: 2019-02-06 10:25:02,353+01 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-15727) [051cfc8c-9efc-427c-9e2e-9127e3e0a86d] EVENT_ID: GLUSTER_VOLUME_OPTION_SET_FAILED(4,003), Volume Option cluster.granular-entry-heal=enable could not be set on ssd9 of cluster GlusterFS-storage. This looks like the same issue as https://bugzilla.redhat.com/show_bug.cgi?id=1635684 Volume set option 'granular-entry-heal' is not longer set via gluster volume set option. Is this a known issue or should I open a bug for this? Met vriendelijke groet, With kind regards, Jorick Astrego Netbulae Virtualization Experts ---------------- Tel: 053 20 30 270 info(a)netbulae.eu Staalsteden 4-3A KvK 08198180 Fax: 053 20 30 271 www.netbulae.eu 7547 TA Enschede BTW NL821234584B01 ----------------

2 1

ovirt-node 4.3 hyperconverged - fails on VM deployment - all nodes broken
by feral 07 Feb '19

07 Feb '19

Boring 3 vanilla node deployment. Default options except for gluster volume size. All three nodes on static IP on LAN. All three have each other listed in /etc/hosts as well as dns. Gluster wizard complete successfully, deploy VM. VM deployment fails after copying to the gluster storage. At that point, rebooting any node results in node not coming back to life. No networking, so no other services. Only error I can get is to check the engine.log, which I cannot do as the engine fails to come up. Anyone else seeing this with a vanilla install/deployment? -- _____ Fact: 1. Ninjas are mammals. 2. Ninjas fight ALL the time. 3. The purpose of the ninja is to flip out and kill people.

1 0

ovirt-node 4.2 iso - hyperconverged wizard doesn't write gdeployConfig settings
by feral 07 Feb '19

07 Feb '19

New install of ovirt-node 4.2 (from iso). Setup each node with networking and ssh keys, and use the hyperconverged gluster deployment wizard. None of the user specified settings are ever reflected in the gdeployConfig.conf. Anyone running into this? -- _____ Fact: 1. Ninjas are mammals. 2. Ninjas fight ALL the time. 3. The purpose of the ninja is to flip out and kill people.

7 12

performance issues with Windows 10
by Hetz Ben Hamo 07 Feb '19

07 Feb '19

Hi, I'm doing some very simple disk benchmarks on Windows 10, both with ESXI 6.7 and oVirt 4.3.0. Both Windows 10 Pro guests have all the driver installed. the "Storage" (Datastore in VMWare and storage domains in oVirt) comes from the same ZFS machine, both mounted as NFS *without* any parameters for NFS mount. The ESXI is running on HP DL360 G7 with E5620 CPU, while the oVirt node is running on IBM X3550 M3 with dual Xeon E5620. There are no memory issues as both machines have plenty of free memory and free CPU resources. Screenshots: - Windows 10 in vSphere 6.7 - https://imgur.com/V75ep2n - Windows 10 in oVirt 4.3.0 - https://imgur.com/3JDrWLx As you can see, while oVirt lags a bit in 4K Read, the write performance is really bad. How can this be improved? Thanks

2 1

Re: ovirt 4.2.7 -> 4.3.0 upgrade process
by Douglas Duckworth 06 Feb '19

06 Feb '19

Thanks everyone! We will try the upgrade to 4.2.8 then try 4.3 later. Thanks, Douglas Duckworth, MSc, LFCS HPC System Administrator Scientific Computing Unit<https://scu.med.cornell.edu> Weill Cornell Medicine 1300 York Avenue New York, NY 10065 E: doug(a)med.cornell.edu<mailto:doug@med.cornell.edu> O: 212-746-6305 F: 212-746-8690 On Wed, Feb 6, 2019 at 11:56 AM Sandro Bonazzola <sbonazzo(a)redhat.com<mailto:sbonazzo@redhat.com>> wrote: Il giorno mer 6 feb 2019 alle ore 17:28 Douglas Duckworth <dod2014(a)med.cornell.edu<mailto:dod2014@med.cornell.edu>> ha scritto: Hello Can anyone confirm that the steps for upgrading to 4.3 from 4.2 are the same as listed for previous versions? I reviewed 4.1 to 4.2 which looks straight forward: https://www.ovirt.org/documentation/upgrade-guide/chap-Upgrading_from_4.1_t…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_document…> I am sure nothing will go wrong though we are doing daily backups of the hosted engine VM database. If you are on 4.2.7 I would recommend upgrade the engine to 4.2.8 before upgrading to 4.3. Since in 4.3 we switched from fluentd to rsyslog for the metrics part, with 4.2.7 you may have some issue if you upgrade hosts to 4.3 before the engine gets upgraded. Thanks, Douglas Duckworth, MSc, LFCS HPC System Administrator Scientific Computing Unit<https://scu.med.cornell.edu> Weill Cornell Medicine 1300 York Avenue New York, NY 10065 E: doug(a)med.cornell.edu<mailto:doug@med.cornell.edu> O: 212-746-6305 F: 212-746-8690 _______________________________________________ Users mailing list -- users(a)ovirt.org<mailto:users@ovirt.org> To unsubscribe send an email to users-leave(a)ovirt.org<mailto:users-leave@ovirt.org> Privacy Statement: https://www.ovirt.org/site/privacy-policy/<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_site_pri…> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.ovirt.org_communit…> List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/VC2TVZIHTOTMZ…<https://urldefense.proofpoint.com/v2/url?u=https-3A__lists.ovirt.org_archiv…> -- SANDRO BONAZZOLA MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.redhat.com_&d=DwMF…> sbonazzo(a)redhat.com<mailto:sbonazzo@redhat.com> [https://www.redhat.com/files/brand/email/sig-redhat.png]<https://urldefense.proofpoint.com/v2/url?u=https-3A__red.ht_sig&d=DwMFaQ&c=…>

1 0

sun.security.validator
by suporte＠logicworks.pt 06 Feb '19

06 Feb '19

Hi, I'm running Version 4.2.3.8-1.el7, and after reboot the engine machine no longer could login into administration portal with this error: sun.security.validator.ValidatorException: PKIX path validation faile java.security.cert.CertPathValidatorException: validity check failed I'm using a self signed cert. Any idea? Thanks -- Jose Ferradeira http://www.logicworks.pt

5 5

ovirt 4.2.7 -> 4.3.0 upgrade process
by Douglas Duckworth 06 Feb '19

06 Feb '19

Hello Can anyone confirm that the steps for upgrading to 4.3 from 4.2 are the same as listed for previous versions? I reviewed 4.1 to 4.2 which looks straight forward: https://www.ovirt.org/documentation/upgrade-guide/chap-Upgrading_from_4.1_t… I am sure nothing will go wrong though we are doing daily backups of the hosted engine VM database. Thanks, Douglas Duckworth, MSc, LFCS HPC System Administrator Scientific Computing Unit<https://scu.med.cornell.edu> Weill Cornell Medicine 1300 York Avenue New York, NY 10065 E: doug(a)med.cornell.edu<mailto:doug@med.cornell.edu> O: 212-746-6305 F: 212-746-8690

5 5

Strange behavior when changing memory and virtual cpu for VM
by matthias.barmeier＠sourcepark.de 06 Feb '19

06 Feb '19

Hi, after creating a VM from a template everything works fine. After a while I would like to increase memory and cpus. I changed the memory and virtual cpu settings in the "System" settings. I restarted the VM. From this moment on the VM hangs on boot with this messages filling the console: url_helper.py[WARNING]: Calling 'http://169.254.169.254/2009-04-04/meta-data/instance-id' Connection to 169.254.169.254 timed out. This goes on for ever. What can I do to make the VM work again ? I tried to restore the settings to the values it has before but this does not help. The VM contains debian 9 (stretch) with cloud init. Ovirt version: 4.2.7.5-1.el7 Ciao Matze

4 4

But in the web interface?
by Hetz Ben Hamo 06 Feb '19

06 Feb '19

Hi, I upgraded to 4.3 and on the hosted engine web interface, I see the "dashboard" button twice, one below the other. How can I fix it or is it a known bug? Thanks Hetz

7 14

Re: Changing CPU type from Opteron G3 to Epyc with hosted engine in 4.3
by Simone Tiraboschi 06 Feb '19

06 Feb '19

On Wed, Feb 6, 2019 at 11:02 AM Juhani Rautiainen < juhani.rautiainen(a)gmail.com> wrote: > On Wed, Feb 6, 2019 at 11:27 AM Juhani Rautiainen > <juhani.rautiainen(a)gmail.com> wrote: > > > > On Wed, Feb 6, 2019 at 10:31 AM Simone Tiraboschi <stirabos(a)redhat.com> > wrote: > > > > > > The only case that could prevent that is that you are in hosted-engine > mode and so you cannot set the latest host into maintenance mode without > loosing the engine itself. > > > > > > If this is your case, > > > what you can do is: > > > - set HE global maintenance mode > > > - set one of the hosted-engine hosts into maintenance mode > > > - move it to a different cluster > > > - shutdown the engine VM > > > - manually restart the engine VM on the host on the custom cluster > directly executing on that host: hosted-engine --vm-start > > > - connect again to the engine > > > - set all the hosts of the initial cluster into maintenance mode > > > - upgrade the cluster > > > - shut down again the engine VM > > > - manually restart the engine VM on one of the hosts of the initial > cluster > > > - move back the host that got into a temporary cluster to its initial > cluster > > > > I might try this one. > > I tried this one and it worked. There was problem with couple of VM's > (they were made from OVA from Virtualbox). It couldn't upgrade old > cluster until they were moved to temporary cluster too (complaining > about wrong cluster level). It might have been the real reason why the > normal upgrade failed? Maybe the error message was wrong? > Thanks for the report, honestly I have to double check it because it looks a bit suspicious. I also think that an addition to https://github.com/oVirt/ovirt-ansible-cluster-upgrade to handle also the upgrade of the hosted-engine cluster making it smoother could make a lot of sense. > > Thanks a lot, > Juhani >

1 0

Changing CPU type from Opteron G3 to Epyc with hosted engine in 4.3
by Juhani Rautiainen 06 Feb '19

06 Feb '19

Hi! Now that I have engine and nodes on 4.3 level I'm stuck on upgrading the CPU type. I have 2 node cluster with Epyc processors. It was originally installed with 4.2 so it chose CPU type as Opteron G3 (no Epyc support back then). In Engine 4.3 Epyc is available as CPU type when I choose Compatibility Version: 4.3. Big problem is that it doesn't allow to upgrade CPU because all hosts are not in maintenance: "Error while executing action: Cannot change Cluster CPU type unless all Hosts attached to this Cluster are in Maintenance". Putting all hosts to maintenance is impossible because Engine is hosted in the cluster. I tried with Global HA maintenance, but that didn't help. What is the correct way to solve this problem? Thanks, -Juhani

2 3

Issue when adding new hypervisor to cluster
by Jonas Lindholm 06 Feb '19

06 Feb '19

Background: We had an issue when an operator decided to just install Windows on a running oVirt hypervisor with VMs running. Somehow the Windows installation somehow corrupted some of the storage metadata for one storage domain (The storage domain could not be activated, activation failed after ~5 minutes each time I tried). I was able to move all disks on that storage domain except two to another a new storage domain so all important data was saved. After data was moved I removed the corrupted storage domain from the cluster/datacenter with no issues. I then destroyed the storage domain. The existing hypervisors in the cluster can reboot without any issues with the existing storage domains. So far so good. Issue: However when I try to add an additional hypervisor to the cluster I get an error referencing the corrupted storage domain (UUID is for the bad one that no longer exists). My question is where can the reference still be, in the DB or in any active data structure the hypervisors are using? if it is in the DB I guess some clever SQL statement might be able to remove it but if that's the case I would need help with those SQL statements. Thanks /Jonas *********************************************************** CONFIDENTIALITY AND PRIVACY NOTICE: This e-mail and any attachments are for the exclusive and confidential use of the intended recipient and may constitute non-public information. Personal data in this email is governed by our Privacy Policy at http://business.nasdaq.com/privacy-statement unless explicitly excluded from it; please see the section in the policy entitled “Situations Where This Privacy Policy Does Not Apply” for circumstances where different privacy terms govern emailed personal data. If you received this e-mail in error, disclosing, copying, distributing or taking any action in reliance of this e-mail is strictly prohibited and may be unlawful. Instead, please notify us immediately by return e-mail and promptly delete this message and its attachments from your computer system. We do not waive any work product or other applicable legal privilege(s) by the transmission of this message. ***********************************************************

1 0

rebooting an ovirt cluster
by feral 05 Feb '19

05 Feb '19

How is an oVirt hyperconverged cluster supposed to come back to life after a power outage to all 3 nodes? Running ovirt-node (ovirt-node-ng-installer-4.2.0-2019013006.el7.iso) to get things going, but I've run into multiple issues. 1. During the gluster setup, the volume sizes I specify, are not reflected in the deployment configuration. The auto-populated values are used every time. I manually hacked on the config to get the volume sizes correct. I also noticed if I create the deployment config with "sdb" by accident, but click back and change it to "vdb", again, the changes are not reflected in the config. My deployment config does seem to work. All volumes are created (though the xfs options used don't make sense as you end up with stripe sizes that aren't a multiple of the block size). Once gluster is deployed, I deploy the hosted engine, and everything works. 2. Reboot all nodes. I was testing for power outage response. All nodes come up, but glusterd is not running (seems to have failed for some reason). I can manually restart glusterd on all nodes and it comes up and starts communicating normally. However, the engine does not come online. So I figure out where it last lived, and try to start it manually through the web interface. This fails because vdsm-ovirtmgmt is not up. I figured out the correct way to start up the engine would be through the cli via hosted-engine --vm-start. This does work, but it takes a very long time, and it usually starts up on any node other than the one I told it to start on. So I guess two (or three) questions. What is the expected operation after a full cluster reboot (ie: in the event of a power failure)? Why doesn't the engine start automatically, and what might be causing glusterd to fail, when it can be restarted manually and works fine? -- _____ Fact: 1. Ninjas are mammals. 2. Ninjas fight ALL the time. 3. The purpose of the ninja is to flip out and kill people.

6 10

Version 4.3.0 installed, but shows 4.2.8
by arturo＠somosespeciales.com 05 Feb '19

05 Feb '19

Hi: I just made a new installation from scratch since the last version of oVirt (ovirt-node-ng-installer-4.3.0-2019020409.el7.iso) and at the end of the installation and entering the cockpit, appears that the version is 4.2.8. Here is a screenshot: https://drive.google.com/uc?export=download&id=1muIsMPeiMYi-FN4Y4NTxSfQ-EeV… Any ideas? Thanks in advance. Greetings

1 2

oVirt 4.3 node-ng host kernel options for nvidia vGPU
by Edward Berger 05 Feb '19

05 Feb '19

Hi, One of our projects wants to try offering VMs with nvidia vGPU. My co-worker had some problems before, so I thought I'd try the latest 4.3 ovirt-node-ng. In the "Edit Host" -> kernel dialog I see two promising checkbox options Hostdev Passthrough & SR-IOV (which adds to kernel line intel_iommu=on) and Blacklist Nouveau (which adds to kernel line rdblacklist=nouveau) but they seem to be acting as mutually exclusive options, when both are selected the kernel command line box is outlined in red and I can't continue on. Am I wrong to want both options?

1 0

Host compatibility issue after upgrade from 4.2.8 to 4.3.0
by ronjero＠gmail.com 05 Feb '19

05 Feb '19

I have a three node (hyper converged) cluster, all hosts are identical hardware wise, however after the upgrade one of the three is getting kicked out of the cluster with the following error: Host is compatible with versions (3.6,4.0,4.1,4.2) and cannot join Cluster... The hosts have SandyBridge processors but do have SSBD: CPU Type: Intel SandyBridge IBRS SSBD Family. virsh -r capabilities | grep ssbd <feature name='ssbd'/> The only other thing I should mention is that I *may* have change the cluster compatibly level to 4.3 while this particular node was in maintenance mode (don't know if that has any influence on this issue). Any help getting this node back into the cluster would be greatly appreciated. Ron.

3 4

ERROR running your engine inside of the hosted-engine VM and are not in "Global Maintenance" mode
by mhumaj＠gmail.com 05 Feb '19

05 Feb '19

Hi, We run ovirt upgrade to 4.3, after upgrade we wanted to run engine-setup but we do not know how to put this host which is simply another virtual machine with ovirt-engine. hosted-engine is running on hosts. During execution engine service will be stopped (OK, Cancel) [OK]: [ ERROR ] It seems that you are running your engine inside of the hosted-engine VM and are not in "Global Maintenance" mode. In that case you should put the system into the "Global Maintenance" mode before running engine-setup, or the hosted-engine HA agent might kill the machine, which might corrupt your data. [ ERROR ] Failed to execute stage 'Setup validation': Hosted Engine setup detected, but Global Maintenance is not set. [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20190205121802-l7llrw.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20190205121855-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed from the hosted nodes --== Host 2 status ==-- Host ID : 2 Engine status : {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"} Can anyone please tell me how to put the global maintenance on virtual machine where the ovirt-engine is? not the hosts even if I put them on the global maintenance I am unable to run engine-setup on vm with ovirt-enging. thanks

2 1

[4.3.0] VNC Virt-viewer console not opening
by Nicolas Ecarnot 05 Feb '19

05 Feb '19

Hello, First, congratulations to all of you who worked for this 4.3.0 release, and obviously thank you. Today, I upgraded 4 oVirt setups (4 DC) from 4.2.7 to 4.3.0. I went well on all 4 DCs. But on one of them, when I try to open a console, I see it open as a flash (it opens and closes immediately). I'm using Firefox 64.0 with Ubuntu 18.10, and all my VMs are setup like this : - video type : QXL - Gfx protocol : VNC - VNC Kbd layout : fr and I'm using virt-viewer On the problematic DC, all the VMs are showing the same issue. When I try to use Spice instead of VNc, it is working nicely. When I try to use noVNC, the additional tab opens and shows "Unsupported security types: 19" I tried to track down this issue thanks to the firefox dev console, but it's beyond my understanding. Trying the same with Chromium does the same blinking open/close. I'd rather learn how to provide additionnal debug messages, but /var/log/ovirt-engine/engine.log does not give any useful hint : 2019-02-04 16:57:04,150+01 INFO [org.ovirt.engine.core.bll.SetVmTicketCommand] (default task-24) [1fb01d42] Running command: SetVmTicketCommand internal: false. Entities affected : ID: 0c3e02b3-7fec-4bb1-b3d6-2e6c228e7278 Type: VMAction group CONNECT_TO_VM with role type USER 2019-02-04 16:57:04,155+01 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (default task-24) [1fb01d42] START, SetVmTicketVDSCommand(HostName = hv01.prd.sdis38.fr, SetVmTicketVDSCommandParameters:{hostId=' 687c1c01-a5e1-449c-89d2-9713ccfc2487', vmId='0c3e02b3-7fec-4bb1-b3d6-2e6c228e7278', protocol='VNC', ticket='IivrpGHx5zSw', validTime='120', userName='admin', userId='4a340386-851a-11e8-863d-3417ebeef1af', disconnectAction='NONE'} ), log id: 2a897f30 2019-02-04 16:57:04,188+01 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SetVmTicketVDSCommand] (default task-24) [1fb01d42] FINISH, SetVmTicketVDSCommand, return: , log id: 2a897f30 2019-02-04 16:57:04,211+01 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-24) [1fb01d42] EVENT_ID: VM_SET_TICKET(164), User admin@internal-authz initiated console session for VM ad02.ct at.sdis38.fr What could I give to help you help me? -- Nicolas ECARNOT

4 5

Upgrade guide for node from 4.2->4.3
by Juhani Rautiainen 05 Feb '19

05 Feb '19

Hi! Thanks for the new release. I managed to upgrade the engine from 4.2->4.3 with old upgrade instructions but I'm having problems with 4.2 node upgrades. Adding repos with ovirt-release43 doesn't allow node upgrade. Lot's of missing dependencies. Dpdk depencies could be solved with adding Centos Extras, but what repo you should use for openscap, openscap-utils and scap-security-guide packages? -Juhani

3 5

Ovirt cluster unstable; gluster to blame (again)
by Jim Kusznir 04 Feb '19

04 Feb '19

hi all: Once again my production ovirt cluster is collapsing in on itself. My servers are intermittently unavailable or degrading, customers are noticing and calling in. This seems to be yet another gluster failure that I haven't been able to pin down. I posted about this a while ago, but didn't get anywhere (no replies that I found). The problem started out as a glusterfsd process consuming large amounts of ram (up to the point where ram and swap were exhausted and the kernel OOM killer killed off the glusterfsd process). For reasons not clear to me at this time, that resulted in any VMs running on that host and that gluster volume to be paused with I/O error (the glusterfs process is usually unharmed; why it didn't continue I/O with other servers is confusing to me). I have 3 servers and a total of 4 gluster volumes (engine, iso, data, and data-hdd). The first 3 are replica 2+arb; the 4th (data-hdd) is replica 3. The first 3 are backed by an LVM partition (some thin provisioned) on an SSD; the 4th is on a seagate hybrid disk (hdd + some internal flash for acceleration). data-hdd is the only thing on the disk. Servers are Dell R610 with the PERC/6i raid card, with the disks individually passed through to the OS (no raid enabled). The above RAM usage issue came from the data-hdd volume. Yesterday, I cought one of the glusterfsd high ram usage before the OOM-Killer had to run. I was able to migrate the VMs off the machine and for good measure, reboot the entire machine (after taking this opportunity to run the software updates that ovirt said were pending). Upon booting back up, the necessary volume healing began. However, this time, the healing caused all three servers to go to very, very high load averages (I saw just under 200 on one server; typically they've been 40-70) with top reporting IO Wait at 7-20%. Network for this volume is a dedicated gig network. According to bwm-ng, initially the network bandwidth would hit 50MB/s (yes, bytes), but tailed off to mostly in the kB/s for a while. All machines' load averages were still 40+ and gluster volume heal data-hdd info reported 5 items needing healing. Server's were intermittently experiencing IO issues, even on the 3 gluster volumes that appeared largely unaffected. Even the OS activities on the hosts itself (logging in, running commands) would often be very delayed. The ovirt engine was seemingly randomly throwing engine down / engine up / engine failed notifications. Responsiveness on ANY VM was horrific most of the time, with random VMs being inaccessible. I let the gluster heal run overnight. By morning, there were still 5 items needing healing, all three servers were still experiencing high load, and servers were still largely unstable. I've noticed that all of my ovirt outages (and I've had a lot, way more than is acceptable for a production cluster) have come from gluster. I still have 3 VMs who's hard disk images have become corrupted by my last gluster crash that I haven't had time to repair / rebuild yet (I believe this crash was caused by the OOM issue previously mentioned, but I didn't know it at the time). Is gluster really ready for production yet? It seems so unstable to me.... I'm looking at replacing gluster with a dedicated NFS server likely FreeNAS. Any suggestions? What is the "right" way to do production storage on this (3 node cluster)? Can I get this gluster volume stable enough to get my VMs to run reliably again until I can deploy another storage solution? --Jim

11 23

ETL service aggregation to hourly tables has encountered an error. Please consult the service log for more details.
by melnyksergii＠gmail.com 04 Feb '19

04 Feb '19

Dears, I have an a some error in Ovirt 4.2.7 In dash I see: ETL service aggregation to hourly tables has encountered an error. Please consult the service log for more details. In log ovirt engine server: 2019-01-14 15:59:59|rwL6AB|euUXph|wfcjQ7|OVIRT_ENGINE_DWH|HourlyTimeKeepingJob|Default|5|tWarn|tWarn_1|2019-01-14 15:59:59| ETL service aggregation to hourly tables has encountered an error. lastHourAgg value =Mon Jan 14 14:00:00 EET 2019 and runTime = Mon Jan 14 15:59:59 EET 2019 .Please consult the service log for more details.|42 In some sources people said the problem is in PostgreSQL DB, but I don't understand how can I fix this problem? Thanks

4 9

One disk in illegal state after deleting snapshot with several disks
by Florian Schmid 04 Feb '19

04 Feb '19

Hi, I'm using oVirt 4.2.5. I know, it is not the newest anymore, but our cluster is quite big and I will upgrade to 4.2.8 as soon as possible. I have a VM with several disks, one with virtio (boot device) and 3 other disks with virtio-scsi: log 8190c797-0ed8-421f-85c7-cc1f540408f8 1 GiB root 5edab51c-9113-466c-bd27-e73d4bfb29c4 10 GiB tmp 11d74762-6053-4347-bdf2-4838dc2ea6f0 1 GiB web_web-content bb5b1881-d40f-4ad1-a8c8-8ee594b3fe8a 20 GiB Snapshots where quite small, because not much is changing there. All disks are on NFS v3 share running on NetApp cluster. Some IDs: VM ID: bc25c5c9-353b-45ba-b0d5-5dbba41e9c5f affected disk ID: 6cbd2f85-8335-416f-a208-ef60ecd839a4 Snapshot ID: c8103ae8-3432-4b69-8b91-790cdc37a2da Snapshot disk ID: 2564b125-857e-41fa-b187-2832df277ccf Task ID: 2a60efb5-1a11-49ac-a7f0-406faac219d6 Storage domain ID: 14794a3e-16fc-4dd3-a867-10507acfe293 After triggering snapshot delete task (2a60efb5-1a11-49ac-a7f0-406faac219d6), deletion was running for about one hour and I though it was hanging and I restarted the engine process on self-hosted engine... After that, snapshot was still in lock state, therefore, I deleted the lock: /usr/share/ovirt-engine/setup/dbutils/unlock_entity.sh -t snapshot c8103ae8-3432-4b69-8b91-790cdc37a2da ########################################## CAUTION, this operation may lead to data corruption and should be used with care. Please contact support prior to running this command ########################################## Are you sure you want to proceed? [y/n] y select fn_db_unlock_snapshot('c8103ae8-3432-4b69-8b91-790cdc37a2da'); INSERT 0 1 unlock snapshot c8103ae8-3432-4b69-8b91-790cdc37a2da completed successfully. After trying to delete snapshot again, engine gave the error, that the Disk is in status Illegal. Snapshot file is still there for the disk log: -rw-rw----. 1 vdsm kvm 282M Feb 1 13:33 2564b125-857e-41fa-b187-2832df277ccf -rw-rw----. 1 vdsm kvm 1.0M Jan 22 03:22 2564b125-857e-41fa-b187-2832df277ccf.lease -rw-r--r--. 1 vdsm kvm 267 Feb 1 14:05 2564b125-857e-41fa-b187-2832df277ccf.meta -rw-rw----. 1 vdsm kvm 1.0G Feb 1 11:53 6cbd2f85-8335-416f-a208-ef60ecd839a4 -rw-rw----. 1 vdsm kvm 1.0M Jan 10 12:07 6cbd2f85-8335-416f-a208-ef60ecd839a4.lease -rw-r--r--. 1 vdsm kvm 272 Jan 22 03:22 6cbd2f85-8335-416f-a208-ef60ecd839a4.meta All other snapshots have been merged successfully. I have umounted the disk inside the VM, after I saw, that the snapshot disk is still in use. That's why, the date is not changed anymore. The strange thing is, that it looks like that the merge was working for a short time, because also time of the underlying disk has changed... In database, I have this data about the VM and its snapshot: engine=# select snapshot_id,snapshot_type,status,description from snapshots where vm_id='bc25c5c9-353b-45ba-b0d5-5dbba41e9c5f'; snapshot_id | snapshot_type | status | description --------------------------------------+---------------+--------+------------- f596ba1c-4a6e-4372-9df4-c8e870c55fea | ACTIVE | OK | Active VM c8103ae8-3432-4b69-8b91-790cdc37a2da | REGULAR | OK | cab-3449 engine=# select image_guid,parentid,imagestatus,vm_snapshot_id,volume_type,volume_format,active from images where image_group_id='8190c797-0ed8-421f-85c7-cc1f540408f8'; image_guid | parentid | imagestatus | vm_snapshot_id | volume_type | volume_format | active --------------------------------------+--------------------------------------+-------------+--------------------------------------+-------------+---------------+-------- 2564b125-857e-41fa-b187-2832df277ccf | 6cbd2f85-8335-416f-a208-ef60ecd839a4 | 1 | f596ba1c-4a6e-4372-9df4-c8e870c55fea | 2 | 4 | t 6cbd2f85-8335-416f-a208-ef60ecd839a4 | 00000000-0000-0000-0000-000000000000 | 4 | c8103ae8-3432-4b69-8b91-790cdc37a2da | 2 | 5 | f vdsm-tool dump-volume-chains 14794a3e-16fc-4dd3-a867-10507acfe293: image: 8190c797-0ed8-421f-85c7-cc1f540408f8 - 6cbd2f85-8335-416f-a208-ef60ecd839a4 status: OK, voltype: INTERNAL, format: RAW, legality: LEGAL, type: SPARSE - 2564b125-857e-41fa-b187-2832df277ccf status: OK, voltype: LEAF, format: COW, legality: LEGAL, type: SPARSE @bzlotnik, it would be great, when you can help me to get the disk back only without stopping or starting the VM. I'm really afraid now of deleting snapshots... I will send you the vdsm log from host running the VM and from SPM and engine.log. Thank you very much! BR Florian Schmid

1 0

Wrong CPU performance report
by Hetz Ben Hamo 04 Feb '19

04 Feb '19

Hi, I'm running oVirt 4.2.7.1. I installed Windows 10 pro as a guest, along with QXL and all the drivers, as well as QEMU guest agent. While Windows reports a CPU usage of something like 2-4% when idle, oVirt reports 24-27% CPU usage. Bug? should I report it? Thanks

2 1

oVirt can't communicate with vSphere
by Benjamin Selinger 03 Feb '19

03 Feb '19

Trying to get my ovirt cluster connected to my vSphere cluster to import my guests. When trying to connect, I get: "VDSM ovirt1 command GetVmsNamesFromExternalProviderVDS failed: internal error: curl_easy_perform() returned an error: Couldn't connect to server (7) : Failed connect to 10.0.0.55:443; Connection timed out" ovirt1 node (192.168.1.195) is at location A while vSphere (10.0.0.55) is at location B. I added a static route on ovirt1 for 10.0.0.0/8 via 192.168.1.13, which has a VPN connection back to 10.0.0.0/8. ICMP from ovirt1 gets through just fine, but any other traffic never leaves ovirt1 (ie: 443 traffic never arrives at 1.13). I'm assuming there's some firewall rule somewhere, blocking anything other than outbound ICMP, but I have been unable to find it. Any suggestions?

2 3

Windows 10 - Ovirt 4.3 - EPYC
by Darin Schmidt 01 Feb '19

01 Feb '19

I have successfully setup a centos vm, its up and running. Now I need to setup a windows 10 VM and I cant seem to get anything to work. Ive tried setting the OS type to other or Windows 10 64bit. With Windows 64bit, it fails to startup at all.... When I select OtherOS it will allow me to start to run the Windows ISO, but then fails after a few seconds as well. Is there something I'm not correctly configuring?

2 2

Mounting ISO in subfolder
by Giulio Casella 01 Feb '19

01 Feb '19

Hi, I noticed that if I create a directory in root of ISO domain and put an image in it, you can see it in admin portal image list (listed as "foo/bar.iso"), but mounting that iso in a VM ("change CD") fails "Error while executing action Change CD: Drive image file could not be found" I can easily reproduce this behaviour in ovirt 4.2.8 and rhv 4.2.7. Is it a bug? Cheers, gc

5 9