April 2021 - Users - oVirt List Archives

[ANN] oVirt 4.4.6 Sixth Release Candidate is now available for testing
by Lev Veyde 29 Apr '21

29 Apr '21

oVirt 4.4.6 Sixth Release Candidate is now available for testing The oVirt Project is pleased to announce the availability of oVirt 4.4.6 Sixth Release Candidate for testing, as of April 29th, 2021. This update is the sixth in a series of stabilization updates to the 4.4 series. How to prevent hosts entering emergency mode after upgrade from oVirt 4.4.1 Note: Upgrading from 4.4.2 GA or later should not require re-doing these steps, if already performed while upgrading from 4.4.1 to 4.4.2 GA. These are only required to be done once. Due to Bug 1837864 <https://bugzilla.redhat.com/show_bug.cgi?id=1837864> - Host enter emergency mode after upgrading to latest build If you have your root file system on a multipath device on your hosts you should be aware that after upgrading from 4.4.1 to 4.4.6 you may get your host entering emergency mode. In order to prevent this be sure to upgrade oVirt Engine first, then on your hosts: 1. Remove the current lvm filter while still on 4.4.1, or in emergency mode (if rebooted). 2. Reboot. 3. Upgrade to 4.4.6 (redeploy in case of already being on 4.4.6). 4. Run vdsm-tool config-lvm-filter to confirm there is a new filter in place. 5. Only if not using oVirt Node: - run "dracut --force --add multipath” to rebuild initramfs with the correct filter configuration 6. Reboot. Documentation - If you want to try oVirt as quickly as possible, follow the instructions on the Download <https://ovirt.org/download/> page. - For complete installation, administration, and usage instructions, see the oVirt Documentation <https://ovirt.org/documentation/>. - For upgrading from a previous version, see the oVirt Upgrade Guide <https://ovirt.org/documentation/upgrade_guide/>. - For a general overview of oVirt, see About oVirt <https://ovirt.org/community/about.html>. Important notes before you try it Please note this is a pre-release build. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not be used in production. Installation instructions For installation instructions and additional information please refer to: https://ovirt.org/documentation/ This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.3 or newer * CentOS Linux (or similar) 8.3 or newer * CentOS Stream 8 This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.3 or newer * CentOS Linux (or similar) 8.3 or newer * CentOS Stream 8 * oVirt Node 4.4 based on CentOS Stream 8 (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available based on CentOS Stream 8 - oVirt Node NG is already available based on CentOS Stream 8 Additional Resources: * Read more about the oVirt 4.4.6 release highlights: http://www.ovirt.org/release/4.4.6/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.6/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Lev Veyde Senior Software Engineer, RHCE | RHCVA | MCITP Red Hat Israel <https://www.redhat.com> lev(a)redhat.com | lveyde(a)redhat.com <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

1 0

how to enable HA for all vms and entire cluster at global settings
by dhanaraj.ramesh＠yahoo.com 29 Apr '21

29 Apr '21

Hi Team instead of enabling HA for each vm one by one, I want to enable HA for all vms that is already running in the cluster and also for the future vms that going to be installed. I already did configure HA reservation at the cluster level, any other settings or commands I should configure? how I can achieve the above

1 0

Unable to provide network acces to second cluster in DC
by Miguel Garcia 28 Apr '21

28 Apr '21

I have created the following DC and cluster structure in my ovirt server - Data Center Public - - cluster-public1 - - cluster-public2 Also created a couple Logical Network for DC-Public - - prodvlan - - havlan And added 4 host (two for each cluster because processor type) and each host has ports added to both logical networks (besides ovirtmgmt) When I create a new vm in cluster public1 and add nics I'm able to list prodvlan and havlan but when I try to create the vm for cluster public2 no logical networks are listed. Any idea how to get logical networks listed for cluster public2? Thanks in advance

2 1

Restoring hosted engine from backup fails on new FC storage domain creation
by Juhani Rautiainen 28 Apr '21

28 Apr '21

Hi! I started the upgrade from 4.3->4.4. Now I'm stuck as restoring the backup fails to create the correct storage domain for Hosted Engine. How can I create one? Error from ansible task is: [ ERROR ] ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Domain format is different from master storage domain format]". HTTP response code is 400. [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Fault reason is \"Operation Failed\". Fault detail is \"[Domain format is different from master storage domain format]\". HTTP response code is 400."} And from UI I can see that what has been created is a data domain. Not data (master) domain as old one was. Now I'm stuck here. This is a fibre channel system where I'm trying to do this if it is relevant. What I could find from the logs is this: 2021-04-27 09:36:06,925+0300 DEBUG otopi.ovirt_hosted_engine_setup.ansible_utils ansible_utils._process_output:105 storage_domain_details: {'changed': False, 'ovirt_storage_domains': [{'href': '/ovirt-engine/api/storagedomains/dd52022b-7616-47f6-9534-6f1a4084fdf4', 'comment': '', 'description': '', 'id': 'dd52022b-7616-47f6-9534-6f1a4084fdf4', 'name': 'hosted_storage', 'available': 531502202880, 'backup': False, 'block_size': 512, 'committed': 0, 'critical_space_action_blocker': 5, 'discard_after_delete': True, 'disk_profiles': [], 'disk_snapshots': [], 'disks': [], 'external_status': 'ok', 'master': False, 'permissions': [], 'status': 'unattached', 'storage': {'type': 'fcp', 'volume_group': {'id': 'HRLDCn-p7X2-5X2O-vm4h-1Wb9-wAMu-WkIwit', 'logical_units': [{'discard_max_size': 268435456, 'discard_zeroes_data': False, 'id': '36000d31005b4f6000000000000000029', 'lun_mapping': 3, 'paths': 0, 'product_id': 'Compellent Vol', 'serial': 'SCOMPELNTCompellent_Vol_0005b4f6-00000029', 'size': 536870912000, 'storage_domain_id': 'dd52022b-7616-47f6-9534-6f1a4084fdf4', 'vendor_id': 'COMPELNT', 'volume_group_id': 'HRLDCn-p7X2-5X2O-vm4h-1Wb9-wAMu-WkIwit'}]}}, 'storage_connections': [], 'storage_format': 'v5', 'supports_discard': True, 'supports_discard_zeroes_data': False, 'templates': [], 'type': 'data', 'used': 4294967296, 'vms': [], 'warning_low_space_indicator': 10, 'wipe_after_delete': False}], 'failed': False} 'master': False? I'm not sure if this creation or check. I tried this opration twice. I removed the new hosted_storage and remove also old hosted_engine domain on second try to make sure that it doesn't prevent creation of another master. No luck with that. Thanks, Juhani

3 14

Import VM with Xen Based in Ovirt
by hemaa＠emiratesnbd.com 28 Apr '21

28 Apr '21

Hi All, I am trying to migrate a VM from a Xen Based virtualization to Ovirt with the import option in GUI But I am not able to list any stopped VMs on the Xen host. So what I did is I started the VM and got it listed. Then selected the VM and moved to right hand section. Clicked on next button. But then it gave an error "All chosen VMs couldn't be retrieved by the external system and therefore have been filtered. Please see log for details." When I check the libvirt logs in xen hypervisor I see error as below. There is no other errors in engine logs or vdsm logs 2021-04-22 08:52:36.796+0000: 30219: error : do_connect:116 : internal error: failed to connect to xend 2021-04-22 08:52:36.830+0000: 30219: error : virNodeSuspendSupportsTarget:332 : internal error: Cannot probe for supported suspend types 2021-04-22 08:52:36.830+0000: 30219: warning : xenHypervisorMakeCapabilities:2550 : Failed to get host power management capabilities 2021-04-22 08:52:36.832+0000: 30220: error : virConnectListAllDomains:6803 : this function is not supported by the connection driver: virConnectListAllDomains This is the same error I got when I tried importing a running VM as well. Any idea on what could be a possible reason behind this?

5 5

Faild ovirt-websocket-proxy.
by jesado74＠gmail.com 28 Apr '21

28 Apr '21

Hello again. After getting the hosted-engine vm back, now I have the following problem. I can't use the graphic console. The websocket-proy fails me. Surely when I update the certificates I have missed some intermediate step, but I do not know how to follow. Anyone know of a link to follow the certificate change procedure in the websocket-proxy service. Thank you. PS: Here I leave the output of the service: ● ovirt-websocket-proxy.service - oVirt Engine websockets proxy Loaded: loaded (/usr/lib/systemd/system/ovirt-websocket-proxy.service; enabled; vendor preset: disabled) Active: failed (Result: exit-code) since Wed 2021-04-28 02:03:54 UTC; 7h ago Process: 1694 ExecStart = / usr / share / ovirt-engine / services / ovirt-websocket-proxy / ovirt-websocket-proxy.py --systemd = notify $ EXTRA_ARGS start (code = exited, status = 1 / FAILURE) Main PID: 1694 (code = exited, status = 1 / FAILURE) Apr 28 02:03:53 ovirt.myhostedengine.com systemd [1]: Starting oVirt Engine websockets proxy ... Apr 28 02:03:54 ovirt.myhostedengine.com ovirt-websocket [1694]: 2021-04-28 02: 03: 54,614 + 0000 ovirt-websocket-proxy: ERROR run: 554 Error: SSL_ONLY is set but SSL_CERTIFICATE or SSL_KEY file not found. Apr 28 02:03:54ovirt.hostedengine.com ovirt-websocket-proxy.py [1694]: ovirt-websocket-proxy [1694] ERROR run: 554 Error: SSL_ONLY is set but SSL_CERTIFICATE or SSL_KEY file not found. Apr 28 02:03:54 ovirt.myhostedengine.com systemd [1]: ovirt-websocket-proxy.service: main process exited, code = exited, status = 1 / FAILURE Apr 28 02:03:54 ovirt.myhostedengine.com systemd [1]: Failed to start oVirt Engine websockets proxy. Apr 28 02:03:54 ovirt.myhostedengine.com systemd [1]: Unit ovirt-websocket-proxy.service entered failed state. Apr 28 02:03:54 ovirt.myhostedengine.com systemd [1]: ovirt-websocket-proxy.service failed. Sorry if I say any inconsistencies, but I'm new to this whole ovirt topic. Thanks again.

2 1

How i can set vnic while Create VM
by ovirt.org＠nevim.eu 28 Apr '21

28 Apr '21

How i can set vnic while Create VM via rest-api? I mean this (on screenshot), how to via rest-api? https://prnt.sc/126trb8 Thanks very much.

1 0

Ovirt-engine Setup Error-Failed to execute stage 'Misc configuration
by rajkumar madhu 28 Apr '21

28 Apr '21

Hi Team, Unable to install Ovirt in my centos server.while executing Engine-setup command ,I am getting below error.Please help me on this . Please confirm installation settings (OK, Cancel) [OK]: [ INFO ] Stage: Transaction setup [ INFO ] Stopping engine service [ INFO ] Stopping ovirt-fence-kdump-listener service [ INFO ] Stopping dwh service [ INFO ] Stopping vmconsole-proxy service [ INFO ] Stopping websocket-proxy service [ INFO ] Stage: Misc configuration (early) [ INFO ] Stage: Package installation [ INFO ] Stage: Misc configuration [ ERROR ] Failed to execute stage 'Misc configuration': [Errno 2] No such file or directory: '/etc/ovirt-engine/extensions.d' [ INFO ] DNF Performing DNF transaction rollback [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20210427090149-r0i80v.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20210427090311-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed Regards, Rajkumar M. 9176772077

2 4

Ovirt 4.4.6.5-1 engine-setup failed
by Don Dupuis 28 Apr '21

28 Apr '21

I am installing Ovirt 4.4.6.5-1 engine on CentOS Stream 8 on a dedicated vm. Towards the end of the engine-setup session I have a failure: [ INFO ] Stage: Transaction setup [ INFO ] Stopping engine service [ INFO ] Stopping ovirt-fence-kdump-listener service [ INFO ] Stopping dwh service [ INFO ] Stopping vmconsole-proxy service [ INFO ] Stopping websocket-proxy service [ INFO ] Stage: Misc configuration (early) [ INFO ] Stage: Package installation [ INFO ] Stage: Misc configuration [ INFO ] Upgrading CA [ INFO ] Initializing PostgreSQL [ INFO ] Creating PostgreSQL 'engine' database [ INFO ] Configuring PostgreSQL [ INFO ] Creating PostgreSQL 'ovirt_engine_history' database [ INFO ] Configuring PostgreSQL [ INFO ] Creating CA: /etc/pki/ovirt-engine/ca.pem [ INFO ] Creating CA: /etc/pki/ovirt-engine/qemu-ca.pem [ INFO ] Updating OVN SSL configuration [ INFO ] Updating OVN timeout configuration [ INFO ] Creating/refreshing DWH database schema [ INFO ] Setting up ovirt-vmconsole proxy helper PKI artifacts [ INFO ] Setting up ovirt-vmconsole SSH PKI artifacts [ INFO ] Configuring WebSocket Proxy [ INFO ] Creating/refreshing Engine database schema [ INFO ] Creating a user for Grafana [ INFO ] Creating/refreshing Engine 'internal' domain database schema [ INFO ] Creating default mac pool range [ INFO ] Adding default OVN provider to database [ INFO ] Adding OVN provider secret to database [ INFO ] Setting a password for internal user admin [ INFO ] Install selinux module /usr/share/ovirt-engine/selinux/ansible-runner-service.cil [ INFO ] Generating post install configuration file '/etc/ovirt-engine-setup.conf.d/20-setup-ovirt-post.conf' [ INFO ] Stage: Transaction commit [ INFO ] Stage: Closing up [ INFO ] Starting engine service [ INFO ] Starting dwh service [ INFO ] Starting Grafana service [ ERROR ] Failed to execute stage 'Closing up': Failed to start service 'ovirt-imageio' [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20210426111225-g31wa5.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20210426111501-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed Below is output of /var/log/ovirt-imageio/daemon.log: 2021-04-26 11:15:01,481 ERROR (MainThread) [server] Server failed Traceback (most recent call last): File "/usr/lib64/python3.6/site-packages/ovirt_imageio/_internal/server.py", line 46, in main server = Server(cfg) File "/usr/lib64/python3.6/site-packages/ovirt_imageio/_internal/server.py", line 110, in __init__ self.remote_service = services.RemoteService(self.config, self.auth) File "/usr/lib64/python3.6/site-packages/ovirt_imageio/_internal/services.py", line 73, in __init__ self._server = http.Server((config.remote.host, port), http.Connection) File "/usr/lib64/python3.6/site-packages/ovirt_imageio/_internal/http.py", line 91, in __init__ self.create_socket(prefer_ipv4) File "/usr/lib64/python3.6/site-packages/ovirt_imageio/_internal/http.py", line 123, in create_socket self.socket = socket.socket(self.address_family, self.socket_type) File "/usr/lib64/python3.6/socket.py", line 144, in __init__ _socket.socket.__init__(self, family, type, proto, fileno) OSError: [Errno 97] Address family not supported by protocol I am not seeing errors in /var/log/ovirt-engine/setup/setup.log. What other information do you need that is revelant to this issue? Thanks Don

3 8

Brick didn't come up after planned Poweroutage
by Marcel d'Heureuse 27 Apr '21

27 Apr '21

Hi Guys, We hat a planned power outage and we have stopped all VMS and try to keep the servers alive as long as possible. Some Servers made a Reboot by itself but the IPMI interface was not reachable for the engine. The some hosts have made a restart. Now all systems running and all 180 VMs too. But one Brick of the hosted engine didn't come up. Did you have an idea. Please find attached some screenshots. Our Hosted Engine has 6 bricks on 6 different Servers. A restart of the Host didn't work. The Server Restart of glusterd didn't work. I hope you have some more Ideas? Thanks Br Marcel

2 1

Re: [ceph-users] osd nearfull is not detected
by Konstantin Shalygin 27 Apr '21

27 Apr '21

Create tracker for this issue [1] [1] https://tracker.ceph.com/issues/50533 <https://tracker.ceph.com/issues/50533> k > On 21 Apr 2021, at 21:21, Dan van der Ster <dan(a)vanderster.com <mailto:dan@vanderster.com>> wrote: > > Are you currently doing IO on the relevant pool? Maybe nearfull isn't > reported until some pgstats are reported. > > Otherwise sorry I haven't seen this.

1 0

Re: Attempting to detach a storage domain
by Vojtech Juranek 27 Apr '21

27 Apr '21

On Tuesday, 27 April 2021 02:18:18 CEST Matthew.Stier(a)fujitsu.com wrote: > There is no /var/log/vdsm directory on the hosted-engine. > > This is from the current host, hosting the engine: aaa.bbb.ccc.100 is the > hosted-engine > 2021-04-26 19:12:42,760-0500 INFO (jsonrpc/2) [api.host] START > getCapabilities() from=::ffff:aaa.bbb.ccc.100,37812 (api:48) 2021-04-26 > 19:12:42,763-0500 INFO (jsonrpc/2) [api.host] FINISH getCapabilities > error=internal error: Duplicate key from=::ffff:168.127.151.100,37812 > (api:52) 2021-04-26 19:12:42,763-0500 ERROR (jsonrpc/2) > [jsonrpc.JsonRpcServer] Internal server error (__init__:350) Traceback > (most recent call last): > File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 345, > in _handle_request res = method(**params) > File "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 198, in > _dynamicMethod result = fn(*methodArgs) > File "<string>", line 2, in getCapabilities > File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 50, in > method ret = func(*args, **kwargs) > File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 1371, in > getCapabilities c = caps.get() > File "/usr/lib/python2.7/site-packages/vdsm/host/caps.py", line 95, in > get machinetype.compatible_cpu_models()) > File "/usr/lib/python2.7/site-packages/vdsm/common/cache.py", line 43, in > __call__ value = self.func(*args) > File "/usr/lib/python2.7/site-packages/vdsm/machinetype.py", line 142, in > compatible_cpu_models all_models = domain_cpu_models(c, arch, cpu_mode) > File "/usr/lib/python2.7/site-packages/vdsm/machinetype.py", line 97, in > domain_cpu_models domcaps = conn.getDomainCapabilities(None, arch, None, > virt_type, 0) File > "/usr/lib/python2.7/site-packages/vdsm/common/libvirtconnection.py", line > 131, in wrapper ret = f(*args, **kwargs) > File "/usr/lib/python2.7/site-packages/vdsm/common/function.py", line 94, > in wrapper return func(inst, *args, **kwargs) > File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3844, in > getDomainCapabilities if ret is None: raise libvirtError > ('virConnectGetDomainCapabilities() failed', conn=self) libvirtError: > internal error: Duplicate key looks like https://bugzilla.redhat.com/show_bug.cgi?id=1791790 The fix should be contained in recent oVirt relases. > 2021-04-26 19:12:42,764-0500 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC > call Host.getCapabilities failed (error -32603) in 0.00 seconds > (__init__:312) > > -----Original Message----- > From: Nir Soffer <nsoffer(a)redhat.com> > Sent: Monday, April 26, 2021 5:12 PM > To: Stier, Matthew <Matthew.Stier(a)fujitsu.com> > Cc: Benny Zlotnik <bzlotnik(a)redhat.com>; users(a)ovirt.org > Subject: Re: [ovirt-users] Re: Attempting to detach a storage domain > > On Tue, Apr 27, 2021 at 12:48 AM Matthew.Stier(a)fujitsu.com > <Matthew.Stier(a)fujitsu.com> wrote: > > > > > > I'm getting tons of these in the > > hosted-engine:/var/log/ovirt-engine/engine.log > > > > > > > > 2021-04-26 16:40:40,260-05 ERROR > > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] > > (EE-ManagedThreadFactory-engineScheduled-Thread-8) [] EVENT_ID: > > VDS_BROKER_COMMAND_FAILURE(10,802), VDSM xxxx.yyyy.zzz command Get > > Host Capabilities failed: Internal JSON-RPC error: {'reason': > > 'internal error: Duplicate key'} > > > This looks like bad response from vdsm. Can you share the vdsm log from the > host xxxx.yyyy.zzz? > /var/log/vdsm/vdsm.log > > Nir > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/Z2GOGEZ2DZX34 > ADZ5L2BATIINYGVWYJD/

1 0

Cannot delete snapshot
by Giulio Casella 27 Apr '21

27 Apr '21

Hi, I'm having (another) issue working with snapshots. Since a few days my backup system (storware vprotect) cannot delete a snapshot. Message reported by SPM is: HSMGetAllTasksStatusesVDS failed: value=Volume does not exist: ('6180c2e8-141a-4126-bcb1-5af5caa98175',) abortedcode=201 Other snapshots from other VMs are working fine (created and deleted as needed). I verified it, I can reach on SPM filesystem other snapshots from the same VM, but that one doesn't exist. I suspect that during normal backup management that snapshot has been correctly removed from file system, but still live in ovirt database. I'm pretty sure vProtect use ovirt API to operate, it doesn't directly interact with ovirt database. That's why I'm talking to you and not to storware guys. Is there a (safe) way to get rid of that snapshot? TIA Regards, Giulio Casella

5 11

Re: Ansible ovirt.ovirt_vm nics
by Matthew.Stier＠fujitsu.com 27 Apr '21

27 Apr '21

I believe I have identified the issue, variable inheritance. The inventory I include to define the hosts, includes several classes. ‘virtualmachines’ which the script uses to get the list of VMs it is going to process. All VM defaults are defined within its ‘:vars’ section. I also have groups of VMs where I want to override variables. Unfortunately, what is being defined in ‘virtualmachines’ is not being override in the class level, because they are considered sibling classes. I have found the ‘ansible_group_priority’ variable, which can be assigned at each class. I assigned the entry in [virtualmachines:vars] with the value of 2 (default is 1) and then in the other classes, I assigned a value of 3. Now the variable in [class:vars] will override the variables in [virtualmachines:vars]. Of course the host level can still override all. From: Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> Sent: Thursday, April 22, 2021 2:01 PM To: Martin Perina <mperina(a)redhat.com> Cc: users(a)ovirt.org; Martin Necas <mnecas(a)redhat.com> Subject: [ovirt-users] Re: Ansible ovirt.ovirt_vm nics It’s basically the one listed in the URL. The changes I’ve made is to add some addition ‘defaults’, and the code I mentioned below, to select different nic profiles for vms that are on different networks. I’m running an Oracle Linux 7u9 system, and the version of Ansible is 2.9.18 In my environment, I have created different networks, and labeled them based upon their vlan tag number (vlan20, vlan21, vlan22, …) A VM can be created on any of these vlans, so I need to be able to select the nic profile within ‘ini’ file holding all the configuration information. (hostname, fqdn, IP address, etc…) From: Martin Perina <mperina(a)redhat.com<mailto:mperina@redhat.com>> Sent: Thursday, April 22, 2021 2:51 AM To: Stier, Matthew <Matthew.Stier(a)fujitsu.com<mailto:Matthew.Stier@fujitsu.com>> Cc: users(a)ovirt.org<mailto:users@ovirt.org>; Martin Necas <mnecas(a)redhat.com<mailto:mnecas@redhat.com>> Subject: Re: [ovirt-users] Ansible ovirt.ovirt_vm nics Hi Matthew, Could you please share with us your playbook? Which ansible version are you using? Are you using ovirt_vm module from oVirt Ansible Collection which contains newer versions than the ovirt_vm module included in Ansible 2.9? https://docs.ansible.com/ansible/latest/collections/ovirt/ovirt/ovirt_vm_mo… Thanks, Martin On Thu, Apr 22, 2021 at 9:28 AM Matthew.Stier(a)fujitsu.com<mailto:Matthew.Stier@fujitsu.com> <Matthew.Stier(a)fujitsu.com<mailto:Matthew.Stier@fujitsu.com>> wrote: The ‘nics’ section of ovirt_vm is vague and with nearly no examples. My playbook is based upon https://blogs.oracle.com/scoter/ansible-with-oracle-linux-virtualization-ma… I’ve made several modifications, (more default) and added a few lines, which I believe is supposed to assign vnic profiles to the primary vnic (nic1), based upon the definition of ‘vm_nic1_profile’ defined in an included ‘ini’ file. (the profile defaulting to blank if it is not defined in the ini file.) It isn’t doing its job. nics: - name: “nic1” profile_name: "{{ hostvars[item]['vm_nic1_profile'] | default('') }}” The playbook runs without complaint. If I run it with option ‘-vvv’ part of the output lists the variables, but the ‘nics’ variable is an empty list (nics[]) Any hints on what I’m doing wrong? I’ve checked the forum, but it tends to strip leading spaces, which is bad for indent sensitive code. _______________________________________________ Users mailing list -- users(a)ovirt.org<mailto:users@ovirt.org> To unsubscribe send an email to users-leave(a)ovirt.org<mailto:users-leave@ovirt.org> Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/MEZLXGSSRCRJR… -- Martin Perina Manager, Software Engineering Red Hat Czech s.r.o.

1 0

HCI - oVirt for CEPH
by penguin pages 27 Apr '21

27 Apr '21

I have been building out HCI stack with KVM/RHEV + oVirt with the HCI deployment process. This is very nice for small / remote site use cases, but with Gluster being anounced as EOL in 18 months, what is the replacement plan? Are their working projects and plans to replace Gluster with CEPH? Are their deployment plans to get an HCI stack onto a supported file system? I liked gluster for the control plan for the oVirt engine and smaller utility VMs as each system has a full copy, I can retrieve /extract a copy of the VM without having all bricks back... it was just "easy" to use. CEPH just means more complexity.. and though it scales better and has better features, it means that repair means having critical mass of nodes up before you can extra data (vs any disk can be pulled out of a gluster node, plugged into my laptop and I can at least extract the data). I guess I am not trying to debate shifting to CEPH.. it does not matter.. that ship sailed... What I am asking is when / what are the plans for replacement of Gluster for HCI. Because right now, for small sites for HCI, when Gluster is no longer supported.. and CEPH does not make it... is to go VMWare and vSAN or some other total different stack.

4 9

Re: Attempting to detach a storage domain
by Matthew.Stier＠fujitsu.com 27 Apr '21

27 Apr '21

Problem solved. I used Ansible and ran 'grep Duplicate /var/log/vdsm/vdsm.log' on all 121 of my hosts. Only the log of the host currently running the hosted-engine had entries. I migrated the hosted-engine, and all other VMs to other hosts, and then put the affected host into maintenance. I then undeployed it; then patched it; and finally deployed it. Its back up and running and taking VMs, and no more 'Duplicate keys' errors. -----Original Message----- From: Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> Sent: Monday, April 26, 2021 7:18 PM To: Nir Soffer <nsoffer(a)redhat.com> Cc: users(a)ovirt.org Subject: [ovirt-users] Re: Attempting to detach a storage domain There is no /var/log/vdsm directory on the hosted-engine. This is from the current host, hosting the engine: aaa.bbb.ccc.100 is the hosted-engine 2021-04-26 19:12:42,760-0500 INFO (jsonrpc/2) [api.host] START getCapabilities() from=::ffff:aaa.bbb.ccc.100,37812 (api:48) 2021-04-26 19:12:42,763-0500 INFO (jsonrpc/2) [api.host] FINISH getCapabilities error=internal error: Duplicate key from=::ffff:168.127.151.100,37812 (api:52) 2021-04-26 19:12:42,763-0500 ERROR (jsonrpc/2) [jsonrpc.JsonRpcServer] Internal server error (__init__:350) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 345, in _handle_request res = method(**params) File "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 198, in _dynamicMethod result = fn(*methodArgs) File "<string>", line 2, in getCapabilities File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 50, in method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 1371, in getCapabilities c = caps.get() File "/usr/lib/python2.7/site-packages/vdsm/host/caps.py", line 95, in get machinetype.compatible_cpu_models()) File "/usr/lib/python2.7/site-packages/vdsm/common/cache.py", line 43, in __call__ value = self.func(*args) File "/usr/lib/python2.7/site-packages/vdsm/machinetype.py", line 142, in compatible_cpu_models all_models = domain_cpu_models(c, arch, cpu_mode) File "/usr/lib/python2.7/site-packages/vdsm/machinetype.py", line 97, in domain_cpu_models domcaps = conn.getDomainCapabilities(None, arch, None, virt_type, 0) File "/usr/lib/python2.7/site-packages/vdsm/common/libvirtconnection.py", line 131, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/common/function.py", line 94, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3844, in getDomainCapabilities if ret is None: raise libvirtError ('virConnectGetDomainCapabilities() failed', conn=self) libvirtError: internal error: Duplicate key 2021-04-26 19:12:42,764-0500 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities failed (error -32603) in 0.00 seconds (__init__:312) -----Original Message----- From: Nir Soffer <nsoffer(a)redhat.com> Sent: Monday, April 26, 2021 5:12 PM To: Stier, Matthew <Matthew.Stier(a)fujitsu.com> Cc: Benny Zlotnik <bzlotnik(a)redhat.com>; users(a)ovirt.org Subject: Re: [ovirt-users] Re: Attempting to detach a storage domain On Tue, Apr 27, 2021 at 12:48 AM Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> wrote: > > I'm getting tons of these in the > hosted-engine:/var/log/ovirt-engine/engine.log > > 2021-04-26 16:40:40,260-05 ERROR > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] > (EE-ManagedThreadFactory-engineScheduled-Thread-8) [] EVENT_ID: > VDS_BROKER_COMMAND_FAILURE(10,802), VDSM xxxx.yyyy.zzz command Get > Host Capabilities failed: Internal JSON-RPC error: {'reason': > 'internal error: Duplicate key'} This looks like bad response from vdsm. Can you share the vdsm log from the host xxxx.yyyy.zzz? /var/log/vdsm/vdsm.log Nir _______________________________________________ Users mailing list -- users(a)ovirt.org To unsubscribe send an email to users-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/Z2GOGEZ2DZX34…

1 0

Re: Attempting to detach a storage domain
by Nir Soffer 27 Apr '21

27 Apr '21

On Tue, Apr 27, 2021 at 12:48 AM Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> wrote: > > I'm getting tons of these in the hosted-engine:/var/log/ovirt-engine/engine.log > > 2021-04-26 16:40:40,260-05 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engineScheduled-Thread-8) [] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10,802), VDSM xxxx.yyyy.zzz command Get Host Capabilities failed: Internal JSON-RPC error: {'reason': 'internal error: Duplicate key'} This looks like bad response from vdsm. Can you share the vdsm log from the host xxxx.yyyy.zzz? /var/log/vdsm/vdsm.log Nir

2 1

Re: Attempting to detach a storage domain
by Benny Zlotnik 26 Apr '21

26 Apr '21

I think engine.log would be a good place to start, it would likely tell us on which host there's a problem (if there is one) On Sun, Apr 25, 2021 at 10:22 AM Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> wrote: > > Which logs, on which hosts should I be looking through? > > I have a hint of that from my research, but all 121 hosts are up and running. > > -----Original Message----- > From: Benny Zlotnik <bzlotnik(a)redhat.com> > Sent: Sunday, April 25, 2021 1:53 AM > To: Stier, Matthew <Matthew.Stier(a)fujitsu.com> > Cc: users(a)ovirt.org > Subject: Re: [ovirt-users] Attempting to detach a storage domain > > What do the logs say? > This usually means that not all hosts were able to disconnect from it > > On Sun, Apr 25, 2021 at 9:45 AM Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> wrote: > > > > Ovirt: 4.3.10 > > > > Storage: iSCSI > > > > > > > > Problem: Attempting to place storage domain into ‘maintenance’ in preparation for detachment and destruction, has left it hung in a ‘Preparation for maintenance’ state. > > > > > > > > I have three storage domain I need to put into maintenance, detach and delete. When I placed place the first, and smallest (100GB) into maintenance mode, it switched to ‘Preparing for Maintenance’, and has stuck there for hours. > > > > > > > > Early on, I was able to re-activate it, but I do want to remove for use somewhere else, and I want make sure I can remove it, before I try to do the same with two 11TB storage domains. > > > > _______________________________________________ > > Users mailing list -- users(a)ovirt.org > > To unsubscribe send an email to users-leave(a)ovirt.org Privacy > > Statement: https://www.ovirt.org/privacy-policy.html > > oVirt Code of Conduct: > > https://www.ovirt.org/community/about/community-guidelines/ > > List Archives: > > https://lists.ovirt.org/archives/list/users@ovirt.org/message/HY3LWX7H > > MN56SDHNQWB3MDXLLU7GNLGX/ >

2 1

How to reduce load during create VM
by ovirt.org＠nevim.eu 26 Apr '21

26 Apr '21

Hi everyone, please, can you limit the "Create VM" process somewhere so that setting up quota does not load the server so much, especially storage when duplicating the template disk?

3 3

oVirt on GCP
by mario.gandara＠gmail.com 26 Apr '21

26 Apr '21

Hello, guys! I'm trying to deploy oVirt on GCP for the last two weeks. Someone did it on GCP using nested virtualization? My scenario is: One standalone oVirt Engine and two hosts. In the future I imagine to scale this solution. Thank you. Mário Gândara

2 1

How do I share a disk across multiple VMs?
by David White 26 Apr '21

26 Apr '21

I need to mount a partition across 3 different VMs. How do I attach a disk to multiple VMs? This looks like fairly old documentation-not-documentation: https://www.ovirt.org/develop/release-management/features/storage/sharedraw… Sent with ProtonMail Secure Email.

8 24

Problem with ISCSI multipathing identifying faild path to a LUN every few seconds.
by Gal Villaret 25 Apr '21

25 Apr '21

Hi All, In the past few days, we have been having problems with hosts becoming unmanageable due to multipathd identifying false failed paths and VDSM crashing because of it. We were running version 4.4.1 and upgrading to 4.4.5(engine) and 4.4.6(nodes) seems to have resolved the VDSM. However, currently, we see that the multipathing events continue. From what we have observed, the events start in correlation to the host reporting on low swap space. The low swap space seems to be related to Commvault backup operation running. By running top on the host while a backup operation is running I can see swap being consumed to 100% although there is plenty of RAM available. After the multipath events start happening the only means of stopping it was to reboot the host. This is the warning in oVirt UI: Apr 24, 2021, 9:14:07 PM - Available swap memory of host Ovirt-Node2 [953 MB] is under defined threshold [1024 MB]. This is the first appearance of the multipath event in /var/log/messages: Apr 24 21:14:58 ovirt-node2 kernel: sd 21:0:0:9: [sdgi] tag#77 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=15s Apr 24 21:14:58 ovirt-node2 kernel: sd 21:0:0:9: [sdgi] tag#77 Sense Key : Aborted Command [current] Apr 24 21:14:58 ovirt-node2 kernel: sd 21:0:0:9: [sdgi] tag#77 <<vendor>>ASC=0xc1 ASCQ=0x1 Apr 24 21:14:58 ovirt-node2 kernel: sd 21:0:0:9: [sdgi] tag#77 CDB: Read(16) 88 00 00 00 00 00 79 ac 75 a0 00 00 06 00 00 00 Apr 24 21:14:58 ovirt-node2 kernel: blk_update_request: I/O error, dev sdgi, sector 2041345440 op 0x0:(READ) flags 0x4200 phys_seg 192 prio class 0 Apr 24 21:14:58 ovirt-node2 kernel: device-mapper: multipath: 253:20: Failing path 131:224. Apr 24 21:14:58 ovirt-node2 multipathd[3044]: sdgi: mark as failed Apr 24 21:14:58 ovirt-node2 multipathd[3044]: 3600000e00d2c0000002cb4a8000b0000: remaining active paths: 11 Apr 24 21:15:03 ovirt-node2 multipathd[3044]: 3600000e00d2c0000002cb4a8000b0000: sdgi - tur checker reports path is up Apr 24 21:15:03 ovirt-node2 multipathd[3044]: 131:224: reinstated Apr 24 21:15:03 ovirt-node2 multipathd[3044]: 3600000e00d2c0000002cb4a8000b0000: remaining active paths: 12 Apr 24 21:15:03 ovirt-node2 kernel: device-mapper: multipath: 253:20: Reinstating path 131:224. Apr 24 21:15:03 ovirt-node2 kernel: sd 21:0:0:9: alua: port group 8091 state A preferred supports toluSNA Apr 24 21:15:03 ovirt-node2 kernel: sd 21:0:0:9: alua: port group 8091 state A preferred supports toluSNA Apr 24 21:15:13 ovirt-node2 kernel: sd 13:0:0:9: [sdau] tag#25 FAILED Result: hostbyte=DID_OK driverbyte=DRIVER_SENSE cmd_age=15s Apr 24 21:15:13 ovirt-node2 kernel: sd 13:0:0:9: [sdau] tag#25 Sense Key : Aborted Command [current] Apr 24 21:15:13 ovirt-node2 kernel: sd 13:0:0:9: [sdau] tag#25 <<vendor>>ASC=0xc1 ASCQ=0x1 Apr 24 21:15:13 ovirt-node2 kernel: sd 13:0:0:9: [sdau] tag#25 CDB: Read(16) 88 00 00 00 00 00 79 ac 75 a0 00 00 06 00 00 00 Apr 24 21:15:13 ovirt-node2 kernel: blk_update_request: I/O error, dev sdau, sector 2041345440 op 0x0:(READ) flags 0x4200 phys_seg 192 prio class 0 Apr 24 21:15:13 ovirt-node2 kernel: device-mapper: multipath: 253:20: Failing path 66:224. Apr 24 21:15:13 ovirt-node2 multipathd[3044]: sdau: mark as failed Underlying storage is Fujitsu DX200 S5 with all SSD drives. Each host has two 10Gbit network adapters dedicated to ISCSI. Any help with this would be highly appreciated. Thanks, Gal Villaret

2 1

Migration VM and Storage Domains
by LS CHENG 25 Apr '21

25 Apr '21

Hi I have a question about migrating VM's. If I have 2 VM and each VM is stored in separate Storage Domains can the VM migrate between physical hosts? Or the VM must be stored in the same Storage Domain? For example VM1 is stored in SD1 and runs in HOST-A VM2 is stored in SD2 and runs in HOST-B Can VM2 migrated to HOST-A? Thanks

2 2

Re: Attempting to detach a storage domain
by Benny Zlotnik 25 Apr '21

25 Apr '21

What do the logs say? This usually means that not all hosts were able to disconnect from it On Sun, Apr 25, 2021 at 9:45 AM Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com> wrote: > > Ovirt: 4.3.10 > > Storage: iSCSI > > > > Problem: Attempting to place storage domain into ‘maintenance’ in preparation for detachment and destruction, has left it hung in a ‘Preparation for maintenance’ state. > > > > I have three storage domain I need to put into maintenance, detach and delete. When I placed place the first, and smallest (100GB) into maintenance mode, it switched to ‘Preparing for Maintenance’, and has stuck there for hours. > > > > Early on, I was able to re-activate it, but I do want to remove for use somewhere else, and I want make sure I can remove it, before I try to do the same with two 11TB storage domains. > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/HY3LWX7HMN56S…

2 1

Attempting to detach a storage domain
by Matthew.Stier＠fujitsu.com 25 Apr '21

25 Apr '21

Ovirt: 4.3.10 Storage: iSCSI Problem: Attempting to place storage domain into 'maintenance' in preparation for detachment and destruction, has left it hung in a 'Preparation for maintenance' state. I have three storage domain I need to put into maintenance, detach and delete. When I placed place the first, and smallest (100GB) into maintenance mode, it switched to 'Preparing for Maintenance', and has stuck there for hours. Early on, I was able to re-activate it, but I do want to remove for use somewhere else, and I want make sure I can remove it, before I try to do the same with two 11TB storage domains.

1 0