September 2020 - Users - oVirt List Archives

Upgrading self-Hosted engine from 4.3 to oVirt 4.4
by Adam Xu 22 Sep '20

22 Sep '20

Hi ovirt I just try to upgrade a self-Hosted engine from 4.3.10 to 4.4.1.4. I followed the step in the document: https://www.ovirt.org/documentation/upgrade_guide/#SHE_Upgrading_from_4-3 the old 4.3 env has a FC storage as engine storage domain and I have created a new FC storage vv for the new storage domain to be used in the next steps. I backup the old 4.3 env and prepare a total new host to restore the env. in charter 4.4 step 8, it said: "During the deployment you need to provide a new storage domain. The deployment script renames the 4.3 storage domain and retains its data." it does rename the old storage domain. but it didn't let me choose a new storage domain during the deployment. So the new enigne just deployed in the new host's local storage and can not move to the FC storage domain. Can anyone tell me what the problem is? Thanks -- Adam Xu

2 13

AAA Extension mapping could not be found
by dominique.deschenes＠gcgenicom.com 21 Sep '20

21 Sep '20

I tried to use AAA mapping. but I have this message Sep 21, 2020 2:12:05 PM org.ovirt.engine.exttool.aaa.AAAServiceImpl run INFO: Iteration: 0 Sep 21, 2020 2:12:05 PM org.ovirt.engine.exttool.core.ExtensionsToolExecutor main SEVERE: Extension mapping could not be found Sep 21, 2020 2:12:05 PM org.ovirt.engine.exttool.core.ExtensionsToolExecutor main FINE: Exception: org.ovirt.engine.core.extensions.mgr.ConfigurationException: Extension mapping could not be found at org.ovirt.engine.core.extensions-manager//org.ovirt.engine.core.extensions.mgr.ExtensionsManager.getExtensionByName(ExtensionsManager.java:286) at org.ovirt.engine.core.extensions-tool//org.ovirt.engine.exttool.aaa.AAAServiceImpl$AAAProfile.<init>(AAAServiceImpl.java:846) at org.ovirt.engine.core.extensions-tool//org.ovirt.engine.exttool.aaa.AAAServiceImpl$Action.lambda$static$3(AAAServiceImpl.java:154) at org.ovirt.engine.core.extensions-tool//org.ovirt.engine.exttool.aaa.AAAServiceImpl$Action.execute(AAAServiceImpl.java:417) at org.ovirt.engine.core.extensions-tool//org.ovirt.engine.exttool.aaa.AAAServiceImpl.run(AAAServiceImpl.java:686) at org.ovirt.engine.core.extensions-tool//org.ovirt.engine.exttool.core.ExtensionsToolExecutor.main(ExtensionsToolExecutor.java:121) at org.jboss.modules.Module.run(Module.java:352) at org.jboss.modules.Module.run(Module.java:320) at org.jboss.modules.Main.main(Main.java:593) it's like it can't find for my mapping.properties file I followed the Howto on this page. https://www.ovirt.org/develop/release-management/features/infra/aaa_faq.html Here my config : tail /etc/ovirt-engine/extensions.d/local.lan-authn.properties ovirt.engine.aaa.authn.authz.plugin ovirt.engine.extension.name = local.lan-authn ovirt.engine.extension.bindings.method = jbossmodule ovirt.engine.extension.binding.jbossmodule.module = org.ovirt.engine.extension.aaa.ldap ovirt.engine.extension.binding.jbossmodule.class = org.ovirt.engine.extension.aaa.ldap.AuthnExtension ovirt.engine.extension.provides = org.ovirt.engine.api.extensions.aaa.Authn ovirt.engine.aaa.authn.profile.name = local.lan ovirt.engine.aaa.authn.authz.plugin = local.lan ovirt.engine.aaa.authn.mapping.plugin = mapping config.profile.file.1 = ../aaa/local.lan.properties tail /etc/ovirt-engine/extensions.d/mapping.properties ovirt.engine.extension.name = mapping ovirt.engine.extension.bindings.method = jbossmodule ovirt.engine.extension.binding.jbossmodule.module = org.ovirt.engine-extensions.aaa.misc ovirt.engine.extension.binding.jbossmodule.class = org.ovirt.engineextensions.aaa.misc.mapping.MappingExtension ovirt.engine.extension.provides = org.ovirt.engine.api.extensions.aaa.Mapping config.mapUser.type = regex config.mapUser.regex.pattern = ^(?<user>[^@]*)$ config.mapUser.regex.replacement = ${user}(a)domain.com config.mapUser.regex.mustMatch = false

2 1

New install
by info＠worldhostess.com 21 Sep '20

21 Sep '20

I have an issue with new installation. The server name is changing all the time and it keep disconnecting me. Plus it is impossible to log in as admin. The install went through without any issues, but it seems something is wrong. Server: engine01.xxxx.com Log in with your server user account. Server: node01.xxxx.com Log in with your server user account.

1 0

i cannot access to ovirt-engine with this error"sun.security.validator.validatorexception: pkix path validation failed: java.security.cert.certpathvalidatorexception: timestamp check failed
by momokch＠yahoo.com.hk 21 Sep '20

21 Sep '20

hello everyone, I apologize for asking what is probably a very basic question. when i login to my ovirt-engine webpage, the page show "sun.security.validator.validatorexception: pkix path validation failed: java.security.cert.certpathvalidatorexception: timestamp check failed" does anyone face it before and how to solve it the site is normal before which error message is just show near a month Yours Sincerely, school it

3 3

routing policy problem in ovirt 4.4
by g.vasilopoulos＠uoc.gr 19 Sep '20

19 Sep '20

Hello I created a cluster of ovirt 4.4 with 5 servers, I have a diferent gateway, ovirtmgmt and display network. In 4.4 routing is managed from network manager. Network manager seems to "forget" and recreate the route each time. So I cannot connect to the virtual machines console unless I run a ping for about a minute on the display network ip of the hypervisor, so network manager "wakes up" and "recreates" the route. I use this work around but it is not something that a user can do. What is the proper way to do this ? Thank you

3 3

OVirt HCI Setup Wizard - Drive specification Ignored
by Jeremey Wise 19 Sep '20

19 Sep '20

Greetings: 3 x servers each server has 1 x 512GB ssd 2 x 1TB SSD JBOD Goal: use HCI disk setup wizard to deploy initial structure Each server has disk scanning in as different /dev/sd# and so trying to use more clear /dev/mapper/<disk ID> As such I set this per table below: # Select each server and set each drive <<<<<<<<<<Double Check drive device ID as they do NOT match up per host # I transitioned to /dev/mapper object to avoid unclearness of /dev/sd# thor /dev/sdc /dev/mapper/Samsung_SSD_850_PRO_512GB_S250NXAGA15787L odin /dev/sdb /dev/mapper/Micron_1100_MTFDDAV512TBN_17401F699137 medusa /dev/sdb /dev/mapper/SAMSUNG_SSD_PM851_mSATA_512GB_S1EWNYAF609306 # Note that drives need to be completely clear of any partition or file system [root@thor /]# gdisk /dev/sdc GPT fdisk (gdisk) version 1.0.3 Partition table scan: MBR: protective BSD: not present APM: not present GPT: present Found valid GPT with protective MBR; using GPT. Command (? for help): x Expert command (? for help): z About to wipe out GPT on /dev/sdc. Proceed? (Y/N): y GPT data structures destroyed! You may now partition the disk using fdisk or other utilities. Blank out MBR? (Y/N): y [image: image.png] [image: image.png] But deployment fails with Error: <snip> TASK [gluster.infra/roles/backend_setup : Filter none-existing devices] ******** task path: /etc/ansible/roles/gluster.infra/roles/backend_setup/tasks/get_vg_groupings.yml:38 ok: [thorst.penguinpages.local] => {"ansible_facts": {"gluster_volumes_by_groupname": {}}, "changed": false} ok: [odinst.penguinpages.local] => {"ansible_facts": {"gluster_volumes_by_groupname": {}}, "changed": false} ok: [medusast.penguinpages.local] => {"ansible_facts": {"gluster_volumes_by_groupname": {}}, "changed": false} TASK [gluster.infra/roles/backend_setup : Make sure thick pvs exists in volume group] *** task path: /etc/ansible/roles/gluster.infra/roles/backend_setup/tasks/thick_lv_create.yml:37 TASK [gluster.infra/roles/backend_setup : update LVM fact's] ******************* task path: /etc/ansible/roles/gluster.infra/roles/backend_setup/tasks/thick_lv_create.yml:83 skipping: [thorst.penguinpages.local] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [odinst.penguinpages.local] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [medusast.penguinpages.local] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [gluster.infra/roles/backend_setup : Create thick logical volume] ********* task path: /etc/ansible/roles/gluster.infra/roles/backend_setup/tasks/thick_lv_create.yml:90 failed: [medusast.penguinpages.local] (item={'vgname': ' gluster_vg_Samsung_SSD_850_PRO_512GB_S250NXAGA15787L', 'lvname': 'gluster_lv_engine', 'size': '1000G'}) => {"ansible_index_var": "index", "ansible_loop_var": "item", "changed": false, "err": " Volume group \"gluster_vg_Samsung_SSD_850_PRO_512GB_S250NXAGA15787L\" not found.\n Cannot process volume group gluster_vg_Samsung_SSD_850_PRO_512GB_S250NXAGA15787L\n", "index": 0, "item": {"lvname": "gluster_lv_engine", "size": "1000G", "vgname": "gluster_vg_Samsung_SSD_850_PRO_512GB_S250NXAGA15787L"}, "msg": "Volume group gluster_vg_Samsung_SSD_850_PRO_512GB_S250NXAGA15787L does not exist.", "rc": 5} changed: [thorst.penguinpages.local] => (item={'vgname': ' gluster_vg_Samsung_SSD_850_PRO_512GB_S250NXAGA15787L', 'lvname': 'gluster_lv_engine', 'size': '1000G'}) => {"ansible_index_var": "index", "ansible_loop_var": "item", "changed": true, "index": 0, "item": {"lvname": "gluster_lv_engine", "size": "1000G", "vgname": "gluster_vg_Samsung_SSD_850_PRO_512GB_S250NXAGA15787L"}, "msg": ""} failed: [odinst.penguinpages.local] (item={'vgname': 'gluster_vg_Samsung_SSD_850_PRO_512GB_S250NXAGA15787L', 'lvname': 'gluster_lv_engine', 'size': '1000G'}) => {"ansible_index_var": "index", "ansible_loop_var": "item", "changed": false, "err": " Volume group \"gluster_vg_Samsung_SSD_850_PRO_512GB_S250NXAGA15787L\" not found.\n Cannot process volume group gluster_vg_Samsung_SSD_850_PRO_512GB_S250NXAGA15787L\n", "index": 0, "item": {"lvname": "gluster_lv_engine", "size": "1000G", "vgname": "gluster_vg_Samsung_SSD_850_PRO_512GB_S250NXAGA15787L"}, "msg": "Volume group gluster_vg_Samsung_SSD_850_PRO_512GB_S250NXAGA15787L does not exist.", "rc": 5} NO MORE HOSTS LEFT ************************************************************* NO MORE HOSTS LEFT ************************************************************* PLAY RECAP ********************************************************************* medusast.penguinpages.local : ok=23 changed=5 unreachable=0 failed=1 skipped=34 rescued=0 ignored=0 odinst.penguinpages.local : ok=23 changed=5 unreachable=0 failed=1 skipped=34 rescued=0 ignored=0 thorst.penguinpages.local : ok=30 changed=9 unreachable=0 failed=0 skipped=29 rescued=0 ignored=0 Please check /var/log/cockpit/ovirt-dashboard/gluster-deployment.log for more informations. ############ Why is oVirt ignoring when I set (and double check explicite device call for deployment? Attached is the ansible file it creates and then one I had to edit to correct what wizard should have built it as. -- p <jeremey.wise(a)gmail.com>enguinpages

3 5

New oVirt Install - Host Engine Deployment Fails
by mblanton＠vnet.net 18 Sep '20

18 Sep '20

I am attempting a new oVirt install. I have two nodes installed (with oVirt Node 4.4). I have NFS shared storage for the hosted engine. Both nodes are Dell quad core Xeon CPUs with 32GB of RAM. Both have been hypervisors before, XCP-NG and Proxmox. However I'm very interested to learn oVirt now. The hosted engine deployment (through cockpit) fails during the "Finish" stage. I do see the initial files created on the NFS storage. [ INFO ] TASK [ovirt.hosted_engine_setup : Convert CPU model name] [ ERROR ] fatal: [localhost]: FAILED! => {"msg": "The task includes an option with an undefined variable. The error was: 'dict object' has no attribute ''\n\nThe error appears to be in '/usr/share/ansible/roles/ovirt.hosted_engine_setup/tasks/create_target_vm/01_create_target_hosted_engine_vm.yml': line 105, column 16, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n# - debug: var=server_cpu_dict\n ^ here\n\nThere appears to be both 'k=v' shorthand syntax and YAML in this task. Only one syntax may be used.\n"} 2020-09-13 17:39:56,507+0000 ERROR ansible failed { "ansible_host": "localhost", "ansible_playbook": "/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml", "ansible_result": { "_ansible_no_log": false, "msg": "The task includes an option with an undefined variable. The error was: 'dict object' has no attribute '' \n\nThe error appears to be in '/usr/share/ansible/roles/ovirt.hosted_engine_setup/tasks/create_target_vm/01_create_targ et_hosted_engine_vm.yml': line 105, column 16, but may\nbe elsewhere in the file depending on the exact syntax problem.\ n\nThe offending line appears to be:\n\n# - debug: var=server_cpu_dict\n ^ here\n\nThere appears to be bo th 'k=v' shorthand syntax and YAML in this task. Only one syntax may be used.\n" }, "ansible_task": "Convert CPU model name", "ansible_type": "task", "status": "FAILED", "task_duration": 1 } I can see the host engine is created and running locally on the node. I can event SSH into the HostedEngineLocal instance. [root@ovirt-node01]# virsh --readonly list Id Name State ----------------------------------- 1 HostedEngineLocal running Looking at the "Convert CPU model name" task: https://github.com/oVirt/ovirt-ansible-hosted-engine-setup/blob/master/task… set_fact: cluster_cpu_model: "{{ server_cpu_dict[cluster_cpu.type] }}" server_cpu_dict is good, I can find that in the logs, cluster_cpu is undefined. But this is normal correct? The Cluster CPU type is "undefined" until the first host is added to the cluster. The error makes it seems that server_cpu_dict and not cluster_cpu.type is the problem. I'm not sure this is really the problem, but that is the only undefined variable I can find. Any advice or recommendation is appreciated -Thanks in advance

5 8

Re: Random hosts disconnects
by Artur Socha 18 Sep '20

18 Sep '20

Hi Anton, I am not sure if changing this value would fix the issue. Defaults are pretty high. For example vdsHeartbeatInSeconds=30seconds, vdsTimeout=180seconds, vdsConnectionTimeout=20seconds. Do you still have relevant logs from the affected hosts: * /var/logs/vdsm/vdsm.log* * /var/logs/vdsm/supervdsm.log* Please look for any jsonrpc errors ie. write/read errors or (connection) timeouts. Storage related warnings/errors might also be relevant. Plus system logs if possible: *journalctl -f /usr/share/vdsm/vdsmd* *journalctl -f /usr/sbin/libvirtd* In order to get system logs from particular time period please combine it with the following example using -S -U options: *journalctl -S "2020-01-12 07:00:00" -U "2020-01-12 07:15:00" * I haven't a clue what to look there for besides any warnings/errors or anything else that seems .... unusual. Artur On Thu, Sep 17, 2020 at 8:09 AM Anton Louw via Users <users(a)ovirt.org> wrote: > > > Hi Everybody, > > > > Did some digging around, and saw a few things regarding “vdsHeartbeatInSeconds” > > I had a look at the properties file located at /etc/ovirt-engine/engine-config/engine-config.properties, and do not see an entry for “vdsHeartbeatInSeconds.type=Integer”. > > Seeing as these data centers are geographically split, could the “vdsHeartbeatInSeconds” potentially be the issue? Is it safe to increase this value after I add “vdsHeartbeatInSeconds.type=Integer” into my engine-config.properties file? > > > > Thanks > > > > *Anton Louw* > *Cloud Engineer: Storage and Virtualization* at *Vox* > ------------------------------ > *T:* 087 805 0000 | *D:* 087 805 1572 > *M:* N/A > *E:* anton.louw(a)voxtelecom.co.za > *A:* Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za > > [image: F] <https://www.facebook.com/voxtelecomZA> > [image: T] <https://www.twitter.com/voxtelecom> > [image: I] <https://www.instagram.com/voxtelecomza/> > [image: L] <https://www.linkedin.com/company/voxtelecom> > [image: Y] <https://www.youtube.com/user/VoxTelecom> > > *From:* Anton Louw via Users <users(a)ovirt.org> > *Sent:* 16 September 2020 09:01 > *To:* users(a)ovirt.org > *Subject:* [ovirt-users] Random hosts disconnects > > > > > > Hi All, > > > > I have a strange issue in my oVirt environment. I currently have a > standalone manager which is running in VMware. In my oVirt environment, I > have two Data Centers. The manager is currently sitting on the same subnet > as DC1. Randomly, hosts in DC2 will say “Not Responding” and then 2 seconds > later, the hosts will activate again. > > > > The strange thing is, when the manager was sitting on the same subnet as > DC2, hosts in DC1 will randomly say “Not Responding” > > > > I have tried going through the logs, but I cannot see anything out of the > ordinary regarding why the hosts would drop connection. I have attached the > engine.log for anybody that would like to do a spot check. > > > > Thanks > > > > *Anton Louw* > > *Cloud Engineer: Storage and Virtualization* at *Vox* > ------------------------------ > > *T:* 087 805 0000 | *D:* 087 805 1572 > *M:* N/A > *E:* anton.louw(a)voxtelecom.co.za > *A:* Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za > > > > [image: F] <https://www.facebook.com/voxtelecomZA> > > > > [image: T] <https://www.twitter.com/voxtelecom> > > > > [image: I] <https://www.instagram.com/voxtelecomza> > > > > [image: L] <https://www.linkedin.com/company/voxtelecom> > > > > [image: Y] <https://www.youtube.com/user/VoxTelecom> > > > > > > [image: #VoxBrand] > <https://www.vox.co.za/fibre/fibre-to-the-home/?prod=HOME> > > > *Disclaimer* > > The contents of this email are confidential to the sender and the intended > recipient. Unless the contents are clearly and entirely of a personal > nature, they are subject to copyright in favour of the holding company of > the Vox group of companies. Any recipient who receives this email in error > should immediately report the error to the sender and permanently delete > this email from all storage devices. > > This email has been scanned for viruses and malware, and may have been > automatically archived by *Mimecast Ltd*, an innovator in Software as a > Service (SaaS) for business. Providing a *safer* and *more useful* place > for your human generated data. Specializing in; Security, archiving and > compliance. To find out more Click Here > <https://www.voxtelecom.co.za/security/mimecast/?prod=Enterprise>. > > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/EJL246IPBGEHI… > -- Artur Socha Senior Software Engineer, RHV Red Hat

2 1

Bad volume specification
by Facundo Garat 18 Sep '20

18 Sep '20

Hi all, I'm having some issues with one VM. The VM won't start and it's showing problems with the virtual disks so I started the VM without any disks and trying to hot adding the disk and that's fail too. The servers are connected thru FC, all the other VMs are working fine. Any ideas?. Thanks!! PS: The engine.log is showing this: 2020-09-15 20:10:37,926-03 INFO [org.ovirt.engine.core.bll.storage.disk.HotPlugDiskToVmCommand] (default task-168) [dd72c8e8-cdbe-470f-8e32-b3d14b96f37a] Lock Acquired to object 'EngineLock:{exclusiveLocks='[f5bd2e15-a1ab-4724-883a-988b4dc7985b=DISK]', sharedLocks='[71db02c2-df29-4552-8a7e-cb8bb429a2ac=VM]'}' 2020-09-15 20:10:38,082-03 INFO [org.ovirt.engine.core.bll.storage.disk.HotPlugDiskToVmCommand] (EE-ManagedThreadFactory-engine-Thread-36528) [dd72c8e8-cdbe-470f-8e32-b3d14b96f37a] Running command: HotPlugDiskToVmCommand internal: false. Entities affected : ID: 71db02c2-df29-4552-8a7e-cb8bb429a2ac Type: VMAction group CONFIGURE_VM_STORAGE with role type USER 2020-09-15 20:10:38,117-03 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (EE-ManagedThreadFactory-engine-Thread-36528) [dd72c8e8-cdbe-470f-8e32-b3d14b96f37a] START, HotPlugDiskVDSCommand(HostName = nodo2, HotPlugDiskVDSParameters:{hostId='1c24c269-76c3-468d-a7ce-d0332beb7aef', vmId='71db02c2-df29-4552-8a7e-cb8bb429a2ac', diskId='f5bd2e15-a1ab-4724-883a-988b4dc7985b', addressMap='null'}), log id: f57ee9e 2020-09-15 20:10:38,125-03 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (EE-ManagedThreadFactory-engine-Thread-36528) [dd72c8e8-cdbe-470f-8e32-b3d14b96f37a] Disk hot-plug: <?xml version="1.0" encoding="UTF-8"?><hotplug> <devices> <disk snapshot="no" type="block" device="disk"> <target dev="vda" bus="virtio"/> <source dev="/rhev/data-center/mnt/blockSD/55327311-e47c-46b5-b168-258c5924757b/images/f5bd2e15-a1ab-4724-883a-988b4dc7985b/bd714f21-8eed-43ee-a2d4-3d2ef1ee4c3f"> <seclabel model="dac" type="none" relabel="no"/> </source> <driver name="qemu" io="native" type="qcow2" error_policy="stop" cache="none"/> <alias name="ua-f5bd2e15-a1ab-4724-883a-988b4dc7985b"/> <serial>f5bd2e15-a1ab-4724-883a-988b4dc7985b</serial> </disk> </devices> <metadata xmlns:ovirt-vm="http://ovirt.org/vm/1.0"> <ovirt-vm:vm> <ovirt-vm:device devtype="disk" name="vda"> <ovirt-vm:poolID>00000001-0001-0001-0001-000000000311</ovirt-vm:poolID> <ovirt-vm:volumeID>bd714f21-8eed-43ee-a2d4-3d2ef1ee4c3f</ovirt-vm:volumeID> <ovirt-vm:imageID>f5bd2e15-a1ab-4724-883a-988b4dc7985b</ovirt-vm:imageID> <ovirt-vm:domainID>55327311-e47c-46b5-b168-258c5924757b</ovirt-vm:domainID> </ovirt-vm:device> </ovirt-vm:vm> </metadata> </hotplug> 2020-09-15 20:10:38,289-03 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (EE-ManagedThreadFactory-engine-Thread-36528) [dd72c8e8-cdbe-470f-8e32-b3d14b96f37a] Failed in 'HotPlugDiskVDS' method 2020-09-15 20:10:38,295-03 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-36528) [dd72c8e8-cdbe-470f-8e32-b3d14b96f37a] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10,802), VDSM nodo2 command HotPlugDiskVDS failed: General Exception: ("Bad volume specification {'device': 'disk', 'type': 'disk', 'diskType': 'block', 'specParams': {}, 'alias': 'ua-f5bd2e15-a1ab-4724-883a-988b4dc7985b', 'domainID': '55327311-e47c-46b5-b168-258c5924757b', 'imageID': 'f5bd2e15-a1ab-4724-883a-988b4dc7985b', 'poolID': '00000001-0001-0001-0001-000000000311', 'volumeID': 'bd714f21-8eed-43ee-a2d4-3d2ef1ee4c3f', 'path': '/rhev/data-center/mnt/blockSD/55327311-e47c-46b5-b168-258c5924757b/images/f5bd2e15-a1ab-4724-883a-988b4dc7985b/bd714f21-8eed-43ee-a2d4-3d2ef1ee4c3f', 'discard': False, 'format': 'cow', 'propagateErrors': 'off', 'cache': 'none', 'iface': 'virtio', 'name': 'vda', 'serial': 'f5bd2e15-a1ab-4724-883a-988b4dc7985b', 'index': 0}",) 2020-09-15 20:10:38,295-03 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (EE-ManagedThreadFactory-engine-Thread-36528) [dd72c8e8-cdbe-470f-8e32-b3d14b96f37a] Command 'org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand' return value 'StatusOnlyReturn [status=Status [code=100, message=General Exception: ("Bad volume specification {'device': 'disk', 'type': 'disk', 'diskType': 'block', 'specParams': {}, 'alias': 'ua-f5bd2e15-a1ab-4724-883a-988b4dc7985b', 'domainID': '55327311-e47c-46b5-b168-258c5924757b', 'imageID': 'f5bd2e15-a1ab-4724-883a-988b4dc7985b', 'poolID': '00000001-0001-0001-0001-000000000311', 'volumeID': 'bd714f21-8eed-43ee-a2d4-3d2ef1ee4c3f', 'path': '/rhev/data-center/mnt/blockSD/55327311-e47c-46b5-b168-258c5924757b/images/f5bd2e15-a1ab-4724-883a-988b4dc7985b/bd714f21-8eed-43ee-a2d4-3d2ef1ee4c3f', 'discard': False, 'format': 'cow', 'propagateErrors': 'off', 'cache': 'none', 'iface': 'virtio', 'name': 'vda', 'serial': 'f5bd2e15-a1ab-4724-883a-988b4dc7985b', 'index': 0}",)]]' 2020-09-15 20:10:38,295-03 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (EE-ManagedThreadFactory-engine-Thread-36528) [dd72c8e8-cdbe-470f-8e32-b3d14b96f37a] HostName = nodo2 2020-09-15 20:10:38,295-03 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (EE-ManagedThreadFactory-engine-Thread-36528) [dd72c8e8-cdbe-470f-8e32-b3d14b96f37a] Command 'HotPlugDiskVDSCommand(HostName = nodo2, HotPlugDiskVDSParameters:{hostId='1c24c269-76c3-468d-a7ce-d0332beb7aef', vmId='71db02c2-df29-4552-8a7e-cb8bb429a2ac', diskId='f5bd2e15-a1ab-4724-883a-988b4dc7985b', addressMap='null'})' execution failed: VDSGenericException: VDSErrorException: Failed to HotPlugDiskVDS, error = General Exception: ("Bad volume specification {'device': 'disk', 'type': 'disk', 'diskType': 'block', 'specParams': {}, 'alias': 'ua-f5bd2e15-a1ab-4724-883a-988b4dc7985b', 'domainID': '55327311-e47c-46b5-b168-258c5924757b', 'imageID': 'f5bd2e15-a1ab-4724-883a-988b4dc7985b', 'poolID': '00000001-0001-0001-0001-000000000311', 'volumeID': 'bd714f21-8eed-43ee-a2d4-3d2ef1ee4c3f', 'path': '/rhev/data-center/mnt/blockSD/55327311-e47c-46b5-b168-258c5924757b/images/f5bd2e15-a1ab-4724-883a-988b4dc7985b/bd714f21-8eed-43ee-a2d4-3d2ef1ee4c3f', 'discard': False, 'format': 'cow', 'propagateErrors': 'off', 'cache': 'none', 'iface': 'virtio', 'name': 'vda', 'serial': 'f5bd2e15-a1ab-4724-883a-988b4dc7985b', 'index': 0}",), code = 100 2020-09-15 20:10:38,296-03 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.HotPlugDiskVDSCommand] (EE-ManagedThreadFactory-engine-Thread-36528) [dd72c8e8-cdbe-470f-8e32-b3d14b96f37a] FINISH, HotPlugDiskVDSCommand, return: , log id: f57ee9e 2020-09-15 20:10:38,296-03 ERROR [org.ovirt.engine.core.bll.storage.disk.HotPlugDiskToVmCommand] (EE-ManagedThreadFactory-engine-Thread-36528) [dd72c8e8-cdbe-470f-8e32-b3d14b96f37a] Command 'org.ovirt.engine.core.bll.storage.disk.HotPlugDiskToVmCommand' failed: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to HotPlugDiskVDS, error = General Exception: ("Bad volume specification {'device': 'disk', 'type': 'disk', 'diskType': 'block', 'specParams': {}, 'alias': 'ua-f5bd2e15-a1ab-4724-883a-988b4dc7985b', 'domainID': '55327311-e47c-46b5-b168-258c5924757b', 'imageID': 'f5bd2e15-a1ab-4724-883a-988b4dc7985b', 'poolID': '00000001-0001-0001-0001-000000000311', 'volumeID': 'bd714f21-8eed-43ee-a2d4-3d2ef1ee4c3f', 'path': '/rhev/data-center/mnt/blockSD/55327311-e47c-46b5-b168-258c5924757b/images/f5bd2e15-a1ab-4724-883a-988b4dc7985b/bd714f21-8eed-43ee-a2d4-3d2ef1ee4c3f', 'discard': False, 'format': 'cow', 'propagateErrors': 'off', 'cache': 'none', 'iface': 'virtio', 'name': 'vda', 'serial': 'f5bd2e15-a1ab-4724-883a-988b4dc7985b', 'index': 0}",), code = 100 (Failed with error GeneralException and code 100) 2020-09-15 20:10:38,307-03 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (EE-ManagedThreadFactory-engine-Thread-36528) [dd72c8e8-cdbe-470f-8e32-b3d14b96f37a] EVENT_ID: USER_FAILED_HOTPLUG_DISK(2,001), Failed to plug disk owncloud_Disk0 to VM owncloud (User: admin@internal-authz).

4 9

Low Performance (KVM Vs VMware Hypervisor) When running multi-process application
by Rav Ya 17 Sep '20

17 Sep '20

Hello Everyone, Please advice. Any help will be highly appreciated. Thank you in advance. Test Setup: 1. oVirt Centos 7.8 Virtulization Host 2. Guest VM Centos 7.8 (Mutiqueue enabled 6 vCPUs with 6 Rx Tx Queues) 3. The vCPUs are configured for host pass through (Pinned CPU). The Guest VM runs the application in userspace. The Application consists of the parent process that reads packets in raw socket mode from the interface and forwards then to child processes (~vCPUs) via IPC (shared memory – pipes). *The performance (throughput / CPU utilization) that I get with KVM is half of what I get with VMware.* Any thoughts on the below observations? Any suggestions? - KVM Guest VMs degraded performance when running multi-process applications. - High FUTEX time (Seen on the Guest VM when passing traffic). - *High SY: *System CPU time spent in kernel space (Seen on both Hypervisor and the Guest VMs only when running my application.) -Rav Ya

3 6

[ANN] oVirt 4.4.3 First Release Candidate is now available for testing
by Lev Veyde 17 Sep '20

17 Sep '20

oVirt 4.4.3 First Release Candidate is now available for testing The oVirt Project is pleased to announce the availability of oVirt 4.4.3 First Release Candidate for testing, as of September 17th, 2020. This update is the third in a series of stabilization updates to the 4.4 series. Important notes before you try it Please note this is a pre-release build. The oVirt Project makes no guarantees as to its suitability or usefulness. This pre-release must not be used in production. Installation instructions For installation instructions and additional information please refer to: https://ovirt.org/documentation/ This release is available now on x86_64 architecture for: * Red Hat Enterprise Linux 8.2 or newer * CentOS Linux (or similar) 8.2 or newer This release supports Hypervisor Hosts on x86_64 and ppc64le architectures for: * Red Hat Enterprise Linux 8.2 or newer * CentOS Linux (or similar) 8.2 or newer * oVirt Node 4.4 based on CentOS Linux 8.2 (available for x86_64 only) See the release notes [1] for installation instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance is already available for CentOS Linux 8 - oVirt Node NG will be available soon for CentOS Linux 8 Additional Resources: * Read more about the oVirt 4.4.3 release highlights: http://www.ovirt.org/release/4.4.3/ * Get more oVirt project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.4.3/ [2] http://resources.ovirt.org/pub/ovirt-4.4-pre/iso/ -- Lev Veyde Senior Software Engineer, RHCE | RHCVA | MCITP Red Hat Israel <https://www.redhat.com> lev(a)redhat.com | lveyde(a)redhat.com <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>

1 0

UPN suffix and my SAM account do not have the sames domains
by dominique.deschenes＠gcgenicom.com 17 Sep '20

17 Sep '20

I have a SSO authentication question. In my Active Directory, my UPN suffix login and my SAM account do not have the sames domains. Example : UPN : dominique.test(a)abc.com Sam account : domtest(a)local.lan On the VM portal, I am able to connect with dominique.test(a)abc.com but not with domtest(a)local.lan (I have the following message:server_error: Cannot resolve principal 'domtest(a)local.lan' If I connect to the VM PORTAL with dominique.test(a)abc.com, when I click on "RDP Console" to get the link, the login of the RDP is dominique.test(a)local.lan. So I have to manually change the login to dominique.test(a)abc.com. Is it possible to use the Sam account domtes(a)local.lan instead of the UPN ? if not, is it possible to adjust the consol.rdp configuration and include the domain abc.com instead of local.lan ? In research I found this, but I don't have access. How to authenticate with Active directory when UPN suffix and Forest Name are different using AAA LDAP extension - Red Hat C https://access.redhat.com/solutions/2332561 Thank you

1 0

Re: Random hosts disconnects
by Anton Louw 17 Sep '20

17 Sep '20

Hi Everybody, Did some digging around, and saw a few things regarding “vdsHeartbeatInSeconds” I had a look at the properties file located at /etc/ovirt-engine/engine-config/engine-config.properties, and do not see an entry for “vdsHeartbeatInSeconds.type=Integer”. Seeing as these data centers are geographically split, could the “vdsHeartbeatInSeconds” potentially be the issue? Is it safe to increase this value after I add “vdsHeartbeatInSeconds.type=Integer” into my engine-config.properties file? Thanks Anton Louw Cloud Engineer: Storage and Virtualization ______________________________________ D: 087 805 1572 | M: N/A A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg anton.louw(a)voxtelecom.co.za www.vox.co.za From: Anton Louw via Users <users(a)ovirt.org> Sent: 16 September 2020 09:01 To: users(a)ovirt.org Subject: [ovirt-users] Random hosts disconnects Hi All, I have a strange issue in my oVirt environment. I currently have a standalone manager which is running in VMware. In my oVirt environment, I have two Data Centers. The manager is currently sitting on the same subnet as DC1. Randomly, hosts in DC2 will say “Not Responding” and then 2 seconds later, the hosts will activate again. The strange thing is, when the manager was sitting on the same subnet as DC2, hosts in DC1 will randomly say “Not Responding” I have tried going through the logs, but I cannot see anything out of the ordinary regarding why the hosts would drop connection. I have attached the engine.log for anybody that would like to do a spot check. Thanks Anton Louw Cloud Engineer: Storage and Virtualization at Vox ________________________________ T: 087 805 0000 | D: 087 805 1572 M: N/A E: anton.louw(a)voxtelecom.co.za<mailto:anton.louw@voxtelecom.co.za> A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg www.vox.co.za<http://www.vox.co.za> [F]<https://www.facebook.com/voxtelecomZA> [T]<https://www.twitter.com/voxtelecom> [I]<https://www.instagram.com/voxtelecomza> [L]<https://www.linkedin.com/company/voxtelecom> [Y]<https://www.youtube.com/user/VoxTelecom> [#VoxBrand]<https://www.vox.co.za/fibre/fibre-to-the-home/?prod=HOME> Disclaimer The contents of this email are confidential to the sender and the intended recipient. Unless the contents are clearly and entirely of a personal nature, they are subject to copyright in favour of the holding company of the Vox group of companies. Any recipient who receives this email in error should immediately report the error to the sender and permanently delete this email from all storage devices. This email has been scanned for viruses and malware, and may have been automatically archived by Mimecast Ltd, an innovator in Software as a Service (SaaS) for business. Providing a safer and more useful place for your human generated data. Specializing in; Security, archiving and compliance. To find out more Click Here<https://www.voxtelecom.co.za/security/mimecast/?prod=Enterprise>.

1 0

Ovirt legacy migration policy is missing
by ovirtand-cnj342＠yahoo.com 16 Sep '20

16 Sep '20

Hello, We have many cases of failed migrations, and reducing the load on the respective VMs made migration possible. Using "Suspend workload when needed" did not help either with the migrations, which only worked when stopping services on the VMs, thus reducing load. I was therefore trying to tweak the migration downtime setting. The suggested way of doing this is by using the Legacy migration policy. That being said, I am unable to find the Legacy migration policy in the VM Host tab, nor in the cluster's "Migration policy" tab. I cannot find any mention of it being left out of our current version (4.3.6.1) - moreover, the setting "Use custom migration downtime" (only available when using the Legacy migration policy) does exist in the interface - but I cannot find the Legacy policy itself. The only policies present are Minimal downtime (default for cluster), Post-copy migration and Suspend workload when needed. Is there a way to make the Legacy migration policy available if it's missing? Thanks! Best regards, Andy PS. Setting DefaultMaximumMigrationDowntime=20000 as default did not have any effect, presumably because the system uses one of the 3 pre-defined policies and ignores the "default"

1 0

Low Performance (KVM Vs VMware Hypervisor) When running multi-process application
by Ravin Ya 16 Sep '20

16 Sep '20

Hello Everyone, Please advice. Any help will be highly appreciated. Thank you in advance. Test Setup: oVirt Centos 7.8 Virtulization Host Guest VM Centos 7.8 (Mutiqueue enabled 6 vCPUs with 6 Rx Tx Queues) The vCPUs are configured for host pass through (Pinned CPU). The Guest VM runs the application in userspace. The Application consists of the parent process that reads packets in raw socket mode from the interface and forwards then to child processes (~vCPUs) via IPC (shared memory – pipes). The performance (throughput / CPU utilization) that I get with KVM is half of what I get with VMware. Any thoughts on the below observations? Any suggestions? KVM Guest VMs degraded performance when running multi-process applications. High FUTEX time (Seen on the Guest VM when passing traffic). High SY: System CPU time spent in kernel space (Seen on both Hypervisor and the Guest VMs only when running my application.) -Rav Ya

2 1

cpu QoS doesn't work
by pub.virtualization＠gmail.com 16 Sep '20

16 Sep '20

Hello, I set cpu QoS as 10 and applied it to VM on oVirt 4.2, but it doesn't seem to work. compared to VM without QoS, there wasn't any difference in cpu usage. Also, there wasn't any <period>...</period> or <quota>...</quota> field related to QoS in libvirt file. is it right result?? Thanks,

2 1

Unable to create a node in oVirt 4.0
by Rodrigo G. López 16 Sep '20

16 Sep '20

Hi there, We are trying to setup a node in the same machine where we are running the engine, and noticed that the vdsmd service fails because the supervdsmd daemon can't authenticate against libvirtd afaict. The error is the following on supervdsmd: daemonAdapter[17803]: libvirt: XML-RPC error : authentication failed: authentication failed ... and in libvirtd: Sep 15 03:34:18 ovirt-test libvirtd[17775]: 2020-09-15 07:34:18.410+0000: 17775: error : virNetSocketReadWire:1806 : End of file while reading data: Input/output error Sep 15 03:34:18 ovirt-test libvirtd[17775]: 2020-09-15 07:34:18.612+0000: 17776: error : virNetSASLSessionListMechanisms:393 : internal error: cannot list SASL mechanisms -4 (SASL(-4): no mechanism available: Internal Error -4 in server.c near line 1757) Sep 15 03:34:18 ovirt-test libvirtd[17775]: 2020-09-15 07:34:18.612+0000: 17776: error : remoteDispatchAuthSaslInit:3440 : authentication failed: authentication failed Sep 15 03:34:18 ovirt-test libvirtd[17775]: 2020-09-15 07:34:18.612+0000: 17775: error : virNetSocketReadWire:1806 : End of file while reading data: Input/output error Sep 15 03:34:18 ovirt-test libvirtd[17775]: 2020-09-15 07:34:18.814+0000: 17778: error : virNetSASLSessionListMechanisms:393 : internal error: cannot list SASL mechanisms -4 (SASL(-4): no mechanism available: Internal Error -4 in server.c near line 1757) Sep 15 03:34:18 ovirt-test libvirtd[17775]: 2020-09-15 07:34:18.814+0000: 17778: error : remoteDispatchAuthSaslInit:3440 : authentication failed: authentication failed Sep 15 03:34:18 ovirt-test libvirtd[17775]: 2020-09-15 07:34:18.815+0000: 17775: error : virNetSocketReadWire:1806 : End of file while reading data: Input/output error Sep 15 03:34:19 ovirt-test libvirtd[17775]: 2020-09-15 07:34:19.017+0000: 17780: error : virNetSASLSessionListMechanisms:393 : internal error: cannot list SASL mechanisms -4 (SASL(-4): no mechanism available: Internal Error -4 in server.c near line 1757) Sep 15 03:34:19 ovirt-test libvirtd[17775]: 2020-09-15 07:34:19.017+0000: 17780: error : remoteDispatchAuthSaslInit:3440 : authentication failed: authentication failed Sep 15 03:34:19 ovirt-test libvirtd[17775]: 2020-09-15 07:34:19.020+0000: 17775: error : virNetSocketReadWire:1806 : End of file while reading data: Input/output error Is there any way to work around that? We have working infra on top of 4.0 in CentOS 7 systems, and we would like to replicate the exact same environment for availability purposes, in case anything bad happened. Best regards, -rodri

3 4

Removal of deprecated init-scripts (network-scripts)
by Ales Musil 16 Sep '20

16 Sep '20

Hello, network-scripts for host networking were deprecated since oVirt 4.4. It will be removed completely in the 4.4.3 release. There is no action required for setups that did not change the configuration to use network-scripts backend (net_nmstate_enabled = false). Users that did disable nmstate should redeploy all affected hosts before 4.4.3. Also can you please tell us what was the reason to use network-scripts, if that is the case? Thank you. Best regards, Ales Musil -- Ales Musil Software Engineer - RHV Network Red Hat EMEA <https://www.redhat.com> amusil(a)redhat.com IM: amusil <https://red.ht/sig>

1 0

Random hosts disconnects
by Anton Louw 16 Sep '20

16 Sep '20

Hi All, I have a strange issue in my oVirt environment. I currently have a standalone manager which is running in VMware. In my oVirt environment, I have two Data Centers. The manager is currently sitting on the same subnet as DC1. Randomly, hosts in DC2 will say "Not Responding" and then 2 seconds later, the hosts will activate again. The strange thing is, when the manager was sitting on the same subnet as DC2, hosts in DC1 will randomly say "Not Responding" I have tried going through the logs, but I cannot see anything out of the ordinary regarding why the hosts would drop connection. I have attached the engine.log for anybody that would like to do a spot check. Thanks Anton Louw Cloud Engineer: Storage and Virtualization ______________________________________ D: 087 805 1572 | M: N/A A: Rutherford Estate, 1 Scott Street, Waverley, Johannesburg anton.louw(a)voxtelecom.co.za www.vox.co.za

1 0

Enable a cluster node to run the hosted engine
by rap＠isogmbh.de 16 Sep '20

16 Sep '20

Hi there, currently my team is evaluating oVirt and we're also testing several fail scenarios, backup and so on. One scenario was: - hyperconverged oVirt cluster with 3 nodes - self-hosted engine - simulate the break down of one of the nodes by power off - to replace it make a clean install of a new node and reintegrate it in the cluster Actually everything worked out fine. The new installed node and related bricks (vmstore, data, engine) were added to the existing Gluster storage and it was added to the oVirt cluster (as host). But there's one remaining problem: The new host doesn't have the grey crown, which means it's unable to run the hosted engine. How can I achieve that? I also found out that the ovirt-ha-agent and ovirt-ha-broker isn't started/enabled on that node. Reason is that the /etc/ovirt-hosted-engine/hosted-engine.conf doesn't exist. I guess this is not only a problem concerning the hosted engine, but also for HA VM's. Thank you for any advice and greetings, Marcus

3 7

Random hosts disconnects
by anton.louw＠voxtelecom.co.za 16 Sep '20

16 Sep '20

Hi All, I have a strange issue in my oVirt environment. I currently have a standalone manager which is running in VMware. In my oVirt environment, I have two Data Centers. The manager is currently sitting on the same subnet as DC1. Randomly, hosts in DC2 will say “Not Responding” and then 2 seconds later, the hosts will activate again. The strange thing is, when the manager was sitting on the same subnet as DC2, hosts in DC1 will randomly say “Not Responding” I have tried going through the logs, but I cannot see anything out of the ordinary regarding why the hosts would drop connection. I have attached the engine.log for anybody that would like to do a spot check. Thanks

1 0

Disconnected Server has closed the connection.
by info＠worldhostess.com 15 Sep '20

15 Sep '20

It seems that the installation is all done, but I have a problem. it takes very long to open the web pages, plus it disconnect all the time. it is impossible to do anything. I can ping the hostname as I set up a sub-domain for it. to be honest, I am new to this and it took me days to get to this point. I think there are some issues with my network settings. if there are any oVirt experts that can check my installation and give me advice about how to improve it, it will be greatly appreciated. I have done an "Installing oVirt as a self-hosted engine using the Cockpit web interface"

3 3

Gluster quorum issue on 3-node HCI with extra 5-nodes as compute and storage nodes
by thomas＠hoberg.net 15 Sep '20

15 Sep '20

Yes, I've also posted this on the Gluster Slack. But I am using Gluster mostly because it's part of oVirt HCI, so don't just send me away, please! Problem: GlusterD refusing to start due to quorum issues for volumes where it isn’t contributing any brick (I've had this before on a different farm, but there it was transitory. Now I have it in a more observable manner, that's why I open a new topic) In a test farm with recycled servers, I started running Gluster via oVirt 3node-HCI, because I got 3 machines originally. They were set up as group A in a 2:1 (replica:arbiter) oVirt HCI setup with 'engine', 'vmstore' and 'data' volumes, one brick on each node. I then got another five machines with hardware specs that were rather different to group A, so I set those up as group B to mostly act as compute nodes, but also to provide extra storage, mostly to be used externally as GlusterFS shares. It took a bit of fiddling with Ansible but I got these 5 nodes to serve two more Gluster volumes 'tape' and 'scratch' using dispersed bricks (4 disperse:1 redundancy), RAID5 in my mind. The two groups are in one Gluster, not because they serve bricks to the same volumes, but because oVirt doesn't like nodes to be in different Glusters (or actually, to already be in a Gluster when you add them as host node). But the two groups provide bricks to distinct volumes, there is no overlap. After setup things have been running fine for weeks, but now I needed to restart a machine from group B, which has ‘tape’ and ‘scratch’ bricks, but none from original oVirt ‘engine’, ‘vmstore’ and ‘data’ in group A. Yet the gluster daemon refuses to start, citing a loss of quorum for these three volumes, even if it has no bricks in them… which makes no sense to me. I am afraid the source of the issue is concept issues: I clearly don't really understand some design assumptions of Gluster. And I'm afraid the design assumptions of Gluster and of oVirt (even with HCI), are not as related as one might assume from the marketing materials on the oVirt home-page. But most of all I'd like to know: How do I fix this now? I can't heal 'tape' and 'scratch', which are growing ever more apart while the glusterd on this machine in group B refuses to come online for lack of a quorum on volumes where it is not contributing bricks.

3 2

What is the purpose of memory deflation in oVirt memory ballooning?
by pub.virtualization＠gmail.com 15 Sep '20

15 Sep '20

Hi, guys Why does momd(ballooning manager in oVirt) explicitly deflate the balloon when host gets plenty of memory? as far as I know, momd is supporting memory ballooning with setMemory API to inflate/deflate the balloon in guest and I've just checked the memory change in the guest after inflating the balloon. as expected, memory(total, free, available) in the guest was reduced just after inflating the balloon, but it was "automatically" restored to its initial memory after a few seconds. So, here I'm wondering why deflation is additionally required even though it can be restored automatically just after seconds. Thanks.

1 1

Posts not updating on lists.ovirt.org web site since September 10th?
by thomas＠hoberg.net 15 Sep '20

15 Sep '20

I can see new posts coming in via e-mail, but updates on the web sites have stopped and posts don't disappear?

2 1

Any eta for 4.4.2 final?
by Gianluca Cecchi 15 Sep '20

15 Sep '20

Hello, I would like to upgrade a 4.4.0 environment to the latest 4.4.2 when available. Any indication if there are any show stoppers after the rc5 released on 27th of August or any eta about other release candidates? Thanks, Gianluca

4 3

oVirt disk disappeared after importing iSCSI domain
by gantonjo-ovirt＠yahoo.com 15 Sep '20

15 Sep '20

Hi all oVirt experts. So, I managed to f.. up a VM today. I had one VM running on a oVirt 4.3 cluster, where the disk was located on an iSCSI data domain. I stopped the VM, put the storage domain in maintenance mode, detached adn removed the storage domain from the ovirt 4.3 cluster. Then I imported the storage domain to our new oVirt 4.4.1 cluster, let the process convert it from V4 to V5 format and activated the storage domain in the new cluster. Entering the information page for the imported storage domain, I expected to see "Import VM" and "Import Disk" menus, but these menues did not appear as they did for other storage domains that I successfully had moved from old to new cluster. Clicking "Scan Disks" did not help either. So, now I am stuck with a storage domain where the VM's disk is located, but oVirt is not able to see the disk. What can I do to recover the lost disk from the storage domain? Any CLI commands available in ovirt 4.4.1 would be nice. Thanks in advance for your quick and good help.

2 1

Disconnected Server has closed the connection.
by info＠worldhostess.com 15 Sep '20

15 Sep '20

It seems that the installation is all done, but I have a problem. it takes very long to open the web pages, plus it disconnect all the time. it is impossible to do anything. I can ping the hostname as I set up a sub-domain for it. to be honest, I am new to this and it took me days to get to this point. I think there are some issues with my network settings. if there are any oVirt experts that can check my installation and give me advice about how to improve it, it will be greatly appreciated. I have done an "Installing oVirt as a self-hosted engine using the Cockpit web interface"

1 0

Multiple GPU Passthrough with NVLink (Invalid I/O region)
by Vinícius Ferrão 14 Sep '20

14 Sep '20

Hello, here we go again. I’m trying to passthrough 4x NVIDIA Tesla V100 GPUs (with NVLink) to a single VM; but things aren’t that good. Only one GPU shows up on the VM. lspci is able to show the GPUs, but three of them are unusable: 08:00.0 3D controller: NVIDIA Corporation GV100GL [Tesla V100 SXM2 16GB] (rev a1) 09:00.0 3D controller: NVIDIA Corporation GV100GL [Tesla V100 SXM2 16GB] (rev a1) 0a:00.0 3D controller: NVIDIA Corporation GV100GL [Tesla V100 SXM2 16GB] (rev a1) 0b:00.0 3D controller: NVIDIA Corporation GV100GL [Tesla V100 SXM2 16GB] (rev a1) There are some errors on dmesg, regarding a misconfigured BIOS: [ 27.295972] nvidia: loading out-of-tree module taints kernel. [ 27.295980] nvidia: module license 'NVIDIA' taints kernel. [ 27.295981] Disabling lock debugging due to kernel taint [ 27.304180] nvidia: module verification failed: signature and/or required key missing - tainting kernel [ 27.364244] nvidia-nvlink: Nvlink Core is being initialized, major device number 241 [ 27.579261] nvidia 0000:09:00.0: enabling device (0000 -> 0002) [ 27.579560] NVRM: This PCI I/O region assigned to your NVIDIA device is invalid: NVRM: BAR1 is 0M @ 0x0 (PCI:0000:09:00.0) [ 27.579560] NVRM: The system BIOS may have misconfigured your GPU. [ 27.579566] nvidia: probe of 0000:09:00.0 failed with error -1 [ 27.580727] NVRM: This PCI I/O region assigned to your NVIDIA device is invalid: NVRM: BAR0 is 0M @ 0x0 (PCI:0000:0a:00.0) [ 27.580729] NVRM: The system BIOS may have misconfigured your GPU. [ 27.580734] nvidia: probe of 0000:0a:00.0 failed with error -1 [ 27.581299] NVRM: This PCI I/O region assigned to your NVIDIA device is invalid: NVRM: BAR0 is 0M @ 0x0 (PCI:0000:0b:00.0) [ 27.581300] NVRM: The system BIOS may have misconfigured your GPU. [ 27.581305] nvidia: probe of 0000:0b:00.0 failed with error -1 [ 27.581333] NVRM: The NVIDIA probe routine failed for 3 device(s). [ 27.581334] NVRM: loading NVIDIA UNIX x86_64 Kernel Module 450.51.06 Sun Jul 19 20:02:54 UTC 2020 [ 27.649128] nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms 450.51.06 Sun Jul 19 20:06:42 UTC 2020 The host is Secure Intel Skylake (x86_64). VM is running with Q35 Chipset with UEFI (pc-q35-rhel8.2.0) I’ve tried to change the I/O mapping options on the host, tried with 56TB and 12TB without success. Same results. Didn’t tried with 512GB since the machine have 768GB of system RAM. Tried blacklisting the nouveau on the host, nothing. Installed NVIDIA drivers on the host, nothing. In the host I can use the 4x V100, but inside a single VM it’s impossible. Any suggestions?

3 7

Testing ovirt 4.4.1 Nested KVM on Skylake-client (core i5) does not work
by wodel youchi 14 Sep '20

14 Sep '20

Hi, I've been using my core i5 6500 (skylake-client) for some time now to test oVirt on my machine. However this is no longer the case. I am using Fedora 32 as my base system with nested-kvm enabled, when I try to install oVirt 4.4 as HCI single node, I get an error in the last phase which consists of copying the VM-Manager to the engine volume and boot it. It is the boot that causes the problem, I get an error about the CPU : *the CPU is incompatible with host CPU: Host CPU does not provide required features: mpx* *This is the CPU part from virsh domcapabilities on my physical machine* <cpu> <mode name='host-passthrough' supported='yes'/> <mode name='host-model' supported='yes'> *<model fallback='forbid'>Skylake-Client-IBRS</model> * <vendor>Intel</vendor> <feature policy='require' name='ss'/> <feature policy='require' name='vmx'/> <feature policy='require' name='pdcm'/> <feature policy='require' name='hypervisor'/> <feature policy='require' name='tsc_adjust'/> <feature policy='require' name='clflushopt'/> <feature policy='require' name='umip'/> <feature policy='require' name='md-clear'/> <feature policy='require' name='stibp'/> <feature policy='require' name='arch-capabilities'/> <feature policy='require' name='ssbd'/> <feature policy='require' name='xsaves'/> <feature policy='require' name='pdpe1gb'/> <feature policy='require' name='invtsc'/> <feature policy='require' name='ibpb'/> <feature policy='require' name='amd-ssbd'/> <feature policy='require' name='skip-l1dfl-vmentry'/> </mode> <mode name='custom' supported='yes'> <model usable='yes'>qemu64</model> <model usable='yes'>qemu32</model> <model usable='no'>phenom</model> <model usable='yes'>pentium3</model> <model usable='yes'>pentium2</model> <model usable='yes'>pentium</model> <model usable='yes'>n270</model> <model usable='yes'>kvm64</model> <model usable='yes'>kvm32</model> <model usable='yes'>coreduo</model> <model usable='yes'>core2duo</model> <model usable='no'>athlon</model> <model usable='yes'>Westmere-IBRS</model> <model usable='yes'>Westmere</model> <model usable='no'>Skylake-Server-IBRS</model> <model usable='no'>Skylake-Server</model> <model usable='yes'>Skylake-Client-IBRS</model> <model usable='yes'>Skylake-Client</model> <model usable='yes'>SandyBridge-IBRS</model> <model usable='yes'>SandyBridge</model> <model usable='yes'>Penryn</model> <model usable='no'>Opteron_G5</model> <model usable='no'>Opteron_G4</model> <model usable='no'>Opteron_G3</model> <model usable='yes'>Opteron_G2</model> <model usable='yes'>Opteron_G1</model> <model usable='yes'>Nehalem-IBRS</model> <model usable='yes'>Nehalem</model> <model usable='yes'>IvyBridge-IBRS</model> <model usable='yes'>IvyBridge</model> <model usable='no'>Icelake-Server</model> <model usable='no'>Icelake-Client</model> <model usable='yes'>Haswell-noTSX-IBRS</model> <model usable='yes'>Haswell-noTSX</model> <model usable='yes'>Haswell-IBRS</model> <model usable='yes'>Haswell</model> <model usable='no'>EPYC-IBPB</model> <model usable='no'>EPYC</model> <model usable='no'>Dhyana</model> <model usable='yes'>Conroe</model> <model usable='no'>Cascadelake-Server</model> <model usable='yes'>Broadwell-noTSX-IBRS</model> <model usable='yes'>Broadwell-noTSX</model> <model usable='yes'>Broadwell-IBRS</model> <model usable='yes'>Broadwell</model> <model usable='yes'>486</model> </mode> </cpu> *Here is the lscpu of my physical machine* # lscpu Architecture: x86_64 CPU op-mode(s): 32-bit, 64-bit Byte Order: Little Endian Address sizes: 39 bits physical, 48 bits virtual CPU(s): 4 On-line CPU(s) list: 0-3 Thread(s) per core: 1 Core(s) per socket: 4 Socket(s): 1 NUMA node(s): 1 Vendor ID: GenuineIntel CPU family: 6 Model: 94 Model name: Intel(R) Core(TM) i5-6500 CPU @ 3.20GHz Stepping: 3 CPU MHz: 954.588 CPU max MHz: 3600.0000 CPU min MHz: 800.0000 BogoMIPS: 6399.96 Virtualization: VT-x L1d cache: 128 KiB L1i cache: 128 KiB L2 cache: 1 MiB L3 cache: 6 MiB NUMA node0 CPU(s): 0-3 Vulnerability Itlb multihit: KVM: Mitigation: Split huge pages Vulnerability L1tf: Mitigation; PTE Inversion; VMX conditional cache flushes, SMT disabled Vulnerability Mds: Mitigation; Clear CPU buffers; SMT disabled Vulnerability Meltdown: Mitigation; PTI Vulnerability Spec store bypass: Mitigation; Speculative Store Bypass disabled via prctl and seccomp Vulnerability Spectre v1: Mitigation; usercopy/swapgs barriers and __user pointer sanitization Vulnerability Spectre v2: Mitigation; Full generic retpoline, IBPB conditional, IBRS_FW, STIBP disabled, RSB filling Vulnerability Srbds: Vulnerable: No microcode Vulnerability Tsx async abort: Mitigation; Clear CPU buffers; SMT disabled Flags: fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx pdpe1gb rdtscp lm constan t_tsc art arch_perfmon pebs bts rep_good nopl xtopology nonstop_tsc cpuid aperfmperf pni pclmulqdq dtes64 monitor ds_cpl vmx smx est tm2 ssse3 sdbg fma cx16 xtpr pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand lahf_lm abm 3dnowprefetch cpuid_fault invpcid_single pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid ept_ad fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm *mpx* rdseed adx smap clflushopt in tel_pt xsaveopt xsavec xgetbv1 xsaves dtherm ida arat pln pts hwp hwp_notify hwp_act_window hwp_epp md_clear flush_l1d *Here is the CPU part from virsh dumpxml of my ovirt hypervisor* <cpu mode='custom' match='exact' check='full'> <model fallback='forbid'>Skylake-Client-IBRS</model> <vendor>Intel</vendor> <feature policy='require' name='ss'/> <feature policy='require' name='vmx'/> <feature policy='require' name='pdcm'/> <feature policy='require' name='hypervisor'/> <feature policy='require' name='tsc_adjust'/> <feature policy='require' name='clflushopt'/> <feature policy='require' name='umip'/> <feature policy='require' name='md-clear'/> <feature policy='require' name='stibp'/> <feature policy='require' name='arch-capabilities'/> <feature policy='require' name='ssbd'/> <feature policy='require' name='xsaves'/> <feature policy='require' name='pdpe1gb'/> <feature policy='require' name='ibpb'/> <feature policy='require' name='amd-ssbd'/> <feature policy='require' name='skip-l1dfl-vmentry'/> <feature policy='disable' name='mpx'/> </cpu> *Here is the lcpu of my ovirt hypervisor* [root@node1 ~]# lscpu Architecture : x86_64 Mode(s) opératoire(s) des processeurs : 32-bit, 64-bit Boutisme : Little Endian Processeur(s) : 4 Liste de processeur(s) en ligne : 0-3 Thread(s) par cœur : 1 Cœur(s) par socket : 1 Socket(s) : 4 Nœud(s) NUMA : 1 Identifiant constructeur : GenuineIntel Famille de processeur : 6 Modèle : 94 Nom de modèle : Intel Core Processor (Skylake, IBRS) Révision : 3 Vitesse du processeur en MHz : 3191.998 BogoMIPS : 6383.99 Virtualisation : VT-x Constructeur d'hyperviseur : KVM Type de virtualisation : complet Cache L1d : 32K Cache L1i : 32K Cache L2 : 4096K Cache L3 : 16384K Nœud NUMA 0 de processeur(s) : 0-3 Drapaux : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc rep_go od nopl xtopology cpuid tsc_known_freq pni pclmulqdq vmx ssse3 fma cx16 pdcm pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnow prefetch cpuid_fault invpcid_single pti ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap clflushopt xs aveopt xsavec xgetbv1 xsaves arat umip md_clear arch_capabilities it seems not all the flags are presented to the hypervisor especially the mpx which causes the error Is there a workaround for this? Regards.

4 6

oVirt HCI issue: GlusterD refusing to start due to quorum issues for volumes where it isn’t contributing any brick
by thomas＠hoberg.net 14 Sep '20

14 Sep '20

Sorry if it's a duplicate: I go an error on post... And yes I posted it on the Gluster slack first, but I am using Gluster only because the marketing on oVirt HCI worked so well... I got 3 recycled servers for an oVirt test environment first and set those up as 3-node HCI using defaults mostly, 2 replica + 1 arbiter, 'engine', 'vmstore' and 'data' volumes with single bricks for each node. I call these group A. Then I got another set of five machines, let's call them group B, with somewhat different hardware characteristics than group A, but nicely similar between themselves. I wanted to add these to the farm as compute nodes but also use their storage as general GlusterFS storage for a wider use. Group B machines were added as hosts and set up to run hosted-engine, but they do not contribute bricks to the normal oVirt volumes 'engine', 'vmstore' or 'data'. With some Ansible trickery I managed to set up two dispersed volumes (4 data: 1 redundancy) on group B 'scratch' and 'tape', mostly for external GlusterFS use. oVirt picked them up automagically, so I guess they could also be used with VMs. I expect to get more machines and adding them one-by-one to dispersed volumes with a fine balance between capacity and redundancy made me so enthusiastic about oVirt HCI in the first place... After some weeks of fine operation I had to restart a machine from group B for maintenance. When it came back up, GlusterD refuses to come online, because it doesn't have "quorum for volumes 'engine', 'vmstore' and 'data'".... It's a small surprise it doesn't *have* quorum, what's a bigger surprise is that it *asks* for quorum in a volume where it's not contributing any bricks. What's worse is that it then refuses to start serving its bricks for 'scratch' and 'tape', which are now growing apart without any chance of healing. How do I fix this? Is this a bug (my interpretation) or do I fundamentlly misunderstand how Gluster as a hyper scale out file system is supposed to work with potentially thousands of hosts contributing each dozens of bricks to each of hundreds of volumes in a single name space?

1 0

Probably dns problem: Internal JSON-RPC error
by jan.kleefeld＠jan-home.de 14 Sep '20

14 Sep '20

I have a clean installed CentOS 8.2 2004 on my server. The self hosted engine deploy (ovirt-4.4) aborts with the following message: [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "The host has been set in non_operational status, deployment errors: code 505: Host red.colors.ovirt.local installation failed. Failed to configure management network on the host., code 1120: Failed to configure management network on host red.colors.ovirt.local due to setup networks failure., code 9000: Failed to verify Power Management configuration for Host red.colors.ovirt.local., code 10802: VDSM red.colors.ovirt.local command HostSetupNetworksVDS failed: Internal JSON-RPC error: {'reason': ' desired ======= --- dns-resolver: search: [] server: - 192.168.2.150 - fe80::1%eno1 current ======= --- dns-resolver: search: [] server: - 192.168.2.150 difference ========== --- desired +++ current @@ -3,4 +3,3 @@ search: [] server: - 192.168.2.150 - - fe80::1%eno1 '}, fix accordingly and re-deploy."} ~# cat /etc/resolv.conf # Generated by NetworkManager search colors.ovirt.local nameserver 192.168.2.150 nameserver fe80::1%eno1 I am confused, because the probalby missing line is present. Is there maybe another config file, where this last line could be missing? Maybe I can force somehow the installer, to reload the resolv conf, so it can fetch ne new line? I appreciate your help. Jan

3 3

OVN Geneve tunnels not been established
by Konstantinos B 11 Sep '20

11 Sep '20

Hi all We have a small installation based on OVIRT 4.3. 1 Cluster is based on Centos 7 and the other on OVIRT NG Node image. The environment was stable till an upgrade took place a couple of months ago. As such we had to re-install one of the Centos 7 node and start from scratch. Even though the installation completed successfully and VMs are created, the following are not working as expected: 1. ovn geneve tunnels are not established with the other Centos 7 node in the cluster. 2. Centos 7 node is configured by ovirt engine however no geneve tunnel is established when "ovn-sbctl show" is issued on the engine. 3. no flows are shown on the engine on port 6642 for the ovs db. Does anyone have any experience on how to troubleshoot OVN on ovirt? Thank you

2 1

"Add NFS storage domain", "status": "FAILED",
by info＠worldhostess.com 10 Sep '20

10 Sep '20

I am new to oVirt and this is my first installation https://ovirt.org/documentation/installing_ovirt_as_a_self-hosted_engine_us ing_the_cockpit_web_interface/ Everything seems fine, but then when I tried step 5, "Hosted Engine Deployment" it keep giving me this error. This information might be too much, but I am not familiar to know what is important. 2020-09-08 06:53:58,991+0200 DEBUG var changed: host "localhost" var "datacenter_name" type "<class 'ansible.utils.unsafe_proxy.AnsibleUnsafeText'>" value: ""Default"" 2020-09-08 06:53:58,991+0200 INFO ansible ok {'status': 'OK', 'ansible_type': 'task', 'ansible_playbook': '/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml', 'ansible_host': 'localhost', 'ansible_task': 'Fetch Datacenter name', 'task_duration': 0} 2020-09-08 06:53:58,991+0200 DEBUG ansible on_any args <ansible.executor.task_result.TaskResult object at 0x7f825fb425c0> kwargs 2020-09-08 06:53:59,242+0200 INFO ansible task start {'status': 'OK', 'ansible_type': 'task', 'ansible_playbook': '/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml', 'ansible_task': 'ovirt.hosted_engine_setup : Add NFS storage domain'} 2020-09-08 06:53:59,242+0200 DEBUG ansible on_any args TASK: ovirt.hosted_engine_setup : Add NFS storage domain kwargs is_conditional:False 2020-09-08 06:53:59,242+0200 DEBUG ansible on_any args localhostTASK: ovirt.hosted_engine_setup : Add NFS storage domain kwargs 2020-09-08 06:56:04,962+0200 DEBUG var changed: host "localhost" var "ansible_play_hosts" type "<class 'list'>" value: "[]" 2020-09-08 06:56:04,963+0200 DEBUG var changed: host "localhost" var "ansible_play_batch" type "<class 'list'>" value: "[]" 2020-09-08 06:56:04,963+0200 DEBUG var changed: host "localhost" var "play_hosts" type "<class 'list'>" value: "[]" 2020-09-08 06:56:04,963+0200 ERROR ansible failed { "ansible_host": "localhost", "ansible_playbook": "/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml", "ansible_result": { "_ansible_no_log": false, "changed": false, "exception": "Traceback (most recent call last):\n File \"/tmp/ansible_ovirt_storage_domain_payload_ir_v98cz/ansible_ovirt_storage_d omain_payload.zip/ansible/modules/cloud/ovirt/ovirt_storage_domain.py\", line 792, in main\n File \"/tmp/ansible_ovirt_storage_domain_payload_ir_v98cz/ansible_ovirt_storage_d omain_payload.zip/ansible/module_utils/ovirt.py\", line 623, in create\n **kwargs\n File \"/usr/lib64/python3.6/site-packages/ovirtsdk4/services.py\", line 26097, in add\n return self._internal_add(storage_domain, headers, query, wait)\n File \"/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py\", line 232, in _internal_add\n return future.wait() if wait else future\n File \"/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py\", line 55, in wait\n return self._code(response)\n File \"/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py\", line 229, in callback\n self._check_fault(response)\n File \"/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py\", line 132, in _check_fault\n self._raise_error(response, body)\n File \"/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py\", line 118, in _raise_error\n raise error\novirtsdk4.Error: Fault reason is \"Operation Failed\". Fault detail is \"[Problem while trying to mount target]\". HTTP response code is 400.\n", "invocation": { "module_args": { "backup": null, "comment": null, "critical_space_action_blocker": null, "data_center": "Default", "description": null, "destroy": null, "discard_after_delete": null, "domain_function": "data", "fcp": null, "fetch_nested": false, "format": null, "glusterfs": null, "host": "host.worldhostess.co.za", "id": null, "iscsi": null, "localfs": null, "managed_block_storage": null, "name": "hosted_storage", "nested_attributes": [], "nfs": { "address": "storage01.worldhostess.co.za", "mount_options": null, "path": "/data/nfs", "version": "auto" }, "poll_interval": 3, "posixfs": null, "state": "unattached", "timeout": 180, "wait": true, "warning_low_space": null, "wipe_after_delete": null } }, "msg": "Fault reason is \"Operation Failed\". Fault detail is \"[Problem while trying to mount target]\". HTTP response code is 400." }, "ansible_task": "Add NFS storage domain", "ansible_type": "task", "status": "FAILED", "task_duration": 125 } 2020-09-08 06:56:04,963+0200 DEBUG ansible on_any args <ansible.executor.task_result.TaskResult object at 0x7f825f9c3a58> kwargs ignore_errors:None 2020-09-08 06:56:04,964+0200 INFO ansible stats { "ansible_playbook": "/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml", "ansible_playbook_duration": "02:16 Minutes", "ansible_result": "type: <class 'dict'>\nstr: {'localhost': {'ok': 14, 'failures': 1, 'unreachable': 0, 'changed': 0, 'skipped': 2, 'rescued': 0, 'ignored': 0}}", "ansible_type": "finish", "status": "FAILED" } 2020-09-08 06:56:04,964+0200 INFO SUMMARY: Duration Task Name -------- -------- [ < 1 sec ] Execute just a specific set of steps [ 00:01 ] Force facts gathering [ < 1 sec ] Check local VM dir stat [ < 1 sec ] Obtain SSO token using username/password credentials [ < 1 sec ] Fetch host facts [ < 1 sec ] Fetch cluster ID [ < 1 sec ] Fetch cluster facts [ < 1 sec ] Fetch Datacenter facts [ < 1 sec ] Fetch Datacenter ID [ < 1 sec ] Fetch Datacenter name [ FAILED ] Add NFS storage domain 2020-09-08 06:56:04,965+0200 DEBUG ansible on_any args <ansible.executor.stats.AggregateStats object at 0x7f826252ef60> kwargs Yours Sincerely, Dr Henni Appelgryn PhD DBA MBA AEP MDP WorldHostess Skype: genie_za WeChat: HenniAppelgryn LinkedIn: https://www.linkedin.com/in/henni-appelgryn/ Hosting with a difference

4 7

Failed to create a new VM in ovirt due to "The host did not satisfy internal filter Memory" error
by KISHOR K 10 Sep '20

10 Sep '20

Hi All, I'm new to Ovirt and not having a perfect experience with Ovirt yet. I ran into a strange issue today when I tried to create a new VM with 32GB in ovirt. VM creation basically due to an error, pasted below. Cannot run VM. There is no host that satisfies current scheduling constraints. See below for details:, The host host-01 did not satisfy internal filter Memory., The host host-01 did not satisfy internal filter Memory. After some troubleshooting, I found that there was enough available memory (around 120 GB free ) in the host to host new VM and there were around 10 VMs already running on this host. But, I noticed that ovirt is actually scheduling and creating VM based on "Max free Memory for scheduling new VMs" value, which seems to be set/updated based on total allocated memory for all VMs running on the host and it's not really the then consumed memory by running VMs. Can anyone help to explain if it is some kind of bug in ovirt or it expected behavior? If it is expected behavior, is there any possibility to change it to make sure VM is created based on actual free memory? Thanks a lot in advance for your support. /Kishore /Kishore

4 8

Diskless oVirt Nodes
by harryo.dk＠gmail.com 10 Sep '20

10 Sep '20

Hi, why does my ovirt hypervisor node crash when i pull the hypervisor boot drive? The following thread claims that the oVirt node hypervisor should lodad into memory, so boot disk failure shouldn't have any impact on a running node. https://lists.ovirt.org/pipermail/users/2014-December/029771.html Only memory failure should have a impact, and if RAM fails there is a possibility that the hypervisor OS would have crashed regardless. If you load the hypervisor OS into memory there will be moved/combined a point of failure (the boot disk) with another(the RAM). RAM=memory

3 6

Hyperconverged set up with Gluster and 6 Nodes
by Holger Petrick 09 Sep '20

09 Sep '20

Dear All, in all documentation to set up oVirt in a Hyperconverged system with Gluster says that it must have 3 Enterprise nodes. In our test environment we set up successfully with oVirt wizard an oVirt cluster with gluster + Arbiter and hosted engine. Is it also possible to build a cluster with 6 nodes? The wizard gives only the option to add 3 nodes. Is this kind of design supported? My idea is, first to set up the Gluster, then install the oVirt nodes and deploy the engine. Would this work? Any documentation avaiable? Thanks Holger

3 5

Hosted engine install failure: ipv6.gateway: gateway cannot be set if there are no addresses configured
by Sverker Abrahamsson 08 Sep '20

08 Sep '20

Hi, I'm attempting to install hosted engine but getting this failure: [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "The host has been set in non_operational status, deployment errors: code 505: Host h1-mgmt.limetransit.com installation failed. Failed to configure management network on the host., code 1120: Failed to configure management network on host h1-mgmt.limetransit.com due to setup networks failure., code 9000: Failed to verify Power Management configuration for Host h1-mgmt.limetransit.com., code 10802: VDSM h1-mgmt.limetransit.com command HostSetupNetworksVDS failed: Internal JSON-RPC error: {'reason': 'Unexpected failure of libnm when running the mainloop: run execution'}, fix accordingly and re-deploy."} Looking in vdsm.log I find this which I believe is the root cause: MainProcess|jsonrpc/0::DEBUG::2020-09-02 16:38:25,897::supervdsm_server::93::SuperVdsm.ServerCallback::(wrapper) call setupNetworks with ({'ovirtmgmt': {'vlan': '4000', 'netmask': '255.255.255.0', 'ipv6autoconf': False, 'nic': 'enp4s0', 'bridged': 'true', 'ipaddr': '172.27.1.1', 'defaultRoute': True, 'dhcpv6': False, 'STP': 'no', 'mtu': 1500, 'switch': 'legacy'}}, {}, {'connectivityTimeout': 120, 'commitOnSuccess': True, 'connectivityCh eck': 'true'}) {} MainProcess|jsonrpc/0::INFO::2020-09-02 16:38:25,897::api::220::root::(setupNetworks) Setting up network according to configuration: networks:{'ovirtmgmt': {'vlan': '4000', 'netmask': '255.255.255.0', 'ipv6autoconf': Fal se, 'nic': 'enp4s0', 'bridged': 'true', 'ipaddr': '172.27.1.1', 'defaultRoute': True, 'dhcpv6': False, 'STP': 'no', 'mtu': 1500, 'switch': 'legacy'}}, bondings:{}, options:{'connectivityTimeout': 120, 'commitOnSuccess': True, 'connectivityCheck': 'true'} MainProcess|jsonrpc/0::DEBUG::2020-09-02 16:38:25,902::cmdutils::130::root::(exec_cmd) /sbin/tc qdisc show (cwd None) MainProcess|jsonrpc/0::DEBUG::2020-09-02 16:38:25,906::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/0::DEBUG::2020-09-02 16:38:25,945::vsctl::74::root::(commit) Executing commands: /usr/bin/ovs-vsctl --timeout=5 --oneline --format=json -- list Bridge -- list Port -- list Interface MainProcess|jsonrpc/0::DEBUG::2020-09-02 16:38:25,945::cmdutils::130::root::(exec_cmd) /usr/bin/ovs-vsctl --timeout=5 --oneline --format=json -- list Bridge -- list Port -- list Interface (cwd None) MainProcess|jsonrpc/0::DEBUG::2020-09-02 16:38:25,952::cmdutils::138::root::(exec_cmd) SUCCESS: <err> = b''; <rc> = 0 MainProcess|jsonrpc/0::INFO::2020-09-02 16:38:25,957::netconfpersistence::58::root::(setNetwork) Adding network ovirtmgmt({'vlan': 4000, 'netmask': '255.255.255.0', 'ipv6autoconf': False, 'nic': 'enp4s0', 'bridged': True , 'ipaddr': '172.27.1.1', 'defaultRoute': True, 'dhcpv6': False, 'mtu': 1500, 'switch': 'legacy', 'stp': False, 'bootproto': 'none', 'nameservers': ['213.133.98.98']}) MainProcess|jsonrpc/0::DEBUG::2020-09-02 16:38:25,958::commands::153::common.commands::(start) /usr/bin/taskset --cpu-list 0-7 /usr/libexec/vdsm/hooks/before_network_setup/50_fcoe (cwd None) MainProcess|jsonrpc/0::INFO::2020-09-02 16:38:26,154::hooks::122::root::(_runHooksDir) /usr/libexec/vdsm/hooks/before_network_setup/50_fcoe: rc=0 err=b'' MainProcess|jsonrpc/0::INFO::2020-09-02 16:38:26,155::configurator::195::root::(_setup_nmstate) Processing setup through nmstate MainProcess|jsonrpc/0::INFO::2020-09-02 16:38:26,175::configurator::197::root::(_setup_nmstate) Desired state: {'interfaces': [{'name': 'enp4s0', 'state': 'up', 'mtu': 1500}, {'vlan': {'id': 4000, 'base-iface': 'enp4s0'} , 'name': 'enp4s0.4000', 'type': 'vlan', 'state': 'up', 'mtu': 1500, 'ipv4': {'enabled': False}, 'ipv6': {'enabled': False}}, {'name': 'ovirtmgmt', 'type': 'linux-bridge', 'state': 'up', 'mtu': 1500, 'bridge': {'port': [ {'name': 'enp4s0.4000'}], 'options': {'stp': {'enabled': False}}}, 'ipv4': {'enabled': True, 'address': [{'ip': '172.27.1.1', 'prefix-length': 24}], 'dhcp': False}, 'ipv6': {'enabled': False}}], 'dns-resolver': {'config' : {'server': ['213.133.98.98']}}} MainProcess|jsonrpc/0::DEBUG::2020-09-02 16:38:26,217::checkpoint::121::root::(create) Checkpoint /org/freedesktop/NetworkManager/Checkpoint/1 created for all devices: 60 MainProcess|jsonrpc/0::DEBUG::2020-09-02 16:38:26,218::netapplier::239::root::(_add_interfaces) Adding new interfaces: ['ovirtmgmt'] MainProcess|jsonrpc/0::DEBUG::2020-09-02 16:38:26,221::netapplier::251::root::(_edit_interfaces) Editing interfaces: ['enp4s0.4000', 'enp4s0'] MainProcess|jsonrpc/0::DEBUG::2020-09-02 16:38:26,224::nmclient::136::root::(execute_next_action) Executing NM action: func=add_connection_async MainProcess|jsonrpc/0::DEBUG::2020-09-02 16:38:26,231::connection::329::root::(_add_connection_callback) Connection adding succeeded: dev=ovirtmgmt MainProcess|jsonrpc/0::DEBUG::2020-09-02 16:38:26,232::nmclient::136::root::(execute_next_action) Executing NM action: func=commit_changes_async MainProcess|jsonrpc/0::ERROR::2020-09-02 16:38:26,233::nmclient::200::root::(quit) NM main-loop aborted: Connection update failed: error=nm-connection-error-quark: ipv6.gateway: gateway cannot be set if there are no addresses configured (7), dev=enp4s0/<enum NM_DEVICE_STATE_ACTIVATED of type NM.DeviceState> MainProcess|jsonrpc/0::DEBUG::2020-09-02 16:38:26,246::checkpoint::164::root::(rollback) Checkpoint /org/freedesktop/NetworkManager/Checkpoint/1 rollback executed: dbus.Dictionary({dbus.String('/org/freedesktop/NetworkManager/Devices/6'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/7'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/8'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/9'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/3'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/2'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/4'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/1'): dbus.UInt32(0), dbus.String('/org/freedesktop/NetworkManager/Devices/5'): dbus.UInt32(0)}, signature=dbus.Signature('su')) MainProcess|jsonrpc/0::ERROR::2020-09-02 16:38:31,251::supervdsm_server::97::SuperVdsm.ServerCallback::(wrapper) Error in setupNetworks Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vdsm/supervdsm_server.py", line 95, in wrapper res = func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/vdsm/network/api.py", line 241, in setupNetworks _setup_networks(networks, bondings, options, net_info) File "/usr/lib/python3.6/site-packages/vdsm/network/api.py", line 266, in _setup_networks networks, bondings, options, net_info, in_rollback File "/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py", line 154, in setup _setup_nmstate(networks, bondings, options, in_rollback) File "/usr/lib/python3.6/site-packages/vdsm/network/netswitch/configurator.py", line 199, in _setup_nmstate nmstate.setup(desired_state, verify_change=not in_rollback) File "/usr/lib/python3.6/site-packages/vdsm/network/nmstate.py", line 63, in setup state_apply(desired_state, verify_change=verify_change) File "/usr/lib/python3.6/site-packages/libnmstate/deprecation.py", line 40, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/libnmstate/nm/nmclient.py", line 96, in wrapped ret = func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", line 73, in apply state.State(desired_state), verify_change, commit, rollback_timeout File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", line 163, in _apply_ifaces_state con_profiles=ifaces_add_configs + ifaces_edit_configs, File "/usr/lib64/python3.6/contextlib.py", line 88, in __exit__ next(self.gen) File "/usr/lib/python3.6/site-packages/libnmstate/netapplier.py", line 232, in _setup_providers mainloop.run(timeout=MAINLOOP_TIMEOUT) File "/usr/lib/python3.6/site-packages/libnmstate/nm/nmclient.py", line 177, in run f"Unexpected failure of libnm when running the mainloop: {err}" libnmstate.error.NmstateLibnmError: Unexpected failure of libnm when running the mainloop: run execution My host have a main network interface and a vlan interface on the same physical interface which is an internal management network which should be used as management network. The vlan interface doesn't have any ipv6 interface, but nmclient fails on setting ipv6 gateway. This seems like a bug? /Sverker _______________________________________________ discuss mailing list discuss(a)openvswitch.org https://mail.openvswitch.org/mailman/listinfo/ovs-discuss

4 21

iSCSI multipath issue
by Nick Kas 08 Sep '20

08 Sep '20

Hello evryone, setup ovirt 4.4.1 on CentOS 8.2 as an experiment, and I am trying to get an iSCSI domain working but have issues. The little experimental cluster has 3 hosts. There is an ovirtmgmt network on the default vlan, and two iSCSI network (172.27.0/1.X) with vlans 20/21. ovirtmgmt has all the functions (Data, display, migration etc), and the iSCSI networks nothing yet, and they are not set as required. The SAN device is already serving a few iSCSI volumes to a vmware cluster, so I know things are fine on this end. It has two controllers, and four NICs per controller so a total of 8 NICs, half of the NICS per controller on 172.27.0.X and half on 172.27.1.X. When I create the iSCSI domain, I login to only one of the targets, and add the Volume, all is good and I can use the disc fine. However when I login to more than one of the targets, then I start having issues with the Volume. Even when I enabled multipath in the cluster, and I created a single multipath by selecting both of the 172.27.0/1.X networks, and all the targets, the end result was the same. The hosts have difficulty accessing the volume, they may even swing between 'non-operational' and 'up' if I transfer data to the volume. When I ssh to the hosts and i check things in the command line I also get inconsistent results between hosts, and blocks that appear with lsblk when I first setup iSCSI have dissapeared after I try to actively use the volume. I am new to iSCSI so I am not sure how to debug this. I am not sure if my multipath configuration is correct or not. The documentation on this part was not very detailed. I also tried to remove the domain, and try to experiment with mounting the iSCSI volume from the command line, but I cannot even discover the target from the command line, which is very bizarre. The command iscsiadm --mode discovery --target sendtargets --portal 172.27.0.55 --discover returns the message 'iscsiadm: cannot make connection to 172.27.0.55: No route to host'. Yet through ovirt, and if I select only one target, everything work fine! Any suggestions on how to start debugging this would really be appreciated.

2 3

New Installation OVIRT NODE 4.4.1
by henni＠africadragon.com 08 Sep '20

08 Sep '20

I am on step 5, but I am not sure what I am doing wrong. I get the following error. Any help will be appreciated. I have a subdomain, but I am not sure if it is needed. I am not sure if I have to add things in /etc/hosts [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Obtain SSO token using username/password credentials] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Fetch host facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Fetch cluster ID] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Fetch cluster facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Fetch Datacenter facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Fetch Datacenter ID] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Fetch Datacenter name] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.hosted_engine_setup : Add NFS storage domain] [ ERROR ] ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Problem while trying to mount target]". HTTP response code is 400. [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Fault reason is \"Operation Failed\". Fault detail is \"[Problem while trying to mount target]\". HTTP response code is 400."}

2 1

Engine certificate and HTTPS : broken on recent Firefox
by Michaël Couren 08 Sep '20

08 Sep '20

Hi, Is there a "verified"* way to add a valid certificate to an oVirt 4.3 engine ? (or suppress HTTP Strict Transport Security) It is no more possible to add a security exception (on latest Firefox 80.0.1 Linux) and I don't want to use 2 browsers (like sanp-chromium just for oVirt...) *"verified" : I mean we have already tried official doc (many months ago) but with no success Thanks -- Cordialement / Best regards, Michaël Couren, ABES, Montpellier, France.

2 1

Using Ansible to automate failed Drive replacement
by kushagra2agarwal＠gmail.com 07 Sep '20

07 Sep '20

Do we have any inbuild ansible modules/tasks which can help to automate replacing failed drive/volume in oVirt hypervisor

3 5

Re: KeyCloak Integration
by Artur Socha 07 Sep '20

07 Sep '20

Hi Anton, Just to let you know. I investigated this issue. If you want to use keycloak in version >=10 you would need to define all additional scopes as 'optional client scopes' in your client configuration. In my case, on my test environment, I only had to add 'ovirt-ext=auth:sequence-priority=~' but in your case you may need all listed in error_description: *{"error_description":"Cannot authenticate user Invalid scopes: ovirt-app-api ovirt-ext=revoke:revoke-all ovirt-ext=token-info:authz-search ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate ovirt-ext=token:password-access.","error":"access_denied"}* This configuration change is required because it has been changed/fixed how 'unknown' scopes are handled in keycloak. Now keycloak must always be aware of all scopes and previously unknown ones were simply ignored. Here is BZ with details: https://bugzilla.redhat.com/show_bug.cgi?id=1849569 best, Artur On Tue, Jun 23, 2020 at 5:03 PM Artur Socha <asocha(a)redhat.com> wrote: > On Tue, 2020-06-23 at 14:41 +0000, Anton Louw wrote: > > > > Hi Artur, > > > > Apologies for the late response. So we have downgraded the version of > KeyCloak, and all seems to be working 100% again, I can obtain a token, and > do API calls. > > Hi Anton, > I'm glad it works now. This keycloak version (9.0.x) will stay for some > time the recommended & supported choice for oVirt because it is part of > 'Red Hat SSO' just like oVirt is part of 'Red Hat Virtualization'. > Artur > > > > Thank you very much for all the help > > > > *From:* Artur Socha <asocha(a)redhat.com> > *Sent:* 22 June 2020 16:52 > *To:* Anton Louw <Anton.Louw(a)voxtelecom.co.za>; users(a)ovirt.org > *Cc:* Stephen Hutchinson <Stephen.Hutchinson(a)voxtelecom.co.za> > *Subject:* Re: [ovirt-users] KeyCloak Integration > > > > On Mon, 2020-06-22 at 15:14 +0200, Artur Socha wrote: > > Anton, > > I managed to re-create the issue on my local environment. > > Previously I tested it against Keycloak 8.0.1 with users loaded from LDAP. > Currently I have users/groups created via Keycloak management panel. I need > to investigate it further which of the two changes is the root cause (it > works fine with the old setup) > > > > One more update: it seems the issue is keycloak version related. Trying to > figure out what was changed and how it affected engine sso integration. > > > > Latest keycloak version I tested and verified that works is 9.0.3. Perhaps > it could be possible for you to use it until we fully support 10.0.x ? > > Artur > > > > *Anton Louw* > *Cloud Engineer: Storage and Virtualization* at *Vox* > ------------------------------ > *T:* 087 805 0000 | *D:* 087 805 1572 > *M:* N/A > *E:* anton.louw(a)voxtelecom.co.za > *A:* Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za > > [image: F] <https://www.facebook.com/voxtelecomZA> > [image: T] <https://www.twitter.com/voxtelecom> > [image: I] <https://www.instagram.com/voxtelecomza/> > [image: L] <https://www.linkedin.com/company/voxtelecom> > [image: Y] <https://www.youtube.com/user/VoxTelecom> > > Artur > > > > On Mon, 2020-06-22 at 11:05 +0000, Anton Louw wrote: > > > > Hi Artur, > > > > Great, thanks a lot! 😊 > > > > > > *Anton Louw* > > *Cloud Engineer: Storage and Virtualization* at *Vox* > ------------------------------ > > *T:* 087 805 0000 | *D:* 087 805 1572 > *M:* N/A > *E:* anton.louw(a)voxtelecom.co.za > *A:* Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za > > > > [image: F] <https://www.facebook.com/voxtelecomZA> > > > > [image: T] <https://www.twitter.com/voxtelecom> > > > > [image: I] <https://www.instagram.com/voxtelecomza> > > > > [image: L] <https://www.linkedin.com/company/voxtelecom> > > > > [image: Y] <https://www.youtube.com/user/VoxTelecom> > > > > > > *From:* Artur Socha <asocha(a)redhat.com> > *Sent:* 22 June 2020 11:23 > *To:* Anton Louw <Anton.Louw(a)voxtelecom.co.za>; users(a)ovirt.org > *Cc:* Stephen Hutchinson <Stephen.Hutchinson(a)voxtelecom.co.za> > *Subject:* Re: [ovirt-users] KeyCloak Integration > > > > Hi Anton, > > Thanks for the specs. I have create BZ issue for tracking: > > https://bugzilla.redhat.com/show_bug.cgi?id=1849569 > > Feel free to add comments/change it when needed. > > > > Artur > > > > On Fri, 2020-06-19 at 10:57 +0000, Anton Louw wrote: > > > > Hi Artur, > > > > Please see below: > > > > ovirt-engine.noarch 4.3.10.4-1.el7 @ovirt-4.3 > > ovirt-engine-extension-aaa-misc.noarch 1.0.4-1.el7 @ovirt-4.3 > > mod_auth_openidc.x86_64 1.8.8-5.el7 @base > > > > [root@virt ~]# cat /etc/*elease > > CentOS Linux release 7.7.1908 (Core) > > NAME="CentOS Linux" > > VERSION="7 (Core)" > > ID="centos" > > ID_LIKE="rhel fedora" > > VERSION_ID="7" > > PRETTY_NAME="CentOS Linux 7 (Core)" > > ANSI_COLOR="0;31" > > CPE_NAME="cpe:/o:centos:centos:7" > > HOME_URL="https://www.centos.org/" > > BUG_REPORT_URL="https://bugs.centos.org/" > > > > CENTOS_MANTISBT_PROJECT="CentOS-7" > > CENTOS_MANTISBT_PROJECT_VERSION="7" > > REDHAT_SUPPORT_PRODUCT="centos" > > REDHAT_SUPPORT_PRODUCT_VERSION="7" > > > > CentOS Linux release 7.7.1908 (Core) > > CentOS Linux release 7.7.1908 (Core) > > > > KeyCloak – > > > > Server Version > > 10.0.1 > > > > Thanks a lot for your help Artur. Please let me know if you need anything > else. > > > > *From:* Artur Socha <asocha(a)redhat.com> > *Sent:* 19 June 2020 12:39 > *To:* Anton Louw <Anton.Louw(a)voxtelecom.co.za>; users(a)ovirt.org > *Cc:* Stephen Hutchinson <Stephen.Hutchinson(a)voxtelecom.co.za> > *Subject:* Re: [ovirt-users] KeyCloak Integration > > > > On Fri, 2020-06-19 at 10:21 +0000, Anton Louw wrote: > > > > Yes I didn’t get to the OVN part yet, as I first wanted to test the if the > token can be obtained. > > > > This is the first time we are testing KeyCloak in any environment, so we > have never been able to obtain a token for API access. > > > > Please post the exact versions of: > > - ovirt-engine* : > > yum list --installed | grep ovirt-engine > > yum list --intalled | grep ovirt-engine-extension-aaa-misc > > yum list --installed | grep mod_auth_openidc > > - keycloak > > - OS > > cat /etc/*elease > > > > I'll submit a bug ... which, most likely, I will assign to myself anyway :) > > > > Artur > > > > > > *Anton Louw* > > *Cloud Engineer: Storage and Virtualization* at *Vox* > ------------------------------ > > *T:* 087 805 0000 | *D:* 087 805 1572 > *M:* N/A > *E:* anton.louw(a)voxtelecom.co.za > *A:* Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za > > > > [image: F] <https://www.facebook.com/voxtelecomZA> > > > > [image: T] <https://www.twitter.com/voxtelecom> > > > > [image: I] <https://www.instagram.com/voxtelecomza> > > > > [image: L] <https://www.linkedin.com/company/voxtelecom> > > > > [image: Y] <https://www.youtube.com/user/VoxTelecom> > > > > > > Thanks > > > > *From:* Artur Socha <asocha(a)redhat.com> > *Sent:* 19 June 2020 12:16 > *To:* Anton Louw <Anton.Louw(a)voxtelecom.co.za>; users(a)ovirt.org > *Cc:* Stephen Hutchinson <Stephen.Hutchinson(a)voxtelecom.co.za> > *Subject:* Re: [ovirt-users] KeyCloak Integration > > > > On Fri, 2020-06-19 at 10:03 +0000, Anton Louw wrote: > > > > Hi Artur, > > > > Sure, please see below output: > > > > [root@virt ~]# curl -vvv -H "Accept:application/json" ' > https://virt.example.co.za/ovirt-engine/sso/oauth/token?grant_type=password… > ' > > * About to connect() to virt.example.co.za port 443 (#0) > > * Trying 127.0.0.1... > > * Connected to virt.example.co.za (127.0.0.1) port 443 (#0) > > * Initializing NSS with certpath: sql:/etc/pki/nssdb > > * CAfile: /etc/pki/tls/certs/ca-bundle.crt > > CApath: none > > * SSL connection using TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 > > * Server certificate: > > * subject: CN=*.example.co.za,OU=Domain Control Validated > > * start date: Sep 25 07:46:12 2019 GMT > > * expire date: Oct 02 07:39:01 2020 GMT > > * common name: *example.co.za > > * issuer: CN=Starfield Secure Certificate Authority - G2,OU= > http://certs.starfieldtech.com/repository/,O="Starfield Technologies, > Inc.",L=Scottsdale,ST=Arizona,C=US > > > GET > /ovirt-engine/sso/oauth/token?grant_type=password&username=myuser&password=mypass&scope=ovirt-app-api > HTTP/1.1 > > > User-Agent: curl/7.29.0 > > > Host: virt.example.co.za > > > Accept:application/json > > > > > < HTTP/1.1 400 Bad Request > > < Date: Fri, 19 Jun 2020 09:52:11 GMT > > < Server: Apache/2.4.6 (CentOS) OpenSSL/1.0.2k-fips > > < Set-Cookie: locale=en_US; path=/; secure; HttpOnly; Max-Age=2147483647; > Expires=Wed, 07-Jul-2088 13:06:18 GMT > > < X-XSS-PROTECTION: 1; MODE=BLOCK > > < X-CONTENT-TYPE-OPTIONS: NOSNIFF > > < X-FRAME-OPTIONS: SAMEORIGIN > > < Content-Type: application/json > > < Content-Length: 233 > > < Connection: close > > < > > * Closing connection 0 > > {"error_code":"access_denied","error":"Cannot authenticate user Invalid > scopes: ovirt-app-api ovirt-ext=token-info:authz-search > ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate > ovirt-ext=token:password-access."} > > > > 1) Test connection using python script (from the blog post ) using sdk. I > suspect it will not work either. > > Testing from Python gives me the same error as well. > > > > 2) I saw some errors in the log on revoking token. Please go to keycloak > admin panel, and under users kill all its active sessions. Then, please > without logging in to engine admin UI, use that curl to obtain token. > > Tested this again, but still getting the below: > > {"error_code":"access_denied","error":"Cannot authenticate user Invalid > scopes: ovirt-app-api ovirt-ext=token-info:authz-search > ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate > ovirt-ext=token:password-access."} > > > > Thanks for these test ... unfortunately nothing helped > > > > > > 3) Does it work without OVN integration enabled? > > Can you explain a bit more? How can I disable OVN integration to test this? > > > > I had in mind reverting OVN vs Keycloak integration done according to > "Configuring OVN" chapter in > https://blogs.ovirt.org/2019/01/federate-ovirt-engine-authentication-to-ope… > > Unless, of course, you skipped it. > > > > Most likely you found a bug. Have you ever been able to obtain token for > api access with keycloak integration (even with you previous environments)? > > I am now trying to understand what happened and how to reproduce it before > submitting the bug into http://bugzilla.redhat.com > > > > > > *Anton Louw* > > *Cloud Engineer: Storage and Virtualization* at *Vox* > ------------------------------ > > *T:* 087 805 0000 | *D:* 087 805 1572 > *M:* N/A > *E:* anton.louw(a)voxtelecom.co.za > *A:* Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za > > > > [image: F] <https://www.facebook.com/voxtelecomZA> > > > > [image: T] <https://www.twitter.com/voxtelecom> > > > > [image: I] <https://www.instagram.com/voxtelecomza> > > > > [image: L] <https://www.linkedin.com/company/voxtelecom> > > > > [image: Y] <https://www.youtube.com/user/VoxTelecom> > > > > > > > > Thanks > > > > > > *Anton Louw* > > *Cloud Engineer: Storage and Virtualization* at *Vox* > ------------------------------ > > *T:* 087 805 0000 | *D:* 087 805 1572 > *M:* N/A > *E:* anton.louw(a)voxtelecom.co.za > *A:* Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za > > > > [image: F] <https://www.facebook.com/voxtelecomZA> > > > > [image: T] <https://www.twitter.com/voxtelecom> > > > > [image: I] <https://www.instagram.com/voxtelecomza> > > > > [image: L] <https://www.linkedin.com/company/voxtelecom> > > > > [image: Y] <https://www.youtube.com/user/VoxTelecom> > > > > > > *From:* Artur Socha <asocha(a)redhat.com> > *Sent:* 19 June 2020 11:40 > *To:* Anton Louw <Anton.Louw(a)voxtelecom.co.za>; users(a)ovirt.org > *Cc:* Stephen Hutchinson <Stephen.Hutchinson(a)voxtelecom.co.za> > *Subject:* Re: [ovirt-users] KeyCloak Integration > > > > On Fri, 2020-06-19 at 08:34 +0000, Anton Louw wrote: > > > > Hi Artur, > > > > Thank you for the quick response. > > > > I have actually tried creating another user, but I still get the same > error. I have attached the output of curl -vvv as well as the logs the > engine and keycloak logs. > > > > This `curl -vvv ...` is actually is incorrect because it is missing -H > before 'Accept' header. However, previous attempts that led to this error > seemed to be fine. Could you just re-send output of the correct curl? > > > > There are few things we can test to try to narrow down the root cause: > > > > 1) Test connection using python script (from the blog post ) using sdk. I > suspect it will not work either. > > > > 2) I saw some errors in the log on revoking token. Please go to keycloak > admin panel, and under users kill all its active sessions. Then, please > without logging in to engine admin UI, use that curl to obtain token. > > > > 3) Does it work without OVN integration enabled? > > > > Artur > > > > > > > > Thank you > > > > > > *Anton Louw* > > *Cloud Engineer: Storage and Virtualization* at *Vox* > ------------------------------ > > *T:* 087 805 0000 | *D:* 087 805 1572 > *M:* N/A > *E:* anton.louw(a)voxtelecom.co.za > *A:* Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za > > > > [image: F] <https://www.facebook.com/voxtelecomZA> > > > > [image: T] <https://www.twitter.com/voxtelecom> > > > > [image: I] <https://www.instagram.com/voxtelecomza> > > > > [image: L] <https://www.linkedin.com/company/voxtelecom> > > > > [image: Y] <https://www.youtube.com/user/VoxTelecom> > > > > > > *From:* Artur Socha <asocha(a)redhat.com> > *Sent:* 19 June 2020 10:23 > *To:* Anton Louw <Anton.Louw(a)voxtelecom.co.za>; users(a)ovirt.org > *Subject:* Re: [ovirt-users] KeyCloak Integration > > > > O > > n Fri, 2020-06-19 at 07:35 +0000, Anton Louw via Users wrote: > > > > Hi Everybody, > > > > Hi Anton, > > > > So I have implemented KeyCloak into our oVirt environment, which works, up > until a point. So WebUI access works, but when calling the API, using: > > *curl -k -H "Accept: application/json" '* > *https://virt.example.co.za/ovirt-engine/sso/oauth/token?grant_type=password&username=admin@openidchttp&password=mypass&scope=ovirt-app-api* > <https://virt.example.co.za/ovirt-engine/sso/oauth/token?grant_type=password…> > *'* > > > > I get the below error: > > > > *{"error_description":"Cannot authenticate user Invalid scopes: > ovirt-app-api ovirt-ext=revoke:revoke-all ovirt-ext=token-info:authz-search > ovirt-ext=token-info:public-authz-search ovirt-ext=token-info:validate > ovirt-ext=token:password-access.","error":"access_denied"}* > > > > If my configs are removed, and I use “admin@internal” for my username, > then it works. > > > > I followed the below article step by step, and I double checked that all > the scopes are added into KeyCloak (ovirt-app-api and ovirt-app-admin) > > > > > https://blogs.ovirt.org/2019/01/federate-ovirt-engine-authentication-to-ope… > > > > Anybody have any ideas? > > > > It is my blind shot but could create & check another user? > > > > One more thing to check please use curl -vvv to check if there are any > redirects along the way. > > I will check keycloak settings on my setup - perhaps there is something > non-obvious that could have been missed. > > > > Any chance to get a bit more logs from engine.log and even from keycloak? > Perhaps there is something there that could help. > > > > Artur > > > > > > Thank you > > > > *Anton Louw* > > *Cloud Engineer: Storage and Virtualization* at *Vox* > ------------------------------ > > *T:* 087 805 0000 | *D:* 087 805 1572 > *M:* N/A > *E:* anton.louw(a)voxtelecom.co.za > *A:* Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za > > > > [image: F] <https://www.facebook.com/voxtelecomZA> > > > > [image: T] <https://www.twitter.com/voxtelecom> > > > > [image: I] <https://www.instagram.com/voxtelecomza> > > > > [image: L] <https://www.linkedin.com/company/voxtelecom> > > > > [image: Y] <https://www.youtube.com/user/VoxTelecom> > > > > > > [image: #VoxBrand] > <https://www.vox.co.za/fibre/fibre-to-the-home/?prod=HOME> > > > *Disclaimer* > > The contents of this email are confidential to the sender and the intended > recipient. Unless the contents are clearly and entirely of a personal > nature, they are subject to copyright in favour of the holding company of > the Vox group of companies. Any recipient who receives this email in error > should immediately report the error to the sender and permanently delete > this email from all storage devices. > > This email has been scanned for viruses and malware, and may have been > automatically archived by *Mimecast Ltd*, an innovator in Software as a > Service (SaaS) for business. Providing a *safer* and *more useful* place > for your human generated data. Specializing in; Security, archiving and > compliance. To find out more Click Here > <https://www.voxtelecom.co.za/security/mimecast/?prod=Enterprise>. > > > > _______________________________________________ > > Users mailing list -- > > * <users(a)ovirt.org>* > > *users(a)ovirt.org <users(a)ovirt.org>* > > > > > > > > > > > > > > > > To unsubscribe send an email to > > * <users-leave(a)ovirt.org>* > > *users-leave(a)ovirt.org <users-leave(a)ovirt.org>* > > > > > > > > > > > > > > > > Privacy Statement: > > * <https://www.ovirt.org/privacy-policy.html>* > > *https://www.ovirt.org/privacy-policy.html > <https://www.ovirt.org/privacy-policy.html>* > > > > > > > > > > > > > > > > oVirt Code of Conduct: > > * <https://www.ovirt.org/community/about/community-guidelines/>* > > *https://www.ovirt.org/community/about/community-guidelines/ > <https://www.ovirt.org/community/about/community-guidelines/>* > > > > > > > > > > > > > > > > List Archives: > > * > <https://lists.ovirt.org/archives/list/users@ovirt.org/message/CC54IPZLYJYE2…>* > > *https://lists.ovirt.org/archives/list/users@ovirt.org/message/CC54IPZLYJYE2B3NP4LT4TN4CJX4C7BU/ > <https://lists.ovirt.org/archives/list/users@ovirt.org/message/CC54IPZLYJYE2…>* > > > > > > > > > > > > > > > > > > > > > > > > > > > -- Artur Socha Senior Software Engineer, RHV Red Hat

1 0

Storage Domain won't activate
by Gillingham, Eric J (US 393D) 05 Sep '20

05 Sep '20

I recently removed a host from my cluster to upgrade it to 4.4, after I removed the host from the datacenter VMs started to pause on the second system they all migrated to. Investigating via the engine showed the storage domain was showing as "unknown", when I try to activate it via the engine it cycles to locked then to unknown again. /var/log/sanlock.log contains a repeating: add_lockspace e1270474-108c-4cae-83d6-51698cffebbf:1:/dev/e1270474-108c-4cae-83d6-51698cffebbf/ids:0 conflicts with name of list1 s1 e1270474-108c-4cae-83d6-51698cffebbf:3:/dev/e1270474-108c-4cae-83d6-51698cffebbf/ids:0 vdsm.log contains these (maybe related) snippets: --- 2020-09-03 20:19:53,483+0000 INFO (jsonrpc/6) [vdsm.api] FINISH getAllTasksStatuses error=Secured object is not in safe state from=::ffff:137.79.52.43,36326, flow_id=18031a91, task_id=8e92f059-743a-48c8-aa9d-e7c4c836337b (api:52) 2020-09-03 20:19:53,483+0000 ERROR (jsonrpc/6) [storage.TaskManager.Task] (Task='8e92f059-743a-48c8-aa9d-e7c4c836337b') Unexpected error (task:875) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in _run return fn(*args, **kargs) File "<string>", line 2, in getAllTasksStatuses File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 50, in method ret = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/hsm.py", line 2201, in getAllTasksStatuses allTasksStatus = self._pool.getAllTasksStatuses() File "/usr/lib/python2.7/site-packages/vdsm/storage/securable.py", line 77, in wrapper raise SecureError("Secured object is not in safe state") SecureError: Secured object is not in safe state 2020-09-03 20:19:53,483+0000 INFO (jsonrpc/6) [storage.TaskManager.Task] (Task='8e92f059-743a-48c8-aa9d-e7c4c836337b') aborting: Task is aborted: u'Secured object is not in safe state' - code 100 (task:1181) 2020-09-03 20:19:53,483+0000 ERROR (jsonrpc/6) [storage.Dispatcher] FINISH getAllTasksStatuses error=Secured object is not in safe state (dispatcher:87) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/dispatcher.py", line 74, in wrapper result = ctask.prepare(func, *args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 108, in wrapper return m(self, *a, **kw) File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 1189, in prepare raise self.error SecureError: Secured object is not in safe state --- 2020-09-03 20:44:23,252+0000 INFO (tasks/2) [storage.ThreadPool.WorkerThread] START task 76415a77-9d29-4b72-ade1-53207cfc503b (cmd=<bound method Task.commit of <vdsm.storage.task.Task instance at 0x7fe99c27dea8>>, args=None) (thre adPool:208) 2020-09-03 20:44:23,266+0000 INFO (tasks/2) [storage.SANLock] Acquiring host id for domain e1270474-108c-4cae-83d6-51698cffebbf (id=1, wait=True) (clusterlock:313) 2020-09-03 20:44:23,267+0000 ERROR (tasks/2) [storage.TaskManager.Task] (Task='76415a77-9d29-4b72-ade1-53207cfc503b') Unexpected error (task:875) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 882, in _run return fn(*args, **kargs) File "/usr/lib/python2.7/site-packages/vdsm/storage/task.py", line 336, in run return self.cmd(*self.argslist, **self.argsdict) File "/usr/lib/python2.7/site-packages/vdsm/storage/sp.py", line 317, in startSpm self.masterDomain.acquireHostId(self.id) File "/usr/lib/python2.7/site-packages/vdsm/storage/sd.py", line 957, in acquireHostId self._manifest.acquireHostId(hostId, wait) File "/usr/lib/python2.7/site-packages/vdsm/storage/sd.py", line 501, in acquireHostId self._domainLock.acquireHostId(hostId, wait) File "/usr/lib/python2.7/site-packages/vdsm/storage/clusterlock.py", line 344, in acquireHostId raise se.AcquireHostIdFailure(self._sdUUID, e) AcquireHostIdFailure: Cannot acquire host id: ('e1270474-108c-4cae-83d6-51698cffebbf', SanlockException(22, 'Sanlock lockspace add failure', 'Invalid argument')) --- Another symptom is in the hosts view of the engine SPM bounces between "Normal" and "Contending". When it's Normal if I select Management -> Select as SPM I get "Error while executing action: Cannot force select SPM. Unknown Data Center status." I've tried rebooting the one remaining host in the cluster no to avail, hosted-engine --reinitialize-lockspace also seems to not solve the issue. I'm kind of stumped as to what else to try, would appreciate any guidance on how to resolve this. Thank You

5 9

Failed to connect to server (code: 1006) connecting to second host noVNC console
by James Loker-Steele 04 Sep '20

04 Sep '20

Hi All, Using OLVM and having an issue connecting to a noVNC console on a secondary host. Im getting the Failed to connect. We are using the standalone host as the deployment of the self hosted kept failing, something about the machine not being able to run virtualised machines even though it can. Added a second kvm host to the management engine. Can create new machines, disks etc. Just when trying to connect to the console using noVNC. Any help would be appreciated.

1 1

Upgrade 4.3 to 4.4 node to manager communication error
by Pierre pit 03 Sep '20

03 Sep '20

I have a communication problem between all the nodes and the manager following the upgrade from 4.3 to 4.4. I followed the procedure of update 4.3 to 4.4 everything worked correctly, according to the import export scripts as well as the installation setup on the new manager in 4.4, all is ok. Only after connection to the manager, all the nodes are in a down state, there is no more communication between the manager newly installed in 4.4 and the nodes still in production in 4.3. In the manager I have this message for all the nodes: ` VDSM virtdell8 command Get Host Capabilities failed: PKIX path validation failed: java.security.cert.CertPathValidatorException: Algorithm constraints check failed on signature algorithm: SHA256withRSA` And on the nodes: ` 2020-09-01 17:38:13,083+0200 ERROR (Reactor thread) [ProtocolDetector.SSLHandshakeDispatcher] ssl handshake: SSLError, address: ::ffff:XXX.XXX.XXX.XXX (sslutils:264) vdsm[4400]: ERROR ssl handshake: SSLError, address: ::ffff:XXX.XXX.XXX.XXX` After a search on the forums I found a similar error on version 4.2 only the solution of comment `ssl_excludes` in the `/etc/vdsm/vdsm.conf` file but does not apply to my problem. I unfortunately had to backtrack because it was no longer possible to control ovirt and use the manager for our production. the new machine with the manager in 4.4 is offline while a solution is found Do you know where should I look in order to solve this problem? thank you in advance Pierre

4 3

Re: [ovirt 4.2]The snapshot is deleted after restoring the snapshot
by Strahil Nikolov 03 Sep '20

03 Sep '20

If you have snapshots like A -> B -> C and you restore A , it is normal to loose B & C. After all when you restore A , B & C never happened. Otherwise , ovirt should clone the snapshots in separate images and that is not the requested, right ? Best Regards, Strahil Nikolov В четвъртък, 3 септември 2020 г., 10:03:30 Гринуич+3, liuweijie(a)sunyainfo.com <liuweijie(a)sunyainfo.com> написа: Dear All: I used ovirt api (POST /ovirt-engine/api/vms/{vm:id}/snapshots) to create several snapshots. When I call the snapshot recovery api (POST /ovirt-engine/api/vms/{vm:id }/snapshots/{snapshot:id}/restore) to restoe the first snapshot, I found that the next few snapshots were deleted, and it was normal when I restored the last snapshot. Why does the snapshot with the earlier recovery time delete the subsequent snapshot? The vm's os is centos. Hope get help from you soon, Thank you. Yours sincerely， Evelyn _______________________________________________ Users mailing list -- users(a)ovirt.org To unsubscribe send an email to users-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/LJL6NUYBPGJAF…

1 0

Hosted engine + OVN
by Sverker Abrahamsson 03 Sep '20

03 Sep '20

Was it ever solved to install hosted engine with ovn? I tried a few years ago, got it almost to work but then gave up.

2 1

How to Backup a VM
by Stefan Wolf 03 Sep '20

03 Sep '20

Hello to all I try to backup a normal VM. But It seems that I don't really understand the concept. At first I found the possibility to backup with the api https://www.ovirt.org/documentation/administration_guide/#Setting_a_storage…. Create a snapshot of the VM, finding the ID of the snapshot and the configuration of the VM makes sense to me. But at this point, I would download the config an the snapshot and put it to my backup storage. And not create a new VM attach the disk and run a backup with backup programm. And for restoring do the sam way backwards. If i look at other project, there seems do be a way to download the snapshot and configfile, or am I wrong? Maybe someone can explain to me why I should use additional software to install in an additional machine. Or even better someone can explain to me how I don't have to use additional backup software. And to the same topic backup. There is in the documentation the possibility to set up a backup storage It is nearly the same, create a snapshot, or clone the machine and export it to backup storage > Export the new virtual machine to a backup domain. See Exporting a Virtual Machine to a Data Domain in the Virtual Machine Management Guide. Sadly there is just writen what to do, not how, the link points to 404 page. maybe someone can explain to me how to use backup storage thank you very much shb

5 15

[ovirt 4.2]The snapshot is deleted after restoring the snapshot
by liuweijie＠sunyainfo.com 03 Sep '20

03 Sep '20

Dear All: I used ovirt api (POST /ovirt-engine/api/vms/{vm:id}/snapshots) to create several snapshots. When I call the snapshot recovery api (POST /ovirt-engine/api/vms/{vm:id }/snapshots/{snapshot:id}/restore) to restoe the first snapshot, I found that the next few snapshots were deleted, and it was normal when I restored the last snapshot. Why does the snapshot with the earlier recovery time delete the subsequent snapshot? The vm's os is centos. Hope get help from you soon, Thank you. Yours sincerely， Evelyn

1 0