- Users - oVirt List Archives

oVirt Node 4.4.1.1 Cockpit Hyperconverged Gluster deploy fails insufficient free space no matter how small the volume is set
by clam2718＠gmail.com 17 Jul '20

17 Jul '20

Hi, Deploying oVirt 4.4.1.1 via Cockpit --> Hosted Engine --> Hyperconverged fails at Gluster deployment: TASK [gluster.infra/roles/backend_setup : Create thick logical volume] ********* failed: [fmov1n3.sn.dtcorp.com] (item={'vgname': 'gluster_vg_nvme0n1', 'lvname': 'gluster_lv_engine', 'size': '100G'}) => {"ansible_index_var": "index", "ansible_loop_var": "item", "changed": false, "err": " Volume group \"gluster_vg_nvme0n1\" has insufficient free space (25599 extents): 25600 required.\n", "index": 0, "item": {"lvname": "gluster_lv_engine", "size": "100G", "vgname": "gluster_vg_nvme0n1"}, "msg": "Creating logical volume 'gluster_lv_engine' failed", "rc": 5} failed: [fmov1n1.sn.dtcorp.com] (item={'vgname': 'gluster_vg_nvme0n1', 'lvname': 'gluster_lv_engine', 'size': '100G'}) => {"ansible_index_var": "index", "ansible_loop_var": "item", "changed": false, "err": " Volume group \"gluster_vg_nvme0n1\" has insufficient free space (25599 extents): 25600 required.\n", "index": 0, "item": {"lvname": "gluster_lv_engine", "size": "100G", "vgname": "gluster_vg_nvme0n1"}, "msg": "Creating logical volume 'gluster_lv_engine' failed", "rc": 5} failed: [fmov1n2.sn.dtcorp.com] (item={'vgname': 'gluster_vg_nvme0n1', 'lvname': 'gluster_lv_engine', 'size': '100G'}) => {"ansible_index_var": "index", "ansible_loop_var": "item", "changed": false, "err": " Volume group \"gluster_vg_nvme0n1\" has insufficient free space (25599 extents): 25600 required.\n", "index": 0, "item": {"lvname": "gluster_lv_engine", "size": "100G", "vgname": "gluster_vg_nvme0n1"}, "msg": "Creating logical volume 'gluster_lv_engine' failed", "rc": 5} Deployment is on 3 count Dell PowerEdge R740xd with 5 count 1.6TB NVMe drives per host. Deployment is only to three as JBOD, 1 drive per node per volume (engine, data, vmstore) utilizing VDO. Thus, deploying even a 100G volume to 1.6TB drive fails with "insufficient free space" error. I suspect this might have to do with the Ansible playbook deploying Gluster mishandling the logical volume creation due to the rounding error as described here: https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/6/ht… If I can provide any additional information, logs, etc. please ask. Also, if anyone has experience/suggestions with Gluster config for hyperconverged setup on NVMe drives I would greatly appreciate any pearls of wisdom. Thank you so very much for any assistance! Charles

7 19

Parent checkpoint ID does not match the actual leaf checkpoint
by Łukasz Kołaciński 17 Jul '20

17 Jul '20

Hello, Thanks to previous answers, I was able to make backups. Unfortunately, we had some infrastructure issues and after the host reboots new problems appeared. I am not able to do any backup using the commands that worked yesterday. I looked through the logs and there is something like this: 2020-07-17 15:06:30,644+02 ERROR [org.ovirt.engine.core.bll.StartVmBackupCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-54) [944a1447-4ea5-4a1c-b971-0bc612b6e45e] Failed to execute VM backup operation 'StartVmBackup': {}: org.ovirt.engine.core.common.errors.EngineException: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to StartVmBackupVDS, error = Checkpoint Error: {'parent_checkpoint_id': None, 'leaf_checkpoint_id': 'cd078706-84c0-4370-a6ec-654ccd6a21aa', 'vm_id': '116aa6eb-31a1-43db-9b1e-ad6e32fb9260', 'reason': 'Parent checkpoint ID does not match the actual leaf checkpoint'}, code = 1610 (Failed with error unexpected and code 16) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.VdsHandler.handleVdsResult(VdsHandler.java:114) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.VDSBrokerFrontendImpl.runVdsCommand(VDSBrokerFrontendImpl.java:33) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.CommandBase.runVdsCommand(CommandBase.java:2114) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.StartVmBackupCommand.performVmBackupOperation(StartVmBackupCommand.java:368) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.StartVmBackupCommand.runVmBackup(StartVmBackupCommand.java:225) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.StartVmBackupCommand.performNextOperation(StartVmBackupCommand.java:199) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.SerialChildCommandsExecutionCallback.childCommandsExecutionEnded(SerialChildCommandsExecutionCallback.java:32) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.ChildCommandsCallbackBase.doPolling(ChildCommandsCallbackBase.java:80) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller.invokeCallbackMethodsImpl(CommandCallbacksPoller.java:175) at deployment.engine.ear.bll.jar//org.ovirt.engine.core.bll.tasks.CommandCallbacksPoller.invokeCallbackMethods(CommandCallbacksPoller.java:109) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305) at org.glassfish.javax.enterprise.concurrent//org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.access$201(ManagedScheduledThreadPoolExecutor.java:383) at org.glassfish.javax.enterprise.concurrent//org.glassfish.enterprise.concurrent.internal.ManagedScheduledThreadPoolExecutor$ManagedScheduledFutureTask.run(ManagedScheduledThreadPoolExecutor.java:534) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) at java.base/java.lang.Thread.run(Thread.java:834) at org.glassfish.javax.enterprise.concurrent//org.glassfish.enterprise.concurrent.ManagedThreadFactoryImpl$ManagedThread.run(ManagedThreadFactoryImpl.java:250) And the last error is: 2020-07-17 15:13:45,835+02 ERROR [org.ovirt.engine.core.bll.StartVmBackupCommand] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-14) [f553c1f2-1c99-4118-9365-ba6b862da936] Failed to execute VM backup operation 'GetVmBackupInfo': {}: org.ovirt.engine.core.common.errors.EngineException: EngineException: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException: VDSGenericException: VDSErrorException: Failed to GetVmBackupInfoVDS, error = No such backup Error: {'vm_id': '116aa6eb-31a1-43db-9b1e-ad6e32fb9260', 'backup_id': 'bf1c26f7-c3e5-437c-bb5a-255b8c1b3b73', 'reason': 'VM backup not exists: Domain backup job id not found: no domain backup job present'}, code = 1601 (Failed with error unexpected and code 16) (these errors are from full backup) Like I said this is very strange because everything was working correctly. Regards Łukasz Kołaciński Junior Java Developer e-mail: l.kolacinski(a)storware.eu<mailto:l.kolacinski@storware.eu> <mailto:m.helbert@storware.eu> [STORWARE]<http://www.storware.eu/> ul. Leszno 8/44 01-192 Warszawa www.storware.eu <https://www.storware.eu/> [facebook]<https://www.facebook.com/storware> [twitter]<https://twitter.com/storware> [linkedin]<https://www.linkedin.com/company/storware> [Storware_Stopka_09]<https://www.youtube.com/channel/UCKvLitYPyAplBctXibFWrkw> Storware Spółka z o.o. nr wpisu do ewidencji KRS dla M.St. Warszawa 000510131 , NIP 5213672602. Wiadomość ta jest przeznaczona jedynie dla osoby lub podmiotu, który jest jej adresatem i może zawierać poufne i/lub uprzywilejowane informacje. Zakazane jest jakiekolwiek przeglądanie, przesyłanie, rozpowszechnianie lub inne wykorzystanie tych informacji lub podjęcie jakichkolwiek działań odnośnie tych informacji przez osoby lub podmioty inne niż zamierzony adresat. Jeżeli Państwo otrzymali przez pomyłkę tę informację prosimy o poinformowanie o tym nadawcy i usunięcie tej wiadomości z wszelkich komputerów. This message is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited. If you have received this message in error, please contact the sender and remove the material from all of your computer systems.

1 0

Engine deployment fails with engine booting to grub rescue
by Andy 17 Jul '20

17 Jul '20

After working through some DNS problems I was able to install oVirt 4.4.1.1 and progress the engine deployment stops within the ansible scripts. The system deploys the gluster domain, creates the engine, starts the engine, however it will never fully boot and complete the deployment. Bringing up the console of the engine sets it into rescue mode. I have attempted to set the appropriate variables in grub rescue set root=(hd0,msdos1) set prefix=(hd0,msdos1)/boot/grub insmod normal And this will not boot the engine. Is there a procedure to mount a CENTOS 8 rescue CD/ISO to troubleshoot this or is there a specific fix published for this problem? The specific error I am seeing in the Engine Console is "attempt to read outside of HD0. I upgraded the ovirt engine appliance package to ovirt-engine-appliance-4.4-20200716090128.1.el8.x86_64 which produces the same result. I have gotten this error deploying on both my Intel and AMD based servers. any help is appreciated. thanks Andy

2 1

VM Portal on a stand alone server
by gal.villaret＠gmail.com 16 Jul '20

16 Jul '20

Hi Folks, I'm rather new to oVirt and loving it. running 4.4.1. I would like to be able to run the VM Portal on a stand-alone server for security concerns. Can anyone point in the right direction for achieving this? Thanks, Gal Villaret

4 4

ovirt-node-ng-image-update 4.4.1 to 4.4.1.1
by David M. Hornsby 16 Jul '20

16 Jul '20

All, I applied the recent update 4.4.1 -> 4.4.1.1 to a host in a cluster and it failed. After reboot it was hund at the emergency console. I reinstalled 4.4.1 fresh on the host. Prior to adding it back to the cluster I applied the same update with the same result. Is this just a bad update or is the post install script bad. Thanks, David.

1 0

what is OVF_STORE ?
by 崔涛的公司邮箱 16 Jul '20

16 Jul '20

Could anyone give me some explain?

2 1

ovirt
by Nazan CENGİZ 16 Jul '20

16 Jul '20

Hi all We have 3 domain storage on ovirt. One of them is full.Doesn't let me move or open vm I restart all the hosts, the situation is the same what should I do? Could you please help me [cid:1dcfee51-130f-4f53-b390-dd4e1b1548e7] not space left [cid:09172d82-91d5-48a0-b4c6-503be9217cc6] Best Regards nazan [cid:imagef9b16a.PNG@4ccb2d29.40931c5b]<http://www.havelsan.com.tr> [cid:image61b00c.JPG@1d7940f3.4dac82f7] Nazan CENGİZ AR-GE MÜHENDİSİ Mustafa Kemal Mahallesi 2120 Cad. No:39 06510 Çankaya Ankara TÜRKİYE [cid:image2a1f23.PNG@29171ed8.4ba6b336] +90 312 219 57 87 [cid:image641031.PNG@c924d7e3.48a139b7] +90 312 219 57 97 [cid:imageb7a0b3.JPG@f9ee6f03.4eab9aed] YASAL UYARI: Bu elektronik posta işbu linki kullanarak ulaşabileceğiniz Koşul ve Şartlar dokümanına tabidir. <https://havelsan.com.tr/sabit-sayfalar/eposta-yasal-uyari> LEGAL NOTICE: This e-mail is subject to the Terms and Conditions document which can be accessed with this link. <https://havelsan.com.tr/sabit-sayfalar/eposta-yasal-uyari> Lütfen gerekmedikçe bu sayfa ve eklerini yazdırmayınız / Please consider the environment before printing this email

2 1

Re: Failing to restore a backup
by Yedidyah Bar David 16 Jul '20

16 Jul '20

On Tue, Jul 14, 2020 at 4:40 PM Anton Louw via Users <users(a)ovirt.org> wrote: > > > Hi Andrea, > > > > I have had sleepless nights with the same issue, but eventually figured it > out. The two commands I used are below: > > > > 1. Backup the configs > > engine-backup --scope=all --mode=backup --file=Full --log=Log_Full > > > > 1. Restore the configs > > engine-backup --mode=restore --file=Full --log=Log_Full --provision-db > --provision-dwh-db --restore-permissions > Andrea asked about hosted-engine, where you do not (by default) run restore manually yourself. > > > I ran the second command after I built a new HE from scratch. You just > need to download the backup files from the original and copy them to the > new HE before you restore. > > > > Give it a bash and see if it works for you. > > > > Cheers > > > > *Anton Louw* > *Cloud Engineer: Storage and Virtualization* at *Vox* > ------------------------------ > *T:* 087 805 0000 | *D:* 087 805 1572 > *M:* N/A > *E:* anton.louw(a)voxtelecom.co.za > *A:* Rutherford Estate, 1 Scott Street, Waverley, Johannesburg > www.vox.co.za > > [image: F] <https://www.facebook.com/voxtelecomZA> > [image: T] <https://www.twitter.com/voxtelecom> > [image: I] <https://www.instagram.com/voxtelecomza/> > [image: L] <https://www.linkedin.com/company/voxtelecom> > [image: Y] <https://www.youtube.com/user/VoxTelecom> > > [image: #VoxBrand] > <https://www.vox.co.za/fibre/fibre-to-the-home/?prod=HOME> > *Disclaimer* > > The contents of this email are confidential to the sender and the intended > recipient. Unless the contents are clearly and entirely of a personal > nature, they are subject to copyright in favour of the holding company of > the Vox group of companies. Any recipient who receives this email in error > should immediately report the error to the sender and permanently delete > this email from all storage devices. > > This email has been scanned for viruses and malware, and may have been > automatically archived by *Mimecast Ltd*, an innovator in Software as a > Service (SaaS) for business. Providing a *safer* and *more useful* place > for your human generated data. Specializing in; Security, archiving and > compliance. To find out more Click Here > <https://www.voxtelecom.co.za/security/mimecast/?prod=Enterprise>. > > > *From:* Andrea Chierici <andrea.chierici(a)cnaf.infn.it> > *Sent:* 14 July 2020 14:54 > *To:* users(a)ovirt.org > *Subject:* [ovirt-users] Failing to restore a backup > > > > Dear all, > I'm rather new to the list, not to ovirt, that I use since 2014 profitably. > I've a problem with an ovirt instance and I am desperately seeking for > help. > > I run a 4.3 self hosted engine installation, with 8 hypervisors and an > iscsi storage. > Since the storage is not very reliable, I bought a dell powervault where > to move everything. No problem to move the VMs, the problem came out with > the hosted engine. > I've read many documentation and the procedure I think I must follow > involves backing up the current HE, powering it off, installing a new host > where to create a new HE recovering the backup. > The command I used to generate the backup is: > engine-backup --mode=backup --file=file_name --log=log_file_name > > and the command used to restore it on the new HE is: > hosted-engine --deploy --restore-from-file=backup/file_name > > The problem comes out during the recovering of the backup. > > With versions prior to 4.3.11 and also with 4.4.0 I got the error: > 2020-06-25 15:17:34,950+0200 ERROR ansible failed { > "ansible_host": "localhost", > "ansible_playbook": > "/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml", > "ansible_result": { > "_ansible_no_log": false, > "changed": false, > "invocation": { > "module_args": { > "ca_file": null, > "compress": true, > "headers": null, > "hostname": null, > "insecure": null, > "kerberos": false, > "ovirt_auth": { > "ansible_facts": { > "ovirt_auth": { > "ca_file": null, > "compress": true, > "headers": null, > "insecure": true, > "kerberos": false, > "timeout": 0, > "token": > "1f5Zoys35sQmLb2MiEg6bhWm2rDJULFan3eBK0juJJR3S-nXtN_b31jac1sZ0KRz3d1KSDmr8tyf7ExNe_pqJg", > "url": > "https://ovirt-sgsi.cnaf.infn.it/ovirt-engine/api" > <https://ovirt-sgsi.cnaf.infn.it/ovirt-engine/api> > } > }, > "attempts": 1, > "changed": false, > "failed": false > }, > "password": null, > "state": "absent", > "timeout": 0, > "token": null, > "url": null, > "username": null > } > }, > "msg": "You must specify either 'url' or 'hostname'." > }, > "ansible_task": "Always revoke the SSO token", > "ansible_type": "task", > "status": "FAILED", > "task_duration": 3 > } > I think this is not a critical failure, and is not what failed the restore. > > > Recently I tried the 4.3.11 beta and 4.4.1 and the error now is different: > > [ INFO ] Upgrading CA\n[ ERROR ] Failed to execute stage 'Misc > configuration': (2, 'No such file or directory')\n[ INFO ] DNF Performing > DNF transaction rollback\n > This is part of 'engine-setup' output, which 'hosted-engine' runs inside the engine VM. If you can access the engine VM, you can try finding more information in /var/log/ovirt-engine/setup/* there. Otherwise, the hosted-engine deploy script might have managed to get a copy to /var/log/ovirt-hosted-engine-setup/engine-logs*. Please check/share these. Thanks. > > I simply can't figure out what file is missing. > If, as a test, I try to install the HE without restoring the backup, the > installation goes smoothly to the end, but at that point I can't restore > the backup, as far as I can understand. > Another option is to do the restore manually. To find relevant information, search the net for "enginevm_before_engine_setup". Best regards, > > Any hint on what I may be missing? > Thanks, > Andrea > > > -- > > Andrea Chierici - INFN-CNAF > > Viale Berti Pichat 6/2, 40127 BOLOGNA > > Office Tel: +39 051 2095463 > > SkypeID ataruz > > -- > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/Q4GGDSLBACN4M… > -- Didi

2 4

mixed hyperconverged?
by Philip Brown 16 Jul '20

16 Jul '20

I'm thinking of doing an SSD based hyperconverged setup (for 4.3), but am wondering about certain design issues. seems like the optimal number is 3 nodes for the glusterfs. but.. I want 5 host nodes, not 3 and I want the main storage for VMs to be separate iSCSI NAS boxes. Is it possible to have 3 nodes be the hyperconverged stuff.. but then add in 2 "regular" nodes, that dont store anything and arent part of the cluster? is it required to be part of the gluster cluster, to also be part of the ovirt cluster, if thats where the hosted-engine lives? or can I just have the hosted engine be switchable between the 3 nodes, and the other 2 be VM-only hosts? Any recommendations here? I dont what 5 way replication going on. Nor do I want to have to pay for large SSDs on all my host nodes. (Im planning to run them with the ovirt 3.4 node image) -- Philip Brown| Sr. Linux System Administrator | Medata, Inc. 5 Peters Canyon Rd Suite 250 Irvine CA 92606 Office 714.918.1310| Fax 714.918.1325 pbrown(a)medata.com| www.medata.com

3 7

Ovirt 4.4.1 Install failure at OVF_Store check
by farkey_2000＠yahoo.com 16 Jul '20

16 Jul '20

I am trying to freshly install oVirt 4.4.1 with HCI on CentOS 8.2. I am using the "hosted-engine --deploy" script and the installation fails at "Check the OVF Store" consistently. I did try to apply the fix loaded on Jenkins (https://jenkins.ovirt.org/job/ovirt-hosted-engine-setup_standard-check-patc…) which produced the same result. Any help is appreciated and I ma working to attached the install log. Thanks Andy

5 13