- Users - oVirt List Archives

Re: Ovirt 4.2.7 won't start and drops to emergency console
by Strahil 29 Sep '19

29 Sep '19

Can you suffer downtime ? You can try something like this (I'm improvising): Set to global maintenance (either via UI or hosted-engine --set-maintenance --mode=global) Stop the engine. Stop ovirt-ha-agent ovirt-ha-broker vdsmd supervdsmd sanlock glusterd. Stop all gluster processes via thr script in /usr/share/gluster*..../something-named-kill Disable all LVs in the vg via: lvchange -an LV If it doesn't work try disabling the VG: vgchange -an VG and then enabling it again: vgchange -ay VG Last try to repair the thinpool via: lvchange --repair VG/thinpool Last disable the VG and give the system a reboot to verify everything works. Best Regards, Strahil NikolovOn Sep 29, 2019 14:39, jeremy_tourville(a)hotmail.com wrote: > > Thank you for the reply. Please pardon my ignorance, I'm not very good with GlusterFS. I don't think this is a replicated volume (though I could be wrong) I built a single node hyperconverged hypervisor. I was reviewing my gdeploy file from when I originally built the system. I have the following values: > PV = /dev/sda > VG1= gluster_vg1 > LV1= engine_lv (thick) > LV2 = gluster_vg1 thinpool > LV3 = lv_vmdisks (thinpooll) > LV4 = lv_datadisks (thinpool) > > So according to the article I read in my OP, it says to deactivate the volumes under the thin pool as the first step. I ran the command lvchange -an /dev/gluster_vg1/lv_datadisks When I do this I am told Volume group "gluster_vg1" not found. Cannot process volume group gluster_vg1. > > That seems consistent with the timeout error message. How do you fix this if you can't access the volumes? Thoughts? > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/HZXE3NCSFWCUI…

2 1

Cannot enable maintenance mode
by Bruno Martins 29 Sep '19

29 Sep '19

Hello guys, I am being unable to put a host from a two nodes cluster into maintenance mode in order to remove it from the cluster afterwards. This is what I see in engine.log: 2019-09-27 16:20:58,364 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-6-thread-45) [4cc251c9] Correlation ID: 4cc251c9, Job ID: 65731fbb-db34-49a9-ab56-9fba59bc0ee0, Call Stack: null, Custom Event ID: -1, Message: Host CentOS-H1 cannot change into maintenance mode - not all Vms have been migrated successfully. Consider manual intervention: stopping/migrating Vms: Non interactive user (User: admin). Host has been rebooted multiple times. vdsClient shows no VM's running. What else can I do? Kind regards, Bruno Martins

1 0

Re: Ovirt 4.2.7 won't start and drops to emergency console
by Strahil 29 Sep '19

29 Sep '19

If it's a replicated volume - then you can safely rebuild your bricks and don't even tryhto repair. There is no guarantee that the issue will not reoccur. Best Regards, Strahil NikolovOn Sep 29, 2019 00:22, jeremy_tourville(a)hotmail.com wrote: > > I see evidence that appears to be a problem with gluster. /var/log/messages has multiple occurrences of: WARNING: /dev/gluster_vg1/lv_<name>: Thin's tihin-pool needs inspection. Also, if I run vgs I am returned info for my other volume groups but not gluster_vg1. Lastly, when reviewing journalctl -xb | grep -i timed I see messages from systemd > Job dev-gluster_vg1-lv_vmdisks.device/start timed.out. > Timed out waiting for device dev-glustet_vg1-lv_vmdisks.device > > Thses messages are happening for both > /dev/gluster_vg1/lv_datadisks > /dev/gluster_vg1/lv_vmdisks > > I did review the article here but I am unable to change to VG1. > https://mellowhost.com/billing/index.php?rp=/knowledgebase/65/How-to-Repair… > > Can anyone assist with a procedure on how to repair? > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/VCHU2Q4RD5QWN…

2 1

Ovirt 4.2.7 won't start and drops to emergency console
by jeremy_tourville＠hotmail.com 28 Sep '19

28 Sep '19

I see evidence that appears to be a problem with gluster. /var/log/messages has multiple occurrences of: WARNING: /dev/gluster_vg1/lv_<name>: Thin's tihin-pool needs inspection. Also, if I run vgs I am returned info for my other volume groups but not gluster_vg1. Lastly, when reviewing journalctl -xb | grep -i timed I see messages from systemd Job dev-gluster_vg1-lv_vmdisks.device/start timed.out. Timed out waiting for device dev-glustet_vg1-lv_vmdisks.device Thses messages are happening for both /dev/gluster_vg1/lv_datadisks /dev/gluster_vg1/lv_vmdisks I did review the article here but I am unable to change to VG1. https://mellowhost.com/billing/index.php?rp=/knowledgebase/65/How-to-Repair… Can anyone assist with a procedure on how to repair?

1 0

Re: Super Low VM disk IO via Shared Storage
by Strahil 28 Sep '19

28 Sep '19

Why don't you try with 4096 ? Most block devices have a blcok size of 4096 and anything bellow is slowing them down. Best Regards, Strahil NikolovOn Sep 24, 2019 17:40, Amit Bawer <abawer(a)redhat.com> wrote: > > have you reproduced performance issue when checking this directly with the shared storage mount, outside the VMs? > > On Tue, Sep 24, 2019 at 4:53 PM Vrgotic, Marko <M.Vrgotic(a)activevideo.com> wrote: >> >> Dear oVirt, >> >> >> >> I have executed some tests regarding IO disk speed on the VMs, running on shared storage and local storage in oVirt. >> >> >> >> Results of the tests on local storage domains: >> >> avlocal2: >> >> [root@mpollocalcheck22 ~]# dd if=/dev/zero of=/tmp/test2.img bs=512 count=100000 oflag=dsync >> >> 100000+0 records in >> >> 100000+0 records out >> >> 51200000 bytes (51 MB) copied, 45.9756 s, 1.1 MB/s >> >> >> >> avlocal3: >> >> [root@mpollocalcheck3 ~]# dd if=/dev/zero of=/tmp/test2.img bs=512 count=100000 oflag=dsync >> >> 100000+0 records in >> >> 100000+0 records out >> >> 51200000 bytes (51 MB) copied, 43.6179 s, 1.2 MB/s >> >> >> >> Results of the test on shared storage domain: >> >> avshared: >> >> [root@mpoludctest4udc-1 ~]# dd if=/dev/zero of=/tmp/test2.img bs=512 count=100000 oflag=dsync >> >> 100000+0 records in >> >> 100000+0 records out >> >> 51200000 bytes (51 MB) copied, 283.499 s, 181 kB/s >> >> >> >> Why is it so low? Is there anything I can do to tune, configure VDSM or other service to speed this up? >> >> Any advice is appreciated. >> >> >> >> Shared storage is based on Netapp with 20Gbps LACP path from Hypervisor to Netapp volume, and set to MTU 9000. Used protocol is NFS4.0. >> >> oVirt is 4.3.4.3 SHE. >> >> >> >> >> >> _______________________________________________ >> Users mailing list -- users(a)ovirt.org >> To unsubscribe send an email to users-leave(a)ovirt.org >> Privacy Statement: <

4 6

Changing certificates for oVirt 4.3.5
by TomK 28 Sep '19

28 Sep '19

Hey All, Would anyone have a more recent wiki on changing all certificates, including VDSM ones? Have this page but it's for version 3. https://access.redhat.com/solutions/2409751 Thinking the process didn't change much but wanted to ask if there's anything more recent floating around. -- Thx, TK.

2 3

Incremental backup using ovirt api
by smidhunraj＠gmail.com 28 Sep '19

28 Sep '19

Hi, I tried to take incremental backup of a vm using this script. public function downloadDiskIncremental(){ $data=array(); $xmlStr = "<disk_attachment> <disk id='1371afdd-91d4-4bc7-9792-0efbf6bbd1c9'> <backup>incremental</backup> </disk> </disk_attachment>"; $curlParam=array( "url" => "vms/4044e014-7e20-4dbc-abe5-64690ec45f63/diskattachments", "method" => "POST", "data" =>$xmlStr, ); } But it is throwing me error as Array ( [status] => error [message] => For correct usage, see: https://ovirt.bobcares.com/ovirt-engine/api/v4/model#services/disk-attachme… Please help me with this issue....

1 0

Re: [ANN] oVirt 4.3.6 is now generally available
by Strahil 28 Sep '19

28 Sep '19

I have upgraded from engine and after reboot the engine knows that I have no more updates pending. This is my flow: 0.Engine upgrade 1. Host is moved in maintenance (from UI) - no ticks for stopping gluster. Automatically evacuates all VMs. 2. Use UI to check for updates 3. Update host (keep tick for autoreboot) 4. Wait for hostto come up and general system & gluster healthcheck Best Regards, Strahil Nikolov

1 0

Re: Migrate running hosts to new Engine
by Strahil 28 Sep '19

28 Sep '19

I would go with fixing your current engine that trying to migrate without downtime. Have you tries to create a backup and then shutdown current engine and restore from backup ? P.S.: Before doing anything, try to find the xml configuration of each VM in the past vdsm configs.As that data is only in the engine, you won't be able to power up any machine without that configuration. Best Regards, Strahil NikolovOn Sep 27, 2019 16:11, Magnus Isaksson <magnus(a)vmar.se> wrote: > > Hello all, > > I need to migrate 4 hosts running CentOS with oVirt 4.2 to a new Engine that runs 4.3 and not disrupt the VMs on these hosts? The VMs need to be running, i have a slim option of downtime for them, but rather not. > > The reason is that my current engine 4.2 will not upgrade to 4.3, tried so many times, but all i get is a white page after the upgrade, according to engine-setup, was a success. > > So, how can i do this? > > Reagrds > Magnus Isaksson > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/site/privacy-policy/ > oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ > List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/7WLV5VF6BPDIO…

1 0

Re: NFS based - incremental backups
by Strahil 28 Sep '19

28 Sep '19

Geo replication requires master and slave volumes , but I'm not sure if the slave volumeshould also be replica 3. Maybe in your case it coould be replica 1 or something lile that. In KVM I would create a snapshot, back it up and then merge all disks back to one (a.k.a. block commit). So a simple script with user for the API, can allow you to do that without paying anything extra to a 3rd party. Best Regards, Strahil Nikolov On Sep 27, 2019 08:25, Leo David <leoalex(a)gmail.com> wrote: > > Hello Everyone, > Ive been struggling since a while to find out a propper solution to have a full backup scenario for a production environment. > In the past, we have used Proxmox, and the scheduled incremenral nfs based full vm backups is a thing that we really miss. > As far as i know, at this point the only way to have a backup in oVirt / rhev is by using gluster geo-replication feature. > This is nice, but as far as i know it lacks some important features: > - ability to have incremental backups to restore vms from > - ability to backup vms placed on different storage domains ( only one storage domain can be geo-replicated !!! some vms have disks on ssd volume, some on hdd, some on both) > - need to setup an external 3 nodes gluster cluster ( although a workaround would be to have single bricks based volumes for a single instance ) > I know we can create snaps, but they will die with the platform in a fail scenario, and neither they can be scheduled. > We have found bacchus project that looked promising, although it had a pretty hassled way to achieve backups ( create snap, create vm from the snap, export vm to export domain, delete vm, delete snap - all in a scheduled fashion ) > As a mention, Proxmox is incrementaly creating a tar archive of the vm disk content, and places it to an external network storage like nfs. This allowed us to backup/reatore both linux and windows vms very easily. > Now, I know this have been discussed before, but i would like to know if there are at least any future plans to implement this feature in the next releases. > Personally, i consider this a major, and quite decent feature to have with the platform, without the need to pay for 3rd party solutions that may or may not achieve the goal while adding extra pieces to the stack. Geo-replication is a good and nice feature, but in my oppinion it is not what a "backup domain" would be. > Have a nice day, > > Leo > >

1 0