- Users - oVirt List Archives

clean of .shard files if changing volume settings
by Gianluca Cecchi 08 Jun '20

08 Jun '20

Hello, I have a single host in 4.4 with HCI and Gluster. I have only one brick for the volume and I disabled sharding: [root@ovirt01 /root]# gluster volume set data features.shard off volume set: success [root@ovirt01 /root]# In events of web admin I see it registered and updating db: Detected change in value of option features.shard from on to off on volume data of cluster Default, and updated it to engine DB. 6/3/206:46:52 PM Then I delete a VM with a 65Gb disk, that I created while sharding was enabled (I enabled the check box to remove disks) but it seems that files under .shard are not removed. [root@ovirt01 ~]# du -sh /rhev/data-center/mnt/glusterSD/ovirt01st.lutwyn.storage\:_data/.shard/ 62G /rhev/data-center/mnt/glusterSD/ovirt01st.lutwyn.storage:_data/.shard/ [root@ovirt01 ~]# Is there any special command I have to run? Or can I simply remove the .shard directory now? I only had that VM in that storage domain before disabling sharding. The files are all of type: -rw-rw----. 1 root root 67100672 Jun 3 18:18 23f0c94c-cf2a-42c1-8e2e-a21c4e542774.1 -rw-rw----. 1 root root 67108864 Jun 3 18:18 23f0c94c-cf2a-42c1-8e2e-a21c4e542774.2 ... -rw-rw----. 1 root root 67108864 Jun 3 18:44 23f0c94c-cf2a-42c1-8e2e-a21c4e542774.1008 -rw-rw----. 1 root root 39845888 Jun 3 18:44 23f0c94c-cf2a-42c1-8e2e-a21c4e542774.1009 -rw-rw----. 1 root root 56643584 Jun 3 18:44 23f0c94c-cf2a-42c1-8e2e-a21c4e542774.1031 Thanks in advance, Gianluca

2 2

Re: Slow disk upload via WebGUI
by Strahil Nikolov 06 Jun '20

06 Jun '20

There is also the API and I think there was a python script for ISO upload. You can also import from OVA. As you have multiple VMDKs, why don't you just upload in parallel (20-30 disk in batch). Best Regards, Strahil Nikolov На 6 юни 2020 г. 13:39:44 GMT+03:00, Magnus Isaksson <magnus(a)vmar.se> написа: >Hi > >From what i can tell from that link is that there is only one way for >my scenario, or have i missed something? > >"Procedure 11.8. Uploading a Disk Image to a Storage Domain" > >//Magnus >________________________________ >From: Strahil Nikolov <hunter86_bg(a)yahoo.com> >Sent: 06 June 2020 12:26 >To: users(a)ovirt.org <users(a)ovirt.org>; Magnus Isaksson <magnus(a)vmar.se> >Subject: Re: [ovirt-users] Re: Slow disk upload via WebGUI > >Hi Magnus, > > >there are several ways to upload a disk. > >For details, check >https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.1/ht… > >Best Regards, >Strahil Nikolov > >На 6 юни 2020 г. 12:15:36 GMT+03:00, Magnus Isaksson <magnus(a)vmar.se> >написа: >>A note to this is that we are migrating a couple of customers from a >>vmware enviroment that we have no control over, we get the vmdk files >>on a NFS share. its a bit over 130 VM:s and if every disk will go at >>100mbit/s its quite a painful process. >> >>Is there a faster way to import these disk images other then via >>WebGUI? (of course after convert) >> >>//Magnus >>________________________________ >>From: Magnus Isaksson <magnus(a)vmar.se> >>Sent: 06 June 2020 10:58 >>To: users <users(a)ovirt.org> >>Subject: [ovirt-users] Slow disk upload via WebGUI >> >>Hello >> >>I'm running Engine 4.3.9 and have fibre channel SSD storage and 4 >>nodes. >> >>When uploading disk images i get around 100mbit/s per disk, if im >>running 3 uploads at the same time i get about 300mbit/s combined. >>Everything is connected via 10G and 16G to FC storage. >> >>Why is it so slow? and what can i do to speed things up? >> >>Regards >> Magnus

1 0

Re: Slow disk upload via WebGUI
by Strahil Nikolov 06 Jun '20

06 Jun '20

Hi Magnus, there are several ways to upload a disk. For details, check https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.1/ht… Best Regards, Strahil Nikolov На 6 юни 2020 г. 12:15:36 GMT+03:00, Magnus Isaksson <magnus(a)vmar.se> написа: >A note to this is that we are migrating a couple of customers from a >vmware enviroment that we have no control over, we get the vmdk files >on a NFS share. its a bit over 130 VM:s and if every disk will go at >100mbit/s its quite a painful process. > >Is there a faster way to import these disk images other then via >WebGUI? (of course after convert) > >//Magnus >________________________________ >From: Magnus Isaksson <magnus(a)vmar.se> >Sent: 06 June 2020 10:58 >To: users <users(a)ovirt.org> >Subject: [ovirt-users] Slow disk upload via WebGUI > >Hello > >I'm running Engine 4.3.9 and have fibre channel SSD storage and 4 >nodes. > >When uploading disk images i get around 100mbit/s per disk, if im >running 3 uploads at the same time i get about 300mbit/s combined. >Everything is connected via 10G and 16G to FC storage. > >Why is it so slow? and what can i do to speed things up? > >Regards > Magnus

2 1

Re: Slow disk upload via WebGUI
by Magnus Isaksson 06 Jun '20

06 Jun '20

A note to this is that we are migrating a couple of customers from a vmware enviroment that we have no control over, we get the vmdk files on a NFS share. its a bit over 130 VM:s and if every disk will go at 100mbit/s its quite a painful process. Is there a faster way to import these disk images other then via WebGUI? (of course after convert) //Magnus ________________________________ From: Magnus Isaksson <magnus(a)vmar.se> Sent: 06 June 2020 10:58 To: users <users(a)ovirt.org> Subject: [ovirt-users] Slow disk upload via WebGUI Hello I'm running Engine 4.3.9 and have fibre channel SSD storage and 4 nodes. When uploading disk images i get around 100mbit/s per disk, if im running 3 uploads at the same time i get about 300mbit/s combined. Everything is connected via 10G and 16G to FC storage. Why is it so slow? and what can i do to speed things up? Regards Magnus

1 0

Slow disk upload via WebGUI
by Magnus Isaksson 06 Jun '20

06 Jun '20

Hello I'm running Engine 4.3.9 and have fibre channel SSD storage and 4 nodes. When uploading disk images i get around 100mbit/s per disk, if im running 3 uploads at the same time i get about 300mbit/s combined. Everything is connected via 10G and 16G to FC storage. Why is it so slow? and what can i do to speed things up? Regards Magnus

1 0

Q: Which types of tests and tools are used?
by Juergen Novak 05 Jun '20

05 Jun '20

Hi, can anybody help me to find some information about test types used in the project and tools used? Particularly interesting would be tools and tests used for the Python coding, but also any information about Java would be appreciated. I already scanned the documentation, but I mainly found only information about Mocking tools. Thank you! /juergen

3 2

Ovirt 4.4 Migration assistance needed.
by Strahil Nikolov 05 Jun '20

05 Jun '20

Hello All, I would like to ask for some assistance with the planing of the upgrade to 4.4 . I have issues with the OVN (doesn't work at all), thus I would like to start fresh with the HE. The plan so far (downtime is not an issue) : 1. Reinstall the nodes one by 1 and rejoin them in the Gluster TSP 2. Wipe the HostedEngine's gluster volume 3. Deploy a fresh hosted engine 4. Import the storage domains (gluster) back to the engine and import the VMs Do you see any issues with the plan ? Any problems expected if the VMs do have snapshots? What about the storage domain version ? Thanks in Advance. Best Regards, Strahil Nikolov

3 4

Gluster error in server log.
by Krist van Besien 05 Jun '20

05 Jun '20

Hello all, On my ovirt HC cluster I constantly get the following kinds of errors: From /var/log/ovirt-engine/engine.log 2020-06-05 10:38:36,652+02 WARN [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-15) [] Could not associate brick 'on1.ws.kri.st:/gluster_bricks/vmstore/vmstore' of volume 'dab47af2-16fc-461d-956e-daab00c8489e' with correct network as no gluster network found in cluster 'a8a38ffe-a499-11ea-9471-00163e5ffe63' Normally you get these errors if you forgot to define and assign a storage network. However I do have a storage network, have assigned it to the interface used by gluster on each host, and have set it as the “gluster” network in the default cluster. So why am I still getting this error? Krist Vriendelijke Groet | Best Regards | Freundliche Grüße | Cordialement Krist van Besien krist.vanbesien(a)gmail.com

2 1

Tasks stuck waiting on another after failed storage migration (yet not visible on SPM)
by David Sekne 05 Jun '20

05 Jun '20

Hello, I'm running oVirt version 4.3.9.4-1.el7. After a failed live storage migration a VM got stuck with snapshot. Checking the engine logs I can see that the snapshot removal task is waiting for Merge to complete and vice versa. 2020-05-26 18:34:04,826+02 INFO [org.ovirt.engine.core.bll.snapshots.RemoveSnapshotSingleDiskLiveCommandCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-70) [90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Command 'RemoveSnapshotSingleDiskLive' (id: '60ce36c1-bf74-40a9-9fb0-7fcf7eb95f40') waiting on child command id: 'f7d1de7b-9e87-47ba-9ba0-ee04301ba3b1' type:'Merge' to complete 2020-05-26 18:34:04,827+02 INFO [org.ovirt.engine.core.bll.MergeCommandCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-70) [90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Waiting on merge command to complete (jobId = f694590a-1577-4dce-bf0c-3a8d74adf341) 2020-05-26 18:34:04,845+02 INFO [org.ovirt.engine.core.bll.ConcurrentChildCommandsExecutionCallback] (EE-ManagedThreadFactory-engineScheduled-Thread-70) [90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Command 'RemoveSnapshot' (id: '47c9a847-5b4b-4256-9264-a760acde8275') waiting on child command id: '60ce36c1-bf74-40a9-9fb0-7fcf7eb95f40' type:'RemoveSnapshotSingleDiskLive' to complete 2020-05-26 18:34:14,277+02 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmJobsMonitoring] (EE-ManagedThreadFactory-engineScheduled-Thread-96) [] VM Job [f694590a-1577-4dce-bf0c-3a8d74adf341]: In progress (no change) I cannot see any runnig tasks on the SPM (vdsm-client Host getAllTasksInfo). I also cannot find the task ID in any of the other node's logs. I already tried restarting the Engine (didn't help). To start I'm puzzled as to where this task is queueing? Any Ideas on how I could resolve this? Thank you. Regards, David

3 12

Re: Single instance scaleup.
by Strahil 05 Jun '20

05 Jun '20

Hi Leo, As you do not have a distributed volume , you can easily switch to replica 2 arbiter 1 or replica 3 volumes. You can use the following for adding the bricks: https://access.redhat.com/documentation/en-US/Red_Hat_Storage/2.1/html/Admi… Best Regards, Strahil NikolivOn May 26, 2019 10:54, Leo David <leoalex(a)gmail.com> wrote: > > Hi Stahil, > Thank you so much for yout input ! > > gluster volume info > > > Volume Name: engine > Type: Distribute > Volume ID: d7449fc2-cc35-4f80-a776-68e4a3dbd7e1 > Status: Started > Snapshot Count: 0 > Number of Bricks: 1 > Transport-type: tcp > Bricks: > Brick1: 192.168.80.191:/gluster_bricks/engine/engine > Options Reconfigured: > nfs.disable: on > transport.address-family: inet > storage.owner-uid: 36 > storage.owner-gid: 36 > features.shard: on > performance.low-prio-threads: 32 > performance.strict-o-direct: off > network.remote-dio: off > network.ping-timeout: 30 > user.cifs: off > performance.quick-read: off > performance.read-ahead: off > performance.io-cache: off > cluster.eager-lock: enable > Volume Name: ssd-samsung > Type: Distribute > Volume ID: 76576cc6-220b-4651-952d-99846178a19e > Status: Started > Snapshot Count: 0 > Number of Bricks: 1 > Transport-type: tcp > Bricks: > Brick1: 192.168.80.191:/gluster_bricks/sdc/data > Options Reconfigured: > cluster.eager-lock: enable > performance.io-cache: off > performance.read-ahead: off > performance.quick-read: off > user.cifs: off > network.ping-timeout: 30 > network.remote-dio: off > performance.strict-o-direct: on > performance.low-prio-threads: 32 > features.shard: on > storage.owner-gid: 36 > storage.owner-uid: 36 > transport.address-family: inet > nfs.disable: on > > The other two hosts will be 192.168.80.192/193 - this is gluster dedicated network over 10GB sfp+ switch. > - host 2 wil have identical harware configuration with host 1 ( each disk is actually a raid0 array ) > - host 3 has: > - 1 ssd for OS > - 1 ssd - for adding to engine volume in a full replica 3 > - 2 ssd's in a raid 1 array to be added as arbiter for the data volume ( ssd-samsung ) > So the plan is to have "engine" scaled in a full replica 3, and "ssd-samsung" scalled in a replica 3 arbitrated. > > > > > On Sun, May 26, 2019 at 10:34 AM Strahil <hunter86_bg(a)yahoo.com> wrote: >> >> Hi Leo, >> >> Gluster is quite smart, but in order to provide any hints , can you provide output of 'gluster volume info <glustervol>'. >> If you have 2 more systems , keep in mind that it is best to mirror the storage on the second replica (2 disks on 1 machine -> 2 disks on the new machine), while for the arbiter this is not neccessary. >> >> What is your network and NICs ? Based on my experience , I can recommend at least 10 gbit/s interfase(s). >> >> Best Regards, >> Strahil Nikolov >> >> On May 26, 2019 07:52, Leo David <leoalex(a)gmail.com> wrote: >>> >>> Hello Everyone, >>> Can someone help me to clarify this ? >>> I have a single-node 4.2.8 installation ( only two gluster storage domains - distributed single drive volumes ). Now I just got two identintical servers and I would like to go for a 3 nodes bundle. >>> Is it possible ( after joining the new nodes to the cluster ) to expand the existing volumes across the new nodes and change them to replica 3 arbitrated ? >>> If so, could you share with me what would it be the procedure ? >>> Thank you very much ! >>> >>> Leo > > > > -- > Best regards, Leo David

4 5