clean of .shard files if changing volume settings
by Gianluca Cecchi
Hello,
I have a single host in 4.4 with HCI and Gluster.
I have only one brick for the volume and I disabled sharding:
[root@ovirt01 /root]# gluster volume set data features.shard off
volume set: success
[root@ovirt01 /root]#
In events of web admin I see it registered and updating db:
Detected change in value of option features.shard from on to off on volume
data of cluster Default, and updated it to engine DB.
6/3/206:46:52 PM
Then I delete a VM with a 65Gb disk, that I created while sharding was
enabled (I enabled the check box to remove disks) but it seems that files
under .shard are not removed.
[root@ovirt01 ~]# du -sh
/rhev/data-center/mnt/glusterSD/ovirt01st.lutwyn.storage\:_data/.shard/
62G /rhev/data-center/mnt/glusterSD/ovirt01st.lutwyn.storage:_data/.shard/
[root@ovirt01 ~]#
Is there any special command I have to run? Or can I simply remove the
.shard directory now?
I only had that VM in that storage domain before disabling sharding.
The files are all of type:
-rw-rw----. 1 root root 67100672 Jun 3 18:18
23f0c94c-cf2a-42c1-8e2e-a21c4e542774.1
-rw-rw----. 1 root root 67108864 Jun 3 18:18
23f0c94c-cf2a-42c1-8e2e-a21c4e542774.2
...
-rw-rw----. 1 root root 67108864 Jun 3 18:44
23f0c94c-cf2a-42c1-8e2e-a21c4e542774.1008
-rw-rw----. 1 root root 39845888 Jun 3 18:44
23f0c94c-cf2a-42c1-8e2e-a21c4e542774.1009
-rw-rw----. 1 root root 56643584 Jun 3 18:44
23f0c94c-cf2a-42c1-8e2e-a21c4e542774.1031
Thanks in advance,
Gianluca
3 years, 10 months
Re: Slow disk upload via WebGUI
by Strahil Nikolov
There is also the API and I think there was a python script for ISO upload.
You can also import from OVA.
As you have multiple VMDKs, why don't you just upload in parallel (20-30 disk in batch).
Best Regards,
Strahil Nikolov
На 6 юни 2020 г. 13:39:44 GMT+03:00, Magnus Isaksson <magnus(a)vmar.se> написа:
>Hi
>
>From what i can tell from that link is that there is only one way for
>my scenario, or have i missed something?
>
>"Procedure 11.8. Uploading a Disk Image to a Storage Domain"
>
>//Magnus
>________________________________
>From: Strahil Nikolov <hunter86_bg(a)yahoo.com>
>Sent: 06 June 2020 12:26
>To: users(a)ovirt.org <users(a)ovirt.org>; Magnus Isaksson <magnus(a)vmar.se>
>Subject: Re: [ovirt-users] Re: Slow disk upload via WebGUI
>
>Hi Magnus,
>
>
>there are several ways to upload a disk.
>
>For details, check
>https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.1/...
>
>Best Regards,
>Strahil Nikolov
>
>На 6 юни 2020 г. 12:15:36 GMT+03:00, Magnus Isaksson <magnus(a)vmar.se>
>написа:
>>A note to this is that we are migrating a couple of customers from a
>>vmware enviroment that we have no control over, we get the vmdk files
>>on a NFS share. its a bit over 130 VM:s and if every disk will go at
>>100mbit/s its quite a painful process.
>>
>>Is there a faster way to import these disk images other then via
>>WebGUI? (of course after convert)
>>
>>//Magnus
>>________________________________
>>From: Magnus Isaksson <magnus(a)vmar.se>
>>Sent: 06 June 2020 10:58
>>To: users <users(a)ovirt.org>
>>Subject: [ovirt-users] Slow disk upload via WebGUI
>>
>>Hello
>>
>>I'm running Engine 4.3.9 and have fibre channel SSD storage and 4
>>nodes.
>>
>>When uploading disk images i get around 100mbit/s per disk, if im
>>running 3 uploads at the same time i get about 300mbit/s combined.
>>Everything is connected via 10G and 16G to FC storage.
>>
>>Why is it so slow? and what can i do to speed things up?
>>
>>Regards
>> Magnus
3 years, 10 months
Re: Slow disk upload via WebGUI
by Strahil Nikolov
Hi Magnus,
there are several ways to upload a disk.
For details, check https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.1/...
Best Regards,
Strahil Nikolov
На 6 юни 2020 г. 12:15:36 GMT+03:00, Magnus Isaksson <magnus(a)vmar.se> написа:
>A note to this is that we are migrating a couple of customers from a
>vmware enviroment that we have no control over, we get the vmdk files
>on a NFS share. its a bit over 130 VM:s and if every disk will go at
>100mbit/s its quite a painful process.
>
>Is there a faster way to import these disk images other then via
>WebGUI? (of course after convert)
>
>//Magnus
>________________________________
>From: Magnus Isaksson <magnus(a)vmar.se>
>Sent: 06 June 2020 10:58
>To: users <users(a)ovirt.org>
>Subject: [ovirt-users] Slow disk upload via WebGUI
>
>Hello
>
>I'm running Engine 4.3.9 and have fibre channel SSD storage and 4
>nodes.
>
>When uploading disk images i get around 100mbit/s per disk, if im
>running 3 uploads at the same time i get about 300mbit/s combined.
>Everything is connected via 10G and 16G to FC storage.
>
>Why is it so slow? and what can i do to speed things up?
>
>Regards
> Magnus
3 years, 10 months
Re: Slow disk upload via WebGUI
by Magnus Isaksson
A note to this is that we are migrating a couple of customers from a vmware enviroment that we have no control over, we get the vmdk files on a NFS share. its a bit over 130 VM:s and if every disk will go at 100mbit/s its quite a painful process.
Is there a faster way to import these disk images other then via WebGUI? (of course after convert)
//Magnus
________________________________
From: Magnus Isaksson <magnus(a)vmar.se>
Sent: 06 June 2020 10:58
To: users <users(a)ovirt.org>
Subject: [ovirt-users] Slow disk upload via WebGUI
Hello
I'm running Engine 4.3.9 and have fibre channel SSD storage and 4 nodes.
When uploading disk images i get around 100mbit/s per disk, if im running 3 uploads at the same time i get about 300mbit/s combined.
Everything is connected via 10G and 16G to FC storage.
Why is it so slow? and what can i do to speed things up?
Regards
Magnus
3 years, 10 months
Slow disk upload via WebGUI
by Magnus Isaksson
Hello
I'm running Engine 4.3.9 and have fibre channel SSD storage and 4 nodes.
When uploading disk images i get around 100mbit/s per disk, if im running 3 uploads at the same time i get about 300mbit/s combined.
Everything is connected via 10G and 16G to FC storage.
Why is it so slow? and what can i do to speed things up?
Regards
Magnus
3 years, 10 months
Q: Which types of tests and tools are used?
by Juergen Novak
Hi,
can anybody help me to find some information about test types used in
the project and tools used?
Particularly interesting would be tools and tests used for the Python
coding, but also any information about Java would be appreciated.
I already scanned the documentation, but I mainly found only information
about Mocking tools.
Thank you!
/juergen
3 years, 10 months
Ovirt 4.4 Migration assistance needed.
by Strahil Nikolov
Hello All,
I would like to ask for some assistance with the planing of the upgrade to 4.4 .
I have issues with the OVN (doesn't work at all), thus I would like to start fresh with the HE.
The plan so far (downtime is not an issue) :
1. Reinstall the nodes one by 1 and rejoin them in the Gluster TSP
2. Wipe the HostedEngine's gluster volume
3. Deploy a fresh hosted engine
4. Import the storage domains (gluster) back to the engine and import the VMs
Do you see any issues with the plan ?
Any problems expected if the VMs do have snapshots? What about the storage domain version ?
Thanks in Advance.
Best Regards,
Strahil Nikolov
3 years, 10 months
Gluster error in server log.
by Krist van Besien
Hello all,
On my ovirt HC cluster I constantly get the following kinds of errors:
From /var/log/ovirt-engine/engine.log
2020-06-05 10:38:36,652+02 WARN [org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturn] (EE-ManagedScheduledExecutorService-engineScheduledThreadPool-Thread-15) [] Could not associate brick 'on1.ws.kri.st:/gluster_bricks/vmstore/vmstore' of volume 'dab47af2-16fc-461d-956e-daab00c8489e' with correct network as no gluster network found in cluster 'a8a38ffe-a499-11ea-9471-00163e5ffe63'
Normally you get these errors if you forgot to define and assign a storage network. However I do have a storage network, have assigned it to the interface used by gluster on each host, and have set it as the “gluster” network in the default cluster.
So why am I still getting this error?
Krist
Vriendelijke Groet | Best Regards | Freundliche Grüße | Cordialement
Krist van Besien
krist.vanbesien(a)gmail.com
3 years, 10 months
Tasks stuck waiting on another after failed storage migration (yet not visible on SPM)
by David Sekne
Hello,
I'm running oVirt version 4.3.9.4-1.el7.
After a failed live storage migration a VM got stuck with snapshot.
Checking the engine logs I can see that the snapshot removal task is
waiting for Merge to complete and vice versa.
2020-05-26 18:34:04,826+02 INFO
[org.ovirt.engine.core.bll.snapshots.RemoveSnapshotSingleDiskLiveCommandCallback]
(EE-ManagedThreadFactory-engineScheduled-Thread-70)
[90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Command
'RemoveSnapshotSingleDiskLive' (id: '60ce36c1-bf74-40a9-9fb0-7fcf7eb95f40')
waiting on child command id: 'f7d1de7b-9e87-47ba-9ba0-ee04301ba3b1'
type:'Merge' to complete
2020-05-26 18:34:04,827+02 INFO
[org.ovirt.engine.core.bll.MergeCommandCallback]
(EE-ManagedThreadFactory-engineScheduled-Thread-70)
[90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Waiting on merge command to complete
(jobId = f694590a-1577-4dce-bf0c-3a8d74adf341)
2020-05-26 18:34:04,845+02 INFO
[org.ovirt.engine.core.bll.ConcurrentChildCommandsExecutionCallback]
(EE-ManagedThreadFactory-engineScheduled-Thread-70)
[90f428b0-9c4e-4ac0-8de6-1103fc13da9e] Command 'RemoveSnapshot' (id:
'47c9a847-5b4b-4256-9264-a760acde8275') waiting on child command id:
'60ce36c1-bf74-40a9-9fb0-7fcf7eb95f40' type:'RemoveSnapshotSingleDiskLive'
to complete
2020-05-26 18:34:14,277+02 INFO
[org.ovirt.engine.core.vdsbroker.monitoring.VmJobsMonitoring]
(EE-ManagedThreadFactory-engineScheduled-Thread-96) [] VM Job
[f694590a-1577-4dce-bf0c-3a8d74adf341]: In progress (no change)
I cannot see any runnig tasks on the SPM (vdsm-client Host
getAllTasksInfo). I also cannot find the task ID in any of the other node's
logs.
I already tried restarting the Engine (didn't help).
To start I'm puzzled as to where this task is queueing?
Any Ideas on how I could resolve this?
Thank you.
Regards,
David
3 years, 10 months
Re: Single instance scaleup.
by Strahil
Hi Leo,
As you do not have a distributed volume , you can easily switch to replica 2 arbiter 1 or replica 3 volumes.
You can use the following for adding the bricks:
https://access.redhat.com/documentation/en-US/Red_Hat_Storage/2.1/html/Ad...
Best Regards,
Strahil NikolivOn May 26, 2019 10:54, Leo David <leoalex(a)gmail.com> wrote:
>
> Hi Stahil,
> Thank you so much for yout input !
>
> gluster volume info
>
>
> Volume Name: engine
> Type: Distribute
> Volume ID: d7449fc2-cc35-4f80-a776-68e4a3dbd7e1
> Status: Started
> Snapshot Count: 0
> Number of Bricks: 1
> Transport-type: tcp
> Bricks:
> Brick1: 192.168.80.191:/gluster_bricks/engine/engine
> Options Reconfigured:
> nfs.disable: on
> transport.address-family: inet
> storage.owner-uid: 36
> storage.owner-gid: 36
> features.shard: on
> performance.low-prio-threads: 32
> performance.strict-o-direct: off
> network.remote-dio: off
> network.ping-timeout: 30
> user.cifs: off
> performance.quick-read: off
> performance.read-ahead: off
> performance.io-cache: off
> cluster.eager-lock: enable
> Volume Name: ssd-samsung
> Type: Distribute
> Volume ID: 76576cc6-220b-4651-952d-99846178a19e
> Status: Started
> Snapshot Count: 0
> Number of Bricks: 1
> Transport-type: tcp
> Bricks:
> Brick1: 192.168.80.191:/gluster_bricks/sdc/data
> Options Reconfigured:
> cluster.eager-lock: enable
> performance.io-cache: off
> performance.read-ahead: off
> performance.quick-read: off
> user.cifs: off
> network.ping-timeout: 30
> network.remote-dio: off
> performance.strict-o-direct: on
> performance.low-prio-threads: 32
> features.shard: on
> storage.owner-gid: 36
> storage.owner-uid: 36
> transport.address-family: inet
> nfs.disable: on
>
> The other two hosts will be 192.168.80.192/193 - this is gluster dedicated network over 10GB sfp+ switch.
> - host 2 wil have identical harware configuration with host 1 ( each disk is actually a raid0 array )
> - host 3 has:
> - 1 ssd for OS
> - 1 ssd - for adding to engine volume in a full replica 3
> - 2 ssd's in a raid 1 array to be added as arbiter for the data volume ( ssd-samsung )
> So the plan is to have "engine" scaled in a full replica 3, and "ssd-samsung" scalled in a replica 3 arbitrated.
>
>
>
>
> On Sun, May 26, 2019 at 10:34 AM Strahil <hunter86_bg(a)yahoo.com> wrote:
>>
>> Hi Leo,
>>
>> Gluster is quite smart, but in order to provide any hints , can you provide output of 'gluster volume info <glustervol>'.
>> If you have 2 more systems , keep in mind that it is best to mirror the storage on the second replica (2 disks on 1 machine -> 2 disks on the new machine), while for the arbiter this is not neccessary.
>>
>> What is your network and NICs ? Based on my experience , I can recommend at least 10 gbit/s interfase(s).
>>
>> Best Regards,
>> Strahil Nikolov
>>
>> On May 26, 2019 07:52, Leo David <leoalex(a)gmail.com> wrote:
>>>
>>> Hello Everyone,
>>> Can someone help me to clarify this ?
>>> I have a single-node 4.2.8 installation ( only two gluster storage domains - distributed single drive volumes ). Now I just got two identintical servers and I would like to go for a 3 nodes bundle.
>>> Is it possible ( after joining the new nodes to the cluster ) to expand the existing volumes across the new nodes and change them to replica 3 arbitrated ?
>>> If so, could you share with me what would it be the procedure ?
>>> Thank you very much !
>>>
>>> Leo
>
>
>
> --
> Best regards, Leo David
3 years, 10 months
