[ovirt-users] gluster performance oVirt 3.4

Sahina Bose sabose at redhat.com
Wed May 14 09:11:05 UTC 2014


On 05/14/2014 02:36 PM, Vadims Korsaks wrote:
> Citējot Sahina Bose <sabose at redhat.com> :
>>   
>>   On 05/13/2014 07:27 PM, Vadims Korsaks wrote:
>>   > Citējot Humble Devassy Chirammal
>>   > <humble.devassy at gmail.com> :
>>   >>
>>   >> |
>>   >> | Citējot Vijay Bellur <vbellur at redhat.com> :
>>   >> | > On 05/11/2014 02:04 AM, Vadims Korsaks
> wrote:
>>   >> | > > HI!
>>   >> | > >
>>   >> | > > Created 2 node setup with oVirt 3.4 and
>>   >> | CentOS 6.5, for storage created
>>   >> | > > 2 node replicated gluster (3.5) fs on same
>>   >> | hosts with oVirt.
>>   >> | > > mount looks like this:
>>   >> | > > 127.0.0.1:/gluster01 on
>>   >> | > >
>>   >> |
>>   >
> /rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01
>>   >> | type fuse.glusterfs
>>   >> | > >
>>   >> |
>>   >
> (rw,default_permissions,allow_other,max_read=131072)
>>   >> | > >
>>   >> | > > when i making gluster test with dd,
>>   > something
>>   >> | like
>>   >> | > > dd if=/dev/zero bs=1M count=20000
>>   >> | > >
>>   >> |
>>   >
> of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka
>>   >> | > > i'm gettting speed ~ 110 MB/s, so this is
>>   >> | 1Gbps speed of ethernet adapter
>>   >> | > >
>>   >> | > > but with in VM created in oVirt speed is
>>   >> | lower than 20 MB/s
>>   >> | > >
>>   >> | > > why there is so huge difference?
>>   >> | > > how can improve VMs disks speed?
>>   >> | > >
>>   >> | >
>>   >> | > What are your gluster volume settings?
>>   > Have you
>>   >> | applied the following
>>   >> | > performance tunables in gluster's virt
>>   > profile:
>>   >> | >
>>   >> | > eager-lock=enable
>>   >> | > remote-dio=enable
>>   >> | >
>>   >> | > Regards,
>>   >> | > Vijay
>>   >> | >
>>   >> | setting were:
>>   >> | [root at centos155 ~]# gluster volume info
> gluster01
>>   >> |
>>   >> | Volume Name: gluster01
>>   >> | Type: Replicate
>>   >> | Volume ID:
> 436edaa3-ac8b-421f-aa35-68b5bd7064b6
>>   >> | Status: Started
>>   >> | Number of Bricks: 1 x 2 = 2
>>   >> | Transport-type: tcp
>>   >> | Bricks:
>>   >> | Brick1: 10.2.75.152:/mnt/gluster01/brick
>>   >> | Brick2: 10.2.75.155:/mnt/gluster01/brick
>>   >> | Options Reconfigured:
>>   >> | storage.owner-gid: 36
>>   >> | storage.owner-uid: 36
>>   >> |
>>   >> |
>>   >> | add your settings settings now it looks
>>   >> |
>>   >> | [root at centos155 ~]# gluster volume info
> gluster01
>>   >> |
>>   >> | Volume Name: gluster01
>>   >> | Type: Replicate
>>   >> | Volume ID:
> 436edaa3-ac8b-421f-aa35-68b5bd7064b6
>>   >> | Status: Started
>>   >> | Number of Bricks: 1 x 2 = 2
>>   >> | Transport-type: tcp
>>   >> | Bricks:
>>   >> | Brick1: 10.2.75.152:/mnt/gluster01/brick
>>   >> | Brick2: 10.2.75.155:/mnt/gluster01/brick
>>   >> | Options Reconfigured:
>>   >> | network.remote-dio: enable
>>   >> | cluster.eager-lock: enable
>>   >> | storage.owner-gid: 36
>>   >> | storage.owner-uid: 36
>>   >> |
>>   >> |
>>   >> | but this didn't affected performace in any
>>   > big way
>>   >> | should hosts to be restarted?
>>   >> |
>>   >>
>>   >> glusterfs storage domain configuration GUI got
>>   > ""Optimize for virt. store" option which have to
>>   > be enabled when configuring for virt store.
>>   >>
>>   >>
>>   >
> Ref#http://www.ovirt.org/Features/GlusterFS_Storage_Domain
>>   >>
>>   >> If the configuration is manual, you need to
>>   > set the group to 'virt' as shown below
>>   >>
>>   >> #gluster volume set VOLNAME group virt
>>   >>
>>   >> This will enable below options on gluster
> volume :
>>   >>
>>   >> quick-read=off
>>   >> read-ahead=off
>>   >> io-cache=off
>>   >> stat-prefetch=off
>>   >> eager-lock=enable
>>   >> remote-dio=on
>>   >>
>>   >>
>>   >> Can you please make sure group has set
> properly ?
>>   >>
>>   >> Also, invoke "dd" with oflag=direct option and
>>   > check whether it helps ..
>>   >>
>>   >>
>>   >> --Humble
>>   > tnx a lot!! now it's much better - from VM i can
>>   > get dd with ~ 60 MB/s
>>   > this is still ~ x2 lower than from host, but x3
>>   > better than it was before :)
>>   >
>>   > BTW could not found "GUI got ""Optimize for virt.
>>   > store" option" in oVirt 3.5
>>   
>>   
>>   The option "Optimize for Virt store" is
> available when you select a
>>   volume in Ovirt - both as a right click menu
> option as well as a button
>>   in the top sub navigation bar.
>>   
>>   You also can check this option while creating a
> gluster volume using the
>>   oVirt GUI
>>   
>>   
> i have glusterfs as my master storage, but there
> is nothing in volumes, empty. And i can't create
> gluster volume, there is no choise in Data Center
> and Volume Cluster.
>


To be able to manage gluster (i.e create volume, add bricks and peer 
probe hosts) from Ovirt UI, the cluster should have the "Enable gluster 
service" option checked. I think you may not have enabled this when you 
created the cluster. To use gluster volume as storage domain, this 
option is not required.

Hope this helps.





More information about the Users mailing list