[ovirt-users] gluster performance oVirt 3.4

[Vadims Korsaks]

Citējot Sahina Bose <sabose at redhat.com> :
>  
>  On 05/13/2014 07:27 PM, Vadims Korsaks wrote:
>  > Citējot Humble Devassy Chirammal
>  > <humble.devassy at gmail.com> :
>  >>
>  >> |
>  >> | Citējot Vijay Bellur <vbellur at redhat.com> :
>  >> | > On 05/11/2014 02:04 AM, Vadims Korsaks
wrote:
>  >> | > > HI!
>  >> | > >
>  >> | > > Created 2 node setup with oVirt 3.4 and
>  >> | CentOS 6.5, for storage created
>  >> | > > 2 node replicated gluster (3.5) fs on same
>  >> | hosts with oVirt.
>  >> | > > mount looks like this:
>  >> | > > 127.0.0.1:/gluster01 on
>  >> | > >
>  >> |
>  >
/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01
>  >> | type fuse.glusterfs
>  >> | > >
>  >> |
>  >
(rw,default_permissions,allow_other,max_read=131072)
>  >> | > >
>  >> | > > when i making gluster test with dd,
>  > something
>  >> | like
>  >> | > > dd if=/dev/zero bs=1M count=20000
>  >> | > >
>  >> |
>  >
of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka
>  >> | > > i'm gettting speed ~ 110 MB/s, so this is
>  >> | 1Gbps speed of ethernet adapter
>  >> | > >
>  >> | > > but with in VM created in oVirt speed is
>  >> | lower than 20 MB/s
>  >> | > >
>  >> | > > why there is so huge difference?
>  >> | > > how can improve VMs disks speed?
>  >> | > >
>  >> | >
>  >> | > What are your gluster volume settings?
>  > Have you
>  >> | applied the following
>  >> | > performance tunables in gluster's virt
>  > profile:
>  >> | >
>  >> | > eager-lock=enable
>  >> | > remote-dio=enable
>  >> | >
>  >> | > Regards,
>  >> | > Vijay
>  >> | >
>  >> | setting were:
>  >> | [root at centos155 ~]# gluster volume info
gluster01
>  >> |
>  >> | Volume Name: gluster01
>  >> | Type: Replicate
>  >> | Volume ID:
436edaa3-ac8b-421f-aa35-68b5bd7064b6
>  >> | Status: Started
>  >> | Number of Bricks: 1 x 2 = 2
>  >> | Transport-type: tcp
>  >> | Bricks:
>  >> | Brick1: 10.2.75.152:/mnt/gluster01/brick
>  >> | Brick2: 10.2.75.155:/mnt/gluster01/brick
>  >> | Options Reconfigured:
>  >> | storage.owner-gid: 36
>  >> | storage.owner-uid: 36
>  >> |
>  >> |
>  >> | add your settings settings now it looks
>  >> |
>  >> | [root at centos155 ~]# gluster volume info
gluster01
>  >> |
>  >> | Volume Name: gluster01
>  >> | Type: Replicate
>  >> | Volume ID:
436edaa3-ac8b-421f-aa35-68b5bd7064b6
>  >> | Status: Started
>  >> | Number of Bricks: 1 x 2 = 2
>  >> | Transport-type: tcp
>  >> | Bricks:
>  >> | Brick1: 10.2.75.152:/mnt/gluster01/brick
>  >> | Brick2: 10.2.75.155:/mnt/gluster01/brick
>  >> | Options Reconfigured:
>  >> | network.remote-dio: enable
>  >> | cluster.eager-lock: enable
>  >> | storage.owner-gid: 36
>  >> | storage.owner-uid: 36
>  >> |
>  >> |
>  >> | but this didn't affected performace in any
>  > big way
>  >> | should hosts to be restarted?
>  >> |
>  >>
>  >> glusterfs storage domain configuration GUI got
>  > ""Optimize for virt. store" option which have to
>  > be enabled when configuring for virt store.
>  >>
>  >>
>  >
Ref#http://www.ovirt.org/Features/GlusterFS_Storage_Domain
>  >>
>  >> If the configuration is manual, you need to
>  > set the group to 'virt' as shown below
>  >>
>  >> #gluster volume set VOLNAME group virt
>  >>
>  >> This will enable below options on gluster
volume :
>  >>
>  >> quick-read=off
>  >> read-ahead=off
>  >> io-cache=off
>  >> stat-prefetch=off
>  >> eager-lock=enable
>  >> remote-dio=on
>  >>
>  >>
>  >> Can you please make sure group has set
properly ?
>  >>
>  >> Also, invoke "dd" with oflag=direct option and
>  > check whether it helps ..
>  >>
>  >>
>  >> --Humble
>  > tnx a lot!! now it's much better - from VM i can
>  > get dd with ~ 60 MB/s
>  > this is still ~ x2 lower than from host, but x3
>  > better than it was before :)
>  >
>  > BTW could not found "GUI got ""Optimize for virt.
>  > store" option" in oVirt 3.5
>  
>  
>  The option "Optimize for Virt store" is
available when you select a
>  volume in Ovirt - both as a right click menu
option as well as a button
>  in the top sub navigation bar.
>  
>  You also can check this option while creating a
gluster volume using the
>  oVirt GUI
>  
>  
i have glusterfs as my master storage, but there
is nothing in volumes, empty. And i can't create
gluster volume, there is no choise in Data Center
and Volume Cluster.