Re: [ovirt-users] gluster performance oVirt 3.4

On 05/14/2014 02:36 PM, Vadims Korsaks wrote: > Citējot Sahina Bose <sabose(a)redhat.com&gt; : >> >> On 05/13/2014 07:27 PM, Vadims Korsaks wrote: >>> Citējot Humble Devassy Chirammal >>> <humble.devassy(a)gmail.com&gt; : >>>> >>>>> >>>>> Citējot Vijay Bellur <vbellur(a)redhat.com&gt; : >>>>>> On 05/11/2014 02:04 AM, Vadims Korsaks > wrote: >>>>>>> HI! >>>>>>> >>>>>>> Created 2 node setup with oVirt 3.4 and >>>>> CentOS 6.5, for storage created >>>>>>> 2 node replicated gluster (3.5) fs on same >>>>> hosts with oVirt. >>>>>>> mount looks like this: >>>>>>> 127.0.0.1:/gluster01 on >>>>>>> >>>>> >>> >

>>>>> type fuse.glusterfs >>>>>>> >>>>> >>> >

>>>>>>> >>>>>>> when i making gluster test with dd, >>> something >>>>> like >>>>>>> dd if=/dev/zero bs=1M count=20000 >>>>>>> >>>>> >>> >

>>>>>>> i'm gettting speed ~ 110 MB/s, so this is >>>>> 1Gbps speed of ethernet adapter >>>>>>> >>>>>>> but with in VM created in oVirt speed is >>>>> lower than 20 MB/s >>>>>>> >>>>>>> why there is so huge difference? >>>>>>> how can improve VMs disks speed? >>>>>>> >>>>>> >>>>>> What are your gluster volume settings? >>> Have you >>>>> applied the following >>>>>> performance tunables in gluster's virt >>> profile: >>>>>> >>>>>> eager-lock=enable >>>>>> remote-dio=enable >>>>>> >>>>>> Regards, >>>>>> Vijay >>>>>> >>>>> setting were: >>>>> [root@centos155 ~]# gluster volume info > gluster01 >>>>> >>>>> Volume Name: gluster01 >>>>> Type: Replicate >>>>> Volume ID: > 436edaa3-ac8b-421f-aa35-68b5bd7064b6 >>>>> Status: Started >>>>> Number of Bricks: 1 x 2 = 2 >>>>> Transport-type: tcp >>>>> Bricks: >>>>> Brick1: 10.2.75.152:/mnt/gluster01/brick >>>>> Brick2: 10.2.75.155:/mnt/gluster01/brick >>>>> Options Reconfigured: >>>>> storage.owner-gid: 36 >>>>> storage.owner-uid: 36 >>>>> >>>>> >>>>> add your settings settings now it looks >>>>> >>>>> [root@centos155 ~]# gluster volume info > gluster01 >>>>> >>>>> Volume Name: gluster01 >>>>> Type: Replicate >>>>> Volume ID: > 436edaa3-ac8b-421f-aa35-68b5bd7064b6 >>>>> Status: Started >>>>> Number of Bricks: 1 x 2 = 2 >>>>> Transport-type: tcp >>>>> Bricks: >>>>> Brick1: 10.2.75.152:/mnt/gluster01/brick >>>>> Brick2: 10.2.75.155:/mnt/gluster01/brick >>>>> Options Reconfigured: >>>>> network.remote-dio: enable >>>>> cluster.eager-lock: enable >>>>> storage.owner-gid: 36 >>>>> storage.owner-uid: 36 >>>>> >>>>> >>>>> but this didn't affected performace in any >>> big way >>>>> should hosts to be restarted? >>>>> >>>> >>>> glusterfs storage domain configuration GUI got >>> ""Optimize for virt. store" option which have to >>> be enabled when configuring for virt store. >>>> >>>> >>> >

>>>> >>>> If the configuration is manual, you need to >>> set the group to 'virt' as shown below >>>> >>>> #gluster volume set VOLNAME group virt >>>> >>>> This will enable below options on gluster > volume : >>>> >>>> quick-read=off >>>> read-ahead=off >>>> io-cache=off >>>> stat-prefetch=off >>>> eager-lock=enable >>>> remote-dio=on >>>> >>>> >>>> Can you please make sure group has set > properly ? >>>> >>>> Also, invoke "dd" with oflag=direct option and >>> check whether it helps .. >>>> >>>> >>>> --Humble >>> tnx a lot!! now it's much better - from VM i can >>> get dd with ~ 60 MB/s >>> this is still ~ x2 lower than from host, but x3 >>> better than it was before :) >>> >>> BTW could not found "GUI got ""Optimize for virt. >>> store" option" in oVirt 3.5 >> >> >> The option "Optimize for Virt store" is > available when you select a >> volume in Ovirt - both as a right click menu > option as well as a button >> in the top sub navigation bar. >> >> You also can check this option while creating a > gluster volume using the >> oVirt GUI >> >> > i have glusterfs as my master storage, but there > is nothing in volumes, empty. And i can't create > gluster volume, there is no choise in Data Center > and Volume Cluster. > To be able to manage gluster (i.e create volume,

probe hosts) from Ovirt UI, the cluster should

service" option checked. I think you may not

created the cluster. To use gluster volume as

option is not required. Hope this helps.