<div dir="ltr"><div><div><div>><br>tnx a lot!! now it's much better - from VM i can<br>
get dd with ~ 60 MB/s<br>
this is still ~ x2 lower than from host, but x3<br>
better than it was before :)<br>><br><br></div>cool :)<br><br>><br>BTW could not found "GUI got ""Optimize for virt.<br>
store" option" in oVirt 3.5<br>><br><br></div>Thanks Sahina for the inputs here. <br><br></div>--Humble<br></div><div class="gmail_extra"><br><br><div class="gmail_quote">On Tue, May 13, 2014 at 7:27 PM, Vadims Korsaks <span dir="ltr"><<a href="mailto:truckk@inbox.lv" target="_blank">truckk@inbox.lv</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">Citējot Humble Devassy Chirammal<br>
<<a href="mailto:humble.devassy@gmail.com">humble.devassy@gmail.com</a>> :<br>
<div><div class="h5">><br>
> |<br>
> | Citējot Vijay Bellur <<a href="mailto:vbellur@redhat.com">vbellur@redhat.com</a>> :<br>
> | > On 05/11/2014 02:04 AM, Vadims Korsaks wrote:<br>
> | > > HI!<br>
> | > ><br>
> | > > Created 2 node setup with oVirt 3.4 and<br>
> | CentOS 6.5, for storage created<br>
> | > > 2 node replicated gluster (3.5) fs on same<br>
> | hosts with oVirt.<br>
> | > > mount looks like this:<br>
> | > > 127.0.0.1:/gluster01 on<br>
> | > ><br>
> |<br>
/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01<br>
> | type fuse.glusterfs<br>
> | > ><br>
> |<br>
(rw,default_permissions,allow_other,max_read=131072)<br>
> | > ><br>
> | > > when i making gluster test with dd,<br>
something<br>
> | like<br>
> | > > dd if=/dev/zero bs=1M count=20000<br>
> | > ><br>
> |<br>
of=/rhev/data-center/mnt/glusterSD/<a href="http://127.0.0.1" target="_blank">127.0.0.1</a>\:_gluster01/kaka<br>
> | > > i'm gettting speed ~ 110 MB/s, so this is<br>
> | 1Gbps speed of ethernet adapter<br>
> | > ><br>
> | > > but with in VM created in oVirt speed is<br>
> | lower than 20 MB/s<br>
> | > ><br>
> | > > why there is so huge difference?<br>
> | > > how can improve VMs disks speed?<br>
> | > ><br>
> | ><br>
> | > What are your gluster volume settings?<br>
Have you<br>
> | applied the following<br>
> | > performance tunables in gluster's virt<br>
profile:<br>
> | ><br>
> | > eager-lock=enable<br>
> | > remote-dio=enable<br>
> | ><br>
> | > Regards,<br>
> | > Vijay<br>
> | ><br>
> | setting were:<br>
> | [root@centos155 ~]# gluster volume info gluster01<br>
> |<br>
> | Volume Name: gluster01<br>
> | Type: Replicate<br>
> | Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6<br>
> | Status: Started<br>
> | Number of Bricks: 1 x 2 = 2<br>
> | Transport-type: tcp<br>
> | Bricks:<br>
> | Brick1: 10.2.75.152:/mnt/gluster01/brick<br>
> | Brick2: 10.2.75.155:/mnt/gluster01/brick<br>
> | Options Reconfigured:<br>
> | storage.owner-gid: 36<br>
> | storage.owner-uid: 36<br>
> |<br>
> |<br>
> | add your settings settings now it looks<br>
> |<br>
> | [root@centos155 ~]# gluster volume info gluster01<br>
> |<br>
> | Volume Name: gluster01<br>
> | Type: Replicate<br>
> | Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6<br>
> | Status: Started<br>
> | Number of Bricks: 1 x 2 = 2<br>
> | Transport-type: tcp<br>
> | Bricks:<br>
> | Brick1: 10.2.75.152:/mnt/gluster01/brick<br>
> | Brick2: 10.2.75.155:/mnt/gluster01/brick<br>
> | Options Reconfigured:<br>
> | network.remote-dio: enable<br>
> | cluster.eager-lock: enable<br>
> | storage.owner-gid: 36<br>
> | storage.owner-uid: 36<br>
> |<br>
> |<br>
> | but this didn't affected performace in any<br>
big way<br>
> | should hosts to be restarted?<br>
> |<br>
><br>
> glusterfs storage domain configuration GUI got<br>
""Optimize for virt. store" option which have to<br>
be enabled when configuring for virt store.<br>
><br>
><br>
Ref#<a href="http://www.ovirt.org/Features/GlusterFS_Storage_Domain" target="_blank">http://www.ovirt.org/Features/GlusterFS_Storage_Domain</a><br>
><br>
> If the configuration is manual, you need to<br>
set the group to 'virt' as shown below<br>
><br>
> #gluster volume set VOLNAME group virt<br>
><br>
> This will enable below options on gluster volume :<br>
><br>
> quick-read=off<br>
> read-ahead=off<br>
> io-cache=off<br>
> stat-prefetch=off<br>
> eager-lock=enable<br>
> remote-dio=on<br>
><br>
><br>
> Can you please make sure group has set properly ?<br>
><br>
> Also, invoke "dd" with oflag=direct option and<br>
check whether it helps ..<br>
><br>
><br>
> --Humble<br>
<br>
</div></div>tnx a lot!! now it's much better - from VM i can<br>
get dd with ~ 60 MB/s<br>
this is still ~ x2 lower than from host, but x3<br>
better than it was before :)<br>
<br>
BTW could not found "GUI got ""Optimize for virt.<br>
store" option" in oVirt 3.5<br>
<br>
</blockquote></div><br></div>