Re: [ovirt-users] gluster performance oVirt 3.4
On 05/11/2014 02:04 AM, Vadims Korsaks wrote:
HI!
Created 2 node setup with oVirt 3.4 and CentOS 6.5, for storage created 2 node replicated gluster (3.5) fs on same hosts with oVirt. mount looks like this: 127.0.0.1:/gluster01 on
/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01 type fuse.glusterfs
(rw,default_permissions,allow_other,max_read=131072)
when i making gluster test with dd, something
Citējot Vijay Bellur <vbellur@redhat.com> : like
dd if=/dev/zero bs=1M count=20000
of=/rhev/data-center/mnt/glusterSD/127.0.0.1\:_gluster01/kaka
i'm gettting speed ~ 110 MB/s, so this is 1Gbps speed of ethernet adapter
but with in VM created in oVirt speed is lower than 20 MB/s
why there is so huge difference? how can improve VMs disks speed?
What are your gluster volume settings? Have you applied the following performance tunables in gluster's virt profile:
eager-lock=enable remote-dio=enable
Regards, Vijay
setting were: [root@centos155 ~]# gluster volume info gluster01 Volume Name: gluster01 Type: Replicate Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6 Status: Started Number of Bricks: 1 x 2 = 2 Transport-type: tcp Bricks: Brick1: 10.2.75.152:/mnt/gluster01/brick Brick2: 10.2.75.155:/mnt/gluster01/brick Options Reconfigured: storage.owner-gid: 36 storage.owner-uid: 36 add your settings settings now it looks [root@centos155 ~]# gluster volume info gluster01 Volume Name: gluster01 Type: Replicate Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd7064b6 Status: Started Number of Bricks: 1 x 2 = 2 Transport-type: tcp Bricks: Brick1: 10.2.75.152:/mnt/gluster01/brick Brick2: 10.2.75.155:/mnt/gluster01/brick Options Reconfigured: network.remote-dio: enable cluster.eager-lock: enable storage.owner-gid: 36 storage.owner-uid: 36 but this didn't affected performace in any big way should hosts to be restarted?
--Alternative_=_Boundary_=_1399847189 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable What's the underlying filesystem for gluster is it XFS?<br>What version of = gluster are you using?<br>What distro are you using and if its not RHEL or = Fedora are you using a version of QEMU with gluster support compiled in kee= p in mind the versions with CentOS and Scientific Linux do not include Glus= ter native support compiled in.<br><br><span style=3D"font-family:Prelude, = Verdana, san-serif;"><br><br></span><span id=3D"signature"><div style=3D"fo= nt-family: arial, sans-serif; font-size: 12px;color: #999999;">-- Sent from= my HP Pre3</div><br></span><span style=3D"color:navy; font-family:Prelude,= Verdana, san-serif; "><hr align=3D"left" style=3D"width:75%">On May 11, 20= 14 5:40, Vadims Korsaks <truckk@inbox.lv> wrote: <br><br></span>Cit= =C4=93jot Vijay Bellur <vbellur@redhat.com> :<br>> On 05/11/2014 = 02:04 AM, Vadims Korsaks wrote:<br>> > HI!<br>> ><br>> &g= t; Created 2 node setup with oVirt 3.4 and<br>CentOS 6.5, for storage creat= ed<br>> > 2 node replicated gluster (3.5) fs on same<br>hosts with o= Virt.<br>> > mount looks like this:<br>> > 127.0.0.1:/gluster= 01 on<br>> ><br>/rhev/data-center/mnt/glusterSD/127.0.0.1:_gluster01= <br>type fuse.glusterfs<br>> ><br>(rw,default_permissions,allow_othe= r,max_read=3D131072)<br>> ><br>> > when i making gluster test= with dd, something<br>like<br>> > dd if=3D/dev/zero bs=3D1M count= =3D20000<br>> ><br>of=3D/rhev/data-center/mnt/glusterSD/127.0.0.1\:_= gluster01/kaka<br>> > i'm gettting speed ~ 110 MB/s, so this is<br>1= Gbps speed of ethernet adapter<br>> ><br>> > but with in VM c= reated in oVirt speed is<br>lower than 20 MB/s<br>> ><br>> > = why there is so huge difference?<br>> > how can improve VMs disks sp= eed?<br>> ><br>> <br>> What are your gluster volume settings= ? Have you<br>applied the following<br>> performance tunables in gluste= r's virt profile:<br>> <br>> eager-lock=3Denable<br>> remote-di= o=3Denable<br>> <br>> Regards,<br>> Vijay<br>><br>setting we= re:<br>[root@centos155 ~]# gluster volume info gluster01<br><br>Volume Name= : gluster01<br>Type: Replicate<br>Volume ID: 436edaa3-ac8b-421f-aa35-68b5bd= 7064b6<br>Status: Started<br>Number of Bricks: 1 x 2 =3D 2<br>Transport-typ= e: tcp<br>Bricks:<br>Brick1: 10.2.75.152:/mnt/gluster01/brick<br>Brick2: 10= =2E2.75.155:/mnt/gluster01/brick<br>Options Reconfigured:<br>storage.owner-= gid: 36<br>storage.owner-uid: 36<br><br><br>add your settings settings now = it looks<br><br>[root@centos155 ~]# gluster volume info gluster01<br><br>Vo= lume Name: gluster01<br>Type: Replicate<br>Volume ID: 436edaa3-ac8b-421f-aa= 35-68b5bd7064b6<br>Status: Started<br>Number of Bricks: 1 x 2 =3D 2<br>Tran= sport-type: tcp<br>Bricks:<br>Brick1: 10.2.75.152:/mnt/gluster01/brick<br>B= rick2: 10.2.75.155:/mnt/gluster01/brick<br>Options Reconfigured:<br>network= =2Eremote-dio: enable<br>cluster.eager-lock: enable<br>storage.owner-gid: 3= 6<br>storage.owner-uid: 36<br><br><br>but this didn't affected performace i= n any big way<br>should hosts to be restarted?<br><br>_____________________= __________________________<br>Users mailing list<br>Users@ovirt.org<br>http= ://lists.ovirt.org/mailman/listinfo/users<br> --Alternative_=_Boundary_=_1399847189--
participants (2)
-
Paul Robert Marino -
Vadims Korsaks