Performance issue for GlusterFS as the block storage for VMs
--_000_ED08B56256B38842A463A2A0804C5AC0326B0A4595svrcaexch1atg_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hi I have one question about whether GlusterFS is the suitable solution to be = used as the block storage for VMs. The failure tolerant and scalability is good for GlusterFS, but in my test,= it seems the iops is pretty bad. In some blog, it said, it is even with wo= rse performance than normal NFS. Should I use iscsi+drbd for the block storage for VMs. Can somebody give some advice for this? Thanks, Cong ________________________________ This e-mail message is for the sole use of the intended recipient(s) and ma= y contain confidential and privileged information. Any unauthorized review,= use, disclosure or distribution is prohibited. If you are not the intended= recipient, please contact the sender by reply e-mail and destroy all copie= s of the original message. If you are the intended recipient, please be adv= ised that the content of this message is subject to access, review and disc= losure by the sender's e-mail System Administrator. --_000_ED08B56256B38842A463A2A0804C5AC0326B0A4595svrcaexch1atg_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:= //www.w3.org/TR/REC-html40"> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
<meta name=3D"Generator" content=3D"Microsoft Word 14 (filtered medium)"> <style><!-- /* Font Definitions */ @font-face {font-family:SimSun; panose-1:2 1 6 0 3 1 1 1 1 1;} @font-face {font-family:"Cambria Math"; panose-1:2 4 5 3 5 4 6 3 2 4;} @font-face {font-family:Calibri; panose-1:2 15 5 2 2 2 4 3 2 4;} @font-face {font-family:Tahoma; panose-1:2 11 6 4 3 5 4 4 2 4;} @font-face {font-family:"\@SimSun"; panose-1:2 1 6 0 3 1 1 1 1 1;} /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {margin:0in; margin-bottom:.0001pt; font-size:11.0pt; font-family:"Calibri","sans-serif";} a:link, span.MsoHyperlink {mso-style-priority:99; color:blue; text-decoration:underline;} a:visited, span.MsoHyperlinkFollowed {mso-style-priority:99; color:purple; text-decoration:underline;} p.MsoAcetate, li.MsoAcetate, div.MsoAcetate {mso-style-priority:99; mso-style-link:"Balloon Text Char"; margin:0in; margin-bottom:.0001pt; font-size:8.0pt; font-family:"Tahoma","sans-serif";} span.EmailStyle17 {mso-style-type:personal-compose; font-family:"Calibri","sans-serif"; color:windowtext;} span.BalloonTextChar {mso-style-name:"Balloon Text Char"; mso-style-priority:99; mso-style-link:"Balloon Text"; font-family:"Tahoma","sans-serif";} .MsoChpDefault {mso-style-type:export-only; font-family:"Calibri","sans-serif";} @page WordSection1 {size:8.5in 11.0in; margin:1.0in 1.0in 1.0in 1.0in;} div.WordSection1 {page:WordSection1;} --></style><!--[if gte mso 9]><xml> <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" /> </xml><![endif]--><!--[if gte mso 9]><xml> <o:shapelayout v:ext=3D"edit"> <o:idmap v:ext=3D"edit" data=3D"1" /> </o:shapelayout></xml><![endif]--> </head> <body lang=3D"EN-US" link=3D"blue" vlink=3D"purple"> <div class=3D"WordSection1"> <p class=3D"MsoNormal">Hi <o:p></o:p></p> <p class=3D"MsoNormal"><o:p> </o:p></p> <p class=3D"MsoNormal">I have one question about whether GlusterFS is the s= uitable solution to be used as the block storage for VMs.<o:p></o:p></p> <p class=3D"MsoNormal">The failure tolerant and scalability is good for Glu= sterFS, but in my test, it seems the iops is pretty bad. In some blog, it s= aid, it is even with worse performance than normal NFS.<o:p></o:p></p> <p class=3D"MsoNormal">Should I use iscsi+drbd for the block storage fo= r VMs.<o:p></o:p></p> <p class=3D"MsoNormal">Can somebody give some advice for this? <o:p></o:p><= /p> <p class=3D"MsoNormal"><o:p> </o:p></p> <p class=3D"MsoNormal">Thanks,<br> Cong<o:p></o:p></p> </div> <br> <hr> <font face=3D"Arial" color=3D"Gray" size=3D"1">This e-mail message is for t= he sole use of the intended recipient(s) and may contain confidential and p= rivileged information. Any unauthorized review, use, disclosure or distribu= tion is prohibited. If you are not the intended recipient, please contact the sender by reply e-mail and destroy = all copies of the original message. If you are the intended recipient, plea= se be advised that the content of this message is subject to access, review= and disclosure by the sender's e-mail System Administrator.<br> </font> </body> </html> --_000_ED08B56256B38842A463A2A0804C5AC0326B0A4595svrcaexch1atg_--
This is a multipart message in MIME format. ------=_NextPart_000_005B_01D030B6.2A3EBC40 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Do you have any metrics to give an idea of the difference. I am using NFS right now, and I am migrating to Gluster. I have the gluster system up, and I see that it seems to provision disks faster than my NFS. I haven't used any real measurement tools to get actual metrics, this is all perceived. Do you have an operational gluster? Do what are you using right now? Donny D cloudspin.me From: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] On Behalf Of Yue, Cong Sent: Thursday, January 15, 2015 10:57 AM To: users@ovirt.org Subject: [ovirt-users] Performance issue for GlusterFS as the block storage for VMs Hi I have one question about whether GlusterFS is the suitable solution to be used as the block storage for VMs. The failure tolerant and scalability is good for GlusterFS, but in my test, it seems the iops is pretty bad. In some blog, it said, it is even with worse performance than normal NFS. Should I use iscsi+drbd for the block storage for VMs. Can somebody give some advice for this? Thanks, Cong _____ This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's e-mail System Administrator. ------=_NextPart_000_005B_01D030B6.2A3EBC40 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" = xmlns:o=3D"urn:schemas-microsoft-com:office:office" = xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" = xmlns=3D"http://www.w3.org/TR/REC-html40"><head><META = HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; = charset=3Dus-ascii"><meta name=3DGenerator content=3D"Microsoft Word 14 = (filtered medium)"><!--[if !mso]><style>v\:* = {behavior:url(#default#VML);} o\:* {behavior:url(#default#VML);} w\:* {behavior:url(#default#VML);} .shape {behavior:url(#default#VML);} </style><![endif]--><style><!-- /* Font Definitions */ @font-face {font-family:Calibri; panose-1:2 15 5 2 2 2 4 3 2 4;} @font-face {font-family:Tahoma; panose-1:2 11 6 4 3 5 4 4 2 4;} /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {margin:0in; margin-bottom:.0001pt; font-size:11.0pt; font-family:"Calibri","sans-serif";} a:link, span.MsoHyperlink {mso-style-priority:99; color:blue; text-decoration:underline;} a:visited, span.MsoHyperlinkFollowed {mso-style-priority:99; color:purple; text-decoration:underline;} p.MsoAcetate, li.MsoAcetate, div.MsoAcetate {mso-style-priority:99; mso-style-link:"Balloon Text Char"; margin:0in; margin-bottom:.0001pt; font-size:8.0pt; font-family:"Tahoma","sans-serif";} span.BalloonTextChar {mso-style-name:"Balloon Text Char"; mso-style-priority:99; mso-style-link:"Balloon Text"; font-family:"Tahoma","sans-serif";} span.EmailStyle19 {mso-style-type:personal; font-family:"Calibri","sans-serif"; color:windowtext;} span.EmailStyle20 {mso-style-type:personal-reply; font-family:"Calibri","sans-serif"; color:#1F497D;} .MsoChpDefault {mso-style-type:export-only; font-size:10.0pt;} @page WordSection1 {size:8.5in 11.0in; margin:1.0in 1.0in 1.0in 1.0in;} div.WordSection1 {page:WordSection1;} --></style><!--[if gte mso 9]><xml> <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" /> </xml><![endif]--><!--[if gte mso 9]><xml> <o:shapelayout v:ext=3D"edit"> <o:idmap v:ext=3D"edit" data=3D"1" /> </o:shapelayout></xml><![endif]--></head><body lang=3DEN-US link=3Dblue = vlink=3Dpurple><div class=3DWordSection1><p class=3DMsoNormal><span = style=3D'color:#1F497D'>Do you have any metrics to give an idea of the = difference. I am using NFS right now, and I am migrating to Gluster. I = have the gluster system up, and I see that it seems to provision disks = faster than my NFS. I haven’t used any real measurement tools to = get actual metrics, this is all perceived. <o:p></o:p></span></p><p = class=3DMsoNormal><span = style=3D'color:#1F497D'><o:p> </o:p></span></p><p = class=3DMsoNormal><span style=3D'color:#1F497D'>Do you have an = operational gluster?<o:p></o:p></span></p><p class=3DMsoNormal><span = style=3D'color:#1F497D'>Do what are you using right = now?<o:p></o:p></span></p><p class=3DMsoNormal><span = style=3D'color:#1F497D'><o:p> </o:p></span></p><p = class=3DMsoNormal><span style=3D'color:#1F497D'>Donny = D<o:p></o:p></span></p><p class=3DMsoNormal><span = style=3D'color:#1F497D'>cloudspin.me<o:p></o:p></span></p><p = class=3DMsoNormal><span = style=3D'color:#1F497D'><o:p> </o:p></span></p><div><div = style=3D'border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in = 0in 0in'><p class=3DMsoNormal><b><span = style=3D'font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span>= </b><span style=3D'font-size:10.0pt;font-family:"Tahoma","sans-serif"'> = users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] <b>On Behalf Of = </b>Yue, Cong<br><b>Sent:</b> Thursday, January 15, 2015 10:57 = AM<br><b>To:</b> users@ovirt.org<br><b>Subject:</b> [ovirt-users] = Performance issue for GlusterFS as the block storage for = VMs<o:p></o:p></span></p></div></div><p = class=3DMsoNormal><o:p> </o:p></p><p class=3DMsoNormal>Hi = <o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p = class=3DMsoNormal>I have one question about whether GlusterFS is the = suitable solution to be used as the block storage for = VMs.<o:p></o:p></p><p class=3DMsoNormal>The failure tolerant and = scalability is good for GlusterFS, but in my test, it seems the iops is = pretty bad. In some blog, it said, it is even with worse performance = than normal NFS.<o:p></o:p></p><p class=3DMsoNormal>Should I use = iscsi+drbd for the block storage for VMs.<o:p></o:p></p><p = class=3DMsoNormal>Can somebody give some advice for this? = <o:p></o:p></p><p class=3DMsoNormal><o:p> </o:p></p><p = class=3DMsoNormal>Thanks,<br>Cong<o:p></o:p></p><p = class=3DMsoNormal><span style=3D'font-size:12.0pt;font-family:"Times New = Roman","serif"'><o:p> </o:p></span></p><div class=3DMsoNormal = align=3Dcenter style=3D'text-align:center'><span = style=3D'font-size:12.0pt;font-family:"Times New Roman","serif"'><hr = size=3D2 width=3D"100%" align=3Dcenter></span></div><p = class=3DMsoNormal><span = style=3D'font-size:7.5pt;font-family:"Arial","sans-serif";color:gray'>Thi= s e-mail message is for the sole use of the intended recipient(s) and = may contain confidential and privileged information. Any unauthorized = review, use, disclosure or distribution is prohibited. If you are not = the intended recipient, please contact the sender by reply e-mail and = destroy all copies of the original message. If you are the intended = recipient, please be advised that the content of this message is subject = to access, review and disclosure by the sender's e-mail System = Administrator.</span><span style=3D'font-size:12.0pt;font-family:"Times = New Roman","serif"'><o:p></o:p></span></p></div></body></html> ------=_NextPart_000_005B_01D030B6.2A3EBC40--
participants (2)
-
Donny Davis -
Yue, Cong