<div dir="ltr"><div class="gmail_extra"><br>
<br><br><div class="gmail_quote">On Mon, Feb 17, 2014 at 3:50 AM, Justin Clacherty <span dir="ltr"><<a href="mailto:justin@redfish.com.au" target="_blank" onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=justin@redfish.com.au&cc=&bcc=&su=&body=','_blank');return false;">justin@redfish.com.au</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-AU" link="#0563C1" vlink="#954F72"><div><p class="MsoNormal">Hi,<u></u><u></u></p><p class="MsoNormal"><u></u> <u></u></p>
<p class="MsoNormal">I’m just setting up some storage for use with oVirt and am wondering why I might choose glusterfs rather than just exporting a raid array as iscsi. The oVirt team seem to be pushing gluster (though that could just be because it’s a Red Hat product). Can anyone answer this one?</p>
</div></div></blockquote><div><br></div><div>If you're contemplating software iscsi then you probably aren't working on a production setup that requires high availability or data consistency. If you are, you should take a deep dive on what your single point of failures are. If you're actually talking about a SAN lun, then I would imagine you aren't the storage admin, and can leave the particulars in their hands.</div>
<div><br></div><div>Its funny, in RH's current supported version of RHEV, native gluster storage isn't even an option. This is a pretty new project, and if you follow the bread crumbs on distributed file systems like glusterfs or ceph you'll start to see the future advantages. You can also figure that seeing as both projects are spearheaded by RH dev's that there is likely a lot of cross-talk and feature requests making both projects better, and who wouldn't promote a better solution?</div>
<div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-AU" link="#0563C1" vlink="#954F72"><div><p class="MsoNormal"><u></u><u></u></p><p class="MsoNormal">
<u></u> <u></u></p><p class="MsoNormal">What I have come up with is as follows.<u></u><u></u></p><p class="MsoNormal"><u></u> <u></u></p><p class="MsoNormal">For:</p></div></div></blockquote><div><br></div><div>There is too much to cover in any of these advantages, you're going to need to do a lot of research on each of these 'features' if you want to use them successfully. </div>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-AU" link="#0563C1" vlink="#954F72"><div><p class="MsoNormal"><u></u><u></u></p><p><u></u><span>-<span style="font:7.0pt "Times New Roman""> </span></span><u></u>easy to expand<u></u><u></u></p>
<p><u></u><span>-<span style="font:7.0pt "Times New Roman""> </span></span><u></u>redundancy across storage devices/easy replication<u></u><u></u></p><p><u></u><span>-<span style="font:7.0pt "Times New Roman""> </span></span><u></u>high availablility<u></u><u></u></p>
<p><u></u><span>-<span style="font:7.0pt "Times New Roman""> </span></span><u></u>performance<u></u><u></u></p><p><u></u><span>-<span style="font:7.0pt "Times New Roman""> </span></span><u></u>it’s kind of cool <span style="font-family:Wingdings">J</span><u></u><u></u></p>
<p><u></u><span>-<span style="font:7.0pt "Times New Roman""> </span></span><u></u>maintenance?<u></u><u></u></p><p class="MsoNormal"><u></u> <u></u></p><p class="MsoNormal">Against (these are guesses):<u></u><u></u></p>
<p><u></u><span>-<span style="font:7.0pt "Times New Roman""> </span></span><u></u>performance? (multiple layers of filesystems everywhere – fs in vm + image on gluster + gluster + block filesystem)</p></div>
</div></blockquote><div>Its worse than just a ton of software layers. NAS protocols seem to be focused on data consistency, which means they don't write async to storage. iscsi is typically async and has much better throughput, but also a greater chance for data loss or corruption. Technically you can achieve the same level of performance as iscsi using NFS (backed by glusterfs if you like) but you need to set options on the volume to allow async writes.</div>
<div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-AU" link="#0563C1" vlink="#954F72"><div><p><u></u><u></u></p><p><u></u><span>-<span style="font:7.0pt "Times New Roman""> </span></span><u></u>complexity</p>
</div></div></blockquote><div>If you're doing storage properly, the underpinnings are always complex unless you're paying someone else to do it (read: SAN / managed service provider). Research multipath and HA on software iscsi and you'll see what I mean.</div>
<div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-AU" link="#0563C1" vlink="#954F72"><div><p><u></u><u></u></p><p><u></u><span>-<span style="font:7.0pt "Times New Roman""> </span></span><u></u>maintenance?<u></u><u></u></p>
<p class="MsoNormal"><u></u> <u></u></p><p class="MsoNormal">Any help here is appreciated. Also, does the underlying block level filesystem matter here? VMs running under ovirt would be typical business applications – file serving (samba4), email, databases, web servers, etc.</p>
</div></div></blockquote><div><br></div><div>There is a lot to answer here and I don't have all the answers. Take a look at the gluster docs for underlying file system requirements. Any block device should work. Specifically I'll mention that the glusterfs team doesn't suggest hosting db's on glusterfs - many small reads/writes are not one of glusters strong points.</div>
<div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div lang="EN-AU" link="#0563C1" vlink="#954F72"><div><p class="MsoNormal"><u></u><u></u></p><p class="MsoNormal">
<u></u> <u></u></p><p class="MsoNormal">Cheers,<u></u><u></u></p><p class="MsoNormal">Justin.<u></u><u></u></p><p class="MsoNormal"><u></u> <u></u></p><p class="MsoNormal"><u></u> <u></u></p><p class="MsoNormal"><u></u> <u></u></p>
</div></div><br>_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" onclick="window.open('https://mail.google.com/mail/?view=cm&tf=1&to=Users@ovirt.org&cc=&bcc=&su=&body=','_blank');return false;">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
<br></blockquote></div><br></div></div>