<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=windows-1251">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 14px; font-family: Calibri, sans-serif;">
<div>Hi</div>
<div><br>
</div>
<div>You can have 150MB/s for a while, but evetually the replication has to catch up and you will have more and more blocks out of sync.</div>
<div><br>
</div>
<div>If you really need that much speed you need to go for 10GBit links</div>
<div><br>
</div>
<div>There are some switches e.g .the ones compatible with Open Network Linux that are relativley cheap when it comes to 10Gbit ( <a href="http://opennetlinux.org/hcl">http://opennetlinux.org/hcl</a> )</div>
<div><br>
</div>
<div>Cheers</div>
<div>Soeren </div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Calibri; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>Юрий Полторацкий <<a href="mailto:y.poltoratskiy@gmail.com">y.poltoratskiy@gmail.com</a>><br>
<span style="font-weight:bold">Date: </span>Monday 1 June 2015 08:56<br>
<span style="font-weight:bold">To: </span>Soeren Malchow <<a href="mailto:soeren.malchow@mcon.net">soeren.malchow@mcon.net</a>><br>
<span style="font-weight:bold">Cc: </span>"<a href="mailto:users@ovirt.org">users@ovirt.org</a>" <<a href="mailto:users@ovirt.org">users@ovirt.org</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [ovirt-users] gluster config in 4 node cluster<br>
</div>
<div><br>
</div>
<div>
<div>
<div dir="ltr">
<div class="gmail_extra"><br>
<div class="gmail_quote">2015-06-01 2:32 GMT+03:00 Soeren Malchow <span dir="ltr">
<<a href="mailto:soeren.malchow@mcon.net" target="_blank">soeren.malchow@mcon.net</a>></span>:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div style="word-wrap:break-word;color:rgb(0,0,0);font-size:14px;font-family:Calibri,sans-serif">
<div>Hi</div>
<div><br>
</div>
<div>For a production environment i would not build a 2 node gluster, i would build at least 3 nodes to have it much easier with the quorum.</div>
<div><br>
</div>
<div>Taking into account that you can use commodity hardware i would also suggest to split the services, but i would go for at least 3 gluster nodes – which add up to at least 5 nodes for a HA system.</div>
<div><br>
</div>
<div>If you want 4 in any case, then my suggestion would be to go for 4 replicas, each node has anything that it needs to run and you can basically use NFS to localhost for the storage which would make the nodes always access the local storage for the VMS,
availability wise it makes no difference.</div>
</div>
</blockquote>
<div><br>
</div>
<div>I have data center with one cluster based on 3 nodes with both services: virt and gluster, and GlusterFS as a data domain. Every node has a single HDD as a brick (replica 3) and 2x1G nics with bonding on top (src-dst-ip). I have 2 vlans: 1 - management,
2 - VMs.<br>
<br>
</div>
<div>If in a VM I run something like 'dd if=/dev/zero of=/tmp/tmp' I have around 80+ MB/s write speed, at this moment on SPM node i run 'iftop -i bond0.1' and can see two flows with around 900 Mb/s each of them to the second and to the third nodes (thanks to
the bonding that every flow can be done through separate nic). All of this is expected result and in this case we reach a
<span id="result_box" class="" lang="en"><span class="">limit</span> of <span class="">
bandwidth</span></span> our nics. And even if HDD of a node has 150+ MB/s linear write speed I can not reach such speed of write in VMs.<br>
<br>
</div>
<div>What result would I get with 4 nodes and gluster replica 4? I expect that write speed in VM will be much slower, because now SPM node will generate three flows, and two of them will go through one nic and we will have only 500Mb/s per flow and in this
way the write speed of VM will be twice lower. <br>
<br>
</div>
<div>Am I wrong?<br>
</div>
<div><br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div style="word-wrap:break-word;color:rgb(0,0,0);font-size:14px;font-family:Calibri,sans-serif">
<div><br>
</div>
<div>Cheers</div>
<div>Soeren </div>
<div><br>
</div>
<span>
<div style="font-family:Calibri;font-size:11pt;text-align:left;color:black;border-width:1pt medium medium;border-style:solid none none;border-color:rgb(181,196,223) -moz-use-text-color -moz-use-text-color;padding:3pt 0in 0in">
<span style="font-weight:bold">From: </span>Юрий Полторацкий <<a href="mailto:y.poltoratskiy@gmail.com" target="_blank">y.poltoratskiy@gmail.com</a>><br>
<span style="font-weight:bold">Date: </span>Sunday 31 May 2015 18:32<br>
<span style="font-weight:bold">To: </span>"<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>" <<a href="mailto:users@ovirt.org" target="_blank">users@ovirt.org</a>><br>
<span style="font-weight:bold">Subject: </span>Re: [ovirt-users] gluster config in 4 node cluster<br>
</div>
<div>
<div class="h5">
<div><br>
</div>
<div>
<div text="#000000" bgcolor="#FFFFFF"><br>
Hi,<br>
<br>
As for me, I would build one cluster with gluster service only based on two nodes (replica 2), and the other one with virt service only based on other two nodes. I think this variant is more scalable in future.
<br>
<br>
PS. I am a new in oVirt, so do not except that I am wrong.<br>
<br>
<br>
<div>28.05.2015 23:11, <a href="mailto:paf1@email.cz" target="_blank">paf1@email.cz</a> пишет:<br>
</div>
<blockquote type="cite">Hello,<br>
How to optimal configure 4 node cluster for any one node goes to maintenance without stopping VM ??<br>
<br>
a) replica 4 - but it takes a lot of space<br>
b) disperse 3+1 ( raid 5 ) - but bad performance and not visible by oVirt 3.7.2<br>
c) stripe2+replica2 = but VM paused <br>
<br>
any other idea ?<br>
regs.<br>
Pa.<br>
<br>
<fieldset></fieldset> <br>
<pre>_______________________________________________
Users mailing list
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><a href="http://lists.ovirt.org/mailman/listinfo/users" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a></pre>
</blockquote>
<br>
</div>
</div>
</div>
</div>
</span></div>
</blockquote>
</div>
<br>
</div>
</div>
</div>
</div>
</span>
</body>
</html>