<div dir="ltr"><br><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><pre cols="72"><span style="font-family:arial,helvetica,sans-serif">Yaniv Dary
Technical Product Manager
Red Hat Israel Ltd.
34 Jerusalem Road
Building A, 4th floor
Ra'anana, Israel 4350109
Tel : +972 (9) 7692306
8272306
Email: <a href="mailto:ydary@redhat.com" target="_blank">ydary@redhat.com</a>
IRC : ydary</span></pre>
</div></div></div></div></div>
<br><div class="gmail_quote">On Sun, Jun 26, 2016 at 11:49 AM, Nicolás <span dir="ltr"><<a href="mailto:nicolas@devels.es" target="_blank">nicolas@devels.es</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div text="#000000" bgcolor="#FFFFFF">
Hi Nir,<br>
<br>
<div>El 25/06/16 a las 22:57, Nir Soffer
escribió:<br>
</div><span class="">
<blockquote type="cite">
<pre>On Sat, Jun 25, 2016 at 11:47 PM, Nicolás <a href="mailto:nicolas@devels.es" target="_blank"><nicolas@devels.es></a> wrote:
</pre>
<blockquote type="cite">
<pre>Hi,
We're using Ceph along with an iSCSI gateway, so our storage domain is
actually an iSCSI backend. So far, we have had zero issues with cca. 50 high
IO rated VMs. Perhaps [1] might shed some light on how to set it up.
</pre>
</blockquote>
<pre>Can you share more details on this setup and how you integrate with ovirt?
For example, are you using ceph luns in regular iscsi storage domain, or
attaching luns directly to vms?
</pre>
</blockquote>
<br></span>
Fernando Frediani (responding to this thread) hit the nail on the
head. Actually we have a 3-node Ceph infrastructure, so we created a
few volumes on the Ceph nodes side (RBD) and then exported them to
iSCSI, so it's oVirt who creates the LVs on the top, this way we
don't need to attach luns directly.<br>
<br>
Once the volumes are exported on the iSCSI side, adding an iSCSI
domain on oVirt is enough to make the whole thing work.<br>
<br>
As for experience, we have done a few tests and so far we've had
zero issues:<br>
<ul>
<li>The main bottleneck is the iSCSI gateway interface bandwith.
In our case we have a balance-alb bond over two 1G network
interfaces. Later we realized this kind of bonding is useless
because MAC addresses won't change, so in practice only 1G will
be used at most. Making some heavy tests (i.e., powering on 50
VMs at a time) we've reached this threshold at specific points
but it didn't affect performance significantly.</li></ul></div></blockquote><div><br></div><div>Did you try using ISCSI bonding to allow use of more than one path?</div><div> </div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div text="#000000" bgcolor="#FFFFFF"><ul>
<li>Doing some additional heavy tests (powering on and off all VMs
at a time), we've reached the maximum value of cca. 1200 IOPS at
a time. In normal conditions we don't surpass 200 IOPS, even
when these 50 VMs do lots of disk operations.</li>
<li>We've also done some tolerance tests, like removing one or
more disks from a Ceph node, reinserting them, suddenly shut
down one node, restoring it... The only problem we've
experienced is a slower access to the iSCSI backend, which
results in a message in the oVirt manager warning about this:
something like "Storage is taking to long to respond...", which
was maybe 15-20 seconds. We got no VM pauses at any time,
though, nor any significant issue.</li>
</ul><span class="">
<blockquote type="cite">
<pre>Did you try our dedicated cinder/ceph support and compared it with ceph
iscsi gateway?
</pre>
</blockquote>
<br></span>
Not actually, in order to avoid deploying Cinder we directly
implemented the gateway as it looked easier to us.<br>
<br>
<blockquote type="cite">
<pre>Nir
</pre>
</blockquote>
<br>
<p>Hope this helps.<br>
</p>
<p>Regards.</p>
<br>
</div>
<br>_______________________________________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman/listinfo/users</a><br>
<br></blockquote></div><br></div></div>