7:22 a.m.
Hi,
we want to use a Ceph cluster as the main storage for our oVirt 4.1.x
datacenter. We successfully tested using librbd1-12.2.1-0.el7 package
from Ceph repos instead of the standard librbd1-0.94.5-2.el7 from CentOS
7 in an oVirt virtualization node. Are there any caveats when doing so?
Will this work in oVirt 4.2?
thx
matthias
7:09 a.m.
This is a multi-part message in MIME format.
--------------0AC4344B480303E03A95F74A
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
we want to use a Ceph cluster as the main storage for our oVirt
4.1.x
datacenter. We successfully tested using librbd1-12.2.1-0.el7 package
from Ceph repos instead of the standard librbd1-0.94.5-2.el7 from CentOS
7 in an oVirt virtualization node. Are there any caveats when doing so?
Will this work in oVirt 4.2?
Hello Matthias. Can I ask separate question?
At this time we atoVirt 4.1.3.5 and Ceph Cluster at 11.2.0 (Kraken).In
few weeks I planned to expand the cluster and I would like to upgrade to
Ceph 12 (Luminous), for bluestore support.
So my question is:have you tested oVirt with Ceph 12?
Thanks.
--
Best regards,
Konstantin Shalygin
--------------0AC4344B480303E03A95F74A
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 7bit
<html>
<head>
<meta http-equiv="content-type" content="text/html;
charset=utf-8">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p> </p>
<blockquote type="cite">
<pre>we want to use a Ceph cluster as the main storage for our oVirt 4.1.x
datacenter. We successfully tested using librbd1-12.2.1-0.el7 package
from Ceph repos instead of the standard librbd1-0.94.5-2.el7 from CentOS
7 in an oVirt virtualization node. Are there any caveats when doing so?
Will this work in oVirt 4.2?</pre>
</blockquote>
<br>
Hello Matthias. Can I ask separate question?<br>
At this time we at<span class="version-text"> oVirt 4.1.3.5 and Ceph
Cluster at 11.2.0 (Kraken).</span><span id="result_box"
class=""
lang="en"><span> In few weeks I planned to expand the cluster
and
I would like to upgrade to Ceph 12 (Luminous), for bluestore
support.<br>
So my question is:</span></span><span id="result_box"
class=""
lang="en"><span> have you tested oVirt with Ceph 12?<br>
<br>
<br>
Thanks.</span></span><span id="result_box"
class="" lang="en"><span></span></span><span
id="result_box" class=""
lang="en"><span></span></span><span
class="version-text"></span><span
class="version-text"></span>
<pre class="moz-signature" cols="72">--
Best regards,
Konstantin Shalygin
</pre>
</body>
</html>
--------------0AC4344B480303E03A95F74A--
7:26 a.m.
Am 2017-10-24 um 14:09 schrieb Konstantin Shalygin:
> we want to use a Ceph cluster as the main storage for our oVirt
4.1.x
> datacenter. We successfully tested using librbd1-12.2.1-0.el7 package
> from Ceph repos instead of the standard librbd1-0.94.5-2.el7 from CentOS
> 7 in an oVirt virtualization node. Are there any caveats when doing so?
> Will this work in oVirt 4.2?
Hello Matthias. Can I ask separate question?
At this time we atoVirt 4.1.3.5 and Ceph Cluster at 11.2.0 (Kraken).In
few weeks I planned to expand the cluster and I would like to upgrade to
Ceph 12 (Luminous), for bluestore support.
So my question is:have you tested oVirt with Ceph 12?
Thanks.
--
Best regards,
Konstantin Shalygin
--
Matthias Leopold
IT Systems & Communications
Medizinische Universität Wien
Spitalgasse 23 / BT 88 /Ebene 00
A-1090 Wien
Tel: +43 1 40160-21241
Fax: +43 1 40160-921200
Hi Konstantin,
yes, we have a Ceph 12 Cluster and are using librbd1-12.2.1 on oVirt
Hypervisor Hosts, which we're installed with CentOS 7 and Ceph upstream
repos, not oVirt Node (for this exact purpose). Since
/usr/lib64/libvirt/storage-backend/libvirt_storage_backend_rbd.so is
using /lib64/librbd.so.1 our VMs with disks from Cinder storage domain
are using Ceph 12 all the way.
Are you also using a newer librbd1?
Regards
Matthias
8:11 a.m.
On 10/24/2017 07:26 PM, Matthias Leopold wrote:
yes, we have a Ceph 12 Cluster and are using librbd1-12.2.1 on oVirt
Hypervisor Hosts, which we're installed with CentOS 7 and Ceph
upstream repos, not oVirt Node (for this exact purpose).
On oVirt Hypervisor hosts
we use librbd1-0.94.5-1.el7.x86_64
Since
/usr/lib64/libvirt/storage-backend/libvirt_storage_backend_rbd.so is
using /lib64/librbd.so.1 our VMs with disks from Cinder storage domain
are using Ceph 12 all the way.
Our OpenStack cinder is
openstack-cinder-10.0.0-1.el7.noarch with
librbd1-10.2.3-0.el7.x86_64
What version of Cinder I should have for work with Ceph 12? Or just
upgrade python-rbd/librados/librbd1/etc.
Are you also using a newer librbd1?
Not for now as you can
see. I was open "ovirt-users" for my questions
about Ceph 12 and see your fresh message. I think you first who used
Ceph 12 with oVirt.
--
Best regards,
Konstantin Shalygin
10:04 a.m.
Am 2017-10-24 um 15:11 schrieb Konstantin Shalygin:
On 10/24/2017 07:26 PM, Matthias Leopold wrote:
> yes, we have a Ceph 12 Cluster and are using librbd1-12.2.1 on oVirt
> Hypervisor Hosts, which we're installed with CentOS 7 and Ceph
> upstream repos, not oVirt Node (for this exact purpose).
On oVirt Hypervisor hosts we use librbd1-0.94.5-1.el7.x86_64
> Since
> /usr/lib64/libvirt/storage-backend/libvirt_storage_backend_rbd.so is
> using /lib64/librbd.so.1 our VMs with disks from Cinder storage domain
> are using Ceph 12 all the way.
Our OpenStack cinder is openstack-cinder-10.0.0-1.el7.noarch with
librbd1-10.2.3-0.el7.x86_64
What version of Cinder I should have for work with Ceph 12? Or just
upgrade python-rbd/librados/librbd1/etc.
I'll talk to my colleague, who is the Ceph expert, about this tomorrow.
Regards
Matthias
3:30 a.m.
Am 2017-10-24 um 15:11 schrieb Konstantin Shalygin:
On 10/24/2017 07:26 PM, Matthias Leopold wrote:
> yes, we have a Ceph 12 Cluster and are using librbd1-12.2.1 on oVirt
> Hypervisor Hosts, which we're installed with CentOS 7 and Ceph
> upstream repos, not oVirt Node (for this exact purpose).
On oVirt Hypervisor hosts we use librbd1-0.94.5-1.el7.x86_64
> Since
> /usr/lib64/libvirt/storage-backend/libvirt_storage_backend_rbd.so is
> using /lib64/librbd.so.1 our VMs with disks from Cinder storage domain
> are using Ceph 12 all the way.
Our OpenStack cinder is openstack-cinder-10.0.0-1.el7.noarch with
librbd1-10.2.3-0.el7.x86_64
we're also using cinder from openstack ocata release.
the point is
a) we didn't upgrade, but started from scratch with ceph 12
b) we didn't test all of the new features in ceph 12 (eg. EC pools for
RBD devices) in connection with cinder yet
matthias
6:45 a.m.
This is a multi-part message in MIME format.
--------------F21CBAF3CD53691C26FFFE99
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 7bit
On 10/25/2017 03:30 PM, Matthias Leopold wrote:
we're also using cinder from openstack ocata release.
the point is
a) we didn't upgrade, but started from scratch with ceph 12
b) we didn't test all of the new features in ceph 12 (eg. EC pools for
RBD devices) in connection with cinder yet
Thanks. We use EC pools with replication pull cache - only one way to
use EC with rbd, before Ceph 12.
We are half year on Ceph with oVirt in production. The best storage
experience, the only thing you can find fault this is impossible to move
images between pools. Only manually migration with qemu-img/rados or
cp/rsync inside VM.
--
Best regards,
Konstantin Shalygin
--------------F21CBAF3CD53691C26FFFE99
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 7bit
<html>
<head>
<meta http-equiv="Content-Type" content="text/html;
charset=utf-8">
</head>
<body bgcolor="#FFFFFF" text="#000000">
On 10/25/2017 03:30 PM, Matthias Leopold wrote:<br>
<blockquote type="cite"
cite="mid:46bcd7a5-1739-7117-12a5-80c85f8f4035@meduniwien.ac.at">we're
also using cinder from openstack ocata release.
<br>
<br>
the point is
<br>
a) we didn't upgrade, but started from scratch with ceph 12
<br>
b) we didn't test all of the new features in ceph 12 (eg. EC pools
for RBD devices) in connection with cinder yet
</blockquote>
<br>
Thanks. We use EC pools with replication pull cache - only one way
to use EC with rbd, before Ceph 12.<br>
We are half year on Ceph with oVirt in production. The best storage
experience, the only thing you can find fault this is impossible to
move images between pools. Only manually migration with
qemu-img/rados or cp/rsync inside VM.<span id="result_box"
class="short_text" lang="en"><span
class=""><br>
</span></span>
<pre class="moz-signature" cols="72">--
Best regards,
Konstantin Shalygin
</pre>
</body>
</html>
--------------F21CBAF3CD53691C26FFFE99--
8:25 a.m.
we're also using cinder from openstack ocata release.
the point is
a) we didn't upgrade, but started from scratch with ceph 12
b) we didn't test all of the new features in ceph 12 (eg. EC pools for
RBD devices) in connection with cinder yet
We are live on librbd1-12.2.1 for a
week. All works okay.
I was upgraded ceph from 11.2.0 to 11.2.1. Not Luminous, because seems
12.2.1 is stable only when cluster started from Luminous
(http://lists.ceph.com/pipermail/ceph-users-ceph.com/2017-November/022522....).
2350
days inactive
2376
days old
7 comments
2 participants
participants (2)
-
Konstantin Shalygin -
Matthias Leopold