1:55 a.m.
This is a multi-part message in MIME format.
--------------C7D3C76DD1E6339049812313
Content-Type: text/plain; charset=iso-8859-15; format=flowed
Content-Transfer-Encoding: 7bit
Hi,
I'm happily using our research cluster in Italy via gluster, and now I'm
trying to hotplug a ceph disk on a VM of my cluster, without success.
The ceph cluster is managed via openstack cinder and I can create
correctly the disk via ovirt (3.6.6.2-1 on CentOS 7.2).
The problem comes when trying to hotplug, or start a machine with the
given disk attached.
In the vdsm log of the host where the VM is running or starting I see
the following error:
jsonrpc.Executor/5::INFO::2016-05-30
10:35:29,197::vm::2729::virt.vm::(hotplugDisk)
vmId=`c189472e-25d2-4df1-b089-590009856dd3`::Hotplug disk xml: <disk
address="" device="disk" snapshot="no"
type="network">
<source
name="images/volume-9134b639-c23c-4ff1-91ca-0462c80026d2"
protocol="rbd">
<host name="141.108.X.Y1" port="6789"
transport="tcp"/>
<host name="141.108.X.Y2" port="6789"
transport="tcp"/>
</source>
<auth username="cinder">
<secret type="ceph" uuid="<base 64 ceph
secret>"/>
</auth>
<target bus="virtio" dev="vdb"/>
<driver cache="none" error_policy="stop"
io="threads"
name="qemu" type="raw"/>
</disk>
jsonrpc.Executor/5::ERROR::2016-05-30
10:35:29,198::vm::2737::virt.vm::(hotplugDisk)
vmId=`c189472e-25d2-4df1-b089-590009856dd3`::Hotplug failed
Traceback (most recent call last):
File "/usr/share/vdsm/virt/vm.py", line 2735, in hotplugDisk
self._dom.attachDevice(driveXml)
File "/usr/share/vdsm/virt/virdomain.py", line 68, in f
ret = attr(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py",
line 124, in wrapper
ret = f(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 1313, in
wrapper
return func(inst, *args, **kwargs)
File "/usr/lib64/python2.7/site-packages/libvirt.py", line 530, in
attachDevice
if ret == -1: raise libvirtError ('virDomainAttachDevice() failed',
dom=self)
libvirtError: XML error: invalid auth secret uuid
In fact the uuid of the secret used by ovirt to hotplug seems to be the
ceph secret (masked here as <base 64 ceph secret>), while libvirt
expects the uuid of the libvirt secret, by looking at the instructions
http://docs.ceph.com/docs/jewel/rbd/libvirt/.
Anyone got it working?
Thanks,
Alessandro
--------------C7D3C76DD1E6339049812313
Content-Type: text/html; charset=iso-8859-15
Content-Transfer-Encoding: 8bit
<html>
<head>
<meta http-equiv="content-type" content="text/html;
charset=iso-8859-15">
</head>
<body bgcolor="#FFFFFF" text="#000000">
<p>
</p>
<div class="moz-text-flowed" style="font-family: -moz-fixed;
font-size: 12px;" lang="x-western">Hi,
<br>
I'm happily using our research cluster in Italy via gluster, and
now I'm trying to hotplug a ceph disk on a VM of my cluster,
without success.
<br>
The ceph cluster is managed via openstack cinder and I can create
correctly the disk via ovirt (3.6.6.2-1 on CentOS 7.2).
<br>
The problem comes when trying to hotplug, or start a machine with
the given disk attached.
<br>
In the vdsm log of the host where the VM is running or starting I
see the following error:
<br>
<br>
<br>
jsonrpc.Executor/5::INFO::2016-05-30
10:35:29,197::vm::2729::virt.vm::(hotplugDisk)
vmId=`c189472e-25d2-4df1-b089-590009856dd3`::Hotplug disk xml:
<disk address="" device="disk" snapshot="no"
type="network">
<br>
<source
name="images/volume-9134b639-c23c-4ff1-91ca-0462c80026d2"
protocol="rbd">
<br>
<host name="141.108.X.Y1" port="6789"
transport="tcp"/>
<br>
<host name="141.108.X.Y2" port="6789"
transport="tcp"/>
<br>
</source>
<br>
<auth username="cinder">
<br>
<secret type="ceph" uuid="<base 64
ceph
secret>"/>
<br>
</auth>
<br>
<target bus="virtio" dev="vdb"/>
<br>
<driver cache="none" error_policy="stop"
io="threads"
name="qemu" type="raw"/>
<br>
</disk>
<br>
<br>
jsonrpc.Executor/5::ERROR::2016-05-30
10:35:29,198::vm::2737::virt.vm::(hotplugDisk)
vmId=`c189472e-25d2-4df1-b089-590009856dd3`::Hotplug failed
<br>
Traceback (most recent call last):
<br>
File "/usr/share/vdsm/virt/vm.py", line 2735, in hotplugDisk
<br>
self._dom.attachDevice(driveXml)
<br>
File "/usr/share/vdsm/virt/virdomain.py", line 68, in f
<br>
ret = attr(*args, **kwargs)
<br>
File
"/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line
124, in wrapper
<br>
ret = f(*args, **kwargs)
<br>
File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line
1313, in wrapper
<br>
return func(inst, *args, **kwargs)
<br>
File "/usr/lib64/python2.7/site-packages/libvirt.py", line 530,
in attachDevice
<br>
if ret == -1: raise libvirtError ('virDomainAttachDevice()
failed', dom=self)
<br>
libvirtError: XML error: invalid auth secret uuid
<br>
<br>
<br>
<br>
In fact the uuid of the secret used by ovirt to hotplug seems to
be the ceph secret (masked here as <base 64 ceph secret>),
while libvirt expects the uuid of the libvirt secret, by looking
at the instructions <a class="moz-txt-link-freetext"
href="http://docs.ceph.com/docs/jewel/rbd/libvirt/">http://d...;.
<br>
Anyone got it working?
<br>
Thanks,
<br>
<br>
Alessandro
<br>
</div>
</body>
</html>
--------------C7D3C76DD1E6339049812313--