Cannot acquire Lock .... snapshot error
by Enrico Becchetti
Dear All,
my ovirt 4.2.1.7-1.el7.centos has three hypervisors, lvm storage and
virtiual machine with
ovirt-engine. All works fine but with one vm when I try to remove its
snapshot I have
this error:
2018-06-22 07:35:48,155+0200 INFO (jsonrpc/5) [vdsm.api] START
prepareMerge(spUUID=u'18d57688-6ed4-43b8-bd7c-0665b55950b7',
subchainInfo={u'img_id': u'c5611862-6504-445e-a6c8-f1e1a95b5df7',
u'sd_id': u'47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5', u'top_id':
u'0e6f7512-871d-4645-b9c6-320ba7e3bee7', u'base_id':
u'e156ac2e-09ac-4e1e-a139-17fa374a96d4'}) from=::ffff:10.0.0.46,53304,
flow_id=07011450-2296-4a13-a9ed-5d5d2b91be98,
task_id=87f95d85-cc3d-4f29-9883-a4dbb3808f88 (api:46)
2018-06-22 07:35:48,406+0200 INFO (tasks/3) [storage.merge] Preparing
subchain <SubchainInfo sd_id=47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5,
img_id=c5611862-6504-445e-a6c8-f1e1a95b5df7,
top_id=0e6f7512-871d-4645-b9c6-320ba7e3bee7,
base_id=e156ac2e-09ac-4e1e-a139-17fa374a96d4 base_generation=None at
0x7fcf84ae2510> for merge (merge:177)
2018-06-22 07:35:48,614+0200 INFO (tasks/3) [storage.SANLock] Acquiring
Lease(name='e156ac2e-09ac-4e1e-a139-17fa374a96d4',
path='/dev/47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5/leases',
offset=115343360) for host id 1 (clusterlock:377)
2018-06-22 07:35:48,634+0200 ERROR (tasks/3) [storage.guarded] Error
acquiring lock <VolumeLease
ns=04_lease_47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5,
name=e156ac2e-09ac-4e1e-a139-17fa374a96d4, mode=exclusive at
0x7fcfe09ddf90> (guarded:96)
AcquireLockFailure: Cannot obtain lock:
"id=47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5, rc=-227, out=Cannot acquire
Lease(name='e156ac2e-09ac-4e1e-a139-17fa374a96d4',
path='/dev/47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5/leases',
offset=115343360), err=(-227, 'Sanlock resource not acquired', 'Lease
resource name is incorrect')"
2018-06-22 07:35:56,881+0200 INFO (jsonrpc/7) [vdsm.api] FINISH
getAllTasksStatuses return={'allTasksStatus':
{'87f95d85-cc3d-4f29-9883-a4dbb3808f88': {'code': 651, 'message':
'Cannot obtain lock: "id=47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5, rc=-227,
out=Cannot acquire Lease(name=\'e156ac2e-09ac-4e1e-a139-17fa374a96d4\',
path=\'/dev/47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5/leases\',
offset=115343360), err=(-227, \'Sanlock resource not acquired\', \'Lease
resource name is incorrect\')"', 'taskState': 'finished', 'taskResult':
'cleanSuccess', 'taskID': '87f95d85-cc3d-4f29-9883-a4dbb3808f88'}}}
from=::ffff:10.0.0.46,53136,
task_id=d0e2f4e3-90cb-43c6-aa08-98d1f7efb1bd (api:52)
Any ideas ?
Many thanks to everybody.
Best Regards
Enrico
--
_______________________________________________________________________
Enrico Becchetti Servizio di Calcolo e Reti
Istituto Nazionale di Fisica Nucleare - Sezione di Perugia
Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY)
Phone:+39 075 5852777 Mail: Enrico.Becchetti<at>pg.infn.it
______________________________________________________________________
5 years, 10 months
Problems import vm/uploading disk
by Alan G
Hi, I'm trying to import a KVM VM into Ovirt. First I tried the GUI VM import functionality and this failed with the error below. However other VMs from the same source host were imported fine. read-32893::ERROR::2018-06-27 09:43:48,703::v2v::679::root::(_run) Job u'1a5fe287-d2dd-429c-87b5-6f240b59c17f' failed Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/v2v.py", line 674, in _run self._import() File "/usr/lib/python2.7/site-packages/vdsm/v2v.py", line 691, in _import with self._command.execute() as self._proc: File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/vdsm/v2v.py", line 597, in execute yield self._start_helper() File "/usr/lib/python2.7/site-packages/vdsm/v2v.py", line 374, in _start_helper env=self._environment()) File "/usr/lib/python2.7/site-packages/vdsm/commands.py", line 71, in execCmd deathSignal=deathSignal) File "/usr/lib64/python2.7/site-packages/cpopen/__init__.py", line 63, in __init__ **kw) File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__ errread, errwrite) File "/usr/lib64/python2.7/site-packages/cpopen/__init__.py", line 83, in _execute_child_v276 _to_close=to_close File "/usr/lib64/python2.7/site-packages/cpopen/__init__.py", line 118, in _execute_child_v275 restore_sigpipe OSError: [Errno 0] Error Thread-32893::ERROR::2018-06-27 09:43:48,704::v2v::686::root::(_run) Job u'1a5fe287-d2dd-429c-87b5-6f240b59c17f', error trying to abort: AttributeError("'NoneType' object has no attribute 'returncode'",) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/v2v.py", line 683, in _run self._abort() File "/usr/lib/python2.7/site-packages/vdsm/v2v.py", line 743, in _abort if self._proc.returncode is None: AttributeError: 'NoneType' object has no attribute 'returncode' Second I tried using the disk upload feature in the GUI, but this created the target disk then fails to upload the content - I've ensured that the relevant CAs are loaded into the browser. Third I successfully imported the VM into an ovirt 4.2 instance in the lab, but can find no way of then importing it into ovirt 4.0 as the storage domain format seems not to be backwards compatible. Finally I used the upload_disk.py example script from python SDK. This creates the disk and starts to upload the content but always fails at 2% with "socket.error: [Errno 32] Broken pipe" Any ideas on how I can get this qcow2 image loaded into ovirt 4.0? Thanks, Alan
5 years, 10 months
Host unable to run VMs after upgrading to 4.2 release
by Michael Watters
After upgrading our ovirt hosts to the 4.2.4 release two nodes are
unable to run VMs. The vdsm.log shows a failure which appears to be
related to firewalld.
2018-06-27 10:58:08,340-0400 ERROR (vm/5a42e1ed) [virt.vm] (vmId='5a42e1ed-7b9f-42f2-b1c3-403276cf1cd9') The vm start process failed (vm:943)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 872, in _startUnderlyingVm
self._run()
File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 2876, in _run
dom.createWithFlags(flags)
File "/usr/lib/python2.7/site-packages/vdsm/common/libvirtconnection.py", line 130, in wrapper
ret = f(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/vdsm/common/function.py", line 92, in wrapper
return func(inst, *args, **kwargs)
File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1099, in createWithFlags
if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
libvirtError: The name org.fedoraproject.FirewallD1 was not provided by any .service files
2018-06-27 10:58:08,342-0400 INFO (vm/5a42e1ed) [virt.vm] (vmId='5a42e1ed-7b9f-42f2-b1c3-403276cf1cd9') Changed state to Down: The name org.fedoraproject.FirewallD1 was not provided by any .service files (code=1) (vm:1683)
The cluster this host is a member of is configured to use *iptables*,
not firewalld. Is there a way to resolve this? What package provides
the .service file that vdsm is looking for?
5 years, 10 months
NAT+IP masquerading with oVirt 4.2
by julius.schwartzenberg＠gmail.com
Hi,
I'm trying to set up NAT+IP masquerading with oVirt 4.2. I have enabled the libvirt default network on virbr0 and added a network with the same name in oVirt. I have also installed vdsm-hook-extnet and set extnet to 'default' for this network to default.
When I try to start my VM with this network assigned to it, I get this error:
The host ovirthost did not satisfy internal filter Network because network(s) virbr0 are missing.
What should I do to solve this?
Best regards,
Julius
5 years, 10 months
RHEL5 guests frequently hang when migrating host.
by Eduardo Mayoral
Hi,
I am experiencing that my RHEL5 guests frequently "hang" when
migrating host. Console is blank, CPU after migration is 100% and as far
as oVirt is concerned, the VM is OK.
oVirt is 4.2.3.8-1.el7, on CentOS 7. Hosts are CentOS 7 as well.
Cluster is in "Intel Westmere family" CPU type.
Guest is RHEL5, fully patched, kernel 4.2.3.8-1.el7 with
ovirt-guest-agent installed from EPEL.
I do not see anything out of place in the ovirt-engine and vdsm
logs, and the guest logs are simply not there, the stop right before the
migration,as if the machine had "frozen".
Powering the VM off and starting it starts the VM correctly. This
does not happen 100% of the time. If I try to migrate the VM when it is
freshly started the migration is faster (maybe 5 seconds), and the guest
OS does not hang.
Anybody else experiencing something similar? Maybe something
(timeouts?) that I should tune on the guest OS for RHEL5?
Thanks!
--
Eduardo Mayoral.
5 years, 10 months
Internal Server Error 'AutoProxy[instance]' object has no attribute 'glusterLogicalVolumeList'
by Hesham Ahmed
I am receiving the following error in journal repeatedly every few minutes
on all 3 nodes of a hyperconverged oVirt 4.2.3 setup running oVirt Nodes:
Jun 25 06:03:26 vhost01.somedomain.com vdsm[45222]: ERROR Internal server
error
Traceback (most recent
call last):
File
"/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 606, in
_handle_request
res =
method(**params)
File
"/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 197, in
_dynamicMethod
result =
fn(*methodArgs)
File
"/usr/lib/python2.7/site-packages/vdsm/gluster/apiwrapper.py", line 85, in
logicalVolumeList
return
self._gluster.logicalVolumeList()
File
"/usr/lib/python2.7/site-packages/vdsm/gluster/api.py", line 90, in wrapper
rv = func(*args,
**kwargs)
File
"/usr/lib/python2.7/site-packages/vdsm/gluster/api.py", line 808, in
logicalVolumeList
status =
self.svdsmProxy.glusterLogicalVolumeList()
File
"/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 55, in
__call__
return callMethod()
File
"/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 52, in
<lambda>
getattr(self._supervdsmProxy._svdsm, self._funcName)(*args,
AttributeError:
'AutoProxy[instance]' object has no attribute 'glusterLogicalVolumeList'
And in /var/log/vdsm/vdsm.log
2018-06-25 06:03:24,118+0300 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC
call Host.getCapabilities succeeded in 0.79 seconds (__init__:573)
2018-06-25 06:03:26,106+0300 ERROR (jsonrpc/0) [jsonrpc.JsonRpcServer]
Internal server error (__init__:611)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 606,
in _handle_request
res = method(**params)
File "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 197, in
_dynamicMethod
result = fn(*methodArgs)
File "/usr/lib/python2.7/site-packages/vdsm/gluster/apiwrapper.py", line
85, in logicalVolumeList
return self._gluster.logicalVolumeList()
File "/usr/lib/python2.7/site-packages/vdsm/gluster/api.py", line 90, in
wrapper
rv = func(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/vdsm/gluster/api.py", line 808, in
logicalVolumeList
status = self.svdsmProxy.glusterLogicalVolumeList()
File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line
55, in __call__
return callMethod()
File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line
52, in <lambda>
getattr(self._supervdsmProxy._svdsm, self._funcName)(*args,
AttributeError: 'AutoProxy[instance]' object has no attribute
'glusterLogicalVolumeList'
2018-06-25 06:03:26,107+0300 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC
call GlusterHost.logicalVolumeList failed (error -32603) in 0.00 seconds
(__init__:573)
There are no apparent affects of this on the operation of the servers
though. Any idea why these are there?
5 years, 10 months
Problem download disk
by Marcelo Leandro
Hello,
I am use api java to download a disk but not was concluded , I have this
error:
The server response was 503 in the range request
I need change anythings how timeout or size the download ?
Very Thanks.
5 years, 10 months
Failed to delete snapshot '<UNKNOWN>' for VM 'vmname'.
by nicolas＠devels.es
Hi,
We're running oVirt 4.1.9, recently we had an issue with snapshots so we
had to fix them manually. The issue is mostly solved but now we're
seeing a lot of events like this one:
2018-06-25 07:58:06,637+01 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(DefaultQuartzScheduler6) [91430fc5-284d-4c26-8d8d-b7bf4053a7e4]
EVENT_ID: USER_REMOVE_SNAPSHOT_FINISHED_FAILURE(357), Correlation ID:
91430fc5-284d-4c26-8d8d-b7bf4053a7e4, Job ID:
da8120a4-9c6d-4379-ad67-a3808db1fd46, Call Stack: null, Custom ID: null,
Custom Event ID: -1, Message: Failed to delete snapshot '<UNKNOWN>' for
VM 'vmname'.
Which generates the following event in the manager:
Failed to delete snapshot '<UNKNOWN>' for VM 'vmname'.
This event is being generated every 10 seconds, so it's kind of
annoying.
Any way to remove it manually? It doesn't matter if it entails touching
the DB directly.
Thanks.
5 years, 10 months
Import ova failed
by du_hongyu＠yeah.net
Hi,
I make a OVA by "ovirt appliance", then import my ovirt cluster ,but here is trouble
ovirt-engine 4.2.0
2018-06-26 15:55:51,032+0800 INFO (jsonrpc/3) [api.host] FINISH getExternalVmFromOva error=Error parsing ovf information: no memory size from=::ffff:192.168.100.48,37288, flow_id=29946b38-c3fc-4ade-80c6-4f304fa0faa7 (api:50)
2018-06-26 15:55:51,033+0800 ERROR (jsonrpc/3) [jsonrpc.JsonRpcServer] Internal server error (__init__:611)
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 606, in _handle_request
res = method(**params)
File "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 197, in _dynamicMethod
result = fn(*methodArgs)
File "<string>", line 2, in getExternalVmFromOva
File "/usr/lib/python2.7/site-packages/vdsm/common/api.py", line 48, in method
ret = func(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/vdsm/API.py", line 1503, in getExternalVmFromOva
return v2v.get_ova_info(ova_path)
File "/usr/lib/python2.7/site-packages/vdsm/v2v.py", line 244, in get_ova_info
_add_general_ovf_info(vm, root, ns, ova_path)
File "/usr/lib/python2.7/site-packages/vdsm/v2v.py", line 1385, in _add_general_ovf_info
raise V2VError('Error parsing ovf information: no memory size')
V2VError: Error parsing ovf information: no memory size
Regards
Hongyu Du
5 years, 10 months
