- Users - oVirt List Archives

Broker fails to start after upgrade 4.1 to 4.2 metadata_image_UUID can't be ''
by reznikov_aa＠soskol.com 28 Jun '18

28 Jun '18

Hi list! After upgrade my cluster from 4.1.9 to 4.2.2, agent and broker can't start on host... cat /var/log/ovirt-hosted-engine-ha/agent.log MainThread::ERROR::2018-06-21 03:25:34,603::hosted_engine::538::ovirt_hosted_engine_ha.agent.hosted_engine.HostedEngine::(_initialize_broker) Failed to start necessary monitors MainThread::ERROR::2018-06-21 03:25:34,604::agent::144::ovirt_hosted_engine_ha.agent.agent.Agent::(_run_agent) Traceback (most recent call last) cat /var/log/ovirt-hosted-engine-ha/broker.log MainThread::INFO::2018-06-21 03:25:40,406::monitor::50::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Finished loading submonitors MainThread::WARNING::2018-06-21 03:25:40,406::storage_broker::97::ovirt_hosted_engine_ha.broker.storage_broker.StorageBroker::(__init__) Can't connect vdsm storage: 'metadata_image_UUID can't be '' cat /etc/ovirt-hosted-engine/hosted-engine.conf | grep metadata_image metadata_image_UUID= Also is: cat /etc/ovirt-hosted-engine/hosted-engine.conf | grep lock lockspace_image_UUID= lockspace_volume_UUID= This bug is very much like this https://bugzilla.redhat.com/show_bug.cgi?id=1521011 My cluster started with version 3.3... But i can't resolution this bug correctly. Guru please help me!!! Thanx, Alex!

4 7

Cannot acquire Lock .... snapshot error
by Enrico Becchetti 27 Jun '18

27 Jun '18

Dear All, my ovirt 4.2.1.7-1.el7.centos has three hypervisors, lvm storage and virtiual machine with ovirt-engine. All works fine but with one vm when I try to remove its snapshot I have this error: 2018-06-22 07:35:48,155+0200 INFO (jsonrpc/5) [vdsm.api] START prepareMerge(spUUID=u'18d57688-6ed4-43b8-bd7c-0665b55950b7', subchainInfo={u'img_id': u'c5611862-6504-445e-a6c8-f1e1a95b5df7', u'sd_id': u'47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5', u'top_id': u'0e6f7512-871d-4645-b9c6-320ba7e3bee7', u'base_id': u'e156ac2e-09ac-4e1e-a139-17fa374a96d4'}) from=::ffff:10.0.0.46,53304, flow_id=07011450-2296-4a13-a9ed-5d5d2b91be98, task_id=87f95d85-cc3d-4f29-9883-a4dbb3808f88 (api:46) 2018-06-22 07:35:48,406+0200 INFO (tasks/3) [storage.merge] Preparing subchain <SubchainInfo sd_id=47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5, img_id=c5611862-6504-445e-a6c8-f1e1a95b5df7, top_id=0e6f7512-871d-4645-b9c6-320ba7e3bee7, base_id=e156ac2e-09ac-4e1e-a139-17fa374a96d4 base_generation=None at 0x7fcf84ae2510> for merge (merge:177) 2018-06-22 07:35:48,614+0200 INFO (tasks/3) [storage.SANLock] Acquiring Lease(name='e156ac2e-09ac-4e1e-a139-17fa374a96d4', path='/dev/47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5/leases', offset=115343360) for host id 1 (clusterlock:377) 2018-06-22 07:35:48,634+0200 ERROR (tasks/3) [storage.guarded] Error acquiring lock <VolumeLease ns=04_lease_47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5, name=e156ac2e-09ac-4e1e-a139-17fa374a96d4, mode=exclusive at 0x7fcfe09ddf90> (guarded:96) AcquireLockFailure: Cannot obtain lock: "id=47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5, rc=-227, out=Cannot acquire Lease(name='e156ac2e-09ac-4e1e-a139-17fa374a96d4', path='/dev/47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5/leases', offset=115343360), err=(-227, 'Sanlock resource not acquired', 'Lease resource name is incorrect')" 2018-06-22 07:35:56,881+0200 INFO (jsonrpc/7) [vdsm.api] FINISH getAllTasksStatuses return={'allTasksStatus': {'87f95d85-cc3d-4f29-9883-a4dbb3808f88': {'code': 651, 'message': 'Cannot obtain lock: "id=47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5, rc=-227, out=Cannot acquire Lease(name=\'e156ac2e-09ac-4e1e-a139-17fa374a96d4\', path=\'/dev/47b7c9aa-ef53-48bc-bb55-4a1a0ba5c8d5/leases\', offset=115343360), err=(-227, \'Sanlock resource not acquired\', \'Lease resource name is incorrect\')"', 'taskState': 'finished', 'taskResult': 'cleanSuccess', 'taskID': '87f95d85-cc3d-4f29-9883-a4dbb3808f88'}}} from=::ffff:10.0.0.46,53136, task_id=d0e2f4e3-90cb-43c6-aa08-98d1f7efb1bd (api:52) Any ideas ? Many thanks to everybody. Best Regards Enrico -- _______________________________________________________________________ Enrico Becchetti Servizio di Calcolo e Reti Istituto Nazionale di Fisica Nucleare - Sezione di Perugia Via Pascoli,c/o Dipartimento di Fisica 06123 Perugia (ITALY) Phone:+39 075 5852777 Mail: Enrico.Becchetti<at>pg.infn.it ______________________________________________________________________

3 9

Problems import vm/uploading disk
by Alan G 27 Jun '18

27 Jun '18

Hi, I'm trying to import a KVM VM into Ovirt. First I tried the GUI VM import functionality and this failed with the error below. However other VMs from the same source host were imported fine. read-32893::ERROR::2018-06-27 09:43:48,703::v2v::679::root::(_run) Job u'1a5fe287-d2dd-429c-87b5-6f240b59c17f' failed Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/v2v.py", line 674, in _run self._import() File "/usr/lib/python2.7/site-packages/vdsm/v2v.py", line 691, in _import with self._command.execute() as self._proc: File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/vdsm/v2v.py", line 597, in execute yield self._start_helper() File "/usr/lib/python2.7/site-packages/vdsm/v2v.py", line 374, in _start_helper env=self._environment()) File "/usr/lib/python2.7/site-packages/vdsm/commands.py", line 71, in execCmd deathSignal=deathSignal) File "/usr/lib64/python2.7/site-packages/cpopen/__init__.py", line 63, in __init__ **kw) File "/usr/lib64/python2.7/subprocess.py", line 711, in __init__ errread, errwrite) File "/usr/lib64/python2.7/site-packages/cpopen/__init__.py", line 83, in _execute_child_v276 _to_close=to_close File "/usr/lib64/python2.7/site-packages/cpopen/__init__.py", line 118, in _execute_child_v275 restore_sigpipe OSError: [Errno 0] Error Thread-32893::ERROR::2018-06-27 09:43:48,704::v2v::686::root::(_run) Job u'1a5fe287-d2dd-429c-87b5-6f240b59c17f', error trying to abort: AttributeError("'NoneType' object has no attribute 'returncode'",) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/v2v.py", line 683, in _run self._abort() File "/usr/lib/python2.7/site-packages/vdsm/v2v.py", line 743, in _abort if self._proc.returncode is None: AttributeError: 'NoneType' object has no attribute 'returncode' Second I tried using the disk upload feature in the GUI, but this created the target disk then fails to upload the content - I've ensured that the relevant CAs are loaded into the browser. Third I successfully imported the VM into an ovirt 4.2 instance in the lab, but can find no way of then importing it into ovirt 4.0 as the storage domain format seems not to be backwards compatible. Finally I used the upload_disk.py example script from python SDK. This creates the disk and starts to upload the content but always fails at 2% with "socket.error: [Errno 32] Broken pipe" Any ideas on how I can get this qcow2 image loaded into ovirt 4.0? Thanks, Alan

4 4

Host unable to run VMs after upgrading to 4.2 release
by Michael Watters 27 Jun '18

27 Jun '18

After upgrading our ovirt hosts to the 4.2.4 release two nodes are unable to run VMs. The vdsm.log shows a failure which appears to be related to firewalld. 2018-06-27 10:58:08,340-0400 ERROR (vm/5a42e1ed) [virt.vm] (vmId='5a42e1ed-7b9f-42f2-b1c3-403276cf1cd9') The vm start process failed (vm:943) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 872, in _startUnderlyingVm self._run() File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 2876, in _run dom.createWithFlags(flags) File "/usr/lib/python2.7/site-packages/vdsm/common/libvirtconnection.py", line 130, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/common/function.py", line 92, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1099, in createWithFlags if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self) libvirtError: The name org.fedoraproject.FirewallD1 was not provided by any .service files 2018-06-27 10:58:08,342-0400 INFO (vm/5a42e1ed) [virt.vm] (vmId='5a42e1ed-7b9f-42f2-b1c3-403276cf1cd9') Changed state to Down: The name org.fedoraproject.FirewallD1 was not provided by any .service files (code=1) (vm:1683) The cluster this host is a member of is configured to use *iptables*, not firewalld. Is there a way to resolve this? What package provides the .service file that vdsm is looking for?

1 0

NAT+IP masquerading with oVirt 4.2
by julius.schwartzenberg＠gmail.com 27 Jun '18

27 Jun '18

Hi, I'm trying to set up NAT+IP masquerading with oVirt 4.2. I have enabled the libvirt default network on virbr0 and added a network with the same name in oVirt. I have also installed vdsm-hook-extnet and set extnet to 'default' for this network to default. When I try to start my VM with this network assigned to it, I get this error: The host ovirthost did not satisfy internal filter Network because network(s) virbr0 are missing. What should I do to solve this? Best regards, Julius

1 0

RHEL5 guests frequently hang when migrating host.
by Eduardo Mayoral 27 Jun '18

27 Jun '18

Hi, I am experiencing that my RHEL5 guests frequently "hang" when migrating host. Console is blank, CPU after migration is 100% and as far as oVirt is concerned, the VM is OK. oVirt is 4.2.3.8-1.el7, on CentOS 7. Hosts are CentOS 7 as well. Cluster is in "Intel Westmere family" CPU type. Guest is RHEL5, fully patched, kernel 4.2.3.8-1.el7 with ovirt-guest-agent installed from EPEL. I do not see anything out of place in the ovirt-engine and vdsm logs, and the guest logs are simply not there, the stop right before the migration,as if the machine had "frozen". Powering the VM off and starting it starts the VM correctly. This does not happen 100% of the time. If I try to migrate the VM when it is freshly started the migration is faster (maybe 5 seconds), and the guest OS does not hang. Anybody else experiencing something similar? Maybe something (timeouts?) that I should tune on the guest OS for RHEL5? Thanks! -- Eduardo Mayoral.

3 3

Internal Server Error 'AutoProxy[instance]' object has no attribute 'glusterLogicalVolumeList'
by Hesham Ahmed 27 Jun '18

27 Jun '18

I am receiving the following error in journal repeatedly every few minutes on all 3 nodes of a hyperconverged oVirt 4.2.3 setup running oVirt Nodes: Jun 25 06:03:26 vhost01.somedomain.com vdsm[45222]: ERROR Internal server error Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 606, in _handle_request res = method(**params) File "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 197, in _dynamicMethod result = fn(*methodArgs) File "/usr/lib/python2.7/site-packages/vdsm/gluster/apiwrapper.py", line 85, in logicalVolumeList return self._gluster.logicalVolumeList() File "/usr/lib/python2.7/site-packages/vdsm/gluster/api.py", line 90, in wrapper rv = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/gluster/api.py", line 808, in logicalVolumeList status = self.svdsmProxy.glusterLogicalVolumeList() File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 55, in __call__ return callMethod() File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 52, in <lambda> getattr(self._supervdsmProxy._svdsm, self._funcName)(*args, AttributeError: 'AutoProxy[instance]' object has no attribute 'glusterLogicalVolumeList' And in /var/log/vdsm/vdsm.log 2018-06-25 06:03:24,118+0300 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 0.79 seconds (__init__:573) 2018-06-25 06:03:26,106+0300 ERROR (jsonrpc/0) [jsonrpc.JsonRpcServer] Internal server error (__init__:611) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/yajsonrpc/__init__.py", line 606, in _handle_request res = method(**params) File "/usr/lib/python2.7/site-packages/vdsm/rpc/Bridge.py", line 197, in _dynamicMethod result = fn(*methodArgs) File "/usr/lib/python2.7/site-packages/vdsm/gluster/apiwrapper.py", line 85, in logicalVolumeList return self._gluster.logicalVolumeList() File "/usr/lib/python2.7/site-packages/vdsm/gluster/api.py", line 90, in wrapper rv = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/gluster/api.py", line 808, in logicalVolumeList status = self.svdsmProxy.glusterLogicalVolumeList() File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 55, in __call__ return callMethod() File "/usr/lib/python2.7/site-packages/vdsm/common/supervdsm.py", line 52, in <lambda> getattr(self._supervdsmProxy._svdsm, self._funcName)(*args, AttributeError: 'AutoProxy[instance]' object has no attribute 'glusterLogicalVolumeList' 2018-06-25 06:03:26,107+0300 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call GlusterHost.logicalVolumeList failed (error -32603) in 0.00 seconds (__init__:573) There are no apparent affects of this on the operation of the servers though. Any idea why these are there?

3 3

Problem download disk
by Marcelo Leandro 27 Jun '18

27 Jun '18

Hello, I am use api java to download a disk but not was concluded , I have this error: The server response was 503 in the range request I need change anythings how timeout or size the download ? Very Thanks.

2 1

[ANN] oVirt 4.2.4 is now generally available
by Sandro Bonazzola 26 Jun '18

26 Jun '18

The oVirt Project is pleased to announce the general availability of oVirt 4.2.4 as of June 26th, 2018 This update is the fourth release in a series of stabilization updates to the 4.2 series. This release is available now for: * Red Hat Enterprise Linux 7.5 or later * CentOS Linux (or similar) 7.5 or later This release supports Hypervisor Hosts running: * Red Hat Enterprise Linux 7.5 or later * CentOS Linux (or similar) 7.5 or later * oVirt Node 4.2 See the release notes [1] for installation / upgrade instructions and a list of new features and bugs fixed. Notes: - oVirt Appliance will be available in a few hours - oVirt Node will be available in a few hours [2] Additional Resources: * Read more about the oVirt 4.2.4 release highlights: http://www.ovirt.org/release/4.2.4/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ [1] http://www.ovirt.org/release/4.2.4/ [2] http://resources.ovirt.org/pub/ovirt-4.2/iso/ -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig>

1 0

Failed to delete snapshot '<UNKNOWN>' for VM 'vmname'.
by nicolas＠devels.es 26 Jun '18

26 Jun '18

Hi, We're running oVirt 4.1.9, recently we had an issue with snapshots so we had to fix them manually. The issue is mostly solved but now we're seeing a lot of events like this one: 2018-06-25 07:58:06,637+01 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler6) [91430fc5-284d-4c26-8d8d-b7bf4053a7e4] EVENT_ID: USER_REMOVE_SNAPSHOT_FINISHED_FAILURE(357), Correlation ID: 91430fc5-284d-4c26-8d8d-b7bf4053a7e4, Job ID: da8120a4-9c6d-4379-ad67-a3808db1fd46, Call Stack: null, Custom ID: null, Custom Event ID: -1, Message: Failed to delete snapshot '<UNKNOWN>' for VM 'vmname'. Which generates the following event in the manager: Failed to delete snapshot '<UNKNOWN>' for VM 'vmname'. This event is being generated every 10 seconds, so it's kind of annoying. Any way to remove it manually? It doesn't matter if it entails touching the DB directly. Thanks.

2 14