April 2016 - Users - oVirt List Archives

Hosted engine on gluster problem
by Bond, Darryl 29 Aug '16

29 Aug '16

There seems to be a pretty severe bug with using hosted engine on gluster. If the host that was used as the initial hosted-engine --deploy host goes away, the engine VM wil crash and cannot be restarted until the host comes back. This is regardless of which host the engine was currently running. The issue seems to be buried in the bowels of VDSM and is not an issue with gluster itself. The gluster filesystem is still accessable from the host that was running the engine. The issue has been submitted to bugzilla but the fix is some way off (4.1). Can my hosted engine be converted to use NFS (using the gluster NFS server on the same filesystem) without rebuilding my hosted engine (ie change domainType=glusterfs to domainType=nfs)? What effect would that have on the hosted-engine storage domain inside oVirt, ie would the same filesystem be mounted twice or would it just break. Will this actually fix the problem, does it have the same issue when the hosted engine is on NFS? Darryl ________________________________ The contents of this electronic message and any attachments are intended only for the addressee and may contain legally privileged, personal, sensitive or confidential information. If you are not the intended addressee, and have received this email, any transmission, distribution, downloading, printing or photocopying of the contents of this message or attachments is strictly prohibited. Any legal privilege or confidentiality attached to this message and attachments is not waived, lost or destroyed by reason of delivery to any person other than intended addressee. If you have received this message and are not the intended addressee you should notify the sender by return email and destroy all copies of the message and any attachments. Unless expressly attributed, the views expressed in this email do not necessarily represent the views of the company.

8 20

Dedicated NICs for gluster network
by Nicolas Ecarnot 22 Aug '16

22 Aug '16

Hello, [Here : oVirt 3.5.3, 3 x CentOS 7.0 hosts with replica-3 gluster SD on the hosts]. On the switchs, I have created a dedicated VLAN to isolate the glusterFS traffic, but I'm not using it yet. I was thinking of creating a dedicated IP for each node's gluster NIC, and a DNS record by the way ("my_nodes_name_GL"), but I fear using this hostname or this ip in oVirt GUI host network interface tab, leading oVirt think this is a different host. Not being sure this fear is clearly described, let's say : - On each node, I create a second ip+(dns record in the soa) used by gluster, plugged on the correct VLAN - in oVirt gui, in the host network setting tab, the interface will be seen, with its ip, but reverse-dns-related to a different hostname. Here, I fear oVirt might check this reverse DNS and declare this NIC belongs to another host. I would also prefer not use a reverse pointing to the name of the host management ip, as this is evil and I'm a good guy. On your side, how do you cope with a dedicated storage network in case of storage+compute mixed hosts? -- Nicolas ECARNOT

5 11

oVirt-shell command to move a disk
by Nicolas Ecarnot 16 Aug '16

16 Aug '16

Hello, I'm confused because though I'm using ovirt-shell to script many actions every day, and even after a large bunch of reading and testing, I can not find the correct syntax to move (offline/available) disks between storage domains. May you help me please? (oVirt 3.4.4) -- Nicolas Ecarnot

4 10

centos 7.1 and up & ixgbe
by Johan Kooijman 18 Jul '16

18 Jul '16

Hi all, Since we upgraded to the latest ovirt node running 7.2, we're seeing that nodes become unavailable after a while. It's running fine, with a couple of VM's on it, untill it becomes non responsive. At that moment it doesn't even respond to ICMP. It'll come back by itself after a while, but oVirt fences the machine before that time and restarts VM's elsewhere. Engine tells me this message: VDSM host09 command failed: Message timeout which can be caused by communication issues Is anyone else experiencing these issues with ixgbe drivers? I'm running on Intel X540-AT2 cards. -- Met vriendelijke groeten / With kind regards, Johan Kooijman

7 8

New oVirt-Live (3.6.6 rc1) is available for download
by Lev Veyde 23 Jun '16

23 Jun '16

Hi, The new oVirt-Live 3.6.6 rc1 is available for download. You can download it from: http://resources.ovirt.org/pub/ovirt-3.6-pre/iso/ovirt-live/ovirt-live-el7-… Thanks in advance, Lev Veyde.

1 1

VM get stuck randomly
by Christophe TREFOIS 16 Jun '16

16 Jun '16

Dear all, I have a problem since couple of weeks, where randomly 1 VM (not always the same) becomes completely unresponsive. We find this out because our Icinga server complains that host is down. Upon inspection, we find we can’t open a console to the VM, nor can we login. In oVirt engine, the VM looks like “up”. The only weird thing is that RAM usage shows 0% and CPU usage shows 100% or 75% depending on number of cores. The only way to recover is to force shutdown the VM via 2-times shutdown from the engine. Could you please help me to start debugging this? I can provide any logs, but I’m not sure which ones, because I couldn’t see anything with ERROR in the vdsm logs on the host. The host is running OS Version: RHEL - 7 - 1.1503.el7.centos.2.8 Kernel Version: 3.10.0 - 229.14.1.el7.x86_64 KVM Version: 2.1.2 - 23.el7_1.8.1 LIBVIRT Version: libvirt-1.2.8-16.el7_1.4 VDSM Version: vdsm-4.16.26-0.el7.centos SPICE Version: 0.12.4 - 9.el7_1.3 GlusterFS Version: glusterfs-3.7.5-1.el7 We use a locally exported gluster as storage domain (eg, storage is on the same machine exposed via gluster). No replica. We run around 50 VMs on that host. Thank you for your help in this, — Christophe

5 20

how to come back to the list of available vms in serial console
by Nathanaël Blanchet 02 Jun '16

02 Jun '16

Hello, I can sucessfully connect to the serial console prompt, then I choose the vm to login in. When logout of this vm, I'm stuck on the login banner of this vm, and I didn't find any way to come back to the menu, or any other way rather from closing the terminal tab to exit. Is there a way to do this? Thank you. -- Nathanaël Blanchet Supervision réseau Pôle Infrastrutures Informatiques 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet(a)abes.fr

3 3

One RHEV Virtual Machine does not Automatically Resume following Compellent SAN Controller Failover
by Duckworth, Douglas C 30 May '16

30 May '16

Hello -- Not sure if y'all can help with this issue we've been seeing with RHEV... On 11/13/2015, during Code Upgrade of Compellent SAN at our Disaster Recovery Site, we Failed Over to Secondary SAN Controller. Most Virtual Machines in our DR Cluster Resumed automatically after Pausing except VM "BADVM" on Host "BADHOST." In Engine.log you can see that BADVM was sent into "VM_PAUSED_EIO" state at 10:47:57: "VM BADVM has paused due to storage I/O problem." On this Red Hat Enterprise Virtualization Hypervisor 6.6 (20150512.0.el6ev) Host, two other VMs paused but then automatically resumed without System Administrator intervention... In our DR Cluster, 22 VMs also resumed automatically... None of these Guest VMs are engaged in high I/O as these are DR site VMs not currently doing anything. We sent this information to Dell. Their response: "The root cause may reside within your virtualization solution, not the parent OS (RHEV-Hypervisor disc) or Storage (Dell Compellent.)" We are doing this Failover again on Sunday November 29th so we would like to know how to mitigate this issue, given we have to manually resume paused VMs that don't resume automatically. Before we initiated SAN Controller Failover, all iSCSI paths to Targets were present on Host tulhv2p03. VM logs on Host show in /var/log/libvirt/qemu/badhost.log that Storage error was reported: block I/O error in device 'drive-virtio-disk0': Input/output error (5) block I/O error in device 'drive-virtio-disk0': Input/output error (5) block I/O error in device 'drive-virtio-disk0': Input/output error (5) block I/O error in device 'drive-virtio-disk0': Input/output error (5) All disks used by this Guest VM are provided by single Storage Domain COM_3TB4_DR with serial "270." In syslog we do see that all paths for that Storage Domain Failed: Nov 13 16:47:40 multipathd: 36000d310005caf000000000000000270: remaining active paths: 0 Though these recovered later: Nov 13 16:59:17 multipathd: 36000d310005caf000000000000000270: sdbg - tur checker reports path is up Nov 13 16:59:17 multipathd: 36000d310005caf000000000000000270: remaining active paths: 8 Does anyone have an idea of why the VM would fail to automatically resume if the iSCSI paths used by its Storage Domain recovered? Thanks Doug -- Thanks Douglas Charles Duckworth Unix Administrator Tulane University Technology Services 1555 Poydras Ave NOLA -- 70112 E: duckd(a)tulane.edu O: 504-988-9341 F: 504-988-8505

5 5

Cinder Snapshot Issues
by Kevin Hrpcek 25 May '16

25 May '16

Hello, I'm running into a problem with live snapshots not working when using cinder/ceph disks. There are different failures for including and not including memory, but in each case cinder/ceph creates a new snapshot that can be seen in cinder and ceph. When doing a memory/disk snapshot the VM ends up in a paused state and I need to kill -9 the qemu process to be able to boot the vm again. The engine seems to be losing connection with the vdsm process on the VM host after freezing the guest's filesystems. The guest never receives the thaw command and it fails in the logs. I am pasting in some log snippets. 2016-04-12 19:24:58,851 INFO [org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand] (org.ovirt.thread.pool-8-thread-27) [5c4493e] Ending command 'org.ovirt.engine.core.bll.CreateAllSnapshotsFromVmCommand' successfully. 2016-04-12 19:27:56,873 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-27) [4d97ca06] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM OVCL1A command failed: Message timeout which can be caused by communication issues 2016-04-12 19:27:56,873 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (DefaultQuartzScheduler_Worker-27) [4d97ca06] Command 'org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand' return value 'StatusOnlyReturnForXmlRpc [status=StatusForXmlRpc [code=5022, message=Message timeout which can be caused by communication issues]]' 2016-04-12 19:27:56,874 INFO [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (DefaultQuartzScheduler_Worker-27) [4d97ca06] HostName = OVCL1A 2016-04-12 19:27:56,874 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.SnapshotVDSCommand] (DefaultQuartzScheduler_Worker-27) [4d97ca06] Command 'SnapshotVDSCommand(HostName = OVCL1A, SnapshotVDSCommandParameters:{runAsync='true', hostId='9bdfaedc-34a8-4a08-ad8a-c117835a6094', vmId='040609f6-cfe0-4763-8b32-08ffad158c93'})' execution failed: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues 2016-04-12 19:27:56,875 WARN [org.ovirt.engine.core.vdsbroker.VdsManager] (org.ovirt.thread.pool-8-thread-16) [4d97ca06] Host 'OVCL1A' is not responding. Disk only live snapshots freeze the guest file systems, the vm receives the thaw command, but the VM is no longer responsive. The VM pings on the network but it is hung and it also needs a kill -9 to the qemu process so that it can be booted again. jsonrpc.Executor/0::DEBUG::2016-04-12 19:41:58,342::__init__::503::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'VM.snapshot' in bridge with {u'frozen': True, u'vmID': u'040609f6-cfe0-4763-8b32-08ffad158c93', u'snapDrives': []} jsonrpc.Executor/0::INFO::2016-04-12 19:41:58,343::vm::3237::virt.vm::(snapshot) vmId=`040609f6-cfe0-4763-8b32-08ffad158c93`::<domainsnapshot> <disks/> </domainsnapshot> jsonrpc.Executor/0::ERROR::2016-04-12 19:41:58,346::vm::3252::virt.vm::(snapshot) vmId=`040609f6-cfe0-4763-8b32-08ffad158c93`::Unable to take snapshot Traceback (most recent call last): File "/usr/share/vdsm/virt/vm.py", line 3250, in snapshot self._dom.snapshotCreateXML(snapxml, snapFlags) File "/usr/share/vdsm/virt/virdomain.py", line 68, in f ret = attr(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 124, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 1313, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/libvirt.py", line 2581, in snapshotCreateXML if ret is None:raise libvirtError('virDomainSnapshotCreateXML() failed', dom=self) libvirtError: unsupported configuration: nothing selected for snapshot jsonrpc.Executor/7::DEBUG::2016-04-12 19:41:58,391::__init__::503::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'VM.thaw' in bridge with {u'vmID': u'040609f6-cfe0-4763-8b32-08ffad158c93'} jsonrpc.Executor/7::INFO::2016-04-12 19:41:58,391::vm::3041::virt.vm::(thaw) vmId=`040609f6-cfe0-4763-8b32-08ffad158c93`::Thawing guest filesystems jsonrpc.Executor/7::INFO::2016-04-12 19:41:58,396::vm::3056::virt.vm::(thaw) vmId=`040609f6-cfe0-4763-8b32-08ffad158c93`::6 guest filesystems thawed Everything else is working well with cinder for running VMs (making disks, running VMs, live migration, etc...). I was able to get live snapshots when using a CephFS Posix storage domain. Versions.. Ceph 9.2.0 oVirt Latest CentOS 7.2 Cinder 7.0.1-1.el7 Any help would be appreciated. Thanks, Kevin

2 4

editing VM settting
by Fabrice Bacchella 24 May '16

24 May '16

--Apple-Mail=_0D15CE0B-0FB7-4D4E-8899-589FA7FB4F4F Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii I'm trying to change the way a VM is booted, I want an initial setup = with kernel, initrd and cmdline given and later removed. Using the GUI it works fine. But I have no success using the python API. And running with debug = enable, I get this strange result : > PUT /api/vms/8ced0f81-03fd-415b-a8ef-60141de7eeca HTTP/1.1 ... > <os type=3D"rhel_7x64"> > <boot dev=3D"hd"/> > <boot dev=3D"network"/> > </os> ... < <os type=3D"rhel_7x64"> < <boot dev=3D"hd"/> < <boot dev=3D"network"/> < <kernel>.../vmlinuz</kernel> < <initrd>.../initrd.img</initrd> < <cmdline>....</cmdline> < </os> I got this with: os_params =3D params.OperatingSystem() os_params.set_boot(old_os_params.get_boot()) os_params.set_type(old_os_params.get_type()) os_params.set_kernel(None) os_params.set_initrd(None) os_params.set_cmdline(None) self.broker.set_os(os_params) self.broker.update() trying to set kernel and others to empty string is not really better: > <os type=3D"rhel_7x64"> > <boot dev=3D"hd"/> > <boot dev=3D"network"/> > <kernel></kernel> > <initrd></initrd> > <cmdline></cmdline> > </os> ... < <os type=3D"rhel_7x64"> < <boot dev=3D"hd"/> < <boot dev=3D"network"/> < <kernel></kernel> < <initrd></initrd> < <cmdline></cmdline> < </os> What kind of "magic values" the engine uses to removes values ? --Apple-Mail=_0D15CE0B-0FB7-4D4E-8899-589FA7FB4F4F Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dus-ascii"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D"">I'm trying to change the way a VM is booted, I want an = initial setup with kernel, initrd and cmdline given and later = removed.<div class=3D""><br class=3D""></div><div class=3D"">Using the = GUI it works fine.</div><div class=3D""><br class=3D""></div><div = class=3D"">But I have no success using the python API. And running with = debug enable, I get this strange result :</div><div class=3D""><br = class=3D""></div><div class=3D""><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D"">> PUT = /api/vms/8ced0f81-03fd-415b-a8ef-60141de7eeca HTTP/1.1</div></div><div = class=3D"">...</div><div class=3D""><div style=3D"margin: 0px; = font-size: 11px; font-family: Menlo;" class=3D"">>     = <os type=3D"rhel_7x64"></div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D"">>         = <boot dev=3D"hd"/></div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D"">>         = <boot dev=3D"network"/></div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D"">>     = </os></div></div><div class=3D"">...</div><div class=3D""><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D""><     <os type=3D"rhel_7x64"></div><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D""><         <boot = dev=3D"hd"/></div><div style=3D"margin: 0px; font-size: 11px; = font-family: Menlo;" class=3D""><         = <boot dev=3D"network"/></div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D""><         = <kernel>.../vmlinuz</kernel></div><div style=3D"margin: 0px; = font-size: 11px; font-family: Menlo;" class=3D""><     =     <initrd>.../initrd.img</initrd></div><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D""><         = <cmdline>....</cmdline></div><div style=3D"margin: 0px; = font-size: 11px; font-family: Menlo;" class=3D""><     = </os></div></div><div class=3D""><br class=3D""></div><div = class=3D"">I got this with:</div><div class=3D""><pre = style=3D"background-color: rgb(255, 255, 255); font-family: Menlo;" = class=3D"">os_params =3D params.OperatingSystem()<br = class=3D"">os_params.set_boot(old_os_params.get_boot())<br = class=3D"">os_params.set_type(old_os_params.get_type())<br = class=3D"">os_params.set_kernel(<span style=3D"color:#000080;" = class=3D"">None</span>)<br class=3D"">os_params.set_initrd(<span = style=3D"color:#000080;" class=3D"">None</span>)<br = class=3D"">os_params.set_cmdline(<span style=3D"color:#000080;" = class=3D"">None</span>)<br class=3D""><span style=3D"color:#94558d;" = class=3D"">self</span>.broker.set_os(os_params)<br class=3D""><span = style=3D"color:#94558d;" class=3D"">self</span>.broker.update()<br = class=3D""></pre><div class=3D"">trying to set kernel and others to = empty string is not really better:</div></div><div class=3D""><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D"">>     <os type=3D"rhel_7x64"></div><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D"">>         <boot = dev=3D"hd"/></div><div style=3D"margin: 0px; font-size: 11px; = font-family: Menlo;" class=3D"">>         = <boot dev=3D"network"/></div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D"">>         = <kernel></kernel></div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D"">>         = <initrd></initrd></div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D"">>         = <cmdline></cmdline></div><div style=3D"margin: 0px; = font-size: 11px; font-family: Menlo;" class=3D"">>     = </os></div></div><div class=3D"">...</div><div class=3D""><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D""><     <os type=3D"rhel_7x64"></div><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D""><         <boot = dev=3D"hd"/></div><div style=3D"margin: 0px; font-size: 11px; = font-family: Menlo;" class=3D""><         = <boot dev=3D"network"/></div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D""><         = <kernel></kernel></div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D""><         = <initrd></initrd></div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D""><         = <cmdline></cmdline></div><div style=3D"margin: 0px; = font-size: 11px; font-family: Menlo;" class=3D""><     = </os></div></div><div class=3D""><br class=3D""></div><div = class=3D"">What kind of "magic values" the engine uses to removes values = ?</div><div class=3D""><br class=3D""></div></body></html>= --Apple-Mail=_0D15CE0B-0FB7-4D4E-8899-589FA7FB4F4F--

3 3

Ovirt + OpenVSwitch
by Sverker Abrahamsson 24 May '16

24 May '16

Has anybody succeeded in installing Ovirt 3.6 with hosted engine on a server which uses OpenVSwitch for the network config? I believe my issue is that Ovirt wants to control the network to create a bridge for its management and I wants it to just use whatever network is available on the host without trying to be clever about it. I was able to tweak it to get to the final stage where it fails on waiting for the engine to start. Best regards Sverker

4 7

Errors while trying to join an external LDPA provider
by Alexis HAUSER 23 May '16

23 May '16

Hi, I'm using 3.6.3.4-1.el7.centos and I'm having troubles joining an LDAP provider. When I try to login into the new profile, I get a "general command validation failure" error. This is what I can get from ovirt-engine/engine.log : tail -n 400 /var/log/ovirt-engine/engine.log | grep -i error 2016-04-28 09:27:08,355 WARN [org.ovirt.engineextensions.aaa.ldap.AuthnExtension] (default task-56) [] [ovirt-engine-extension-aaa-ldap.authn::public-authn] Cannot initialize LDAP framework, deferring initialization. Error: /etc/ovirt-engine/aaa/xxxx.jks (No such file or directory) 2016-04-28 09:27:08,356 ERROR [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (default task-56) [] Error during CanDoActionFailure.: Class: class org.ovirt.engine.core.extensions.mgr.ExtensionInvokeCommandFailedException 2016-04-28 09:27:13,941 WARN [org.ovirt.engineextensions.aaa.ldap.AuthnExtension] (default task-58) [] [ovirt-engine-extension-aaa-ldap.authn::public-authn] Cannot initialize LDAP framework, deferring initialization. Error: /etc/ovirt-engine/aaa/xxxx.jks (No such file or directory) 2016-04-28 09:27:13,941 ERROR [org.ovirt.engine.core.bll.aaa.LoginUserCommand] (default task-58) [] Error during CanDoActionFailure.: Class: class org.ovirt.engine.core.extensions.mgr.ExtensionInvokeCommandFailedException I checked the permissions of the file and it's path and they are allright. Changing the path to /tmp/xxx.jks didn't help too. Here is my .profile : include = <openldap.properties> vars.server = xxxx vars.user = cn=xxxx,ou=xxxx,o=xxxx,dc=xxxx,dc=xxxx vars.password = xxxx pool.default.auth.simple.bindDN = ${global:vars.user} pool.default.auth.simple.password = ${global:vars.password} pool.default.serverset.type = single pool.default.serverset.single.server = ${global:vars.server} pool.default.ssl.enable = true pool.default.serverset.single.port = 636 pool.default.ssl.truststore.file = /tmp/xxxx.jks pool.default.ssl.truststore.password = xxxx Any idea how to deal with that problem ?

4 28

how can I update several vm properties at a time in the ui?
by Nathanaël Blanchet 22 May '16

22 May '16

Hi all, I had to use: for i in $(cat myvms); do ovirt-shell -E "update vm $i --console-enabled true"; done to add the serial port on many vms. because, I didn't find the way to do the same with the UI, by highlighting several vm and editing them. I thought it was possible because doing the same to add some users to many vm is possible with UI. Can someone help me with this? -- Nathanaël Blanchet Supervision réseau Pôle Infrastrutures Informatiques 227 avenue Professeur-Jean-Louis-Viala 34193 MONTPELLIER CEDEX 5 Tél. 33 (0)4 67 54 84 55 Fax 33 (0)4 67 54 84 14 blanchet(a)abes.fr

2 1

hosted-engine install stalls
by Johan Vermeulen 22 May '16

22 May '16

Hello All, my setup of a hosted engine on Centos7.2 hangs on : [ INFO ] Connecting Storage Pool In the log file I see a lot of items with "ok": *2016-04-20 13:04:01 DEBUG otopi.plugins.ovirt_hosted_engine_setup.storage.storage storage._activateStorageDomain:1067 activateStorageDomain2016-04-20 13:04:01 DEBUG otopi.plugins.ovirt_hosted_engine_setup.storage.storage heconflib.task_wait:283 Waiting for existing tasks to complete2016-04-20 13:04:01 DEBUG otopi.plugins.ovirt_hosted_engine_setup.storage.storage storage._activateStorageDomain:1076 {'status': {'message': 'OK', 'code': 0}, 'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2}}2016-04-20 13:04:01 DEBUG otopi.plugins.ovirt_hosted_engine_setup.storage.storage storage._activateStorageDomain:1078 {'status': {'message': 'OK', 'code': 0}, 'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2, 'spm_id': 1, 'master_uuid': '4bec7cce-b3d4-4a46-a1db-c7829951ec89', 'version': '3', 'domains': '4bec7cce-b3d4-4a46-a1db-c7829951ec89:Active,c817a126-f45b-4f03-b44b-e6249ef214a7:Active', 'type': 'POSIXFS', 'master_ver': 1}, 'dominfo': {'4bec7cce-b3d4-4a46-a1db-c7829951ec89': {'status': 'Active', 'diskfree': '1933926400', 'isoprefix': '', 'alerts': [], 'disktotal': '2046640128', 'version': 3}, 'c817a126-f45b-4f03-b44b-e6249ef214a7': {'status': 'Active', 'diskfree': '52560920576', 'isoprefix': '', 'alerts': [], 'disktotal': '53660876800', 'version': 3}}}2016-04-20 13:04:01 DEBUG otopi.plugins.ovirt_hosted_engine_setup.storage.storage storage._activateStorageDomain:1079 {'status': {'message': 'OK', 'code': 0}, '4bec7cce-b3d4-4a46-a1db-c7829951ec89': {'code': 0, 'actual': True, 'acquired': True, 'delay': '9.9272e-05', 'lastCheck': '0.3', 'version': 3, 'valid': True}, 'c817a126-f45b-4f03-b44b-e6249ef214a7': {'code': 0, 'actual': True, 'acquired': False, 'delay': '0.0889462', 'lastCheck': '9.0', 'version': 3, 'valid': True}}2016-04-20 13:04:01 DEBUG otopi.context context._executeMethod:142 Stage misc METHOD otopi.plugins.ovirt_hosted_engine_setup.storage.heconf.Plugin._misc_create_volume2016-04-20 13:04:01 DEBUG otopi.plugins.ovirt_hosted_engine_setup.storage.heconf heconflib.create_and_prepare_image:358 {'status': {'message': 'OK', 'code': 0}, 'uuid': '4835326e-5528-4c2f-831b-19dd323f1084'}2016-04-20 13:04:01 DEBUG otopi.plugins.ovirt_hosted_engine_setup.storage.heconf heconflib.create_and_prepare_image:372 Created configuration volume OK, request was:- image: f48e629e-17b3-4849-871e-e5547dd8b031- volume: 869c3519-6875-4f7a-a15f-6ddf93f23d93* but then it keeps displaying: *2016-04-20 13:05:02 DEBUG otopi.plugins.ovirt_hosted_engine_setup.storage.heconf heconflib.task_wait:283 Waiting for existing tasks to complete* and that's it. This is the summary of the install: --== CONFIGURATION PREVIEW ==-- Bridge interface : enp13s0 Engine FQDN : *********.ddns.net Bridge name : ovirtmgmt Host address : **********.ddns.net SSH daemon port : 8023 Firewall manager : iptables Gateway address : 192.168.66.1 Host name for web application : ************ Host ID : 1 Image size GB : 25 GlusterFS Share Name : hosted_engine_glusterfs GlusterFS Brick Provisioning : False Storage connection : ***********.ddns.net: /export/data Console type : qxl Memory size MB : 4096 MAC address : 00:16:3e:4f:0e:31 Boot type : cdrom Number of CPUs : 2 ISO image (cdrom boot/cloud-init) : /tmp/CentOS-7-x86_64-Minimal-1511.iso CPU Type : model_Penryn Thanks for any help on this issue. greetings, J.

2 1

VM migrations via san replication?
by At Work 22 May '16

22 May '16

I have a question regarding migration of VMs. It's my hope that someone can tell me if my migration idea can work or if it is not possible I want to migrate about 100-200 VMs from one oVirt deployment to a new oVirt deployment. Some of the VMs are over 3TB in size. Exporting and importing these via NFS would involve downtime and probably be a very lengthy process. I'm wondering if there's a way to get around this by using san replication. I have an equallogic san group currently in use by an oVirt installation 3.4.0-1.el6. I have a different equallogic group set up as storage for a different oVirt installation on another network. The new oVirt installation is version 3.6.4.1-1.el7.centos. My idea is to avoid the downtime and lengthy export/import process by telling my current production san to do volume replication to the new san that's been allocated for use as storage for our new oVirt installation. Once replication is in sync, I'll have exact copies of the original iSCSI volumes, VM's, metadata, etc. I am hoping I can then break replication, tell my new oVirt installation to log into the freshly-copied volumes, and use the VMs that were previously in use on the other installation. Due to the differences in oVirt versions and not knowing how oVirt internally handles metadata, I am not sure if this is possible. Can anyone confirm if this will work or not? Thank you all!

2 1

Add a physical drive to Ovirt
by Bryan Hughes 22 May '16

22 May '16

--_000_0301E97FEAF646D1B654DD628251CF46exetergovcom_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 QWxsLA0KDQpJIGFtIHRyeWluZyB0byBhZGQgYSBwaHlzaWNhbCBkcml2ZSB0byBPdmlydC4gIEZv ciBpbnN0YW5jZSwgbXkgcGh5c2ljYWwgbWFjaGluZSBoYXMgMyBleHRyYSBoYXJkIGRyaXZlcyBh dHRhY2hlZCBhbmQgSSB3YW50IHRvIGFkZCBpdCBkaXJlY3RseSBpbnN0ZWFkIG9mIHRocm91Z2gg R2x1c3RlciBvciBpU0NTSS4gIElzIHRoaXMgcG9zc2libGU/DQoNCkkgdHJpZWQgdXNpbmcgUE9T SVggYnkgY3JlYXRpbmcgYW4geGZzIGZpbGVzeXN0ZW0gb24gL2Rldi9zZGUxIGFuZCB0cmllZCB0 byBhZGQgdGhhdCBhcyBhIFBPU0lYIGRhdGFzdG9yZSBidXQgaXQgZmFpbHMgaW4gdHJ5aW5nIHRv IG1vdW50IHRoZSBmaWxlc3lzdGVtLg0KDQpBbnkgaGVscCBpcyBhcHByZWNpYXRlZC4NCg0KVGhh bmtzLA0KQnJ5YW4NCg== --_000_0301E97FEAF646D1B654DD628251CF46exetergovcom_ Content-Type: text/html; charset="utf-8" Content-ID: <515157EE3423364E9AA575E59AF989DE(a)namprd06.prod.outlook.com> Content-Transfer-Encoding: base64 PGh0bWw+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIgY29udGVudD0i dGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjwvaGVhZD4NCjxib2R5IHN0eWxlPSJ3b3JkLXdy YXA6IGJyZWFrLXdvcmQ7IC13ZWJraXQtbmJzcC1tb2RlOiBzcGFjZTsgLXdlYmtpdC1saW5lLWJy ZWFrOiBhZnRlci13aGl0ZS1zcGFjZTsgY29sb3I6IHJnYigwLCAwLCAwKTsgZm9udC1zaXplOiAx NHB4OyBmb250LWZhbWlseTogQ2FsaWJyaSwgc2Fucy1zZXJpZjsiPg0KPGRpdj4NCjxkaXY+DQo8 ZGl2PkFsbCw8L2Rpdj4NCjxkaXY+PGJyPg0KPC9kaXY+DQo8ZGl2PkkgYW0gdHJ5aW5nIHRvIGFk ZCBhIHBoeXNpY2FsIGRyaXZlIHRvIE92aXJ0LiAmbmJzcDtGb3IgaW5zdGFuY2UsIG15IHBoeXNp Y2FsIG1hY2hpbmUgaGFzIDMgZXh0cmEgaGFyZCBkcml2ZXMgYXR0YWNoZWQgYW5kIEkgd2FudCB0 byBhZGQgaXQgZGlyZWN0bHkgaW5zdGVhZCBvZiB0aHJvdWdoIEdsdXN0ZXIgb3IgaVNDU0kuICZu YnNwO0lzIHRoaXMgcG9zc2libGU/PC9kaXY+DQo8ZGl2Pjxicj4NCjwvZGl2Pg0KPGRpdj5JIHRy aWVkIHVzaW5nIFBPU0lYIGJ5IGNyZWF0aW5nIGFuIHhmcyBmaWxlc3lzdGVtIG9uIC9kZXYvc2Rl MSBhbmQgdHJpZWQgdG8gYWRkIHRoYXQgYXMgYSBQT1NJWCBkYXRhc3RvcmUgYnV0IGl0IGZhaWxz IGluIHRyeWluZyB0byBtb3VudCB0aGUgZmlsZXN5c3RlbS48L2Rpdj4NCjxkaXY+PGJyPg0KPC9k aXY+DQo8ZGl2PkFueSBoZWxwIGlzIGFwcHJlY2lhdGVkLjwvZGl2Pg0KPGRpdj48YnI+DQo8L2Rp dj4NCjxkaXY+VGhhbmtzLDwvZGl2Pg0KPGRpdj5CcnlhbjwvZGl2Pg0KPGRpdj4NCjxkaXYgaWQ9 Ik1BQ19PVVRMT09LX1NJR05BVFVSRSI+PC9kaXY+DQo8L2Rpdj4NCjwvZGl2Pg0KPC9kaXY+DQo8 L2JvZHk+DQo8L2h0bWw+DQo= --_000_0301E97FEAF646D1B654DD628251CF46exetergovcom_--

2 1

attaching a storage domain to a datacenter
by Fabrice Bacchella 22 May '16

22 May '16

--Apple-Mail=_33DFF62E-3CCC-498F-8E1E-FD21397C6DBD Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii I'm trying to attach a SAN domain to data center. It's an old domain that is re-attached. Import works fine. But doing the attachement failed, either throug the UI or REST API call. The log of the api calls are : > POST = /api/datacenters/92fbe5d6-2920-401d-b69b-ad4568e4f407/storagedomains = HTTP/1.1 > Host: example.com:1443 > Authorization: XXX > User-Agent: PycURL/7.43.0 libcurl/7.46.0 OpenSSL/1.0.2e zlib/1.2.8 > Cookie: XXXX > Version: 3 > Content-Type: application/xml > Accept: application/xml > Filter: False > Prefer: persistent-auth > Content-Length: 60 > <storage_domain id=3D"a8dedf2c-5574-48e9-a7fb-e343dc0c6b4d"/> * upload completely sent off: 60 out of 60 bytes * ? < HTTP/1.1 400 Bad Request < Date: Thu, 14 Apr 2016 16:31:48 GMT < Server: Apache < Content-Type: application/xml < Content-Length: 135 < JSESSIONID: R4TTWw65M5TIhbVJo8VBuOOV < Connection: close <=20 * ? < <?xml version=3D"1.0" encoding=3D"UTF-8" standalone=3D"yes"?> < <fault> < <reason>Operation Failed</reason> < <detail>[]</detail> < </fault> There is nothing in the engine.log : 2016-04-14 18:00:57,831 ERROR = [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] = (default task-23) [] Correlation ID: 59497e82, Job ID: = 84e0e22c-bb28-434b-a952-73f0e2c4cfaa, Call Stack: null, Custom Event ID: = -1, Message: Failed to attach Storage Domain vmsys01 to Data Center = en01. (User: FA4@apachesso) Where can I find informations about that ? --Apple-Mail=_33DFF62E-3CCC-498F-8E1E-FD21397C6DBD Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dus-ascii"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D"">I'm trying to attach a SAN domain to data center.<div = class=3D""><br class=3D""></div><div class=3D"">It's an old domain that = is re-attached. Import works fine.</div><div class=3D""><br = class=3D""></div><div class=3D"">But doing the attachement failed, = either throug the UI or REST API call.</div><div class=3D""><br = class=3D""></div><div class=3D"">The log of the api calls are = :</div><div class=3D""><br class=3D""></div><div class=3D""><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D"">> POST = /api/datacenters/92fbe5d6-2920-401d-b69b-ad4568e4f407/storagedomains = HTTP/1.1</div><div style=3D"margin: 0px; font-size: 11px; font-family: = Menlo;" class=3D"">> Host: <a href=3D"http://example.com" = class=3D"">example.com</a>:1443</div><div style=3D"margin: 0px; = font-size: 11px; font-family: Menlo;" class=3D"">> Authorization: = XXX</div><div style=3D"margin: 0px; font-size: 11px; font-family: = Menlo;" class=3D"">> User-Agent: PycURL/7.43.0 libcurl/7.46.0 = OpenSSL/1.0.2e zlib/1.2.8</div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D"">> Cookie: XXXX</div><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D"">> Version: 3</div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D"">> Content-Type: = application/xml</div><div style=3D"margin: 0px; font-size: 11px; = font-family: Menlo;" class=3D"">> Accept: application/xml</div><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D"">> Filter: False</div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D"">> Prefer: = persistent-auth</div><div style=3D"margin: 0px; font-size: 11px; = font-family: Menlo;" class=3D"">> Content-Length: 60</div><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D"">> <storage_domain = id=3D"a8dedf2c-5574-48e9-a7fb-e343dc0c6b4d"/></div><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" class=3D"">* = upload completely sent off: 60 out of 60 bytes</div><div style=3D"margin: = 0px; font-size: 11px; font-family: Menlo;" class=3D"">* ?</div><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D"">< HTTP/1.1 400 Bad Request</div><div style=3D"margin: 0px; = font-size: 11px; font-family: Menlo;" class=3D"">< Date: Thu, 14 Apr = 2016 16:31:48 GMT</div><div style=3D"margin: 0px; font-size: 11px; = font-family: Menlo;" class=3D"">< Server: Apache</div><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D"">< Content-Type: application/xml</div><div style=3D"margin: = 0px; font-size: 11px; font-family: Menlo;" class=3D"">< = Content-Length: 135</div><div style=3D"margin: 0px; font-size: 11px; = font-family: Menlo;" class=3D"">< JSESSIONID: = R4TTWw65M5TIhbVJo8VBuOOV</div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D"">< Connection: close</div><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D"">< </div><div style=3D"margin: 0px; font-size: 11px; = font-family: Menlo;" class=3D"">* ?</div><div style=3D"margin: 0px; = font-size: 11px; font-family: Menlo;" class=3D"">< <?xml = version=3D"1.0" encoding=3D"UTF-8" standalone=3D"yes"?></div><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D"">< <fault></div><div style=3D"margin: 0px; font-size: = 11px; font-family: Menlo;" class=3D""><     = <reason>Operation Failed</reason></div><div style=3D"margin: = 0px; font-size: 11px; font-family: Menlo;" class=3D""><     = <detail>[]</detail></div><div style=3D"margin: 0px; = font-size: 11px; font-family: Menlo;" class=3D"">< = </fault></div></div><div class=3D""><br class=3D""></div><div = class=3D"">There is nothing in the engine.log :</div><div class=3D""><div = style=3D"margin: 0px; font-size: 11px; font-family: Menlo;" = class=3D"">2016-04-14 18:00:57,831 ERROR = [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] = (default task-23) [] Correlation ID: 59497e82, Job ID: = 84e0e22c-bb28-434b-a952-73f0e2c4cfaa, Call Stack: null, Custom Event ID: = -1, Message: Failed to attach Storage Domain vmsys01 to Data Center = en01. (User: FA4@apachesso)</div></div><div class=3D""><br = class=3D""></div><div class=3D"">Where can I find informations about = that ?</div><div class=3D""><br class=3D""></div><div class=3D""><br = class=3D""></div></body></html>= --Apple-Mail=_33DFF62E-3CCC-498F-8E1E-FD21397C6DBD--

2 1

Upgrade path/possibility from 3.3?
by William Kwan 22 May '16

22 May '16

------=_Part_731664_597039218.1460392041230 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi all, I have a couple of oVirt cluster running 3.3.3-2.el6. =C2=A0I would like to= upgrade them to the latest version. I sort of remember upgrading from 3.3 = to 3.5 required an step to upgrade to 3.4 as an extra step. =C2=A0With the = new 3.6, will it be fine to upgrade straight from 3.3.3 to 3.6? or I need s= ome extra steps? Another question is about preservation of the virtual machines. Can I expor= t the VMs to some storage, upgrade oVirt and then import the VMs afterwards= ? =C2=A0 Thanks in advance.Will ------=_Part_731664_597039218.1460392041230 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <html><head></head><body><div style=3D"color:#000; background-color:#fff; f= ont-family:Courier New, courier, monaco, monospace, sans-serif;font-size:13= px"><div id=3D"yui_3_16_0_ym19_1_1460391403570_2952">Hi all,</div><div id= =3D"yui_3_16_0_ym19_1_1460391403570_2952"><br></div><div id=3D"yui_3_16_0_y= m19_1_1460391403570_2952" dir=3D"ltr">I have a couple of oVirt cluster runn= ing 3.3.3-2.el6.  I would like to upgrade them to the latest version. = I sort of remember upgrading from 3.3 to 3.5 required an step to upgrade to= 3.4 as an extra step.  With the new 3.6, will it be fine to upgrade s= traight from 3.3.3 to 3.6? or I need some extra steps?</div><div id=3D"yui_= 3_16_0_ym19_1_1460391403570_2952" dir=3D"ltr"><br></div><div id=3D"yui_3_16= _0_ym19_1_1460391403570_2952" dir=3D"ltr">Another question is about preserv= ation of the virtual machines. Can I export the VMs to some storage, upgrad= e oVirt and then import the VMs afterwards?  </div><div id=3D"yui_3_16= _0_ym19_1_1460391403570_2952" dir=3D"ltr"><br></div><div id=3D"yui_3_16_0_y= m19_1_1460391403570_2952" dir=3D"ltr">Thanks in advance.</div><div id=3D"yu= i_3_16_0_ym19_1_1460391403570_2952" dir=3D"ltr">Will</div></div></body></ht= ml> ------=_Part_731664_597039218.1460392041230--

2 1

Cannot create local ISO storage domain from UI.
by knarra 22 May '16

22 May '16

Hi, I am trying to set up Hosted Engine. I wanted to deploy windows virtual machines in this environment and as part of that i am creating ISO Domain to upload my windows image. But for some reason, while i create ISO domain it always fails with error "Failed to add Storage Domain <storagedomain_name"> and always remains in unattached state. Can some one please help me to reslove this issue? Attaching the vdsm logs. Thanks kasturi.

3 3

Failed to migrate a VMware through virt-v2v included in oVirt 3.6
by Julián Tete 13 May '16

13 May '16

My oVirt DataCenter Cluster CPU Type: Intel SandyBridge Family Emulated Machine: pc-i440fx-rhel7.2.0

3 7

Re: [ovirt-users] vms in paused state
by Michal Skrivanek 13 May '16

13 May '16

--Apple-Mail=_FC29514C-FC8B-44E8-A9D8-B78C0939837D Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On 28 Apr 2016, at 19:40, Bill James <bill.james(a)j2.com> wrote: >=20 > thank you for response. > I bold-ed the ones that are listed as "paused". >=20 >=20 > [root@ovirt1 test vdsm]# virsh -r list --all > Id Name State > ---------------------------------------------------- > 2 puppet.test.j2noc.com running > 4 sftp2.test.j2noc.com running > 5 oct.test.j2noc.com running > 6 sftp2.dev.j2noc.com running > 10 darmaster1.test.j2noc.com running > 14 api1.test.j2noc.com running > 25 ftp1.frb.test.j2noc.com running > 26 auto7.test.j2noc.com running > 32 epaymv02.j2noc.com running > 34 media2.frb.test.j2noc.com running > 36 auto2.j2noc.com running > 44 nfs.testhvy2.colo.j2noc.com running > 53 billapp-zuma1.dev.j2noc.com running > 54 billing-ci.dev.j2noc.com running > 60 log2.test.j2noc.com running > 63 log1.test.j2noc.com running > 69 sonar.dev.j2noc.com running > 73 billapp-ui1.dev.j2noc.com running > 74 billappvm01.dev.j2noc.com running > 75 db2.frb.test.j2noc.com running > 83 billapp-ui1.test.j2noc.com running > 84 epayvm01.test.j2noc.com running > 87 billappvm01.test.j2noc.com running > 89 etapi1.test.j2noc.com running > 93 billapp-zuma2.test.j2noc.com running > 94 git.dev.j2noc.com running >=20 > Yes I did "systemctl restart libvirtd" which apparently also restart = vdsm? yes, it does.=20 >=20 >=20 > Looks like problem started around 2016-04-17 20:19:34,822, based on = engine.log attached. yes, that time looks correct. Any idea what might have been a trigger? = Anything interesting happened at that time (power outage of some host, = some maintenance action, anything)?=20 logs indicate a problem when vdsm talks to libvirt(all those "monitor = become unresponsive=E2=80=9D) It does seem that at that time you started to have some storage = connectivity issues - first one at 2016-04-17 20:06:53,929. And it = doesn=E2=80=99t look temporary because such errors are still there = couple hours later(in your most recent file you attached I can see at = 23:00:54) When I/O gets blocked the VMs may experience issues (then VM gets = Paused), or their qemu process gets stuck(resulting in libvirt either = reporting error or getting stuck as well -> resulting in what vdsm sees = as =E2=80=9Cmonitor unresponsive=E2=80=9D) Since you now bounced libvirtd - did it help? Do you still see wrong = status for those VMs and still those "monitor unresponsive" errors in = vdsm.log? If not=E2=80=A6then I would suspect the =E2=80=9Cvm recovery=E2=80=9D = code not working correctly. Milan is looking at that. Thanks, michal > There's a lot of vdsm logs! >=20 > fyi, the storage domain for these Vms is a "local" nfs share, = 7e566f55-e060-47b7-bfa4-ac3c48d70dda. >=20 > attached more logs. >=20 >=20 > On 04/28/2016 12:53 AM, Michal Skrivanek wrote: >>> On 27 Apr 2016, at 19:16, Bill James <bill.james(a)j2.com> = <mailto:bill.james@j2.com> wrote: >>>=20 >>> virsh # list --all >>> error: failed to connect to the hypervisor >>> error: no valid connection >>> error: Failed to connect socket to '/var/run/libvirt/libvirt-sock': = No such file or directory >>>=20 >> you need to run virsh in read-only mode >> virsh -r list =E2=80=94all >>=20 >>> [root@ovirt1 test vdsm]# systemctl status libvirtd >>> =E2=97=8F libvirtd.service - Virtualization daemon >>> Loaded: loaded (/usr/lib/systemd/system/libvirtd.service; enabled; = vendor preset: enabled) >>> Drop-In: /etc/systemd/system/libvirtd.service.d >>> =E2=94=94=E2=94=80unlimited-core.conf >>> Active: active (running) since Thu 2016-04-21 16:00:03 PDT; 5 days = ago >>>=20 >>>=20 >>> tried systemctl restart libvirtd. >>> No change. >>>=20 >>> Attached vdsm.log and supervdsm.log. >>>=20 >>>=20 >>> [root@ovirt1 test vdsm]# systemctl status vdsmd >>> =E2=97=8F vdsmd.service - Virtual Desktop Server Manager >>> Loaded: loaded (/usr/lib/systemd/system/vdsmd.service; enabled; = vendor preset: enabled) >>> Active: active (running) since Wed 2016-04-27 10:09:14 PDT; 3min = 46s ago >>>=20 >>>=20 >>> vdsm-4.17.18-0.el7.centos.noarch >> the vdsm.log attach is good, but it=E2=80=99s too short interval, it = only shows recovery(vdsm restart) phase when the VMs are identified as = paused=E2=80=A6.can you add earlier logs? Did you restart vdsm yourself = or did it crash? >>=20 >>=20 >>> libvirt-daemon-1.2.17-13.el7_2.4.x86_64 >>>=20 >>>=20 >>> Thanks. >>>=20 >>>=20 >>> On 04/26/2016 11:35 PM, Michal Skrivanek wrote: >>>>> On 27 Apr 2016, at 02:04, Nir Soffer <nsoffer(a)redhat.com> = <mailto:nsoffer@redhat.com> wrote: >>>>>=20 >>>>> jjOn Wed, Apr 27, 2016 at 2:03 AM, Bill James <bill.james(a)j2.com> = <mailto:bill.james@j2.com> wrote: >>>>>> I have a hardware node that has 26 VMs. >>>>>> 9 are listed as "running", 17 are listed as "paused". >>>>>>=20 >>>>>> In truth all VMs are up and running fine. >>>>>>=20 >>>>>> I tried telling the db they are up: >>>>>>=20 >>>>>> engine=3D> update vm_dynamic set status =3D 1 where vm_guid = =3D(select >>>>>> vm_guid from vm_static where vm_name =3D 'api1.test.j2noc.com'); >>>>>>=20 >>>>>> GUI then shows it up for a short while, >>>>>>=20 >>>>>> then puts it back in paused state. >>>>>>=20 >>>>>> 2016-04-26 15:16:46,095 INFO = [org.ovirt.engine.core.vdsbroker.VmAnalyzer] >>>>>> (DefaultQuartzScheduler_Worker-16) [157cc21e] VM = '242ca0af-4ab2-4dd6-b515-5 >>>>>> d435e6452c4'(api1.test.j2noc.com) moved from 'Up' --> 'Paused' >>>>>> 2016-04-26 15:16:46,221 INFO = [org.ovirt.engine.core.dal.dbbroker.auditlogh >>>>>> andling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) = [157cc21e] Cor >>>>>> relation ID: null, Call Stack: null, Custom Event ID: -1, = Message: VM api1. >>>>>> test.j2noc.com has been paused. >>>>>>=20 >>>>>>=20 >>>>>> Why does the engine think the VMs are paused? >>>>>> Attached engine.log. >>>>>>=20 >>>>>> I can fix the problem by powering off the VM then starting it = back up. >>>>>> But the VM is working fine! How do I get ovirt to realize that? >>>>> If this is an issue in engine, restarting engine may fix this. >>>>> but having this problem only with one node, I don't think this is = the issue. >>>>>=20 >>>>> If this is an issue in vdsm, restarting vdsm may fix this. >>>>>=20 >>>>> If this does not help, maybe this is libvirt issue? did you try to = check vm >>>>> status using virsh? >>>> this looks more likely as it seems such status is being reported >>>> logs would help, vdsm.log at the very least. >>>>=20 >>>>> If virsh thinks that the vms are paused, you can try to restart = libvirtd. >>>>>=20 >>>>> Please file a bug about this in any case with engine and vdsm = logs. >>>>>=20 >>>>> Adding Michal in case he has better idea how to proceed. >>>>>=20 >>>>> Nir >>>=20 >>> Cloud Services for Business www.j2.com <http://www.j2.com/> >>> j2 | eFax | eVoice | FuseMail | Campaigner | KeepItSafe | Onebox >>>=20 >>>=20 >>> This email, its contents and attachments contain information from j2 = Global, Inc. and/or its affiliates which may be privileged, confidential = or otherwise protected from disclosure. The information is intended to = be for the addressee(s) only. If you are not an addressee, any = disclosure, copy, distribution, or use of the contents of this message = is prohibited. If you have received this email in error please notify = the sender by reply e-mail and delete the original message and any = copies. (c) 2015 j2 Global, Inc. All rights reserved. eFax, eVoice, = Campaigner, FuseMail, KeepItSafe, and Onebox are registered trademarks = of j2 Global, Inc. and its affiliates. >>> = <supervdsm.log.gz><vdsm.log.gz>___________________________________________= ____ >>> Users mailing list >>> Users(a)ovirt.org <mailto:Users@ovirt.org> >>> http://lists.ovirt.org/mailman/listinfo/users = <http://lists.ovirt.org/mailman/listinfo/users> >=20 > <engine.log-20160421.gz><vdsm.logs.tar.gz> --Apple-Mail=_FC29514C-FC8B-44E8-A9D8-B78C0939837D Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html = charset=3Dutf-8"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;" = class=3D""><br class=3D""><div><blockquote type=3D"cite" class=3D""><div = class=3D"">On 28 Apr 2016, at 19:40, Bill James <<a = href=3D"mailto:bill.james@j2.com" class=3D"">bill.james(a)j2.com</a>> = wrote:</div><br class=3D"Apple-interchange-newline"><div class=3D""> =20 <meta content=3D"text/html; charset=3DUTF-8" = http-equiv=3D"Content-Type" class=3D""> =20 <div bgcolor=3D"#FFFFFF" text=3D"#000000" class=3D""> thank you for response.<br class=3D""> I bold-ed the ones that are listed as "paused".<br class=3D""> <br class=3D""> <br class=3D""> [root@ovirt1 test vdsm]# virsh -r list --all<br class=3D"">  Id    = Name           &nbs= p;            =    State<br class=3D""> ----------------------------------------------------<br class=3D""> <b class=3D""> 2     <a = href=3D"http://puppet.test.j2noc.com" = class=3D"">puppet.test.j2noc.com</a>      &n= bsp;   running</b><br class=3D""> <b class=3D""> 4     <a = href=3D"http://sftp2.test.j2noc.com" = class=3D"">sftp2.test.j2noc.com</a>      &nb= sp;    running</b><br class=3D""> <b class=3D""> 5     <a = href=3D"http://oct.test.j2noc.com" = class=3D"">oct.test.j2noc.com</a>      &nbsp= ;      running</b><br class=3D""> <b class=3D""> 6     <a = href=3D"http://sftp2.dev.j2noc.com" = class=3D"">sftp2.dev.j2noc.com</a>      &nbs= p;     running</b><br class=3D""> <b class=3D""> 10    <a = href=3D"http://darmaster1.test.j2noc.com" = class=3D"">darmaster1.test.j2noc.com</a>      = running</b><br class=3D""> <b class=3D""> 14    <a = href=3D"http://api1.test.j2noc.com" = class=3D"">api1.test.j2noc.com</a>      &nbs= p;     running</b><br class=3D"">  25    <a href=3D"http://ftp1.frb.test.j2noc.com" = class=3D"">ftp1.frb.test.j2noc.com</a>      =   running<br class=3D"">  26    <a href=3D"http://auto7.test.j2noc.com" = class=3D"">auto7.test.j2noc.com</a>      &nb= sp;    running<br class=3D""> <b class=3D""> 32    <a = href=3D"http://epaymv02.j2noc.com" = class=3D"">epaymv02.j2noc.com</a>      &nbsp= ;      running</b><br class=3D"">  34    <a = href=3D"http://media2.frb.test.j2noc.com" = class=3D"">media2.frb.test.j2noc.com</a>      = running<br class=3D"">  36    <a href=3D"http://auto2.j2noc.com" = class=3D"">auto2.j2noc.com</a>       &n= bsp;        running<br class=3D"">  44    <a = href=3D"http://nfs.testhvy2.colo.j2noc.com" = class=3D"">nfs.testhvy2.colo.j2noc.com</a>    running<br = class=3D""> <b class=3D""> 53    <a = href=3D"http://billapp-zuma1.dev.j2noc.com" = class=3D"">billapp-zuma1.dev.j2noc.com</a>    = running</b><br class=3D""> <b class=3D""> 54    <a = href=3D"http://billing-ci.dev.j2noc.com" = class=3D"">billing-ci.dev.j2noc.com</a>     &nbsp= ; running</b><br class=3D"">  60    <a href=3D"http://log2.test.j2noc.com" = class=3D"">log2.test.j2noc.com</a>      &nbs= p;     running<br class=3D"">  63    <a href=3D"http://log1.test.j2noc.com" = class=3D"">log1.test.j2noc.com</a>      &nbs= p;     running<br class=3D""> <b class=3D""> 69    <a = href=3D"http://sonar.dev.j2noc.com" = class=3D"">sonar.dev.j2noc.com</a>      &nbs= p;     running</b><br class=3D""> <b class=3D""> 73    <a = href=3D"http://billapp-ui1.dev.j2noc.com" = class=3D"">billapp-ui1.dev.j2noc.com</a>      = running</b><br class=3D""> <b class=3D""> 74    <a = href=3D"http://billappvm01.dev.j2noc.com" = class=3D"">billappvm01.dev.j2noc.com</a>      = running</b><br class=3D"">  75    <a href=3D"http://db2.frb.test.j2noc.com" = class=3D"">db2.frb.test.j2noc.com</a>      &= nbsp;  running<br class=3D"">  83    <a = href=3D"http://billapp-ui1.test.j2noc.com" = class=3D"">billapp-ui1.test.j2noc.com</a>     = running<br class=3D""> <b class=3D""> 84    <a = href=3D"http://epayvm01.test.j2noc.com" = class=3D"">epayvm01.test.j2noc.com</a>      =   running</b><br class=3D""> <b class=3D""> 87    <a = href=3D"http://billappvm01.test.j2noc.com" = class=3D"">billappvm01.test.j2noc.com</a>     = running</b><br class=3D""> <b class=3D""> 89    <a = href=3D"http://etapi1.test.j2noc.com" = class=3D"">etapi1.test.j2noc.com</a>      &n= bsp;   running</b><br class=3D""> <b class=3D""> 93    <a = href=3D"http://billapp-zuma2.test.j2noc.com" = class=3D"">billapp-zuma2.test.j2noc.com</a>   running</b><br = class=3D""> <b class=3D""> 94    <a = href=3D"http://git.dev.j2noc.com" = class=3D"">git.dev.j2noc.com</a>       =        running</b><br class=3D""> <br class=3D""> Yes I did "systemctl restart libvirtd" which apparently also restart vdsm?<br class=3D""></div></div></blockquote><div><br = class=3D""></div>yes, it does. </div><div><br = class=3D""></div><div><blockquote type=3D"cite" class=3D""><div = class=3D""><div bgcolor=3D"#FFFFFF" text=3D"#000000" class=3D""> <br class=3D""> <br class=3D""> Looks like problem started around 2016-04-17 20:19:34,822, based on engine.log attached.<br class=3D""></div></div></blockquote><div><br = class=3D""></div><div>yes, that time looks correct. Any idea what might = have been a trigger? Anything interesting happened at that time (power = outage of some host, some maintenance action, = anything)? </div><div>logs indicate a problem when vdsm talks to = libvirt(all those "monitor become unresponsive=E2=80=9D)</div><div><br = class=3D""></div><div>It does seem that at that time you started to have = some storage connectivity issues - first one at 2016-04-17 = 20:06:53,929. And it doesn=E2=80=99t look temporary because such errors = are still there couple hours later(in your most recent file you attached = I can see at 23:00:54)</div><div>When I/O gets blocked the VMs may = experience issues (then VM gets Paused), or their qemu process gets = stuck(resulting in libvirt either reporting error or getting stuck as = well -> resulting in what vdsm sees as =E2=80=9Cmonitor = unresponsive=E2=80=9D)</div><div><br class=3D""></div><div>Since you now = bounced libvirtd - did it help? Do you still see wrong status for those = VMs and still those "monitor unresponsive" errors in = vdsm.log?</div><div>If not=E2=80=A6then I would suspect the =E2=80=9Cvm = recovery=E2=80=9D code not working correctly. Milan is looking at = that.</div><div><br = class=3D""></div><div>Thanks,</div><div>michal</div><div><div><br = class=3D""></div></div><div class=3D""><br class=3D""></div><blockquote = type=3D"cite" class=3D""><div class=3D""><div bgcolor=3D"#FFFFFF" = text=3D"#000000" class=3D""> There's a lot of vdsm logs!<br class=3D""> <br class=3D""> fyi, the storage domain for these Vms is a "local" nfs share, 7e566f55-e060-47b7-bfa4-ac3c48d70dda.<br class=3D""> <br class=3D""> attached more logs.<br class=3D""> <br class=3D""> <br class=3D""> <div class=3D"moz-cite-prefix">On 04/28/2016 12:53 AM, Michal Skrivanek wrote:<br class=3D""> </div> <blockquote = cite=3D"mid:28BF55E6-3A90-4BB7-90B9-1EE0A82FC460@redhat.com" type=3D"cite"= class=3D""> <pre wrap=3D"" class=3D""></pre> <blockquote type=3D"cite" class=3D""> <pre wrap=3D"" class=3D"">On 27 Apr 2016, at 19:16, Bill James = <a class=3D"moz-txt-link-rfc2396E" = href=3D"mailto:bill.james@j2.com"><bill.james(a)j2.com></a> wrote: virsh # list --all error: failed to connect to the hypervisor error: no valid connection error: Failed to connect socket to '/var/run/libvirt/libvirt-sock': No = such file or directory </pre> </blockquote> <pre wrap=3D"" class=3D"">you need to run virsh in read-only mode virsh -r list =E2=80=94all </pre> <blockquote type=3D"cite" class=3D""> <pre wrap=3D"" class=3D"">[root@ovirt1 test vdsm]# systemctl = status libvirtd =E2=97=8F libvirtd.service - Virtualization daemon Loaded: loaded (/usr/lib/systemd/system/libvirtd.service; enabled; = vendor preset: enabled) Drop-In: /etc/systemd/system/libvirtd.service.d =E2=94=94=E2=94=80unlimited-core.conf Active: active (running) since Thu 2016-04-21 16:00:03 PDT; 5 days ago tried systemctl restart libvirtd. No change. Attached vdsm.log and supervdsm.log. [root@ovirt1 test vdsm]# systemctl status vdsmd =E2=97=8F vdsmd.service - Virtual Desktop Server Manager Loaded: loaded (/usr/lib/systemd/system/vdsmd.service; enabled; vendor = preset: enabled) Active: active (running) since Wed 2016-04-27 10:09:14 PDT; 3min 46s = ago vdsm-4.17.18-0.el7.centos.noarch </pre> </blockquote> <pre wrap=3D"" class=3D"">the vdsm.log attach is good, but it=E2=80=99= s too short interval, it only shows recovery(vdsm restart) phase when = the VMs are identified as paused=E2=80=A6.can you add earlier logs? Did = you restart vdsm yourself or did it crash? </pre> <blockquote type=3D"cite" class=3D""> <pre wrap=3D"" class=3D"">libvirt-daemon-1.2.17-13.el7_2.4.x86_64 Thanks. On 04/26/2016 11:35 PM, Michal Skrivanek wrote: </pre> <blockquote type=3D"cite" class=3D""> <blockquote type=3D"cite" class=3D""> <pre wrap=3D"" class=3D"">On 27 Apr 2016, at 02:04, Nir = Soffer <a class=3D"moz-txt-link-rfc2396E" = href=3D"mailto:nsoffer@redhat.com"><nsoffer(a)redhat.com></a> wrote: jjOn Wed, Apr 27, 2016 at 2:03 AM, Bill James <a = class=3D"moz-txt-link-rfc2396E" = href=3D"mailto:bill.james@j2.com"><bill.james(a)j2.com></a> wrote: </pre> <blockquote type=3D"cite" class=3D""> <pre wrap=3D"" class=3D"">I have a hardware node that has = 26 VMs. 9 are listed as "running", 17 are listed as "paused". In truth all VMs are up and running fine. I tried telling the db they are up: engine=3D> update vm_dynamic set status =3D 1 where vm_guid =3D(select vm_guid from vm_static where vm_name =3D '<a = href=3D"http://api1.test.j2noc.com" class=3D"">api1.test.j2noc.com</a>'); GUI then shows it up for a short while, then puts it back in paused state. 2016-04-26 15:16:46,095 INFO = [org.ovirt.engine.core.vdsbroker.VmAnalyzer] (DefaultQuartzScheduler_Worker-16) [157cc21e] VM = '242ca0af-4ab2-4dd6-b515-5 d435e6452c4'(<a href=3D"http://api1.test.j2noc.com" = class=3D"">api1.test.j2noc.com</a>) moved from 'Up' --> 'Paused' 2016-04-26 15:16:46,221 INFO = [org.ovirt.engine.core.dal.dbbroker.auditlogh andling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [157cc21e] = Cor relation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM = api1. <a href=3D"http://test.j2noc.com" class=3D"">test.j2noc.com</a> has been = paused. Why does the engine think the VMs are paused? Attached engine.log. I can fix the problem by powering off the VM then starting it back up. But the VM is working fine! How do I get ovirt to realize that? </pre> </blockquote> <pre wrap=3D"" class=3D"">If this is an issue in engine, = restarting engine may fix this. but having this problem only with one node, I don't think this is the = issue. If this is an issue in vdsm, restarting vdsm may fix this. If this does not help, maybe this is libvirt issue? did you try to check = vm status using virsh? </pre> </blockquote> <pre wrap=3D"" class=3D"">this looks more likely as it seems = such status is being reported logs would help, vdsm.log at the very least. </pre> <blockquote type=3D"cite" class=3D""> <pre wrap=3D"" class=3D"">If virsh thinks that the vms are = paused, you can try to restart libvirtd. Please file a bug about this in any case with engine and vdsm logs. Adding Michal in case he has better idea how to proceed. Nir </pre> </blockquote> </blockquote> <pre wrap=3D"" class=3D""> Cloud Services for Business <a class=3D"moz-txt-link-abbreviated" = href=3D"http://www.j2.com/">www.j2.com</a> j2 | eFax | eVoice | FuseMail | Campaigner | KeepItSafe | Onebox This email, its contents and attachments contain information from j2 = Global, Inc. and/or its affiliates which may be privileged, confidential = or otherwise protected from disclosure. The information is intended to = be for the addressee(s) only. If you are not an addressee, any = disclosure, copy, distribution, or use of the contents of this message = is prohibited. If you have received this email in error please notify = the sender by reply e-mail and delete the original message and any = copies. (c) 2015 j2 Global, Inc. All rights reserved. eFax, eVoice, = Campaigner, FuseMail, KeepItSafe, and Onebox are registered trademarks = of j2 Global, Inc. and its affiliates. = <supervdsm.log.gz><vdsm.log.gz>_______________________________= ________________ Users mailing list <a class=3D"moz-txt-link-abbreviated" = href=3D"mailto:Users@ovirt.org">Users(a)ovirt.org</a> <a class=3D"moz-txt-link-freetext" = href=3D"http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.= org/mailman/listinfo/users</a> </pre> </blockquote> <pre wrap=3D"" class=3D""></pre> </blockquote> <br class=3D""> </div> <span = id=3D"cid:EB02B488-C070-46FA-9938-DC7D6DF5BEED@brq.redhat.com"><engine.= log-20160421.gz></span><span = id=3D"cid:52E27023-A602-4DB0-B69A-18237CC048A3@brq.redhat.com"><vdsm.lo= gs.tar.gz></span></div></blockquote></div><br class=3D""></body></html>= --Apple-Mail=_FC29514C-FC8B-44E8-A9D8-B78C0939837D--

4 7

[ANN] oVirt 3.6.5 Final Release is now available
by Sandro Bonazzola 09 May '16

09 May '16

The oVirt Project is pleased to announce today the general availability of oVirt 3.6.5. This latest community release includes new features and bug fixes for - oVirt Engine - VDSM - oVirt Hosted Engine HA - oVirt Hosted Engine Setup - oVirt Reports - oVirt Engine SDK - oVirt Engine Extension AAA LDAP oVirt is an open-source, openly-governed enterprise virtualization management application, developed by a global community. You can use the oVirt management interface (oVirt Engine) to manage hardware nodes, storage and network resources, and to deploy and monitor virtual machines running in your data center. If you are familiar with VMware products, oVirt is conceptually similar to vSphere. oVirt serves as the bedrock for Red Hat's Enterprise Virtualization product, and it is the "upstream" project where new features are developed prior to their inclusion in Red Hat's supported product offering. Additional Resources: * Read more about the oVirt 3.6.5 release highlights: http://www.ovirt.org/release/3.6.5/ * Get more oVirt Project updates on Twitter: https://twitter.com/ovirt * Check out the latest project news on the oVirt blog: http://www.ovirt.org/blog/ Note: ovirt.org website is suffering update issues so it may take a while before it receives 3.6.5 updates. ( https://github.com/oVirt/ovirt-site/issues/193 ) -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

6 9

Import storage domain - disks not listed
by Sahina Bose 08 May '16

08 May '16

Hi all, I have a gluster volume used as data storage domain which is replicated to a slave gluster volume (say, slavevol) using gluster's geo-replication feature. Now, in a new oVirt instance, I use the import storage domain to import the slave gluster volume. The "VM Import" tab correctly lists the VMs that were present in my original gluster volume. However the "Disks" tab is empty. GET https://new-ovitt/api/storagedomains/5e1a37cf-933d-424c-8e3d-eb9e40b690a7/d… --> <disks/> In the code GetUnregisteredDiskQuery - if volumesList.size() != 1 - the image is skipped with a comment that we can't deal with snapshots. How do I recover the disks/images in this case? Further info: /rhev/data-center/mnt/glusterSD/10.70.40.112:_slavevol ├── 5e1a37cf-933d-424c-8e3d-eb9e40b690a7 │ ├── dom_md │ │ ├── ids │ │ ├── inbox │ │ ├── leases │ │ ├── metadata │ │ └── outbox │ ├── images │ │ ├── 202efaa6-0d01-40f3-a541-10eee920d221 │ │ │ ├── eb701046-6ee1-4c9d-b097-e51a8fd283e1 │ │ │ ├── eb701046-6ee1-4c9d-b097-e51a8fd283e1.lease │ │ │ └── eb701046-6ee1-4c9d-b097-e51a8fd283e1.meta │ │ ├── c52e4e02-dc6c-4a77-a184-9fcab88106c2 │ │ │ ├── 34e46104-8fad-4510-a5bf-0730b97a6659 │ │ │ ├── 34e46104-8fad-4510-a5bf-0730b97a6659.lease │ │ │ ├── 34e46104-8fad-4510-a5bf-0730b97a6659.meta │ │ │ ├── 766a15b9-57db-417d-bfa0-beadbbb84ad2 │ │ │ ├── 766a15b9-57db-417d-bfa0-beadbbb84ad2.lease │ │ │ ├── 766a15b9-57db-417d-bfa0-beadbbb84ad2.meta │ │ │ ├── 90f1e26a-00e9-4ea5-9e92-2e448b9b8bfa │ │ │ ├── 90f1e26a-00e9-4ea5-9e92-2e448b9b8bfa.lease │ │ │ └── 90f1e26a-00e9-4ea5-9e92-2e448b9b8bfa.meta │ │ ├── c75de5b7-aa88-48d7-ba1b-067181eac6ae │ │ │ ├── ff09e16a-e8a0-452b-b95c-e160e68d09a9 │ │ │ ├── ff09e16a-e8a0-452b-b95c-e160e68d09a9.lease │ │ │ └── ff09e16a-e8a0-452b-b95c-e160e68d09a9.meta │ │ ├── efa94a0d-c08e-4ad9-983b-4d1d76bca865 │ │ │ ├── 64e3913c-da91-447c-8b69-1cff1f34e4b7 │ │ │ ├── 64e3913c-da91-447c-8b69-1cff1f34e4b7.lease │ │ │ ├── 64e3913c-da91-447c-8b69-1cff1f34e4b7.meta │ │ │ ├── 8174e8b4-3605-4db3-86a1-cb62c3a079f4 │ │ │ ├── 8174e8b4-3605-4db3-86a1-cb62c3a079f4.lease │ │ │ ├── 8174e8b4-3605-4db3-86a1-cb62c3a079f4.meta │ │ │ ├── e79a8821-bb4a-436a-902d-3876f107dd99 │ │ │ ├── e79a8821-bb4a-436a-902d-3876f107dd99.lease │ │ │ └── e79a8821-bb4a-436a-902d-3876f107dd99.meta │ │ └── f5eacc6e-4f16-4aa5-99ad-53ac1cda75b7 │ │ ├── 476bbfe9-1805-4c43-bde6-e7de5f7bd75d │ │ ├── 476bbfe9-1805-4c43-bde6-e7de5f7bd75d.lease │ │ └── 476bbfe9-1805-4c43-bde6-e7de5f7bd75d.meta │ └── master │ ├── tasks │ └── vms └── __DIRECT_IO_TEST__ engine.log: 2016-04-26 06:37:57,715 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetImageInfoVDSCommand] (org.ovirt.thread.pool-6-thread-25) [5e6b7a53] FINISH, GetImageInfoVDSCommand, return: org.ov irt.engine.core.common.businessentities.storage.DiskImage@d4b3ac2f, log id: 7b693bad 2016-04-26 06:37:57,724 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-6-thread-25) [5e6b7a53] START, GetVolumesListVDSCommand( StoragePool DomainAndGroupIdBaseVDSCommandParameters:{runAsync='true', storagePoolId='ed338557-5995-4634-97e2-15454a9d8800', ignoreFailoverLimit='false', storageDomainId='5e1a37cf-933d-424c-8e3d-eb9e40b 690a7', imageGroupId='c52e4e02-dc6c-4a77-a184-9fcab88106c2'}), log id: 741b9214 2016-04-26 06:37:58,748 INFO [org.ovirt.engine.core.vdsbroker.irsbroker.GetVolumesListVDSCommand] (org.ovirt.thread.pool-6-thread-25) [5e6b7a53] FINISH, GetVolumesListVDSCommand, return: [9 0f1e26a-00e9-4ea5-9e92-2e448b9b8bfa, 766a15b9-57db-417d-bfa0-beadbbb84ad2, 34e46104-8fad-4510-a5bf-0730b97a6659], log id: 741b9214

2 11

[hosted-engine] engine VM doesn't respawn when its host was killed (poweroff)
by Wee Sritippho 04 May '16

04 May '16

Hi, From the hosted-engine FAQ, the engine VM should be up and running in about 5 minutes after its host was forced poweroff. However, after updated oVirt 3.6.4 to 3.6.5, the engine VM won't restart automatically even after 10+ minutes (I already made sure that global maintenance mode is set to none). I initially thought its a time sync issue, so I installed and enabled ntp on the hosts and engine. However, the issue still persists. ###Versions: [root@host01 ~]# rpm -qa | grep ovirt libgovirt-0.3.3-1.el7_2.1.x86_64 ovirt-vmconsole-1.0.0-1.el7.centos.noarch ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch ovirt-hosted-engine-ha-1.3.5.3-1.el7.centos.noarch ovirt-host-deploy-1.4.1-1.el7.centos.noarch ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch ovirt-hosted-engine-setup-1.3.5.0-1.el7.centos.noarch ovirt-release36-007-1.noarch ovirt-setup-lib-1.0.1-1.el7.centos.noarch [root@host01 ~]# rpm -qa | grep vdsm vdsm-infra-4.17.26-0.el7.centos.noarch vdsm-jsonrpc-4.17.26-0.el7.centos.noarch vdsm-gluster-4.17.26-0.el7.centos.noarch vdsm-python-4.17.26-0.el7.centos.noarch vdsm-yajsonrpc-4.17.26-0.el7.centos.noarch vdsm-4.17.26-0.el7.centos.noarch vdsm-cli-4.17.26-0.el7.centos.noarch vdsm-xmlrpc-4.17.26-0.el7.centos.noarch vdsm-hook-vmfex-dev-4.17.26-0.el7.centos.noarch ###Log files: https://app.box.com/s/fkurmwagogwkv5smkwwq7i4ztmwf9q9r ###After host02 was killed: [root@host03 wees]# hosted-engine --vm-status --== Host 1 status ==-- Status up-to-date : True Hostname : host01.ovirt.forest.go.th Host ID : 1 Engine status : {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"} Score : 3400 stopped : False Local maintenance : False crc32 : 396766e0 Host timestamp : 4391 --== Host 2 status ==-- Status up-to-date : True Hostname : host02.ovirt.forest.go.th Host ID : 2 Engine status : {"health": "good", "vm": "up", "detail": "up"} Score : 0 stopped : True Local maintenance : False crc32 : 3a345b65 Host timestamp : 1458 --== Host 3 status ==-- Status up-to-date : True Hostname : host03.ovirt.forest.go.th Host ID : 3 Engine status : {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"} Score : 3400 stopped : False Local maintenance : False crc32 : 4c34b0ed Host timestamp : 11958 ###After host02 was killed for a while: [root@host03 wees]# hosted-engine --vm-status --== Host 1 status ==-- Status up-to-date : False Hostname : host01.ovirt.forest.go.th Host ID : 1 Engine status : unknown stale-data Score : 3400 stopped : False Local maintenance : False crc32 : 72e4e418 Host timestamp : 4415 --== Host 2 status ==-- Status up-to-date : False Hostname : host02.ovirt.forest.go.th Host ID : 2 Engine status : unknown stale-data Score : 0 stopped : True Local maintenance : False crc32 : 3a345b65 Host timestamp : 1458 --== Host 3 status ==-- Status up-to-date : False Hostname : host03.ovirt.forest.go.th Host ID : 3 Engine status : unknown stale-data Score : 3400 stopped : False Local maintenance : False crc32 : 4c34b0ed Host timestamp : 11958 ###After host02 was up again completely: [root@host03 wees]# hosted-engine --vm-status --== Host 1 status ==-- Status up-to-date : True Hostname : host01.ovirt.forest.go.th Host ID : 1 Engine status : {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"} Score : 0 stopped : False Local maintenance : False crc32 : f5728fca Host timestamp : 5555 --== Host 2 status ==-- Status up-to-date : True Hostname : host02.ovirt.forest.go.th Host ID : 2 Engine status : {"health": "good", "vm": "up", "detail": "up"} Score : 3400 stopped : False Local maintenance : False crc32 : e5284763 Host timestamp : 715 --== Host 3 status ==-- Status up-to-date : True Hostname : host03.ovirt.forest.go.th Host ID : 3 Engine status : {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"} Score : 3400 stopped : False Local maintenance : False crc32 : bc10c7fc Host timestamp : 13119 -- Wee

3 6

Open in Full Screen
by Colin Coe 04 May '16

04 May '16

Hi all Is there a setting for globally turning on the console option of "Open in Full Screen"? Also, can the "Connect Automatically" be permanently and globally disabled? We're on RHEV 3.5.7 Thanks CC

3 3