- Users - oVirt List Archives

Import and Exporting domains (to export/import across datacenters) no longer working
by ccox＠endlessnow.com 01 May '16

01 May '16

In the past we had a 3.4 and a 3.5 ovirt. I was able to attach an Export domain to one, export Templates and/or VMs... put in into Maint mode, Detach it from the datacenter, go to the other ovirt manager, import the Domain (sometimes forcing an attach, sometimes it would automatically attach) and import my VM and/or template. Afterwards, placing it back into Maint mode and Dettaching. Often times there would be a residual icon left under Storage for the detached item... and the process was fairly repeatable. Now, it's getting repeatable in a bad way. Now it won't import, I have to manually do two table record deletes and a REST call to remove the connected storage and then and only then can I successfully import. psql db mods look like (from the ovirt manage box): First to find erroneous data: select * from storage_domain_static where storage_domain_type = 3; Then we locate the offending uuid (see full one below on the REST call) and delete the record our of storage_domain_dynamic and static like so: engine=# delete from storage_domain_dynamic where id = '9f00c1d9-3f2a-41b9-80c3-344900622b07'; DELETE 1 engine=# select Deletestorage_domain_static('9f00c1d9-3f2a-41b9-80c3-344900622b07'); Folks here talked about the latter command, but it would fail if the reference in the storage_domain_dynamic table wasn't removed first. Rest call looks something like this: curl -v -u "admin@internal:ourpassword" -X DELETE https://ovirt.example.com/ovirt-engine/api/storageconnections/9f00c1d9-3f2a… Any ideas about what is not apparently broken on our site? Is there any other way to do export/import across datacenters?

2 1

Hosted-engine-Issue
by Budur Nagaraju 01 May '16

01 May '16

HI Installed hosted engine and after configuring IP to ovirt engine unable to ping the gateway and found that there is no issue with the Network . Is there any thing am missing while installing Hosted engine ? below is output details, --== CONFIGURATION PREVIEW ==-- Engine FQDN : oe.bnglab.psecure.net Bridge name : ovirtmgmt SSH daemon port : 22 Gateway address : 10.206.67.254 Host name for web application : hosted_engine_1 Host ID : 1 Image alias : hosted_engine Image size GB : 25 Storage connection : 10.204.207.152:/home/heoe Console type : vnc Memory size MB : 4096 MAC address : 00:16:3e:2f:5c:40 Boot type : cdrom Number of CPUs : 2 ISO image (for cdrom boot) : /ovirt/CentOS-6.7-x86_64-minimal.iso CPU Type : model_SandyBridge Please confirm installation settings (Yes, No)[Yes]: yes [ INFO ] Stage: Transaction setup [ INFO ] Stage: Misc configuration [ INFO ] Stage: Package installation [ INFO ] Stage: Misc configuration [ INFO ] Configuring libvirt [ INFO ] Configuring VDSM [ INFO ] Starting vdsmd [ INFO ] Waiting for VDSM hardware info [ INFO ] Waiting for VDSM hardware info [ INFO ] Creating Storage Domain [ INFO ] Creating Storage Pool [ INFO ] Connecting Storage Pool [ INFO ] Verifying sanlock lockspace initialization [ INFO ] Creating VM Image [ INFO ] Disconnecting Storage Pool [ INFO ] Start monitoring domain [ INFO ] Configuring VM [ INFO ] Updating hosted-engine configuration [ INFO ] Stage: Transaction commit [ INFO ] Stage: Closing up The following network ports should be opened: tcp:5900 tcp:5901 udp:5900 udp:5901 An example of the required configuration for iptables can be found at: /etc/ovirt-hosted-engine/iptables.example In order to configure firewalld, copy the files from /etc/ovirt-hosted-engine/firewalld to /etc/firewalld/services and execute the following commands: firewall-cmd -service hosted-console [ INFO ] Creating VM You can now connect to the VM with the following command: /usr/bin/remote-viewer vnc://localhost:5900 Use temporary password "2049ZfXr" to connect to vnc console. Please note that in order to use remote-viewer you need to be able to run graphical applications. This means that if you are using ssh you have to supply the -Y flag (enables trusted X11 forwarding). Otherwise you can run the command from a terminal in your preferred desktop environment. If you cannot run graphical applications you can connect to the graphic console from another host or connect to the console using the following command: virsh -c qemu+tls://Test/system console HostedEngine If you need to reboot the VM you will need to start it manually using the command: hosted-engine --vm-start You can then set a temporary password using the command: hosted-engine --add-console-password The VM has been started. Install the OS and shut down or reboot it. To continue please make a selection: (1) Continue setup - VM installation is complete (2) Reboot the VM and restart installation (3) Abort setup (4) Destroy VM and abort setup

4 9

ovirt and JMX
by Fabrice Bacchella 29 Apr '16

29 Apr '16

I'm trying to communicate with ovirt-engine using jmx. I read https://www.ovirt.org/develop/developer-guide/engine/jmx-support/ In the line ENGINE_JMX_INTERFACE=public what is public ? Is that the string 'public', if I set that, ovirt-engine don't listen any more on port 8706. If i set it to the public IP of the server or to the interface name it fails with : 16:40:46,622 ERROR [org.jboss.as.server] JBAS015956: Caught exception during boot: org.jboss.as.controller.persistence.ConfigurationPersistenceException: JBAS014676: Failed to parse configuration at org.jboss.as.controller.persistence.XmlConfigurationPersister.load(XmlConfigurationPersister.java:112) [wildfly-controller-8.2.1.Final.jar:8.2.1.Final] at org.jboss.as.server.ServerService.boot(ServerService.java:331) [wildfly-server-8.2.1.Final.jar:8.2.1.Final] at org.jboss.as.controller.AbstractControllerService$1.run(AbstractControllerService.java:259) [wildfly-controller-8.2.1.Final.jar:8.2.1.Final] at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_101] Caused by: javax.xml.stream.XMLStreamException: ParseError at [row,col]:[477,70] Message: JBAS014796: Unknown interface bond0 interface must be declared in element interfaces at org.jboss.as.server.parsing.CommonXml.parseSocketBinding(CommonXml.java:691) [wildfly-server-8.2.1.Final.jar:8.2.1.Final] at org.jboss.as.server.parsing.StandaloneXml.parseSocketBindingGroup_1_1(StandaloneXml.java:1093) [wildfly-server-8.2.1.Final.jar:8.2.1.Final] at org.jboss.as.server.parsing.StandaloneXml.readServerElement_1_4(StandaloneXml.java:470) [wildfly-server-8.2.1.Final.jar:8.2.1.Final] at org.jboss.as.server.parsing.StandaloneXml.readElement(StandaloneXml.java:145) [wildfly-server-8.2.1.Final.jar:8.2.1.Final] at org.jboss.as.server.parsing.StandaloneXml.readElement(StandaloneXml.java:107) [wildfly-server-8.2.1.Final.jar:8.2.1.Final] at org.jboss.staxmapper.XMLMapperImpl.processNested(XMLMapperImpl.java:110) [staxmapper-1.1.0.Final.jar:1.1.0.Final] at org.jboss.staxmapper.XMLMapperImpl.parseDocument(XMLMapperImpl.java:69) [staxmapper-1.1.0.Final.jar:1.1.0.Final] at org.jboss.as.controller.persistence.XmlConfigurationPersister.load(XmlConfigurationPersister.java:104) [wildfly-controller-8.2.1.Final.jar:8.2.1.Final] ... 3 more

2 2

missing GPG key (key ID d55f98a6)
by Николаев Алексей 29 Apr '16

29 Apr '16

1 0

Fwd: Having issues with Hosted Engine
by Luiz Claudio Prazeres Goncalves 29 Apr '16

29 Apr '16

Hi everyone, Until today my environment was fully updated (3.6.5+centos7.2) with 3 nodes (kvm1,kvm2 and kvm3 hosts) . I also have 3 external gluster nodes (gluster-root1,gluster1 and gluster2 hosts ) , replica 3, which the engine storage domain is sitting on top (3.7.11 fully updated+centos7.2) For some weird reason i've been receiving emails from oVirt with EngineUnexpectedDown (attached picture) on a daily basis more or less, but the engine seems to be working fine and my vm's are up and running normally. I've never had any issue to access the User Interface to manage the vm's Today I run "yum update" on the nodes and realised that vdsm was outdated, so I updated the kvm hosts and they are now , again, fully updated. Reviewing the logs It seems to be an intermittent connectivity issue when trying to access the gluster engine storage domain as you can see below. I don't have any network issue in place and I'm 100% sure about it. I have another oVirt Cluster using the same network and using a engine storage domain on top of an iSCSI Storage Array with no issues. *Here seems to be the issue:* Thread-1111::INFO::2016-04-27 23:01:27,864::fileSD::357::Storage.StorageDomain::(validate) sdUUID=03926733-1872-4f85-bb21-18dc320560db Thread-1111::DEBUG::2016-04-27 23:01:27,865::persistentDict::234::Storage.PersistentDict::(refresh) read lines (FileMetadataRW)=[] Thread-1111::DEBUG::2016-04-27 23:01:27,865::persistentDict::252::Storage.PersistentDict::(refresh) Empty metadata Thread-1111::ERROR::2016-04-27 23:01:27,865::task::866::Storage.TaskManager.Task::(_setError) Task=`d2acf575-1a60-4fa0-a5bb-cd4363636b94`::Unexpected error Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 873, in _run return fn(*args, **kargs) File "/usr/share/vdsm/logUtils.py", line 49, in wrapper res = f(*args, **kwargs) File "/usr/share/vdsm/storage/hsm.py", line 2835, in getStorageDomainInfo dom = self.validateSdUUID(sdUUID) File "/usr/share/vdsm/storage/hsm.py", line 278, in validateSdUUID sdDom.validate() File "/usr/share/vdsm/storage/fileSD.py", line 360, in validate raise se.StorageDomainAccessError(self.sdUUID) StorageDomainAccessError: Domain is either partially accessible or entirely inaccessible: (u'03926733-1872-4f85-bb21-18dc320560db',) Thread-1111::DEBUG::2016-04-27 23:01:27,865::task::885::Storage.TaskManager.Task::(_run) Task=`d2acf575-1a60-4fa0-a5bb-cd4363636b94`::Task._run: d2acf575-1a60-4fa0-a5bb-cd4363636b94 ('03926733-1872-4f85-bb21-18dc320560db',) {} failed - stopping task Thread-1111::DEBUG::2016-04-27 23:01:27,865::task::1246::Storage.TaskManager.Task::(stop) Task=`d2acf575-1a60-4fa0-a5bb-cd4363636b94`::stopping in state preparing (force False) Thread-1111::DEBUG::2016-04-27 23:01:27,865::task::993::Storage.TaskManager.Task::(_decref) Task=`d2acf575-1a60-4fa0-a5bb-cd4363636b94`::ref 1 aborting True Thread-1111::INFO::2016-04-27 23:01:27,865::task::1171::Storage.TaskManager.Task::(prepare) Task=`d2acf575-1a60-4fa0-a5bb-cd4363636b94`::aborting: Task is aborted: 'Domain is either partially accessible or entirely inaccessible' - code 379 Thread-1111::DEBUG::2016-04-27 23:01:27,866::task::1176::Storage.TaskManager.Task::(prepare) Task=`d2acf575-1a60-4fa0-a5bb-cd4363636b94`::Prepare: aborted: Domain is either partially accessible or entirely inaccessible *Question: Anyone know what might be happening? I have several gluster config's, as you can see below. All the storage domain are using the same config's* *More information:* I have the "engine" storage domain, "vmos1" storage domain and "master" storage domain, so everything looks good. [root@kvm1 vdsm]# vdsClient -s 0 getStorageDomainsList 03926733-1872-4f85-bb21-18dc320560db 35021ff4-fb95-43d7-92a3-f538273a3c2e e306e54e-ca98-468d-bb04-3e8900f8840c *Gluster config:* [root@gluster-root1 ~]# gluster volume info Volume Name: engine Type: Replicate Volume ID: 64b413d2-c42e-40fd-b356-3e6975e941b0 Status: Started Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: gluster1.xyz.com:/gluster/engine/brick1 Brick2: gluster2.xyz.com:/gluster/engine/brick1 Brick3: gluster-root1.xyz.com:/gluster/engine/brick1 Options Reconfigured: performance.cache-size: 1GB performance.write-behind-window-size: 4MB performance.write-behind: off performance.quick-read: off performance.read-ahead: off performance.io-cache: off performance.stat-prefetch: off cluster.eager-lock: enable cluster.quorum-type: auto network.remote-dio: enable cluster.server-quorum-type: server cluster.data-self-heal-algorithm: full performance.low-prio-threads: 32 features.shard-block-size: 512MB features.shard: on storage.owner-gid: 36 storage.owner-uid: 36 performance.readdir-ahead: on Volume Name: master Type: Replicate Volume ID: 20164808-7bbe-4eeb-8770-d222c0e0b830 Status: Started Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: gluster1.xyz.com:/home/storage/master/brick1 Brick2: gluster2.xyz.com:/home/storage/master/brick1 Brick3: gluster-root1.xyz.com:/home/storage/master/brick1 Options Reconfigured: performance.readdir-ahead: on performance.quick-read: off performance.read-ahead: off performance.io-cache: off performance.stat-prefetch: off cluster.eager-lock: enable network.remote-dio: enable cluster.quorum-type: auto cluster.server-quorum-type: server storage.owner-uid: 36 storage.owner-gid: 36 features.shard: on features.shard-block-size: 512MB performance.low-prio-threads: 32 cluster.data-self-heal-algorithm: full performance.write-behind: off performance.write-behind-window-size: 4MB performance.cache-size: 1GB Volume Name: vmos1 Type: Replicate Volume ID: ea8fb50e-7bc8-4de3-b775-f3976b6b4f13 Status: Started Number of Bricks: 1 x 3 = 3 Transport-type: tcp Bricks: Brick1: gluster1.xyz.com:/gluster/vmos1/brick1 Brick2: gluster2.xyz.com:/gluster/vmos1/brick1 Brick3: gluster-root1.xyz.com:/gluster/vmos1/brick1 Options Reconfigured: network.ping-timeout: 60 performance.readdir-ahead: on performance.quick-read: off performance.read-ahead: off performance.io-cache: off performance.stat-prefetch: off cluster.eager-lock: enable network.remote-dio: enable cluster.quorum-type: auto cluster.server-quorum-type: server storage.owner-uid: 36 storage.owner-gid: 36 features.shard: on features.shard-block-size: 512MB performance.low-prio-threads: 32 cluster.data-self-heal-algorithm: full performance.write-behind: off performance.write-behind-window-size: 4MB performance.cache-size: 1GB Attached goes all the logs... Thanks -Luiz

3 6

Question about taking clugerfs storage offline
by Edward Clay 29 Apr '16

29 Apr '16

Hello, I have a 2 node replicated glusterfs storage cluster configured that shows up under storage. I need to take both of these glusterfs nodes down to perform some hardware upgrades. I'm wondering if I need to put this storage into maintenance mode or if putting each host into maintenance mode is good enough? The reason I'm asking is the last time I took one of these glusterfs servers down leaving the other up we ended up in a split brain state that I'm trying to avoid. Once the hardware upgrade has been performed I will be adding a 3rd brick/node to this config which should make things a bit happier. Thanks

2 1

Re: [ovirt-users] Unable to power off the vm
by Budur Nagaraju 29 Apr '16

29 Apr '16

Not able to access through console ,SSH, even the migration option is not getting highlighted unable to perform any actions. To reboot host I need to migrate remaining vms to other host , that is time consuming. Any commands to kill the process without rebooting the host? On Apr 28, 2016 5:42 PM, "Michal Skrivanek" <michal.skrivanek(a)redhat.com> wrote: On 28 Apr 2016, at 14:11, Budur Nagaraju <nbudoor(a)gmail.com> wrote: Earlier it was working ,now not able to power on/off shutdown. deploy in another host etc. I don’t mean in ovirt, I mean the guest itself. Can you get to the console? Can you ssh to that guest? Does it do anythign? if so it might be worth trying to save it (e.g. migrate), if not, just kill it from the host…or migrate everything else away and reboot the host On Apr 28, 2016 5:38 PM, "Michal Skrivanek" <michal.skrivanek(a)redhat.com> wrote: > > On 28 Apr 2016, at 14:01, Budur Nagaraju <nbudoor(a)gmail.com> wrote: > > ovirt node is having 50vms and one VM is having issues, by restarting > libvirt will the other vms get affect? And am not getting the option to > delete. > > > it will not affect the running VMs, they will keep running > again, does that one VM actually work? > > On Apr 28, 2016 5:26 PM, "Michal Skrivanek" <michal.skrivanek(a)redhat.com> > wrote: > >> >> > On 28 Apr 2016, at 13:49, Budur Nagaraju <nbudoor(a)gmail.com> wrote: >> > >> > Any commands to check the same ? >> >> so does the VM actually work? >> what’s the status of the process? >> >> if it works, restart libvirtd (that will induce a vdsm restart as well), >> and check if it makes any difference. If not then I guess you’re out of >> luck and you can try to kill the qemu process yourself…or reboot the box >> >> > On Apr 28, 2016 5:10 PM, "Michal Skrivanek" < >> michal.skrivanek(a)redhat.com> >> > wrote: >> > >> >> >> >>> On 28 Apr 2016, at 10:03, Budur Nagaraju <nbudoor(a)gmail.com> wrote: >> >>> >> >>> HI >> >>> >> >>> One of the vm is showing "?" and unable to perform any actions below >> >> are the logs ,let me know is there any ways to bring it back ? >> >> >> >> then it’s probably broken in lower layers. check/add vdsm.log from that >> >> period, but it is likely that libvirt lost control over the qemu >> process. >> >> You may want to check that particular qemu process if it is alright or >> .g >> >> >

2 2

audit_log table performance tuning
by Marina Kalinin 28 Apr '16

28 Apr '16

Hi, Any suggestions or maybe already available features in the pipeline for tuning the database, and specifically the audit_log table? The problem today is that with multiple applications accessing the engine through the RestAPI, especially deployments with CloudForms, create huge amount of login records in the audit_table. Which, in turns, consumes most of the available memory on the machine running the engine and the database and results in a terrible performance of engine and inaccessible Web UI. The solution today is to delete those records from the table [1]: => delete from audit_log where message like '%logged%'; Are there any current tunings we can apply to the database? And if not - do we have any RFEs on limiting the records entered to the database or a way to delete/filter those records somehow from the WebUI? All I could find was RFE#1120659 [2], but it does not describe the exact issue. -- Thanks, Marina. [1] https://access.redhat.com/solutions/2110011 [2] https://bugzilla.redhat.com/show_bug.cgi?id=1120659

5 7

Re: [ovirt-users] vms in paused state
by Bill James 28 Apr '16

28 Apr '16

trying again with smaller attachments... On 04/28/2016 10:40 AM, Bill James wrote: > thank you for response. > I bold-ed the ones that are listed as "paused". > > > [root@ovirt1 test vdsm]# virsh -r list --all > Id Name State > ---------------------------------------------------- > * 2 puppet.test.j2noc.com running* > * 4 sftp2.test.j2noc.com running* > * 5 oct.test.j2noc.com running* > * 6 sftp2.dev.j2noc.com running* > * 10 darmaster1.test.j2noc.com running* > * 14 api1.test.j2noc.com running* > 25 ftp1.frb.test.j2noc.com running > 26 auto7.test.j2noc.com running > * 32 epaymv02.j2noc.com running* > 34 media2.frb.test.j2noc.com running > 36 auto2.j2noc.com running > 44 nfs.testhvy2.colo.j2noc.com running > * 53 billapp-zuma1.dev.j2noc.com running* > * 54 billing-ci.dev.j2noc.com running* > 60 log2.test.j2noc.com running > 63 log1.test.j2noc.com running > * 69 sonar.dev.j2noc.com running* > * 73 billapp-ui1.dev.j2noc.com running* > * 74 billappvm01.dev.j2noc.com running* > 75 db2.frb.test.j2noc.com running > 83 billapp-ui1.test.j2noc.com running > * 84 epayvm01.test.j2noc.com running* > * 87 billappvm01.test.j2noc.com running* > * 89 etapi1.test.j2noc.com running* > * 93 billapp-zuma2.test.j2noc.com running* > * 94 git.dev.j2noc.com running* > > Yes I did "systemctl restart libvirtd" which apparently also restart vdsm? > > > Looks like problem started around 2016-04-17 20:19:34,822, based on > engine.log attached. > There's a lot of vdsm logs! > > fyi, the storage domain for these Vms is a "local" nfs share, > 7e566f55-e060-47b7-bfa4-ac3c48d70dda. > > attached more logs. > > > On 04/28/2016 12:53 AM, Michal Skrivanek wrote: >>> On 27 Apr 2016, at 19:16, Bill James<bill.james(a)j2.com> wrote: >>> >>> virsh # list --all >>> error: failed to connect to the hypervisor >>> error: no valid connection >>> error: Failed to connect socket to '/var/run/libvirt/libvirt-sock': No such file or directory >>> >> you need to run virsh in read-only mode >> virsh -r list —all >> >>> [root@ovirt1 test vdsm]# systemctl status libvirtd >>> ● libvirtd.service - Virtualization daemon >>> Loaded: loaded (/usr/lib/systemd/system/libvirtd.service; enabled; vendor preset: enabled) >>> Drop-In: /etc/systemd/system/libvirtd.service.d >>> └─unlimited-core.conf >>> Active: active (running) since Thu 2016-04-21 16:00:03 PDT; 5 days ago >>> >>> >>> tried systemctl restart libvirtd. >>> No change. >>> >>> Attached vdsm.log and supervdsm.log. >>> >>> >>> [root@ovirt1 test vdsm]# systemctl status vdsmd >>> ● vdsmd.service - Virtual Desktop Server Manager >>> Loaded: loaded (/usr/lib/systemd/system/vdsmd.service; enabled; vendor preset: enabled) >>> Active: active (running) since Wed 2016-04-27 10:09:14 PDT; 3min 46s ago >>> >>> >>> vdsm-4.17.18-0.el7.centos.noarch >> the vdsm.log attach is good, but it’s too short interval, it only shows recovery(vdsm restart) phase when the VMs are identified as paused….can you add earlier logs? Did you restart vdsm yourself or did it crash? >> >> >>> libvirt-daemon-1.2.17-13.el7_2.4.x86_64 >>> >>> >>> Thanks. >>> >>> >>> On 04/26/2016 11:35 PM, Michal Skrivanek wrote: >>>>> On 27 Apr 2016, at 02:04, Nir Soffer<nsoffer(a)redhat.com> wrote: >>>>> >>>>> jjOn Wed, Apr 27, 2016 at 2:03 AM, Bill James<bill.james(a)j2.com> wrote: >>>>>> I have a hardware node that has 26 VMs. >>>>>> 9 are listed as "running", 17 are listed as "paused". >>>>>> >>>>>> In truth all VMs are up and running fine. >>>>>> >>>>>> I tried telling the db they are up: >>>>>> >>>>>> engine=> update vm_dynamic set status = 1 where vm_guid =(select >>>>>> vm_guid from vm_static where vm_name = 'api1.test.j2noc.com'); >>>>>> >>>>>> GUI then shows it up for a short while, >>>>>> >>>>>> then puts it back in paused state. >>>>>> >>>>>> 2016-04-26 15:16:46,095 INFO [org.ovirt.engine.core.vdsbroker.VmAnalyzer] >>>>>> (DefaultQuartzScheduler_Worker-16) [157cc21e] VM '242ca0af-4ab2-4dd6-b515-5 >>>>>> d435e6452c4'(api1.test.j2noc.com) moved from 'Up' --> 'Paused' >>>>>> 2016-04-26 15:16:46,221 INFO [org.ovirt.engine.core.dal.dbbroker.auditlogh >>>>>> andling.AuditLogDirector] (DefaultQuartzScheduler_Worker-16) [157cc21e] Cor >>>>>> relation ID: null, Call Stack: null, Custom Event ID: -1, Message: VM api1. >>>>>> test.j2noc.com has been paused. >>>>>> >>>>>> >>>>>> Why does the engine think the VMs are paused? >>>>>> Attached engine.log. >>>>>> >>>>>> I can fix the problem by powering off the VM then starting it back up. >>>>>> But the VM is working fine! How do I get ovirt to realize that? >>>>> If this is an issue in engine, restarting engine may fix this. >>>>> but having this problem only with one node, I don't think this is the issue. >>>>> >>>>> If this is an issue in vdsm, restarting vdsm may fix this. >>>>> >>>>> If this does not help, maybe this is libvirt issue? did you try to check vm >>>>> status using virsh? >>>> this looks more likely as it seems such status is being reported >>>> logs would help, vdsm.log at the very least. >>>> >>>>> If virsh thinks that the vms are paused, you can try to restart libvirtd. >>>>> >>>>> Please file a bug about this in any case with engine and vdsm logs. >>>>> >>>>> Adding Michal in case he has better idea how to proceed. >>>>> >>>>> Nir >>> Cloud Services for Businesswww.j2.com >>> j2 | eFax | eVoice | FuseMail | Campaigner | KeepItSafe | Onebox >>> >>> >>> This email, its contents and attachments contain information from j2 Global, Inc. and/or its affiliates which may be privileged, confidential or otherwise protected from disclosure. The information is intended to be for the addressee(s) only. If you are not an addressee, any disclosure, copy, distribution, or use of the contents of this message is prohibited. If you have received this email in error please notify the sender by reply e-mail and delete the original message and any copies. (c) 2015 j2 Global, Inc. All rights reserved. eFax, eVoice, Campaigner, FuseMail, KeepItSafe, and Onebox are registered trademarks of j2 Global, Inc. and its affiliates. >>> <supervdsm.log.gz><vdsm.log.gz>_______________________________________________ >>> Users mailing list >>> Users(a)ovirt.org >>> http://lists.ovirt.org/mailman/listinfo/users >

1 0

node unresponsive after reboot
by Campbell McLeay 28 Apr '16

28 Apr '16

Hi, I have a two node + engine ovirt setup, and I was having problems doing a live migration between nodes. I looked in the vdsm logs and noticed selinux errors, so I checked the selinux config, and both the ovirt-engine host and one of the nodes had selinux disabled. So I thought I would enable it on these two hosts, as it is officially supported anyway. I started with the node, and put it into maintenance mode, which interestingly, migrated the VMs off to the other node without issue. After modifying the selinux config, I then rebooted that node, which came back up. I then tried to activate the node but it fails and marks it as unresponsive. From the log: ----------8<---------- 2016-04-28 16:34:31,326 INFO [org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient] (SSL Stomp Reactor) [29acb18b] Connecting to kvm-ldn-02.ldn.framestore.com/172.16.75.189 2016-04-28 16:34:31,327 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-32) [ac322cb] Command 'GetCapabilitiesVDSCommand(HostName = kvm-ldn-02, VdsIdAndVdsVDSCommandParametersBase:{runAsync='true', hostId='b12c0b80-d64d-42fd-8a55-94f92b9ca3aa', vds='Host[kvm-ldn-02,b12c0b80-d64d-42fd-8a55-94f92b9ca3aa]'})' execution failed: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed 2016-04-28 16:34:31,327 ERROR [org.ovirt.engine.core.vdsbroker.HostMonitoring] (DefaultQuartzScheduler_Worker-32) [ac322cb] Failure to refresh Vds runtime info: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed 2016-04-28 16:34:31,327 ERROR [org.ovirt.engine.core.vdsbroker.HostMonitoring] (DefaultQuartzScheduler_Worker-32) [ac322cb] Exception: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:157) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:120) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:65) [vdsbroker.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:33) [dal.jar:] at org.ovirt.engine.core.vdsbroker.ResourceManager.runVdsCommand(ResourceManager.java:467) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:652) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.HostMonitoring.refreshVdsRunTimeInfo(HostMonitoring.java:119) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.HostMonitoring.refresh(HostMonitoring.java:84) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:227) [vdsbroker.jar:] at sun.reflect.GeneratedMethodAccessor120.invoke(Unknown Source) [:1.8.0_71] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_71] at java.lang.reflect.Method.invoke(Method.java:497) [rt.jar:1.8.0_71] at org.ovirt.engine.core.utils.timer.JobWrapper.invokeMethod(JobWrapper.java:81) [scheduler.jar:] at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:52) [scheduler.jar:] at org.quartz.core.JobRunShell.run(JobRunShell.java:213) [quartz.jar:] at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) [quartz.jar:] Caused by: org.ovirt.vdsm.jsonrpc.client.ClientConnectionException: Connection failed at org.ovirt.vdsm.jsonrpc.client.reactors.ReactorClient.connect(ReactorClient.java:157) [vdsm-jsonrpc-java-client.jar:] at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.getClient(JsonRpcClient.java:114) [vdsm-jsonrpc-java-client.jar:] at org.ovirt.vdsm.jsonrpc.client.JsonRpcClient.call(JsonRpcClient.java:73) [vdsm-jsonrpc-java-client.jar:] at org.ovirt.engine.core.vdsbroker.jsonrpc.FutureMap.<init>(FutureMap.java:68) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.jsonrpc.JsonRpcVdsServer.getCapabilities(JsonRpcVdsServer.java:268) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand.executeVdsBrokerCommand(GetCapabilitiesVDSCommand.java:15) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:110) [vdsbroker.jar:] ... 14 more ----------8<---------- Any ideas? Thanks, Cam

1 0