
In order to be easier to read, you can rotate the log before starting the engine.Should be something like: hosted-engine --set-maintenance --mode=global && logrotate -f /etc/vdsm/logrotate/vdsm && hosted-engine -- vm-start Best Regards, Strahil NikolovOn Mar 16, 2019 10:52, Simone Tiraboschi <stirabos@redhat.com> wrote:
On Sat, Mar 16, 2019 at 7:44 AM <siovelrm@gmail.com> wrote:
Hi, I have a big problem with ovirt. I use version 4.2.7 with self-hosted. The problem is that when I try to raise the vm of the ovirt-engine with the command: hosted-engine --vm-start, it appears in the output "VM exists and is down, cleaning up and restarting" when running: hosted-engine --vm-status appears --== Host 1 status ==--
conf_on_shared_storage : True Status up-to-date : True Hostname : node1.softel.cu Host ID : 1 Engine status : {"reason": "bad vm status", "health": "bad", "vm": "down_unexpected", "detail": "Down"} Score : 0 stopped : False Local maintenance : False crc32 : 02c3b5a4 local_conf_timestamp : 49529 Host timestamp : 49529 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=49529 (Sat Mar 16 02:39:10 2019) host-id=1 score=0 vm_conf_refresh_time=49529 (Sat Mar 16 02:39:11 2019) conf_on_shared_storage=True maintenance=False state=EngineUnexpectedlyDown stopped=False timeout=Thu Jan 1 08:49:39 1970
in /var/log/messages Mar 16 02:35:34 node1 vdsm[26151]: WARN Attempting to remove a non existing network: ovirtmgmt/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 Mar 16 02:35:34 node1 vdsm[26151]: WARN Attempting to remove a non existing net user: ovirtmgmt/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 Mar 16 02:35:34 node1 vdsm[26151]: WARN Attempting to remove a non existing network: ovirtmgmt/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 Mar 16 02:35:34 node1 vdsm[26151]: WARN Attempting to remove a non existing net user: ovirtmgmt/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 Mar 16 02:35:34 node1 vdsm[26151]: WARN File: /var/lib/libvirt/qemu/channels/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241.org.qemu.guest_agent.0 already removed
Please help!!
I'd suggest to check in /var/log/vdsm/vdsm.log why it failed to start.
_______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/OTXJFCVCAHMYZJ...

Hi, thanks for your answers. Here are the logs of vdsm.log. Please help!!! 2019-03-18 10:12:00,172-0400 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:00,175-0400 INFO (jsonrpc/7) [api.host] START getCapabilities() from=::1,47126 (api:46) 2019-03-18 10:12:00,472-0400 INFO (Reactor thread) [ProtocolDetector.AcceptorImpl] Accepted connection from ::1:51344 (protocoldetector:61) 2019-03-18 10:12:00,479-0400 INFO (Reactor thread) [ProtocolDetector.Detector] Detected protocol stomp from ::1:51344 (protocoldetector:125) 2019-03-18 10:12:00,479-0400 INFO (Reactor thread) [Broker.StompAdapter] Processing CONNECT request (stompreactor:103) 2019-03-18 10:12:00,481-0400 INFO (JsonRpc (StompReactor)) [Broker.StompAdapter] Subscribe command received (stompreactor:132) 2019-03-18 10:12:00,485-0400 INFO (jsonrpc/7) [root] /usr/libexec/vdsm/hooks/after_get_caps/50_openstacknet: rc=0 err= (hooks:110) 2019-03-18 10:12:00,521-0400 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:00,534-0400 INFO (jsonrpc/2) [api.virt] START getStats() from=::1,51344, vmId=0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (api:46) 2019-03-18 10:12:00,535-0400 INFO (jsonrpc/2) [api.virt] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Down', 'exitMessage': "'NoneType' object has no attribute '__getitem__'", 'statusTime': '4301155670', 'vmId': '0c3e1c08-3928-47f1-96a8-c6a8d0dc3241', 'exitReason': 1, 'exitCode': 1}]} from=::1,51344, vmId=0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (api:52) 2019-03-18 10:12:00,535-0400 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call VM.getStats succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:00,657-0400 INFO (jsonrpc/7) [root] /usr/libexec/vdsm/hooks/after_get_caps/openstacknet_utils.py: rc=0 err= (hooks:110) 2019-03-18 10:12:00,703-0400 INFO (Reactor thread) [ProtocolDetector.AcceptorImpl] Accepted connection from ::1:51346 (protocoldetector:61) 2019-03-18 10:12:00,709-0400 INFO (Reactor thread) [ProtocolDetector.Detector] Detected protocol stomp from ::1:51346 (protocoldetector:125) 2019-03-18 10:12:00,709-0400 INFO (Reactor thread) [Broker.StompAdapter] Processing CONNECT request (stompreactor:103) 2019-03-18 10:12:00,710-0400 INFO (JsonRpc (StompReactor)) [Broker.StompAdapter] Subscribe command received (stompreactor:132) 2019-03-18 10:12:00,751-0400 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:00,757-0400 INFO (jsonrpc/3) [api.virt] START destroy(gracefulAttempts=1) from=::1,51346, vmId=0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (api:46) 2019-03-18 10:12:00,758-0400 INFO (jsonrpc/3) [virt.vm] (vmId='0c3e1c08-3928-47f1-96a8-c6a8d0dc3241') Release VM resources (vm:5283) 2019-03-18 10:12:00,758-0400 WARN (jsonrpc/3) [virt.vm] (vmId='0c3e1c08-3928-47f1-96a8-c6a8d0dc3241') trying to set state to Powering down when already Down (vm:612) 2019-03-18 10:12:00,758-0400 INFO (jsonrpc/3) [virt.vm] (vmId='0c3e1c08-3928-47f1-96a8-c6a8d0dc3241') Stopping connection (guestagent:442) 2019-03-18 10:12:00,758-0400 INFO (jsonrpc/3) [vdsm.api] START teardownImage(sdUUID='89fcd80a-0840-4877-8abb-3a4c0432f36e', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='5f6b263c-3ce8-4964-ac7c-ea47c49242e9', volUUID=None) from=::1,51346, task_id=6235caf7-9318-4b7b-bf98-4c3b2304ac4a (api:46) 2019-03-18 10:12:00,759-0400 INFO (jsonrpc/3) [storage.StorageDomain] Removing image rundir link u'/var/run/vdsm/storage/89fcd80a-0840-4877-8abb-3a4c0432f36e/5f6b263c-3ce8-4964-ac7c-ea47c49242e9' (fileSD:600) 2019-03-18 10:12:00,759-0400 INFO (jsonrpc/3) [vdsm.api] FINISH teardownImage return=None from=::1,51346, task_id=6235caf7-9318-4b7b-bf98-4c3b2304ac4a (api:52) 2019-03-18 10:12:00,759-0400 INFO (jsonrpc/3) [virt.vm] (vmId='0c3e1c08-3928-47f1-96a8-c6a8d0dc3241') Stopping connection (guestagent:442) 2019-03-18 10:12:00,759-0400 WARN (jsonrpc/3) [root] File: /var/lib/libvirt/qemu/channels/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241.ovirt-guest-agent.0 already removed (fileutils:51) 2019-03-18 10:12:00,760-0400 WARN (jsonrpc/3) [root] Attempting to remove a non existing network: ovirtmgmt/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (libvirtnetwork:196) 2019-03-18 10:12:00,760-0400 WARN (jsonrpc/3) [root] Attempting to remove a non existing net user: ovirtmgmt/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (libvirtnetwork:203) 2019-03-18 10:12:00,761-0400 WARN (jsonrpc/3) [root] Attempting to remove a non existing network: ovirtmgmt/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (libvirtnetwork:196) 2019-03-18 10:12:00,761-0400 WARN (jsonrpc/3) [root] Attempting to remove a non existing net user: ovirtmgmt/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (libvirtnetwork:203) 2019-03-18 10:12:00,762-0400 WARN (jsonrpc/3) [root] File: /var/lib/libvirt/qemu/channels/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241.org.qemu.guest_agent.0 already removed (fileutils:51) 2019-03-18 10:12:00,762-0400 WARN (jsonrpc/3) [virt.vm] (vmId='0c3e1c08-3928-47f1-96a8-c6a8d0dc3241') timestamp already removed from stats cache (vm:2398) 2019-03-18 10:12:00,762-0400 INFO (jsonrpc/3) [vdsm.api] START inappropriateDevices(thiefId='0c3e1c08-3928-47f1-96a8-c6a8d0dc3241') from=::1,51346, task_id=259ee7a7-c7f6-476e-9c32-0b42eebe137b (api:46) 2019-03-18 10:12:00,762-0400 INFO (jsonrpc/3) [vdsm.api] FINISH inappropriateDevices return=None from=::1,51346, task_id=259ee7a7-c7f6-476e-9c32-0b42eebe137b (api:52) 2019-03-18 10:12:00,848-0400 INFO (jsonrpc/7) [root] /usr/libexec/vdsm/hooks/after_get_caps/ovirt_provider_ovn_hook: rc=0 err= (hooks:110) 2019-03-18 10:12:00,849-0400 INFO (jsonrpc/7) [api.host] FINISH getCapabilities return={'status': {'message': 'Done', 'code': 0}, 'info': {u'HBAInventory': {u'iSCSI': [{u'InitiatorName': u'iqn.1994-05.com.redhat:1612863cd006'}], u'FC': []}, u'packages2': {u'kernel': {u'release': u'862.14.4.el7.x86_64', u'version': u'3.10.0'}, u'glusterfs-rdma': {u'release': u'1.el7', u'version': u'3.12.15'}, u'glusterfs-fuse': {u'release': u'1.el7', u'version': u'3.12.15'}, u'spice-server': {u'release': u'2.el7_5.5', u'version': u'0.14.0'}, u'librbd1': {u'release': u'2.el7', u'version': u'0.94.5'}, u'vdsm': {u'release': u'1.el7', u'version': u'4.20.43'}, u'qemu-kvm': {u'release': u'21.el7_5.7.1', u'version': u'2.10.0'}, u'openvswitch': {u'release': u'4.el7', u'version': u'2.9.0'}, u'libvirt': {u'release': u'14.el7_5.8', u'version': u'3.9.0'}, u'ovirt-hosted-engine-ha': {u'release': u'1.el7', u'version': u'2.2.18'}, u'qemu-img': {u'release': u'21.el7_5.7.1', u'version': u'2.10.0'}, u'mom': {u'release ': u'1.el7.centos', u'version': u'0.5.12'}, u'glusterfs': {u'release': u'1.el7', u'version': u'3.12.15'}, u'glusterfs-cli': {u'release': u'1.el7', u'version': u'3.12.15'}, u'glusterfs-server': {u'release': u'1.el7', u'version': u'3.12.15'}, u'glusterfs-geo-replication': {u'release': u'1.el7', u'version': u'3.12.15'}}, u'numaNodeDistance': {u'0': [10]}, u'cpuModel': u'Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz', u'nestedVirtualization': False, u'liveMerge': u'true', u'hooks': {u'before_vm_start': {u'50_hostedengine': {u'md5': u'95c810cdcfe4195302a59574a5148289'}, u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_network_setup': {u'30_ethtool_options': {u'md5': u'f04c2ca5dce40663e2ed69806eea917c'}}, u'after_vm_destroy': {u'delete_vhostuserclient_hook': {u'md5': u'c2f279cc9483a3f842f6c29df13994c1'}, u'50_vhostmd': {u'md5': u'bdf4802c0521cf1bae08f2b90a9559cf'}}, u'after_vm_start': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstack net': {u'md5': u'ea0a5a715da8c1badbcda28e8b8fa00e'}}, u'after_device_migrate_destination': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_network_setup': {u'50_fcoe': {u'md5': u'28c352339c8beef1e1b05c67d106d062'}}, u'before_device_create': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'a8af653b7386c138b2e6e9738bd6b62c'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'73822988042847bab1ea832a6b9fa837'}}, u'before_nic_hotplug': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'a8af653b7 386c138b2e6e9738bd6b62c'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'73822988042847bab1ea832a6b9fa837'}}, u'before_vm_migrate_destination': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_nic_hotplug': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_vm_dehibernate': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_get_caps': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0e00c63ab44a952e722209ea31fd7a71'}, u'ovirt_provider_ovn_hook': {u'md5': u'4c4b1d2d5460e6a65114ae36cb775df6'}}, u'before_device_migrate_destination': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}}, u'after_device_create': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}}, u'supportsIPv6': True, u'realtimeKer nel': False, u'vmTypes': [u'kvm'], u'liveSnapshot': u'true', u'cpuThreads': u'4', u'kdumpStatus': 0, u'networks': {}, u'kernelArgs': u'BOOT_IMAGE=/ovirt-node-ng-4.2.7.1-0.20181114.0+1/vmlinuz-3.10.0-862.14.4.el7.x86_64 root=/dev/onn/ovirt-node-ng-4.2.7.1-0.20181114.0+1 ro crashkernel=auto rd.lvm.lv=onn/ovirt-node-ng-4.2.7.1-0.20181114.0+1 rd.lvm.lv=onn/swap rhgb quiet LANG=en_US.UTF-8 img.bootid=ovirt-node-ng-4.2.7.1-0.20181114.0+1', u'bridges': {u'ovirtmgmt': {u'ipv6autoconf': True, u'addr': u'192.168.14.161', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'192.168.14.161/24'], u'ipv6gateway': u'::', u'gateway': u'192.168.14.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3 125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.00e04c680408', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'609', u'root_id': u'8000.00e04c680408', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u '0', u'forward_delay': u'0'}, u'ports': [u'enp1s0']}}, u'uuid': u'03000200-0400-0500-0006-000700080009', u'onlineCpus': u'0,1,2,3', u'nameservers': [u'192.168.10.3'], u'nics': {u'enp1s0': {u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'00:e0:4c:68:04:08', u'ipv6gateway': u'::', u'gateway': u''}}, u'software_revision': u'1', u'hostdevPassthrough': u'false', u'clusterLevels': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,art,arch_perfmon,pebs,bts,rep_good,nopl,xtopology,nonstop_tsc,aperfmperf,eagerfpu,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,est,tm2,ssse3,sdbg,fma,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,aes,xsave,avx,f16c,rdrand,lahf_lm,abm,3dnowprefetch,epb, intel_pt,ssbd,ibrs,ibpb,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,tsc_adjust,bmi1,avx2,smep,bmi2,erms,invpcid,mpx,rdseed,adx,smap,clflushopt,xsaveopt,xsavec,xgetbv1,dtherm,ida,arat,pln,pts,hwp,hwp_notify,hwp_act_window,hwp_epp,model_n270,model_coreduo,model_SandyBridge-IBRS,model_Nehalem,model_Haswell-noTSX,model_Westmere-IBRS,model_Broadwell-noTSX,model_Haswell-noTSX-IBRS,model_Nehalem-IBRS,model_core2duo,model_IvyBridge,model_Penryn,model_IvyBridge-IBRS,model_Westmere,model_Broadwell-noTSX-IBRS,model_SandyBridge,model_Conroe', u'kernelFeatures': {u'RETP': 0, u'IBRS': 1, u'PTI': 1}, u'ISCSIInitiatorName': u'iqn.1994-05.com.redhat:1612863cd006', u'netConfigDirty': u'False', u'selinux': {u'mode': u'1'}, u'autoNumaBalancing': 0, u'reservedMem': u'321', u'containers': False, u'bondings': {}, u'software_version': u'4.20', u'supportedENGINEs': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuSpeed': u'3099.957', u'numaNodes': {u'0': {u'totalMemory': u'15794', u'cpus': [0, 1, 2, 3]}}, u'cpuSoc kets': u'1', u'vlans': {}, u'version_name': u'Snow Man', 'lastClientIface': 'lo', u'cpuCores': u'2', u'hostedEngineDeployed': True, u'hugepages': [1048576, 2048], u'guestOverhead': u'65', u'additionalFeatures': [u'libgfapi_supported', u'GLUSTER_SNAPSHOT', u'GLUSTER_GEO_REPLICATION', u'GLUSTER_BRICK_MANAGEMENT'], u'openstack_binding_host_ids': {u'OVIRT_PROVIDER_OVN': u'ed35b4f0-8c54-4262-b2a4-1f2cdc7c7ddf'}, u'kvmEnabled': u'true', u'memSize': u'15794', u'emulatedMachines': [u'pc-i440fx-rhel7.1.0', u'pc-q35-rhel7.3.0', u'rhel6.3.0', u'pc-i440fx-rhel7.5.0', u'pc-i440fx-rhel7.0.0', u'rhel6.1.0', u'pc-i440fx-rhel7.4.0', u'rhel6.6.0', u'pc-q35-rhel7.5.0', u'rhel6.2.0', u'pc', u'pc-i440fx-rhel7.3.0', u'q35', u'pc-i440fx-rhel7.2.0', u'rhel6.4.0', u'pc-q35-rhel7.4.0', u'rhel6.0.0', u'rhel6.5.0'], u'rngSources': [u'hwrng', u'random'], u'operatingSystem': {u'release': u'5.1804.5.el7.centos', u'pretty_name': u'oVirt Node 4.2.7.1', u'version': u'7', u'name': u'RHEL'}}} from=::1,47126 (api:52) 2019-03-18 10:12:00,854-0400 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 0.68 seconds (__init__:573) 2019-03-18 10:12:00,919-0400 INFO (jsonrpc/3) [root] /usr/libexec/vdsm/hooks/after_vm_destroy/50_vhostmd: rc=0 err= (hooks:110) 2019-03-18 10:12:01,024-0400 INFO (jsonrpc/3) [root] /usr/libexec/vdsm/hooks/after_vm_destroy/delete_vhostuserclient_hook: rc=0 err= (hooks:110) 2019-03-18 10:12:01,025-0400 INFO (jsonrpc/3) [api.virt] FINISH destroy return={'status': {'message': 'Machine destroyed', 'code': 0}} from=::1,51346, vmId=0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (api:52) 2019-03-18 10:12:01,025-0400 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call VM.destroy succeeded in 0.27 seconds (__init__:573) 2019-03-18 10:12:01,228-0400 INFO (Reactor thread) [ProtocolDetector.AcceptorImpl] Accepted connection from ::1:51348 (protocoldetector:61) 2019-03-18 10:12:01,234-0400 INFO (Reactor thread) [ProtocolDetector.Detector] Detected protocol stomp from ::1:51348 (protocoldetector:125) 2019-03-18 10:12:01,235-0400 INFO (Reactor thread) [Broker.StompAdapter] Processing CONNECT request (stompreactor:103) 2019-03-18 10:12:01,236-0400 INFO (JsonRpc (StompReactor)) [Broker.StompAdapter] Subscribe command received (stompreactor:132) 2019-03-18 10:12:01,277-0400 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:01,282-0400 INFO (jsonrpc/0) [api.virt] START create(vmParams={u'xml': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?>\n<domain xmlns:ovirt-tune="http://ovirt.org/vm/tune/1.0" xmlns:ovirt-vm="http://ovirt.org/vm/1.0" type="kvm"><name>HostedEngine</name><uuid>0c3e1c08-3928-47f1-96a8-c6a8d0dc3241</uuid><memory>4153344</memory><currentMemory>4153344</currentMemory><iothreads>1</iothreads><maxMemory slots="16">24805376</maxMemory><vcpu current="4">64</vcpu><sysinfo type="smbios"><system><entry name="manufacturer">oVirt</entry><entry name="product">OS-NAME:</entry><entry name="version">OS-VERSION:</entry><entry name="serial">HOST-SERIAL:</entry><entry name="uuid">0c3e1c08-3928-47f1-96a8-c6a8d0dc3241</entry></system></sysinfo><clock offset="variable" adjustment="0"><timer name="rtc" tickpolicy="catchup"/><timer name="pit" tickpolicy="delay"/><timer name="hpet" present="no"/></clock><features><acpi/></features><cpu match="exact"><model>Broadwell-noTSX</model><topology cores=" 4" threads="1" sockets="16"/><numa><cell id="0" cpus="0,1,2,3" memory="4153344"/></numa></cpu><cputune/><devices><input type="mouse" bus="ps2"/><channel type="unix"><target type="virtio" name="ovirt-guest-agent.0"/><source mode="bind" path="/var/lib/libvirt/qemu/channels/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241.ovirt-guest-agent.0"/></channel><channel type="unix"><target type="virtio" name="org.qemu.guest_agent.0"/><source mode="bind" path="/var/lib/libvirt/qemu/channels/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241.org.qemu.guest_agent.0"/></channel><controller type="virtio-serial" index="0" ports="16"><alias name="ua-0aa18171-e350-43b8-9555-7d378f19e724"/><address bus="0x00" domain="0x0000" function="0x0" slot="0x05" type="pci"/></controller><controller type="usb" model="piix3-uhci" index="0"><address bus="0x00" domain="0x0000" function="0x2" slot="0x01" type="pci"/></controller><graphics type="vnc" port="-1" autoport="yes" passwd="*****" passwdValidTo="1970-01-01T00:00:01" keymap="en-us"><lis ten type="network" network="vdsm-ovirtmgmt"/></graphics><video><model type="qxl" vram="32768" heads="1" ram="65536" vgamem="16384"/><alias name="ua-507e08b1-44b9-4796-9fab-9535195577ab"/><address bus="0x00" domain="0x0000" function="0x0" slot="0x02" type="pci"/></video><controller type="ide" index="0"><address bus="0x00" domain="0x0000" function="0x1" slot="0x01" type="pci"/></controller><memballoon model="virtio"><stats period="5"/><alias name="ua-962db293-f65d-4c5c-88b2-5f7bd2014d2d"/><address bus="0x00" domain="0x0000" function="0x0" slot="0x08" type="pci"/></memballoon><graphics type="spice" port="-1" autoport="yes" passwd="*****" passwdValidTo="1970-01-01T00:00:01" tlsPort="-1"><channel name="main" mode="secure"/><channel name="inputs" mode="secure"/><channel name="cursor" mode="secure"/><channel name="playback" mode="secure"/><channel name="record" mode="secure"/><channel name="display" mode="secure"/><channel name="smartcard" mode="secure"/><channel name="usbredir" mode="secu re"/><listen type="network" network="vdsm-ovirtmgmt"/></graphics><rng model="virtio"><backend model="random">/dev/urandom</backend><alias name="ua-a04d377a-e4ef-4e8d-a142-a97ec1b8a6f4"/></rng><sound model="ich6"><alias name="ua-ac09e7ce-0882-407a-83b9-c529333cca7a"/><address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/></sound><controller type="scsi" model="virtio-scsi" index="0"><driver iothread="1"/><alias name="ua-bc6f5133-a880-4e2f-b5a4-42236ae2ecde"/><address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/></controller><channel type="spicevmc"><target type="virtio" name="com.redhat.spice.0"/></channel><interface type="bridge"><model type="virtio"/><link state="up"/><source bridge="ovirtmgmt"/><driver queues="4" name="vhost"/><alias name="ua-d2906c43-b027-4e69-9bea-76f835940efa"/><address bus="0x00" domain="0x0000" function="0x0" slot="0x03" type="pci"/><mac address="00:16:3e:2e:1d:8c"/><mtu size="1500"/><filterref filter="vdsm-no-mac-spoof ing"/><bandwidth/></interface><disk type="file" device="cdrom" snapshot="no"><driver name="qemu" type="raw" error_policy="report"/><source file="" startupPolicy="optional"/><target dev="hdc" bus="ide"/><readonly/><alias name="ua-96e6227b-a664-4ac0-87c9-3a9157af2456"/><address bus="1" controller="0" unit="0" type="drive" target="0"/></disk><disk snapshot="no" type="file" device="disk"><target dev="vda" bus="virtio"/><source file="/rhev/data-center/00000000-0000-0000-0000-000000000000/89fcd80a-0840-4877-8abb-3a4c0432f36e/images/5f6b263c-3ce8-4964-ac7c-ea47c49242e9/2ca51d06-0424-4aa0-8f1c-6c5417712c14"/><driver name="qemu" iothread="1" io="threads" type="raw" error_policy="stop" cache="none"/><alias name="ua-5f6b263c-3ce8-4964-ac7c-ea47c49242e9"/><address bus="0x00" domain="0x0000" function="0x0" slot="0x07" type="pci"/><serial>5f6b263c-3ce8-4964-ac7c-ea47c49242e9</serial></disk><lease><key>2ca51d06-0424-4aa0-8f1c-6c5417712c14</key><lockspace>89fcd80a-0840-4877-8abb-3a4c0432f36e</locks pace><target offset="LEASE-OFFSET:2ca51d06-0424-4aa0-8f1c-6c5417712c14:89fcd80a-0840-4877-8abb-3a4c0432f36e" path="LEASE-PATH:2ca51d06-0424-4aa0-8f1c-6c5417712c14:89fcd80a-0840-4877-8abb-3a4c0432f36e"/></lease></devices><pm><suspend-to-disk enabled="no"/><suspend-to-mem enabled="no"/></pm><os><type arch="x86_64" machine="pc-i440fx-rhel7.3.0">hvm</type><smbios mode="sysinfo"/></os><metadata><ovirt-tune:qos/><ovirt-vm:vm><minGuaranteedMemoryMb type="int">6056</minGuaranteedMemoryMb><clusterVersion>4.2</clusterVersion><ovirt-vm:custom/><ovirt-vm:device mac_address="00:16:3e:2e:1d:8c"><ovirt-vm:custom/></ovirt-vm:device><ovirt-vm:device devtype="disk" name="vda"><ovirt-vm:poolID>00000000-0000-0000-0000-000000000000</ovirt-vm:poolID><ovirt-vm:volumeID>2ca51d06-0424-4aa0-8f1c-6c5417712c14</ovirt-vm:volumeID><ovirt-vm:shared>exclusive</ovirt-vm:shared><ovirt-vm:imageID>5f6b263c-3ce8-4964-ac7c-ea47c49242e9</ovirt-vm:imageID><ovirt-vm:domainID>89fcd80a-0840-4877-8abb-3a4c0432f36e</ovirt-vm:d omainID></ovirt-vm:device><launchPaused>false</launchPaused><resumeBehavior>auto_resume</resumeBehavior></ovirt-vm:vm></metadata></domain>'}) from=::1,51348, vmId=0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (api:46) 2019-03-18 10:12:01,291-0400 INFO (jsonrpc/0) [api.virt] FINISH create return={'status': {'message': 'Done', 'code': 0}, 'vmList': {'status': 'WaitForLaunch', 'maxMemSize': 24224, 'acpiEnable': 'true', 'emulatedMachine': 'pc-i440fx-rhel7.3.0', 'numOfIoThreads': '1', 'vmId': '0c3e1c08-3928-47f1-96a8-c6a8d0dc3241', 'memGuaranteedSize': 6056, 'timeOffset': '0', 'smpThreadsPerCore': '1', 'cpuType': 'Broadwell-noTSX', 'guestDiskMapping': {}, 'arch': 'x86_64', 'smp': '4', 'guestNumaNodes': [{'nodeIndex': 0, 'cpus': '0,1,2,3', 'memory': '4056'}], u'xml': u'<?xml version=\'1.0\' encoding=\'UTF-8\'?>\n<domain xmlns:ovirt-tune="http://ovirt.org/vm/tune/1.0" xmlns:ovirt-vm="http://ovirt.org/vm/1.0" type="kvm"><name>HostedEngine</name><uuid>0c3e1c08-3928-47f1-96a8-c6a8d0dc3241</uuid><memory>4153344</memory><currentMemory>4153344</currentMemory><iothreads>1</iothreads><maxMemory slots="16">24805376</maxMemory><vcpu current="4">64</vcpu><sysinfo type="smbios"><system><entry name="manufacturer">oV irt</entry><entry name="product">OS-NAME:</entry><entry name="version">OS-VERSION:</entry><entry name="serial">HOST-SERIAL:</entry><entry name="uuid">0c3e1c08-3928-47f1-96a8-c6a8d0dc3241</entry></system></sysinfo><clock offset="variable" adjustment="0"><timer name="rtc" tickpolicy="catchup"/><timer name="pit" tickpolicy="delay"/><timer name="hpet" present="no"/></clock><features><acpi/></features><cpu match="exact"><model>Broadwell-noTSX</model><topology cores="4" threads="1" sockets="16"/><numa><cell id="0" cpus="0,1,2,3" memory="4153344"/></numa></cpu><cputune/><devices><input type="mouse" bus="ps2"/><channel type="unix"><target type="virtio" name="ovirt-guest-agent.0"/><source mode="bind" path="/var/lib/libvirt/qemu/channels/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241.ovirt-guest-agent.0"/></channel><channel type="unix"><target type="virtio" name="org.qemu.guest_agent.0"/><source mode="bind" path="/var/lib/libvirt/qemu/channels/0c3e1c08-3928-47f1-96a8-c6a8d0dc3241.org.qemu.guest_agent.0 "/></channel><controller type="virtio-serial" index="0" ports="16"><alias name="ua-0aa18171-e350-43b8-9555-7d378f19e724"/><address bus="0x00" domain="0x0000" function="0x0" slot="0x05" type="pci"/></controller><controller type="usb" model="piix3-uhci" index="0"><address bus="0x00" domain="0x0000" function="0x2" slot="0x01" type="pci"/></controller><graphics type="vnc" port="-1" autoport="yes" passwd="*****" passwdValidTo="1970-01-01T00:00:01" keymap="en-us"><listen type="network" network="vdsm-ovirtmgmt"/></graphics><video><model type="qxl" vram="32768" heads="1" ram="65536" vgamem="16384"/><alias name="ua-507e08b1-44b9-4796-9fab-9535195577ab"/><address bus="0x00" domain="0x0000" function="0x0" slot="0x02" type="pci"/></video><controller type="ide" index="0"><address bus="0x00" domain="0x0000" function="0x1" slot="0x01" type="pci"/></controller><memballoon model="virtio"><stats period="5"/><alias name="ua-962db293-f65d-4c5c-88b2-5f7bd2014d2d"/><address bus="0x00" domain="0x0000" fun ction="0x0" slot="0x08" type="pci"/></memballoon><graphics type="spice" port="-1" autoport="yes" passwd="*****" passwdValidTo="1970-01-01T00:00:01" tlsPort="-1"><channel name="main" mode="secure"/><channel name="inputs" mode="secure"/><channel name="cursor" mode="secure"/><channel name="playback" mode="secure"/><channel name="record" mode="secure"/><channel name="display" mode="secure"/><channel name="smartcard" mode="secure"/><channel name="usbredir" mode="secure"/><listen type="network" network="vdsm-ovirtmgmt"/></graphics><rng model="virtio"><backend model="random">/dev/urandom</backend><alias name="ua-a04d377a-e4ef-4e8d-a142-a97ec1b8a6f4"/></rng><sound model="ich6"><alias name="ua-ac09e7ce-0882-407a-83b9-c529333cca7a"/><address bus="0x00" domain="0x0000" function="0x0" slot="0x04" type="pci"/></sound><controller type="scsi" model="virtio-scsi" index="0"><driver iothread="1"/><alias name="ua-bc6f5133-a880-4e2f-b5a4-42236ae2ecde"/><address bus="0x00" domain="0x0000" function="0x0" slot="0x06" type="pci"/></controller><channel type="spicevmc"><target type="virtio" name="com.redhat.spice.0"/></channel><interface type="bridge"><model type="virtio"/><link state="up"/><source bridge="ovirtmgmt"/><driver queues="4" name="vhost"/><alias name="ua-d2906c43-b027-4e69-9bea-76f835940efa"/><address bus="0x00" domain="0x0000" function="0x0" slot="0x03" type="pci"/><mac address="00:16:3e:2e:1d:8c"/><mtu size="1500"/><filterref filter="vdsm-no-mac-spoofing"/><bandwidth/></interface><disk type="file" device="cdrom" snapshot="no"><driver name="qemu" type="raw" error_policy="report"/><source file="" startupPolicy="optional"/><target dev="hdc" bus="ide"/><readonly/><alias name="ua-96e6227b-a664-4ac0-87c9-3a9157af2456"/><address bus="1" controller="0" unit="0" type="drive" target="0"/></disk><disk snapshot="no" type="file" device="disk"><target dev="vda" bus="virtio"/><source file="/rhev/data-center/00000000-0000-0000-0000-000000000000/89fcd80a-0840-4877-8abb-3a4c0432f36e/images /5f6b263c-3ce8-4964-ac7c-ea47c49242e9/2ca51d06-0424-4aa0-8f1c-6c5417712c14"/><driver name="qemu" iothread="1" io="threads" type="raw" error_policy="stop" cache="none"/><alias name="ua-5f6b263c-3ce8-4964-ac7c-ea47c49242e9"/><address bus="0x00" domain="0x0000" function="0x0" slot="0x07" type="pci"/><serial>5f6b263c-3ce8-4964-ac7c-ea47c49242e9</serial></disk><lease><key>2ca51d06-0424-4aa0-8f1c-6c5417712c14</key><lockspace>89fcd80a-0840-4877-8abb-3a4c0432f36e</lockspace><target offset="LEASE-OFFSET:2ca51d06-0424-4aa0-8f1c-6c5417712c14:89fcd80a-0840-4877-8abb-3a4c0432f36e" path="LEASE-PATH:2ca51d06-0424-4aa0-8f1c-6c5417712c14:89fcd80a-0840-4877-8abb-3a4c0432f36e"/></lease></devices><pm><suspend-to-disk enabled="no"/><suspend-to-mem enabled="no"/></pm><os><type arch="x86_64" machine="pc-i440fx-rhel7.3.0">hvm</type><smbios mode="sysinfo"/></os><metadata><ovirt-tune:qos/><ovirt-vm:vm><minGuaranteedMemoryMb type="int">6056</minGuaranteedMemoryMb><clusterVersion>4.2</clusterVersion><ovirt-vm: custom/><ovirt-vm:device mac_address="00:16:3e:2e:1d:8c"><ovirt-vm:custom/></ovirt-vm:device><ovirt-vm:device devtype="disk" name="vda"><ovirt-vm:poolID>00000000-0000-0000-0000-000000000000</ovirt-vm:poolID><ovirt-vm:volumeID>2ca51d06-0424-4aa0-8f1c-6c5417712c14</ovirt-vm:volumeID><ovirt-vm:shared>exclusive</ovirt-vm:shared><ovirt-vm:imageID>5f6b263c-3ce8-4964-ac7c-ea47c49242e9</ovirt-vm:imageID><ovirt-vm:domainID>89fcd80a-0840-4877-8abb-3a4c0432f36e</ovirt-vm:domainID></ovirt-vm:device><launchPaused>false</launchPaused><resumeBehavior>auto_resume</resumeBehavior></ovirt-vm:vm></metadata></domain>', 'smpCoresPerSocket': '4', 'kvmEnable': 'true', 'bootMenuEnable': 'false', 'devices': [], 'custom': {}, 'maxVCpus': '64', 'clientIp': '', 'statusTime': '4301156420', 'vmName': 'HostedEngine', 'maxMemSlots': 16}} from=::1,51348, vmId=0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (api:52) 2019-03-18 10:12:01,292-0400 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call VM.create succeeded in 0.01 seconds (__init__:573) 2019-03-18 10:12:01,293-0400 INFO (vm/0c3e1c08) [virt.vm] (vmId='0c3e1c08-3928-47f1-96a8-c6a8d0dc3241') VM wrapper has started (vm:2789) 2019-03-18 10:12:01,317-0400 INFO (vm/0c3e1c08) [vdsm.api] START getVolumeSize(sdUUID='89fcd80a-0840-4877-8abb-3a4c0432f36e', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='5f6b263c-3ce8-4964-ac7c-ea47c49242e9', volUUID='2ca51d06-0424-4aa0-8f1c-6c5417712c14', options=None) from=internal, task_id=76ba7024-c78e-4b0b-aa54-e623d969c5b9 (api:46) 2019-03-18 10:12:01,319-0400 INFO (vm/0c3e1c08) [vdsm.api] FINISH getVolumeSize return={'truesize': '8700542976', 'apparentsize': '62277025792'} from=internal, task_id=76ba7024-c78e-4b0b-aa54-e623d969c5b9 (api:52) 2019-03-18 10:12:01,319-0400 INFO (vm/0c3e1c08) [vds] prepared volume path: (clientIF:497) 2019-03-18 10:12:01,319-0400 INFO (vm/0c3e1c08) [vdsm.api] START prepareImage(sdUUID='89fcd80a-0840-4877-8abb-3a4c0432f36e', spUUID='00000000-0000-0000-0000-000000000000', imgUUID='5f6b263c-3ce8-4964-ac7c-ea47c49242e9', leafUUID='2ca51d06-0424-4aa0-8f1c-6c5417712c14', allowIllegal=False) from=internal, task_id=b67f7f2d-14e4-46e0-a39a-c0f039265590 (api:46) 2019-03-18 10:12:01,325-0400 INFO (vm/0c3e1c08) [storage.StorageDomain] Fixing permissions on /rhev/data-center/mnt/192.168.14.161:_nfsnode1/89fcd80a-0840-4877-8abb-3a4c0432f36e/images/5f6b263c-3ce8-4964-ac7c-ea47c49242e9/2ca51d06-0424-4aa0-8f1c-6c5417712c14 (fileSD:623) 2019-03-18 10:12:01,326-0400 INFO (vm/0c3e1c08) [storage.StorageDomain] Creating domain run directory u'/var/run/vdsm/storage/89fcd80a-0840-4877-8abb-3a4c0432f36e' (fileSD:577) 2019-03-18 10:12:01,326-0400 INFO (vm/0c3e1c08) [storage.fileUtils] Creating directory: /var/run/vdsm/storage/89fcd80a-0840-4877-8abb-3a4c0432f36e mode: None (fileUtils:197) 2019-03-18 10:12:01,326-0400 INFO (vm/0c3e1c08) [storage.StorageDomain] Creating symlink from /rhev/data-center/mnt/192.168.14.161:_nfsnode1/89fcd80a-0840-4877-8abb-3a4c0432f36e/images/5f6b263c-3ce8-4964-ac7c-ea47c49242e9 to /var/run/vdsm/storage/89fcd80a-0840-4877-8abb-3a4c0432f36e/5f6b263c-3ce8-4964-ac7c-ea47c49242e9 (fileSD:580) 2019-03-18 10:12:01,329-0400 INFO (vm/0c3e1c08) [vdsm.api] FINISH prepareImage return={'info': {'path': u'/rhev/data-center/mnt/192.168.14.161:_nfsnode1/89fcd80a-0840-4877-8abb-3a4c0432f36e/images/5f6b263c-3ce8-4964-ac7c-ea47c49242e9/2ca51d06-0424-4aa0-8f1c-6c5417712c14', 'type': 'file'}, 'path': u'/var/run/vdsm/storage/89fcd80a-0840-4877-8abb-3a4c0432f36e/5f6b263c-3ce8-4964-ac7c-ea47c49242e9/2ca51d06-0424-4aa0-8f1c-6c5417712c14', 'imgVolumesInfo': [{'domainID': '89fcd80a-0840-4877-8abb-3a4c0432f36e', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/192.168.14.161:_nfsnode1/89fcd80a-0840-4877-8abb-3a4c0432f36e/images/5f6b263c-3ce8-4964-ac7c-ea47c49242e9/2ca51d06-0424-4aa0-8f1c-6c5417712c14', 'volumeID': u'2ca51d06-0424-4aa0-8f1c-6c5417712c14', 'leasePath': u'/rhev/data-center/mnt/192.168.14.161:_nfsnode1/89fcd80a-0840-4877-8abb-3a4c0432f36e/images/5f6b263c-3ce8-4964-ac7c-ea47c49242e9/2ca51d06-0424-4aa0-8f1c-6c5417712c14.lease', 'imageID': '5f6b263c-3ce8-4964-ac7c-ea47c49242e9'}]} f rom=internal, task_id=b67f7f2d-14e4-46e0-a39a-c0f039265590 (api:52) 2019-03-18 10:12:01,329-0400 INFO (vm/0c3e1c08) [vds] prepared volume path: /var/run/vdsm/storage/89fcd80a-0840-4877-8abb-3a4c0432f36e/5f6b263c-3ce8-4964-ac7c-ea47c49242e9/2ca51d06-0424-4aa0-8f1c-6c5417712c14 (clientIF:497) 2019-03-18 10:12:01,329-0400 INFO (vm/0c3e1c08) [virt.vm] (vmId='0c3e1c08-3928-47f1-96a8-c6a8d0dc3241') Enabling drive monitoring (drivemonitor:54) 2019-03-18 10:12:01,331-0400 ERROR (vm/0c3e1c08) [virt.vm] (vmId='0c3e1c08-3928-47f1-96a8-c6a8d0dc3241') Failed to setup device vnc (vm:2633) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 2630, in _setup_devices dev_object.setup() File "/usr/lib/python2.7/site-packages/vdsm/virt/vmdevices/graphics.py", line 91, in setup displaynetwork.create_network(display_network, self.vmid) File "/usr/lib/python2.7/site-packages/vdsm/virt/displaynetwork.py", line 26, in create_network display_device = _display_device(netname) File "/usr/lib/python2.7/site-packages/vdsm/virt/displaynetwork.py", line 35, in _display_device return net_api.network_northbound(netname) File "/usr/lib/python2.7/site-packages/vdsm/network/api.py", line 100, in network_northbound return netswitch.configurator.net2northbound(network_name) File "/usr/lib/python2.7/site-packages/vdsm/network/netswitch/configurator.py", line 440, in net2northbound is_legacy = net_attr['switch'] == legacy_switch.SWITCH_TYPE TypeError: 'NoneType' object has no attribute '__getitem__' 2019-03-18 10:12:01,331-0400 ERROR (vm/0c3e1c08) [virt.vm] (vmId='0c3e1c08-3928-47f1-96a8-c6a8d0dc3241') The vm start process failed (vm:948) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 877, in _startUnderlyingVm self._run() File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 2811, in _run self._setup_devices() File "/usr/lib/python2.7/site-packages/vdsm/virt/vm.py", line 2630, in _setup_devices dev_object.setup() File "/usr/lib/python2.7/site-packages/vdsm/virt/vmdevices/graphics.py", line 91, in setup displaynetwork.create_network(display_network, self.vmid) File "/usr/lib/python2.7/site-packages/vdsm/virt/displaynetwork.py", line 26, in create_network display_device = _display_device(netname) File "/usr/lib/python2.7/site-packages/vdsm/virt/displaynetwork.py", line 35, in _display_device return net_api.network_northbound(netname) File "/usr/lib/python2.7/site-packages/vdsm/network/api.py", line 100, in network_northbound return netswitch.configurator.net2northbound(network_name) File "/usr/lib/python2.7/site-packages/vdsm/network/netswitch/configurator.py", line 440, in net2northbound is_legacy = net_attr['switch'] == legacy_switch.SWITCH_TYPE TypeError: 'NoneType' object has no attribute '__getitem__' 2019-03-18 10:12:01,332-0400 INFO (vm/0c3e1c08) [virt.vm] (vmId='0c3e1c08-3928-47f1-96a8-c6a8d0dc3241') Changed state to Down: 'NoneType' object has no attribute '__getitem__' (code=1) (vm:1693) 2019-03-18 10:12:01,346-0400 INFO (vm/0c3e1c08) [virt.vm] (vmId='0c3e1c08-3928-47f1-96a8-c6a8d0dc3241') Stopping connection (guestagent:442) 2019-03-18 10:12:02,488-0400 INFO (periodic/0) [vdsm.api] START repoStats(domains=()) from=internal, task_id=8e834d63-ffdb-45a2-a2ba-f7fd619fb71c (api:46) 2019-03-18 10:12:02,488-0400 INFO (periodic/0) [vdsm.api] FINISH repoStats return={u'89fcd80a-0840-4877-8abb-3a4c0432f36e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000320206', 'lastCheck': '3.1', 'valid': True}} from=internal, task_id=8e834d63-ffdb-45a2-a2ba-f7fd619fb71c (api:52) 2019-03-18 10:12:02,488-0400 INFO (periodic/0) [vdsm.api] START multipath_health() from=internal, task_id=9f5ea117-ee64-41cf-a3f3-174a130f42e7 (api:46) 2019-03-18 10:12:02,488-0400 INFO (periodic/0) [vdsm.api] FINISH multipath_health return={} from=internal, task_id=9f5ea117-ee64-41cf-a3f3-174a130f42e7 (api:52) 2019-03-18 10:12:03,385-0400 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:03,388-0400 INFO (jsonrpc/1) [api.host] START getStats() from=::1,47126 (api:46) 2019-03-18 10:12:03,389-0400 INFO (jsonrpc/1) [vdsm.api] START repoStats(domains=()) from=::1,47126, task_id=5721089a-c442-4989-abcd-093e541f1090 (api:46) 2019-03-18 10:12:03,389-0400 INFO (jsonrpc/1) [vdsm.api] FINISH repoStats return={u'89fcd80a-0840-4877-8abb-3a4c0432f36e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000320206', 'lastCheck': '4.0', 'valid': True}} from=::1,47126, task_id=5721089a-c442-4989-abcd-093e541f1090 (api:52) 2019-03-18 10:12:03,389-0400 INFO (jsonrpc/1) [vdsm.api] START multipath_health() from=::1,47126, task_id=7be1431f-6be8-4f13-8f9f-97733708bc1b (api:46) 2019-03-18 10:12:03,389-0400 INFO (jsonrpc/1) [vdsm.api] FINISH multipath_health return={} from=::1,47126, task_id=7be1431f-6be8-4f13-8f9f-97733708bc1b (api:52) 2019-03-18 10:12:03,394-0400 INFO (jsonrpc/1) [api.host] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'info': {'cpuStatistics': {'1': {'cpuUser': '3.13', 'nodeIndex': 0, 'cpuSys': '1.27', 'cpuIdle': '95.60'}, '0': {'cpuUser': '4.40', 'nodeIndex': 0, 'cpuSys': '0.87', 'cpuIdle': '94.73'}, '3': {'cpuUser': '4.06', 'nodeIndex': 0, 'cpuSys': '1.00', 'cpuIdle': '94.94'}, '2': {'cpuUser': '5.93', 'nodeIndex': 0, 'cpuSys': '1.07', 'cpuIdle': '93.00'}}, 'numaNodeMemFree': {'0': {'memPercent': 8, 'memFree': '14654'}}, 'memShared': 0, 'haScore': 3400, 'thpState': 'always', 'ksmMergeAcrossNodes': True, 'vmCount': 1, 'memUsed': '5', 'storageDomains': {u'89fcd80a-0840-4877-8abb-3a4c0432f36e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000320206', 'lastCheck': '4.0', 'valid': True}}, 'incomingVmMigrations': 0, 'network': {'ovirtmgmt': {'txErrors': '0', 'state': 'up', 'sampleTime': 1552918322.481056, 'name': 'ovirtmgmt', 'tx': '24187550', 'txDroppe d': '0', 'rx': '3148829', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '6'}, 'lo': {'txErrors': '0', 'state': 'up', 'sampleTime': 1552918322.481056, 'name': 'lo', 'tx': '1146067437', 'txDropped': '0', 'rx': '1146067437', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovs-system': {'txErrors': '0', 'state': 'down', 'sampleTime': 1552918322.481056, 'name': 'ovs-system', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, ';vdsmdummy;': {'txErrors': '0', 'state': 'down', 'sampleTime': 1552918322.481056, 'name': ';vdsmdummy;', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'br-int': {'txErrors': '0', 'state': 'down', 'sampleTime': 1552918322.481056, 'name': 'br-int', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'genev_sys_6081': {'txErrors': '8', 'state': 'up', 'sampleTime': 1552918322.481056, 'name': 'genev_sys_6081', 'tx': '0', 'txDropped': '0 ', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'enp1s0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1552918322.481056, 'name': 'enp1s0', 'tx': '24254964', 'txDropped': '0', 'rx': '3896498', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}}, 'txDropped': '0', 'anonHugePages': '92', 'ksmPages': 100, 'elapsedTime': '6471.23', 'cpuLoad': '0.04', 'cpuSys': '1.05', 'diskStats': {'/var/log': {'free': '7195'}, '/var/run/vdsm/': {'free': '7871'}, '/tmp': {'free': '906'}}, 'cpuUserVdsmd': '0.87', 'netConfigDirty': 'False', 'memCommitted': 4121, 'ksmState': False, 'vmMigrating': 0, 'ksmCpu': 0, 'memAvailable': 10733, 'bootTime': '1552911832', 'haStats': {'active': True, 'configured': True, 'score': 3400, 'localMaintenance': False, 'globalMaintenance': True}, 'momStatus': 'active', 'multipathHealth': {}, 'rxDropped': '6', 'outgoingVmMigrations': 0, 'swapTotal': 7999, 'swapFree': 7999, 'hugepages': defaultdict(<type 'dict'>, {1048576: {'resv_hugepages': 0, 'free_hugepa ges': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}, 2048: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}}), 'dateTime': '2019-03-18T14:12:03 GMT', 'cpuUser': '4.40', 'memFree': 15110, 'cpuIdle': '94.55', 'vmActive': 0, 'v2vJobs': {}, 'cpuSysVdsmd': '0.47'}} from=::1,47126 (api:52) 2019-03-18 10:12:03,395-0400 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:573) 2019-03-18 10:12:05,644-0400 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:05,698-0400 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:05,702-0400 INFO (jsonrpc/7) [vdsm.api] START repoStats(domains=[u'89fcd80a-0840-4877-8abb-3a4c0432f36e']) from=::1,47126, task_id=93faad77-468b-4087-9f00-3a00b3e4950c (api:46) 2019-03-18 10:12:05,702-0400 INFO (jsonrpc/7) [vdsm.api] FINISH repoStats return={u'89fcd80a-0840-4877-8abb-3a4c0432f36e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.00033028', 'lastCheck': '0.6', 'valid': True}} from=::1,47126, task_id=93faad77-468b-4087-9f00-3a00b3e4950c (api:52) 2019-03-18 10:12:05,702-0400 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:05,706-0400 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:08,237-0400 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:08,240-0400 INFO (jsonrpc/0) [api.virt] START getStats() from=::1,47126, vmId=0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (api:46) 2019-03-18 10:12:08,241-0400 INFO (jsonrpc/0) [api.virt] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Down', 'exitMessage': "'NoneType' object has no attribute '__getitem__'", 'statusTime': '4301163380', 'vmId': '0c3e1c08-3928-47f1-96a8-c6a8d0dc3241', 'exitReason': 1, 'exitCode': 1}]} from=::1,47126, vmId=0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (api:52) 2019-03-18 10:12:08,241-0400 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call VM.getStats succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:08,295-0400 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:08,298-0400 INFO (jsonrpc/1) [vdsm.api] START repoStats(domains=[u'89fcd80a-0840-4877-8abb-3a4c0432f36e']) from=::1,47126, task_id=68b1b201-fbc4-412b-889b-efcb53676bc4 (api:46) 2019-03-18 10:12:08,298-0400 INFO (jsonrpc/1) [vdsm.api] FINISH repoStats return={u'89fcd80a-0840-4877-8abb-3a4c0432f36e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.00033028', 'lastCheck': '3.2', 'valid': True}} from=::1,47126, task_id=68b1b201-fbc4-412b-889b-efcb53676bc4 (api:52) 2019-03-18 10:12:08,298-0400 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:09,049-0400 INFO (jsonrpc/2) [api.host] START getAllVmStats() from=::1,47130 (api:46) 2019-03-18 10:12:09,050-0400 INFO (jsonrpc/2) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::1,47130 (api:52) 2019-03-18 10:12:09,050-0400 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.01 seconds (__init__:573) 2019-03-18 10:12:10,901-0400 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:10,904-0400 INFO (jsonrpc/7) [api.host] START getCapabilities() from=::1,47126 (api:46) 2019-03-18 10:12:11,202-0400 INFO (jsonrpc/7) [root] /usr/libexec/vdsm/hooks/after_get_caps/50_openstacknet: rc=0 err= (hooks:110) 2019-03-18 10:12:11,370-0400 INFO (jsonrpc/7) [root] /usr/libexec/vdsm/hooks/after_get_caps/openstacknet_utils.py: rc=0 err= (hooks:110) 2019-03-18 10:12:11,544-0400 INFO (jsonrpc/7) [root] /usr/libexec/vdsm/hooks/after_get_caps/ovirt_provider_ovn_hook: rc=0 err= (hooks:110) 2019-03-18 10:12:11,544-0400 INFO (jsonrpc/7) [api.host] FINISH getCapabilities return={'status': {'message': 'Done', 'code': 0}, 'info': {u'HBAInventory': {u'iSCSI': [{u'InitiatorName': u'iqn.1994-05.com.redhat:1612863cd006'}], u'FC': []}, u'packages2': {u'kernel': {u'release': u'862.14.4.el7.x86_64', u'version': u'3.10.0'}, u'glusterfs-rdma': {u'release': u'1.el7', u'version': u'3.12.15'}, u'glusterfs-fuse': {u'release': u'1.el7', u'version': u'3.12.15'}, u'spice-server': {u'release': u'2.el7_5.5', u'version': u'0.14.0'}, u'librbd1': {u'release': u'2.el7', u'version': u'0.94.5'}, u'vdsm': {u'release': u'1.el7', u'version': u'4.20.43'}, u'qemu-kvm': {u'release': u'21.el7_5.7.1', u'version': u'2.10.0'}, u'openvswitch': {u'release': u'4.el7', u'version': u'2.9.0'}, u'libvirt': {u'release': u'14.el7_5.8', u'version': u'3.9.0'}, u'ovirt-hosted-engine-ha': {u'release': u'1.el7', u'version': u'2.2.18'}, u'qemu-img': {u'release': u'21.el7_5.7.1', u'version': u'2.10.0'}, u'mom': {u'release ': u'1.el7.centos', u'version': u'0.5.12'}, u'glusterfs': {u'release': u'1.el7', u'version': u'3.12.15'}, u'glusterfs-cli': {u'release': u'1.el7', u'version': u'3.12.15'}, u'glusterfs-server': {u'release': u'1.el7', u'version': u'3.12.15'}, u'glusterfs-geo-replication': {u'release': u'1.el7', u'version': u'3.12.15'}}, u'numaNodeDistance': {u'0': [10]}, u'cpuModel': u'Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz', u'nestedVirtualization': False, u'liveMerge': u'true', u'hooks': {u'before_vm_start': {u'50_hostedengine': {u'md5': u'95c810cdcfe4195302a59574a5148289'}, u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_network_setup': {u'30_ethtool_options': {u'md5': u'f04c2ca5dce40663e2ed69806eea917c'}}, u'after_vm_destroy': {u'delete_vhostuserclient_hook': {u'md5': u'c2f279cc9483a3f842f6c29df13994c1'}, u'50_vhostmd': {u'md5': u'bdf4802c0521cf1bae08f2b90a9559cf'}}, u'after_vm_start': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstack net': {u'md5': u'ea0a5a715da8c1badbcda28e8b8fa00e'}}, u'after_device_migrate_destination': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_network_setup': {u'50_fcoe': {u'md5': u'28c352339c8beef1e1b05c67d106d062'}}, u'before_device_create': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'a8af653b7386c138b2e6e9738bd6b62c'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'73822988042847bab1ea832a6b9fa837'}}, u'before_nic_hotplug': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'a8af653b7 386c138b2e6e9738bd6b62c'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'73822988042847bab1ea832a6b9fa837'}}, u'before_vm_migrate_destination': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_nic_hotplug': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_vm_dehibernate': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_get_caps': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0e00c63ab44a952e722209ea31fd7a71'}, u'ovirt_provider_ovn_hook': {u'md5': u'4c4b1d2d5460e6a65114ae36cb775df6'}}, u'before_device_migrate_destination': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}}, u'after_device_create': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}}, u'supportsIPv6': True, u'realtimeKer nel': False, u'vmTypes': [u'kvm'], u'liveSnapshot': u'true', u'cpuThreads': u'4', u'kdumpStatus': 0, u'networks': {}, u'kernelArgs': u'BOOT_IMAGE=/ovirt-node-ng-4.2.7.1-0.20181114.0+1/vmlinuz-3.10.0-862.14.4.el7.x86_64 root=/dev/onn/ovirt-node-ng-4.2.7.1-0.20181114.0+1 ro crashkernel=auto rd.lvm.lv=onn/ovirt-node-ng-4.2.7.1-0.20181114.0+1 rd.lvm.lv=onn/swap rhgb quiet LANG=en_US.UTF-8 img.bootid=ovirt-node-ng-4.2.7.1-0.20181114.0+1', u'bridges': {u'ovirtmgmt': {u'ipv6autoconf': True, u'addr': u'192.168.14.161', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'192.168.14.161/24'], u'ipv6gateway': u'::', u'gateway': u'192.168.14.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3 125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.00e04c680408', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'3556', u'root_id': u'8000.00e04c680408', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'0'}, u'ports': [u'enp1s0']}}, u'uuid': u'03000200-0400-0500-0006-000700080009', u'onlineCpus': u'0,1,2,3', u'nameservers': [u'192.168.10.3'], u'nics': {u'enp1s0': {u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'00:e0:4c:68:04:08', u'ipv6gateway': u'::', u'gateway': u''}}, u'software_revision': u'1', u'hostdevPassthrough': u'false', u'clusterLevels': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,art,arch_perfmon,pebs,bts,rep_good,nopl,xtopology,nonstop_tsc,aperfmperf,eagerfpu,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,est,tm2,ssse3,sdbg,fma,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,aes,xsave,avx,f16c,rdrand,lahf_lm,abm,3dnowprefetch,epb ,intel_pt,ssbd,ibrs,ibpb,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,tsc_adjust,bmi1,avx2,smep,bmi2,erms,invpcid,mpx,rdseed,adx,smap,clflushopt,xsaveopt,xsavec,xgetbv1,dtherm,ida,arat,pln,pts,hwp,hwp_notify,hwp_act_window,hwp_epp,model_n270,model_coreduo,model_SandyBridge-IBRS,model_Nehalem,model_Haswell-noTSX,model_Westmere-IBRS,model_Broadwell-noTSX,model_Haswell-noTSX-IBRS,model_Nehalem-IBRS,model_core2duo,model_IvyBridge,model_Penryn,model_IvyBridge-IBRS,model_Westmere,model_Broadwell-noTSX-IBRS,model_SandyBridge,model_Conroe', u'kernelFeatures': {u'RETP': 0, u'IBRS': 1, u'PTI': 1}, u'ISCSIInitiatorName': u'iqn.1994-05.com.redhat:1612863cd006', u'netConfigDirty': u'False', u'selinux': {u'mode': u'1'}, u'autoNumaBalancing': 0, u'reservedMem': u'321', u'containers': False, u'bondings': {}, u'software_version': u'4.20', u'supportedENGINEs': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuSpeed': u'3099.957', u'numaNodes': {u'0': {u'totalMemory': u'15794', u'cpus': [0, 1, 2, 3]}}, u'cpuSo ckets': u'1', u'vlans': {}, u'version_name': u'Snow Man', 'lastClientIface': 'lo', u'cpuCores': u'2', u'hostedEngineDeployed': True, u'hugepages': [1048576, 2048], u'guestOverhead': u'65', u'additionalFeatures': [u'libgfapi_supported', u'GLUSTER_SNAPSHOT', u'GLUSTER_GEO_REPLICATION', u'GLUSTER_BRICK_MANAGEMENT'], u'openstack_binding_host_ids': {u'OVIRT_PROVIDER_OVN': u'ed35b4f0-8c54-4262-b2a4-1f2cdc7c7ddf'}, u'kvmEnabled': u'true', u'memSize': u'15794', u'emulatedMachines': [u'pc-i440fx-rhel7.1.0', u'pc-q35-rhel7.3.0', u'rhel6.3.0', u'pc-i440fx-rhel7.5.0', u'pc-i440fx-rhel7.0.0', u'rhel6.1.0', u'pc-i440fx-rhel7.4.0', u'rhel6.6.0', u'pc-q35-rhel7.5.0', u'rhel6.2.0', u'pc', u'pc-i440fx-rhel7.3.0', u'q35', u'pc-i440fx-rhel7.2.0', u'rhel6.4.0', u'pc-q35-rhel7.4.0', u'rhel6.0.0', u'rhel6.5.0'], u'rngSources': [u'hwrng', u'random'], u'operatingSystem': {u'release': u'5.1804.5.el7.centos', u'pretty_name': u'oVirt Node 4.2.7.1', u'version': u'7', u'name': u'RHEL'}}} from=::1,47126 (api:52) 2019-03-18 10:12:11,549-0400 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 0.64 seconds (__init__:573) 2019-03-18 10:12:13,409-0400 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:13,412-0400 INFO (jsonrpc/5) [api.host] START getStats() from=::1,47126 (api:46) 2019-03-18 10:12:13,412-0400 INFO (jsonrpc/5) [vdsm.api] START repoStats(domains=()) from=::1,47126, task_id=ec9339ea-c895-487b-93b2-6fad1a952df2 (api:46) 2019-03-18 10:12:13,412-0400 INFO (jsonrpc/5) [vdsm.api] FINISH repoStats return={u'89fcd80a-0840-4877-8abb-3a4c0432f36e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.00033028', 'lastCheck': '4.0', 'valid': True}} from=::1,47126, task_id=ec9339ea-c895-487b-93b2-6fad1a952df2 (api:52) 2019-03-18 10:12:13,412-0400 INFO (jsonrpc/5) [vdsm.api] START multipath_health() from=::1,47126, task_id=34d462f8-f7fe-423e-963a-9763ef1ca783 (api:46) 2019-03-18 10:12:13,413-0400 INFO (jsonrpc/5) [vdsm.api] FINISH multipath_health return={} from=::1,47126, task_id=34d462f8-f7fe-423e-963a-9763ef1ca783 (api:52) 2019-03-18 10:12:13,419-0400 INFO (jsonrpc/5) [api.host] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'info': {'cpuStatistics': {'1': {'cpuUser': '3.13', 'nodeIndex': 0, 'cpuSys': '1.27', 'cpuIdle': '95.60'}, '0': {'cpuUser': '4.40', 'nodeIndex': 0, 'cpuSys': '0.87', 'cpuIdle': '94.73'}, '3': {'cpuUser': '4.06', 'nodeIndex': 0, 'cpuSys': '1.00', 'cpuIdle': '94.94'}, '2': {'cpuUser': '5.93', 'nodeIndex': 0, 'cpuSys': '1.07', 'cpuIdle': '93.00'}}, 'numaNodeMemFree': {'0': {'memPercent': 8, 'memFree': '14654'}}, 'memShared': 0, 'haScore': 3400, 'thpState': 'always', 'ksmMergeAcrossNodes': True, 'vmCount': 1, 'memUsed': '5', 'storageDomains': {u'89fcd80a-0840-4877-8abb-3a4c0432f36e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.00033028', 'lastCheck': '4.0', 'valid': True}}, 'incomingVmMigrations': 0, 'network': {'ovirtmgmt': {'txErrors': '0', 'state': 'up', 'sampleTime': 1552918322.481056, 'name': 'ovirtmgmt', 'tx': '24187550', 'txDropped ': '0', 'rx': '3148829', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '6'}, 'lo': {'txErrors': '0', 'state': 'up', 'sampleTime': 1552918322.481056, 'name': 'lo', 'tx': '1146067437', 'txDropped': '0', 'rx': '1146067437', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovs-system': {'txErrors': '0', 'state': 'down', 'sampleTime': 1552918322.481056, 'name': 'ovs-system', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, ';vdsmdummy;': {'txErrors': '0', 'state': 'down', 'sampleTime': 1552918322.481056, 'name': ';vdsmdummy;', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'br-int': {'txErrors': '0', 'state': 'down', 'sampleTime': 1552918322.481056, 'name': 'br-int', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'genev_sys_6081': {'txErrors': '8', 'state': 'up', 'sampleTime': 1552918322.481056, 'name': 'genev_sys_6081', 'tx': '0', 'txDropped': '0' , 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'enp1s0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1552918322.481056, 'name': 'enp1s0', 'tx': '24254964', 'txDropped': '0', 'rx': '3896498', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}}, 'txDropped': '0', 'anonHugePages': '92', 'ksmPages': 100, 'elapsedTime': '6481.26', 'cpuLoad': '0.04', 'cpuSys': '1.05', 'diskStats': {'/var/log': {'free': '7195'}, '/var/run/vdsm/': {'free': '7871'}, '/tmp': {'free': '906'}}, 'cpuUserVdsmd': '0.87', 'netConfigDirty': 'False', 'memCommitted': 4121, 'ksmState': False, 'vmMigrating': 0, 'ksmCpu': 0, 'memAvailable': 10733, 'bootTime': '1552911832', 'haStats': {'active': True, 'configured': True, 'score': 3400, 'localMaintenance': False, 'globalMaintenance': True}, 'momStatus': 'active', 'multipathHealth': {}, 'rxDropped': '6', 'outgoingVmMigrations': 0, 'swapTotal': 7999, 'swapFree': 7999, 'hugepages': defaultdict(<type 'dict'>, {1048576: {'resv_hugepages': 0, 'free_hugepag es': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}, 2048: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}}), 'dateTime': '2019-03-18T14:12:13 GMT', 'cpuUser': '4.40', 'memFree': 15110, 'cpuIdle': '94.55', 'vmActive': 0, 'v2vJobs': {}, 'cpuSysVdsmd': '0.47'}} from=::1,47126 (api:52) 2019-03-18 10:12:13,420-0400 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:573) 2019-03-18 10:12:15,774-0400 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:15,828-0400 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:15,832-0400 INFO (jsonrpc/1) [vdsm.api] START repoStats(domains=[u'89fcd80a-0840-4877-8abb-3a4c0432f36e']) from=::1,47126, task_id=d5da1c48-166b-49b0-88a0-dca9aef704eb (api:46) 2019-03-18 10:12:15,832-0400 INFO (jsonrpc/1) [vdsm.api] FINISH repoStats return={u'89fcd80a-0840-4877-8abb-3a4c0432f36e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000336763', 'lastCheck': '0.7', 'valid': True}} from=::1,47126, task_id=d5da1c48-166b-49b0-88a0-dca9aef704eb (api:52) 2019-03-18 10:12:15,833-0400 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:15,837-0400 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:17,499-0400 INFO (periodic/3) [vdsm.api] START repoStats(domains=()) from=internal, task_id=ee5dbdcd-d285-4071-a0a1-c1e693e4f6de (api:46) 2019-03-18 10:12:17,499-0400 INFO (periodic/3) [vdsm.api] FINISH repoStats return={u'89fcd80a-0840-4877-8abb-3a4c0432f36e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000336763', 'lastCheck': '2.4', 'valid': True}} from=internal, task_id=ee5dbdcd-d285-4071-a0a1-c1e693e4f6de (api:52) 2019-03-18 10:12:17,500-0400 INFO (periodic/3) [vdsm.api] START multipath_health() from=internal, task_id=d99869b4-3fe5-41d3-953a-179abd7a269f (api:46) 2019-03-18 10:12:17,500-0400 INFO (periodic/3) [vdsm.api] FINISH multipath_health return={} from=internal, task_id=d99869b4-3fe5-41d3-953a-179abd7a269f (api:52) 2019-03-18 10:12:18,255-0400 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:18,258-0400 INFO (jsonrpc/7) [api.virt] START getStats() from=::1,47126, vmId=0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (api:46) 2019-03-18 10:12:18,258-0400 INFO (jsonrpc/7) [api.virt] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Down', 'exitMessage': "'NoneType' object has no attribute '__getitem__'", 'statusTime': '4301173390', 'vmId': '0c3e1c08-3928-47f1-96a8-c6a8d0dc3241', 'exitReason': 1, 'exitCode': 1}]} from=::1,47126, vmId=0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (api:52) 2019-03-18 10:12:18,258-0400 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call VM.getStats succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:18,312-0400 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:18,315-0400 INFO (jsonrpc/5) [vdsm.api] START repoStats(domains=[u'89fcd80a-0840-4877-8abb-3a4c0432f36e']) from=::1,47126, task_id=42c45fe4-c675-4c7c-a283-41a5345afe3e (api:46) 2019-03-18 10:12:18,315-0400 INFO (jsonrpc/5) [vdsm.api] FINISH repoStats return={u'89fcd80a-0840-4877-8abb-3a4c0432f36e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000336763', 'lastCheck': '3.2', 'valid': True}} from=::1,47126, task_id=42c45fe4-c675-4c7c-a283-41a5345afe3e (api:52) 2019-03-18 10:12:18,315-0400 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:20,579-0400 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:20,582-0400 INFO (jsonrpc/4) [api.host] START getCapabilities() from=::1,47126 (api:46) 2019-03-18 10:12:20,877-0400 INFO (jsonrpc/4) [root] /usr/libexec/vdsm/hooks/after_get_caps/50_openstacknet: rc=0 err= (hooks:110) 2019-03-18 10:12:21,044-0400 INFO (jsonrpc/4) [root] /usr/libexec/vdsm/hooks/after_get_caps/openstacknet_utils.py: rc=0 err= (hooks:110) 2019-03-18 10:12:21,218-0400 INFO (jsonrpc/4) [root] /usr/libexec/vdsm/hooks/after_get_caps/ovirt_provider_ovn_hook: rc=0 err= (hooks:110) 2019-03-18 10:12:21,219-0400 INFO (jsonrpc/4) [api.host] FINISH getCapabilities return={'status': {'message': 'Done', 'code': 0}, 'info': {u'HBAInventory': {u'iSCSI': [{u'InitiatorName': u'iqn.1994-05.com.redhat:1612863cd006'}], u'FC': []}, u'packages2': {u'kernel': {u'release': u'862.14.4.el7.x86_64', u'version': u'3.10.0'}, u'glusterfs-rdma': {u'release': u'1.el7', u'version': u'3.12.15'}, u'glusterfs-fuse': {u'release': u'1.el7', u'version': u'3.12.15'}, u'spice-server': {u'release': u'2.el7_5.5', u'version': u'0.14.0'}, u'librbd1': {u'release': u'2.el7', u'version': u'0.94.5'}, u'vdsm': {u'release': u'1.el7', u'version': u'4.20.43'}, u'qemu-kvm': {u'release': u'21.el7_5.7.1', u'version': u'2.10.0'}, u'openvswitch': {u'release': u'4.el7', u'version': u'2.9.0'}, u'libvirt': {u'release': u'14.el7_5.8', u'version': u'3.9.0'}, u'ovirt-hosted-engine-ha': {u'release': u'1.el7', u'version': u'2.2.18'}, u'qemu-img': {u'release': u'21.el7_5.7.1', u'version': u'2.10.0'}, u'mom': {u'release ': u'1.el7.centos', u'version': u'0.5.12'}, u'glusterfs': {u'release': u'1.el7', u'version': u'3.12.15'}, u'glusterfs-cli': {u'release': u'1.el7', u'version': u'3.12.15'}, u'glusterfs-server': {u'release': u'1.el7', u'version': u'3.12.15'}, u'glusterfs-geo-replication': {u'release': u'1.el7', u'version': u'3.12.15'}}, u'numaNodeDistance': {u'0': [10]}, u'cpuModel': u'Intel(R) Core(TM) i5-7200U CPU @ 2.50GHz', u'nestedVirtualization': False, u'liveMerge': u'true', u'hooks': {u'before_vm_start': {u'50_hostedengine': {u'md5': u'95c810cdcfe4195302a59574a5148289'}, u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_network_setup': {u'30_ethtool_options': {u'md5': u'f04c2ca5dce40663e2ed69806eea917c'}}, u'after_vm_destroy': {u'delete_vhostuserclient_hook': {u'md5': u'c2f279cc9483a3f842f6c29df13994c1'}, u'50_vhostmd': {u'md5': u'bdf4802c0521cf1bae08f2b90a9559cf'}}, u'after_vm_start': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstack net': {u'md5': u'ea0a5a715da8c1badbcda28e8b8fa00e'}}, u'after_device_migrate_destination': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_network_setup': {u'50_fcoe': {u'md5': u'28c352339c8beef1e1b05c67d106d062'}}, u'before_device_create': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'a8af653b7386c138b2e6e9738bd6b62c'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'73822988042847bab1ea832a6b9fa837'}}, u'before_nic_hotplug': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}, u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0438de5ff9b6bf8d3160804ff71bf827'}, u'20_ovirt_provider_ovn_vhostuser_hook': {u'md5': u'a8af653b7 386c138b2e6e9738bd6b62c'}, u'10_ovirt_provider_ovn_hook': {u'md5': u'73822988042847bab1ea832a6b9fa837'}}, u'before_vm_migrate_destination': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_nic_hotplug': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}, u'before_vm_dehibernate': {u'50_vhostmd': {u'md5': u'9206bc390bcbf208b06a8e899581be2d'}}, u'after_get_caps': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'0e00c63ab44a952e722209ea31fd7a71'}, u'ovirt_provider_ovn_hook': {u'md5': u'4c4b1d2d5460e6a65114ae36cb775df6'}}, u'before_device_migrate_destination': {u'50_vmfex': {u'md5': u'49caba1a5faadd8efacef966f79bc30a'}}, u'after_device_create': {u'openstacknet_utils.py': {u'md5': u'640ef8b473cbc16b102c5ebf57ea533f'}, u'50_openstacknet': {u'md5': u'f93c12af7454bbba4c1ef445c2bc9860'}}}, u'supportsIPv6': True, u'realtimeKer nel': False, u'vmTypes': [u'kvm'], u'liveSnapshot': u'true', u'cpuThreads': u'4', u'kdumpStatus': 0, u'networks': {}, u'kernelArgs': u'BOOT_IMAGE=/ovirt-node-ng-4.2.7.1-0.20181114.0+1/vmlinuz-3.10.0-862.14.4.el7.x86_64 root=/dev/onn/ovirt-node-ng-4.2.7.1-0.20181114.0+1 ro crashkernel=auto rd.lvm.lv=onn/ovirt-node-ng-4.2.7.1-0.20181114.0+1 rd.lvm.lv=onn/swap rhgb quiet LANG=en_US.UTF-8 img.bootid=ovirt-node-ng-4.2.7.1-0.20181114.0+1', u'bridges': {u'ovirtmgmt': {u'ipv6autoconf': True, u'addr': u'192.168.14.161', u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'255.255.255.0', u'ipv4defaultroute': True, u'stp': u'off', u'ipv4addrs': [u'192.168.14.161/24'], u'ipv6gateway': u'::', u'gateway': u'192.168.14.1', u'opts': {u'multicast_last_member_count': u'2', u'vlan_protocol': u'0x8100', u'hash_elasticity': u'4', u'multicast_query_response_interval': u'1000', u'group_fwd_mask': u'0x0', u'multicast_snooping': u'1', u'multicast_startup_query_interval': u'3 125', u'hello_timer': u'0', u'multicast_querier_interval': u'25500', u'max_age': u'2000', u'hash_max': u'512', u'stp_state': u'0', u'topology_change_detected': u'0', u'priority': u'32768', u'multicast_igmp_version': u'2', u'multicast_membership_interval': u'26000', u'root_path_cost': u'0', u'root_port': u'0', u'multicast_stats_enabled': u'0', u'multicast_startup_query_count': u'2', u'nf_call_iptables': u'0', u'vlan_stats_enabled': u'0', u'hello_time': u'200', u'topology_change': u'0', u'bridge_id': u'8000.00e04c680408', u'topology_change_timer': u'0', u'ageing_time': u'30000', u'nf_call_ip6tables': u'0', u'multicast_mld_version': u'1', u'gc_timer': u'2588', u'root_id': u'8000.00e04c680408', u'nf_call_arptables': u'0', u'group_addr': u'1:80:c2:0:0:0', u'multicast_last_member_interval': u'100', u'default_pvid': u'1', u'multicast_query_interval': u'12500', u'multicast_query_use_ifaddr': u'0', u'tcn_timer': u'0', u'multicast_router': u'1', u'vlan_filtering': u'0', u'multicast_querier': u'0', u'forward_delay': u'0'}, u'ports': [u'enp1s0']}}, u'uuid': u'03000200-0400-0500-0006-000700080009', u'onlineCpus': u'0,1,2,3', u'nameservers': [u'192.168.10.3'], u'nics': {u'enp1s0': {u'ipv6autoconf': False, u'addr': u'', u'speed': 1000, u'dhcpv6': False, u'ipv6addrs': [], u'mtu': u'1500', u'dhcpv4': False, u'netmask': u'', u'ipv4defaultroute': False, u'ipv4addrs': [], u'hwaddr': u'00:e0:4c:68:04:08', u'ipv6gateway': u'::', u'gateway': u''}}, u'software_revision': u'1', u'hostdevPassthrough': u'false', u'clusterLevels': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuFlags': u'fpu,vme,de,pse,tsc,msr,pae,mce,cx8,apic,sep,mtrr,pge,mca,cmov,pat,pse36,clflush,dts,acpi,mmx,fxsr,sse,sse2,ss,ht,tm,pbe,syscall,nx,pdpe1gb,rdtscp,lm,constant_tsc,art,arch_perfmon,pebs,bts,rep_good,nopl,xtopology,nonstop_tsc,aperfmperf,eagerfpu,pni,pclmulqdq,dtes64,monitor,ds_cpl,vmx,est,tm2,ssse3,sdbg,fma,cx16,xtpr,pdcm,pcid,sse4_1,sse4_2,x2apic,movbe,popcnt,aes,xsave,avx,f16c,rdrand,lahf_lm,abm,3dnowprefetch,epb ,intel_pt,ssbd,ibrs,ibpb,tpr_shadow,vnmi,flexpriority,ept,vpid,fsgsbase,tsc_adjust,bmi1,avx2,smep,bmi2,erms,invpcid,mpx,rdseed,adx,smap,clflushopt,xsaveopt,xsavec,xgetbv1,dtherm,ida,arat,pln,pts,hwp,hwp_notify,hwp_act_window,hwp_epp,model_n270,model_coreduo,model_SandyBridge-IBRS,model_Nehalem,model_Haswell-noTSX,model_Westmere-IBRS,model_Broadwell-noTSX,model_Haswell-noTSX-IBRS,model_Nehalem-IBRS,model_core2duo,model_IvyBridge,model_Penryn,model_IvyBridge-IBRS,model_Westmere,model_Broadwell-noTSX-IBRS,model_SandyBridge,model_Conroe', u'kernelFeatures': {u'RETP': 0, u'IBRS': 1, u'PTI': 1}, u'ISCSIInitiatorName': u'iqn.1994-05.com.redhat:1612863cd006', u'netConfigDirty': u'False', u'selinux': {u'mode': u'1'}, u'autoNumaBalancing': 0, u'reservedMem': u'321', u'containers': False, u'bondings': {}, u'software_version': u'4.20', u'supportedENGINEs': [u'3.6', u'4.0', u'4.1', u'4.2'], u'cpuSpeed': u'3099.957', u'numaNodes': {u'0': {u'totalMemory': u'15794', u'cpus': [0, 1, 2, 3]}}, u'cpuSo ckets': u'1', u'vlans': {}, u'version_name': u'Snow Man', 'lastClientIface': 'lo', u'cpuCores': u'2', u'hostedEngineDeployed': True, u'hugepages': [1048576, 2048], u'guestOverhead': u'65', u'additionalFeatures': [u'libgfapi_supported', u'GLUSTER_SNAPSHOT', u'GLUSTER_GEO_REPLICATION', u'GLUSTER_BRICK_MANAGEMENT'], u'openstack_binding_host_ids': {u'OVIRT_PROVIDER_OVN': u'ed35b4f0-8c54-4262-b2a4-1f2cdc7c7ddf'}, u'kvmEnabled': u'true', u'memSize': u'15794', u'emulatedMachines': [u'pc-i440fx-rhel7.1.0', u'pc-q35-rhel7.3.0', u'rhel6.3.0', u'pc-i440fx-rhel7.5.0', u'pc-i440fx-rhel7.0.0', u'rhel6.1.0', u'pc-i440fx-rhel7.4.0', u'rhel6.6.0', u'pc-q35-rhel7.5.0', u'rhel6.2.0', u'pc', u'pc-i440fx-rhel7.3.0', u'q35', u'pc-i440fx-rhel7.2.0', u'rhel6.4.0', u'pc-q35-rhel7.4.0', u'rhel6.0.0', u'rhel6.5.0'], u'rngSources': [u'hwrng', u'random'], u'operatingSystem': {u'release': u'5.1804.5.el7.centos', u'pretty_name': u'oVirt Node 4.2.7.1', u'version': u'7', u'name': u'RHEL'}}} from=::1,47126 (api:52) 2019-03-18 10:12:21,223-0400 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 0.64 seconds (__init__:573) 2019-03-18 10:12:21,379-0400 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:23,438-0400 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:23,441-0400 INFO (jsonrpc/6) [api.host] START getStats() from=::1,47126 (api:46) 2019-03-18 10:12:23,442-0400 INFO (jsonrpc/6) [vdsm.api] START repoStats(domains=()) from=::1,47126, task_id=37cbaabd-9850-4424-bc50-8e651cc174d2 (api:46) 2019-03-18 10:12:23,442-0400 INFO (jsonrpc/6) [vdsm.api] FINISH repoStats return={u'89fcd80a-0840-4877-8abb-3a4c0432f36e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000336763', 'lastCheck': '4.1', 'valid': True}} from=::1,47126, task_id=37cbaabd-9850-4424-bc50-8e651cc174d2 (api:52) 2019-03-18 10:12:23,442-0400 INFO (jsonrpc/6) [vdsm.api] START multipath_health() from=::1,47126, task_id=e794c720-367d-4919-be7d-633d24b7fc12 (api:46) 2019-03-18 10:12:23,442-0400 INFO (jsonrpc/6) [vdsm.api] FINISH multipath_health return={} from=::1,47126, task_id=e794c720-367d-4919-be7d-633d24b7fc12 (api:52) 2019-03-18 10:12:23,448-0400 INFO (jsonrpc/6) [api.host] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'info': {'cpuStatistics': {'1': {'cpuUser': '1.27', 'nodeIndex': 0, 'cpuSys': '0.60', 'cpuIdle': '98.13'}, '0': {'cpuUser': '1.53', 'nodeIndex': 0, 'cpuSys': '0.40', 'cpuIdle': '98.07'}, '3': {'cpuUser': '2.07', 'nodeIndex': 0, 'cpuSys': '0.53', 'cpuIdle': '97.40'}, '2': {'cpuUser': '1.73', 'nodeIndex': 0, 'cpuSys': '0.53', 'cpuIdle': '97.74'}}, 'numaNodeMemFree': {'0': {'memPercent': 8, 'memFree': '14655'}}, 'memShared': 0, 'haScore': 3400, 'thpState': 'always', 'ksmMergeAcrossNodes': True, 'vmCount': 1, 'memUsed': '5', 'storageDomains': {u'89fcd80a-0840-4877-8abb-3a4c0432f36e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000336763', 'lastCheck': '4.1', 'valid': True}}, 'incomingVmMigrations': 0, 'network': {'ovirtmgmt': {'txErrors': '0', 'state': 'up', 'sampleTime': 1552918337.492382, 'name': 'ovirtmgmt', 'tx': '24253858', 'txDroppe d': '0', 'rx': '3159712', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '6'}, 'lo': {'txErrors': '0', 'state': 'up', 'sampleTime': 1552918337.492382, 'name': 'lo', 'tx': '1147973985', 'txDropped': '0', 'rx': '1147973985', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'ovs-system': {'txErrors': '0', 'state': 'down', 'sampleTime': 1552918337.492382, 'name': 'ovs-system', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, ';vdsmdummy;': {'txErrors': '0', 'state': 'down', 'sampleTime': 1552918337.492382, 'name': ';vdsmdummy;', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'br-int': {'txErrors': '0', 'state': 'down', 'sampleTime': 1552918337.492382, 'name': 'br-int', 'tx': '0', 'txDropped': '0', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'genev_sys_6081': {'txErrors': '8', 'state': 'up', 'sampleTime': 1552918337.492382, 'name': 'genev_sys_6081', 'tx': '0', 'txDropped': '0 ', 'rx': '0', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}, 'enp1s0': {'txErrors': '0', 'state': 'up', 'sampleTime': 1552918337.492382, 'name': 'enp1s0', 'tx': '24321452', 'txDropped': '0', 'rx': '3909593', 'rxErrors': '0', 'speed': '1000', 'rxDropped': '0'}}, 'txDropped': '0', 'anonHugePages': '90', 'ksmPages': 100, 'elapsedTime': '6491.29', 'cpuLoad': '0.04', 'cpuSys': '0.55', 'diskStats': {'/var/log': {'free': '7195'}, '/var/run/vdsm/': {'free': '7871'}, '/tmp': {'free': '906'}}, 'cpuUserVdsmd': '0.40', 'netConfigDirty': 'False', 'memCommitted': 4121, 'ksmState': False, 'vmMigrating': 0, 'ksmCpu': 0, 'memAvailable': 10733, 'bootTime': '1552911832', 'haStats': {'active': True, 'configured': True, 'score': 3400, 'localMaintenance': False, 'globalMaintenance': True}, 'momStatus': 'active', 'multipathHealth': {}, 'rxDropped': '6', 'outgoingVmMigrations': 0, 'swapTotal': 7999, 'swapFree': 7999, 'hugepages': defaultdict(<type 'dict'>, {1048576: {'resv_hugepages': 0, 'free_hugepa ges': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}, 2048: {'resv_hugepages': 0, 'free_hugepages': 0, 'nr_overcommit_hugepages': 0, 'surplus_hugepages': 0, 'vm.free_hugepages': 0, 'nr_hugepages': 0, 'nr_hugepages_mempolicy': 0}}), 'dateTime': '2019-03-18T14:12:23 GMT', 'cpuUser': '1.65', 'memFree': 15110, 'cpuIdle': '97.80', 'vmActive': 0, 'v2vJobs': {}, 'cpuSysVdsmd': '0.27'}} from=::1,47126 (api:52) 2019-03-18 10:12:23,449-0400 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:24,063-0400 INFO (jsonrpc/7) [api.host] START getAllVmStats() from=::1,47130 (api:46) 2019-03-18 10:12:24,063-0400 INFO (jsonrpc/7) [api.host] FINISH getAllVmStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': (suppressed)} from=::1,47130 (api:52) 2019-03-18 10:12:24,063-0400 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:25,903-0400 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:25,957-0400 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:25,961-0400 INFO (jsonrpc/0) [vdsm.api] START repoStats(domains=[u'89fcd80a-0840-4877-8abb-3a4c0432f36e']) from=::1,47126, task_id=d5dd13f8-9e9b-4173-81c5-5c71e9dd7080 (api:46) 2019-03-18 10:12:25,961-0400 INFO (jsonrpc/0) [vdsm.api] FINISH repoStats return={u'89fcd80a-0840-4877-8abb-3a4c0432f36e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000291248', 'lastCheck': '0.9', 'valid': True}} from=::1,47126, task_id=d5dd13f8-9e9b-4173-81c5-5c71e9dd7080 (api:52) 2019-03-18 10:12:25,961-0400 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:25,966-0400 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:28,271-0400 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:28,274-0400 INFO (jsonrpc/2) [api.virt] START getStats() from=::1,47126, vmId=0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (api:46) 2019-03-18 10:12:28,274-0400 INFO (jsonrpc/2) [api.virt] FINISH getStats return={'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Down', 'exitMessage': "'NoneType' object has no attribute '__getitem__'", 'statusTime': '4301183410', 'vmId': '0c3e1c08-3928-47f1-96a8-c6a8d0dc3241', 'exitReason': 1, 'exitCode': 1}]} from=::1,47126, vmId=0c3e1c08-3928-47f1-96a8-c6a8d0dc3241 (api:52) 2019-03-18 10:12:28,275-0400 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call VM.getStats succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:28,329-0400 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:28,332-0400 INFO (jsonrpc/7) [vdsm.api] START repoStats(domains=[u'89fcd80a-0840-4877-8abb-3a4c0432f36e']) from=::1,47126, task_id=5aa25cff-7697-49df-844d-255a6f6d95c2 (api:46) 2019-03-18 10:12:28,332-0400 INFO (jsonrpc/7) [vdsm.api] FINISH repoStats return={u'89fcd80a-0840-4877-8abb-3a4c0432f36e': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000291248', 'lastCheck': '3.2', 'valid': True}} from=::1,47126, task_id=5aa25cff-7697-49df-844d-255a6f6d95c2 (api:52) 2019-03-18 10:12:28,333-0400 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:30,253-0400 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.ping2 succeeded in 0.00 seconds (__init__:573) 2019-03-18 10:12:30,256-0400 INFO (jsonrpc/5) [api.host] START getCapabilities() from=::1,47126 (api:46) 2019-03-18 10:12:30,549-0400 INFO (jsonrpc/5) [root] /usr/libexec/vdsm/hooks/after_get_caps/50_openstacknet: rc=0 err= (hooks:110)
participants (2)
-
siovelrm@gmail.com
-
Strahil