[ovirt-users] Cluster comms error, can't migrate

Mike ovirt at theinternet.org.uk
Thu Mar 19 10:22:43 EDT 2015


Hi Everyone

I have a two node hosted engine cluster that's been running for a month
or two. 

NFS is used for the VM's shared off the nodes on a second network
interface with different hostnames, I hope easier to migrate later on.
NFS 172.16.67.0/24 ov1-nfs.domain.dom on .1 and ov2-nfs.domain.dom
on .2. The NFS shares are working.

Management net is 10.10.10.224/28

Last night the cluster had communication errors, but I could not find
any issues, all nodes can ping & ssh with each other and engine.

Today, it got worse, the engine migrated all but 3 VM's to OV2, the node
hosting the engine. The VMs still on OV1 are there because the migration
for those failed. I can't manually migrate anything back to ov1. I
eventually shut down the engine and started on OV1, but still no joy.

The VMs are alive, both on OV1 & OV2. OV2 is currently in local
maintenance to stop the engine moving and stop the email alerts.

I have been through the logs, I see there be a cert issue in
libvirtd.log on
the receiving host?

The web interface cert has been changed for a CA issued one several
weeks ago, this is working and I monitor the manager using nagios via
the API. This is still working. I did not change any of the other
internal oVirt PKI stuff.

The portal is working to view the VMs and config, but I haven't tried
changing anything during this issue apart from trying the migrate. The
VMs are providing public services, so I have not tried changing things.

Linux ov1.domain.dom 2.6.32-504.3.3.el6.x86_64 #1 SMP Wed Dec 17 01:55:02 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux
oVirt Engine Version: 3.5.1-1.el6
OS Version: RHEL - 6 - 6.el6.centos.12.2
Kernel Version: 2.6.32 - 504.3.3.el6.x86_64
KVM Version: 0.12.1.2 - 2.448.el6_6
LIBVIRT Version: libvirt-0.10.2-46.el6_6.2
VDSM Version: vdsm-4.16.10-8.gitc937927.el6
SPICE Version: 0.12.4 - 11.el6

Any help appreciated.
Mike


[root at ov1 ~]#  libvirtd.log
2015-03-18 15:42:17.387+0000: 3017: error :
virNetTLSContextValidCertificate:1008 : Unable to verify TLS peer: The
peer did not send any certificate.

2015-03-18 15:42:17.387+0000: 3017: warning :
virNetTLSContextCheckCertificate:1142 : Certificate check failed Unable
to verify TLS peer: The peer did not send any certificate.

2015-03-18 15:42:17.387+0000: 3017: error :
virNetTLSContextCheckCertificate:1145 : authentication failed: Failed to
verify peer's certificate

[root at ov2 ~]#  vdsm.log
Thread-49490::DEBUG::2015-03-18
15:42:17,294::migration::298::vm.Vm::(_startUnderlyingMigration)
vmId=`b44b2182-f943-4987-8421-8a98fd2a04d4`::starting migration to qemu
+tls://ov1.domain.dom/system with miguri tcp://10.10.10.227

Thread-49525::DEBUG::2015-03-18
15:42:17,296::migration::361::vm.Vm::(run)
vmId=`b44b2182-f943-4987-8421-8a98fd2a04d4`::migration downtime thread
started

Thread-49526::DEBUG::2015-03-18
15:42:17,297::migration::410::vm.Vm::(monitor_migration)
vmId=`b44b2182-f943-4987-8421-8a98fd2a04d4`::starting migration monitor
thread

Thread-49490::DEBUG::2015-03-18
15:42:17,388::libvirtconnection::143::root::(wrapper) Unknown
libvirterror: ecode: 9 edom: 10 level: 2 message: operation failed:
Failed to connect to remote libvirt URI qemu+tls://ov1.domain.dom/system

Thread-49490::DEBUG::2015-03-18
15:42:17,390::migration::376::vm.Vm::(cancel)
vmId=`b44b2182-f943-4987-8421-8a98fd2a04d4`::canceling migration
downtime thread

Thread-49525::DEBUG::2015-03-18
15:42:17,391::migration::373::vm.Vm::(run)
vmId=`b44b2182-f943-4987-8421-8a98fd2a04d4`::migration downtime thread
exiting

Thread-49490::DEBUG::2015-03-18
15:42:17,391::migration::470::vm.Vm::(stop)
vmId=`b44b2182-f943-4987-8421-8a98fd2a04d4`::stopping migration monitor
thread

Thread-49490::ERROR::2015-03-18
15:42:17,393::migration::161::vm.Vm::(_recover)
vmId=`b44b2182-f943-4987-8421-8a98fd2a04d4`::operation failed: Failed to
connect to remote libvirt URI qemu+tls://ov1.domain.dom/system


[root at ov1 ~]# cat /var/log/vdsm/vdsm.log|grep MY_VM
Thread-7589263::DEBUG::2015-03-18
15:22:01,936::BindingXMLRPC::1133::vds::(wrapper) client
[10.10.10.228]::call vmMigrationCreate with ({'status': 'Up',
'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0',
'afterMigrationStatus': '', 'tabletEnable': 'true', 'vmId':
'b44b2182-f943-4987-8421-8a98fd2a04d4', 'memGuaranteedSize': 2048,
'transparentHugePages': 'true', 'displayPort': '5929',
'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType':
'SandyBridge', 'smp': '2', 'migrationDest': 'libvirt', 'custom': {},
'vmType': 'kvm', '_srcDomXML': "<domain type='kvm' id='58'>\n
<name>MY_VM</name>\n
<uuid>b44b2182-f943-4987-8421-8a98fd2a04d4</uuid>\n  <memory
unit='KiB'>2097152</memory>\n  <currentMemory
unit='KiB'>2097152</currentMemory>\n  <vcpu placement='static'
current='2'>16</vcpu>\n  <cputune>\n    <shares>1020</shares>\n
</cputune>\n  <sysinfo type='smbios'>\n    <system>\n      <entry
name='manufacturer'>oVirt</entry>\n      <entry name='product'>oVirt
Node<
 /entry>\n      <entry name='version'>6-6.el6.centos.12.2</entry>\n
<entry name='serial'>36333337-3434-5A43-3234-313130484A52</entry>\n
<entry name='uuid'>b44b2182-f943-4987-8421-8a98fd2a04d4</entry>\n
</system>\n  </sysinfo>\n  <os>\n    <type arch='x86_64'
machine='rhel6.5.0'>hvm</type>\n    <smbios mode='sysinfo'/>\n  </os>\n
<features>\n    <acpi/>\n  </features>\n  <cpu mode='custom'
match='exact'>\n    <model fallback='allow'>SandyBridge</model>\n
<topology sockets='16' cores='1' threads='1'/>\n  </cpu>\n  <clock
offset='variable' adjustment='0' basis='utc'>\n    <timer name='rtc'
tickpolicy='catchup'/>\n    <timer name='pit' tickpolicy='delay'/>\n
<timer name='hpet' present='no'/>\n  </clock>\n
<on_poweroff>destroy</on_poweroff>\n  <on_reboot>restart</on_reboot>\n
<on_crash>destroy</on_crash>\n  <devices>\n
<emulator>/usr/libexec/qemu-kvm</emulator>\n    <disk type='file'
device='disk' snapshot='no'>\n      <driver name='qemu' type='raw'
cache=
 'none' error_policy='stop' io='threads'/>\n      <source
file='/rhev/data-center/00000002-0002-0002-0002-0000000001a1/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4'>\n        <seclabel model='selinux' relabel='no'/>\n      </source>\n      <target dev='hda' bus='ide'/>\n      <serial>6f9a8a62-8419-48ba-9642-0bee23a06d06</serial>\n      <alias name='ide0-0-0'/>\n      <address type='drive' controller='0' bus='0' target='0' unit='0'/>\n    </disk>\n    <disk type='file' device='cdrom'>\n      <driver name='qemu' type='raw'/>\n      <source startupPolicy='optional'>\n        <seclabel model='selinux' relabel='no'/>\n      </source>\n      <target dev='hdc' bus='ide' tray='open'/>\n      <readonly/>\n      <serial></serial>\n      <boot order='1'/>\n      <alias name='ide0-1-0'/>\n      <address type='drive' controller='0' bus='1' target='0' unit='0'/>\n    </disk>\n    <controller type='scsi' index='0' mode
 l='virtio-scsi'>\n      <alias name='scsi0'/>\n      <address
type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>\n
</controller>\n    <controller type='virtio-serial' index='0'
ports='16'>\n      <alias name='virtio-serial0'/>\n      <address
type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>\n
</controller>\n    <controller type='ide' index='0'>\n      <alias
name='ide0'/>\n      <address type='pci' domain='0x0000' bus='0x00'
slot='0x01' function='0x1'/>\n    </controller>\n    <controller
type='usb' index='0'>\n      <alias name='usb0'/>\n      <address
type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>\n
</controller>\n    <interface type='bridge'>\n      <mac
address='00:1a:4a:8f:8b:14'/>\n      <source bridge='SalMan'/>\n
<bandwidth>\n      </bandwidth>\n      <target dev='vnet57'/>\n
<model type='virtio'/>\n      <filterref
filter='vdsm-no-mac-spoofing'/>\n      <link state='up'/>\n      <alias
name='ne
 t0'/>\n      <address type='pci' domain='0x0000' bus='0x00' slot='0x03'
function='0x0'/>\n    </interface>\n    <interface type='bridge'>\n
<mac address='00:1a:4a:8f:8b:15'/>\n      <source bridge='DSVRMan'/>\n
<bandwidth>\n      </bandwidth>\n      <target dev='vnet64'/>\n
<model type='virtio'/>\n      <filterref
filter='vdsm-no-mac-spoofing'/>\n      <link state='up'/>\n      <alias
name='net1'/>\n      <address type='pci' domain='0x0000' bus='0x00'
slot='0x04' function='0x0'/>\n    </interface>\n    <interface
type='bridge'>\n      <mac address='00:1a:4a:8f:8b:16'/>\n      <source
bridge='DSVR_832'/>\n      <bandwidth>\n      </bandwidth>\n
<target dev='vnet65'/>\n      <model type='virtio'/>\n      <filterref
filter='vdsm-no-mac-spoofing'/>\n      <link state='up'/>\n      <alias
name='net2'/>\n      <address type='pci' domain='0x0000' bus='0x00'
slot='0x05' function='0x0'/>\n    </interface>\n    <interface
type='bridge'>\n      <mac address='00:1a:4
 a:8f:8b:17'/>\n      <source bridge='DSVR_835'/>\n      <bandwidth>\n
</bandwidth>\n      <target dev='vnet66'/>\n      <model
type='virtio'/>\n      <filterref filter='vdsm-no-mac-spoofing'/>\n
<link state='up'/>\n      <alias name='net3'/>\n      <address
type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>\n
</interface>\n    <channel type='unix'>\n      <source mode='bind'
path='/var/lib/libvirt/qemu/channels/b44b2182-f943-4987-8421-8a98fd2a04d4.com.redhat.rhevm.vdsm'/>\n      <target type='virtio' name='com.redhat.rhevm.vdsm'/>\n      <alias name='channel0'/>\n      <address type='virtio-serial' controller='0' bus='0' port='1'/>\n    </channel>\n    <channel type='unix'>\n      <source mode='bind' path='/var/lib/libvirt/qemu/channels/b44b2182-f943-4987-8421-8a98fd2a04d4.org.qemu.guest_agent.0'/>\n      <target type='virtio' name='org.qemu.guest_agent.0'/>\n      <alias name='channel1'/>\n      <address type='virtio-serial' controller='0' bus='
 0' port='2'/>\n    </channel>\n    <input type='tablet' bus='usb'>\n
<alias name='input0'/>\n    </input>\n    <input type='mouse'
bus='ps2'/>\n    <graphics type='vnc' port='5929' autoport='yes'
keymap='en-gb' passwdValidTo='2015-03-18T15:18:42'>\n      <listen
type='network' address='10.10.10.228' network='vdsm-ovirtmgmt'/>\n
</graphics>\n    <video>\n      <model type='cirrus' vram='32768'
heads='1'/>\n      <alias name='video0'/>\n      <address type='pci'
domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>\n    </video>\n
<memballoon model='none'>\n      <alias name='balloon0'/>\n
</memballoon>\n  </devices>\n  <seclabel type='dynamic' model='selinux'
relabel='yes'>\n
<label>system_u:system_r:svirt_t:s0:c796,c841</label>\n
<imagelabel>system_u:object_r:svirt_image_t:s0:c796,c841</imagelabel>\n
</seclabel>\n</domain>\n", 'memSize': 2048, 'smpCoresPerSocket': '1',
'vmName': 'MY_VM', 'nice': '0', 'username': 'Unknown', 'clientIp': '',
'bootMenuEnab
 le': 'false', 'nicModel': 'rtl8139,pv', 'guestDiskMapping': {},
'displayIp': '10.10.10.228', 'keyboardLayout': 'en-gb', 'cdrom': '',
'smartcardEnable': 'false', 'spiceSecureChannels':
'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard',
'guestFQDN': '', 'elapsedTimeOffset': 3017230.7908568382, 'kvmEnable':
'true', 'pitReinjection': 'false', 'displayNetwork': 'ovirtmgmt',
'devices': [{'device': 'memballoon', 'specParams': {'model': 'none'},
'type': 'balloon', 'target': 2097152, 'alias': 'balloon0'}, {'device':
'unix', 'alias': 'channel0', 'type': 'channel', 'address': {'bus': '0',
'controller': '0', 'type': 'virtio-serial', 'port': '1'}}, {'device':
'unix', 'alias': 'channel1', 'type': 'channel', 'address': {'bus': '0',
'controller': '0', 'type': 'virtio-serial', 'port': '2'}}, {'index':
'0', 'alias': 'scsi0', 'specParams': {}, 'deviceId':
'2a313e5e-d4c6-495a-b74d-5a48dad219f9', 'address': {'slot': '0x06',
'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 
 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type':
'controller'}, {'specParams': {}, 'alias': 'virtio-serial0', 'deviceId':
'17eec938-fbc3-466b-90c1-17114ad8fefd', 'address': {'slot': '0x07',
'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'},
'device': 'virtio-serial', 'type': 'controller'}, {'device': 'usb',
'alias': 'usb0', 'type': 'controller', 'address': {'slot': '0x01',
'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x2'}},
{'device': 'ide', 'alias': 'ide0', 'type': 'controller', 'address':
{'slot': '0x01', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci',
'function': '0x1'}}, {'specParams': {'vram': '32768', 'heads': '1'},
'alias': 'video0', 'deviceId': 'a2a91897-2cac-46e2-9d21-5e420f3a2ef7',
'address': {'slot': '0x02', 'bus': '0x00', 'domain': '0x0000', 'type':
'pci', 'function': '0x0'}, 'device': 'cirrus', 'type': 'video'},
{'device': 'vnc', 'specParams': {'displayNetwork': 'ovirtmgmt',
'keyMap': 'en-gb', 'display
 Ip': '10.10.10.228', 'spiceSecureChannels':
'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard'}, 'type': 'graphics', 'port': '5929'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:8f:8b:14', 'linkActive': True, 'network': 'SalMan', 'specParams': {'inbound': {}, 'outbound': {}}, 'filter': 'vdsm-no-mac-spoofing', 'alias': 'net0', 'deviceId': 'da869900-305c-46b2-87f0-833840c3e512', 'address': {'slot': '0x03', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface', 'name': 'vnet57'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:8f:8b:15', 'linkActive': True, 'network': 'DSVRMan', 'specParams': {'inbound': {}, 'outbound': {}}, 'filter': 'vdsm-no-mac-spoofing', 'alias': 'net1', 'deviceId': '3e7fbd28-96e3-4111-a8c2-77b33ded773f', 'address': {'slot': '0x04', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'}, 'device': 'bridge', 'type': 'interface', 'name': 'vnet64'}, {'nicModel': 'pv', 'macAddr': '00
 :1a:4a:8f:8b:16', 'linkActive': True, 'network': 'DSVR_832',
'specParams': {'inbound': {}, 'outbound': {}}, 'filter':
'vdsm-no-mac-spoofing', 'alias': 'net2', 'deviceId':
'3546e9d0-4288-490a-bbb4-17f24fed1dd5', 'address': {'slot': '0x05',
'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'},
'device': 'bridge', 'type': 'interface', 'name': 'vnet65'}, {'nicModel':
'pv', 'macAddr': '00:1a:4a:8f:8b:17', 'linkActive': True, 'network':
'DSVR_835', 'specParams': {'inbound': {}, 'outbound': {}}, 'filter':
'vdsm-no-mac-spoofing', 'alias': 'net3', 'deviceId':
'4e586a4a-d620-4e4c-a1e3-bdd0958ab56c', 'address': {'slot': '0x08',
'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'},
'device': 'bridge', 'type': 'interface', 'name': 'vnet66'}, {'index':
'2', 'iface': 'ide', 'name': 'hdc', 'alias': 'ide0-1-0', 'bootOrder':
'1', 'specParams': {'path': 'Mik-6.26.iso'}, 'readonly': 'True',
'deviceId': '2da7ceb2-0fc7-4b78-88c7-2bd0c1fa4d37', 'address': {'bus':
'1
 ', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'},
'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'},
{'poolID': '00000002-0002-0002-0002-0000000001a1', 'reqsize': '0',
'index': 0, 'iface': 'ide', 'apparentsize': '1073741824', 'specParams':
{}, 'imageID': '6f9a8a62-8419-48ba-9642-0bee23a06d06', 'readonly':
'False', 'shared': 'false', 'truesize': '1073745920', 'type': 'disk',
'domainID': '7423c49d-0d67-43af-ac2c-d225eb9b22de', 'volumeInfo':
{'domainID': '7423c49d-0d67-43af-ac2c-d225eb9b22de', 'volType': 'path',
'leaseOffset': 0, 'volumeID': '8568fca9-f857-419b-ab4b-ca3729d108d4',
'leasePath':
'/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4.lease', 'imageID': '6f9a8a62-8419-48ba-9642-0bee23a06d06', 'path': '/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9
 642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4'}, 'format':
'raw', 'deviceId': '6f9a8a62-8419-48ba-9642-0bee23a06d06', 'address':
{'bus': '0', 'controller': '0', 'type': 'drive', 'target': '0', 'unit':
'0'}, 'device': 'disk', 'path':
'/rhev/data-center/00000002-0002-0002-0002-0000000001a1/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4', 'propagateErrors': 'off', 'optional': 'false', 'name': 'hda', 'volumeID': '8568fca9-f857-419b-ab4b-ca3729d108d4', 'alias': 'ide0-0-0', 'volumeChain': [{'domainID': '7423c49d-0d67-43af-ac2c-d225eb9b22de', 'volType': 'path', 'leaseOffset': 0, 'volumeID': '8568fca9-f857-419b-ab4b-ca3729d108d4', 'leasePath': '/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4.lease', 'imageID': '6f9a8a62-8419-48ba-9642-0bee23a06d06', 'path': '/rhev/data-center/mnt/ov1-

nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4'}]}], 'timeOffset': '0', 'maxVCpus': '16', 'guestIPs': '', 'display': 'vnc'},) {}

Thread-7589263::DEBUG::2015-03-18
15:22:12,692::BindingXMLRPC::1140::vds::(wrapper) return
vmMigrationCreate with {'status': {'message': 'Done', 'code': 0},
'migrationPort': 0, 'params': {'cdrom': '', 'username': 'Unknown',
'acpiEnable': 'true', 'emulatedMachine': 'rhel6.5.0',
'afterMigrationStatus': '', 'tabletEnable': 'true', 'pid': '0',
'memGuaranteedSize': 2048, 'transparentHugePages': 'true',
'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType':
'SandyBridge', 'custom': {}, 'migrationDest': 'libvirt',
'smartcardEnable': 'false', 'smp': '2', 'vmType': 'kvm', 'memSize':
2048, 'smpCoresPerSocket': '1', 'vmName': 'MY_VM', 'nice': '0',
'guestFQDN': '', 'bootMenuEnable': 'false', 'vmId':
'b44b2182-f943-4987-8421-8a98fd2a04d4', 'displayIp': '10.10.10.227',
'displayPort': '-1', 'guestIPs': '', 'guestDiskMapping': {},
'spiceSecureChannels':
'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard',
'nicModel': 'rtl8139,pv', 'keyboardLayout': 'en-gb
 ', 'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork':
'ovirtmgmt', 'devices': [{'device': 'memballoon', 'specParams':
{'model': 'none'}, 'type': 'balloon', 'target': 2097152, 'alias':
'balloon0'}, {'device': 'unix', 'alias': 'channel0', 'type': 'channel',
'address': {'bus': '0', 'controller': '0', 'type': 'virtio-serial',
'port': '1'}}, {'device': 'unix', 'alias': 'channel1', 'type':
'channel', 'address': {'bus': '0', 'controller': '0', 'type':
'virtio-serial', 'port': '2'}}, {'index': '0', 'alias': 'scsi0',
'specParams': {}, 'deviceId': '2a313e5e-d4c6-495a-b74d-5a48dad219f9',
'address': {'slot': '0x06', 'bus': '0x00', 'domain': '0x0000', 'type':
'pci', 'function': '0x0'}, 'device': 'scsi', 'model': 'virtio-scsi',
'type': 'controller'}, {'alias': 'virtio-serial0', 'specParams': {},
'deviceId': '17eec938-fbc3-466b-90c1-17114ad8fefd', 'address': {'slot':
'0x07', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function':
'0x0'}, 'device': 'virtio-serial', 'typ
 e': 'controller'}, {'device': 'usb', 'alias': 'usb0', 'type':
'controller', 'address': {'slot': '0x01', 'bus': '0x00', 'domain':
'0x0000', 'type': 'pci', 'function': '0x2'}}, {'device': 'ide', 'alias':
'ide0', 'type': 'controller', 'address': {'slot': '0x01', 'bus': '0x00',
'domain': '0x0000', 'type': 'pci', 'function': '0x1'}}, {'alias':
'video0', 'specParams': {'vram': '32768', 'heads': '1'}, 'deviceId':
'a2a91897-2cac-46e2-9d21-5e420f3a2ef7', 'address': {'slot': '0x02',
'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'},
'device': 'cirrus', 'type': 'video'}, {'device': 'vnc', 'specParams':
{'displayNetwork': 'ovirtmgmt', 'keyMap': 'en-gb', 'displayIp':
'10.10.10.228', 'spiceSecureChannels':
'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard'}, 'type': 'graphics', 'port': '5929'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:8f:8b:14', 'linkActive': True, 'network': 'SalMan', 'alias': 'net0', 'filter': 'vdsm-no-mac-spoofing', 'specParams': 
 {'inbound': {}, 'outbound': {}}, 'deviceId':
'da869900-305c-46b2-87f0-833840c3e512', 'address': {'slot': '0x03',
'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'},
'device': 'bridge', 'type': 'interface', 'name': 'vnet57'}, {'nicModel':
'pv', 'macAddr': '00:1a:4a:8f:8b:15', 'linkActive': True, 'network':
'DSVRMan', 'alias': 'net1', 'filter': 'vdsm-no-mac-spoofing',
'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId':
'3e7fbd28-96e3-4111-a8c2-77b33ded773f', 'address': {'slot': '0x04',
'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'},
'device': 'bridge', 'type': 'interface', 'name': 'vnet64'}, {'nicModel':
'pv', 'macAddr': '00:1a:4a:8f:8b:16', 'linkActive': True, 'network':
'DSVR_832', 'alias': 'net2', 'filter': 'vdsm-no-mac-spoofing',
'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId':
'3546e9d0-4288-490a-bbb4-17f24fed1dd5', 'address': {'slot': '0x05',
'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'},
'de
 vice': 'bridge', 'type': 'interface', 'name': 'vnet65'}, {'nicModel':
'pv', 'macAddr': '00:1a:4a:8f:8b:17', 'linkActive': True, 'network':
'DSVR_835', 'alias': 'net3', 'filter': 'vdsm-no-mac-spoofing',
'specParams': {'inbound': {}, 'outbound': {}}, 'deviceId':
'4e586a4a-d620-4e4c-a1e3-bdd0958ab56c', 'address': {'slot': '0x08',
'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function': '0x0'},
'device': 'bridge', 'type': 'interface', 'name': 'vnet66'}, {'index':
'2', 'iface': 'ide', 'name': 'hdc', 'alias': 'ide0-1-0', 'bootOrder':
'1', 'specParams': {'path': 'Mik-6.26.iso'}, 'readonly': 'True',
'deviceId': '2da7ceb2-0fc7-4b78-88c7-2bd0c1fa4d37', 'address': {'bus':
'1', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'},
'device': 'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'},
{'poolID': '00000002-0002-0002-0002-0000000001a1', 'volumeInfo':
{'domainID': '7423c49d-0d67-43af-ac2c-d225eb9b22de', 'volType': 'path',
'leaseOffset': 0, 'volumeID': '8568fca9-
 f857-419b-ab4b-ca3729d108d4', 'leasePath':
'/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4.lease', 'imageID': '6f9a8a62-8419-48ba-9642-0bee23a06d06', 'path': '/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4'}, 'index': 0, 'iface': 'ide', 'apparentsize': '1073741824', 'alias': 'ide0-0-0', 'imageID': '6f9a8a62-8419-48ba-9642-0bee23a06d06', 'readonly': 'False', 'shared': 'false', 'truesize': '1073745920', 'type': 'disk', 'domainID': '7423c49d-0d67-43af-ac2c-d225eb9b22de', 'reqsize': '0', 'format': 'raw', 'deviceId': '6f9a8a62-8419-48ba-9642-0bee23a06d06', 'address': {'bus': '0', 'controller': '0', 'type': 'drive', 'target': '0', 'unit': '0'}, 'device': 'disk', 'path': '/rhev/data-center/00000002-0002-0002-0002-0000000001a1/7423c49d-0d6

7-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4', 'propagateErrors': 'off', 'optional': 'false', 'name': 'hda', 'volumeID': '8568fca9-f857-419b-ab4b-ca3729d108d4', 'specParams': {}, 'volumeChain': [{'domainID': '7423c49d-0d67-43af-ac2c-d225eb9b22de', 'volType': 'path', 'leaseOffset': 0, 'volumeID': '8568fca9-f857-419b-ab4b-ca3729d108d4', 'leasePath': '/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4.lease', 'imageID': '6f9a8a62-8419-48ba-9642-0bee23a06d06', 'path': '/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4'}]}], 'status': 'Migration Destination', 'timeOffset': '0', 'maxVCpus': '16', 'clientIp': '', 'display': 'vnc'}}

[root at ov2 ~]# cat /var/log/vdsm/vdsm.log|grep MY_VM
Thread-39206::DEBUG::2015-03-18
15:22:01,621::__init__::500::jsonrpc.JsonRpcServer::(_serveRequest)
Return 'Host.getVMFullList' in bridge with [{'acpiEnable': 'true',
'emulatedMachine': 'rhel6.5.0', 'afterMigrationStatus': '',
'tabletEnable': 'true', 'pid': '25551', 'memGuaranteedSize': 2048,
'transparentHugePages': 'true', 'displayPort': u'5929',
'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType':
'SandyBridge', 'smp': '2', 'custom': {}, 'vmType': 'kvm', 'memSize':
2048, 'smpCoresPerSocket': '1', 'vmName': 'MY_VM', 'nice': '0',
'status': 'Migration Source', 'bootMenuEnable': 'false',
'guestDiskMapping': {}, 'vmId': 'b44b2182-f943-4987-8421-8a98fd2a04d4',
'displayIp': '10.10.10.228', 'cdrom': '', 'smartcardEnable': 'false',
'clientIp': '', 'nicModel': 'rtl8139,pv', 'keyboardLayout': 'en-gb',
'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork':
'ovirtmgmt', 'devices': [{'target': 2097152, 'alias': 'balloon0',
'specParams': {'model': 'none'}, 'd
 eviceType': 'balloon', 'device': 'memballoon', 'type': 'balloon'},
{'device': 'unix', 'alias': 'channel0', 'deviceType': 'channel', 'type':
'channel', 'address': {'bus': '0', 'controller': '0', 'type':
'virtio-serial', 'port': '1'}}, {'device': 'unix', 'alias': 'channel1',
'deviceType': 'channel', 'type': 'channel', 'address': {'bus': '0',
'controller': '0', 'type': 'virtio-serial', 'port': '2'}}, {'index':
'0', 'alias': u'scsi0', 'specParams': {}, 'deviceType': 'controller',
'deviceId': '2a313e5e-d4c6-495a-b74d-5a48dad219f9', 'address': {u'slot':
u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci',
u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type':
'controller'}, {'alias': u'virtio-serial0', 'specParams': {},
'deviceType': 'controller', 'deviceId':
'17eec938-fbc3-466b-90c1-17114ad8fefd', 'address': {u'slot': u'0x07',
u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function':
u'0x0'}, 'device': 'virtio-serial', 'type': 'controller'}
 , {'device': 'usb', 'alias': u'usb0', 'deviceType': 'controller',
'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00',
u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device':
'ide', 'alias': u'ide0', 'deviceType': 'controller', 'type':
'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain':
u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'alias': 'video0',
'specParams': {'vram': '32768', 'heads': '1'}, 'deviceType': 'video',
'deviceId': 'a2a91897-2cac-46e2-9d21-5e420f3a2ef7', 'address': {'slot':
'0x02', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function':
'0x0'}, 'device': 'cirrus', 'type': 'video'}, {'device': 'vnc',
'specParams': {'displayNetwork': 'ovirtmgmt', 'keyMap': 'en-gb',
'displayIp': '10.10.10.228', 'spiceSecureChannels':
'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard'}, 'deviceType': 'graphics', 'type': 'graphics', 'port': u'5929'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:8f:8b:
 14', 'linkActive': True, 'network': 'SalMan', 'alias': u'net0',
'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {},
'outbound': {}}, 'deviceType': 'interface', 'deviceId':
'da869900-305c-46b2-87f0-833840c3e512', 'address': {u'slot': u'0x03',
u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function':
u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet57'},
{'nicModel': 'pv', 'macAddr': '00:1a:4a:8f:8b:15', 'linkActive': True,
'network': 'DSVRMan', 'alias': u'net1', 'filter':
'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}},
'deviceType': 'interface', 'deviceId':
'3e7fbd28-96e3-4111-a8c2-77b33ded773f', 'address': {u'slot': u'0x04',
u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function':
u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet64'},
{'nicModel': 'pv', 'macAddr': '00:1a:4a:8f:8b:16', 'linkActive': True,
'network': 'DSVR_832', 'alias': u'net2', 'filter':
'vdsm-no-mac-spoofing', 'specParam
 s': {'inbound': {}, 'outbound': {}}, 'deviceType': 'interface',
'deviceId': '3546e9d0-4288-490a-bbb4-17f24fed1dd5', 'address': {u'slot':
u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci',
u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name':
u'vnet65'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:8f:8b:17',
'linkActive': True, 'network': 'DSVR_835', 'alias': u'net3', 'filter':
'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}},
'deviceType': 'interface', 'deviceId':
'4e586a4a-d620-4e4c-a1e3-bdd0958ab56c', 'address': {u'slot': u'0x08',
u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function':
u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet66'},
{'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0',
'bootOrder': u'1', 'specParams': {'path': 'Mik-6.26.iso'}, 'readonly':
'True', 'deviceType': 'disk', 'deviceId':
'2da7ceb2-0fc7-4b78-88c7-2bd0c1fa4d37', 'address': {u'bus': u'1',
u'controller': 
 u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'device':
'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'poolID':
'00000002-0002-0002-0002-0000000001a1', 'volumeInfo': {'domainID':
'7423c49d-0d67-43af-ac2c-d225eb9b22de', 'volType': 'path',
'leaseOffset': 0, 'volumeID': u'8568fca9-f857-419b-ab4b-ca3729d108d4',
'leasePath':
u'/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4.lease', 'imageID': '6f9a8a62-8419-48ba-9642-0bee23a06d06', 'path': u'/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4'}, 'index': 0, 'iface': 'ide', 'apparentsize': '1073741824', 'alias': u'ide0-0-0', 'imageID': '6f9a8a62-8419-48ba-9642-0bee23a06d06', 'readonly': 'False', 'deviceType': 'disk', 'shared': 'false', 'truesize': '1073745920', 'type': 
 'disk', 'domainID': '7423c49d-0d67-43af-ac2c-d225eb9b22de', 'reqsize':
'0', 'format': 'raw', 'deviceId':
'6f9a8a62-8419-48ba-9642-0bee23a06d06', 'address': {u'bus': u'0',
u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'},
'device': 'disk', 'path':
u'/rhev/data-center/00000002-0002-0002-0002-0000000001a1/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4', 'propagateErrors': 'off', 'optional': 'false', 'name': u'hda', 'volumeID': '8568fca9-f857-419b-ab4b-ca3729d108d4', 'specParams': {}, 'volumeChain': [{'domainID': '7423c49d-0d67-43af-ac2c-d225eb9b22de', 'volType': 'path', 'leaseOffset': 0, 'volumeID': u'8568fca9-f857-419b-ab4b-ca3729d108d4', 'leasePath': u'/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4.lease', 'imageID': '6f9a8a62-8419-48ba-9642-0bee23a06d06', 'path
 ':
u'/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4'}]}], 'timeOffset': '0', 'maxVCpus': '16', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'vnc'}]

Thread-49524::DEBUG::2015-03-18
15:42:15,656::__init__::500::jsonrpc.JsonRpcServer::(_serveRequest)
Return 'Host.getVMFullList' in bridge with [{'acpiEnable': 'true',
'emulatedMachine': 'rhel6.5.0', 'afterMigrationStatus': '',
'tabletEnable': 'true', 'pid': '25551', 'memGuaranteedSize': 2048,
'transparentHugePages': 'true', 'displayPort': u'5929',
'displaySecurePort': '-1', 'spiceSslCipherSuite': 'DEFAULT', 'cpuType':
'SandyBridge', 'smp': '2', 'custom': {}, 'vmType': 'kvm', 'memSize':
2048, 'smpCoresPerSocket': '1', 'vmName': 'MY_VM', 'nice': '0',
'status': 'Migration Source', 'bootMenuEnable': 'false',
'guestDiskMapping': {}, 'vmId': 'b44b2182-f943-4987-8421-8a98fd2a04d4',
'displayIp': '10.10.10.228', 'cdrom': '', 'smartcardEnable': 'false',
'clientIp': '', 'nicModel': 'rtl8139,pv', 'keyboardLayout': 'en-gb',
'kvmEnable': 'true', 'pitReinjection': 'false', 'displayNetwork':
'ovirtmgmt', 'devices': [{'target': 2097152, 'alias': 'balloon0',
'specParams': {'model': 'none'}, 'd
 eviceType': 'balloon', 'device': 'memballoon', 'type': 'balloon'},
{'device': 'unix', 'alias': 'channel0', 'deviceType': 'channel', 'type':
'channel', 'address': {'bus': '0', 'controller': '0', 'type':
'virtio-serial', 'port': '1'}}, {'device': 'unix', 'alias': 'channel1',
'deviceType': 'channel', 'type': 'channel', 'address': {'bus': '0',
'controller': '0', 'type': 'virtio-serial', 'port': '2'}}, {'index':
'0', 'alias': u'scsi0', 'specParams': {}, 'deviceType': 'controller',
'deviceId': '2a313e5e-d4c6-495a-b74d-5a48dad219f9', 'address': {u'slot':
u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci',
u'function': u'0x0'}, 'device': 'scsi', 'model': 'virtio-scsi', 'type':
'controller'}, {'alias': u'virtio-serial0', 'specParams': {},
'deviceType': 'controller', 'deviceId':
'17eec938-fbc3-466b-90c1-17114ad8fefd', 'address': {u'slot': u'0x07',
u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function':
u'0x0'}, 'device': 'virtio-serial', 'type': 'controller'}
 , {'device': 'usb', 'alias': u'usb0', 'deviceType': 'controller',
'type': 'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00',
u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {'device':
'ide', 'alias': u'ide0', 'deviceType': 'controller', 'type':
'controller', 'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain':
u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {'alias': 'video0',
'specParams': {'vram': '32768', 'heads': '1'}, 'deviceType': 'video',
'deviceId': 'a2a91897-2cac-46e2-9d21-5e420f3a2ef7', 'address': {'slot':
'0x02', 'bus': '0x00', 'domain': '0x0000', 'type': 'pci', 'function':
'0x0'}, 'device': 'cirrus', 'type': 'video'}, {'device': 'vnc',
'specParams': {'displayNetwork': 'ovirtmgmt', 'keyMap': 'en-gb',
'displayIp': '10.10.10.228', 'spiceSecureChannels':
'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard'}, 'deviceType': 'graphics', 'type': 'graphics', 'port': u'5929'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:8f:8b:
 14', 'linkActive': True, 'network': 'SalMan', 'alias': u'net0',
'filter': 'vdsm-no-mac-spoofing', 'specParams': {'inbound': {},
'outbound': {}}, 'deviceType': 'interface', 'deviceId':
'da869900-305c-46b2-87f0-833840c3e512', 'address': {u'slot': u'0x03',
u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function':
u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet57'},
{'nicModel': 'pv', 'macAddr': '00:1a:4a:8f:8b:15', 'linkActive': True,
'network': 'DSVRMan', 'alias': u'net1', 'filter':
'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}},
'deviceType': 'interface', 'deviceId':
'3e7fbd28-96e3-4111-a8c2-77b33ded773f', 'address': {u'slot': u'0x04',
u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function':
u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet64'},
{'nicModel': 'pv', 'macAddr': '00:1a:4a:8f:8b:16', 'linkActive': True,
'network': 'DSVR_832', 'alias': u'net2', 'filter':
'vdsm-no-mac-spoofing', 'specParam
 s': {'inbound': {}, 'outbound': {}}, 'deviceType': 'interface',
'deviceId': '3546e9d0-4288-490a-bbb4-17f24fed1dd5', 'address': {u'slot':
u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci',
u'function': u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name':
u'vnet65'}, {'nicModel': 'pv', 'macAddr': '00:1a:4a:8f:8b:17',
'linkActive': True, 'network': 'DSVR_835', 'alias': u'net3', 'filter':
'vdsm-no-mac-spoofing', 'specParams': {'inbound': {}, 'outbound': {}},
'deviceType': 'interface', 'deviceId':
'4e586a4a-d620-4e4c-a1e3-bdd0958ab56c', 'address': {u'slot': u'0x08',
u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function':
u'0x0'}, 'device': 'bridge', 'type': 'interface', 'name': u'vnet66'},
{'index': '2', 'iface': 'ide', 'name': u'hdc', 'alias': u'ide0-1-0',
'bootOrder': u'1', 'specParams': {'path': 'Mik-6.26.iso'}, 'readonly':
'True', 'deviceType': 'disk', 'deviceId':
'2da7ceb2-0fc7-4b78-88c7-2bd0c1fa4d37', 'address': {u'bus': u'1',
u'controller': 
 u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, 'device':
'cdrom', 'shared': 'false', 'path': '', 'type': 'disk'}, {'poolID':
'00000002-0002-0002-0002-0000000001a1', 'volumeInfo': {'domainID':
'7423c49d-0d67-43af-ac2c-d225eb9b22de', 'volType': 'path',
'leaseOffset': 0, 'volumeID': u'8568fca9-f857-419b-ab4b-ca3729d108d4',
'leasePath':
u'/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4.lease', 'imageID': '6f9a8a62-8419-48ba-9642-0bee23a06d06', 'path': u'/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4'}, 'index': 0, 'iface': 'ide', 'apparentsize': '1073741824', 'alias': u'ide0-0-0', 'imageID': '6f9a8a62-8419-48ba-9642-0bee23a06d06', 'readonly': 'False', 'deviceType': 'disk', 'shared': 'false', 'truesize': '1073745920', 'type': 
 'disk', 'domainID': '7423c49d-0d67-43af-ac2c-d225eb9b22de', 'reqsize':
'0', 'format': 'raw', 'deviceId':
'6f9a8a62-8419-48ba-9642-0bee23a06d06', 'address': {u'bus': u'0',
u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'},
'device': 'disk', 'path':
u'/rhev/data-center/00000002-0002-0002-0002-0000000001a1/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4', 'propagateErrors': 'off', 'optional': 'false', 'name': u'hda', 'volumeID': '8568fca9-f857-419b-ab4b-ca3729d108d4', 'specParams': {}, 'volumeChain': [{'domainID': '7423c49d-0d67-43af-ac2c-d225eb9b22de', 'volType': 'path', 'leaseOffset': 0, 'volumeID': u'8568fca9-f857-419b-ab4b-ca3729d108d4', 'leasePath': u'/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4.lease', 'imageID': '6f9a8a62-8419-48ba-9642-0bee23a06d06', 'path
 ':
u'/rhev/data-center/mnt/ov1-nfs.domain.dom:_OV1Storage/7423c49d-0d67-43af-ac2c-d225eb9b22de/images/6f9a8a62-8419-48ba-9642-0bee23a06d06/8568fca9-f857-419b-ab4b-ca3729d108d4'}]}], 'timeOffset': '0', 'maxVCpus': '16', 'spiceSecureChannels': 'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', 'display': 'vnc'}]

[root at ovman ~]# cat /var/log/ovirt-engine/engine.log|grep MY_VM
2015-03-18 15:41:48,520 INFO
[org.ovirt.engine.core.bll.UpdateVmCommand] (ajp--127.0.0.1-8702-7)
[53bddfa0] Lock Acquired to object EngineLock [exclusiveLocks= key:
MY_VM value: VM_NAME

2015-03-18 15:41:48,668 INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(ajp--127.0.0.1-8702-7) [53bddfa0] Correlation ID: 53bddfa0, Job ID:
884157e6-1e53-47cc-9bd3-2763ae252509, Call Stack: null, Custom Event ID:
-1, Message: VM MY_VM configuration was updated by admin at internal.

2015-03-18 15:41:48,679 INFO
[org.ovirt.engine.core.bll.UpdateVmCommand] (ajp--127.0.0.1-8702-7)
[53bddfa0] Lock freed to object EngineLock [exclusiveLocks= key: MY_VM
value: VM_NAME

2015-03-18 15:41:57,058 INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(ajp--127.0.0.1-8702-2) [301cf038] Correlation ID: 301cf038, Call Stack:
null, Custom Event ID: -1, Message: user admin at internal initiated
console session for VM MY_VM

2015-03-18 15:42:10,836 INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(org.ovirt.thread.pool-8-thread-18) [707f8b78] Correlation ID: 707f8b78,
Job ID: de95278f-639a-4837-b657-8773b3436858, Call Stack: null, Custom
Event ID: -1, Message: Migration started (VM: MY_VM, Source:
hosted_engine_2, Destination: hosted_engine_1, User: admin at internal).

2015-03-18 15:42:13,175 INFO
[org.ovirt.engine.core.vdsbroker.vdsbroker.FullListVdsCommand]
(DefaultQuartzScheduler_Worker-2) FINISH, FullListVdsCommand, return:
[{acpiEnable=true, emulatedMachine=rhel6.5.0, afterMigrationStatus=,
tabletEnable=true, pid=25551, memGuaranteedSize=2048,
transparentHugePages=true, displayPort=5929, displaySecurePort=-1,
spiceSslCipherSuite=DEFAULT, cpuType=SandyBridge, smp=2, custom={},
vmType=kvm, memSize=2048, smpCoresPerSocket=1, vmName=MY_VM, nice=0,
status=Migration Source, bootMenuEnable=false, guestDiskMapping={},
vmId=b44b2182-f943-4987-8421-8a98fd2a04d4, displayIp=10.10.10.228,
cdrom=, smartcardEnable=false, clientIp=, nicModel=rtl8139,pv,
keyboardLayout=en-gb, kvmEnable=true, pitReinjection=false,
displayNetwork=ovirtmgmt, devices=[Ljava.lang.Object;@5edb8168,
timeOffset=0, maxVCpus=16,
spiceSecureChannels=smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard, display=vnc}], log id: 28628ffe

2015-03-18 15:42:16,473 INFO
[org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
(DefaultQuartzScheduler_Worker-22) VM MY_VM
b44b2182-f943-4987-8421-8a98fd2a04d4 moved from MigratingFrom --> Up

2015-03-18 15:42:16,699 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(org.ovirt.thread.pool-8-thread-27) Correlation ID: 707f8b78, Job ID:
de95278f-639a-4837-b657-8773b3436858, Call Stack: null, Custom Event ID:
-1, Message: Migration failed due to Error: Fatal error during
migration. Trying to migrate to another Host (VM: MY_VM, Source:
hosted_engine_2, Destination: hosted_engine_1).

2015-03-18 15:42:16,787 WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(org.ovirt.thread.pool-8-thread-27) Correlation ID: 707f8b78, Job ID:
de95278f-639a-4837-b657-8773b3436858, Call Stack: null, Custom Event ID:
-1, Message: Migration failed, No available host found (VM: MY_VM,
Source: hosted_engine_2).





More information about the Users mailing list