On Fri, Nov 06, 2015 at 02:37:56PM -0500, Jason Keltz wrote:
On 11/06/2015 02:02 PM, Simone Tiraboschi wrote:
On Fri, Nov 6, 2015 at 5:21 PM, Jason Keltz <jas@cse.yorku.ca <mailto:jas@cse.yorku.ca>> wrote:
Hi.
Last night, I upgraded my engine from 3.5 to 3.6. That went flawlessly. Today, I'm trying to upgrade the vdsm on the hosts from 3.5 to 3.6 (along with applying other RHEL7.1 updates) However, when I'm trying to put each host into maintenance mode, and migrations start to occur, they all seem to FAIL now! Even worse, when they fail, it leaves the hosts DOWN! If there's a failure, I'd expect the host to simply abort the migration.... Any help in debugging this would be VERY much appreciated!
2015-11-06 10:09:16,065 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-4) [] Correlation ID: 658ba478, Job ID: 524e8c44-04e0-42d3-89f9-9f4e4d397583, Call Stack: null, Custom Event ID: -1, Message: Migration failed (VM: eportfolio, Source: virt1). 2015-11-06 10:10:17,112 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-22) [2f0dee16] Correlation ID: 7da3ac1b, Job ID: 93c0b1f2-4c8e-48cf-9e63-c1ba91be425f, Call Stack: null, Custom Event ID: -1, Message: Migration failed (VM: ftp1, Source: virt1). 2015-11-06 10:15:08,273 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-45) [] Correlation ID: 5394ef76, Job ID: 994065fc-a142-4821-934a-c2297d86ec12, Call Stack: null, Custom Event ID: -1, Message: Migration failed while Host is in 'preparing for maintenance' state. 2015-11-06 10:19:13,712 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-36) [] Correlation ID: 6e422728, Job ID: 994065fc-a142-4821-934a-c2297d86ec12, Call Stack: null, Custom Event ID: -1, Message: Migration failed while Host is in 'preparing for maintenance' state. 2015-11-06 10:42:37,852 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-12) [] Correlation ID: e7f6300, Job ID: 1ea16622-0fa0-4e92-89e5-9dc235c03ef8, Call Stack: null, Custom Event ID: -1, Message: Migration failed (VM: ipa, Source: virt1). 2015-11-06 10:43:59,732 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-40) [] Correlation ID: 39cfdf9, Job ID: 72be29bc-a02b-4a90-b5ec-8b995c2fa692, Call Stack: null, Custom Event ID: -1, Message: Migration failed (VM: labtesteval, Source: virt1). 2015-11-06 10:52:11,893 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-23) [] Correlation ID: 5c435149, Job ID: 1dcd1e14-baa6-44bc-a853-5d33107b759c, Call Stack: null, Custom Event ID: -1, Message: Migration failed (VM: www-vhost, Source: virt1).
The complete engine log, virt1, virt2, and virt3 vdsm logs are here:
http://www.eecs.yorku.ca/~jas/ovirt-debug/11062015 <http://www.eecs.yorku.ca/%7Ejas/ovirt-debug/11062015>
Is vdsmd service still active on that hosts?
Hi Simone..
Yes..
It seems that 3.6's vdsm-4.17.10.1 cannot consume a Random Number Generator device that was created on 3.5. Please open a bug on this - it should be fixed ASAP. Thread-156::DEBUG::2015-11-06 10:43:19,134::__init__::503::jsonrpc.JsonRpcServer::(_serveRequest) Calling 'VM.migrationCreate' in bridge with [u'77766cb4-0625-4432-a16f-def5e702102a', {u'guestFQDN': u'', u'acpiEnable': u'true', u'emulatedMachine': u'rhel6.5.0', u'afterMigrationStatus': u'', u'spiceSecureChannels': u'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard', u'vmId': u'77766cb4-0625-4432-a16f-def5e702102a', u'memGuaranteedSize': 666, u'transparentHugePages': u'true', u'displaySecurePort': u'5905', u'spiceSslCipherSuite': u'DEFAULT', u'cpuType': u'SandyBridge', u'smp': u'1', u'migrationDest': u'libvirt', u'custom': {u'device_652f5624-9607-43b3-9cb1-d4b60145858cdevice_f6cf6e79-c87b-4859-ac35-90f21e402d06': u'VmDevice {vmId=77766cb4-0625-4432-a16f-def5e702102a, deviceId=f6cf6e79-c87b-4859-ac35-90f21e402d06, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=1}, managed=false, plugged=true, readOnly=false, deviceAlias=channel0, customProperties={}, snapshotId=null, logicalName=null}', u'device_652f5624-9607-43b3-9cb1-d4b60145858c': u'VmDevice {vmId=77766cb4-0625-4432-a16f-def5e702102a, deviceId=652f5624-9607-43b3-9cb1-d4b60145858c, device=ide, type=CONTROLLER, bootOrder=0, specParams={}, address={slot=0x01, bus=0x00, domain=0x0000, type=pci, function=0x1}, managed=false, plugged=true, readOnly=false, deviceAlias=ide0, customProperties={}, snapshotId=null, logicalName=null}', u'device_652f5624-9607-43b3-9cb1-d4b60145858cdevice_f6cf6e79-c87b-4859-ac35-90f21e402d06device_ebc927d9-a3b8-48db-b7d4-2bc05463debcdevice_3f79972b-2fd4-468e-abde-8b448c2121c4': u'VmDevice {vmId=77766cb4-0625-4432-a16f-def5e702102a, deviceId=3f79972b-2fd4-468e-abde-8b448c2121c4, device=spicevmc, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=3}, managed=false, plugged=true, readOnly=false, deviceAlias=channel2, customProperties={}, snapshotId=null, logicalName=null}', u'device_652f5624-9607-43b3-9cb1-d4b60145858cdevice_f6cf6e79-c87b-4859-ac35-90f21e402d06device_ebc927d9-a3b8-48db-b7d4-2bc05463debc': u'VmDevice {vmId=77766cb4-0625-4432-a16f-def5e702102a, deviceId=ebc927d9-a3b8-48db-b7d4-2bc05463debc, device=unix, type=CHANNEL, bootOrder=0, specParams={}, address={bus=0, controller=0, type=virtio-serial, port=2}, managed=false, plugged=true, readOnly=false, deviceAlias=channel1, customProperties={}, snapshotId=null, logicalName=null}'}, u'vmType': u'kvm', u'_srcDomXML': u"<domain type='kvm' id='25'>\n <name>labtesteval</name>\n <uuid>77766cb4-0625-4432-a16f-def5e702102a</uuid>\n <memory unit='KiB'>1024000</memory>\n <currentMemory unit='KiB'>1024000</currentMemory>\n <vcpu placement='static' current='1'>16</vcpu>\n <cputune>\n <shares>1020</shares>\n </cputune>\n <resource>\n <partition>/machine</partition>\n </resource>\n <sysinfo type='smbios'>\n <system>\n <entry name='manufacturer'>oVirt</entry>\n <entry name='product'>oVirt Node</entry>\n <entry name='version'>7-1.1503.el7.centos.2.8</entry>\n <entry name='serial'>4C4C4544-0034-4E10-8031-B6C04F445A31</entry>\n <entry name='uuid'>77766cb4-0625-4432-a16f-def5e702102a</entry>\n </system>\n </sysinfo>\n <os>\n <type arch='x86_64' machine='rhel6.5.0'>hvm</type>\n <smbios mode='sysinfo'/>\n </os>\n <features>\n <acpi/>\n </features>\n <cpu mode='custom' match='exact'>\n <model fallback='allow'>SandyBridge</model>\n <topology sockets='16' cores='1' threads='1'/>\n </cpu>\n <clock offset='variable' adjustment='-18000' basis='utc'>\n <timer name='rtc' tickpolicy='catchup'/>\n <timer name='pit' tickpolicy='delay'/>\n <timer name='hpet' present='no'/>\n </clock>\n <on_poweroff>destroy</on_poweroff>\n <on_reboot>restart</on_reboot>\n <on_crash>destroy</on_crash>\n <devices>\n <emulator>/usr/libexec/qemu-kvm</emulator>\n <disk type='file' device='cdrom'>\n <driver name='qemu' type='raw'/>\n <source startupPolicy='optional'/>\n <backingStore/>\n <target dev='hdc' bus='ide'/>\n <readonly/>\n <serial></serial>\n <alias name='ide0-1-0'/>\n <address type='drive' controller='0' bus='1' target='0' unit='0'/>\n </disk>\n <disk type='file' device='disk' snapshot='no'>\n <driver name='qemu' type='raw' cache='none' error_policy='stop' io='threads'/>\n <source file='/rhev/data-center/aca61eac-ed8a-484b-bbee-3645148f6405/c8653dba-63ec-4447-872c-0ffcc6af9c0f/images/15552565-cde9-46f1-b5fa-988aa0e5977f/c33da882-d20e-43b8-8aee-ea8ddcd1f3a0'>\n <seclabel model='selinux' labelskip='yes'/>\n </source>\n <backingStore/>\n <target dev='vda' bus='virtio'/>\n <serial>15552565-cde9-46f1-b5fa-988aa0e5977f</serial>\n <boot order='1'/>\n <alias name='virtio-disk0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>\n </disk>\n <disk type='file' device='disk' snapshot='no'>\n <driver name='qemu' type='raw' cache='none' error_policy='stop' io='threads'/>\n <source file='/rhev/data-center/aca61eac-ed8a-484b-bbee-3645148f6405/c8653dba-63ec-4447-872c-0ffcc6af9c0f/images/663cbb1a-95a2-445d-b32c-1e34299ea6e3/755ab7bb-dbe8-47be-b663-a47fc4b3c571'>\n <seclabel model='selinux' labelskip='yes'/>\n </source>\n <backingStore/>\n <target dev='vdb' bus='virtio'/>\n <serial>663cbb1a-95a2-445d-b32c-1e34299ea6e3</serial>\n <alias name='virtio-disk1'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>\n </disk>\n <controller type='scsi' index='0' model='virtio-scsi'>\n <alias name='scsi0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>\n </controller>\n <controller type='virtio-serial' index='0' ports='16'>\n <alias name='virtio-serial0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>\n </controller>\n <controller type='ide' index='0'>\n <alias name='ide0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>\n </controller>\n <controller type='usb' index='0'>\n <alias name='usb0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>\n </controller>\n <controller type='pci' index='0' model='pci-root'>\n <alias name='pci.0'/>\n </controller>\n <interface type='bridge'>\n <mac address='00:1a:4a:32:3d:21'/>\n <source bridge='yorku'/>\n <bandwidth>\n </bandwidth>\n <target dev='vnet10'/>\n <model type='virtio'/>\n <filterref filter='vdsm-no-mac-spoofing'/>\n <link state='up'/>\n <alias name='net0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>\n </interface>\n <interface type='bridge'>\n <mac address='00:1a:4a:32:3d:22'/>\n <source bridge='mrpriv'/>\n <bandwidth>\n </bandwidth>\n <target dev='vnet11'/>\n <model type='virtio'/>\n <filterref filter='vdsm-no-mac-spoofing'/>\n <link state='up'/>\n <alias name='net1'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>\n </interface>\n <channel type='unix'>\n <source mode='bind' path='/var/lib/libvirt/qemu/channels/77766cb4-0625-4432-a16f-def5e702102a.com.redhat.rhevm.vdsm'/>\n <target type='virtio' name='com.redhat.rhevm.vdsm' state='disconnected'/>\n <alias name='channel0'/>\n <address type='virtio-serial' controller='0' bus='0' port='1'/>\n </channel>\n <channel type='unix'>\n <source mode='bind' path='/var/lib/libvirt/qemu/channels/77766cb4-0625-4432-a16f-def5e702102a.org.qemu.guest_agent.0'/>\n <target type='virtio' name='org.qemu.guest_agent.0' state='disconnected'/>\n <alias name='channel1'/>\n <address type='virtio-serial' controller='0' bus='0' port='2'/>\n </channel>\n <channel type='spicevmc'>\n <target type='virtio' name='com.redhat.spice.0' state='disconnected'/>\n <alias name='channel2'/>\n <address type='virtio-serial' controller='0' bus='0' port='3'/>\n </channel>\n <input type='mouse' bus='ps2'/>\n <input type='keyboard' bus='ps2'/>\n <graphics type='spice' tlsPort='5905' autoport='yes' keymap='en-us' passwdValidTo='2015-11-03T00:37:31' connected='disconnect'>\n <listen type='network' address='130.63.94.34' network='vdsm-yorku'/>\n <channel name='main' mode='secure'/>\n <channel name='display' mode='secure'/>\n <channel name='inputs' mode='secure'/>\n <channel name='cursor' mode='secure'/>\n <channel name='playback' mode='secure'/>\n <channel name='record' mode='secure'/>\n <channel name='smartcard' mode='secure'/>\n <channel name='usbredir' mode='secure'/>\n </graphics>\n <video>\n <model type='qxl' ram='65536' vram='32768' vgamem='16384' heads='1'/>\n <alias name='video0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>\n </video>\n <memballoon model='virtio'>\n <alias name='balloon0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x09' function='0x0'/>\n </memballoon>\n <rng model='virtio'>\n <backend model='random'>/dev/random</backend>\n <alias name='rng0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x0a' function='0x0'/>\n </rng>\n </devices>\n <seclabel type='dynamic' model='selinux' relabel='yes'>\n <label>system_u:system_r:svirt_t:s0:c91,c286</label>\n <imagelabel>system_u:object_r:svirt_image_t:s0:c91,c286</imagelabel>\n </seclabel>\n</domain>\n", u'memSize': 1000, u'smpCoresPerSocket': u'1', u'vmName': u'labtesteval', u'nice': u'0', u'username': u'Unknown', u'bootMenuEnable': u'false', u'guestDiskMapping': {}, u'copyPasteEnable': u'true', u'displayIp': u'130.63.94.34', u'keyboardLayout': u'en-us', u'displayPort': u'-1', u'smartcardEnable': u'false', u'clientIp': u'', u'fileTransferEnable': u'true', u'nicModel': u'rtl8139,pv', u'elapsedTimeOffset': 308058.1552519798, u'kvmEnable': u'true', u'displayNetwork': u'yorku', u'devices': [{u'target': 1024000, u'specParams': {u'model': u'virtio'}, u'alias': u'balloon0', u'deviceId': u'f8d2d555-df6b-4ce1-ac08-18eee4e74845', u'address': {u'slot': u'0x09', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, u'device': u'memballoon', u'type': u'balloon'}, {u'alias': u'rng0', u'specParams': {u'source': u'random'}, u'deviceId': u'eb6d7c3a-c1ee-426b-a719-a949621808cc', u'address': {u'slot': u'0x0a', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, u'model': u'virtio', u'type': u'rng'}, {u'device': u'', u'alias': u'rng0', u'type': u'rng', u'address': {u'slot': u'0x0a', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}}, {u'device': u'unix', u'alias': u'channel0', u'type': u'channel', u'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'1'}}, {u'device': u'unix', u'alias': u'channel1', u'type': u'channel', u'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'2'}}, {u'device': u'spicevmc', u'alias': u'channel2', u'type': u'channel', u'address': {u'bus': u'0', u'controller': u'0', u'type': u'virtio-serial', u'port': u'3'}}, {u'index': u'0', u'alias': u'scsi0', u'specParams': {}, u'deviceId': u'3beb42a9-69b5-454d-b9f8-326509d23984', u'address': {u'slot': u'0x05', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, u'device': u'scsi', u'model': u'virtio-scsi', u'type': u'controller'}, {u'specParams': {}, u'alias': u'virtio-serial0', u'deviceId': u'dee9b89f-5518-4349-b885-918774e6eb3e', u'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, u'device': u'virtio-serial', u'type': u'controller'}, {u'device': u'usb', u'alias': u'usb0', u'type': u'controller', u'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x2'}}, {u'device': u'ide', u'alias': u'ide0', u'type': u'controller', u'address': {u'slot': u'0x01', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x1'}}, {u'specParams': {u'vram': u'32768', u'heads': u'1'}, u'alias': u'video0', u'deviceId': u'f54f3bd7-2a59-4c25-90ed-30b40621e28a', u'address': {u'slot': u'0x02', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, u'device': u'qxl', u'type': u'video'}, {u'device': u'spice', u'specParams': {u'copyPasteEnable': u'true', u'displayNetwork': u'yorku', u'keyMap': u'en-us', u'displayIp': u'130.63.94.34', u'spiceSecureChannels': u'smain,sinputs,scursor,splayback,srecord,sdisplay,susbredir,ssmartcard'}, u'type': u'graphics', u'tlsPort': u'5905'}, {u'nicModel': u'pv', u'macAddr': u'00:1a:4a:32:3d:21', u'linkActive': True, u'network': u'yorku', u'specParams': {u'inbound': {}, u'outbound': {}}, u'filter': u'vdsm-no-mac-spoofing', u'alias': u'net0', u'deviceId': u'aed60117-08a1-4ba3-a7fd-e1b7b57202be', u'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, u'device': u'bridge', u'type': u'interface', u'name': u'vnet10'}, {u'nicModel': u'pv', u'macAddr': u'00:1a:4a:32:3d:22', u'linkActive': True, u'network': u'mrpriv', u'specParams': {u'inbound': {}, u'outbound': {}}, u'filter': u'vdsm-no-mac-spoofing', u'alias': u'net1', u'deviceId': u'72f26169-9052-4d52-8d95-c1c084bd4916', u'address': {u'slot': u'0x04', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, u'device': u'bridge', u'type': u'interface', u'name': u'vnet11'}, {u'index': u'2', u'iface': u'ide', u'name': u'hdc', u'alias': u'ide0-1-0', u'specParams': {u'path': u''}, u'readonly': u'True', u'deviceId': u'f2509c75-eb84-4e89-b6c3-83a26a65cc6a', u'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, u'device': u'cdrom', u'shared': u'false', u'path': u'', u'type': u'disk'}, {u'poolID': u'aca61eac-ed8a-484b-bbee-3645148f6405', u'volumeInfo': {u'domainID': u'c8653dba-63ec-4447-872c-0ffcc6af9c0f', u'volType': u'path', u'leaseOffset': 0, u'volumeID': u'c33da882-d20e-43b8-8aee-ea8ddcd1f3a0', u'leasePath': u'/rhev/data-center/mnt/virtfs-fs:_nfs_data/c8653dba-63ec-4447-872c-0ffcc6af9c0f/images/15552565-cde9-46f1-b5fa-988aa0e5977f/c33da882-d20e-43b8-8aee-ea8ddcd1f3a0.lease', u'imageID': u'15552565-cde9-46f1-b5fa-988aa0e5977f', u'path': u'/rhev/data-center/mnt/virtfs-fs:_nfs_data/c8653dba-63ec-4447-872c-0ffcc6af9c0f/images/15552565-cde9-46f1-b5fa-988aa0e5977f/c33da882-d20e-43b8-8aee-ea8ddcd1f3a0'}, u'index': 0, u'iface': u'virtio', u'apparentsize': u'42949672960', u'specParams': {}, u'imageID': u'15552565-cde9-46f1-b5fa-988aa0e5977f', u'readonly': u'False', u'shared': u'false', u'truesize': u'14287695872', u'type': u'disk', u'domainID': u'c8653dba-63ec-4447-872c-0ffcc6af9c0f', u'reqsize': u'0', u'format': u'raw', u'deviceId': u'15552565-cde9-46f1-b5fa-988aa0e5977f', u'address': {u'slot': u'0x07', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, u'device': u'disk', u'path': u'/rhev/data-center/aca61eac-ed8a-484b-bbee-3645148f6405/c8653dba-63ec-4447-872c-0ffcc6af9c0f/images/15552565-cde9-46f1-b5fa-988aa0e5977f/c33da882-d20e-43b8-8aee-ea8ddcd1f3a0', u'propagateErrors': u'off', u'optional': u'false', u'name': u'vda', u'bootOrder': u'1', u'volumeID': u'c33da882-d20e-43b8-8aee-ea8ddcd1f3a0', u'alias': u'virtio-disk0', u'volumeChain': [{u'domainID': u'c8653dba-63ec-4447-872c-0ffcc6af9c0f', u'volType': u'path', u'leaseOffset': 0, u'volumeID': u'c33da882-d20e-43b8-8aee-ea8ddcd1f3a0', u'leasePath': u'/rhev/data-center/mnt/virtfs-fs:_nfs_data/c8653dba-63ec-4447-872c-0ffcc6af9c0f/images/15552565-cde9-46f1-b5fa-988aa0e5977f/c33da882-d20e-43b8-8aee-ea8ddcd1f3a0.lease', u'imageID': u'15552565-cde9-46f1-b5fa-988aa0e5977f', u'path': u'/rhev/data-center/mnt/virtfs-fs:_nfs_data/c8653dba-63ec-4447-872c-0ffcc6af9c0f/images/15552565-cde9-46f1-b5fa-988aa0e5977f/c33da882-d20e-43b8-8aee-ea8ddcd1f3a0'}]}, {u'poolID': u'aca61eac-ed8a-484b-bbee-3645148f6405', u'reqsize': u'0', u'index': u'1', u'iface': u'virtio', u'apparentsize': u'21474836480', u'specParams': {}, u'imageID': u'663cbb1a-95a2-445d-b32c-1e34299ea6e3', u'readonly': u'False', u'shared': u'false', u'truesize': u'476389376', u'type': u'disk', u'domainID': u'c8653dba-63ec-4447-872c-0ffcc6af9c0f', u'volumeInfo': {u'domainID': u'c8653dba-63ec-4447-872c-0ffcc6af9c0f', u'volType': u'path', u'leaseOffset': 0, u'volumeID': u'755ab7bb-dbe8-47be-b663-a47fc4b3c571', u'leasePath': u'/rhev/data-center/mnt/virtfs-fs:_nfs_data/c8653dba-63ec-4447-872c-0ffcc6af9c0f/images/663cbb1a-95a2-445d-b32c-1e34299ea6e3/755ab7bb-dbe8-47be-b663-a47fc4b3c571.lease', u'imageID': u'663cbb1a-95a2-445d-b32c-1e34299ea6e3', u'path': u'/rhev/data-center/mnt/virtfs-fs:_nfs_data/c8653dba-63ec-4447-872c-0ffcc6af9c0f/images/663cbb1a-95a2-445d-b32c-1e34299ea6e3/755ab7bb-dbe8-47be-b663-a47fc4b3c571'}, u'format': u'raw', u'deviceId': u'663cbb1a-95a2-445d-b32c-1e34299ea6e3', u'address': {u'slot': u'0x08', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, u'device': u'disk', u'path': u'/rhev/data-center/aca61eac-ed8a-484b-bbee-3645148f6405/c8653dba-63ec-4447-872c-0ffcc6af9c0f/images/663cbb1a-95a2-445d-b32c-1e34299ea6e3/755ab7bb-dbe8-47be-b663-a47fc4b3c571', u'propagateErrors': u'off', u'optional': u'false', u'name': u'vdb', u'volumeID': u'755ab7bb-dbe8-47be-b663-a47fc4b3c571', u'alias': u'virtio-disk1', u'volumeChain': [{u'domainID': u'c8653dba-63ec-4447-872c-0ffcc6af9c0f', u'volType': u'path', u'leaseOffset': 0, u'volumeID': u'755ab7bb-dbe8-47be-b663-a47fc4b3c571', u'leasePath': u'/rhev/data-center/mnt/virtfs-fs:_nfs_data/c8653dba-63ec-4447-872c-0ffcc6af9c0f/images/663cbb1a-95a2-445d-b32c-1e34299ea6e3/755ab7bb-dbe8-47be-b663-a47fc4b3c571.lease', u'imageID': u'663cbb1a-95a2-445d-b32c-1e34299ea6e3', u'path': u'/rhev/data-center/mnt/virtfs-fs:_nfs_data/c8653dba-63ec-4447-872c-0ffcc6af9c0f/images/663cbb1a-95a2-445d-b32c-1e34299ea6e3/755ab7bb-dbe8-47be-b663-a47fc4b3c571'}]}], u'status': u'Up', u'timeOffset': u'-18000', u'maxVCpus': u'16', u'guestIPs': u'', u'statusTime': u'9387795610', u'display': u'qxl'}] Thread-157::ERROR::2015-11-06 10:43:54,839::vm::751::virt.vm::(_startUnderlyingVm) vmId=`77766cb4-0625-4432-a16f-def5e702102a`::The vm start process failed Traceback (most recent call last): File "/usr/share/vdsm/virt/vm.py", line 714, in _startUnderlyingVm self._completeIncomingMigration() File "/usr/share/vdsm/virt/vm.py", line 2762, in _completeIncomingMigration self._domDependentInit() File "/usr/share/vdsm/virt/vm.py", line 1733, in _domDependentInit self._getUnderlyingVmDevicesInfo() File "/usr/share/vdsm/virt/vm.py", line 1680, in _getUnderlyingVmDevicesInfo self._getUnderlyingRngDeviceInfo() File "/usr/share/vdsm/virt/vm.py", line 4064, in _getUnderlyingRngDeviceInfo if caps.RNG_SOURCES[dev.specParams['source']] == source and \ KeyError: 'source'