
20 Sep
2012
20 Sep
'12
11:55 a.m.
--0__=C9BBF0ECDFA610B98f9e8a93df938690918cC9BBF0ECDFA610B9 Content-type: text/plain; charset=US-ASCII Content-transfer-encoding: quoted-printable Hello, I have two oVirt nodes ovirt-node-iso-2.5.0-2.0.fc17. When I try to migrate VM from one host to another, I have an error: Migration failed due to Error: Fatal error during migration. vdsm.log: Thread-3797::DEBUG::2012-09-20 09:42:56,439::BindingXMLRPC::859::vds::(wrapper) client [192.168.10.10]::call vmMigrate with ({'src': '192.168.10.13', 'dst': '192.168.10.12:54321', 'vmId': '2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86', 'method': 'online'},) {} flowID [180ad979] Thread-3797::DEBUG::2012-09-20 09:42:56,439::API::441::vds::(migrate) {'src': '192.168.10.13', 'dst': '192.168.10.12:54321', 'vmId': '2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86', 'method': 'online'} Thread-3798::DEBUG::2012-09-20 09:42:56,441::vm::122::vm.Vm::(_setupVdsConnection) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::Destination server is: 192.168.10.12:54321 Thread-3797::DEBUG::2012-09-20 09:42:56,441::BindingXMLRPC::865::vds::(wrapper) return vmMigrate with {'status': {'message': 'Migration process starting', 'code': 0}} Thread-3798::DEBUG::2012-09-20 09:42:56,441::vm::124::vm.Vm::(_setupVdsConnection) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::Initiating connection wi= th destination Thread-3798::DEBUG::2012-09-20 09:42:56,452::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::Disk hdc stats not avail= able Thread-3798::DEBUG::2012-09-20 09:42:56,457::vm::170::vm.Vm::(_prepareGuest) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::migration Process begins= Thread-3798::DEBUG::2012-09-20 09:42:56,475::vm::217::vm.Vm::(run) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::migration semaphore acqu= ired Thread-3798::DEBUG::2012-09-20 09:42:56,888::libvirtvm::427::vm.Vm::(_startUnderlyingMigration) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::starting migration to qe= mu +tls://192.168.10.12/system Thread-3799::DEBUG::2012-09-20 09:42:56,889::libvirtvm::325::vm.Vm::(ru= n) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::migration downtime threa= d started Thread-3800::DEBUG::2012-09-20 09:42:56,890::libvirtvm::353::vm.Vm::(ru= n) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::starting migration monit= or thread Thread-3798::DEBUG::2012-09-20 09:42:56,903::libvirtvm::340::vm.Vm::(cancel) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::canceling migration down= time thread Thread-3798::DEBUG::2012-09-20 09:42:56,904::libvirtvm::390::vm.Vm::(st= op) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::stopping migration monit= or thread Thread-3799::DEBUG::2012-09-20 09:42:56,904::libvirtvm::337::vm.Vm::(ru= n) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::migration downtime threa= d exiting Thread-3798::ERROR::2012-09-20 09:42:56,905::vm::176::vm.Vm::(_recover)= vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::operation failed: Failed= to connect to remote libvirt URI qemu+tls://192.168.10.12/system Thread-3798::ERROR::2012-09-20 09:42:56,977::vm::240::vm.Vm::(run) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::Failed to migrate Traceback (most recent call last): File "/usr/share/vdsm/vm.py", line 223, in run File "/usr/share/vdsm/libvirtvm.py", line 451, in _startUnderlyingMigration File "/usr/share/vdsm/libvirtvm.py", line 491, in f File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", li= ne 82, in wrapper File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1034, in migrateToURI2 libvirtError: operation failed: Failed to connect to remote libvirt URI= qemu+tls://192.168.10.12/system Thread-3802::DEBUG::2012-09-20 09:42:57,793::BindingXMLRPC::859::vds::(wrapper) client [192.168.10.10]::call vmGetStats with ('2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86',) {} Thread-3802::DEBUG::2012-09-20 09:42:57,793::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::Disk hdc stats not avail= able Thread-3802::DEBUG::2012-09-20 09:42:57,794::BindingXMLRPC::865::vds::(wrapper) return vmGetStats with= {'status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up= ', 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '22047', 'displayIp': '192.168.10.13', 'displayPort': u'5912', 'session= ': 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'hash': '3018874162324753083', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable= ': 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:a8:0a:08', 'rxDropp= ed': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate': '0.0= ', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name': u'vnet6'}= }, 'vmId': '2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86', 'displayType': 'qxl', 'cpuUser': '13.27', 'disks': {u'hdc': {'flushLatency': '0', 'readLatenc= y': '0', 'writeLatency': '0'}, u'hda': {'readLatency': '6183805', 'apparentsize': '11811160064', 'writeLatency': '0', 'imageID': 'd96d19f6-5a28-4fef-892f-4a04549d4e38', 'flushLatency': '0', 'readRate'= : '271.87', 'truesize': '11811160064', 'writeRate': '0.00'}}, 'monitorResponse': '0', 'statsAge': '0.77', 'cpuIdle': '86.73', 'elapsedTime': '3941', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [= ], 'guestIPs': '', 'nice': ''}]} Thread-3803::DEBUG::2012-09-20 09:42:57,869::BindingXMLRPC::859::vds::(wrapper) client [192.168.10.10]::call vmGetMigrationStatus with ('2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86',) {} Thread-3803::DEBUG::2012-09-20 09:42:57,870::BindingXMLRPC::865::vds::(wrapper) return vmGetMigrationStatus with {'status': {'message': 'Fatal error during migration', 'code': 12}} Dummy-1264::DEBUG::2012-09-20 09:42:58,172::__init__::1249::Storage.Misc.excCmd::(_log) 'dd if=3D/rhev/data-center/332694bb-364a-434e-b23f-5fef985d3cbd/mastersd/do= m_md/inbox iflag=3Ddirect,fullblock count=3D1 bs=3D1024000' (cwd None) Dummy-1264::DEBUG::2012-09-20 09:42:58,262::__init__::1249::Storage.Misc.excCmd::(_log) SUCCESS: <err= > =3D '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0515= 109 s, 19.9 MB/s\n'; <rc> =3D 0 Dummy-1264::DEBUG::2012-09-20 09:43:00,271::__init__::1249::Storage.Misc.excCmd::(_log) 'dd if=3D/rhev/data-center/332694bb-364a-434e-b23f-5fef985d3cbd/mastersd/do= m_md/inbox iflag=3Ddirect,fullblock count=3D1 bs=3D1024000' (cwd None) Dummy-1264::DEBUG::2012-09-20 09:43:00,362::__init__::1249::Storage.Misc.excCmd::(_log) SUCCESS: <err= > =3D '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0530= 171 s, 19.3 MB/s\n'; <rc> =3D 0 Thread-21::DEBUG::2012-09-20 09:43:00,612::__init__::1249::Storage.Misc.excCmd::(_log) '/usr/bin/dd iflag=3Ddirect if=3D/dev/26187d25-bfcb-40c7-97d1-667705ad2223/metadata = bs=3D4096 count=3D1' (cwd None) Thread-21::DEBUG::2012-09-20 09:43:00,629::__init__::1249::Storage.Misc.excCmd::(_log) SUCCESS: <err= > =3D '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.0009376= 98 s, 4.4 MB/s\n'; <rc> =3D 0 Thread-3805::DEBUG::2012-09-20 09:43:01,901::task::588::TaskManager.Task::(_updateState) Task=3D`ff134ecc-5597-4a83-81d6-e4f9804871ff`::moving from state init -= > state preparing Thread-3805::INFO::2012-09-20 09:43:01,902::logUtils::37::dispatcher::(wrapper) Run and protect: repoStats(options=3DNone) Thread-3805::INFO::2012-09-20 09:43:01,902::logUtils::39::dispatcher::(wrapper) Run and protect: repoStats, Return response: {'26187d25-bfcb-40c7-97d1-667705ad2223': {'delay': '0.0180931091309', 'lastCheck': 1348134180.825892, 'code': 0,= 'valid': True}, '90104c3d-837b-47dd-8c82-dda92eec30d9': {'delay': '0.000955820083618', 'lastCheck': 1348134175.493277, 'code': 0, 'valid'= : True}} Thread-3805::DEBUG::2012-09-20 09:43:01,902::task::1172::TaskManager.Task::(prepare) Task=3D`ff134ecc-5597-4a83-81d6-e4f9804871ff`::finished: {'26187d25-bfcb-40c7-97d1-667705ad2223': {'delay': '0.0180931091309', 'lastCheck': 1348134180.825892, 'code': 0, 'valid': True}, '90104c3d-837b-47dd-8c82-dda92eec30d9': {'delay': '0.000955820083618', 'lastCheck': 1348134175.493277, 'code': 0, 'valid': True}} Thread-3805::DEBUG::2012-09-20 09:43:01,902::task::588::TaskManager.Task::(_updateState) Task=3D`ff134ecc-5597-4a83-81d6-e4f9804871ff`::moving from state prepar= ing -> state finished Thread-3805::DEBUG::2012-09-20 09:43:01,903::resourceManager::809::ResourceManager.Owner::(releaseAll)= Owner.releaseAll requests {} resources {} Thread-3805::DEBUG::2012-09-20 09:43:01,903::resourceManager::844::ResourceManager.Owner::(cancelAll) Owner.cancelAll requests {} Thread-3805::DEBUG::2012-09-20 09:43:01,903::task::978::TaskManager.Task::(_decref) Task=3D`ff134ecc-5597-4a83-81d6-e4f9804871ff`::ref 0 aborting False Thread-3806::DEBUG::2012-09-20 09:43:01,931::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`540335f0-2269-4bc4-aaf4-11bf5990013f`::Disk hdc stats not avail= able Thread-3806::DEBUG::2012-09-20 09:43:01,931::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`2c3af5f5-f877-4e6b-8a34-05bbe78b3c82`::Disk hdc stats not avail= able Thread-3806::DEBUG::2012-09-20 09:43:01,932::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`0ac0dd3a-ae2a-4963-adf1-918993031f6b`::Disk hdc stats not avail= able Thread-3806::DEBUG::2012-09-20 09:43:01,932::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`35a65bb8-cbca-4049-a428-28914bcb094a`::Disk hdc stats not avail= able Thread-3806::DEBUG::2012-09-20 09:43:01,933::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`4ef3258c-0380-4919-991f-ee7be7e9f7fa`::Disk hdc stats not avail= able Thread-3806::DEBUG::2012-09-20 09:43:01,933::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`252e6d46-f362-46aa-a7ed-dd00a86af6f0`::Disk hdc stats not avail= able Thread-3806::DEBUG::2012-09-20 09:43:01,933::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`509e608c-e657-473a-b031-f0811da96bde`::Disk hdc stats not avail= able Thread-3806::DEBUG::2012-09-20 09:43:01,934::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::Disk hdc stats not avail= able Dummy-1264::DEBUG::2012-09-20 09:43:02,371::__init__::1249::Storage.Misc.excCmd::(_log) 'dd if=3D/rhev/data-center/332694bb-364a-434e-b23f-5fef985d3cbd/mastersd/do= m_md/inbox iflag=3Ddirect,fullblock count=3D1 bs=3D1024000' (cwd None) Dummy-1264::DEBUG::2012-09-20 09:43:02,462::__init__::1249::Storage.Misc.excCmd::(_log) SUCCESS: <err= > =3D '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied, 0.0525= 183 s, 19.5 MB/s\n'; <rc> =3D 0 - -= --0__=C9BBF0ECDFA610B98f9e8a93df938690918cC9BBF0ECDFA610B9 Content-type: text/html; charset=US-ASCII Content-Disposition: inline Content-transfer-encoding: quoted-printable <html><body> <p><font size=3D"2" face=3D"sans-serif">Hello,</font><br> <br> <font size=3D"2" face=3D"sans-serif">I have two oVirt nodes ovirt-node-= iso-2.5.0-2.0.fc17.</font><br> <br> <font size=3D"2" face=3D"sans-serif">When I try to migrate VM from one = host to another, I have an error: Migration failed due to Error: Fatal = error during migration.</font><br> <br> <font size=3D"2" face=3D"sans-serif">vdsm.log:</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3797::DEBUG::2012-09-20 09:= 42:56,439::BindingXMLRPC::859::vds::(wrapper) client [192.168.10.10]::c= all vmMigrate with ({'src': '192.168.10.13', 'dst': '192.168.10.12:5432= 1', 'vmId': '2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86', 'method': 'online'}= ,) {} flowID [180ad979]</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3797::DEBUG::2012-09-20 09:= 42:56,439::API::441::vds::(migrate) {'src': '192.168.10.13', 'dst': '19= 2.168.10.12:54321', 'vmId': '2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86', 'me= thod': 'online'}</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3798::DEBUG::2012-09-20 09:= 42:56,441::vm::122::vm.Vm::(_setupVdsConnection) vmId=3D`2bf3e6eb-49e4-= 42c7-8188-fc2aeeae2e86`::Destination server is: 192.168.10.12:54321</fo= nt><br> <font size=3D"2" face=3D"sans-serif">Thread-3797::DEBUG::2012-09-20 09:= 42:56,441::BindingXMLRPC::865::vds::(wrapper) return vmMigrate with {'s= tatus': {'message': 'Migration process starting', 'code': 0}}</font><br= > <font size=3D"2" face=3D"sans-serif">Thread-3798::DEBUG::2012-09-20 09:= 42:56,441::vm::124::vm.Vm::(_setupVdsConnection) vmId=3D`2bf3e6eb-49e4-= 42c7-8188-fc2aeeae2e86`::Initiating connection with destination</font><= br> <font size=3D"2" face=3D"sans-serif">Thread-3798::DEBUG::2012-09-20 09:= 42:56,452::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`2bf3e6eb-49e4= -42c7-8188-fc2aeeae2e86`::Disk hdc stats not available</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3798::DEBUG::2012-09-20 09:= 42:56,457::vm::170::vm.Vm::(_prepareGuest) vmId=3D`2bf3e6eb-49e4-42c7-8= 188-fc2aeeae2e86`::migration Process begins</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3798::DEBUG::2012-09-20 09:= 42:56,475::vm::217::vm.Vm::(run) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aee= ae2e86`::migration semaphore acquired</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3798::DEBUG::2012-09-20 09:= 42:56,888::libvirtvm::427::vm.Vm::(_startUnderlyingMigration) vmId=3D`2= bf3e6eb-49e4-42c7-8188-fc2aeeae2e86`::starting migration to qemu+tls://= 192.168.10.12/system</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3799::DEBUG::2012-09-20 09:= 42:56,889::libvirtvm::325::vm.Vm::(run) vmId=3D`2bf3e6eb-49e4-42c7-8188= -fc2aeeae2e86`::migration downtime thread started</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3800::DEBUG::2012-09-20 09:= 42:56,890::libvirtvm::353::vm.Vm::(run) vmId=3D`2bf3e6eb-49e4-42c7-8188= -fc2aeeae2e86`::starting migration monitor thread</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3798::DEBUG::2012-09-20 09:= 42:56,903::libvirtvm::340::vm.Vm::(cancel) vmId=3D`2bf3e6eb-49e4-42c7-8= 188-fc2aeeae2e86`::canceling migration downtime thread</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3798::DEBUG::2012-09-20 09:= 42:56,904::libvirtvm::390::vm.Vm::(stop) vmId=3D`2bf3e6eb-49e4-42c7-818= 8-fc2aeeae2e86`::stopping migration monitor thread</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3799::DEBUG::2012-09-20 09:= 42:56,904::libvirtvm::337::vm.Vm::(run) vmId=3D`2bf3e6eb-49e4-42c7-8188= -fc2aeeae2e86`::migration downtime thread exiting</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3798::ERROR::2012-09-20 09:= 42:56,905::vm::176::vm.Vm::(_recover) vmId=3D`2bf3e6eb-49e4-42c7-8188-f= c2aeeae2e86`::operation failed: Failed to connect to remote libvirt URI= qemu+tls://192.168.10.12/system</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3798::ERROR::2012-09-20 09:= 42:56,977::vm::240::vm.Vm::(run) vmId=3D`2bf3e6eb-49e4-42c7-8188-fc2aee= ae2e86`::Failed to migrate</font><br> <font size=3D"2" face=3D"sans-serif">Traceback (most recent call last):= </font><br> <font size=3D"2" face=3D"sans-serif"> File "/usr/share/vdsm/vm.py= ", line 223, in run</font><br> <font size=3D"2" face=3D"sans-serif"> File "/usr/share/vdsm/libvi= rtvm.py", line 451, in _startUnderlyingMigration</font><br> <font size=3D"2" face=3D"sans-serif"> File "/usr/share/vdsm/libvi= rtvm.py", line 491, in f</font><br> <font size=3D"2" face=3D"sans-serif"> File "/usr/lib/python2.7/si= te-packages/vdsm/libvirtconnection.py", line 82, in wrapper</font>= <br> <font size=3D"2" face=3D"sans-serif"> File "/usr/lib64/python2.7/= site-packages/libvirt.py", line 1034, in migrateToURI2</font><br> <font size=3D"2" face=3D"sans-serif">libvirtError: operation failed: Fa= iled to connect to remote libvirt URI qemu+tls://192.168.10.12/system</= font> <ul style=3D"padding-left: 0pt"><font size=3D"2" face=3D"sans-serif">Th= read-3802::DEBUG::2012-09-20 09:42:57,793::BindingXMLRPC::859::vds::(wr= apper) client [192.168.10.10]::call vmGetStats with ('2bf3e6eb-49e4-42c= 7-8188-fc2aeeae2e86',) {}</font></ul> <font size=3D"2" face=3D"sans-serif">Thread-3802::DEBUG::2012-09-20 09:= 42:57,793::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`2bf3e6eb-49e4= -42c7-8188-fc2aeeae2e86`::Disk hdc stats not available</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3802::DEBUG::2012-09-20 09:= 42:57,794::BindingXMLRPC::865::vds::(wrapper) return vmGetStats with {'= status': {'message': 'Done', 'code': 0}, 'statsList': [{'status': 'Up',= 'username': 'Unknown', 'memUsage': '0', 'acpiEnable': 'true', 'pid': '= 22047', 'displayIp': '192.168.10.13', 'displayPort': u'5912', 'session'= : 'Unknown', 'displaySecurePort': u'5913', 'timeOffset': '0', 'hash': '= 3018874162324753083', 'pauseCode': 'NOERR', 'clientIp': '', 'kvmEnable'= : 'true', 'network': {u'vnet6': {'macAddr': '00:1a:4a:a8:0a:08', 'rxDro= pped': '0', 'rxErrors': '0', 'txDropped': '0', 'txRate': '0.0', 'rxRate= ': '0.0', 'txErrors': '0', 'state': 'unknown', 'speed': '1000', 'name':= u'vnet6'}}, 'vmId': '2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86', 'displayTy= pe': 'qxl', 'cpuUser': '13.27', 'disks': {u'hdc': {'flushLatency': '0',= 'readLatency': '0', 'writeLatency': '0'}, u'hda': {'readLatency': '618= 3805', 'apparentsize': '11811160064', 'writeLatency': '0', 'imageID': '= d96d19f6-5a28-4fef-892f-4a04549d4e38', 'flushLatency': '0', 'readRate':= '271.87', 'truesize': '11811160064', 'writeRate': '0.00'}}, 'monitorRe= sponse': '0', 'statsAge': '0.77', 'cpuIdle': '86.73', 'elapsedTime': '3= 941', 'vmType': 'kvm', 'cpuSys': '0.00', 'appsList': [], 'guestIPs': ''= , 'nice': ''}]}</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3803::DEBUG::2012-09-20 09:= 42:57,869::BindingXMLRPC::859::vds::(wrapper) client [192.168.10.10]::c= all vmGetMigrationStatus with ('2bf3e6eb-49e4-42c7-8188-fc2aeeae2e86',)= {}</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3803::DEBUG::2012-09-20 09:= 42:57,870::BindingXMLRPC::865::vds::(wrapper) return vmGetMigrationStat= us with {'status': {'message': 'Fatal error during migration', 'code': = 12}}</font><br> <font size=3D"2" face=3D"sans-serif">Dummy-1264::DEBUG::2012-09-20 09:4= 2:58,172::__init__::1249::Storage.Misc.excCmd::(_log) 'dd if=3D/rhev/da= ta-center/332694bb-364a-434e-b23f-5fef985d3cbd/mastersd/dom_md/inbox if= lag=3Ddirect,fullblock count=3D1 bs=3D1024000' (cwd None)</font><br> <font size=3D"2" face=3D"sans-serif">Dummy-1264::DEBUG::2012-09-20 09:4= 2:58,262::__init__::1249::Storage.Misc.excCmd::(_log) SUCCESS: <err&= gt; =3D '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied= , 0.0515109 s, 19.9 MB/s\n'; <rc> =3D 0</font><br> <font size=3D"2" face=3D"sans-serif">Dummy-1264::DEBUG::2012-09-20 09:4= 3:00,271::__init__::1249::Storage.Misc.excCmd::(_log) 'dd if=3D/rhev/da= ta-center/332694bb-364a-434e-b23f-5fef985d3cbd/mastersd/dom_md/inbox if= lag=3Ddirect,fullblock count=3D1 bs=3D1024000' (cwd None)</font><br> <font size=3D"2" face=3D"sans-serif">Dummy-1264::DEBUG::2012-09-20 09:4= 3:00,362::__init__::1249::Storage.Misc.excCmd::(_log) SUCCESS: <err&= gt; =3D '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied= , 0.0530171 s, 19.3 MB/s\n'; <rc> =3D 0</font><br> <font size=3D"2" face=3D"sans-serif">Thread-21::DEBUG::2012-09-20 09:43= :00,612::__init__::1249::Storage.Misc.excCmd::(_log) '/usr/bin/dd iflag= =3Ddirect if=3D/dev/26187d25-bfcb-40c7-97d1-667705ad2223/metadata bs=3D= 4096 count=3D1' (cwd None)</font><br> <font size=3D"2" face=3D"sans-serif">Thread-21::DEBUG::2012-09-20 09:43= :00,629::__init__::1249::Storage.Misc.excCmd::(_log) SUCCESS: <err&g= t; =3D '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied, 0.= 000937698 s, 4.4 MB/s\n'; <rc> =3D 0</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3805::DEBUG::2012-09-20 09:= 43:01,901::task::588::TaskManager.Task::(_updateState) Task=3D`ff134ecc= -5597-4a83-81d6-e4f9804871ff`::moving from state init -> state prepa= ring</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3805::INFO::2012-09-20 09:4= 3:01,902::logUtils::37::dispatcher::(wrapper) Run and protect: repoStat= s(options=3DNone)</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3805::INFO::2012-09-20 09:4= 3:01,902::logUtils::39::dispatcher::(wrapper) Run and protect: repoStat= s, Return response: {'26187d25-bfcb-40c7-97d1-667705ad2223': {'delay': = '0.0180931091309', 'lastCheck': 1348134180.825892, 'code': 0, 'valid': = True}, '90104c3d-837b-47dd-8c82-dda92eec30d9': {'delay': '0.00095582008= 3618', 'lastCheck': 1348134175.493277, 'code': 0, 'valid': True}}</font= ><br> <font size=3D"2" face=3D"sans-serif">Thread-3805::DEBUG::2012-09-20 09:= 43:01,902::task::1172::TaskManager.Task::(prepare) Task=3D`ff134ecc-559= 7-4a83-81d6-e4f9804871ff`::finished: {'26187d25-bfcb-40c7-97d1-667705ad= 2223': {'delay': '0.0180931091309', 'lastCheck': 1348134180.825892, 'co= de': 0, 'valid': True}, '90104c3d-837b-47dd-8c82-dda92eec30d9': {'delay= ': '0.000955820083618', 'lastCheck': 1348134175.493277, 'code': 0, 'val= id': True}}</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3805::DEBUG::2012-09-20 09:= 43:01,902::task::588::TaskManager.Task::(_updateState) Task=3D`ff134ecc= -5597-4a83-81d6-e4f9804871ff`::moving from state preparing -> state = finished</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3805::DEBUG::2012-09-20 09:= 43:01,903::resourceManager::809::ResourceManager.Owner::(releaseAll) Ow= ner.releaseAll requests {} resources {}</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3805::DEBUG::2012-09-20 09:= 43:01,903::resourceManager::844::ResourceManager.Owner::(cancelAll) Own= er.cancelAll requests {}</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3805::DEBUG::2012-09-20 09:= 43:01,903::task::978::TaskManager.Task::(_decref) Task=3D`ff134ecc-5597= -4a83-81d6-e4f9804871ff`::ref 0 aborting False</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3806::DEBUG::2012-09-20 09:= 43:01,931::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`540335f0-2269= -4bc4-aaf4-11bf5990013f`::Disk hdc stats not available</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3806::DEBUG::2012-09-20 09:= 43:01,931::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`2c3af5f5-f877= -4e6b-8a34-05bbe78b3c82`::Disk hdc stats not available</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3806::DEBUG::2012-09-20 09:= 43:01,932::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`0ac0dd3a-ae2a= -4963-adf1-918993031f6b`::Disk hdc stats not available</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3806::DEBUG::2012-09-20 09:= 43:01,932::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`35a65bb8-cbca= -4049-a428-28914bcb094a`::Disk hdc stats not available</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3806::DEBUG::2012-09-20 09:= 43:01,933::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`4ef3258c-0380= -4919-991f-ee7be7e9f7fa`::Disk hdc stats not available</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3806::DEBUG::2012-09-20 09:= 43:01,933::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`252e6d46-f362= -46aa-a7ed-dd00a86af6f0`::Disk hdc stats not available</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3806::DEBUG::2012-09-20 09:= 43:01,933::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`509e608c-e657= -473a-b031-f0811da96bde`::Disk hdc stats not available</font><br> <font size=3D"2" face=3D"sans-serif">Thread-3806::DEBUG::2012-09-20 09:= 43:01,934::libvirtvm::240::vm.Vm::(_getDiskStats) vmId=3D`2bf3e6eb-49e4= -42c7-8188-fc2aeeae2e86`::Disk hdc stats not available</font><br> <font size=3D"2" face=3D"sans-serif">Dummy-1264::DEBUG::2012-09-20 09:4= 3:02,371::__init__::1249::Storage.Misc.excCmd::(_log) 'dd if=3D/rhev/da= ta-center/332694bb-364a-434e-b23f-5fef985d3cbd/mastersd/dom_md/inbox if= lag=3Ddirect,fullblock count=3D1 bs=3D1024000' (cwd None)</font><br> <font size=3D"2" face=3D"sans-serif">Dummy-1264::DEBUG::2012-09-20 09:4= 3:02,462::__init__::1249::Storage.Misc.excCmd::(_log) SUCCESS: <err&= gt; =3D '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB) copied= , 0.0525183 s, 19.5 MB/s\n'; <rc> =3D 0<br> <br> - -<br> </font></body></html>= --0__=C9BBF0ECDFA610B98f9e8a93df938690918cC9BBF0ECDFA610B9--