2017-08-24 15:29:13,761+0200 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2017-08-24 15:29:13,803+0200 INFO (jsonrpc/7) [vdsm.api] START repoStats(options=None) from=::ffff:172.16.252.200,56136, flow_id=1acd6778, task_id=dbf6819c-a29d-4bb7-bb72-a92acd82d887 (api:46) 2017-08-24 15:29:13,803+0200 INFO (jsonrpc/7) [vdsm.api] FINISH repoStats return={u'7c8deaa8-be02-4aaf-b9b4-ddc8da99ad96': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000297791', 'lastCheck': '0.8', 'valid': True}, u'2b2a44fc-f2bd-47cd-b7af-00be59e30a35': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000710249', 'lastCheck': '0.8', 'valid': True}, u'5d99af76-33b5-47d8-99da-1f32413c7bb0': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000295381', 'lastCheck': '0.8', 'valid': True}, u'a7fbaaad-7043-4391-9523-3bedcdc4fb0d': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000791434', 'lastCheck': '0.8', 'valid': True}} from=::ffff:172.16.252.200,56136, flow_id=1acd6778, task_id=dbf6819c-a29d-4bb7-bb72-a92acd82d887 (api:52) 2017-08-24 15:29:13,807+0200 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.00 seconds (__init__:539) 2017-08-24 15:29:14,296+0200 INFO (jsonrpc/1) [vdsm.api] START migrate(params={u'incomingLimit': 2, u'src': u'microcloud22.rxmgmt.databay.de', u'dstqemu': u'172.16.252.124', u'autoConverge': u'true', u'tunneled': u'false', u'enableGuestEvents': True, u'dst': u'microcloud24.rxmgmt.databay.de:54321', u'convergenceSchedule': {u'init': [{u'params': [u'100'], u'name': u'setDowntime'}], u'stalling': [{u'action': {u'params': [u'150'], u'name': u'setDowntime'}, u'limit': 1}, {u'action': {u'params': [u'200'], u'name': u'setDowntime'}, u'limit': 2}, {u'action': {u'params': [u'300'], u'name': u'setDowntime'}, u'limit': 3}, {u'action': {u'params': [u'400'], u'name': u'setDowntime'}, u'limit': 4}, {u'action': {u'params': [u'500'], u'name': u'setDowntime'}, u'limit': 6}, {u'action': {u'params': [], u'name': u'abort'}, u'limit': -1}]}, u'vmId': u'ffb71f79-54cd-4f0e-b6b5-3670236cb497', u'abortOnError': u'true', u'outgoingLimit': 2, u'compressed': u'false', u'method': u'online', 'mode': 'remote'}) from=::ffff:172.16.252.200,56136, flow_id=6c91f368-aa5d-47f4-8d4a-29f6f3005dc6 (api:46) 2017-08-24 15:29:14,298+0200 INFO (jsonrpc/1) [vdsm.api] FINISH migrate return={'status': {'message': 'Migration in progress', 'code': 0}, 'progress': 0} from=::ffff:172.16.252.200,56136, flow_id=6c91f368-aa5d-47f4-8d4a-29f6f3005dc6 (api:52) 2017-08-24 15:29:14,298+0200 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call VM.migrate succeeded in 0.00 seconds (__init__:539) 2017-08-24 15:29:14,787+0200 INFO (migsrc/ffb71f79) [virt.vm] (vmId='ffb71f79-54cd-4f0e-b6b5-3670236cb497') Creation of destination VM took: 0 seconds (migration:455) 2017-08-24 15:29:14,788+0200 INFO (migsrc/ffb71f79) [virt.vm] (vmId='ffb71f79-54cd-4f0e-b6b5-3670236cb497') starting migration to qemu+tls://microcloud24.rxmgmt.databay.de/system with miguri tcp://172.16.252.124 (migration:480) 2017-08-24 15:29:14,971+0200 ERROR (migsrc/ffb71f79) [virt.vm] (vmId='ffb71f79-54cd-4f0e-b6b5-3670236cb497') failed to initialize gluster connection (src=0x7fd81803b530 priv=0x7fd818054130): Success (migration:287) 2017-08-24 15:29:15,005+0200 ERROR (migsrc/ffb71f79) [virt.vm] (vmId='ffb71f79-54cd-4f0e-b6b5-3670236cb497') Failed to migrate (migration:429) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/virt/migration.py", line 411, in run self._startUnderlyingMigration(time.time()) File "/usr/lib/python2.7/site-packages/vdsm/virt/migration.py", line 487, in _startUnderlyingMigration self._perform_with_conv_schedule(duri, muri) File "/usr/lib/python2.7/site-packages/vdsm/virt/migration.py", line 563, in _perform_with_conv_schedule self._perform_migration(duri, muri) File "/usr/lib/python2.7/site-packages/vdsm/virt/migration.py", line 529, in _perform_migration self._vm._dom.migrateToURI3(duri, params, flags) File "/usr/lib/python2.7/site-packages/vdsm/virt/virdomain.py", line 69, in f ret = attr(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 123, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 944, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1939, in migrateToURI3 if ret == -1: raise libvirtError ('virDomainMigrateToURI3() failed', dom=self) libvirtError: failed to initialize gluster connection (src=0x7fd81803b530 priv=0x7fd818054130): Success 2017-08-24 15:29:19,473+0200 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2017-08-24 15:29:19,531+0200 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmIoTunePolicies succeeded in 0.00 seconds (__init__:539) 2017-08-24 15:29:26,095+0200 INFO (periodic/0) [vdsm.api] START repoStats(options=None) from=internal, task_id=b92f1abd-5ea3-4098-a486-e3259ebd138c (api:46) 2017-08-24 15:29:26,095+0200 INFO (periodic/0) [vdsm.api] FINISH repoStats return={u'7c8deaa8-be02-4aaf-b9b4-ddc8da99ad96': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000279694', 'lastCheck': '1.5', 'valid': True}, u'2b2a44fc-f2bd-47cd-b7af-00be59e30a35': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000683755', 'lastCheck': '3.1', 'valid': True}, u'5d99af76-33b5-47d8-99da-1f32413c7bb0': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000293234', 'lastCheck': '0.2', 'valid': True}, u'a7fbaaad-7043-4391-9523-3bedcdc4fb0d': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000654555', 'lastCheck': '3.1', 'valid': True}} from=internal, task_id=b92f1abd-5ea3-4098-a486-e3259ebd138c (api:52) 2017-08-24 15:29:29,098+0200 INFO (jsonrpc/3) [vdsm.api] START repoStats(options=None) from=::ffff:172.16.252.200,56136, flow_id=2d054216, task_id=76bb3034-40d2-4d65-929c-1df0bacee281 (api:46) 2017-08-24 15:29:29,098+0200 INFO (jsonrpc/3) [vdsm.api] FINISH repoStats return={u'7c8deaa8-be02-4aaf-b9b4-ddc8da99ad96': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000279694', 'lastCheck': '4.5', 'valid': True}, u'2b2a44fc-f2bd-47cd-b7af-00be59e30a35': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000683755', 'lastCheck': '6.1', 'valid': True}, u'5d99af76-33b5-47d8-99da-1f32413c7bb0': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000293234', 'lastCheck': '3.2', 'valid': True}, u'a7fbaaad-7043-4391-9523-3bedcdc4fb0d': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000654555', 'lastCheck': '6.1', 'valid': True}} from=::ffff:172.16.252.200,56136, flow_id=2d054216, task_id=76bb3034-40d2-4d65-929c-1df0bacee281 (api:52) 2017-08-24 15:29:29,102+0200 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:539) 2017-08-24 15:29:29,143+0200 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539) 2017-08-24 15:29:30,279+0200 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call VM.getMigrationStatus succeeded in 0.00 seconds (__init__:539) 2017-08-24 15:29:34,480+0200 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.01 seconds (__init__:539) 2017-08-24 15:29:34,548+0200 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmIoTunePolicies succeeded in 0.00 seconds (__init__:539) 2017-08-24 15:29:41,157+0200 INFO (periodic/1) [vdsm.api] START repoStats(options=None) from=internal, task_id=be7d2436-a9c9-480f-a1dc-5404e0807666 (api:46) 2017-08-24 15:29:41,157+0200 INFO (periodic/1) [vdsm.api] FINISH repoStats return={u'7c8deaa8-be02-4aaf-b9b4-ddc8da99ad96': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000307391', 'lastCheck': '6.5', 'valid': True}, u'2b2a44fc-f2bd-47cd-b7af-00be59e30a35': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000672854', 'lastCheck': '1.6', 'valid': True}, u'5d99af76-33b5-47d8-99da-1f32413c7bb0': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000287642', 'lastCheck': '5.3', 'valid': True}, u'a7fbaaad-7043-4391-9523-3bedcdc4fb0d': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000780185', 'lastCheck': '0.9', 'valid': True}} from=internal, task_id=be7d2436-a9c9-480f-a1dc-5404e0807666 (api:52) 2017-08-24 15:29:44,264+0200 INFO (jsonrpc/1) [vdsm.api] START repoStats(options=None) from=::ffff:172.16.252.200,56136, flow_id=7806a830, task_id=ee4f75dc-363c-4203-b512-370e5c2b4a75 (api:46) 2017-08-24 15:29:44,265+0200 INFO (jsonrpc/1) [vdsm.api] FINISH repoStats return={u'7c8deaa8-be02-4aaf-b9b4-ddc8da99ad96': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000292021', 'lastCheck': '1.3', 'valid': True}, u'2b2a44fc-f2bd-47cd-b7af-00be59e30a35': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000698031', 'lastCheck': '1.3', 'valid': True}, u'5d99af76-33b5-47d8-99da-1f32413c7bb0': {'code': 0, 'actual': True, 'version': 4, 'acquired': True, 'delay': '0.000280107', 'lastCheck': '1.3', 'valid': True}, u'a7fbaaad-7043-4391-9523-3bedcdc4fb0d': {'code': 0, 'actual': True, 'version': 0, 'acquired': True, 'delay': '0.000672383', 'lastCheck': '1.2', 'valid': True}} from=::ffff:172.16.252.200,56136, flow_id=7806a830, task_id=ee4f75dc-363c-4203-b512-370e5c2b4a75 (api:52) 2017-08-24 15:29:44,269+0200 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.00 seconds (__init__:539) 2017-08-24 15:29:45,256+0200 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:539)