2017-05-01 11:38:11,759+0100 INFO (MainThread) [vds] (PID: 21605) I am the actual vdsm 4.19.11-3.git7fd045b.el7.centos host1.bajada.es (3.10.0-514.el7.x86_64) (vdsm:145) 2017-05-01 11:38:11,759+0100 INFO (MainThread) [vds] VDSM will run with cpu affinity: frozenset([1]) (vdsm:251) 2017-05-01 11:38:11,797+0100 INFO (MainThread) [storage.check] Starting check service (check:92) 2017-05-01 11:38:11,800+0100 INFO (MainThread) [storage.Dispatcher] Starting StorageDispatcher... (dispatcher:47) 2017-05-01 11:38:11,800+0100 INFO (check/loop) [storage.asyncevent] Starting (asyncevent:122) 2017-05-01 11:38:11,851+0100 INFO (MainThread) [dispatcher] Run and protect: registerDomainStateChangeCallback(callbackFunc=) (logUtils:51) 2017-05-01 11:38:11,851+0100 INFO (MainThread) [dispatcher] Run and protect: registerDomainStateChangeCallback, Return response: None (logUtils:54) 2017-05-01 11:38:11,851+0100 INFO (MainThread) [MOM] Preparing MOM interface (momIF:53) 2017-05-01 11:38:11,852+0100 INFO (MainThread) [MOM] Using named unix socket /var/run/vdsm/mom-vdsm.sock (momIF:62) 2017-05-01 11:38:11,852+0100 INFO (MainThread) [root] Unregistering all secrets (secret:91) 2017-05-01 11:38:11,863+0100 INFO (MainThread) [vds] Setting channels' timeout to 30 seconds. (vmchannels:223) 2017-05-01 11:38:11,864+0100 INFO (MainThread) [vds.MultiProtocolAcceptor] Listening at :::54321 (protocoldetector:185) 2017-05-01 11:38:11,897+0100 INFO (vmrecovery) [vds] recovery: completed in 0s (clientIF:495) 2017-05-01 11:38:12,019+0100 INFO (BindingXMLRPC) [vds] XMLRPC server running (bindingxmlrpc:63) 2017-05-01 11:38:12,035+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:38:12,035+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:38:12,035+0100 WARN (periodic/0) [throttled] MOM not available. (throttledlog:105) 2017-05-01 11:38:12,036+0100 WARN (periodic/0) [throttled] MOM not available, KSM stats will be missing. (throttledlog:105) 2017-05-01 11:38:13,571+0100 INFO (Reactor thread) [ProtocolDetector.AcceptorImpl] Accepted connection from ::1:49914 (protocoldetector:72) 2017-05-01 11:38:13,576+0100 INFO (Reactor thread) [ProtocolDetector.Detector] Detected protocol stomp from ::1:49914 (protocoldetector:127) 2017-05-01 11:38:13,577+0100 INFO (Reactor thread) [Broker.StompAdapter] Processing CONNECT request (stompreactor:102) 2017-05-01 11:38:13,579+0100 INFO (JsonRpc (StompReactor)) [Broker.StompAdapter] Subscribe command received (stompreactor:129) 2017-05-01 11:38:13,744+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getHardwareInfo succeeded in 0.02 seconds (__init__:533) 2017-05-01 11:38:13,835+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getVMList succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:38:13,852+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getConnectedStoragePoolsList(options=None) (logUtils:51) 2017-05-01 11:38:13,853+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} (logUtils:54) 2017-05-01 11:38:13,853+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getConnectedStoragePools succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:38:16,910+0100 INFO (Reactor thread) [ProtocolDetector.AcceptorImpl] Accepted connection from ::1:49916 (protocoldetector:72) 2017-05-01 11:38:16,914+0100 INFO (Reactor thread) [ProtocolDetector.Detector] Detected protocol stomp from ::1:49916 (protocoldetector:127) 2017-05-01 11:38:16,914+0100 INFO (Reactor thread) [Broker.StompAdapter] Processing CONNECT request (stompreactor:102) 2017-05-01 11:38:16,915+0100 INFO (JsonRpc (StompReactor)) [Broker.StompAdapter] Subscribe command received (stompreactor:129) 2017-05-01 11:38:17,040+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.ping succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:38:17,043+0100 INFO (jsonrpc/4) [throttled] Current getAllVmStats: {} (throttledlog:105) 2017-05-01 11:38:17,043+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:38:27,046+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:38:27,046+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:38:32,062+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:38:32,173+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.setKsmTune succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:38:42,058+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:38:42,058+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:38:47,081+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:38:57,072+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:38:57,072+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:39:02,100+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:39:09,380+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: connectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'protocol_version': 3, u'connection': u'host1.bajada.es:/ovirt/vm', u'user': u'kvm', u'id': u'09049a0c-754d-4975-8bbb-be5ef17a235f'}], options=None) (logUtils:51) 2017-05-01 11:39:09,382+0100 INFO (jsonrpc/1) [storage.Mount] mounting host1.bajada.es:/ovirt/vm at /rhev/data-center/mnt/host1.bajada.es:_ovirt_vm (mount:187) 2017-05-01 11:39:09,409+0100 INFO (jsonrpc/1) [IOProcessClient] Starting client ioprocess-0 (__init__:330) 2017-05-01 11:39:09,414+0100 INFO (ioprocess/21723) [IOProcess] Starting ioprocess (__init__:452) 2017-05-01 11:39:09,420+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': u'09049a0c-754d-4975-8bbb-be5ef17a235f'}]} (logUtils:54) 2017-05-01 11:39:09,421+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call StoragePool.connectStorageServer succeeded in 0.04 seconds (__init__:533) 2017-05-01 11:39:09,443+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getStorageDomainsList(spUUID=u'00000000-0000-0000-0000-000000000000', domainClass=None, storageType=None, remotePath=None, options=None) (logUtils:51) 2017-05-01 11:39:09,524+0100 INFO (itmap/0) [IOProcessClient] Starting client ioprocess-1 (__init__:330) 2017-05-01 11:39:09,529+0100 INFO (ioprocess/21741) [IOProcess] Starting ioprocess (__init__:452) 2017-05-01 11:39:09,530+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getStorageDomainsList, Return response: {'domlist': []} (logUtils:54) 2017-05-01 11:39:09,530+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getStorageDomains succeeded in 0.09 seconds (__init__:533) 2017-05-01 11:39:09,557+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: disconnectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'protocol_version': 3, u'connection': u'host1.bajada.es:/ovirt/vm', u'user': u'kvm', u'id': u'09049a0c-754d-4975-8bbb-be5ef17a235f'}], options=None) (logUtils:51) 2017-05-01 11:39:09,558+0100 INFO (jsonrpc/3) [storage.Mount] unmounting /rhev/data-center/mnt/host1.bajada.es:_ovirt_vm (mount:195) 2017-05-01 11:39:09,634+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: disconnectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': u'09049a0c-754d-4975-8bbb-be5ef17a235f'}]} (logUtils:54) 2017-05-01 11:39:09,634+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call StoragePool.disconnectStorageServer succeeded in 0.08 seconds (__init__:533) 2017-05-01 11:39:12,077+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:39:12,077+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:39:17,119+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:39:19,778+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 0.52 seconds (__init__:533) 2017-05-01 11:39:27,094+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:39:27,094+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:39:32,137+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:39:42,107+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:39:42,107+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:39:47,156+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:39:57,119+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:39:57,119+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:40:02,175+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:40:12,130+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:40:12,130+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:40:17,194+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:40:27,144+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:40:27,144+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:40:32,212+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:40:42,149+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:40:42,149+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:40:47,232+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:40:57,160+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:40:57,160+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:41:02,250+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:41:12,174+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:41:12,174+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:41:17,269+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:41:27,178+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:41:27,178+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:41:32,288+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:41:42,192+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:41:42,192+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:41:47,307+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:41:48,615+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:41:48,615+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:41:48,619+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:41:52,278+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 0.05 seconds (__init__:533) 2017-05-01 11:41:57,197+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:41:57,197+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:42:00,399+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 0.04 seconds (__init__:533) 2017-05-01 11:42:02,326+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:42:12,211+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:42:12,211+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:42:17,344+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:42:27,216+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:42:27,216+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:42:32,363+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:42:42,230+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:42:42,230+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:42:47,382+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:42:57,244+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:42:57,245+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:43:02,401+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:43:12,249+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:43:12,249+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:43:17,420+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:43:27,263+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:43:27,263+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:43:31,971+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 0.04 seconds (__init__:533) 2017-05-01 11:43:32,439+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:43:42,268+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:43:42,268+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:43:47,920+0100 INFO (MainThread) [vds] Received signal 15, shutting down (vdsm:68) 2017-05-01 11:43:47,920+0100 INFO (MainThread) [jsonrpc.JsonRpcServer] Stopping JsonRPC Server (__init__:658) 2017-05-01 11:43:47,922+0100 INFO (MainThread) [vds] Stopping XMLRPC server (bindingxmlrpc:85) 2017-05-01 11:43:47,922+0100 INFO (BindingXMLRPC) [vds] XMLRPC server stopped (bindingxmlrpc:75) 2017-05-01 11:43:47,923+0100 INFO (MainThread) [root] Unregistering all secrets (secret:91) 2017-05-01 11:43:47,923+0100 INFO (MainThread) [dispatcher] Run and protect: prepareForShutdown(options=None) (logUtils:51) 2017-05-01 11:43:47,937+0100 INFO (MainThread) [storage.Monitor] Shutting down domain monitors (monitor:222) 2017-05-01 11:43:47,937+0100 INFO (MainThread) [storage.check] Stopping check service (check:105) 2017-05-01 11:43:47,937+0100 INFO (check/loop) [storage.asyncevent] Stopping (asyncevent:194) 2017-05-01 11:43:47,937+0100 INFO (MainThread) [IOProcessClient] Closing client ioprocess-0 (__init__:598) 2017-05-01 11:43:47,937+0100 INFO (ioprocess/21723) [IOProcessClient] shutdown requested (__init__:129) 2017-05-01 11:43:47,938+0100 INFO (MainThread) [IOProcessClient] Closing client ioprocess-1 (__init__:598) 2017-05-01 11:43:47,938+0100 INFO (ioprocess/21741) [IOProcessClient] shutdown requested (__init__:129) 2017-05-01 11:43:47,938+0100 INFO (MainThread) [dispatcher] Run and protect: prepareForShutdown, Return response: None (logUtils:54) 2017-05-01 11:43:47,939+0100 INFO (MainThread) [vds] Stopping threads (vdsm:156) 2017-05-01 11:43:47,939+0100 INFO (MainThread) [vds] Exiting (vdsm:167) 2017-05-01 11:43:51,245+0100 INFO (MainThread) [vds] (PID: 22119) I am the actual vdsm 4.19.11-3.git7fd045b.el7.centos host1.bajada.es (3.10.0-514.el7.x86_64) (vdsm:145) 2017-05-01 11:43:51,245+0100 INFO (MainThread) [vds] VDSM will run with cpu affinity: frozenset([1]) (vdsm:251) 2017-05-01 11:43:51,281+0100 INFO (MainThread) [storage.check] Starting check service (check:92) 2017-05-01 11:43:51,285+0100 INFO (MainThread) [storage.Dispatcher] Starting StorageDispatcher... (dispatcher:47) 2017-05-01 11:43:51,285+0100 INFO (check/loop) [storage.asyncevent] Starting (asyncevent:122) 2017-05-01 11:43:51,335+0100 INFO (MainThread) [dispatcher] Run and protect: registerDomainStateChangeCallback(callbackFunc=) (logUtils:51) 2017-05-01 11:43:51,335+0100 INFO (MainThread) [dispatcher] Run and protect: registerDomainStateChangeCallback, Return response: None (logUtils:54) 2017-05-01 11:43:51,335+0100 INFO (MainThread) [MOM] Preparing MOM interface (momIF:53) 2017-05-01 11:43:51,336+0100 INFO (MainThread) [MOM] Using named unix socket /var/run/vdsm/mom-vdsm.sock (momIF:62) 2017-05-01 11:43:51,336+0100 INFO (MainThread) [root] Unregistering all secrets (secret:91) 2017-05-01 11:43:51,339+0100 INFO (MainThread) [vds] Setting channels' timeout to 30 seconds. (vmchannels:223) 2017-05-01 11:43:51,341+0100 INFO (MainThread) [vds.MultiProtocolAcceptor] Listening at :::54321 (protocoldetector:185) 2017-05-01 11:43:51,374+0100 INFO (vmrecovery) [vds] recovery: completed in 0s (clientIF:495) 2017-05-01 11:43:51,496+0100 INFO (BindingXMLRPC) [vds] XMLRPC server running (bindingxmlrpc:63) 2017-05-01 11:43:51,511+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:43:51,512+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:43:51,512+0100 WARN (periodic/0) [throttled] MOM not available. (throttledlog:105) 2017-05-01 11:43:51,512+0100 WARN (periodic/0) [throttled] MOM not available, KSM stats will be missing. (throttledlog:105) 2017-05-01 11:43:53,059+0100 INFO (Reactor thread) [ProtocolDetector.AcceptorImpl] Accepted connection from ::1:50136 (protocoldetector:72) 2017-05-01 11:43:53,065+0100 INFO (Reactor thread) [ProtocolDetector.Detector] Detected protocol stomp from ::1:50136 (protocoldetector:127) 2017-05-01 11:43:53,065+0100 INFO (Reactor thread) [Broker.StompAdapter] Processing CONNECT request (stompreactor:102) 2017-05-01 11:43:53,066+0100 INFO (JsonRpc (StompReactor)) [Broker.StompAdapter] Subscribe command received (stompreactor:129) 2017-05-01 11:43:53,237+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getHardwareInfo succeeded in 0.02 seconds (__init__:533) 2017-05-01 11:43:53,746+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getCapabilities succeeded in 0.49 seconds (__init__:533) 2017-05-01 11:43:56,420+0100 INFO (Reactor thread) [ProtocolDetector.AcceptorImpl] Accepted connection from ::1:50138 (protocoldetector:72) 2017-05-01 11:43:56,425+0100 INFO (Reactor thread) [ProtocolDetector.Detector] Detected protocol stomp from ::1:50138 (protocoldetector:127) 2017-05-01 11:43:56,425+0100 INFO (Reactor thread) [Broker.StompAdapter] Processing CONNECT request (stompreactor:102) 2017-05-01 11:43:56,425+0100 INFO (JsonRpc (StompReactor)) [Broker.StompAdapter] Subscribe command received (stompreactor:129) 2017-05-01 11:43:56,552+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.ping succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:43:56,557+0100 INFO (jsonrpc/4) [throttled] Current getAllVmStats: {} (throttledlog:105) 2017-05-01 11:43:56,557+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:43:59,461+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.setupNetworks succeeded in 5.70 seconds (__init__:533) 2017-05-01 11:43:59,497+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.setSafeNetworkConfig succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:44:00,732+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: connectStorageServer(domType=1, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'protocol_version': 3, u'connection': u'host1.bajada.es:/ovirt/vm', u'user': u'kvm', u'id': u'09049a0c-754d-4975-8bbb-be5ef17a235f'}], options=None) (logUtils:51) 2017-05-01 11:44:00,735+0100 INFO (jsonrpc/6) [storage.Mount] mounting host1.bajada.es:/ovirt/vm at /rhev/data-center/mnt/host1.bajada.es:_ovirt_vm (mount:187) 2017-05-01 11:44:00,762+0100 INFO (jsonrpc/6) [IOProcessClient] Starting client ioprocess-0 (__init__:330) 2017-05-01 11:44:00,768+0100 INFO (ioprocess/22565) [IOProcess] Starting ioprocess (__init__:452) 2017-05-01 11:44:00,775+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': u'09049a0c-754d-4975-8bbb-be5ef17a235f'}]} (logUtils:54) 2017-05-01 11:44:00,775+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call StoragePool.connectStorageServer succeeded in 0.04 seconds (__init__:533) 2017-05-01 11:44:00,796+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: connectStorageServer(domType=6, spUUID=u'00000000-0000-0000-0000-000000000000', conList=[{u'vfsType': u'ext3', u'connection': u'/var/lib/ovirt-hosted-engine-setup/tmpIO_Slb', u'spec': u'/var/lib/ovirt-hosted-engine-setup/tmpIO_Slb', u'id': u'83204c18-491e-4a06-b76a-1af7379f3f38'}], options=None) (logUtils:51) 2017-05-01 11:44:00,797+0100 INFO (jsonrpc/7) [storage.Mount] mounting /var/lib/ovirt-hosted-engine-setup/tmpIO_Slb at /rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb (mount:187) 2017-05-01 11:44:00,821+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: connectStorageServer, Return response: {'statuslist': [{'status': 0, 'id': u'83204c18-491e-4a06-b76a-1af7379f3f38'}]} (logUtils:54) 2017-05-01 11:44:00,821+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call StoragePool.connectStorageServer succeeded in 0.03 seconds (__init__:533) 2017-05-01 11:44:00,828+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getConnectedStoragePoolsList(options=None) (logUtils:51) 2017-05-01 11:44:00,828+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getConnectedStoragePoolsList, Return response: {'poollist': []} (logUtils:54) 2017-05-01 11:44:00,828+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getConnectedStoragePools succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:44:00,832+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: createStorageDomain(storageType=1, sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', domainName=u'hosted_storage', typeSpecificArg=u'host1.bajada.es:/ovirt/vm', domClass=1, domVersion=3, options=None) (logUtils:51) 2017-05-01 11:44:00,915+0100 INFO (itmap/0) [IOProcessClient] Starting client ioprocess-1 (__init__:330) 2017-05-01 11:44:00,920+0100 INFO (ioprocess/22593) [IOProcess] Starting ioprocess (__init__:452) 2017-05-01 11:44:00,921+0100 INFO (itmap/0) [IOProcessClient] Starting client ioprocess-2 (__init__:330) 2017-05-01 11:44:00,925+0100 INFO (ioprocess/22602) [IOProcess] Starting ioprocess (__init__:452) 2017-05-01 11:44:00,926+0100 INFO (jsonrpc/1) [storage.StorageDomain] sdUUID=cf8fd003-3666-4eb9-b589-bd78f70e2f49 domainName=hosted_storage remotePath=host1.bajada.es:/ovirt/vm domClass=1 (nfsSD:70) 2017-05-01 11:44:00,933+0100 INFO (jsonrpc/1) [IOProcessClient] Starting client ioprocess-3 (__init__:330) 2017-05-01 11:44:00,938+0100 INFO (ioprocess/22612) [IOProcess] Starting ioprocess (__init__:452) 2017-05-01 11:44:01,256+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: createStorageDomain, Return response: None (logUtils:54) 2017-05-01 11:44:01,257+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call StorageDomain.create succeeded in 0.42 seconds (__init__:533) 2017-05-01 11:44:01,300+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:44:01,300+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:44:01,300+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:44:01,303+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: getStorageDomainStats(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', options=None) (logUtils:51) 2017-05-01 11:44:01,304+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '21872246784', 'disktotal': '23117955072', 'mdafree': 0}} (logUtils:54) 2017-05-01 11:44:01,304+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call StorageDomain.getStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:44:01,307+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: createStorageDomain(storageType=6, sdUUID=u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac', domainName=u'FakeHostedEngineStorageDomain', typeSpecificArg=u'/var/lib/ovirt-hosted-engine-setup/tmpIO_Slb', domClass=1, domVersion=3, options=None) (logUtils:51) 2017-05-01 11:44:01,329+0100 INFO (jsonrpc/2) [storage.StorageDomain] sdUUID=76144cd5-fb52-4b53-bfe7-d6d02a9744ac domainName=FakeHostedEngineStorageDomain remotePath=/var/lib/ovirt-hosted-engine-setup/tmpIO_Slb domClass=1 (nfsSD:70) 2017-05-01 11:44:01,336+0100 INFO (jsonrpc/2) [IOProcessClient] Starting client ioprocess-4 (__init__:330) 2017-05-01 11:44:01,342+0100 INFO (ioprocess/22630) [IOProcess] Starting ioprocess (__init__:452) 2017-05-01 11:44:01,479+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: createStorageDomain, Return response: None (logUtils:54) 2017-05-01 11:44:01,479+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call StorageDomain.create succeeded in 0.18 seconds (__init__:533) 2017-05-01 11:44:01,521+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:44:01,521+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:44:01,522+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:44:01,524+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getStorageDomainStats(sdUUID=u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac', options=None) (logUtils:51) 2017-05-01 11:44:01,525+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getStorageDomainStats, Return response: {'stats': {'mdasize': 0, 'mdathreshold': True, 'mdavalid': True, 'diskfree': '1933930496', 'disktotal': '2046640128', 'mdafree': 0}} (logUtils:54) 2017-05-01 11:44:01,526+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call StorageDomain.getStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:44:01,528+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: createStoragePool(poolType=None, spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', poolName=u'hosted_datacenter', masterDom=u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac', domList=[u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac', u'cf8fd003-3666-4eb9-b589-bd78f70e2f49'], masterVersion=1, lockPolicy=None, lockRenewalIntervalSec=None, leaseTimeSec=None, ioOpTimeoutSec=None, leaseRetries=None, options=None) (logUtils:51) 2017-05-01 11:44:01,529+0100 INFO (jsonrpc/7) [storage.StoragePool] updating pool 077fddb7-57e3-4bb4-98c9-ec4a3c799471 backend from type NoneType instance 0x7fd0da0eef00 to type StoragePoolDiskBackend instance 0x3d6fe18 (sp:158) 2017-05-01 11:44:01,529+0100 INFO (jsonrpc/7) [storage.StoragePool] spUUID=077fddb7-57e3-4bb4-98c9-ec4a3c799471 poolName=hosted_datacenter master_sd=76144cd5-fb52-4b53-bfe7-d6d02a9744ac domList=[u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac', u'cf8fd003-3666-4eb9-b589-bd78f70e2f49'] masterVersion=1 {'LEASETIMESEC': 60, 'LOCKPOLICY': 'ON', 'IOOPTIMEOUTSEC': 10, 'LEASERETRIES': 3, 'LOCKRENEWALINTERVALSEC': 5} (sp:595) 2017-05-01 11:44:01,529+0100 INFO (jsonrpc/7) [storage.StorageDomain] sdUUID=76144cd5-fb52-4b53-bfe7-d6d02a9744ac (fileSD:504) 2017-05-01 11:44:01,530+0100 INFO (jsonrpc/7) [storage.StorageDomain] sdUUID=cf8fd003-3666-4eb9-b589-bd78f70e2f49 (fileSD:504) 2017-05-01 11:44:01,532+0100 INFO (jsonrpc/7) [storage.SANLock] Acquiring host id for domain 76144cd5-fb52-4b53-bfe7-d6d02a9744ac (id: 250) (clusterlock:282) 2017-05-01 11:44:06,520+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:44:06,521+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:44:11,569+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:44:11,683+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.setKsmTune succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:44:21,533+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:44:21,533+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:44:22,535+0100 INFO (jsonrpc/7) [storage.SANLock] Acquiring Lease(name='SDM', path=u'/rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb/76144cd5-fb52-4b53-bfe7-d6d02a9744ac/dom_md/leases', offset=1048576) for host id 250 (clusterlock:343) 2017-05-01 11:44:22,539+0100 INFO (jsonrpc/7) [storage.StoragePool] setting master domain for spUUID 077fddb7-57e3-4bb4-98c9-ec4a3c799471 on sdUUID=76144cd5-fb52-4b53-bfe7-d6d02a9744ac (sp:752) 2017-05-01 11:44:22,543+0100 INFO (jsonrpc/7) [storage.Monitor] Start monitoring 76144cd5-fb52-4b53-bfe7-d6d02a9744ac (monitor:182) 2017-05-01 11:44:22,551+0100 INFO (monitor/76144cd) [storage.check] Start checking u'/rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb/76144cd5-fb52-4b53-bfe7-d6d02a9744ac/dom_md/metadata' (check:122) 2017-05-01 11:44:22,574+0100 INFO (jsonrpc/7) [storage.StoragePool] Linking /rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb/76144cd5-fb52-4b53-bfe7-d6d02a9744ac to /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/76144cd5-fb52-4b53-bfe7-d6d02a9744ac (sp:1220) 2017-05-01 11:44:22,575+0100 INFO (jsonrpc/7) [storage.StoragePool] Linking /rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb/76144cd5-fb52-4b53-bfe7-d6d02a9744ac to /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/mastersd (sp:1220) 2017-05-01 11:44:22,575+0100 INFO (jsonrpc/7) [storage.StoragePool] sdUUID=cf8fd003-3666-4eb9-b589-bd78f70e2f49 spUUID=077fddb7-57e3-4bb4-98c9-ec4a3c799471 (sp:942) 2017-05-01 11:44:22,577+0100 INFO (jsonrpc/7) [storage.SANLock] Acquiring host id for domain cf8fd003-3666-4eb9-b589-bd78f70e2f49 (id: 250) (clusterlock:282) 2017-05-01 11:44:22,599+0100 INFO (check/loop) [storage.Monitor] Domain 76144cd5-fb52-4b53-bfe7-d6d02a9744ac became VALID (monitor:456) 2017-05-01 11:44:22,599+0100 INFO (event/1) [vds] vmContainerLock acquired (clientIF:186) 2017-05-01 11:44:26,588+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:44:36,541+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:44:36,541+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '0.000276794', 'lastCheck': '4.0', 'valid': True}} (logUtils:54) 2017-05-01 11:44:41,607+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:44:43,580+0100 INFO (jsonrpc/7) [storage.SANLock] Acquiring Lease(name='SDM', path=u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/dom_md/leases', offset=1048576) for host id 250 (clusterlock:343) 2017-05-01 11:44:43,661+0100 INFO (jsonrpc/7) [storage.StoragePool] Linking /rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49 to /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/cf8fd003-3666-4eb9-b589-bd78f70e2f49 (sp:1220) 2017-05-01 11:44:43,662+0100 INFO (jsonrpc/7) [storage.SANLock] Releasing Lease(name='SDM', path=u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/dom_md/leases', offset=1048576) (clusterlock:390) 2017-05-01 11:44:43,696+0100 INFO (jsonrpc/7) [storage.SANLock] Releasing host id for domain cf8fd003-3666-4eb9-b589-bd78f70e2f49 (id: 250) (clusterlock:305) 2017-05-01 11:44:45,698+0100 INFO (jsonrpc/7) [storage.SANLock] Releasing Lease(name='SDM', path=u'/rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb/76144cd5-fb52-4b53-bfe7-d6d02a9744ac/dom_md/leases', offset=1048576) (clusterlock:390) 2017-05-01 11:44:45,698+0100 INFO (jsonrpc/7) [storage.SANLock] Releasing host id for domain 76144cd5-fb52-4b53-bfe7-d6d02a9744ac (id: 250) (clusterlock:305) 2017-05-01 11:44:47,699+0100 INFO (jsonrpc/7) [storage.Monitor] Stop monitoring 76144cd5-fb52-4b53-bfe7-d6d02a9744ac (shutdown=False) (monitor:237) 2017-05-01 11:44:47,699+0100 INFO (monitor/76144cd) [storage.check] Stop checking u'/rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb/76144cd5-fb52-4b53-bfe7-d6d02a9744ac/dom_md/metadata' (check:136) 2017-05-01 11:44:47,699+0100 INFO (monitor/76144cd) [storage.SANLock] Releasing host id for domain 76144cd5-fb52-4b53-bfe7-d6d02a9744ac (id: 250) (clusterlock:305) 2017-05-01 11:44:47,699+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: createStoragePool, Return response: True (logUtils:54) 2017-05-01 11:44:47,700+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call StoragePool.create succeeded in 46.17 seconds (__init__:533) 2017-05-01 11:44:47,747+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: connectStoragePool(spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', hostID=1, msdUUID=u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac', masterVersion=1, domainsMap={u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': u'active', u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': u'active'}, options=None) (logUtils:51) 2017-05-01 11:44:47,748+0100 INFO (jsonrpc/2) [storage.StoragePoolMemoryBackend] new storage pool master version 1 and domains map {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': u'Active', u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': u'Active'} (spbackends:450) 2017-05-01 11:44:47,748+0100 INFO (jsonrpc/2) [storage.StoragePool] updating pool 077fddb7-57e3-4bb4-98c9-ec4a3c799471 backend from type NoneType instance 0x7fd0da0eef00 to type StoragePoolMemoryBackend instance 0x392fe10 (sp:158) 2017-05-01 11:44:47,748+0100 INFO (jsonrpc/2) [storage.StoragePool] Connect host #1 to the storage pool 077fddb7-57e3-4bb4-98c9-ec4a3c799471 with master domain: 76144cd5-fb52-4b53-bfe7-d6d02a9744ac (ver = 1) (sp:681) 2017-05-01 11:44:47,818+0100 INFO (jsonrpc/2) [storage.StorageDomain] Resource namespace 01_img_76144cd5-fb52-4b53-bfe7-d6d02a9744ac already registered (sd:732) 2017-05-01 11:44:47,818+0100 INFO (jsonrpc/2) [storage.StorageDomain] Resource namespace 02_vol_76144cd5-fb52-4b53-bfe7-d6d02a9744ac already registered (sd:741) 2017-05-01 11:44:47,819+0100 INFO (jsonrpc/2) [storage.Monitor] Start monitoring 76144cd5-fb52-4b53-bfe7-d6d02a9744ac (monitor:182) 2017-05-01 11:44:47,819+0100 INFO (jsonrpc/2) [storage.Monitor] Start monitoring cf8fd003-3666-4eb9-b589-bd78f70e2f49 (monitor:182) 2017-05-01 11:44:47,819+0100 INFO (monitor/76144cd) [storage.check] Start checking u'/rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb/76144cd5-fb52-4b53-bfe7-d6d02a9744ac/dom_md/metadata' (check:122) 2017-05-01 11:44:47,842+0100 INFO (jsonrpc/2) [storage.StoragePool] Linking /rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49 to /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/cf8fd003-3666-4eb9-b589-bd78f70e2f49 (sp:1220) 2017-05-01 11:44:47,842+0100 INFO (jsonrpc/2) [storage.StoragePool] Linking /rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb/76144cd5-fb52-4b53-bfe7-d6d02a9744ac to /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/76144cd5-fb52-4b53-bfe7-d6d02a9744ac (sp:1220) 2017-05-01 11:44:47,842+0100 INFO (jsonrpc/2) [storage.StoragePool] Linking /rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb/76144cd5-fb52-4b53-bfe7-d6d02a9744ac to /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/mastersd (sp:1220) 2017-05-01 11:44:47,849+0100 INFO (jsonrpc/2) [storage.MailBox.HsmMailMonitor] HSM_MailMonitor sending mail to SPM - ['/usr/bin/dd', 'of=/rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] (storage_mailbox:386) 2017-05-01 11:44:47,883+0100 INFO (monitor/cf8fd00) [storage.StorageDomain] Resource namespace 01_img_cf8fd003-3666-4eb9-b589-bd78f70e2f49 already registered (sd:732) 2017-05-01 11:44:47,883+0100 INFO (monitor/cf8fd00) [storage.StorageDomain] Resource namespace 02_vol_cf8fd003-3666-4eb9-b589-bd78f70e2f49 already registered (sd:741) 2017-05-01 11:44:47,883+0100 INFO (monitor/cf8fd00) [storage.check] Start checking u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/dom_md/metadata' (check:122) 2017-05-01 11:44:47,897+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: connectStoragePool, Return response: True (logUtils:54) 2017-05-01 11:44:47,897+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call StoragePool.connect succeeded in 0.15 seconds (__init__:533) 2017-05-01 11:44:47,911+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: spmStart(spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', prevID=-1, prevLVER=-1, maxHostID=250, domVersion=3, options=None) (logUtils:51) 2017-05-01 11:44:47,912+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: spmStart, Return response: None (logUtils:54) 2017-05-01 11:44:47,912+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call StoragePool.spmStart succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:44:47,912+0100 INFO (tasks/1) [storage.ThreadPool.WorkerThread] START task 7e1c8869-4141-42b6-bbb2-680a4c992890 (cmd=>, args=None) (threadPool:208) 2017-05-01 11:44:47,913+0100 INFO (tasks/1) [storage.SANLock] Acquiring host id for domain 76144cd5-fb52-4b53-bfe7-d6d02a9744ac (id: 1) (clusterlock:282) 2017-05-01 11:44:47,914+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: activateStorageDomain(sdUUID=u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac', spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', options=None) (logUtils:51) 2017-05-01 11:44:47,929+0100 INFO (check/loop) [storage.Monitor] Domain cf8fd003-3666-4eb9-b589-bd78f70e2f49 became VALID (monitor:456) 2017-05-01 11:44:47,929+0100 INFO (check/loop) [storage.SANLock] Acquiring host id for domain cf8fd003-3666-4eb9-b589-bd78f70e2f49 (id: 1) (clusterlock:282) 2017-05-01 11:44:47,929+0100 INFO (check/loop) [storage.Monitor] Domain 76144cd5-fb52-4b53-bfe7-d6d02a9744ac became VALID (monitor:456) 2017-05-01 11:44:47,930+0100 INFO (event/3) [vds] vmContainerLock acquired (clientIF:186) 2017-05-01 11:44:47,930+0100 INFO (event/6) [vds] vmContainerLock acquired (clientIF:186) 2017-05-01 11:44:51,555+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:44:51,555+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'code': 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '0.0651706', 'lastCheck': '3.6', 'valid': True}, u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '7.986e-05', 'lastCheck': '3.6', 'valid': True}} (logUtils:54) 2017-05-01 11:44:56,626+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:06,571+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:45:06,571+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'code': 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '0.0651706', 'lastCheck': '18.6', 'valid': True}, u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '7.986e-05', 'lastCheck': '8.7', 'valid': True}} (logUtils:54) 2017-05-01 11:45:07,890+0100 INFO (monitor/cf8fd00) [IOProcessClient] Closing client ioprocess-0 (__init__:598) 2017-05-01 11:45:08,916+0100 INFO (tasks/1) [storage.SANLock] Acquiring Lease(name='SDM', path=u'/rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb/76144cd5-fb52-4b53-bfe7-d6d02a9744ac/dom_md/leases', offset=1048576) for host id 1 (clusterlock:343) 2017-05-01 11:45:08,920+0100 INFO (check/loop) [storage.SANLock] Acquiring host id for domain 76144cd5-fb52-4b53-bfe7-d6d02a9744ac (id: 1) (clusterlock:282) 2017-05-01 11:45:08,920+0100 WARN (check/loop) [storage.asyncutils] Call > delayed by 11.10 seconds (asyncutils:138) 2017-05-01 11:45:08,927+0100 WARN (check/loop) [storage.asyncutils] Call > missed 1 deadlines, scheduling next call at 4355660.48 (asyncutils:161) 2017-05-01 11:45:08,927+0100 WARN (check/loop) [storage.asyncutils] Call > delayed by 11.04 seconds (asyncutils:138) 2017-05-01 11:45:08,929+0100 WARN (check/loop) [storage.asyncutils] Call > missed 1 deadlines, scheduling next call at 4355660.54 (asyncutils:161) 2017-05-01 11:45:08,950+0100 INFO (tasks/1) [storage.ThreadPool.WorkerThread] FINISH task 7e1c8869-4141-42b6-bbb2-680a4c992890 (threadPool:210) 2017-05-01 11:45:08,951+0100 INFO (jsonrpc/6) [storage.StoragePool] sdUUID=76144cd5-fb52-4b53-bfe7-d6d02a9744ac spUUID=077fddb7-57e3-4bb4-98c9-ec4a3c799471 (sp:1115) 2017-05-01 11:45:08,951+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: activateStorageDomain, Return response: None (logUtils:54) 2017-05-01 11:45:08,952+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call StorageDomain.activate succeeded in 21.04 seconds (__init__:533) 2017-05-01 11:45:08,952+0100 INFO (event/5) [storage.StoragePool] Linking /rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49 to /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/cf8fd003-3666-4eb9-b589-bd78f70e2f49 (sp:1220) 2017-05-01 11:45:08,953+0100 INFO (event/7) [storage.StoragePool] Linking /rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb/76144cd5-fb52-4b53-bfe7-d6d02a9744ac to /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/76144cd5-fb52-4b53-bfe7-d6d02a9744ac (sp:1220) 2017-05-01 11:45:08,953+0100 INFO (event/7) [storage.StoragePool] Linking /rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb/76144cd5-fb52-4b53-bfe7-d6d02a9744ac to /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/mastersd (sp:1220) 2017-05-01 11:45:08,975+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:08,975+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} (logUtils:54) 2017-05-01 11:45:08,976+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:08,978+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: getSpmStatus(spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', options=None) (logUtils:51) 2017-05-01 11:45:08,979+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} (logUtils:54) 2017-05-01 11:45:08,979+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call StoragePool.getSpmStatus succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:08,982+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: getStoragePoolInfo(spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', options=None) (logUtils:51) 2017-05-01 11:45:08,984+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac:Active,cf8fd003-3666-4eb9-b589-bd78f70e2f49:Active', 'master_uuid': u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac', 'version': '3', 'spm_id': 1, 'type': 'POSIXFS', 'master_ver': 1}, 'dominfo': {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'status': u'Active', 'diskfree': '1933926400', 'isoprefix': '', 'alerts': [], 'disktotal': '2046640128', 'version': 3}, u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'status': u'Active', 'diskfree': '21872246784', 'isoprefix': '', 'alerts': [], 'disktotal': '23117955072', 'version': 3}}} (logUtils:54) 2017-05-01 11:45:08,984+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call StoragePool.getInfo succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:08,989+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:45:08,989+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: repoStats, Return response: {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '8.4163e-05', 'lastCheck': '0.1', 'valid': True}, u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '8.4168e-05', 'lastCheck': '0.0', 'valid': True}} (logUtils:54) 2017-05-01 11:45:08,990+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:08,993+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: activateStorageDomain(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', options=None) (logUtils:51) 2017-05-01 11:45:08,993+0100 INFO (jsonrpc/2) [storage.StoragePool] sdUUID=cf8fd003-3666-4eb9-b589-bd78f70e2f49 spUUID=077fddb7-57e3-4bb4-98c9-ec4a3c799471 (sp:1115) 2017-05-01 11:45:08,993+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: activateStorageDomain, Return response: None (logUtils:54) 2017-05-01 11:45:08,994+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call StorageDomain.activate succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:08,996+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:08,996+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} (logUtils:54) 2017-05-01 11:45:08,996+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:08,999+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getSpmStatus(spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', options=None) (logUtils:51) 2017-05-01 11:45:09,000+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} (logUtils:54) 2017-05-01 11:45:09,000+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call StoragePool.getSpmStatus succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:09,003+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getStoragePoolInfo(spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', options=None) (logUtils:51) 2017-05-01 11:45:09,005+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac:Active,cf8fd003-3666-4eb9-b589-bd78f70e2f49:Active', 'master_uuid': u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac', 'version': '3', 'spm_id': 1, 'type': 'POSIXFS', 'master_ver': 1}, 'dominfo': {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'status': u'Active', 'diskfree': '1933926400', 'isoprefix': '', 'alerts': [], 'disktotal': '2046640128', 'version': 3}, u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'status': u'Active', 'diskfree': '21872246784', 'isoprefix': '', 'alerts': [], 'disktotal': '23117955072', 'version': 3}}} (logUtils:54) 2017-05-01 11:45:09,005+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call StoragePool.getInfo succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:09,006+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:45:09,006+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: repoStats, Return response: {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '8.4163e-05', 'lastCheck': '0.1', 'valid': True}, u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '8.4168e-05', 'lastCheck': '0.1', 'valid': True}} (logUtils:54) 2017-05-01 11:45:09,007+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:11,048+0100 INFO (Reactor thread) [ProtocolDetector.AcceptorImpl] Accepted connection from ::1:50142 (protocoldetector:72) 2017-05-01 11:45:11,052+0100 INFO (Reactor thread) [ProtocolDetector.Detector] Detected protocol stomp from ::1:50142 (protocoldetector:127) 2017-05-01 11:45:11,053+0100 INFO (Reactor thread) [Broker.StompAdapter] Processing CONNECT request (stompreactor:102) 2017-05-01 11:45:11,053+0100 INFO (JsonRpc (StompReactor)) [Broker.StompAdapter] Subscribe command received (stompreactor:129) 2017-05-01 11:45:11,206+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getHardwareInfo succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:11,208+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: prepareImage(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', imgUUID=u'3009f5f4-0d77-4ad4-b8b6-76c64a653f35', leafUUID=u'707a4a35-c209-408f-99b1-542661dd94b5', allowIllegal=False) (logUtils:51) 2017-05-01 11:45:11,209+0100 ERROR (jsonrpc/4) [storage.TaskManager.Task] (Task='f11a985b-b848-4468-8924-d8d2209d6c12') Unexpected error (task:870) Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 877, in _run return fn(*args, **kargs) File "/usr/lib/python2.7/site-packages/vdsm/logUtils.py", line 52, in wrapper res = f(*args, **kwargs) File "/usr/share/vdsm/storage/hsm.py", line 3139, in prepareImage raise se.VolumeDoesNotExist(leafUUID) VolumeDoesNotExist: Volume does not exist: (u'707a4a35-c209-408f-99b1-542661dd94b5',) 2017-05-01 11:45:11,210+0100 INFO (jsonrpc/4) [storage.TaskManager.Task] (Task='f11a985b-b848-4468-8924-d8d2209d6c12') aborting: Task is aborted: 'Volume does not exist' - code 201 (task:1175) 2017-05-01 11:45:11,210+0100 ERROR (jsonrpc/4) [storage.Dispatcher] {'status': {'message': "Volume does not exist: (u'707a4a35-c209-408f-99b1-542661dd94b5',)", 'code': 201}} (dispatcher:77) 2017-05-01 11:45:11,210+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Image.prepare failed (error 201) in 0.01 seconds (__init__:533) 2017-05-01 11:45:11,216+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: createVolume(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', imgUUID=u'3009f5f4-0d77-4ad4-b8b6-76c64a653f35', size=u'1048576', volFormat=5, preallocate=1, diskType=2, volUUID=u'707a4a35-c209-408f-99b1-542661dd94b5', desc=u'hosted-engine.lockspace', srcImgUUID=u'00000000-0000-0000-0000-000000000000', srcVolUUID=u'00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:51) 2017-05-01 11:45:11,216+0100 INFO (jsonrpc/7) [IOProcessClient] Starting client ioprocess-5 (__init__:330) 2017-05-01 11:45:11,223+0100 INFO (ioprocess/22756) [IOProcess] Starting ioprocess (__init__:452) 2017-05-01 11:45:11,227+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: createVolume, Return response: None (logUtils:54) 2017-05-01 11:45:11,232+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Volume.create succeeded in 0.02 seconds (__init__:533) 2017-05-01 11:45:11,232+0100 INFO (tasks/1) [storage.ThreadPool.WorkerThread] START task 2d7a173d-7789-414d-9ed6-0d1447ddf92c (cmd=>, args=None) (threadPool:208) 2017-05-01 11:45:11,236+0100 INFO (tasks/1) [storage.Image] Create placeholder /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/3009f5f4-0d77-4ad4-b8b6-76c64a653f35 for image's volumes (image:152) 2017-05-01 11:45:11,248+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getTaskStatus(taskID=u'2d7a173d-7789-414d-9ed6-0d1447ddf92c', spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:11,248+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '2d7a173d-7789-414d-9ed6-0d1447ddf92c'}} (logUtils:54) 2017-05-01 11:45:11,248+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Task.getStatus succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:11,281+0100 INFO (tasks/1) [storage.Volume] Creating volume 707a4a35-c209-408f-99b1-542661dd94b5 (volume:1046) 2017-05-01 11:45:11,372+0100 INFO (tasks/1) [storage.Volume] Request to create RAW volume /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/3009f5f4-0d77-4ad4-b8b6-76c64a653f35/707a4a35-c209-408f-99b1-542661dd94b5 with size = 2048 sectors (fileVolume:462) 2017-05-01 11:45:11,484+0100 INFO (tasks/1) [storage.ThreadPool.WorkerThread] FINISH task 2d7a173d-7789-414d-9ed6-0d1447ddf92c (threadPool:210) 2017-05-01 11:45:11,644+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:12,253+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getTaskStatus(taskID=u'2d7a173d-7789-414d-9ed6-0d1447ddf92c', spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:12,253+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2d7a173d-7789-414d-9ed6-0d1447ddf92c'}} (logUtils:54) 2017-05-01 11:45:12,253+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Task.getStatus succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:12,256+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: clearTask(taskID=u'2d7a173d-7789-414d-9ed6-0d1447ddf92c', spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:12,259+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: clearTask, Return response: None (logUtils:54) 2017-05-01 11:45:12,259+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Task.clear succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:12,264+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: prepareImage(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'00000000-0000-0000-0000-000000000000', imgUUID=u'3009f5f4-0d77-4ad4-b8b6-76c64a653f35', leafUUID=u'707a4a35-c209-408f-99b1-542661dd94b5', allowIllegal=False) (logUtils:51) 2017-05-01 11:45:12,271+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: prepareImage, Return response: {'info': {'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/3009f5f4-0d77-4ad4-b8b6-76c64a653f35/707a4a35-c209-408f-99b1-542661dd94b5', 'volumeID': u'707a4a35-c209-408f-99b1-542661dd94b5', 'leasePath': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/3009f5f4-0d77-4ad4-b8b6-76c64a653f35/707a4a35-c209-408f-99b1-542661dd94b5.lease', 'imageID': u'3009f5f4-0d77-4ad4-b8b6-76c64a653f35'}, 'path': u'/var/run/vdsm/storage/cf8fd003-3666-4eb9-b589-bd78f70e2f49/3009f5f4-0d77-4ad4-b8b6-76c64a653f35/707a4a35-c209-408f-99b1-542661dd94b5', 'imgVolumesInfo': [{'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/3009f5f4-0d77-4ad4-b8b6-76c64a653f35/707a4a35-c209-408f-99b1-542661dd94b5', 'volumeID': u'707a4a35-c209-408f-99b1-542661dd94b5', 'leasePath': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/3009f5f4-0d77-4ad4-b8b6-76c64a653f35/707a4a35-c209-408f-99b1-542661dd94b5.lease', 'imageID': u'3009f5f4-0d77-4ad4-b8b6-76c64a653f35'}]} (logUtils:54) 2017-05-01 11:45:12,271+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Image.prepare succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:14,319+0100 INFO (Reactor thread) [ProtocolDetector.AcceptorImpl] Accepted connection from ::1:50144 (protocoldetector:72) 2017-05-01 11:45:14,324+0100 INFO (Reactor thread) [ProtocolDetector.Detector] Detected protocol stomp from ::1:50144 (protocoldetector:127) 2017-05-01 11:45:14,324+0100 INFO (Reactor thread) [Broker.StompAdapter] Processing CONNECT request (stompreactor:102) 2017-05-01 11:45:14,325+0100 INFO (JsonRpc (StompReactor)) [Broker.StompAdapter] Subscribe command received (stompreactor:129) 2017-05-01 11:45:14,478+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getHardwareInfo succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:14,482+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: prepareImage(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', imgUUID=u'0da93c66-1ba3-4492-9daa-14964d3eaa28', leafUUID=u'45f20dd5-42f3-4c25-9d6c-9935d6b700ed', allowIllegal=False) (logUtils:51) 2017-05-01 11:45:14,483+0100 ERROR (jsonrpc/4) [storage.TaskManager.Task] (Task='886b9014-d146-483b-bf63-0bd6ede4db7e') Unexpected error (task:870) Traceback (most recent call last): File "/usr/share/vdsm/storage/task.py", line 877, in _run return fn(*args, **kargs) File "/usr/lib/python2.7/site-packages/vdsm/logUtils.py", line 52, in wrapper res = f(*args, **kwargs) File "/usr/share/vdsm/storage/hsm.py", line 3139, in prepareImage raise se.VolumeDoesNotExist(leafUUID) VolumeDoesNotExist: Volume does not exist: (u'45f20dd5-42f3-4c25-9d6c-9935d6b700ed',) 2017-05-01 11:45:14,483+0100 INFO (jsonrpc/4) [storage.TaskManager.Task] (Task='886b9014-d146-483b-bf63-0bd6ede4db7e') aborting: Task is aborted: 'Volume does not exist' - code 201 (task:1175) 2017-05-01 11:45:14,483+0100 ERROR (jsonrpc/4) [storage.Dispatcher] {'status': {'message': "Volume does not exist: (u'45f20dd5-42f3-4c25-9d6c-9935d6b700ed',)", 'code': 201}} (dispatcher:77) 2017-05-01 11:45:14,483+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Image.prepare failed (error 201) in 0.00 seconds (__init__:533) 2017-05-01 11:45:14,485+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: createVolume(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', imgUUID=u'0da93c66-1ba3-4492-9daa-14964d3eaa28', size=u'1028096', volFormat=5, preallocate=1, diskType=2, volUUID=u'45f20dd5-42f3-4c25-9d6c-9935d6b700ed', desc=u'hosted-engine.metadata', srcImgUUID=u'00000000-0000-0000-0000-000000000000', srcVolUUID=u'00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:51) 2017-05-01 11:45:14,489+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: createVolume, Return response: None (logUtils:54) 2017-05-01 11:45:14,495+0100 INFO (tasks/5) [storage.ThreadPool.WorkerThread] START task 2d3b6884-569d-4627-9ee9-59b02e7c9b35 (cmd=>, args=None) (threadPool:208) 2017-05-01 11:45:14,495+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Volume.create succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:14,499+0100 INFO (tasks/5) [storage.Image] Create placeholder /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/0da93c66-1ba3-4492-9daa-14964d3eaa28 for image's volumes (image:152) 2017-05-01 11:45:14,501+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getTaskStatus(taskID=u'2d3b6884-569d-4627-9ee9-59b02e7c9b35', spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:14,501+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '2d3b6884-569d-4627-9ee9-59b02e7c9b35'}} (logUtils:54) 2017-05-01 11:45:14,501+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Task.getStatus succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:14,516+0100 INFO (tasks/5) [storage.Volume] Creating volume 45f20dd5-42f3-4c25-9d6c-9935d6b700ed (volume:1046) 2017-05-01 11:45:14,607+0100 INFO (tasks/5) [storage.Volume] Request to create RAW volume /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/0da93c66-1ba3-4492-9daa-14964d3eaa28/45f20dd5-42f3-4c25-9d6c-9935d6b700ed with size = 2008 sectors (fileVolume:462) 2017-05-01 11:45:14,712+0100 INFO (tasks/5) [storage.ThreadPool.WorkerThread] FINISH task 2d3b6884-569d-4627-9ee9-59b02e7c9b35 (threadPool:210) 2017-05-01 11:45:15,506+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: getTaskStatus(taskID=u'2d3b6884-569d-4627-9ee9-59b02e7c9b35', spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:15,506+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: getTaskStatus, Return response: {'taskStatus': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '2d3b6884-569d-4627-9ee9-59b02e7c9b35'}} (logUtils:54) 2017-05-01 11:45:15,507+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Task.getStatus succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:15,509+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: clearTask(taskID=u'2d3b6884-569d-4627-9ee9-59b02e7c9b35', spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:15,512+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: clearTask, Return response: None (logUtils:54) 2017-05-01 11:45:15,512+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Task.clear succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:15,517+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: prepareImage(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'00000000-0000-0000-0000-000000000000', imgUUID=u'0da93c66-1ba3-4492-9daa-14964d3eaa28', leafUUID=u'45f20dd5-42f3-4c25-9d6c-9935d6b700ed', allowIllegal=False) (logUtils:51) 2017-05-01 11:45:15,524+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: prepareImage, Return response: {'info': {'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/0da93c66-1ba3-4492-9daa-14964d3eaa28/45f20dd5-42f3-4c25-9d6c-9935d6b700ed', 'volumeID': u'45f20dd5-42f3-4c25-9d6c-9935d6b700ed', 'leasePath': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/0da93c66-1ba3-4492-9daa-14964d3eaa28/45f20dd5-42f3-4c25-9d6c-9935d6b700ed.lease', 'imageID': u'0da93c66-1ba3-4492-9daa-14964d3eaa28'}, 'path': u'/var/run/vdsm/storage/cf8fd003-3666-4eb9-b589-bd78f70e2f49/0da93c66-1ba3-4492-9daa-14964d3eaa28/45f20dd5-42f3-4c25-9d6c-9935d6b700ed', 'imgVolumesInfo': [{'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/0da93c66-1ba3-4492-9daa-14964d3eaa28/45f20dd5-42f3-4c25-9d6c-9935d6b700ed', 'volumeID': u'45f20dd5-42f3-4c25-9d6c-9935d6b700ed', 'leasePath': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/0da93c66-1ba3-4492-9daa-14964d3eaa28/45f20dd5-42f3-4c25-9d6c-9935d6b700ed.lease', 'imageID': u'0da93c66-1ba3-4492-9daa-14964d3eaa28'}]} (logUtils:54) 2017-05-01 11:45:15,524+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Image.prepare succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:17,573+0100 INFO (Reactor thread) [ProtocolDetector.AcceptorImpl] Accepted connection from ::1:50146 (protocoldetector:72) 2017-05-01 11:45:17,577+0100 INFO (Reactor thread) [ProtocolDetector.Detector] Detected protocol stomp from ::1:50146 (protocoldetector:127) 2017-05-01 11:45:17,578+0100 INFO (Reactor thread) [Broker.StompAdapter] Processing CONNECT request (stompreactor:102) 2017-05-01 11:45:17,578+0100 INFO (JsonRpc (StompReactor)) [Broker.StompAdapter] Subscribe command received (stompreactor:129) 2017-05-01 11:45:17,739+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getHardwareInfo succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:17,742+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: prepareImage(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'00000000-0000-0000-0000-000000000000', imgUUID=u'3009f5f4-0d77-4ad4-b8b6-76c64a653f35', leafUUID=u'707a4a35-c209-408f-99b1-542661dd94b5', allowIllegal=False) (logUtils:51) 2017-05-01 11:45:17,747+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: prepareImage, Return response: {'info': {'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/3009f5f4-0d77-4ad4-b8b6-76c64a653f35/707a4a35-c209-408f-99b1-542661dd94b5', 'volumeID': u'707a4a35-c209-408f-99b1-542661dd94b5', 'leasePath': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/3009f5f4-0d77-4ad4-b8b6-76c64a653f35/707a4a35-c209-408f-99b1-542661dd94b5.lease', 'imageID': u'3009f5f4-0d77-4ad4-b8b6-76c64a653f35'}, 'path': u'/var/run/vdsm/storage/cf8fd003-3666-4eb9-b589-bd78f70e2f49/3009f5f4-0d77-4ad4-b8b6-76c64a653f35/707a4a35-c209-408f-99b1-542661dd94b5', 'imgVolumesInfo': [{'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/3009f5f4-0d77-4ad4-b8b6-76c64a653f35/707a4a35-c209-408f-99b1-542661dd94b5', 'volumeID': u'707a4a35-c209-408f-99b1-542661dd94b5', 'leasePath': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/3009f5f4-0d77-4ad4-b8b6-76c64a653f35/707a4a35-c209-408f-99b1-542661dd94b5.lease', 'imageID': u'3009f5f4-0d77-4ad4-b8b6-76c64a653f35'}]} (logUtils:54) 2017-05-01 11:45:17,747+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Image.prepare succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:17,750+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: prepareImage(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'00000000-0000-0000-0000-000000000000', imgUUID=u'0da93c66-1ba3-4492-9daa-14964d3eaa28', leafUUID=u'45f20dd5-42f3-4c25-9d6c-9935d6b700ed', allowIllegal=False) (logUtils:51) 2017-05-01 11:45:17,755+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: prepareImage, Return response: {'info': {'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/0da93c66-1ba3-4492-9daa-14964d3eaa28/45f20dd5-42f3-4c25-9d6c-9935d6b700ed', 'volumeID': u'45f20dd5-42f3-4c25-9d6c-9935d6b700ed', 'leasePath': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/0da93c66-1ba3-4492-9daa-14964d3eaa28/45f20dd5-42f3-4c25-9d6c-9935d6b700ed.lease', 'imageID': u'0da93c66-1ba3-4492-9daa-14964d3eaa28'}, 'path': u'/var/run/vdsm/storage/cf8fd003-3666-4eb9-b589-bd78f70e2f49/0da93c66-1ba3-4492-9daa-14964d3eaa28/45f20dd5-42f3-4c25-9d6c-9935d6b700ed', 'imgVolumesInfo': [{'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/0da93c66-1ba3-4492-9daa-14964d3eaa28/45f20dd5-42f3-4c25-9d6c-9935d6b700ed', 'volumeID': u'45f20dd5-42f3-4c25-9d6c-9935d6b700ed', 'leasePath': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/0da93c66-1ba3-4492-9daa-14964d3eaa28/45f20dd5-42f3-4c25-9d6c-9935d6b700ed.lease', 'imageID': u'0da93c66-1ba3-4492-9daa-14964d3eaa28'}]} (logUtils:54) 2017-05-01 11:45:17,755+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Image.prepare succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:17,821+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: createVolume(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', imgUUID=u'c3a2329e-8221-4cea-bfa8-bbc813572251', size=u'1073741824', volFormat=5, preallocate=1, diskType=2, volUUID=u'7d59fc4f-e3ba-4607-b074-51105eb9a512', desc=u'HostedEngineConfigurationImage', srcImgUUID=u'00000000-0000-0000-0000-000000000000', srcVolUUID=u'00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:51) 2017-05-01 11:45:17,825+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: createVolume, Return response: None (logUtils:54) 2017-05-01 11:45:17,837+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Volume.create succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:17,837+0100 INFO (tasks/7) [storage.ThreadPool.WorkerThread] START task 4420f948-bd3e-412f-ba63-841310e55c95 (cmd=>, args=None) (threadPool:208) 2017-05-01 11:45:17,841+0100 INFO (tasks/7) [storage.Image] Create placeholder /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c3a2329e-8221-4cea-bfa8-bbc813572251 for image's volumes (image:152) 2017-05-01 11:45:17,853+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:17,853+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:17,853+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:17,855+0100 INFO (tasks/7) [storage.Volume] Creating volume 7d59fc4f-e3ba-4607-b074-51105eb9a512 (volume:1046) 2017-05-01 11:45:18,858+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:18,859+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:18,859+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:19,863+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:19,864+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:19,864+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:20,868+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:20,868+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:20,868+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:21,578+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:45:21,578+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '4.5882e-05', 'lastCheck': '2.7', 'valid': True}, u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '8.221e-05', 'lastCheck': '3.7', 'valid': True}} (logUtils:54) 2017-05-01 11:45:21,873+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:21,873+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:21,874+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:22,878+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:22,878+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:22,878+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:23,883+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:23,883+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:23,884+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:24,888+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:24,888+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:24,888+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:25,893+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:25,900+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:25,900+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:26,650+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:26,910+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:26,910+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:26,910+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:27,915+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:27,915+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:27,915+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:28,920+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:28,920+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:28,921+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:29,925+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:29,925+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:29,926+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:30,930+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:30,931+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:30,931+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:31,935+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:31,935+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:31,936+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:32,940+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:32,940+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:32,940+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:33,945+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:33,945+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:33,946+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:34,950+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:34,950+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:34,950+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:35,955+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:35,955+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:35,956+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:36,592+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:45:36,593+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '8.5006e-05', 'lastCheck': '7.7', 'valid': True}, u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '8.4604e-05', 'lastCheck': '8.7', 'valid': True}} (logUtils:54) 2017-05-01 11:45:36,960+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:36,960+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:36,960+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:37,965+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:37,965+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:37,965+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:38,970+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:38,970+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:38,970+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:39,975+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:39,990+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:39,990+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.02 seconds (__init__:533) 2017-05-01 11:45:41,008+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:41,008+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:41,009+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:41,669+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:42,013+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:42,013+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:42,014+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:43,018+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:43,018+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:43,019+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:44,023+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:44,024+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:44,024+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:45,028+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:45,031+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:45,031+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:46,037+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:46,038+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:46,038+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:47,042+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:47,042+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:47,043+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:47,896+0100 INFO (monitor/cf8fd00) [IOProcessClient] Closing client ioprocess-2 (__init__:598) 2017-05-01 11:45:47,897+0100 INFO (monitor/cf8fd00) [IOProcessClient] Closing client ioprocess-1 (__init__:598) 2017-05-01 11:45:48,047+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:48,047+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:48,047+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:49,052+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:49,052+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:49,052+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:50,057+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:50,059+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:50,060+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:51,066+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:51,066+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': 'running job 1 of 1', 'taskState': 'running', 'taskResult': '', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:51,066+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:51,346+0100 INFO (tasks/7) [storage.Volume] Request to create RAW volume /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c3a2329e-8221-4cea-bfa8-bbc813572251/7d59fc4f-e3ba-4607-b074-51105eb9a512 with size = 2097152 sectors (fileVolume:462) 2017-05-01 11:45:51,451+0100 INFO (tasks/7) [storage.ThreadPool.WorkerThread] FINISH task 4420f948-bd3e-412f-ba63-841310e55c95 (threadPool:210) 2017-05-01 11:45:51,597+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:45:51,597+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '7.7516e-05', 'lastCheck': '2.7', 'valid': True}, u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '9.7615e-05', 'lastCheck': '3.7', 'valid': True}} (logUtils:54) 2017-05-01 11:45:52,071+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:52,071+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'4420f948-bd3e-412f-ba63-841310e55c95': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '4420f948-bd3e-412f-ba63-841310e55c95'}}} (logUtils:54) 2017-05-01 11:45:52,071+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:52,074+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: clearTask(taskID=u'4420f948-bd3e-412f-ba63-841310e55c95', spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:52,077+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: clearTask, Return response: None (logUtils:54) 2017-05-01 11:45:52,077+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Task.clear succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:52,082+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: prepareImage(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', imgUUID=u'c3a2329e-8221-4cea-bfa8-bbc813572251', leafUUID=u'7d59fc4f-e3ba-4607-b074-51105eb9a512', allowIllegal=False) (logUtils:51) 2017-05-01 11:45:52,088+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: prepareImage, Return response: {'info': {'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c3a2329e-8221-4cea-bfa8-bbc813572251/7d59fc4f-e3ba-4607-b074-51105eb9a512', 'volumeID': u'7d59fc4f-e3ba-4607-b074-51105eb9a512', 'leasePath': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c3a2329e-8221-4cea-bfa8-bbc813572251/7d59fc4f-e3ba-4607-b074-51105eb9a512.lease', 'imageID': u'c3a2329e-8221-4cea-bfa8-bbc813572251'}, 'path': u'/rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c3a2329e-8221-4cea-bfa8-bbc813572251/7d59fc4f-e3ba-4607-b074-51105eb9a512', 'imgVolumesInfo': [{'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c3a2329e-8221-4cea-bfa8-bbc813572251/7d59fc4f-e3ba-4607-b074-51105eb9a512', 'volumeID': u'7d59fc4f-e3ba-4607-b074-51105eb9a512', 'leasePath': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c3a2329e-8221-4cea-bfa8-bbc813572251/7d59fc4f-e3ba-4607-b074-51105eb9a512.lease', 'imageID': u'c3a2329e-8221-4cea-bfa8-bbc813572251'}]} (logUtils:54) 2017-05-01 11:45:52,088+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Image.prepare succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:52,099+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: createVolume(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', imgUUID=u'c765d43a-d1aa-4037-8e16-b0b248698310', size=u'53687091200', volFormat=5, preallocate=2, diskType=2, volUUID=u'397f6a0c-2824-443b-b3a6-797eed1d1059', desc=u'Hosted Engine Image', srcImgUUID=u'00000000-0000-0000-0000-000000000000', srcVolUUID=u'00000000-0000-0000-0000-000000000000', initialSize=None) (logUtils:51) 2017-05-01 11:45:52,105+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: createVolume, Return response: None (logUtils:54) 2017-05-01 11:45:52,112+0100 INFO (tasks/1) [storage.ThreadPool.WorkerThread] START task 5a4260e1-ac49-43f9-bb68-fb7489bb7afd (cmd=>, args=None) (threadPool:208) 2017-05-01 11:45:52,112+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Volume.create succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:45:52,114+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:52,115+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'5a4260e1-ac49-43f9-bb68-fb7489bb7afd': {'code': 0, 'message': 'Task is initializing', 'taskState': 'running', 'taskResult': '', 'taskID': '5a4260e1-ac49-43f9-bb68-fb7489bb7afd'}}} (logUtils:54) 2017-05-01 11:45:52,115+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:52,118+0100 INFO (tasks/1) [storage.Image] Create placeholder /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c765d43a-d1aa-4037-8e16-b0b248698310 for image's volumes (image:152) 2017-05-01 11:45:52,133+0100 INFO (tasks/1) [storage.Volume] Creating volume 397f6a0c-2824-443b-b3a6-797eed1d1059 (volume:1046) 2017-05-01 11:45:52,188+0100 INFO (tasks/1) [storage.Volume] Request to create RAW volume /rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c765d43a-d1aa-4037-8e16-b0b248698310/397f6a0c-2824-443b-b3a6-797eed1d1059 with size = 104857600 sectors (fileVolume:462) 2017-05-01 11:45:52,287+0100 INFO (tasks/1) [storage.ThreadPool.WorkerThread] FINISH task 5a4260e1-ac49-43f9-bb68-fb7489bb7afd (threadPool:210) 2017-05-01 11:45:53,119+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:53,120+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {'5a4260e1-ac49-43f9-bb68-fb7489bb7afd': {'code': 0, 'message': '1 jobs completed successfully', 'taskState': 'finished', 'taskResult': 'success', 'taskID': '5a4260e1-ac49-43f9-bb68-fb7489bb7afd'}}} (logUtils:54) 2017-05-01 11:45:53,120+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:53,123+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: clearTask(taskID=u'5a4260e1-ac49-43f9-bb68-fb7489bb7afd', spUUID=None, options=None) (logUtils:51) 2017-05-01 11:45:53,126+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: clearTask, Return response: None (logUtils:54) 2017-05-01 11:45:53,126+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Task.clear succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:53,130+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: prepareImage(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', imgUUID=u'c765d43a-d1aa-4037-8e16-b0b248698310', leafUUID=u'397f6a0c-2824-443b-b3a6-797eed1d1059', allowIllegal=False) (logUtils:51) 2017-05-01 11:45:53,137+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: prepareImage, Return response: {'info': {'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c765d43a-d1aa-4037-8e16-b0b248698310/397f6a0c-2824-443b-b3a6-797eed1d1059', 'volumeID': u'397f6a0c-2824-443b-b3a6-797eed1d1059', 'leasePath': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c765d43a-d1aa-4037-8e16-b0b248698310/397f6a0c-2824-443b-b3a6-797eed1d1059.lease', 'imageID': u'c765d43a-d1aa-4037-8e16-b0b248698310'}, 'path': u'/rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c765d43a-d1aa-4037-8e16-b0b248698310/397f6a0c-2824-443b-b3a6-797eed1d1059', 'imgVolumesInfo': [{'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c765d43a-d1aa-4037-8e16-b0b248698310/397f6a0c-2824-443b-b3a6-797eed1d1059', 'volumeID': u'397f6a0c-2824-443b-b3a6-797eed1d1059', 'leasePath': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c765d43a-d1aa-4037-8e16-b0b248698310/397f6a0c-2824-443b-b3a6-797eed1d1059.lease', 'imageID': u'c765d43a-d1aa-4037-8e16-b0b248698310'}]} (logUtils:54) 2017-05-01 11:45:53,137+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Image.prepare succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:45:56,688+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:46:06,611+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:46:06,611+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '7.3291e-05', 'lastCheck': '7.7', 'valid': True}, u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '8.1182e-05', 'lastCheck': '8.7', 'valid': True}} (logUtils:54) 2017-05-01 11:46:11,706+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:46:21,622+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:46:21,622+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '4.9069e-05', 'lastCheck': '2.7', 'valid': True}, u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '7.5855e-05', 'lastCheck': '3.7', 'valid': True}} (logUtils:54) 2017-05-01 11:46:26,725+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:46:36,630+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:46:36,631+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '7.0662e-05', 'lastCheck': '7.7', 'valid': True}, u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '7.5334e-05', 'lastCheck': '8.7', 'valid': True}} (logUtils:54) 2017-05-01 11:46:41,744+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:46:42,936+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getVolumeSize(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', imgUUID=u'c765d43a-d1aa-4037-8e16-b0b248698310', volUUID=u'397f6a0c-2824-443b-b3a6-797eed1d1059', options=None) (logUtils:51) 2017-05-01 11:46:42,937+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: getVolumeSize, Return response: {'truesize': '0', 'apparentsize': '53687091200'} (logUtils:54) 2017-05-01 11:46:42,938+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Volume.getSize succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:46:51,640+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:46:51,640+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '5.0074e-05', 'lastCheck': '2.7', 'valid': True}, u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '6.7964e-05', 'lastCheck': '3.7', 'valid': True}} (logUtils:54) 2017-05-01 11:46:56,763+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:46:57,907+0100 INFO (monitor/cf8fd00) [IOProcessClient] Closing client ioprocess-5 (__init__:598) 2017-05-01 11:47:02,692+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: detachStorageDomain(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', msdUUID=u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac', masterVersion=1, options=None) (logUtils:51) 2017-05-01 11:47:02,693+0100 INFO (jsonrpc/0) [storage.StoragePool] sdUUID=cf8fd003-3666-4eb9-b589-bd78f70e2f49 spUUID=077fddb7-57e3-4bb4-98c9-ec4a3c799471 (sp:1038) 2017-05-01 11:47:02,693+0100 INFO (jsonrpc/0) [storage.StorageDomain] detaching storage domain cf8fd003-3666-4eb9-b589-bd78f70e2f49 from pool 077fddb7-57e3-4bb4-98c9-ec4a3c799471 (sd:835) 2017-05-01 11:47:02,714+0100 WARN (jsonrpc/0) [storage.StoragePool] Force detaching domain `cf8fd003-3666-4eb9-b589-bd78f70e2f49` (sp:1011) 2017-05-01 11:47:02,714+0100 INFO (jsonrpc/0) [storage.StoragePoolMemoryBackend] new storage pool master version 1 and domains map {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': u'Active'} (spbackends:450) 2017-05-01 11:47:02,714+0100 INFO (jsonrpc/0) [storage.Monitor] Stop monitoring cf8fd003-3666-4eb9-b589-bd78f70e2f49 (shutdown=False) (monitor:237) 2017-05-01 11:47:02,715+0100 INFO (monitor/cf8fd00) [storage.check] Stop checking u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/dom_md/metadata' (check:136) 2017-05-01 11:47:02,715+0100 INFO (monitor/cf8fd00) [storage.SANLock] Releasing host id for domain cf8fd003-3666-4eb9-b589-bd78f70e2f49 (id: 1) (clusterlock:305) 2017-05-01 11:47:04,716+0100 INFO (jsonrpc/0) [dispatcher] Run and protect: detachStorageDomain, Return response: None (logUtils:54) 2017-05-01 11:47:04,716+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call StorageDomain.detach succeeded in 2.02 seconds (__init__:533) 2017-05-01 11:47:04,760+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getAllTasksStatuses(spUUID=None, options=None) (logUtils:51) 2017-05-01 11:47:04,760+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: getAllTasksStatuses, Return response: {'allTasksStatus': {}} (logUtils:54) 2017-05-01 11:47:04,761+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllTasksStatuses succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:47:04,764+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: getSpmStatus(spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', options=None) (logUtils:51) 2017-05-01 11:47:04,765+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: getSpmStatus, Return response: {'spm_st': {'spmId': 1, 'spmStatus': 'SPM', 'spmLver': 2L}} (logUtils:54) 2017-05-01 11:47:04,766+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call StoragePool.getSpmStatus succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:47:04,771+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: getStoragePoolInfo(spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', options=None) (logUtils:51) 2017-05-01 11:47:04,774+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: getStoragePoolInfo, Return response: {'info': {'name': 'No Description', 'isoprefix': '', 'pool_status': 'connected', 'lver': 2L, 'domains': u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac:Active', 'master_uuid': u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac', 'version': '3', 'spm_id': 1, 'type': 'POSIXFS', 'master_ver': 1}, 'dominfo': {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'status': u'Active', 'diskfree': '1932886016', 'isoprefix': '', 'alerts': [], 'disktotal': '2046640128', 'version': 3}}} (logUtils:54) 2017-05-01 11:47:04,775+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call StoragePool.getInfo succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:47:04,779+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:47:04,779+0100 INFO (jsonrpc/4) [dispatcher] Run and protect: repoStats, Return response: {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '6.0869e-05', 'lastCheck': '5.8', 'valid': True}} (logUtils:54) 2017-05-01 11:47:04,779+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getStorageRepoStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:47:04,783+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: destroyStoragePool(spUUID=u'077fddb7-57e3-4bb4-98c9-ec4a3c799471', hostID=1, options=None) (logUtils:51) 2017-05-01 11:47:04,784+0100 INFO (jsonrpc/2) [storage.HSM] spUUID=077fddb7-57e3-4bb4-98c9-ec4a3c799471 (hsm:1119) 2017-05-01 11:47:04,784+0100 WARN (jsonrpc/2) [storage.StoragePool] Force detaching domain `76144cd5-fb52-4b53-bfe7-d6d02a9744ac` (sp:1011) 2017-05-01 11:47:04,784+0100 INFO (jsonrpc/2) [storage.StoragePoolMemoryBackend] new storage pool master version 1 and domains map {} (spbackends:450) 2017-05-01 11:47:04,785+0100 INFO (jsonrpc/2) [storage.SANLock] Releasing Lease(name='SDM', path=u'/rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb/76144cd5-fb52-4b53-bfe7-d6d02a9744ac/dom_md/leases', offset=1048576) (clusterlock:390) 2017-05-01 11:47:04,785+0100 INFO (jsonrpc/2) [storage.Monitor] Stop monitoring 76144cd5-fb52-4b53-bfe7-d6d02a9744ac (shutdown=False) (monitor:237) 2017-05-01 11:47:04,785+0100 INFO (monitor/76144cd) [storage.check] Stop checking u'/rhev/data-center/mnt/_var_lib_ovirt-hosted-engine-setup_tmpIO__Slb/76144cd5-fb52-4b53-bfe7-d6d02a9744ac/dom_md/metadata' (check:136) 2017-05-01 11:47:04,786+0100 INFO (monitor/76144cd) [storage.SANLock] Releasing host id for domain 76144cd5-fb52-4b53-bfe7-d6d02a9744ac (id: 1) (clusterlock:305) 2017-05-01 11:47:06,647+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:47:06,647+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '6.0869e-05', 'lastCheck': '7.7', 'valid': True}} (logUtils:54) 2017-05-01 11:47:06,786+0100 INFO (jsonrpc/2) [storage.StorageDomain] detaching storage domain 76144cd5-fb52-4b53-bfe7-d6d02a9744ac from pool 077fddb7-57e3-4bb4-98c9-ec4a3c799471 (sd:835) 2017-05-01 11:47:06,788+0100 INFO (jsonrpc/2) [storage.StoragePool] Disconnect from the storage pool 077fddb7-57e3-4bb4-98c9-ec4a3c799471 (sp:729) 2017-05-01 11:47:07,914+0100 INFO (mailbox-hsm) [storage.MailBox.HsmMailMonitor] HSM_MailboxMonitor - Incoming mail monitoring thread stopped, clearing outgoing mail (storage_mailbox:510) 2017-05-01 11:47:07,914+0100 INFO (mailbox-hsm) [storage.MailBox.HsmMailMonitor] HSM_MailMonitor sending mail to SPM - ['/usr/bin/dd', 'of=/rhev/data-center/077fddb7-57e3-4bb4-98c9-ec4a3c799471/mastersd/dom_md/inbox', 'iflag=fullblock', 'oflag=direct', 'conv=notrunc', 'bs=512', 'seek=8'] (storage_mailbox:386) 2017-05-01 11:47:08,855+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: destroyStoragePool, Return response: True (logUtils:54) 2017-05-01 11:47:08,855+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call StoragePool.destroy succeeded in 4.07 seconds (__init__:533) 2017-05-01 11:47:08,906+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: formatStorageDomain(sdUUID=u'76144cd5-fb52-4b53-bfe7-d6d02a9744ac', autoDetach=True, options=None) (logUtils:51) 2017-05-01 11:47:08,952+0100 INFO (mailbox-spm) [storage.MailBox.SpmMailMonitor] SPM_MailMonitor - Incoming mail monitoring thread stopped (storage_mailbox:793) 2017-05-01 11:47:08,976+0100 INFO (jsonrpc/5) [storage.StorageDomain] Formatting domain 76144cd5-fb52-4b53-bfe7-d6d02a9744ac (fileSD:603) 2017-05-01 11:47:08,977+0100 INFO (itmap/0) [IOProcessClient] Starting client ioprocess-6 (__init__:330) 2017-05-01 11:47:08,982+0100 INFO (itmap/1) [IOProcessClient] Starting client ioprocess-7 (__init__:330) 2017-05-01 11:47:08,986+0100 INFO (ioprocess/22887) [IOProcess] Starting ioprocess (__init__:452) 2017-05-01 11:47:08,987+0100 INFO (ioprocess/22893) [IOProcess] Starting ioprocess (__init__:452) 2017-05-01 11:47:08,994+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: formatStorageDomain, Return response: None (logUtils:54) 2017-05-01 11:47:08,994+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call StorageDomain.format succeeded in 0.09 seconds (__init__:533) 2017-05-01 11:47:09,026+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: startMonitoringDomain(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', hostID=1, options=None) (logUtils:51) 2017-05-01 11:47:09,026+0100 INFO (jsonrpc/7) [storage.Monitor] Start monitoring cf8fd003-3666-4eb9-b589-bd78f70e2f49 (monitor:182) 2017-05-01 11:47:09,026+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: startMonitoringDomain, Return response: None (logUtils:54) 2017-05-01 11:47:09,027+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.startMonitoringDomain succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:47:09,027+0100 INFO (monitor/cf8fd00) [storage.check] Start checking u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/dom_md/metadata' (check:122) 2017-05-01 11:47:09,034+0100 INFO (monitor/cf8fd00) [storage.Monitor] Domain cf8fd003-3666-4eb9-b589-bd78f70e2f49 became VALID (monitor:456) 2017-05-01 11:47:09,035+0100 INFO (monitor/cf8fd00) [storage.SANLock] Acquiring host id for domain cf8fd003-3666-4eb9-b589-bd78f70e2f49 (id: 1) (clusterlock:282) 2017-05-01 11:47:09,035+0100 INFO (event/9) [vds] vmContainerLock acquired (clientIF:186) 2017-05-01 11:47:11,781+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:47:14,035+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:47:14,035+0100 INFO (jsonrpc/6) [dispatcher] Run and protect: repoStats, Return response: {u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '8.603e-05', 'lastCheck': '5.0', 'valid': True}} (logUtils:54) 2017-05-01 11:47:14,039+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:47:19,048+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:47:19,048+0100 INFO (jsonrpc/1) [dispatcher] Run and protect: repoStats, Return response: {u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '8.603e-05', 'lastCheck': '0.0', 'valid': True}} (logUtils:54) 2017-05-01 11:47:19,051+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:47:21,661+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:47:21,661+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '8.2248e-05', 'lastCheck': '2.6', 'valid': True}} (logUtils:54) 2017-05-01 11:47:24,061+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:47:24,061+0100 INFO (jsonrpc/3) [dispatcher] Run and protect: repoStats, Return response: {u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '8.2248e-05', 'lastCheck': '5.0', 'valid': True}} (logUtils:54) 2017-05-01 11:47:24,064+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:47:26,800+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:47:29,074+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:47:29,074+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: repoStats, Return response: {u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '8.6209e-05', 'lastCheck': '0.0', 'valid': True}} (logUtils:54) 2017-05-01 11:47:29,078+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:47:34,087+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:47:34,087+0100 INFO (jsonrpc/5) [dispatcher] Run and protect: repoStats, Return response: {u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '8.6209e-05', 'lastCheck': '5.0', 'valid': True}} (logUtils:54) 2017-05-01 11:47:34,090+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:47:36,670+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:47:36,670+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': False, 'delay': '8.6209e-05', 'lastCheck': '7.6', 'valid': True}} (logUtils:54) 2017-05-01 11:47:39,100+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:47:39,101+0100 INFO (jsonrpc/7) [dispatcher] Run and protect: repoStats, Return response: {u'cf8fd003-3666-4eb9-b589-bd78f70e2f49': {'code': 0, 'actual': True, 'version': 3, 'acquired': True, 'delay': '9.4134e-05', 'lastCheck': '0.1', 'valid': True}} (logUtils:54) 2017-05-01 11:47:39,104+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:47:41,819+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:47:44,686+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call VM.getStats failed (error 1) in 0.00 seconds (__init__:533) 2017-05-01 11:47:44,691+0100 INFO (jsonrpc/1) [vdsm.api] START __init__(cif=, params={u'cpuType': u'Broadwell', u'emulatedMachine': u'pc', u'vmId': u'92faf919-b7b1-42dc-a70c-15c6eb32ba2f', u'devices': [{u'device': u'scsi', u'model': u'virtio-scsi', u'type': u'controller'}, {u'device': u'console', u'specParams': {u'enableSocket': u'true'}, u'type': u'console', u'deviceId': u'4a3511b0-07e9-43bb-9f8c-f25df055d6f7', u'alias': u'console0'}, {u'index': u'2', u'iface': u'ide', u'specParams': {}, u'readonly': u'true', u'deviceId': u'5e158794-d263-422f-8982-5184e4c954ce', u'address': {u'bus': u'1', u'controller': u'0', u'type': u'drive', u'target': u'0', u'unit': u'0'}, u'device': u'cdrom', u'shared': u'false', u'path': u'/tmp/tmpoJEuG6/seed.iso', u'type': u'disk'}, {u'index': u'0', u'iface': u'virtio', u'format': u'raw', u'bootOrder': u'1', u'poolID': u'00000000-0000-0000-0000-000000000000', u'volumeID': u'397f6a0c-2824-443b-b3a6-797eed1d1059', u'imageID': u'c765d43a-d1aa-4037-8e16-b0b248698310', u'specParams': {}, u'readonly': u'false', u'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', u'optional': u'false', u'deviceId': u'c765d43a-d1aa-4037-8e16-b0b248698310', u'address': {u'slot': u'0x06', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, u'device': u'disk', u'shared': u'exclusive', u'propagateErrors': u'off', u'type': u'disk'}, {u'nicModel': u'pv', u'macAddr': u'00:16:3e:66:a0:2b', u'linkActive': u'true', u'network': u'ovirtmgmt', u'specParams': {}, u'deviceId': u'daa6925b-bd4c-440b-8ec4-b05c6c0de291', u'address': {u'slot': u'0x03', u'bus': u'0x00', u'domain': u'0x0000', u'type': u'pci', u'function': u'0x0'}, u'device': u'bridge', u'type': u'interface'}, {u'device': u'vga', u'alias': u'video0', u'type': u'video'}, {u'device': u'vnc', u'type': u'graphics'}, {u'device': u'virtio', u'specParams': {u'source': u'random'}, u'model': u'virtio', u'type': u'rng'}], u'smp': u'2', 'vmType': 'kvm', u'memSize': 4096, u'maxVCpus': u'6', u'spiceSecureChannels': u'smain,sdisplay,sinputs,scursor,splayback,srecord,ssmartcard,susbredir', u'vmName': u'HostedEngine', u'display': u'vnc'}, recover=False) (api:39) 2017-05-01 11:47:44,693+0100 INFO (jsonrpc/1) [vdsm.api] FINISH __init__ return=None (api:45) 2017-05-01 11:47:44,698+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call VM.create succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:47:44,699+0100 INFO (vm/92faf919) [virt.vm] (vmId='92faf919-b7b1-42dc-a70c-15c6eb32ba2f') VM wrapper has started (vm:1930) 2017-05-01 11:47:44,700+0100 INFO (vm/92faf919) [dispatcher] Run and protect: getVolumeSize(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'00000000-0000-0000-0000-000000000000', imgUUID=u'c765d43a-d1aa-4037-8e16-b0b248698310', volUUID=u'397f6a0c-2824-443b-b3a6-797eed1d1059', options=None) (logUtils:51) 2017-05-01 11:47:44,702+0100 INFO (vm/92faf919) [dispatcher] Run and protect: getVolumeSize, Return response: {'truesize': '1973469184', 'apparentsize': '53687091200'} (logUtils:54) 2017-05-01 11:47:44,702+0100 INFO (vm/92faf919) [vds] prepared volume path: /tmp/tmpoJEuG6/seed.iso (clientIF:374) 2017-05-01 11:47:44,703+0100 INFO (vm/92faf919) [dispatcher] Run and protect: prepareImage(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', spUUID=u'00000000-0000-0000-0000-000000000000', imgUUID=u'c765d43a-d1aa-4037-8e16-b0b248698310', leafUUID=u'397f6a0c-2824-443b-b3a6-797eed1d1059', allowIllegal=False) (logUtils:51) 2017-05-01 11:47:44,707+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call VM.getStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:47:44,710+0100 INFO (vm/92faf919) [dispatcher] Run and protect: prepareImage, Return response: {'info': {'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c765d43a-d1aa-4037-8e16-b0b248698310/397f6a0c-2824-443b-b3a6-797eed1d1059', 'volumeID': u'397f6a0c-2824-443b-b3a6-797eed1d1059', 'leasePath': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c765d43a-d1aa-4037-8e16-b0b248698310/397f6a0c-2824-443b-b3a6-797eed1d1059.lease', 'imageID': u'c765d43a-d1aa-4037-8e16-b0b248698310'}, 'path': u'/var/run/vdsm/storage/cf8fd003-3666-4eb9-b589-bd78f70e2f49/c765d43a-d1aa-4037-8e16-b0b248698310/397f6a0c-2824-443b-b3a6-797eed1d1059', 'imgVolumesInfo': [{'domainID': u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', 'volType': 'path', 'leaseOffset': 0, 'path': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c765d43a-d1aa-4037-8e16-b0b248698310/397f6a0c-2824-443b-b3a6-797eed1d1059', 'volumeID': u'397f6a0c-2824-443b-b3a6-797eed1d1059', 'leasePath': u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/images/c765d43a-d1aa-4037-8e16-b0b248698310/397f6a0c-2824-443b-b3a6-797eed1d1059.lease', 'imageID': u'c765d43a-d1aa-4037-8e16-b0b248698310'}]} (logUtils:54) 2017-05-01 11:47:44,710+0100 INFO (vm/92faf919) [vds] prepared volume path: /var/run/vdsm/storage/cf8fd003-3666-4eb9-b589-bd78f70e2f49/c765d43a-d1aa-4037-8e16-b0b248698310/397f6a0c-2824-443b-b3a6-797eed1d1059 (clientIF:374) 2017-05-01 11:47:44,802+0100 INFO (vm/92faf919) [root] (hooks:108) 2017-05-01 11:47:44,803+0100 INFO (vm/92faf919) [virt.vm] (vmId='92faf919-b7b1-42dc-a70c-15c6eb32ba2f') HostedEngine 92faf919-b7b1-42dc-a70c-15c6eb32ba2f 4194304 4194304 6 /dev/random
c765d43a-d1aa-4037-8e16-b0b248698310 397f6a0c-2824-443b-b3a6-797eed1d1059 cf8fd003-3666-4eb9-b589-bd78f70e2f49 hvm oVirt oVirt Node 7-3.1611.el7.centos C0007970-0000-3412-567A-14DDA9D7154A 92faf919-b7b1-42dc-a70c-15c6eb32ba2f Broadwell destroydestroydestroy (vm:2018) 2017-05-01 11:47:45,038+0100 ERROR (vm/92faf919) [virt.vm] (vmId='92faf919-b7b1-42dc-a70c-15c6eb32ba2f') The vm start process failed (vm:632) Traceback (most recent call last): File "/usr/share/vdsm/virt/vm.py", line 563, in _startUnderlyingVm self._run() File "/usr/share/vdsm/virt/vm.py", line 2021, in _run self._connection.createXML(domxml, flags), File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 123, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 941, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-packages/libvirt.py", line 3782, in createXML if ret is None:raise libvirtError('virDomainCreateXML() failed', conn=self) libvirtError: internal error: process exited while connecting to monitor: /dev/random -device virtio-rng-pci,rng=objrng0,id=rng0,bus=pci.0,addr=0x7 -msg timestamp=on Could not access KVM kernel module: Permission denied failed to initialize KVM: Permission denied 2017-05-01 11:47:45,040+0100 INFO (vm/92faf919) [virt.vm] (vmId='92faf919-b7b1-42dc-a70c-15c6eb32ba2f') Changed state to Down: internal error: process exited while connecting to monitor: /dev/random -device virtio-rng-pci,rng=objrng0,id=rng0,bus=pci.0,addr=0x7 -msg timestamp=on Could not access KVM kernel module: Permission denied failed to initialize KVM: Permission denied (code=1) (vm:1222) 2017-05-01 11:47:45,040+0100 INFO (vm/92faf919) [virt.vm] (vmId='92faf919-b7b1-42dc-a70c-15c6eb32ba2f') Stopping connection (guestagent:430) 2017-05-01 11:47:47,714+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call VM.getStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:47:48,065+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: stopMonitoringDomain(sdUUID=u'cf8fd003-3666-4eb9-b589-bd78f70e2f49', options=None) (logUtils:51) 2017-05-01 11:47:48,066+0100 INFO (jsonrpc/2) [storage.Monitor] Stop monitoring cf8fd003-3666-4eb9-b589-bd78f70e2f49 (shutdown=False) (monitor:237) 2017-05-01 11:47:48,066+0100 INFO (monitor/cf8fd00) [storage.check] Stop checking u'/rhev/data-center/mnt/host1.bajada.es:_ovirt_vm/cf8fd003-3666-4eb9-b589-bd78f70e2f49/dom_md/metadata' (check:136) 2017-05-01 11:47:48,066+0100 INFO (monitor/cf8fd00) [storage.SANLock] Releasing host id for domain cf8fd003-3666-4eb9-b589-bd78f70e2f49 (id: 1) (clusterlock:305) 2017-05-01 11:47:50,067+0100 INFO (jsonrpc/2) [dispatcher] Run and protect: stopMonitoringDomain, Return response: None (logUtils:54) 2017-05-01 11:47:50,067+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.stopMonitoringDomain succeeded in 2.00 seconds (__init__:533) 2017-05-01 11:47:51,686+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:47:51,686+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:47:51,692+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:47:51,692+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:47:56,838+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:48:06,710+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:48:06,710+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:48:06,714+0100 ERROR (periodic/3) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:48:06,714+0100 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:48:11,857+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:48:21,726+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:48:21,726+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:48:21,729+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:48:21,729+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:48:26,876+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:48:36,740+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:48:36,740+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:48:36,743+0100 ERROR (periodic/3) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:48:36,744+0100 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:48:41,883+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:48:51,755+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:48:51,755+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:48:51,759+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:48:51,759+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:48:56,902+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:49:06,770+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:49:06,770+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:49:06,773+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:49:06,773+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:49:11,921+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:49:21,784+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:49:21,784+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:49:21,787+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:49:21,788+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:49:26,940+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:49:36,799+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:49:36,799+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:49:36,802+0100 ERROR (periodic/3) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:49:36,802+0100 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:49:41,959+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:49:51,814+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:49:51,814+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:49:51,817+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:49:51,817+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:49:56,977+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:50:06,818+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:50:06,818+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:50:06,821+0100 ERROR (periodic/3) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:50:06,822+0100 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:50:11,996+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:50:21,832+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:50:21,832+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:50:21,835+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:50:21,836+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:50:27,015+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:50:36,837+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:50:36,837+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:50:36,840+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:50:36,840+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:50:42,034+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:50:51,851+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:50:51,851+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:50:51,854+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:50:51,854+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:50:57,053+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:51:06,866+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:51:06,866+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:51:06,869+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:51:06,869+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:51:12,071+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:51:21,880+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:51:21,880+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:51:21,883+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:51:21,884+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:51:27,090+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:51:36,894+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:51:36,895+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:51:36,898+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:51:36,898+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:51:42,107+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:51:51,909+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:51:51,909+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:51:51,912+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:51:51,913+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:51:57,125+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:52:06,923+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:52:06,923+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:52:06,926+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:52:06,927+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:52:12,144+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:52:21,928+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:52:21,928+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:52:21,931+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:52:21,931+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:52:27,163+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:52:36,943+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:52:36,943+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:52:36,946+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:52:36,946+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:52:42,182+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:52:51,947+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:52:51,947+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:52:51,950+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:52:51,950+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:52:57,201+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:53:06,961+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:53:06,961+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:53:06,964+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:53:06,964+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:53:12,220+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:53:21,975+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:53:21,976+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:53:21,979+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:53:21,979+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:53:27,239+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:53:36,990+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:53:36,990+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:53:36,993+0100 ERROR (periodic/3) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:53:36,993+0100 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:53:42,257+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:53:52,004+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:53:52,005+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:53:52,008+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:53:52,008+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:53:57,276+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:54:07,019+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:54:07,019+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:54:07,022+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:54:07,022+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:54:12,295+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:54:22,034+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:54:22,034+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:54:22,037+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:54:22,037+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:54:27,314+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:54:37,038+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:54:37,039+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:54:37,042+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:54:37,042+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:54:42,333+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:54:52,053+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:54:52,053+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:54:52,056+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:54:52,057+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:54:57,352+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:55:07,057+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:55:07,058+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:55:07,061+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:55:07,061+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:55:12,370+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:55:22,072+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:55:22,072+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:55:22,075+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:55:22,076+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:55:27,389+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:55:37,077+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:55:37,077+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:55:37,080+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:55:37,080+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:55:42,408+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:55:52,091+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:55:52,092+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:55:52,095+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:55:52,095+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:55:57,427+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:56:07,096+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:56:07,096+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:56:07,099+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:56:07,099+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:56:12,446+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:56:22,110+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:56:22,110+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:56:22,114+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:56:22,114+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:56:27,465+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:56:37,125+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:56:37,125+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:56:37,128+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:56:37,128+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:56:42,484+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:56:52,140+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:56:52,140+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:56:52,143+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:56:52,143+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:56:57,503+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:57:07,154+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:57:07,155+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:57:07,158+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:57:07,158+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:57:12,521+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:57:22,169+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:57:22,169+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:57:22,172+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:57:22,172+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:57:27,540+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:57:37,183+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:57:37,184+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:57:37,187+0100 ERROR (periodic/3) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:57:37,187+0100 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:57:42,559+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:57:52,188+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:57:52,188+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:57:52,191+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:57:52,192+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:57:57,578+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.01 seconds (__init__:533) 2017-05-01 11:58:07,203+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:58:07,203+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:58:07,206+0100 ERROR (periodic/3) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:58:07,206+0100 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:58:12,597+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:58:22,208+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:58:22,208+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:58:22,211+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:58:22,211+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:58:27,616+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:58:37,222+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:58:37,222+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:58:37,225+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:58:37,226+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:58:42,634+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:58:52,227+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:58:52,227+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:58:52,230+0100 ERROR (periodic/3) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:58:52,230+0100 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:58:57,653+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:59:07,241+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:59:07,241+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:59:07,244+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:59:07,245+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:59:12,672+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:59:22,255+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:59:22,255+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:59:22,258+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:59:22,259+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:59:27,691+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:59:37,269+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:59:37,269+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:59:37,272+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:59:37,273+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:59:42,699+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 11:59:52,284+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 11:59:52,284+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 11:59:52,287+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 11:59:52,288+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 11:59:57,718+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:00:07,299+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:00:07,299+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:00:07,302+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:00:07,302+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:00:12,737+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:00:22,313+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:00:22,313+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:00:22,316+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:00:22,316+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:00:27,756+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:00:37,318+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:00:37,318+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:00:37,321+0100 ERROR (periodic/3) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:00:37,321+0100 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:00:42,775+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:00:52,332+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:00:52,333+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:00:52,336+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:00:52,336+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:00:57,793+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:01:07,337+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:01:07,338+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:01:07,342+0100 ERROR (periodic/3) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:01:07,342+0100 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:01:12,812+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:01:22,352+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:01:22,353+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:01:22,356+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:01:22,356+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:01:27,831+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:01:37,366+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:01:37,366+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:01:37,369+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:01:37,369+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:01:42,850+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:01:52,381+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:01:52,381+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:01:52,384+0100 ERROR (periodic/3) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:01:52,384+0100 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:01:57,869+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:02:07,396+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:02:07,396+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:02:07,400+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:02:07,400+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:02:12,888+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:02:22,410+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:02:22,410+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:02:22,413+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:02:22,414+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:02:27,906+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:02:37,424+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:02:37,425+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:02:37,428+0100 ERROR (periodic/3) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:02:37,428+0100 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:02:42,925+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:02:52,439+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:02:52,439+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:02:52,442+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:02:52,443+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:02:57,944+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:03:07,453+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:03:07,454+0100 INFO (periodic/3) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:03:07,457+0100 ERROR (periodic/3) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:03:07,457+0100 ERROR (periodic/3) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:03:12,963+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:03:22,458+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:03:22,458+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:03:22,461+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:03:22,461+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:03:27,981+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:03:37,473+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:03:37,473+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:03:37,476+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:03:37,476+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:03:43,000+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:03:52,477+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:03:52,478+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:03:52,481+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:03:52,481+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:03:58,019+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:04:07,492+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:04:07,492+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:04:07,495+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:04:07,495+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:04:13,038+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.01 seconds (__init__:533) 2017-05-01 12:04:22,497+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:04:22,497+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:04:22,500+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:04:22,500+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:04:28,057+0100 INFO (jsonrpc/0) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:04:37,511+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:04:37,511+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:04:37,514+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:04:37,514+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:04:43,076+0100 INFO (jsonrpc/6) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:04:52,526+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:04:52,526+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:04:52,529+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:04:52,529+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:04:58,094+0100 INFO (jsonrpc/1) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:05:07,540+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:05:07,540+0100 INFO (periodic/2) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:05:07,543+0100 ERROR (periodic/2) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:05:07,543+0100 ERROR (periodic/2) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:05:13,113+0100 INFO (jsonrpc/3) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:05:22,555+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:05:22,555+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:05:22,558+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:05:22,558+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:05:28,123+0100 INFO (jsonrpc/4) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:05:37,569+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:05:37,569+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:05:37,572+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:05:37,573+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:05:43,142+0100 INFO (jsonrpc/2) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:05:52,584+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:05:52,584+0100 INFO (periodic/1) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:05:52,587+0100 ERROR (periodic/1) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:05:52,587+0100 ERROR (periodic/1) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:05:58,161+0100 INFO (jsonrpc/5) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533) 2017-05-01 12:06:07,598+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats(options=None) (logUtils:51) 2017-05-01 12:06:07,598+0100 INFO (periodic/0) [dispatcher] Run and protect: repoStats, Return response: {} (logUtils:54) 2017-05-01 12:06:07,602+0100 ERROR (periodic/0) [ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink] Failed to connect to broker, the number of errors has exceeded the limit (1) (brokerlink:75) 2017-05-01 12:06:07,602+0100 ERROR (periodic/0) [root] failed to retrieve Hosted Engine HA info (api:252) Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/vdsm/host/api.py", line 231, in _getHaInfo stats = instance.get_all_stats() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", line 102, in get_all_stats with broker.connection(self._retries, self._wait): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 99, in connection self.connect(retries, wait) File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 78, in connect raise BrokerConnectionError(error_msg) BrokerConnectionError: Failed to connect to broker, the number of errors has exceeded the limit (1) 2017-05-01 12:06:13,180+0100 INFO (jsonrpc/7) [jsonrpc.JsonRpcServer] RPC call Host.getAllVmStats succeeded in 0.00 seconds (__init__:533)