[ovirt-devel] [VDSM] STOMP tests failures

Hi all, We are seeing the following error randomly - there must be a timing issue in the test, or maybe in the code? Pitor, can you check this? (From http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/3568/con...) 13:33:28 ====================================================================== 13:33:28 ERROR: test_echo(1024, False) (stompTests.StompTests) 13:33:28 ---------------------------------------------------------------------- 13:33:28 Traceback (most recent call last): 13:33:28 File "/home/jenkins/workspace/vdsm_master_check-patch-fc23-x86_64/vdsm/tests/testlib.py", line 73, in wrapper 13:33:28 return f(self, *args) 13:33:28 File "/home/jenkins/workspace/vdsm_master_check-patch-fc23-x86_64/vdsm/tests/stompTests.py", line 83, in test_echo 13:33:28 str(uuid4())), 13:33:28 File "/home/jenkins/workspace/vdsm_master_check-patch-fc23-x86_64/vdsm/lib/yajsonrpc/__init__.py", line 339, in callMethod 13:33:28 raise JsonRpcNoResponseError(methodName) 13:33:28 JsonRpcNoResponseError: [-32605] No response for JSON-RPC echo request. 13:33:28 -------------------- >> begin captured logging << -------------------- 13:33:28 vds.MultiProtocolAcceptor: INFO: Listening at ::1:38659 13:33:28 Scheduler: DEBUG: Starting scheduler test.Scheduler 13:33:28 Scheduler: DEBUG: started 13:33:28 Executor: DEBUG: Starting executor 13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/0 13:33:28 Executor: DEBUG: Worker started 13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/1 13:33:28 Executor: DEBUG: Worker started 13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/2 13:33:28 Executor: DEBUG: Worker started 13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/3 13:33:28 Executor: DEBUG: Worker started 13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/4 13:33:28 Executor: DEBUG: Worker started 13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/5 13:33:28 Executor: DEBUG: Worker started 13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/6 13:33:28 Executor: DEBUG: Worker started 13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/7 13:33:28 Executor: DEBUG: Worker started 13:33:28 vds.MultiProtocolAcceptor: DEBUG: Adding detector <vdsm.rpc.bindingxmlrpc.XmlDetector instance at 0x7f9e4b3e9a70> 13:33:28 vds.MultiProtocolAcceptor: DEBUG: Adding detector <yajsonrpc.stompreactor.StompDetector instance at 0x7f9e4b3e9ab8> 13:33:28 FakeClientIf: INFO: XMLRPC server running 13:33:28 ProtocolDetector.AcceptorImpl: INFO: Accepting connection from ::1:39788 13:33:28 ProtocolDetector.Detector: DEBUG: Using required_size=11 13:33:28 ProtocolDetector.Detector: INFO: Detected protocol stomp from ::1:39788 13:33:28 Broker.StompAdapter: INFO: Processing CONNECT request 13:33:28 jsonrpc.AsyncoreClient: DEBUG: Sending response 13:33:28 yajsonrpc.protocols.stomp.AsyncClient: DEBUG: Stomp connection established 13:33:28 Broker.StompAdapter: INFO: Subscribe command received 13:33:28 jsonrpc.JsonRpcServer: DEBUG: Calling 'echo' in bridge with [u'Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum. Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum. Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut en'] 13:33:29 jsonrpc.JsonRpcServer: DEBUG: Return 'echo' in bridge with Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum. Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum. Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut en 13:33:29 protocoldetector.StompDetector: DEBUG: Stomp detected from ('::1', 39788) 13:33:29 vds.MultiProtocolAcceptor: DEBUG: Stopping Acceptor 13:33:29 jsonrpc.JsonRpcServer: INFO: Stopping JsonRPC Server 13:33:29 Executor: DEBUG: Stopping executor 13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/7 13:33:29 Executor: DEBUG: Worker stopped 13:33:29 Executor: DEBUG: Worker stopped 13:33:29 Executor: DEBUG: Worker stopped 13:33:29 Executor: DEBUG: Worker stopped 13:33:29 Executor: DEBUG: Worker stopped 13:33:29 Executor: DEBUG: Worker stopped 13:33:29 Executor: DEBUG: Worker stopped 13:33:29 Executor: DEBUG: Worker stopped 13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/2 13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/3 13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/0 13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/1 13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/6 13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/5 13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/4 13:33:29 FakeClientIf: INFO: Stopping XMLRPC server 13:33:29 FakeClientIf: INFO: XMLRPC server stopped 13:33:29 Scheduler: DEBUG: Stopping scheduler test.Scheduler 13:33:29 Scheduler: DEBUG: stopped 13:33:29 --------------------- >> end captured logging << ---------------------