[ovirt-devel] [VDSM] STOMP tests failures

[Nir Soffer]

Hi all,

We are seeing the following error randomly - there must be a timing
issue in the test,
or maybe in the code?

Pitor, can you check this?

(From http://jenkins.ovirt.org/job/vdsm_master_check-patch-fc23-x86_64/3568/console)

13:33:28 ======================================================================
13:33:28 ERROR: test_echo(1024, False) (stompTests.StompTests)
13:33:28 ----------------------------------------------------------------------
13:33:28 Traceback (most recent call last):
13:33:28   File
"/home/jenkins/workspace/vdsm_master_check-patch-fc23-x86_64/vdsm/tests/testlib.py",
line 73, in wrapper
13:33:28     return f(self, *args)
13:33:28   File
"/home/jenkins/workspace/vdsm_master_check-patch-fc23-x86_64/vdsm/tests/stompTests.py",
line 83, in test_echo
13:33:28     str(uuid4())),
13:33:28   File
"/home/jenkins/workspace/vdsm_master_check-patch-fc23-x86_64/vdsm/lib/yajsonrpc/__init__.py",
line 339, in callMethod
13:33:28     raise JsonRpcNoResponseError(methodName)
13:33:28 JsonRpcNoResponseError: [-32605] No response for JSON-RPC echo request.
13:33:28 -------------------- >> begin captured logging << --------------------
13:33:28 vds.MultiProtocolAcceptor: INFO: Listening at ::1:38659
13:33:28 Scheduler: DEBUG: Starting scheduler test.Scheduler
13:33:28 Scheduler: DEBUG: started
13:33:28 Executor: DEBUG: Starting executor
13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/0
13:33:28 Executor: DEBUG: Worker started
13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/1
13:33:28 Executor: DEBUG: Worker started
13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/2
13:33:28 Executor: DEBUG: Worker started
13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/3
13:33:28 Executor: DEBUG: Worker started
13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/4
13:33:28 Executor: DEBUG: Worker started
13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/5
13:33:28 Executor: DEBUG: Worker started
13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/6
13:33:28 Executor: DEBUG: Worker started
13:33:28 Executor: DEBUG: Starting worker jsonrpc.Executor/7
13:33:28 Executor: DEBUG: Worker started
13:33:28 vds.MultiProtocolAcceptor: DEBUG: Adding detector
<vdsm.rpc.bindingxmlrpc.XmlDetector instance at 0x7f9e4b3e9a70>
13:33:28 vds.MultiProtocolAcceptor: DEBUG: Adding detector
<yajsonrpc.stompreactor.StompDetector instance at 0x7f9e4b3e9ab8>
13:33:28 FakeClientIf: INFO: XMLRPC server running
13:33:28 ProtocolDetector.AcceptorImpl: INFO: Accepting connection
from ::1:39788
13:33:28 ProtocolDetector.Detector: DEBUG: Using required_size=11
13:33:28 ProtocolDetector.Detector: INFO: Detected protocol stomp from ::1:39788
13:33:28 Broker.StompAdapter: INFO: Processing CONNECT request
13:33:28 jsonrpc.AsyncoreClient: DEBUG: Sending response
13:33:28 yajsonrpc.protocols.stomp.AsyncClient: DEBUG: Stomp
connection established
13:33:28 Broker.StompAdapter: INFO: Subscribe command received
13:33:28 jsonrpc.JsonRpcServer: DEBUG: Calling 'echo' in bridge with
[u'Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do
eiusmod tempor

incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea
commodo consequat. Duis aute irure dolor in reprehenderit in voluptate
velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint
occaecat cupidatat non proident, sunt in culpa qui officia deserunt
mollit anim id est laborum. Lorem ipsum dolor sit amet, consectetur
adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore
magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation
ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute
irure dolor in reprehenderit in voluptate velit esse cillum dolore eu
fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident,
sunt in culpa qui officia deserunt mollit anim id est laborum. Lorem
ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod
tempor incididunt ut labore et dolore magna aliqua. Ut en']
13:33:29 jsonrpc.JsonRpcServer: DEBUG: Return 'echo' in bridge with
Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do
eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad
minim veniam, quis nostrud exercitation ullamco laboris nisi ut
aliquip ex ea commodo consequat. Duis aute irure dolor in
reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla
pariatur. Excepteur sint occaecat cupidatat non proident, sunt in
culpa qui officia deserunt mollit anim id est laborum. Lorem ipsum
dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor
incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam,
quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea
commodo consequat. Duis aute irure dolor in reprehenderit in voluptate
velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint
occaecat cupidatat non proident, sunt in culpa qui officia deserunt
mollit anim id est laborum. Lorem ipsum dolor sit amet, consectetur
adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore
magna aliqua. Ut en
13:33:29 protocoldetector.StompDetector: DEBUG: Stomp detected from
('::1', 39788)
13:33:29 vds.MultiProtocolAcceptor: DEBUG: Stopping Acceptor
13:33:29 jsonrpc.JsonRpcServer: INFO: Stopping JsonRPC Server
13:33:29 Executor: DEBUG: Stopping executor
13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/7
13:33:29 Executor: DEBUG: Worker stopped
13:33:29 Executor: DEBUG: Worker stopped
13:33:29 Executor: DEBUG: Worker stopped
13:33:29 Executor: DEBUG: Worker stopped
13:33:29 Executor: DEBUG: Worker stopped
13:33:29 Executor: DEBUG: Worker stopped
13:33:29 Executor: DEBUG: Worker stopped
13:33:29 Executor: DEBUG: Worker stopped
13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/2
13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/3
13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/0
13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/1
13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/6
13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/5
13:33:29 Executor: DEBUG: Waiting for worker jsonrpc.Executor/4
13:33:29 FakeClientIf: INFO: Stopping XMLRPC server
13:33:29 FakeClientIf: INFO: XMLRPC server stopped
13:33:29 Scheduler: DEBUG: Stopping scheduler test.Scheduler
13:33:29 Scheduler: DEBUG: stopped
13:33:29 --------------------- >> end captured logging << ---------------------