On Thu, Mar 12, 2020 at 9:10 PM Nir Soffer <nsoffer@redhat.com> wrote:
Another failure from json rpc test:
https://jenkins.ovirt.org/job/vdsm_standard-check-patch/19356//artifact/check-patch.tests-py3.fc30.x86_64/mock_logs/script/stdout_stderr.log

Another random failure today:
________________ JsonRpcServerTests.testMethodCallArgList(True) ________________

self = <jsonrpcserver_test.JsonRpcServerTests testMethod=testMethodCallArgList(True)>
use_ssl = True

    @permutations(USE_SSL)
    def testMethodCallArgList(self, use_ssl):
        data = dummyTextGenerator(1024)
        ssl_ctx = self.ssl_ctx if use_ssl else None
        bridge = _DummyBridge()
    
        with constructClient(self.log, bridge, ssl_ctx) as clientFactory:
            with self._client(clientFactory) as client:
                self.log.info("Calling 'echo'")
                self.assertEqual(self._callTimeout(client, "echo",
>                                                  (data,), CALL_ID), data)

lib/yajsonrpc/jsonrpcserver_test.py:166: 
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ 

self = <jsonrpcserver_test.JsonRpcServerTests testMethod=testMethodCallArgList(True)>
client = <yajsonrpc.jsonrpcclient.JsonRpcClient object at 0x7f07715ba6d8>
methodName = 'echo'
params = ('Lorem ipsum dolor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna...lor sit amet, consectetur adipisicing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut en',)
rid = '2c8134fd-7dd4-4cfc-b7f8-6b7549399cb6', timeout = None

    def _callTimeout(self, client, methodName, params=None, rid=None,
                     timeout=None):
        responses = client.call(JsonRpcRequest(methodName, params, rid),
                                timeout=CALL_TIMEOUT)
        if not responses:
>           raise JsonRpcNoResponseError(method=methodName)
E           yajsonrpc.exception.JsonRpcNoResponseError: No response for JSON-RPC request: {'method': 'echo'}

lib/yajsonrpc/jsonrpcserver_test.py:123: JsonRpcNoResponseError
------------------------------ Captured log call -------------------------------
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
ERROR    vds.dispatcher:betterAsyncore.py:179 uncaptured python exception, closing channel <yajsonrpc.betterAsyncore.Dispatcher ('::1', 34046, 0, 0) at 0x7f07715bafd0> (<class 'ValueError'>:'b'ept-version:1.2'' contains illegal character ':' [/usr/lib64/python3.6/asyncore.py|readwrite|108] [/usr/lib64/python3.6/asyncore.py|handle_read_event|423] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|handle_read|71] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|_delegate_call|168] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/protocoldetector.py|handle_read|129] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|handle_socket|413] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/rpc/bindingjsonrpc.py|add_socket|54] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|createListener|379] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|StompListener|345] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|__init__|47] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|switch_implementation|86] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|init|363] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/rpc/bindingjsonrpc.py|_onAccept|57] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|set_message_handler|645] [/usr/lib64/python3.6/asyncore.py|handle_read_event|423] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|handle_read|71] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|_delegate_call|168] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|handle_read|421] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|parse|323] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|_parse_command|245] [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|decode_value|167])
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled close event
=============================== warnings summary ===============================
/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334
  /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334: PytestUnknownMarkWarning: Unknown pytest.mark.stress - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
    PytestUnknownMarkWarning,

/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334
  /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334: PytestUnknownMarkWarning: Unknown pytest.mark.slow - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
    PytestUnknownMarkWarning,

/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/v2v.py:79
  /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/v2v.py:79: DeprecationWarning: invalid escape sequence \d
    _SSH_AUTH_RE = b'(SSH_AUTH_SOCK)=([^;]+).*;\nSSH_AGENT_PID=(\d+)'

/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/v2v.py:1421
  /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/v2v.py:1421: DeprecationWarning: invalid escape sequence \^
    '(?P<m2_base>[0-9]+){sp}\^{sp}(?P<m2_exp>{exp}))'.format(

/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334
  /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334: PytestUnknownMarkWarning: Unknown pytest.mark.xpass - is this a typo?  You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/latest/mark.html
    PytestUnknownMarkWarning,

tests/lib/osinfo_test.py::test_package_versions
  /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/osinfo.py:284: UnicodeWarning: decode() called on unicode string, see https://bugzilla.redhat.com/show_bug.cgi?id=1693751
    'version': mi['version'].decode('utf-8'),

tests/lib/osinfo_test.py::test_package_versions
  /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/osinfo.py:285: UnicodeWarning: decode() called on unicode string, see https://bugzilla.redhat.com/show_bug.cgi?id=1693751
    'release': mi['release'].decode('utf-8'),

-- Docs: https://docs.pytest.org/en/latest/warnings.html

----------- coverage: platform linux, python 3.6.8-final-0 -----------
Coverage HTML written to dir htmlcov-lib

========================== slowest 10 test durations ===========================
18.17s call     tests/lib/yajsonrpc/jsonrpcserver_test.py::JsonRpcServerTests::testMethodCallArgList(True)
3.00s call     tests/lib/protocoldetector_test.py::AcceptorTests::test_reject_very_slow_client(True)
2.80s call     tests/lib/protocoldetector_test.py::AcceptorTests::test_reject_very_slow_client_concurrency(True)
2.79s call     tests/lib/protocoldetector_test.py::AcceptorTests::test_reject_very_slow_client_concurrency(False)
2.67s call     tests/lib/protocoldetector_test.py::AcceptorTests::test_reject_very_slow_client(False)
1.97s call     tests/pywatch_test.py::TestPyWatch::test_timeout_output
1.90s call     tests/pywatch_test.py::TestPyWatch::test_timeout_backtrace
1.35s call     tests/lib/protocoldetector_test.py::AcceptorTests::test_detect_slow_client(True)
1.35s call     tests/lib/utils_test.py::TestPickleCopy::test_picklecopy_faster
1.29s call     tests/lib/protocoldetector_test.py::AcceptorTests::test_detect_slow_client_concurrency(False)

 


_________________ JsonRpcServerTests.testClientSubscribe(True) _________________

self = <jsonrpcserver_test.JsonRpcServerTests
testMethod=testClientSubscribe(True)>
use_ssl = True

    @permutations(USE_SSL)
    def testClientSubscribe(self, use_ssl):
        ssl_ctx = self.ssl_ctx if use_ssl else None
        bridge = _DummyBridge()

        with constructClient(self.log, bridge, ssl_ctx) as clientFactory:
            with self._client(clientFactory) as client:
                event_queue = queue.Queue()
                sub = client.subscribe(EVENT_TOPIC, event_queue)

                res = self._callTimeout(client, "send_event", [],
>                                       CALL_ID)

lib/yajsonrpc/jsonrpcserver_test.py:264:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

self = <jsonrpcserver_test.JsonRpcServerTests
testMethod=testClientSubscribe(True)>
client = <yajsonrpc.jsonrpcclient.JsonRpcClient object at 0x7fc58ed1b410>
methodName = 'send_event', params = []
rid = '2c8134fd-7dd4-4cfc-b7f8-6b7549399cb6', timeout = None

    def _callTimeout(self, client, methodName, params=None, rid=None,
                     timeout=None):
        responses = client.call(JsonRpcRequest(methodName, params, rid),
                                timeout=CALL_TIMEOUT)
        if not responses:
>           raise JsonRpcNoResponseError(method=methodName)
E           yajsonrpc.exception.JsonRpcNoResponseError: No response
for JSON-RPC request: {'method': 'send_event'}

lib/yajsonrpc/jsonrpcserver_test.py:123: JsonRpcNoResponseError
------------------------------ Captured log call -------------------------------
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event

    We are missing handle_write in some dispatcher.

WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
ERROR    vds.dispatcher:betterAsyncore.py:179 uncaptured python
exception, closing channel <yajsonrpc.betterAsyncore.Dispatcher
('::1', 56210, 0, 0) at 0x7fc58ed1b790> (<class
'ValueError'>:'b'ept-version:1.2'' contains illegal character ':'
[/usr/lib64/python3.7/asyncore.py|readwrite|108]
[/usr/lib64/python3.7/asyncore.py|handle_read_event|422]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|handle_read|71]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|_delegate_call|168]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/protocoldetector.py|handle_read|129]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|handle_socket|413]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/rpc/bindingjsonrpc.py|add_socket|54]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|createListener|379]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|StompListener|345]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|__init__|47]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|switch_implementation|86]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|init|363]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/rpc/bindingjsonrpc.py|_onAccept|57]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|set_message_handler|645]
[/usr/lib64/python3.7/asyncore.py|handle_read_event|422]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|handle_read|71]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|_delegate_call|168]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|handle_read|421]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|parse|323]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|_parse_command|245]
[/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|decode_value|167])
WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled close event
ERROR    root:concurrent.py:267 FINISH thread <Thread(JsonRpc
(StompReactor), started daemon 140486081763072)> failed
Traceback (most recent call last):
  File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/common/concurrent.py",
line 260, in run
    ret = func(*args, **kwargs)
  File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py",
line 393, in process_requests
    self._reactor.process_requests()
  File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py",
line 238, in process_requests
    timeout=self._get_timeout(self._map),
  File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py",
line 253, in _get_timeout
    interval = disp.next_check_interval()
  File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py",
line 99, in next_check_interval
    return getattr(self.__impl, "next_check_interval", default_func)()
  File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py",
line 486, in next_check_interval
    self.handle_timeout()
  File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py",
line 451, in handle_timeout
    self._frame_handler.handle_timeout(self)
  File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompclient.py",
line 130, in handle_timeout
    dispatcher._on_timeout)
  File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py",
line 630, in reconnect
    AsyncDispatcher(self, self._async_client, count=count))
  File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py",
line 271, in reconnect
    dispatcher.create_socket(address, sslctx)
  File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py",
line 112, in create_socket
    sock = sslctx.wrapSocket(sock)
  File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/sslutils.py",
line 113, in wrapSocket
    ca_certs=self.ca_certs)
  File "/usr/lib64/python3.7/ssl.py", line 1230, in wrap_socket
    context.load_verify_locations(ca_certs)
FileNotFoundError: [Errno 2] No such file or directory

On Thu, Mar 12, 2020 at 5:34 PM Nir Soffer <nsoffer@redhat.com> wrote:
>
> I had 2 of these unrelated failures today. Would be nice to mark this
> test as broken on CI.
>
> https://jenkins.ovirt.org/job/vdsm_standard-check-patch/19353//artifact/check-patch.tests-py3.el8.x86_64/mock_logs/script/stdout_stderr.log
> https://jenkins.ovirt.org/job/vdsm_standard-check-patch/19354//artifact/check-patch.tests-py3.el8.x86_64/mock_logs/script/stdout_stderr.log
>
> =================================== FAILURES ===================================
> ______________________ VdsmClientTests.test_event_handler ______________________
>
> self = <stomprpcclient_test.VdsmClientTests testMethod=test_event_handler>
>
>     def test_event_handler(self):
>         with self._create_client() as client:
>             event_queue = queue.Queue()
>
>             sub_id = client.subscribe(EVENT_TOPIC, event_queue)
> >           client.Test.sendEvent()
>
> lib/yajsonrpc/stomprpcclient_test.py:215:
> _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
>
> self = <stomprpcclient_test._MockedClient object at 0x7fe19f6db1d0>
> namespace = 'Test', method_name = 'sendEvent', kwargs = {}
> method = 'Test.sendEvent', timeout = 3
> req = {'jsonrpc': '2.0', 'method': 'Test.sendEvent', 'params': {},
> 'id': 'c3985771-6f77-4431-9ed6-15082063a2d5'}
> responses = None
>
>     def _call(self, namespace, method_name, **kwargs):
>         """
>         Client call method, executes a given command
>
>         Args:
>             namespace (string): namespace name
>             method_name (string): method name
>             **kwargs: Arbitrary keyword arguments
>
>         Returns:
>             method result
>
>         Raises:
>             ClientError: in case of an error in the protocol.
>             TimeoutError: if there is no response after a pre configured time.
>             ServerError: in case of an error while executing the command
>         """
>         method = namespace + "." + method_name
>         timeout = kwargs.pop("_timeout", self._default_timeout)
>
>         req = yajsonrpc.JsonRpcRequest(
>             method, kwargs, reqId=str(uuid.uuid4()))
>
>         try:
>             responses = self._client.call(
>                 req, timeout=timeout, flow_id=self._flow_id)
>         except EnvironmentError as e:
>             raise ClientError(method, kwargs, e)
>
>         if not responses:
> >           raise TimeoutError(method, kwargs, timeout)
> E           vdsm.client.TimeoutError: Request Test.sendEvent with args
> {} timed out after 3 seconds
>
> ../lib/vdsm/client.py:294: TimeoutError
> ------------------------------ Captured log call -------------------------------
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled read event
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled write event
> ERROR    vds.dispatcher:betterAsyncore.py:179 uncaptured python
> exception, closing channel <yajsonrpc.betterAsyncore.Dispatcher
> ('::1', 36398, 0, 0) at 0x7fe19f6db208> (<class
> 'ValueError'>:'b'ept-version:1.2'' contains illegal character ':'
> [/usr/lib64/python3.6/asyncore.py|readwrite|108]
> [/usr/lib64/python3.6/asyncore.py|handle_read_event|423]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|handle_read|71]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|_delegate_call|168]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/protocoldetector.py|handle_read|129]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|handle_socket|413]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/rpc/bindingjsonrpc.py|add_socket|54]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|createListener|379]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|StompListener|345]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|__init__|47]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|switch_implementation|86]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py|init|363]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/rpc/bindingjsonrpc.py|_onAccept|57]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|set_message_handler|645]
> [/usr/lib64/python3.6/asyncore.py|handle_read_event|423]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|handle_read|71]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py|_delegate_call|168]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|handle_read|421]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|parse|323]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|_parse_command|245]
> [/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py|decode_value|167])
> WARNING  vds.dispatcher:betterAsyncore.py:179 unhandled close event
> ERROR    root:concurrent.py:267 FINISH thread <Thread(JsonRpc
> (StompReactor), started daemon 140606575712000)> failed
> Traceback (most recent call last):
>   File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/common/concurrent.py",
> line 260, in run
>     ret = func(*args, **kwargs)
>   File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompserver.py",
> line 393, in process_requests
>     self._reactor.process_requests()
>   File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py",
> line 238, in process_requests
>     timeout=self._get_timeout(self._map),
>   File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py",
> line 253, in _get_timeout
>     interval = disp.next_check_interval()
>   File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py",
> line 99, in next_check_interval
>     return getattr(self.__impl, "next_check_interval", default_func)()
>   File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py",
> line 486, in next_check_interval
>     self.handle_timeout()
>   File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py",
> line 451, in handle_timeout
>     self._frame_handler.handle_timeout(self)
>   File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stompclient.py",
> line 130, in handle_timeout
>     dispatcher._on_timeout)
>   File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/stomp.py",
> line 630, in reconnect
>     AsyncDispatcher(self, self._async_client, count=count))
>   File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py",
> line 271, in reconnect
>     dispatcher.create_socket(address, sslctx)
>   File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/yajsonrpc/betterAsyncore.py",
> line 112, in create_socket
>     sock = sslctx.wrapSocket(sock)
>   File "/home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/sslutils.py",
> line 113, in wrapSocket
>     ca_certs=self.ca_certs)
>   File "/usr/lib64/python3.6/ssl.py", line 1114, in wrap_socket
>     ciphers=ciphers)
>   File "/usr/lib64/python3.6/ssl.py", line 704, in __init__
>     self._context.load_verify_locations(ca_certs)
> FileNotFoundError: [Errno 2] No such file or directory
> =============================== warnings summary ===============================
> /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334
>   /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334:
> PytestUnknownMarkWarning: Unknown pytest.mark.stress - is this a typo?
>  You can register custom marks to avoid this warning - for details,
> see https://docs.pytest.org/en/latest/mark.html
>     PytestUnknownMarkWarning,
>
> /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334
>   /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334:
> PytestUnknownMarkWarning: Unknown pytest.mark.slow - is this a typo?
> You can register custom marks to avoid this warning - for details, see
> https://docs.pytest.org/en/latest/mark.html
>     PytestUnknownMarkWarning,
>
> /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/v2v.py:79
>   /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/v2v.py:79:
> DeprecationWarning: invalid escape sequence \d
>     _SSH_AUTH_RE = b'(SSH_AUTH_SOCK)=([^;]+).*;\nSSH_AGENT_PID=(\d+)'
>
> /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/v2v.py:1421
>   /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/v2v.py:1421:
> DeprecationWarning: invalid escape sequence \^
>     '(?P<m2_base>[0-9]+){sp}\^{sp}(?P<m2_exp>{exp}))'.format(
>
> /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334
>   /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/.tox/lib/lib/python3.6/site-packages/_pytest/mark/structures.py:334:
> PytestUnknownMarkWarning: Unknown pytest.mark.xpass - is this a typo?
> You can register custom marks to avoid this warning - for details, see
> https://docs.pytest.org/en/latest/mark.html
>     PytestUnknownMarkWarning,
>
> tests/lib/osinfo_test.py::test_package_versions
>   /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/osinfo.py:284:
> UnicodeWarning: decode() called on unicode string, see
> https://bugzilla.redhat.com/show_bug.cgi?id=1693751
>     'version': mi['version'].decode('utf-8'),
>
> tests/lib/osinfo_test.py::test_package_versions
>   /home/jenkins/workspace/vdsm_standard-check-patch/vdsm/lib/vdsm/osinfo.py:285:
> UnicodeWarning: decode() called on unicode string, see
> https://bugzilla.redhat.com/show_bug.cgi?id=1693751
>     'release': mi['release'].decode('utf-8'),
>
> -- Docs: https://docs.pytest.org/en/latest/warnings.html
>
> ----------- coverage: platform linux, python 3.6.8-final-0 -----------
> Coverage HTML written to dir htmlcov-lib
>
> ========================== slowest 10 test durations ===========================
> 18.29s call
> tests/lib/yajsonrpc/stomprpcclient_test.py::VdsmClientTests::test_event_handler
> 2.96s call     tests/lib/protocoldetector_test.py::AcceptorTests::test_reject_very_slow_client_concurrency(True)
> 2.90s call     tests/lib/protocoldetector_test.py::AcceptorTests::test_reject_very_slow_client_concurrency(False)
> 2.75s call     tests/lib/protocoldetector_test.py::AcceptorTests::test_reject_very_slow_client(False)
> 2.63s call     tests/lib/protocoldetector_test.py::AcceptorTests::test_reject_very_slow_client(True)
> 1.90s call     tests/pywatch_test.py::TestPyWatch::test_timeout_backtrace
> 1.44s call     tests/pywatch_test.py::TestPyWatch::test_timeout_output
> 1.19s call     tests/pywatch_test.py::TestPyWatch::test_kill_grandkids
> 0.93s call     tests/lib/protocoldetector_test.py::AcceptorTests::test_detect_slow_client(True)
> 0.90s call     tests/lib/yajsonrpc/stomp_test.py::StompTests::test_echo(16384,
> False)
> =========================== short test summary info ============================