Re: [ovirt-devel] [oVirt Jenkins] ovirt_4.1_hc-system-tests - Build # 76 - Failure!

On Sat, May 27, 2017 at 8:23 PM, Eyal Edri <eedri(a)redhat.com&gt; wrote: > Since HC tests are using appliance, I think we need to verify the > appliance build is working and includes the latest fix. > Is this still an issue? > > On Fri, May 26, 2017 at 3:39 PM, Sahina Bose <sabose(a)redhat.com&gt; wrote: > >> I see that the 4.1 hc test is still failing with same error : >> >> Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang.StringUtils from [Module "org.ovirt.vdsm-jsonrpc-java:main" from local module loader @5e91993f (finder: local module finder @1c4af82c (roots: /usr/share/ovirt-engine-wildfly-overlay/modules,/usr/share/ovirt-engine/modules/common,/usr/share/ovirt-engine-extension-aaa-jdbc/modules,/usr/share/ovirt-engine-wildfly/modules,/usr/share/ovirt-engine-wildfly/modules/system/layers/base))] >> >> Does the lago test need to be updated, as this fix has already landed? >> >> On Thu, May 25, 2017 at 2:03 PM, Eyal Edri <eedri(a)redhat.com&gt; wrote: >> >>> So that was fixed already since hc suite is running once a day, I guess >>> triggering it will fix it. >>> >>> On Thu, May 25, 2017 at 11:31 AM, Piotr Kliczewski < >>> piotr.kliczewski(a)gmail.com&gt; wrote: >>> >>>> This is the issue I described in the other thread. Engine you are >>>> using do not have a patch [1]. >>>> >>>> [1] https://gerrit.ovirt.org/#/c/77203 >>>> >>>> On Thu, May 25, 2017 at 10:26 AM, Eyal Edri <eedri(a)redhat.com&gt; wrote: >>>> >>>>> Adding devel and Piotr. >>>>> >>>>> On Thu, May 25, 2017 at 9:31 AM, Sahina Bose <sabose(a)redhat.com&gt; >>>>> wrote: >>>>> >>>>>> Connecting to lago-hc-basic-suite-4-1-host0.lago.local/192.168.200.2 >>>>>> 2017-05-24 23:31:00,492-04 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-1) [712d05a6] Error: org.ovirt.engine.core.vdsbroker.TransportRunTimeException: Connection issues during send request >>>>>> 2017-05-24 23:31:00,492-04 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-1) [712d05a6] Exception: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.TransportRunTimeException: Connection issues during send request >>>>>> Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang.StringUtils from [Module "org.ovirt.vdsm-jsonrpc-java:main" from local module loader @5e91993f (finder: local module finder @1c4af82c (roots: /usr/share/ovirt-engine-wildfly-overlay/modules,/usr/share/ovirt-engine/modules/common,/usr/share/ovirt-engine-extension-aaa-jdbc/modules,/usr/share/ovirt-engine-wildfly/modules,/usr/share/ovirt-engine-wildfly/modules/system/layers/base))] >>>>>> >>>>>> >>>>>> Known issue? >>>>>> >>>>>> >>>>>> On Thu, May 25, 2017 at 9:16 AM, <jenkins(a)jenkins.phx.ovirt.org&gt; >>>>>> wrote: >>>>>> >>>>>>> Project: http://jenkins.ovirt.org/job/ovirt_4.1_hc-system-tests/ >>>>>>> Build: http://jenkins.ovirt.org/job/ovirt_4.1_hc-system-tests/76/ >>>>>>> Build Number: 76 >>>>>>> Build Status: Failure >>>>>>> Triggered By: Started by timer >>>>>>> >>>>>>> ------------------------------------- >>>>>>> Changes Since Last Success: >>>>>>> ------------------------------------- >>>>>>> Changes for Build #76 >>>>>>> [Ondřej Svoboda] Use SDKv4 code in add_labeled_network. >>>>>>> >>>>>>> [Barak Korren] Refactor: Use macros in defaults file >>>>>>> >>>>>>> [Barak Korren] Default values for 'arch' and 'distro' in STD-CI >>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> ----------------- >>>>>>> Failed Tests: >>>>>>> ----------------- >>>>>>> 1 tests failed. >>>>>>> FAILED: 002_bootstrap.add_hosts >>>>>>> >>>>>>> Error Message: >>>>>>> >>>>>>> status: 409 >>>>>>> reason: Conflict >>>>>>> detail: Cannot add Host. There is no available server in the >>>>>>> cluster to probe the new server. >>>>>>> -------------------- >> begin captured logging << >>>>>>> -------------------- >>>>>>> lago.utils: ERROR: Error while running thread >>>>>>> Traceback (most recent call last): >>>>>>> File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, >>>>>>> in _ret_via_queue >>>>>>> queue.put({'return': func()}) >>>>>>> File "/home/jenkins/workspace/ovirt_4.1_hc-system-tests/ovirt-sys >>>>>>> tem-tests/hc-basic-suite-4.1/test-scenarios/002_bootstrap.py", >>>>>>> line 141, in _add_host >>>>>>> return api.hosts.add(p) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", >>>>>>> line 18306, in add >>>>>>> headers={"Correlation-Id":correlation_id, "Expect":expect} >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>>> line 79, in add >>>>>>> return self.request('POST', url, body, headers, cls=cls) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>>> line 122, in request >>>>>>> persistent_auth=self.__persistent_auth >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>>> line 79, in do_request >>>>>>> persistent_auth) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>>> line 162, in __do_request >>>>>>> raise errors.RequestError(response_code, response_reason, >>>>>>> response_body) >>>>>>> RequestError: >>>>>>> status: 409 >>>>>>> reason: Conflict >>>>>>> detail: Cannot add Host. There is no available server in the >>>>>>> cluster to probe the new server. >>>>>>> lago.utils: ERROR: Error while running thread >>>>>>> Traceback (most recent call last): >>>>>>> File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, >>>>>>> in _ret_via_queue >>>>>>> queue.put({'return': func()}) >>>>>>> File "/home/jenkins/workspace/ovirt_4.1_hc-system-tests/ovirt-sys >>>>>>> tem-tests/hc-basic-suite-4.1/test-scenarios/002_bootstrap.py", >>>>>>> line 141, in _add_host >>>>>>> return api.hosts.add(p) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", >>>>>>> line 18306, in add >>>>>>> headers={"Correlation-Id":correlation_id, "Expect":expect} >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>>> line 79, in add >>>>>>> return self.request('POST', url, body, headers, cls=cls) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>>> line 122, in request >>>>>>> persistent_auth=self.__persistent_auth >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>>> line 79, in do_request >>>>>>> persistent_auth) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>>> line 162, in __do_request >>>>>>> raise errors.RequestError(response_code, response_reason, >>>>>>> response_body) >>>>>>> RequestError: >>>>>>> status: 409 >>>>>>> reason: Conflict >>>>>>> detail: Cannot add Host. There is no available server in the >>>>>>> cluster to probe the new server. >>>>>>> --------------------- >> end captured logging << >>>>>>> --------------------- >>>>>>> >>>>>>> Stack Trace: >>>>>>> File "/usr/lib64/python2.7/unittest/case.py", line 369, in run >>>>>>> testMethod() >>>>>>> File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, >>>>>>> in runTest >>>>>>> self.test(*self.arg) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", >>>>>>> line 129, in wrapped_test >>>>>>> test() >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", >>>>>>> line 59, in wrapper >>>>>>> return func(get_test_prefix(), *args, **kwargs) >>>>>>> File "/home/jenkins/workspace/ovirt_4.1_hc-system-tests/ovirt-sys >>>>>>> tem-tests/hc-basic-suite-4.1/test-scenarios/002_bootstrap.py", >>>>>>> line 160, in add_hosts >>>>>>> nt.assert_true(all(vt.join_all())) >>>>>>> File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, >>>>>>> in _ret_via_queue >>>>>>> queue.put({'return': func()}) >>>>>>> File "/home/jenkins/workspace/ovirt_4.1_hc-system-tests/ovirt-sys >>>>>>> tem-tests/hc-basic-suite-4.1/test-scenarios/002_bootstrap.py", >>>>>>> line 141, in _add_host >>>>>>> return api.hosts.add(p) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", >>>>>>> line 18306, in add >>>>>>> headers={"Correlation-Id":correlation_id, "Expect":expect} >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>>> line 79, in add >>>>>>> return self.request('POST', url, body, headers, cls=cls) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>>> line 122, in request >>>>>>> persistent_auth=self.__persistent_auth >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>>> line 79, in do_request >>>>>>> persistent_auth) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>>> line 162, in __do_request >>>>>>> raise errors.RequestError(response_code, response_reason, >>>>>>> response_body) >>>>>>> >>>>>>> status: 409 >>>>>>> reason: Conflict >>>>>>> detail: Cannot add Host. There is no available server in the >>>>>>> cluster to probe the new server. >>>>>>> -------------------- >> begin captured logging << >>>>>>> -------------------- >>>>>>> lago.utils: ERROR: Error while running thread >>>>>>> Traceback (most recent call last): >>>>>>> File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, >>>>>>> in _ret_via_queue >>>>>>> queue.put({'return': func()}) >>>>>>> File "/home/jenkins/workspace/ovirt_4.1_hc-system-tests/ovirt-sys >>>>>>> tem-tests/hc-basic-suite-4.1/test-scenarios/002_bootstrap.py", >>>>>>> line 141, in _add_host >>>>>>> return api.hosts.add(p) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", >>>>>>> line 18306, in add >>>>>>> headers={"Correlation-Id":correlation_id, "Expect":expect} >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>>> line 79, in add >>>>>>> return self.request('POST', url, body, headers, cls=cls) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>>> line 122, in request >>>>>>> persistent_auth=self.__persistent_auth >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>>> line 79, in do_request >>>>>>> persistent_auth) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>>> line 162, in __do_request >>>>>>> raise errors.RequestError(response_code, response_reason, >>>>>>> response_body) >>>>>>> RequestError: >>>>>>> status: 409 >>>>>>> reason: Conflict >>>>>>> detail: Cannot add Host. There is no available server in the >>>>>>> cluster to probe the new server. >>>>>>> lago.utils: ERROR: Error while running thread >>>>>>> Traceback (most recent call last): >>>>>>> File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, >>>>>>> in _ret_via_queue >>>>>>> queue.put({'return': func()}) >>>>>>> File "/home/jenkins/workspace/ovirt_4.1_hc-system-tests/ovirt-sys >>>>>>> tem-tests/hc-basic-suite-4.1/test-scenarios/002_bootstrap.py", >>>>>>> line 141, in _add_host >>>>>>> return api.hosts.add(p) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", >>>>>>> line 18306, in add >>>>>>> headers={"Correlation-Id":correlation_id, "Expect":expect} >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>>> line 79, in add >>>>>>> return self.request('POST', url, body, headers, cls=cls) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>>> line 122, in request >>>>>>> persistent_auth=self.__persistent_auth >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>>> line 79, in do_request >>>>>>> persistent_auth) >>>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>>> line 162, in __do_request >>>>>>> raise errors.RequestError(response_code, response_reason, >>>>>>> response_body) >>>>>>> RequestError: >>>>>>> status: 409 >>>>>>> reason: Conflict >>>>>>> detail: Cannot add Host. There is no available server in the >>>>>>> cluster to probe the new server. >>>>>>> --------------------- >> end captured logging << >>>>>>> --------------------- >>>>>> >>>>>> >>>>>> >>>>>> _______________________________________________ >>>>>> Infra mailing list >>>>>> Infra(a)ovirt.org >>>>>> http://lists.ovirt.org/mailman/listinfo/infra >>>>>> >>>>>> >>>>> >>>>> >>>>> -- >>>>> >>>>> Eyal edri >>>>> >>>>> >>>>> ASSOCIATE MANAGER >>>>> >>>>> RHV DevOps >>>>> >>>>> EMEA VIRTUALIZATION R&D >>>>> >>>>> >>>>> Red Hat EMEA <https://www.redhat.com/> >>>>> <https://red.ht/sig> TRIED. TESTED. TRUSTED. >>>>> <https://redhat.com/trusted> >>>>> phone: +972-9-7692018 <+972%209-769-2018> >>>>> irc: eedri (on #tlv #rhev-dev #rhev-integ) >>>>> >>>>> _______________________________________________ >>>>> Devel mailing list >>>>> Devel(a)ovirt.org >>>>> http://lists.ovirt.org/mailman/listinfo/devel >>>>> >>>> >>>> >>> >>> >>> -- >>> >>> Eyal edri >>> >>> >>> ASSOCIATE MANAGER >>> >>> RHV DevOps >>> >>> EMEA VIRTUALIZATION R&D >>> >>> >>> Red Hat EMEA <https://www.redhat.com/> >>> <https://red.ht/sig> TRIED. TESTED. TRUSTED. >>> <https://redhat.com/trusted> >>> phone: +972-9-7692018 <+972%209-769-2018> >>> irc: eedri (on #tlv #rhev-dev #rhev-integ) >>> >> >> > > > -- > > Eyal edri > > > ASSOCIATE MANAGER > > RHV DevOps > > EMEA VIRTUALIZATION R&D > > > Red Hat EMEA <https://www.redhat.com/> > <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> > phone: +972-9-7692018 <+972%209-769-2018> > irc: eedri (on #tlv #rhev-dev #rhev-integ) > -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>