Re: [ovirt-devel] [oVirt Jenkins] ovirt_4.1_hc-system-tests - Build # 76 - Failure!

Since HC tests are using appliance, I think we need to verify the appliance build is working and includes the latest fix.

On Fri, May 26, 2017 at 3:39 PM, Sahina Bose <sabose(a)redhat.com&gt; wrote: > I see that the 4.1 hc test is still failing with same error : > > Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang.StringUtils from [Module "org.ovirt.vdsm-jsonrpc-java:main" from local module loader @5e91993f (finder: local module finder @1c4af82c (roots: /usr/share/ovirt-engine-wildfly-overlay/modules,/usr/share/ovirt-engine/modules/common,/usr/share/ovirt-engine-extension-aaa-jdbc/modules,/usr/share/ovirt-engine-wildfly/modules,/usr/share/ovirt-engine-wildfly/modules/system/layers/base))] > > Does the lago test need to be updated, as this fix has already landed? > > On Thu, May 25, 2017 at 2:03 PM, Eyal Edri <eedri(a)redhat.com&gt; wrote: > >> So that was fixed already since hc suite is running once a day, I guess >> triggering it will fix it. >> >> On Thu, May 25, 2017 at 11:31 AM, Piotr Kliczewski < >> piotr.kliczewski(a)gmail.com&gt; wrote: >> >>> This is the issue I described in the other thread. Engine you are using >>> do not have a patch [1]. >>> >>> [1] https://gerrit.ovirt.org/#/c/77203 >>> >>> On Thu, May 25, 2017 at 10:26 AM, Eyal Edri <eedri(a)redhat.com&gt; wrote: >>> >>>> Adding devel and Piotr. >>>> >>>> On Thu, May 25, 2017 at 9:31 AM, Sahina Bose <sabose(a)redhat.com&gt; >>>> wrote: >>>> >>>>> Connecting to lago-hc-basic-suite-4-1-host0.lago.local/192.168.200.2 >>>>> 2017-05-24 23:31:00,492-04 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-1) [712d05a6] Error: org.ovirt.engine.core.vdsbroker.TransportRunTimeException: Connection issues during send request >>>>> 2017-05-24 23:31:00,492-04 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-7-thread-1) [712d05a6] Exception: java.util.concurrent.ExecutionException: org.ovirt.engine.core.vdsbroker.TransportRunTimeException: Connection issues during send request >>>>> Caused by: java.lang.ClassNotFoundException: org.apache.commons.lang.StringUtils from [Module "org.ovirt.vdsm-jsonrpc-java:main" from local module loader @5e91993f (finder: local module finder @1c4af82c (roots: /usr/share/ovirt-engine-wildfly-overlay/modules,/usr/share/ovirt-engine/modules/common,/usr/share/ovirt-engine-extension-aaa-jdbc/modules,/usr/share/ovirt-engine-wildfly/modules,/usr/share/ovirt-engine-wildfly/modules/system/layers/base))] >>>>> >>>>> >>>>> Known issue? >>>>> >>>>> >>>>> On Thu, May 25, 2017 at 9:16 AM, <jenkins(a)jenkins.phx.ovirt.org&gt; >>>>> wrote: >>>>> >>>>>> Project: http://jenkins.ovirt.org/job/ovirt_4.1_hc-system-tests/ >>>>>> Build: http://jenkins.ovirt.org/job/ovirt_4.1_hc-system-tests/76/ >>>>>> Build Number: 76 >>>>>> Build Status: Failure >>>>>> Triggered By: Started by timer >>>>>> >>>>>> ------------------------------------- >>>>>> Changes Since Last Success: >>>>>> ------------------------------------- >>>>>> Changes for Build #76 >>>>>> [Ondřej Svoboda] Use SDKv4 code in add_labeled_network. >>>>>> >>>>>> [Barak Korren] Refactor: Use macros in defaults file >>>>>> >>>>>> [Barak Korren] Default values for 'arch' and 'distro' in STD-CI >>>>>> >>>>>> >>>>>> >>>>>> >>>>>> ----------------- >>>>>> Failed Tests: >>>>>> ----------------- >>>>>> 1 tests failed. >>>>>> FAILED: 002_bootstrap.add_hosts >>>>>> >>>>>> Error Message: >>>>>> >>>>>> status: 409 >>>>>> reason: Conflict >>>>>> detail: Cannot add Host. There is no available server in the cluster >>>>>> to probe the new server. >>>>>> -------------------- >> begin captured logging << >>>>>> -------------------- >>>>>> lago.utils: ERROR: Error while running thread >>>>>> Traceback (most recent call last): >>>>>> File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, >>>>>> in _ret_via_queue >>>>>> queue.put({'return': func()}) >>>>>> File "/home/jenkins/workspace/ovirt_4.1_hc-system-tests/ovirt-sys >>>>>> tem-tests/hc-basic-suite-4.1/test-scenarios/002_bootstrap.py", line >>>>>> 141, in _add_host >>>>>> return api.hosts.add(p) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", >>>>>> line 18306, in add >>>>>> headers={"Correlation-Id":correlation_id, "Expect":expect} >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>> line 79, in add >>>>>> return self.request('POST', url, body, headers, cls=cls) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>> line 122, in request >>>>>> persistent_auth=self.__persistent_auth >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>> line 79, in do_request >>>>>> persistent_auth) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>> line 162, in __do_request >>>>>> raise errors.RequestError(response_code, response_reason, >>>>>> response_body) >>>>>> RequestError: >>>>>> status: 409 >>>>>> reason: Conflict >>>>>> detail: Cannot add Host. There is no available server in the cluster >>>>>> to probe the new server. >>>>>> lago.utils: ERROR: Error while running thread >>>>>> Traceback (most recent call last): >>>>>> File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, >>>>>> in _ret_via_queue >>>>>> queue.put({'return': func()}) >>>>>> File "/home/jenkins/workspace/ovirt_4.1_hc-system-tests/ovirt-sys >>>>>> tem-tests/hc-basic-suite-4.1/test-scenarios/002_bootstrap.py", line >>>>>> 141, in _add_host >>>>>> return api.hosts.add(p) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", >>>>>> line 18306, in add >>>>>> headers={"Correlation-Id":correlation_id, "Expect":expect} >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>> line 79, in add >>>>>> return self.request('POST', url, body, headers, cls=cls) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>> line 122, in request >>>>>> persistent_auth=self.__persistent_auth >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>> line 79, in do_request >>>>>> persistent_auth) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>> line 162, in __do_request >>>>>> raise errors.RequestError(response_code, response_reason, >>>>>> response_body) >>>>>> RequestError: >>>>>> status: 409 >>>>>> reason: Conflict >>>>>> detail: Cannot add Host. There is no available server in the cluster >>>>>> to probe the new server. >>>>>> --------------------- >> end captured logging << >>>>>> --------------------- >>>>>> >>>>>> Stack Trace: >>>>>> File "/usr/lib64/python2.7/unittest/case.py", line 369, in run >>>>>> testMethod() >>>>>> File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, >>>>>> in runTest >>>>>> self.test(*self.arg) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", >>>>>> line 129, in wrapped_test >>>>>> test() >>>>>> File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", >>>>>> line 59, in wrapper >>>>>> return func(get_test_prefix(), *args, **kwargs) >>>>>> File "/home/jenkins/workspace/ovirt_4.1_hc-system-tests/ovirt-sys >>>>>> tem-tests/hc-basic-suite-4.1/test-scenarios/002_bootstrap.py", line >>>>>> 160, in add_hosts >>>>>> nt.assert_true(all(vt.join_all())) >>>>>> File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, >>>>>> in _ret_via_queue >>>>>> queue.put({'return': func()}) >>>>>> File "/home/jenkins/workspace/ovirt_4.1_hc-system-tests/ovirt-sys >>>>>> tem-tests/hc-basic-suite-4.1/test-scenarios/002_bootstrap.py", line >>>>>> 141, in _add_host >>>>>> return api.hosts.add(p) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", >>>>>> line 18306, in add >>>>>> headers={"Correlation-Id":correlation_id, "Expect":expect} >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>> line 79, in add >>>>>> return self.request('POST', url, body, headers, cls=cls) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>> line 122, in request >>>>>> persistent_auth=self.__persistent_auth >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>> line 79, in do_request >>>>>> persistent_auth) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>> line 162, in __do_request >>>>>> raise errors.RequestError(response_code, response_reason, >>>>>> response_body) >>>>>> >>>>>> status: 409 >>>>>> reason: Conflict >>>>>> detail: Cannot add Host. There is no available server in the cluster >>>>>> to probe the new server. >>>>>> -------------------- >> begin captured logging << >>>>>> -------------------- >>>>>> lago.utils: ERROR: Error while running thread >>>>>> Traceback (most recent call last): >>>>>> File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, >>>>>> in _ret_via_queue >>>>>> queue.put({'return': func()}) >>>>>> File "/home/jenkins/workspace/ovirt_4.1_hc-system-tests/ovirt-sys >>>>>> tem-tests/hc-basic-suite-4.1/test-scenarios/002_bootstrap.py", line >>>>>> 141, in _add_host >>>>>> return api.hosts.add(p) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", >>>>>> line 18306, in add >>>>>> headers={"Correlation-Id":correlation_id, "Expect":expect} >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>> line 79, in add >>>>>> return self.request('POST', url, body, headers, cls=cls) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>> line 122, in request >>>>>> persistent_auth=self.__persistent_auth >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>> line 79, in do_request >>>>>> persistent_auth) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>> line 162, in __do_request >>>>>> raise errors.RequestError(response_code, response_reason, >>>>>> response_body) >>>>>> RequestError: >>>>>> status: 409 >>>>>> reason: Conflict >>>>>> detail: Cannot add Host. There is no available server in the cluster >>>>>> to probe the new server. >>>>>> lago.utils: ERROR: Error while running thread >>>>>> Traceback (most recent call last): >>>>>> File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, >>>>>> in _ret_via_queue >>>>>> queue.put({'return': func()}) >>>>>> File "/home/jenkins/workspace/ovirt_4.1_hc-system-tests/ovirt-sys >>>>>> tem-tests/hc-basic-suite-4.1/test-scenarios/002_bootstrap.py", line >>>>>> 141, in _add_host >>>>>> return api.hosts.add(p) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", >>>>>> line 18306, in add >>>>>> headers={"Correlation-Id":correlation_id, "Expect":expect} >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>> line 79, in add >>>>>> return self.request('POST', url, body, headers, cls=cls) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", >>>>>> line 122, in request >>>>>> persistent_auth=self.__persistent_auth >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>> line 79, in do_request >>>>>> persistent_auth) >>>>>> File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", >>>>>> line 162, in __do_request >>>>>> raise errors.RequestError(response_code, response_reason, >>>>>> response_body) >>>>>> RequestError: >>>>>> status: 409 >>>>>> reason: Conflict >>>>>> detail: Cannot add Host. There is no available server in the cluster >>>>>> to probe the new server. >>>>>> --------------------- >> end captured logging << >>>>>> --------------------- >>>>> >>>>> >>>>> >>>>> _______________________________________________ >>>>> Infra mailing list >>>>> Infra(a)ovirt.org >>>>> http://lists.ovirt.org/mailman/listinfo/infra >>>>> >>>>> >>>> >>>> >>>> -- >>>> >>>> Eyal edri >>>> >>>> >>>> ASSOCIATE MANAGER >>>> >>>> RHV DevOps >>>> >>>> EMEA VIRTUALIZATION R&D >>>> >>>> >>>> Red Hat EMEA <https://www.redhat.com/> >>>> <https://red.ht/sig> TRIED. TESTED. TRUSTED. >>>> <https://redhat.com/trusted> >>>> phone: +972-9-7692018 <+972%209-769-2018> >>>> irc: eedri (on #tlv #rhev-dev #rhev-integ) >>>> >>>> _______________________________________________ >>>> Devel mailing list >>>> Devel(a)ovirt.org >>>> http://lists.ovirt.org/mailman/listinfo/devel >>>> >>> >>> >> >> >> -- >> >> Eyal edri >> >> >> ASSOCIATE MANAGER >> >> RHV DevOps >> >> EMEA VIRTUALIZATION R&D >> >> >> Red Hat EMEA <https://www.redhat.com/> >> <https://red.ht/sig> TRIED. TESTED. TRUSTED. >> <https://redhat.com/trusted> >> phone: +972-9-7692018 <+972%209-769-2018> >> irc: eedri (on #tlv #rhev-dev #rhev-integ) >> > > -- Eyal edri ASSOCIATE MANAGER RHV DevOps EMEA VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> phone: +972-9-7692018 <+972%209-769-2018> irc: eedri (on #tlv #rhev-dev #rhev-integ)