- Infra - oVirt List Archives

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 246 - Failure!
by jenkins＠jenkins.phx.ovirt.org 26 Mar '18

26 Mar '18

------=_Part_509_392092441.1521814475196 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/246/ Build Number: 246 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #246 [Yaniv Kaul] Apparently, now we need more disk space to succesfully install HE. [Sandro Bonazzola] otopi: drop check merged jobs ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_509_392092441.1521814475196--

1 7

[oVirt Jenkins] ovirt-system-tests_he-basic-suite-master - Build # 260 - Failure!
by jenkins＠jenkins.phx.ovirt.org 25 Mar '18

25 Mar '18

------=_Part_503_901366054.1521811114513 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/260/ Build Number: 260 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #260 [Yaniv Kaul] Apparently, now we need more disk space to succesfully install HE. [Sandro Bonazzola] otopi: drop check merged jobs ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_master_storage_domain Error Message: Could not find hosts that are up in DC Default -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:6a79af4a-278f-4995-845b-26d756184f9e:Get ssh client for lago-he-basic-suite-master-storage: lago.ssh: DEBUG: end task:6a79af4a-278f-4995-845b-26d756184f9e:Get ssh client for lago-he-basic-suite-master-storage: lago.ssh: DEBUG: Running a342d0ee on lago-he-basic-suite-master-storage: cat /root/multipath.txt lago.ssh: DEBUG: Command a342d0ee on lago-he-basic-suite-master-storage returned with 0 lago.ssh: DEBUG: Command a342d0ee on lago-he-basic-suite-master-storage output: 360014054e28d9997e3340b49db775f17 3600140582ab558fe39d49b18d3f16f88 36001405a834f2c26abf4ea7a68770944 36001405aa6b8e88b8344442b06c2d149 36001405beeefd176a224c9f8758099a7 --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-master/ovirt-system-tests/he-basic-suite-master/test-scenarios/002_bootstrap.py", line 485, in add_master_storage_domain add_iscsi_storage_domain(prefix) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-master/ovirt-system-tests/he-basic-suite-master/test-scenarios/002_bootstrap.py", line 600, in add_iscsi_storage_domain host=_random_host_from_dc(api, DC_NAME), File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-master/ovirt-system-tests/he-basic-suite-master/test-scenarios/002_bootstrap.py", line 102, in _random_host_from_dc return random.choice(_hosts_in_dc(api, dc_name)) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-suite-master/ovirt-system-tests/he-basic-suite-master/test-scenarios/002_bootstrap.py", line 92, in _hosts_in_dc raise RuntimeError('Could not find hosts that are up in DC %s' % dc_name) 'Could not find hosts that are up in DC Default\n-------------------- >> begin captured logging << --------------------\nlago.ssh: DEBUG: start task:6a79af4a-278f-4995-845b-26d756184f9e:Get ssh client for lago-he-basic-suite-master-storage:\nlago.ssh: DEBUG: end task:6a79af4a-278f-4995-845b-26d756184f9e:Get ssh client for lago-he-basic-suite-master-storage:\nlago.ssh: DEBUG: Running a342d0ee on lago-he-basic-suite-master-storage: cat /root/multipath.txt\nlago.ssh: DEBUG: Command a342d0ee on lago-he-basic-suite-master-storage returned with 0\nlago.ssh: DEBUG: Command a342d0ee on lago-he-basic-suite-master-storage output:\n 360014054e28d9997e3340b49db775f17\n3600140582ab558fe39d49b18d3f16f88\n36001405a834f2c26abf4ea7a68770944\n36001405aa6b8e88b8344442b06c2d149\n36001405beeefd176a224c9f8758099a7\n\n--------------------- >> end captured logging << ---------------------' ------=_Part_503_901366054.1521811114513--

1 7

[CQ]: 89420, 2 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 25 Mar '18

25 Mar '18

A system test invoked by the "ovirt-master" change queue including change 89420,2 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 89419,2 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 89419,2 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/89420/2 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/89419/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6535/

1 0

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-4.2 - Build # 37 - Failure!
by jenkins＠jenkins.phx.ovirt.org 25 Mar '18

25 Mar '18

------=_Part_628_1536305003.1521969966539 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2= /=20 Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/3= 7/ Build Number: 37 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #37 [Yaniv Kaul] Apparently, now we need more disk space to succesfully install= HE. ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: The response content type 'text/html; charset=3Diso-8859-1' isn't the expec= ted XML -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_u= p_4 at 0x3dc7ed8> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, i= n assert_equals_within res =3D func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt= -system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254= , in _host_is_up_4 host_obj =3D host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 362= 19, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211,= in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, = in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 208,= in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 130,= in _check_fault body =3D self._internal_read_body(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 316,= in _internal_read_body self._connection.check_xml_content_type(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 849= , in check_xml_content_type response.headers File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 889= , in _check_content_type raise Error(msg) Error: The response content type 'text/html; charset=3Diso-8859-1' isn't th= e expected XML --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTes= t self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, i= n wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in= wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt= -system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 229= , in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt= -system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 273= , in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=3D15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 263, i= n assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, i= n assert_equals_within res =3D func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt= -system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254= , in _host_is_up_4 host_obj =3D host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 362= 19, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211,= in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, = in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 208,= in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 130,= in _check_fault body =3D self._internal_read_body(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 316,= in _internal_read_body self._connection.check_xml_content_type(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 849= , in check_xml_content_type response.headers File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 889= , in _check_content_type raise Error(msg) 'The response content type \'text/html; charset=3Diso-8859-1\' isn\'t the e= xpected XML\n-------------------- >> begin captured logging << ------------= --------\novirtlago.testlib: ERROR: * Unhandled exception in <function = _host_is_up_4 at 0x3dc7ed8>\nTraceback (most recent call last):\n File "/u= sr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_e= quals_within\n res =3D func()\n File "/home/jenkins/workspace/ovirt-sys= tem-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-sce= narios/002_bootstrap.py", line 254, in _host_is_up_4\n host_obj =3D host= _service.get()\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/servic= es.py", line 36219, in get\n return self._internal_get(headers, query, w= ait)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", lin= e 211, in _internal_get\n return future.wait() if wait else future\n Fi= le "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in w= ait\n return self._code(response)\n File "/usr/lib64/python2.7/site-pac= kages/ovirtsdk4/service.py", line 208, in callback\n self._check_fault(r= esponse)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py",= line 130, in _check_fault\n body =3D self._internal_read_body(response)= \n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 31= 6, in _internal_read_body\n self._connection.check_xml_content_type(resp= onse)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", l= ine 849, in check_xml_content_type\n response.headers\n File "/usr/lib6= 4/python2.7/site-packages/ovirtsdk4/__init__.py", line 889, in _check_conte= nt_type\n raise Error(msg)\nError: The response content type \'text/html= ; charset=3Diso-8859-1\' isn\'t the expected XML\n--------------------- >> = end captured logging << ---------------------' ------=_Part_628_1536305003.1521969966539--

1 1

[CQ]: 89419,2 (ovirt-engine) failed "ovirt-master" system tests
by oVirt Jenkins 25 Mar '18

25 Mar '18

Change 89419,2 (ovirt-engine) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/89419/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6533/

1 0

Build failed in Jenkins: system-sync_mirrors-epel-el6-x86_64 #1325
by jenkins＠jenkins.phx.ovirt.org 25 Mar '18

25 Mar '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/1325/displ…> ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision d741e848ae1af9a8d6937ed8c3f8a25f58947153 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f d741e848ae1af9a8d6937ed8c3f8a25f58947153 Commit message: "otopi: drop check merged jobs" > git rev-list --no-walk d741e848ae1af9a8d6937ed8c3f8a25f58947153 # timeout=10 [system-sync_mirrors-epel-el6-x86_64] $ /bin/bash -xe /tmp/jenkins199364623258790609.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror epel-el6 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-updates-el7 error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-updates-el7' Build step 'Execute shell' marked build as failure

1 2

Jenkins build became unstable: ovirt_4.2_publish-rpms_nightly #162
by jenkins＠jenkins.phx.ovirt.org 25 Mar '18

25 Mar '18

See <http://jenkins.ovirt.org/job/ovirt_4.2_publish-rpms_nightly/162/display/red…>

1 2

[CQ]: 83415, 9 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 25 Mar '18

25 Mar '18

A system test invoked by the "ovirt-master" change queue including change 83415,9 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 89238,3 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 89238,3 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/83415/9 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/89238/3 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6529/

1 0

Re: Question regarding oVirt System Testing
by Barak Korren 25 Mar '18

25 Mar '18

The job you linked to just launches the suit inside `mock_runner.sh`, with no extra tweaks other then what is in automation/suit.sh. Did you run natively or inside `mock_runnser.sh`? Adding infra to get some OST maintainers in the loop. On 16 March 2018 at 23:02, Douglas Landgraf <dlandgra(a)redhat.com> wrote: > Hi Dafna/Barak, > > I see our tests with HE 4.2 are all green [1] but if I try to run it > locally I see some issues regarding vmstats.py from vdsm. Even after > backporting vdsm patches [2] to 4.2 local repo and making it available > via rpm I still can't get my setup running. Now I see in host0 > (vdsm.log): > > " > 2018-03-16 16:49:11,463-0400 ERROR (periodic/4) [root] failed to > retrieve Hostedd > Engine HA score '[Errno 2] No such file or directory'Is the Hosted > Engine setupp > finished? (api:196) > " > > Are you guys doing any workaround or it's my local steup of lago? BTW, > I see the same error in he-basic-suite-master. > > Thanks! > > [1] http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.2/ > [2] vmstats patches: > > commit b45082b1daf92ad2f9f0c3a42647395fc1121a0e > Author: Daniel Erez <derez(a)redhat.com> > Date: Thu Mar 15 15:25:10 2018 +0200 > > virt: vmstats - disk_info add default values > > commit f1e8dc72e5c487fa7aef06fa56017967df822ff5 > Author: Francesco Romani <fromani(a)redhat.com> > Date: Mon Mar 5 11:20:11 2018 +0100 > > vmstats: initialize cpuUsage > > commit 120ec03617ad00489eaa5835e7132151b44583fd > Author: Francesco Romani <fromani(a)redhat.com> > Date: Mon Mar 5 10:21:17 2018 +0100 > > virt: vmstats: nic.name may be missing > > > > -- > Cheers > Douglas -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted

3 3

[CQ]: 89395,2 (vdsm) failed "ovirt-master" system tests
by oVirt Jenkins 25 Mar '18

25 Mar '18

Change 89395,2 (vdsm) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/89395/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6527/

1 0