October 2018 - Infra - oVirt List Archives

[oVirt Jenkins] ovirt-system-tests_compat-4.0-suite-master - Build # 13 - Failure!
by jenkins＠jenkins.phx.ovirt.org 26 Oct '18

26 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.0-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.0-suite-master/13/ Build Number: 13 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #13 [Gal Ben Haim] compat: Set "ex" bash flags [Daniel Belenky] dsl: add runtimereqs normalization [Daniel Belenky] Add support for dsl's isolation to label selection [Daniel Belenky] Run poll upstream sources @midnight [Barak Korren] Add compat suits to OST manual job selection ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.list_glance_images_40 Error Message: global name 'list_glance_images_4' is not defined Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 78, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/home/jenkins/workspace/ovirt-system-tests_compat-4.0-suite-master/ovirt-system-tests/compat-4.0-suite-master/test-scenarios/002_bootstrap.py", line 633, in list_glance_images raise SkipTest('%s: GLANCE connectivity test failed' % list_glance_images_4.__name__ ) NameError: global name 'list_glance_images_4' is not defined

3 279

[CQ]: 94695,6 (ovirt-engine) failed "ovirt-master" system tests
by oVirt Jenkins 26 Oct '18

26 Oct '18

Change 94695,6 (ovirt-engine) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/94695/6 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10927/

2 1

[JIRA] (OVIRT-2546) 004_basic_sanity.verify_suspend_resume_vm0 failure on verify_suspend_resume_vm0 with no reason
by Dafna Ron (oVirt JIRA) 26 Oct '18

26 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2546?page=com.atlassian.jira.… ] Dafna Ron reassigned OVIRT-2546: -------------------------------- Assignee: Galit Rosenthal (was: infra) > 004_basic_sanity.verify_suspend_resume_vm0 failure on verify_suspend_resume_vm0 with no reason > ---------------------------------------------------------------------------------------------- > > Key: OVIRT-2546 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2546 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: Galit Rosenthal > Labels: ost_failures, ost_lago > > We had a failure on master ovirt-provider ovn project > The change (https://gerrit.ovirt.org/#/c/94647/) had not caused the failure and I am not seeing any infra issue that can cause this failure. > The build is: 'https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10625/' > Here is the error: > 'https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10625/testRe…' > [~gbenhaim(a)redhat.com] can you please have a look before I move this to the developers? -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2559) fatal: unable to access 'https://gerrit.ovirt.org/jenkins/': Could not resolve host: gerrit.ovirt.org; Unknown error
by Dafna Ron (oVirt JIRA) 26 Oct '18

26 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2559?page=com.atlassian.jira.… ] Dafna Ron reassigned OVIRT-2559: -------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > fatal: unable to access 'https://gerrit.ovirt.org/jenkins/': Could not resolve host: gerrit.ovirt.org; Unknown error > -------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-2559 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2559 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: Evgheni Dereveanchin > Labels: ost_failures, ost_infra > > We had a failed ovirt-4.2 build for project ovirt-engine. > seems like we have a problem cloning the repo > https://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3406/consoleFull > https://gerrit.ovirt.org/#/c/95085/4 -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2554) no clear logs on test exit
by Dafna Ron (oVirt JIRA) 26 Oct '18

26 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2554?page=com.atlassian.jira.… ] Dafna Ron reassigned OVIRT-2554: -------------------------------- Assignee: Galit Rosenthal (was: infra) > no clear logs on test exit > -------------------------- > > Key: OVIRT-2554 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2554 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: Galit Rosenthal > Priority: Highest > Labels: ost_failures, ost_lago > > we had a failure in master on test 004_basic_sanity.next_run_unplug_cpu for project pthreading and there are no logs that can help me debug the issue. > There are post-suite-sigterm but there are no logs in there that can help me understand what happened. > [~gbenhaim(a)redhat.com] can you please look at this failure? > https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10892/artifa… > I re-triggered the last project's change to make sure it passes but I am not sure how to debug this failure. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2554) no clear logs on test exit
by Dafna Ron (oVirt JIRA) 26 Oct '18

26 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2554?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2554: ---------------------------------- I have another test that exited with signal 15 and I do not have any logs from the test to understand what happened, only I am assigning this to Galit as I do not know what signal 15 and why we do not collect all the logs from the failed test https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10927/artifa… Galit, this is the log collection from run_suite.sh, but I am not sure why its not collecting the logs from ovirt (as it does on other failures). even on timeout I need all of ovirt dir to be collected and all of hosts vdsm dir to be collected. {code:python} on_sigterm() { local dest="${OST_REPO_ROOT}/test_logs/${SUITE##*/}/post-suite-sigterm" set +e export CLI export -f env_collect timeout \ 120s \ bash -c "env_collect $dest" exit 143 } {code} > no clear logs on test exit > -------------------------- > > Key: OVIRT-2554 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2554 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Priority: Highest > Labels: ost_failures, ost_lago > > we had a failure in master on test 004_basic_sanity.next_run_unplug_cpu for project pthreading and there are no logs that can help me debug the issue. > There are post-suite-sigterm but there are no logs in there that can help me understand what happened. > [~gbenhaim(a)redhat.com] can you please look at this failure? > https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10892/artifa… > I re-triggered the last project's change to make sure it passes but I am not sure how to debug this failure. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2554) no clear logs on test exit
by Dafna Ron (oVirt JIRA) 26 Oct '18

26 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2554?page=com.atlassian.jira.… ] Dafna Ron updated OVIRT-2554: ----------------------------- Summary: no clear logs on test exit (was: failure in master pthreading project on test 004_basic_sanity.next_run_unplug_cpu with no clear logs) > no clear logs on test exit > -------------------------- > > Key: OVIRT-2554 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2554 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Priority: Highest > Labels: ost_failures, ost_lago > > we had a failure in master on test 004_basic_sanity.next_run_unplug_cpu for project pthreading and there are no logs that can help me debug the issue. > There are post-suite-sigterm but there are no logs in there that can help me understand what happened. > [~gbenhaim(a)redhat.com] can you please look at this failure? > https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10892/artifa… > I re-triggered the last project's change to make sure it passes but I am not sure how to debug this failure. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 817 - Failure!
by jenkins＠jenkins.phx.ovirt.org 26 Oct '18

26 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/817/ Build Number: 817 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #817 [Miguel Duarte Barroso] Openvswitch 2.10 requires latest dpdk version [Sandro Bonazzola] ovirt-engine: add 4.2.7.z branch [Sandro Bonazzola] ovirt-engine: drop EOL release jobs ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.snapshot_merge Error Message: False != True after 180 seconds Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 69, in wrapper return func(prefix.virt_env.engine_vm().get_api(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/004_basic_sanity.py", line 202, in snapshot_merge lambda: File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 282, in assert_true_within_short assert_equals_within_short(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 266, in assert_equals_within_short func, value, SHORT_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) AssertionError: False != True after 180 seconds

1 2

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-4.2 - Build # 595 - Failure!
by jenkins＠jenkins.phx.ovirt.org 26 Oct '18

26 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/595/ Build Number: 595 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #595 [Miguel Duarte Barroso] Openvswitch 2.10 requires latest dpdk version ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: 143 -------------------- >> begin captured logging << -------------------- cli: DEBUG: signal 15 was caught --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 229, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 273, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 278, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37093, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 54, in wait response = self._connection.wait(self._context) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 496, in wait return self.__wait(context, failed_auth) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 532, in __wait self._multi.select(1.0) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in exit_handler sys.exit(128 + signum) '143\n-------------------- >> begin captured logging << --------------------\ncli: DEBUG: signal 15 was caught\n--------------------- >> end captured logging << ---------------------'

1 3

Build failed in Jenkins: system-sync_mirrors-epel-el6-x86_64 #1988
by jenkins＠jenkins.phx.ovirt.org 26 Oct '18

26 Oct '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/1988/displ…> Changes: [Sandro Bonazzola] ovirt-engine: add 4.2.7.z branch [Sandro Bonazzola] ovirt-engine: drop EOL release jobs ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision b41f91147d6d04e4ba87c7ad5d43cf4043d6a077 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f b41f91147d6d04e4ba87c7ad5d43cf4043d6a077 Commit message: "ovirt-engine: drop EOL release jobs" > git rev-list --no-walk 30ca1e1d873c96bd9d467c7ea5c8a15a7b35cebc # timeout=10 [system-sync_mirrors-epel-el6-x86_64] $ /bin/bash -xe /tmp/jenkins1929786876317976215.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror epel-el6 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-updates-el7/packages error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-updates-el7/packages' Build step 'Execute shell' marked build as failure

1 1