- Infra - oVirt List Archives

[JIRA] (OVIRT-2546) 004_basic_sanity.verify_suspend_resume_vm0 failure on verify_suspend_resume_vm0 with no reason
by Dafna Ron (oVirt JIRA) 26 Oct '18

26 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2546?page=com.atlassian.jira.… ] Dafna Ron reassigned OVIRT-2546: -------------------------------- Assignee: Galit Rosenthal (was: infra) > 004_basic_sanity.verify_suspend_resume_vm0 failure on verify_suspend_resume_vm0 with no reason > ---------------------------------------------------------------------------------------------- > > Key: OVIRT-2546 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2546 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: Galit Rosenthal > Labels: ost_failures, ost_lago > > We had a failure on master ovirt-provider ovn project > The change (https://gerrit.ovirt.org/#/c/94647/) had not caused the failure and I am not seeing any infra issue that can cause this failure. > The build is: 'https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10625/' > Here is the error: > 'https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10625/testRe…' > [~gbenhaim(a)redhat.com] can you please have a look before I move this to the developers? -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2559) fatal: unable to access 'https://gerrit.ovirt.org/jenkins/': Could not resolve host: gerrit.ovirt.org; Unknown error
by Dafna Ron (oVirt JIRA) 26 Oct '18

26 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2559?page=com.atlassian.jira.… ] Dafna Ron reassigned OVIRT-2559: -------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > fatal: unable to access 'https://gerrit.ovirt.org/jenkins/': Could not resolve host: gerrit.ovirt.org; Unknown error > -------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-2559 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2559 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: Evgheni Dereveanchin > Labels: ost_failures, ost_infra > > We had a failed ovirt-4.2 build for project ovirt-engine. > seems like we have a problem cloning the repo > https://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3406/consoleFull > https://gerrit.ovirt.org/#/c/95085/4 -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2554) no clear logs on test exit
by Dafna Ron (oVirt JIRA) 26 Oct '18

26 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2554?page=com.atlassian.jira.… ] Dafna Ron reassigned OVIRT-2554: -------------------------------- Assignee: Galit Rosenthal (was: infra) > no clear logs on test exit > -------------------------- > > Key: OVIRT-2554 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2554 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: Galit Rosenthal > Priority: Highest > Labels: ost_failures, ost_lago > > we had a failure in master on test 004_basic_sanity.next_run_unplug_cpu for project pthreading and there are no logs that can help me debug the issue. > There are post-suite-sigterm but there are no logs in there that can help me understand what happened. > [~gbenhaim(a)redhat.com] can you please look at this failure? > https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10892/artifa… > I re-triggered the last project's change to make sure it passes but I am not sure how to debug this failure. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2554) no clear logs on test exit
by Dafna Ron (oVirt JIRA) 26 Oct '18

26 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2554?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2554: ---------------------------------- I have another test that exited with signal 15 and I do not have any logs from the test to understand what happened, only I am assigning this to Galit as I do not know what signal 15 and why we do not collect all the logs from the failed test https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10927/artifa… Galit, this is the log collection from run_suite.sh, but I am not sure why its not collecting the logs from ovirt (as it does on other failures). even on timeout I need all of ovirt dir to be collected and all of hosts vdsm dir to be collected. {code:python} on_sigterm() { local dest="${OST_REPO_ROOT}/test_logs/${SUITE##*/}/post-suite-sigterm" set +e export CLI export -f env_collect timeout \ 120s \ bash -c "env_collect $dest" exit 143 } {code} > no clear logs on test exit > -------------------------- > > Key: OVIRT-2554 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2554 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Priority: Highest > Labels: ost_failures, ost_lago > > we had a failure in master on test 004_basic_sanity.next_run_unplug_cpu for project pthreading and there are no logs that can help me debug the issue. > There are post-suite-sigterm but there are no logs in there that can help me understand what happened. > [~gbenhaim(a)redhat.com] can you please look at this failure? > https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10892/artifa… > I re-triggered the last project's change to make sure it passes but I am not sure how to debug this failure. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2554) no clear logs on test exit
by Dafna Ron (oVirt JIRA) 26 Oct '18

26 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2554?page=com.atlassian.jira.… ] Dafna Ron updated OVIRT-2554: ----------------------------- Summary: no clear logs on test exit (was: failure in master pthreading project on test 004_basic_sanity.next_run_unplug_cpu with no clear logs) > no clear logs on test exit > -------------------------- > > Key: OVIRT-2554 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2554 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Priority: Highest > Labels: ost_failures, ost_lago > > we had a failure in master on test 004_basic_sanity.next_run_unplug_cpu for project pthreading and there are no logs that can help me debug the issue. > There are post-suite-sigterm but there are no logs in there that can help me understand what happened. > [~gbenhaim(a)redhat.com] can you please look at this failure? > https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10892/artifa… > I re-triggered the last project's change to make sure it passes but I am not sure how to debug this failure. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 817 - Failure!
by jenkins＠jenkins.phx.ovirt.org 25 Oct '18

25 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/817/ Build Number: 817 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #817 [Miguel Duarte Barroso] Openvswitch 2.10 requires latest dpdk version [Sandro Bonazzola] ovirt-engine: add 4.2.7.z branch [Sandro Bonazzola] ovirt-engine: drop EOL release jobs ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.snapshot_merge Error Message: False != True after 180 seconds Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 69, in wrapper return func(prefix.virt_env.engine_vm().get_api(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/004_basic_sanity.py", line 202, in snapshot_merge lambda: File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 282, in assert_true_within_short assert_equals_within_short(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 266, in assert_equals_within_short func, value, SHORT_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) AssertionError: False != True after 180 seconds

1 2

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-4.2 - Build # 595 - Failure!
by jenkins＠jenkins.phx.ovirt.org 25 Oct '18

25 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/595/ Build Number: 595 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #595 [Miguel Duarte Barroso] Openvswitch 2.10 requires latest dpdk version ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: 143 -------------------- >> begin captured logging << -------------------- cli: DEBUG: signal 15 was caught --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 229, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 273, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 278, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37093, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 54, in wait response = self._connection.wait(self._context) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 496, in wait return self.__wait(context, failed_auth) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 532, in __wait self._multi.select(1.0) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in exit_handler sys.exit(128 + signum) '143\n-------------------- >> begin captured logging << --------------------\ncli: DEBUG: signal 15 was caught\n--------------------- >> end captured logging << ---------------------'

1 3

Build failed in Jenkins: system-sync_mirrors-epel-el6-x86_64 #1988
by jenkins＠jenkins.phx.ovirt.org 25 Oct '18

25 Oct '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/1988/displ…> Changes: [Sandro Bonazzola] ovirt-engine: add 4.2.7.z branch [Sandro Bonazzola] ovirt-engine: drop EOL release jobs ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision b41f91147d6d04e4ba87c7ad5d43cf4043d6a077 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f b41f91147d6d04e4ba87c7ad5d43cf4043d6a077 Commit message: "ovirt-engine: drop EOL release jobs" > git rev-list --no-walk 30ca1e1d873c96bd9d467c7ea5c8a15a7b35cebc # timeout=10 [system-sync_mirrors-epel-el6-x86_64] $ /bin/bash -xe /tmp/jenkins1929786876317976215.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror epel-el6 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/centos-updates-el7/packages error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/centos-updates-el7/packages' Build step 'Execute shell' marked build as failure

1 1

oVirt infra daily report - unstable production jobs - 624
by jenkins＠jenkins.phx.ovirt.org 25 Oct '18

25 Oct '18

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/624//artifact/exported-a… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-master - Build # 498 - Failure!
by jenkins＠jenkins.phx.ovirt.org 25 Oct '18

25 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/498/ Build Number: 498 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #498 [Miguel Duarte Barroso] Openvswitch 2.10 requires latest dpdk version ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 012_local_maintenance_sdk.local_maintenance Error Message: 143 -------------------- >> begin captured logging << -------------------- root: INFO: * Waiting For System Stability... root: INFO: * Performing Deactivation... root: INFO: * Performing Activation... root: INFO: * Waiting For System Stability... cli: DEBUG: signal 15 was caught --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-master/ovirt-system-tests/he-node-ng-suite-master/test-scenarios/012_local_maintenance_sdk.py", line 79, in local_maintenance time.sleep(wait_value) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in exit_handler sys.exit(128 + signum) '143\n-------------------- >> begin captured logging << --------------------\nroot: INFO: * Waiting For System Stability...\nroot: INFO: * Performing Deactivation...\nroot: INFO: * Performing Activation...\nroot: INFO: * Waiting For System Stability...\ncli: DEBUG: signal 15 was caught\n--------------------- >> end captured logging << ---------------------'

1 2