- Infra - oVirt List Archives

[CQ]: 89113, 2 (ovirt-engine-nodejs-modules) failed "ovirt-master" system tests
by oVirt Jenkins 16 Mar '18

16 Mar '18

Change 89113,2 (ovirt-engine-nodejs-modules) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/89113/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6401/

1 0

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 223 - Failure!
by jenkins＠jenkins.phx.ovirt.org 16 Mar '18

16 Mar '18

------=_Part_248_224867011.1521170625791 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/223/ Build Number: 223 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #223 [Michal Skrivanek] master: add USB to the sanity VM [Sandro Bonazzola] mirrors-reposync: add qemu-ev testing repo [Daniel Belenky] Modify mergeoptions in parser utils to merge runif ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: None != True after 900 seconds Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 230, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 274, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 263, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 237, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) AssertionError: None != True after 900 seconds ------=_Part_248_224867011.1521170625791--

1 1

[ OST Failure Report ] [ oVirt Master (cockpit-ovirt) ] [ 15-03-2018 ] [ 098_ovirt_provider_ovn.use_ovn_provider ]
by Dafna Ron 16 Mar '18

16 Mar '18

Hi, We have a failure on master for test 098_ovirt_provider_ovn.use_ovn_provider in project cockpit-ovirt. This seems to be a race because object is locked. also, the actual failure is logged as WARN and not ERROR. I don't think the patch is actually related to the failure but I think the test should be fixed. can you please review to make sure we do not have an actual regression and let me know if we need to open a bz to fix the test? *Link and headline of suspected patches: * *https://gerrit.ovirt.org/#/c/89020/2 <https://gerrit.ovirt.org/#/c/89020/2> - * *wizard: Enable scroll on start page for low-res screensLink to Job:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6374 <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6374>Link to all logs:http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6374/art… <http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6374/artifacts>(Relevant) error snippet from the log: <error>2018-03-15 10:05:00,160-04 DEBUG [org.ovirt.engine.core.sso.servlets.OAuthTokenInfoServlet] (default task-10) [] Sending json response2018-03-15 10:05:00,160-04 DEBUG [org.ovirt.engine.core.sso.utils.TokenCleanupUtility] (default task-10) [] Not cleaning up expired tokens2018-03-15 10:05:00,169-04 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-90) [789edb23] Lock Acquired to object 'EngineLock:{exclusiveLocks='[c38a67ec-0b48-4e6f-be85-70c700df5483=PROVIDER]', sharedLocks=''}'2018-03-15 10:05:00,184-04 INFO [org.ovirt.engine.core.bll.provider.network.SyncNetworkProviderCommand] (EE-ManagedThreadFactory-engineScheduled-Thread-90) [789edb23] Running command: SyncNetworkProviderCommand internal: true.2018-03-15 10:05:00,228-04 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (default task-13) [e1328379-17b7-49f8-beb2-cf8331784828] Compiled stored procedure. Call string is [{call getdcidbyexternalnetworkid(?)}]2018-03-15 10:05:00,228-04 DEBUG [org.ovirt.engine.core.dal.dbbroker.PostgresDbEngineDialect$PostgresSimpleJdbcCall] (default task-13) [e1328379-17b7-49f8-beb2-cf8331784828] SqlCall for procedure [GetDcIdByExternalNetworkId] compiled2018-03-15 10:05:00,229-04 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (default task-13) [e1328379-17b7-49f8-beb2-cf8331784828] method: runQuery, params: [GetAllExternalNetworksOnProvider, IdQueryParameters:{refresh='false', filtered='false'}], timeElapsed: 353ms2018-03-15 10:05:00,239-04 INFO [org.ovirt.engine.core.bll.network.dc.AddNetworkCommand] (default task-13) [e1328379-17b7-49f8-beb2-cf8331784828] Failed to Acquire Lock to object 'EngineLock:{exclusiveLocks='[network_1=NETWORK, c38a67ec-0b48-4e6f-be85-70c700df5483=PROVIDER]', sharedLocks=''}'2018-03-15 10:05:00,239-04 WARN [org.ovirt.engine.core.bll.network.dc.AddNetworkCommand] (default task-13) [e1328379-17b7-49f8-beb2-cf8331784828] Validation of action 'AddNetwork' failed for user admin@internal-authz. Reasons: VAR__TYPE__NETWORK,VAR__ACTION__ADD,ACTION_TYPE_FAILED_PROVIDER_LOCKED,$providerId c38a67ec-0b48-4e6f-be85-70c700df54832018-03-15 10:05:00,240-04 DEBUG [org.ovirt.engine.core.common.di.interceptor.DebugLoggingInterceptor] (default task-13) [e1328379-17b7-49f8-beb2-cf8331784828] method: runAction, params: [AddNetwork, AddNetworkStoragePoolParameters:{commandId='61b365ec-27c1-49af-ad72-f907df8befcd', user='null', commandType='Unknown'}], timeElapsed: 10ms2018-03-15 10:05:00,250-04 ERROR [org.ovirt.engine.api.restapi.resource.AbstractBackendResource] (default task-13) [] Operation Failed: [Cannot add Network. Related operation on provider with the id c38a67ec-0b48-4e6f-be85-70c700df5483 is currently in progress. Please try again later.]2018-03-15 10:05:00,254-04 DEBUG [org.ovirt.engine.core.utils.servlet.LocaleFilter] (default task-14) [] Incoming locale 'en-US'. Filter determined locale to be 'en-US'2018-03-15 10:05:00,254-04 DEBUG [org.ovirt.engine.core.sso.servlets.OAuthTokenServlet] (default task-14) [] Entered OAuthTokenServlet Query String: null, Parameters : password = ***, grant_type = password, scope = ovirt-app-api ovirt-ext=token-info:validate, username = admin@internal, </error>*

2 2

Build failed in Jenkins: system-sync_mirrors-centos-updates-el7-x86_64 #1373
by jenkins＠jenkins.phx.ovirt.org 16 Mar '18

16 Mar '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> Changes: [Eyal Edri] Run all nightly suites 3 times a day [Sandro Bonazzola] system-tests: add he-basic-iscsi-suite-master ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision f395591f18d0a3b6ae3ff8daaafd93321b7d61f3 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f f395591f18d0a3b6ae3ff8daaafd93321b7d61f3 Commit message: "system-tests: add he-basic-iscsi-suite-master" > git rev-list --no-walk 26142503ea0774cd18e740630cd68c7ab86d9f83 # timeout=10 [system-sync_mirrors-centos-updates-el7-x86_64] $ /bin/bash -xe /tmp/jenkins4149197632192240639.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-updates-el7 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1474, in _commonLoadRepoXML if self._latestRepoXML(local): File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1443, in _latestRepoXML oxml = self._saveOldRepoXML(local) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1300, in _saveOldRepoXML shutil.copy2(local, old_local) File "/usr/lib64/python2.7/shutil.py", line 131, in copy2 copystat(src, dst) File "/usr/lib64/python2.7/shutil.py", line 98, in copystat os.utime(dst, (st.st_atime, st.st_mtime)) OSError: [Errno 2] No such file or directory: '/home/jenkins/mirrors_cache/fedora-updates-fc24/repomd.xml.old.tmp' Build step 'Execute shell' marked build as failure

1 1

[oVirt Jenkins] ovirt-system-tests_he-basic-ansible-suite-master - Build # 75 - Failure!
by jenkins＠jenkins.phx.ovirt.org 16 Mar '18

16 Mar '18

------=_Part_242_652355769.1521166632821 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-mast… Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-mast… Build Number: 75 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #75 [Michal Skrivanek] master: add USB to the sanity VM [Sandro Bonazzola] mirrors-reposync: add qemu-ev testing repo [Daniel Belenky] Modify mergeoptions in parser utils to merge runif ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_242_652355769.1521166632821--

1 1

[JIRA] (OVIRT-1936) (nested)&&fc27 label has no online slaves
by sbonazzo (oVirt JIRA) 16 Mar '18

16 Mar '18

This is a multi-part message in MIME format... ------------=_1521177247-12355-118 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit sbonazzo created OVIRT-1936: ------------------------------- Summary: (nested)&&fc27 label has no online slaves Key: OVIRT-1936 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1936 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: sbonazzo Assignee: infra jenkins has pending job waiting for a slave on (nested)&&fc27 label but all slaves matching this label are offline. vm0159.workers-phx.ovirt.org Jan 21, 2018 6:49:39 AM Disconnected by dbelenky : fc27 slave not functioning properly - bringing offline vm0160.workers-phx.ovirt.org Jan 21, 2018 6:49:36 AM Disconnected by dbelenky : fc27 slave not functioning properly - bringing offline vm0161.workers-phx.ovirt.org Jan 21, 2018 6:49:34 AM Disconnected by dbelenky : fc27 slave not functioning properly - bringing offline vm0162.workers-phx.ovirt.org Jan 21, 2018 6:45:53 AM Disconnected by bkorren : slave not functioning properly - bringing offline vm0163.workers-phx.ovirt.org Jan 21, 2018 6:49:51 AM Disconnected by dbelenky : fc27 slave not functioning properly - bringing offline vm0164.workers-phx.ovirt.org Jan 21, 2018 6:49:38 AM Disconnected by dbelenky : fc27 slave not functioning properly - bringing offline vm0165.workers-phx.ovirt.org Jan 21, 2018 6:49:16 AM Disconnected by dbelenky : fc27 slave not functioning properly - bringing offline Please re-provision the slaves and bring them back online If this can't be done in a short loop, in the meanwhile please move back lago_master_github_check-patch-fc27-x86_64 job to (libvirt phx nested fc26) label -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig> <https://redhat.com/summit> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100082) ------------=_1521177247-12355-118 Content-Type: text/html; charset="UTF-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit <html><body> <h3>sbonazzo created OVIRT-1936:</h3> <pre> Summary: (nested)&&fc27 label has no online slaves Key: OVIRT-1936 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1936 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: sbonazzo Assignee: infra</pre> jenkins has pending job waiting for a slave on (nested)&&fc27 label but all slaves matching this label are offline. vm0159.workers-phx.ovirt.org Jan 21, 2018 6:49:39 AM Disconnected by dbelenky : fc27 slave not functioning properly – bringing offline vm0160.workers-phx.ovirt.org Jan 21, 2018 6:49:36 AM Disconnected by dbelenky : fc27 slave not functioning properly – bringing offline vm0161.workers-phx.ovirt.org Jan 21, 2018 6:49:34 AM Disconnected by dbelenky : fc27 slave not functioning properly – bringing offline vm0162.workers-phx.ovirt.org Jan 21, 2018 6:45:53 AM Disconnected by bkorren : slave not functioning properly – bringing offline vm0163.workers-phx.ovirt.org Jan 21, 2018 6:49:51 AM Disconnected by dbelenky : fc27 slave not functioning properly – bringing offline vm0164.workers-phx.ovirt.org Jan 21, 2018 6:49:38 AM Disconnected by dbelenky : fc27 slave not functioning properly – bringing offline vm0165.workers-phx.ovirt.org Jan 21, 2018 6:49:16 AM Disconnected by dbelenky : fc27 slave not functioning properly – bringing offline Please re-provision the slaves and bring them back online If this can't be done in a short loop, in the meanwhile please move back lago_master_github_check-patch-fc27-x86_64 job to (libvirt phx nested fc26) label — SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D Red Hat EMEA <<a href="https://www.redhat.com/">https://www.redhat.com/</a>> sbonazzo(a)redhat.com <<a href="https://red.ht/sig">https://red.ht/sig</a>> <<a href="https://redhat.com/summit">https://redhat.com/summit</a>> — This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100082) <img src="https://u4043402.ct.sendgrid.net/wf/open?upn=i5TMWGV99amJbNxJpSp2-2BJ33BSM3…" alt="" width="1" height="1" border="0" style="height:1px !important;width:1px !important;border-width:0 !important;margin-top:0 !important;margin-bottom:0 !important;margin-right:0 !important;margin-left:0 !important;padding-top:0 !important;padding-bottom:0 !important;padding-right:0 !important;padding-left:0 !important;"/> </body></html> ------------=_1521177247-12355-118--

1 0

[CQ]: af3e0c6 (ovirt-flexdriver) failed "ovirt-master" system tests
by oVirt Jenkins 15 Mar '18

15 Mar '18

Change af3e0c6 (ovirt-flexdriver) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://github.com/rgolangh/ovirt-flexdriver/commit/af3e0c65e2a5f3a3ba313c1… For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6389/

1 0

[CQ]: 88690, 7 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 15 Mar '18

15 Mar '18

A system test invoked by the "ovirt-master" change queue including change 88690,7 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 88620,4 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 88620,4 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/88690/7 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/88620/4 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6384/

1 0

[CQ]: 88920, 8 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 15 Mar '18

15 Mar '18

A system test invoked by the "ovirt-master" change queue including change 88920,8 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 88620,4 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 88620,4 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/88920/8 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/88620/4 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/6379/

1 0

Build failed in Jenkins: system-sync_mirrors-epel-el6-x86_64 #1294
by jenkins＠jenkins.phx.ovirt.org 15 Mar '18

15 Mar '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/1294/displ…> Changes: [Sandro Bonazzola] mirrors-reposync: add qemu-ev testing repo ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 69275d191c2de9980fccd25d7f9a6079871d2d81 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 69275d191c2de9980fccd25d7f9a6079871d2d81 Commit message: "mirrors-reposync: add qemu-ev testing repo" > git rev-list --no-walk da1e4fe5ea4c69de5cefab65baaa9579f4180ca7 # timeout=10 [system-sync_mirrors-epel-el6-x86_64] $ /bin/bash -xe /tmp/jenkins590594148875260902.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror epel-el6 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 112, in retrieveAllMD repo._revertOldRepoXML() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1331, in _revertOldRepoXML os.rename(old_data['old_local'], old_data['local']) OSError: [Errno 2] No such file or directory Build step 'Execute shell' marked build as failure

1 1