- Infra - oVirt List Archives

[CQ]: 95270, 2 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 07 Nov '18

07 Nov '18

A system test invoked by the "ovirt-master" change queue including change 95270,2 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 95190,2 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 95190,2 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/95270/2 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/95190/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/11048/

1 0

[oVirt Jenkins] ovirt-system-tests_network-suite-master - Build # 737 - Failure!
by jenkins＠jenkins.phx.ovirt.org 07 Nov '18

07 Nov '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_network-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_network-suite-master/737/ Build Number: 737 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #737 [Eitan Raviv] networking: introduce Node with ssh capabilities ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: network-suite-master.tests.ovs.test_ovn_physnet.test_connect_vm_to_external_physnet Error Message: test setup failure Stack Trace: system = <lib.system.SDKSystemRoot object at 0x7fcd40678e10> ovs_cluster = <lib.clusterlib.Cluster object at 0x7fcd39fc7190> default_cluster = <lib.clusterlib.Cluster object at 0x7fcd4502fa50> default_data_center = <lib.datacenterlib.DataCenter object at 0x7fcd4294aed0> @pytest.fixture(scope='session') def host_in_ovs_cluster( system, ovs_cluster, default_cluster, default_data_center): host_id = default_cluster.host_ids()[0] host = hostlib.Host(system) host.import_by_id(host_id) host.wait_for_up_status(timeout=hostlib.HOST_TIMEOUT_LONG) with hostlib.change_cluster(host, ovs_cluster): host.sync_all_networks() default_data_center.wait_for_up_status() > yield host network-suite-master/fixtures/host.py:73: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ /usr/lib64/python2.7/contextlib.py:35: in __exit__ self.gen.throw(type, value, traceback) network-suite-master/lib/hostlib.py:84: in change_cluster host.change_cluster(original_cluster) network-suite-master/lib/hostlib.py:137: in change_cluster self.deactivate() network-suite-master/lib/hostlib.py:134: in deactivate self.wait_for_maintenance_status() network-suite-master/lib/hostlib.py:226: in wait_for_maintenance_status success_criteria=lambda s: s == HostStatus.MAINTENANCE) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function <lambda> at 0x7fcd3a0f07d0>, exec_func_args = () success_criteria = <function <lambda> at 0x7fcd3a085500> error_criteria = <function <lambda> at 0x7fcd45ba5aa0>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: up network-suite-master/lib/syncutil.py:104: Timeout

1 1

Fwd: [oVirt Jenkins] ovirt-system-tests_network-suite-4.2 - Build # 719 - Still Failing!
by Eitan Raviv 07 Nov '18

07 Nov '18

Hi, We have a failure on OST/network-suite-master for several days now. My suspicions of the cause are detailed below. Can you have a look? Thanks ---------- Forwarded message --------- From: Eitan Raviv <eraviv(a)redhat.com> Date: Mon, Nov 5, 2018 at 8:39 AM Subject: Re: [oVirt Jenkins] ovirt-system-tests_network-suite-4.2 - Build # 719 - Still Failing! To: Ori Liel <oliel(a)redhat.com> Hi, Can you have a look? Thanks On Thu, Nov 1, 2018 at 10:08 AM Eitan Raviv <eraviv(a)redhat.com> wrote: > Hi Ondra, > > We have above failure on OST network-suite-4.2 [1] due to: > Fault reason is "Request syntactically incorrect.". Fault detail is "For > correct usage, see: > https://192.168.201.4/ovirt-engine/apidoc#services/vm/methods/preview_snaps… > " > > and I see in engine.log [2]: > > javax.xml.bind.UnmarshalException: unexpected element (uri:"", local:"disks") > > at the same time I see in model_4.2 [3] that a change was done to add the disks, but if i am not mistaken the ovirt-engine-sdk pom.xml [4] was not bumped to reflect this change. > > Can you please check? > > Thanks > > [1] > https://jenkins.ovirt.org/job/ovirt-system-tests_network-suite-4.2/719/arti… > [2] > https://jenkins.ovirt.org/job/ovirt-system-tests_network-suite-4.2/717/arti… > [3] > https://gerrit.ovirt.org/#/q/project:ovirt-engine-api-model+branch:model_4.2 > [4] https://gerrit.ovirt.org/#/q/project:ovirt-engine-sdk+branch:sdk_4.2 > > > > ---------- Forwarded message --------- > From: Edward Haas <edwardh(a)redhat.com> > Date: Thu, Nov 1, 2018 at 8:35 AM > Subject: Fwd: [oVirt Jenkins] ovirt-system-tests_network-suite-4.2 - Build > # 719 - Still Failing! > To: <rhevm-network-staff(a)redhat.com> > > > FYI > > ---------- Forwarded message --------- > From: <jenkins(a)jenkins.phx.ovirt.org> > Date: Thu, Nov 1, 2018 at 6:02 AM > Subject: [oVirt Jenkins] ovirt-system-tests_network-suite-4.2 - Build # > 719 - Still Failing! > To: <lgoldber(a)redhat.com>, <edwardh(a)redhat.com>, <infra(a)ovirt.org> > > > Project: > http://jenkins.ovirt.org/job/ovirt-system-tests_network-suite-4.2/ > Build: > http://jenkins.ovirt.org/job/ovirt-system-tests_network-suite-4.2/719/ > Build Number: 719 > Build Status: Still Failing > Triggered By: Started by timer > > ------------------------------------- > Changes Since Last Success: > ------------------------------------- > Changes for Build #717 > [Marcin Sobczyk] Change logging level for 'schema.inconsistency' > > > Changes for Build #718 > [Ales Musil] master: Update master suite compatibility version > > > Changes for Build #719 > [Ales Musil] master: Update master suite compatibility version > > > > > ----------------- > Failed Tests: > ----------------- > 1 tests failed. > FAILED: > network-suite-4.2.tests.test_mac_pools.test_undo_preview_snapshot_when_mac_used_reassigns_a_new_mac > > Error Message: > Error: Fault reason is "Request syntactically incorrect.". Fault detail is > "For correct usage, see: > https://192.168.201.4/ovirt-engine/apidoc#services/vm/methods/preview_snaps…". > HTTP response code is 400. > > Stack Trace: > system = <lib.system.SDKSystemRoot object at 0x7fc7f91f48d0> > default_cluster = <lib.clusterlib.Cluster object at 0x7fc7f91f4bd0> > ovirtmgmt_vnic_profile = <lib.netlib.VnicProfile object at 0x7fc7f81b3710> > cirros_template = 'Cirros_0_4_0' > > def test_undo_preview_snapshot_when_mac_used_reassigns_a_new_mac( > system, default_cluster, ovirtmgmt_vnic_profile, > cirros_template): > with virtlib.vm_pool(system, size=2) as (vm_0, vm_1): > vm_0.create(vm_name=VM0, > cluster=default_cluster, > template=cirros_template) > vm_0.wait_for_down_status() > > vm_0.run() > vm_0.wait_for_up_status() > > nicless_snapshot = _create_snapshot(vm_0) > > vm_0.create_vnic(NIC_NAME_1, ovirtmgmt_vnic_profile, > MAC_ADDR_1) > vm_0.stop() > vm_0.wait_for_down_status() > > > nicless_snapshot.preview() > > network-suite-4.2/tests/test_mac_pools.py:124: > _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ > _ _ _ > network-suite-4.2/lib/virtlib.py:243: in preview > snapshot=self.get_sdk_type() > /usr/lib64/python2.7/site-packages/ovirtsdk4/services.py:31091: in > preview_snapshot > return self._internal_action(action, 'previewsnapshot', None, headers, > query, wait) > /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:299: in > _internal_action > return future.wait() if wait else future > /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:55: in wait > return self._code(response) > /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:296: in callback > self._check_fault(response) > /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:132: in > _check_fault > self._raise_error(response, body) > _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ > _ _ _ > > response = <ovirtsdk4.http.Response object at 0x7fc7f81b3350> > detail = <ovirtsdk4.types.Fault object at 0x7fc7f81b39d0> > > @staticmethod > def _raise_error(response, detail=None): > """ > Creates and raises an error containing the details of the > given HTTP > response and fault. > > This method is intended for internal use by other components > of the > SDK. Refrain from using it directly, as backwards > compatibility isn't > guaranteed. > """ > fault = detail if isinstance(detail, types.Fault) else None > > msg = '' > if fault: > if fault.reason: > if msg: > msg += ' ' > msg = msg + 'Fault reason is "%s".' % fault.reason > if fault.detail: > if msg: > msg += ' ' > msg = msg + 'Fault detail is "%s".' % fault.detail > if response: > if response.code: > if msg: > msg += ' ' > msg = msg + 'HTTP response code is %s.' % response.code > if response.message: > if msg: > msg += ' ' > msg = msg + 'HTTP response message is "%s".' % > response.message > > if isinstance(detail, six.string_types): > if msg: > msg += ' ' > msg = msg + detail + '.' > > class_ = Error > if response is not None: > if response.code in [401, 403]: > class_ = AuthError > elif response.code == 404: > class_ = NotFoundError > > error = class_(msg) > error.code = response.code if response else None > error.fault = fault > > raise error > E Error: Fault reason is "Request syntactically incorrect.". Fault > detail is "For correct usage, see: > https://192.168.201.4/ovirt-engine/apidoc#services/vm/methods/preview_snaps…". > HTTP response code is 400. > > /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:118: Error >

4 7

[oVirt Jenkins] ovirt-system-tests_network-suite-4.2 - Build # 717 - Failure!
by jenkins＠jenkins.phx.ovirt.org 07 Nov '18

07 Nov '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_network-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_network-suite-4.2/717/ Build Number: 717 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #717 [Marcin Sobczyk] Change logging level for 'schema.inconsistency' ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: network-suite-4.2.tests.test_mac_pools.test_undo_preview_snapshot_when_mac_used_reassigns_a_new_mac Error Message: Error: Fault reason is "Request syntactically incorrect.". Fault detail is "For correct usage, see: https://192.168.201.4/ovirt-engine/apidoc#services/vm/methods/preview_snaps…". HTTP response code is 400. Stack Trace: system = <lib.system.SDKSystemRoot object at 0x7fb4857daed0> default_cluster = <lib.clusterlib.Cluster object at 0x7fb4857da250> ovirtmgmt_vnic_profile = <lib.netlib.VnicProfile object at 0x7fb484018c50> cirros_template = 'Cirros_0_4_0' def test_undo_preview_snapshot_when_mac_used_reassigns_a_new_mac( system, default_cluster, ovirtmgmt_vnic_profile, cirros_template): with virtlib.vm_pool(system, size=2) as (vm_0, vm_1): vm_0.create(vm_name=VM0, cluster=default_cluster, template=cirros_template) vm_0.wait_for_down_status() vm_0.run() vm_0.wait_for_up_status() nicless_snapshot = _create_snapshot(vm_0) vm_0.create_vnic(NIC_NAME_1, ovirtmgmt_vnic_profile, MAC_ADDR_1) vm_0.stop() vm_0.wait_for_down_status() > nicless_snapshot.preview() network-suite-4.2/tests/test_mac_pools.py:124: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ network-suite-4.2/lib/virtlib.py:243: in preview snapshot=self.get_sdk_type() /usr/lib64/python2.7/site-packages/ovirtsdk4/services.py:31091: in preview_snapshot return self._internal_action(action, 'previewsnapshot', None, headers, query, wait) /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:299: in _internal_action return future.wait() if wait else future /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:55: in wait return self._code(response) /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:296: in callback self._check_fault(response) /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:132: in _check_fault self._raise_error(response, body) _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ response = <ovirtsdk4.http.Response object at 0x7fb485712f50> detail = <ovirtsdk4.types.Fault object at 0x7fb485712490> @staticmethod def _raise_error(response, detail=None): """ Creates and raises an error containing the details of the given HTTP response and fault. This method is intended for internal use by other components of the SDK. Refrain from using it directly, as backwards compatibility isn't guaranteed. """ fault = detail if isinstance(detail, types.Fault) else None msg = '' if fault: if fault.reason: if msg: msg += ' ' msg = msg + 'Fault reason is "%s".' % fault.reason if fault.detail: if msg: msg += ' ' msg = msg + 'Fault detail is "%s".' % fault.detail if response: if response.code: if msg: msg += ' ' msg = msg + 'HTTP response code is %s.' % response.code if response.message: if msg: msg += ' ' msg = msg + 'HTTP response message is "%s".' % response.message if isinstance(detail, six.string_types): if msg: msg += ' ' msg = msg + detail + '.' class_ = Error if response is not None: if response.code in [401, 403]: class_ = AuthError elif response.code == 404: class_ = NotFoundError error = class_(msg) error.code = response.code if response else None error.fault = fault > raise error E Error: Fault reason is "Request syntactically incorrect.". Fault detail is "For correct usage, see: https://192.168.201.4/ovirt-engine/apidoc#services/vm/methods/preview_snaps…". HTTP response code is 400. /usr/lib64/python2.7/site-packages/ovirtsdk4/service.py:118: Error

1 22

[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-master - Build # 536 - Failure!
by jenkins＠jenkins.phx.ovirt.org 07 Nov '18

07 Nov '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/536/ Build Number: 536 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #536 [Galit Rosenthal] Added PG10 to master repo file [Ehud Yonasi] slave.conf: Update mirror links to latest. ----------------- Failed Tests: ----------------- No tests ran.

1 2

[CQ]: 94188, 12 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 07 Nov '18

07 Nov '18

A system test invoked by the "ovirt-master" change queue including change 94188,12 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 95190,2 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 95190,2 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/94188/12 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/95190/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/11044/

1 0

[CQ]: 94867,4 (ovirt-engine) failed "ovirt-4.2" system tests
by oVirt Jenkins 07 Nov '18

07 Nov '18

Change 94867,4 (ovirt-engine) is probably the reason behind recent system test failures in the "ovirt-4.2" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/94867/4 For failed test results see: http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3453/

3 3

[CQ]: 94207, 8 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 07 Nov '18

07 Nov '18

A system test invoked by the "ovirt-master" change queue including change 94207,8 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 95190,2 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 95190,2 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/94207/8 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/95190/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/11041/

2 1

[JENKINS] Failed to setup proejct kubevirt_kubevirt_standard-check-pr
by jenkins＠jenkins.phx.ovirt.org 07 Nov '18

07 Nov '18

Failed to run project_setup.sh for: #2434 kubevirt [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on ovirt-srv05.phx.ovirt.org-container-2.

1 0

Build failed in Jenkins: system-sync_mirrors-centos-updates-el7-x86_64 #2108
by jenkins＠jenkins.phx.ovirt.org 06 Nov '18

06 Nov '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> Changes: [Ehud Yonasi] slave.conf: Update mirror links to latest. ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 74a12b7f9fb08940d439b308833f0ab91bb5c27d (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 74a12b7f9fb08940d439b308833f0ab91bb5c27d Commit message: "slave.conf: Update mirror links to latest." > git rev-list --no-walk fb90ff88facd41c44b2eb5af874e2acc7126d9e9 # timeout=10 [system-sync_mirrors-centos-updates-el7-x86_64] $ /bin/bash -xe /tmp/jenkins6004725110998527870.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-updates-el7 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1474, in _commonLoadRepoXML if self._latestRepoXML(local): File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1452, in _latestRepoXML repomd = self.metalink_data.repomd File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 918, in <lambda> metalink_data = property(fget=lambda self: self._getMetalink(), File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 914, in _getMetalink self._metalink = metalink.MetaLinkRepoMD(self.metalink_filename) File "/usr/lib/python2.7/site-packages/yum/metalink.py", line 189, in __init__ raise MetaLinkRepoErrorParseFail, "File %s is not XML" % filename yum.metalink.MetaLinkRepoErrorParseFail: File /home/jenkins/mirrors_cache/fedora-base-fc29/metalink.xml is not XML Build step 'Execute shell' marked build as failure

1 2