March 2021 - Infra - oVirt List Archives

[CQ]: 113924, 2 (ovirt-system-tests) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 17 Mar '21

17 Mar '21

A system test invoked by the "ovirt-master" change queue including change 113924,2 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 113144,5 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 113144,5 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113924/2 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113144/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/28690/

1 0

[CQ]: 113899, 3 (ovirt-system-tests) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 17 Mar '21

17 Mar '21

A system test invoked by the "ovirt-master" change queue including change 113899,3 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 113144,5 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 113144,5 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113899/3 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113144/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/28683/

1 0

dummy-master_change-queue is broken
by Yedidyah Bar David 17 Mar '21

17 Mar '21

Hi all, On Wed, Mar 17, 2021 at 10:43 AM Code Review <gerrit(a)ovirt.org> wrote: > > From Jenkins CI <jenkins(a)ovirt.org>: > > Jenkins CI has posted comments on this change. ( https://gerrit.ovirt.org/c/jenkins/+/113907 ) > > Change subject: Email didi on node suite > ...................................................................... > > > Patch Set 1: > > Build Failed > > https://jenkins.ovirt.org/job/standard-enqueue/32675/ : > This change was not submitted to any change queues for system testing. You will need to create some 'build-artifacts' jobs if you want changes to be submitted to change queues, take part in the system tests and be deployed to the nightly snapshot repositories. If your project uses STDCI V2 and you have release branches configured, you may disregard this message. > > > https://jenkins.ovirt.org/job/jenkins_standard-on-merge/1126/ : UNSTABLE AFAIU, this ^^^ ran: https://jenkins.ovirt.org/job/dummy-master_change-queue/1284/ Which failed with: 10:46:24 File "/home/jenkins/workspace/dummy-master_change-queue(a)tmp/durable-d1ad9c18/script.sh", line 7, in <module> 10:46:24 with JenkinsChangeQueue.persist_in_artifacts() as cq: 10:46:24 File "/usr/lib64/python3.6/contextlib.py", line 81, in __enter__ 10:46:24 return next(self.gen) 10:46:24 File "/home/jenkins/workspace/dummy-master_change-queue/jenkins/stdci_libs/jenkins_objects.py", line 315, in persist_in_artifacts 10:46:24 obj = cls.load_from_artifact(artifact_file) 10:46:24 File "/home/jenkins/workspace/dummy-master_change-queue/jenkins/stdci_libs/jenkins_objects.py", line 296, in load_from_artifact 10:46:24 artifact_file, cls if fallback_to_new else None 10:46:24 File "/home/jenkins/workspace/dummy-master_change-queue/jenkins/stdci_libs/jenkins_objects.py", line 270, in object_from_artifact 10:46:24 return _cpickle_loads(fd.read()) 10:46:24 File "/home/jenkins/workspace/dummy-master_change-queue/jenkins/stdci_libs/jenkins_objects.py", line 223, in _cpickle_loads 10:46:24 return pk.load() 10:46:24 File "/home/jenkins/workspace/dummy-master_change-queue/jenkins/stdci_libs/jenkins_objects.py", line 207, in _find_global 10:46:24 mod = import_module(mod_name) 10:46:24 File "/usr/lib64/python3.6/importlib/__init__.py", line 126, in import_module 10:46:24 return _bootstrap._gcd_import(name[level:], package, level) 10:46:24 File "<frozen importlib._bootstrap>", line 994, in _gcd_import 10:46:24 File "<frozen importlib._bootstrap>", line 971, in _find_and_load 10:46:24 File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked 10:46:24 ModuleNotFoundError: No module named 'copy_reg' Quickly looking at the code, it seems like we keep somewhere in "exported-artifacts" cached picked objects, and above fails when trying to load them. I guess it might include too-old code and should be refreshed (hopefully, if we did this the way I expect we did, by just finding the file ("<class name>.dat") and removing it). Last successful run of this job was a month ago. Anyone is taking care of this? Thanks, -- Didi

2 1

[CQ]: 112878, 28 (ovirt-system-tests) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 17 Mar '21

17 Mar '21

A system test invoked by the "ovirt-master" change queue including change 112878,28 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 113144,5 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 113144,5 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/112878/28 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113144/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/28680/

1 0

[CQ]: 112877, 13 (ovirt-system-tests) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 17 Mar '21

17 Mar '21

A system test invoked by the "ovirt-master" change queue including change 112877,13 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 113144,5 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 113144,5 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/112877/13 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113144/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/28677/

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build # 228 - Still Failing!
by jenkins＠jenkins.phx.ovirt.org 17 Mar '21

17 Mar '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/22… Build Number: 228 Build Status: Still Failing Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #198 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #199 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #200 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #201 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #202 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #203 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #204 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #205 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #206 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #207 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #208 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #209 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #210 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #211 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #212 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #213 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #214 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #215 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #216 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #217 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #218 [Martin Perina] network: Readd network-suite-4.3 from check-patch [Galit Rosenthal] Remove performance nightly job Changes for Build #219 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #220 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #221 [Martin Perina] network: Readd network-suite-4.3 from check-patch [Marcin Sobczyk] ost: Update the description for CUSTOM_REPOS Changes for Build #222 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #223 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #224 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #225 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #226 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #227 [Martin Perina] network: Readd network-suite-4.3 from check-patch Changes for Build #228 [Martin Perina] network: Readd network-suite-4.3 from check-patch ----------------- Failed Tests: ----------------- No tests ran.

1 72

[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_el7-nightly - Build # 292 - Failure!
by jenkins＠jenkins.phx.ovirt.org 17 Mar '21

17 Mar '21

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_el7-nightl… Build Number: 292 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #292 [Martin Perina] network: Readd network-suite-4.3 from check-patch ----------------- Failed Tests: ----------------- No tests ran.

1 2

oVirt infra daily report - unstable production jobs - 1497
by jenkins＠jenkins.phx.ovirt.org 17 Mar '21

17 Mar '21

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1497//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-3089) [FIRING:1] InstanceUnreachable ovirt-srv08.infra-phx.ovirt.org kubernetes-nodes-exporter (amd64 linux ovirt-srv08.infra-phx.ovirt.org true r620 true primary bare-metal ci)
by Alertmanager_Bot (oVirt JIRA) 16 Mar '21

16 Mar '21

Alertmanager_Bot created OVIRT-3089: --------------------------------------- Summary: [FIRING:1] InstanceUnreachable ovirt-srv08.infra-phx.ovirt.org kubernetes-nodes-exporter (amd64 linux ovirt-srv08.infra-phx.ovirt.org true r620 true primary bare-metal ci) Key: OVIRT-3089 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3089 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Alertmanager_Bot Assignee: infra Labels: - alertname = InstanceUnreachable - beta_kubernetes_io_arch = amd64 - beta_kubernetes_io_os = linux - instance = ovirt-srv08.infra-phx.ovirt.org - job = kubernetes-nodes-exporter - kubernetes_io_hostname = ovirt-srv08.infra-phx.ovirt.org - logging_infra_fluentd = true - model = r620 - node_role_kubernetes_io_compute = true - region = primary - type = bare-metal - zone = ci Annotations: - description = ovirt-srv08.infra-phx.ovirt.org of job kubernetes-nodes-exporter has been possibly down for more than 10 minutes. Source: http://prometheus-0:9090/graph?g0.expr=up%7Bjob%3D%22kubernetes-nodes-expor… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100155)

1 0

[CQ]: 113895, 2 (ovirt-system-tests) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 16 Mar '21

16 Mar '21

A system test invoked by the "ovirt-master" change queue including change 113895,2 (ovirt-system-tests) failed. However, this change seems not to be the root cause for this failure. Change 113144,5 (ovirt-system-tests) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 113144,5 (ovirt-system-tests) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113895/2 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/c/ovirt-system-tests/+/#/c/113144/5 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/28660/

1 0