- Infra - oVirt List Archives

[JIRA] (OVIRT-3042) git fetch fails - Network is unreachable (was: [CQ]: 111471,2 (ovirt-engine) failed "ovirt-master" system tests)
by Yedidyah Bar David (oVirt JIRA) 15 Oct '20

15 Oct '20

Yedidyah Bar David created OVIRT-3042: ----------------------------------------- Summary: git fetch fails - Network is unreachable (was: [CQ]: 111471,2 (ovirt-engine) failed "ovirt-master" system tests) Key: OVIRT-3042 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3042 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Yedidyah Bar David Assignee: infra On Thu, Oct 15, 2020 at 10:47 AM Radoslaw Szwajkowski <rszwajko(a)redhat.com> wrote: > > Fixed in https://gerrit.ovirt.org/#/c/111741/ It failed due to infra issue, adding infra-support and changing subject: https://jenkins.ovirt.org/job/ovirt-engine_standard-check-patch/8460/console 10:42:37 stderr: fatal: unable to access 'https://gerrit.ovirt.org/ovirt-engine/': Failed to connect to 2600:1f18:26e2:3333::3333: Network is unreachable I think we already saw several other similar cases recently. Is anyone checking this? Is it a network issue? Routine maintenance? Something else? Perhaps we should patch our scripts to try a few times before failing. Thanks, -- Didi -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0

[JIRA] (OVIRT-3040) [FIRING:1] InstanceUnreachable ibm-srv03.ovirt.org kubernetes-nodes-exporter (amd64 linux ibm-srv03.ovirt.org true external bare-metal-external ci)
by Shlomi Zidmi (oVirt JIRA) 15 Oct '20

15 Oct '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-3040?page=com.atlassian.jira.… ] Shlomi Zidmi commented on OVIRT-3040: ------------------------------------- Node is back online and reachable, however something went wrong with it yesterday and caused it to crash. I’m investigating what was the root cause for this. > [FIRING:1] InstanceUnreachable ibm-srv03.ovirt.org kubernetes-nodes-exporter (amd64 linux ibm-srv03.ovirt.org true external bare-metal-external ci) > --------------------------------------------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-3040 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3040 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Alertmanager_Bot > Assignee: infra > Labels: ALERT{alertname="InstanceUnreachable",instance="ibm-srv03.ovirt.org",job="kubernetes-nodes-exporter"} > > Labels: > - alertname = InstanceUnreachable > - beta_kubernetes_io_arch = amd64 > - beta_kubernetes_io_os = linux > - instance = ibm-srv03.ovirt.org > - job = kubernetes-nodes-exporter > - kubernetes_io_hostname = ibm-srv03.ovirt.org > - node_role_kubernetes_io_compute = true > - region = external > - type = bare-metal-external > - zone = ci > Annotations: > - description = ibm-srv03.ovirt.org of job kubernetes-nodes-exporter has been possibly down for more than 10 minutes. > Source: http://prometheus-0:9090/graph?g0.expr=up%7Bjob%3D%22kubernetes-nodes-expor… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0

[CQ]: 111628, 8 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 15 Oct '20

15 Oct '20

A system test invoked by the "ovirt-master" change queue including change 111628,8 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 111471,2 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 111471,2 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/111628/8 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/111471/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26386/

1 0

[CQ]: 111184, 11 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 15 Oct '20

15 Oct '20

A system test invoked by the "ovirt-master" change queue including change 111184,11 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 111471,2 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 111471,2 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/111184/11 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/111471/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26384/

1 0

[oVirt Jenkins] ovirt-system-tests_upgrade-from-release-suite-4.3_nightly - Build # 420 - Failure!
by jenkins＠jenkins.phx.ovirt.org 15 Oct '20

15 Oct '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-release-suite… Build: https://jenkins.ovirt.org/job/ovirt-system-tests_upgrade-from-release-suite… Build Number: 420 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #420 No changes ----------------- Failed Tests: ----------------- No tests ran.

1 1

oVirt infra daily report - unstable production jobs - 1344
by jenkins＠jenkins.phx.ovirt.org 15 Oct '20

15 Oct '20

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - https://jenkins.ovirt.org/job/system_jenkins-report/1344//artifact/exported… Cheers, Jenkins

1 0

[JIRA] (OVIRT-3041) review IOPS load on PHX storage servers
by Evgheni Dereveanchin (oVirt JIRA) 14 Oct '20

14 Oct '20

Evgheni Dereveanchin created OVIRT-3041: ------------------------------------------- Summary: review IOPS load on PHX storage servers Key: OVIRT-3041 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-3041 Project: oVirt - virtualization made easy Issue Type: Task Reporter: Evgheni Dereveanchin Assignee: infra While looking at Grafana I stumbled upon strange IOPS load on our storage servers. Looks like /dev/sdc on both is seeing a constant flow of 500 write IOPS with few actual data traffic. Let's investigate this as this may be some VM putting extra load and maybe it is not feeling well. /dev/sda3 should be the storage0[1-2]-data1 storage domain according to the configuration document: https://ovirt-infra-docs.readthedocs.io/en/latest/Phoenix_Lab/Storage_Hosts… -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100149)

1 0

[CQ]: 111471,2 (ovirt-engine) failed "ovirt-master" system tests
by oVirt Jenkins 14 Oct '20

14 Oct '20

Change 111471,2 (ovirt-engine) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111471/2 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26378/

1 0

[CQ]: 111681, 3 (ovirt-system-tests) failed "ovirt-master" system tests
by oVirt Jenkins 14 Oct '20

14 Oct '20

Change 111681,3 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111681/3 For failed test results see: https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/26375/

1 0

[CQ]: 111681,3 (ovirt-system-tests) failed "ovirt-4.3" system tests
by oVirt Jenkins 14 Oct '20

14 Oct '20

Change 111681,3 (ovirt-system-tests) is probably the reason behind recent system test failures in the "ovirt-4.3" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/111681/3 For failed test results see: https://jenkins.ovirt.org/job/ovirt-4.3_change-queue-tester/3956/

1 0