December 2018 - Infra - oVirt List Archives

[JIRA] (OVIRT-2610) Add alerts for Jenkins job queue
by Evgheni Dereveanchin (oVirt JIRA) 03 Dec '18

03 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2610?page=com.atlassian.jira.… ] Evgheni Dereveanchin reassigned OVIRT-2610: ------------------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > Add alerts for Jenkins job queue > -------------------------------- > > Key: OVIRT-2610 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2610 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Evgheni Dereveanchin > Assignee: Evgheni Dereveanchin > > We do have some monitoring in place for Jenkins job queues yet there are no alerts configured. > Opening ticket to discuss adding alerts and normal actions that should be taken if one happens. > Sample actions for the infra owner: > * verify that jobs aren't stuck waiting for a label that has no hosts assigned > * verify that a stuck job isn't blocking queues (CQ in particular) > Monitoring can be added to Nagios using a trivial plugin based on API output: > # curl jenkins.ovirt.org/queue/api/xml | grep -o '<item' | wc -l -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2610) Add alerts for Jenkins job queue
by Evgheni Dereveanchin (oVirt JIRA) 03 Dec '18

03 Dec '18

Evgheni Dereveanchin created OVIRT-2610: ------------------------------------------- Summary: Add alerts for Jenkins job queue Key: OVIRT-2610 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2610 Project: oVirt - virtualization made easy Issue Type: Improvement Reporter: Evgheni Dereveanchin Assignee: infra We do have some monitoring in place for Jenkins job queues yet there are no alerts configured. Opening ticket to discuss adding alerts and normal actions that should be taken if one happens. Sample actions for the infra owner: * verify that jobs aren't stuck waiting for a label that has no hosts assigned * verify that a stuck job isn't blocking queues (CQ in particular) Monitoring can be added to Nagios using a trivial plugin based on API output: # curl jenkins.ovirt.org/queue/api/xml | grep -o '<item' | wc -l -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2609) stdci style reports sometimes disappear pretty fast
by Roman Mohr (oVirt JIRA) 03 Dec '18

03 Dec '18

Roman Mohr created OVIRT-2609: --------------------------------- Summary: stdci style reports sometimes disappear pretty fast Key: OVIRT-2609 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2609 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: Roman Mohr Assignee: infra Can there be a SLA defined for how long we can see test results until they get removed? It does not have to be like on travis (where I can still see all my build logs from years ago), but at least a predictable period would be nice. The PR in [1] did for instance not have the results anymore from 5 days ago. Thanks, Roman [1] https://github.com/kubevirt/kubevirt/pull/1744 -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2600) add monitoring to OpenShift
by Evgheni Dereveanchin (oVirt JIRA) 03 Dec '18

03 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2600?page=com.atlassian.jira.… ] Evgheni Dereveanchin reassigned OVIRT-2600: ------------------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > add monitoring to OpenShift > --------------------------- > > Key: OVIRT-2600 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2600 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Evgheni Dereveanchin > Assignee: Evgheni Dereveanchin > > We use OpenShift for CI so we need to monitor health of the masters along with node availability and other parameters if possible to get alerted if something starts failing. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[CQ]: 252c21d (ovirt-ansible-engine-setup) failed "ovirt-master" system tests
by oVirt Jenkins 03 Dec '18

03 Dec '18

Change 252c21d (ovirt-ansible-engine-setup) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://github.com/oVirt/ovirt-ansible-engine-setup/commit/252c21d708e0e9a1… For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/11740/

3 4

[CQ]: a1e4392 (ovirt-ansible) failed "ovirt-4.2" system tests
by oVirt Jenkins 03 Dec '18

03 Dec '18

Change a1e4392 (ovirt-ansible) is probably the reason behind recent system test failures in the "ovirt-4.2" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://github.com/oVirt/ovirt-ansible/commit/a1e439270f84e4ee422996fc5b5df… For failed test results see: http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3578/

1 0

[JIRA] (OVIRT-2608) jenkins_standard-on-merge failed with timeout
by Evgheni Dereveanchin (oVirt JIRA) 03 Dec '18

03 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2608?page=com.atlassian.jira.… ] Evgheni Dereveanchin reassigned OVIRT-2608: ------------------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > jenkins_standard-on-merge failed with timeout > --------------------------------------------- > > Key: OVIRT-2608 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2608 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: Evgheni Dereveanchin > > The following job failed in the middle of reconfiguring jobs with a timeout: > https://jenkins.ovirt.org/job/jenkins_standard-on-merge/357/ > Error message: > HTTPError: 504 Server Error: Gateway Timeout for url: http://jenkins.phx.ovirt.org/job/ovirt-engine_master_check-patch-el7-x86_64… > This may be related to Jenkins general slowness reported last week. Need to re-trigger the job to ensure all changes are in as the fc29 pathces that needed to be merged are missing. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2608) jenkins_standard-on-merge failed with timeout
by Evgheni Dereveanchin (oVirt JIRA) 03 Dec '18

03 Dec '18

Evgheni Dereveanchin created OVIRT-2608: ------------------------------------------- Summary: jenkins_standard-on-merge failed with timeout Key: OVIRT-2608 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2608 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Evgheni Dereveanchin Assignee: infra The following job failed in the middle of reconfiguring jobs with a timeout: https://jenkins.ovirt.org/job/jenkins_standard-on-merge/357/ Error message: HTTPError: 504 Server Error: Gateway Timeout for url: http://jenkins.phx.ovirt.org/job/ovirt-engine_master_check-patch-el7-x86_64… This may be related to Jenkins general slowness reported last week. Need to re-trigger the job to ensure all changes are in as the fc29 pathces that needed to be merged are missing. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[CQ]: 95911,1 (vdsm) failed "ovirt-master" system tests
by oVirt Jenkins 03 Dec '18

03 Dec '18

Change 95911,1 (vdsm) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/95911/1 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/11839/

1 0

[oVirt Jenkins] ovirt-node-ng-image_4.3_build-artifacts-fc28-x86_64 - Build # 8 - Failure!
by jenkins＠jenkins.phx.ovirt.org 03 Dec '18

03 Dec '18

Project: http://jenkins.ovirt.org/job/ovirt-node-ng-image_4.3_build-artifacts-fc28-x… Build: http://jenkins.ovirt.org/job/ovirt-node-ng-image_4.3_build-artifacts-fc28-x… Build Number: 8 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #8 No changes ----------------- Failed Tests: ----------------- No tests ran.

1 1