- Infra - oVirt List Archives

[JIRA] (OVIRT-2973) [FIRING:1] TestAlert
by Shlomi Zidmi (oVirt JIRA) 20 Jul '20

20 Jul '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2973?page=com.atlassian.jira.… ] Shlomi Zidmi updated OVIRT-2973: -------------------------------- Resolution: Fixed Status: Done (was: To Do) Making sure jiralert is functioning properly > [FIRING:1] TestAlert > --------------------- > > Key: OVIRT-2973 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2973 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Alertmanager_Bot > Assignee: infra > Labels: ALERT{alertname="TestAlert"} > > Labels: > - alertname = TestAlert > - key = value > Annotations: > Source: -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100133)

1 0

[JIRA] (OVIRT-2973) [FIRING:1] TestAlert
by Alertmanager_Bot (oVirt JIRA) 20 Jul '20

20 Jul '20

Alertmanager_Bot created OVIRT-2973: --------------------------------------- Summary: [FIRING:1] TestAlert Key: OVIRT-2973 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2973 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Alertmanager_Bot Assignee: infra Labels: - alertname = TestAlert - key = value Annotations: Source: -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100133)

1 0

[JIRA] (OVIRT-2972) resources.ovirt.org ran out of space for artifact publishing
by Shlomi Zidmi (oVirt JIRA) 20 Jul '20

20 Jul '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2972?page=com.atlassian.jira.… ] Shlomi Zidmi commented on OVIRT-2972: ------------------------------------- Actually we are monitoring [resources.ovirt.org|http://resources.ovirt.org] in Prometheus, and should have caught this on time !prom.png|width=83.33333333333334%! Looking at the alert rules defined, i see the following: {noformat}node_filesystem_free_bytes / node_filesystem_size_bytes{device!="tmpfs"} < 0.1{noformat} The blue line (/dev/sdb - mounted on /home/jenkins) in the picture is slightly above 0.1, and that’s why no alerts were fired. I’ll readjust the threshold so that Prometheus would be able to catch similar issues sooner next time. > resources.ovirt.org ran out of space for artifact publishing > ------------------------------------------------------------ > > Key: OVIRT-2972 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2972 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: infra > Attachments: image-20200720-083159.png, prom.png > > > This weekend Nagios sent disk space alerts for the /home/jenkins on resources.ovirt.org > AFAIR this is used as intermediate artifact storage for publishing and shouldn't fill up that much. Logging a ticket to investigate the root cause. > The partition is free again now so this is not blocking anything right now. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100133)

1 0

[JIRA] (OVIRT-2972) resources.ovirt.org ran out of space for artifact publishing
by Galit Rosenthal (oVirt JIRA) 20 Jul '20

20 Jul '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2972?page=com.atlassian.jira.… ] Galit Rosenthal edited comment on OVIRT-2972 at 7/20/20 9:13 AM: ----------------------------------------------------------------- When I fixed the issues, the nagios already send a message that the disk space came back to normal. I just removed the *.ready directory that prevented from the publish to work was (Author: grosenth(a)redhat.com) When I fixed the issues, the jenkins already send a message that the disk space came back to normal. I just removed the *.ready directory that prevented from the publish to work > resources.ovirt.org ran out of space for artifact publishing > ------------------------------------------------------------ > > Key: OVIRT-2972 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2972 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: infra > Attachments: image-20200720-083159.png > > > This weekend Nagios sent disk space alerts for the /home/jenkins on resources.ovirt.org > AFAIR this is used as intermediate artifact storage for publishing and shouldn't fill up that much. Logging a ticket to investigate the root cause. > The partition is free again now so this is not blocking anything right now. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100133)

1 0

[JIRA] (OVIRT-2972) resources.ovirt.org ran out of space for artifact publishing
by Galit Rosenthal (oVirt JIRA) 20 Jul '20

20 Jul '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2972?page=com.atlassian.jira.… ] Galit Rosenthal commented on OVIRT-2972: ---------------------------------------- When I fixed the issues, the jenkins already send a message that the disk space came back to normal. I just removed the *.ready directory that prevented from the publish to work > resources.ovirt.org ran out of space for artifact publishing > ------------------------------------------------------------ > > Key: OVIRT-2972 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2972 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: infra > Attachments: image-20200720-083159.png > > > This weekend Nagios sent disk space alerts for the /home/jenkins on resources.ovirt.org > AFAIR this is used as intermediate artifact storage for publishing and shouldn't fill up that much. Logging a ticket to investigate the root cause. > The partition is free again now so this is not blocking anything right now. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100133)

1 0

ovirt-engine-wildfly 19.1.0-2 publishing
by Yedidyah Bar David 20 Jul '20

20 Jul '20

Hi all, 1. Yesterday mperina pushed and merged a patch [1] to hopefully solve a rather-long-time breakage of, among others, he-basic-suite. I still do not see it in master-snapshot [2] - only 19.1.0-1. I do see it in tested [3]. Can someone please publish it to snapshot? 2. I tried to debug this myself a bit, but failed to find documentation for the publishing part. A few months ago it was said (not very clearly/officially, IIRC) that we do not anymore pass built-artifacts results through OST, because it's too fragile. Did we update docs? Where can I find a clear overview of the process from pressing Merge to having an rpm in master snapshot? Thanks and best regards, [1] https://gerrit.ovirt.org/110324 [2] https://resources.ovirt.org/pub/ovirt-master-snapshot/rpm/el8/ [3] https://resources.ovirt.org/repos/ovirt/tested/master/rpm/el8/ -- Didi

3 4

[JIRA] (OVIRT-2972) resources.ovirt.org ran out of space for artifact publishing
by Ehud Yonasi (oVirt JIRA) 20 Jul '20

20 Jul '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2972?page=com.atlassian.jira.… ] Ehud Yonasi commented on OVIRT-2972: ------------------------------------ I read that on Sunday the repo was not accessible. I think [~accountid:5b25ec3f8b08c009c48b25c9] did cleanup there and might add more info on what used a lot of storage. > resources.ovirt.org ran out of space for artifact publishing > ------------------------------------------------------------ > > Key: OVIRT-2972 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2972 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: infra > Attachments: image-20200720-083159.png > > > This weekend Nagios sent disk space alerts for the /home/jenkins on resources.ovirt.org > AFAIR this is used as intermediate artifact storage for publishing and shouldn't fill up that much. Logging a ticket to investigate the root cause. > The partition is free again now so this is not blocking anything right now. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100133)

1 0

[JIRA] (OVIRT-2972) resources.ovirt.org ran out of space for artifact publishing
by Evgheni Dereveanchin (oVirt JIRA) 20 Jul '20

20 Jul '20

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2972?page=com.atlassian.jira.… ] Evgheni Dereveanchin commented on OVIRT-2972: --------------------------------------------- !image-20200720-083159.png|width=597,height=215! Here’s the usage graph, looks like something happened on the night of 17th that caused files not to clean up, then repeated on the 18th and has been fixed during the 19th. [~accountid:5aa0f39f5a4d022884128a0f] [~accountid:5c977456c430371a3c67dbf6] did you get any reports on Sunday? May this be related to some nightly jobs? > resources.ovirt.org ran out of space for artifact publishing > ------------------------------------------------------------ > > Key: OVIRT-2972 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2972 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Evgheni Dereveanchin > Assignee: infra > Attachments: image-20200720-083159.png > > > This weekend Nagios sent disk space alerts for the /home/jenkins on resources.ovirt.org > AFAIR this is used as intermediate artifact storage for publishing and shouldn't fill up that much. Logging a ticket to investigate the root cause. > The partition is free again now so this is not blocking anything right now. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100133)

1 0

[JIRA] (OVIRT-2972) resources.ovirt.org ran out of space for artifact publishing
by Evgheni Dereveanchin (oVirt JIRA) 20 Jul '20

20 Jul '20

Evgheni Dereveanchin created OVIRT-2972: ------------------------------------------- Summary: resources.ovirt.org ran out of space for artifact publishing Key: OVIRT-2972 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2972 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Evgheni Dereveanchin Assignee: infra This weekend Nagios sent disk space alerts for the /home/jenkins on resources.ovirt.org AFAIR this is used as intermediate artifact storage for publishing and shouldn't fill up that much. Logging a ticket to investigate the root cause. The partition is free again now so this is not blocking anything right now. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100133)

1 0

[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly - Build # 204 - Failure!
by jenkins＠jenkins.phx.ovirt.org 20 Jul '20

20 Jul '20

Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/ Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly… Build Number: 204 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #204 [Marcin Sobczyk] ost_utils: Add ansible fixtures ----------------- Failed Tests: ----------------- No tests ran.

1 1