July 2017 - Infra - oVirt List Archives

[JIRA] (OVIRT-1551) Add slaves to staging Jenkins instance
by Barak Korren (oVirt JIRA) 25 Jul '17

25 Jul '17

[ https://ovirt-jira.atlassian.net/browse/OVIRT-1551?page=com.atlassian.jira.… ] Barak Korren updated OVIRT-1551: -------------------------------- Epic Link: OVIRT-403 > Add slaves to staging Jenkins instance > -------------------------------------- > > Key: OVIRT-1551 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1551 > Project: oVirt - virtualization made easy > Issue Type: New Feature > Components: oVirt Infra > Reporter: Barak Korren > Assignee: infra > Labels: jenkins, slaves > > We currently have just one slave attached to the staging Jenkins instance. > We need some more, at least one of each slave platform we support so that we can: > # Test jobs running in paralllel > # Test jobs running on different slave platforms. -- This message was sent by Atlassian JIRA (v1000.1139.0#100055)

1 0

[JIRA] (OVIRT-1551) Add slaves to staging Jenkins instance
by Barak Korren (oVirt JIRA) 25 Jul '17

25 Jul '17

Barak Korren created OVIRT-1551: ----------------------------------- Summary: Add slaves to staging Jenkins instance Key: OVIRT-1551 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1551 Project: oVirt - virtualization made easy Issue Type: New Feature Components: oVirt Infra Reporter: Barak Korren Assignee: infra We currently have just one slave attached to the staging Jenkins instance. We need some more, at least one of each slave platform we support so that we can: # Test jobs running in paralllel # Test jobs running on different slave platforms. -- This message was sent by Atlassian JIRA (v1000.1139.0#100055)

1 0

Jenkins error: java.io.FileNotFoundException: ... (Too many open files)
by Nir Soffer 25 Jul '17

25 Jul '17

Jenkins needs restart? Building remotely on ovirt-srv21.phx.ovirt.org <http://jenkins.ovirt.org/computer/ovirt-srv21.phx.ovirt.org> (fc24 phx integ-tests physical) in workspace /home/jenkins/workspace/ovirt-system-tests_manual java.io.FileNotFoundException: /var/lib/data/jenkins/jobs/ovirt-system-tests_manual/builds/856/changelog.xml (Too many open files) at java.io.FileOutputStream.open0(Native Method) at java.io.FileOutputStream.open(FileOutputStream.java:270) at java.io.FileOutputStream.<init>(FileOutputStream.java:213) at java.io.FileOutputStream.<init>(FileOutputStream.java:162) at org.jenkinsci.plugins.multiplescms.MultiSCM.checkout(MultiSCM.java:119) at hudson.scm.SCM.checkout(SCM.java:495) at hudson.model.AbstractProject.checkout(AbstractProject.java:1276) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:560) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:485) at hudson.model.Run.execute(Run.java:1735) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:97) at hudson.model.Executor.run(Executor.java:405) ERROR: Step ?Post build task? aborted due to exception:

2 2

[JIRA] (OVIRT-1550) Configure and monitor nofiles on Jenkins
by Barak Korren (oVirt JIRA) 25 Jul '17

25 Jul '17

Barak Korren created OVIRT-1550: ----------------------------------- Summary: Configure and monitor nofiles on Jenkins Key: OVIRT-1550 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1550 Project: oVirt - virtualization made easy Issue Type: Improvement Components: oVirt CI Reporter: Barak Korren Assignee: infra Priority: High We had an issue today (Jul 25th, 2017) of Jenkins running out of file descriptors. Things already reached the point where Jenkins was barely functioning so to get things back to working order I've: * Manually added a line in '{{/etc/security/limits.conf}}' to set 'nofiles' to 16384 for the 'jenkins' user (Previously it was just not configured and seems to have defaulted to 4096). * Restarted the 'jenkins' service. We now need to: * Place this configuration in Puppet/Ansible. * Add monitoring so we'll know in advance the next time Jenkins goes near to the nofiles limit. -- This message was sent by Atlassian JIRA (v1000.1139.0#100055)

1 0

[JIRA] (OVIRT-1550) Configure and monitor nofiles on Jenkins
by Barak Korren (oVirt JIRA) 25 Jul '17

25 Jul '17

[ https://ovirt-jira.atlassian.net/browse/OVIRT-1550?page=com.atlassian.jira.… ] Barak Korren updated OVIRT-1550: -------------------------------- Epic Link: OVIRT-403 > Configure and monitor nofiles on Jenkins > ---------------------------------------- > > Key: OVIRT-1550 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1550 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Components: oVirt CI > Reporter: Barak Korren > Assignee: infra > Priority: High > Labels: infra, jenkins > > We had an issue today (Jul 25th, 2017) of Jenkins running out of file descriptors. > Things already reached the point where Jenkins was barely functioning so to get things back to working order I've: > * Manually added a line in '{{/etc/security/limits.conf}}' to set 'nofiles' to 16384 for the 'jenkins' user (Previously it was just not configured and seems to have defaulted to 4096). > * Restarted the 'jenkins' service. > We now need to: > * Place this configuration in Puppet/Ansible. > * Add monitoring so we'll know in advance the next time Jenkins goes near to the nofiles limit. -- This message was sent by Atlassian JIRA (v1000.1139.0#100055)

1 0

Jenkins was restarted
by Barak Korren 25 Jul '17

25 Jul '17

Jenkins ran out of file descriptors so we had to restart it to bump the number. Jobs should be running jobs already but the UI will probably take 30-40 minutes to become available. Issues seem to have started around 15:00 UTC yesterday (18:00 IST) so you may need to re-trigger jobs for patches submitted since then. -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted

1 0

[JIRA] (OVIRT-1198) Job times out on: 'Removing the used loop devices' on the initial clean up stage
by ngoldin＠redhat.com (oVirt JIRA) 24 Jul '17

24 Jul '17

[ https://ovirt-jira.atlassian.net/browse/OVIRT-1198?page=com.atlassian.jira.… ] ngoldin(a)redhat.com updated OVIRT-1198: -------------------------------------- Resolution: Cannot Reproduce Status: Done (was: To Do) Nope, closing for now. > Job times out on: 'Removing the used loop devices' on the initial clean up stage > -------------------------------------------------------------------------------- > > Key: OVIRT-1198 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1198 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: ngoldin(a)redhat.com > Assignee: infra > > 15:44:38 Making sure there are no device mappings... > 15:44:38 Removing the used loop devices... > 21:44:37 Build timed out (after 360 minutes). Marking the build as failed. > 21:44:37 Build was aborted > (Notice the 6 hours between). > http://jenkins.ovirt.org/job/jenkins_master_check-patch-fc25-x86_64/710/con… > I think I saw another one earlier this week, also on fc25. -- This message was sent by Atlassian JIRA (v1000.1131.0#100055)

1 0

[oVirt Jenkins] test-repo_ovirt_experimental_master - Build #7666 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 24 Jul '17

24 Jul '17

------=_Part_290_1385421467.1500915956626 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Build: http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/7666/, Build Number: 7666, Build Status: FAILURE ------=_Part_290_1385421467.1500915956626--

1 1

[CQ]: 79655, 6 (ovirt-log-collector) failed "ovirt-master" system tests
by oVirt Jenkins 24 Jul '17

24 Jul '17

Change 79655,6 (ovirt-log-collector) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/79655/6 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/1486/

1 0

[oVirt Jenkins] standard-enqueue - Build #2954 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 24 Jul '17

24 Jul '17

------=_Part_288_601321151.1500915102131 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Build: http://jenkins.ovirt.org/job/standard-enqueue/2954/ Build Name: 2954 ovirt-log-collector (4.1) Build Status: FAILURE Gerrit change: https://gerrit.ovirt.org/79771 - title: inventory: Add MAC Pools section - project: ovirt-log-collector - branch: ovirt-log-collector-4.1 - author: Douglas Schilling Landgraf <dougsland(a)redhat.com> ------=_Part_288_601321151.1500915102131--

1 0