September 2016 - Infra - oVirt List Archives

oVirt infra daily report - unstable production jobs - 76
by jenkins＠jenkins.phx.ovirt.org 13 Sep '16

13 Sep '16

------=_Part_241_990179947.1473807609865 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/76//artifact/exported-ar… Cheers, Jenkins ------=_Part_241_990179947.1473807609865 Content-Type: application/octet-stream; name=upstream_report.html Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=upstream_report.html Content-ID: <upstream_report.html> <!DOCTYPE html><head><style type="text/css"> table.gridtable { border-collapse: collapse; table-layout:fixed; width:1600px; font-family: monospace; font-size:13px; } .head { font-size:20px; font-family: arial; } .sub { font-size:18px; background-color:#e5e5e5; font-family: arial; } pre { font-family: monospace; display: inline; white-space: pre-wrap; white-space: -moz-pre-wrap !important; white-space: -pre-wrap; white-space: -o-pre-wrap; word-wrap: break-word; } </style> </head> <body> <table class="gridtable" border=2> <tr><th colspan=2 class=head> RHEVM CI Jenkins Daily Report - 13/09/2016 </th></tr><tr><th colspan=2 class=sub> <font color="blue"><a href="http://jenkins.ovirt.org/">00 Unstable Jobs (Production)</a></font> </th></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/fabric-ovirt_master_check-merged-el7-x86_64/">fabric-ovirt_master_check-merged-el7-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/fabric-ovirt_master_check-merged-fc23-x86_64/">fabric-ovirt_master_check-merged-fc23-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-node-ng_master_build-artifacts-el7-x86_6…">ovirt-node-ng_master_build-artifacts-el7-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-node-ng_ovirt-3.6_build-artifacts-el7-x8…">ovirt-node-ng_ovirt-3.6_build-artifacts-el7-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-all-x86_6…">ovirt-release_master_build-artifacts-all-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/repos_master_check-closure_fc24_merged/">repos_master_check-closure_fc24_merged</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/vdsm_4.0_check-merged-fc23-x86_64/">vdsm_4.0_check-merged-fc23-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> ------=_Part_241_990179947.1473807609865--

1 0

[JIRA] (OVIRT-726) increase max number of concurrent builds
by eyal edri [Administrator] (oVirt JIRA) 13 Sep '16

13 Sep '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-726?page=com.atlassian.jira.p… ] eyal edri [Administrator] commented on OVIRT-726: ------------------------------------------------- feel free to update gradually and lets see how it goes. > increase max number of concurrent builds > ---------------------------------------- > > Key: OVIRT-726 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-726 > Project: oVirt - virtualization made easy > Issue Type: Task > Components: Jenkins > Reporter: Evgheni Dereveanchin > Assignee: infra > > I saw the build queue rise to ~200 tasks today due to these two jobs configured for running only 6 builds in parallel: > ovirt-engine_master_upgrade-from-4.0_el7_created > ovirt-engine_master_upgrade-from-master_el7_created > I bumped the default limit to 10 in https://gerrit.ovirt.org/61319/ but engine-upgrade job override this setting 6: > https://gerrit.ovirt.org/gitweb?p=jenkins.git;a=blob;f=jobs/confs/yaml/temp… > there's more places where various limits are set - I think we should review them and even remove if possible as the number of slaves is going to increase. > git grep max-total > jobs/confs/projects/defaults.yaml: max-total: 3 > jobs/confs/projects/defaults.yaml: max-total: 3 > jobs/confs/projects/ovirt/publish-rpms-nightly-3.6.yaml: max-total: 3 > jobs/confs/projects/ovirt/publish-rpms-nightly-4.0.yaml: max-total: 3 > jobs/confs/projects/ovirt/publish-rpms-nightly-master.yaml: max-total: 3 > jobs/confs/yaml/templates/engine-upgrade.yaml: max-total: 6 > jobs/confs/yaml/templates/find-bugs.yaml: max-total: 3 > jobs/confs/yaml/templates/install-rpm-sanity.yaml: max-total: 3 > jobs/confs/yaml/templates/ovirt-node-job-templates.yaml: max-total: 3 > jobs/confs/yaml/templates/standard-stage.yaml: max-total: 10 > jobs/confs/yaml/templates/standard-stage.yaml: max-total: 1 -- This message was sent by Atlassian JIRA (v1000.319.1#100012)

1 0

Jenkins build became unstable: ovirt_3.6_he-system-tests #422
by jenkins＠jenkins.phx.ovirt.org 13 Sep '16

13 Sep '16

See <http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/422/changes>

1 1

[JIRA] (OVIRT-729) Jenkins leaves behind connections in ESTABLISHED state
by Evgheni Dereveanchin (oVirt JIRA) 13 Sep '16

13 Sep '16

Evgheni Dereveanchin created OVIRT-729: ------------------------------------------ Summary: Jenkins leaves behind connections in ESTABLISHED state Key: OVIRT-729 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-729 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Evgheni Dereveanchin Assignee: infra Priority: Low Throughout the last days I noticed several times when a slave got non-responsive and after rebooting it never recovered until being removed/re-added to Jenkins. Further investigation on el7-vm06.phx.ovirt.org revealed that on Jenkins the connection is still marked as "ESTABLISHED" hours after the slave crashed and rebooted: {quote} tcp6 0 0 66.187.230.92:33374 66.187.230.77:22 ESTABLISHED 14625/java {quote} Due to this new SSH connections are not opened and Jenkins can't reconnect to the slave. I didn't see this behavior before, maybe it is related to the latest security upgrade of jenkins. -- This message was sent by Atlassian JIRA (v1000.319.1#100012)

1 0

[JIRA] (OVIRT-728) Jenkins data partition running out of space
by Evgheni Dereveanchin (oVirt JIRA) 13 Sep '16

13 Sep '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-728?page=com.atlassian.jira.p… ] Evgheni Dereveanchin reassigned OVIRT-728: ------------------------------------------ Assignee: Evgheni Dereveanchin (was: infra) > Jenkins data partition running out of space > ------------------------------------------- > > Key: OVIRT-728 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-728 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Evgheni Dereveanchin > Assignee: Evgheni Dereveanchin > Priority: High > Attachments: jenkins_disk_usage.png > > > jenkins.phx.ovirt.org has only 8% of free space left on /var/lib/data > Size Used Avail Use% Mounted on > 700G 638G 63G 92% /var/lib/data > We still have around 60G left but it's a bad idea to have less than 20% free space on a partition. Also, as job history was increased, disk space usage will continue to grow. The amount of data saved in a week is around 50G so we need to act fast -- This message was sent by Atlassian JIRA (v1000.319.1#100012)

1 0

[JIRA] (OVIRT-728) Jenkins data partition running out of space
by eyal edri [Administrator] (oVirt JIRA) 13 Sep '16

13 Sep '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-728?page=com.atlassian.jira.p… ] eyal edri [Administrator] commented on OVIRT-728: ------------------------------------------------- This might be due to increased history to 120 on all jobs, which is needed for debugging errors on jobs. Please extend the disk as needed, probably to 1TB for now and lets see how it goes. > Jenkins data partition running out of space > ------------------------------------------- > > Key: OVIRT-728 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-728 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Evgheni Dereveanchin > Assignee: infra > Priority: High > > jenkins.phx.ovirt.org has only 8% of free space left on /var/lib/data > Size Used Avail Use% Mounted on > 700G 638G 63G 92% /var/lib/data > We still have around 60G left but it's a bad idea to have less than 20% free space on a partition. Also, as job history was increased, disk space usage will continue to grow. The amount of data saved in a week is around 50G so we need to act fast -- This message was sent by Atlassian JIRA (v1000.319.1#100012)

1 0

[JIRA] (OVIRT-728) Jenkins data partition running out of space
by Evgheni Dereveanchin (oVirt JIRA) 13 Sep '16

13 Sep '16

Evgheni Dereveanchin created OVIRT-728: ------------------------------------------ Summary: Jenkins data partition running out of space Key: OVIRT-728 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-728 Project: oVirt - virtualization made easy Issue Type: Task Reporter: Evgheni Dereveanchin Assignee: infra Priority: High jenkins.phx.ovirt.org has only 8% of free space left on /var/lib/data Size Used Avail Use% Mounted on 700G 638G 63G 92% /var/lib/data We still have around 60G left but it's a bad idea to have less than 20% free space on a partition. Also, as job history was increased, disk space usage will continue to grow. The amount of data saved in a week is around 50G so we need to act fast -- This message was sent by Atlassian JIRA (v1000.319.1#100012)

1 0

oVirt infra daily report - unstable production jobs - 75
by jenkins＠jenkins.phx.ovirt.org 12 Sep '16

12 Sep '16

------=_Part_237_219893073.1473721208999 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/75//artifact/exported-ar… Cheers, Jenkins ------=_Part_237_219893073.1473721208999 Content-Type: application/octet-stream; name=upstream_report.html Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=upstream_report.html Content-ID: <upstream_report.html> <!DOCTYPE html><head><style type="text/css"> table.gridtable { border-collapse: collapse; table-layout:fixed; width:1600px; font-family: monospace; font-size:13px; } .head { font-size:20px; font-family: arial; } .sub { font-size:18px; background-color:#e5e5e5; font-family: arial; } pre { font-family: monospace; display: inline; white-space: pre-wrap; white-space: -moz-pre-wrap !important; white-space: -pre-wrap; white-space: -o-pre-wrap; word-wrap: break-word; } </style> </head> <body> <table class="gridtable" border=2> <tr><th colspan=2 class=head> RHEVM CI Jenkins Daily Report - 12/09/2016 </th></tr><tr><th colspan=2 class=sub> <font color="blue"><a href="http://jenkins.ovirt.org/">00 Unstable Jobs (Production)</a></font> </th></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/fabric-ovirt_master_check-merged-el7-x86_64/">fabric-ovirt_master_check-merged-el7-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/fabric-ovirt_master_check-merged-fc23-x86_64/">fabric-ovirt_master_check-merged-fc23-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-node-ng_master_build-artifacts-el7-x86_6…">ovirt-node-ng_master_build-artifacts-el7-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-node-ng_ovirt-3.6_build-artifacts-el7-x8…">ovirt-node-ng_ovirt-3.6_build-artifacts-el7-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-node-ng_ovirt-4.0-snapshot_build-artifac…">ovirt-node-ng_ovirt-4.0-snapshot_build-artifacts-el7-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-all-x86_6…">ovirt-release_master_build-artifacts-all-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/repos_master_check-closure_fc24_merged/">repos_master_check-closure_fc24_merged</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/vdsm_4.0_check-merged-fc23-x86_64/">vdsm_4.0_check-merged-fc23-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> ------=_Part_237_219893073.1473721208999--

1 0

[JIRA] (OVIRT-727) test-repo_ovirt_experimental_4.0 job stuck for 3 days
by Evgheni Dereveanchin (oVirt JIRA) 12 Sep '16

12 Sep '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-727?page=com.atlassian.jira.p… ] Evgheni Dereveanchin reassigned OVIRT-727: ------------------------------------------ Assignee: Evgheni Dereveanchin (was: infra) > test-repo_ovirt_experimental_4.0 job stuck for 3 days > ----------------------------------------------------- > > Key: OVIRT-727 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-727 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: Jenkins > Reporter: Evgheni Dereveanchin > Assignee: Evgheni Dereveanchin > > This build is stuck for several days already: > http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_4.0/1266/ > I tried to stop it from Jenkins but that doesn't seem to help. -- This message was sent by Atlassian JIRA (v1000.319.1#100012)

1 0

[JIRA] (OVIRT-727) test-repo_ovirt_experimental_4.0 job stuck for 3 days
by eyal edri [Administrator] (oVirt JIRA) 12 Sep '16

12 Sep '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-727?page=com.atlassian.jira.p… ] eyal edri [Administrator] commented on OVIRT-727: ------------------------------------------------- There is a link inside the job console which will let you abandon the patch On Sep 12, 2016 12:01 PM, "Evgheni Dereveanchin (oVirt JIRA)" < > test-repo_ovirt_experimental_4.0 job stuck for 3 days > ----------------------------------------------------- > > Key: OVIRT-727 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-727 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: Jenkins > Reporter: Evgheni Dereveanchin > Assignee: infra > > This build is stuck for several days already: > http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_4.0/1266/ > I tried to stop it from Jenkins but that doesn't seem to help. -- This message was sent by Atlassian JIRA (v1000.319.1#100012)

1 0