- Infra - oVirt List Archives

[JIRA] (OVIRT-1190) Migrate some SAT6 VMs from Amazon to PHX production DC
by eyal edri [Administrator] (oVirt JIRA) 23 Feb '17

23 Feb '17

eyal edri [Administrator] created OVIRT-1190: ------------------------------------------------ Summary: Migrate some SAT6 VMs from Amazon to PHX production DC Key: OVIRT-1190 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1190 Project: oVirt - virtualization made easy Issue Type: Improvement Reporter: eyal edri [Administrator] Assignee: infra Opening a ticket to start tracking the info for this effort. Initial info on the instances in Amazon: 3 m1 larges (8 GB RAM, 2 VCPU, 800.0 GB DISK) 1 m4 large (8 GB RAM, 2 VCPU, 400 GB DISK) -- This message was sent by Atlassian JIRA (v1000.773.3#100032)

1 0

[JIRA] (OVIRT-1190) Migrate some SAT6 VMs from Amazon to PHX production DC
by eyal edri [Administrator] (oVirt JIRA) 23 Feb '17

23 Feb '17

[ https://ovirt-jira.atlassian.net/browse/OVIRT-1190?page=com.atlassian.jira.… ] eyal edri [Administrator] updated OVIRT-1190: --------------------------------------------- Epic Link: OVIRT-399 > Migrate some SAT6 VMs from Amazon to PHX production DC > ------------------------------------------------------ > > Key: OVIRT-1190 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1190 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: eyal edri [Administrator] > Assignee: infra > > Opening a ticket to start tracking the info for this effort. > Initial info on the instances in Amazon: > 3 m1 larges (8 GB RAM, 2 VCPU, 800.0 GB DISK) > 1 m4 large (8 GB RAM, 2 VCPU, 400 GB DISK) -- This message was sent by Atlassian JIRA (v1000.773.3#100032)

1 0

[JIRA] (OVIRT-1189) Increase experimental lock timeout to 15m
by Barak Korren (oVirt JIRA) 23 Feb '17

23 Feb '17

[ https://ovirt-jira.atlassian.net/browse/OVIRT-1189?page=com.atlassian.jira.… ] Barak Korren updated OVIRT-1189: -------------------------------- Assignee: Barak Korren (was: infra) Status: In Progress (was: To Do) > Increase experimental lock timeout to 15m > ----------------------------------------- > > Key: OVIRT-1189 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1189 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Components: Repositories Mgmt > Reporter: Barak Korren > Assignee: Barak Korren > Priority: Highest > > We're still seeing weekly failures on lock timeouts, test try increasing the timeout to see if it makes the failures rare enough. -- This message was sent by Atlassian JIRA (v1000.773.3#100032)

1 0

[JIRA] (OVIRT-1189) Increase experimental lock timeout to 15m
by Barak Korren (oVirt JIRA) 23 Feb '17

23 Feb '17

[ https://ovirt-jira.atlassian.net/browse/OVIRT-1189?page=com.atlassian.jira.… ] Barak Korren updated OVIRT-1189: -------------------------------- Epic Link: OVIRT-400 > Increase experimental lock timeout to 15m > ----------------------------------------- > > Key: OVIRT-1189 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1189 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Components: Repositories Mgmt > Reporter: Barak Korren > Assignee: infra > Priority: Highest > > We're still seeing weekly failures on lock timeouts, test try increasing the timeout to see if it makes the failures rare enough. -- This message was sent by Atlassian JIRA (v1000.773.3#100032)

1 0

[JIRA] (OVIRT-1189) Increase experimental lock timeout to 15m
by Barak Korren (oVirt JIRA) 23 Feb '17

23 Feb '17

Barak Korren created OVIRT-1189: ----------------------------------- Summary: Increase experimental lock timeout to 15m Key: OVIRT-1189 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1189 Project: oVirt - virtualization made easy Issue Type: Improvement Components: Repositories Mgmt Reporter: Barak Korren Assignee: infra Priority: Highest We're still seeing weekly failures on lock timeouts, test try increasing the timeout to see if it makes the failures rare enough. -- This message was sent by Atlassian JIRA (v1000.773.3#100032)

1 0

[JIRA] (OVIRT-1188) Require Signed-off-by in commit message: not working
by sbonazzo (oVirt JIRA) 22 Feb '17

22 Feb '17

sbonazzo created OVIRT-1188: ------------------------------- Summary: Require Signed-off-by in commit message: not working Key: OVIRT-1188 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1188 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: sbonazzo Assignee: infra Despite Require Signed-off-by in commit message: is set to TRUE for https://gerrit.ovirt.org/#/admin/projects/ovirt-release it doesn't fail pushing patches without it. See as example: https://gerrit.ovirt.org/#/c/72942/1 -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com -- This message was sent by Atlassian JIRA (v1000.773.3#100032)

1 0

Build failed in Jenkins: deploy-to-ovirt_experimental_4.1 #2285
by jenkins＠jenkins.phx.ovirt.org 22 Feb '17

22 Feb '17

See <http://jenkins.ovirt.org/job/deploy-to-ovirt_experimental_4.1/2285/display/…> ------------------------------------------ [...truncated 3.78 KB...] + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + sleep 5 + (( i++ )) + (( i < 120 )) + echo 'Timed out waiting for lock' Timed out waiting for lock + exit 1 Build step 'Execute shell' marked build as failure [ssh-agent] Stopped.

1 1

oVirt infra daily report - unstable production jobs - 239
by jenkins＠jenkins.phx.ovirt.org 22 Feb '17

22 Feb '17

------=_Part_313_715580882.1487804410157 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/239//artifact/exported-a… Cheers, Jenkins ------=_Part_313_715580882.1487804410157 Content-Type: text/html; charset=us-ascii; name=upstream_report.html Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=upstream_report.html Content-ID: <upstream_report.html> <!DOCTYPE html><head><style type="text/css"> table.gridtable { border-collapse: collapse; table-layout:fixed; width:1600px; font-family: monospace; font-size:13px; } .head { font-size:20px; font-family: arial; } .sub { font-size:18px; background-color:#e5e5e5; font-family: arial; } pre { font-family: monospace; display: inline; white-space: pre-wrap; white-space: -moz-pre-wrap !important; white-space: -pre-wrap; white-space: -o-pre-wrap; word-wrap: break-word; } </style> </head> <body> <table class="gridtable" border=2> <tr><th colspan=2 class=head> RHEVM CI Jenkins Daily Report - 22/02/2017 </th></tr><tr><th colspan=2 class=sub> <font color="blue"><a href="http://jenkins.ovirt.org/">00 Unstable Critical</a></font> </th></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-live_master_experimental_create-iso-el7-…">ovirt-live_master_experimental_create-iso-el7-x86_64</a> </td><td> <h3>This job generates a nightly iso of ovirt-live using experimental repos</h3> </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-node-ng_ovirt-master-experimental_build-…">ovirt-node-ng_ovirt-master-experimental_build-artifacts-el7-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x86_…">ovirt-system-tests_master_check-patch-el7-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/">ovirt_3.6_he-system-tests</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt_4.1_hc-system-tests/">ovirt_4.1_hc-system-tests</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt_master_hc-system-tests/">ovirt_master_hc-system-tests</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt_master_image-ng-system-tests/">ovirt_master_image-ng-system-tests</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/repos_4.1_check-closure_el7_merged/">repos_4.1_check-closure_el7_merged</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/repos_4.1_check-closure_fc24_merged/">repos_4.1_check-closure_fc24_merged</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/repos_master_check-closure_el7_merged/">repos_master_check-closure_el7_merged</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/repos_master_check-closure_fc24_merged/">repos_master_check-closure_fc24_merged</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/">test-repo_ovirt_experimental_master</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> ------=_Part_313_715580882.1487804410157--

1 0

Build failed in Jenkins: deploy-to-ovirt_experimental_master #12582
by jenkins＠jenkins.phx.ovirt.org 22 Feb '17

22 Feb '17

See <http://jenkins.ovirt.org/job/deploy-to-ovirt_experimental_master/12582/disp…> ------------------------------------------ [...truncated 4.88 KB...] extra_symlinks = [store.IsoStore] signing_passphrase = ask signing_key = temp_dir = generate path_prefix = iso [filter.OnlyMissingFilter] [filter.LatestFilter] [filter.NameFilter] [source.JenkinsSource] jenkins_host_re = jenkins\.ovirt\.org [source.CoprURLSource] copr_host_re = copr\.fedorainfracloud\.org [source.KojiBuildSource] koji_extra_opts = krbservice=host koji_topurl = https://kojipkgs.fedoraproject.org/ koji_server = https://koji.fedoraproject.org/kojihub koji_skip_unavailable = true [source.URLSource] [source.KojiURLSource] koji_host_re = koji\.fedoraproject\.org [source.DirSource] allowed_dir_paths = ### Config [main] allowed_repo_paths = /srv/resources/repos/ovirt/experimental temp_dir = /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpMvtJb0 stores = RPMStore,IsoStore 2017-02-22 20:03:51,330::INFO::repoman.common.repo.add_source:169::Adding repo extra dir ovirt-engine_fc24_2538 2017-02-22 20:03:51,330::DEBUG::repoman.common.repo.rebase:264::Rebasing repo /srv/resources/repos/ovirt/experimental/master to /srv/resources/repos/ovirt/experimental/master/ovirt-engine_fc24_2538 2017-02-22 20:03:51,330::DEBUG::repoman.common.repo.__init__:71::### Defaults: [main] allowed_repo_paths = temp_dir = generate singing_key = signing_passphrase = ask stores = all filters = all sources = all verify_ssl = true on_empty_source = fail [store.RPMStore] distro_reg = \.(fc|el)\d+(?=\w*) with_srcrpms = true signing_passphrase = ask on_wrong_distro = fail path_prefix = rpm,src rpm_dir = rpm temp_dir = generate with_sources = false signing_key = extra_symlinks = [store.IsoStore] signing_passphrase = ask signing_key = temp_dir = generate path_prefix = iso [filter.OnlyMissingFilter] [filter.LatestFilter] [filter.NameFilter] [source.JenkinsSource] jenkins_host_re = jenkins\.ovirt\.org [source.CoprURLSource] copr_host_re = copr\.fedorainfracloud\.org [source.KojiBuildSource] koji_extra_opts = krbservice=host koji_topurl = https://kojipkgs.fedoraproject.org/ koji_server = https://koji.fedoraproject.org/kojihub koji_skip_unavailable = true [source.URLSource] [source.KojiURLSource] koji_host_re = koji\.fedoraproject\.org [source.DirSource] allowed_dir_paths = ### Config [main] allowed_repo_paths = /srv/resources/repos/ovirt/experimental temp_dir = /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpMvtJb0/tmpw11WkS stores = RPMStore,IsoStore 2017-02-22 20:03:51,333::DEBUG::repoman.common.repo.load:103::Loading repo /srv/resources/repos/ovirt/experimental/master/ovirt-engine_fc24_2538 2017-02-22 20:03:51,335::INFO::repoman.common.stores.RPM.__init__:164::Loading repo /srv/resources/repos/ovirt/experimental/master/ovirt-engine_fc24_2538 2017-02-22 20:03:51,335::INFO::repoman.common.stores.RPM.__init__:171::Repo /srv/resources/repos/ovirt/experimental/master/ovirt-engine_fc24_2538 loaded 2017-02-22 20:03:51,338::INFO::repoman.common.stores.iso.__init__:138::Loading repo /srv/resources/repos/ovirt/experimental/master/ovirt-engine_fc24_2538 2017-02-22 20:03:51,338::INFO::repoman.common.stores.iso.__init__:145::Repo /srv/resources/repos/ovirt/experimental/master/ovirt-engine_fc24_2538 loaded 2017-02-22 20:03:51,353::INFO::repoman.common.repo.add_source:174::Resolving artifact source http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,354::DEBUG::repoman.common.parser.parse:73::Checking source JenkinsSource with http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,354::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… is an iso 2017-02-22 20:03:51,355::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,416::INFO::requests.packages.urllib3.connectionpool._new_conn:203::Starting new HTTP connection (1): jenkins.ovirt.org 2017-02-22 20:03:51,519::DEBUG::requests.packages.urllib3.connectionpool._make_request:383::"GET /job/ovirt-engine_master_build-artifacts-fc24-x86_64/2538//api/json?depth=3 HTTP/1.1" 200 9425 2017-02-22 20:03:51,531::INFO::repoman.common.sources.jenkins.expand:93::Parsing jenkins URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,532::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if exported-artifacts/mock_logs/mocker-fedora-24-x86_64.fc24.build-artifacts.sh/build-artifacts.sh.log is an iso 2017-02-22 20:03:51,532::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,532::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if exported-artifacts/mock_logs/mocker-fedora-24-x86_64.fc24.clean_rpmdb/stdout_stderr.log is an iso 2017-02-22 20:03:51,533::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,533::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if exported-artifacts/mock_logs/mocker-fedora-24-x86_64.fc24.init/build.log is an iso 2017-02-22 20:03:51,533::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,533::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if exported-artifacts/mock_logs/mocker-fedora-24-x86_64.fc24.init/root.log is an iso 2017-02-22 20:03:51,534::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,534::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if exported-artifacts/mock_logs/mocker-fedora-24-x86_64.fc24.init/state.log is an iso 2017-02-22 20:03:51,534::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,534::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if exported-artifacts/mock_logs/mocker-fedora-24-x86_64.fc24.init/stdout_stderr.log is an iso 2017-02-22 20:03:51,535::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,535::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,535::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,536::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if exported-artifacts/ovirt-engine-4.2.0_master.tar.gz is an iso 2017-02-22 20:03:51,536::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,536::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,536::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,537::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,537::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,537::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,538::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,538::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,538::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,539::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,539::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,539::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,540::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,540::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,540::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,540::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,541::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,541::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,541::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,542::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,542::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,543::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,543::INFO::repoman.common.sources.jenkins.expand:108:: Got URL: http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… 2017-02-22 20:03:51,543::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if exported-artifacts/repodata/0060a12086717773c3ebf7de63a01742dd3ae713cab7d0e1cf107aa10aea8260-other.sqlite.bz2 is an iso 2017-02-22 20:03:51,544::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,544::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if exported-artifacts/repodata/426e4f0ef8095d8d50660d880e96feb4f2663545bbb1b66644fefe299abd56fc-filelists.xml.gz is an iso 2017-02-22 20:03:51,544::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,544::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if exported-artifacts/repodata/630c0eca7c47f6d029f93cdcafd6329e9476c8693d06069b933e1dc4fdd057f3-filelists.sqlite.bz2 is an iso 2017-02-22 20:03:51,545::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,545::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if exported-artifacts/repodata/6539bfd2d0985f143ba785bccddf174ce075d27c63ad0f36544d67c0ce9fdd7f-primary.xml.gz is an iso 2017-02-22 20:03:51,545::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,545::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if exported-artifacts/repodata/81383a9e9f7419b75f81e7023da5e65bb8396cdef360ff57c91e668012800945-primary.sqlite.bz2 is an iso 2017-02-22 20:03:51,546::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,546::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if exported-artifacts/repodata/aa9ed1fdeeb72e3235dacdf7e0e6c043282d2efdc38c0e6988b79d0b75821147-other.xml.gz is an iso 2017-02-22 20:03:51,546::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,546::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if exported-artifacts/repodata/repomd.xml is an iso 2017-02-22 20:03:51,547::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,547::INFO::root.expand:111:: Done 2017-02-22 20:03:51,547::DEBUG::root.parse:115::From source string http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… got: [u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…', u'http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…'] 2017-02-22 20:03:51,550::INFO::requests.packages.urllib3.connectionpool._new_conn:203::Starting new HTTP connection (1): jenkins.ovirt.org 2017-02-22 20:03:51,617::DEBUG::requests.packages.urllib3.connectionpool._make_request:383::"HEAD /job/ovirt-engine_master_build-artifacts-fc24-x86_64/2538//artifact/exported-artifacts/ovirt-engine-4.2.0-0.0.master.20170222195430.gitb439665.fc24.noarch.rpm HTTP/1.1" 200 0 2017-02-22 20:03:51,619::INFO::root.download:221::Downloading http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…, length 2M ... 2017-02-22 20:03:51,621::INFO::requests.packages.urllib3.connectionpool._new_conn:203::Starting new HTTP connection (1): jenkins.ovirt.org 2017-02-22 20:03:51,661::DEBUG::requests.packages.urllib3.connectionpool._make_request:383::"GET /job/ovirt-engine_master_build-artifacts-fc24-x86_64/2538//artifact/exported-artifacts/ovirt-engine-4.2.0-0.0.master.20170222195430.gitb439665.fc24.noarch.rpm HTTP/1.1" 200 2229622 %[-----------------------25------------------------50-----------------------75------------------------] %[====================================================================================================] 2017-02-22 20:03:51,721::INFO::repoman.common.stores.RPM.add_rpm:248::Adding package /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpMvtJb0/tmpw11WkS/tmpv6y0Ky/ovirt-engine-4.2.0-0.0.master.20170222195430.gitb439665.fc24.noarch.rpm to repo /srv/resources/repos/ovirt/experimental/master/ovirt-engine_fc24_2538 2017-02-22 20:03:51,722::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… is an iso 2017-02-22 20:03:51,722::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:51,725::INFO::requests.packages.urllib3.connectionpool._new_conn:203::Starting new HTTP connection (1): jenkins.ovirt.org 2017-02-22 20:03:51,748::DEBUG::requests.packages.urllib3.connectionpool._make_request:383::"HEAD /job/ovirt-engine_master_build-artifacts-fc24-x86_64/2538//artifact/exported-artifacts/ovirt-engine-4.2.0-0.0.master.20170222195430.gitb439665.fc24.src.rpm HTTP/1.1" 200 0 2017-02-22 20:03:51,750::INFO::root.download:221::Downloading http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…, length 9M ... 2017-02-22 20:03:51,752::INFO::requests.packages.urllib3.connectionpool._new_conn:203::Starting new HTTP connection (1): jenkins.ovirt.org 2017-02-22 20:03:51,816::DEBUG::requests.packages.urllib3.connectionpool._make_request:383::"GET /job/ovirt-engine_master_build-artifacts-fc24-x86_64/2538//artifact/exported-artifacts/ovirt-engine-4.2.0-0.0.master.20170222195430.gitb439665.fc24.src.rpm HTTP/1.1" 200 9951283 %[-----------------------25------------------------50-----------------------75------------------------] %[====================================================================================================] 2017-02-22 20:03:52,060::INFO::repoman.common.stores.RPM.add_rpm:248::Adding package /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpMvtJb0/tmpw11WkS/tmpv6y0Ky/ovirt-engine-4.2.0-0.0.master.20170222195430.gitb439665.fc24.src.rpm to repo /srv/resources/repos/ovirt/experimental/master/ovirt-engine_fc24_2538 2017-02-22 20:03:52,060::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… is an iso 2017-02-22 20:03:52,061::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:52,064::INFO::requests.packages.urllib3.connectionpool._new_conn:203::Starting new HTTP connection (1): jenkins.ovirt.org 2017-02-22 20:03:52,084::DEBUG::requests.packages.urllib3.connectionpool._make_request:383::"HEAD /job/ovirt-engine_master_build-artifacts-fc24-x86_64/2538//artifact/exported-artifacts/ovirt-engine-backend-4.2.0-0.0.master.20170222195430.gitb439665.fc24.noarch.rpm HTTP/1.1" 200 0 2017-02-22 20:03:52,085::INFO::root.download:221::Downloading http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…, length 10M ... 2017-02-22 20:03:52,087::INFO::requests.packages.urllib3.connectionpool._new_conn:203::Starting new HTTP connection (1): jenkins.ovirt.org 2017-02-22 20:03:52,150::DEBUG::requests.packages.urllib3.connectionpool._make_request:383::"GET /job/ovirt-engine_master_build-artifacts-fc24-x86_64/2538//artifact/exported-artifacts/ovirt-engine-backend-4.2.0-0.0.master.20170222195430.gitb439665.fc24.noarch.rpm HTTP/1.1" 200 11143014 %[-----------------------25------------------------50-----------------------75------------------------] %[====================================================================================================] 2017-02-22 20:03:52,365::INFO::repoman.common.stores.RPM.add_rpm:248::Adding package /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpMvtJb0/tmpw11WkS/tmpv6y0Ky/ovirt-engine-backend-4.2.0-0.0.master.20170222195430.gitb439665.fc24.noarch.rpm to repo /srv/resources/repos/ovirt/experimental/master/ovirt-engine_fc24_2538 2017-02-22 20:03:52,365::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… is an iso 2017-02-22 20:03:52,365::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:52,368::INFO::requests.packages.urllib3.connectionpool._new_conn:203::Starting new HTTP connection (1): jenkins.ovirt.org 2017-02-22 20:03:52,432::DEBUG::requests.packages.urllib3.connectionpool._make_request:383::"HEAD /job/ovirt-engine_master_build-artifacts-fc24-x86_64/2538//artifact/exported-artifacts/ovirt-engine-dbscripts-4.2.0-0.0.master.20170222195430.gitb439665.fc24.noarch.rpm HTTP/1.1" 200 0 2017-02-22 20:03:52,434::INFO::root.download:221::Downloading http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6…, length 266K ... 2017-02-22 20:03:52,436::INFO::requests.packages.urllib3.connectionpool._new_conn:203::Starting new HTTP connection (1): jenkins.ovirt.org 2017-02-22 20:03:52,452::DEBUG::requests.packages.urllib3.connectionpool._make_request:383::"GET /job/ovirt-engine_master_build-artifacts-fc24-x86_64/2538//artifact/exported-artifacts/ovirt-engine-dbscripts-4.2.0-0.0.master.20170222195430.gitb439665.fc24.noarch.rpm HTTP/1.1" 200 273130 %[-----------------------25------------------------50-----------------------75------------------------] %[====================================================================================================] 2017-02-22 20:03:52,462::INFO::repoman.common.stores.RPM.add_rpm:248::Adding package /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpMvtJb0/tmpw11WkS/tmpv6y0Ky/ovirt-engine-dbscripts-4.2.0-0.0.master.20170222195430.gitb439665.fc24.noarch.rpm to repo /srv/resources/repos/ovirt/experimental/master/ovirt-engine_fc24_2538 2017-02-22 20:03:52,462::DEBUG::repoman.common.stores.iso.handles_artifact:152::Checking if http://jenkins.ovirt.org/job/ovirt-engine_master_build-artifacts-fc24-x86_6… is an iso 2017-02-22 20:03:52,462::DEBUG::repoman.common.stores.iso.handles_artifact:158:: It is not 2017-02-22 20:03:52,464::INFO::requests.packages.urllib3.connectionpool._new_conn:203::Starting new HTTP connection (1): jenkins.ovirt.org Traceback (most recent call last): File "/usr/bin/repoman", line 10, in <module> sys.exit(main()) File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 455, in main exit_code = do_add(args, config, repo) File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 338, in do_add repo.add_source(art_src.strip()) File "/usr/lib/python2.7/site-packages/repoman/common/repo.py", line 153, in add_source self.parse_source_stream(sys.stdin.readlines()) File "/usr/lib/python2.7/site-packages/repoman/common/repo.py", line 193, in parse_source_stream self.add_source(line.strip()) File "/usr/lib/python2.7/site-packages/repoman/common/repo.py", line 179, in add_source store.add_artifact(artifact_path) File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py", line 192, in add_artifact self.add_rpm(pkg, **args) File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py", line 213, in add_rpm verify_ssl=self.config.getboolean('verify_ssl'), File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/RPM.py", line 100, in __init__ download(path, fpath, verify=verify_ssl) File "/usr/lib/python2.7/site-packages/repoman/common/utils.py", line 215, in download headers = requests.head(path, verify=verify) File "/usr/lib/python2.7/site-packages/requests/api.py", line 94, in head return request('head', url, **kwargs) File "/usr/lib/python2.7/site-packages/requests/api.py", line 50, in request response = session.request(method=method, url=url, **kwargs) File "/usr/lib/python2.7/site-packages/requests/sessions.py", line 464, in request resp = self.send(prep, **send_kwargs) File "/usr/lib/python2.7/site-packages/requests/sessions.py", line 576, in send r = adapter.send(request, **kwargs) File "/usr/lib/python2.7/site-packages/requests/adapters.py", line 415, in send raise ConnectionError(err, request=request) requests.exceptions.ConnectionError: ('Connection aborted.', gaierror(-2, 'Name or service not known')) 2017-02-22 20:03:52,686::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpMvtJb0/tmpw11WkS/tmpv6y0Ky 2017-02-22 20:03:52,686::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpMvtJb0/tmpw11WkS 2017-02-22 20:03:52,687::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpMvtJb0 + rm -f /home/deploy-ovirt-experimental/experimental_repo.lock Build step 'Execute shell' marked build as failure [ssh-agent] Stopped.

1 1

repoman errors in OST
by Barak Korren 22 Feb '17

22 Feb '17

Hi everyone, We've recently seen repeating errors where the OST 'master upgrade from release' suit failed with a repoman exception. Close analysis revealed that repoman was failing because it ran out of space in /dev/shm (OST suites are configured to run fro, /dev/shm if the slave has more then 16G available in it). The thing is, there is nothing that seems special about this suit and the packages it downloads, but since we suspected package sizes we opened OST-49 [1]. Trying to get more information we monitored a slave while it was running the suit. We found out that it wasn't the /dev/shm that we filling up with files, instead, repoman`s memory usage was exploding (20G+) to the point where there was not more memory available for use by /dev/shm. As a result we reported REP-3 [2]. This is not happening all the time. The same suit sometimes succeeds on the exact same slaves. We haven't yet managed to manually reproduce this. Since we cannot reproduce this, and we cannot easily stop using repoman in OST at this point. We implemented a work-around for the time being where we directed the master flow to run on a fixed set of nodes that have A LOT of RAM [3]. Needless to say this is not a long term solution. We need to somehow manage to reproduce or gain insight on the problem. Alternatively we can consider reworking the OST suites to not use repoman for downloading, but still use it for local repo building (Where its unique properties are crucial). [1]: https://ovirt-jira.atlassian.net/browse/OST-49 [2]: https://ovirt-jira.atlassian.net/browse/REP-3 [3]: http://jenkins.ovirt.org/label/integ-tests-big/ -- Barak Korren bkorren(a)redhat.com RHCE, RHCi, RHV-DevOps Team https://ifireball.wordpress.com/

2 2