[JIRA] (OVIRT-1444) Gate mirror changes in change-queue jobs
by Barak Korren (oVirt JIRA)
Barak Korren created OVIRT-1444:
-----------------------------------
Summary: Gate mirror changes in change-queue jobs
Key: OVIRT-1444
URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1444
Project: oVirt - virtualization made easy
Issue Type: Improvement
Components: oVirt CI
Reporter: Barak Korren
Assignee: infra
When mirrors change, make the new snapshot be submitted as a change to the change queues.
The change queue test jobs will in turn be switched to not use the latest mirror snapshots and instead track which mirror snapshot successfully passed tests.
This will effectively provide gating for upstream repo changes.
--
This message was sent by Atlassian JIRA
(v1000.1065.1#100048)
7 years, 5 months
[JIRA] (OVIRT-1444) Gate mirror changes in change-queue jobs
by Barak Korren (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-1444?page=com.atlassian.jir... ]
Barak Korren updated OVIRT-1444:
--------------------------------
Epic Link: OVIRT-400
> Gate mirror changes in change-queue jobs
> ----------------------------------------
>
> Key: OVIRT-1444
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1444
> Project: oVirt - virtualization made easy
> Issue Type: Improvement
> Components: oVirt CI
> Reporter: Barak Korren
> Assignee: infra
> Labels: change-queue
>
> When mirrors change, make the new snapshot be submitted as a change to the change queues.
> The change queue test jobs will in turn be switched to not use the latest mirror snapshots and instead track which mirror snapshot successfully passed tests.
> This will effectively provide gating for upstream repo changes.
--
This message was sent by Atlassian JIRA
(v1000.1065.1#100048)
7 years, 5 months
Build failed in Jenkins: system-sync_mirrors-epel-el6-x86_64 #435
by jenkins＠jenkins.phx.ovirt.org
See <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/435/disp...>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
Pruning obsolete local branches
Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git
> git --version # timeout=10
> git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/changes/13/75913/5:patch --prune
> git rev-parse origin/patch^{commit} # timeout=10
> git rev-parse patch^{commit} # timeout=10
Checking out Revision 4b0fe3e0c9fba26cdbaafe2b29fddd3411225d6f (patch)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4b0fe3e0c9fba26cdbaafe2b29fddd3411225d6f
> git rev-list 4b0fe3e0c9fba26cdbaafe2b29fddd3411225d6f # timeout=10
[system-sync_mirrors-epel-el6-x86_64] $ /bin/bash -xe /tmp/hudson1786334846940847910.sh
+ jenkins/scripts/mirror_mgr.sh resync_yum_mirror epel-el6 x86_64 jenkins/data/mirrors-reposync.conf
Checking if mirror needs a resync
Not using downloaded repomd.xml because it is older than what we have:
Current : Wed Jun 14 02:40:28 2017
Downloaded: Sun Jun 11 17:37:33 2017
Traceback (most recent call last):
File "/usr/bin/reposync", line 343, in <module>
main()
File "/usr/bin/reposync", line 175, in main
my.doRepoSetup()
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup
return self._getRepos(thisrepo, True)
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos
self._repos.doSetup(thisrepo)
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup
self.retrieveAllMD()
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD
dl = repo._async and repo._commonLoadRepoXML(repo)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1494, in _commonLoadRepoXML
self._revertOldRepoXML()
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1323, in _revertOldRepoXML
os.rename(old_data['old_local'], old_data['local'])
OSError: [Errno 2] No such file or directory
Build step 'Execute shell' marked build as failure
7 years, 5 months
Build failed in Jenkins: system-sync_mirrors-centos-updates-el7-x86_64 #501
by jenkins＠jenkins.phx.ovirt.org
See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_6...>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_6...>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
Pruning obsolete local branches
Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git
> git --version # timeout=10
> git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/changes/13/75913/5:patch --prune
> git rev-parse origin/patch^{commit} # timeout=10
> git rev-parse patch^{commit} # timeout=10
Checking out Revision 4b0fe3e0c9fba26cdbaafe2b29fddd3411225d6f (patch)
> git config core.sparsecheckout # timeout=10
> git checkout -f 4b0fe3e0c9fba26cdbaafe2b29fddd3411225d6f
> git rev-list 4b0fe3e0c9fba26cdbaafe2b29fddd3411225d6f # timeout=10
[system-sync_mirrors-centos-updates-el7-x86_64] $ /bin/bash -xe /tmp/hudson8025271032904376196.sh
+ jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-updates-el7 x86_64 jenkins/data/mirrors-reposync.conf
Checking if mirror needs a resync
Traceback (most recent call last):
File "/usr/bin/reposync", line 343, in <module>
main()
File "/usr/bin/reposync", line 175, in main
my.doRepoSetup()
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup
return self._getRepos(thisrepo, True)
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos
self._repos.doSetup(thisrepo)
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup
self.retrieveAllMD()
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 96, in retrieveAllMD
downloading = repo._commonRetrieveDataMD_list(mdtypes)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1609, in _commonRetrieveDataMD_list
os.rename(local, local + '.old.tmp')
OSError: [Errno 2] No such file or directory
Build step 'Execute shell' marked build as failure
7 years, 5 months
oVirt infra daily report - unstable production jobs - 353
by jenkins＠jenkins.phx.ovirt.org
------=_Part_379_359593749.1497481201710
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
Good morning!
Attached is the HTML page with the jenkins status report. You can see it also here:
- http://jenkins.ovirt.org/job/system_jenkins-report/353//artifact/exported...
Cheers,
Jenkins
------=_Part_379_359593749.1497481201710
Content-Type: text/html; charset=us-ascii; name=upstream_report.html
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment; filename=upstream_report.html
Content-ID: <upstream_report.html>
<!DOCTYPE html><head><style type="text/css">
table.gridtable {
border-collapse: collapse;
table-layout:fixed;
width:1600px;
font-family: monospace;
font-size:13px;
}
.head {
font-size:20px;
font-family: arial;
}
.sub {
font-size:18px;
background-color:#e5e5e5;
font-family: arial;
}
pre {
font-family: monospace;
display: inline;
white-space: pre-wrap;
white-space: -moz-pre-wrap !important;
white-space: -pre-wrap;
white-space: -o-pre-wrap;
word-wrap: break-word;
}
</style>
</head>
<body>
<table class="gridtable" border=2>
<tr><th colspan=2 class=head>
RHEVM CI Jenkins Daily Report - 14/06/2017
</th></tr><tr><th colspan=2 class=sub>
<font color="blue"><a href="http://jenkins.ovirt.org/">00 Unstable Critical</a></font>
</th></tr>
<tr><td>
<a href="http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/">system-sync_mirrors-centos-updates-el7-x86_64</a>
</td><td>
This job is automatically updated by jenkins job builder, any manual
change will be lost in the next update. If you want to make permanent
changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;h...">
jenkins</a> repo.
<!-- Managed by Jenkins Job Builder -->
</td></tr>
<tr><td>
<a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/">test-repo_ovirt_experimental_master</a>
</td><td>
This job is automatically updated by jenkins job builder, any manual
change will be lost in the next update. If you want to make permanent
changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;h...">
jenkins</a> repo.
<!-- Managed by Jenkins Job Builder -->
</td></tr>
------=_Part_379_359593749.1497481201710--
7 years, 5 months
Re: [ovirt-devel] [ovirt-system-tests] Failed after fluentd rpm ubdate
by Eyal Edri
Adding infra as well.
Currently, master OST is still failing on this.
http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/7189/tes...
On Wed, Jun 14, 2017 at 4:54 PM, Sandro Bonazzola <sbonazzo(a)redhat.com>
wrote:
>
>
> On Wed, Jun 14, 2017 at 3:50 PM, Yedidyah Bar David <didi(a)redhat.com>
> wrote:
>
>> On Wed, Jun 14, 2017 at 4:44 PM, Gil Shinar <gshinar(a)redhat.com> wrote:
>> > This patch fixes the chgrp but not we see:
>> >
>> > Unable to start service fluentd: Job for fluentd.service failed because
>> > start of the service was attempted too often
>>
>> Adding Shirly.
>>
>> Do we collect syslog (/var/log/messages or journalctl)? If so, we can try
>> to see why it fails.
>>
>
> Adding also Richard who may be interested on this.
>
>
>>
>> >
>> >
>> > On Wed, Jun 14, 2017 at 12:29 PM, Yedidyah Bar David <didi(a)redhat.com>
>> > wrote:
>> >>
>> >> On Wed, Jun 14, 2017 at 11:34 AM, Valentina Makarova
>> >> <makarovavs07(a)gmail.com> wrote:
>> >> > Hello!
>> >> >
>> >> > Fluentd packages was modified yesterday there
>> >> >
>> >> > http://resources.ovirt.org/pub/ovirt-master-snapshot-static/
>> rpm/el7/noarch/
>> >> > This repository is referenced in reposync-config.
>> >> >
>> >> > And now run_suile.sh failed in 003_00_metrics_bootstrap test with
>> error:
>> >> > TASK [fluentd : Ensure fluentd configuration directory exists]
>> >> > ***************** fatal: [localhost]: FAILED! => {"changed": false,
>> >> > "failed": true, "gid": 0, "group": "root", "mode": "0755", "msg":
>> "chgrp
>> >> > failed: failed to look up group fluentd"
>> >> >
>> >> > And the same error on host0 and hos1.
>> >> >
>> >> > Does anyone know how to fix it?
>> >>
>> >> Should be fixed by [1]. Either wait for the repos to be updated or
>> install
>> >> the update from jenkins (link to it inside [1]).
>> >>
>> >> [1] https://gerrit.ovirt.org/#/c/78140/
>> >>
>> >> >
>> >> > Sincerely, Valentina Makarova
>> >> >
>> >> >
>> >> > _______________________________________________
>> >> > Devel mailing list
>> >> > Devel(a)ovirt.org
>> >> > http://lists.ovirt.org/mailman/listinfo/devel
>> >>
>> >>
>> >>
>> >> --
>> >> Didi
>> >> _______________________________________________
>> >> Devel mailing list
>> >> Devel(a)ovirt.org
>> >> http://lists.ovirt.org/mailman/listinfo/devel
>> >
>> >
>>
>>
>>
>> --
>> Didi
>> _______________________________________________
>> Devel mailing list
>> Devel(a)ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/devel
>>
>
>
>
> --
>
> SANDRO BONAZZOLA
>
> ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D
>
> Red Hat EMEA <https://www.redhat.com/>
> <https://red.ht/sig>
> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>
>
> _______________________________________________
> Devel mailing list
> Devel(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/devel
>
--
Eyal edri
ASSOCIATE MANAGER
RHV DevOps
EMEA VIRTUALIZATION R&D
Red Hat EMEA <https://www.redhat.com/>
<https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>
phone: +972-9-7692018
irc: eedri (on #tlv #rhev-dev #rhev-integ)
7 years, 5 months
[JIRA] (OVIRT-1441) [RFE] Add a jenkins job for copying external packages to static repos
by Barak Korren (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-1441?page=com.atlassian.jir... ]
Barak Korren commented on OVIRT-1441:
-------------------------------------
So again, I see 3 types of packages:
1. 3rd party packages for which an RPM is available for an official and reliable source (e.g. CentOS, Fedora)
2. 3rd party packages where there is no RPM avialable and we want to ship an RPM with oVirt
3. oVirt packages
For the 1st case we setup the 3rd party repo in the '*release*.rpm'.
For the 3rd case the package is usually built and managed by the CI systems.
We seem to be dealing with the 2nd case here, the solution for that was to make an oVirt "adapter" source repo with a usual build-artifacts job that creates or downloads the RPM. One is runs, the rest works just like for packages of the 3rd case.
Since we want to track and gate changes to oVirt, the "adapter" repo should be made so that is downloads a very specific version of the 3rd party package. That way getting an updated version of the upstream package requires a patch to the adapter repo which can be tracked and gated.
See also discussion in OVIRT-1299.
> [RFE] Add a jenkins job for copying external packages to static repos
> ---------------------------------------------------------------------
>
> Key: OVIRT-1441
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1441
> Project: oVirt - virtualization made easy
> Issue Type: By-EMAIL
> Reporter: Yedidyah Bar David
> Assignee: infra
>
> Description of problem:
> Currently, when we want to copy a package from elsewhere to
> resources.ovirt.org, we manually run repoman. It will be nice to have
> a jenkins job for this - with inputs probably being URLs of source
> packages/repos and target versions to copy to:
> 1. It will not require us anymore to login there and do sensitive
> stuff on it directly
> 2. It will have proper logs, allowing much more easily understand when
> a package was added, by whom, and even perhaps why. So better add to
> the inputs also 'Notes'.
> This is cloned from:
> https://bugzilla.redhat.com/show_bug.cgi?id=1455316
> Best,
> --
> Didi
--
This message was sent by Atlassian JIRA
(v1000.1045.3#100046)
7 years, 5 months
