[JIRA] (OVIRT-920) Add a standard-CI job and button "build-scratch-artifacts"
by eyal edri [Administrator] (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-920?page=com.atlassian.jira... ]
eyal edri [Administrator] reassigned OVIRT-920:
-----------------------------------------------
Assignee: eyal edri [Administrator] (was: infra)
> Add a standard-CI job and button "build-scratch-artifacts"
> ----------------------------------------------------------
>
> Key: OVIRT-920
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-920
> Project: oVirt - virtualization made easy
> Issue Type: By-EMAIL
> Reporter: Yedidyah Bar David
> Assignee: eyal edri [Administrator]
>
> Hi,
> I think it will be useful to have an option to very easily (such as
> pressing a button in gerrit) to do a full build of a project,
> similarly to current build-artifacts, but for a pending patch - so it
> will not be collected by any publisher, and will keep its artifacts
> for a short time (say, 2 days).
> This will allow to use these artifacts for manual tests, perhaps
> longer than check-patch, in case a developer wants to do them.
> --
> Didi
--
This message was sent by Atlassian JIRA
(v1000.621.4#100023)
7 years, 11 months
[JIRA] (OVIRT-935) Unable to build fc25 chroots with mock
by Evgheni Dereveanchin (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-935?page=com.atlassian.jira... ]
Evgheni Dereveanchin commented on OVIRT-935:
--------------------------------------------
We have Fedora slaves attached to the Jenkins and I prepared a few fc25 ones as part of OVIRT-822 . Maybe we should make fc25 jobs run only on fc25 slaves for now? Does mock itself support dnf?
> Unable to build fc25 chroots with mock
> --------------------------------------
>
> Key: OVIRT-935
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-935
> Project: oVirt - virtualization made easy
> Issue Type: Improvement
> Reporter: Nadav Goldin
> Assignee: infra
>
> Mock fails when trying to build the chroot for fedora25, on installing '@buildsys-build' group(with dnf) stage.
> Open bug: https://bugzilla.redhat.com/show_bug.cgi?id=1360781
> Temporarily workaround: add the 'libcrypt' package to '.packages.fc25' file.
> Possible solution: patch mock-*fc25*.cfg file in Jenkins repository to always install 'libcrypt' first.
> Until fixed this will block us from building anything with mock on fc25(hit it when trying to build fc25 RPMs for lago).
> Error logs:
> {code}
> DEBUG util.py:502: Executing command: ['/usr/bin/yum-deprecated', '--installroot', '/var/lib/mock/fedora-25-x86_64-2474d86945a1de9c6d14549ec2401b9c-8291/root/', '--releasever', '25', 'install', '@buildsys-build', 'git', 'python', 'python-dulwich', 'python-setuptools', 'yum', 'yum-utils', '--setopt=tsflags=nocontexts'] with env {'PS1': '<mock-chroot> \\s-\\v\\$ ',
> ....
> DEBUG util.py:421: Yum command has been deprecated, use dnf instead.
> DEBUG util.py:421: See 'man dnf' and 'man yum2dnf' for more information.
> DEBUG util.py:421: Error: libcrypt conflicts with libcrypt-nss-2.24-3.fc25.x86_64
> DEBUG util.py:421: Error: libcrypt-nss conflicts with libcrypt-2.24-3.fc25.x86_64
> DEBUG util.py:421: You could try using --skip-broken to work around the problem
> DEBUG util.py:421: You could try running: rpm -Va --nofiles --nodigest
> DEBUG util.py:557: Child return code was: 1
> DEBUG util.py:180: kill orphans
> {code}
--
This message was sent by Atlassian JIRA
(v1000.621.4#100023)
7 years, 11 months
[JIRA] (OVIRT-944) Prepare CI for 4.1 oVirt branch
by eyal edri [Administrator] (oVirt JIRA)
eyal edri [Administrator] created OVIRT-944:
-----------------------------------------------
Summary: Prepare CI for 4.1 oVirt branch
Key: OVIRT-944
URL: https://ovirt-jira.atlassian.net/browse/OVIRT-944
Project: oVirt - virtualization made easy
Issue Type: Task
Reporter: eyal edri [Administrator]
Assignee: infra
Priority: Highest
We need to add all relevant jobs and flows for 4.1, lets use this ticket to track all progress
* system tests
* experimental flows
* publishers
* deploy to experimental
* gerrit hooks (?)
* standard flows for various projects
cc [~sbonazolla(a)redhat.com] [~ederevea] [~bkorren(a)redhat.com] [~amarchuk] [~sbendavi(a)redhat.com]
--
This message was sent by Atlassian JIRA
(v1000.621.4#100023)
7 years, 11 months
[JIRA] (OVIRT-944) Prepare CI for 4.1 oVirt branch
by eyal edri [Administrator] (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-944?page=com.atlassian.jira... ]
eyal edri [Administrator] updated OVIRT-944:
--------------------------------------------
Epic Link: OVIRT-400
> Prepare CI for 4.1 oVirt branch
> -------------------------------
>
> Key: OVIRT-944
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-944
> Project: oVirt - virtualization made easy
> Issue Type: Task
> Reporter: eyal edri [Administrator]
> Assignee: infra
> Priority: Highest
>
> We need to add all relevant jobs and flows for 4.1, lets use this ticket to track all progress
> * system tests
> * experimental flows
> * publishers
> * deploy to experimental
> * gerrit hooks (?)
> * standard flows for various projects
> cc [~sbonazolla(a)redhat.com] [~ederevea] [~bkorren(a)redhat.com] [~amarchuk] [~sbendavi(a)redhat.com]
--
This message was sent by Atlassian JIRA
(v1000.621.4#100023)
7 years, 11 months
oVirt master experimental system tests now failing on snapshot merge
by Barak Korren
After we've fixed the various system test issues that arose from the
CentOS 7.3 release, we're now seeing a new failure that seems to has
to do with snapshot merges.
I'm guessing this may have to do with something the went in last week
while we "weren't looking".
Failing job can be seen here:
http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/4275
The test code snippet that is failing is as follows:
226 api.vms.get(VM0_NAME).snapshots.list()[-2].delete()
227 testlib.assert_true_within_short(
228 lambda:
229 (len(api.vms.get(VM0_NAME).snapshots.list()) == 2) and
230 (api.vms.get(VM0_NAME).snapshots.list()[-1].snapshot_status
231 == 'ok'),
232 )
The failure itself is a test timeout:
...
File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/004_basic_sanity.py",
line 228, in snapshot_merge
lambda:
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line
248, in assert_true_within_short
allowed_exceptions=allowed_exceptions,
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line
240, in assert_true_within
raise AssertionError('Timed out after %s seconds' % timeout)
AssertionError: Timed out after 180 seconds
Engine log generated during the test can be found here:
http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/4275/art...
Please have a look.
Thanks,
Barak.
--
Barak Korren
bkorren(a)redhat.com
RHCE, RHCi, RHV-DevOps Team
https://ifireball.wordpress.com/
7 years, 11 months
[JIRA] (OVIRT-943) Filter out 'latest.under_testing' from repoman '--latest' calculation in 'deploy-to-experiminetal' flow
by Barak Korren (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-943?page=com.atlassian.jira... ]
Barak Korren updated OVIRT-943:
-------------------------------
Epic Link: OVIRT-400
> Filter out 'latest.under_testing' from repoman '--latest' calculation in 'deploy-to-experiminetal' flow
> -------------------------------------------------------------------------------------------------------
>
> Key: OVIRT-943
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-943
> Project: oVirt - virtualization made easy
> Issue Type: Bug
> Components: repoman
> Reporter: Barak Korren
> Assignee: infra
>
> It seems that the repoman '--latest' switch, as it is used in the 'deploy-to-experimatal' job, is not (Or cannot be) configured to ignore the 'latest.under_testing' directory.
> This can lead to the deploy job failing when other jobs manipulate the 'latest.under_testing' directory.
> An example for this kind of failure:
> http://jenkins.ovirt.org/job/deploy-to-ovirt_experimental_master/8392/con...
> Relevant error messages:
> {code}
> 2016-12-18 10:02:09,021::INFO::repoman.common.stores.RPM.add_rpm:248::Adding package /srv/resources/repos/ovirt/experimental/master/latest.under_testing/rpm/el7/SRPMS/vdsm-jsonrpc-java-1.3.5-1.20161214084205.gitfbe3dec.el7.centos.src.rpm to repo Non persistent RPMStore
> 2016-12-18 10:02:09,022::INFO::repoman.common.stores.RPM.add_rpm:248::Adding package /srv/resources/repos/ovirt/experimental/master/latest.under_testing/rpm/el7/SRPMS/unboundid-ldapsdk-3.2.0-1.el7.src.rpm to repo Non persistent RPMStore
> Traceback (most recent call last):
> File "/usr/bin/repoman", line 10, in <module>
> sys.exit(main())
> File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 455, in main
> exit_code = do_add(args, config, repo)
> File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 360, in do_add
> latest_repo.add_source('%s:latest' % root_dir)
> File "/usr/lib/python2.7/site-packages/repoman/common/repo.py", line 175, in add_source
> artifact_paths = self.parser.parse(artifact_source)
> File "/usr/lib/python2.7/site-packages/repoman/common/parser.py", line 96, in parse
> art_list,
> File "/usr/lib/python2.7/site-packages/repoman/common/filters/latest.py", line 37, in filter
> store.add_artifact(artifact)
> File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py", line 192, in add_artifact
> self.add_rpm(pkg, **args)
> File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py", line 213, in add_rpm
> verify_ssl=self.config.getboolean('verify_ssl'),
> File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/RPM.py", line 114, in __init__
> with open(path) as fdno:
> IOError: [Errno 2] No such file or directory: '/srv/resources/repos/ovirt/experimental/master/latest.under_testing/rpm/el7/SRPMS/vdsm-4.18.999-1188.gitbf3f9e9.el7.centos.src.rpm'
> 2016-12-18 10:02:09,810::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC/tmpQ_3ssv/tmp7HZmrN/tmplYE1KR
> 2016-12-18 10:02:09,813::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC/tmpQ_3ssv/tmp7HZmrN
> 2016-12-18 10:02:09,814::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC/tmpQ_3ssv
> 2016-12-18 10:02:09,814::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC
> Build step 'Execute shell' marked build as failure
> {code}
> This issue can also be mitigated with global exclusive locking as described in OVIRT-899
--
This message was sent by Atlassian JIRA
(v1000.621.4#100023)
7 years, 11 months
[JIRA] (OVIRT-943) Filter out 'latest.under_testing' from repoman '--latest' calculation in 'deploy-to-experiminetal' flow
by Barak Korren (oVirt JIRA)
Barak Korren created OVIRT-943:
----------------------------------
Summary: Filter out 'latest.under_testing' from repoman '--latest' calculation in 'deploy-to-experiminetal' flow
Key: OVIRT-943
URL: https://ovirt-jira.atlassian.net/browse/OVIRT-943
Project: oVirt - virtualization made easy
Issue Type: Bug
Components: repoman
Reporter: Barak Korren
Assignee: infra
It seems that the repoman '--latest' switch, as it is used in the 'deploy-to-experimatal' job, is not (Or cannot be) configured to ignore the 'latest.under_testing' directory.
This can lead to the deploy job failing when other jobs manipulate the 'latest.under_testing' directory.
An example for this kind of failure:
http://jenkins.ovirt.org/job/deploy-to-ovirt_experimental_master/8392/con...
Relevant error messages:
{code}
2016-12-18 10:02:09,021::INFO::repoman.common.stores.RPM.add_rpm:248::Adding package /srv/resources/repos/ovirt/experimental/master/latest.under_testing/rpm/el7/SRPMS/vdsm-jsonrpc-java-1.3.5-1.20161214084205.gitfbe3dec.el7.centos.src.rpm to repo Non persistent RPMStore
2016-12-18 10:02:09,022::INFO::repoman.common.stores.RPM.add_rpm:248::Adding package /srv/resources/repos/ovirt/experimental/master/latest.under_testing/rpm/el7/SRPMS/unboundid-ldapsdk-3.2.0-1.el7.src.rpm to repo Non persistent RPMStore
Traceback (most recent call last):
File "/usr/bin/repoman", line 10, in <module>
sys.exit(main())
File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 455, in main
exit_code = do_add(args, config, repo)
File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 360, in do_add
latest_repo.add_source('%s:latest' % root_dir)
File "/usr/lib/python2.7/site-packages/repoman/common/repo.py", line 175, in add_source
artifact_paths = self.parser.parse(artifact_source)
File "/usr/lib/python2.7/site-packages/repoman/common/parser.py", line 96, in parse
art_list,
File "/usr/lib/python2.7/site-packages/repoman/common/filters/latest.py", line 37, in filter
store.add_artifact(artifact)
File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py", line 192, in add_artifact
self.add_rpm(pkg, **args)
File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py", line 213, in add_rpm
verify_ssl=self.config.getboolean('verify_ssl'),
File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/RPM.py", line 114, in __init__
with open(path) as fdno:
IOError: [Errno 2] No such file or directory: '/srv/resources/repos/ovirt/experimental/master/latest.under_testing/rpm/el7/SRPMS/vdsm-4.18.999-1188.gitbf3f9e9.el7.centos.src.rpm'
2016-12-18 10:02:09,810::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC/tmpQ_3ssv/tmp7HZmrN/tmplYE1KR
2016-12-18 10:02:09,813::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC/tmpQ_3ssv/tmp7HZmrN
2016-12-18 10:02:09,814::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC/tmpQ_3ssv
2016-12-18 10:02:09,814::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC
Build step 'Execute shell' marked build as failure
{code}
This issue can also be mitigated with global exclusive locking as described in OVIRT-899
--
This message was sent by Atlassian JIRA
(v1000.621.4#100023)
7 years, 11 months
[JIRA] (OVIRT-935) Unable to build fc25 chroots with mock
by Barak Korren (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-935?page=com.atlassian.jira... ]
Barak Korren commented on OVIRT-935:
------------------------------------
{quote}
So we need to think if we can just use 'dnf' in fc25 mock config instead.
{quote}
We cant. We need it to run on el7 hosts. Those do not have DNF.
> Unable to build fc25 chroots with mock
> --------------------------------------
>
> Key: OVIRT-935
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-935
> Project: oVirt - virtualization made easy
> Issue Type: Improvement
> Reporter: Nadav Goldin
> Assignee: infra
>
> Mock fails when trying to build the chroot for fedora25, on installing '@buildsys-build' group(with dnf) stage.
> Open bug: https://bugzilla.redhat.com/show_bug.cgi?id=1360781
> Temporarily workaround: add the 'libcrypt' package to '.packages.fc25' file.
> Possible solution: patch mock-*fc25*.cfg file in Jenkins repository to always install 'libcrypt' first.
> Until fixed this will block us from building anything with mock on fc25(hit it when trying to build fc25 RPMs for lago).
> Error logs:
> {code}
> DEBUG util.py:502: Executing command: ['/usr/bin/yum-deprecated', '--installroot', '/var/lib/mock/fedora-25-x86_64-2474d86945a1de9c6d14549ec2401b9c-8291/root/', '--releasever', '25', 'install', '@buildsys-build', 'git', 'python', 'python-dulwich', 'python-setuptools', 'yum', 'yum-utils', '--setopt=tsflags=nocontexts'] with env {'PS1': '<mock-chroot> \\s-\\v\\$ ',
> ....
> DEBUG util.py:421: Yum command has been deprecated, use dnf instead.
> DEBUG util.py:421: See 'man dnf' and 'man yum2dnf' for more information.
> DEBUG util.py:421: Error: libcrypt conflicts with libcrypt-nss-2.24-3.fc25.x86_64
> DEBUG util.py:421: Error: libcrypt-nss conflicts with libcrypt-2.24-3.fc25.x86_64
> DEBUG util.py:421: You could try using --skip-broken to work around the problem
> DEBUG util.py:421: You could try running: rpm -Va --nofiles --nodigest
> DEBUG util.py:557: Child return code was: 1
> DEBUG util.py:180: kill orphans
> {code}
--
This message was sent by Atlassian JIRA
(v1000.621.4#100023)
7 years, 11 months
[JIRA] (OVIRT-935) Unable to build fc25 chroots with mock
by Nadav Goldin (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-935?page=com.atlassian.jira... ]
Nadav Goldin commented on OVIRT-935:
------------------------------------
As commented in https://bugzilla.redhat.com/show_bug.cgi?id=1360781#c28 , changing the installation to 'dnf' works. So we need to think if we can just use 'dnf' in fc25 mock config instead.
> Unable to build fc25 chroots with mock
> --------------------------------------
>
> Key: OVIRT-935
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-935
> Project: oVirt - virtualization made easy
> Issue Type: Improvement
> Reporter: Nadav Goldin
> Assignee: infra
>
> Mock fails when trying to build the chroot for fedora25, on installing '@buildsys-build' group(with dnf) stage.
> Open bug: https://bugzilla.redhat.com/show_bug.cgi?id=1360781
> Temporarily workaround: add the 'libcrypt' package to '.packages.fc25' file.
> Possible solution: patch mock-*fc25*.cfg file in Jenkins repository to always install 'libcrypt' first.
> Until fixed this will block us from building anything with mock on fc25(hit it when trying to build fc25 RPMs for lago).
> Error logs:
> {code}
> DEBUG util.py:502: Executing command: ['/usr/bin/yum-deprecated', '--installroot', '/var/lib/mock/fedora-25-x86_64-2474d86945a1de9c6d14549ec2401b9c-8291/root/', '--releasever', '25', 'install', '@buildsys-build', 'git', 'python', 'python-dulwich', 'python-setuptools', 'yum', 'yum-utils', '--setopt=tsflags=nocontexts'] with env {'PS1': '<mock-chroot> \\s-\\v\\$ ',
> ....
> DEBUG util.py:421: Yum command has been deprecated, use dnf instead.
> DEBUG util.py:421: See 'man dnf' and 'man yum2dnf' for more information.
> DEBUG util.py:421: Error: libcrypt conflicts with libcrypt-nss-2.24-3.fc25.x86_64
> DEBUG util.py:421: Error: libcrypt-nss conflicts with libcrypt-2.24-3.fc25.x86_64
> DEBUG util.py:421: You could try using --skip-broken to work around the problem
> DEBUG util.py:421: You could try running: rpm -Va --nofiles --nodigest
> DEBUG util.py:557: Child return code was: 1
> DEBUG util.py:180: kill orphans
> {code}
--
This message was sent by Atlassian JIRA
(v1000.621.4#100023)
7 years, 11 months
