- Infra - oVirt List Archives

[JIRA] (OVIRT-947) [gerrit hooks] Disable change bug status to MODIFIED for 'master' branch
by Shlomo Ben David (oVirt JIRA) 20 Dec '16

20 Dec '16

Shlomo Ben David created OVIRT-947: -------------------------------------- Summary: [gerrit hooks] Disable change bug status to MODIFIED for 'master' branch Key: OVIRT-947 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-947 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Shlomo Ben David Assignee: infra -- This message was sent by Atlassian JIRA (v1000.621.5#100023)

1 0

[JIRA] (OVIRT-947) [gerrit hooks] Disable change bug status to MODIFIED for 'master' branch
by Shlomo Ben David (oVirt JIRA) 20 Dec '16

20 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-947?page=com.atlassian.jira.p… ] Shlomo Ben David updated OVIRT-947: ----------------------------------- Epic Link: OVIRT-411 > [gerrit hooks] Disable change bug status to MODIFIED for 'master' branch > ------------------------------------------------------------------------ > > Key: OVIRT-947 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-947 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Shlomo Ben David > Assignee: infra > -- This message was sent by Atlassian JIRA (v1000.621.5#100023)

1 0

[oVirt Jenkins] test-repo_ovirt_experimental_master - Build #4322 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 20 Dec '16

20 Dec '16

------=_Part_552_1143196015.1482252713690 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Build: http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/4322/, Build Number: 4322, Build Status: FAILURE ------=_Part_552_1143196015.1482252713690--

1 1

[JIRA] (OVIRT-946) emails no longer create JIRA tickets
by Evgheni Dereveanchin (oVirt JIRA) 20 Dec '16

20 Dec '16

Evgheni Dereveanchin created OVIRT-946: ------------------------------------------ Summary: emails no longer create JIRA tickets Key: OVIRT-946 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-946 Project: oVirt - virtualization made easy Issue Type: Improvement Reporter: Evgheni Dereveanchin Assignee: infra After the mailman instance was moved ( OVIRT-408 ) emails to infra-support no longer create tickets. SELinux seems to be blocking a custom antispam script that we have installed. Logging this ticket to investigate and fix the issue. -- This message was sent by Atlassian JIRA (v1000.621.5#100023)

1 0

[JIRA] (OVIRT-946) emails no longer create JIRA tickets
by Evgheni Dereveanchin (oVirt JIRA) 20 Dec '16

20 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-946?page=com.atlassian.jira.p… ] Evgheni Dereveanchin reassigned OVIRT-946: ------------------------------------------ Assignee: Evgheni Dereveanchin (was: infra) > emails no longer create JIRA tickets > ------------------------------------ > > Key: OVIRT-946 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-946 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Evgheni Dereveanchin > Assignee: Evgheni Dereveanchin > > After the mailman instance was moved ( OVIRT-408 ) emails to infra-support no longer create tickets. SELinux seems to be blocking a custom antispam script that we have installed. Logging this ticket to investigate and fix the issue. -- This message was sent by Atlassian JIRA (v1000.621.5#100023)

1 0

Build failed in Jenkins: ovirt_3.6_he-system-tests #756
by jenkins＠jenkins.phx.ovirt.org 20 Dec '16

20 Dec '16

See <http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/756/changes> Changes: [Yaniv Kaul] - Removed some undeeded deps. ------------------------------------------ [...truncated 766 lines...] ## rc = 1 ########################################################## ##! ERROR vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv ##! Last 20 log entries: logs/mocker-epel-7-x86_64.el7.he_basic_suite_3.6.sh/he_basic_suite_3.6.sh.log ##! + env_cleanup + echo '#########################' ######################### + local res=0 + local uuid + echo '======== Cleaning up' ======== Cleaning up + [[ -e <http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/ovirt-system-test…> ]] + echo '----------- Cleaning with lago' ----------- Cleaning with lago + lago --workdir <http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/ovirt-system-test…> destroy --yes --all-prefixes + echo '----------- Cleaning with lago done' ----------- Cleaning with lago done + [[ 0 != \0 ]] + echo '======== Cleanup done' ======== Cleanup done + exit 0 + exit Took 723 seconds =================================== ##! ##! ERROR ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ##!######################################################## ########################################################## Build step 'Execute shell' marked build as failure Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo 'shell_scripts/system_tests.collect_logs.sh' # # Required jjb vars: # version # VERSION=3.6 SUITE_TYPE= WORKSPACE="$PWD" OVIRT_SUITE="$SUITE_TYPE_suite_$VERSION" TESTS_LOGS="$WORKSPACE/ovirt-system-tests/exported-artifacts" rm -rf "$WORKSPACE/exported-artifacts" mkdir -p "$WORKSPACE/exported-artifacts" if [[ -d "$TESTS_LOGS" ]]; then mv "$TESTS_LOGS/"* "$WORKSPACE/exported-artifacts/" fi [ovirt_3.6_he-system-tests] $ /bin/bash -xe /tmp/hudson6880042928624017790.sh + echo shell_scripts/system_tests.collect_logs.sh shell_scripts/system_tests.collect_logs.sh + VERSION=3.6 + SUITE_TYPE= + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/> + OVIRT_SUITE=3.6 + TESTS_LOGS=<http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/ovirt-system-test…> + rm -rf <http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/756/artifact/exporte…> + mkdir -p <http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/756/artifact/exporte…> + [[ -d <http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/ovirt-system-test…> ]] + mv <http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/ovirt-system-test…> <http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/756/artifact/exporte…> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 0 Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -x echo "shell-scripts/mock_cleanup.sh" shopt -s nullglob WORKSPACE="$PWD" # Make clear this is the cleanup, helps reading the jenkins logs cat <<EOC _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### EOC # restore the permissions in the working dir, as sometimes it leaves files # owned by root and then the 'cleanup workspace' from jenkins job fails to # clean and breaks the jobs sudo chown -R "$USER" "$WORKSPACE" # Archive the logs, we want them anyway logs=( ./*log ./*/logs ) if [[ "$logs" ]]; then for log in "${logs[@]}"; do [[ "$log" = ./exported-artifacts/* ]] && continue echo "Copying ${log} to exported-artifacts" mv $log exported-artifacts/ done fi # stop any processes running inside the chroot failed=false mock_confs=("$WORKSPACE"/*/mocker*) # Clean current jobs mockroot if any for mock_conf_file in "${mock_confs[@]}"; do [[ "$mock_conf_file" ]] || continue echo "Cleaning up mock $mock_conf" mock_root="${mock_conf_file##*/}" mock_root="${mock_root%.*}" my_mock="/usr/bin/mock" my_mock+=" --configdir=${mock_conf_file%/*}" my_mock+=" --root=${mock_root}" my_mock+=" --resultdir=$WORKSPACE" #TODO: investigate why mock --clean fails to umount certain dirs sometimes, #so we can use it instead of manually doing all this. echo "Killing all mock orphan processes, if any." $my_mock \ --orphanskill \ || { echo "ERROR: Failed to kill orphans on $chroot." failed=true } mock_root="$(\ grep \ -Po "(?<=config_opts\['root'\] = ')[^']*" \ "$mock_conf_file" \ )" || : [[ "$mock_root" ]] || continue mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $chroot. Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true } done done # Clean any leftover chroot from other jobs for mock_root in /var/lib/mock/*; do this_chroot_failed=false mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $mock_root." \ "Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true this_chroot_failed=true } done if ! $this_chroot_failed; then sudo rm -rf "$mock_root" fi done # remove mock caches that are older then 2 days: find /var/cache/mock/ -mindepth 1 -maxdepth 1 -type d -mtime +2 -print0 | \ xargs -0 -tr sudo rm -rf # We make no effort to leave around caches that may still be in use because # packages installed in them may go out of date, so may as well recreate them # Drop all left over libvirt domains for UUID in $(virsh list --all --uuid); do virsh destroy $UUID || : sleep 2 virsh undefine --remove-all-storage --storage vda --snapshots-metadata $UUID || : done if $failed; then echo "Cleanup script failed, propegating failure to job" exit 1 fi [ovirt_3.6_he-system-tests] $ /bin/bash -x /tmp/hudson5940921516581207254.sh + echo shell-scripts/mock_cleanup.sh shell-scripts/mock_cleanup.sh + shopt -s nullglob + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/> + cat _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### + sudo chown -R jenkins <http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/> + logs=(./*log ./*/logs) + [[ -n ./ovirt-system-tests/logs ]] + for log in '"${logs[@]}"' + [[ ./ovirt-system-tests/logs = ./exported-artifacts/* ]] + echo 'Copying ./ovirt-system-tests/logs to exported-artifacts' Copying ./ovirt-system-tests/logs to exported-artifacts + mv ./ovirt-system-tests/logs exported-artifacts/ + failed=false + mock_confs=("$WORKSPACE"/*/mocker*) + for mock_conf_file in '"${mock_confs[@]}"' + [[ -n <http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/ovirt-system-test…> ]] + echo 'Cleaning up mock ' Cleaning up mock + mock_root=mocker-epel-7-x86_64.el7.cfg + mock_root=mocker-epel-7-x86_64.el7 + my_mock=/usr/bin/mock + my_mock+=' --configdir=<http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/ovirt-system-tests'> + my_mock+=' --root=mocker-epel-7-x86_64.el7' + my_mock+=' --resultdir=<http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/'> + echo 'Killing all mock orphan processes, if any.' Killing all mock orphan processes, if any. + /usr/bin/mock --configdir=<http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/ovirt-system-tests> --root=mocker-epel-7-x86_64.el7 --resultdir=<http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/> --orphanskill WARNING: Could not find required logging config file: <http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/ovirt-system-test….> Using default... INFO: mock.py version 1.2.21 starting (python version = 3.4.3)... Start: init plugins INFO: selinux enabled Finish: init plugins Start: run Finish: run ++ grep -Po '(?<=config_opts\['\''root'\''\] = '\'')[^'\'']*' <http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/ws/ovirt-system-test…> + mock_root=epel-7-x86_64-aa7d25407b9c15b3736f25fc4fcf3710 + [[ -n epel-7-x86_64-aa7d25407b9c15b3736f25fc4fcf3710 ]] + mounts=($(mount | awk '{print $3}' | grep "$mock_root")) ++ mount ++ awk '{print $3}' ++ grep epel-7-x86_64-aa7d25407b9c15b3736f25fc4fcf3710 + : + [[ -n '' ]] + find /var/cache/mock/ -mindepth 1 -maxdepth 1 -type d -mtime +2 -print0 + xargs -0 -tr sudo rm -rf ++ virsh list --all --uuid + false POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 1 Recording test results ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? Archiving artifacts

1 13

Maintainers can't give +2 on code review in ovirt-engine-4.1 stable branch
by Tal Nisan 20 Dec '16

20 Dec '16

Heard it from a couple of guys, yesterday it appeared to be working fine, today it's not

3 11

[ACTION REQUIRED] stabilization branches for 4.1
by Sandro Bonazzola 20 Dec '16

20 Dec '16

In order to stabilize the build and allow to prepare jenkins on time, 4.1 branches need to be created before or on Monday Dec 19th. oVirt engine will be branched on Monday Dec 19th at 11:00 AM TLV time (10:00 AM CET). -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

2 6

[JIRA] (OVIRT-935) Unable to build fc25 chroots with mock
by Anton Marchukov (oVirt JIRA) 20 Dec '16

20 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-935?page=com.atlassian.jira.p… ] Anton Marchukov commented on OVIRT-935: --------------------------------------- Another solution as I see would be to check the current status of "dnf" in epel, here are some references: "EL6 and EL7 does not have DNF available (well there is DNF in EPEL7, but not dnf-plugins-core, which are crucial for for Mock)." and in comments there is a reference to some old dnf-plugins-core build: https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-6436 it might be that everything needed is already in EPEL and this potentially may mean that we can install dnf and everything needed on CentOS7 vms we use and use "dnf" only for Fedora mocks while keeping "yum" for CentOS mocks. Not sure if they can work together and if it is possible to make it work, but this is another direction to explore. > Unable to build fc25 chroots with mock > -------------------------------------- > > Key: OVIRT-935 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-935 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Nadav Goldin > Assignee: infra > > Mock fails when trying to build the chroot for fedora25, on installing '@buildsys-build' group(with dnf) stage. > Open bug: https://bugzilla.redhat.com/show_bug.cgi?id=1360781 > Temporarily workaround: add the 'libcrypt' package to '.packages.fc25' file. > Possible solution: patch mock-*fc25*.cfg file in Jenkins repository to always install 'libcrypt' first. > Until fixed this will block us from building anything with mock on fc25(hit it when trying to build fc25 RPMs for lago). > Error logs: > {code} > DEBUG util.py:502: Executing command: ['/usr/bin/yum-deprecated', '--installroot', '/var/lib/mock/fedora-25-x86_64-2474d86945a1de9c6d14549ec2401b9c-8291/root/', '--releasever', '25', 'install', '@buildsys-build', 'git', 'python', 'python-dulwich', 'python-setuptools', 'yum', 'yum-utils', '--setopt=tsflags=nocontexts'] with env {'PS1': '<mock-chroot> \\s-\\v\\$ ', > .... > DEBUG util.py:421: Yum command has been deprecated, use dnf instead. > DEBUG util.py:421: See 'man dnf' and 'man yum2dnf' for more information. > DEBUG util.py:421: Error: libcrypt conflicts with libcrypt-nss-2.24-3.fc25.x86_64 > DEBUG util.py:421: Error: libcrypt-nss conflicts with libcrypt-2.24-3.fc25.x86_64 > DEBUG util.py:421: You could try using --skip-broken to work around the problem > DEBUG util.py:421: You could try running: rpm -Va --nofiles --nodigest > DEBUG util.py:557: Child return code was: 1 > DEBUG util.py:180: kill orphans > {code} -- This message was sent by Atlassian JIRA (v1000.621.5#100023)

1 0

[JIRA] (OVIRT-935) Unable to build fc25 chroots with mock
by Anton Marchukov (oVirt JIRA) 20 Dec '16

20 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-935?page=com.atlassian.jira.p… ] Anton Marchukov commented on OVIRT-935: --------------------------------------- Official information: https://github.com/rpm-software-management/mock/wiki#mock-on-el-6-and-el-7-… http://miroslav.suchy.cz/blog/archives/2015/05/20/why_mock_does_not_work_on… the later says: "This is something which you may want to do, when you are building some packages for personal usage. However you should avoid that if you are operating some build system. In such case migration to some recent Fedora is your only option." and "Change Mock settings that EL6 and EL7 users will continue to use Yum for building Fedora rawhide (and F23+). While this option seems to be good trade-off, there is big risk that you end up with different binary compared to the same process on Fedoras. For example there was issue that Rubygems requires ruby(release), which Yum resolved to normal ruby, however DNF resolved that to jruby. And that is big difference." and all the workarounds proposed as I see for the opposite - use yum enabled mocks on fedora. Upgrading Fedora seems to me standard and supported procedure and business as usual. If we do it manually we can automate it so it scales. Inserting hacks into "yum" to work with Fedora composes is not standard and not supported. Hence it is not possible to automate and it will always be manual work on its own and thus I do not think it is sustainable solution for future. Especially since we do have Fedora slaves already and have to support them anyway. > Unable to build fc25 chroots with mock > -------------------------------------- > > Key: OVIRT-935 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-935 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Nadav Goldin > Assignee: infra > > Mock fails when trying to build the chroot for fedora25, on installing '@buildsys-build' group(with dnf) stage. > Open bug: https://bugzilla.redhat.com/show_bug.cgi?id=1360781 > Temporarily workaround: add the 'libcrypt' package to '.packages.fc25' file. > Possible solution: patch mock-*fc25*.cfg file in Jenkins repository to always install 'libcrypt' first. > Until fixed this will block us from building anything with mock on fc25(hit it when trying to build fc25 RPMs for lago). > Error logs: > {code} > DEBUG util.py:502: Executing command: ['/usr/bin/yum-deprecated', '--installroot', '/var/lib/mock/fedora-25-x86_64-2474d86945a1de9c6d14549ec2401b9c-8291/root/', '--releasever', '25', 'install', '@buildsys-build', 'git', 'python', 'python-dulwich', 'python-setuptools', 'yum', 'yum-utils', '--setopt=tsflags=nocontexts'] with env {'PS1': '<mock-chroot> \\s-\\v\\$ ', > .... > DEBUG util.py:421: Yum command has been deprecated, use dnf instead. > DEBUG util.py:421: See 'man dnf' and 'man yum2dnf' for more information. > DEBUG util.py:421: Error: libcrypt conflicts with libcrypt-nss-2.24-3.fc25.x86_64 > DEBUG util.py:421: Error: libcrypt-nss conflicts with libcrypt-2.24-3.fc25.x86_64 > DEBUG util.py:421: You could try using --skip-broken to work around the problem > DEBUG util.py:421: You could try running: rpm -Va --nofiles --nodigest > DEBUG util.py:557: Child return code was: 1 > DEBUG util.py:180: kill orphans > {code} -- This message was sent by Atlassian JIRA (v1000.621.5#100023)

1 0

Gerrit hooks change 4.1 bugs status to MODIFIED if merged on master
by Tal Nisan 20 Dec '16

20 Dec '16

This should be change to move to MODIFIED only after the bug is merged on the 4.1 branch. Here's an example: https://gerrit.ovirt.org/#/c/68739/ Thanks.

3 2

[JIRA] (OVIRT-935) Unable to build fc25 chroots with mock
by eyal edri [Administrator] (oVirt JIRA) 20 Dec '16

20 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-935?page=com.atlassian.jira.p… ] eyal edri [Administrator] commented on OVIRT-935: ------------------------------------------------- This comes with a price - if we'll have more fedora slaves than centos due to this, then we'll need to to mass upgrades much more often, due to the speed of fedora releases goes EOL > Unable to build fc25 chroots with mock > -------------------------------------- > > Key: OVIRT-935 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-935 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Nadav Goldin > Assignee: infra > > Mock fails when trying to build the chroot for fedora25, on installing '@buildsys-build' group(with dnf) stage. > Open bug: https://bugzilla.redhat.com/show_bug.cgi?id=1360781 > Temporarily workaround: add the 'libcrypt' package to '.packages.fc25' file. > Possible solution: patch mock-*fc25*.cfg file in Jenkins repository to always install 'libcrypt' first. > Until fixed this will block us from building anything with mock on fc25(hit it when trying to build fc25 RPMs for lago). > Error logs: > {code} > DEBUG util.py:502: Executing command: ['/usr/bin/yum-deprecated', '--installroot', '/var/lib/mock/fedora-25-x86_64-2474d86945a1de9c6d14549ec2401b9c-8291/root/', '--releasever', '25', 'install', '@buildsys-build', 'git', 'python', 'python-dulwich', 'python-setuptools', 'yum', 'yum-utils', '--setopt=tsflags=nocontexts'] with env {'PS1': '<mock-chroot> \\s-\\v\\$ ', > .... > DEBUG util.py:421: Yum command has been deprecated, use dnf instead. > DEBUG util.py:421: See 'man dnf' and 'man yum2dnf' for more information. > DEBUG util.py:421: Error: libcrypt conflicts with libcrypt-nss-2.24-3.fc25.x86_64 > DEBUG util.py:421: Error: libcrypt-nss conflicts with libcrypt-2.24-3.fc25.x86_64 > DEBUG util.py:421: You could try using --skip-broken to work around the problem > DEBUG util.py:421: You could try running: rpm -Va --nofiles --nodigest > DEBUG util.py:557: Child return code was: 1 > DEBUG util.py:180: kill orphans > {code} -- This message was sent by Atlassian JIRA (v1000.621.5#100023)

1 0

[JIRA] (OVIRT-935) Unable to build fc25 chroots with mock
by Anton Marchukov (oVirt JIRA) 20 Dec '16

20 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-935?page=com.atlassian.jira.p… ] Anton Marchukov commented on OVIRT-935: --------------------------------------- I support [~ederevea] in that we should not try to maintain non supported options ourselves if we have options. I would better use fedora executors with dnf for fedora mock jobs. This is part of reality that using yum with FC25 is no longer supported and will never be supported, that mock uses external package management tool to install packages and that there is no dnf in centos7. All this combined means that we cannot normally use Fedora mock on CentOS right now. And since we have Fedora slaves we can run such jobs on Fedora. > Unable to build fc25 chroots with mock > -------------------------------------- > > Key: OVIRT-935 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-935 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Nadav Goldin > Assignee: infra > > Mock fails when trying to build the chroot for fedora25, on installing '@buildsys-build' group(with dnf) stage. > Open bug: https://bugzilla.redhat.com/show_bug.cgi?id=1360781 > Temporarily workaround: add the 'libcrypt' package to '.packages.fc25' file. > Possible solution: patch mock-*fc25*.cfg file in Jenkins repository to always install 'libcrypt' first. > Until fixed this will block us from building anything with mock on fc25(hit it when trying to build fc25 RPMs for lago). > Error logs: > {code} > DEBUG util.py:502: Executing command: ['/usr/bin/yum-deprecated', '--installroot', '/var/lib/mock/fedora-25-x86_64-2474d86945a1de9c6d14549ec2401b9c-8291/root/', '--releasever', '25', 'install', '@buildsys-build', 'git', 'python', 'python-dulwich', 'python-setuptools', 'yum', 'yum-utils', '--setopt=tsflags=nocontexts'] with env {'PS1': '<mock-chroot> \\s-\\v\\$ ', > .... > DEBUG util.py:421: Yum command has been deprecated, use dnf instead. > DEBUG util.py:421: See 'man dnf' and 'man yum2dnf' for more information. > DEBUG util.py:421: Error: libcrypt conflicts with libcrypt-nss-2.24-3.fc25.x86_64 > DEBUG util.py:421: Error: libcrypt-nss conflicts with libcrypt-2.24-3.fc25.x86_64 > DEBUG util.py:421: You could try using --skip-broken to work around the problem > DEBUG util.py:421: You could try running: rpm -Va --nofiles --nodigest > DEBUG util.py:557: Child return code was: 1 > DEBUG util.py:180: kill orphans > {code} -- This message was sent by Atlassian JIRA (v1000.621.5#100023)

1 0

[JIRA] (OVIRT-945) Add upgrade suites for 4.1
by Daniel Belenky (oVirt JIRA) 20 Dec '16

20 Dec '16

Daniel Belenky created OVIRT-945: ------------------------------------ Summary: Add upgrade suites for 4.1 Key: OVIRT-945 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-945 Project: oVirt - virtualization made easy Issue Type: Task Reporter: Daniel Belenky Assignee: infra -- This message was sent by Atlassian JIRA (v1000.621.5#100023)

1 0

[JIRA] (OVIRT-945) Add upgrade suites for 4.1
by Daniel Belenky (oVirt JIRA) 20 Dec '16

20 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-945?page=com.atlassian.jira.p… ] Daniel Belenky reassigned OVIRT-945: ------------------------------------ Assignee: (was: infra) > Add upgrade suites for 4.1 > -------------------------- > > Key: OVIRT-945 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-945 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Daniel Belenky > -- This message was sent by Atlassian JIRA (v1000.621.5#100023)

1 0

[oVirt Jenkins] test-repo_ovirt_experimental_4.1 - Build #8 - SUCCESS!
by jenkins＠jenkins.phx.ovirt.org 20 Dec '16

20 Dec '16

------=_Part_548_537680974.1482223668400 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Build: http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_4.1/8/, Build Number: 8, Build Status: SUCCESS ------=_Part_548_537680974.1482223668400--

1 0

Build failed in Jenkins: ovirt_4.1_system-tests #1
by jenkins＠jenkins.phx.ovirt.org 20 Dec '16

20 Dec '16

See <http://jenkins.ovirt.org/job/ovirt_4.1_system-tests/1/> ------------------------------------------ [...truncated 74 lines...] Emptying some common logs /var/log/wtmp Done /home/jenkins/workspace/basic_suite_master.sh-el7 /home/jenkins/workspace/test-repo_ovirt_experimental_master Making sure there are no device mappings... Removing the used loop devices... Redirecting to /bin/systemctl restart libvirtd.service --------------------------------------------------------------- Filesystem Size Used Avail Use% Mounted on devtmpfs 24G 0 24G 0% /dev tmpfs 24G 0 24G 0% /dev/shm tmpfs 24G 3.2M 24G 1% /run tmpfs 24G 0 24G 0% /sys/fs/cgroup /dev/sda3 908G 22G 886G 3% / tmpfs 24G 336K 24G 1% /tmp /dev/sda1 253M 121M 132M 48% /boot tmpfs 4.8G 0 4.8G 0% /run/user/1012 ################################################################### # Slave cleanup done # ################################################################### [ovirt_4.1_system-tests] $ /bin/bash -xe /tmp/hudson3221576944294627045.sh + echo shell-scripts/system_tests.sh shell-scripts/system_tests.sh + VERSION=4.1 + SUITE_TYPE=basic + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_4.1_system-tests/ws/> + OVIRT_SUITE=basic_suite_4.1 + PREFIX=<http://jenkins.ovirt.org/job/ovirt_4.1_system-tests/ws/ovirt-system-tests/d…> + chmod g+x <http://jenkins.ovirt.org/job/ovirt_4.1_system-tests/ws/> + rm -rf <http://jenkins.ovirt.org/job/ovirt_4.1_system-tests/ws/ovirt-system-tests/d…> + cd ovirt-system-tests + ../jenkins/mock_configs/mock_runner.sh --mock-confs-dir ../jenkins/mock_configs --try-proxy --execute-script automation/basic_suite_4.1.sh el7 ########################################################## ########################################################## ## Mon Dec 19 14:42:52 UTC 2016 Running env: el7:epel-7-x86_64 ########################################################## ERROR: Script automation/basic_suite_4.1.sh does not exist or is not readable. ########################################################## ## Mon Dec 19 14:42:52 UTC 2016 Finished env: el7:epel-7-x86_64 ## took 0 seconds ## rc = 1 ########################################################## No log files found, check command output ##!######################################################## ########################################################## Build step 'Execute shell' marked build as failure Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo 'shell_scripts/system_tests.collect_logs.sh' # # Required jjb vars: # version # VERSION=4.1 SUITE_TYPE= WORKSPACE="$PWD" OVIRT_SUITE="$SUITE_TYPE_suite_$VERSION" TESTS_LOGS="$WORKSPACE/ovirt-system-tests/exported-artifacts" rm -rf "$WORKSPACE/exported-artifacts" mkdir -p "$WORKSPACE/exported-artifacts" if [[ -d "$TESTS_LOGS" ]]; then mv "$TESTS_LOGS/"* "$WORKSPACE/exported-artifacts/" fi [ovirt_4.1_system-tests] $ /bin/bash -xe /tmp/hudson4079159423720154558.sh + echo shell_scripts/system_tests.collect_logs.sh shell_scripts/system_tests.collect_logs.sh + VERSION=4.1 + SUITE_TYPE= + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_4.1_system-tests/ws/> + OVIRT_SUITE=4.1 + TESTS_LOGS=<http://jenkins.ovirt.org/job/ovirt_4.1_system-tests/ws/ovirt-system-tests/e…> + rm -rf <http://jenkins.ovirt.org/job/ovirt_4.1_system-tests/1/artifact/exported-art…> + mkdir -p <http://jenkins.ovirt.org/job/ovirt_4.1_system-tests/1/artifact/exported-art…> + [[ -d <http://jenkins.ovirt.org/job/ovirt_4.1_system-tests/ws/ovirt-system-tests/e…> ]] POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 0 Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -x echo "shell-scripts/mock_cleanup.sh" # Make clear this is the cleanup, helps reading the jenkins logs cat <<EOC _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### EOC shopt -s nullglob WORKSPACE="${WORKSPACE:-$PWD}" UMOUNT_RETRIES="${UMOUNT_RETRIES:-3}" UMOUNT_RETRY_DELAY="${UMOUNT_RETRY_DELAY:-1s}" safe_umount() { local mount="${1:?}" local attempt for ((attempt=0 ; attempt < $UMOUNT_RETRIES ; attempt++)); do # If this is not the 1st time through the loop, Sleep a while to let # the problem "solve itself" [[ attempt > 0 ]] && sleep "$UMOUNT_RETRY_DELAY" # Try to umount sudo umount --lazy "$mount" && return 0 # See if the mount is already not there despite failing findmnt --kernel --first "$mount" > /dev/null && return 0 done echo "ERROR: Failed to umount $mount." return 1 } # restore the permissions in the working dir, as sometimes it leaves files # owned by root and then the 'cleanup workspace' from jenkins job fails to # clean and breaks the jobs sudo chown -R "$USER" "$WORKSPACE" # Archive the logs, we want them anyway logs=( ./*log ./*/logs ) if [[ "$logs" ]]; then for log in "${logs[@]}"; do [[ "$log" = ./exported-artifacts/* ]] && continue echo "Copying ${log} to exported-artifacts" mv $log exported-artifacts/ done fi # stop any processes running inside the chroot failed=false mock_confs=("$WORKSPACE"/*/mocker*) # Clean current jobs mockroot if any for mock_conf_file in "${mock_confs[@]}"; do [[ "$mock_conf_file" ]] || continue echo "Cleaning up mock $mock_conf" mock_root="${mock_conf_file##*/}" mock_root="${mock_root%.*}" my_mock="/usr/bin/mock" my_mock+=" --configdir=${mock_conf_file%/*}" my_mock+=" --root=${mock_root}" my_mock+=" --resultdir=$WORKSPACE" #TODO: investigate why mock --clean fails to umount certain dirs sometimes, #so we can use it instead of manually doing all this. echo "Killing all mock orphan processes, if any." $my_mock \ --orphanskill \ || { echo "ERROR: Failed to kill orphans on $chroot." failed=true } mock_root="$(\ grep \ -Po "(?<=config_opts\['root'\] = ')[^']*" \ "$mock_conf_file" \ )" || : [[ "$mock_root" ]] || continue mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $chroot. Trying to umount." fi for mount in "${mounts[@]}"; do safe_umount "$mount" || failed=true done done # Clean any leftover chroot from other jobs for mock_root in /var/lib/mock/*; do this_chroot_failed=false mounts=($(cut -d\ -f2 /proc/mounts | grep "$mock_root" | sort -r)) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $mock_root." \ "Trying to umount." fi for mount in "${mounts[@]}"; do safe_umount "$mount" && continue # If we got here, we failed $UMOUNT_RETRIES attempts so we should make # noise failed=true this_chroot_failed=true done if ! $this_chroot_failed; then sudo rm -rf "$mock_root" fi done # remove mock caches that are older then 2 days: find /var/cache/mock/ -mindepth 1 -maxdepth 1 -type d -mtime +2 -print0 | \ xargs -0 -tr sudo rm -rf # We make no effort to leave around caches that may still be in use because # packages installed in them may go out of date, so may as well recreate them # Drop all left over libvirt domains for UUID in $(virsh list --all --uuid); do virsh destroy $UUID || : sleep 2 virsh undefine --remove-all-storage --storage vda --snapshots-metadata $UUID || : done if $failed; then echo "Cleanup script failed, propegating failure to job" exit 1 fi [ovirt_4.1_system-tests] $ /bin/bash -x /tmp/hudson5498140227125921290.sh + echo shell-scripts/mock_cleanup.sh shell-scripts/mock_cleanup.sh + cat _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### + shopt -s nullglob + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_4.1_system-tests/ws/> + UMOUNT_RETRIES=3 + UMOUNT_RETRY_DELAY=1s + sudo chown -R jenkins <http://jenkins.ovirt.org/job/ovirt_4.1_system-tests/ws/> + logs=(./*log ./*/logs) + [[ -n ./ovirt-system-tests/logs ]] + for log in '"${logs[@]}"' + [[ ./ovirt-system-tests/logs = ./exported-artifacts/* ]] + echo 'Copying ./ovirt-system-tests/logs to exported-artifacts' Copying ./ovirt-system-tests/logs to exported-artifacts + mv ./ovirt-system-tests/logs exported-artifacts/ + failed=false + mock_confs=("$WORKSPACE"/*/mocker*) + find /var/cache/mock/ -mindepth 1 -maxdepth 1 -type d -mtime +2 -print0 + xargs -0 -tr sudo rm -rf ++ virsh list --all --uuid + false POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 1 Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Archiving artifacts

1 6

Build failed in Jenkins: ovirt_master_system-tests #871
by jenkins＠jenkins.phx.ovirt.org 20 Dec '16

20 Dec '16

See <http://jenkins.ovirt.org/job/ovirt_master_system-tests/871/changes> Changes: [Yaniv Kaul] Move log-collector to use /dev/shm for faster execution [Evgheni Dereveanchin] OVIRT-645 remove repoproxy for Fedora and EL6 x86_64 [Barak Korren] Make mock_cleanup.sh safer about un-mouting [Barak Korren] Fix mock_genconfig nested dict settings ------------------------------------------ [...truncated 779 lines...] + [[ -e <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> ]] + echo '----------- Cleaning with lago' ----------- Cleaning with lago + lago --workdir <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> destroy --yes --all-prefixes + echo '----------- Cleaning with lago done' ----------- Cleaning with lago done + [[ 0 != \0 ]] + echo '======== Cleanup done' ======== Cleanup done + exit 0 + exit Took 640 seconds =================================== ##! ##! ERROR ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ##!######################################################## ########################################################## Build step 'Execute shell' marked build as failure Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo 'shell_scripts/system_tests.collect_logs.sh' # # Required jjb vars: # version # VERSION=master SUITE_TYPE= WORKSPACE="$PWD" OVIRT_SUITE="$SUITE_TYPE_suite_$VERSION" TESTS_LOGS="$WORKSPACE/ovirt-system-tests/exported-artifacts" rm -rf "$WORKSPACE/exported-artifacts" mkdir -p "$WORKSPACE/exported-artifacts" if [[ -d "$TESTS_LOGS" ]]; then mv "$TESTS_LOGS/"* "$WORKSPACE/exported-artifacts/" fi [ovirt_master_system-tests] $ /bin/bash -xe /tmp/hudson2709353388353252686.sh + echo shell_scripts/system_tests.collect_logs.sh shell_scripts/system_tests.collect_logs.sh + VERSION=master + SUITE_TYPE= + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/> + OVIRT_SUITE=master + TESTS_LOGS=<http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> + rm -rf <http://jenkins.ovirt.org/job/ovirt_master_system-tests/871/artifact/exporte…> + mkdir -p <http://jenkins.ovirt.org/job/ovirt_master_system-tests/871/artifact/exporte…> + [[ -d <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> ]] + mv <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> <http://jenkins.ovirt.org/job/ovirt_master_system-tests/871/artifact/exporte…> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 0 Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -x echo "shell-scripts/mock_cleanup.sh" # Make clear this is the cleanup, helps reading the jenkins logs cat <<EOC _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### EOC shopt -s nullglob WORKSPACE="${WORKSPACE:-$PWD}" UMOUNT_RETRIES="${UMOUNT_RETRIES:-3}" UMOUNT_RETRY_DELAY="${UMOUNT_RETRY_DELAY:-1s}" safe_umount() { local mount="${1:?}" local attempt for ((attempt=0 ; attempt < $UMOUNT_RETRIES ; attempt++)); do # If this is not the 1st time through the loop, Sleep a while to let # the problem "solve itself" [[ attempt > 0 ]] && sleep "$UMOUNT_RETRY_DELAY" # Try to umount sudo umount --lazy "$mount" && return 0 # See if the mount is already not there despite failing findmnt --kernel --first "$mount" > /dev/null && return 0 done echo "ERROR: Failed to umount $mount." return 1 } # restore the permissions in the working dir, as sometimes it leaves files # owned by root and then the 'cleanup workspace' from jenkins job fails to # clean and breaks the jobs sudo chown -R "$USER" "$WORKSPACE" # Archive the logs, we want them anyway logs=( ./*log ./*/logs ) if [[ "$logs" ]]; then for log in "${logs[@]}"; do [[ "$log" = ./exported-artifacts/* ]] && continue echo "Copying ${log} to exported-artifacts" mv $log exported-artifacts/ done fi # stop any processes running inside the chroot failed=false mock_confs=("$WORKSPACE"/*/mocker*) # Clean current jobs mockroot if any for mock_conf_file in "${mock_confs[@]}"; do [[ "$mock_conf_file" ]] || continue echo "Cleaning up mock $mock_conf" mock_root="${mock_conf_file##*/}" mock_root="${mock_root%.*}" my_mock="/usr/bin/mock" my_mock+=" --configdir=${mock_conf_file%/*}" my_mock+=" --root=${mock_root}" my_mock+=" --resultdir=$WORKSPACE" #TODO: investigate why mock --clean fails to umount certain dirs sometimes, #so we can use it instead of manually doing all this. echo "Killing all mock orphan processes, if any." $my_mock \ --orphanskill \ || { echo "ERROR: Failed to kill orphans on $chroot." failed=true } mock_root="$(\ grep \ -Po "(?<=config_opts\['root'\] = ')[^']*" \ "$mock_conf_file" \ )" || : [[ "$mock_root" ]] || continue mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $chroot. Trying to umount." fi for mount in "${mounts[@]}"; do safe_umount "$mount" || failed=true done done # Clean any leftover chroot from other jobs for mock_root in /var/lib/mock/*; do this_chroot_failed=false mounts=($(cut -d\ -f2 /proc/mounts | grep "$mock_root" | sort -r)) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $mock_root." \ "Trying to umount." fi for mount in "${mounts[@]}"; do safe_umount "$mount" && continue # If we got here, we failed $UMOUNT_RETRIES attempts so we should make # noise failed=true this_chroot_failed=true done if ! $this_chroot_failed; then sudo rm -rf "$mock_root" fi done # remove mock caches that are older then 2 days: find /var/cache/mock/ -mindepth 1 -maxdepth 1 -type d -mtime +2 -print0 | \ xargs -0 -tr sudo rm -rf # We make no effort to leave around caches that may still be in use because # packages installed in them may go out of date, so may as well recreate them # Drop all left over libvirt domains for UUID in $(virsh list --all --uuid); do virsh destroy $UUID || : sleep 2 virsh undefine --remove-all-storage --storage vda --snapshots-metadata $UUID || : done if $failed; then echo "Cleanup script failed, propegating failure to job" exit 1 fi [ovirt_master_system-tests] $ /bin/bash -x /tmp/hudson7578817524005175999.sh + echo shell-scripts/mock_cleanup.sh shell-scripts/mock_cleanup.sh + cat _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### + shopt -s nullglob + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/> + UMOUNT_RETRIES=3 + UMOUNT_RETRY_DELAY=1s + sudo chown -R jenkins <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/> + logs=(./*log ./*/logs) + [[ -n ./ovirt-system-tests/logs ]] + for log in '"${logs[@]}"' + [[ ./ovirt-system-tests/logs = ./exported-artifacts/* ]] + echo 'Copying ./ovirt-system-tests/logs to exported-artifacts' Copying ./ovirt-system-tests/logs to exported-artifacts + mv ./ovirt-system-tests/logs exported-artifacts/ + failed=false + mock_confs=("$WORKSPACE"/*/mocker*) + for mock_conf_file in '"${mock_confs[@]}"' + [[ -n <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> ]] + echo 'Cleaning up mock ' Cleaning up mock + mock_root=mocker-epel-7-x86_64.el7.cfg + mock_root=mocker-epel-7-x86_64.el7 + my_mock=/usr/bin/mock + my_mock+=' --configdir=<http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-tests'> + my_mock+=' --root=mocker-epel-7-x86_64.el7' + my_mock+=' --resultdir=<http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/'> + echo 'Killing all mock orphan processes, if any.' Killing all mock orphan processes, if any. + /usr/bin/mock --configdir=<http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-tests> --root=mocker-epel-7-x86_64.el7 --resultdir=<http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/> --orphanskill WARNING: Could not find required logging config file: <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test….> Using default... INFO: mock.py version 1.2.21 starting (python version = 3.5.1)... Start: init plugins INFO: selinux enabled Finish: init plugins Start: run Finish: run ++ grep -Po '(?<=config_opts\['\''root'\''\] = '\'')[^'\'']*' <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> + mock_root=epel-7-x86_64-b8fbc97503d2f9478015768d3094ffe4 + [[ -n epel-7-x86_64-b8fbc97503d2f9478015768d3094ffe4 ]] + mounts=($(mount | awk '{print $3}' | grep "$mock_root")) ++ mount ++ awk '{print $3}' ++ grep epel-7-x86_64-b8fbc97503d2f9478015768d3094ffe4 + : + [[ -n '' ]] + find /var/cache/mock/ -mindepth 1 -maxdepth 1 -type d -mtime +2 -print0 + xargs -0 -tr sudo rm -rf ++ virsh list --all --uuid + false POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 1 Recording test results Archiving artifacts

1 5

Ability to run [job-name] when a tag is pushed to Gerrit
by Vojtech Szocs 19 Dec '16

19 Dec '16

Hi, this was discussed loong time ago.. how much effort would it take for oVirt CI infra to support running e.g. [build-artifacts] when a git tag is pushed to Gerrit repo? Imagine the following situation: 1, new tag is pushed -or- existing tag gets updated (force push) 2, CI infra detects the new/updated tag and runs [job-name-here] on the relevant (tagged) commit I'm asking this because in oVirt Dashboard, we're making releases from tagged commits, so we basically: - merge patch that prepares the (stable) branch for release - tag the release-prep patch & push tag to Gerrit - re-trigger [build-artifacts] for the release-prep patch Thanks, Vojtech

3 5

[oVirt Jenkins] test-repo_ovirt_experimental_master - Build #4216 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 19 Dec '16

19 Dec '16

------=_Part_314_1505723065.1481811489049 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Build: http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/4216/, Build Number: 4216, Build Status: FAILURE ------=_Part_314_1505723065.1481811489049--

1 83

[oVirt Jenkins] test-repo_ovirt_experimental_3.6 - Build #4493 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 19 Dec '16

19 Dec '16

------=_Part_404_120101232.1481898344969 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Build: http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_3.6/4493/, Build Number: 4493, Build Status: FAILURE ------=_Part_404_120101232.1481898344969--

1 1

oVirt 4.1.0 beta2 merge / branch / tag / bugzilla reminder
by Sandro Bonazzola 19 Dec '16

19 Dec '16

All stable branch maintainers, please make sure to merge all relevant open bugs until Wednesday December 21st morning 11:00 AM TLV time (10:00 AM CET). In order to stabilize the build and allow to prepare jenkins on time, 4.1 branches need to be created before or on Monday Dec 19th. oVirt engine will be branched on Monday Dec 19th at 11:00 AM TLV time (10:00 AM CET). This build is also marking the string freeze milestone. After this build please avoid to push new strings to be translated to allow translators to complete translations for RC. For each package that need to be built (i.e oVirt product) please make sure every bug in MODIFIED has the right Target Release and Target Milestone. A Target release should state the final version of the package you're building (e.g. for ovirt-engine, tag: ovirt-engine-4.1.0_beta2, tr: 4.1.0) A list of bugs that require attention is here: https://bugzilla.redhat.com/buglist.cgi?quicksearch=target_milestone%3A4.1.… -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 1

[oVirt Jenkins] test-repo_ovirt_experimental_4.0 - Build #3582 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 19 Dec '16

19 Dec '16

------=_Part_497_1866573285.1482142454455 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Build: http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_4.0/3582/, Build Number: 3582, Build Status: FAILURE ------=_Part_497_1866573285.1482142454455--

1 3

Build failed in Jenkins: ovirt_3.6_system-tests #827
by jenkins＠jenkins.phx.ovirt.org 19 Dec '16

19 Dec '16

See <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/827/changes> Changes: [Yaniv Kaul] Move log-collector to use /dev/shm for faster execution [Sandro Bonazzola] repo_closure_check: fix el7 repos for metrics [Sandro Bonazzola] repos-check-closure: add 4.1 repos [Sandro Bonazzola] ovirt-live: add 4.1 branch jobs ------------------------------------------ [...truncated 789 lines...] + [[ -e <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/d…> ]] + echo '----------- Cleaning with lago' ----------- Cleaning with lago + lago --workdir <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/d…> destroy --yes --all-prefixes + echo '----------- Cleaning with lago done' ----------- Cleaning with lago done + [[ 0 != \0 ]] + echo '======== Cleanup done' ======== Cleanup done + exit 0 + exit Took 528 seconds =================================== ##! ##! ERROR ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ##!######################################################## ########################################################## Build step 'Execute shell' marked build as failure Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo 'shell_scripts/system_tests.collect_logs.sh' # # Required jjb vars: # version # VERSION=3.6 SUITE_TYPE= WORKSPACE="$PWD" OVIRT_SUITE="$SUITE_TYPE_suite_$VERSION" TESTS_LOGS="$WORKSPACE/ovirt-system-tests/exported-artifacts" rm -rf "$WORKSPACE/exported-artifacts" mkdir -p "$WORKSPACE/exported-artifacts" if [[ -d "$TESTS_LOGS" ]]; then mv "$TESTS_LOGS/"* "$WORKSPACE/exported-artifacts/" fi [ovirt_3.6_system-tests] $ /bin/bash -xe /tmp/hudson8592848801410316506.sh + echo shell_scripts/system_tests.collect_logs.sh shell_scripts/system_tests.collect_logs.sh + VERSION=3.6 + SUITE_TYPE= + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> + OVIRT_SUITE=3.6 + TESTS_LOGS=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> + rm -rf <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/827/artifact/exported-a…> + mkdir -p <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/827/artifact/exported-a…> + [[ -d <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> ]] + mv <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/827/artifact/exported-a…> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 0 Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -x echo "shell-scripts/mock_cleanup.sh" # Make clear this is the cleanup, helps reading the jenkins logs cat <<EOC _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### EOC shopt -s nullglob WORKSPACE="${WORKSPACE:-$PWD}" UMOUNT_RETRIES="${UMOUNT_RETRIES:-3}" UMOUNT_RETRY_DELAY="${UMOUNT_RETRY_DELAY:-1s}" safe_umount() { local mount="${1:?}" local attempt for ((attempt=0 ; attempt < $UMOUNT_RETRIES ; attempt++)); do # If this is not the 1st time through the loop, Sleep a while to let # the problem "solve itself" [[ attempt > 0 ]] && sleep "$UMOUNT_RETRY_DELAY" # Try to umount sudo umount --lazy "$mount" && return 0 # See if the mount is already not there despite failing findmnt --kernel --first "$mount" > /dev/null && return 0 done echo "ERROR: Failed to umount $mount." return 1 } # restore the permissions in the working dir, as sometimes it leaves files # owned by root and then the 'cleanup workspace' from jenkins job fails to # clean and breaks the jobs sudo chown -R "$USER" "$WORKSPACE" # Archive the logs, we want them anyway logs=( ./*log ./*/logs ) if [[ "$logs" ]]; then for log in "${logs[@]}"; do [[ "$log" = ./exported-artifacts/* ]] && continue echo "Copying ${log} to exported-artifacts" mv $log exported-artifacts/ done fi # stop any processes running inside the chroot failed=false mock_confs=("$WORKSPACE"/*/mocker*) # Clean current jobs mockroot if any for mock_conf_file in "${mock_confs[@]}"; do [[ "$mock_conf_file" ]] || continue echo "Cleaning up mock $mock_conf" mock_root="${mock_conf_file##*/}" mock_root="${mock_root%.*}" my_mock="/usr/bin/mock" my_mock+=" --configdir=${mock_conf_file%/*}" my_mock+=" --root=${mock_root}" my_mock+=" --resultdir=$WORKSPACE" #TODO: investigate why mock --clean fails to umount certain dirs sometimes, #so we can use it instead of manually doing all this. echo "Killing all mock orphan processes, if any." $my_mock \ --orphanskill \ || { echo "ERROR: Failed to kill orphans on $chroot." failed=true } mock_root="$(\ grep \ -Po "(?<=config_opts\['root'\] = ')[^']*" \ "$mock_conf_file" \ )" || : [[ "$mock_root" ]] || continue mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $chroot. Trying to umount." fi for mount in "${mounts[@]}"; do safe_umount "$mount" || failed=true done done # Clean any leftover chroot from other jobs for mock_root in /var/lib/mock/*; do this_chroot_failed=false mounts=($(cut -d\ -f2 /proc/mounts | grep "$mock_root" | sort -r)) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $mock_root." \ "Trying to umount." fi for mount in "${mounts[@]}"; do safe_umount "$mount" && continue # If we got here, we failed $UMOUNT_RETRIES attempts so we should make # noise failed=true this_chroot_failed=true done if ! $this_chroot_failed; then sudo rm -rf "$mock_root" fi done # remove mock caches that are older then 2 days: find /var/cache/mock/ -mindepth 1 -maxdepth 1 -type d -mtime +2 -print0 | \ xargs -0 -tr sudo rm -rf # We make no effort to leave around caches that may still be in use because # packages installed in them may go out of date, so may as well recreate them # Drop all left over libvirt domains for UUID in $(virsh list --all --uuid); do virsh destroy $UUID || : sleep 2 virsh undefine --remove-all-storage --storage vda --snapshots-metadata $UUID || : done if $failed; then echo "Cleanup script failed, propegating failure to job" exit 1 fi [ovirt_3.6_system-tests] $ /bin/bash -x /tmp/hudson5394810375570137830.sh + echo shell-scripts/mock_cleanup.sh shell-scripts/mock_cleanup.sh + cat _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### + shopt -s nullglob + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> + UMOUNT_RETRIES=3 + UMOUNT_RETRY_DELAY=1s + sudo chown -R jenkins <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> + logs=(./*log ./*/logs) + [[ -n ./ovirt-system-tests/logs ]] + for log in '"${logs[@]}"' + [[ ./ovirt-system-tests/logs = ./exported-artifacts/* ]] + echo 'Copying ./ovirt-system-tests/logs to exported-artifacts' Copying ./ovirt-system-tests/logs to exported-artifacts + mv ./ovirt-system-tests/logs exported-artifacts/ + failed=false + mock_confs=("$WORKSPACE"/*/mocker*) + for mock_conf_file in '"${mock_confs[@]}"' + [[ -n <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/m…> ]] + echo 'Cleaning up mock ' Cleaning up mock + mock_root=mocker-epel-7-x86_64.el7.cfg + mock_root=mocker-epel-7-x86_64.el7 + my_mock=/usr/bin/mock + my_mock+=' --configdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests'> + my_mock+=' --root=mocker-epel-7-x86_64.el7' + my_mock+=' --resultdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/'> + echo 'Killing all mock orphan processes, if any.' Killing all mock orphan processes, if any. + /usr/bin/mock --configdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests> --root=mocker-epel-7-x86_64.el7 --resultdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> --orphanskill WARNING: Could not find required logging config file: <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/l….> Using default... INFO: mock.py version 1.2.21 starting (python version = 3.5.2)... Start: init plugins INFO: selinux enabled Finish: init plugins Start: run Finish: run ++ grep -Po '(?<=config_opts\['\''root'\''\] = '\'')[^'\'']*' <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/m…> + mock_root=epel-7-x86_64-aa7d25407b9c15b3736f25fc4fcf3710 + [[ -n epel-7-x86_64-aa7d25407b9c15b3736f25fc4fcf3710 ]] + mounts=($(mount | awk '{print $3}' | grep "$mock_root")) ++ mount ++ awk '{print $3}' ++ grep epel-7-x86_64-aa7d25407b9c15b3736f25fc4fcf3710 + : + [[ -n '' ]] + find /var/cache/mock/ -mindepth 1 -maxdepth 1 -type d -mtime +2 -print0 + xargs -0 -tr sudo rm -rf ++ virsh list --all --uuid + false POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 1 Recording test results Archiving artifacts

1 3

Build failed in Jenkins: ovirt_4.0_system-tests #746
by jenkins＠jenkins.phx.ovirt.org 19 Dec '16

19 Dec '16

See <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/746/changes> Changes: [Sandro Bonazzola] 3.6 repo: Fix typo: ovirt-optimizier ------------------------------------------ [...truncated 765 lines...] + [[ -e <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/d…> ]] + echo '----------- Cleaning with lago' ----------- Cleaning with lago + lago --workdir <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/d…> destroy --yes --all-prefixes + echo '----------- Cleaning with lago done' ----------- Cleaning with lago done + [[ 0 != \0 ]] + echo '======== Cleanup done' ======== Cleanup done + exit 0 + exit Took 560 seconds =================================== ##! ##! ERROR ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ##!######################################################## ########################################################## Build step 'Execute shell' marked build as failure Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo 'shell_scripts/system_tests.collect_logs.sh' # # Required jjb vars: # version # VERSION=4.0 SUITE_TYPE= WORKSPACE="$PWD" OVIRT_SUITE="$SUITE_TYPE_suite_$VERSION" TESTS_LOGS="$WORKSPACE/ovirt-system-tests/exported-artifacts" rm -rf "$WORKSPACE/exported-artifacts" mkdir -p "$WORKSPACE/exported-artifacts" if [[ -d "$TESTS_LOGS" ]]; then mv "$TESTS_LOGS/"* "$WORKSPACE/exported-artifacts/" fi [ovirt_4.0_system-tests] $ /bin/bash -xe /tmp/hudson5562949287383041800.sh + echo shell_scripts/system_tests.collect_logs.sh shell_scripts/system_tests.collect_logs.sh + VERSION=4.0 + SUITE_TYPE= + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/> + OVIRT_SUITE=4.0 + TESTS_LOGS=<http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/e…> + rm -rf <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/746/artifact/exported-a…> + mkdir -p <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/746/artifact/exported-a…> + [[ -d <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/e…> ]] + mv <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/746/artifact/exported-a…> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 0 Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -x echo "shell-scripts/mock_cleanup.sh" # Make clear this is the cleanup, helps reading the jenkins logs cat <<EOC _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### EOC shopt -s nullglob WORKSPACE="${WORKSPACE:-$PWD}" UMOUNT_RETRIES="${UMOUNT_RETRIES:-3}" UMOUNT_RETRY_DELAY="${UMOUNT_RETRY_DELAY:-1s}" safe_umount() { local mount="${1:?}" local attempt for ((attempt=0 ; attempt < $UMOUNT_RETRIES ; attempt++)); do # If this is not the 1st time through the loop, Sleep a while to let # the problem "solve itself" [[ attempt > 0 ]] && sleep "$UMOUNT_RETRY_DELAY" # Try to umount sudo umount --lazy "$mount" && return 0 # See if the mount is already not there despite failing findmnt --kernel --first "$mount" > /dev/null && return 0 done echo "ERROR: Failed to umount $mount." return 1 } # restore the permissions in the working dir, as sometimes it leaves files # owned by root and then the 'cleanup workspace' from jenkins job fails to # clean and breaks the jobs sudo chown -R "$USER" "$WORKSPACE" # Archive the logs, we want them anyway logs=( ./*log ./*/logs ) if [[ "$logs" ]]; then for log in "${logs[@]}"; do [[ "$log" = ./exported-artifacts/* ]] && continue echo "Copying ${log} to exported-artifacts" mv $log exported-artifacts/ done fi # stop any processes running inside the chroot failed=false mock_confs=("$WORKSPACE"/*/mocker*) # Clean current jobs mockroot if any for mock_conf_file in "${mock_confs[@]}"; do [[ "$mock_conf_file" ]] || continue echo "Cleaning up mock $mock_conf" mock_root="${mock_conf_file##*/}" mock_root="${mock_root%.*}" my_mock="/usr/bin/mock" my_mock+=" --configdir=${mock_conf_file%/*}" my_mock+=" --root=${mock_root}" my_mock+=" --resultdir=$WORKSPACE" #TODO: investigate why mock --clean fails to umount certain dirs sometimes, #so we can use it instead of manually doing all this. echo "Killing all mock orphan processes, if any." $my_mock \ --orphanskill \ || { echo "ERROR: Failed to kill orphans on $chroot." failed=true } mock_root="$(\ grep \ -Po "(?<=config_opts\['root'\] = ')[^']*" \ "$mock_conf_file" \ )" || : [[ "$mock_root" ]] || continue mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $chroot. Trying to umount." fi for mount in "${mounts[@]}"; do safe_umount "$mount" || failed=true done done # Clean any leftover chroot from other jobs for mock_root in /var/lib/mock/*; do this_chroot_failed=false mounts=($(cut -d\ -f2 /proc/mounts | grep "$mock_root" | sort -r)) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $mock_root." \ "Trying to umount." fi for mount in "${mounts[@]}"; do safe_umount "$mount" && continue # If we got here, we failed $UMOUNT_RETRIES attempts so we should make # noise failed=true this_chroot_failed=true done if ! $this_chroot_failed; then sudo rm -rf "$mock_root" fi done # remove mock caches that are older then 2 days: find /var/cache/mock/ -mindepth 1 -maxdepth 1 -type d -mtime +2 -print0 | \ xargs -0 -tr sudo rm -rf # We make no effort to leave around caches that may still be in use because # packages installed in them may go out of date, so may as well recreate them # Drop all left over libvirt domains for UUID in $(virsh list --all --uuid); do virsh destroy $UUID || : sleep 2 virsh undefine --remove-all-storage --storage vda --snapshots-metadata $UUID || : done if $failed; then echo "Cleanup script failed, propegating failure to job" exit 1 fi [ovirt_4.0_system-tests] $ /bin/bash -x /tmp/hudson5757423838546789539.sh + echo shell-scripts/mock_cleanup.sh shell-scripts/mock_cleanup.sh + cat _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### + shopt -s nullglob + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/> + UMOUNT_RETRIES=3 + UMOUNT_RETRY_DELAY=1s + sudo chown -R jenkins <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/> + logs=(./*log ./*/logs) + [[ -n ./ovirt-system-tests/logs ]] + for log in '"${logs[@]}"' + [[ ./ovirt-system-tests/logs = ./exported-artifacts/* ]] + echo 'Copying ./ovirt-system-tests/logs to exported-artifacts' Copying ./ovirt-system-tests/logs to exported-artifacts + mv ./ovirt-system-tests/logs exported-artifacts/ + failed=false + mock_confs=("$WORKSPACE"/*/mocker*) + for mock_conf_file in '"${mock_confs[@]}"' + [[ -n <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/m…> ]] + echo 'Cleaning up mock ' Cleaning up mock + mock_root=mocker-epel-7-x86_64.el7.cfg + mock_root=mocker-epel-7-x86_64.el7 + my_mock=/usr/bin/mock + my_mock+=' --configdir=<http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests'> + my_mock+=' --root=mocker-epel-7-x86_64.el7' + my_mock+=' --resultdir=<http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/'> + echo 'Killing all mock orphan processes, if any.' Killing all mock orphan processes, if any. + /usr/bin/mock --configdir=<http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests> --root=mocker-epel-7-x86_64.el7 --resultdir=<http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/> --orphanskill WARNING: Could not find required logging config file: <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/l….> Using default... INFO: mock.py version 1.2.21 starting (python version = 3.5.1)... Start: init plugins INFO: selinux enabled Finish: init plugins Start: run Finish: run ++ grep -Po '(?<=config_opts\['\''root'\''\] = '\'')[^'\'']*' <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/m…> + mock_root=epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e + [[ -n epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e ]] + mounts=($(mount | awk '{print $3}' | grep "$mock_root")) ++ mount ++ awk '{print $3}' ++ grep epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e + : + [[ -n '' ]] + find /var/cache/mock/ -mindepth 1 -maxdepth 1 -type d -mtime +2 -print0 + xargs -0 -tr sudo rm -rf ++ virsh list --all --uuid + false POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 1 Recording test results Archiving artifacts

1 1

[HEADS UP] ovirt-engine-4.1 branch has been created
by Sandro Bonazzola 19 Dec '16

19 Dec '16

As per subject. -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

[JIRA] (OVIRT-920) Add a standard-CI job and button "build-scratch-artifacts"
by eyal edri [Administrator] (oVirt JIRA) 19 Dec '16

19 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-920?page=com.atlassian.jira.p… ] eyal edri [Administrator] reassigned OVIRT-920: ----------------------------------------------- Assignee: eyal edri [Administrator] (was: infra) > Add a standard-CI job and button "build-scratch-artifacts" > ---------------------------------------------------------- > > Key: OVIRT-920 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-920 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Yedidyah Bar David > Assignee: eyal edri [Administrator] > > Hi, > I think it will be useful to have an option to very easily (such as > pressing a button in gerrit) to do a full build of a project, > similarly to current build-artifacts, but for a pending patch - so it > will not be collected by any publisher, and will keep its artifacts > for a short time (say, 2 days). > This will allow to use these artifacts for manual tests, perhaps > longer than check-patch, in case a developer wants to do them. > -- > Didi -- This message was sent by Atlassian JIRA (v1000.621.4#100023)

1 0

[JIRA] (OVIRT-935) Unable to build fc25 chroots with mock
by Evgheni Dereveanchin (oVirt JIRA) 19 Dec '16

19 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-935?page=com.atlassian.jira.p… ] Evgheni Dereveanchin commented on OVIRT-935: -------------------------------------------- We have Fedora slaves attached to the Jenkins and I prepared a few fc25 ones as part of OVIRT-822 . Maybe we should make fc25 jobs run only on fc25 slaves for now? Does mock itself support dnf? > Unable to build fc25 chroots with mock > -------------------------------------- > > Key: OVIRT-935 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-935 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Nadav Goldin > Assignee: infra > > Mock fails when trying to build the chroot for fedora25, on installing '@buildsys-build' group(with dnf) stage. > Open bug: https://bugzilla.redhat.com/show_bug.cgi?id=1360781 > Temporarily workaround: add the 'libcrypt' package to '.packages.fc25' file. > Possible solution: patch mock-*fc25*.cfg file in Jenkins repository to always install 'libcrypt' first. > Until fixed this will block us from building anything with mock on fc25(hit it when trying to build fc25 RPMs for lago). > Error logs: > {code} > DEBUG util.py:502: Executing command: ['/usr/bin/yum-deprecated', '--installroot', '/var/lib/mock/fedora-25-x86_64-2474d86945a1de9c6d14549ec2401b9c-8291/root/', '--releasever', '25', 'install', '@buildsys-build', 'git', 'python', 'python-dulwich', 'python-setuptools', 'yum', 'yum-utils', '--setopt=tsflags=nocontexts'] with env {'PS1': '<mock-chroot> \\s-\\v\\$ ', > .... > DEBUG util.py:421: Yum command has been deprecated, use dnf instead. > DEBUG util.py:421: See 'man dnf' and 'man yum2dnf' for more information. > DEBUG util.py:421: Error: libcrypt conflicts with libcrypt-nss-2.24-3.fc25.x86_64 > DEBUG util.py:421: Error: libcrypt-nss conflicts with libcrypt-2.24-3.fc25.x86_64 > DEBUG util.py:421: You could try using --skip-broken to work around the problem > DEBUG util.py:421: You could try running: rpm -Va --nofiles --nodigest > DEBUG util.py:557: Child return code was: 1 > DEBUG util.py:180: kill orphans > {code} -- This message was sent by Atlassian JIRA (v1000.621.4#100023)

1 0

[JIRA] (OVIRT-944) Prepare CI for 4.1 oVirt branch
by eyal edri [Administrator] (oVirt JIRA) 19 Dec '16

19 Dec '16

eyal edri [Administrator] created OVIRT-944: ----------------------------------------------- Summary: Prepare CI for 4.1 oVirt branch Key: OVIRT-944 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-944 Project: oVirt - virtualization made easy Issue Type: Task Reporter: eyal edri [Administrator] Assignee: infra Priority: Highest We need to add all relevant jobs and flows for 4.1, lets use this ticket to track all progress * system tests * experimental flows * publishers * deploy to experimental * gerrit hooks (?) * standard flows for various projects cc [~sbonazolla(a)redhat.com] [~ederevea] [~bkorren(a)redhat.com] [~amarchuk] [~sbendavi(a)redhat.com] -- This message was sent by Atlassian JIRA (v1000.621.4#100023)

1 0

[JIRA] (OVIRT-944) Prepare CI for 4.1 oVirt branch
by eyal edri [Administrator] (oVirt JIRA) 19 Dec '16

19 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-944?page=com.atlassian.jira.p… ] eyal edri [Administrator] updated OVIRT-944: -------------------------------------------- Epic Link: OVIRT-400 > Prepare CI for 4.1 oVirt branch > ------------------------------- > > Key: OVIRT-944 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-944 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: eyal edri [Administrator] > Assignee: infra > Priority: Highest > > We need to add all relevant jobs and flows for 4.1, lets use this ticket to track all progress > * system tests > * experimental flows > * publishers > * deploy to experimental > * gerrit hooks (?) > * standard flows for various projects > cc [~sbonazolla(a)redhat.com] [~ederevea] [~bkorren(a)redhat.com] [~amarchuk] [~sbendavi(a)redhat.com] -- This message was sent by Atlassian JIRA (v1000.621.4#100023)

1 0

oVirt master experimental system tests now failing on snapshot merge
by Barak Korren 18 Dec '16

18 Dec '16

After we've fixed the various system test issues that arose from the CentOS 7.3 release, we're now seeing a new failure that seems to has to do with snapshot merges. I'm guessing this may have to do with something the went in last week while we "weren't looking". Failing job can be seen here: http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/4275 The test code snippet that is failing is as follows: 226 api.vms.get(VM0_NAME).snapshots.list()[-2].delete() 227 testlib.assert_true_within_short( 228 lambda: 229 (len(api.vms.get(VM0_NAME).snapshots.list()) == 2) and 230 (api.vms.get(VM0_NAME).snapshots.list()[-1].snapshot_status 231 == 'ok'), 232 ) The failure itself is a test timeout: ... File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/004_basic_sanity.py", line 228, in snapshot_merge lambda: File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 248, in assert_true_within_short allowed_exceptions=allowed_exceptions, File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 240, in assert_true_within raise AssertionError('Timed out after %s seconds' % timeout) AssertionError: Timed out after 180 seconds Engine log generated during the test can be found here: http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/4275/artif… Please have a look. Thanks, Barak. -- Barak Korren bkorren(a)redhat.com RHCE, RHCi, RHV-DevOps Team https://ifireball.wordpress.com/

3 5

[JIRA] (OVIRT-943) Filter out 'latest.under_testing' from repoman '--latest' calculation in 'deploy-to-experiminetal' flow
by Barak Korren (oVirt JIRA) 18 Dec '16

18 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-943?page=com.atlassian.jira.p… ] Barak Korren updated OVIRT-943: ------------------------------- Epic Link: OVIRT-400 > Filter out 'latest.under_testing' from repoman '--latest' calculation in 'deploy-to-experiminetal' flow > ------------------------------------------------------------------------------------------------------- > > Key: OVIRT-943 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-943 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: repoman > Reporter: Barak Korren > Assignee: infra > > It seems that the repoman '--latest' switch, as it is used in the 'deploy-to-experimatal' job, is not (Or cannot be) configured to ignore the 'latest.under_testing' directory. > This can lead to the deploy job failing when other jobs manipulate the 'latest.under_testing' directory. > An example for this kind of failure: > http://jenkins.ovirt.org/job/deploy-to-ovirt_experimental_master/8392/conso… > Relevant error messages: > {code} > 2016-12-18 10:02:09,021::INFO::repoman.common.stores.RPM.add_rpm:248::Adding package /srv/resources/repos/ovirt/experimental/master/latest.under_testing/rpm/el7/SRPMS/vdsm-jsonrpc-java-1.3.5-1.20161214084205.gitfbe3dec.el7.centos.src.rpm to repo Non persistent RPMStore > 2016-12-18 10:02:09,022::INFO::repoman.common.stores.RPM.add_rpm:248::Adding package /srv/resources/repos/ovirt/experimental/master/latest.under_testing/rpm/el7/SRPMS/unboundid-ldapsdk-3.2.0-1.el7.src.rpm to repo Non persistent RPMStore > Traceback (most recent call last): > File "/usr/bin/repoman", line 10, in <module> > sys.exit(main()) > File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 455, in main > exit_code = do_add(args, config, repo) > File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 360, in do_add > latest_repo.add_source('%s:latest' % root_dir) > File "/usr/lib/python2.7/site-packages/repoman/common/repo.py", line 175, in add_source > artifact_paths = self.parser.parse(artifact_source) > File "/usr/lib/python2.7/site-packages/repoman/common/parser.py", line 96, in parse > art_list, > File "/usr/lib/python2.7/site-packages/repoman/common/filters/latest.py", line 37, in filter > store.add_artifact(artifact) > File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py", line 192, in add_artifact > self.add_rpm(pkg, **args) > File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py", line 213, in add_rpm > verify_ssl=self.config.getboolean('verify_ssl'), > File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/RPM.py", line 114, in __init__ > with open(path) as fdno: > IOError: [Errno 2] No such file or directory: '/srv/resources/repos/ovirt/experimental/master/latest.under_testing/rpm/el7/SRPMS/vdsm-4.18.999-1188.gitbf3f9e9.el7.centos.src.rpm' > 2016-12-18 10:02:09,810::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC/tmpQ_3ssv/tmp7HZmrN/tmplYE1KR > 2016-12-18 10:02:09,813::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC/tmpQ_3ssv/tmp7HZmrN > 2016-12-18 10:02:09,814::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC/tmpQ_3ssv > 2016-12-18 10:02:09,814::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC > Build step 'Execute shell' marked build as failure > {code} > This issue can also be mitigated with global exclusive locking as described in OVIRT-899 -- This message was sent by Atlassian JIRA (v1000.621.4#100023)

1 0

[JIRA] (OVIRT-943) Filter out 'latest.under_testing' from repoman '--latest' calculation in 'deploy-to-experiminetal' flow
by Barak Korren (oVirt JIRA) 18 Dec '16

18 Dec '16

Barak Korren created OVIRT-943: ---------------------------------- Summary: Filter out 'latest.under_testing' from repoman '--latest' calculation in 'deploy-to-experiminetal' flow Key: OVIRT-943 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-943 Project: oVirt - virtualization made easy Issue Type: Bug Components: repoman Reporter: Barak Korren Assignee: infra It seems that the repoman '--latest' switch, as it is used in the 'deploy-to-experimatal' job, is not (Or cannot be) configured to ignore the 'latest.under_testing' directory. This can lead to the deploy job failing when other jobs manipulate the 'latest.under_testing' directory. An example for this kind of failure: http://jenkins.ovirt.org/job/deploy-to-ovirt_experimental_master/8392/conso… Relevant error messages: {code} 2016-12-18 10:02:09,021::INFO::repoman.common.stores.RPM.add_rpm:248::Adding package /srv/resources/repos/ovirt/experimental/master/latest.under_testing/rpm/el7/SRPMS/vdsm-jsonrpc-java-1.3.5-1.20161214084205.gitfbe3dec.el7.centos.src.rpm to repo Non persistent RPMStore 2016-12-18 10:02:09,022::INFO::repoman.common.stores.RPM.add_rpm:248::Adding package /srv/resources/repos/ovirt/experimental/master/latest.under_testing/rpm/el7/SRPMS/unboundid-ldapsdk-3.2.0-1.el7.src.rpm to repo Non persistent RPMStore Traceback (most recent call last): File "/usr/bin/repoman", line 10, in <module> sys.exit(main()) File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 455, in main exit_code = do_add(args, config, repo) File "/usr/lib/python2.7/site-packages/repoman/cmd.py", line 360, in do_add latest_repo.add_source('%s:latest' % root_dir) File "/usr/lib/python2.7/site-packages/repoman/common/repo.py", line 175, in add_source artifact_paths = self.parser.parse(artifact_source) File "/usr/lib/python2.7/site-packages/repoman/common/parser.py", line 96, in parse art_list, File "/usr/lib/python2.7/site-packages/repoman/common/filters/latest.py", line 37, in filter store.add_artifact(artifact) File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py", line 192, in add_artifact self.add_rpm(pkg, **args) File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/__init__.py", line 213, in add_rpm verify_ssl=self.config.getboolean('verify_ssl'), File "/usr/lib/python2.7/site-packages/repoman/common/stores/RPM/RPM.py", line 114, in __init__ with open(path) as fdno: IOError: [Errno 2] No such file or directory: '/srv/resources/repos/ovirt/experimental/master/latest.under_testing/rpm/el7/SRPMS/vdsm-4.18.999-1188.gitbf3f9e9.el7.centos.src.rpm' 2016-12-18 10:02:09,810::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC/tmpQ_3ssv/tmp7HZmrN/tmplYE1KR 2016-12-18 10:02:09,813::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC/tmpQ_3ssv/tmp7HZmrN 2016-12-18 10:02:09,814::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC/tmpQ_3ssv 2016-12-18 10:02:09,814::INFO::repoman.common.repo.cleanup:35::Cleaning up temporary dir /srv/resources/repos/ovirt/experimental/.lago_tmp/tmpx7iqIC Build step 'Execute shell' marked build as failure {code} This issue can also be mitigated with global exclusive locking as described in OVIRT-899 -- This message was sent by Atlassian JIRA (v1000.621.4#100023)

1 0

[JIRA] (OVIRT-935) Unable to build fc25 chroots with mock
by Barak Korren (oVirt JIRA) 18 Dec '16

18 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-935?page=com.atlassian.jira.p… ] Barak Korren commented on OVIRT-935: ------------------------------------ {quote} So we need to think if we can just use 'dnf' in fc25 mock config instead. {quote} We cant. We need it to run on el7 hosts. Those do not have DNF. > Unable to build fc25 chroots with mock > -------------------------------------- > > Key: OVIRT-935 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-935 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Nadav Goldin > Assignee: infra > > Mock fails when trying to build the chroot for fedora25, on installing '@buildsys-build' group(with dnf) stage. > Open bug: https://bugzilla.redhat.com/show_bug.cgi?id=1360781 > Temporarily workaround: add the 'libcrypt' package to '.packages.fc25' file. > Possible solution: patch mock-*fc25*.cfg file in Jenkins repository to always install 'libcrypt' first. > Until fixed this will block us from building anything with mock on fc25(hit it when trying to build fc25 RPMs for lago). > Error logs: > {code} > DEBUG util.py:502: Executing command: ['/usr/bin/yum-deprecated', '--installroot', '/var/lib/mock/fedora-25-x86_64-2474d86945a1de9c6d14549ec2401b9c-8291/root/', '--releasever', '25', 'install', '@buildsys-build', 'git', 'python', 'python-dulwich', 'python-setuptools', 'yum', 'yum-utils', '--setopt=tsflags=nocontexts'] with env {'PS1': '<mock-chroot> \\s-\\v\\$ ', > .... > DEBUG util.py:421: Yum command has been deprecated, use dnf instead. > DEBUG util.py:421: See 'man dnf' and 'man yum2dnf' for more information. > DEBUG util.py:421: Error: libcrypt conflicts with libcrypt-nss-2.24-3.fc25.x86_64 > DEBUG util.py:421: Error: libcrypt-nss conflicts with libcrypt-2.24-3.fc25.x86_64 > DEBUG util.py:421: You could try using --skip-broken to work around the problem > DEBUG util.py:421: You could try running: rpm -Va --nofiles --nodigest > DEBUG util.py:557: Child return code was: 1 > DEBUG util.py:180: kill orphans > {code} -- This message was sent by Atlassian JIRA (v1000.621.4#100023)

1 0

ovirt-engine-api-explorer failing on fc23 master
by Sandro Bonazzola 18 Dec '16

18 Dec '16

http://jenkins.ovirt.org/job/ovirt-engine-api-explorer_master_build-artifac… is failing trying to build fc23 package for master. Master is not supporting fc23 and the repo is not there. Considering fc23 is going EOL I would suggest to just delete this job. Thanks -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

2 1

[JIRA] (OVIRT-935) Unable to build fc25 chroots with mock
by Nadav Goldin (oVirt JIRA) 18 Dec '16

18 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-935?page=com.atlassian.jira.p… ] Nadav Goldin commented on OVIRT-935: ------------------------------------ As commented in https://bugzilla.redhat.com/show_bug.cgi?id=1360781#c28 , changing the installation to 'dnf' works. So we need to think if we can just use 'dnf' in fc25 mock config instead. > Unable to build fc25 chroots with mock > -------------------------------------- > > Key: OVIRT-935 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-935 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Nadav Goldin > Assignee: infra > > Mock fails when trying to build the chroot for fedora25, on installing '@buildsys-build' group(with dnf) stage. > Open bug: https://bugzilla.redhat.com/show_bug.cgi?id=1360781 > Temporarily workaround: add the 'libcrypt' package to '.packages.fc25' file. > Possible solution: patch mock-*fc25*.cfg file in Jenkins repository to always install 'libcrypt' first. > Until fixed this will block us from building anything with mock on fc25(hit it when trying to build fc25 RPMs for lago). > Error logs: > {code} > DEBUG util.py:502: Executing command: ['/usr/bin/yum-deprecated', '--installroot', '/var/lib/mock/fedora-25-x86_64-2474d86945a1de9c6d14549ec2401b9c-8291/root/', '--releasever', '25', 'install', '@buildsys-build', 'git', 'python', 'python-dulwich', 'python-setuptools', 'yum', 'yum-utils', '--setopt=tsflags=nocontexts'] with env {'PS1': '<mock-chroot> \\s-\\v\\$ ', > .... > DEBUG util.py:421: Yum command has been deprecated, use dnf instead. > DEBUG util.py:421: See 'man dnf' and 'man yum2dnf' for more information. > DEBUG util.py:421: Error: libcrypt conflicts with libcrypt-nss-2.24-3.fc25.x86_64 > DEBUG util.py:421: Error: libcrypt-nss conflicts with libcrypt-2.24-3.fc25.x86_64 > DEBUG util.py:421: You could try using --skip-broken to work around the problem > DEBUG util.py:421: You could try running: rpm -Va --nofiles --nodigest > DEBUG util.py:557: Child return code was: 1 > DEBUG util.py:180: kill orphans > {code} -- This message was sent by Atlassian JIRA (v1000.621.4#100023)

1 0

[HEADS UP] CentOS 7.3 ppc64le rolling out today
by Sandro Bonazzola 16 Dec '16

16 Dec '16

Hi, as for x86_64 released on Monday, please wait for qemu-kvm-ev 2.6 to be built on top of the new CentOS 7.3 before upgrading to avoid breakages. Thanks, -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

1 0

[oVirt Jenkins] test-repo_ovirt_experimental_3.6 - Build #4488 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 16 Dec '16

16 Dec '16

------=_Part_129_1791049716.1481537913080 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Build: http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_3.6/4488/, Build Number: 4488, Build Status: FAILURE ------=_Part_129_1791049716.1481537913080--

1 3

[JIRA] (OVIRT-923) define process to manage and apply ansible playbooks
by Marc Dequènes (Duck) (oVirt JIRA) 16 Dec '16

16 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-923?page=com.atlassian.jira.p… ] Marc Dequènes (Duck) commented on OVIRT-923: -------------------------------------------- Misc is managing a bastion for ManageIQ, which is an interesting solution. This is not to say we have to use the exact same one, but it is an interesting working example which can be a starting point to think about. The role to install the bastion with the scripts used to handle the automatic launch depending on which hosts are affected by the changed push in a public git repo: https://github.com/OSAS/ansible-role-ansible_bastion The playbook repository is here for example: git@gitlab.osas.lab.eng.rdu2.redhat.com:osas/ansible_manageiq.git (you may have to ask [~misc(a)redhat.com] for permission for this one. > define process to manage and apply ansible playbooks > ---------------------------------------------------- > > Key: OVIRT-923 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-923 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Evgheni Dereveanchin > Assignee: infra > Priority: Low > > We already have a repository with ansible code, but to use it effectively we need to define a way to manage playbooks and run them effectively. As Ansible Tower is not open source we need to investigate other solutions on the market. -- This message was sent by Atlassian JIRA (v1000.621.4#100023)

1 0

Build failed in Jenkins: ovirt_4.0_he-system-tests #596
by jenkins＠jenkins.phx.ovirt.org 16 Dec '16

16 Dec '16

See <http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/596/changes> Changes: [Yaniv Kaul] Fixes for 3.6 suite to work on CentOS 7.3 [Sandro Bonazzola] ovirt-host-deploy: move 4.1 to stable branch [Martin Perina] aaa-ldap: Create stable branch for oVirt 4.0 [Sandro Bonazzola] ovirt-log-collector: move 4.1 to stable branch [Eyal Edri] add more history to standard jobs [Barak Korren] Fix issue with mock_genconfig [Evgheni Dereveanchin] increase max concurrent builds to 30 ------------------------------------------ [...truncated 1205 lines...] + TESTS_LOGS=<http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/ovirt-system-test…> + rm -rf <http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/596/artifact/exporte…> + mkdir -p <http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/596/artifact/exporte…> + [[ -d <http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/ovirt-system-test…> ]] POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 0 Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -x echo "shell-scripts/mock_cleanup.sh" shopt -s nullglob WORKSPACE="$PWD" # Make clear this is the cleanup, helps reading the jenkins logs cat <<EOC _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### EOC # restore the permissions in the working dir, as sometimes it leaves files # owned by root and then the 'cleanup workspace' from jenkins job fails to # clean and breaks the jobs sudo chown -R "$USER" "$WORKSPACE" # Archive the logs, we want them anyway logs=( ./*log ./*/logs ) if [[ "$logs" ]]; then for log in "${logs[@]}"; do [[ "$log" = ./exported-artifacts/* ]] && continue echo "Copying ${log} to exported-artifacts" mv $log exported-artifacts/ done fi # stop any processes running inside the chroot failed=false mock_confs=("$WORKSPACE"/*/mocker*) # Clean current jobs mockroot if any for mock_conf_file in "${mock_confs[@]}"; do [[ "$mock_conf_file" ]] || continue echo "Cleaning up mock $mock_conf" mock_root="${mock_conf_file##*/}" mock_root="${mock_root%.*}" my_mock="/usr/bin/mock" my_mock+=" --configdir=${mock_conf_file%/*}" my_mock+=" --root=${mock_root}" my_mock+=" --resultdir=$WORKSPACE" #TODO: investigate why mock --clean fails to umount certain dirs sometimes, #so we can use it instead of manually doing all this. echo "Killing all mock orphan processes, if any." $my_mock \ --orphanskill \ || { echo "ERROR: Failed to kill orphans on $chroot." failed=true } mock_root="$(\ grep \ -Po "(?<=config_opts\['root'\] = ')[^']*" \ "$mock_conf_file" \ )" || : [[ "$mock_root" ]] || continue mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $chroot. Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true } done done # Clean any leftover chroot from other jobs for mock_root in /var/lib/mock/*; do this_chroot_failed=false mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $mock_root." \ "Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true this_chroot_failed=true } done if ! $this_chroot_failed; then sudo rm -rf "$mock_root" fi done # remove mock caches that are older then 2 days: find /var/cache/mock/ -mindepth 1 -maxdepth 1 -type d -mtime +2 -print0 | \ xargs -0 -tr sudo rm -rf # We make no effort to leave around caches that may still be in use because # packages installed in them may go out of date, so may as well recreate them # Drop all left over libvirt domains for UUID in $(virsh list --all --uuid); do virsh destroy $UUID || : sleep 2 virsh undefine --remove-all-storage --storage vda --snapshots-metadata $UUID || : done if $failed; then echo "Cleanup script failed, propegating failure to job" exit 1 fi [ovirt_4.0_he-system-tests] $ /bin/bash -x /tmp/hudson3446399328267158833.sh + echo shell-scripts/mock_cleanup.sh shell-scripts/mock_cleanup.sh + shopt -s nullglob + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/> + cat _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### + sudo chown -R jenkins <http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/> + logs=(./*log ./*/logs) + [[ -n ./ovirt-system-tests/logs ]] + for log in '"${logs[@]}"' + [[ ./ovirt-system-tests/logs = ./exported-artifacts/* ]] + echo 'Copying ./ovirt-system-tests/logs to exported-artifacts' Copying ./ovirt-system-tests/logs to exported-artifacts + mv ./ovirt-system-tests/logs exported-artifacts/ + failed=false + mock_confs=("$WORKSPACE"/*/mocker*) + for mock_conf_file in '"${mock_confs[@]}"' + [[ -n <http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/ovirt-system-test…> ]] + echo 'Cleaning up mock ' Cleaning up mock + mock_root=mocker-epel-7-x86_64.el7.cfg + mock_root=mocker-epel-7-x86_64.el7 + my_mock=/usr/bin/mock + my_mock+=' --configdir=<http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/ovirt-system-tests'> + my_mock+=' --root=mocker-epel-7-x86_64.el7' + my_mock+=' --resultdir=<http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/'> + echo 'Killing all mock orphan processes, if any.' Killing all mock orphan processes, if any. + /usr/bin/mock --configdir=<http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/ovirt-system-tests> --root=mocker-epel-7-x86_64.el7 --resultdir=<http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/> --orphanskill WARNING: Could not find required logging config file: <http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/ovirt-system-test….> Using default... INFO: mock.py version 1.2.21 starting (python version = 3.4.3)... Start: init plugins INFO: selinux enabled Finish: init plugins Start: run WARNING: Process ID 20466 still running in chroot. Killing... WARNING: Process ID 20482 still running in chroot. Killing... WARNING: Process ID 20483 still running in chroot. Killing... WARNING: Process ID 20489 still running in chroot. Killing... WARNING: Process ID 22126 still running in chroot. Killing... Finish: run sh: [20466: 1 (255)] tcsetattr: Inappropriate ioctl for device tee: <http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/ovirt-system-test…>: No such file or directory Took 21590 seconds Finish: shell ++ grep -Po '(?<=config_opts\['\''root'\''\] = '\'')[^'\'']*' <http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/ovirt-system-test…> + mock_root=epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e + [[ -n epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e ]] + mounts=($(mount | awk '{print $3}' | grep "$mock_root")) ++ mount ++ awk '{print $3}' ++ grep epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e + [[ -n /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/proc ]] + echo 'Found mounted dirs inside the chroot . Trying to umount.' Found mounted dirs inside the chroot . Trying to umount. + for mount in '"${mounts[@]}"' + sudo umount --lazy /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/proc + for mount in '"${mounts[@]}"' + sudo umount --lazy /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/sys + for mount in '"${mounts[@]}"' + sudo umount --lazy /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/dev/shm + for mount in '"${mounts[@]}"' + sudo umount --lazy /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/dev/pts + for mount in '"${mounts[@]}"' + sudo umount --lazy /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/var/cache/yum umount: /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/var/cache/yum: not mounted + echo 'ERROR: Failed to umount /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/var/cache/yum.' ERROR: Failed to umount /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/var/cache/yum. + failed=true + for mount in '"${mounts[@]}"' + sudo umount --lazy /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root<http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/ovirt-system-tests> umount: /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root<http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/ovirt-system-tests>: not mounted + echo 'ERROR: Failed to umount /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root<http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/ovirt-system-tests.'> ERROR: Failed to umount /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root<http://jenkins.ovirt.org/job/ovirt_4.0_he-system-tests/ws/ovirt-system-tests.> + failed=true + for mount in '"${mounts[@]}"' + sudo umount --lazy /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/run/libvirt umount: /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/run/libvirt: not mounted + echo 'ERROR: Failed to umount /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/run/libvirt.' ERROR: Failed to umount /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/run/libvirt. + failed=true + for mount in '"${mounts[@]}"' + sudo umount --lazy /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/var/lib/lago umount: /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/var/lib/lago: not mounted + echo 'ERROR: Failed to umount /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/var/lib/lago.' ERROR: Failed to umount /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/var/lib/lago. + failed=true + for mount in '"${mounts[@]}"' + sudo umount --lazy /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/proc/filesystems umount: /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/proc/filesystems: mountpoint not found + echo 'ERROR: Failed to umount /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/proc/filesystems.' ERROR: Failed to umount /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311/root/proc/filesystems. + failed=true + for mock_root in '/var/lib/mock/*' + this_chroot_failed=false + mounts=($(mount | awk '{print $3}' | grep "$mock_root")) ++ mount ++ awk '{print $3}' ++ grep /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311 + : + [[ -n '' ]] + false + sudo rm -rf /var/lib/mock/epel-7-x86_64-ed452d1ea0f6dadf50c66d3b3f6b3a6e-20311 + find /var/cache/mock/ -mindepth 1 -maxdepth 1 -type d -mtime +2 -print0 + xargs -0 -tr sudo rm -rf sudo rm -rf /var/cache/mock/fedora-24-x86_64-16f322197a7139379dcbc4fa34591c1e /var/cache/mock/epel-7-x86_64-c72c78366ff14254e85061296f0d13fb ++ virsh list --all --uuid + true + echo 'Cleanup script failed, propegating failure to job' Cleanup script failed, propegating failure to job + exit 1 POST BUILD TASK : FAILURE END OF POST BUILD TASK : 1 Recording test results ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? Archiving artifacts

1 1

[JIRA] (OVIRT-942) [gerrit hooks] add CR (-1) grade beside the gerrit message
by Shlomo Ben David (oVirt JIRA) 15 Dec '16

15 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-942?page=com.atlassian.jira.p… ] Shlomo Ben David reassigned OVIRT-942: -------------------------------------- Assignee: Shlomo Ben David (was: infra) > [gerrit hooks] add CR (-1) grade beside the gerrit message > ---------------------------------------------------------- > > Key: OVIRT-942 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-942 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Shlomo Ben David > Assignee: Shlomo Ben David > > Currently, we are grading with CR (-1) if there is not bug url > added to the commit message (only for stable branches). > The current message that Gerrit prints don't show the CR grade (-1) > beside the Gerrit message, It only shows the message. -- This message was sent by Atlassian JIRA (v1000.621.3#100023)

1 0

[JIRA] (OVIRT-942) [gerrit hooks] add CR (-1) grade beside the gerrit message
by Shlomo Ben David (oVirt JIRA) 15 Dec '16

15 Dec '16

Shlomo Ben David created OVIRT-942: -------------------------------------- Summary: [gerrit hooks] add CR (-1) grade beside the gerrit message Key: OVIRT-942 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-942 Project: oVirt - virtualization made easy Issue Type: Improvement Reporter: Shlomo Ben David Assignee: infra Currently, we are grading with CR (-1) if there is not bug url added to the commit message (only for stable branches). The current message that Gerrit prints don't show the CR grade (-1) beside the Gerrit message, It only shows the message. -- This message was sent by Atlassian JIRA (v1000.621.3#100023)

1 0

[JIRA] (OVIRT-942) [gerrit hooks] add CR (-1) grade beside the gerrit message
by Shlomo Ben David (oVirt JIRA) 15 Dec '16

15 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-942?page=com.atlassian.jira.p… ] Shlomo Ben David updated OVIRT-942: ----------------------------------- Epic Link: OVIRT-411 > [gerrit hooks] add CR (-1) grade beside the gerrit message > ---------------------------------------------------------- > > Key: OVIRT-942 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-942 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Shlomo Ben David > Assignee: infra > > Currently, we are grading with CR (-1) if there is not bug url > added to the commit message (only for stable branches). > The current message that Gerrit prints don't show the CR grade (-1) > beside the Gerrit message, It only shows the message. -- This message was sent by Atlassian JIRA (v1000.621.3#100023)

1 0

[JIRA] (OVIRT-845) Build oVirt 4.0.6 RC1
by sbonazzo (oVirt JIRA) 15 Dec '16

15 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-845?page=com.atlassian.jira.p… ] sbonazzo updated OVIRT-845: --------------------------- Assignee: sbonazzo (was: infra) Status: In Progress (was: To Do) > Build oVirt 4.0.6 RC1 > --------------------- > > Key: OVIRT-845 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-845 > Project: oVirt - virtualization made easy > Issue Type: Task > Components: Repositories Mgmt > Reporter: sbonazzo > Assignee: sbonazzo > Priority: Highest > -- This message was sent by Atlassian JIRA (v1000.621.3#100023)

1 0

[JIRA] (OVIRT-941) [gerrit hooks] fix get_bug_info function
by Shlomo Ben David (oVirt JIRA) 15 Dec '16

15 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-941?page=com.atlassian.jira.p… ] Shlomo Ben David updated OVIRT-941: ----------------------------------- Epic Link: OVIRT-411 > [gerrit hooks] fix get_bug_info function > ---------------------------------------- > > Key: OVIRT-941 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-941 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Shlomo Ben David > Assignee: infra > > The current function doesn't handle private/unavailable bugs. -- This message was sent by Atlassian JIRA (v1000.621.3#100023)

1 0

[JIRA] (OVIRT-941) [gerrit hooks] fix get_bug_info function
by Shlomo Ben David (oVirt JIRA) 15 Dec '16

15 Dec '16

Shlomo Ben David created OVIRT-941: -------------------------------------- Summary: [gerrit hooks] fix get_bug_info function Key: OVIRT-941 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-941 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Shlomo Ben David Assignee: infra The current function doesn't handle private/unavailable bugs. -- This message was sent by Atlassian JIRA (v1000.621.3#100023)

1 0

[JIRA] (OVIRT-941) [gerrit hooks] fix get_bug_info function
by Shlomo Ben David (oVirt JIRA) 15 Dec '16

15 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-941?page=com.atlassian.jira.p… ] Shlomo Ben David reassigned OVIRT-941: -------------------------------------- Assignee: Shlomo Ben David (was: infra) > [gerrit hooks] fix get_bug_info function > ---------------------------------------- > > Key: OVIRT-941 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-941 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Shlomo Ben David > Assignee: Shlomo Ben David > > The current function doesn't handle private/unavailable bugs. -- This message was sent by Atlassian JIRA (v1000.621.3#100023)

1 0

[JIRA] (OVIRT-885) lago-devel list stopped archiving mails from November 2016
by eyal edri [Administrator] (oVirt JIRA) 15 Dec '16

15 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-885?page=com.atlassian.jira.p… ] eyal edri [Administrator] updated OVIRT-885: -------------------------------------------- Resolution: Fixed Status: Done (was: To Do) seems that post the lists migration to PHX the issue is fixed and we can see lago-devel archives now: http://lists.phx.ovirt.org/pipermail/lago-devel/ > lago-devel list stopped archiving mails from November 2016 > ---------------------------------------------------------- > > Key: OVIRT-885 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-885 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: eyal edri [Administrator] > Assignee: infra > > Can't see any mails from Nov [1] even though the settings was set to weekly. > [1] http://lists.ovirt.org/pipermail/lago-devel/ -- This message was sent by Atlassian JIRA (v1000.621.3#100023)

1 0

[oVirt Jenkins] test-repo_ovirt_experimental_master - Build #4184 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 15 Dec '16

15 Dec '16

------=_Part_241_1355739028.1481730802350 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Build: http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/4184/, Build Number: 4184, Build Status: FAILURE ------=_Part_241_1355739028.1481730802350--

1 30

[JIRA] (OVIRT-940) mock setup failed
by Barak Korren (oVirt JIRA) 15 Dec '16

15 Dec '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-940?page=com.atlassian.jira.p… ] Barak Korren updated OVIRT-940: ------------------------------- Resolution: Duplicate Status: Done (was: To Do) > mock setup failed > ----------------- > > Key: OVIRT-940 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-940 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Reporter: Evgheni Dereveanchin > Assignee: infra > > This job seems to be failing due to mock setup issues: > http://jenkins.ovirt.org/job/ovirt-engine-nodejs-modules_4.0_create-rpms-el… > 10:04:23 ##### Initializing chroot > 10:04:23 + /usr/bin/mock --configdir=/home/jenkins/workspace/ovirt-engine-nodejs-modules_4.0_create-rpms-el7-x86_64_created/jenkins/mock_configs --root=epel-7-x86_64-custom --resultdir=/home/jenkins/workspace/ovirt-engine-nodejs-modules_4.0_create-rpms-el7-x86_64_created --init > 10:04:24 INFO: mock.py version 1.2.21 starting (python version = 3.5.2)... > 10:04:24 ERROR: 'selinux_enable' > 10:04:24 Traceback (most recent call last): > 10:04:24 File "/usr/sbin/mock", line 844, in <module> > 10:04:24 main() > 10:04:24 File "/usr/lib/python3.5/site-packages/mockbuild/trace_decorator.py", line 88, in trace > 10:04:24 result = func(*args, **kw) > 10:04:24 File "/usr/sbin/mock", line 634, in main > 10:04:24 buildroot = Buildroot(config_opts, uidManager, state, plugins) > 10:04:24 File "/usr/lib/python3.5/site-packages/mockbuild/trace_decorator.py", line 88, in trace > 10:04:24 result = func(*args, **kw) > 10:04:24 File "/usr/lib/python3.5/site-packages/mockbuild/buildroot.py", line 47, in __init__ > 10:04:24 self.selinux = (not self.config['plugin_conf']['selinux_enable'] > 10:04:24 KeyError: 'selinux_enable' > 10:04:24 Build step 'Execute shell' marked build as failure > This runs on an FC24 slave that I updated yesterday - maybe that caused the issue. -- This message was sent by Atlassian JIRA (v1000.621.3#100023)

1 0