July 2016 - Infra - oVirt List Archives

Build failed in Jenkins: ovirt_3.6_system-tests #222
by jenkins＠jenkins.phx.ovirt.org 10 Jul '16

10 Jul '16

See <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/222/> ------------------------------------------ [...truncated 787 lines...] warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/gperftools-devel-2.4-7.el7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/fence-agents-brocade-4.0.11-27.el7_2.7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/gnutls-dane-3.3.8-14.el7_2.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/libtalloc-2.1.5-1.el7_2.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/cockpit-ws-0.108-1.el7.centos.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/libvirt-1.2.17-13.el7_2.5.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/gsm-1.0.13-11.el7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/perl-libs-5.16.3-286.el7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/libbasicobjects-0.1.1-25.el7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/libseccomp-2.2.1-1.el7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/perl-Net-LibIDN-0.12-15.el7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/fence-agents-drac5-4.0.11-27.el7_2.7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/libunwind-devel-1.1-5.el7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/atk-2.14.0-1.el7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/libstoraged-2.2.0-3.el7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/id_rsa.pub warning: failed to remove deployment-basic_suite_3.6/default/id_rsa warning: failed to remove deployment-basic_suite_3.6/default/scripts/_home_jenkins_workspace_ovirt_3.6_system-tests_ovirt-system-tests_basic_suite_3.6_.._common_deploy-scripts_setup_engine.sh warning: failed to remove deployment-basic_suite_3.6/default/scripts/_home_jenkins_workspace_ovirt_3.6_system-tests_ovirt-system-tests_basic_suite_3.6_.._common_deploy-scripts_add_local_repo.sh warning: failed to remove deployment-basic_suite_3.6/default/scripts/_home_jenkins_workspace_ovirt_3.6_system-tests_ovirt-system-tests_basic_suite_3.6_.._common_deploy-scripts_setup_host_el7.sh warning: failed to remove deployment-basic_suite_3.6/default/scripts/_home_jenkins_workspace_ovirt_3.6_system-tests_ovirt-system-tests_basic_suite_3.6_.._common_deploy-scripts_setup_storage_unified_el7.sh warning: failed to remove deployment-basic_suite_3.6/current warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_host1/_var_log_messages warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_host0/_var_log_messages warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/ovirt-image-uploader warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/engine.log warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/boot.log warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/setup/ovirt-engine-setup-20160710083448-ugrcmw.log warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/server.log warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/dump warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/notifier warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/console.log warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/host-deploy warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/ovirt-iso-uploader warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/ui.log warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_storage warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_logs/lago.log warning: failed to remove exported-artifacts/lago_logs/lago.log warning: failed to remove exported-artifacts/nosetests-001_initialize_engine.py.xml at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1640) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1616) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1612) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:1254) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:1266) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.clean(CliGitAPIImpl.java:621) at hudson.plugins.git.GitAPI.clean(GitAPI.java:311) at sun.reflect.GeneratedMethodAccessor64.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:608) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:583) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:542) at hudson.remoting.UserRequest.perform(UserRequest.java:120) at hudson.remoting.UserRequest.perform(UserRequest.java:48) at hudson.remoting.Request$2.run(Request.java:326) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) at ......remote call to ovirt-srv09.phx.ovirt.org(Native Method) at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1416) at hudson.remoting.UserResponse.retrieve(UserRequest.java:220) at hudson.remoting.Channel.call(Channel.java:781) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:250) at com.sun.proxy.$Proxy71.clean(Unknown Source) at org.jenkinsci.plugins.gitclient.RemoteGitImpl.clean(RemoteGitImpl.java:444) at hudson.plugins.git.extensions.impl.CleanBeforeCheckout.decorateFetchCommand(CleanBeforeCheckout.java:32) at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:762) ... 12 more ERROR: null Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo 'shell_scripts/system_tests.collect_logs.sh' # # Required jjb vars: # version # VERSION=3.6 SUITE_TYPE= WORKSPACE="$PWD" OVIRT_SUITE="$SUITE_TYPE_suite_$VERSION" TESTS_LOGS="$WORKSPACE/ovirt-system-tests/exported-artifacts" rm -rf "$WORKSPACE/exported-artifacts" mkdir -p "$WORKSPACE/exported-artifacts" if [[ -d "$TESTS_LOGS" ]]; then mv "$TESTS_LOGS/"* "$WORKSPACE/exported-artifacts/" fi [ovirt_3.6_system-tests] $ /bin/bash -xe /tmp/hudson6978875531127841066.sh + echo shell_scripts/system_tests.collect_logs.sh shell_scripts/system_tests.collect_logs.sh + VERSION=3.6 + SUITE_TYPE= + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> + OVIRT_SUITE=3.6 + TESTS_LOGS=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> + rm -rf <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/222/artifact/exported-a…> + mkdir -p <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/222/artifact/exported-a…> + [[ -d <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> ]] + mv <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/222/artifact/exported-a…> mv: cannot move '<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…'> to '<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/222/artifact/exported-a…'>: Permission denied mv: cannot move '<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…'> to '<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/222/artifact/exported-a…'>: Permission denied mv: cannot move '<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…'> to '<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/222/artifact/exported-a…'>: Permission denied POST BUILD TASK : FAILURE END OF POST BUILD TASK : 0 ESCALATE FAILED POST BUILD TASK TO JOB STATUS Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo "shell-scripts/mock_cleanup.sh" shopt -s nullglob WORKSPACE="$PWD" # Make clear this is the cleanup, helps reading the jenkins logs cat <<EOC _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### EOC # Archive the logs, we want them anyway logs=( ./*log ./*/logs ) if [[ "$logs" ]]; then tar cvzf exported-artifacts/logs.tgz "${logs[@]}" rm -rf "${logs[@]}" fi # stop any processes running inside the chroot failed=false mock_confs=("$WORKSPACE"/*/mocker*) # Clean current jobs mockroot if any for mock_conf_file in "${mock_confs[@]}"; do [[ "$mock_conf_file" ]] || continue echo "Cleaning up mock $mock_conf" mock_root="${mock_conf_file##*/}" mock_root="${mock_root%.*}" my_mock="/usr/bin/mock" my_mock+=" --configdir=${mock_conf_file%/*}" my_mock+=" --root=${mock_root}" my_mock+=" --resultdir=$WORKSPACE" #TODO: investigate why mock --clean fails to umount certain dirs sometimes, #so we can use it instead of manually doing all this. echo "Killing all mock orphan processes, if any." $my_mock \ --orphanskill \ || { echo "ERROR: Failed to kill orphans on $chroot." failed=true } mock_root="$(\ grep \ -Po "(?<=config_opts\['root'\] = ')[^']*" \ "$mock_conf_file" \ )" || : [[ "$mock_root" ]] || continue mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $chroot. Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true } done done # Clean any leftover chroot from other jobs for mock_root in /var/lib/mock/*; do this_chroot_failed=false mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $mock_root." \ "Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true this_chroot_failed=true } done if ! $this_chroot_failed; then sudo rm -rf "$mock_root" fi done if $failed; then echo "Aborting." exit 1 fi # remove mock system cache, we will setup proxies to do the caching and this # takes lots of space between runs shopt -u nullglob sudo rm -Rf /var/cache/mock/* # restore the permissions in the working dir, as sometimes it leaves files # owned by root and then the 'cleanup workspace' from jenkins job fails to # clean and breaks the jobs sudo chown -R "$USER" "$WORKSPACE" [ovirt_3.6_system-tests] $ /bin/bash -xe /tmp/hudson5319308473554557490.sh + echo shell-scripts/mock_cleanup.sh shell-scripts/mock_cleanup.sh + shopt -s nullglob + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> + cat _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### + logs=(./*log ./*/logs) + [[ -n '' ]] + failed=false + mock_confs=("$WORKSPACE"/*/mocker*) + false + shopt -u nullglob + sudo rm -Rf /var/cache/mock/fedora-23-x86_64-235bec7d0621e95d1cae73d7cf9dc27c + sudo chown -R jenkins <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 1 Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Archiving artifacts

1 3

Build failed in Jenkins: ovirt_master_system-tests #255
by jenkins＠jenkins.phx.ovirt.org 10 Jul '16

10 Jul '16

See <http://jenkins.ovirt.org/job/ovirt_master_system-tests/255/changes> Changes: [Eyal Edri] fix ovirt 3.6 repos to use nightlies ------------------------------------------ [...truncated 553 lines...] ## took 2185 seconds ## rc = 1 ########################################################## ##! ERROR vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv ##! Last 20 log enties: logs/mocker-fedora-23-x86_64.fc23.basic_suite_master.sh/basic_suite_master.sh.log ##! current session does not belong to lago group. @ Collect artifacts: # [Thread-1] lago_basic_suite_master_storage: # [Thread-2] lago_basic_suite_master_host0: # [Thread-3] lago_basic_suite_master_engine: # [Thread-4] lago_basic_suite_master_host1: # [Thread-1] lago_basic_suite_master_storage: Success (in 0:00:15) # [Thread-4] lago_basic_suite_master_host1: Success (in 0:00:15) # [Thread-2] lago_basic_suite_master_host0: Success (in 0:00:15) # [Thread-3] lago_basic_suite_master_engine: Success (in 0:00:16) @ Collect artifacts: Success (in 0:00:16) <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-tests> @@@@ ERROR: Failed running <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> ######################### ======== Cleaning up ----------- Cleaning with lago ----------- Cleaning with lago done ======== Cleanup done Took 2013 seconds =================================== ##! ##! ERROR ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ##!######################################################## ########################################################## Build step 'Execute shell' marked build as failure Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo 'shell_scripts/system_tests.collect_logs.sh' # # Required jjb vars: # version # VERSION=master SUITE_TYPE= WORKSPACE="$PWD" OVIRT_SUITE="$SUITE_TYPE_suite_$VERSION" TESTS_LOGS="$WORKSPACE/ovirt-system-tests/exported-artifacts" rm -rf "$WORKSPACE/exported-artifacts" mkdir -p "$WORKSPACE/exported-artifacts" if [[ -d "$TESTS_LOGS" ]]; then mv "$TESTS_LOGS/"* "$WORKSPACE/exported-artifacts/" fi [ovirt_master_system-tests] $ /bin/bash -xe /tmp/hudson8637390592580956948.sh + echo shell_scripts/system_tests.collect_logs.sh shell_scripts/system_tests.collect_logs.sh + VERSION=master + SUITE_TYPE= + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/> + OVIRT_SUITE=master + TESTS_LOGS=<http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> + rm -rf <http://jenkins.ovirt.org/job/ovirt_master_system-tests/255/artifact/exporte…> + mkdir -p <http://jenkins.ovirt.org/job/ovirt_master_system-tests/255/artifact/exporte…> + [[ -d <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> ]] + mv <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> <http://jenkins.ovirt.org/job/ovirt_master_system-tests/255/artifact/exporte…> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 0 Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo "shell-scripts/mock_cleanup.sh" shopt -s nullglob WORKSPACE="$PWD" # Make clear this is the cleanup, helps reading the jenkins logs cat <<EOC _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### EOC # Archive the logs, we want them anyway logs=( ./*log ./*/logs ) if [[ "$logs" ]]; then tar cvzf exported-artifacts/logs.tgz "${logs[@]}" rm -rf "${logs[@]}" fi # stop any processes running inside the chroot failed=false mock_confs=("$WORKSPACE"/*/mocker*) # Clean current jobs mockroot if any for mock_conf_file in "${mock_confs[@]}"; do [[ "$mock_conf_file" ]] || continue echo "Cleaning up mock $mock_conf" mock_root="${mock_conf_file##*/}" mock_root="${mock_root%.*}" my_mock="/usr/bin/mock" my_mock+=" --configdir=${mock_conf_file%/*}" my_mock+=" --root=${mock_root}" my_mock+=" --resultdir=$WORKSPACE" #TODO: investigate why mock --clean fails to umount certain dirs sometimes, #so we can use it instead of manually doing all this. echo "Killing all mock orphan processes, if any." $my_mock \ --orphanskill \ || { echo "ERROR: Failed to kill orphans on $chroot." failed=true } mock_root="$(\ grep \ -Po "(?<=config_opts\['root'\] = ')[^']*" \ "$mock_conf_file" \ )" || : [[ "$mock_root" ]] || continue mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $chroot. Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true } done done # Clean any leftover chroot from other jobs for mock_root in /var/lib/mock/*; do this_chroot_failed=false mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $mock_root." \ "Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true this_chroot_failed=true } done if ! $this_chroot_failed; then sudo rm -rf "$mock_root" fi done if $failed; then echo "Aborting." exit 1 fi # remove mock system cache, we will setup proxies to do the caching and this # takes lots of space between runs shopt -u nullglob sudo rm -Rf /var/cache/mock/* # restore the permissions in the working dir, as sometimes it leaves files # owned by root and then the 'cleanup workspace' from jenkins job fails to # clean and breaks the jobs sudo chown -R "$USER" "$WORKSPACE" [ovirt_master_system-tests] $ /bin/bash -xe /tmp/hudson4812618348886718774.sh + echo shell-scripts/mock_cleanup.sh shell-scripts/mock_cleanup.sh + shopt -s nullglob + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/> + cat _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### + logs=(./*log ./*/logs) + [[ -n ./ovirt-system-tests/logs ]] + tar cvzf exported-artifacts/logs.tgz ./ovirt-system-tests/logs ./ovirt-system-tests/logs/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/stdout_stderr.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/state.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/build.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/root.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/stdout_stderr.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/state.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/build.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/root.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.clean_rpmdb/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.clean_rpmdb/stdout_stderr.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.basic_suite_master.sh/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.basic_suite_master.sh/basic_suite_master.sh.log + rm -rf ./ovirt-system-tests/logs + failed=false + mock_confs=("$WORKSPACE"/*/mocker*) + for mock_conf_file in '"${mock_confs[@]}"' + [[ -n <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> ]] + echo 'Cleaning up mock ' Cleaning up mock + mock_root=mocker-fedora-23-x86_64.fc23.cfg + mock_root=mocker-fedora-23-x86_64.fc23 + my_mock=/usr/bin/mock + my_mock+=' --configdir=<http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-tests'> + my_mock+=' --root=mocker-fedora-23-x86_64.fc23' + my_mock+=' --resultdir=<http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/'> + echo 'Killing all mock orphan processes, if any.' Killing all mock orphan processes, if any. + /usr/bin/mock --configdir=<http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-tests> --root=mocker-fedora-23-x86_64.fc23 --resultdir=<http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/> --orphanskill WARNING: Could not find required logging config file: <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test….> Using default... INFO: mock.py version 1.2.18 starting (python version = 3.5.1)... Start: init plugins INFO: selinux enabled Finish: init plugins Start: run Finish: run ++ grep -Po '(?<=config_opts\['\''root'\''\] = '\'')[^'\'']*' <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/ovirt-system-test…> + mock_root=fedora-23-x86_64-4ddbe48c8f8b7d8c2c3635b52313f04a + [[ -n fedora-23-x86_64-4ddbe48c8f8b7d8c2c3635b52313f04a ]] + mounts=($(mount | awk '{print $3}' | grep "$mock_root")) ++ mount ++ awk '{print $3}' ++ grep fedora-23-x86_64-4ddbe48c8f8b7d8c2c3635b52313f04a + : + [[ -n '' ]] + false + shopt -u nullglob + sudo rm -Rf /var/cache/mock/fedora-23-x86_64-4ddbe48c8f8b7d8c2c3635b52313f04a + sudo chown -R jenkins <http://jenkins.ovirt.org/job/ovirt_master_system-tests/ws/> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 1 Recording test results Archiving artifacts

1 1

Build failed in Jenkins: ovirt_4.0_system-tests #148
by jenkins＠jenkins.phx.ovirt.org 10 Jul '16

10 Jul '16

See <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/148/changes> Changes: [Eyal Edri] add hystrix deps to yum repos include list ------------------------------------------ [...truncated 549 lines...] ## took 2307 seconds ## rc = 1 ########################################################## ##! ERROR vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv ##! Last 20 log enties: logs/mocker-fedora-23-x86_64.fc23.basic_suite_4.0.sh/basic_suite_4.0.sh.log ##! current session does not belong to lago group. @ Collect artifacts: # [Thread-1] lago_basic_suite_4_0_host0: # [Thread-2] lago_basic_suite_4_0_host1: # [Thread-3] lago_basic_suite_4_0_engine: # [Thread-4] lago_basic_suite_4_0_storage: # [Thread-1] lago_basic_suite_4_0_host0: Success (in 0:00:15) # [Thread-2] lago_basic_suite_4_0_host1: Success (in 0:00:15) # [Thread-3] lago_basic_suite_4_0_engine: Success (in 0:00:16) # [Thread-4] lago_basic_suite_4_0_storage: Success (in 0:00:16) @ Collect artifacts: Success (in 0:00:16) <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests> @@@@ ERROR: Failed running <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/b…> ######################### ======== Cleaning up ----------- Cleaning with lago ----------- Cleaning with lago done ======== Cleanup done Took 2134 seconds =================================== ##! ##! ERROR ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ##!######################################################## ########################################################## Build step 'Execute shell' marked build as failure Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo 'shell_scripts/system_tests.collect_logs.sh' # # Required jjb vars: # version # VERSION=4.0 SUITE_TYPE= WORKSPACE="$PWD" OVIRT_SUITE="$SUITE_TYPE_suite_$VERSION" TESTS_LOGS="$WORKSPACE/ovirt-system-tests/exported-artifacts" rm -rf "$WORKSPACE/exported-artifacts" mkdir -p "$WORKSPACE/exported-artifacts" if [[ -d "$TESTS_LOGS" ]]; then mv "$TESTS_LOGS/"* "$WORKSPACE/exported-artifacts/" fi [ovirt_4.0_system-tests] $ /bin/bash -xe /tmp/hudson3005391852137258240.sh + echo shell_scripts/system_tests.collect_logs.sh shell_scripts/system_tests.collect_logs.sh + VERSION=4.0 + SUITE_TYPE= + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/> + OVIRT_SUITE=4.0 + TESTS_LOGS=<http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/e…> + rm -rf <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/148/artifact/exported-a…> + mkdir -p <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/148/artifact/exported-a…> + [[ -d <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/e…> ]] + mv <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/148/artifact/exported-a…> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 0 Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo "shell-scripts/mock_cleanup.sh" shopt -s nullglob WORKSPACE="$PWD" # Make clear this is the cleanup, helps reading the jenkins logs cat <<EOC _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### EOC # Archive the logs, we want them anyway logs=( ./*log ./*/logs ) if [[ "$logs" ]]; then tar cvzf exported-artifacts/logs.tgz "${logs[@]}" rm -rf "${logs[@]}" fi # stop any processes running inside the chroot failed=false mock_confs=("$WORKSPACE"/*/mocker*) # Clean current jobs mockroot if any for mock_conf_file in "${mock_confs[@]}"; do [[ "$mock_conf_file" ]] || continue echo "Cleaning up mock $mock_conf" mock_root="${mock_conf_file##*/}" mock_root="${mock_root%.*}" my_mock="/usr/bin/mock" my_mock+=" --configdir=${mock_conf_file%/*}" my_mock+=" --root=${mock_root}" my_mock+=" --resultdir=$WORKSPACE" #TODO: investigate why mock --clean fails to umount certain dirs sometimes, #so we can use it instead of manually doing all this. echo "Killing all mock orphan processes, if any." $my_mock \ --orphanskill \ || { echo "ERROR: Failed to kill orphans on $chroot." failed=true } mock_root="$(\ grep \ -Po "(?<=config_opts\['root'\] = ')[^']*" \ "$mock_conf_file" \ )" || : [[ "$mock_root" ]] || continue mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $chroot. Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true } done done # Clean any leftover chroot from other jobs for mock_root in /var/lib/mock/*; do this_chroot_failed=false mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $mock_root." \ "Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true this_chroot_failed=true } done if ! $this_chroot_failed; then sudo rm -rf "$mock_root" fi done if $failed; then echo "Aborting." exit 1 fi # remove mock system cache, we will setup proxies to do the caching and this # takes lots of space between runs shopt -u nullglob sudo rm -Rf /var/cache/mock/* # restore the permissions in the working dir, as sometimes it leaves files # owned by root and then the 'cleanup workspace' from jenkins job fails to # clean and breaks the jobs sudo chown -R "$USER" "$WORKSPACE" [ovirt_4.0_system-tests] $ /bin/bash -xe /tmp/hudson6561692759003124028.sh + echo shell-scripts/mock_cleanup.sh shell-scripts/mock_cleanup.sh + shopt -s nullglob + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/> + cat _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### + logs=(./*log ./*/logs) + [[ -n ./ovirt-system-tests/logs ]] + tar cvzf exported-artifacts/logs.tgz ./ovirt-system-tests/logs ./ovirt-system-tests/logs/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/stdout_stderr.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/state.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/build.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/root.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/stdout_stderr.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/state.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/build.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/root.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.clean_rpmdb/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.clean_rpmdb/stdout_stderr.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.basic_suite_4.0.sh/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.basic_suite_4.0.sh/basic_suite_4.0.sh.log + rm -rf ./ovirt-system-tests/logs + failed=false + mock_confs=("$WORKSPACE"/*/mocker*) + for mock_conf_file in '"${mock_confs[@]}"' + [[ -n <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/m…> ]] + echo 'Cleaning up mock ' Cleaning up mock + mock_root=mocker-fedora-23-x86_64.fc23.cfg + mock_root=mocker-fedora-23-x86_64.fc23 + my_mock=/usr/bin/mock + my_mock+=' --configdir=<http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests'> + my_mock+=' --root=mocker-fedora-23-x86_64.fc23' + my_mock+=' --resultdir=<http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/'> + echo 'Killing all mock orphan processes, if any.' Killing all mock orphan processes, if any. + /usr/bin/mock --configdir=<http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests> --root=mocker-fedora-23-x86_64.fc23 --resultdir=<http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/> --orphanskill WARNING: Could not find required logging config file: <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/l….> Using default... INFO: mock.py version 1.2.18 starting (python version = 3.5.1)... Start: init plugins INFO: selinux enabled Finish: init plugins Start: run Finish: run ++ grep -Po '(?<=config_opts\['\''root'\''\] = '\'')[^'\'']*' <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/ovirt-system-tests/m…> + mock_root=fedora-23-x86_64-0c362156a2fa4a935ea8b988eb73b2ad + [[ -n fedora-23-x86_64-0c362156a2fa4a935ea8b988eb73b2ad ]] + mounts=($(mount | awk '{print $3}' | grep "$mock_root")) ++ mount ++ awk '{print $3}' ++ grep fedora-23-x86_64-0c362156a2fa4a935ea8b988eb73b2ad + : + [[ -n '' ]] + false + shopt -u nullglob + sudo rm -Rf /var/cache/mock/fedora-23-x86_64-0c362156a2fa4a935ea8b988eb73b2ad + sudo chown -R jenkins <http://jenkins.ovirt.org/job/ovirt_4.0_system-tests/ws/> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 1 Recording test results Archiving artifacts

1 3

Build failed in Jenkins: ovirt_3.6_system-tests #219
by jenkins＠jenkins.phx.ovirt.org 10 Jul '16

10 Jul '16

See <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/219/> ------------------------------------------ [...truncated 787 lines...] warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/docker-1.10.3-44.el7.centos.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/storaged-lvm2-2.2.0-3.el7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/cockpit-docker-0.108-1.el7.centos.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/libssh-0.7.1-2.el7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/oci-register-machine-1.10.3-44.el7.centos.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/cockpit-ws-0.108-1.el7.centos.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/cockpit-storaged-0.71-1.el7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/libstoraged-2.2.0-3.el7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/cockpit-0.108-1.el7.centos.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/cockpit-bridge-0.108-1.el7.centos.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/docker-forward-journald-1.10.3-44.el7.centos.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/docker-selinux-1.10.3-44.el7.centos.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/storaged-2.2.0-3.el7.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/x86_64/oci-systemd-hook-1.10.3-44.el7.centos.x86_64.rpm warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/repodata/ad622fbf4daec3da9f3b71a539b30ff427203b8596fae3a3c23563acf7040f3b-other.sqlite.bz2 warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/repodata/3de779fa482b711bc2a14c19fd3e420063073618e785a2db7a532c800945ca2a-other.xml.gz warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/repodata/6c0a4e65124b1b63bc7d38e85cc9f199ffc106054ab71f84ec5043ad013b065f-filelists.sqlite.bz2 warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/repodata/e78f380902ca3184aa616a147ca738098d7cb66a1efccd57957ddf8cbaea85cc-filelists.xml.gz warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/repodata/2ee5c662753fc25f715bdfa0292b7381c1a811123b922d4efabed77adc14f122-primary.sqlite.bz2 warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/repodata/6e1478425f37890ab2595e3f3c96d9971d3e0e9bd7155bad76746b258b794020-primary.xml.gz warning: failed to remove deployment-basic_suite_3.6/default/internal_repo/el7/repodata/repomd.xml warning: failed to remove deployment-basic_suite_3.6/current warning: failed to remove exported-artifacts/lago_logs/lago.log warning: failed to remove exported-artifacts/nosetests-001_initialize_engine.py.xml warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/boot.log warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/console.log warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/dump warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/engine.log warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/host-deploy warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/notifier warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/ovirt-image-uploader warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/ovirt-iso-uploader warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/server.log warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/setup/ovirt-engine-setup-20160710073600-oxs7nq.log warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_engine/_var_log_ovirt-engine/ui.log warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_host0/_var_log_messages warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_host1/_var_log_messages warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_basic_suite_3_6_storage warning: failed to remove exported-artifacts/test_logs/basic_suite_3.6/post-001_initialize_engine.py/lago_logs/lago.log at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1640) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1616) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1612) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:1254) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommand(CliGitAPIImpl.java:1266) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.clean(CliGitAPIImpl.java:621) at hudson.plugins.git.GitAPI.clean(GitAPI.java:311) at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at hudson.remoting.RemoteInvocationHandler$RPCRequest.perform(RemoteInvocationHandler.java:608) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:583) at hudson.remoting.RemoteInvocationHandler$RPCRequest.call(RemoteInvocationHandler.java:542) at hudson.remoting.UserRequest.perform(UserRequest.java:120) at hudson.remoting.UserRequest.perform(UserRequest.java:48) at hudson.remoting.Request$2.run(Request.java:326) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) at ......remote call to ovirt-srv20.phx.ovirt.org(Native Method) at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1416) at hudson.remoting.UserResponse.retrieve(UserRequest.java:220) at hudson.remoting.Channel.call(Channel.java:781) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:250) at com.sun.proxy.$Proxy71.clean(Unknown Source) at org.jenkinsci.plugins.gitclient.RemoteGitImpl.clean(RemoteGitImpl.java:444) at hudson.plugins.git.extensions.impl.CleanBeforeCheckout.decorateFetchCommand(CleanBeforeCheckout.java:32) at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:762) ... 12 more ERROR: null Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo 'shell_scripts/system_tests.collect_logs.sh' # # Required jjb vars: # version # VERSION=3.6 SUITE_TYPE= WORKSPACE="$PWD" OVIRT_SUITE="$SUITE_TYPE_suite_$VERSION" TESTS_LOGS="$WORKSPACE/ovirt-system-tests/exported-artifacts" rm -rf "$WORKSPACE/exported-artifacts" mkdir -p "$WORKSPACE/exported-artifacts" if [[ -d "$TESTS_LOGS" ]]; then mv "$TESTS_LOGS/"* "$WORKSPACE/exported-artifacts/" fi [ovirt_3.6_system-tests] $ /bin/bash -xe /tmp/hudson378668733062906348.sh + echo shell_scripts/system_tests.collect_logs.sh shell_scripts/system_tests.collect_logs.sh + VERSION=3.6 + SUITE_TYPE= + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> + OVIRT_SUITE=3.6 + TESTS_LOGS=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> + rm -rf <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/219/artifact/exported-a…> + mkdir -p <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/219/artifact/exported-a…> + [[ -d <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> ]] + mv <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/219/artifact/exported-a…> mv: cannot move '<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…'> to '<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/219/artifact/exported-a…'>: Permission denied mv: cannot move '<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…'> to '<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/219/artifact/exported-a…'>: Permission denied mv: cannot move '<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…'> to '<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/219/artifact/exported-a…'>: Permission denied POST BUILD TASK : FAILURE END OF POST BUILD TASK : 0 ESCALATE FAILED POST BUILD TASK TO JOB STATUS Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo "shell-scripts/mock_cleanup.sh" shopt -s nullglob WORKSPACE="$PWD" # Make clear this is the cleanup, helps reading the jenkins logs cat <<EOC _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### EOC # Archive the logs, we want them anyway logs=( ./*log ./*/logs ) if [[ "$logs" ]]; then tar cvzf exported-artifacts/logs.tgz "${logs[@]}" rm -rf "${logs[@]}" fi # stop any processes running inside the chroot failed=false mock_confs=("$WORKSPACE"/*/mocker*) # Clean current jobs mockroot if any for mock_conf_file in "${mock_confs[@]}"; do [[ "$mock_conf_file" ]] || continue echo "Cleaning up mock $mock_conf" mock_root="${mock_conf_file##*/}" mock_root="${mock_root%.*}" my_mock="/usr/bin/mock" my_mock+=" --configdir=${mock_conf_file%/*}" my_mock+=" --root=${mock_root}" my_mock+=" --resultdir=$WORKSPACE" #TODO: investigate why mock --clean fails to umount certain dirs sometimes, #so we can use it instead of manually doing all this. echo "Killing all mock orphan processes, if any." $my_mock \ --orphanskill \ || { echo "ERROR: Failed to kill orphans on $chroot." failed=true } mock_root="$(\ grep \ -Po "(?<=config_opts\['root'\] = ')[^']*" \ "$mock_conf_file" \ )" || : [[ "$mock_root" ]] || continue mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $chroot. Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true } done done # Clean any leftover chroot from other jobs for mock_root in /var/lib/mock/*; do this_chroot_failed=false mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $mock_root." \ "Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true this_chroot_failed=true } done if ! $this_chroot_failed; then sudo rm -rf "$mock_root" fi done if $failed; then echo "Aborting." exit 1 fi # remove mock system cache, we will setup proxies to do the caching and this # takes lots of space between runs shopt -u nullglob sudo rm -Rf /var/cache/mock/* # restore the permissions in the working dir, as sometimes it leaves files # owned by root and then the 'cleanup workspace' from jenkins job fails to # clean and breaks the jobs sudo chown -R "$USER" "$WORKSPACE" [ovirt_3.6_system-tests] $ /bin/bash -xe /tmp/hudson6363977727457908906.sh + echo shell-scripts/mock_cleanup.sh shell-scripts/mock_cleanup.sh + shopt -s nullglob + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> + cat _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### + logs=(./*log ./*/logs) + [[ -n '' ]] + failed=false + mock_confs=("$WORKSPACE"/*/mocker*) + false + shopt -u nullglob + sudo rm -Rf /var/cache/mock/fedora-23-x86_64-0eb52e4213cc7d73555a8d3bbc2d5df1 + sudo chown -R jenkins <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 1 Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Archiving artifacts

1 1

[JIRA] (OVIRT-625) jenkins colorized diff is not colorized anymore
by eyal edri [Administrator] (oVirt JIRA) 10 Jul '16

10 Jul '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-625?page=com.atlassian.jira.p… ] eyal edri [Administrator] updated OVIRT-625: -------------------------------------------- Epic Link: OVIRT-400 > jenkins colorized diff is not colorized anymore > ----------------------------------------------- > > Key: OVIRT-625 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-625 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: sbonazzo > Assignee: infra > > Have a look at: > http://jenkins.ovirt.org/job/jenkins_master_check-yaml_gerrit/217/artifact/… > output is not colorized anymore. > -- > Sandro Bonazzola > Better technology. Faster innovation. Powered by community collaboration. > See how it works at redhat.com -- This message was sent by Atlassian JIRA (v1000.141.1#100004)

1 0

[JIRA] (OVIRT-622) Weird messages about using post request for triggering jobs
by eyal edri [Administrator] (oVirt JIRA) 10 Jul '16

10 Jul '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-622?page=com.atlassian.jira.p… ] eyal edri [Administrator] reassigned OVIRT-622: ----------------------------------------------- Assignee: Evgheni Dereveanchin (was: infra) Evgheni, please check, I have a feeling its related to the network load/reverse proxy we're seeing from time to time recently > Weird messages about using post request for triggering jobs > ----------------------------------------------------------- > > Key: OVIRT-622 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-622 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: sbonazzo > Assignee: Evgheni Dereveanchin > > Hi, > just tried to trigger publisher job for 3.6 and got this message: > You must use POST method to trigger builds. (From scripts you may instead > pass a per-project authentication token, or authenticate with your API > token.) If you see this page, it may be because a plugin offered a GET > link; file a bug report for that plugin. > hitting the build now button opens: > http://jenkins.ovirt.org/view/Publishers/job/ovirt_3.6_publish-rpms_nightly… > which is passing GET parameter delay=0sec > This always worked before so I think it's related to some update done in > the last 4 weeks. > Can you have a look? > -- > Sandro Bonazzola > Better technology. Faster innovation. Powered by community collaboration. > See how it works at redhat.com -- This message was sent by Atlassian JIRA (v1000.141.1#100004)

1 0

Build failed in Jenkins: ovirt_3.6_system-tests #209
by jenkins＠jenkins.phx.ovirt.org 10 Jul '16

10 Jul '16

See <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/209/changes> Changes: [Eyal Edri] add hystrix deps to yum repos include list [Eyal Edri] remove missing fedora builds from 3.6 publisher [Eyal Edri] replace f23 with f24 builds ------------------------------------------ [...truncated 151 lines...] @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ ========== Scrubbing chroot mock \ --configdir="<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests"> \ --root="mocker-fedora-23-x86_64.fc23" \ --resultdir="logs/mocker-fedora-23-x86_64.fc23.scrub" \ --scrub=chroot WARNING: Could not find required logging config file: <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/l….> Using default... INFO: mock.py version 1.2.18 starting (python version = 3.5.1)... Start: init plugins INFO: selinux enabled Finish: init plugins Start: run Start: scrub ['chroot'] INFO: scrubbing chroot for mocker-fedora-23-x86_64.fc23 Finish: scrub ['chroot'] Finish: run Scrub chroot took 0 seconds ============================ ########################################################## ## Fri Jul 8 11:49:08 UTC 2016 Finished env: fc23:fedora-23-x86_64 ## took 1 seconds ## rc = 1 ########################################################## ##! ERROR vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv ##! Last 20 log enties: logs/mocker-fedora-23-x86_64.fc23.init/stdout_stderr.log ##! ========== Initializing chroot mock \ --configdir="<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests"> \ --root="mocker-fedora-23-x86_64.fc23" \ --resultdir="logs/mocker-fedora-23-x86_64.fc23.init" \ --init Init took 1 seconds ============================ ##! ##! ERROR ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ##!######################################################## ########################################################## Build step 'Execute shell' marked build as failure Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo 'shell_scripts/system_tests.collect_logs.sh' # # Required jjb vars: # version # VERSION=3.6 SUITE_TYPE= WORKSPACE="$PWD" OVIRT_SUITE="$SUITE_TYPE_suite_$VERSION" TESTS_LOGS="$WORKSPACE/ovirt-system-tests/exported-artifacts" rm -rf "$WORKSPACE/exported-artifacts" mkdir -p "$WORKSPACE/exported-artifacts" if [[ -d "$TESTS_LOGS" ]]; then mv "$TESTS_LOGS/"* "$WORKSPACE/exported-artifacts/" fi [ovirt_3.6_system-tests] $ /bin/bash -xe /tmp/hudson2859305231072948770.sh + echo shell_scripts/system_tests.collect_logs.sh shell_scripts/system_tests.collect_logs.sh + VERSION=3.6 + SUITE_TYPE= + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> + OVIRT_SUITE=3.6 + TESTS_LOGS=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> + rm -rf <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/209/artifact/exported-a…> + mkdir -p <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/209/artifact/exported-a…> + [[ -d <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> ]] POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 0 Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo "shell-scripts/mock_cleanup.sh" shopt -s nullglob WORKSPACE="$PWD" # Make clear this is the cleanup, helps reading the jenkins logs cat <<EOC _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### EOC # Archive the logs, we want them anyway logs=( ./*log ./*/logs ) if [[ "$logs" ]]; then tar cvzf exported-artifacts/logs.tgz "${logs[@]}" rm -rf "${logs[@]}" fi # stop any processes running inside the chroot failed=false mock_confs=("$WORKSPACE"/*/mocker*) # Clean current jobs mockroot if any for mock_conf_file in "${mock_confs[@]}"; do [[ "$mock_conf_file" ]] || continue echo "Cleaning up mock $mock_conf" mock_root="${mock_conf_file##*/}" mock_root="${mock_root%.*}" my_mock="/usr/bin/mock" my_mock+=" --configdir=${mock_conf_file%/*}" my_mock+=" --root=${mock_root}" my_mock+=" --resultdir=$WORKSPACE" #TODO: investigate why mock --clean fails to umount certain dirs sometimes, #so we can use it instead of manually doing all this. echo "Killing all mock orphan processes, if any." $my_mock \ --orphanskill \ || { echo "ERROR: Failed to kill orphans on $chroot." failed=true } mock_root="$(\ grep \ -Po "(?<=config_opts\['root'\] = ')[^']*" \ "$mock_conf_file" \ )" || : [[ "$mock_root" ]] || continue mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $chroot. Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true } done done # Clean any leftover chroot from other jobs for mock_root in /var/lib/mock/*; do this_chroot_failed=false mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $mock_root." \ "Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true this_chroot_failed=true } done if ! $this_chroot_failed; then sudo rm -rf "$mock_root" fi done if $failed; then echo "Aborting." exit 1 fi # remove mock system cache, we will setup proxies to do the caching and this # takes lots of space between runs shopt -u nullglob sudo rm -Rf /var/cache/mock/* # restore the permissions in the working dir, as sometimes it leaves files # owned by root and then the 'cleanup workspace' from jenkins job fails to # clean and breaks the jobs sudo chown -R "$USER" "$WORKSPACE" [ovirt_3.6_system-tests] $ /bin/bash -xe /tmp/hudson3572324428158029156.sh + echo shell-scripts/mock_cleanup.sh shell-scripts/mock_cleanup.sh + shopt -s nullglob + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> + cat _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### + logs=(./*log ./*/logs) + [[ -n ./ovirt-system-tests/logs ]] + tar cvzf exported-artifacts/logs.tgz ./ovirt-system-tests/logs ./ovirt-system-tests/logs/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/stdout_stderr.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/state.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/build.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/root.log + rm -rf ./ovirt-system-tests/logs + failed=false + mock_confs=("$WORKSPACE"/*/mocker*) + for mock_conf_file in '"${mock_confs[@]}"' + [[ -n <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/m…> ]] + echo 'Cleaning up mock ' Cleaning up mock + mock_root=mocker-fedora-23-x86_64.fc23.cfg + mock_root=mocker-fedora-23-x86_64.fc23 + my_mock=/usr/bin/mock + my_mock+=' --configdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests'> + my_mock+=' --root=mocker-fedora-23-x86_64.fc23' + my_mock+=' --resultdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/'> + echo 'Killing all mock orphan processes, if any.' Killing all mock orphan processes, if any. + /usr/bin/mock --configdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests> --root=mocker-fedora-23-x86_64.fc23 --resultdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> --orphanskill WARNING: Could not find required logging config file: <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/l….> Using default... INFO: mock.py version 1.2.18 starting (python version = 3.5.1)... Start: init plugins INFO: selinux enabled Finish: init plugins Start: run Finish: run ++ grep -Po '(?<=config_opts\['\''root'\''\] = '\'')[^'\'']*' <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/m…> + mock_root=fedora-23-x86_64-ecdfd9c866cbf1a2d41342199fdb011f + [[ -n fedora-23-x86_64-ecdfd9c866cbf1a2d41342199fdb011f ]] + mounts=($(mount | awk '{print $3}' | grep "$mock_root")) ++ mount ++ awk '{print $3}' ++ grep fedora-23-x86_64-ecdfd9c866cbf1a2d41342199fdb011f + : + [[ -n '' ]] + false + shopt -u nullglob + sudo rm -Rf /var/cache/mock/fedora-23-x86_64-ecdfd9c866cbf1a2d41342199fdb011f + sudo chown -R jenkins <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 1 Recording test results ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Archiving artifacts

1 8

[JIRA] (OVIRT-627) add manual testing flow to experimental
by eyal edri [Administrator] (oVirt JIRA) 10 Jul '16

10 Jul '16

eyal edri [Administrator] created OVIRT-627: ----------------------------------------------- Summary: add manual testing flow to experimental Key: OVIRT-627 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-627 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: eyal edri [Administrator] Assignee: infra Today, we can test a patch per project on each of the ovirt versions using experimanal flow i,e: run build_artifacts with a patch -> deploy to experimental -> run test job this is problematic since it actually deploys the build with the patch to the experimental repo which should only contain built pkg that are merged. We need to either close the flow or add param to the build artifacts that says 'create temp repo/test repo' so the built rpm won't be part of the official tested repo and the link to latest_tested won't be updated if this option is triggered. -- This message was sent by Atlassian JIRA (v1000.141.1#100004)

1 0

[oVirt Jenkins] gil-test-email - Build # 3 - Successful!
by jenkins＠jenkins.phx.ovirt.org 10 Jul '16

10 Jul '16

------=_Part_79_388240182.1468139962360 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/gil-test-email/ Build: http://jenkins.ovirt.org/job/gil-test-email/3/ Build Number: 3 Build Status: Successful Triggered By: Started by user Gil Shinar ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #3 No changes ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_79_388240182.1468139962360--

1 0

[JIRA] (OVIRT-624) CI Gerrit trigger can make -1 go away if another job finish after and gives +1
by eyal edri [Administrator] (oVirt JIRA) 10 Jul '16

10 Jul '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-624?page=com.atlassian.jira.p… ] eyal edri [Administrator] reassigned OVIRT-624: ----------------------------------------------- Assignee: Shlomo Ben David (was: infra) Please check if we can do something about gerrit trigger configuration to make it not ignore -1 given by other jobs. The easiest will be to move everyting to standard CI, but we can't do it yet, because we still have a few jobs like find bugs and engine-upgrade/setup that are not using STD CI. Lets see if its possible to tweak it either on jenkins or gerrit side (maybe with newer versions) > CI Gerrit trigger can make -1 go away if another job finish after and gives +1 > ------------------------------------------------------------------------------ > > Key: OVIRT-624 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-624 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Martin Mucha > Assignee: Shlomo Ben David > > Hi, > this build gave invalid ci -1: > http://jenkins.ovirt.org/job/ovirt-engine_master_find-bugs_gerrit/46153/ > findbugs complaint about class not altered in patch. > please react quickly, before build disappears. > Thanks, > M. -- This message was sent by Atlassian JIRA (v1000.141.1#100004)

1 0