February 2017 - Infra - oVirt List Archives

[HEADS UP] ovift-engine: repository closure check on check-patch
by Sandro Bonazzola 26 Feb '17

26 Feb '17

Hi, with the following commits: - https://gerrit.ovirt.org/71553 - https://gerrit.ovirt.org/71623 a minimal repository closure check is added to check-patches.sh. Instead of performing a full blown repository closure, I limited the check to the built rpms in oreder to reduce the risk of hitting repository closure errors due to different projects. This should help dropping the long time failing repository closure jobs which are struggling to keep the pace with the changes we introduce in master. It should also help avoiding to merge patches which will break the repository and the plain rpm install flow. The second patch switch from ovirt-master-release to experimental repo. Here I need infra input, not sure experimental is the desired repo, deisgned to replace ovirt-master-snapshot. Thanks, -- Sandro Bonazzola Better technology. Faster innovation. Powered by community collaboration. See how it works at redhat.com

2 4

Can we remove unhelpful text from ovirt system tests console?
by Nir Soffer 26 Feb '17

26 Feb '17

Hi all, Can we remove the unhelpful text from console output? If this output is needed for debugging the CI itself, it should go to a separate log, or be hidden by default (e.g. click to toggle). For users of this system, only text that matter to the *user* should be displayed: - Starting run (server address, server info) - Test configuration (engine version, vdsm version, lago version, etc.) - Environment configuration - Starting test suit - Starting test - Test finished (ok, failed) - Ending suit - Collecting log - Test summary To understand this issue better, please read the the following output :-) This issue also exit in the the standard jobs, but is more painful in OST. Nir --- 00:00:00.002 Started by user Nir Soffer 00:00:00.021 [EnvInject] - Loading node environment variables. 00:00:00.027 Building remotely on ovirt-srv21.phx.ovirt.org (fc24 phx integ-tests physical) in workspace /home/jenkins/workspace/ovirt-system-tests_manual 00:00:00.046 Cloning the remote Git repository 00:00:00.049 Cloning repository git://gerrit.ovirt.org/ovirt-system-tests.git 00:00:00.050 > git init /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests # timeout=10 00:00:00.055 Fetching upstream changes from git://gerrit.ovirt.org/ovirt-system-tests.git 00:00:00.055 > git --version # timeout=10 00:00:00.057 > git fetch --tags --progress git://gerrit.ovirt.org/ovirt-system-tests.git +refs/heads/*:refs/remotes/origin/* 00:00:01.224 > git config remote.origin.url git://gerrit.ovirt.org/ovirt-system-tests.git # timeout=10 00:00:01.227 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 00:00:01.232 > git config remote.origin.url git://gerrit.ovirt.org/ovirt-system-tests.git # timeout=10 00:00:01.235 Cleaning workspace 00:00:01.237 > git rev-parse --verify HEAD # timeout=10 00:00:01.240 No valid HEAD. Skipping the resetting 00:00:01.240 > git clean -fdx # timeout=10 00:00:01.242 Pruning obsolete local branches 00:00:01.245 Fetching upstream changes from git://gerrit.ovirt.org/ovirt-system-tests.git 00:00:01.245 > git fetch --tags --progress git://gerrit.ovirt.org/ovirt-system-tests.git refs/heads/master --prune 00:00:01.740 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:01.755 Checking out Revision 1b87bdf60900ebb5c155b619095de3813ccd55d9 (origin/master) 00:00:01.758 > git config core.sparsecheckout # timeout=10 00:00:01.760 > git checkout -f 1b87bdf60900ebb5c155b619095de3813ccd55d9 00:00:01.799 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:01.810 > git rev-list f734e31cf552967ed20920cc3bf52a568fe76d82 # timeout=10 00:00:01.840 Cloning the remote Git repository 00:00:01.843 Cloning repository http://gerrit.ovirt.org/jenkins.git 00:00:01.843 > git init /home/jenkins/workspace/ovirt-system-tests_manual/jenkins # timeout=10 00:00:01.847 Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git 00:00:01.847 > git --version # timeout=10 00:00:01.849 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* 00:00:03.646 > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 00:00:03.649 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # timeout=10 00:00:03.659 > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 00:00:03.666 Cleaning workspace 00:00:03.669 > git rev-parse --verify HEAD # timeout=10 00:00:03.676 No valid HEAD. Skipping the resetting 00:00:03.676 > git clean -fdx # timeout=10 00:00:03.677 Pruning obsolete local branches 00:00:03.682 Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git 00:00:03.682 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune 00:00:04.232 > git rev-parse origin/master^{commit} # timeout=10 00:00:04.235 Checking out Revision b4de3457fa69b61caeae31d74129976b35489a3a (origin/master) 00:00:04.237 > git config core.sparsecheckout # timeout=10 00:00:04.240 > git checkout -f b4de3457fa69b61caeae31d74129976b35489a3a 00:00:04.284 > git rev-list b4de3457fa69b61caeae31d74129976b35489a3a # timeout=10 00:00:04.325 [ovirt-system-tests_manual] $ /bin/bash -e /tmp/hudson4273955741408554997.sh 00:00:04.326 shell-scripts/cleanup_slave.sh 00:00:04.329 ################################################################### 00:00:04.329 # Cleaning up slave # 00:00:04.329 ################################################################### 00:00:04.342 Filesystem Size Used Avail Use% Mounted on 00:00:04.342 devtmpfs 24G 0 24G 0% /dev 00:00:04.342 tmpfs 24G 8.0G 16G 34% /dev/shm 00:00:04.342 tmpfs 24G 9.2M 24G 1% /run 00:00:04.342 tmpfs 24G 0 24G 0% /sys/fs/cgroup 00:00:04.342 /dev/sda3 908G 24G 884G 3% / 00:00:04.342 tmpfs 24G 244K 24G 1% /tmp 00:00:04.342 /dev/sda1 253M 126M 128M 50% /boot 00:00:04.342 tmpfs 4.8G 0 4.8G 0% /run/user/1012 00:00:04.343 --------------------------------------------------------------- 00:00:04.343 Cleaning up postgres databases 00:00:04.344 /tmp ~/workspace/ovirt-system-tests_manual 00:00:04.352 sudo: psql: command not found 00:00:04.353 ~/workspace/ovirt-system-tests_manual 00:00:04.353 done 00:00:04.353 Cleaning up journal logs (if any) 00:00:04.477 Redirecting to /bin/systemctl restart systemd-journald.service 00:00:04.720 Cleaning up /var/tmp 00:00:04.720 done 00:00:04.720 Emptying some common logs 00:00:04.739 /var/log/wtmp 00:00:04.756 Done 00:00:04.756 Cleaning up workspaces 00:00:04.756 /home/jenkins/workspace/test-repo_ovirt_experimental_4.1 00:00:04.888 /home/jenkins/workspace/test-repo_ovirt_experimental_4.1@tmp 00:00:04.895 Making sure there are no device mappings... 00:00:04.910 Removing the used loop devices... 00:00:05.082 Redirecting to /bin/systemctl restart libvirtd.service 00:00:06.655 --------------------------------------------------------------- 00:00:06.671 Filesystem Size Used Avail Use% Mounted on 00:00:06.671 devtmpfs 24G 0 24G 0% /dev 00:00:06.671 tmpfs 24G 8.0G 16G 34% /dev/shm 00:00:06.671 tmpfs 24G 9.2M 24G 1% /run 00:00:06.671 tmpfs 24G 0 24G 0% /sys/fs/cgroup 00:00:06.671 /dev/sda3 908G 24G 884G 3% / 00:00:06.671 tmpfs 24G 244K 24G 1% /tmp 00:00:06.671 /dev/sda1 253M 126M 128M 50% /boot 00:00:06.671 tmpfs 4.8G 0 4.8G 0% /run/user/1012 00:00:06.672 ################################################################### 00:00:06.672 # Slave cleanup done # 00:00:06.672 ################################################################### 00:00:06.686 [ovirt-system-tests_manual] $ /bin/bash -xe /tmp/hudson630628407240599324.sh 00:00:06.688 + [[ stable = \u\n\s\t\a\b\l\e ]] 00:00:06.704 [ovirt-system-tests_manual] $ /bin/bash -xe /tmp/hudson6716759035228323238.sh 00:00:06.707 + '[' -z x ']' 00:00:06.707 + echo http://jenkins.ovirt.org/job/vdsm_master_build-artifacts-on-demand-el7-x86_… 00:00:06.707 + [[ latest_tested = \l\a\t\e\s\t\_\t\e\s\t\e\d ]] 00:00:06.707 + echo rec:http://plain.resources.ovirt.org/repos/ovirt/experimental/4.1/latest.te… 00:00:06.722 [ovirt-system-tests_manual] $ /usr/bin/env python /tmp/hudson320001683352275681.sh 00:00:06.900 [ovirt-system-tests_manual] $ /bin/bash -xe /tmp/hudson8899940778056051311.sh 00:00:06.901 + rm -rf ovirt-system-tests/deployment-basic_suite_4.1 00:00:06.923 [ovirt-system-tests_manual] $ /bin/bash -xe /tmp/hudson3346977489304109542.sh 00:00:06.925 + echo shell-scripts/global_setup.sh 00:00:06.925 shell-scripts/global_setup.sh 00:00:06.925 + rm -rf /home/jenkins/workspace/ovirt-system-tests_manual/tmp 00:00:06.926 + mkdir -p /home/jenkins/workspace/ovirt-system-tests_manual/tmp 00:00:06.942 [ovirt-system-tests_manual] $ /bin/bash -xe /tmp/hudson5888114385967221308.sh 00:00:06.943 + echo shell-scripts/mock_setup.sh 00:00:06.943 shell-scripts/mock_setup.sh 00:00:06.943 + shopt -s nullglob 00:00:06.944 + [[ '' == \t\r\u\e ]] 00:00:06.944 + failed=false 00:00:06.944 + mock_dir=/home/jenkins/workspace/ovirt-system-tests_manual/mock 00:00:06.944 + chroots=("$WORKSPACE"/mock/*) 00:00:06.945 ++ uname -i 00:00:06.945 + arch=x86_64 00:00:06.945 + echo 'arch is x86_64' 00:00:06.945 arch is x86_64 00:00:06.945 + false 00:00:06.945 + sudo rm -Rf mock mock-cache exported-artifacts 00:00:06.961 + mkdir -p mock exported-artifacts 00:00:06.962 + chgrp mock mock /home/jenkins/workspace/ovirt-system-tests_manual /home/jenkins/workspace/ovirt-system-tests_manual/exported-artifacts 00:00:06.964 + chmod g+rws mock 00:00:06.965 + sudo touch /var/cache/mock/epel-7-x86_64-01697a1bf57a435c45bc1a350385679f/root_cache/cache.tar.gz /var/cache/mock/epel-7-x86_64-399702c59af639c37a994aa1edaf2b42/root_cache/cache.tar.gz /var/cache/mock/epel-7-x86_64-5b49d5ab6dd463517e7d1f75a1af3c45/root_cache/cache.tar.gz /var/cache/mock/epel-7-x86_64-738f2cae5d5ae64e84b02ae0edcfa38d/root_cache/cache.tar.gz /var/cache/mock/epel-7-x86_64-8210d7ad1003fd297f7ef42b45a8f241/root_cache/cache.tar.gz /var/cache/mock/epel-7-x86_64-879e19824572188438e953cc9ca88baf/root_cache/cache.tar.gz /var/cache/mock/fedora-25-x86_64-081f9a3eab4b49384d184a44dec787f4/root_cache/cache.tar.gz /var/cache/mock/fedora-25-x86_64-43689cce8ba2fabbbe0ce475d86f5f9b/root_cache/cache.tar.gz /var/cache/mock/fedora-25-x86_64-d916215305890e3e4f9f56e564215882/root_cache/cache.tar.gz 00:00:06.979 + sudo yum clean all 00:00:06.991 Redirecting to '/usr/bin/dnf clean all' (see 'man yum2dnf') 00:00:06.991 00:00:07.193 0 files removed 00:00:07.211 + exit 0 00:00:07.224 [ovirt-system-tests_manual] $ /bin/bash -xe /tmp/hudson3970903084390783171.sh 00:00:07.227 + WORKSPACE=/home/jenkins/workspace/ovirt-system-tests_manual 00:00:07.227 + try_mirrors=(${CI_MIRRORS_URL:+--try-mirrors "$CI_MIRRORS_URL"}) 00:00:07.227 + cd ./ovirt-system-tests 00:00:07.228 + /home/jenkins/workspace/ovirt-system-tests_manual/jenkins/mock_configs/mock_runner.sh --execute-script automation/basic_suite_4.1.sh --mock-confs-dir /home/jenkins/workspace/ovirt-system-tests_manual/jenkins/mock_configs --try-proxy --try-mirrors http://mirrors.phx.ovirt.org/repos/yum/all_latest.json 'el7.*x86_64' 00:00:07.239 ########################################################## 00:00:07.239 ########################################################## 00:00:07.240 ## Thu Feb 23 19:26:55 UTC 2017 Running env: el7:epel-7-x86_64 00:00:07.240 ########################################################## 00:00:07.243 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 00:00:07.244 @@ Thu Feb 23 19:26:55 UTC 2017 Running chroot for script: automation/basic_suite_4.1.sh 00:00:07.244 @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ 00:00:07.245 Using base mock conf /home/jenkins/workspace/ovirt-system-tests_manual/jenkins/mock_configs/epel-7-x86_64.cfg 00:00:07.247 WARN: Unable to find req file automation/basic_suite_4.1.req or automation/basic_suite_4.1.req.el7, skipping req 00:00:07.341 Using proxified config /home/jenkins/workspace/ovirt-system-tests_manual/jenkins/mock_configs/epel-7-x86_64_proxied.cfg 00:00:07.341 Generating temporary mock conf /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/mocker-epel-7-x86_64.el7 00:00:07.343 Skipping mount points 00:00:07.349 Using chroot cache = /var/cache/mock/epel-7-x86_64-879e19824572188438e953cc9ca88baf 00:00:07.349 Using chroot dir = /var/lib/mock/epel-7-x86_64-879e19824572188438e953cc9ca88baf-64500 00:00:07.352 Adding repo lago -> http://resources.ovirt.org/repos/lago/stable/0.0/rpm/el7 00:00:07.353 Adding repo ovirt-master-snapshot -> http://resources.ovirt.org/pub/ovirt-master-snapshot/rpm/el7 00:00:07.355 Adding repo ci-tools -> http://resources.ovirt.org/repos/ci-tools/el7 00:00:07.370 ========== Initializing chroot 00:00:07.372 mock \ 00:00:07.372 --configdir="/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests" \ 00:00:07.372 --root="mocker-epel-7-x86_64.el7" \ 00:00:07.372 --resultdir="./mock_logs.MV9XJacl/mocker-epel-7-x86_64.el7.init" \ 00:00:07.372 --init 00:00:07.695 WARNING: Could not find required logging config file: /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/logging.ini. Using default... 00:00:07.702 INFO: mock.py version 1.2.21 starting (python version = 3.5.1)... 00:00:07.741 Start: init plugins 00:00:07.770 INFO: selinux enabled 00:00:07.782 Finish: init plugins 00:00:07.783 Start: run 00:00:07.787 Start: clean chroot 00:00:07.788 Finish: clean chroot 00:00:07.794 Start: chroot init 00:00:07.811 INFO: calling preinit hooks 00:00:07.813 INFO: enabled root cache 00:00:07.816 Start: unpacking root cache 00:00:14.304 Finish: unpacking root cache 00:00:14.306 INFO: enabled yum cache 00:00:14.311 Start: cleaning yum metadata 00:00:14.317 Finish: cleaning yum metadata 00:00:14.365 Mock Version: 1.2.21 00:00:14.366 INFO: Mock Version: 1.2.21 00:00:14.528 Finish: chroot init 00:00:14.531 Finish: run 00:00:14.684 Init took 7 seconds 00:00:14.684 ============================ 00:00:14.689 ========== Cleaning rpmdb 00:00:14.693 mock \ 00:00:14.693 --configdir="/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests" \ 00:00:14.694 --root="mocker-epel-7-x86_64.el7" \ 00:00:14.694 --resultdir="./mock_logs.MV9XJacl/mocker-epel-7-x86_64.el7.clean_rpmdb" \ 00:00:14.694 --shell <<EOC 00:00:14.694 set -e 00:00:14.694 logdir="/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/./mock_logs.MV9XJacl/mocker-epel-7-x86_64.el7.clean_rpmdb" 00:00:14.694 [[ -d $logdir ]] \ 00:00:14.694 || mkdir -p "$logdir" 00:00:14.694 # Fix that allows using yum inside the chroot on dnf enabled 00:00:14.694 # distros 00:00:14.694 [[ -d /etc/dnf ]] && [[ -e /etc/yum/yum.conf ]] && cat /etc/yum/yum.conf > /etc/dnf/dnf.conf 00:00:14.694 rm -Rf /var/lib/rpm/__* &>$logdir/rpmbuild.log 00:00:14.694 rpm --rebuilddb &>>$logdir/rpmbuild.log 00:00:14.694 EOC 00:00:14.975 WARNING: Could not find required logging config file: /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/logging.ini. Using default... 00:00:14.980 INFO: mock.py version 1.2.21 starting (python version = 3.5.1)... 00:00:14.999 Start: init plugins 00:00:15.016 INFO: selinux enabled 00:00:15.023 Finish: init plugins 00:00:15.023 Start: run 00:00:15.029 Start: chroot init 00:00:15.041 INFO: calling preinit hooks 00:00:15.042 INFO: enabled root cache 00:00:15.046 INFO: enabled yum cache 00:00:15.048 Start: cleaning yum metadata 00:00:15.052 Finish: cleaning yum metadata 00:00:15.370 Finish: chroot init 00:00:15.373 Start: shell 00:00:15.384 sh: no job control in this shell 00:00:15.400 <mock-chroot> sh-4.2# set -e 00:00:15.418 <mock-chroot> sh-4.2# logdir="/home/jenkins/workspace/ovirt-system-t ests_manual/ovirt-system-tests/./mock_logs.MV9XJacl/mocker-epel-7-x86_64.el7.cle an_rpmdb" 00:00:15.421 <mock-chroot> sh-4.2# [[ -d $logdir ]] \ 00:00:15.424 > || mkdir -p "$logdir" 00:00:15.430 <mock-chroot> sh-4.2# # Fix that allows using yum inside the chroot on dnf enabled 00:00:15.432 <mock-chroot> sh-4.2# # distros 00:00:15.440 <mock-chroot> sh-4.2# [[ -d /etc/dnf ]] && [[ -e /etc/yum/yum.conf ] ] && cat /etc/yum/yum.conf > /etc/dnf/dnf.conf 00:00:15.446 <mock-chroot> sh-4.2# rm -Rf /var/lib/rpm/__* &>$logdir/rpmbuild.log g 00:00:15.451 <mock-chroot> sh-4.2# rpm --rebuilddb &>>$logdir/rpmbuild.log 00:00:16.674 <mock-chroot> sh-4.2# logout 00:00:16.679 Finish: shell 00:00:16.851 Clean rpmdb took 2 seconds 00:00:16.851 ============================ 00:00:16.940 Using proxified config /home/jenkins/workspace/ovirt-system-tests_manual/jenkins/mock_configs/epel-7-x86_64_proxied.cfg 00:00:16.940 Generating temporary mock conf /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/mocker-epel-7-x86_64.el7 00:00:16.942 Adding mount points 00:00:16.956 Using chroot cache = /var/cache/mock/epel-7-x86_64-879e19824572188438e953cc9ca88baf 00:00:16.956 Using chroot dir = /var/lib/mock/epel-7-x86_64-879e19824572188438e953cc9ca88baf-64500 00:00:16.959 Adding repo lago -> http://resources.ovirt.org/repos/lago/stable/0.0/rpm/el7 00:00:16.960 Adding repo ovirt-master-snapshot -> http://resources.ovirt.org/pub/ovirt-master-snapshot/rpm/el7 00:00:16.962 Adding repo ci-tools -> http://resources.ovirt.org/repos/ci-tools/el7 00:00:16.976 mock \ 00:00:16.976 --root="mocker-epel-7-x86_64.el7" \ 00:00:16.976 --configdir="/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests" \ 00:00:16.976 --no-clean \ 00:00:16.976 --resultdir="./mock_logs.MV9XJacl/mocker-epel-7-x86_64.el7.basic_suite_4.1.sh" \ 00:00:16.976 --shell <<EOS 00:00:16.976 set -e 00:00:16.976 # Remove all system repos from the environment to ensure we're not 00:00:16.976 # using any pakcge repos we didn't specify explicitly 00:00:16.976 rpm -qf /etc/system-release | xargs -r rpm -ql fedora-repos epel-release | grep '/etc/yum\.repos\.d/.*\.repo' | xargs -r rm -fv 00:00:16.977 logdir="/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/./mock_logs.MV9XJacl/mocker-epel-7-x86_64.el7.basic_suite_4.1.sh" 00:00:16.977 [[ -d "\$logdir" ]] \ 00:00:16.977 || mkdir -p "\$logdir" 00:00:16.977 export HOME=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:00:16.977 cd 00:00:16.977 chmod +x automation/basic_suite_4.1.sh 00:00:16.977 runner_GID="1012" 00:00:16.977 runner_GROUP="jenkins" 00:00:16.977 # mock group is called mockbuild inside the chroot 00:00:16.977 if [[ \$runner_GROUP == "mock" ]]; then 00:00:16.977 runner_GROUP=mockbuild 00:00:16.977 fi 00:00:16.977 if ! getent group "\$runner_GID" &>/dev/null; then 00:00:16.977 groupadd \ 00:00:16.977 --gid "\$runner_GID" \ 00:00:16.977 "\$runner_GROUP" 00:00:16.978 fi 00:00:16.978 start="\$(date +%s)" 00:00:16.978 res=0 00:00:16.978 echo "========== Running the shellscript automation/basic_suite_4.1.sh" \ 00:00:16.978 | tee -a \$logdir/basic_suite_4.1.sh.log 00:00:16.978 ./automation/basic_suite_4.1.sh 2>&1 | tee -a \$logdir/basic_suite_4.1.sh.log \ 00:00:16.978 || res=\${PIPESTATUS[0]} 00:00:16.978 end="\$(date +%s)" 00:00:16.978 echo "Took \$((end - start)) seconds" \ 00:00:16.978 | tee -a \$logdir/basic_suite_4.1.sh.log 00:00:16.978 echo "===================================" \ 00:00:16.978 | tee -a \$logdir/basic_suite_4.1.sh.log 00:00:16.978 if [[ "\$(find . -uid 0 -print -quit)" != '' ]]; then 00:00:16.978 chown -R "$UID:\$runner_GID" . 00:00:16.978 fi 00:00:16.978 exit \$res 00:00:16.978 EOS 00:00:17.274 WARNING: Could not find required logging config file: /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/logging.ini. Using default... 00:00:17.281 INFO: mock.py version 1.2.21 starting (python version = 3.5.1)... 00:00:17.313 Start: init plugins 00:00:17.355 INFO: selinux enabled 00:00:17.362 Finish: init plugins 00:00:17.363 Start: run 00:00:17.369 Start: chroot init 00:00:17.382 INFO: calling preinit hooks 00:00:17.384 INFO: enabled root cache 00:00:17.387 INFO: enabled yum cache 00:00:17.390 Start: cleaning yum metadata 00:00:17.394 Finish: cleaning yum metadata 00:00:17.567 Finish: chroot init 00:00:17.569 Start: shell 00:00:17.579 sh: no job control in this shell 00:00:17.593 <mock-chroot> sh-4.2# set -e 00:00:17.599 <mock-chroot> sh-4.2# # Remove all system repos from the environment to ensure we're not 00:00:17.604 <mock-chroot> sh-4.2# # using any pakcge repos we didn't specify exp licitly 00:00:17.621 <mock-chroot> sh-4.2# rpm -qf /etc/system-release | xargs -r rpm -ql fedora-repos epel-release | grep '/etc/yum\.rep os\.d/.*\.repo' | xargs -r rm -fv 00:00:17.670 removed ��/etc/yum.repos.d/CentOS-Base.repo�� 00:00:17.670 removed ��/etc/yum.repos.d/CentOS-CR.repo�� 00:00:17.670 removed ��/etc/yum.repos.d/CentOS-Debuginfo.repo�� 00:00:17.670 removed ��/etc/yum.repos.d/CentOS-Media.repo�� 00:00:17.670 removed ��/etc/yum.repos.d/CentOS-Sources.repo�� 00:00:17.670 removed ��/etc/yum.repos.d/CentOS-Vault.repo�� 00:00:17.670 removed ��/etc/yum.repos.d/CentOS-fasttrack.repo�� 00:00:17.693 <mock-chroot> sh-4.2# logdir="/home/jenkins/workspace/ovirt-system-t ests_manual/ovirt-system-tests/./mock_logs.MV9XJacl/mocker-epel-7-x86_64.el7.bas ic_suite_4.1.sh" 00:00:17.696 <mock-chroot> sh-4.2# [[ -d "$logdir" ]] \ 00:00:17.698 > || mkdir -p "$logdir" 00:00:17.705 <mock-chroot> sh-4.2# export HOME=/home/jenkins/workspace/ovirt-syst em-tests_manual/ovirt-system-tests 00:00:17.706 <mock-chroot> sh-4.2# cd 00:00:17.710 <mock-chroot> sh-4.2# chmod +x automation/basic_suite_4.1.sh 00:00:17.712 <mock-chroot> sh-4.2# runner_GID="1012" 00:00:17.715 <mock-chroot> sh-4.2# runner_GROUP="jenkins" 00:00:17.719 <mock-chroot> sh-4.2# # mock group is called mockbuild inside the ch root 00:00:17.725 <mock-chroot> sh-4.2# if [[ $runner_GROUP == "mock" ]]; then 00:00:17.728 > runner_GROUP=mockbuild 00:00:17.729 > fi 00:00:17.735 <mock-chroot> sh-4.2# if ! getent group "$runner_GID" &>/dev/null; t hen 00:00:17.745 > groupadd --gid "$runner_GID" "$runner_GROUP" 00:00:17.746 > fi 00:00:17.828 <mock-chroot> sh-4.2# start="$(date +%s)" 00:00:17.834 <mock-chroot> sh-4.2# res=0 00:00:17.845 <mock-chroot> sh-4.2# echo "========== Running the shellscript autom ation/basic_suite_4.1.sh" | tee -a $logdir/basic_suite_4.1.sh.lo g 00:00:17.845 ========== Running the shellscript automation/basic_suite_4.1.sh 00:00:17.852 <mock-chroot> sh-4.2# # It turns out that on some scripts if the fol lowing is not all 00:00:17.864 <mock-chroot> sh-4.2# # in the same line, it never runs and returns with 0 (giving false 00:00:17.866 <mock-chroot> sh-4.2# # positives) 00:00:17.910 <mock-chroot> sh-4.2# ./automation/basic_suite_4.1.sh 2>&1 | tee -a $logdir/basic_suite_4.1.sh.log && res=${PIPESTATUS[0]}; end="$(date +%s)"; echo "Took $((end - start)) seconds" | tee -a $logdir/basic_suite_4.1.sh.log; echo "===================== ==============" | tee -a $logdir/basic_suite_4.1.sh.log; if [[ "$(find . -uid 0 -print -quit)" != '' ]]; then chown -R " 1012:$runner_GID" . ; fi; exit $res 00:00:17.911 + SUITE=./automation/basic_suite_4.1.sh 00:00:17.911 ++ echo ./automation/basic_suite_4.1.sh 00:00:17.911 ++ tr _ - 00:00:17.911 + SUITE=./automation/basic-suite-4.1.sh 00:00:17.912 + SUITE=basic-suite-4.1.sh 00:00:17.912 + SUITE=basic-suite-4.1 00:00:17.912 + echo 'Running suite: basic-suite-4.1' 00:00:17.912 Running suite: basic-suite-4.1 00:00:17.912 ++ realpath basic-suite-4.1 00:00:17.912 + SUITE_REAL_PATH=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:00:17.912 + RAM_THRESHOLD=15000000 00:00:17.913 + export LIBGUESTFS_BACKEND=direct 00:00:17.913 + LIBGUESTFS_BACKEND=direct 00:00:17.913 + [[ -c /dev/kvm ]] 00:00:17.913 + mknod /dev/kvm c 10 232 00:00:17.913 ++ get_run_path 00:00:17.913 ++ local avail_shm 00:00:17.913 +++ df --output=avail /dev/shm 00:00:17.913 +++ sed 1d 00:00:17.913 ++ avail_shm=16357840 00:00:17.913 ++ [[ 16357840 -ge 15000000 ]] 00:00:17.913 ++ mkdir -p /dev/shm/ost 00:00:17.914 ++ echo /dev/shm/ost/deployment-basic-suite-4.1 00:00:17.914 + run_path=/dev/shm/ost/deployment-basic-suite-4.1 00:00:17.914 + trap 'cleanup "$run_path"' SIGTERM SIGINT SIGQUIT EXIT 00:00:17.914 + res=0 00:00:17.914 + extra_sources_cmd= 00:00:17.914 + [[ -e /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/extra_sources ]] 00:00:17.914 + cat /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/extra_sources 00:00:17.915 http://jenkins.ovirt.org/job/vdsm_master_build-artifacts-on-demand-el7-x86_… 00:00:17.915 rec:http://plain.resources.ovirt.org/repos/ovirt/experimental/4.1/latest.te… 00:00:17.915 + extra_sources_cmd='-s "conf:/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/extra_sources"' 00:00:17.915 + [[ -z -s "conf:/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/extra_sources" ]] 00:00:17.915 + ./run_suite.sh -o /dev/shm/ost/deployment-basic-suite-4.1 '-s "conf:/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/extra_sources"' basic-suite-4.1 00:00:17.916 + CLI=lago 00:00:17.916 + DO_CLEANUP=false 00:00:17.916 + RECOMMENDED_RAM_IN_MB=8196 00:00:17.916 + EXTRA_SOURCES=() 00:00:17.916 ++ getopt -o ho:e:n:b:cs:r: --long help,output:,engine:,node:,boot-iso:,cleanup --long extra-rpm-source,reposync-config: -n run_suite.sh -- -o /dev/shm/ost/deployment-basic-suite-4.1 '-s "conf:/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/extra_sources"' basic-suite-4.1 00:00:17.917 + options=' -o '\''/dev/shm/ost/deployment-basic-suite-4.1'\'' -s '\'' "conf:/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/extra_sources"'\'' -- '\''basic-suite-4.1'\''' 00:00:17.917 + [[ 0 != \0 ]] 00:00:17.917 + eval set -- ' -o '\''/dev/shm/ost/deployment-basic-suite-4.1'\'' -s '\'' "conf:/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/extra_sources"'\'' -- '\''basic-suite-4.1'\''' 00:00:17.917 ++ set -- -o /dev/shm/ost/deployment-basic-suite-4.1 -s ' "conf:/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/extra_sources"' -- basic-suite-4.1 00:00:17.918 + true 00:00:17.918 + case $1 in 00:00:17.918 ++ realpath /dev/shm/ost/deployment-basic-suite-4.1 00:00:17.918 + PREFIX=/dev/shm/ost/deployment-basic-suite-4.1 00:00:17.918 + shift 2 00:00:17.918 + true 00:00:17.918 + case $1 in 00:00:17.918 + EXTRA_SOURCES+=("$2") 00:00:17.918 + shift 2 00:00:17.918 + true 00:00:17.918 + case $1 in 00:00:17.918 + shift 00:00:17.919 + break 00:00:17.919 + [[ -z basic-suite-4.1 ]] 00:00:17.919 ++ realpath basic-suite-4.1 00:00:17.919 + export SUITE=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:00:17.919 + SUITE=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:00:17.919 + '[' -z /dev/shm/ost/deployment-basic-suite-4.1 ']' 00:00:17.919 + false 00:00:17.919 + [[ -d /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 ]] 00:00:17.919 + echo '################# lago version' 00:00:17.920 ################# lago version 00:00:17.920 + lago --version 00:00:18.119 lago 0.34.0 00:00:18.134 + echo '#################' 00:00:18.134 ################# 00:00:18.134 + check_ram 8196 00:00:18.134 + local recommended=8196 00:00:18.135 ++ free -m 00:00:18.135 ++ grep Mem 00:00:18.136 ++ awk '{print $2}' 00:00:18.139 + local cur_ram=48187 00:00:18.139 + [[ 48187 -lt 8196 ]] 00:00:18.140 + echo 'Running suite found in /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1' 00:00:18.140 Running suite found in /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:00:18.140 + echo 'Environment will be deployed at /dev/shm/ost/deployment-basic-suite-4.1' 00:00:18.140 Environment will be deployed at /dev/shm/ost/deployment-basic-suite-4.1 00:00:18.140 + rm -rf /dev/shm/ost/deployment-basic-suite-4.1 00:00:18.141 + export PYTHONPATH=:/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:00:18.141 + PYTHONPATH=:/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:00:18.141 + source /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/control.sh 00:00:18.141 + prep_suite '' '' '' 00:00:18.142 + local suite_name=basic-suite-4.1 00:00:18.142 + suite_name=basic-suite-4-1 00:00:18.142 + local engine hosts 00:00:18.142 + source /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/templates 00:00:18.143 ++ engine=el7.3-base 00:00:18.143 ++ hosts=el7.3-base 00:00:18.143 + sed -r -e s,__ENGINE__,lago-basic-suite-4-1-engine,g -e 's,__HOST([0-9]+)__,lago-basic-suite-4-1-host\1,g' -e 's,__LAGO_NET_([A-Za-z0-9]*)__,lago-basic-suite-4-1-net-\L\1,g' -e s,__STORAGE__,lago-basic-suite-4-1-storage,g -e s,__ENGINE_TEMPLATE__,el7.3-base,g -e s,__HOSTS_TEMPLATE__,el7.3-base,g 00:00:18.145 + run_suite 00:00:18.145 + env_init '' /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/LagoInitFile 00:00:18.146 + ci_msg_if_fails env_init 00:00:18.146 + msg_if_fails 'Failed to prepare environment on step env_init, please contact the CI team.' 00:00:18.146 ++ dirname /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:00:18.146 + local repo_root_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:00:18.146 + echo 'Failed to prepare environment on step env_init, please contact the CI team.' 00:00:18.147 + echo '#########################' 00:00:18.147 ######################### 00:00:18.147 + local template_repo=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/template-repo.json 00:00:18.147 + local initfile=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/LagoInitFile 00:00:18.147 + lago init /dev/shm/ost/deployment-basic-suite-4.1 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/LagoInitFile --template-repo-path /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/template-repo.json 00:00:18.407 current session does not belong to lago group. 00:00:18.407 @ Initialize and populate prefix: 00:00:18.408 # Initialize prefix: 00:00:18.409 * Create prefix dirs: 00:00:18.409 * Create prefix dirs: Success (in 0:00:00) 00:00:18.410 * Generate prefix uuid: 00:00:18.410 * Generate prefix uuid: Success (in 0:00:00) 00:00:18.411 * Create ssh keys: 00:00:18.439 * Create ssh keys: Success (in 0:00:00) 00:00:18.439 * Tag prefix as initialized: 00:00:18.440 * Tag prefix as initialized: Success (in 0:00:00) 00:00:18.440 # Initialize prefix: Success (in 0:00:00) 00:00:18.461 # Create disks for VM lago-basic-suite-4-1-engine: 00:00:18.461 * Create disk root: 00:00:18.532 * Create disk root: Success (in 0:00:00) 00:00:18.533 * Create disk nfs: 00:00:18.592 * Create disk nfs: Success (in 0:00:00) 00:00:18.593 * Create disk iscsi: 00:00:18.647 * Create disk iscsi: Success (in 0:00:00) 00:00:18.648 # Create disks for VM lago-basic-suite-4-1-engine: Success (in 0:00:00) 00:00:18.649 # Create disks for VM lago-basic-suite-4-1-host1: 00:00:18.650 * Create disk root: 00:00:18.708 * Create disk root: Success (in 0:00:00) 00:00:18.709 # Create disks for VM lago-basic-suite-4-1-host1: Success (in 0:00:00) 00:00:18.709 # Create disks for VM lago-basic-suite-4-1-host0: 00:00:18.710 * Create disk root: 00:00:18.769 * Create disk root: Success (in 0:00:00) 00:00:18.770 # Create disks for VM lago-basic-suite-4-1-host0: Success (in 0:00:00) 00:00:18.785 # Copying any deploy scripts: 00:00:18.787 # Copying any deploy scripts: Success (in 0:00:00) 00:00:18.803 # [Thread-1] Bootstrapping lago-basic-suite-4-1-engine: 00:00:18.803 # [Thread-2] Bootstrapping lago-basic-suite-4-1-host1: 00:00:18.804 # [Thread-3] Bootstrapping lago-basic-suite-4-1-host0: 00:00:44.042 # [Thread-3] Bootstrapping lago-basic-suite-4-1-host0: Success (in 0:00:25) 00:00:44.043 # [Thread-2] Bootstrapping lago-basic-suite-4-1-host1: Success (in 0:00:25) 00:00:44.089 # [Thread-1] Bootstrapping lago-basic-suite-4-1-engine: Success (in 0:00:25) 00:00:44.090 # Save prefix: 00:00:44.090 * Save nets: 00:00:44.091 * Save nets: Success (in 0:00:00) 00:00:44.091 * Save VMs: 00:00:44.092 * Save VMs: Success (in 0:00:00) 00:00:44.092 * Save env: 00:00:44.093 * Save env: Success (in 0:00:00) 00:00:44.093 # Save prefix: Success (in 0:00:00) 00:00:44.094 @ Initialize and populate prefix: Success (in 0:00:25) 00:00:44.114 + env_repo_setup 00:00:44.114 + ci_msg_if_fails env_repo_setup 00:00:44.114 + msg_if_fails 'Failed to prepare environment on step env_repo_setup, please contact the CI team.' 00:00:44.114 ++ dirname /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:00:44.114 + local repo_root_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:00:44.115 + echo 'Failed to prepare environment on step env_repo_setup, please contact the CI team.' 00:00:44.115 + echo '#########################' 00:00:44.115 ######################### 00:00:44.115 + local extrasrc 00:00:44.115 + declare -a extrasrcs 00:00:44.115 + cd /dev/shm/ost/deployment-basic-suite-4.1 00:00:44.115 + for extrasrc in '"${EXTRA_SOURCES[@]}"' 00:00:44.115 + extrasrcs+=("--custom-source=$extrasrc") 00:00:44.115 + echo 'Adding extra source: "conf:/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/extra_sources"' 00:00:44.115 Adding extra source: "conf:/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/extra_sources" 00:00:44.116 + local reposync_conf=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/reposync-config.repo 00:00:44.124 + [[ -e '' ]] 00:00:44.125 + echo 'using reposync config file: /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/reposync-config.repo' 00:00:44.125 using reposync config file: /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/reposync-config.repo 00:00:44.125 + http_proxy= 00:00:44.125 + lago ovirt reposetup --reposync-yum-config /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/reposync-config.repo '--custom-source= "conf:/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/extra_sources"' 00:00:44.421 current session does not belong to lago group. 00:00:44.422 @ Create prefix internal repo: 00:00:44.425 # Syncing remote repos locally (this might take some time): 00:00:44.426 * Running reposync: 00:00:59.581 * Running reposync: Success (in 0:00:15) 00:00:59.582 # Syncing remote repos locally (this might take some time): Success (in 0:00:15) 00:00:59.583 # Running repoman: 00:01:26.543 # Running repoman: Success (in 0:00:26) 00:01:26.544 # Save prefix: 00:01:26.544 * Save nets: 00:01:26.553 * Save nets: Success (in 0:00:00) 00:01:26.554 * Save VMs: 00:01:26.554 * Save VMs: Success (in 0:00:00) 00:01:26.555 * Save env: 00:01:26.555 * Save env: Success (in 0:00:00) 00:01:26.556 # Save prefix: Success (in 0:00:00) 00:01:26.556 @ Create prefix internal repo: Success (in 0:00:42) 00:01:26.587 + cd - 00:01:26.587 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:01:26.587 + env_start 00:01:26.587 + ci_msg_if_fails env_start 00:01:26.587 + msg_if_fails 'Failed to prepare environment on step env_start, please contact the CI team.' 00:01:26.588 ++ dirname /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:01:26.588 + local repo_root_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:01:26.588 + echo 'Failed to prepare environment on step env_start, please contact the CI team.' 00:01:26.589 + echo '#########################' 00:01:26.589 ######################### 00:01:26.589 + cd /dev/shm/ost/deployment-basic-suite-4.1 00:01:26.589 + lago start 00:01:26.882 current session does not belong to lago group. 00:01:26.893 @ Start Prefix: 00:01:26.893 # Start nets: 00:01:26.894 * Create network lago-basic-suite-4-1-net-bonding: 00:01:33.616 * Create network lago-basic-suite-4-1-net-bonding: Success (in 0:00:06) 00:01:33.617 * Create network lago-basic-suite-4-1-net-management: 00:01:40.267 * Create network lago-basic-suite-4-1-net-management: Success (in 0:00:06) 00:01:40.268 * Create network lago-basic-suite-4-1-net-storage: 00:01:46.906 * Create network lago-basic-suite-4-1-net-storage: Success (in 0:00:06) 00:01:46.907 # Start nets: Success (in 0:00:20) 00:01:46.908 # Start vms: 00:01:46.909 * Starting VM lago-basic-suite-4-1-engine: 00:01:47.321 * Starting VM lago-basic-suite-4-1-engine: Success (in 0:00:00) 00:01:47.322 * Starting VM lago-basic-suite-4-1-host1: 00:01:47.825 * Starting VM lago-basic-suite-4-1-host1: Success (in 0:00:00) 00:01:47.826 * Starting VM lago-basic-suite-4-1-host0: 00:01:48.354 * Starting VM lago-basic-suite-4-1-host0: Success (in 0:00:00) 00:01:48.355 # Start vms: Success (in 0:00:01) 00:01:48.356 @ Start Prefix: Success (in 0:00:21) 00:01:48.389 + cd - 00:01:48.389 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:01:48.389 + env_status 00:01:48.389 + ci_msg_if_fails env_status 00:01:48.389 + msg_if_fails 'Failed to prepare environment on step env_status, please contact the CI team.' 00:01:48.390 ++ dirname /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:01:48.390 + local repo_root_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:01:48.390 + echo 'Failed to prepare environment on step env_status, please contact the CI team.' 00:01:48.391 + echo '#########################' 00:01:48.391 ######################### 00:01:48.391 + cd /dev/shm/ost/deployment-basic-suite-4.1 00:01:48.391 + lago status 00:01:48.687 current session does not belong to lago group. 00:01:48.704 [Prefix]: 00:01:48.704 Base directory: /dev/shm/ost/deployment-basic-suite-4.1/default 00:01:48.704 [Networks]: 00:01:48.704 [lago-basic-suite-4-1-net-bonding]: 00:01:48.704 gateway: 192.168.201.1 00:01:48.704 management: False 00:01:48.704 status: up 00:01:48.704 [lago-basic-suite-4-1-net-management]: 00:01:48.704 gateway: 192.168.202.1 00:01:48.704 management: True 00:01:48.704 status: up 00:01:48.704 [lago-basic-suite-4-1-net-storage]: 00:01:48.704 gateway: 192.168.203.1 00:01:48.704 management: False 00:01:48.704 status: up 00:01:48.704 UUID: 0fc1dfd2f9fe11e6a489141877444154 00:01:48.705 [VMs]: 00:01:48.705 [lago-basic-suite-4-1-engine]: 00:01:48.705 [NICs]: 00:01:48.705 [eth0]: 00:01:48.705 ip: 192.168.202.2 00:01:48.705 network: lago-basic-suite-4-1-net-management 00:01:48.705 [eth1]: 00:01:48.705 ip: 192.168.203.2 00:01:48.705 network: lago-basic-suite-4-1-net-storage 00:01:48.705 distro: el7 00:01:48.705 [metadata]: 00:01:48.705 deploy-scripts: 00:01:48.705 $LAGO_PREFIX_PATH/scripts/_home_jenkins_workspace_ovirt-system-tests_manual_ovirt-system-tests_basic-suite-4.1_.._common_deploy-scripts_add_local_repo.sh 00:01:48.705 $LAGO_PREFIX_PATH/scripts/_home_jenkins_workspace_ovirt-system-tests_manual_ovirt-system-tests_basic-suite-4.1_.._common_deploy-scripts_setup_storage_unified_el7.sh 00:01:48.705 $LAGO_PREFIX_PATH/scripts/_home_jenkins_workspace_ovirt-system-tests_manual_ovirt-system-tests_basic-suite-4.1_.._common_deploy-scripts_setup_engine.sh 00:01:48.706 ovirt-engine-password: 123 00:01:48.706 root password: 123456 00:01:48.706 status: running 00:01:48.706 [lago-basic-suite-4-1-host0]: 00:01:48.706 [NICs]: 00:01:48.706 [eth0]: 00:01:48.706 ip: 192.168.202.4 00:01:48.706 network: lago-basic-suite-4-1-net-management 00:01:48.706 [eth1]: 00:01:48.706 ip: 192.168.203.4 00:01:48.706 network: lago-basic-suite-4-1-net-storage 00:01:48.706 [eth2]: 00:01:48.706 ip: 192.168.201.4 00:01:48.706 network: lago-basic-suite-4-1-net-bonding 00:01:48.706 [eth3]: 00:01:48.706 ip: 192.168.201.5 00:01:48.706 network: lago-basic-suite-4-1-net-bonding 00:01:48.706 distro: el7 00:01:48.706 [metadata]: 00:01:48.707 deploy-scripts: 00:01:48.707 $LAGO_PREFIX_PATH/scripts/_home_jenkins_workspace_ovirt-system-tests_manual_ovirt-system-tests_basic-suite-4.1_.._common_deploy-scripts_add_local_repo.sh 00:01:48.707 $LAGO_PREFIX_PATH/scripts/_home_jenkins_workspace_ovirt-system-tests_manual_ovirt-system-tests_basic-suite-4.1_.._common_deploy-scripts_setup_host_el7.sh 00:01:48.707 root password: 123456 00:01:48.707 status: running 00:01:48.707 [lago-basic-suite-4-1-host1]: 00:01:48.707 [NICs]: 00:01:48.707 [eth0]: 00:01:48.707 ip: 192.168.202.3 00:01:48.707 network: lago-basic-suite-4-1-net-management 00:01:48.707 [eth1]: 00:01:48.707 ip: 192.168.203.3 00:01:48.707 network: lago-basic-suite-4-1-net-storage 00:01:48.707 [eth2]: 00:01:48.707 ip: 192.168.201.2 00:01:48.707 network: lago-basic-suite-4-1-net-bonding 00:01:48.708 [eth3]: 00:01:48.708 ip: 192.168.201.3 00:01:48.708 network: lago-basic-suite-4-1-net-bonding 00:01:48.708 distro: el7 00:01:48.708 [metadata]: 00:01:48.708 deploy-scripts: 00:01:48.708 $LAGO_PREFIX_PATH/scripts/_home_jenkins_workspace_ovirt-system-tests_manual_ovirt-system-tests_basic-suite-4.1_.._common_deploy-scripts_add_local_repo.sh 00:01:48.708 $LAGO_PREFIX_PATH/scripts/_home_jenkins_workspace_ovirt-system-tests_manual_ovirt-system-tests_basic-suite-4.1_.._common_deploy-scripts_setup_host_el7.sh 00:01:48.708 root password: 123456 00:01:48.708 status: running 00:01:48.731 + cd - 00:01:48.731 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:01:48.731 + env_deploy 00:01:48.731 + ci_msg_if_fails env_deploy 00:01:48.731 + msg_if_fails 'Failed to prepare environment on step env_deploy, please contact the CI team.' 00:01:48.731 ++ dirname /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:01:48.732 + local repo_root_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:01:48.732 + echo 'Failed to prepare environment on step env_deploy, please contact the CI team.' 00:01:48.732 + echo '#########################' 00:01:48.733 ######################### 00:01:48.733 + local res=0 00:01:48.733 + cd /dev/shm/ost/deployment-basic-suite-4.1 00:01:48.733 + lago ovirt deploy 00:01:49.049 current session does not belong to lago group. 00:01:49.050 @ Deploy oVirt environment: 00:01:49.078 # Deploy environment: 00:01:49.079 * [Thread-2] Deploy VM lago-basic-suite-4-1-engine: 00:01:49.079 * [Thread-3] Deploy VM lago-basic-suite-4-1-host1: 00:01:49.081 * [Thread-4] Deploy VM lago-basic-suite-4-1-host0: 00:02:11.938 * [Thread-4] Deploy VM lago-basic-suite-4-1-host0: Success (in 0:00:22) 00:02:12.768 * [Thread-3] Deploy VM lago-basic-suite-4-1-host1: Success (in 0:00:23) 00:04:26.983 * [Thread-2] Deploy VM lago-basic-suite-4-1-engine: Success (in 0:02:37) 00:04:26.984 # Deploy environment: Success (in 0:02:37) 00:04:27.478 @ Deploy oVirt environment: Success (in 0:02:38) 00:04:27.512 + cd - 00:04:27.513 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:04:27.513 + return 0 00:04:27.513 + test_scenarios=($(ls "$SUITE"/test-scenarios/*.py | sort)) 00:04:27.514 ++ ls /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/001_initialize_engine.py /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/002_bootstrap.py /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/003_basic_networking.py /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/004_basic_sanity.py /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/005_network_by_label.py /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/099_aaa-ldap.py 00:04:27.516 ++ sort 00:04:27.518 + declare test_scenarios 00:04:27.518 + declare failed=false 00:04:27.518 + for scenario in '"${test_scenarios[@]}"' 00:04:27.518 + echo 'Running test scenario 001_initialize_engine.py' 00:04:27.518 Running test scenario 001_initialize_engine.py 00:04:27.519 + env_run_test /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/001_initialize_engine.py 00:04:27.520 + msg_if_fails 'Test 001_initialize_engine.py failed.' 00:04:27.520 ++ dirname /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:04:27.521 + local repo_root_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:04:27.521 + echo 'Test 001_initialize_engine.py failed.' 00:04:27.521 + echo '#########################' 00:04:27.521 ######################### 00:04:27.521 + local res=0 00:04:27.521 + cd /dev/shm/ost/deployment-basic-suite-4.1 00:04:27.522 + lago ovirt runtest /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/001_initialize_engine.py 00:04:27.822 current session does not belong to lago group. 00:04:27.851 @ Run test: 001_initialize_engine.py: 00:04:27.873 nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$'] 00:04:27.878 # 001_initialize_engine.test_initialize_engine: 00:04:27.884 * Copy /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/engine-answer-file.conf to lago-basic-suite-4-1-engine:/tmp/answer-file: 00:04:28.322 * Copy /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/engine-answer-file.conf to lago-basic-suite-4-1-engine:/tmp/answer-file: Success (in 0:00:00) 00:05:37.363 # 001_initialize_engine.test_initialize_engine: Success (in 0:01:09) 00:05:37.364 # Results located at /dev/shm/ost/deployment-basic-suite-4.1/default/nosetests-001_initialize_engine.py.xml 00:05:37.364 @ Run test: 001_initialize_engine.py: Success (in 0:01:09) 00:05:37.414 + cd - 00:05:37.414 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:05:37.414 + return 0 00:05:37.414 + env_collect /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-001_initialize_engine.py 00:05:37.414 + local tests_out_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-001_initialize_engine.py 00:05:37.415 + echo '#########################' 00:05:37.415 ######################### 00:05:37.415 + [[ -e /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1 ]] 00:05:37.415 + mkdir -p /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1 00:05:37.417 + cd /dev/shm/ost/deployment-basic-suite-4.1/current 00:05:37.417 + lago collect --output /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-001_initialize_engine.py 00:05:37.715 current session does not belong to lago group. 00:05:37.715 @ Collect artifacts: 00:05:37.723 # [Thread-1] lago-basic-suite-4-1-engine: 00:05:37.724 # [Thread-2] lago-basic-suite-4-1-host1: 00:05:37.725 # [Thread-3] lago-basic-suite-4-1-host0: 00:05:39.084 # [Thread-3] lago-basic-suite-4-1-host0: Success (in 0:00:01) 00:05:39.224 # [Thread-2] lago-basic-suite-4-1-host1: Success (in 0:00:01) 00:05:40.535 # [Thread-1] lago-basic-suite-4-1-engine: Success (in 0:00:02) 00:05:40.536 @ Collect artifacts: Success (in 0:00:02) 00:05:40.570 + cp -a logs /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-001_initialize_engine.py/lago_logs 00:05:40.576 + cd - 00:05:40.576 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:05:40.576 + false 00:05:40.576 + for scenario in '"${test_scenarios[@]}"' 00:05:40.576 + echo 'Running test scenario 002_bootstrap.py' 00:05:40.576 Running test scenario 002_bootstrap.py 00:05:40.576 + env_run_test /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/002_bootstrap.py 00:05:40.577 + msg_if_fails 'Test 002_bootstrap.py failed.' 00:05:40.577 ++ dirname /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:05:40.578 + local repo_root_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:05:40.578 + echo 'Test 002_bootstrap.py failed.' 00:05:40.578 + echo '#########################' 00:05:40.578 ######################### 00:05:40.578 + local res=0 00:05:40.578 + cd /dev/shm/ost/deployment-basic-suite-4.1 00:05:40.578 + lago ovirt runtest /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/002_bootstrap.py 00:05:40.891 current session does not belong to lago group. 00:05:40.919 @ Run test: 002_bootstrap.py: 00:05:40.942 nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$'] 00:05:40.957 # print_api_ver: 00:05:40.958 # print_api_ver: Success (in 0:00:00) 00:05:40.958 # add_dc: 00:05:49.770 # add_dc: Success (in 0:00:08) 00:05:49.771 # add_cluster: 00:05:50.140 # add_cluster: Success (in 0:00:00) 00:05:50.141 # add_hosts: 00:07:39.509 # add_hosts: Success (in 0:01:49) 00:07:39.510 # add_master_storage_domain: 00:08:41.865 # add_master_storage_domain: Success (in 0:01:02) 00:08:41.866 # list_glance_images: 00:08:43.620 # list_glance_images: Success (in 0:00:01) 00:08:43.621 # add_secondary_storage_domains: 00:11:21.120 # add_secondary_storage_domains: Success (in 0:02:37) 00:11:21.121 # import_templates: 00:11:21.186 * SKIPPED: Exported domain generation not supported yet 00:11:21.187 # import_templates: Success (in 0:00:00) 00:11:21.187 # run_log_collector: 00:12:04.459 # run_log_collector: Success (in 0:00:43) 00:12:04.460 # add_non_vm_network: 00:12:04.748 # add_non_vm_network: Success (in 0:00:00) 00:12:04.749 # add_vm_network: 00:12:04.919 # add_vm_network: Success (in 0:00:00) 00:12:04.920 # add_dc_quota: 00:12:06.050 # add_dc_quota: Success (in 0:00:01) 00:12:06.051 # remove_default_dc: 00:12:06.244 # remove_default_dc: Success (in 0:00:00) 00:12:06.245 # remove_default_cluster: 00:12:06.334 # remove_default_cluster: Success (in 0:00:00) 00:12:06.335 # add_quota_storage_limits: 00:12:06.511 # add_quota_storage_limits: Success (in 0:00:00) 00:12:06.512 # add_quota_cluster_limits: 00:12:06.608 # add_quota_cluster_limits: Success (in 0:00:00) 00:12:06.608 # set_dc_quota_audit: 00:12:07.727 # set_dc_quota_audit: Success (in 0:00:01) 00:12:07.727 # install_cockpit_ovirt: 00:12:44.927 # install_cockpit_ovirt: Success (in 0:00:37) 00:12:44.928 # Results located at /dev/shm/ost/deployment-basic-suite-4.1/default/nosetests-002_bootstrap.py.xml 00:12:44.928 @ Run test: 002_bootstrap.py: Success (in 0:07:04) 00:12:45.280 + cd - 00:12:45.280 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:12:45.280 + return 0 00:12:45.281 + env_collect /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-002_bootstrap.py 00:12:45.281 + local tests_out_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-002_bootstrap.py 00:12:45.281 + echo '#########################' 00:12:45.281 ######################### 00:12:45.281 + [[ -e /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1 ]] 00:12:45.281 + cd /dev/shm/ost/deployment-basic-suite-4.1/current 00:12:45.281 + lago collect --output /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-002_bootstrap.py 00:12:45.584 current session does not belong to lago group. 00:12:45.584 @ Collect artifacts: 00:12:45.596 # [Thread-1] lago-basic-suite-4-1-engine: 00:12:45.606 # [Thread-2] lago-basic-suite-4-1-host1: 00:12:45.607 # [Thread-3] lago-basic-suite-4-1-host0: 00:12:47.406 # [Thread-2] lago-basic-suite-4-1-host1: Success (in 0:00:01) 00:12:47.630 # [Thread-3] lago-basic-suite-4-1-host0: Success (in 0:00:02) 00:12:47.965 # [Thread-1] lago-basic-suite-4-1-engine: Success (in 0:00:02) 00:12:47.965 @ Collect artifacts: Success (in 0:00:02) 00:12:47.996 + cp -a logs /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-002_bootstrap.py/lago_logs 00:12:48.002 + cd - 00:12:48.002 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:12:48.002 + false 00:12:48.002 + for scenario in '"${test_scenarios[@]}"' 00:12:48.002 + echo 'Running test scenario 003_basic_networking.py' 00:12:48.002 Running test scenario 003_basic_networking.py 00:12:48.003 + env_run_test /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/003_basic_networking.py 00:12:48.003 + msg_if_fails 'Test 003_basic_networking.py failed.' 00:12:48.003 ++ dirname /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:12:48.004 + local repo_root_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:12:48.004 + echo 'Test 003_basic_networking.py failed.' 00:12:48.004 + echo '#########################' 00:12:48.004 ######################### 00:12:48.004 + local res=0 00:12:48.004 + cd /dev/shm/ost/deployment-basic-suite-4.1 00:12:48.004 + lago ovirt runtest /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/003_basic_networking.py 00:12:48.328 current session does not belong to lago group. 00:12:48.354 @ Run test: 003_basic_networking.py: 00:12:48.376 nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$'] 00:12:48.381 # attach_vlan_to_host_static_config: 00:12:59.447 # attach_vlan_to_host_static_config: Success (in 0:00:11) 00:12:59.448 # modify_host_ip_to_dhcp: 00:13:06.019 # modify_host_ip_to_dhcp: Success (in 0:00:06) 00:13:06.019 # detach_vlan_from_host: 00:13:10.584 # detach_vlan_from_host: Success (in 0:00:04) 00:13:10.588 # Results located at /dev/shm/ost/deployment-basic-suite-4.1/default/nosetests-003_basic_networking.py.xml 00:13:10.589 @ Run test: 003_basic_networking.py: Success (in 0:00:22) 00:13:10.916 + cd - 00:13:10.916 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:13:10.916 + return 0 00:13:10.916 + env_collect /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-003_basic_networking.py 00:13:10.916 + local tests_out_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-003_basic_networking.py 00:13:10.916 + echo '#########################' 00:13:10.916 ######################### 00:13:10.917 + [[ -e /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1 ]] 00:13:10.917 + cd /dev/shm/ost/deployment-basic-suite-4.1/current 00:13:10.917 + lago collect --output /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-003_basic_networking.py 00:13:11.207 current session does not belong to lago group. 00:13:11.207 @ Collect artifacts: 00:13:11.218 # [Thread-1] lago-basic-suite-4-1-engine: 00:13:11.220 # [Thread-2] lago-basic-suite-4-1-host1: 00:13:11.220 # [Thread-3] lago-basic-suite-4-1-host0: 00:13:13.060 # [Thread-2] lago-basic-suite-4-1-host1: Success (in 0:00:01) 00:13:13.205 # [Thread-3] lago-basic-suite-4-1-host0: Success (in 0:00:01) 00:13:13.562 # [Thread-1] lago-basic-suite-4-1-engine: Success (in 0:00:02) 00:13:13.563 @ Collect artifacts: Success (in 0:00:02) 00:13:13.596 + cp -a logs /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-003_basic_networking.py/lago_logs 00:13:13.600 + cd - 00:13:13.600 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:13:13.600 + false 00:13:13.600 + for scenario in '"${test_scenarios[@]}"' 00:13:13.600 + echo 'Running test scenario 004_basic_sanity.py' 00:13:13.600 Running test scenario 004_basic_sanity.py 00:13:13.600 + env_run_test /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/004_basic_sanity.py 00:13:13.601 + msg_if_fails 'Test 004_basic_sanity.py failed.' 00:13:13.601 ++ dirname /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:13:13.601 + local repo_root_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:13:13.602 + echo 'Test 004_basic_sanity.py failed.' 00:13:13.602 + echo '#########################' 00:13:13.602 ######################### 00:13:13.602 + local res=0 00:13:13.602 + cd /dev/shm/ost/deployment-basic-suite-4.1 00:13:13.602 + lago ovirt runtest /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/004_basic_sanity.py 00:13:13.937 current session does not belong to lago group. 00:13:13.963 @ Run test: 004_basic_sanity.py: 00:13:13.985 nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$'] 00:13:13.994 # add_vm_blank: 00:13:14.923 # add_vm_blank: Success (in 0:00:00) 00:13:14.924 # add_vm_template: 00:13:25.079 # add_vm_template: Success (in 0:00:10) 00:13:25.080 # add_nic: 00:13:25.434 # add_nic: Success (in 0:00:00) 00:13:25.435 # add_disk: 00:13:35.672 # add_disk: Success (in 0:00:10) 00:13:35.673 # add_console: 00:13:35.908 # add_console: Success (in 0:00:00) 00:13:35.909 # add_directlun: 00:13:36.739 # add_directlun: Success (in 0:00:00) 00:13:36.740 # vm_run: 00:14:53.153 # vm_run: Success (in 0:01:16) 00:14:53.155 # snapshots_merge: 00:17:07.327 # snapshots_merge: Success (in 0:02:14) 00:17:07.328 # suspend_resume_vm: 00:20:58.847 # suspend_resume_vm: Success (in 0:03:51) 00:20:58.848 # vm_migrate: 00:21:06.017 # vm_migrate: Success (in 0:00:07) 00:21:06.017 # template_export: 00:21:07.726 # template_export: Success (in 0:00:01) 00:21:07.727 # hotplug_nic: 00:21:08.491 # hotplug_nic: Success (in 0:00:00) 00:21:08.492 # hotplug_disk: 00:21:15.569 # hotplug_disk: Success (in 0:00:07) 00:21:15.570 # add_event: 00:21:15.719 # add_event: Success (in 0:00:00) 00:21:15.720 # Results located at /dev/shm/ost/deployment-basic-suite-4.1/default/nosetests-004_basic_sanity.py.xml 00:21:15.721 @ Run test: 004_basic_sanity.py: Success (in 0:08:01) 00:21:16.161 + cd - 00:21:16.161 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:21:16.161 + return 0 00:21:16.161 + env_collect /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-004_basic_sanity.py 00:21:16.161 + local tests_out_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-004_basic_sanity.py 00:21:16.162 + echo '#########################' 00:21:16.162 ######################### 00:21:16.162 + [[ -e /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1 ]] 00:21:16.162 + cd /dev/shm/ost/deployment-basic-suite-4.1/current 00:21:16.162 + lago collect --output /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-004_basic_sanity.py 00:21:16.457 current session does not belong to lago group. 00:21:16.458 @ Collect artifacts: 00:21:16.470 # [Thread-1] lago-basic-suite-4-1-engine: 00:21:16.471 # [Thread-2] lago-basic-suite-4-1-host1: 00:21:16.471 # [Thread-3] lago-basic-suite-4-1-host0: 00:21:18.143 # [Thread-2] lago-basic-suite-4-1-host1: Success (in 0:00:01) 00:21:18.500 # [Thread-3] lago-basic-suite-4-1-host0: Success (in 0:00:02) 00:21:18.984 # [Thread-1] lago-basic-suite-4-1-engine: Success (in 0:00:02) 00:21:18.985 @ Collect artifacts: Success (in 0:00:02) 00:21:19.015 + cp -a logs /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-004_basic_sanity.py/lago_logs 00:21:19.020 + cd - 00:21:19.020 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:21:19.020 + false 00:21:19.020 + for scenario in '"${test_scenarios[@]}"' 00:21:19.020 + echo 'Running test scenario 005_network_by_label.py' 00:21:19.021 Running test scenario 005_network_by_label.py 00:21:19.021 + env_run_test /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/005_network_by_label.py 00:21:19.021 + msg_if_fails 'Test 005_network_by_label.py failed.' 00:21:19.021 ++ dirname /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:21:19.021 + local repo_root_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:21:19.021 + echo 'Test 005_network_by_label.py failed.' 00:21:19.022 + echo '#########################' 00:21:19.022 ######################### 00:21:19.022 + local res=0 00:21:19.022 + cd /dev/shm/ost/deployment-basic-suite-4.1 00:21:19.022 + lago ovirt runtest /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/005_network_by_label.py 00:21:19.290 current session does not belong to lago group. 00:21:19.316 @ Run test: 005_network_by_label.py: 00:21:19.337 nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$'] 00:21:19.342 # assign_hosts_network_label: 00:21:24.325 # assign_hosts_network_label: Success (in 0:00:04) 00:21:24.326 # add_labeled_network: 00:21:24.504 # add_labeled_network: Success (in 0:00:00) 00:21:24.504 # assign_labeled_network: 00:21:31.072 # assign_labeled_network: Success (in 0:00:06) 00:21:31.073 # Results located at /dev/shm/ost/deployment-basic-suite-4.1/default/nosetests-005_network_by_label.py.xml 00:21:31.073 @ Run test: 005_network_by_label.py: Success (in 0:00:11) 00:21:31.364 + cd - 00:21:31.364 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:21:31.365 + return 0 00:21:31.365 + env_collect /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-005_network_by_label.py 00:21:31.365 + local tests_out_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-005_network_by_label.py 00:21:31.365 + echo '#########################' 00:21:31.365 ######################### 00:21:31.365 + [[ -e /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1 ]] 00:21:31.366 + cd /dev/shm/ost/deployment-basic-suite-4.1/current 00:21:31.366 + lago collect --output /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-005_network_by_label.py 00:21:31.663 current session does not belong to lago group. 00:21:31.663 @ Collect artifacts: 00:21:31.677 # [Thread-1] lago-basic-suite-4-1-engine: 00:21:31.678 # [Thread-2] lago-basic-suite-4-1-host1: 00:21:31.678 # [Thread-3] lago-basic-suite-4-1-host0: 00:21:33.580 # [Thread-3] lago-basic-suite-4-1-host0: Success (in 0:00:01) 00:21:33.682 # [Thread-2] lago-basic-suite-4-1-host1: Success (in 0:00:02) 00:21:34.087 # [Thread-1] lago-basic-suite-4-1-engine: Success (in 0:00:02) 00:21:34.088 @ Collect artifacts: Success (in 0:00:02) 00:21:34.121 + cp -a logs /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/test_logs/basic-suite-4.1/post-005_network_by_label.py/lago_logs 00:21:34.125 + cd - 00:21:34.125 /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:21:34.126 + false 00:21:34.126 + for scenario in '"${test_scenarios[@]}"' 00:21:34.126 + echo 'Running test scenario 099_aaa-ldap.py' 00:21:34.126 Running test scenario 099_aaa-ldap.py 00:21:34.126 + env_run_test /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/099_aaa-ldap.py 00:21:34.127 + msg_if_fails 'Test 099_aaa-ldap.py failed.' 00:21:34.127 ++ dirname /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1 00:21:34.127 + local repo_root_dir=/home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests 00:21:34.128 + echo 'Test 099_aaa-ldap.py failed.' 00:21:34.128 + echo '#########################' 00:21:34.128 ######################### 00:21:34.128 + local res=0 00:21:34.128 + cd /dev/shm/ost/deployment-basic-suite-4.1 00:21:34.128 + lago ovirt runtest /home/jenkins/workspace/ovirt-system-tests_manual/ovirt-system-tests/basic-suite-4.1/test-scenarios/099_aaa-ldap.py 00:21:34.418 current session does not belong to lago group. 00:21:34.445 @ Run test: 099_aaa-ldap.py: 00:21:34.463 nose.config: INFO: Ignoring files matching ['^\\.', '^_', '^setup\\.py$'] 00:21:34.467 # add_ldap_provider: 00:21:34.476 * Copy /tmp/tmp_VWKh6 to lago-basic-suite-4-1-engine:/root/aaa-ldap-answer-file.conf: 00:21:35.010 * Copy /tmp/tmp_VWKh6 to lago-basic-suite-4-1-engine:/root/aaa-ldap-answer-file.conf: Success (in 0:00:00) 00:21:49.410 # add_ldap_provider: Success (in 0:00:14) 00:21:49.410 # add_ldap_user: ...

3 2

oVirt infra daily report - unstable production jobs - 242
by jenkins＠jenkins.phx.ovirt.org 25 Feb '17

25 Feb '17

------=_Part_7_1601664460.1488063611445 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/242//artifact/exported-a… Cheers, Jenkins ------=_Part_7_1601664460.1488063611445 Content-Type: text/html; charset=us-ascii; name=upstream_report.html Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=upstream_report.html Content-ID: <upstream_report.html> <!DOCTYPE html><head><style type="text/css"> table.gridtable { border-collapse: collapse; table-layout:fixed; width:1600px; font-family: monospace; font-size:13px; } .head { font-size:20px; font-family: arial; } .sub { font-size:18px; background-color:#e5e5e5; font-family: arial; } pre { font-family: monospace; display: inline; white-space: pre-wrap; white-space: -moz-pre-wrap !important; white-space: -pre-wrap; white-space: -o-pre-wrap; word-wrap: break-word; } </style> </head> <body> <table class="gridtable" border=2> <tr><th colspan=2 class=head> RHEVM CI Jenkins Daily Report - 25/02/2017 </th></tr><tr><th colspan=2 class=sub> <font color="blue"><a href="http://jenkins.ovirt.org/">00 Unstable Critical</a></font> </th></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x86_…">ovirt-system-tests_master_check-patch-el7-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/">ovirt_3.6_he-system-tests</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt_4.1_hc-system-tests/">ovirt_4.1_hc-system-tests</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt_master_hc-system-tests/">ovirt_master_hc-system-tests</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/repos_4.1_check-closure_el7_merged/">repos_4.1_check-closure_el7_merged</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/repos_4.1_check-closure_fc24_merged/">repos_4.1_check-closure_fc24_merged</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/repos_master_check-closure_el7_merged/">repos_master_check-closure_el7_merged</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/repos_master_check-closure_fc24_merged/">repos_master_check-closure_fc24_merged</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> ------=_Part_7_1601664460.1488063611445--

1 0

Build failed in Jenkins: system-sync_mirrors-centos-extras-el7-x86_64 #114
by jenkins＠jenkins.phx.ovirt.org 25 Feb '17

25 Feb '17

See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-extras-el7-x86_64/1…> ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-extras-el7-x86_64/w…> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune ERROR: Error fetching remote repo 'origin' hudson.plugins.git.GitException: Failed to fetch from http://gerrit.ovirt.org/jenkins.git at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:799) at hudson.plugins.git.GitSCM.retrieveChanges(GitSCM.java:1055) at hudson.plugins.git.GitSCM.checkout(GitSCM.java:1086) at hudson.scm.SCM.checkout(SCM.java:495) at hudson.model.AbstractProject.checkout(AbstractProject.java:1278) at hudson.model.AbstractBuild$AbstractBuildExecution.defaultCheckout(AbstractBuild.java:604) at jenkins.scm.SCMCheckoutStrategy.checkout(SCMCheckoutStrategy.java:86) at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:529) at hudson.model.Run.execute(Run.java:1728) at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43) at hudson.model.ResourceController.execute(ResourceController.java:98) at hudson.model.Executor.run(Executor.java:404) Caused by: hudson.plugins.git.GitException: Command "git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune" returned status code 128: stdout: stderr: fatal: unable to access 'http://gerrit.ovirt.org/jenkins.git/': Could not resolve host: gerrit.ovirt.org; Name or service not known at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1784) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandWithCredentials(CliGitAPIImpl.java:1513) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.access$300(CliGitAPIImpl.java:64) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl$1.execute(CliGitAPIImpl.java:315) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:152) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler$1.call(RemoteGitImpl.java:145) at hudson.remoting.UserRequest.perform(UserRequest.java:153) at hudson.remoting.UserRequest.perform(UserRequest.java:50) at hudson.remoting.Request$2.run(Request.java:336) at hudson.remoting.InterceptingExecutorService$1.call(InterceptingExecutorService.java:68) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) at ......remote call to mirrors.phx.ovirt.org(Native Method) at hudson.remoting.Channel.attachCallSiteStackTrace(Channel.java:1537) at hudson.remoting.UserResponse.retrieve(UserRequest.java:253) at hudson.remoting.Channel.call(Channel.java:822) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.execute(RemoteGitImpl.java:145) at sun.reflect.GeneratedMethodAccessor598.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.jenkinsci.plugins.gitclient.RemoteGitImpl$CommandInvocationHandler.invoke(RemoteGitImpl.java:131) at com.sun.proxy.$Proxy76.execute(Unknown Source) at hudson.plugins.git.GitSCM.fetchFrom(GitSCM.java:797) ... 11 more ERROR: null

1 1

[JIRA] (OVIRT-1196) Please install the gerrit events-log plugin
by Barak Korren (oVirt JIRA) 25 Feb '17

25 Feb '17

[ https://ovirt-jira.atlassian.net/browse/OVIRT-1196?page=com.atlassian.jira.… ] Barak Korren reassigned OVIRT-1196: ----------------------------------- Assignee: Barak Korren (was: infra) > Please install the gerrit events-log plugin > ------------------------------------------- > > Key: OVIRT-1196 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1196 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Components: Gerrit/git > Reporter: Barak Korren > Assignee: Barak Korren > > Please install the gerrit events-log plugin: > https://gerrit.googlesource.com/plugins/events-log/ > The plugin saves Gerrit events in to database to allow even consumers (Like the Jenkins Gerrit plugin), to consume events even if those events were missed when the original notification was fired. -- This message was sent by Atlassian JIRA (v1000.784.2#100032)

1 0

[JIRA] (OVIRT-1196) Please install the gerrit events-log plugin
by Barak Korren (oVirt JIRA) 25 Feb '17

25 Feb '17

Barak Korren created OVIRT-1196: ----------------------------------- Summary: Please install the gerrit events-log plugin Key: OVIRT-1196 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1196 Project: oVirt - virtualization made easy Issue Type: Improvement Components: Gerrit/git Reporter: Barak Korren Assignee: infra Please install the gerrit events-log plugin: https://gerrit.googlesource.com/plugins/events-log/ The plugin saves Gerrit events in to database to allow even consumers (Like the Jenkins Gerrit plugin), to consume events even if those events were missed when the original notification was fired. -- This message was sent by Atlassian JIRA (v1000.784.2#100032)

1 0

[JIRA] (OVIRT-1196) Please install the gerrit events-log plugin
by Barak Korren (oVirt JIRA) 25 Feb '17

25 Feb '17

[ https://ovirt-jira.atlassian.net/browse/OVIRT-1196?page=com.atlassian.jira.… ] Barak Korren updated OVIRT-1196: -------------------------------- Epic Link: OVIRT-403 > Please install the gerrit events-log plugin > ------------------------------------------- > > Key: OVIRT-1196 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1196 > Project: oVirt - virtualization made easy > Issue Type: Improvement > Components: Gerrit/git > Reporter: Barak Korren > Assignee: infra > > Please install the gerrit events-log plugin: > https://gerrit.googlesource.com/plugins/events-log/ > The plugin saves Gerrit events in to database to allow even consumers (Like the Jenkins Gerrit plugin), to consume events even if those events were missed when the original notification was fired. -- This message was sent by Atlassian JIRA (v1000.784.2#100032)

1 0

oVirt infra daily report - unstable production jobs - 241
by jenkins＠jenkins.phx.ovirt.org 24 Feb '17

24 Feb '17

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/241//artifact/exported-a… Cheers, Jenkins

1 0

[JIRA] (OVIRT-1195) Unexplained failure in CI job
by Yaniv Kaul (oVirt JIRA) 24 Feb '17

24 Feb '17

Yaniv Kaul created OVIRT-1195: --------------------------------- Summary: Unexplained failure in CI job Key: OVIRT-1195 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1195 Project: oVirt - virtualization made easy Issue Type: Bug Components: Jenkins Reporter: Yaniv Kaul Assignee: infra Priority: High See http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x86_… I'm not sure what the failure is. All I see is: 18:50:23 Start: yum install 18:50:37 ERROR: Command failed. See logs for output. -- This message was sent by Atlassian JIRA (v1000.784.1#100032)

1 0

[JIRA] (OVIRT-1195) Unexplained failure in CI job
by Yaniv Kaul (oVirt JIRA) 24 Feb '17

24 Feb '17

[ https://ovirt-jira.atlassian.net/browse/OVIRT-1195?page=com.atlassian.jira.… ] Yaniv Kaul updated OVIRT-1195: ------------------------------ Epic Link: OVIRT-400 > Unexplained failure in CI job > ----------------------------- > > Key: OVIRT-1195 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1195 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: Jenkins > Reporter: Yaniv Kaul > Assignee: infra > Priority: High > > See http://jenkins.ovirt.org/job/ovirt-system-tests_master_check-patch-el7-x86_… > I'm not sure what the failure is. All I see is: > 18:50:23 Start: yum install > 18:50:37 ERROR: Command failed. See logs for output. -- This message was sent by Atlassian JIRA (v1000.784.1#100032)

1 0