July 2016 - Infra - oVirt List Archives

[oVirt Jenkins] ovirt-engine_master_upgrade-from-master_el7_merged - Build # 892 - Failure!
by jenkins＠jenkins.phx.ovirt.org 05 Jul '16

05 Jul '16

------=_Part_354_380841001.1467714782799 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-master_el7_me… Build: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-master_el7_me… Build Number: 892 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/60156 ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #892 [Arik Hadas] core: rename update pool command ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_354_380841001.1467714782799--

1 0

[oVirt Jenkins] ovirt-engine_master_upgrade-from-4.0_el7_merged - Build # 425 - Failure!
by jenkins＠jenkins.phx.ovirt.org 05 Jul '16

05 Jul '16

------=_Part_342_1598354640.1467709775139 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-4.0_el7_merge… Build: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-4.0_el7_merge… Build Number: 425 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/60173 ------------------------------------- Changes Since Last Success: ------------------------------------- ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_342_1598354640.1467709775139--

1 1

[oVirt Jenkins] ovirt-engine_master_upgrade-from-master_el7_merged - Build # 885 - Failure!
by jenkins＠jenkins.phx.ovirt.org 05 Jul '16

05 Jul '16

------=_Part_346_1190487851.1467709775692 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-master_el7_me… Build: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-master_el7_me… Build Number: 885 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/60174 ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #885 No changes ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_346_1190487851.1467709775692--

1 1

[oVirt Jenkins] ovirt-engine_master_upgrade-from-master_el7_merged - Build # 887 - Failure!
by jenkins＠jenkins.phx.ovirt.org 05 Jul '16

05 Jul '16

------=_Part_348_1370145697.1467709777713 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-master_el7_me… Build: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-master_el7_me… Build Number: 887 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/60175 ------------------------------------- Changes Since Last Success: ------------------------------------- ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_348_1370145697.1467709777713--

1 0

[oVirt Jenkins] ovirt-engine_master_upgrade-from-4.0_el7_merged - Build # 424 - Failure!
by jenkins＠jenkins.phx.ovirt.org 05 Jul '16

05 Jul '16

------=_Part_344_1300217601.1467709775551 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-4.0_el7_merge… Build: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-4.0_el7_merge… Build Number: 424 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/60174 ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #424 No changes ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_344_1300217601.1467709775551--

1 0

[ovirt-infra] jenkins is misbehaving
by Piotr Kliczewski 05 Jul '16

05 Jul '16

Some time ago jenkins did not update the patches with the score. Now I see that builds are not triggered. One of the builds that I triggered manually [1] failed with: 16:04:47 ERROR: Timeout after 10 minutes 16:04:47 ERROR: Error cloning remote repo 'origin' 16:04:47 hudson.plugins.git.GitException: Command "git fetch --tags --progress git://gerrit.ovirt.org/ovirt-engine.git +refs/heads/*:refs/remotes/origin/*" returned status code 143: 16:04:47 stdout: 16:04:47 stderr: 16:04:47 at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:1640) Thanks, Piotr [1] http://jenkins.ovirt.org/job/ovirt-engine_master_check-patch-el7-x86_64/338…

4 6

[JIRA] (OVIRT-619) Jenkins times out when fetching from gerrit randomly
by Nadav Goldin (oVirt JIRA) 05 Jul '16

05 Jul '16

Nadav Goldin created OVIRT-619: ---------------------------------- Summary: Jenkins times out when fetching from gerrit randomly Key: OVIRT-619 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-619 Project: oVirt - virtualization made easy Issue Type: Task Reporter: Nadav Goldin Assignee: infra Priority: High At the first stage of ovirt-engine jobs, Jenkins attemps to fetch ovirt-engine, this sometimes fail with the following error: {quote} 12:55:02 hudson.plugins.git.GitException: Command "git fetch --tags --progress git://gerrit.ovirt.org/ovirt-engine.git +refs/heads/*:refs/remotes/origin/*" returned status code 143: {quote} It can time out while downloading(and then you see 'counting objects messages') or sometimes it simply fails after 10 times(which is set as the time out parameter for git) So far I've tested few issues: # Tried cloning ovirt-engine from one of the slaves for 300-500 times in a row, outside of Jenkins. This showed we have around a 6.5% failure rate with a time out of 90 seconds, which should be reasonable as the current engine is 244MB. # Some of the exceptions appear in the Gerrit error_log as: {quote} [2016-06-29 19:18:26,933] [NioProcessor-1] WARN com.google.gerrit.sshd.GerritServerSession : Exception caught org.apache.sshd.common.SshException: Received 97 on unknown channel 0 at org.apache.sshd.common.session.AbstractConnectionService.getChannel(AbstractConnectionService.java:301){quote} however, there was no one-to-one match between failing to clone and the exceptions in gerrit. # Did the same test but from our github mirror, there were almost no failures at all(less than 1%) -- This message was sent by Atlassian JIRA (v1000.126.1#100004)

1 0

Build failed in Jenkins: ovirt_3.6_system-tests #195
by jenkins＠jenkins.phx.ovirt.org 04 Jul '16

04 Jul '16

See <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/195/changes> Changes: [Eyal Edri] add hystrix deps to yum repos include list ------------------------------------------ [...truncated 561 lines...] ## took 2196 seconds ## rc = 1 ########################################################## ##! ERROR vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv ##! Last 20 log enties: logs/mocker-fedora-23-x86_64.fc23.basic_suite_3.6.sh/basic_suite_3.6.sh.log ##! @ Collect artifacts: # ovirt-role metadata entry will be soon deprecated, instead you should use the vm-provider entry in the domain definiton and set it no one of: ovirt-node, ovirt-engine, ovirt-host # [Thread-1] lago_basic_suite_3_6_engine: # [Thread-2] lago_basic_suite_3_6_host1: # [Thread-3] lago_basic_suite_3_6_host0: # [Thread-4] lago_basic_suite_3_6_storage: # [Thread-3] lago_basic_suite_3_6_host0: Success (in 0:00:16) # [Thread-2] lago_basic_suite_3_6_host1: Success (in 0:00:16) # [Thread-4] lago_basic_suite_3_6_storage: Success (in 0:00:18) # [Thread-1] lago_basic_suite_3_6_engine: Success (in 0:00:18) @ Collect artifacts: Success (in 0:00:18) <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests> @@@@ ERROR: Failed running <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/b…> ######################### ======== Cleaning up ----------- Cleaning with lago ----------- Cleaning with lago done ======== Cleanup done Took 2039 seconds =================================== ##! ##! ERROR ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ##!######################################################## ########################################################## Build step 'Execute shell' marked build as failure Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo 'shell_scripts/system_tests.collect_logs.sh' # # Required jjb vars: # version # VERSION=3.6 SUITE_TYPE= WORKSPACE="$PWD" OVIRT_SUITE="$SUITE_TYPE_suite_$VERSION" TESTS_LOGS="$WORKSPACE/ovirt-system-tests/exported-artifacts" rm -rf "$WORKSPACE/exported-artifacts" mkdir -p "$WORKSPACE/exported-artifacts" if [[ -d "$TESTS_LOGS" ]]; then mv "$TESTS_LOGS/"* "$WORKSPACE/exported-artifacts/" fi [ovirt_3.6_system-tests] $ /bin/bash -xe /tmp/hudson3366418728529327794.sh + echo shell_scripts/system_tests.collect_logs.sh shell_scripts/system_tests.collect_logs.sh + VERSION=3.6 + SUITE_TYPE= + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> + OVIRT_SUITE=3.6 + TESTS_LOGS=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> + rm -rf <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/195/artifact/exported-a…> + mkdir -p <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/195/artifact/exported-a…> + [[ -d <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> ]] + mv <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/195/artifact/exported-a…> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 0 Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo "shell-scripts/mock_cleanup.sh" shopt -s nullglob WORKSPACE="$PWD" # Make clear this is the cleanup, helps reading the jenkins logs cat <<EOC _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### EOC # Archive the logs, we want them anyway logs=( ./*log ./*/logs ) if [[ "$logs" ]]; then tar cvzf exported-artifacts/logs.tgz "${logs[@]}" rm -rf "${logs[@]}" fi # stop any processes running inside the chroot failed=false mock_confs=("$WORKSPACE"/*/mocker*) # Clean current jobs mockroot if any for mock_conf_file in "${mock_confs[@]}"; do [[ "$mock_conf_file" ]] || continue echo "Cleaning up mock $mock_conf" mock_root="${mock_conf_file##*/}" mock_root="${mock_root%.*}" my_mock="/usr/bin/mock" my_mock+=" --configdir=${mock_conf_file%/*}" my_mock+=" --root=${mock_root}" my_mock+=" --resultdir=$WORKSPACE" #TODO: investigate why mock --clean fails to umount certain dirs sometimes, #so we can use it instead of manually doing all this. echo "Killing all mock orphan processes, if any." $my_mock \ --orphanskill \ || { echo "ERROR: Failed to kill orphans on $chroot." failed=true } mock_root="$(\ grep \ -Po "(?<=config_opts\['root'\] = ')[^']*" \ "$mock_conf_file" \ )" || : [[ "$mock_root" ]] || continue mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $chroot. Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true } done done # Clean any leftover chroot from other jobs for mock_root in /var/lib/mock/*; do this_chroot_failed=false mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $mock_root." \ "Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true this_chroot_failed=true } done if ! $this_chroot_failed; then sudo rm -rf "$mock_root" fi done if $failed; then echo "Aborting." exit 1 fi # remove mock system cache, we will setup proxies to do the caching and this # takes lots of space between runs shopt -u nullglob sudo rm -Rf /var/cache/mock/* # restore the permissions in the working dir, as sometimes it leaves files # owned by root and then the 'cleanup workspace' from jenkins job fails to # clean and breaks the jobs sudo chown -R "$USER" "$WORKSPACE" [ovirt_3.6_system-tests] $ /bin/bash -xe /tmp/hudson3452044540989790023.sh + echo shell-scripts/mock_cleanup.sh shell-scripts/mock_cleanup.sh + shopt -s nullglob + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> + cat _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### + logs=(./*log ./*/logs) + [[ -n ./ovirt-system-tests/logs ]] + tar cvzf exported-artifacts/logs.tgz ./ovirt-system-tests/logs ./ovirt-system-tests/logs/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/stdout_stderr.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/build.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/root.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/state.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/stdout_stderr.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/build.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/root.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/state.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.basic_suite_3.6.sh/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.basic_suite_3.6.sh/basic_suite_3.6.sh.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.clean_rpmdb/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.clean_rpmdb/stdout_stderr.log + rm -rf ./ovirt-system-tests/logs + failed=false + mock_confs=("$WORKSPACE"/*/mocker*) + for mock_conf_file in '"${mock_confs[@]}"' + [[ -n <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/m…> ]] + echo 'Cleaning up mock ' Cleaning up mock + mock_root=mocker-fedora-23-x86_64.fc23.cfg + mock_root=mocker-fedora-23-x86_64.fc23 + my_mock=/usr/bin/mock + my_mock+=' --configdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests'> + my_mock+=' --root=mocker-fedora-23-x86_64.fc23' + my_mock+=' --resultdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/'> + echo 'Killing all mock orphan processes, if any.' Killing all mock orphan processes, if any. + /usr/bin/mock --configdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests> --root=mocker-fedora-23-x86_64.fc23 --resultdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> --orphanskill WARNING: Could not find required logging config file: <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/l….> Using default... INFO: mock.py version 1.2.18 starting (python version = 3.4.3)... Start: init plugins INFO: selinux enabled Finish: init plugins Start: run Finish: run ++ grep -Po '(?<=config_opts\['\''root'\''\] = '\'')[^'\'']*' <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/m…> + mock_root=fedora-23-x86_64-ecdfd9c866cbf1a2d41342199fdb011f + [[ -n fedora-23-x86_64-ecdfd9c866cbf1a2d41342199fdb011f ]] + mounts=($(mount | awk '{print $3}' | grep "$mock_root")) ++ mount ++ awk '{print $3}' ++ grep fedora-23-x86_64-ecdfd9c866cbf1a2d41342199fdb011f + : + [[ -n '' ]] + false + shopt -u nullglob + sudo rm -Rf /var/cache/mock/fedora-23-x86_64-ecdfd9c866cbf1a2d41342199fdb011f + sudo chown -R jenkins <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 1 Recording test results Archiving artifacts

1 1

[oVirt Jenkins] ovirt-engine_master_upgrade-from-master_el7_merged - Build # 882 - Failure!
by jenkins＠jenkins.phx.ovirt.org 04 Jul '16

04 Jul '16

------=_Part_337_1232098248.1467650550469 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-master_el7_me… Build: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-master_el7_me… Build Number: 882 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/60135 ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #882 No changes ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_337_1232098248.1467650550469--

1 0

FC24 rpms
by Yevgeny Zaspitsky 04 Jul '16

04 Jul '16

People, is there a good reason for not building ovirt rpms for fc24?

2 1