July 2016 - Infra - oVirt List Archives

[JIRA] (OVIRT-632) upgrade Foreman to 1.8 or newer
by Evgheni Dereveanchin (oVirt JIRA) 13 Jul '16

13 Jul '16

Evgheni Dereveanchin created OVIRT-632: ------------------------------------------ Summary: upgrade Foreman to 1.8 or newer Key: OVIRT-632 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-632 Project: oVirt - virtualization made easy Issue Type: Task Components: Foreman Reporter: Evgheni Dereveanchin Assignee: infra The currently installed version of Foreman is buggy, for example it misreads the primary interface on VMs which causes DHCP issues as the wrong MAC is uesd. Foreman 1.8 fixes this by adding a "Ignore interfaces with matching identifier" filter in provisioning settings. -- This message was sent by Atlassian JIRA (v1000.148.2#100005)

1 0

RHEVM CI Jenkins daily report - 12
by jenkins＠jenkins.phx.ovirt.org 13 Jul '16

13 Jul '16

------=_Part_151_1419667088.1468364404005 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/12//artifact/exported-ar… Cheers, Jenkins ------=_Part_151_1419667088.1468364404005 Content-Type: application/octet-stream; name=upstream_report.html Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=upstream_report.html Content-ID: <upstream_report.html> <!DOCTYPE html><head><style type="text/css"> table.gridtable { border-collapse: collapse; table-layout:fixed; width:1600px; font-family: monospace; font-size:13px; } .head { font-size:20px; font-family: arial; } .sub { font-size:18px; background-color:#e5e5e5; font-family: arial; } pre { font-family: monospace; display: inline; white-space: pre-wrap; white-space: -moz-pre-wrap !important; white-space: -pre-wrap; white-space: -o-pre-wrap; word-wrap: break-word; } </style> </head> <body> <table class="gridtable" border=2> <tr><th colspan=2 class=head> RHEVM CI Jenkins Daily Report - 12/07/2016 </th></tr><tr><th colspan=2 class=sub> <font color="blue"><a href="http://jenkins.ovirt.org/">00 Unstable Jobs (Production)</a></font> </th></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/deploy-to-ovirt_experimental_3.6/">deploy-to-ovirt_experimental_3.6</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/lago_master_build-artifacts-fc24-x86_64/">lago_master_build-artifacts-fc24-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/lago_master_check-merged-pipeline/">lago_master_check-merged-pipeline</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/lago_master_check-merged-trigger/">lago_master_check-merged-trigger</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-dwh_3.6_build-artifacts-el6-x86_64/">ovirt-dwh_3.6_build-artifacts-el6-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-dwh_3.6_build-artifacts-fc23-x86_64/">ovirt-dwh_3.6_build-artifacts-fc23-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-dwh_3.6_check-merged-el6-x86_64/">ovirt-dwh_3.6_check-merged-el6-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-dwh_3.6_check-merged-fc23-x86_64/">ovirt-dwh_3.6_check-merged-fc23-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-dwh_master_build-artifacts-fc24-x86_64/">ovirt-dwh_master_build-artifacts-fc24-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-engine-sdk-java_4.0_create-rpms-fc24-x86…">ovirt-engine-sdk-java_4.0_create-rpms-fc24-x86_64_merged</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-engine-sdk-java_master_create-rpms-fc24-…">ovirt-engine-sdk-java_master_create-rpms-fc24-x86_64_merged</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-engine-sdk-ruby_master_build-artifacts-f…">ovirt-engine-sdk-ruby_master_build-artifacts-fc24-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-hosted-engine-setup_master_check-merged-…">ovirt-hosted-engine-setup_master_check-merged-el7-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-node-ng_master_build-artifacts-fc22-x86_…">ovirt-node-ng_master_build-artifacts-fc22-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-node-ng_ovirt-3.6_build-artifacts-fc22-x…">ovirt-node-ng_ovirt-3.6_build-artifacts-fc22-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-node-ng_ovirt-4.0_build-artifacts-fc22-x…">ovirt-node-ng_ovirt-4.0_build-artifacts-fc22-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt-node-plugin-hosted-engine_ovirt-3.6_chec…">ovirt-node-plugin-hosted-engine_ovirt-3.6_check-merged-el7-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt_3.6_he-system-tests/">ovirt_3.6_he-system-tests</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/ovirt_3.6_publish-rpms_nightly/">ovirt_3.6_publish-rpms_nightly</a> </td><td> Collects RPMs from all oVirt projects (3.6 branches) and publish them to resources.ovirt.org yum repository.<br> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/repos_master_check-closure_merged/">repos_master_check-closure_merged</a> </td><td> No Description </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_3.6/">test-repo_ovirt_experimental_3.6</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> <tr><td> <a href="http://jenkins.ovirt.org/job/vdsm_master_check-merged-fc23-x86_64/">vdsm_master_check-merged-fc23-x86_64</a> </td><td> This job is automatically updated by jenkins job builder, any manual change will be lost in the next update. If you want to make permanent changes, check out the <a href="http://gerrit.ovirt.org/gitweb?p=jenkins.git;a=tree;h=refs/heads/master;hb=…"> jenkins</a> repo.  </td></tr> ------=_Part_151_1419667088.1468364404005--

4 5

[JIRA] (OVIRT-631) intermittent DNS issues in phx.ovirt.org zone
by Evgheni Dereveanchin (oVirt JIRA) 13 Jul '16

13 Jul '16

Evgheni Dereveanchin created OVIRT-631: ------------------------------------------ Summary: intermittent DNS issues in phx.ovirt.org zone Key: OVIRT-631 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-631 Project: oVirt - virtualization made easy Issue Type: Bug Components: Foreman Reporter: Evgheni Dereveanchin Assignee: infra Priority: High There are jobs failing due to name resolution issues: Could not resolve proxy: proxy.phx.ovirt.org; Unknown error -- This message was sent by Atlassian JIRA (v1000.148.2#100005)

1 0

[JIRA] (OVIRT-631) intermittent DNS issues in phx.ovirt.org zone
by Evgheni Dereveanchin (oVirt JIRA) 13 Jul '16

13 Jul '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-631?page=com.atlassian.jira.p… ] Evgheni Dereveanchin reassigned OVIRT-631: ------------------------------------------ Assignee: Evgheni Dereveanchin (was: infra) > intermittent DNS issues in phx.ovirt.org zone > --------------------------------------------- > > Key: OVIRT-631 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-631 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: Foreman > Reporter: Evgheni Dereveanchin > Assignee: Evgheni Dereveanchin > Priority: High > > There are jobs failing due to name resolution issues: > Could not resolve proxy: proxy.phx.ovirt.org; Unknown error -- This message was sent by Atlassian JIRA (v1000.148.2#100005)

1 0

[oVirt Jenkins] ovirt-engine_master_upgrade-from-master_el7_merged - Build # 971 - Failure!
by jenkins＠jenkins.phx.ovirt.org 12 Jul '16

12 Jul '16

------=_Part_149_1396481612.1468356069980 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-master_el7_me… Build: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-master_el7_me… Build Number: 971 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/58401 ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #971 [Yevgeny Zaspitsky] engine: Enable subscribing to external MAC warning [Sharon Naftaly] Yamlized find-bugs jobs [Sandro Bonazzola] jpackage: move to another mirror ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_149_1396481612.1468356069980--

1 0

[oVirt Jenkins] ovirt-engine_master_upgrade-from-4.0_el7_merged - Build # 513 - Failure!
by jenkins＠jenkins.phx.ovirt.org 12 Jul '16

12 Jul '16

------=_Part_147_1439871617.1468355994327 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Project: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-4.0_el7_merge… Build: http://jenkins.ovirt.org/job/ovirt-engine_master_upgrade-from-4.0_el7_merge… Build Number: 513 Build Status: Failure Triggered By: Triggered by Gerrit: https://gerrit.ovirt.org/58401 ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #513 [Yevgeny Zaspitsky] engine: Enable subscribing to external MAC warning [Sharon Naftaly] Yamlized find-bugs jobs [Sandro Bonazzola] jpackage: move to another mirror ----------------- Failed Tests: ----------------- No tests ran. ------=_Part_147_1439871617.1468355994327--

1 0

Build failed in Jenkins: ovirt_master_publish-rpms_nightly #127
by jenkins＠jenkins.phx.ovirt.org 12 Jul '16

12 Jul '16

See <http://jenkins.ovirt.org/job/ovirt_master_publish-rpms_nightly/127/> ------------------------------------------ Started by user Sandro Bonazzola Building on master in workspace <http://jenkins.ovirt.org/job/ovirt_master_publish-rpms_nightly/ws/> [WS-CLEANUP] Deleting project workspace... [workspace] $ /bin/bash -xe /tmp/hudson2357242958332999053.sh + rm -rf <http://jenkins.ovirt.org/job/ovirt_master_publish-rpms_nightly/ws/artifacts> + mkdir <http://jenkins.ovirt.org/job/ovirt_master_publish-rpms_nightly/ws/artifacts> Copied 6 artifacts from "ovirt-host-deploy_master_build-artifacts-el7-x86_64" build number 9 Copied 6 artifacts from "ovirt-host-deploy_master_build-artifacts-fc23-x86_64" build number 9 Copied 8 artifacts from "otopi_master_build-artifacts-el7-x86_64" build number 13 ERROR: Unable to find project for artifact copy: otopi_master_build-artifacts-fc23-x86_64 This may be due to incorrect project name or permission settings; see help for project name in job configuration.

1 4

Build failed in Jenkins: ovirt_3.6_system-tests #233
by jenkins＠jenkins.phx.ovirt.org 12 Jul '16

12 Jul '16

See <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/233/changes> Changes: [Roy Golan] Add IDE files to .gitignore [Sandro Bonazzola] ioprocess: move from fc22 to fc24 [Sandro Bonazzola] 4.0 publisher: moved java sdk4 from master to 4.0 ------------------------------------------ [...truncated 559 lines...] ## took 2800 seconds ## rc = 1 ########################################################## ##! ERROR vvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvvv ##! Last 20 log enties: logs/mocker-fedora-23-x86_64.fc23.basic_suite_3.6.sh/basic_suite_3.6.sh.log ##! @ Collect artifacts: # ovirt-role metadata entry will be soon deprecated, instead you should use the vm-provider entry in the domain definiton and set it no one of: ovirt-node, ovirt-engine, ovirt-host # [Thread-1] lago_basic_suite_3_6_engine: # [Thread-2] lago_basic_suite_3_6_host1: # [Thread-3] lago_basic_suite_3_6_host0: # [Thread-4] lago_basic_suite_3_6_storage: # [Thread-3] lago_basic_suite_3_6_host0: Success (in 0:00:14) # [Thread-2] lago_basic_suite_3_6_host1: Success (in 0:00:15) # [Thread-1] lago_basic_suite_3_6_engine: Success (in 0:00:15) # [Thread-4] lago_basic_suite_3_6_storage: Success (in 0:00:16) @ Collect artifacts: Success (in 0:00:16) <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests> @@@@ ERROR: Failed running <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/b…> ######################### ======== Cleaning up ----------- Cleaning with lago ----------- Cleaning with lago done ======== Cleanup done Took 2628 seconds =================================== ##! ##! ERROR ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ ##!######################################################## ########################################################## Build step 'Execute shell' marked build as failure Performing Post build task... Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo 'shell_scripts/system_tests.collect_logs.sh' # # Required jjb vars: # version # VERSION=3.6 SUITE_TYPE= WORKSPACE="$PWD" OVIRT_SUITE="$SUITE_TYPE_suite_$VERSION" TESTS_LOGS="$WORKSPACE/ovirt-system-tests/exported-artifacts" rm -rf "$WORKSPACE/exported-artifacts" mkdir -p "$WORKSPACE/exported-artifacts" if [[ -d "$TESTS_LOGS" ]]; then mv "$TESTS_LOGS/"* "$WORKSPACE/exported-artifacts/" fi [ovirt_3.6_system-tests] $ /bin/bash -xe /tmp/hudson6029655503325029297.sh + echo shell_scripts/system_tests.collect_logs.sh shell_scripts/system_tests.collect_logs.sh + VERSION=3.6 + SUITE_TYPE= + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> + OVIRT_SUITE=3.6 + TESTS_LOGS=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> + rm -rf <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/233/artifact/exported-a…> + mkdir -p <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/233/artifact/exported-a…> + [[ -d <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> ]] + mv <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/e…> <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/233/artifact/exported-a…> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 0 Match found for :.* : True Logical operation result is TRUE Running script : #!/bin/bash -xe echo "shell-scripts/mock_cleanup.sh" shopt -s nullglob WORKSPACE="$PWD" # Make clear this is the cleanup, helps reading the jenkins logs cat <<EOC _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### EOC # Archive the logs, we want them anyway logs=( ./*log ./*/logs ) if [[ "$logs" ]]; then tar cvzf exported-artifacts/logs.tgz "${logs[@]}" rm -rf "${logs[@]}" fi # stop any processes running inside the chroot failed=false mock_confs=("$WORKSPACE"/*/mocker*) # Clean current jobs mockroot if any for mock_conf_file in "${mock_confs[@]}"; do [[ "$mock_conf_file" ]] || continue echo "Cleaning up mock $mock_conf" mock_root="${mock_conf_file##*/}" mock_root="${mock_root%.*}" my_mock="/usr/bin/mock" my_mock+=" --configdir=${mock_conf_file%/*}" my_mock+=" --root=${mock_root}" my_mock+=" --resultdir=$WORKSPACE" #TODO: investigate why mock --clean fails to umount certain dirs sometimes, #so we can use it instead of manually doing all this. echo "Killing all mock orphan processes, if any." $my_mock \ --orphanskill \ || { echo "ERROR: Failed to kill orphans on $chroot." failed=true } mock_root="$(\ grep \ -Po "(?<=config_opts\['root'\] = ')[^']*" \ "$mock_conf_file" \ )" || : [[ "$mock_root" ]] || continue mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $chroot. Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true } done done # Clean any leftover chroot from other jobs for mock_root in /var/lib/mock/*; do this_chroot_failed=false mounts=($(mount | awk '{print $3}' | grep "$mock_root")) || : if [[ "$mounts" ]]; then echo "Found mounted dirs inside the chroot $mock_root." \ "Trying to umount." fi for mount in "${mounts[@]}"; do sudo umount --lazy "$mount" \ || { echo "ERROR: Failed to umount $mount." failed=true this_chroot_failed=true } done if ! $this_chroot_failed; then sudo rm -rf "$mock_root" fi done if $failed; then echo "Aborting." exit 1 fi # remove mock system cache, we will setup proxies to do the caching and this # takes lots of space between runs shopt -u nullglob sudo rm -Rf /var/cache/mock/* # restore the permissions in the working dir, as sometimes it leaves files # owned by root and then the 'cleanup workspace' from jenkins job fails to # clean and breaks the jobs sudo chown -R "$USER" "$WORKSPACE" [ovirt_3.6_system-tests] $ /bin/bash -xe /tmp/hudson1162261533691334421.sh + echo shell-scripts/mock_cleanup.sh shell-scripts/mock_cleanup.sh + shopt -s nullglob + WORKSPACE=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> + cat _______________________________________________________________________ ####################################################################### # # # CLEANUP # # # ####################################################################### + logs=(./*log ./*/logs) + [[ -n ./ovirt-system-tests/logs ]] + tar cvzf exported-artifacts/logs.tgz ./ovirt-system-tests/logs ./ovirt-system-tests/logs/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/stdout_stderr.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/state.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/build.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.init/root.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/stdout_stderr.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/state.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/build.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.install_packages/root.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.clean_rpmdb/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.clean_rpmdb/stdout_stderr.log ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.basic_suite_3.6.sh/ ./ovirt-system-tests/logs/mocker-fedora-23-x86_64.fc23.basic_suite_3.6.sh/basic_suite_3.6.sh.log + rm -rf ./ovirt-system-tests/logs + failed=false + mock_confs=("$WORKSPACE"/*/mocker*) + for mock_conf_file in '"${mock_confs[@]}"' + [[ -n <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/m…> ]] + echo 'Cleaning up mock ' Cleaning up mock + mock_root=mocker-fedora-23-x86_64.fc23.cfg + mock_root=mocker-fedora-23-x86_64.fc23 + my_mock=/usr/bin/mock + my_mock+=' --configdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests'> + my_mock+=' --root=mocker-fedora-23-x86_64.fc23' + my_mock+=' --resultdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/'> + echo 'Killing all mock orphan processes, if any.' Killing all mock orphan processes, if any. + /usr/bin/mock --configdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests> --root=mocker-fedora-23-x86_64.fc23 --resultdir=<http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> --orphanskill WARNING: Could not find required logging config file: <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/l….> Using default... INFO: mock.py version 1.2.18 starting (python version = 3.5.1)... Start: init plugins INFO: selinux enabled Finish: init plugins Start: run Finish: run ++ grep -Po '(?<=config_opts\['\''root'\''\] = '\'')[^'\'']*' <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/ovirt-system-tests/m…> + mock_root=fedora-23-x86_64-235bec7d0621e95d1cae73d7cf9dc27c + [[ -n fedora-23-x86_64-235bec7d0621e95d1cae73d7cf9dc27c ]] + mounts=($(mount | awk '{print $3}' | grep "$mock_root")) ++ mount ++ awk '{print $3}' ++ grep fedora-23-x86_64-235bec7d0621e95d1cae73d7cf9dc27c + : + [[ -n '' ]] + false + shopt -u nullglob + sudo rm -Rf /var/cache/mock/fedora-23-x86_64-235bec7d0621e95d1cae73d7cf9dc27c + sudo chown -R jenkins <http://jenkins.ovirt.org/job/ovirt_3.6_system-tests/ws/> POST BUILD TASK : SUCCESS END OF POST BUILD TASK : 1 Recording test results Archiving artifacts

1 2

[JIRA] (OVIRT-630) postgresql fails to start on some EL7 jenkins slaves
by Evgheni Dereveanchin (oVirt JIRA) 12 Jul '16

12 Jul '16

Evgheni Dereveanchin created OVIRT-630: ------------------------------------------ Summary: postgresql fails to start on some EL7 jenkins slaves Key: OVIRT-630 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-630 Project: oVirt - virtualization made easy Issue Type: Bug Components: General Reporter: Evgheni Dereveanchin Assignee: infra On several servers I've seen failures to start postgres after VM reboot: {quote}# systemctl status postgresql ● postgresql.service - PostgreSQL database server Loaded: loaded (/etc/systemd/system/postgresql.service; enabled; vendor preset: disabled) Active: failed (Result: exit-code) since Tue 2016-07-12 15:40:46 UTC; 15min ago Jul 12 15:40:45 el7-vm05 systemd[1]: Starting PostgreSQL database server... Jul 12 15:40:45 el7-vm05 pg_ctl[6237]: 2016-07-12 15:40:45 UTC FATAL: could not create lock file "/var/run/postgresql/.s.PGSQL.5432.lock": No such file or directory Jul 12 15:40:46 el7-vm05 pg_ctl[6237]: pg_ctl: could not start server Jul 12 15:40:46 el7-vm05 systemd[1]: postgresql.service: control process exited, code=exited status=1 Jul 12 15:40:46 el7-vm05 systemd[1]: Failed to start PostgreSQL database server. Jul 12 15:40:46 el7-vm05 systemd[1]: Unit postgresql.service entered failed state. Jul 12 15:40:46 el7-vm05 systemd[1]: postgresql.service failed.{quote} the temporary directory does not exist: {quote}# ls -l /var/run/postgresql/ ls: cannot access /var/run/postgresql/: No such file or directory # rpm -V postgresql-server missing /var/run/postgresql # rpm -q postgresql-server postgresql-server-9.2.15-1.el7_2.x86_64{quote} It is defined in systemd configs however: {quote}# cat /usr/lib/tmpfiles.d/postgresql.conf d /var/run/postgresql 0755 postgres postgres - {quote} We need to identify why systemd does not create this directory as it requires manual work to bring such VM up. -- This message was sent by Atlassian JIRA (v1000.141.2#100004)

1 0

[JIRA] (OVIRT-630) postgresql fails to start on some EL7 jenkins slaves
by Evgheni Dereveanchin (oVirt JIRA) 12 Jul '16

12 Jul '16

[ https://ovirt-jira.atlassian.net/browse/OVIRT-630?page=com.atlassian.jira.p… ] Evgheni Dereveanchin reassigned OVIRT-630: ------------------------------------------ Assignee: Evgheni Dereveanchin (was: infra) > postgresql fails to start on some EL7 jenkins slaves > ---------------------------------------------------- > > Key: OVIRT-630 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-630 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: General > Reporter: Evgheni Dereveanchin > Assignee: Evgheni Dereveanchin > > On several servers I've seen failures to start postgres after VM reboot: > {quote}# systemctl status postgresql > ● postgresql.service - PostgreSQL database server > Loaded: loaded (/etc/systemd/system/postgresql.service; enabled; vendor preset: disabled) > Active: failed (Result: exit-code) since Tue 2016-07-12 15:40:46 UTC; 15min ago > Jul 12 15:40:45 el7-vm05 systemd[1]: Starting PostgreSQL database server... > Jul 12 15:40:45 el7-vm05 pg_ctl[6237]: 2016-07-12 15:40:45 UTC FATAL: could not create lock file "/var/run/postgresql/.s.PGSQL.5432.lock": No such file or directory > Jul 12 15:40:46 el7-vm05 pg_ctl[6237]: pg_ctl: could not start server > Jul 12 15:40:46 el7-vm05 systemd[1]: postgresql.service: control process exited, code=exited status=1 > Jul 12 15:40:46 el7-vm05 systemd[1]: Failed to start PostgreSQL database server. > Jul 12 15:40:46 el7-vm05 systemd[1]: Unit postgresql.service entered failed state. > Jul 12 15:40:46 el7-vm05 systemd[1]: postgresql.service failed.{quote} > the temporary directory does not exist: > {quote}# ls -l /var/run/postgresql/ > ls: cannot access /var/run/postgresql/: No such file or directory > # rpm -V postgresql-server > missing /var/run/postgresql > # rpm -q postgresql-server > postgresql-server-9.2.15-1.el7_2.x86_64{quote} > It is defined in systemd configs however: > {quote}# cat /usr/lib/tmpfiles.d/postgresql.conf > d /var/run/postgresql 0755 postgres postgres - > {quote} > We need to identify why systemd does not create this directory as it requires manual work to bring such VM up. -- This message was sent by Atlassian JIRA (v1000.141.2#100004)

1 0