- Infra - oVirt List Archives

Build failed in Jenkins: deploy-to_ovirt-4.1_tested #1487
by jenkins＠jenkins.phx.ovirt.org 13 Jul '18

13 Jul '18

See <http://jenkins.ovirt.org/job/deploy-to_ovirt-4.1_tested/1487/display/redire…> ------------------------------------------ Started by upstream project "ovirt-release_4.1_build-artifacts-el7-x86_64" build number 644 originally caused by: Started by timer [EnvInject] - Loading node environment variables. Building remotely on vm0156.workers-phx.ovirt.org (phx fc28 nested) in workspace <http://jenkins.ovirt.org/job/deploy-to_ovirt-4.1_tested/ws/> [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-UNdjSQSz4DPu/agent.29258 SSH_AGENT_PID=29262 [ssh-agent] Started. $ ssh-add <http://jenkins.ovirt.org/job/deploy-to_ovirt-4.1_tested/ws/@tmp/private_key…> Identity added: <http://jenkins.ovirt.org/job/deploy-to_ovirt-4.1_tested/ws/@tmp/private_key…> (<http://jenkins.ovirt.org/job/deploy-to_ovirt-4.1_tested/ws/@tmp/private_key…)> [ssh-agent] Using credentials deploy-ovirt-experimental (SSH key for deploying to the tested repo) [deploy-to_ovirt-4.1_tested] $ /bin/bash -xe /tmp/jenkins889326999217138486.sh + [[ http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6… == '' ]] + queue_name=ovirt-4.1 + echo repo-extra-dir:4.1 + echo http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6… + ssh -o StrictHostKeyChecking=no deploy-ovirt-experimental(a)resources.ovirt.org Pseudo-terminal will not be allocated because stdin is not a terminal. + BASE_DIR=/srv/resources/repos/ovirt/tested + PUBLISH_MD_COPIES=50 + main + local tmp_dir + mkdir -p /srv/resources/repos/ovirt/tested ++ mktemp -d /srv/resources/repos/ovirt/tested/.deploy.XXXXXXXXXX Collecting packages + tmp_dir=/srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8 + trap 'rm -rf '\''/srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8'\''' EXIT HUP + echo 'Collecting packages' + collect_packages /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8 + local repoman_dst=/srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8 + repoman --temp-dir generate-in-repo --option main.allowed_repo_paths=/srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8 --option main.on_empty_source=warn /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8 add conf:stdin 2018-07-12 03:00:07,369::INFO::repoman.cmd:: 2018-07-12 03:00:07,400::INFO::repoman.cmd::Adding artifacts to the repo /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8 2018-07-12 03:00:07,400::INFO::repoman.common.repo::Adding repo extra dir 4.1 2018-07-12 03:00:07,405::INFO::repoman.common.stores.RPM::Loading repo /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1 2018-07-12 03:00:07,405::INFO::repoman.common.stores.RPM::Repo /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1 loaded 2018-07-12 03:00:07,407::INFO::repoman.common.stores.iso::Loading repo /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1 2018-07-12 03:00:07,408::INFO::repoman.common.stores.iso::Repo /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1 loaded 2018-07-12 03:00:07,424::INFO::repoman.common.repo::Resolving artifact source http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6… 2018-07-12 03:00:08,016::INFO::repoman.common.sources.jenkins::Parsing jenkins URL: http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6… 2018-07-12 03:00:08,019::INFO::repoman.common.sources.jenkins:: Got URL: http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6… 2018-07-12 03:00:08,019::INFO::repoman.common.sources.jenkins:: Got URL: http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6… 2018-07-12 03:00:08,020::INFO::repoman.common.sources.jenkins:: Got URL: http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6… 2018-07-12 03:00:08,020::INFO::repoman.common.sources.jenkins:: Got URL: http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6… 2018-07-12 03:00:08,021::INFO::repoman.common.sources.jenkins:: Got URL: http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6… 2018-07-12 03:00:08,021::INFO::repoman.common.sources.jenkins:: Got URL: http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6… 2018-07-12 03:00:08,023::INFO::root:: Done 2018-07-12 03:00:08,075::INFO::root::Downloading http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6…, length 9K ... %[-----------------------25------------------------50-----------------------75------------------------] %[=====================================================================================================] 2018-07-12 03:00:08,771::INFO::repoman.common.stores.RPM::Adding package /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/.lago_tmp/tmpLN8WcF/tmpaTzE6J/ovirt-node-ng-image-update-placeholder-4.1.9-1.el7.noarch.rpm to repo /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1 2018-07-12 03:00:08,803::INFO::root::Downloading http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6…, length 329K ... %[-----------------------25------------------------50-----------------------75------------------------] %[====================================================================================================] 2018-07-12 03:00:09,051::INFO::repoman.common.stores.RPM::Adding package /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/.lago_tmp/tmpLN8WcF/tmpaTzE6J/ovirt-release-host-node-4.1.9-1.el7.noarch.rpm to repo /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1 2018-07-12 03:00:09,080::INFO::root::Downloading http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6…, length 15K ... %[-----------------------25------------------------50-----------------------75------------------------] %[====================================================================================================] 2018-07-12 03:00:09,206::INFO::repoman.common.stores.RPM::Adding package /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/.lago_tmp/tmpLN8WcF/tmpaTzE6J/ovirt-release41-4.1.9-1.el7.noarch.rpm to repo /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1 2018-07-12 03:00:09,257::INFO::root::Downloading http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6…, length 405K ... %[-----------------------25------------------------50-----------------------75------------------------] %[====================================================================================================] 2018-07-12 03:00:09,482::INFO::repoman.common.stores.RPM::Adding package /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/.lago_tmp/tmpLN8WcF/tmpaTzE6J/ovirt-release41-4.1.9-1.el7.src.rpm to repo /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1 2018-07-12 03:00:09,514::INFO::root::Downloading http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6…, length 15K ... %[-----------------------25------------------------50-----------------------75------------------------] %[====================================================================================================] 2018-07-12 03:00:09,699::INFO::repoman.common.stores.RPM::Adding package /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/.lago_tmp/tmpLN8WcF/tmpaTzE6J/ovirt-release41-pre-4.1.9-1.el7.noarch.rpm to repo /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1 2018-07-12 03:00:09,728::INFO::root::Downloading http://jenkins.ovirt.org/job/ovirt-release_4.1_build-artifacts-el7-x86_64/6…, length 13K ... %[-----------------------25------------------------50-----------------------75------------------------] %[====================================================================================================] 2018-07-12 03:00:09,855::INFO::repoman.common.stores.RPM::Adding package /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/.lago_tmp/tmpLN8WcF/tmpaTzE6J/ovirt-release41-snapshot-4.1.9-1.el7.noarch.rpm to repo /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1 2018-07-12 03:00:09,856::INFO::repoman.cmd:: 2018-07-12 03:00:09,856::INFO::repoman.common.stores.RPM::Saving new added rpms into /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1 2018-07-12 03:00:09,857::INFO::root::Saving /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1/rpm/el7/noarch/ovirt-node-ng-image-update-placeholder-4.1.9-1.el7.noarch.rpm 2018-07-12 03:00:09,863::INFO::root::Saving /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1/rpm/el7/noarch/ovirt-release-host-node-4.1.9-1.el7.noarch.rpm 2018-07-12 03:00:09,863::INFO::root::Saving /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1/rpm/el7/noarch/ovirt-release41-4.1.9-1.el7.noarch.rpm 2018-07-12 03:00:09,864::INFO::root::Saving /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1/rpm/el7/SRPMS/ovirt-release41-4.1.9-1.el7.src.rpm 2018-07-12 03:00:09,864::INFO::root::Saving /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1/rpm/el7/noarch/ovirt-release41-pre-4.1.9-1.el7.noarch.rpm 2018-07-12 03:00:09,865::INFO::root::Saving /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1/rpm/el7/noarch/ovirt-release41-snapshot-4.1.9-1.el7.noarch.rpm 2018-07-12 03:00:09,866::INFO::repoman.common.stores.RPM:: 2018-07-12 03:00:09,866::INFO::repoman.common.stores.RPM::Updating metadata 2018-07-12 03:00:09,866::INFO::repoman.common.stores.RPM:: Creating metadata for el7 2018-07-12 03:00:11,986::INFO::repoman.common.stores.RPM:: 2018-07-12 03:00:11,987::INFO::repoman.common.stores.RPM::Creating symlinks 2018-07-12 03:00:11,988::INFO::repoman.common.stores.RPM:: 2018-07-12 03:00:11,988::INFO::repoman.common.stores.RPM::Saved /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1 2018-07-12 03:00:11,989::INFO::repoman.common.stores.iso::Saving new added isos into /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1 2018-07-12 03:00:11,989::INFO::repoman.common.stores.iso:: 2018-07-12 03:00:11,989::INFO::repoman.common.stores.iso::Saved /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/4.1 2018-07-12 03:00:11,993::INFO::repoman.common.repo::Cleaning up temporary dir /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/.lago_tmp/tmpLN8WcF/tmpaTzE6J 2018-07-12 03:00:11,996::INFO::repoman.common.repo::Cleaning up temporary dir /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8/.lago_tmp/tmpLN8WcF Publishing to repo + echo 'Publishing to repo' + push_to_tested /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8 /srv/resources/repos/ovirt/tested + local pkg_src=/srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8 + local pkg_dst=/srv/resources/repos/ovirt/tested + cd /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8 + find . -type d '!' -name repodata + tac + read dir + install -o deploy-ovirt-experimental -m 755 -d /srv/resources/repos/ovirt/tested/./4.1/rpm/el7/noarch + find ./4.1/rpm/el7/noarch -maxdepth 1 '!' -type d -print0 + xargs -0 -r cp -RPplf -t /srv/resources/repos/ovirt/tested/./4.1/rpm/el7/noarch + [[ -d ./4.1/rpm/el7/noarch/repodata ]] + read dir + install -o deploy-ovirt-experimental -m 755 -d /srv/resources/repos/ovirt/tested/./4.1/rpm/el7/SRPMS + find ./4.1/rpm/el7/SRPMS -maxdepth 1 '!' -type d -print0 + xargs -0 -r cp -RPplf -t /srv/resources/repos/ovirt/tested/./4.1/rpm/el7/SRPMS + [[ -d ./4.1/rpm/el7/SRPMS/repodata ]] + xargs -P 8 -d ' ' ++ date +%Y-%m-%d-%H:%M + comm -23 /dev/fd/63 /dev/fd/62 ++ sort ++ find /srv/resources/repos/ovirt/tested/./4.1/rpm/el7/SRPMS -name '*.rpm' -type f -mtime +14 ++ tr / _ ++ echo /srv/resources/repos/ovirt/tested ++ repomanage -k1 --new -c /srv/resources/repos/ovirt/tested/./4.1/rpm/el7/SRPMS ++ sort + createrepo_c --update --retain-old-md 50 --workers 8 /srv/resources/repos/ovirt/tested/./4.1/rpm/el7/SRPMS Directory walk started Directory walk done - 410 packages Loaded information about 410 packages Temporary output repo path: /srv/resources/repos/ovirt/tested/./4.1/rpm/el7/SRPMS/.repodata/ Preparing sqlite DBs Pool started (with 8 workers) Pool finished + read dir + install -o deploy-ovirt-experimental -m 755 -d /srv/resources/repos/ovirt/tested/./4.1/rpm/el7 + find ./4.1/rpm/el7 -maxdepth 1 '!' -type d -print0 + xargs -0 -r cp -RPplf -t /srv/resources/repos/ovirt/tested/./4.1/rpm/el7 + [[ -d ./4.1/rpm/el7/repodata ]] + xargs -P 8 -d ' ' + comm -23 /dev/fd/63 /dev/fd/62 ++ date +%Y-%m-%d-%H:%M ++ repomanage -k1 --new -c /srv/resources/repos/ovirt/tested/./4.1/rpm/el7 ++ sort ++ sort ++ find /srv/resources/repos/ovirt/tested/./4.1/rpm/el7 -name '*.rpm' -type f -mtime +14 ++ echo /srv/resources/repos/ovirt/tested ++ tr / _ xargs: argument line too long + rm -rf /srv/resources/repos/ovirt/tested/.deploy.Ap4BPkt4b8 Build step 'Execute shell' marked build as failure $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 29262 killed; [ssh-agent] Stopped.

1 2

[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-4.2 - Build # 124 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Jul '18

13 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/124/ Build Number: 124 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #124 [Gal Ben Haim] Adding 1GB of ram to hosts in HE suites ----------------- Failed Tests: ----------------- All tests passed

1 1

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 568 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Jul '18

13 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/568/ Build Number: 568 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #568 [Gal Ben Haim] Adding 1GB of ram to hosts in HE suites ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: Host lago-hc-basic-suite-master-host-1 is in non responsive state -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7fb5836c4c08> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 262, in _host_is_up_4 raise RuntimeError('Host %s is in non responsive state' % api_host.name) RuntimeError: Host lago-hc-basic-suite-master-host-1 is in non responsive state --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 228, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 275, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 263, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 262, in _host_is_up_4 raise RuntimeError('Host %s is in non responsive state' % api_host.name) 'Host lago-hc-basic-suite-master-host-1 is in non responsive state\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7fb5836c4c08>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 262, in _host_is_up_4\n raise RuntimeError(\'Host %s is in non responsive state\' % api_host.name)\nRuntimeError: Host lago-hc-basic-suite-master-host-1 is in non responsive state\n--------------------- >> end captured logging << ---------------------'

1 1

oVirt infra daily report - unstable production jobs - 520
by jenkins＠jenkins.phx.ovirt.org 13 Jul '18

13 Jul '18

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/520//artifact/exported-a… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_he-basic-iscsi-suite-master - Build # 330 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Jul '18

13 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-master… Build Number: 330 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #330 [Gal Ben Haim] Adding 1GB of ram to hosts in HE suites ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_secondary_storage_domains Error Message: Fault reason is "Operation Failed". Fault detail is "[Cannot add storage server connection when Host status is not up]". HTTP response code is 409. -------------------- >> begin captured logging << -------------------- lago.utils: ERROR: Error while running thread Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue queue.put({'return': func()}) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 637, in add_templates_storage_domain add_generic_nfs_storage_domain(prefix, SD_TEMPLATES_NAME, SD_TEMPLATES_HOST_NAME, SD_TEMPLATES_PATH, sd_format='v1', sd_type='export') File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 496, in add_generic_nfs_storage_domain add_generic_nfs_storage_domain_4(prefix, sd_nfs_name, nfs_host_name, mount_path, sd_format, sd_type, nfs_version) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 552, in add_generic_nfs_storage_domain_4 _add_storage_domain_4(api, p) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 447, in _add_storage_domain_4 sd = sds_service.add(p) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 24011, in add return self._internal_add(storage_domain, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault self._raise_error(response, body) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Cannot add storage server connection when Host status is not up]". HTTP response code is 409. lago.utils: ERROR: Error while running thread Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue queue.put({'return': func()}) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 633, in add_iso_storage_domain add_generic_nfs_storage_domain(prefix, SD_ISO_NAME, SD_ISO_HOST_NAME, SD_ISO_PATH, sd_format='v1', sd_type='iso', nfs_version='v3') File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 496, in add_generic_nfs_storage_domain add_generic_nfs_storage_domain_4(prefix, sd_nfs_name, nfs_host_name, mount_path, sd_format, sd_type, nfs_version) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 552, in add_generic_nfs_storage_domain_4 _add_storage_domain_4(api, p) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 447, in _add_storage_domain_4 sd = sds_service.add(p) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 24011, in add return self._internal_add(storage_domain, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault self._raise_error(response, body) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error Error: Fault reason is "Operation Failed". Fault detail is "[Cannot add storage server connection when Host status is not up]". HTTP response code is 409. --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 577, in add_secondary_storage_domains vt.join_all() File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue queue.put({'return': func()}) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 633, in add_iso_storage_domain add_generic_nfs_storage_domain(prefix, SD_ISO_NAME, SD_ISO_HOST_NAME, SD_ISO_PATH, sd_format='v1', sd_type='iso', nfs_version='v3') File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 496, in add_generic_nfs_storage_domain add_generic_nfs_storage_domain_4(prefix, sd_nfs_name, nfs_host_name, mount_path, sd_format, sd_type, nfs_version) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 552, in add_generic_nfs_storage_domain_4 _add_storage_domain_4(api, p) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 447, in _add_storage_domain_4 sd = sds_service.add(p) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 24011, in add return self._internal_add(storage_domain, headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault self._raise_error(response, body) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error raise error 'Fault reason is "Operation Failed". Fault detail is "[Cannot add storage server connection when Host status is not up]". HTTP response code is 409.\n-------------------- >> begin captured logging << --------------------\nlago.utils: ERROR: Error while running thread\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue\n queue.put({\'return\': func()})\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 637, in add_templates_storage_domain\n add_generic_nfs_storage_domain(prefix, SD_TEMPLATES_NAME, SD_TEMPLATES_HOST_NAME, SD_TEMPLATES_PATH, sd_format=\'v1\', sd_type=\'export\')\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 496, in add_generic_nfs_storage_domain\n add_generic_nfs_storage_domain_4(prefix, sd_nfs_name, nfs_host_name, mount_path, sd_format, sd_type, nfs_version)\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 552, in add_generic_nfs_storage_domain_4\n _add_storage_domain_4(api, p)\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 447, in _add_storage_domain_4\n sd = sds_service.add(p)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 24011, in add\n return self._internal_add(storage_domain, headers, query, wait)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add\n return future.wait() if wait else future\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait\n return self._code(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback\n self._check_fault(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault\n self._raise_error(response, body)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error\n raise error\nError: Fault reason is "Operation Failed". Fault detail is "[Cannot add storage server connection when Host status is not up]". HTTP response code is 409.\nlago.utils: ERROR: Error while running thread\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue\n queue.put({\'return\': func()})\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 633, in add_iso_storage_domain\n add_generic_nfs_storage_domain(prefix, SD_ISO_NAME, SD_ISO_HOST_NAME, SD_ISO_PATH, sd_format=\'v1\', sd_type=\'iso\', nfs_version=\'v3\')\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 496, in add_generic_nfs_storage_domain\n add_generic_nfs_storage_domain_4(prefix, sd_nfs_name, nfs_host_name, mount_path, sd_format, sd_type, nfs_version)\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 552, in add_generic_nfs_storage_domain_4\n _add_storage_domain_4(api, p)\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-master/ovirt-system-tests/he-basic-iscsi-suite-master/test-scenarios/002_bootstrap.py", line 447, in _add_storage_domain_4\n sd = sds_service.add(p)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 24011, in add\n return self._internal_add(storage_domain, headers, query, wait)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 232, in _internal_add\n return future.wait() if wait else future\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait\n return self._code(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 229, in callback\n self._check_fault(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 132, in _check_fault\n self._raise_error(response, body)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 118, in _raise_error\n raise error\nError: Fault reason is "Operation Failed". Fault detail is "[Cannot add storage server connection when Host status is not up]". HTTP response code is 409.\n--------------------- >> end captured logging << ---------------------'

1 1

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-4.2 - Build # 348 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Jul '18

13 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/348/ Build Number: 348 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #348 [Gal Ben Haim] Adding 1GB of ram to hosts in HE suites ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.snapshot_merge Error Message: status: 500 reason: Internal Server Error detail: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> <html><head> <title>500 Internal Server Error</title> </head><body> <h1>Internal Server Error</h1> <p>The server encountered an internal error or misconfiguration and was unable to complete your request.</p> <p>Please contact the server administrator at root@localhost to inform them of the time this error occurred, and the actions you performed just before this error.</p> <p>More information about this error may be available in the server error log.</p> </body></html> -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7fb25e0f2938> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/004_basic_sanity.py", line 180, in <lambda> api.vms.get(VM0_NAME).snapshots.list()[-1].snapshot_status == 'ok' File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", line 35733, in get headers={"All-Content":all_content} File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 46, in get return self.request(method='GET', url=url, headers=headers, cls=cls) File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 122, in request persistent_auth=self.__persistent_auth File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 79, in do_request persistent_auth) File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 162, in __do_request raise errors.RequestError(response_code, response_reason, response_body) RequestError: status: 500 reason: Internal Server Error detail: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> <html><head> <title>500 Internal Server Error</title> </head><body> <h1>Internal Server Error</h1> <p>The server encountered an internal error or misconfiguration and was unable to complete your request.</p> <p>Please contact the server administrator at root@localhost to inform them of the time this error occurred, and the actions you performed just before this error.</p> <p>More information about this error may be available in the server error log.</p> </body></html> --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 68, in wrapper return func(prefix.virt_env.engine_vm().get_api(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/004_basic_sanity.py", line 179, in snapshot_merge lambda: File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 267, in assert_true_within_short assert_equals_within_short(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 251, in assert_equals_within_short func, value, SHORT_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/004_basic_sanity.py", line 180, in <lambda> api.vms.get(VM0_NAME).snapshots.list()[-1].snapshot_status == 'ok' File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", line 35733, in get headers={"All-Content":all_content} File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 46, in get return self.request(method='GET', url=url, headers=headers, cls=cls) File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 122, in request persistent_auth=self.__persistent_auth File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 79, in do_request persistent_auth) File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 162, in __do_request raise errors.RequestError(response_code, response_reason, response_body) '\r\nstatus: 500\r\nreason: Internal Server Error\r\ndetail: \n<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n root@localhost to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7fb25e0f2938>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/004_basic_sanity.py", line 180, in <lambda>\n api.vms.get(VM0_NAME).snapshots.list()[-1].snapshot_status == \'ok\'\n File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", line 35733, in get\n headers={"All-Content":all_content}\n File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 46, in get\n return self.request(method=\'GET\', url=url, headers=headers, cls=cls)\n File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 122, in request\n persistent_auth=self.__persistent_auth\n File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 79, in do_request\n persistent_auth)\n File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 162, in __do_request\n raise errors.RequestError(response_code, response_reason, response_body)\nRequestError: \r\nstatus: 500\r\nreason: Internal Server Error\r\ndetail: \n<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n root@localhost to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n\n--------------------- >> end captured logging << ---------------------'

1 1

[JIRA] (OVIRT-2287) ovirt-system-tests_he-node-ng-suite-master is failing on not enough memory to run VMs
by Dafna Ron (oVirt JIRA) 13 Jul '18

13 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2287?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2287: ---------------------------------- [~gbenhaim(a)redhat.com] I am still seeing this failure on my patch. > ovirt-system-tests_he-node-ng-suite-master is failing on not enough memory to run VMs > ------------------------------------------------------------------------------------- > > Key: OVIRT-2287 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2287 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: sbonazzo > Assignee: infra > Priority: Highest > Labels: ost_failures, ost_lago > Attachments: srv.log > > > https://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/16… > Cannot run VM. There is no host that satisfies current scheduling > constraints. See below for details:, The host > lago-he-node-ng-suite-master-host-0 did not satisfy internal filter Memory > because its available memory is too low (656 MB) to run the VM. > -- > SANDRO BONAZZOLA > MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV > Red Hat EMEA <https://www.redhat.com/> > sbonazzo(a)redhat.com > <https://red.ht/sig> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100088)

1 0

Jenkins build is back to normal : deploy-to_ovirt-master_tested #4281
by jenkins＠jenkins.phx.ovirt.org 13 Jul '18

13 Jul '18

See <http://jenkins.ovirt.org/job/deploy-to_ovirt-master_tested/4281/display/red…>

1 0

[JIRA] (OVIRT-2264) Cannot deactivate Storage while there are running tasks on this Storage
by Dafna Ron (oVirt JIRA) 13 Jul '18

13 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2264?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2264: ---------------------------------- [~tnisan(a)redhat.com] [~derez(a)redhat.com] We had another failure today due to this issue. I created a patch to skip this test and the related tests until this is fixed: https://gerrit.ovirt.org/#/c/93006/ [~eedri] [~gbenhaim(a)redhat.com] can you please merge until storage team has a chance to fix the tests? > Cannot deactivate Storage while there are running tasks on this Storage > ----------------------------------------------------------------------- > > Key: OVIRT-2264 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2264 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_failures, ost_race > > we failed test: 007_sd_reattach.deactivate_storage_domain in vdsm project with error: Cannot deactivate Storage while there are running tasks on this Storage. -Please wait until tasks will finish and try again.]". HTTP response code is 409. > I am opening this as a race in case something changed in OST tests which would cause this to repeat. > https://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/2506 > https://gerrit.ovirt.org/#/c/92313/2 -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100088)

1 0

[oVirt Jenkins] ovirt-system-tests_he-basic-iscsi-suite-4.2 - Build # 120 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Jul '18

13 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-4.2/12… Build Number: 120 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #120 [Gal Ben Haim] Adding 1GB of ram to hosts in HE suites ----------------- Failed Tests: ----------------- All tests passed

1 1