August 2018 - Infra - oVirt List Archives

[JIRA] (OVIRT-2468) ExtractPathNoPathError: scp: /var/lib/pgsql/upgrade_rh-postgresql95-postgresql.log: No such file or directory
by Anton Marchukov (oVirt JIRA) 31 Aug '18

31 Aug '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2468?page=com.atlassian.jira.… ] Anton Marchukov updated OVIRT-2468: ----------------------------------- Description: Project name: ovirt-engine Branch: master Failed Suite: upgrade-from-release-suite.el7 Link to first reported failed build: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9261/ 14:16:46 [upgrade-from-release-suite.el7.x86_64] ExtractPathNoPathError: scp: /var/lib/pgsql/upgrade_rh-postgresql95-postgresql.log: No such file or directory 14:16:46 [upgrade-from-release-suite.el7.x86_64] Error while running thread 14:16:46 [upgrade-from-release-suite.el7.x86_64] Traceback (most recent call last): 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue 14:16:46 [upgrade-from-release-suite.el7.x86_64] queue.put({'return': func()}) 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1524, in _collect_artifacts 14:16:46 [upgrade-from-release-suite.el7.x86_64] vm.collect_artifacts(path, ignore_nopath) 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 644, in collect_artifacts 14:16:46 [upgrade-from-release-suite.el7.x86_64] ignore_nopath=ignore_nopath 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 384, in extract_paths 14:16:46 [upgrade-from-release-suite.el7.x86_64] return self.provider.extract_paths(paths, *args, **kwargs) 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/providers/libvirt/vm.py", line 398, in extract_paths 14:16:46 [upgrade-from-release-suite.el7.x86_64] ignore_nopath=ignore_nopath, 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 249, in extract_paths 14:16:46 [upgrade-from-release-suite.el7.x86_64] self._extract_paths_scp(paths=paths, ignore_nopath=ignore_nopath) 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 83, in wrapper 14:16:46 [upgrade-from-release-suite.el7.x86_64] return func(self, *args, **kwargs) 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 279, in _extract_paths_scp 14:16:46 [upgrade-from-release-suite.el7.x86_64] raise ExtractPathNoPathError(err.args[0]) 14:16:46 [upgrade-from-release-suite.el7.x86_64] ExtractPathNoPathError: scp: /var/lib/pgsql/upgrade_rh-postgresql95-postgresql.log: No such file or directory was: Project name: ovirt-engine Branch: master Failed Suite: upgrade-from-release-suite.el7 Failed test/failed phase Link to first reported failed build > ExtractPathNoPathError: scp: /var/lib/pgsql/upgrade_rh-postgresql95-postgresql.log: No such file or directory > -------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-2468 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2468 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: OST > Reporter: Anton Marchukov > Assignee: infra > Labels: ost_failures > > Project name: > ovirt-engine > Branch: > master > Failed Suite: > upgrade-from-release-suite.el7 > Link to first reported failed build: > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9261/ > 14:16:46 [upgrade-from-release-suite.el7.x86_64] ExtractPathNoPathError: scp: /var/lib/pgsql/upgrade_rh-postgresql95-postgresql.log: No such file or directory > 14:16:46 [upgrade-from-release-suite.el7.x86_64] Error while running thread > 14:16:46 [upgrade-from-release-suite.el7.x86_64] Traceback (most recent call last): > 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue > 14:16:46 [upgrade-from-release-suite.el7.x86_64] queue.put({'return': func()}) > 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1524, in _collect_artifacts > 14:16:46 [upgrade-from-release-suite.el7.x86_64] vm.collect_artifacts(path, ignore_nopath) > 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 644, in collect_artifacts > 14:16:46 [upgrade-from-release-suite.el7.x86_64] ignore_nopath=ignore_nopath > 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 384, in extract_paths > 14:16:46 [upgrade-from-release-suite.el7.x86_64] return self.provider.extract_paths(paths, *args, **kwargs) > 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/providers/libvirt/vm.py", line 398, in extract_paths > 14:16:46 [upgrade-from-release-suite.el7.x86_64] ignore_nopath=ignore_nopath, > 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 249, in extract_paths > 14:16:46 [upgrade-from-release-suite.el7.x86_64] self._extract_paths_scp(paths=paths, ignore_nopath=ignore_nopath) > 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 83, in wrapper > 14:16:46 [upgrade-from-release-suite.el7.x86_64] return func(self, *args, **kwargs) > 14:16:46 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 279, in _extract_paths_scp > 14:16:46 [upgrade-from-release-suite.el7.x86_64] raise ExtractPathNoPathError(err.args[0]) > 14:16:46 [upgrade-from-release-suite.el7.x86_64] ExtractPathNoPathError: scp: /var/lib/pgsql/upgrade_rh-postgresql95-postgresql.log: No such file or directory -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100091)

1 0

[JIRA] (OVIRT-2468) ExtractPathNoPathError: scp: /var/lib/pgsql/upgrade_rh-postgresql95-postgresql.log: No such file or directory
by Anton Marchukov (oVirt JIRA) 31 Aug '18

31 Aug '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2468?page=com.atlassian.jira.… ] Anton Marchukov updated OVIRT-2468: ----------------------------------- Description: Project name: ovirt-engine Branch: master Failed Suite: upgrade-from-release-suite.el7 Failed test/failed phase Link to first reported failed build was: Project name: ovirt-ansible-vm-infra Branch: master Failed Suite: [+upgrade-from-release-suite.el7.x86_64+|http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9256/testReport/junit/(root)/001_upgrade_engine/running_tests___upgrade_from_release_suite_el7_x86_64___test_initialize_engine] Failed test/failed phase [+001_upgrade_engine.test_initialize_engine+|http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9256/testReport/junit/(root)/001_upgrade_engine/running_tests___upgrade_from_release_suite_el7_x86_64___test_initialize_engine] Link to first reported failed build [http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9256] Link to first reported failed patch {code}10:48:45 [upgrade-from-release-suite.el7.x86_64] Error while running thread 10:48:45 [upgrade-from-release-suite.el7.x86_64] Traceback (most recent call last): 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue 10:48:45 [upgrade-from-release-suite.el7.x86_64] queue.put({'return': func()}) 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1524, in _collect_artifacts 10:48:45 [upgrade-from-release-suite.el7.x86_64] vm.collect_artifacts(path, ignore_nopath) 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 644, in collect_artifacts 10:48:45 [upgrade-from-release-suite.el7.x86_64] ignore_nopath=ignore_nopath 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 384, in extract_paths 10:48:45 [upgrade-from-release-suite.el7.x86_64] return self.provider.extract_paths(paths, *args, **kwargs) 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/providers/libvirt/vm.py", line 398, in extract_paths 10:48:45 [upgrade-from-release-suite.el7.x86_64] ignore_nopath=ignore_nopath, 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 249, in extract_paths 10:48:45 [upgrade-from-release-suite.el7.x86_64] self._extract_paths_scp(paths=paths, ignore_nopath=ignore_nopath) 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 83, in wrapper 10:48:45 [upgrade-from-release-suite.el7.x86_64] return func(self, *args, **kwargs) 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 279, in _extract_paths_scp 10:48:45 [upgrade-from-release-suite.el7.x86_64] raise ExtractPathNoPathError(err.args[0]) 10:48:45 [upgrade-from-release-suite.el7.x86_64] ExtractPathNoPathError: scp: /root/fluentd: No such file or directory 10:48:45 [upgrade-from-release-suite.el7.x86_64] * Collect artifacts: ERROR (in 0:00:04){code} > ExtractPathNoPathError: scp: /var/lib/pgsql/upgrade_rh-postgresql95-postgresql.log: No such file or directory > -------------------------------------------------------------------------------------------------------------- > > Key: OVIRT-2468 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2468 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: OST > Reporter: Anton Marchukov > Assignee: infra > Labels: ost_failures > > Project name: > ovirt-engine > Branch: > master > Failed Suite: > upgrade-from-release-suite.el7 > Failed test/failed phase > Link to first reported failed build -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100091)

1 0

[JIRA] (OVIRT-2468) ExtractPathNoPathError: scp: /var/lib/pgsql/upgrade_rh-postgresql95-postgresql.log: No such file or directory
by Anton Marchukov (oVirt JIRA) 31 Aug '18

31 Aug '18

Anton Marchukov created OVIRT-2468: -------------------------------------- Summary: ExtractPathNoPathError: scp: /var/lib/pgsql/upgrade_rh-postgresql95-postgresql.log: No such file or directory Key: OVIRT-2468 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2468 Project: oVirt - virtualization made easy Issue Type: Bug Components: OST Reporter: Anton Marchukov Assignee: infra Project name: ovirt-ansible-vm-infra Branch: master Failed Suite: [+upgrade-from-release-suite.el7.x86_64+|http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9256/testReport/junit/(root)/001_upgrade_engine/running_tests___upgrade_from_release_suite_el7_x86_64___test_initialize_engine] Failed test/failed phase [+001_upgrade_engine.test_initialize_engine+|http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9256/testReport/junit/(root)/001_upgrade_engine/running_tests___upgrade_from_release_suite_el7_x86_64___test_initialize_engine] Link to first reported failed build [http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9256] Link to first reported failed patch {code}10:48:45 [upgrade-from-release-suite.el7.x86_64] Error while running thread 10:48:45 [upgrade-from-release-suite.el7.x86_64] Traceback (most recent call last): 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue 10:48:45 [upgrade-from-release-suite.el7.x86_64] queue.put({'return': func()}) 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/prefix.py", line 1524, in _collect_artifacts 10:48:45 [upgrade-from-release-suite.el7.x86_64] vm.collect_artifacts(path, ignore_nopath) 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 644, in collect_artifacts 10:48:45 [upgrade-from-release-suite.el7.x86_64] ignore_nopath=ignore_nopath 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 384, in extract_paths 10:48:45 [upgrade-from-release-suite.el7.x86_64] return self.provider.extract_paths(paths, *args, **kwargs) 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/providers/libvirt/vm.py", line 398, in extract_paths 10:48:45 [upgrade-from-release-suite.el7.x86_64] ignore_nopath=ignore_nopath, 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 249, in extract_paths 10:48:45 [upgrade-from-release-suite.el7.x86_64] self._extract_paths_scp(paths=paths, ignore_nopath=ignore_nopath) 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 83, in wrapper 10:48:45 [upgrade-from-release-suite.el7.x86_64] return func(self, *args, **kwargs) 10:48:45 [upgrade-from-release-suite.el7.x86_64] File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 279, in _extract_paths_scp 10:48:45 [upgrade-from-release-suite.el7.x86_64] raise ExtractPathNoPathError(err.args[0]) 10:48:45 [upgrade-from-release-suite.el7.x86_64] ExtractPathNoPathError: scp: /root/fluentd: No such file or directory 10:48:45 [upgrade-from-release-suite.el7.x86_64] * Collect artifacts: ERROR (in 0:00:04){code} -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100091)

1 0

[CQ]: 94034,3 (ovirt-engine) failed "ovirt-4.2" system tests
by oVirt Jenkins 31 Aug '18

31 Aug '18

Change 94034,3 (ovirt-engine) is probably the reason behind recent system test failures in the "ovirt-4.2" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/94034/3 For failed test results see: http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3016/

2 1

[JIRA] (OVIRT-2148) 005_network_by_label.assign_hosts_network_label
by Anton Marchukov (oVirt JIRA) 31 Aug '18

31 Aug '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2148?page=com.atlassian.jira.… ] Anton Marchukov commented on OVIRT-2148: ---------------------------------------- This also seem to fail http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/3016/ > 005_network_by_label.assign_hosts_network_label > ------------------------------------------------ > > Key: OVIRT-2148 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2148 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_failures, ost_race > > Change 91614,10 (ovirt-provider-ovn) is probably the reason behind recent > system test failures in the "ovirt-4.2" change queue and needs to be fixed. > This change had been removed from the testing queue. Artifacts build from this > change will not be released until it is fixed. > For further details about the change see: > https://gerrit.ovirt.org/#/c/91614/10 > For failed test results see: > http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/2312/ > Fault reason is "Operation Failed". Fault detail is "[Cannot add Label. Another Setup Networks or Host Refresh process in progress on the host. Please try later.]". HTTP response code is 409. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100091)

1 0

[oVirt Jenkins] ovirt-system-tests_he-basic-iscsi-suite-4.2 - Build # 267 - Failure!
by jenkins＠jenkins.phx.ovirt.org 31 Aug '18

31 Aug '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-4.2/26… Build Number: 267 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #267 [Milan Zamazal] ovf_import test ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 008_restart_he_vm.clear_global_maintenance Error Message: could not parse JSON: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3471 (Fri Aug 31 00:03:54 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3472 (Fri Aug 31 00:03:56 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f9976f21", "local_conf_timestamp": 3472, "host-ts": 3471}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3474 (Fri Aug 31 00:03:57 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3475 (Fri Aug 31 00:03:59 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": -------------------- >> begin captured logging << -------------------- root: INFO: * Waiting For System Stability... lago.ssh: DEBUG: start task:8e5f0870-b553-4b5e-800a-b52bcf9bd6f2:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:8e5f0870-b553-4b5e-800a-b52bcf9bd6f2:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running e2898e46 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --set-maintenance --mode=none lago.ssh: DEBUG: Command e2898e46 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: start task:fe224927-909a-4f8d-b6e1-df23323f1c23:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:fe224927-909a-4f8d-b6e1-df23323f1c23:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running e31c25b2 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command e31c25b2 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command e31c25b2 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3471 (Fri Aug 31 00:03:54 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3472 (Fri Aug 31 00:03:56 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f9976f21", "local_conf_timestamp": 3472, "host-ts": 3471}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3464 (Fri Aug 31 00:03:47 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3465 (Fri Aug 31 00:03:48 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "67aeaffc", "local_conf_timestamp": 3465, "host-ts": 3464}, "global_maintenance": false} lago.ssh: DEBUG: start task:67f9cd03-8ec1-47be-84dc-f2b9197ea24d:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:67f9cd03-8ec1-47be-84dc-f2b9197ea24d:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running e3a8b2d4 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command e3a8b2d4 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command e3a8b2d4 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3471 (Fri Aug 31 00:03:54 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3472 (Fri Aug 31 00:03:56 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f9976f21", "local_conf_timestamp": 3472, "host-ts": 3471}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3474 (Fri Aug 31 00:03:57 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3475 (Fri Aug 31 00:03:59 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": ovirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7f5f87df1050> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/008_restart_he_vm.py", line 85, in <lambda> lambda: _is_state_maintenance(host, "GlobalMaintenance") is False File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/008_restart_he_vm.py", line 58, in _is_state_maintenance status = _get_he_status(host) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/008_restart_he_vm.py", line 128, in _get_he_status raise RuntimeError('could not parse JSON: %s' % ret.out) RuntimeError: could not parse JSON: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3471 (Fri Aug 31 00:03:54 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3472 (Fri Aug 31 00:03:56 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f9976f21", "local_conf_timestamp": 3472, "host-ts": 3471}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3474 (Fri Aug 31 00:03:57 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3475 (Fri Aug 31 00:03:59 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/008_restart_he_vm.py", line 85, in clear_global_maintenance lambda: _is_state_maintenance(host, "GlobalMaintenance") is False File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/008_restart_he_vm.py", line 85, in <lambda> lambda: _is_state_maintenance(host, "GlobalMaintenance") is False File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/008_restart_he_vm.py", line 58, in _is_state_maintenance status = _get_he_status(host) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/008_restart_he_vm.py", line 128, in _get_he_status raise RuntimeError('could not parse JSON: %s' % ret.out) 'could not parse JSON: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3471 (Fri Aug 31 00:03:54 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3472 (Fri Aug 31 00:03:56 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f9976f21", "local_conf_timestamp": 3472, "host-ts": 3471}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3474 (Fri Aug 31 00:03:57 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3475 (Fri Aug 31 00:03:59 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason":\n-------------------- >> begin captured logging << --------------------\nroot: INFO: * Waiting For System Stability...\nlago.ssh: DEBUG: start task:8e5f0870-b553-4b5e-800a-b52bcf9bd6f2:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:8e5f0870-b553-4b5e-800a-b52bcf9bd6f2:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running e2898e46 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --set-maintenance --mode=none\nlago.ssh: DEBUG: Command e2898e46 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: start task:fe224927-909a-4f8d-b6e1-df23323f1c23:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:fe224927-909a-4f8d-b6e1-df23323f1c23:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running e31c25b2 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command e31c25b2 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command e31c25b2 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3471 (Fri Aug 31 00:03:54 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3472 (Fri Aug 31 00:03:56 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f9976f21", "local_conf_timestamp": 3472, "host-ts": 3471}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3464 (Fri Aug 31 00:03:47 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3465 (Fri Aug 31 00:03:48 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "67aeaffc", "local_conf_timestamp": 3465, "host-ts": 3464}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:67f9cd03-8ec1-47be-84dc-f2b9197ea24d:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:67f9cd03-8ec1-47be-84dc-f2b9197ea24d:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running e3a8b2d4 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command e3a8b2d4 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command e3a8b2d4 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3471 (Fri Aug 31 00:03:54 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3472 (Fri Aug 31 00:03:56 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f9976f21", "local_conf_timestamp": 3472, "host-ts": 3471}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3474 (Fri Aug 31 00:03:57 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3475 (Fri Aug 31 00:03:59 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason":\novirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7f5f87df1050>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/008_restart_he_vm.py", line 85, in <lambda>\n lambda: _is_state_maintenance(host, "GlobalMaintenance") is False\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/008_restart_he_vm.py", line 58, in _is_state_maintenance\n status = _get_he_status(host)\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/008_restart_he_vm.py", line 128, in _get_he_status\n raise RuntimeError(\'could not parse JSON: %s\' % ret.out)\nRuntimeError: could not parse JSON: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3471 (Fri Aug 31 00:03:54 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3472 (Fri Aug 31 00:03:56 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f9976f21", "local_conf_timestamp": 3472, "host-ts": 3471}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3474 (Fri Aug 31 00:03:57 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3475 (Fri Aug 31 00:03:59 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason":\n--------------------- >> end captured logging << ---------------------'

1 1

[CQ]: 94009,2 (ovirt-engine) failed "ovirt-master" system tests
by oVirt Jenkins 31 Aug '18

31 Aug '18

Change 94009,2 (ovirt-engine) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/94009/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9221/

2 1

[CQ]: 9984774 (ovirt-ansible-hosted-engine-setup) failed "ovirt-master" system tests
by oVirt Jenkins 31 Aug '18

31 Aug '18

Change 9984774 (ovirt-ansible-hosted-engine-setup) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://github.com/oVirt/ovirt-ansible-hosted-engine-setup/commit/998477419… For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9226/

2 1

[CQ]: 93940, 5 (ovirt-engine) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 31 Aug '18

31 Aug '18

A system test invoked by the "ovirt-master" change queue including change 93940,5 (ovirt-engine) failed. However, this change seems not to be the root cause for this failure. Change 94009,2 (ovirt-engine) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 94009,2 (ovirt-engine) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/93940/5 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/94009/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9228/

2 1

[CQ]: 2768f9a (ovirt-ansible-engine-setup) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 31 Aug '18

31 Aug '18

A system test invoked by the "ovirt-master" change queue including change 2768f9a (ovirt-ansible-engine-setup) failed. However, this change seems not to be the root cause for this failure. Change e842386 (ovirt-ansible-engine-setup) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change e842386 (ovirt-ansible-engine- setup) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://github.com/oVirt/ovirt-ansible-engine-setup/commit/2768f9a6ef265306… For further details about the change that seems to be the root cause behind the testing failures see: https://github.com/oVirt/ovirt-ansible-engine-setup/commit/e8423862f86db4f5… For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/9260/

2 1