Build failed in Jenkins: system-sync_mirrors-epel-el6-x86_64 #1607
by jenkins@jenkins.phx.ovirt.org
See <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/1607/dis...>
------------------------------------------
Started by timer
[EnvInject] - Loading node environment variables.
Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/ws/>
> git rev-parse --is-inside-work-tree # timeout=10
Fetching changes from the remote Git repository
> git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10
Cleaning workspace
> git rev-parse --verify HEAD # timeout=10
Resetting working tree
> git reset --hard # timeout=10
> git clean -fdx # timeout=10
Pruning obsolete local branches
Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git
> git --version # timeout=10
> git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune
> git rev-parse origin/master^{commit} # timeout=10
Checking out Revision ff4050330abc014f5d54d61198050d4b9dc5db3a (origin/master)
> git config core.sparsecheckout # timeout=10
> git checkout -f ff4050330abc014f5d54d61198050d4b9dc5db3a
Commit message: "Move repoman project to STDCIv2"
> git rev-list --no-walk ff4050330abc014f5d54d61198050d4b9dc5db3a # timeout=10
[system-sync_mirrors-epel-el6-x86_64] $ /bin/bash -xe /tmp/jenkins7207805546833117692.sh
+ jenkins/scripts/mirror_mgr.sh resync_yum_mirror epel-el6 x86_64 jenkins/data/mirrors-reposync.conf
Checking if mirror needs a resync
Traceback (most recent call last):
File "/usr/bin/reposync", line 343, in <module>
main()
File "/usr/bin/reposync", line 175, in main
my.doRepoSetup()
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup
return self._getRepos(thisrepo, True)
File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos
self._repos.doSetup(thisrepo)
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup
self.retrieveAllMD()
File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD
dl = repo._async and repo._commonLoadRepoXML(repo)
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1474, in _commonLoadRepoXML
if self._latestRepoXML(local):
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1452, in _latestRepoXML
repomd = self.metalink_data.repomd
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 918, in <lambda>
metalink_data = property(fget=lambda self: self._getMetalink(),
File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 906, in _getMetalink
shutil.move(result, self.metalink_filename)
File "/usr/lib64/python2.7/shutil.py", line 301, in move
copy2(src, real_dst)
File "/usr/lib64/python2.7/shutil.py", line 130, in copy2
copyfile(src, dst)
File "/usr/lib64/python2.7/shutil.py", line 82, in copyfile
with open(src, 'rb') as fsrc:
IOError: [Errno 2] No such file or directory: '/home/jenkins/mirrors_cache/fedora-base-fc25/metalink.xml.tmp'
Build step 'Execute shell' marked build as failure
6 years, 6 months
[oVirt Jenkins] ovirt-system-tests_he-basic-ansible-suite-master -
Build # 380 - Failure!
by jenkins@jenkins.phx.ovirt.org
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-ma...
Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-ma...
Build Number: 380
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #380
[Sandro Bonazzola] yum-repos: master: adjusted for new packages
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 008_restart_he_vm.restart_he_vm
Error Message:
could not parse JSON: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2361 (Fri Jun 22 18:49:00 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2361 (Fri Jun 22 18:49:01 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "39ce70cf", "local_conf_timestamp": 2361, "host-ts": 2361}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2360 (Fri Jun 22 18:49:00 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2360 (Fri Jun 22 18:49:00 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-
-------------------- >> begin captured logging << --------------------
lago.ssh: DEBUG: start task:0206c430-f39c-48ba-ae10-463b259c7695:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:0206c430-f39c-48ba-ae10-463b259c7695:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running fc116bfe on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command fc116bfe on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command fc116bfe on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2152 (Fri Jun 22 18:45:31 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=2152 (Fri Jun 22 18:45:32 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ac489e25", "local_conf_timestamp": 2152, "host-ts": 2152}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2150 (Fri Jun 22 18:45:30 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2151 (Fri Jun 22 18:45:31 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c5048dc4", "local_conf_timestamp": 2151, "host-ts": 2150}, "global_maintenance": true}
root: INFO: * Shutting down HE VM on host: lago-he-basic-ansible-suite-master-host-0
lago.ssh: DEBUG: start task:309e4d1e-33d8-40b9-b815-629f19b32c19:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:309e4d1e-33d8-40b9-b815-629f19b32c19:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running fc941d6a on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-shutdown
lago.ssh: DEBUG: Command fc941d6a on lago-he-basic-ansible-suite-master-host-0 returned with 0
root: INFO: * Command succeeded
root: INFO: * Waiting for VM to be down...
lago.ssh: DEBUG: start task:5c70f09d-db34-4dd1-9bd3-fffa981a46cd:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:5c70f09d-db34-4dd1-9bd3-fffa981a46cd:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running fd13e4b4 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command fd13e4b4 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command fd13e4b4 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2152 (Fri Jun 22 18:45:31 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=2152 (Fri Jun 22 18:45:32 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ac489e25", "local_conf_timestamp": 2152, "host-ts": 2152}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2150 (Fri Jun 22 18:45:30 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2151 (Fri Jun 22 18:45:31 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c5048dc4", "local_conf_timestamp": 2151, "host-ts": 2150}, "global_maintenance": true}
lago.ssh: DEBUG: start task:837c46d4-7157-46ad-b124-6a7a75723ad5:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:837c46d4-7157-46ad-b124-6a7a75723ad5:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 03b0c35a on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 03b0c35a on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 03b0c35a on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2162 (Fri Jun 22 18:45:42 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2163 (Fri Jun 22 18:45:42 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "6119f9bf", "local_conf_timestamp": 2163, "host-ts": 2162}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2160 (Fri Jun 22 18:45:40 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2160 (Fri Jun 22 18:45:40 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "aa074cd5", "local_conf_timestamp": 2160, "host-ts": 2160}, "global_maintenance": true}
lago.ssh: DEBUG: start task:c1739841-aa58-424f-811c-9bb089e719c7:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:c1739841-aa58-424f-811c-9bb089e719c7:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 06090d38 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 06090d38 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 06090d38 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2172 (Fri Jun 22 18:45:52 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2172 (Fri Jun 22 18:45:52 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Powering down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3b8d448e", "local_conf_timestamp": 2172, "host-ts": 2172}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2170 (Fri Jun 22 18:45:50 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2171 (Fri Jun 22 18:45:51 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d503d33e", "local_conf_timestamp": 2171, "host-ts": 2170}, "global_maintenance": true}
lago.ssh: DEBUG: start task:07646a89-9b6c-49dd-8346-1149320f2574:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:07646a89-9b6c-49dd-8346-1149320f2574:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 085ce974 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 085ce974 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 085ce974 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2172 (Fri Jun 22 18:45:52 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2172 (Fri Jun 22 18:45:52 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Powering down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3b8d448e", "local_conf_timestamp": 2172, "host-ts": 2172}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2170 (Fri Jun 22 18:45:50 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2171 (Fri Jun 22 18:45:51 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d503d33e", "local_conf_timestamp": 2171, "host-ts": 2170}, "global_maintenance": true}
lago.ssh: DEBUG: start task:ec34da5e-75fa-4c2d-a31c-10b0557f7aae:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:ec34da5e-75fa-4c2d-a31c-10b0557f7aae:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 0aaa42c6 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 0aaa42c6 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 0aaa42c6 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2182 (Fri Jun 22 18:46:02 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=2183 (Fri Jun 22 18:46:02 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down_unexpected", "detail": "Down"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e2fccec7", "local_conf_timestamp": 2183, "host-ts": 2182}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2180 (Fri Jun 22 18:46:00 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2180 (Fri Jun 22 18:46:00 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "da13d433", "local_conf_timestamp": 2180, "host-ts": 2180}, "global_maintenance": true}
root: INFO: * VM is down.
root: INFO: * Restarting services...
lago.ssh: DEBUG: start task:0c52e610-8de0-473d-bab5-9b05bf3e3f38:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:0c52e610-8de0-473d-bab5-9b05bf3e3f38:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 0b29acdc on lago-he-basic-ansible-suite-master-host-0: systemctl restart vdsmd ovirt-ha-broker ovirt-ha-agent
lago.ssh: DEBUG: Command 0b29acdc on lago-he-basic-ansible-suite-master-host-0 returned with 0
root: INFO: * Success.
root: INFO: * Waiting for agent to be ready...
lago.ssh: DEBUG: start task:90ca3da8-f107-44cf-b5bd-282eeffde720:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:90ca3da8-f107-44cf-b5bd-282eeffde720:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 15923248 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status
lago.ssh: DEBUG: Command 15923248 on lago-he-basic-ansible-suite-master-host-0 returned with 1
lago.ssh: DEBUG: Command 15923248 on lago-he-basic-ansible-suite-master-host-0 output:
The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.
lago.ssh: DEBUG: start task:1b0a1bcd-1ef1-4e8c-be38-87e494eb9932:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:1b0a1bcd-1ef1-4e8c-be38-87e494eb9932:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 1bf07e92 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status
lago.ssh: DEBUG: Command 1bf07e92 on lago-he-basic-ansible-suite-master-host-0 returned with 1
lago.ssh: DEBUG: Command 1bf07e92 on lago-he-basic-ansible-suite-master-host-0 output:
The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.
lago.ssh: DEBUG: start task:bd26a276-9760-4946-9edc-0f8e62b4bc04:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:bd26a276-9760-4946-9edc-0f8e62b4bc04:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 1e242678 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status
lago.ssh: DEBUG: Command 1e242678 on lago-he-basic-ansible-suite-master-host-0 returned with 1
lago.ssh: DEBUG: Command 1e242678 on lago-he-basic-ansible-suite-master-host-0 output:
The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.
lago.ssh: DEBUG: start task:e283c4b9-724a-4e16-8410-5a31750a7d7b:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:e283c4b9-724a-4e16-8410-5a31750a7d7b:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 2052e6b4 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status
lago.ssh: DEBUG: Command 2052e6b4 on lago-he-basic-ansible-suite-master-host-0 returned with 1
lago.ssh: DEBUG: Command 2052e6b4 on lago-he-basic-ansible-suite-master-host-0 output:
The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.
lago.ssh: DEBUG: start task:b3e4245b-c3d1-4b90-aada-59901a1d9455:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:b3e4245b-c3d1-4b90-aada-59901a1d9455:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 22807ff0 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status
lago.ssh: DEBUG: Command 22807ff0 on lago-he-basic-ansible-suite-master-host-0 returned with 1
lago.ssh: DEBUG: Command 22807ff0 on lago-he-basic-ansible-suite-master-host-0 output:
The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.
lago.ssh: DEBUG: start task:d6d3ee7e-86bc-4225-b2e7-e5fb3c26b36e:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:d6d3ee7e-86bc-4225-b2e7-e5fb3c26b36e:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 24b0c154 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status
lago.ssh: DEBUG: Command 24b0c154 on lago-he-basic-ansible-suite-master-host-0 returned with 1
lago.ssh: DEBUG: Command 24b0c154 on lago-he-basic-ansible-suite-master-host-0 output:
The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.
lago.ssh: DEBUG: start task:65126cb6-38ed-4953-9355-e0a74e23c8d5:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:65126cb6-38ed-4953-9355-e0a74e23c8d5:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 26e24894 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status
lago.ssh: DEBUG: Command 26e24894 on lago-he-basic-ansible-suite-master-host-0 returned with 1
lago.ssh: DEBUG: Command 26e24894 on lago-he-basic-ansible-suite-master-host-0 output:
The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.
lago.ssh: DEBUG: start task:61a3b3f4-8ff3-4c72-97b9-76451337edda:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:61a3b3f4-8ff3-4c72-97b9-76451337edda:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 29211734 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status
lago.ssh: DEBUG: Command 29211734 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 29211734 on lago-he-basic-ansible-suite-master-host-0 output:
!! Cluster is in GLOBAL MAINTENANCE mode !!
--== Host lago-he-basic-ansible-suite-master-host-0 (id: 1) status ==--
conf_on_shared_storage : True
Status up-to-date : True
Hostname : lago-he-basic-ansible-suite-master-host-0
Host ID : 1
Engine status : {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Down"}
Score : 0
stopped : False
Local maintenance : False
crc32 : 2b063a5e
local_conf_timestamp : 2231
Host timestamp : 2231
Extra metadata (valid at timestamp):
metadata_parse_version=1
metadata_feature_version=1
timestamp=2231 (Fri Jun 22 18:46:50 2018)
host-id=1
score=0
vm_conf_refresh_time=2231 (Fri Jun 22 18:46:50 2018)
conf_on_shared_storage=True
maintenance=False
state=ReinitializeFSM
stopped=False
--== Host lago-he-basic-ansible-suite-master-host-1 (id: 2) status ==--
conf_on_shared_storage : True
Status up-to-date : False
Hostname : lago-he-basic-ansible-suite-master-host-1
Host ID : 2
Engine status : unknown stale-data
Score : 3400
stopped : False
Local maintenance : False
crc32 : f1ce4c2e
local_conf_timestamp : 2230
Host timestamp : 2230
Extra metadata (valid at timestamp):
metadata_parse_version=1
metadata_feature_version=1
timestamp=2230 (Fri Jun 22 18:46:50 2018)
host-id=2
score=3400
vm_conf_refresh_time=2230 (Fri Jun 22 18:46:50 2018)
conf_on_shared_storage=True
maintenance=False
state=GlobalMaintenance
stopped=False
!! Cluster is in GLOBAL MAINTENANCE mode !!
root: INFO: * Agent is ready.
root: INFO: * Starting VM...
lago.ssh: DEBUG: start task:33e28fb6-a232-4363-a3a1-19f7fcd59851:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:33e28fb6-a232-4363-a3a1-19f7fcd59851:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 29a01732 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-start
lago.ssh: DEBUG: Command 29a01732 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 29a01732 on lago-he-basic-ansible-suite-master-host-0 output:
VM exists and is down, cleaning up and restarting
root: INFO: * Command succeeded
root: INFO: * Waiting to VM to be UP...
lago.ssh: DEBUG: start task:c2293362-1b0f-4b35-85ed-0e9beb375b6f:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:c2293362-1b0f-4b35-85ed-0e9beb375b6f:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 2b02fc8e on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 2b02fc8e on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 2b02fc8e on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2231 (Fri Jun 22 18:46:50 2018)\nhost-id=1\nscore=0\nvm_conf_refresh_time=2231 (Fri Jun 22 18:46:50 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=ReinitializeFSM\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Down"}, "score": 0, "stopped": false, "maintenance": false, "crc32": "2b063a5e", "local_conf_timestamp": 2231, "host-ts": 2231}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2230 (Fri Jun 22 18:46:50 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2230 (Fri Jun 22 18:46:50 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "f1ce4c2e", "local_conf_timestamp": 2230, "host-ts": 2230}, "global_maintenance": true}
lago.ssh: DEBUG: start task:30716cb3-bc59-4fc0-b300-af571804841a:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:30716cb3-bc59-4fc0-b300-af571804841a:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 318195b6 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 318195b6 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 318195b6 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2241 (Fri Jun 22 18:47:01 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=2241 (Fri Jun 22 18:47:01 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "abd1bf0a", "local_conf_timestamp": 2241, "host-ts": 2241}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2240 (Fri Jun 22 18:47:00 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2241 (Fri Jun 22 18:47:01 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "bec330cb", "local_conf_timestamp": 2241, "host-ts": 2240}, "global_maintenance": true}
root: INFO: * VM is UP.
root: INFO: * Waiting for engine to start ...
lago.ssh: DEBUG: start task:f7581d83-a119-4ce7-af34-b6421741d98c:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:f7581d83-a119-4ce7-af34-b6421741d98c:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 31f8ab92 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 31f8ab92 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 31f8ab92 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2241 (Fri Jun 22 18:47:01 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=2241 (Fri Jun 22 18:47:01 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "abd1bf0a", "local_conf_timestamp": 2241, "host-ts": 2241}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2240 (Fri Jun 22 18:47:00 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2241 (Fri Jun 22 18:47:01 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "bec330cb", "local_conf_timestamp": 2241, "host-ts": 2240}, "global_maintenance": true}
lago.ssh: DEBUG: start task:66d9af16-ff39-4eb6-947b-36bb82f6c3c6:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:66d9af16-ff39-4eb6-947b-36bb82f6c3c6:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 38864f28 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 38864f28 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 38864f28 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2251 (Fri Jun 22 18:47:11 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=2252 (Fri Jun 22 18:47:11 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "97357a3e", "local_conf_timestamp": 2252, "host-ts": 2251}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2250 (Fri Jun 22 18:47:10 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2250 (Fri Jun 22 18:47:10 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c1c7af20", "local_conf_timestamp": 2250, "host-ts": 2250}, "global_maintenance": true}
lago.ssh: DEBUG: start task:d3b6a09a-2398-469b-a9e0-7c29eb2c7ee3:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:d3b6a09a-2398-469b-a9e0-7c29eb2c7ee3:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 3adfd514 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 3adfd514 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 3adfd514 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2261 (Fri Jun 22 18:47:20 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=2261 (Fri Jun 22 18:47:20 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "3b7b9057", "local_conf_timestamp": 2261, "host-ts": 2261}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2250 (Fri Jun 22 18:47:10 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2250 (Fri Jun 22 18:47:10 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c1c7af20", "local_conf_timestamp": 2250, "host-ts": 2250}, "global_maintenance": true}
lago.ssh: DEBUG: start task:38017336-63a8-487e-b3cf-b8770ec8df6b:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:38017336-63a8-487e-b3cf-b8770ec8df6b:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 3d2b870a on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 3d2b870a on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 3d2b870a on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2261 (Fri Jun 22 18:47:20 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=2261 (Fri Jun 22 18:47:20 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "3b7b9057", "local_conf_timestamp": 2261, "host-ts": 2261}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2250 (Fri Jun 22 18:47:10 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2250 (Fri Jun 22 18:47:10 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c1c7af20", "local_conf_timestamp": 2250, "host-ts": 2250}, "global_maintenance": true}
lago.ssh: DEBUG: start task:6e2a1c23-fab1-4778-b158-6c27bd95bdb2:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:6e2a1c23-fab1-4778-b158-6c27bd95bdb2:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 3f871f1e on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 3f871f1e on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 3f871f1e on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2271 (Fri Jun 22 18:47:31 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=2271 (Fri Jun 22 18:47:31 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "9e9604d9", "local_conf_timestamp": 2271, "host-ts": 2271}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2270 (Fri Jun 22 18:47:30 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2270 (Fri Jun 22 18:47:30 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d1c0f1da", "local_conf_timestamp": 2270, "host-ts": 2270}, "global_maintenance": true}
lago.ssh: DEBUG: start task:aeb7803a-884e-4cf7-abae-50dc4a196ad3:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:aeb7803a-884e-4cf7-abae-50dc4a196ad3:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 41ef5de8 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 41ef5de8 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 41ef5de8 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2271 (Fri Jun 22 18:47:31 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=2271 (Fri Jun 22 18:47:31 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "9e9604d9", "local_conf_timestamp": 2271, "host-ts": 2271}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2270 (Fri Jun 22 18:47:30 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2270 (Fri Jun 22 18:47:30 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d1c0f1da", "local_conf_timestamp": 2270, "host-ts": 2270}, "global_maintenance": true}
lago.ssh: DEBUG: start task:6fcec395-edba-49e7-af0b-905507b437b4:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:6fcec395-edba-49e7-af0b-905507b437b4:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 44413b34 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 44413b34 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 44413b34 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2271 (Fri Jun 22 18:47:31 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=2271 (Fri Jun 22 18:47:31 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "9e9604d9", "local_conf_timestamp": 2271, "host-ts": 2271}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2270 (Fri Jun 22 18:47:30 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2270 (Fri Jun 22 18:47:30 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d1c0f1da", "local_conf_timestamp": 2270, "host-ts": 2270}, "global_maintenance": true}
lago.ssh: DEBUG: start task:6ad23fd0-beaa-4dad-a947-2a56ff4f332b:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:6ad23fd0-beaa-4dad-a947-2a56ff4f332b:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 4705f74c on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 4705f74c on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 4705f74c on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2281 (Fri Jun 22 18:47:40 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=2281 (Fri Jun 22 18:47:40 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "7ecf5046", "local_conf_timestamp": 2281, "host-ts": 2281}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2270 (Fri Jun 22 18:47:30 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2270 (Fri Jun 22 18:47:30 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d1c0f1da", "local_conf_timestamp": 2270, "host-ts": 2270}, "global_maintenance": true}
lago.ssh: DEBUG: start task:79f6e898-bd3a-4f47-8c6c-73d89befd8ac:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:79f6e898-bd3a-4f47-8c6c-73d89befd8ac:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 49860688 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 49860688 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 49860688 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2281 (Fri Jun 22 18:47:40 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=2281 (Fri Jun 22 18:47:40 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "7ecf5046", "local_conf_timestamp": 2281, "host-ts": 2281}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2270 (Fri Jun 22 18:47:30 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2270 (Fri Jun 22 18:47:30 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d1c0f1da", "local_conf_timestamp": 2270, "host-ts": 2270}, "global_maintenance": true}
lago.ssh: DEBUG: start task:180e1799-a99a-4168-9d31-1117997ea17a:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:180e1799-a99a-4168-9d31-1117997ea17a:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 4c0309c4 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 4c0309c4 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 4c0309c4 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2291 (Fri Jun 22 18:47:50 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2291 (Fri Jun 22 18:47:51 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3e46b69b", "local_conf_timestamp": 2291, "host-ts": 2291}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2290 (Fri Jun 22 18:47:50 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2290 (Fri Jun 22 18:47:50 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a1d4693c", "local_conf_timestamp": 2290, "host-ts": 2290}, "global_maintenance": true}
lago.ssh: DEBUG: start task:0c42481f-ceb3-490a-b03d-eabf81706238:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:0c42481f-ceb3-490a-b03d-eabf81706238:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 4e78e246 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 4e78e246 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 4e78e246 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2291 (Fri Jun 22 18:47:50 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2291 (Fri Jun 22 18:47:51 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3e46b69b", "local_conf_timestamp": 2291, "host-ts": 2291}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2290 (Fri Jun 22 18:47:50 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2290 (Fri Jun 22 18:47:50 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a1d4693c", "local_conf_timestamp": 2290, "host-ts": 2290}, "global_maintenance": true}
lago.ssh: DEBUG: start task:02efa199-5e91-40a7-b99c-c21af182fc39:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:02efa199-5e91-40a7-b99c-c21af182fc39:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 50d382e4 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 50d382e4 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 50d382e4 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2301 (Fri Jun 22 18:48:00 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2301 (Fri Jun 22 18:48:00 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "54c62251", "local_conf_timestamp": 2301, "host-ts": 2301}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2300 (Fri Jun 22 18:48:00 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2300 (Fri Jun 22 18:48:00 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c776b387", "local_conf_timestamp": 2300, "host-ts": 2300}, "global_maintenance": true}
lago.ssh: DEBUG: start task:c59c7606-8685-402a-a5c2-6279e0376859:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:c59c7606-8685-402a-a5c2-6279e0376859:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 531da2dc on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 531da2dc on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 531da2dc on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2301 (Fri Jun 22 18:48:00 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2301 (Fri Jun 22 18:48:00 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "54c62251", "local_conf_timestamp": 2301, "host-ts": 2301}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2300 (Fri Jun 22 18:48:00 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2300 (Fri Jun 22 18:48:00 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c776b387", "local_conf_timestamp": 2300, "host-ts": 2300}, "global_maintenance": true}
lago.ssh: DEBUG: start task:a41676e7-26b6-4f4b-ac81-fd2c7eac215d:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:a41676e7-26b6-4f4b-ac81-fd2c7eac215d:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 557f2690 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 557f2690 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 557f2690 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2301 (Fri Jun 22 18:48:00 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2301 (Fri Jun 22 18:48:00 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "54c62251", "local_conf_timestamp": 2301, "host-ts": 2301}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2300 (Fri Jun 22 18:48:00 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2300 (Fri Jun 22 18:48:00 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c776b387", "local_conf_timestamp": 2300, "host-ts": 2300}, "global_maintenance": true}
lago.ssh: DEBUG: start task:4db92d8b-0849-462b-86aa-56aa1fadbdc8:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:4db92d8b-0849-462b-86aa-56aa1fadbdc8:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 581c0b02 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 581c0b02 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 581c0b02 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2311 (Fri Jun 22 18:48:11 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2311 (Fri Jun 22 18:48:11 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "46ba3a94", "local_conf_timestamp": 2311, "host-ts": 2311}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2310 (Fri Jun 22 18:48:10 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2311 (Fri Jun 22 18:48:11 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "b8722c6c", "local_conf_timestamp": 2311, "host-ts": 2310}, "global_maintenance": true}
lago.ssh: DEBUG: start task:3bab9298-81ac-4629-8ca0-e498247bfbc7:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:3bab9298-81ac-4629-8ca0-e498247bfbc7:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 5a915d42 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 5a915d42 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 5a915d42 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2311 (Fri Jun 22 18:48:11 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2311 (Fri Jun 22 18:48:11 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "46ba3a94", "local_conf_timestamp": 2311, "host-ts": 2311}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2310 (Fri Jun 22 18:48:10 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2311 (Fri Jun 22 18:48:11 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "b8722c6c", "local_conf_timestamp": 2311, "host-ts": 2310}, "global_maintenance": true}
lago.ssh: DEBUG: start task:6b9937a8-8904-491a-ac42-1c0939abbc8f:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:6b9937a8-8904-491a-ac42-1c0939abbc8f:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 5d137744 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 5d137744 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 5d137744 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2321 (Fri Jun 22 18:48:20 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2321 (Fri Jun 22 18:48:20 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "703e13db", "local_conf_timestamp": 2321, "host-ts": 2321}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2320 (Fri Jun 22 18:48:20 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2320 (Fri Jun 22 18:48:20 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d771ed7d", "local_conf_timestamp": 2320, "host-ts": 2320}, "global_maintenance": true}
lago.ssh: DEBUG: start task:fc15aa76-0947-4ce4-9753-bfd35660dcd1:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:fc15aa76-0947-4ce4-9753-bfd35660dcd1:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 5f7ce786 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 5f7ce786 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 5f7ce786 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2321 (Fri Jun 22 18:48:20 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2321 (Fri Jun 22 18:48:20 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "703e13db", "local_conf_timestamp": 2321, "host-ts": 2321}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2320 (Fri Jun 22 18:48:20 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2320 (Fri Jun 22 18:48:20 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d771ed7d", "local_conf_timestamp": 2320, "host-ts": 2320}, "global_maintenance": true}
lago.ssh: DEBUG: start task:83dc71d9-013e-4c66-a2d1-d12cc9adddd0:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:83dc71d9-013e-4c66-a2d1-d12cc9adddd0:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 61eef7c0 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 61eef7c0 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 61eef7c0 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2321 (Fri Jun 22 18:48:20 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2321 (Fri Jun 22 18:48:20 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "703e13db", "local_conf_timestamp": 2321, "host-ts": 2321}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2320 (Fri Jun 22 18:48:20 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2320 (Fri Jun 22 18:48:20 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d771ed7d", "local_conf_timestamp": 2320, "host-ts": 2320}, "global_maintenance": true}
lago.ssh: DEBUG: start task:0c3f4987-1d01-46dc-aa66-c3d0c6933430:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:0c3f4987-1d01-46dc-aa66-c3d0c6933430:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 64b46030 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 64b46030 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 64b46030 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2331 (Fri Jun 22 18:48:31 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2331 (Fri Jun 22 18:48:31 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "62420b1e", "local_conf_timestamp": 2331, "host-ts": 2331}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2330 (Fri Jun 22 18:48:30 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2331 (Fri Jun 22 18:48:31 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a8757296", "local_conf_timestamp": 2331, "host-ts": 2330}, "global_maintenance": true}
lago.ssh: DEBUG: start task:baa23295-8069-4395-8756-bc5db853ff9d:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:baa23295-8069-4395-8756-bc5db853ff9d:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 6720458c on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 6720458c on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 6720458c on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2331 (Fri Jun 22 18:48:31 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2331 (Fri Jun 22 18:48:31 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "62420b1e", "local_conf_timestamp": 2331, "host-ts": 2331}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2330 (Fri Jun 22 18:48:30 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2331 (Fri Jun 22 18:48:31 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a8757296", "local_conf_timestamp": 2331, "host-ts": 2330}, "global_maintenance": true}
lago.ssh: DEBUG: start task:479ef1da-24e7-490e-88ed-c61739a044d0:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:479ef1da-24e7-490e-88ed-c61739a044d0:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 699a90ec on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 699a90ec on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 699a90ec on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2341 (Fri Jun 22 18:48:40 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2341 (Fri Jun 22 18:48:40 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "1d364145", "local_conf_timestamp": 2341, "host-ts": 2341}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2340 (Fri Jun 22 18:48:40 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2340 (Fri Jun 22 18:48:40 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e7780e73", "local_conf_timestamp": 2340, "host-ts": 2340}, "global_maintenance": true}
lago.ssh: DEBUG: start task:24152678-5688-4c02-8b24-5f47ba7f2d3c:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:24152678-5688-4c02-8b24-5f47ba7f2d3c:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 6c2692ac on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 6c2692ac on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 6c2692ac on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2341 (Fri Jun 22 18:48:40 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2341 (Fri Jun 22 18:48:40 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "1d364145", "local_conf_timestamp": 2341, "host-ts": 2341}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2340 (Fri Jun 22 18:48:40 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2340 (Fri Jun 22 18:48:40 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e7780e73", "local_conf_timestamp": 2340, "host-ts": 2340}, "global_maintenance": true}
lago.ssh: DEBUG: start task:36dd77ba-9529-45b4-b449-b7722c0b98fe:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:36dd77ba-9529-45b4-b449-b7722c0b98fe:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 6ebb7244 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 6ebb7244 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 6ebb7244 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2341 (Fri Jun 22 18:48:40 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2341 (Fri Jun 22 18:48:40 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "1d364145", "local_conf_timestamp": 2341, "host-ts": 2341}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2350 (Fri Jun 22 18:48:50 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2350 (Fri Jun 22 18:48:50 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ef7ba10e", "local_conf_timestamp": 2350, "host-ts": 2350}, "global_maintenance": true}
lago.ssh: DEBUG: start task:257e02ab-bf9b-4ac2-8ff7-9515d4f1aa56:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:257e02ab-bf9b-4ac2-8ff7-9515d4f1aa56:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 7159a5e8 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 7159a5e8 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 7159a5e8 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2351 (Fri Jun 22 18:48:51 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2352 (Fri Jun 22 18:48:51 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "9643083a", "local_conf_timestamp": 2352, "host-ts": 2351}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2350 (Fri Jun 22 18:48:50 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2350 (Fri Jun 22 18:48:50 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ef7ba10e", "local_conf_timestamp": 2350, "host-ts": 2350}, "global_maintenance": true}
lago.ssh: DEBUG: start task:27ec01d4-6761-4468-8ed4-6ab4fe4fcb00:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:27ec01d4-6761-4468-8ed4-6ab4fe4fcb00:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 73bd77e2 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 73bd77e2 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 73bd77e2 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2351 (Fri Jun 22 18:48:51 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2352 (Fri Jun 22 18:48:51 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "9643083a", "local_conf_timestamp": 2352, "host-ts": 2351}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2350 (Fri Jun 22 18:48:50 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2350 (Fri Jun 22 18:48:50 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ef7ba10e", "local_conf_timestamp": 2350, "host-ts": 2350}, "global_maintenance": true}
lago.ssh: DEBUG: start task:cc1eb4e6-3fd2-47d2-8998-a0e9e91743f9:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:cc1eb4e6-3fd2-47d2-8998-a0e9e91743f9:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 76ff1456 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 76ff1456 on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 76ff1456 on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2361 (Fri Jun 22 18:49:00 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2361 (Fri Jun 22 18:49:01 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "39ce70cf", "local_conf_timestamp": 2361, "host-ts": 2361}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2360 (Fri Jun 22 18:49:00 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2360 (Fri Jun 22 18:49:00 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "f77f5089", "local_conf_timestamp": 2360, "host-ts": 2360}, "global_maintenance": true}
lago.ssh: DEBUG: start task:34564059-b09e-4c89-9a53-9a4a876e15d0:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: end task:34564059-b09e-4c89-9a53-9a4a876e15d0:Get ssh client for lago-he-basic-ansible-suite-master-host-0:
lago.ssh: DEBUG: Running 796297fe on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json
lago.ssh: DEBUG: Command 796297fe on lago-he-basic-ansible-suite-master-host-0 returned with 0
lago.ssh: DEBUG: Command 796297fe on lago-he-basic-ansible-suite-master-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2361 (Fri Jun 22 18:49:00 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2361 (Fri Jun 22 18:49:01 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "39ce70cf", "local_conf_timestamp": 2361, "host-ts": 2361}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2360 (Fri Jun 22 18:49:00 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2360 (Fri Jun 22 18:49:00 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-
ovirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7f48cce38140>
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within
res = func()
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-ansible-suite-master/ovirt-system-tests/he-basic-ansible-suite-master/test-scenarios/008_restart_he_vm.py", line 139, in <lambda>
for k, v in _get_he_status(host).items()
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-ansible-suite-master/ovirt-system-tests/he-basic-ansible-suite-master/test-scenarios/008_restart_he_vm.py", line 83, in _get_he_status
raise RuntimeError('could not parse JSON: %s' % ret.out)
RuntimeError: could not parse JSON: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2361 (Fri Jun 22 18:49:00 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=2361 (Fri Jun 22 18:49:01 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "39ce70cf", "local_conf_timestamp": 2361, "host-ts": 2361}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=2360 (Fri Jun 22 18:49:00 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=2360 (Fri Jun 22 18:49:00 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-ansible-suite-master/ovirt-system-tests/he-basic-ansible-suite-master/test-scenarios/008_restart_he_vm.py", line 47, in restart_he_vm
_wait_for_engine_health(host)
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-ansible-suite-master/ovirt-system-tests/he-basic-ansible-suite-master/test-scenarios/008_restart_he_vm.py", line 137, in _wait_for_engine_health
testlib.assert_true_within_long(lambda: any(
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 271, in assert_true_within_long
assert_equals_within_long(func, True, allowed_exceptions)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 258, in assert_equals_within_long
func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within
res = func()
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-ansible-suite-master/ovirt-system-tests/he-basic-ansible-suite-master/test-scenarios/008_restart_he_vm.py", line 139, in <lambda>
for k, v in _get_he_status(host).items()
File "/home/jenkins/workspace/ovirt-system-tests_he-basic-ansible-suite-master/ovirt-system-tests/he-basic-ansible-suite-master/test-scenarios/008_restart_he_vm.py", line 83, in _get_he_status
raise RuntimeError('could not parse JSON: %s' % ret.out)
'could not parse JSON: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2361 (Fri Jun 22 18:49:00 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2361 (Fri Jun 22 18:49:01 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "39ce70cf", "local_conf_timestamp": 2361, "host-ts": 2361}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2360 (Fri Jun 22 18:49:00 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2360 (Fri Jun 22 18:49:00 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-\n-------------------- >> begin captured logging << --------------------\nlago.ssh: DEBUG: start task:0206c430-f39c-48ba-ae10-463b259c7695:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:0206c430-f39c-48ba-ae10-463b259c7695:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running fc116bfe on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command fc116bfe on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command fc116bfe on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2152 (Fri Jun 22 18:45:31 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=2152 (Fri Jun 22 18:45:32 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ac489e25", "local_conf_timestamp": 2152, "host-ts": 2152}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2150 (Fri Jun 22 18:45:30 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2151 (Fri Jun 22 18:45:31 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c5048dc4", "local_conf_timestamp": 2151, "host-ts": 2150}, "global_maintenance": true}\n\nroot: INFO: * Shutting down HE VM on host: lago-he-basic-ansible-suite-master-host-0\nlago.ssh: DEBUG: start task:309e4d1e-33d8-40b9-b815-629f19b32c19:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:309e4d1e-33d8-40b9-b815-629f19b32c19:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running fc941d6a on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-shutdown\nlago.ssh: DEBUG: Command fc941d6a on lago-he-basic-ansible-suite-master-host-0 returned with 0\nroot: INFO: * Command succeeded\nroot: INFO: * Waiting for VM to be down...\nlago.ssh: DEBUG: start task:5c70f09d-db34-4dd1-9bd3-fffa981a46cd:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:5c70f09d-db34-4dd1-9bd3-fffa981a46cd:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running fd13e4b4 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command fd13e4b4 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command fd13e4b4 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2152 (Fri Jun 22 18:45:31 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=2152 (Fri Jun 22 18:45:32 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ac489e25", "local_conf_timestamp": 2152, "host-ts": 2152}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2150 (Fri Jun 22 18:45:30 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2151 (Fri Jun 22 18:45:31 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c5048dc4", "local_conf_timestamp": 2151, "host-ts": 2150}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:837c46d4-7157-46ad-b124-6a7a75723ad5:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:837c46d4-7157-46ad-b124-6a7a75723ad5:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 03b0c35a on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 03b0c35a on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 03b0c35a on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2162 (Fri Jun 22 18:45:42 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2163 (Fri Jun 22 18:45:42 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "6119f9bf", "local_conf_timestamp": 2163, "host-ts": 2162}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2160 (Fri Jun 22 18:45:40 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2160 (Fri Jun 22 18:45:40 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "aa074cd5", "local_conf_timestamp": 2160, "host-ts": 2160}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:c1739841-aa58-424f-811c-9bb089e719c7:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:c1739841-aa58-424f-811c-9bb089e719c7:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 06090d38 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 06090d38 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 06090d38 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2172 (Fri Jun 22 18:45:52 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2172 (Fri Jun 22 18:45:52 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Powering down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3b8d448e", "local_conf_timestamp": 2172, "host-ts": 2172}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2170 (Fri Jun 22 18:45:50 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2171 (Fri Jun 22 18:45:51 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d503d33e", "local_conf_timestamp": 2171, "host-ts": 2170}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:07646a89-9b6c-49dd-8346-1149320f2574:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:07646a89-9b6c-49dd-8346-1149320f2574:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 085ce974 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 085ce974 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 085ce974 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2172 (Fri Jun 22 18:45:52 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2172 (Fri Jun 22 18:45:52 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Powering down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3b8d448e", "local_conf_timestamp": 2172, "host-ts": 2172}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2170 (Fri Jun 22 18:45:50 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2171 (Fri Jun 22 18:45:51 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d503d33e", "local_conf_timestamp": 2171, "host-ts": 2170}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:ec34da5e-75fa-4c2d-a31c-10b0557f7aae:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:ec34da5e-75fa-4c2d-a31c-10b0557f7aae:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 0aaa42c6 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 0aaa42c6 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 0aaa42c6 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2182 (Fri Jun 22 18:46:02 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=2183 (Fri Jun 22 18:46:02 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down_unexpected", "detail": "Down"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e2fccec7", "local_conf_timestamp": 2183, "host-ts": 2182}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2180 (Fri Jun 22 18:46:00 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2180 (Fri Jun 22 18:46:00 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "da13d433", "local_conf_timestamp": 2180, "host-ts": 2180}, "global_maintenance": true}\n\nroot: INFO: * VM is down.\nroot: INFO: * Restarting services...\nlago.ssh: DEBUG: start task:0c52e610-8de0-473d-bab5-9b05bf3e3f38:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:0c52e610-8de0-473d-bab5-9b05bf3e3f38:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 0b29acdc on lago-he-basic-ansible-suite-master-host-0: systemctl restart vdsmd ovirt-ha-broker ovirt-ha-agent\nlago.ssh: DEBUG: Command 0b29acdc on lago-he-basic-ansible-suite-master-host-0 returned with 0\nroot: INFO: * Success.\nroot: INFO: * Waiting for agent to be ready...\nlago.ssh: DEBUG: start task:90ca3da8-f107-44cf-b5bd-282eeffde720:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:90ca3da8-f107-44cf-b5bd-282eeffde720:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 15923248 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 15923248 on lago-he-basic-ansible-suite-master-host-0 returned with 1\nlago.ssh: DEBUG: Command 15923248 on lago-he-basic-ansible-suite-master-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:1b0a1bcd-1ef1-4e8c-be38-87e494eb9932:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:1b0a1bcd-1ef1-4e8c-be38-87e494eb9932:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 1bf07e92 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 1bf07e92 on lago-he-basic-ansible-suite-master-host-0 returned with 1\nlago.ssh: DEBUG: Command 1bf07e92 on lago-he-basic-ansible-suite-master-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:bd26a276-9760-4946-9edc-0f8e62b4bc04:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:bd26a276-9760-4946-9edc-0f8e62b4bc04:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 1e242678 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 1e242678 on lago-he-basic-ansible-suite-master-host-0 returned with 1\nlago.ssh: DEBUG: Command 1e242678 on lago-he-basic-ansible-suite-master-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:e283c4b9-724a-4e16-8410-5a31750a7d7b:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:e283c4b9-724a-4e16-8410-5a31750a7d7b:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 2052e6b4 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 2052e6b4 on lago-he-basic-ansible-suite-master-host-0 returned with 1\nlago.ssh: DEBUG: Command 2052e6b4 on lago-he-basic-ansible-suite-master-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:b3e4245b-c3d1-4b90-aada-59901a1d9455:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:b3e4245b-c3d1-4b90-aada-59901a1d9455:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 22807ff0 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 22807ff0 on lago-he-basic-ansible-suite-master-host-0 returned with 1\nlago.ssh: DEBUG: Command 22807ff0 on lago-he-basic-ansible-suite-master-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:d6d3ee7e-86bc-4225-b2e7-e5fb3c26b36e:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:d6d3ee7e-86bc-4225-b2e7-e5fb3c26b36e:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 24b0c154 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 24b0c154 on lago-he-basic-ansible-suite-master-host-0 returned with 1\nlago.ssh: DEBUG: Command 24b0c154 on lago-he-basic-ansible-suite-master-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:65126cb6-38ed-4953-9355-e0a74e23c8d5:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:65126cb6-38ed-4953-9355-e0a74e23c8d5:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 26e24894 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 26e24894 on lago-he-basic-ansible-suite-master-host-0 returned with 1\nlago.ssh: DEBUG: Command 26e24894 on lago-he-basic-ansible-suite-master-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:61a3b3f4-8ff3-4c72-97b9-76451337edda:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:61a3b3f4-8ff3-4c72-97b9-76451337edda:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 29211734 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 29211734 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 29211734 on lago-he-basic-ansible-suite-master-host-0 output:\n \n\n!! Cluster is in GLOBAL MAINTENANCE mode !!\n\n\n\n--== Host lago-he-basic-ansible-suite-master-host-0 (id: 1) status ==--\n\nconf_on_shared_storage : True\nStatus up-to-date : True\nHostname : lago-he-basic-ansible-suite-master-host-0\nHost ID : 1\nEngine status : {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Down"}\nScore : 0\nstopped : False\nLocal maintenance : False\ncrc32 : 2b063a5e\nlocal_conf_timestamp : 2231\nHost timestamp : 2231\nExtra metadata (valid at timestamp):\n\tmetadata_parse_version=1\n\tmetadata_feature_version=1\n\ttimestamp=2231 (Fri Jun 22 18:46:50 2018)\n\thost-id=1\n\tscore=0\n\tvm_conf_refresh_time=2231 (Fri Jun 22 18:46:50 2018)\n\tconf_on_shared_storage=True\n\tmaintenance=False\n\tstate=ReinitializeFSM\n\tstopped=False\n\n\n--== Host lago-he-basic-ansible-suite-master-host-1 (id: 2) status ==--\n\nconf_on_shared_storage : True\nStatus up-to-date : False\nHostname : lago-he-basic-ansible-suite-master-host-1\nHost ID : 2\nEngine status : unknown stale-data\nScore : 3400\nstopped : False\nLocal maintenance : False\ncrc32 : f1ce4c2e\nlocal_conf_timestamp : 2230\nHost timestamp : 2230\nExtra metadata (valid at timestamp):\n\tmetadata_parse_version=1\n\tmetadata_feature_version=1\n\ttimestamp=2230 (Fri Jun 22 18:46:50 2018)\n\thost-id=2\n\tscore=3400\n\tvm_conf_refresh_time=2230 (Fri Jun 22 18:46:50 2018)\n\tconf_on_shared_storage=True\n\tmaintenance=False\n\tstate=GlobalMaintenance\n\tstopped=False\n\n\n!! Cluster is in GLOBAL MAINTENANCE mode !!\n\n\nroot: INFO: * Agent is ready.\nroot: INFO: * Starting VM...\nlago.ssh: DEBUG: start task:33e28fb6-a232-4363-a3a1-19f7fcd59851:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:33e28fb6-a232-4363-a3a1-19f7fcd59851:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 29a01732 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-start\nlago.ssh: DEBUG: Command 29a01732 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 29a01732 on lago-he-basic-ansible-suite-master-host-0 output:\n VM exists and is down, cleaning up and restarting\n\nroot: INFO: * Command succeeded\nroot: INFO: * Waiting to VM to be UP...\nlago.ssh: DEBUG: start task:c2293362-1b0f-4b35-85ed-0e9beb375b6f:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:c2293362-1b0f-4b35-85ed-0e9beb375b6f:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 2b02fc8e on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 2b02fc8e on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 2b02fc8e on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2231 (Fri Jun 22 18:46:50 2018)\\nhost-id=1\\nscore=0\\nvm_conf_refresh_time=2231 (Fri Jun 22 18:46:50 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=ReinitializeFSM\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Down"}, "score": 0, "stopped": false, "maintenance": false, "crc32": "2b063a5e", "local_conf_timestamp": 2231, "host-ts": 2231}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2230 (Fri Jun 22 18:46:50 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2230 (Fri Jun 22 18:46:50 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "f1ce4c2e", "local_conf_timestamp": 2230, "host-ts": 2230}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:30716cb3-bc59-4fc0-b300-af571804841a:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:30716cb3-bc59-4fc0-b300-af571804841a:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 318195b6 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 318195b6 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 318195b6 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2241 (Fri Jun 22 18:47:01 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=2241 (Fri Jun 22 18:47:01 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "abd1bf0a", "local_conf_timestamp": 2241, "host-ts": 2241}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2240 (Fri Jun 22 18:47:00 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2241 (Fri Jun 22 18:47:01 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "bec330cb", "local_conf_timestamp": 2241, "host-ts": 2240}, "global_maintenance": true}\n\nroot: INFO: * VM is UP.\nroot: INFO: * Waiting for engine to start ...\nlago.ssh: DEBUG: start task:f7581d83-a119-4ce7-af34-b6421741d98c:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:f7581d83-a119-4ce7-af34-b6421741d98c:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 31f8ab92 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 31f8ab92 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 31f8ab92 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2241 (Fri Jun 22 18:47:01 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=2241 (Fri Jun 22 18:47:01 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "abd1bf0a", "local_conf_timestamp": 2241, "host-ts": 2241}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2240 (Fri Jun 22 18:47:00 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2241 (Fri Jun 22 18:47:01 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "bec330cb", "local_conf_timestamp": 2241, "host-ts": 2240}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:66d9af16-ff39-4eb6-947b-36bb82f6c3c6:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:66d9af16-ff39-4eb6-947b-36bb82f6c3c6:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 38864f28 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 38864f28 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 38864f28 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2251 (Fri Jun 22 18:47:11 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=2252 (Fri Jun 22 18:47:11 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "97357a3e", "local_conf_timestamp": 2252, "host-ts": 2251}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2250 (Fri Jun 22 18:47:10 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2250 (Fri Jun 22 18:47:10 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c1c7af20", "local_conf_timestamp": 2250, "host-ts": 2250}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:d3b6a09a-2398-469b-a9e0-7c29eb2c7ee3:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:d3b6a09a-2398-469b-a9e0-7c29eb2c7ee3:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 3adfd514 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 3adfd514 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 3adfd514 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2261 (Fri Jun 22 18:47:20 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=2261 (Fri Jun 22 18:47:20 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "3b7b9057", "local_conf_timestamp": 2261, "host-ts": 2261}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2250 (Fri Jun 22 18:47:10 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2250 (Fri Jun 22 18:47:10 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c1c7af20", "local_conf_timestamp": 2250, "host-ts": 2250}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:38017336-63a8-487e-b3cf-b8770ec8df6b:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:38017336-63a8-487e-b3cf-b8770ec8df6b:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 3d2b870a on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 3d2b870a on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 3d2b870a on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2261 (Fri Jun 22 18:47:20 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=2261 (Fri Jun 22 18:47:20 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "3b7b9057", "local_conf_timestamp": 2261, "host-ts": 2261}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2250 (Fri Jun 22 18:47:10 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2250 (Fri Jun 22 18:47:10 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c1c7af20", "local_conf_timestamp": 2250, "host-ts": 2250}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:6e2a1c23-fab1-4778-b158-6c27bd95bdb2:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:6e2a1c23-fab1-4778-b158-6c27bd95bdb2:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 3f871f1e on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 3f871f1e on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 3f871f1e on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2271 (Fri Jun 22 18:47:31 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=2271 (Fri Jun 22 18:47:31 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "9e9604d9", "local_conf_timestamp": 2271, "host-ts": 2271}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2270 (Fri Jun 22 18:47:30 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2270 (Fri Jun 22 18:47:30 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d1c0f1da", "local_conf_timestamp": 2270, "host-ts": 2270}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:aeb7803a-884e-4cf7-abae-50dc4a196ad3:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:aeb7803a-884e-4cf7-abae-50dc4a196ad3:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 41ef5de8 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 41ef5de8 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 41ef5de8 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2271 (Fri Jun 22 18:47:31 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=2271 (Fri Jun 22 18:47:31 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "9e9604d9", "local_conf_timestamp": 2271, "host-ts": 2271}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2270 (Fri Jun 22 18:47:30 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2270 (Fri Jun 22 18:47:30 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d1c0f1da", "local_conf_timestamp": 2270, "host-ts": 2270}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:6fcec395-edba-49e7-af0b-905507b437b4:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:6fcec395-edba-49e7-af0b-905507b437b4:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 44413b34 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 44413b34 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 44413b34 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2271 (Fri Jun 22 18:47:31 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=2271 (Fri Jun 22 18:47:31 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "9e9604d9", "local_conf_timestamp": 2271, "host-ts": 2271}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2270 (Fri Jun 22 18:47:30 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2270 (Fri Jun 22 18:47:30 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d1c0f1da", "local_conf_timestamp": 2270, "host-ts": 2270}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:6ad23fd0-beaa-4dad-a947-2a56ff4f332b:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:6ad23fd0-beaa-4dad-a947-2a56ff4f332b:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 4705f74c on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 4705f74c on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 4705f74c on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2281 (Fri Jun 22 18:47:40 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=2281 (Fri Jun 22 18:47:40 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "7ecf5046", "local_conf_timestamp": 2281, "host-ts": 2281}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2270 (Fri Jun 22 18:47:30 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2270 (Fri Jun 22 18:47:30 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d1c0f1da", "local_conf_timestamp": 2270, "host-ts": 2270}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:79f6e898-bd3a-4f47-8c6c-73d89befd8ac:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:79f6e898-bd3a-4f47-8c6c-73d89befd8ac:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 49860688 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 49860688 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 49860688 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2281 (Fri Jun 22 18:47:40 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=2281 (Fri Jun 22 18:47:40 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "7ecf5046", "local_conf_timestamp": 2281, "host-ts": 2281}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2270 (Fri Jun 22 18:47:30 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2270 (Fri Jun 22 18:47:30 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d1c0f1da", "local_conf_timestamp": 2270, "host-ts": 2270}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:180e1799-a99a-4168-9d31-1117997ea17a:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:180e1799-a99a-4168-9d31-1117997ea17a:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 4c0309c4 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 4c0309c4 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 4c0309c4 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2291 (Fri Jun 22 18:47:50 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2291 (Fri Jun 22 18:47:51 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3e46b69b", "local_conf_timestamp": 2291, "host-ts": 2291}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2290 (Fri Jun 22 18:47:50 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2290 (Fri Jun 22 18:47:50 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a1d4693c", "local_conf_timestamp": 2290, "host-ts": 2290}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:0c42481f-ceb3-490a-b03d-eabf81706238:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:0c42481f-ceb3-490a-b03d-eabf81706238:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 4e78e246 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 4e78e246 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 4e78e246 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2291 (Fri Jun 22 18:47:50 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2291 (Fri Jun 22 18:47:51 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3e46b69b", "local_conf_timestamp": 2291, "host-ts": 2291}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2290 (Fri Jun 22 18:47:50 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2290 (Fri Jun 22 18:47:50 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a1d4693c", "local_conf_timestamp": 2290, "host-ts": 2290}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:02efa199-5e91-40a7-b99c-c21af182fc39:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:02efa199-5e91-40a7-b99c-c21af182fc39:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 50d382e4 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 50d382e4 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 50d382e4 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2301 (Fri Jun 22 18:48:00 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2301 (Fri Jun 22 18:48:00 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "54c62251", "local_conf_timestamp": 2301, "host-ts": 2301}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2300 (Fri Jun 22 18:48:00 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2300 (Fri Jun 22 18:48:00 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c776b387", "local_conf_timestamp": 2300, "host-ts": 2300}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:c59c7606-8685-402a-a5c2-6279e0376859:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:c59c7606-8685-402a-a5c2-6279e0376859:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 531da2dc on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 531da2dc on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 531da2dc on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2301 (Fri Jun 22 18:48:00 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2301 (Fri Jun 22 18:48:00 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "54c62251", "local_conf_timestamp": 2301, "host-ts": 2301}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2300 (Fri Jun 22 18:48:00 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2300 (Fri Jun 22 18:48:00 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c776b387", "local_conf_timestamp": 2300, "host-ts": 2300}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:a41676e7-26b6-4f4b-ac81-fd2c7eac215d:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:a41676e7-26b6-4f4b-ac81-fd2c7eac215d:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 557f2690 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 557f2690 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 557f2690 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2301 (Fri Jun 22 18:48:00 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2301 (Fri Jun 22 18:48:00 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "54c62251", "local_conf_timestamp": 2301, "host-ts": 2301}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2300 (Fri Jun 22 18:48:00 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2300 (Fri Jun 22 18:48:00 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "c776b387", "local_conf_timestamp": 2300, "host-ts": 2300}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:4db92d8b-0849-462b-86aa-56aa1fadbdc8:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:4db92d8b-0849-462b-86aa-56aa1fadbdc8:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 581c0b02 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 581c0b02 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 581c0b02 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2311 (Fri Jun 22 18:48:11 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2311 (Fri Jun 22 18:48:11 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "46ba3a94", "local_conf_timestamp": 2311, "host-ts": 2311}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2310 (Fri Jun 22 18:48:10 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2311 (Fri Jun 22 18:48:11 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "b8722c6c", "local_conf_timestamp": 2311, "host-ts": 2310}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:3bab9298-81ac-4629-8ca0-e498247bfbc7:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:3bab9298-81ac-4629-8ca0-e498247bfbc7:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 5a915d42 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 5a915d42 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 5a915d42 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2311 (Fri Jun 22 18:48:11 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2311 (Fri Jun 22 18:48:11 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "46ba3a94", "local_conf_timestamp": 2311, "host-ts": 2311}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2310 (Fri Jun 22 18:48:10 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2311 (Fri Jun 22 18:48:11 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "b8722c6c", "local_conf_timestamp": 2311, "host-ts": 2310}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:6b9937a8-8904-491a-ac42-1c0939abbc8f:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:6b9937a8-8904-491a-ac42-1c0939abbc8f:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 5d137744 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 5d137744 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 5d137744 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2321 (Fri Jun 22 18:48:20 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2321 (Fri Jun 22 18:48:20 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "703e13db", "local_conf_timestamp": 2321, "host-ts": 2321}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2320 (Fri Jun 22 18:48:20 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2320 (Fri Jun 22 18:48:20 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d771ed7d", "local_conf_timestamp": 2320, "host-ts": 2320}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:fc15aa76-0947-4ce4-9753-bfd35660dcd1:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:fc15aa76-0947-4ce4-9753-bfd35660dcd1:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 5f7ce786 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 5f7ce786 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 5f7ce786 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2321 (Fri Jun 22 18:48:20 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2321 (Fri Jun 22 18:48:20 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "703e13db", "local_conf_timestamp": 2321, "host-ts": 2321}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2320 (Fri Jun 22 18:48:20 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2320 (Fri Jun 22 18:48:20 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d771ed7d", "local_conf_timestamp": 2320, "host-ts": 2320}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:83dc71d9-013e-4c66-a2d1-d12cc9adddd0:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:83dc71d9-013e-4c66-a2d1-d12cc9adddd0:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 61eef7c0 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 61eef7c0 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 61eef7c0 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2321 (Fri Jun 22 18:48:20 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2321 (Fri Jun 22 18:48:20 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "703e13db", "local_conf_timestamp": 2321, "host-ts": 2321}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2320 (Fri Jun 22 18:48:20 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2320 (Fri Jun 22 18:48:20 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d771ed7d", "local_conf_timestamp": 2320, "host-ts": 2320}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:0c3f4987-1d01-46dc-aa66-c3d0c6933430:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:0c3f4987-1d01-46dc-aa66-c3d0c6933430:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 64b46030 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 64b46030 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 64b46030 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2331 (Fri Jun 22 18:48:31 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2331 (Fri Jun 22 18:48:31 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "62420b1e", "local_conf_timestamp": 2331, "host-ts": 2331}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2330 (Fri Jun 22 18:48:30 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2331 (Fri Jun 22 18:48:31 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a8757296", "local_conf_timestamp": 2331, "host-ts": 2330}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:baa23295-8069-4395-8756-bc5db853ff9d:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:baa23295-8069-4395-8756-bc5db853ff9d:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 6720458c on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6720458c on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 6720458c on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2331 (Fri Jun 22 18:48:31 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2331 (Fri Jun 22 18:48:31 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "62420b1e", "local_conf_timestamp": 2331, "host-ts": 2331}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2330 (Fri Jun 22 18:48:30 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2331 (Fri Jun 22 18:48:31 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a8757296", "local_conf_timestamp": 2331, "host-ts": 2330}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:479ef1da-24e7-490e-88ed-c61739a044d0:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:479ef1da-24e7-490e-88ed-c61739a044d0:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 699a90ec on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 699a90ec on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 699a90ec on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2341 (Fri Jun 22 18:48:40 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2341 (Fri Jun 22 18:48:40 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "1d364145", "local_conf_timestamp": 2341, "host-ts": 2341}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2340 (Fri Jun 22 18:48:40 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2340 (Fri Jun 22 18:48:40 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e7780e73", "local_conf_timestamp": 2340, "host-ts": 2340}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:24152678-5688-4c02-8b24-5f47ba7f2d3c:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:24152678-5688-4c02-8b24-5f47ba7f2d3c:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 6c2692ac on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6c2692ac on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 6c2692ac on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2341 (Fri Jun 22 18:48:40 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2341 (Fri Jun 22 18:48:40 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "1d364145", "local_conf_timestamp": 2341, "host-ts": 2341}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2340 (Fri Jun 22 18:48:40 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2340 (Fri Jun 22 18:48:40 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e7780e73", "local_conf_timestamp": 2340, "host-ts": 2340}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:36dd77ba-9529-45b4-b449-b7722c0b98fe:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:36dd77ba-9529-45b4-b449-b7722c0b98fe:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 6ebb7244 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6ebb7244 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 6ebb7244 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2341 (Fri Jun 22 18:48:40 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2341 (Fri Jun 22 18:48:40 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "1d364145", "local_conf_timestamp": 2341, "host-ts": 2341}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2350 (Fri Jun 22 18:48:50 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2350 (Fri Jun 22 18:48:50 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ef7ba10e", "local_conf_timestamp": 2350, "host-ts": 2350}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:257e02ab-bf9b-4ac2-8ff7-9515d4f1aa56:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:257e02ab-bf9b-4ac2-8ff7-9515d4f1aa56:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 7159a5e8 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 7159a5e8 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 7159a5e8 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2351 (Fri Jun 22 18:48:51 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2352 (Fri Jun 22 18:48:51 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "9643083a", "local_conf_timestamp": 2352, "host-ts": 2351}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2350 (Fri Jun 22 18:48:50 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2350 (Fri Jun 22 18:48:50 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ef7ba10e", "local_conf_timestamp": 2350, "host-ts": 2350}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:27ec01d4-6761-4468-8ed4-6ab4fe4fcb00:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:27ec01d4-6761-4468-8ed4-6ab4fe4fcb00:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 73bd77e2 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 73bd77e2 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 73bd77e2 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2351 (Fri Jun 22 18:48:51 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2352 (Fri Jun 22 18:48:51 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "9643083a", "local_conf_timestamp": 2352, "host-ts": 2351}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2350 (Fri Jun 22 18:48:50 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2350 (Fri Jun 22 18:48:50 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ef7ba10e", "local_conf_timestamp": 2350, "host-ts": 2350}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:cc1eb4e6-3fd2-47d2-8998-a0e9e91743f9:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:cc1eb4e6-3fd2-47d2-8998-a0e9e91743f9:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 76ff1456 on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 76ff1456 on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 76ff1456 on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2361 (Fri Jun 22 18:49:00 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2361 (Fri Jun 22 18:49:01 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "39ce70cf", "local_conf_timestamp": 2361, "host-ts": 2361}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2360 (Fri Jun 22 18:49:00 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2360 (Fri Jun 22 18:49:00 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "f77f5089", "local_conf_timestamp": 2360, "host-ts": 2360}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:34564059-b09e-4c89-9a53-9a4a876e15d0:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: end task:34564059-b09e-4c89-9a53-9a4a876e15d0:Get ssh client for lago-he-basic-ansible-suite-master-host-0:\nlago.ssh: DEBUG: Running 796297fe on lago-he-basic-ansible-suite-master-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 796297fe on lago-he-basic-ansible-suite-master-host-0 returned with 0\nlago.ssh: DEBUG: Command 796297fe on lago-he-basic-ansible-suite-master-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2361 (Fri Jun 22 18:49:00 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2361 (Fri Jun 22 18:49:01 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "39ce70cf", "local_conf_timestamp": 2361, "host-ts": 2361}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2360 (Fri Jun 22 18:49:00 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2360 (Fri Jun 22 18:49:00 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-\novirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7f48cce38140>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-ansible-suite-master/ovirt-system-tests/he-basic-ansible-suite-master/test-scenarios/008_restart_he_vm.py", line 139, in <lambda>\n for k, v in _get_he_status(host).items()\n File "/home/jenkins/workspace/ovirt-system-tests_he-basic-ansible-suite-master/ovirt-system-tests/he-basic-ansible-suite-master/test-scenarios/008_restart_he_vm.py", line 83, in _get_he_status\n raise RuntimeError(\'could not parse JSON: %s\' % ret.out)\nRuntimeError: could not parse JSON: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2361 (Fri Jun 22 18:49:00 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=2361 (Fri Jun 22 18:49:01 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "39ce70cf", "local_conf_timestamp": 2361, "host-ts": 2361}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=2360 (Fri Jun 22 18:49:00 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=2360 (Fri Jun 22 18:49:00 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-ansible-suite-master-host-1", "host-\n--------------------- >> end captured logging << ---------------------'
6 years, 6 months
[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build #
503 - Failure!
by jenkins@jenkins.phx.ovirt.org
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/
Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/503/
Build Number: 503
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #503
[Sandro Bonazzola] yum-repos: master: adjusted for new packages
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 004_basic_sanity.snapshot_merge
Error Message:
status: 409
reason: Conflict
detail: Cannot create Snapshot. Snapshot is currently being created for VM vm0.
Stack Trace:
Traceback (most recent call last):
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 68, in wrapper
return func(prefix.virt_env.engine_vm().get_api(), *args, **kwargs)
File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/004_basic_sanity.py", line 194, in snapshot_merge
api.vms.get(VM0_NAME).snapshots.add(dead_snap2_params)
File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", line 34511, in add
headers={"Correlation-Id":correlation_id, "Expect":expect}
File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 79, in add
return self.request('POST', url, body, headers, cls=cls)
File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 122, in request
persistent_auth=self.__persistent_auth
File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 79, in do_request
persistent_auth)
File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 162, in __do_request
raise errors.RequestError(response_code, response_reason, response_body)
RequestError:
status: 409
reason: Conflict
detail: Cannot create Snapshot. Snapshot is currently being created for VM vm0.
6 years, 6 months
[JIRA] (OVIRT-2150) missing packages on check-patch
by Dafna Ron (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2150?page=com.atlassian.jir... ]
Dafna Ron updated OVIRT-2150:
-----------------------------
Issue Type: Bug (was: Task)
> missing packages on check-patch
> -------------------------------
>
> Key: OVIRT-2150
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2150
> Project: oVirt - virtualization made easy
> Issue Type: Bug
> Reporter: Dafna Ron
> Assignee: infra
> Labels: ost_failures, ost_infra, ost_infra_packages
>
> http://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/1170...
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Error: Package: python2-ovsdbapp-0.6.0-1.el7.noarch (alocalsync)
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Requires: python-netaddr
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Error: Package: ovirt-engine-4.3.0-0.0.master.20180604134534.git3e394fa.el7.noarch (alocalsync)
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Requires: pyOpenSSL
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Error: Package: ovirt-provider-ovn-1.2.11-1.el7.noarch (alocalsync)
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Requires: python-netaddr
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64]
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100087)
6 years, 6 months
[JIRA] (OVIRT-2150) missing packages on check-patch
by Dafna Ron (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2150?page=com.atlassian.jir... ]
Dafna Ron commented on OVIRT-2150:
----------------------------------
issue was resolved.
> missing packages on check-patch
> -------------------------------
>
> Key: OVIRT-2150
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2150
> Project: oVirt - virtualization made easy
> Issue Type: Task
> Reporter: Dafna Ron
> Assignee: infra
> Labels: ost_failures, ost_infra, ost_infra_packages
>
> http://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/1170...
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Error: Package: python2-ovsdbapp-0.6.0-1.el7.noarch (alocalsync)
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Requires: python-netaddr
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Error: Package: ovirt-engine-4.3.0-0.0.master.20180604134534.git3e394fa.el7.noarch (alocalsync)
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Requires: pyOpenSSL
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Error: Package: ovirt-provider-ovn-1.2.11-1.el7.noarch (alocalsync)
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Requires: python-netaddr
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64]
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100087)
6 years, 6 months
[JIRA] (OVIRT-2150) missing packages on check-patch
by Dafna Ron (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2150?page=com.atlassian.jir... ]
Dafna Ron updated OVIRT-2150:
-----------------------------
Resolution: Fixed
Status: Done (was: To Do)
> missing packages on check-patch
> -------------------------------
>
> Key: OVIRT-2150
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2150
> Project: oVirt - virtualization made easy
> Issue Type: Task
> Reporter: Dafna Ron
> Assignee: infra
> Labels: ost_failures, ost_infra, ost_infra_packages
>
> http://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/1170...
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Error: Package: python2-ovsdbapp-0.6.0-1.el7.noarch (alocalsync)
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Requires: python-netaddr
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Error: Package: ovirt-engine-4.3.0-0.0.master.20180604134534.git3e394fa.el7.noarch (alocalsync)
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Requires: pyOpenSSL
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Error: Package: ovirt-provider-ovn-1.2.11-1.el7.noarch (alocalsync)
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Requires: python-netaddr
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64]
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100087)
6 years, 6 months
[JIRA] (OVIRT-2150) missing packages on check-patch
by Dafna Ron (oVirt JIRA)
[ https://ovirt-jira.atlassian.net/browse/OVIRT-2150?page=com.atlassian.jir... ]
Dafna Ron commented on OVIRT-2150:
----------------------------------
this was resolved.
> missing packages on check-patch
> -------------------------------
>
> Key: OVIRT-2150
> URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2150
> Project: oVirt - virtualization made easy
> Issue Type: Task
> Reporter: Dafna Ron
> Assignee: infra
> Labels: ost_failures, ost_infra, ost_infra_packages
>
> http://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/1170...
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Error: Package: python2-ovsdbapp-0.6.0-1.el7.noarch (alocalsync)
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Requires: python-netaddr
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Error: Package: ovirt-engine-4.3.0-0.0.master.20180604134534.git3e394fa.el7.noarch (alocalsync)
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Requires: pyOpenSSL
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Error: Package: ovirt-provider-ovn-1.2.11-1.el7.noarch (alocalsync)
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64] Requires: python-netaddr
> 10:18:14 [check-patch.basic_suite_master.el7.x86_64]
--
This message was sent by Atlassian Jira
(v1001.0.0-SNAPSHOT#100087)
6 years, 6 months