[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-4.2 - Build # 376 - Still Failing!

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/376/ Build Number: 376 Build Status: Still Failing Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #347 [Dafna Ron] ovirt-4.2: block external links from running in ost Changes for Build #348 [Dafna Ron] ovirt-4.2: block external links from running in ost Changes for Build #349 [Dafna Ron] ovirt-4.2: block external links from running in ost Changes for Build #350 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #351 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #352 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #353 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #354 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #355 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #356 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #357 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #358 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #359 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #360 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #361 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #362 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" [Sandro Bonazzola] ovirt-setup-lib: drop 3.6 [Sandro Bonazzola] ovirt-host: drop 3.6 and 4.1 Changes for Build #363 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #364 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #365 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" [Sandro Bonazzola] ovirt-reports: drop 3.6 jobs [Sandro Bonazzola] ovirt-host-deploy: drop 3.6 jobs Changes for Build #366 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #367 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #368 [Gal Ben Haim] Remove stale url to the internal repo [Greg Sheremeta] add ovirt-web-ui to stdci v2 Changes for Build #369 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #370 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #371 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #372 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #373 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #374 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #375 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #376 [Gal Ben Haim] Remove stale url to the internal repo ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 008_restart_he_vm.restart_he_vm Error Message: could not parse JSON: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3507 (Sat Oct 6 09:32:07 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3508 (Sat Oct 6 09:32:08 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "b48c6d98", "local_conf_timestamp": 3508, "host-ts": 3507}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3504 (Sat Oct 6 09:32:04 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3504 (Sat Oct 6 09:32:04 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-st -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:c44edc62-5de4-46f8-a4da-91d5e60d519b:Get ssh client for lago-he-node-ng-suite-4-2-host-1: lago.ssh: DEBUG: end task:c44edc62-5de4-46f8-a4da-91d5e60d519b:Get ssh client for lago-he-node-ng-suite-4-2-host-1: lago.ssh: DEBUG: Running 1858959c on lago-he-node-ng-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 1858959c on lago-he-node-ng-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 1858959c on lago-he-node-ng-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3243 (Sat Oct 6 09:27:43 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3243 (Sat Oct 6 09:27:43 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "3a5d8fcb", "local_conf_timestamp": 3243, "host-ts": 3243}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3244 (Sat Oct 6 09:27:44 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3244 (Sat Oct 6 09:27:44 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ff08047a", "local_conf_timestamp": 3244, "host-ts": 3244}, "global_maintenance": true} root: INFO: * Shutting down HE VM on host: lago-he-node-ng-suite-4-2-host-0 lago.ssh: DEBUG: start task:8bec795e-0a02-4d83-8919-c388a99e8798:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:8bec795e-0a02-4d83-8919-c388a99e8798:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 1963e130 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-shutdown lago.ssh: DEBUG: Command 1963e130 on lago-he-node-ng-suite-4-2-host-0 returned with 0 root: INFO: * Command succeeded root: INFO: * Waiting for VM to be down... lago.ssh: DEBUG: start task:1a13a370-162f-4fe7-bc9c-e0c25121d6a6:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:1a13a370-162f-4fe7-bc9c-e0c25121d6a6:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 1bd51f4c on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 1bd51f4c on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 1bd51f4c on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3253 (Sat Oct 6 09:27:53 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3253 (Sat Oct 6 09:27:53 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e63acff4", "local_conf_timestamp": 3253, "host-ts": 3253}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3244 (Sat Oct 6 09:27:44 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3244 (Sat Oct 6 09:27:44 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ff08047a", "local_conf_timestamp": 3244, "host-ts": 3244}, "global_maintenance": true} lago.ssh: DEBUG: start task:5765e57d-473f-433f-98e4-03da4b175b7e:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:5765e57d-473f-433f-98e4-03da4b175b7e:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 237c9734 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 237c9734 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 237c9734 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3263 (Sat Oct 6 09:28:04 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3264 (Sat Oct 6 09:28:04 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Powering down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "202ccf78", "local_conf_timestamp": 3264, "host-ts": 3263}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3254 (Sat Oct 6 09:27:54 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3254 (Sat Oct 6 09:27:54 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "fb4efb7f", "local_conf_timestamp": 3254, "host-ts": 3254}, "global_maintenance": true} lago.ssh: DEBUG: start task:0e1588f5-b1e6-4a80-b9d7-597f9ff9d718:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:0e1588f5-b1e6-4a80-b9d7-597f9ff9d718:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 265cd4be on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 265cd4be on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 265cd4be on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3273 (Sat Oct 6 09:28:13 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3273 (Sat Oct 6 09:28:14 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down_unexpected", "detail": "Down"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "486617f5", "local_conf_timestamp": 3273, "host-ts": 3273}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3264 (Sat Oct 6 09:28:04 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3264 (Sat Oct 6 09:28:04 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "f785fa70", "local_conf_timestamp": 3264, "host-ts": 3264}, "global_maintenance": true} root: INFO: * VM is down. root: INFO: * Stopping services... lago.ssh: DEBUG: start task:0db6b7b8-6e36-40bf-9739-f392e79e2b3c:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:0db6b7b8-6e36-40bf-9739-f392e79e2b3c:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 278add22 on lago-he-node-ng-suite-4-2-host-0: systemctl stop vdsmd ovirt-ha-broker ovirt-ha-agent lago.ssh: DEBUG: Command 278add22 on lago-he-node-ng-suite-4-2-host-0 returned with 0 root: INFO: * Starting services... lago.ssh: DEBUG: start task:af03fd03-5b53-4480-89f6-5bb36ee4aa36:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:af03fd03-5b53-4480-89f6-5bb36ee4aa36:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 3124aa5c on lago-he-node-ng-suite-4-2-host-0: systemctl start vdsmd ovirt-ha-broker ovirt-ha-agent lago.ssh: DEBUG: Command 3124aa5c on lago-he-node-ng-suite-4-2-host-0 returned with 0 root: INFO: * Waiting for agent to be ready... lago.ssh: DEBUG: start task:f679ce56-0d10-4f46-b100-a1e336d7d54f:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:f679ce56-0d10-4f46-b100-a1e336d7d54f:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 3499986e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status lago.ssh: DEBUG: Command 3499986e on lago-he-node-ng-suite-4-2-host-0 returned with 1 lago.ssh: DEBUG: Command 3499986e on lago-he-node-ng-suite-4-2-host-0 output: The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable. lago.ssh: DEBUG: start task:bedcd442-f9c9-41a2-88fb-dd2cabbac11c:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:bedcd442-f9c9-41a2-88fb-dd2cabbac11c:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 3b9471a2 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status lago.ssh: DEBUG: Command 3b9471a2 on lago-he-node-ng-suite-4-2-host-0 returned with 1 lago.ssh: DEBUG: Command 3b9471a2 on lago-he-node-ng-suite-4-2-host-0 output: The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable. lago.ssh: DEBUG: start task:7417fd76-78ba-41b7-87b0-6083d59e95da:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:7417fd76-78ba-41b7-87b0-6083d59e95da:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 3e43e9a0 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status lago.ssh: DEBUG: Command 3e43e9a0 on lago-he-node-ng-suite-4-2-host-0 returned with 1 lago.ssh: DEBUG: Command 3e43e9a0 on lago-he-node-ng-suite-4-2-host-0 output: The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable. lago.ssh: DEBUG: start task:6b7af916-fc70-4770-ba37-a0d8c8df1a8c:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:6b7af916-fc70-4770-ba37-a0d8c8df1a8c:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 40f50a80 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status lago.ssh: DEBUG: Command 40f50a80 on lago-he-node-ng-suite-4-2-host-0 returned with 1 lago.ssh: DEBUG: Command 40f50a80 on lago-he-node-ng-suite-4-2-host-0 output: The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable. lago.ssh: DEBUG: start task:e39ae262-0351-4a14-8600-81ce96de8ad8:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:e39ae262-0351-4a14-8600-81ce96de8ad8:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 43aff550 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status lago.ssh: DEBUG: Command 43aff550 on lago-he-node-ng-suite-4-2-host-0 returned with 1 lago.ssh: DEBUG: Command 43aff550 on lago-he-node-ng-suite-4-2-host-0 output: The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable. lago.ssh: DEBUG: start task:b8b09ab3-a843-4591-880a-4e1eaa4e4948:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:b8b09ab3-a843-4591-880a-4e1eaa4e4948:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 46571770 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status lago.ssh: DEBUG: Command 46571770 on lago-he-node-ng-suite-4-2-host-0 returned with 1 lago.ssh: DEBUG: Command 46571770 on lago-he-node-ng-suite-4-2-host-0 output: The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable. lago.ssh: DEBUG: start task:9ab6204c-2b64-4e80-86cf-19c1a4b74af8:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:9ab6204c-2b64-4e80-86cf-19c1a4b74af8:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 4905ca5c on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status lago.ssh: DEBUG: Command 4905ca5c on lago-he-node-ng-suite-4-2-host-0 returned with 1 lago.ssh: DEBUG: Command 4905ca5c on lago-he-node-ng-suite-4-2-host-0 output: The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable. lago.ssh: DEBUG: start task:9b25c69b-0bf2-4e55-b4f7-e2dda7067c49:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:9b25c69b-0bf2-4e55-b4f7-e2dda7067c49:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 4bb6bfcc on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status lago.ssh: DEBUG: Command 4bb6bfcc on lago-he-node-ng-suite-4-2-host-0 returned with 1 lago.ssh: DEBUG: Command 4bb6bfcc on lago-he-node-ng-suite-4-2-host-0 output: The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable. lago.ssh: DEBUG: start task:9feb9a9f-a76c-4e3a-8ece-7c6f5c81563d:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:9feb9a9f-a76c-4e3a-8ece-7c6f5c81563d:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 4e74bfb6 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status lago.ssh: DEBUG: Command 4e74bfb6 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 4e74bfb6 on lago-he-node-ng-suite-4-2-host-0 output: !! Cluster is in GLOBAL MAINTENANCE mode !! --== Host 1 status ==-- conf_on_shared_storage : True Status up-to-date : True Hostname : lago-he-node-ng-suite-4-2-host-0 Host ID : 1 Engine status : {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Down"} Score : 0 stopped : False Local maintenance : False crc32 : c3a8eba9 local_conf_timestamp : 3337 Host timestamp : 3337 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=3337 (Sat Oct 6 09:29:17 2018) host-id=1 score=0 vm_conf_refresh_time=3337 (Sat Oct 6 09:29:18 2018) conf_on_shared_storage=True maintenance=False state=ReinitializeFSM stopped=False --== Host 2 status ==-- conf_on_shared_storage : True Status up-to-date : False Hostname : lago-he-node-ng-suite-4-2-host-1 Host ID : 2 Engine status : unknown stale-data Score : 3400 stopped : False Local maintenance : False crc32 : 92b64b11 local_conf_timestamp : 3334 Host timestamp : 3334 Extra metadata (valid at timestamp): metadata_parse_version=1 metadata_feature_version=1 timestamp=3334 (Sat Oct 6 09:29:14 2018) host-id=2 score=3400 vm_conf_refresh_time=3334 (Sat Oct 6 09:29:14 2018) conf_on_shared_storage=True maintenance=False state=GlobalMaintenance stopped=False !! Cluster is in GLOBAL MAINTENANCE mode !! root: INFO: * Agent is ready. root: INFO: * Starting VM... lago.ssh: DEBUG: start task:4e7794c3-69f8-4438-afda-e7fcc7c6b284:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:4e7794c3-69f8-4438-afda-e7fcc7c6b284:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 4f87dbea on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-start lago.ssh: DEBUG: Command 4f87dbea on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 4f87dbea on lago-he-node-ng-suite-4-2-host-0 output: VM exists and is down, cleaning up and restarting root: INFO: * Command succeeded root: INFO: * Waiting for VM to be UP... lago.ssh: DEBUG: start task:c226a693-a5bf-42ae-8336-2efcfe1b79df:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:c226a693-a5bf-42ae-8336-2efcfe1b79df:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 5179238c on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 5179238c on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 5179238c on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3337 (Sat Oct 6 09:29:17 2018)\nhost-id=1\nscore=0\nvm_conf_refresh_time=3337 (Sat Oct 6 09:29:18 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=ReinitializeFSM\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Down"}, "score": 0, "stopped": false, "maintenance": false, "crc32": "c3a8eba9", "local_conf_timestamp": 3337, "host-ts": 3337}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3334 (Sat Oct 6 09:29:14 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3334 (Sat Oct 6 09:29:14 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "92b64b11", "local_conf_timestamp": 3334, "host-ts": 3334}, "global_maintenance": true} lago.ssh: DEBUG: start task:f43c6d74-777f-4ce0-9645-45bf215705b5:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:f43c6d74-777f-4ce0-9645-45bf215705b5:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 5889f340 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 5889f340 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 5889f340 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3357 (Sat Oct 6 09:29:37 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3357 (Sat Oct 6 09:29:37 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "efdf572f", "local_conf_timestamp": 3357, "host-ts": 3357}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3354 (Sat Oct 6 09:29:34 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3354 (Sat Oct 6 09:29:34 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "8b20490f", "local_conf_timestamp": 3354, "host-ts": 3354}, "global_maintenance": true} root: INFO: * VM is UP. root: INFO: * Waiting for engine to start... lago.ssh: DEBUG: start task:e2fdfced-2ef7-4c69-9d88-6f4a824a3ce7:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:e2fdfced-2ef7-4c69-9d88-6f4a824a3ce7:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 599c03d6 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 599c03d6 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 599c03d6 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3357 (Sat Oct 6 09:29:37 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3357 (Sat Oct 6 09:29:37 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "efdf572f", "local_conf_timestamp": 3357, "host-ts": 3357}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3354 (Sat Oct 6 09:29:34 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3354 (Sat Oct 6 09:29:34 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "8b20490f", "local_conf_timestamp": 3354, "host-ts": 3354}, "global_maintenance": true} lago.ssh: DEBUG: start task:b6e1e8d4-cd09-4e6e-bb01-dd90e6bf1f0f:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:b6e1e8d4-cd09-4e6e-bb01-dd90e6bf1f0f:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 60f8d9ba on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 60f8d9ba on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 60f8d9ba on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3367 (Sat Oct 6 09:29:47 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3367 (Sat Oct 6 09:29:47 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "af2b10ab", "local_conf_timestamp": 3367, "host-ts": 3367}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3364 (Sat Oct 6 09:29:44 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3364 (Sat Oct 6 09:29:44 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "87eb4800", "local_conf_timestamp": 3364, "host-ts": 3364}, "global_maintenance": true} lago.ssh: DEBUG: start task:2ba187ca-4d15-4830-b47f-31fd2039a6c9:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:2ba187ca-4d15-4830-b47f-31fd2039a6c9:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 641750d6 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 641750d6 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 641750d6 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3377 (Sat Oct 6 09:29:58 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3378 (Sat Oct 6 09:29:58 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "00383046", "local_conf_timestamp": 3378, "host-ts": 3377}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3374 (Sat Oct 6 09:29:54 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3374 (Sat Oct 6 09:29:54 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "83adb705", "local_conf_timestamp": 3374, "host-ts": 3374}, "global_maintenance": true} lago.ssh: DEBUG: start task:9a7facd3-b79b-4d7d-8d2c-b7fbdab7339b:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:9a7facd3-b79b-4d7d-8d2c-b7fbdab7339b:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 6737a216 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 6737a216 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 6737a216 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3377 (Sat Oct 6 09:29:58 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3378 (Sat Oct 6 09:29:58 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "00383046", "local_conf_timestamp": 3378, "host-ts": 3377}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3374 (Sat Oct 6 09:29:54 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3374 (Sat Oct 6 09:29:54 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "83adb705", "local_conf_timestamp": 3374, "host-ts": 3374}, "global_maintenance": true} lago.ssh: DEBUG: start task:d0a5cf4e-015e-462c-a666-eb7ed63aa597:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:d0a5cf4e-015e-462c-a666-eb7ed63aa597:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 6a5cf630 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 6a5cf630 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 6a5cf630 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3387 (Sat Oct 6 09:30:07 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3387 (Sat Oct 6 09:30:07 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "08d37202", "local_conf_timestamp": 3387, "host-ts": 3387}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3384 (Sat Oct 6 09:30:04 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3384 (Sat Oct 6 09:30:04 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "bc4ab236", "local_conf_timestamp": 3384, "host-ts": 3384}, "global_maintenance": true} lago.ssh: DEBUG: start task:8f5d407a-b6f9-41ac-994e-f35daabeea00:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:8f5d407a-b6f9-41ac-994e-f35daabeea00:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 6d99d3ea on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 6d99d3ea on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 6d99d3ea on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3387 (Sat Oct 6 09:30:07 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3387 (Sat Oct 6 09:30:07 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "08d37202", "local_conf_timestamp": 3387, "host-ts": 3387}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3384 (Sat Oct 6 09:30:04 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3384 (Sat Oct 6 09:30:04 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "bc4ab236", "local_conf_timestamp": 3384, "host-ts": 3384}, "global_maintenance": true} lago.ssh: DEBUG: start task:84bdb8e5-5053-42df-9e0c-16602f1c8b77:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:84bdb8e5-5053-42df-9e0c-16602f1c8b77:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 71082d6a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 71082d6a on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 71082d6a on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3397 (Sat Oct 6 09:30:17 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3398 (Sat Oct 6 09:30:18 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "115c818c", "local_conf_timestamp": 3398, "host-ts": 3397}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3394 (Sat Oct 6 09:30:14 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3394 (Sat Oct 6 09:30:14 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "b80c4d33", "local_conf_timestamp": 3394, "host-ts": 3394}, "global_maintenance": true} lago.ssh: DEBUG: start task:bc79cad1-a004-4743-888b-0e702b36a275:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:bc79cad1-a004-4743-888b-0e702b36a275:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 750dddec on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 750dddec on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 750dddec on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3407 (Sat Oct 6 09:30:27 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3407 (Sat Oct 6 09:30:28 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "512ff048", "local_conf_timestamp": 3407, "host-ts": 3407}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3404 (Sat Oct 6 09:30:23 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3404 (Sat Oct 6 09:30:24 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1405530f", "local_conf_timestamp": 3404, "host-ts": 3404}, "global_maintenance": true} lago.ssh: DEBUG: start task:63bb20ac-5a36-406e-be57-1075c035119c:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:63bb20ac-5a36-406e-be57-1075c035119c:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 794fe4f4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 794fe4f4 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 794fe4f4 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3407 (Sat Oct 6 09:30:27 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3407 (Sat Oct 6 09:30:28 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "512ff048", "local_conf_timestamp": 3407, "host-ts": 3407}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3404 (Sat Oct 6 09:30:23 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3404 (Sat Oct 6 09:30:24 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1405530f", "local_conf_timestamp": 3404, "host-ts": 3404}, "global_maintenance": true} lago.ssh: DEBUG: start task:c1557713-869d-4318-a036-fbdccd32c9bf:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:c1557713-869d-4318-a036-fbdccd32c9bf:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 7c750740 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 7c750740 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 7c750740 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3417 (Sat Oct 6 09:30:37 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3417 (Sat Oct 6 09:30:37 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "107a3a14", "local_conf_timestamp": 3417, "host-ts": 3417}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3414 (Sat Oct 6 09:30:34 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3414 (Sat Oct 6 09:30:34 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1043ac0a", "local_conf_timestamp": 3414, "host-ts": 3414}, "global_maintenance": true} lago.ssh: DEBUG: start task:d339c7c0-0ef6-47d0-b369-e2bc29b628bb:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:d339c7c0-0ef6-47d0-b369-e2bc29b628bb:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 7f940cdc on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 7f940cdc on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 7f940cdc on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3417 (Sat Oct 6 09:30:37 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3417 (Sat Oct 6 09:30:37 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "107a3a14", "local_conf_timestamp": 3417, "host-ts": 3417}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3414 (Sat Oct 6 09:30:34 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3414 (Sat Oct 6 09:30:34 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1043ac0a", "local_conf_timestamp": 3414, "host-ts": 3414}, "global_maintenance": true} lago.ssh: DEBUG: start task:4a03aa6b-296c-40ba-b112-31133d8b32eb:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:4a03aa6b-296c-40ba-b112-31133d8b32eb:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 82ea743e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 82ea743e on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 82ea743e on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3427 (Sat Oct 6 09:30:47 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3427 (Sat Oct 6 09:30:48 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d38464f0", "local_conf_timestamp": 3427, "host-ts": 3427}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3424 (Sat Oct 6 09:30:44 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3424 (Sat Oct 6 09:30:44 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1c88ad05", "local_conf_timestamp": 3424, "host-ts": 3424}, "global_maintenance": true} lago.ssh: DEBUG: start task:4a7239e6-0641-4061-a9e1-705ac71fbdc5:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:4a7239e6-0641-4061-a9e1-705ac71fbdc5:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 8659fdc4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 8659fdc4 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 8659fdc4 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3427 (Sat Oct 6 09:30:47 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3427 (Sat Oct 6 09:30:48 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d38464f0", "local_conf_timestamp": 3427, "host-ts": 3427}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3424 (Sat Oct 6 09:30:44 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3424 (Sat Oct 6 09:30:44 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1c88ad05", "local_conf_timestamp": 3424, "host-ts": 3424}, "global_maintenance": true} lago.ssh: DEBUG: start task:675b186f-f933-4c72-a848-464ceed95677:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:675b186f-f933-4c72-a848-464ceed95677:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 89779624 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 89779624 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 89779624 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3437 (Sat Oct 6 09:30:58 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3438 (Sat Oct 6 09:30:58 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "026eb33d", "local_conf_timestamp": 3438, "host-ts": 3437}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3434 (Sat Oct 6 09:30:54 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3434 (Sat Oct 6 09:30:54 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "18ce5200", "local_conf_timestamp": 3434, "host-ts": 3434}, "global_maintenance": true} lago.ssh: DEBUG: start task:500ffb6c-4171-49ac-8f11-636dc32057cd:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:500ffb6c-4171-49ac-8f11-636dc32057cd:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 8cd7ec92 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 8cd7ec92 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 8cd7ec92 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3437 (Sat Oct 6 09:30:58 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3438 (Sat Oct 6 09:30:58 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "026eb33d", "local_conf_timestamp": 3438, "host-ts": 3437}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3434 (Sat Oct 6 09:30:54 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3434 (Sat Oct 6 09:30:54 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "18ce5200", "local_conf_timestamp": 3434, "host-ts": 3434}, "global_maintenance": true} lago.ssh: DEBUG: start task:7aeb35e4-0e21-425b-9e0b-db3eb92cfb09:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:7aeb35e4-0e21-425b-9e0b-db3eb92cfb09:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 903e89d6 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 903e89d6 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 903e89d6 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3447 (Sat Oct 6 09:31:07 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3447 (Sat Oct 6 09:31:08 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "8f09df79", "local_conf_timestamp": 3447, "host-ts": 3447}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3444 (Sat Oct 6 09:31:04 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3445 (Sat Oct 6 09:31:04 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "72199f8d", "local_conf_timestamp": 3445, "host-ts": 3444}, "global_maintenance": true} lago.ssh: DEBUG: start task:0fe988ff-f225-4c70-b20e-d4941d8bda17:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:0fe988ff-f225-4c70-b20e-d4941d8bda17:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 945ceb20 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 945ceb20 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 945ceb20 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3457 (Sat Oct 6 09:31:17 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3457 (Sat Oct 6 09:31:17 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ce5c1525", "local_conf_timestamp": 3457, "host-ts": 3457}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3454 (Sat Oct 6 09:31:14 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3454 (Sat Oct 6 09:31:14 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "0158501e", "local_conf_timestamp": 3454, "host-ts": 3454}, "global_maintenance": true} lago.ssh: DEBUG: start task:b5c9a918-654d-4ce7-be1e-286bfc26cf34:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:b5c9a918-654d-4ce7-be1e-286bfc26cf34:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 97c6f864 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 97c6f864 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 97c6f864 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3457 (Sat Oct 6 09:31:17 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3457 (Sat Oct 6 09:31:17 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ce5c1525", "local_conf_timestamp": 3457, "host-ts": 3457}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3454 (Sat Oct 6 09:31:14 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3454 (Sat Oct 6 09:31:14 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "0158501e", "local_conf_timestamp": 3454, "host-ts": 3454}, "global_maintenance": true} lago.ssh: DEBUG: start task:49e56adb-d202-4589-8416-8164b2821d27:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:49e56adb-d202-4589-8416-8164b2821d27:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 9bc30e08 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 9bc30e08 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 9bc30e08 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3467 (Sat Oct 6 09:31:27 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3467 (Sat Oct 6 09:31:27 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "1a228395", "local_conf_timestamp": 3467, "host-ts": 3467}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3464 (Sat Oct 6 09:31:24 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3464 (Sat Oct 6 09:31:24 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "0d935111", "local_conf_timestamp": 3464, "host-ts": 3464}, "global_maintenance": true} lago.ssh: DEBUG: start task:df31cbc7-427e-4dee-a82a-688d53a69dc2:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:df31cbc7-427e-4dee-a82a-688d53a69dc2:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running a04dac08 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command a04dac08 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command a04dac08 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3477 (Sat Oct 6 09:31:37 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3478 (Sat Oct 6 09:31:38 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "cbc85458", "local_conf_timestamp": 3478, "host-ts": 3477}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3474 (Sat Oct 6 09:31:34 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3474 (Sat Oct 6 09:31:34 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "09d5ae14", "local_conf_timestamp": 3474, "host-ts": 3474}, "global_maintenance": true} lago.ssh: DEBUG: start task:3153a30a-4831-4644-9f65-e62022c548dd:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:3153a30a-4831-4644-9f65-e62022c548dd:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running a4da2986 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command a4da2986 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command a4da2986 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3487 (Sat Oct 6 09:31:47 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3487 (Sat Oct 6 09:31:47 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "2192603f", "local_conf_timestamp": 3487, "host-ts": 3487}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3484 (Sat Oct 6 09:31:44 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3484 (Sat Oct 6 09:31:44 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "3632ab27", "local_conf_timestamp": 3484, "host-ts": 3484}, "global_maintenance": true} lago.ssh: DEBUG: start task:170e0571-d024-4b7f-b125-7679ee0ba1a6:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:170e0571-d024-4b7f-b125-7679ee0ba1a6:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running a9d7f242 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command a9d7f242 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command a9d7f242 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3497 (Sat Oct 6 09:31:57 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3497 (Sat Oct 6 09:31:57 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "60c7aa63", "local_conf_timestamp": 3497, "host-ts": 3497}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3494 (Sat Oct 6 09:31:53 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3494 (Sat Oct 6 09:31:54 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "32745422", "local_conf_timestamp": 3494, "host-ts": 3494}, "global_maintenance": true} lago.ssh: DEBUG: start task:2ef1ee03-ac81-4271-869a-1cd1a44c9d7a:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:2ef1ee03-ac81-4271-869a-1cd1a44c9d7a:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running b008e694 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command b008e694 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command b008e694 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3507 (Sat Oct 6 09:32:07 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3508 (Sat Oct 6 09:32:08 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "b48c6d98", "local_conf_timestamp": 3508, "host-ts": 3507}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3504 (Sat Oct 6 09:32:04 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3504 (Sat Oct 6 09:32:04 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "646be17f", "local_conf_timestamp": 3504, "host-ts": 3504}, "global_maintenance": true} lago.ssh: DEBUG: start task:19008521-0503-40ee-8f84-3f1e3c125d34:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:19008521-0503-40ee-8f84-3f1e3c125d34:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running b5616ada on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command b5616ada on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command b5616ada on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3507 (Sat Oct 6 09:32:07 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3508 (Sat Oct 6 09:32:08 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "b48c6d98", "local_conf_timestamp": 3508, "host-ts": 3507}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3504 (Sat Oct 6 09:32:04 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3504 (Sat Oct 6 09:32:04 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-st ovirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7f368539e410> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py", line 187, in <lambda> for k, v in _get_he_status(host).items() File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py", line 128, in _get_he_status raise RuntimeError('could not parse JSON: %s' % ret.out) RuntimeError: could not parse JSON: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3507 (Sat Oct 6 09:32:07 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3508 (Sat Oct 6 09:32:08 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "b48c6d98", "local_conf_timestamp": 3508, "host-ts": 3507}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3504 (Sat Oct 6 09:32:04 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3504 (Sat Oct 6 09:32:04 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-st --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py", line 53, in restart_he_vm _wait_for_engine_health(host) File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py", line 185, in _wait_for_engine_health testlib.assert_true_within_long(lambda: any( File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py", line 187, in <lambda> for k, v in _get_he_status(host).items() File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py", line 128, in _get_he_status raise RuntimeError('could not parse JSON: %s' % ret.out) 'could not parse JSON: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3507 (Sat Oct 6 09:32:07 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3508 (Sat Oct 6 09:32:08 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "b48c6d98", "local_conf_timestamp": 3508, "host-ts": 3507}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3504 (Sat Oct 6 09:32:04 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3504 (Sat Oct 6 09:32:04 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-st\n-------------------- >> begin captured logging << --------------------\nlago.ssh: DEBUG: start task:c44edc62-5de4-46f8-a4da-91d5e60d519b:Get ssh client for lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:c44edc62-5de4-46f8-a4da-91d5e60d519b:Get ssh client for lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 1858959c on lago-he-node-ng-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 1858959c on lago-he-node-ng-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 1858959c on lago-he-node-ng-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3243 (Sat Oct 6 09:27:43 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3243 (Sat Oct 6 09:27:43 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "3a5d8fcb", "local_conf_timestamp": 3243, "host-ts": 3243}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3244 (Sat Oct 6 09:27:44 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3244 (Sat Oct 6 09:27:44 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ff08047a", "local_conf_timestamp": 3244, "host-ts": 3244}, "global_maintenance": true}\n\nroot: INFO: * Shutting down HE VM on host: lago-he-node-ng-suite-4-2-host-0\nlago.ssh: DEBUG: start task:8bec795e-0a02-4d83-8919-c388a99e8798:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:8bec795e-0a02-4d83-8919-c388a99e8798:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 1963e130 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-shutdown\nlago.ssh: DEBUG: Command 1963e130 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot: INFO: * Command succeeded\nroot: INFO: * Waiting for VM to be down...\nlago.ssh: DEBUG: start task:1a13a370-162f-4fe7-bc9c-e0c25121d6a6:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:1a13a370-162f-4fe7-bc9c-e0c25121d6a6:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 1bd51f4c on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 1bd51f4c on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 1bd51f4c on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3253 (Sat Oct 6 09:27:53 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3253 (Sat Oct 6 09:27:53 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e63acff4", "local_conf_timestamp": 3253, "host-ts": 3253}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3244 (Sat Oct 6 09:27:44 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3244 (Sat Oct 6 09:27:44 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ff08047a", "local_conf_timestamp": 3244, "host-ts": 3244}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:5765e57d-473f-433f-98e4-03da4b175b7e:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:5765e57d-473f-433f-98e4-03da4b175b7e:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 237c9734 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 237c9734 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 237c9734 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3263 (Sat Oct 6 09:28:04 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3264 (Sat Oct 6 09:28:04 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Powering down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "202ccf78", "local_conf_timestamp": 3264, "host-ts": 3263}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3254 (Sat Oct 6 09:27:54 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3254 (Sat Oct 6 09:27:54 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "fb4efb7f", "local_conf_timestamp": 3254, "host-ts": 3254}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:0e1588f5-b1e6-4a80-b9d7-597f9ff9d718:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:0e1588f5-b1e6-4a80-b9d7-597f9ff9d718:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 265cd4be on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 265cd4be on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 265cd4be on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3273 (Sat Oct 6 09:28:13 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3273 (Sat Oct 6 09:28:14 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down_unexpected", "detail": "Down"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "486617f5", "local_conf_timestamp": 3273, "host-ts": 3273}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3264 (Sat Oct 6 09:28:04 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3264 (Sat Oct 6 09:28:04 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "f785fa70", "local_conf_timestamp": 3264, "host-ts": 3264}, "global_maintenance": true}\n\nroot: INFO: * VM is down.\nroot: INFO: * Stopping services...\nlago.ssh: DEBUG: start task:0db6b7b8-6e36-40bf-9739-f392e79e2b3c:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:0db6b7b8-6e36-40bf-9739-f392e79e2b3c:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 278add22 on lago-he-node-ng-suite-4-2-host-0: systemctl stop vdsmd ovirt-ha-broker ovirt-ha-agent\nlago.ssh: DEBUG: Command 278add22 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot: INFO: * Starting services...\nlago.ssh: DEBUG: start task:af03fd03-5b53-4480-89f6-5bb36ee4aa36:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:af03fd03-5b53-4480-89f6-5bb36ee4aa36:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 3124aa5c on lago-he-node-ng-suite-4-2-host-0: systemctl start vdsmd ovirt-ha-broker ovirt-ha-agent\nlago.ssh: DEBUG: Command 3124aa5c on lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot: INFO: * Waiting for agent to be ready...\nlago.ssh: DEBUG: start task:f679ce56-0d10-4f46-b100-a1e336d7d54f:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:f679ce56-0d10-4f46-b100-a1e336d7d54f:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 3499986e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 3499986e on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command 3499986e on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:bedcd442-f9c9-41a2-88fb-dd2cabbac11c:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:bedcd442-f9c9-41a2-88fb-dd2cabbac11c:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 3b9471a2 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 3b9471a2 on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command 3b9471a2 on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:7417fd76-78ba-41b7-87b0-6083d59e95da:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:7417fd76-78ba-41b7-87b0-6083d59e95da:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 3e43e9a0 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 3e43e9a0 on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command 3e43e9a0 on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:6b7af916-fc70-4770-ba37-a0d8c8df1a8c:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:6b7af916-fc70-4770-ba37-a0d8c8df1a8c:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 40f50a80 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 40f50a80 on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command 40f50a80 on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:e39ae262-0351-4a14-8600-81ce96de8ad8:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:e39ae262-0351-4a14-8600-81ce96de8ad8:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 43aff550 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 43aff550 on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command 43aff550 on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:b8b09ab3-a843-4591-880a-4e1eaa4e4948:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:b8b09ab3-a843-4591-880a-4e1eaa4e4948:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 46571770 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 46571770 on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command 46571770 on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:9ab6204c-2b64-4e80-86cf-19c1a4b74af8:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:9ab6204c-2b64-4e80-86cf-19c1a4b74af8:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 4905ca5c on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 4905ca5c on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command 4905ca5c on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:9b25c69b-0bf2-4e55-b4f7-e2dda7067c49:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:9b25c69b-0bf2-4e55-b4f7-e2dda7067c49:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 4bb6bfcc on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 4bb6bfcc on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command 4bb6bfcc on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable.\n\nlago.ssh: DEBUG: start task:9feb9a9f-a76c-4e3a-8ece-7c6f5c81563d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:9feb9a9f-a76c-4e3a-8ece-7c6f5c81563d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 4e74bfb6 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command 4e74bfb6 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 4e74bfb6 on lago-he-node-ng-suite-4-2-host-0 output:\n \n\n!! Cluster is in GLOBAL MAINTENANCE mode !!\n\n\n\n--== Host 1 status ==--\n\nconf_on_shared_storage : True\nStatus up-to-date : True\nHostname : lago-he-node-ng-suite-4-2-host-0\nHost ID : 1\nEngine status : {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Down"}\nScore : 0\nstopped : False\nLocal maintenance : False\ncrc32 : c3a8eba9\nlocal_conf_timestamp : 3337\nHost timestamp : 3337\nExtra metadata (valid at timestamp):\n\tmetadata_parse_version=1\n\tmetadata_feature_version=1\n\ttimestamp=3337 (Sat Oct 6 09:29:17 2018)\n\thost-id=1\n\tscore=0\n\tvm_conf_refresh_time=3337 (Sat Oct 6 09:29:18 2018)\n\tconf_on_shared_storage=True\n\tmaintenance=False\n\tstate=ReinitializeFSM\n\tstopped=False\n\n\n--== Host 2 status ==--\n\nconf_on_shared_storage : True\nStatus up-to-date : False\nHostname : lago-he-node-ng-suite-4-2-host-1\nHost ID : 2\nEngine status : unknown stale-data\nScore : 3400\nstopped : False\nLocal maintenance : False\ncrc32 : 92b64b11\nlocal_conf_timestamp : 3334\nHost timestamp : 3334\nExtra metadata (valid at timestamp):\n\tmetadata_parse_version=1\n\tmetadata_feature_version=1\n\ttimestamp=3334 (Sat Oct 6 09:29:14 2018)\n\thost-id=2\n\tscore=3400\n\tvm_conf_refresh_time=3334 (Sat Oct 6 09:29:14 2018)\n\tconf_on_shared_storage=True\n\tmaintenance=False\n\tstate=GlobalMaintenance\n\tstopped=False\n\n\n!! Cluster is in GLOBAL MAINTENANCE mode !!\n\n\nroot: INFO: * Agent is ready.\nroot: INFO: * Starting VM...\nlago.ssh: DEBUG: start task:4e7794c3-69f8-4438-afda-e7fcc7c6b284:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:4e7794c3-69f8-4438-afda-e7fcc7c6b284:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 4f87dbea on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-start\nlago.ssh: DEBUG: Command 4f87dbea on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 4f87dbea on lago-he-node-ng-suite-4-2-host-0 output:\n VM exists and is down, cleaning up and restarting\n\nroot: INFO: * Command succeeded\nroot: INFO: * Waiting for VM to be UP...\nlago.ssh: DEBUG: start task:c226a693-a5bf-42ae-8336-2efcfe1b79df:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:c226a693-a5bf-42ae-8336-2efcfe1b79df:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 5179238c on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 5179238c on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 5179238c on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3337 (Sat Oct 6 09:29:17 2018)\\nhost-id=1\\nscore=0\\nvm_conf_refresh_time=3337 (Sat Oct 6 09:29:18 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=ReinitializeFSM\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Down"}, "score": 0, "stopped": false, "maintenance": false, "crc32": "c3a8eba9", "local_conf_timestamp": 3337, "host-ts": 3337}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3334 (Sat Oct 6 09:29:14 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3334 (Sat Oct 6 09:29:14 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "92b64b11", "local_conf_timestamp": 3334, "host-ts": 3334}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:f43c6d74-777f-4ce0-9645-45bf215705b5:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:f43c6d74-777f-4ce0-9645-45bf215705b5:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 5889f340 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 5889f340 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 5889f340 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3357 (Sat Oct 6 09:29:37 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3357 (Sat Oct 6 09:29:37 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "efdf572f", "local_conf_timestamp": 3357, "host-ts": 3357}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3354 (Sat Oct 6 09:29:34 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3354 (Sat Oct 6 09:29:34 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "8b20490f", "local_conf_timestamp": 3354, "host-ts": 3354}, "global_maintenance": true}\n\nroot: INFO: * VM is UP.\nroot: INFO: * Waiting for engine to start...\nlago.ssh: DEBUG: start task:e2fdfced-2ef7-4c69-9d88-6f4a824a3ce7:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:e2fdfced-2ef7-4c69-9d88-6f4a824a3ce7:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 599c03d6 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 599c03d6 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 599c03d6 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3357 (Sat Oct 6 09:29:37 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3357 (Sat Oct 6 09:29:37 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "efdf572f", "local_conf_timestamp": 3357, "host-ts": 3357}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3354 (Sat Oct 6 09:29:34 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3354 (Sat Oct 6 09:29:34 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "8b20490f", "local_conf_timestamp": 3354, "host-ts": 3354}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:b6e1e8d4-cd09-4e6e-bb01-dd90e6bf1f0f:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:b6e1e8d4-cd09-4e6e-bb01-dd90e6bf1f0f:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 60f8d9ba on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 60f8d9ba on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 60f8d9ba on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3367 (Sat Oct 6 09:29:47 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3367 (Sat Oct 6 09:29:47 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "af2b10ab", "local_conf_timestamp": 3367, "host-ts": 3367}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3364 (Sat Oct 6 09:29:44 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3364 (Sat Oct 6 09:29:44 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "87eb4800", "local_conf_timestamp": 3364, "host-ts": 3364}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:2ba187ca-4d15-4830-b47f-31fd2039a6c9:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:2ba187ca-4d15-4830-b47f-31fd2039a6c9:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 641750d6 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 641750d6 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 641750d6 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3377 (Sat Oct 6 09:29:58 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3378 (Sat Oct 6 09:29:58 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "00383046", "local_conf_timestamp": 3378, "host-ts": 3377}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3374 (Sat Oct 6 09:29:54 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3374 (Sat Oct 6 09:29:54 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "83adb705", "local_conf_timestamp": 3374, "host-ts": 3374}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:9a7facd3-b79b-4d7d-8d2c-b7fbdab7339b:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:9a7facd3-b79b-4d7d-8d2c-b7fbdab7339b:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 6737a216 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6737a216 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 6737a216 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3377 (Sat Oct 6 09:29:58 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3378 (Sat Oct 6 09:29:58 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "00383046", "local_conf_timestamp": 3378, "host-ts": 3377}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3374 (Sat Oct 6 09:29:54 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3374 (Sat Oct 6 09:29:54 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "83adb705", "local_conf_timestamp": 3374, "host-ts": 3374}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:d0a5cf4e-015e-462c-a666-eb7ed63aa597:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:d0a5cf4e-015e-462c-a666-eb7ed63aa597:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 6a5cf630 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6a5cf630 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 6a5cf630 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3387 (Sat Oct 6 09:30:07 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3387 (Sat Oct 6 09:30:07 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "08d37202", "local_conf_timestamp": 3387, "host-ts": 3387}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3384 (Sat Oct 6 09:30:04 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3384 (Sat Oct 6 09:30:04 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "bc4ab236", "local_conf_timestamp": 3384, "host-ts": 3384}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:8f5d407a-b6f9-41ac-994e-f35daabeea00:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:8f5d407a-b6f9-41ac-994e-f35daabeea00:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 6d99d3ea on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6d99d3ea on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 6d99d3ea on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3387 (Sat Oct 6 09:30:07 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3387 (Sat Oct 6 09:30:07 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "up", "detail": "Powering up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "08d37202", "local_conf_timestamp": 3387, "host-ts": 3387}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3384 (Sat Oct 6 09:30:04 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3384 (Sat Oct 6 09:30:04 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "bc4ab236", "local_conf_timestamp": 3384, "host-ts": 3384}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:84bdb8e5-5053-42df-9e0c-16602f1c8b77:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:84bdb8e5-5053-42df-9e0c-16602f1c8b77:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 71082d6a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 71082d6a on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 71082d6a on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3397 (Sat Oct 6 09:30:17 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3398 (Sat Oct 6 09:30:18 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "115c818c", "local_conf_timestamp": 3398, "host-ts": 3397}, "2": {"conf_on_shared_storage": true, "live-data": false, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3394 (Sat Oct 6 09:30:14 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3394 (Sat Oct 6 09:30:14 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "b80c4d33", "local_conf_timestamp": 3394, "host-ts": 3394}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:bc79cad1-a004-4743-888b-0e702b36a275:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:bc79cad1-a004-4743-888b-0e702b36a275:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 750dddec on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 750dddec on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 750dddec on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3407 (Sat Oct 6 09:30:27 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3407 (Sat Oct 6 09:30:28 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "512ff048", "local_conf_timestamp": 3407, "host-ts": 3407}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3404 (Sat Oct 6 09:30:23 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3404 (Sat Oct 6 09:30:24 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1405530f", "local_conf_timestamp": 3404, "host-ts": 3404}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:63bb20ac-5a36-406e-be57-1075c035119c:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:63bb20ac-5a36-406e-be57-1075c035119c:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 794fe4f4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 794fe4f4 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 794fe4f4 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3407 (Sat Oct 6 09:30:27 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3407 (Sat Oct 6 09:30:28 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "512ff048", "local_conf_timestamp": 3407, "host-ts": 3407}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3404 (Sat Oct 6 09:30:23 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3404 (Sat Oct 6 09:30:24 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1405530f", "local_conf_timestamp": 3404, "host-ts": 3404}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:c1557713-869d-4318-a036-fbdccd32c9bf:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:c1557713-869d-4318-a036-fbdccd32c9bf:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 7c750740 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 7c750740 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 7c750740 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3417 (Sat Oct 6 09:30:37 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3417 (Sat Oct 6 09:30:37 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "107a3a14", "local_conf_timestamp": 3417, "host-ts": 3417}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3414 (Sat Oct 6 09:30:34 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3414 (Sat Oct 6 09:30:34 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1043ac0a", "local_conf_timestamp": 3414, "host-ts": 3414}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:d339c7c0-0ef6-47d0-b369-e2bc29b628bb:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:d339c7c0-0ef6-47d0-b369-e2bc29b628bb:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 7f940cdc on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 7f940cdc on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 7f940cdc on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3417 (Sat Oct 6 09:30:37 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3417 (Sat Oct 6 09:30:37 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "107a3a14", "local_conf_timestamp": 3417, "host-ts": 3417}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3414 (Sat Oct 6 09:30:34 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3414 (Sat Oct 6 09:30:34 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1043ac0a", "local_conf_timestamp": 3414, "host-ts": 3414}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:4a03aa6b-296c-40ba-b112-31133d8b32eb:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:4a03aa6b-296c-40ba-b112-31133d8b32eb:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 82ea743e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 82ea743e on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 82ea743e on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3427 (Sat Oct 6 09:30:47 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3427 (Sat Oct 6 09:30:48 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d38464f0", "local_conf_timestamp": 3427, "host-ts": 3427}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3424 (Sat Oct 6 09:30:44 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3424 (Sat Oct 6 09:30:44 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1c88ad05", "local_conf_timestamp": 3424, "host-ts": 3424}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:4a7239e6-0641-4061-a9e1-705ac71fbdc5:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:4a7239e6-0641-4061-a9e1-705ac71fbdc5:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 8659fdc4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 8659fdc4 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 8659fdc4 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3427 (Sat Oct 6 09:30:47 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3427 (Sat Oct 6 09:30:48 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d38464f0", "local_conf_timestamp": 3427, "host-ts": 3427}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3424 (Sat Oct 6 09:30:44 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3424 (Sat Oct 6 09:30:44 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1c88ad05", "local_conf_timestamp": 3424, "host-ts": 3424}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:675b186f-f933-4c72-a848-464ceed95677:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:675b186f-f933-4c72-a848-464ceed95677:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 89779624 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 89779624 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 89779624 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3437 (Sat Oct 6 09:30:58 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3438 (Sat Oct 6 09:30:58 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "026eb33d", "local_conf_timestamp": 3438, "host-ts": 3437}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3434 (Sat Oct 6 09:30:54 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3434 (Sat Oct 6 09:30:54 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "18ce5200", "local_conf_timestamp": 3434, "host-ts": 3434}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:500ffb6c-4171-49ac-8f11-636dc32057cd:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:500ffb6c-4171-49ac-8f11-636dc32057cd:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 8cd7ec92 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 8cd7ec92 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 8cd7ec92 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3437 (Sat Oct 6 09:30:58 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3438 (Sat Oct 6 09:30:58 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "026eb33d", "local_conf_timestamp": 3438, "host-ts": 3437}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3434 (Sat Oct 6 09:30:54 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3434 (Sat Oct 6 09:30:54 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "18ce5200", "local_conf_timestamp": 3434, "host-ts": 3434}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:7aeb35e4-0e21-425b-9e0b-db3eb92cfb09:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:7aeb35e4-0e21-425b-9e0b-db3eb92cfb09:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 903e89d6 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 903e89d6 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 903e89d6 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3447 (Sat Oct 6 09:31:07 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3447 (Sat Oct 6 09:31:08 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "8f09df79", "local_conf_timestamp": 3447, "host-ts": 3447}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3444 (Sat Oct 6 09:31:04 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3445 (Sat Oct 6 09:31:04 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "72199f8d", "local_conf_timestamp": 3445, "host-ts": 3444}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:0fe988ff-f225-4c70-b20e-d4941d8bda17:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:0fe988ff-f225-4c70-b20e-d4941d8bda17:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 945ceb20 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 945ceb20 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 945ceb20 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3457 (Sat Oct 6 09:31:17 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3457 (Sat Oct 6 09:31:17 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ce5c1525", "local_conf_timestamp": 3457, "host-ts": 3457}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3454 (Sat Oct 6 09:31:14 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3454 (Sat Oct 6 09:31:14 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "0158501e", "local_conf_timestamp": 3454, "host-ts": 3454}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:b5c9a918-654d-4ce7-be1e-286bfc26cf34:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:b5c9a918-654d-4ce7-be1e-286bfc26cf34:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 97c6f864 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 97c6f864 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 97c6f864 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3457 (Sat Oct 6 09:31:17 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3457 (Sat Oct 6 09:31:17 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ce5c1525", "local_conf_timestamp": 3457, "host-ts": 3457}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3454 (Sat Oct 6 09:31:14 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3454 (Sat Oct 6 09:31:14 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "0158501e", "local_conf_timestamp": 3454, "host-ts": 3454}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:49e56adb-d202-4589-8416-8164b2821d27:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:49e56adb-d202-4589-8416-8164b2821d27:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 9bc30e08 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 9bc30e08 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 9bc30e08 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3467 (Sat Oct 6 09:31:27 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3467 (Sat Oct 6 09:31:27 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "1a228395", "local_conf_timestamp": 3467, "host-ts": 3467}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3464 (Sat Oct 6 09:31:24 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3464 (Sat Oct 6 09:31:24 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "0d935111", "local_conf_timestamp": 3464, "host-ts": 3464}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:df31cbc7-427e-4dee-a82a-688d53a69dc2:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:df31cbc7-427e-4dee-a82a-688d53a69dc2:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running a04dac08 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command a04dac08 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command a04dac08 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3477 (Sat Oct 6 09:31:37 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3478 (Sat Oct 6 09:31:38 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "cbc85458", "local_conf_timestamp": 3478, "host-ts": 3477}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3474 (Sat Oct 6 09:31:34 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3474 (Sat Oct 6 09:31:34 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "09d5ae14", "local_conf_timestamp": 3474, "host-ts": 3474}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:3153a30a-4831-4644-9f65-e62022c548dd:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:3153a30a-4831-4644-9f65-e62022c548dd:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running a4da2986 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command a4da2986 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command a4da2986 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3487 (Sat Oct 6 09:31:47 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3487 (Sat Oct 6 09:31:47 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "2192603f", "local_conf_timestamp": 3487, "host-ts": 3487}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3484 (Sat Oct 6 09:31:44 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3484 (Sat Oct 6 09:31:44 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "3632ab27", "local_conf_timestamp": 3484, "host-ts": 3484}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:170e0571-d024-4b7f-b125-7679ee0ba1a6:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:170e0571-d024-4b7f-b125-7679ee0ba1a6:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running a9d7f242 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command a9d7f242 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command a9d7f242 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3497 (Sat Oct 6 09:31:57 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3497 (Sat Oct 6 09:31:57 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "60c7aa63", "local_conf_timestamp": 3497, "host-ts": 3497}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3494 (Sat Oct 6 09:31:53 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3494 (Sat Oct 6 09:31:54 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "32745422", "local_conf_timestamp": 3494, "host-ts": 3494}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:2ef1ee03-ac81-4271-869a-1cd1a44c9d7a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:2ef1ee03-ac81-4271-869a-1cd1a44c9d7a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running b008e694 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command b008e694 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command b008e694 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3507 (Sat Oct 6 09:32:07 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3508 (Sat Oct 6 09:32:08 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "b48c6d98", "local_conf_timestamp": 3508, "host-ts": 3507}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3504 (Sat Oct 6 09:32:04 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3504 (Sat Oct 6 09:32:04 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "646be17f", "local_conf_timestamp": 3504, "host-ts": 3504}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:19008521-0503-40ee-8f84-3f1e3c125d34:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:19008521-0503-40ee-8f84-3f1e3c125d34:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running b5616ada on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command b5616ada on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command b5616ada on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3507 (Sat Oct 6 09:32:07 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3508 (Sat Oct 6 09:32:08 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "b48c6d98", "local_conf_timestamp": 3508, "host-ts": 3507}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3504 (Sat Oct 6 09:32:04 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3504 (Sat Oct 6 09:32:04 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-st\novirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7f368539e410>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py", line 187, in <lambda>\n for k, v in _get_he_status(host).items()\n File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py", line 128, in _get_he_status\n raise RuntimeError(\'could not parse JSON: %s\' % ret.out)\nRuntimeError: could not parse JSON: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3507 (Sat Oct 6 09:32:07 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3508 (Sat Oct 6 09:32:08 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "failed liveliness check", "health": "bad", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "b48c6d98", "local_conf_timestamp": 3508, "host-ts": 3507}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3504 (Sat Oct 6 09:32:04 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3504 (Sat Oct 6 09:32:04 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-st\n--------------------- >> end captured logging << ---------------------'