Project:
http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/
Build:
http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/370/
Build Number: 370
Build Status: Still Failing
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #347
[Dafna Ron] ovirt-4.2: block external links from running in ost
Changes for Build #348
[Dafna Ron] ovirt-4.2: block external links from running in ost
Changes for Build #349
[Dafna Ron] ovirt-4.2: block external links from running in ost
Changes for Build #350
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #351
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #352
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #353
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #354
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #355
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #356
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #357
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #358
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #359
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #360
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #361
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #362
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
[Sandro Bonazzola] ovirt-setup-lib: drop 3.6
[Sandro Bonazzola] ovirt-host: drop 3.6 and 4.1
Changes for Build #363
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #364
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #365
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
[Sandro Bonazzola] ovirt-reports: drop 3.6 jobs
[Sandro Bonazzola] ovirt-host-deploy: drop 3.6 jobs
Changes for Build #366
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #367
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #368
[Gal Ben Haim] Remove stale url to the internal repo
[Greg Sheremeta] add ovirt-web-ui to stdci v2
Changes for Build #369
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #370
[Gal Ben Haim] Remove stale url to the internal repo
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 008_restart_he_vm.restart_he_vm
Error Message:
143
-------------------- >> begin captured logging << --------------------
lago.ssh: DEBUG: start task:f00620a7-648c-4102-80bc-305dfc8df78e:Get ssh client for
lago-he-node-ng-suite-4-2-host-1:
lago.ssh: DEBUG: end task:f00620a7-648c-4102-80bc-305dfc8df78e:Get ssh client for
lago-he-node-ng-suite-4-2-host-1:
lago.ssh: DEBUG: Running aa8cf260 on lago-he-node-ng-suite-4-2-host-1: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command aa8cf260 on lago-he-node-ng-suite-4-2-host-1 returned with 0
lago.ssh: DEBUG: Command aa8cf260 on lago-he-node-ng-suite-4-2-host-1 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3242 (Thu Oct 4
09:41:15 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3242 (Thu Oct 4 09:41:15
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Up"}, "score": 3400,
"stopped": false, "maintenance": false, "crc32":
"8b107fe5", "local_conf_timestamp": 3242, "host-ts": 3242},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3246 (Thu Oct 4
09:41:18 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3246 (Thu Oct 4 09:41:18
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "1fcb2337",
"local_conf_timestamp": 3246, "host-ts": 3246},
"global_maintenance": true}
root: INFO: * Shutting down HE VM on host: lago-he-node-ng-suite-4-2-host-0
lago.ssh: DEBUG: start task:ec93ce68-9d74-4565-953a-955d1eb0e8d1:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:ec93ce68-9d74-4565-953a-955d1eb0e8d1:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running abab09a2 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-shutdown
lago.ssh: DEBUG: Command abab09a2 on lago-he-node-ng-suite-4-2-host-0 returned with 0
root: INFO: * Command succeeded
root: INFO: * Waiting for VM to be down...
lago.ssh: DEBUG: start task:637d3a75-934a-403b-915a-ac54ccf78e16:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:637d3a75-934a-403b-915a-ac54ccf78e16:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running ae5d3166 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command ae5d3166 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command ae5d3166 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3262 (Thu Oct 4
09:41:34 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3262 (Thu Oct 4 09:41:35
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Powering down"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "23914a5d",
"local_conf_timestamp": 3262, "host-ts": 3262}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3256 (Thu Oct 4
09:41:28 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3256 (Thu Oct 4 09:41:29
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "1b8ddc32",
"local_conf_timestamp": 3256, "host-ts": 3256},
"global_maintenance": true}
lago.ssh: DEBUG: start task:f3cc7ee7-b43b-46f1-b562-71fd5f30b603:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:f3cc7ee7-b43b-46f1-b562-71fd5f30b603:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running b614c996 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command b614c996 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command b614c996 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3272 (Thu Oct 4
09:41:45 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3272 (Thu Oct 4 09:41:45
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down_unexpected",
"detail": "Down"}, "score": 3000, "stopped":
false, "maintenance": false, "crc32": "b515bfa9",
"local_conf_timestamp": 3272, "host-ts": 3272}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3266 (Thu Oct 4
09:41:39 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3266 (Thu Oct 4 09:41:39
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "1746dd3d",
"local_conf_timestamp": 3266, "host-ts": 3266},
"global_maintenance": true}
root: INFO: * VM is down.
root: INFO: * Stopping services...
lago.ssh: DEBUG: start task:e3ace6d9-9908-46d5-99cc-941775ff753d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:e3ace6d9-9908-46d5-99cc-941775ff753d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running b71f7034 on lago-he-node-ng-suite-4-2-host-0: systemctl stop
vdsmd ovirt-ha-broker ovirt-ha-agent
lago.ssh: DEBUG: Command b71f7034 on lago-he-node-ng-suite-4-2-host-0 returned with 0
root: INFO: * Starting services...
lago.ssh: DEBUG: start task:06f7c3be-084f-41e8-9b7e-7fd8fd888104:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:06f7c3be-084f-41e8-9b7e-7fd8fd888104:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running c0e5d356 on lago-he-node-ng-suite-4-2-host-0: systemctl start
vdsmd ovirt-ha-broker ovirt-ha-agent
lago.ssh: DEBUG: Command c0e5d356 on lago-he-node-ng-suite-4-2-host-0 returned with 0
root: INFO: * Waiting for agent to be ready...
lago.ssh: DEBUG: start task:1be0a2bc-9f9b-41bc-a071-bfd9fdba671b:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:1be0a2bc-9f9b-41bc-a071-bfd9fdba671b:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running c44de510 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status
lago.ssh: DEBUG: Command c44de510 on lago-he-node-ng-suite-4-2-host-0 returned with 1
lago.ssh: DEBUG: Command c44de510 on lago-he-node-ng-suite-4-2-host-0 output:
The hosted engine configuration has not been retrieved from shared storage. Please ensure
that ovirt-ha-agent is running and the storage server is reachable.
lago.ssh: DEBUG: start task:373c4570-500d-4ce6-927b-bb6123864318:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:373c4570-500d-4ce6-927b-bb6123864318:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running cb39b75a on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status
lago.ssh: DEBUG: Command cb39b75a on lago-he-node-ng-suite-4-2-host-0 returned with 1
lago.ssh: DEBUG: Command cb39b75a on lago-he-node-ng-suite-4-2-host-0 output:
The hosted engine configuration has not been retrieved from shared storage. Please ensure
that ovirt-ha-agent is running and the storage server is reachable.
lago.ssh: DEBUG: start task:37a4e08d-5b8c-483b-933c-dce619e1dedc:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:37a4e08d-5b8c-483b-933c-dce619e1dedc:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running cdf4d326 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status
lago.ssh: DEBUG: Command cdf4d326 on lago-he-node-ng-suite-4-2-host-0 returned with 1
lago.ssh: DEBUG: Command cdf4d326 on lago-he-node-ng-suite-4-2-host-0 output:
The hosted engine configuration has not been retrieved from shared storage. Please ensure
that ovirt-ha-agent is running and the storage server is reachable.
lago.ssh: DEBUG: start task:d521aeb6-5fcf-47c2-9a71-9a780446b6f8:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:d521aeb6-5fcf-47c2-9a71-9a780446b6f8:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running d09c5e6e on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status
lago.ssh: DEBUG: Command d09c5e6e on lago-he-node-ng-suite-4-2-host-0 returned with 1
lago.ssh: DEBUG: Command d09c5e6e on lago-he-node-ng-suite-4-2-host-0 output:
The hosted engine configuration has not been retrieved from shared storage. Please ensure
that ovirt-ha-agent is running and the storage server is reachable.
lago.ssh: DEBUG: start task:b6cf3caa-8870-4f9c-b7aa-0efc0d342232:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:b6cf3caa-8870-4f9c-b7aa-0efc0d342232:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running d347692e on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status
lago.ssh: DEBUG: Command d347692e on lago-he-node-ng-suite-4-2-host-0 returned with 1
lago.ssh: DEBUG: Command d347692e on lago-he-node-ng-suite-4-2-host-0 output:
The hosted engine configuration has not been retrieved from shared storage. Please ensure
that ovirt-ha-agent is running and the storage server is reachable.
lago.ssh: DEBUG: start task:418cf9ef-1ff0-4e84-907a-d8413925b236:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:418cf9ef-1ff0-4e84-907a-d8413925b236:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running d5fb6a58 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status
lago.ssh: DEBUG: Command d5fb6a58 on lago-he-node-ng-suite-4-2-host-0 returned with 1
lago.ssh: DEBUG: Command d5fb6a58 on lago-he-node-ng-suite-4-2-host-0 output:
The hosted engine configuration has not been retrieved from shared storage. Please ensure
that ovirt-ha-agent is running and the storage server is reachable.
lago.ssh: DEBUG: start task:dbd2db9e-0adf-4215-bfaf-f2d71b8673dd:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:dbd2db9e-0adf-4215-bfaf-f2d71b8673dd:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running d8b69a56 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status
lago.ssh: DEBUG: Command d8b69a56 on lago-he-node-ng-suite-4-2-host-0 returned with 1
lago.ssh: DEBUG: Command d8b69a56 on lago-he-node-ng-suite-4-2-host-0 output:
The hosted engine configuration has not been retrieved from shared storage. Please ensure
that ovirt-ha-agent is running and the storage server is reachable.
lago.ssh: DEBUG: start task:9ca1ee48-a3eb-4211-8687-82c96b23ffc4:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:9ca1ee48-a3eb-4211-8687-82c96b23ffc4:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running db62bfdc on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status
lago.ssh: DEBUG: Command db62bfdc on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command db62bfdc on lago-he-node-ng-suite-4-2-host-0 output:
!! Cluster is in GLOBAL MAINTENANCE mode !!
--== Host 1 status ==--
conf_on_shared_storage : True
Status up-to-date : True
Hostname : lago-he-node-ng-suite-4-2-host-0
Host ID : 1
Engine status : {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Down"}
Score : 0
stopped : False
Local maintenance : False
crc32 : 5317f638
local_conf_timestamp : 3338
Host timestamp : 3337
Extra metadata (valid at timestamp):
metadata_parse_version=1
metadata_feature_version=1
timestamp=3337 (Thu Oct 4 09:42:50 2018)
host-id=1
score=0
vm_conf_refresh_time=3338 (Thu Oct 4 09:42:50 2018)
conf_on_shared_storage=True
maintenance=False
state=ReinitializeFSM
stopped=False
--== Host 2 status ==--
conf_on_shared_storage : True
Status up-to-date : False
Hostname : lago-he-node-ng-suite-4-2-host-1
Host ID : 2
Engine status : unknown stale-data
Score : 3400
stopped : False
Local maintenance : False
crc32 : 72756c5c
local_conf_timestamp : 3336
Host timestamp : 3336
Extra metadata (valid at timestamp):
metadata_parse_version=1
metadata_feature_version=1
timestamp=3336 (Thu Oct 4 09:42:48 2018)
host-id=2
score=3400
vm_conf_refresh_time=3336 (Thu Oct 4 09:42:48 2018)
conf_on_shared_storage=True
maintenance=False
state=GlobalMaintenance
stopped=False
!! Cluster is in GLOBAL MAINTENANCE mode !!
root: INFO: * Agent is ready.
root: INFO: * Starting VM...
lago.ssh: DEBUG: start task:256bf5d7-8dab-43b3-8663-aad3142b3931:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:256bf5d7-8dab-43b3-8663-aad3142b3931:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running dc6fdb58 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-start
lago.ssh: DEBUG: Command dc6fdb58 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command dc6fdb58 on lago-he-node-ng-suite-4-2-host-0 output:
VM exists and is down, cleaning up and restarting
root: INFO: * Command succeeded
root: INFO: * Waiting for VM to be UP...
lago.ssh: DEBUG: start task:81f8d6ed-81db-4fe1-bddd-4d14ae2fa5f2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:81f8d6ed-81db-4fe1-bddd-4d14ae2fa5f2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running ded02ba0 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command ded02ba0 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command ded02ba0 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3337 (Thu Oct 4
09:42:50 2018)\nhost-id=1\nscore=0\nvm_conf_refresh_time=3338 (Thu Oct 4 09:42:50
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=ReinitializeFSM\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Down"}, "score": 0, "stopped": false,
"maintenance": false, "crc32": "5317f638",
"local_conf_timestamp": 3338, "host-ts": 3337}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3336 (Thu Oct 4
09:42:48 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3336 (Thu Oct 4 09:42:48
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "72756c5c",
"local_conf_timestamp": 3336, "host-ts": 3336},
"global_maintenance": true}
lago.ssh: DEBUG: start task:59bc4945-9a1c-4406-b554-c17f80313d43:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:59bc4945-9a1c-4406-b554-c17f80313d43:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running e5fe607c on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command e5fe607c on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command e5fe607c on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3348 (Thu Oct 4
09:43:00 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3348 (Thu Oct 4 09:43:01
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "up", "detail":
"Powering up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "560c0311",
"local_conf_timestamp": 3348, "host-ts": 3348}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3346 (Thu Oct 4
09:42:58 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3346 (Thu Oct 4 09:42:59
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "6fa59147",
"local_conf_timestamp": 3346, "host-ts": 3346},
"global_maintenance": true}
root: INFO: * VM is UP.
root: INFO: * Waiting for engine to start...
lago.ssh: DEBUG: start task:42395fbb-6d4f-4700-9c2d-29b8f3c271b1:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:42395fbb-6d4f-4700-9c2d-29b8f3c271b1:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running e719f840 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command e719f840 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command e719f840 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3348 (Thu Oct 4
09:43:00 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3348 (Thu Oct 4 09:43:01
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "up", "detail":
"Powering up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "560c0311",
"local_conf_timestamp": 3348, "host-ts": 3348}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3346 (Thu Oct 4
09:42:58 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3346 (Thu Oct 4 09:42:59
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "6fa59147",
"local_conf_timestamp": 3346, "host-ts": 3346},
"global_maintenance": true}
lago.ssh: DEBUG: start task:a894e3bb-c156-448c-95e9-6a2401b193a5:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:a894e3bb-c156-448c-95e9-6a2401b193a5:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running ee354454 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command ee354454 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command ee354454 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3368 (Thu Oct 4
09:43:21 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3369 (Thu Oct 4 09:43:21
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "up", "detail":
"Powering up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "5e53497f",
"local_conf_timestamp": 3369, "host-ts": 3368}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3366 (Thu Oct 4
09:43:18 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3366 (Thu Oct 4 09:43:18
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "67286f4d",
"local_conf_timestamp": 3366, "host-ts": 3366},
"global_maintenance": true}
lago.ssh: DEBUG: start task:2335e608-378b-412d-8e55-fc56f15b0046:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:2335e608-378b-412d-8e55-fc56f15b0046:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running f1b67954 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command f1b67954 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command f1b67954 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3368 (Thu Oct 4
09:43:21 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3369 (Thu Oct 4 09:43:21
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "up", "detail":
"Powering up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "5e53497f",
"local_conf_timestamp": 3369, "host-ts": 3368}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3366 (Thu Oct 4
09:43:18 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3366 (Thu Oct 4 09:43:18
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "67286f4d",
"local_conf_timestamp": 3366, "host-ts": 3366},
"global_maintenance": true}
lago.ssh: DEBUG: start task:815ddfdf-c730-40b4-be0e-c849bacfc3b3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:815ddfdf-c730-40b4-be0e-c849bacfc3b3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running f4cf656a on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command f4cf656a on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command f4cf656a on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3378 (Thu Oct 4
09:43:30 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3378 (Thu Oct 4 09:43:31
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "up", "detail":
"Powering up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "16f84495",
"local_conf_timestamp": 3378, "host-ts": 3378}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3376 (Thu Oct 4
09:43:28 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3376 (Thu Oct 4 09:43:28
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "636e9048",
"local_conf_timestamp": 3376, "host-ts": 3376},
"global_maintenance": true}
lago.ssh: DEBUG: start task:ea2f18ce-d614-466c-81f5-b758f3605b54:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:ea2f18ce-d614-466c-81f5-b758f3605b54:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running f828d642 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command f828d642 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command f828d642 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3378 (Thu Oct 4
09:43:30 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3378 (Thu Oct 4 09:43:31
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "up", "detail":
"Powering up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "16f84495",
"local_conf_timestamp": 3378, "host-ts": 3378}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3376 (Thu Oct 4
09:43:28 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3376 (Thu Oct 4 09:43:28
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "636e9048",
"local_conf_timestamp": 3376, "host-ts": 3376},
"global_maintenance": true}
lago.ssh: DEBUG: start task:b6afb67b-a051-42dd-8b75-44020ce3ff10:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:b6afb67b-a051-42dd-8b75-44020ce3ff10:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running fb396cac on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command fb396cac on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command fb396cac on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3388 (Thu Oct 4
09:43:41 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3388 (Thu Oct 4 09:43:41
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "4fc508ca",
"local_conf_timestamp": 3388, "host-ts": 3388}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3386 (Thu Oct 4
09:43:38 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3386 (Thu Oct 4 09:43:39
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "5c89957b",
"local_conf_timestamp": 3386, "host-ts": 3386},
"global_maintenance": true}
lago.ssh: DEBUG: start task:20f3c2d4-19a5-40e0-8c97-7b3edb28aec3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:20f3c2d4-19a5-40e0-8c97-7b3edb28aec3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running fe524544 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command fe524544 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command fe524544 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3398 (Thu Oct 4
09:43:50 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3398 (Thu Oct 4 09:43:51
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "0e90c296",
"local_conf_timestamp": 3398, "host-ts": 3398}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3396 (Thu Oct 4
09:43:49 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3396 (Thu Oct 4 09:43:49
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "58cf6a7e",
"local_conf_timestamp": 3396, "host-ts": 3396},
"global_maintenance": true}
lago.ssh: DEBUG: start task:9f48c0ef-ebcc-4a54-80d4-4d3e243de50e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:9f48c0ef-ebcc-4a54-80d4-4d3e243de50e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 040a95b8 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 040a95b8 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 040a95b8 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3398 (Thu Oct 4
09:43:50 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3398 (Thu Oct 4 09:43:51
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "0e90c296",
"local_conf_timestamp": 3398, "host-ts": 3398}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3396 (Thu Oct 4
09:43:49 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3396 (Thu Oct 4 09:43:49
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "58cf6a7e",
"local_conf_timestamp": 3396, "host-ts": 3396},
"global_maintenance": true}
lago.ssh: DEBUG: start task:429cd235-4fe5-4c16-b3b0-11f9e55560ca:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:429cd235-4fe5-4c16-b3b0-11f9e55560ca:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 076c265e on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 076c265e on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 076c265e on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3408 (Thu Oct 4
09:44:01 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3409 (Thu Oct 4 09:44:01
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "a95b9e55",
"local_conf_timestamp": 3409, "host-ts": 3408}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3406 (Thu Oct 4
09:43:58 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3406 (Thu Oct 4 09:43:58
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "f4c67442",
"local_conf_timestamp": 3406, "host-ts": 3406},
"global_maintenance": true}
lago.ssh: DEBUG: start task:2a141c53-21e1-4165-b46e-1cf570715f1e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:2a141c53-21e1-4165-b46e-1cf570715f1e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 0b16e942 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 0b16e942 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 0b16e942 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3408 (Thu Oct 4
09:44:01 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3409 (Thu Oct 4 09:44:01
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "a95b9e55",
"local_conf_timestamp": 3409, "host-ts": 3408}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3406 (Thu Oct 4
09:43:58 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3406 (Thu Oct 4 09:43:58
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "f4c67442",
"local_conf_timestamp": 3406, "host-ts": 3406},
"global_maintenance": true}
lago.ssh: DEBUG: start task:e486af2a-d1e1-4b09-ae1b-4c295bac8e90:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:e486af2a-d1e1-4b09-ae1b-4c295bac8e90:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 0ec55f06 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 0ec55f06 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 0ec55f06 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3418 (Thu Oct 4
09:44:10 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3418 (Thu Oct 4 09:44:11
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "9f09649f",
"local_conf_timestamp": 3418, "host-ts": 3418}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3416 (Thu Oct 4
09:44:08 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3416 (Thu Oct 4 09:44:08
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "f0808b47",
"local_conf_timestamp": 3416, "host-ts": 3416},
"global_maintenance": true}
lago.ssh: DEBUG: start task:f3668d90-a0c3-4f38-b486-1f5efa7f7c88:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:f3668d90-a0c3-4f38-b486-1f5efa7f7c88:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 1261b772 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 1261b772 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 1261b772 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3428 (Thu Oct 4
09:44:21 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3429 (Thu Oct 4 09:44:21
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "2bf00aed",
"local_conf_timestamp": 3429, "host-ts": 3428}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3426 (Thu Oct 4
09:44:18 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3426 (Thu Oct 4 09:44:18
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "fc4b8a48",
"local_conf_timestamp": 3426, "host-ts": 3426},
"global_maintenance": true}
lago.ssh: DEBUG: start task:79c50e1a-ea5f-44e3-a92c-dbdad9dd29e2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:79c50e1a-ea5f-44e3-a92c-dbdad9dd29e2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 15ac24d0 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 15ac24d0 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 15ac24d0 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3428 (Thu Oct 4
09:44:21 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3429 (Thu Oct 4 09:44:21
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "2bf00aed",
"local_conf_timestamp": 3429, "host-ts": 3428}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3426 (Thu Oct 4
09:44:18 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3426 (Thu Oct 4 09:44:18
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "fc4b8a48",
"local_conf_timestamp": 3426, "host-ts": 3426},
"global_maintenance": true}
lago.ssh: DEBUG: start task:8ea9732b-ebbf-479e-a5f8-c33e269564f3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:8ea9732b-ebbf-479e-a5f8-c33e269564f3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 18eb5c92 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 18eb5c92 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 18eb5c92 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3438 (Thu Oct 4
09:44:31 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3438 (Thu Oct 4 09:44:31
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "1da2f027",
"local_conf_timestamp": 3438, "host-ts": 3438}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3436 (Thu Oct 4
09:44:29 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3436 (Thu Oct 4 09:44:29
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "f80d754d",
"local_conf_timestamp": 3436, "host-ts": 3436},
"global_maintenance": true}
lago.ssh: DEBUG: start task:f95ac86b-781d-4bc6-8a9a-a1a6224f395d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:f95ac86b-781d-4bc6-8a9a-a1a6224f395d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 1d18356a on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 1d18356a on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 1d18356a on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3448 (Thu Oct 4
09:44:41 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3448 (Thu Oct 4 09:44:41
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "007a81f2",
"local_conf_timestamp": 3448, "host-ts": 3448}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3446 (Thu Oct 4
09:44:39 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3447 (Thu Oct 4 09:44:39
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "92dab8c0",
"local_conf_timestamp": 3447, "host-ts": 3446},
"global_maintenance": true}
lago.ssh: DEBUG: start task:b0263ebe-2821-49e8-b0a7-2bfbb224a43b:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:b0263ebe-2821-49e8-b0a7-2bfbb224a43b:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 2179aae4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 2179aae4 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 2179aae4 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3448 (Thu Oct 4
09:44:41 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=3448 (Thu Oct 4 09:44:41
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "007a81f2",
"local_conf_timestamp": 3448, "host-ts": 3448}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3446 (Thu Oct 4
09:44:39 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3447 (Thu Oct 4 09:44:39
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "92dab8c0",
"local_conf_timestamp": 3447, "host-ts": 3446},
"global_maintenance": true}
lago.ssh: DEBUG: start task:456b4cca-60ce-4282-a4ea-a675560048e9:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:456b4cca-60ce-4282-a4ea-a675560048e9:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 253bc464 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 253bc464 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 253bc464 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3458 (Thu Oct 4
09:44:50 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3458 (Thu Oct 4 09:44:51
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "56af83fa",
"local_conf_timestamp": 3458, "host-ts": 3458}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3456 (Thu Oct 4
09:44:48 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3456 (Thu Oct 4 09:44:48
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "e19b7753",
"local_conf_timestamp": 3456, "host-ts": 3456},
"global_maintenance": true}
lago.ssh: DEBUG: start task:c63e8892-0155-4afc-a41d-f35f4eb94cd2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:c63e8892-0155-4afc-a41d-f35f4eb94cd2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 28fdd538 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 28fdd538 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 28fdd538 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3468 (Thu Oct 4
09:45:01 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3468 (Thu Oct 4 09:45:01
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "9551dd1e",
"local_conf_timestamp": 3468, "host-ts": 3468}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3466 (Thu Oct 4
09:44:58 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3466 (Thu Oct 4 09:44:58
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "ed50765c",
"local_conf_timestamp": 3466, "host-ts": 3466},
"global_maintenance": true}
lago.ssh: DEBUG: start task:7297b9f6-3b34-4367-a8f8-f6fdd2e32ded:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:7297b9f6-3b34-4367-a8f8-f6fdd2e32ded:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 2d8da9ca on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 2d8da9ca on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 2d8da9ca on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3468 (Thu Oct 4
09:45:01 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3468 (Thu Oct 4 09:45:01
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "9551dd1e",
"local_conf_timestamp": 3468, "host-ts": 3468}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3466 (Thu Oct 4
09:44:58 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3466 (Thu Oct 4 09:44:58
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "ed50765c",
"local_conf_timestamp": 3466, "host-ts": 3466},
"global_maintenance": true}
lago.ssh: DEBUG: start task:d56805c8-ada4-4e0d-b735-22b02bcd3e91:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:d56805c8-ada4-4e0d-b735-22b02bcd3e91:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 32f8f45a on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 32f8f45a on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 32f8f45a on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3478 (Thu Oct 4
09:45:10 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3478 (Thu Oct 4 09:45:11
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "d4041742",
"local_conf_timestamp": 3478, "host-ts": 3478}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3476 (Thu Oct 4
09:45:08 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3476 (Thu Oct 4 09:45:09
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "e9168959",
"local_conf_timestamp": 3476, "host-ts": 3476},
"global_maintenance": true}
lago.ssh: DEBUG: start task:f339adce-4d16-4509-a178-0f0c89fb9acc:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:f339adce-4d16-4509-a178-0f0c89fb9acc:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 36c35c4c on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 36c35c4c on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 36c35c4c on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3488 (Thu Oct 4
09:45:21 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3489 (Thu Oct 4 09:45:21
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "d9e60e22",
"local_conf_timestamp": 3489, "host-ts": 3488}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3486 (Thu Oct 4
09:45:19 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3486 (Thu Oct 4 09:45:19
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "d6f18c6a",
"local_conf_timestamp": 3486, "host-ts": 3486},
"global_maintenance": true}
lago.ssh: DEBUG: start task:108b90d6-a84d-4089-8f0f-c5f017828dea:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:108b90d6-a84d-4089-8f0f-c5f017828dea:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 3b44df52 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command 3b44df52 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command 3b44df52 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3498 (Thu Oct 4
09:45:31 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3498 (Thu Oct 4 09:45:31
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "efb4f4e8",
"local_conf_timestamp": 3498, "host-ts": 3498}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3496 (Thu Oct 4
09:45:28 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3496 (Thu Oct 4 09:45:28
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "d2b7736f",
"local_conf_timestamp": 3496, "host-ts": 3496},
"global_maintenance": true}
lago.ssh: DEBUG: start task:705dfd9b-7751-4274-a837-69b6bc0c3228:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:705dfd9b-7751-4274-a837-69b6bc0c3228:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running 3f92ff80 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
cli: DEBUG: signal 15 was caught
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in
wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in
wrapper
return func(get_test_prefix(), *args, **kwargs)
File
"/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py",
line 53, in restart_he_vm
_wait_for_engine_health(host)
File
"/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py",
line 185, in _wait_for_engine_health
testlib.assert_true_within_long(lambda: any(
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in
assert_true_within_long
assert_equals_within_long(func, True, allowed_exceptions)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in
assert_equals_within_long
func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in
assert_equals_within
res = func()
File
"/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py",
line 187, in <lambda>
for k, v in _get_he_status(host).items()
File
"/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/008_restart_he_vm.py",
line 122, in _get_he_status
ret = host.ssh(["hosted-engine", "--vm-status",
"--json"])
File "/usr/lib/python2.7/site-packages/lago/plugins/vm.py", line 529, in ssh
password=self._spec.get('ssh-password'),
File "/usr/lib/python2.7/site-packages/lago/ssh.py", line 69, in ssh
'stderr': None
File "/usr/lib/python2.7/site-packages/lago/ssh.py", line 247, in
drain_ssh_channel
0.1,
File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in
exit_handler
sys.exit(128 + signum)
'143\n-------------------- >> begin captured logging <<
--------------------\nlago.ssh: DEBUG: start task:f00620a7-648c-4102-80bc-305dfc8df78e:Get
ssh client for lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: end
task:f00620a7-648c-4102-80bc-305dfc8df78e:Get ssh client for
lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: Running aa8cf260 on
lago-he-node-ng-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command aa8cf260 on lago-he-node-ng-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG:
Command aa8cf260 on lago-he-node-ng-suite-4-2-host-1 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3242 (Thu Oct 4
09:41:15 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3242 (Thu Oct 4 09:41:15
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Up"}, "score": 3400,
"stopped": false, "maintenance": false, "crc32":
"8b107fe5", "local_conf_timestamp": 3242, "host-ts": 3242},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3246 (Thu Oct 4
09:41:18 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3246 (Thu Oct 4 09:41:18
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "1fcb2337",
"local_conf_timestamp": 3246, "host-ts": 3246},
"global_maintenance": true}\n\nroot: INFO: * Shutting down HE VM on host:
lago-he-node-ng-suite-4-2-host-0\nlago.ssh: DEBUG: start
task:ec93ce68-9d74-4565-953a-955d1eb0e8d1:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:ec93ce68-9d74-4565-953a-955d1eb0e8d1:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running abab09a2 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-shutdown\nlago.ssh: DEBUG: Command
abab09a2 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot: INFO: * Command
succeeded\nroot: INFO: * Waiting for VM to be down...\nlago.ssh: DEBUG: start
task:637d3a75-934a-403b-915a-ac54ccf78e16:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:637d3a75-934a-403b-915a-ac54ccf78e16:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ae5d3166 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command ae5d3166 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command ae5d3166 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3262 (Thu Oct 4
09:41:34 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3262 (Thu Oct 4 09:41:35
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Powering down"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "23914a5d",
"local_conf_timestamp": 3262, "host-ts": 3262}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3256 (Thu Oct 4
09:41:28 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3256 (Thu Oct 4 09:41:29
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "1b8ddc32",
"local_conf_timestamp": 3256, "host-ts": 3256},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:f3cc7ee7-b43b-46f1-b562-71fd5f30b603:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:f3cc7ee7-b43b-46f1-b562-71fd5f30b603:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running b614c996 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command b614c996 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command b614c996 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3272 (Thu Oct 4
09:41:45 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3272 (Thu Oct 4 09:41:45
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down_unexpected",
"detail": "Down"}, "score": 3000, "stopped":
false, "maintenance": false, "crc32": "b515bfa9",
"local_conf_timestamp": 3272, "host-ts": 3272}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3266 (Thu Oct 4
09:41:39 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3266 (Thu Oct 4 09:41:39
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "1746dd3d",
"local_conf_timestamp": 3266, "host-ts": 3266},
"global_maintenance": true}\n\nroot: INFO: * VM is down.\nroot: INFO: *
Stopping services...\nlago.ssh: DEBUG: start task:e3ace6d9-9908-46d5-99cc-941775ff753d:Get
ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:e3ace6d9-9908-46d5-99cc-941775ff753d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running b71f7034 on
lago-he-node-ng-suite-4-2-host-0: systemctl stop vdsmd ovirt-ha-broker
ovirt-ha-agent\nlago.ssh: DEBUG: Command b71f7034 on lago-he-node-ng-suite-4-2-host-0
returned with 0\nroot: INFO: * Starting services...\nlago.ssh: DEBUG: start
task:06f7c3be-084f-41e8-9b7e-7fd8fd888104:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:06f7c3be-084f-41e8-9b7e-7fd8fd888104:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running c0e5d356 on
lago-he-node-ng-suite-4-2-host-0: systemctl start vdsmd ovirt-ha-broker
ovirt-ha-agent\nlago.ssh: DEBUG: Command c0e5d356 on lago-he-node-ng-suite-4-2-host-0
returned with 0\nroot: INFO: * Waiting for agent to be ready...\nlago.ssh: DEBUG:
start task:1be0a2bc-9f9b-41bc-a071-bfd9fdba671b:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:1be0a2bc-9f9b-41bc-a071-bfd9fdba671b:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running c44de510 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command
c44de510 on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command
c44de510 on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has
not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and
the storage server is reachable.\n\nlago.ssh: DEBUG: start
task:373c4570-500d-4ce6-927b-bb6123864318:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:373c4570-500d-4ce6-927b-bb6123864318:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running cb39b75a on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command
cb39b75a on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command
cb39b75a on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has
not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and
the storage server is reachable.\n\nlago.ssh: DEBUG: start
task:37a4e08d-5b8c-483b-933c-dce619e1dedc:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:37a4e08d-5b8c-483b-933c-dce619e1dedc:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running cdf4d326 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command
cdf4d326 on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command
cdf4d326 on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has
not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and
the storage server is reachable.\n\nlago.ssh: DEBUG: start
task:d521aeb6-5fcf-47c2-9a71-9a780446b6f8:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:d521aeb6-5fcf-47c2-9a71-9a780446b6f8:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running d09c5e6e on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command
d09c5e6e on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command
d09c5e6e on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has
not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and
the storage server is reachable.\n\nlago.ssh: DEBUG: start
task:b6cf3caa-8870-4f9c-b7aa-0efc0d342232:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:b6cf3caa-8870-4f9c-b7aa-0efc0d342232:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running d347692e on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command
d347692e on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command
d347692e on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has
not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and
the storage server is reachable.\n\nlago.ssh: DEBUG: start
task:418cf9ef-1ff0-4e84-907a-d8413925b236:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:418cf9ef-1ff0-4e84-907a-d8413925b236:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running d5fb6a58 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command
d5fb6a58 on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command
d5fb6a58 on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has
not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and
the storage server is reachable.\n\nlago.ssh: DEBUG: start
task:dbd2db9e-0adf-4215-bfaf-f2d71b8673dd:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:dbd2db9e-0adf-4215-bfaf-f2d71b8673dd:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running d8b69a56 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command
d8b69a56 on lago-he-node-ng-suite-4-2-host-0 returned with 1\nlago.ssh: DEBUG: Command
d8b69a56 on lago-he-node-ng-suite-4-2-host-0 output:\n The hosted engine configuration has
not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and
the storage server is reachable.\n\nlago.ssh: DEBUG: start
task:9ca1ee48-a3eb-4211-8687-82c96b23ffc4:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:9ca1ee48-a3eb-4211-8687-82c96b23ffc4:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running db62bfdc on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status\nlago.ssh: DEBUG: Command
db62bfdc on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command
db62bfdc on lago-he-node-ng-suite-4-2-host-0 output:\n \n\n!! Cluster is in GLOBAL
MAINTENANCE mode !!\n\n\n\n--== Host 1 status ==--\n\nconf_on_shared_storage :
True\nStatus up-to-date : True\nHostname :
lago-he-node-ng-suite-4-2-host-0\nHost ID : 1\nEngine status
: {"reason": "bad vm status", "health":
"bad", "vm": "down", "detail":
"Down"}\nScore : 0\nstopped
: False\nLocal maintenance : False\ncrc32
: 5317f638\nlocal_conf_timestamp : 3338\nHost timestamp
: 3337\nExtra metadata (valid at
timestamp):\n\tmetadata_parse_version=1\n\tmetadata_feature_version=1\n\ttimestamp=3337
(Thu Oct 4 09:42:50 2018)\n\thost-id=1\n\tscore=0\n\tvm_conf_refresh_time=3338 (Thu Oct
4 09:42:50
2018)\n\tconf_on_shared_storage=True\n\tmaintenance=False\n\tstate=ReinitializeFSM\n\tstopped=False\n\n\n--==
Host 2 status ==--\n\nconf_on_shared_storage : True\nStatus up-to-date
: False\nHostname :
lago-he-node-ng-suite-4-2-host-1\nHost ID : 2\nEngine status
: unknown stale-data\nScore : 3400\nstopped
: False\nLocal maintenance : False\ncrc32
: 72756c5c\nlocal_conf_timestamp : 3336\nHost
timestamp : 3336\nExtra metadata (valid at
timestamp):\n\tmetadata_parse_version=1\n\tmetadata_feature_version=1\n\ttimestamp=3336
(Thu Oct 4 09:42:48 2018)\n\thost-id=2\n\tscore=3400\n\tvm_conf_refresh_time=3336 (Thu
Oct 4 09:42:48
2018)\n\tconf_on_shared_storage=True\n\tmaintenance=False\n\tstate=GlobalMaintenance\n\tstopped=False\n\n\n!!
Cluster is in GLOBAL MAINTENANCE mode !!\n\n\nroot: INFO: * Agent is ready.\nroot:
INFO: * Starting VM...\nlago.ssh: DEBUG: start
task:256bf5d7-8dab-43b3-8663-aad3142b3931:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:256bf5d7-8dab-43b3-8663-aad3142b3931:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running dc6fdb58 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-start\nlago.ssh: DEBUG: Command
dc6fdb58 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command
dc6fdb58 on lago-he-node-ng-suite-4-2-host-0 output:\n VM exists and is down, cleaning up
and restarting\n\nroot: INFO: * Command succeeded\nroot: INFO: * Waiting for VM to
be UP...\nlago.ssh: DEBUG: start task:81f8d6ed-81db-4fe1-bddd-4d14ae2fa5f2:Get ssh client
for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:81f8d6ed-81db-4fe1-bddd-4d14ae2fa5f2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ded02ba0 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command ded02ba0 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command ded02ba0 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3337 (Thu Oct 4
09:42:50 2018)\\nhost-id=1\\nscore=0\\nvm_conf_refresh_time=3338 (Thu Oct 4 09:42:50
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=ReinitializeFSM\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Down"}, "score": 0, "stopped": false,
"maintenance": false, "crc32": "5317f638",
"local_conf_timestamp": 3338, "host-ts": 3337}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3336 (Thu Oct 4
09:42:48 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3336 (Thu Oct 4 09:42:48
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "72756c5c",
"local_conf_timestamp": 3336, "host-ts": 3336},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:59bc4945-9a1c-4406-b554-c17f80313d43:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:59bc4945-9a1c-4406-b554-c17f80313d43:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running e5fe607c on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command e5fe607c on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command e5fe607c on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3348 (Thu Oct 4
09:43:00 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3348 (Thu Oct 4 09:43:01
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "up", "detail":
"Powering up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "560c0311",
"local_conf_timestamp": 3348, "host-ts": 3348}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3346 (Thu Oct 4
09:42:58 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3346 (Thu Oct 4 09:42:59
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "6fa59147",
"local_conf_timestamp": 3346, "host-ts": 3346},
"global_maintenance": true}\n\nroot: INFO: * VM is UP.\nroot: INFO: *
Waiting for engine to start...\nlago.ssh: DEBUG: start
task:42395fbb-6d4f-4700-9c2d-29b8f3c271b1:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:42395fbb-6d4f-4700-9c2d-29b8f3c271b1:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running e719f840 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command e719f840 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command e719f840 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3348 (Thu Oct 4
09:43:00 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3348 (Thu Oct 4 09:43:01
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "up", "detail":
"Powering up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "560c0311",
"local_conf_timestamp": 3348, "host-ts": 3348}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3346 (Thu Oct 4
09:42:58 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3346 (Thu Oct 4 09:42:59
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "6fa59147",
"local_conf_timestamp": 3346, "host-ts": 3346},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:a894e3bb-c156-448c-95e9-6a2401b193a5:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:a894e3bb-c156-448c-95e9-6a2401b193a5:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ee354454 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command ee354454 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command ee354454 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3368 (Thu Oct 4
09:43:21 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3369 (Thu Oct 4 09:43:21
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "up", "detail":
"Powering up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "5e53497f",
"local_conf_timestamp": 3369, "host-ts": 3368}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3366 (Thu Oct 4
09:43:18 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3366 (Thu Oct 4 09:43:18
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "67286f4d",
"local_conf_timestamp": 3366, "host-ts": 3366},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:2335e608-378b-412d-8e55-fc56f15b0046:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:2335e608-378b-412d-8e55-fc56f15b0046:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running f1b67954 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command f1b67954 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command f1b67954 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3368 (Thu Oct 4
09:43:21 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3369 (Thu Oct 4 09:43:21
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "up", "detail":
"Powering up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "5e53497f",
"local_conf_timestamp": 3369, "host-ts": 3368}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3366 (Thu Oct 4
09:43:18 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3366 (Thu Oct 4 09:43:18
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "67286f4d",
"local_conf_timestamp": 3366, "host-ts": 3366},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:815ddfdf-c730-40b4-be0e-c849bacfc3b3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:815ddfdf-c730-40b4-be0e-c849bacfc3b3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running f4cf656a on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command f4cf656a on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command f4cf656a on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3378 (Thu Oct 4
09:43:30 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3378 (Thu Oct 4 09:43:31
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "up", "detail":
"Powering up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "16f84495",
"local_conf_timestamp": 3378, "host-ts": 3378}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3376 (Thu Oct 4
09:43:28 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3376 (Thu Oct 4 09:43:28
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "636e9048",
"local_conf_timestamp": 3376, "host-ts": 3376},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:ea2f18ce-d614-466c-81f5-b758f3605b54:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:ea2f18ce-d614-466c-81f5-b758f3605b54:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running f828d642 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command f828d642 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command f828d642 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3378 (Thu Oct 4
09:43:30 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3378 (Thu Oct 4 09:43:31
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "up", "detail":
"Powering up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "16f84495",
"local_conf_timestamp": 3378, "host-ts": 3378}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3376 (Thu Oct 4
09:43:28 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3376 (Thu Oct 4 09:43:28
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "636e9048",
"local_conf_timestamp": 3376, "host-ts": 3376},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:b6afb67b-a051-42dd-8b75-44020ce3ff10:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:b6afb67b-a051-42dd-8b75-44020ce3ff10:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running fb396cac on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command fb396cac on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command fb396cac on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3388 (Thu Oct 4
09:43:41 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3388 (Thu Oct 4 09:43:41
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "4fc508ca",
"local_conf_timestamp": 3388, "host-ts": 3388}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3386 (Thu Oct 4
09:43:38 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3386 (Thu Oct 4 09:43:39
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "5c89957b",
"local_conf_timestamp": 3386, "host-ts": 3386},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:20f3c2d4-19a5-40e0-8c97-7b3edb28aec3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:20f3c2d4-19a5-40e0-8c97-7b3edb28aec3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running fe524544 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command fe524544 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command fe524544 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3398 (Thu Oct 4
09:43:50 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3398 (Thu Oct 4 09:43:51
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "0e90c296",
"local_conf_timestamp": 3398, "host-ts": 3398}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3396 (Thu Oct 4
09:43:49 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3396 (Thu Oct 4 09:43:49
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "58cf6a7e",
"local_conf_timestamp": 3396, "host-ts": 3396},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:9f48c0ef-ebcc-4a54-80d4-4d3e243de50e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:9f48c0ef-ebcc-4a54-80d4-4d3e243de50e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 040a95b8 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 040a95b8 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 040a95b8 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3398 (Thu Oct 4
09:43:50 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3398 (Thu Oct 4 09:43:51
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "0e90c296",
"local_conf_timestamp": 3398, "host-ts": 3398}, "2":
{"conf_on_shared_storage": true, "live-data": false,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3396 (Thu Oct 4
09:43:49 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3396 (Thu Oct 4 09:43:49
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "58cf6a7e",
"local_conf_timestamp": 3396, "host-ts": 3396},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:429cd235-4fe5-4c16-b3b0-11f9e55560ca:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:429cd235-4fe5-4c16-b3b0-11f9e55560ca:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 076c265e on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 076c265e on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 076c265e on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3408 (Thu Oct 4
09:44:01 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3409 (Thu Oct 4 09:44:01
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "a95b9e55",
"local_conf_timestamp": 3409, "host-ts": 3408}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3406 (Thu Oct 4
09:43:58 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3406 (Thu Oct 4 09:43:58
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "f4c67442",
"local_conf_timestamp": 3406, "host-ts": 3406},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:2a141c53-21e1-4165-b46e-1cf570715f1e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:2a141c53-21e1-4165-b46e-1cf570715f1e:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 0b16e942 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 0b16e942 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 0b16e942 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3408 (Thu Oct 4
09:44:01 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3409 (Thu Oct 4 09:44:01
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "a95b9e55",
"local_conf_timestamp": 3409, "host-ts": 3408}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3406 (Thu Oct 4
09:43:58 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3406 (Thu Oct 4 09:43:58
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "f4c67442",
"local_conf_timestamp": 3406, "host-ts": 3406},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:e486af2a-d1e1-4b09-ae1b-4c295bac8e90:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:e486af2a-d1e1-4b09-ae1b-4c295bac8e90:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 0ec55f06 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 0ec55f06 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 0ec55f06 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3418 (Thu Oct 4
09:44:10 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3418 (Thu Oct 4 09:44:11
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "9f09649f",
"local_conf_timestamp": 3418, "host-ts": 3418}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3416 (Thu Oct 4
09:44:08 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3416 (Thu Oct 4 09:44:08
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "f0808b47",
"local_conf_timestamp": 3416, "host-ts": 3416},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:f3668d90-a0c3-4f38-b486-1f5efa7f7c88:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:f3668d90-a0c3-4f38-b486-1f5efa7f7c88:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 1261b772 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 1261b772 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 1261b772 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3428 (Thu Oct 4
09:44:21 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3429 (Thu Oct 4 09:44:21
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "2bf00aed",
"local_conf_timestamp": 3429, "host-ts": 3428}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3426 (Thu Oct 4
09:44:18 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3426 (Thu Oct 4 09:44:18
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "fc4b8a48",
"local_conf_timestamp": 3426, "host-ts": 3426},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:79c50e1a-ea5f-44e3-a92c-dbdad9dd29e2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:79c50e1a-ea5f-44e3-a92c-dbdad9dd29e2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 15ac24d0 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 15ac24d0 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 15ac24d0 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3428 (Thu Oct 4
09:44:21 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3429 (Thu Oct 4 09:44:21
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "2bf00aed",
"local_conf_timestamp": 3429, "host-ts": 3428}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3426 (Thu Oct 4
09:44:18 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3426 (Thu Oct 4 09:44:18
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "fc4b8a48",
"local_conf_timestamp": 3426, "host-ts": 3426},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:8ea9732b-ebbf-479e-a5f8-c33e269564f3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:8ea9732b-ebbf-479e-a5f8-c33e269564f3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 18eb5c92 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 18eb5c92 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 18eb5c92 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3438 (Thu Oct 4
09:44:31 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3438 (Thu Oct 4 09:44:31
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "1da2f027",
"local_conf_timestamp": 3438, "host-ts": 3438}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3436 (Thu Oct 4
09:44:29 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3436 (Thu Oct 4 09:44:29
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "f80d754d",
"local_conf_timestamp": 3436, "host-ts": 3436},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:f95ac86b-781d-4bc6-8a9a-a1a6224f395d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:f95ac86b-781d-4bc6-8a9a-a1a6224f395d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 1d18356a on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 1d18356a on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 1d18356a on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3448 (Thu Oct 4
09:44:41 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3448 (Thu Oct 4 09:44:41
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "007a81f2",
"local_conf_timestamp": 3448, "host-ts": 3448}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3446 (Thu Oct 4
09:44:39 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3447 (Thu Oct 4 09:44:39
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "92dab8c0",
"local_conf_timestamp": 3447, "host-ts": 3446},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:b0263ebe-2821-49e8-b0a7-2bfbb224a43b:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:b0263ebe-2821-49e8-b0a7-2bfbb224a43b:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 2179aae4 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 2179aae4 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 2179aae4 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3448 (Thu Oct 4
09:44:41 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=3448 (Thu Oct 4 09:44:41
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "007a81f2",
"local_conf_timestamp": 3448, "host-ts": 3448}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3446 (Thu Oct 4
09:44:39 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3447 (Thu Oct 4 09:44:39
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "92dab8c0",
"local_conf_timestamp": 3447, "host-ts": 3446},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:456b4cca-60ce-4282-a4ea-a675560048e9:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:456b4cca-60ce-4282-a4ea-a675560048e9:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 253bc464 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 253bc464 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 253bc464 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3458 (Thu Oct 4
09:44:50 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3458 (Thu Oct 4 09:44:51
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "56af83fa",
"local_conf_timestamp": 3458, "host-ts": 3458}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3456 (Thu Oct 4
09:44:48 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3456 (Thu Oct 4 09:44:48
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "e19b7753",
"local_conf_timestamp": 3456, "host-ts": 3456},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:c63e8892-0155-4afc-a41d-f35f4eb94cd2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:c63e8892-0155-4afc-a41d-f35f4eb94cd2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 28fdd538 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 28fdd538 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 28fdd538 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3468 (Thu Oct 4
09:45:01 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3468 (Thu Oct 4 09:45:01
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "9551dd1e",
"local_conf_timestamp": 3468, "host-ts": 3468}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3466 (Thu Oct 4
09:44:58 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3466 (Thu Oct 4 09:44:58
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "ed50765c",
"local_conf_timestamp": 3466, "host-ts": 3466},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:7297b9f6-3b34-4367-a8f8-f6fdd2e32ded:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:7297b9f6-3b34-4367-a8f8-f6fdd2e32ded:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 2d8da9ca on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 2d8da9ca on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 2d8da9ca on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3468 (Thu Oct 4
09:45:01 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3468 (Thu Oct 4 09:45:01
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "9551dd1e",
"local_conf_timestamp": 3468, "host-ts": 3468}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3466 (Thu Oct 4
09:44:58 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3466 (Thu Oct 4 09:44:58
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "ed50765c",
"local_conf_timestamp": 3466, "host-ts": 3466},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:d56805c8-ada4-4e0d-b735-22b02bcd3e91:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:d56805c8-ada4-4e0d-b735-22b02bcd3e91:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 32f8f45a on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 32f8f45a on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 32f8f45a on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3478 (Thu Oct 4
09:45:10 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3478 (Thu Oct 4 09:45:11
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "d4041742",
"local_conf_timestamp": 3478, "host-ts": 3478}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3476 (Thu Oct 4
09:45:08 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3476 (Thu Oct 4 09:45:09
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "e9168959",
"local_conf_timestamp": 3476, "host-ts": 3476},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:f339adce-4d16-4509-a178-0f0c89fb9acc:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:f339adce-4d16-4509-a178-0f0c89fb9acc:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 36c35c4c on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 36c35c4c on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 36c35c4c on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3488 (Thu Oct 4
09:45:21 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3489 (Thu Oct 4 09:45:21
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "d9e60e22",
"local_conf_timestamp": 3489, "host-ts": 3488}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3486 (Thu Oct 4
09:45:19 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3486 (Thu Oct 4 09:45:19
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "d6f18c6a",
"local_conf_timestamp": 3486, "host-ts": 3486},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:108b90d6-a84d-4089-8f0f-c5f017828dea:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:108b90d6-a84d-4089-8f0f-c5f017828dea:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 3b44df52 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command 3b44df52 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command 3b44df52 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3498 (Thu Oct 4
09:45:31 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3498 (Thu Oct 4 09:45:31
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "failed liveliness check",
"health": "bad", "vm": "up", "detail":
"Up"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "efb4f4e8",
"local_conf_timestamp": 3498, "host-ts": 3498}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3496 (Thu Oct 4
09:45:28 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3496 (Thu Oct 4 09:45:28
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "d2b7736f",
"local_conf_timestamp": 3496, "host-ts": 3496},
"global_maintenance": true}\n\nlago.ssh: DEBUG: start
task:705dfd9b-7751-4274-a837-69b6bc0c3228:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:705dfd9b-7751-4274-a837-69b6bc0c3228:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 3f92ff80 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\ncli: DEBUG: signal 15
was caught\n--------------------- >> end captured logging <<
---------------------'