Project:
http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/
Build:
http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/378/
Build Number: 378
Build Status: Still Failing
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #348
[Dafna Ron] ovirt-4.2: block external links from running in ost
Changes for Build #349
[Dafna Ron] ovirt-4.2: block external links from running in ost
Changes for Build #350
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #351
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #352
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #353
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #354
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #355
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #356
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #357
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #358
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #359
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #360
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #361
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #362
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
[Sandro Bonazzola] ovirt-setup-lib: drop 3.6
[Sandro Bonazzola] ovirt-host: drop 3.6 and 4.1
Changes for Build #363
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #364
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #365
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
[Sandro Bonazzola] ovirt-reports: drop 3.6 jobs
[Sandro Bonazzola] ovirt-host-deploy: drop 3.6 jobs
Changes for Build #366
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #367
[Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync
config"
Changes for Build #368
[Gal Ben Haim] Remove stale url to the internal repo
[Greg Sheremeta] add ovirt-web-ui to stdci v2
Changes for Build #369
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #370
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #371
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #372
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #373
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #374
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #375
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #376
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #377
[Gal Ben Haim] Remove stale url to the internal repo
Changes for Build #378
[Gal Ben Haim] Remove stale url to the internal repo
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 010_local_maintenance_cli.local_maintenance
Error Message:
143
-------------------- >> begin captured logging << --------------------
root: INFO: * Waiting For System Stability...
lago.ssh: DEBUG: start task:db705a6c-748a-447b-9bf3-e6df46301cd7:Get ssh client for
lago-he-node-ng-suite-4-2-host-1:
lago.ssh: DEBUG: end task:db705a6c-748a-447b-9bf3-e6df46301cd7:Get ssh client for
lago-he-node-ng-suite-4-2-host-1:
lago.ssh: DEBUG: Running c0e39c02 on lago-he-node-ng-suite-4-2-host-1: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command c0e39c02 on lago-he-node-ng-suite-4-2-host-1 returned with 0
lago.ssh: DEBUG: Command c0e39c02 on lago-he-node-ng-suite-4-2-host-1 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4233 (Sun Oct 7
01:38:45 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=4233 (Sun Oct 7 01:38:46
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Up"}, "score": 3400,
"stopped": false, "maintenance": false, "crc32":
"88f742c4", "local_conf_timestamp": 4233, "host-ts": 4233},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4234 (Sun Oct 7
01:38:46 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4234 (Sun Oct 7 01:38:47
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "88e2a18a",
"local_conf_timestamp": 4234, "host-ts": 4234},
"global_maintenance": false}
lago.ssh: DEBUG: start task:2b85eb2e-24c2-464c-be4e-3c93db1d2e6a:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:2b85eb2e-24c2-464c-be4e-3c93db1d2e6a:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running c23b3ac4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--set-maintenance --mode=local
lago.ssh: DEBUG: Command c23b3ac4 on lago-he-node-ng-suite-4-2-host-0 returned with 0
root: INFO: * Waiting for engine to migrate...
lago.ssh: DEBUG: start task:a807d3e3-e442-42cf-be9c-cdbf35470925:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:a807d3e3-e442-42cf-be9c-cdbf35470925:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running c34c9a02 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command c34c9a02 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command c34c9a02 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4243 (Sun Oct 7
01:38:56 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=4243 (Sun Oct 7 01:38:56
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Up"}, "score": 3400,
"stopped": false, "maintenance": false, "crc32":
"f05088ba", "local_conf_timestamp": 4243, "host-ts": 4243},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4244 (Sun Oct 7
01:38:57 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4245 (Sun Oct 7 01:38:57
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "e2356c07",
"local_conf_timestamp": 4245, "host-ts": 4244},
"global_maintenance": false}
lago.ssh: DEBUG: start task:e9533017-248a-409e-b79c-2c1578806fb0:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:e9533017-248a-409e-b79c-2c1578806fb0:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running cabe8a02 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command cabe8a02 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command cabe8a02 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4254 (Sun Oct 7
01:39:06 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4254 (Sun Oct 7 01:39:06
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Up"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32":
"af5b43e1", "local_conf_timestamp": 4254, "host-ts": 4254},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4254 (Sun Oct 7
01:39:06 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4254 (Sun Oct 7 01:39:06
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "9174a394",
"local_conf_timestamp": 4254, "host-ts": 4254},
"global_maintenance": false}
lago.ssh: DEBUG: start task:58ba84d1-15a1-4799-86f2-edbdc68d77c9:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:58ba84d1-15a1-4799-86f2-edbdc68d77c9:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running cef6155e on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command cef6155e on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command cef6155e on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4264 (Sun Oct 7
01:39:16 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:17
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"8d976629", "local_conf_timestamp": 4264, "host-ts": 4264},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4264 (Sun Oct 7
01:39:16 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:16
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "9dbfa29b",
"local_conf_timestamp": 4264, "host-ts": 4264},
"global_maintenance": false}
lago.ssh: DEBUG: start task:7957d4cd-7b19-4356-a8e7-e0e4f18c46ec:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:7957d4cd-7b19-4356-a8e7-e0e4f18c46ec:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running d2471654 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command d2471654 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command d2471654 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4264 (Sun Oct 7
01:39:16 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:17
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"8d976629", "local_conf_timestamp": 4264, "host-ts": 4264},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4264 (Sun Oct 7
01:39:16 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:16
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "9dbfa29b",
"local_conf_timestamp": 4264, "host-ts": 4264},
"global_maintenance": false}
lago.ssh: DEBUG: start task:89d99b91-3e05-4054-bead-d8f0eb44fd2d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:89d99b91-3e05-4054-bead-d8f0eb44fd2d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running d55ff13a on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command d55ff13a on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command d55ff13a on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4274 (Sun Oct 7
01:39:27 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4275 (Sun Oct 7 01:39:27
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"54a3687d", "local_conf_timestamp": 4275, "host-ts": 4274},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4274 (Sun Oct 7
01:39:26 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "eec46806",
"local_conf_timestamp": 4274, "host-ts": 4274},
"global_maintenance": false}
lago.ssh: DEBUG: start task:03e952e2-552c-4106-ba65-28019da139b2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:03e952e2-552c-4106-ba65-28019da139b2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running d83bf174 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command d83bf174 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command d83bf174 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4274 (Sun Oct 7
01:39:27 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4275 (Sun Oct 7 01:39:27
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"54a3687d", "local_conf_timestamp": 4275, "host-ts": 4274},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4274 (Sun Oct 7
01:39:26 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "eec46806",
"local_conf_timestamp": 4274, "host-ts": 4274},
"global_maintenance": false}
lago.ssh: DEBUG: start task:16cde1c5-aa72-4695-aec2-fdb110660f19:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:16cde1c5-aa72-4695-aec2-fdb110660f19:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running db1da734 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command db1da734 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command db1da734 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4284 (Sun Oct 7
01:39:36 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4284 (Sun Oct 7 01:39:36
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"ae1109f0", "local_conf_timestamp": 4284, "host-ts": 4284},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4274 (Sun Oct 7
01:39:26 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "eec46806",
"local_conf_timestamp": 4274, "host-ts": 4274},
"global_maintenance": false}
lago.ssh: DEBUG: start task:5bfb5151-f028-4489-8677-d920820cb50c:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:5bfb5151-f028-4489-8677-d920820cb50c:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running ddfea4a8 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command ddfea4a8 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command ddfea4a8 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4284 (Sun Oct 7
01:39:36 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4284 (Sun Oct 7 01:39:36
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"ae1109f0", "local_conf_timestamp": 4284, "host-ts": 4284},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4274 (Sun Oct 7
01:39:26 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "eec46806",
"local_conf_timestamp": 4274, "host-ts": 4274},
"global_maintenance": false}
lago.ssh: DEBUG: start task:6c64d6ae-f7a4-4d85-9b54-8caca9b0b779:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:6c64d6ae-f7a4-4d85-9b54-8caca9b0b779:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running e0ef624c on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command e0ef624c on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command e0ef624c on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4294 (Sun Oct 7
01:39:46 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:47
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"00223732", "local_conf_timestamp": 4294, "host-ts": 4294},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4294 (Sun Oct 7
01:39:46 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:46
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "66414abe",
"local_conf_timestamp": 4294, "host-ts": 4294},
"global_maintenance": false}
lago.ssh: DEBUG: start task:91be1cf1-f052-413e-bf2e-dfc80f2ce1fd:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:91be1cf1-f052-413e-bf2e-dfc80f2ce1fd:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running e3d20c62 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command e3d20c62 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command e3d20c62 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4294 (Sun Oct 7
01:39:46 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:47
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"00223732", "local_conf_timestamp": 4294, "host-ts": 4294},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4294 (Sun Oct 7
01:39:46 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:46
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "66414abe",
"local_conf_timestamp": 4294, "host-ts": 4294},
"global_maintenance": false}
lago.ssh: DEBUG: start task:8da7a617-74ee-4207-a0a4-fe990310dca2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:8da7a617-74ee-4207-a0a4-fe990310dca2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running e6d722e4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command e6d722e4 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command e6d722e4 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4304 (Sun Oct 7
01:39:57 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4305 (Sun Oct 7 01:39:57
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"dd1c4c13", "local_conf_timestamp": 4305, "host-ts": 4304},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4304 (Sun Oct 7
01:39:56 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4304 (Sun Oct 7 01:39:56
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "305effe3",
"local_conf_timestamp": 4304, "host-ts": 4304},
"global_maintenance": false}
lago.ssh: DEBUG: start task:b91afc61-0b2c-4eac-9b11-722f765e3ae2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:b91afc61-0b2c-4eac-9b11-722f765e3ae2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running ea23c182 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command ea23c182 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command ea23c182 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4304 (Sun Oct 7
01:39:57 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4305 (Sun Oct 7 01:39:57
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"dd1c4c13", "local_conf_timestamp": 4305, "host-ts": 4304},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4304 (Sun Oct 7
01:39:56 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4304 (Sun Oct 7 01:39:56
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "305effe3",
"local_conf_timestamp": 4304, "host-ts": 4304},
"global_maintenance": false}
lago.ssh: DEBUG: start task:6fd22ca3-ff2e-4b0c-a7db-16515e9fd894:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:6fd22ca3-ff2e-4b0c-a7db-16515e9fd894:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running ed33fcf2 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command ed33fcf2 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command ed33fcf2 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4314 (Sun Oct 7
01:40:06 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:07
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "VM migrated away
successfully", "health": "bad", "vm": "down",
"detail": "Down"}, "score": 3000, "stopped":
false, "maintenance": false, "crc32": "2cf1fcda",
"local_conf_timestamp": 4314, "host-ts": 4314}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4314 (Sun Oct 7
01:40:06 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:06
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "341800e6",
"local_conf_timestamp": 4314, "host-ts": 4314},
"global_maintenance": false}
lago.ssh: DEBUG: start task:c959b4a8-c6f0-406b-8597-07f8364940b6:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:c959b4a8-c6f0-406b-8597-07f8364940b6:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running ee40613a on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command ee40613a on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command ee40613a on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4314 (Sun Oct 7
01:40:06 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:07
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "VM migrated away
successfully", "health": "bad", "vm": "down",
"detail": "Down"}, "score": 3000, "stopped":
false, "maintenance": false, "crc32": "2cf1fcda",
"local_conf_timestamp": 4314, "host-ts": 4314}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4314 (Sun Oct 7
01:40:06 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:06
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "341800e6",
"local_conf_timestamp": 4314, "host-ts": 4314},
"global_maintenance": false}
lago.ssh: DEBUG: start task:53853219-0b30-456c-bcd4-ebbfbd2fc3f3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:53853219-0b30-456c-bcd4-ebbfbd2fc3f3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running f54ac0ba on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command f54ac0ba on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command f54ac0ba on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4324 (Sun Oct 7
01:40:17 2018)\nhost-id=1\nscore=0\nvm_conf_refresh_time=4325 (Sun Oct 7 01:40:17
2018)\nconf_on_shared_storage=True\nmaintenance=True\nstate=LocalMaintenance\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 0, "stopped":
false, "maintenance": true, "crc32": "2f0dbd6e",
"local_conf_timestamp": 4325, "host-ts": 4324}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4325 (Sun Oct 7
01:40:17 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4325 (Sun Oct 7 01:40:17
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"health": "good", "vm":
"up", "detail": "Up"}, "score": 3400,
"stopped": false, "maintenance": false, "crc32":
"fd62238f", "local_conf_timestamp": 4325, "host-ts": 4325},
"global_maintenance": false}
root: INFO: * Engine has migrated.
root: INFO: * Waiting For System Stability...
lago.ssh: DEBUG: start task:287a25d7-2123-4ad8-a26b-32c2c460170d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:287a25d7-2123-4ad8-a26b-32c2c460170d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running a929c50e on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--set-maintenance --mode=none
lago.ssh: DEBUG: Command a929c50e on lago-he-node-ng-suite-4-2-host-0 returned with 0
root: INFO: * Waiting for Engine Maintenance to reset...
lago.ssh: DEBUG: start task:a4d502a4-4af2-4295-973b-b4796a6266d8:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:a4d502a4-4af2-4295-973b-b4796a6266d8:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running ab734e20 on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command ab734e20 on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command ab734e20 on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4634 (Sun Oct 7
01:45:27 2018)\nhost-id=1\nscore=0\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=ReinitializeFSM\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 0, "stopped":
false, "maintenance": false, "crc32": "7d32e4c7",
"local_conf_timestamp": 4635, "host-ts": 4634}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4635 (Sun Oct 7
01:45:27 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"health": "good", "vm":
"up", "detail": "Up"}, "score": 3400,
"stopped": false, "maintenance": false, "crc32":
"20c50afa", "local_conf_timestamp": 4635, "host-ts": 4635},
"global_maintenance": false}
lago.ssh: DEBUG: start task:4bf4be88-50f2-41e1-b6fa-f2f8b3915d32:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: end task:4bf4be88-50f2-41e1-b6fa-f2f8b3915d32:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:
lago.ssh: DEBUG: Running ac83f06c on lago-he-node-ng-suite-4-2-host-0: hosted-engine
--vm-status --json
lago.ssh: DEBUG: Command ac83f06c on lago-he-node-ng-suite-4-2-host-0 returned with 0
lago.ssh: DEBUG: Command ac83f06c on lago-he-node-ng-suite-4-2-host-0 output:
{"1": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4634 (Sun Oct 7
01:45:27 2018)\nhost-id=1\nscore=0\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=ReinitializeFSM\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 0, "stopped":
false, "maintenance": false, "crc32": "7d32e4c7",
"local_conf_timestamp": 4635, "host-ts": 4634}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4635 (Sun Oct 7
01:45:27 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27
2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"health": "good", "vm":
"up", "detail": "Up"}, "score": 3400,
"stopped": false, "maintenance": false, "crc32":
"20c50afa", "local_conf_timestamp": 4635, "host-ts": 4635},
"global_maintenance": false}
cli: DEBUG: signal 15 was caught
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in
wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in
wrapper
return func(get_test_prefix(), *args, **kwargs)
File
"/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/010_local_maintenance_cli.py",
line 130, in local_maintenance
_wait_for_engine_maintenance(host, he_index, False)
File
"/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/010_local_maintenance_cli.py",
line 73, in _wait_for_engine_maintenance
lambda: _is_state_maintenance(host, "LocalMaintenance") is False
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in
assert_true_within_long
assert_equals_within_long(func, True, allowed_exceptions)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in
assert_equals_within_long
func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 248, in
assert_equals_within
time.sleep(initial_wait)
File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in
exit_handler
sys.exit(128 + signum)
'143\n-------------------- >> begin captured logging <<
--------------------\nroot: INFO: * Waiting For System Stability...\nlago.ssh: DEBUG:
start task:db705a6c-748a-447b-9bf3-e6df46301cd7:Get ssh client for
lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: end
task:db705a6c-748a-447b-9bf3-e6df46301cd7:Get ssh client for
lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: Running c0e39c02 on
lago-he-node-ng-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command c0e39c02 on lago-he-node-ng-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG:
Command c0e39c02 on lago-he-node-ng-suite-4-2-host-1 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4233 (Sun Oct 7
01:38:45 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=4233 (Sun Oct 7 01:38:46
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Up"}, "score": 3400,
"stopped": false, "maintenance": false, "crc32":
"88f742c4", "local_conf_timestamp": 4233, "host-ts": 4233},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4234 (Sun Oct 7
01:38:46 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4234 (Sun Oct 7 01:38:47
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "88e2a18a",
"local_conf_timestamp": 4234, "host-ts": 4234},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:2b85eb2e-24c2-464c-be4e-3c93db1d2e6a:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:2b85eb2e-24c2-464c-be4e-3c93db1d2e6a:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running c23b3ac4 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --set-maintenance --mode=local\nlago.ssh:
DEBUG: Command c23b3ac4 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot: INFO:
* Waiting for engine to migrate...\nlago.ssh: DEBUG: start
task:a807d3e3-e442-42cf-be9c-cdbf35470925:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:a807d3e3-e442-42cf-be9c-cdbf35470925:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running c34c9a02 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command c34c9a02 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command c34c9a02 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4243 (Sun Oct 7
01:38:56 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=4243 (Sun Oct 7 01:38:56
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Up"}, "score": 3400,
"stopped": false, "maintenance": false, "crc32":
"f05088ba", "local_conf_timestamp": 4243, "host-ts": 4243},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4244 (Sun Oct 7
01:38:57 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4245 (Sun Oct 7 01:38:57
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "e2356c07",
"local_conf_timestamp": 4245, "host-ts": 4244},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:e9533017-248a-409e-b79c-2c1578806fb0:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:e9533017-248a-409e-b79c-2c1578806fb0:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running cabe8a02 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command cabe8a02 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command cabe8a02 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4254 (Sun Oct 7
01:39:06 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4254 (Sun Oct 7 01:39:06
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Up"}, "score": 3000,
"stopped": false, "maintenance": false, "crc32":
"af5b43e1", "local_conf_timestamp": 4254, "host-ts": 4254},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4254 (Sun Oct 7
01:39:06 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4254 (Sun Oct 7 01:39:06
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "9174a394",
"local_conf_timestamp": 4254, "host-ts": 4254},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:58ba84d1-15a1-4799-86f2-edbdc68d77c9:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:58ba84d1-15a1-4799-86f2-edbdc68d77c9:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running cef6155e on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command cef6155e on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command cef6155e on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4264 (Sun Oct 7
01:39:16 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:17
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"8d976629", "local_conf_timestamp": 4264, "host-ts": 4264},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4264 (Sun Oct 7
01:39:16 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:16
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "9dbfa29b",
"local_conf_timestamp": 4264, "host-ts": 4264},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:7957d4cd-7b19-4356-a8e7-e0e4f18c46ec:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:7957d4cd-7b19-4356-a8e7-e0e4f18c46ec:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running d2471654 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command d2471654 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command d2471654 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4264 (Sun Oct 7
01:39:16 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:17
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"8d976629", "local_conf_timestamp": 4264, "host-ts": 4264},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4264 (Sun Oct 7
01:39:16 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:16
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 3400, "stopped":
false, "maintenance": false, "crc32": "9dbfa29b",
"local_conf_timestamp": 4264, "host-ts": 4264},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:89d99b91-3e05-4054-bead-d8f0eb44fd2d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:89d99b91-3e05-4054-bead-d8f0eb44fd2d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running d55ff13a on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command d55ff13a on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command d55ff13a on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4274 (Sun Oct 7
01:39:27 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4275 (Sun Oct 7 01:39:27
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"54a3687d", "local_conf_timestamp": 4275, "host-ts": 4274},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4274 (Sun Oct 7
01:39:26 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "eec46806",
"local_conf_timestamp": 4274, "host-ts": 4274},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:03e952e2-552c-4106-ba65-28019da139b2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:03e952e2-552c-4106-ba65-28019da139b2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running d83bf174 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command d83bf174 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command d83bf174 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4274 (Sun Oct 7
01:39:27 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4275 (Sun Oct 7 01:39:27
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"54a3687d", "local_conf_timestamp": 4275, "host-ts": 4274},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4274 (Sun Oct 7
01:39:26 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "eec46806",
"local_conf_timestamp": 4274, "host-ts": 4274},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:16cde1c5-aa72-4695-aec2-fdb110660f19:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:16cde1c5-aa72-4695-aec2-fdb110660f19:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running db1da734 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command db1da734 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command db1da734 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4284 (Sun Oct 7
01:39:36 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4284 (Sun Oct 7 01:39:36
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"ae1109f0", "local_conf_timestamp": 4284, "host-ts": 4284},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4274 (Sun Oct 7
01:39:26 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "eec46806",
"local_conf_timestamp": 4274, "host-ts": 4274},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:5bfb5151-f028-4489-8677-d920820cb50c:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:5bfb5151-f028-4489-8677-d920820cb50c:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ddfea4a8 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command ddfea4a8 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command ddfea4a8 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4284 (Sun Oct 7
01:39:36 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4284 (Sun Oct 7 01:39:36
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"ae1109f0", "local_conf_timestamp": 4284, "host-ts": 4284},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4274 (Sun Oct 7
01:39:26 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3400, "stopped": false,
"maintenance": false, "crc32": "eec46806",
"local_conf_timestamp": 4274, "host-ts": 4274},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:6c64d6ae-f7a4-4d85-9b54-8caca9b0b779:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:6c64d6ae-f7a4-4d85-9b54-8caca9b0b779:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running e0ef624c on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command e0ef624c on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command e0ef624c on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4294 (Sun Oct 7
01:39:46 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:47
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"00223732", "local_conf_timestamp": 4294, "host-ts": 4294},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4294 (Sun Oct 7
01:39:46 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:46
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "66414abe",
"local_conf_timestamp": 4294, "host-ts": 4294},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:91be1cf1-f052-413e-bf2e-dfc80f2ce1fd:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:91be1cf1-f052-413e-bf2e-dfc80f2ce1fd:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running e3d20c62 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command e3d20c62 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command e3d20c62 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4294 (Sun Oct 7
01:39:46 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:47
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"00223732", "local_conf_timestamp": 4294, "host-ts": 4294},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4294 (Sun Oct 7
01:39:46 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:46
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "66414abe",
"local_conf_timestamp": 4294, "host-ts": 4294},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:8da7a617-74ee-4207-a0a4-fe990310dca2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:8da7a617-74ee-4207-a0a4-fe990310dca2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running e6d722e4 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command e6d722e4 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command e6d722e4 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4304 (Sun Oct 7
01:39:57 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4305 (Sun Oct 7 01:39:57
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"dd1c4c13", "local_conf_timestamp": 4305, "host-ts": 4304},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4304 (Sun Oct 7
01:39:56 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4304 (Sun Oct 7 01:39:56
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "305effe3",
"local_conf_timestamp": 4304, "host-ts": 4304},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:b91afc61-0b2c-4eac-9b11-722f765e3ae2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:b91afc61-0b2c-4eac-9b11-722f765e3ae2:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ea23c182 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command ea23c182 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command ea23c182 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4304 (Sun Oct 7
01:39:57 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4305 (Sun Oct 7 01:39:57
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"health": "good", "vm":
"up", "detail": "Migration Source"}, "score":
3000, "stopped": false, "maintenance": false, "crc32":
"dd1c4c13", "local_conf_timestamp": 4305, "host-ts": 4304},
"2": {"conf_on_shared_storage": true, "live-data": true,
"extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4304 (Sun Oct 7
01:39:56 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4304 (Sun Oct 7 01:39:56
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "305effe3",
"local_conf_timestamp": 4304, "host-ts": 4304},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:6fd22ca3-ff2e-4b0c-a7db-16515e9fd894:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:6fd22ca3-ff2e-4b0c-a7db-16515e9fd894:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ed33fcf2 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command ed33fcf2 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command ed33fcf2 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4314 (Sun Oct 7
01:40:06 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:07
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "VM migrated away
successfully", "health": "bad", "vm": "down",
"detail": "Down"}, "score": 3000, "stopped":
false, "maintenance": false, "crc32": "2cf1fcda",
"local_conf_timestamp": 4314, "host-ts": 4314}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4314 (Sun Oct 7
01:40:06 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:06
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "341800e6",
"local_conf_timestamp": 4314, "host-ts": 4314},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:c959b4a8-c6f0-406b-8597-07f8364940b6:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:c959b4a8-c6f0-406b-8597-07f8364940b6:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ee40613a on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command ee40613a on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command ee40613a on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4314 (Sun Oct 7
01:40:06 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:07
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "VM migrated away
successfully", "health": "bad", "vm": "down",
"detail": "Down"}, "score": 3000, "stopped":
false, "maintenance": false, "crc32": "2cf1fcda",
"local_conf_timestamp": 4314, "host-ts": 4314}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4314 (Sun Oct 7
01:40:06 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:06
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"reason": "bad vm status",
"health": "bad", "vm": "down", "detail":
"Migration Destination"}, "score": 3000, "stopped": false,
"maintenance": false, "crc32": "341800e6",
"local_conf_timestamp": 4314, "host-ts": 4314},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:53853219-0b30-456c-bcd4-ebbfbd2fc3f3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:53853219-0b30-456c-bcd4-ebbfbd2fc3f3:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running f54ac0ba on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command f54ac0ba on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command f54ac0ba on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4324 (Sun Oct 7
01:40:17 2018)\\nhost-id=1\\nscore=0\\nvm_conf_refresh_time=4325 (Sun Oct 7 01:40:17
2018)\\nconf_on_shared_storage=True\\nmaintenance=True\\nstate=LocalMaintenance\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 0, "stopped":
false, "maintenance": true, "crc32": "2f0dbd6e",
"local_conf_timestamp": 4325, "host-ts": 4324}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4325 (Sun Oct 7
01:40:17 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4325 (Sun Oct 7 01:40:17
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"health": "good", "vm":
"up", "detail": "Up"}, "score": 3400,
"stopped": false, "maintenance": false, "crc32":
"fd62238f", "local_conf_timestamp": 4325, "host-ts": 4325},
"global_maintenance": false}\n\nroot: INFO: * Engine has migrated.\nroot:
INFO: * Waiting For System Stability...\nlago.ssh: DEBUG: start
task:287a25d7-2123-4ad8-a26b-32c2c460170d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:287a25d7-2123-4ad8-a26b-32c2c460170d:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running a929c50e on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --set-maintenance --mode=none\nlago.ssh:
DEBUG: Command a929c50e on lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot: INFO:
* Waiting for Engine Maintenance to reset...\nlago.ssh: DEBUG: start
task:a4d502a4-4af2-4295-973b-b4796a6266d8:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:a4d502a4-4af2-4295-973b-b4796a6266d8:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ab734e20 on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command ab734e20 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command ab734e20 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4634 (Sun Oct 7
01:45:27 2018)\\nhost-id=1\\nscore=0\\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=ReinitializeFSM\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 0, "stopped":
false, "maintenance": false, "crc32": "7d32e4c7",
"local_conf_timestamp": 4635, "host-ts": 4634}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4635 (Sun Oct 7
01:45:27 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"health": "good", "vm":
"up", "detail": "Up"}, "score": 3400,
"stopped": false, "maintenance": false, "crc32":
"20c50afa", "local_conf_timestamp": 4635, "host-ts": 4635},
"global_maintenance": false}\n\nlago.ssh: DEBUG: start
task:4bf4be88-50f2-41e1-b6fa-f2f8b3915d32:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end
task:4bf4be88-50f2-41e1-b6fa-f2f8b3915d32:Get ssh client for
lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ac83f06c on
lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG:
Command ac83f06c on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG:
Command ac83f06c on lago-he-node-ng-suite-4-2-host-0 output:\n {"1":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4634 (Sun Oct 7
01:45:27 2018)\\nhost-id=1\\nscore=0\\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=ReinitializeFSM\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id":
1, "engine-status": {"reason": "vm not running on this
host", "health": "bad", "vm": "down",
"detail": "unknown"}, "score": 0, "stopped":
false, "maintenance": false, "crc32": "7d32e4c7",
"local_conf_timestamp": 4635, "host-ts": 4634}, "2":
{"conf_on_shared_storage": true, "live-data": true, "extra":
"metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4635 (Sun Oct 7
01:45:27 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27
2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n",
"hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id":
2, "engine-status": {"health": "good", "vm":
"up", "detail": "Up"}, "score": 3400,
"stopped": false, "maintenance": false, "crc32":
"20c50afa", "local_conf_timestamp": 4635, "host-ts": 4635},
"global_maintenance": false}\n\ncli: DEBUG: signal 15 was
caught\n--------------------- >> end captured logging <<
---------------------'