Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/378/ Build Number: 378 Build Status: Still Failing Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #348 [Dafna Ron] ovirt-4.2: block external links from running in ost Changes for Build #349 [Dafna Ron] ovirt-4.2: block external links from running in ost Changes for Build #350 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #351 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #352 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #353 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #354 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #355 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #356 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #357 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #358 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #359 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #360 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #361 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #362 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" [Sandro Bonazzola] ovirt-setup-lib: drop 3.6 [Sandro Bonazzola] ovirt-host: drop 3.6 and 4.1 Changes for Build #363 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #364 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #365 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" [Sandro Bonazzola] ovirt-reports: drop 3.6 jobs [Sandro Bonazzola] ovirt-host-deploy: drop 3.6 jobs Changes for Build #366 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #367 [Miguel Duarte Barroso] Revert "Repos: add python2-ovsdbapp to the reposync config" Changes for Build #368 [Gal Ben Haim] Remove stale url to the internal repo [Greg Sheremeta] add ovirt-web-ui to stdci v2 Changes for Build #369 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #370 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #371 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #372 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #373 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #374 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #375 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #376 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #377 [Gal Ben Haim] Remove stale url to the internal repo Changes for Build #378 [Gal Ben Haim] Remove stale url to the internal repo ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 010_local_maintenance_cli.local_maintenance Error Message: 143 -------------------- >> begin captured logging << -------------------- root: INFO: * Waiting For System Stability... lago.ssh: DEBUG: start task:db705a6c-748a-447b-9bf3-e6df46301cd7:Get ssh client for lago-he-node-ng-suite-4-2-host-1: lago.ssh: DEBUG: end task:db705a6c-748a-447b-9bf3-e6df46301cd7:Get ssh client for lago-he-node-ng-suite-4-2-host-1: lago.ssh: DEBUG: Running c0e39c02 on lago-he-node-ng-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command c0e39c02 on lago-he-node-ng-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command c0e39c02 on lago-he-node-ng-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4233 (Sun Oct 7 01:38:45 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=4233 (Sun Oct 7 01:38:46 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "88f742c4", "local_conf_timestamp": 4233, "host-ts": 4233}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4234 (Sun Oct 7 01:38:46 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4234 (Sun Oct 7 01:38:47 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "88e2a18a", "local_conf_timestamp": 4234, "host-ts": 4234}, "global_maintenance": false} lago.ssh: DEBUG: start task:2b85eb2e-24c2-464c-be4e-3c93db1d2e6a:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:2b85eb2e-24c2-464c-be4e-3c93db1d2e6a:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running c23b3ac4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --set-maintenance --mode=local lago.ssh: DEBUG: Command c23b3ac4 on lago-he-node-ng-suite-4-2-host-0 returned with 0 root: INFO: * Waiting for engine to migrate... lago.ssh: DEBUG: start task:a807d3e3-e442-42cf-be9c-cdbf35470925:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:a807d3e3-e442-42cf-be9c-cdbf35470925:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running c34c9a02 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command c34c9a02 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command c34c9a02 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4243 (Sun Oct 7 01:38:56 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=4243 (Sun Oct 7 01:38:56 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "f05088ba", "local_conf_timestamp": 4243, "host-ts": 4243}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4244 (Sun Oct 7 01:38:57 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4245 (Sun Oct 7 01:38:57 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e2356c07", "local_conf_timestamp": 4245, "host-ts": 4244}, "global_maintenance": false} lago.ssh: DEBUG: start task:e9533017-248a-409e-b79c-2c1578806fb0:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:e9533017-248a-409e-b79c-2c1578806fb0:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running cabe8a02 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command cabe8a02 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command cabe8a02 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4254 (Sun Oct 7 01:39:06 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4254 (Sun Oct 7 01:39:06 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "af5b43e1", "local_conf_timestamp": 4254, "host-ts": 4254}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4254 (Sun Oct 7 01:39:06 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4254 (Sun Oct 7 01:39:06 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "9174a394", "local_conf_timestamp": 4254, "host-ts": 4254}, "global_maintenance": false} lago.ssh: DEBUG: start task:58ba84d1-15a1-4799-86f2-edbdc68d77c9:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:58ba84d1-15a1-4799-86f2-edbdc68d77c9:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running cef6155e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command cef6155e on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command cef6155e on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4264 (Sun Oct 7 01:39:16 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:17 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8d976629", "local_conf_timestamp": 4264, "host-ts": 4264}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4264 (Sun Oct 7 01:39:16 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:16 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "9dbfa29b", "local_conf_timestamp": 4264, "host-ts": 4264}, "global_maintenance": false} lago.ssh: DEBUG: start task:7957d4cd-7b19-4356-a8e7-e0e4f18c46ec:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:7957d4cd-7b19-4356-a8e7-e0e4f18c46ec:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running d2471654 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command d2471654 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command d2471654 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4264 (Sun Oct 7 01:39:16 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:17 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8d976629", "local_conf_timestamp": 4264, "host-ts": 4264}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4264 (Sun Oct 7 01:39:16 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:16 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "9dbfa29b", "local_conf_timestamp": 4264, "host-ts": 4264}, "global_maintenance": false} lago.ssh: DEBUG: start task:89d99b91-3e05-4054-bead-d8f0eb44fd2d:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:89d99b91-3e05-4054-bead-d8f0eb44fd2d:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running d55ff13a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command d55ff13a on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command d55ff13a on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4274 (Sun Oct 7 01:39:27 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4275 (Sun Oct 7 01:39:27 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "54a3687d", "local_conf_timestamp": 4275, "host-ts": 4274}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4274 (Sun Oct 7 01:39:26 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "eec46806", "local_conf_timestamp": 4274, "host-ts": 4274}, "global_maintenance": false} lago.ssh: DEBUG: start task:03e952e2-552c-4106-ba65-28019da139b2:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:03e952e2-552c-4106-ba65-28019da139b2:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running d83bf174 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command d83bf174 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command d83bf174 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4274 (Sun Oct 7 01:39:27 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4275 (Sun Oct 7 01:39:27 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "54a3687d", "local_conf_timestamp": 4275, "host-ts": 4274}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4274 (Sun Oct 7 01:39:26 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "eec46806", "local_conf_timestamp": 4274, "host-ts": 4274}, "global_maintenance": false} lago.ssh: DEBUG: start task:16cde1c5-aa72-4695-aec2-fdb110660f19:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:16cde1c5-aa72-4695-aec2-fdb110660f19:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running db1da734 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command db1da734 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command db1da734 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4284 (Sun Oct 7 01:39:36 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4284 (Sun Oct 7 01:39:36 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "ae1109f0", "local_conf_timestamp": 4284, "host-ts": 4284}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4274 (Sun Oct 7 01:39:26 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "eec46806", "local_conf_timestamp": 4274, "host-ts": 4274}, "global_maintenance": false} lago.ssh: DEBUG: start task:5bfb5151-f028-4489-8677-d920820cb50c:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:5bfb5151-f028-4489-8677-d920820cb50c:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running ddfea4a8 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command ddfea4a8 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command ddfea4a8 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4284 (Sun Oct 7 01:39:36 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4284 (Sun Oct 7 01:39:36 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "ae1109f0", "local_conf_timestamp": 4284, "host-ts": 4284}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4274 (Sun Oct 7 01:39:26 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "eec46806", "local_conf_timestamp": 4274, "host-ts": 4274}, "global_maintenance": false} lago.ssh: DEBUG: start task:6c64d6ae-f7a4-4d85-9b54-8caca9b0b779:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:6c64d6ae-f7a4-4d85-9b54-8caca9b0b779:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running e0ef624c on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command e0ef624c on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command e0ef624c on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4294 (Sun Oct 7 01:39:46 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:47 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "00223732", "local_conf_timestamp": 4294, "host-ts": 4294}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4294 (Sun Oct 7 01:39:46 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:46 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "66414abe", "local_conf_timestamp": 4294, "host-ts": 4294}, "global_maintenance": false} lago.ssh: DEBUG: start task:91be1cf1-f052-413e-bf2e-dfc80f2ce1fd:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:91be1cf1-f052-413e-bf2e-dfc80f2ce1fd:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running e3d20c62 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command e3d20c62 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command e3d20c62 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4294 (Sun Oct 7 01:39:46 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:47 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "00223732", "local_conf_timestamp": 4294, "host-ts": 4294}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4294 (Sun Oct 7 01:39:46 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:46 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "66414abe", "local_conf_timestamp": 4294, "host-ts": 4294}, "global_maintenance": false} lago.ssh: DEBUG: start task:8da7a617-74ee-4207-a0a4-fe990310dca2:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:8da7a617-74ee-4207-a0a4-fe990310dca2:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running e6d722e4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command e6d722e4 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command e6d722e4 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4304 (Sun Oct 7 01:39:57 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4305 (Sun Oct 7 01:39:57 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "dd1c4c13", "local_conf_timestamp": 4305, "host-ts": 4304}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4304 (Sun Oct 7 01:39:56 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4304 (Sun Oct 7 01:39:56 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "305effe3", "local_conf_timestamp": 4304, "host-ts": 4304}, "global_maintenance": false} lago.ssh: DEBUG: start task:b91afc61-0b2c-4eac-9b11-722f765e3ae2:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:b91afc61-0b2c-4eac-9b11-722f765e3ae2:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running ea23c182 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command ea23c182 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command ea23c182 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4304 (Sun Oct 7 01:39:57 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4305 (Sun Oct 7 01:39:57 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "dd1c4c13", "local_conf_timestamp": 4305, "host-ts": 4304}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4304 (Sun Oct 7 01:39:56 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4304 (Sun Oct 7 01:39:56 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "305effe3", "local_conf_timestamp": 4304, "host-ts": 4304}, "global_maintenance": false} lago.ssh: DEBUG: start task:6fd22ca3-ff2e-4b0c-a7db-16515e9fd894:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:6fd22ca3-ff2e-4b0c-a7db-16515e9fd894:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running ed33fcf2 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command ed33fcf2 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command ed33fcf2 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4314 (Sun Oct 7 01:40:06 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:07 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "VM migrated away successfully", "health": "bad", "vm": "down", "detail": "Down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "2cf1fcda", "local_conf_timestamp": 4314, "host-ts": 4314}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4314 (Sun Oct 7 01:40:06 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:06 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "341800e6", "local_conf_timestamp": 4314, "host-ts": 4314}, "global_maintenance": false} lago.ssh: DEBUG: start task:c959b4a8-c6f0-406b-8597-07f8364940b6:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:c959b4a8-c6f0-406b-8597-07f8364940b6:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running ee40613a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command ee40613a on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command ee40613a on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4314 (Sun Oct 7 01:40:06 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:07 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "VM migrated away successfully", "health": "bad", "vm": "down", "detail": "Down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "2cf1fcda", "local_conf_timestamp": 4314, "host-ts": 4314}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4314 (Sun Oct 7 01:40:06 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:06 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "341800e6", "local_conf_timestamp": 4314, "host-ts": 4314}, "global_maintenance": false} lago.ssh: DEBUG: start task:53853219-0b30-456c-bcd4-ebbfbd2fc3f3:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:53853219-0b30-456c-bcd4-ebbfbd2fc3f3:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running f54ac0ba on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command f54ac0ba on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command f54ac0ba on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4324 (Sun Oct 7 01:40:17 2018)\nhost-id=1\nscore=0\nvm_conf_refresh_time=4325 (Sun Oct 7 01:40:17 2018)\nconf_on_shared_storage=True\nmaintenance=True\nstate=LocalMaintenance\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 0, "stopped": false, "maintenance": true, "crc32": "2f0dbd6e", "local_conf_timestamp": 4325, "host-ts": 4324}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4325 (Sun Oct 7 01:40:17 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4325 (Sun Oct 7 01:40:17 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "fd62238f", "local_conf_timestamp": 4325, "host-ts": 4325}, "global_maintenance": false} root: INFO: * Engine has migrated. root: INFO: * Waiting For System Stability... lago.ssh: DEBUG: start task:287a25d7-2123-4ad8-a26b-32c2c460170d:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:287a25d7-2123-4ad8-a26b-32c2c460170d:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running a929c50e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --set-maintenance --mode=none lago.ssh: DEBUG: Command a929c50e on lago-he-node-ng-suite-4-2-host-0 returned with 0 root: INFO: * Waiting for Engine Maintenance to reset... lago.ssh: DEBUG: start task:a4d502a4-4af2-4295-973b-b4796a6266d8:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:a4d502a4-4af2-4295-973b-b4796a6266d8:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running ab734e20 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command ab734e20 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command ab734e20 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4634 (Sun Oct 7 01:45:27 2018)\nhost-id=1\nscore=0\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=ReinitializeFSM\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 0, "stopped": false, "maintenance": false, "crc32": "7d32e4c7", "local_conf_timestamp": 4635, "host-ts": 4634}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4635 (Sun Oct 7 01:45:27 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "20c50afa", "local_conf_timestamp": 4635, "host-ts": 4635}, "global_maintenance": false} lago.ssh: DEBUG: start task:4bf4be88-50f2-41e1-b6fa-f2f8b3915d32:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:4bf4be88-50f2-41e1-b6fa-f2f8b3915d32:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running ac83f06c on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command ac83f06c on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command ac83f06c on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4634 (Sun Oct 7 01:45:27 2018)\nhost-id=1\nscore=0\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=ReinitializeFSM\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 0, "stopped": false, "maintenance": false, "crc32": "7d32e4c7", "local_conf_timestamp": 4635, "host-ts": 4634}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4635 (Sun Oct 7 01:45:27 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "20c50afa", "local_conf_timestamp": 4635, "host-ts": 4635}, "global_maintenance": false} cli: DEBUG: signal 15 was caught --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/010_local_maintenance_cli.py", line 130, in local_maintenance _wait_for_engine_maintenance(host, he_index, False) File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/010_local_maintenance_cli.py", line 73, in _wait_for_engine_maintenance lambda: _is_state_maintenance(host, "LocalMaintenance") is False File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 248, in assert_equals_within time.sleep(initial_wait) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in exit_handler sys.exit(128 + signum) '143\n-------------------- >> begin captured logging << --------------------\nroot: INFO: * Waiting For System Stability...\nlago.ssh: DEBUG: start task:db705a6c-748a-447b-9bf3-e6df46301cd7:Get ssh client for lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:db705a6c-748a-447b-9bf3-e6df46301cd7:Get ssh client for lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: Running c0e39c02 on lago-he-node-ng-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command c0e39c02 on lago-he-node-ng-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command c0e39c02 on lago-he-node-ng-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4233 (Sun Oct 7 01:38:45 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=4233 (Sun Oct 7 01:38:46 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "88f742c4", "local_conf_timestamp": 4233, "host-ts": 4233}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4234 (Sun Oct 7 01:38:46 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4234 (Sun Oct 7 01:38:47 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "88e2a18a", "local_conf_timestamp": 4234, "host-ts": 4234}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:2b85eb2e-24c2-464c-be4e-3c93db1d2e6a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:2b85eb2e-24c2-464c-be4e-3c93db1d2e6a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running c23b3ac4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --set-maintenance --mode=local\nlago.ssh: DEBUG: Command c23b3ac4 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot: INFO: * Waiting for engine to migrate...\nlago.ssh: DEBUG: start task:a807d3e3-e442-42cf-be9c-cdbf35470925:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:a807d3e3-e442-42cf-be9c-cdbf35470925:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running c34c9a02 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command c34c9a02 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command c34c9a02 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4243 (Sun Oct 7 01:38:56 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=4243 (Sun Oct 7 01:38:56 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "f05088ba", "local_conf_timestamp": 4243, "host-ts": 4243}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4244 (Sun Oct 7 01:38:57 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4245 (Sun Oct 7 01:38:57 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e2356c07", "local_conf_timestamp": 4245, "host-ts": 4244}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:e9533017-248a-409e-b79c-2c1578806fb0:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:e9533017-248a-409e-b79c-2c1578806fb0:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running cabe8a02 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command cabe8a02 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command cabe8a02 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4254 (Sun Oct 7 01:39:06 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4254 (Sun Oct 7 01:39:06 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "af5b43e1", "local_conf_timestamp": 4254, "host-ts": 4254}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4254 (Sun Oct 7 01:39:06 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4254 (Sun Oct 7 01:39:06 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "9174a394", "local_conf_timestamp": 4254, "host-ts": 4254}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:58ba84d1-15a1-4799-86f2-edbdc68d77c9:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:58ba84d1-15a1-4799-86f2-edbdc68d77c9:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running cef6155e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command cef6155e on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command cef6155e on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4264 (Sun Oct 7 01:39:16 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:17 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8d976629", "local_conf_timestamp": 4264, "host-ts": 4264}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4264 (Sun Oct 7 01:39:16 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:16 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "9dbfa29b", "local_conf_timestamp": 4264, "host-ts": 4264}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:7957d4cd-7b19-4356-a8e7-e0e4f18c46ec:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:7957d4cd-7b19-4356-a8e7-e0e4f18c46ec:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running d2471654 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command d2471654 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command d2471654 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4264 (Sun Oct 7 01:39:16 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:17 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8d976629", "local_conf_timestamp": 4264, "host-ts": 4264}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4264 (Sun Oct 7 01:39:16 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4264 (Sun Oct 7 01:39:16 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "9dbfa29b", "local_conf_timestamp": 4264, "host-ts": 4264}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:89d99b91-3e05-4054-bead-d8f0eb44fd2d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:89d99b91-3e05-4054-bead-d8f0eb44fd2d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running d55ff13a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command d55ff13a on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command d55ff13a on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4274 (Sun Oct 7 01:39:27 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4275 (Sun Oct 7 01:39:27 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "54a3687d", "local_conf_timestamp": 4275, "host-ts": 4274}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4274 (Sun Oct 7 01:39:26 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "eec46806", "local_conf_timestamp": 4274, "host-ts": 4274}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:03e952e2-552c-4106-ba65-28019da139b2:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:03e952e2-552c-4106-ba65-28019da139b2:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running d83bf174 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command d83bf174 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command d83bf174 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4274 (Sun Oct 7 01:39:27 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4275 (Sun Oct 7 01:39:27 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "54a3687d", "local_conf_timestamp": 4275, "host-ts": 4274}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4274 (Sun Oct 7 01:39:26 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "eec46806", "local_conf_timestamp": 4274, "host-ts": 4274}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:16cde1c5-aa72-4695-aec2-fdb110660f19:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:16cde1c5-aa72-4695-aec2-fdb110660f19:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running db1da734 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command db1da734 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command db1da734 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4284 (Sun Oct 7 01:39:36 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4284 (Sun Oct 7 01:39:36 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "ae1109f0", "local_conf_timestamp": 4284, "host-ts": 4284}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4274 (Sun Oct 7 01:39:26 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "eec46806", "local_conf_timestamp": 4274, "host-ts": 4274}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:5bfb5151-f028-4489-8677-d920820cb50c:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:5bfb5151-f028-4489-8677-d920820cb50c:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ddfea4a8 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command ddfea4a8 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command ddfea4a8 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4284 (Sun Oct 7 01:39:36 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4284 (Sun Oct 7 01:39:36 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "ae1109f0", "local_conf_timestamp": 4284, "host-ts": 4284}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4274 (Sun Oct 7 01:39:26 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4274 (Sun Oct 7 01:39:26 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "eec46806", "local_conf_timestamp": 4274, "host-ts": 4274}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:6c64d6ae-f7a4-4d85-9b54-8caca9b0b779:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:6c64d6ae-f7a4-4d85-9b54-8caca9b0b779:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running e0ef624c on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command e0ef624c on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command e0ef624c on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4294 (Sun Oct 7 01:39:46 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:47 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "00223732", "local_conf_timestamp": 4294, "host-ts": 4294}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4294 (Sun Oct 7 01:39:46 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:46 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "66414abe", "local_conf_timestamp": 4294, "host-ts": 4294}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:91be1cf1-f052-413e-bf2e-dfc80f2ce1fd:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:91be1cf1-f052-413e-bf2e-dfc80f2ce1fd:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running e3d20c62 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command e3d20c62 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command e3d20c62 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4294 (Sun Oct 7 01:39:46 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:47 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "00223732", "local_conf_timestamp": 4294, "host-ts": 4294}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4294 (Sun Oct 7 01:39:46 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4294 (Sun Oct 7 01:39:46 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "66414abe", "local_conf_timestamp": 4294, "host-ts": 4294}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:8da7a617-74ee-4207-a0a4-fe990310dca2:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:8da7a617-74ee-4207-a0a4-fe990310dca2:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running e6d722e4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command e6d722e4 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command e6d722e4 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4304 (Sun Oct 7 01:39:57 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4305 (Sun Oct 7 01:39:57 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "dd1c4c13", "local_conf_timestamp": 4305, "host-ts": 4304}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4304 (Sun Oct 7 01:39:56 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4304 (Sun Oct 7 01:39:56 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "305effe3", "local_conf_timestamp": 4304, "host-ts": 4304}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:b91afc61-0b2c-4eac-9b11-722f765e3ae2:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:b91afc61-0b2c-4eac-9b11-722f765e3ae2:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ea23c182 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command ea23c182 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command ea23c182 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4304 (Sun Oct 7 01:39:57 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4305 (Sun Oct 7 01:39:57 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "dd1c4c13", "local_conf_timestamp": 4305, "host-ts": 4304}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4304 (Sun Oct 7 01:39:56 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4304 (Sun Oct 7 01:39:56 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "305effe3", "local_conf_timestamp": 4304, "host-ts": 4304}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:6fd22ca3-ff2e-4b0c-a7db-16515e9fd894:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:6fd22ca3-ff2e-4b0c-a7db-16515e9fd894:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ed33fcf2 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command ed33fcf2 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command ed33fcf2 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4314 (Sun Oct 7 01:40:06 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:07 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "VM migrated away successfully", "health": "bad", "vm": "down", "detail": "Down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "2cf1fcda", "local_conf_timestamp": 4314, "host-ts": 4314}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4314 (Sun Oct 7 01:40:06 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:06 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "341800e6", "local_conf_timestamp": 4314, "host-ts": 4314}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:c959b4a8-c6f0-406b-8597-07f8364940b6:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:c959b4a8-c6f0-406b-8597-07f8364940b6:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ee40613a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command ee40613a on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command ee40613a on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4314 (Sun Oct 7 01:40:06 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:07 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "VM migrated away successfully", "health": "bad", "vm": "down", "detail": "Down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "2cf1fcda", "local_conf_timestamp": 4314, "host-ts": 4314}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4314 (Sun Oct 7 01:40:06 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4314 (Sun Oct 7 01:40:06 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "341800e6", "local_conf_timestamp": 4314, "host-ts": 4314}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:53853219-0b30-456c-bcd4-ebbfbd2fc3f3:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:53853219-0b30-456c-bcd4-ebbfbd2fc3f3:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running f54ac0ba on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command f54ac0ba on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command f54ac0ba on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4324 (Sun Oct 7 01:40:17 2018)\\nhost-id=1\\nscore=0\\nvm_conf_refresh_time=4325 (Sun Oct 7 01:40:17 2018)\\nconf_on_shared_storage=True\\nmaintenance=True\\nstate=LocalMaintenance\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 0, "stopped": false, "maintenance": true, "crc32": "2f0dbd6e", "local_conf_timestamp": 4325, "host-ts": 4324}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4325 (Sun Oct 7 01:40:17 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4325 (Sun Oct 7 01:40:17 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "fd62238f", "local_conf_timestamp": 4325, "host-ts": 4325}, "global_maintenance": false}\n\nroot: INFO: * Engine has migrated.\nroot: INFO: * Waiting For System Stability...\nlago.ssh: DEBUG: start task:287a25d7-2123-4ad8-a26b-32c2c460170d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:287a25d7-2123-4ad8-a26b-32c2c460170d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running a929c50e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --set-maintenance --mode=none\nlago.ssh: DEBUG: Command a929c50e on lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot: INFO: * Waiting for Engine Maintenance to reset...\nlago.ssh: DEBUG: start task:a4d502a4-4af2-4295-973b-b4796a6266d8:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:a4d502a4-4af2-4295-973b-b4796a6266d8:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ab734e20 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command ab734e20 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command ab734e20 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4634 (Sun Oct 7 01:45:27 2018)\\nhost-id=1\\nscore=0\\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=ReinitializeFSM\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 0, "stopped": false, "maintenance": false, "crc32": "7d32e4c7", "local_conf_timestamp": 4635, "host-ts": 4634}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4635 (Sun Oct 7 01:45:27 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "20c50afa", "local_conf_timestamp": 4635, "host-ts": 4635}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:4bf4be88-50f2-41e1-b6fa-f2f8b3915d32:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:4bf4be88-50f2-41e1-b6fa-f2f8b3915d32:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running ac83f06c on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command ac83f06c on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command ac83f06c on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4634 (Sun Oct 7 01:45:27 2018)\\nhost-id=1\\nscore=0\\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=ReinitializeFSM\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 0, "stopped": false, "maintenance": false, "crc32": "7d32e4c7", "local_conf_timestamp": 4635, "host-ts": 4634}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4635 (Sun Oct 7 01:45:27 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4635 (Sun Oct 7 01:45:27 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "20c50afa", "local_conf_timestamp": 4635, "host-ts": 4635}, "global_maintenance": false}\n\ncli: DEBUG: signal 15 was caught\n--------------------- >> end captured logging << ---------------------'