[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-4.2 - Build # 318 - Still Failing!

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/318/ Build Number: 318 Build Status: Still Failing Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #299 [Ehud Yonasi] ovirt-master.repo: Added new packages to repo file [Sandro Bonazzola] ovirt-iso-uploader: drop 4.1 jobs Changes for Build #300 [Ehud Yonasi] ovirt-master.repo: Added new packages to repo file Changes for Build #301 [Ehud Yonasi] ovirt-master.repo: Added new packages to repo file Changes for Build #302 [Miguel Duarte Barroso] Repos: add python2-ovsdbapp to the reposync config [Sandro Bonazzola] ovirt-iso-uploader: branched for 4.2 Changes for Build #303 [Miguel Duarte Barroso] Repos: add python2-ovsdbapp to the reposync config Changes for Build #304 [Miguel Duarte Barroso] Repos: add python2-ovsdbapp to the reposync config Changes for Build #305 [Miguel Duarte Barroso] Repos: add python2-ovsdbapp to the reposync config [Gal Ben Haim] Add jobs for ovs-cni Changes for Build #306 [Ales Musil] network: syncutil: Improve sync utility with kwargs Changes for Build #307 [Your Name] network: syncutil: Adding doctext Changes for Build #308 [Milan Zamazal] Update test-vm.ovf file Changes for Build #309 [Milan Zamazal] Update test-vm.ovf file Changes for Build #310 [Milan Zamazal] Update test-vm.ovf file Changes for Build #311 [Milan Zamazal] Update test-vm.ovf file Changes for Build #312 [Milan Zamazal] Update test-vm.ovf file Changes for Build #313 [Milan Zamazal] Update test-vm.ovf file Changes for Build #314 [Milan Zamazal] Update test-vm.ovf file Changes for Build #315 [Milan Zamazal] Update test-vm.ovf file Changes for Build #316 [Milan Zamazal] Update test-vm.ovf file [Ehud Yonasi] standard_pipelines: add nmstate project Changes for Build #317 [Milan Zamazal] Update test-vm.ovf file Changes for Build #318 [Milan Zamazal] Update test-vm.ovf file ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 010_local_maintenance_cli.local_maintenance Error Message: 143 -------------------- >> begin captured logging << -------------------- root: INFO: * Waiting For System Stability... lago.ssh: DEBUG: start task:3a9057b5-0d46-453d-828a-62c93bc6e04d:Get ssh client for lago-he-node-ng-suite-4-2-host-1: lago.ssh: DEBUG: end task:3a9057b5-0d46-453d-828a-62c93bc6e04d:Get ssh client for lago-he-node-ng-suite-4-2-host-1: lago.ssh: DEBUG: Running 35969e58 on lago-he-node-ng-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 35969e58 on lago-he-node-ng-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 35969e58 on lago-he-node-ng-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4122 (Mon Sep 17 01:44:18 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=4122 (Mon Sep 17 01:44:18 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e5622a13", "local_conf_timestamp": 4122, "host-ts": 4122}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4123 (Mon Sep 17 01:44:19 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4123 (Mon Sep 17 01:44:19 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "7bfaf70f", "local_conf_timestamp": 4123, "host-ts": 4123}, "global_maintenance": false} lago.ssh: DEBUG: start task:862f7e41-0e59-424e-9872-a8f0390541fc:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:862f7e41-0e59-424e-9872-a8f0390541fc:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 369e5fde on lago-he-node-ng-suite-4-2-host-0: hosted-engine --set-maintenance --mode=local lago.ssh: DEBUG: Command 369e5fde on lago-he-node-ng-suite-4-2-host-0 returned with 0 root: INFO: * Waiting for engine to migrate... lago.ssh: DEBUG: start task:8f5515d2-0568-41f3-9a6a-e4907c5c3ca5:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:8f5515d2-0568-41f3-9a6a-e4907c5c3ca5:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 37c1cc98 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 37c1cc98 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 37c1cc98 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4132 (Mon Sep 17 01:44:28 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=4132 (Mon Sep 17 01:44:29 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "39056a2c", "local_conf_timestamp": 4132, "host-ts": 4132}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4123 (Mon Sep 17 01:44:19 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4123 (Mon Sep 17 01:44:19 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "7bfaf70f", "local_conf_timestamp": 4123, "host-ts": 4123}, "global_maintenance": false} lago.ssh: DEBUG: start task:e16aa9d6-6360-4f41-b63e-655b14133fdd:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:e16aa9d6-6360-4f41-b63e-655b14133fdd:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 3ece46b0 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 3ece46b0 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 3ece46b0 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4143 (Mon Sep 17 01:44:39 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4143 (Mon Sep 17 01:44:39 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "d3800750", "local_conf_timestamp": 4143, "host-ts": 4143}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4133 (Mon Sep 17 01:44:29 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4133 (Mon Sep 17 01:44:30 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "7fbc080a", "local_conf_timestamp": 4133, "host-ts": 4133}, "global_maintenance": false} lago.ssh: DEBUG: start task:bb7317d6-03ba-46bb-97a1-7ca3bc3e7c21:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:bb7317d6-03ba-46bb-97a1-7ca3bc3e7c21:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 42c7a072 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 42c7a072 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 42c7a072 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4143 (Mon Sep 17 01:44:39 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4143 (Mon Sep 17 01:44:39 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "d3800750", "local_conf_timestamp": 4143, "host-ts": 4143}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4133 (Mon Sep 17 01:44:29 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4133 (Mon Sep 17 01:44:30 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "7fbc080a", "local_conf_timestamp": 4133, "host-ts": 4133}, "global_maintenance": false} lago.ssh: DEBUG: start task:c8d8fef3-9778-4db3-adc9-d337677aaa07:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:c8d8fef3-9778-4db3-adc9-d337677aaa07:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 45fcdeb0 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 45fcdeb0 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 45fcdeb0 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4153 (Mon Sep 17 01:44:49 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4153 (Mon Sep 17 01:44:50 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f8c22293", "local_conf_timestamp": 4153, "host-ts": 4153}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4153 (Mon Sep 17 01:44:49 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4153 (Mon Sep 17 01:44:49 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "11173f8c", "local_conf_timestamp": 4153, "host-ts": 4153}, "global_maintenance": false} lago.ssh: DEBUG: start task:cc422b7b-d279-4f59-baaa-00bafb79c24a:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:cc422b7b-d279-4f59-baaa-00bafb79c24a:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 48f9549a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 48f9549a on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 48f9549a on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4153 (Mon Sep 17 01:44:49 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4153 (Mon Sep 17 01:44:50 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f8c22293", "local_conf_timestamp": 4153, "host-ts": 4153}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4153 (Mon Sep 17 01:44:49 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4153 (Mon Sep 17 01:44:49 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "11173f8c", "local_conf_timestamp": 4153, "host-ts": 4153}, "global_maintenance": false} lago.ssh: DEBUG: start task:a1d6c8c4-259b-4e17-b562-ccda653e512b:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:a1d6c8c4-259b-4e17-b562-ccda653e512b:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 4c12a69a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 4c12a69a on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 4c12a69a on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4163 (Mon Sep 17 01:45:00 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4163 (Mon Sep 17 01:45:00 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "d1e66794", "local_conf_timestamp": 4163, "host-ts": 4163}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4163 (Mon Sep 17 01:44:59 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4163 (Mon Sep 17 01:44:59 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1ddc3e83", "local_conf_timestamp": 4163, "host-ts": 4163}, "global_maintenance": false} lago.ssh: DEBUG: start task:66cc91bb-857b-47ac-8dde-5101428c8e7b:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:66cc91bb-857b-47ac-8dde-5101428c8e7b:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 4f00d160 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 4f00d160 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 4f00d160 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4163 (Mon Sep 17 01:45:00 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4163 (Mon Sep 17 01:45:00 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "d1e66794", "local_conf_timestamp": 4163, "host-ts": 4163}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4163 (Mon Sep 17 01:44:59 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4163 (Mon Sep 17 01:44:59 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1ddc3e83", "local_conf_timestamp": 4163, "host-ts": 4163}, "global_maintenance": false} lago.ssh: DEBUG: start task:eadc747f-41a7-43c2-954f-4902d30490b6:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:eadc747f-41a7-43c2-954f-4902d30490b6:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 51fdc6ca on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 51fdc6ca on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 51fdc6ca on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4173 (Mon Sep 17 01:45:09 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4173 (Mon Sep 17 01:45:10 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "7fd55956", "local_conf_timestamp": 4173, "host-ts": 4173}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4173 (Mon Sep 17 01:45:09 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4173 (Mon Sep 17 01:45:10 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "199ac186", "local_conf_timestamp": 4173, "host-ts": 4173}, "global_maintenance": false} lago.ssh: DEBUG: start task:9adefb57-b1d3-47f5-b056-396e0e9564ee:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:9adefb57-b1d3-47f5-b056-396e0e9564ee:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 54fe7b76 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 54fe7b76 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 54fe7b76 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4173 (Mon Sep 17 01:45:09 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4173 (Mon Sep 17 01:45:10 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "7fd55956", "local_conf_timestamp": 4173, "host-ts": 4173}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4173 (Mon Sep 17 01:45:09 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4173 (Mon Sep 17 01:45:10 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "199ac186", "local_conf_timestamp": 4173, "host-ts": 4173}, "global_maintenance": false} lago.ssh: DEBUG: start task:b7125248-2872-44ab-9139-727c58acce96:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:b7125248-2872-44ab-9139-727c58acce96:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 57ea32d0 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 57ea32d0 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 57ea32d0 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4183 (Mon Sep 17 01:45:20 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4183 (Mon Sep 17 01:45:20 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f260084d", "local_conf_timestamp": 4183, "host-ts": 4183}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4183 (Mon Sep 17 01:45:20 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4184 (Mon Sep 17 01:45:20 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0b3d8998", "local_conf_timestamp": 4184, "host-ts": 4183}, "global_maintenance": false} lago.ssh: DEBUG: start task:f4335a15-4d3c-42a0-b0e5-72a886ee3e3a:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:f4335a15-4d3c-42a0-b0e5-72a886ee3e3a:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 5ad03cec on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 5ad03cec on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 5ad03cec on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4183 (Mon Sep 17 01:45:20 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4183 (Mon Sep 17 01:45:20 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f260084d", "local_conf_timestamp": 4183, "host-ts": 4183}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4183 (Mon Sep 17 01:45:20 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4184 (Mon Sep 17 01:45:20 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0b3d8998", "local_conf_timestamp": 4184, "host-ts": 4183}, "global_maintenance": false} lago.ssh: DEBUG: start task:944d0be0-394f-4e58-9b55-89f3385fbd50:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:944d0be0-394f-4e58-9b55-89f3385fbd50:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 5e02c3ee on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 5e02c3ee on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 5e02c3ee on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4193 (Mon Sep 17 01:45:30 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4194 (Mon Sep 17 01:45:30 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c237a32c", "local_conf_timestamp": 4194, "host-ts": 4193}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4193 (Mon Sep 17 01:45:29 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4193 (Mon Sep 17 01:45:29 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "911fe33e", "local_conf_timestamp": 4193, "host-ts": 4193}, "global_maintenance": false} cli: DEBUG: signal 15 was caught --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/010_local_maintenance_cli.py", line 125, in local_maintenance _wait_for_engine_migration(host, he_index, "bad", "Migration Destination") File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/010_local_maintenance_cli.py", line 36, in _wait_for_engine_migration testlib.assert_true_within_long(lambda: _get_he_status(host) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long assert_equals_within_long(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 246, in assert_equals_within time.sleep(3) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in exit_handler sys.exit(128 + signum) '143\n-------------------- >> begin captured logging << --------------------\nroot: INFO: * Waiting For System Stability...\nlago.ssh: DEBUG: start task:3a9057b5-0d46-453d-828a-62c93bc6e04d:Get ssh client for lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:3a9057b5-0d46-453d-828a-62c93bc6e04d:Get ssh client for lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 35969e58 on lago-he-node-ng-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 35969e58 on lago-he-node-ng-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 35969e58 on lago-he-node-ng-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4122 (Mon Sep 17 01:44:18 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=4122 (Mon Sep 17 01:44:18 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e5622a13", "local_conf_timestamp": 4122, "host-ts": 4122}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4123 (Mon Sep 17 01:44:19 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4123 (Mon Sep 17 01:44:19 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "7bfaf70f", "local_conf_timestamp": 4123, "host-ts": 4123}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:862f7e41-0e59-424e-9872-a8f0390541fc:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:862f7e41-0e59-424e-9872-a8f0390541fc:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 369e5fde on lago-he-node-ng-suite-4-2-host-0: hosted-engine --set-maintenance --mode=local\nlago.ssh: DEBUG: Command 369e5fde on lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot: INFO: * Waiting for engine to migrate...\nlago.ssh: DEBUG: start task:8f5515d2-0568-41f3-9a6a-e4907c5c3ca5:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:8f5515d2-0568-41f3-9a6a-e4907c5c3ca5:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 37c1cc98 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 37c1cc98 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 37c1cc98 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4132 (Mon Sep 17 01:44:28 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=4132 (Mon Sep 17 01:44:29 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "39056a2c", "local_conf_timestamp": 4132, "host-ts": 4132}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4123 (Mon Sep 17 01:44:19 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4123 (Mon Sep 17 01:44:19 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "7bfaf70f", "local_conf_timestamp": 4123, "host-ts": 4123}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:e16aa9d6-6360-4f41-b63e-655b14133fdd:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:e16aa9d6-6360-4f41-b63e-655b14133fdd:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 3ece46b0 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 3ece46b0 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 3ece46b0 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4143 (Mon Sep 17 01:44:39 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4143 (Mon Sep 17 01:44:39 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "d3800750", "local_conf_timestamp": 4143, "host-ts": 4143}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4133 (Mon Sep 17 01:44:29 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4133 (Mon Sep 17 01:44:30 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "7fbc080a", "local_conf_timestamp": 4133, "host-ts": 4133}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:bb7317d6-03ba-46bb-97a1-7ca3bc3e7c21:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:bb7317d6-03ba-46bb-97a1-7ca3bc3e7c21:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 42c7a072 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 42c7a072 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 42c7a072 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4143 (Mon Sep 17 01:44:39 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4143 (Mon Sep 17 01:44:39 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "d3800750", "local_conf_timestamp": 4143, "host-ts": 4143}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4133 (Mon Sep 17 01:44:29 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4133 (Mon Sep 17 01:44:30 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "7fbc080a", "local_conf_timestamp": 4133, "host-ts": 4133}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:c8d8fef3-9778-4db3-adc9-d337677aaa07:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:c8d8fef3-9778-4db3-adc9-d337677aaa07:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 45fcdeb0 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 45fcdeb0 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 45fcdeb0 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4153 (Mon Sep 17 01:44:49 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4153 (Mon Sep 17 01:44:50 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f8c22293", "local_conf_timestamp": 4153, "host-ts": 4153}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4153 (Mon Sep 17 01:44:49 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4153 (Mon Sep 17 01:44:49 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "11173f8c", "local_conf_timestamp": 4153, "host-ts": 4153}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:cc422b7b-d279-4f59-baaa-00bafb79c24a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:cc422b7b-d279-4f59-baaa-00bafb79c24a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 48f9549a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 48f9549a on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 48f9549a on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4153 (Mon Sep 17 01:44:49 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4153 (Mon Sep 17 01:44:50 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f8c22293", "local_conf_timestamp": 4153, "host-ts": 4153}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4153 (Mon Sep 17 01:44:49 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4153 (Mon Sep 17 01:44:49 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "11173f8c", "local_conf_timestamp": 4153, "host-ts": 4153}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:a1d6c8c4-259b-4e17-b562-ccda653e512b:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:a1d6c8c4-259b-4e17-b562-ccda653e512b:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 4c12a69a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 4c12a69a on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 4c12a69a on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4163 (Mon Sep 17 01:45:00 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4163 (Mon Sep 17 01:45:00 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "d1e66794", "local_conf_timestamp": 4163, "host-ts": 4163}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4163 (Mon Sep 17 01:44:59 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4163 (Mon Sep 17 01:44:59 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1ddc3e83", "local_conf_timestamp": 4163, "host-ts": 4163}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:66cc91bb-857b-47ac-8dde-5101428c8e7b:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:66cc91bb-857b-47ac-8dde-5101428c8e7b:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 4f00d160 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 4f00d160 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 4f00d160 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4163 (Mon Sep 17 01:45:00 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4163 (Mon Sep 17 01:45:00 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "d1e66794", "local_conf_timestamp": 4163, "host-ts": 4163}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4163 (Mon Sep 17 01:44:59 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4163 (Mon Sep 17 01:44:59 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "1ddc3e83", "local_conf_timestamp": 4163, "host-ts": 4163}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:eadc747f-41a7-43c2-954f-4902d30490b6:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:eadc747f-41a7-43c2-954f-4902d30490b6:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 51fdc6ca on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 51fdc6ca on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 51fdc6ca on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4173 (Mon Sep 17 01:45:09 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4173 (Mon Sep 17 01:45:10 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "7fd55956", "local_conf_timestamp": 4173, "host-ts": 4173}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4173 (Mon Sep 17 01:45:09 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4173 (Mon Sep 17 01:45:10 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "199ac186", "local_conf_timestamp": 4173, "host-ts": 4173}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:9adefb57-b1d3-47f5-b056-396e0e9564ee:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:9adefb57-b1d3-47f5-b056-396e0e9564ee:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 54fe7b76 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 54fe7b76 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 54fe7b76 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4173 (Mon Sep 17 01:45:09 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4173 (Mon Sep 17 01:45:10 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "7fd55956", "local_conf_timestamp": 4173, "host-ts": 4173}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4173 (Mon Sep 17 01:45:09 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4173 (Mon Sep 17 01:45:10 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "199ac186", "local_conf_timestamp": 4173, "host-ts": 4173}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:b7125248-2872-44ab-9139-727c58acce96:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:b7125248-2872-44ab-9139-727c58acce96:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 57ea32d0 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 57ea32d0 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 57ea32d0 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4183 (Mon Sep 17 01:45:20 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4183 (Mon Sep 17 01:45:20 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f260084d", "local_conf_timestamp": 4183, "host-ts": 4183}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4183 (Mon Sep 17 01:45:20 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4184 (Mon Sep 17 01:45:20 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0b3d8998", "local_conf_timestamp": 4184, "host-ts": 4183}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:f4335a15-4d3c-42a0-b0e5-72a886ee3e3a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:f4335a15-4d3c-42a0-b0e5-72a886ee3e3a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 5ad03cec on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 5ad03cec on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 5ad03cec on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4183 (Mon Sep 17 01:45:20 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4183 (Mon Sep 17 01:45:20 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f260084d", "local_conf_timestamp": 4183, "host-ts": 4183}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4183 (Mon Sep 17 01:45:20 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4184 (Mon Sep 17 01:45:20 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0b3d8998", "local_conf_timestamp": 4184, "host-ts": 4183}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:944d0be0-394f-4e58-9b55-89f3385fbd50:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:944d0be0-394f-4e58-9b55-89f3385fbd50:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 5e02c3ee on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 5e02c3ee on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 5e02c3ee on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4193 (Mon Sep 17 01:45:30 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4194 (Mon Sep 17 01:45:30 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c237a32c", "local_conf_timestamp": 4194, "host-ts": 4193}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4193 (Mon Sep 17 01:45:29 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4193 (Mon Sep 17 01:45:29 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "911fe33e", "local_conf_timestamp": 4193, "host-ts": 4193}, "global_maintenance": false}\n\ncli: DEBUG: signal 15 was caught\n--------------------- >> end captured logging << ---------------------'