- Infra - oVirt List Archives

[oVirt Jenkins] ovirt-system-tests_he-basic-iscsi-suite-4.2 - Build # 136 - Failure!
by jenkins＠jenkins.phx.ovirt.org 18 Jul '18

18 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-4.2/13… Build Number: 136 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #136 [Milan Zamazal] Add basic-suite-compat-master ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 008_restart_he_vm.clear_global_maintenance Error Message: False != True after 180 seconds -------------------- >> begin captured logging << -------------------- lago.ssh: DEBUG: start task:15ccab7d-106b-4b4d-95b2-ce1dfa23366e:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:15ccab7d-106b-4b4d-95b2-ce1dfa23366e:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 0e77e8ea on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --set-maintenance --mode=none lago.ssh: DEBUG: Command 0e77e8ea on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: start task:a1659d8b-d08b-49d8-a36a-ba5721b70b27:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:a1659d8b-d08b-49d8-a36a-ba5721b70b27:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 0f18dbb0 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 0f18dbb0 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 0f18dbb0 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3084 (Wed Jul 18 09:11:12 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3086 (Wed Jul 18 09:11:15 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "941291e0", "local_conf_timestamp": 3086, "host-ts": 3084}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3088 (Wed Jul 18 09:11:16 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3089 (Wed Jul 18 09:11:17 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "f69cb9ec", "local_conf_timestamp": 3089, "host-ts": 3088}, "global_maintenance": true} lago.ssh: DEBUG: start task:34d3fd30-f2f7-432b-920a-022658886559:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:34d3fd30-f2f7-432b-920a-022658886559:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 15e0de84 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 15e0de84 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 15e0de84 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3094 (Wed Jul 18 09:11:23 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3096 (Wed Jul 18 09:11:25 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f90f5a34", "local_conf_timestamp": 3096, "host-ts": 3094}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3098 (Wed Jul 18 09:11:27 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3100 (Wed Jul 18 09:11:28 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a50fda97", "local_conf_timestamp": 3100, "host-ts": 3098}, "global_maintenance": true} lago.ssh: DEBUG: start task:ad7780e2-3a1f-488f-a117-7a2e8a6f96dd:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:ad7780e2-3a1f-488f-a117-7a2e8a6f96dd:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 18337cd2 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 18337cd2 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 18337cd2 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3094 (Wed Jul 18 09:11:23 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3096 (Wed Jul 18 09:11:25 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f90f5a34", "local_conf_timestamp": 3096, "host-ts": 3094}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3098 (Wed Jul 18 09:11:27 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3100 (Wed Jul 18 09:11:28 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a50fda97", "local_conf_timestamp": 3100, "host-ts": 3098}, "global_maintenance": true} lago.ssh: DEBUG: start task:25014fed-2416-40ea-bcb7-ad65d6d17157:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:25014fed-2416-40ea-bcb7-ad65d6d17157:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 1a9a025c on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 1a9a025c on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 1a9a025c on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3104 (Wed Jul 18 09:11:32 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3105 (Wed Jul 18 09:11:33 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "52c4997e", "local_conf_timestamp": 3105, "host-ts": 3104}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3108 (Wed Jul 18 09:11:36 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3109 (Wed Jul 18 09:11:38 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e80b2994", "local_conf_timestamp": 3109, "host-ts": 3108}, "global_maintenance": true} lago.ssh: DEBUG: start task:6ea72486-d2a0-473e-8a57-bf803749dbeb:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:6ea72486-d2a0-473e-8a57-bf803749dbeb:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 1cf379c0 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 1cf379c0 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 1cf379c0 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3104 (Wed Jul 18 09:11:32 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3105 (Wed Jul 18 09:11:33 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "52c4997e", "local_conf_timestamp": 3105, "host-ts": 3104}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3108 (Wed Jul 18 09:11:36 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3109 (Wed Jul 18 09:11:38 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e80b2994", "local_conf_timestamp": 3109, "host-ts": 3108}, "global_maintenance": true} lago.ssh: DEBUG: start task:4dd7a176-6380-40a6-bee6-6d259c976218:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:4dd7a176-6380-40a6-bee6-6d259c976218:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 1f551db8 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 1f551db8 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 1f551db8 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3104 (Wed Jul 18 09:11:32 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3105 (Wed Jul 18 09:11:33 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "52c4997e", "local_conf_timestamp": 3105, "host-ts": 3104}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3108 (Wed Jul 18 09:11:36 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3109 (Wed Jul 18 09:11:38 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e80b2994", "local_conf_timestamp": 3109, "host-ts": 3108}, "global_maintenance": true} lago.ssh: DEBUG: start task:e46da9b9-a030-46b9-bc27-0931971187f3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:e46da9b9-a030-46b9-bc27-0931971187f3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 21af0704 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 21af0704 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 21af0704 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3114 (Wed Jul 18 09:11:43 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3115 (Wed Jul 18 09:11:44 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3fd952aa", "local_conf_timestamp": 3115, "host-ts": 3114}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3118 (Wed Jul 18 09:11:47 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3120 (Wed Jul 18 09:11:48 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "40b5c852", "local_conf_timestamp": 3120, "host-ts": 3118}, "global_maintenance": true} lago.ssh: DEBUG: start task:80fea0ca-925d-4596-969f-6fafa82613f0:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:80fea0ca-925d-4596-969f-6fafa82613f0:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 2400fcf6 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 2400fcf6 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 2400fcf6 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3114 (Wed Jul 18 09:11:43 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3115 (Wed Jul 18 09:11:44 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3fd952aa", "local_conf_timestamp": 3115, "host-ts": 3114}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3118 (Wed Jul 18 09:11:47 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3120 (Wed Jul 18 09:11:48 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "40b5c852", "local_conf_timestamp": 3120, "host-ts": 3118}, "global_maintenance": true} lago.ssh: DEBUG: start task:5b8166e3-5b36-44db-bc42-6a88e72a8552:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:5b8166e3-5b36-44db-bc42-6a88e72a8552:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 26606bda on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 26606bda on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 26606bda on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3114 (Wed Jul 18 09:11:43 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3115 (Wed Jul 18 09:11:44 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3fd952aa", "local_conf_timestamp": 3115, "host-ts": 3114}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3118 (Wed Jul 18 09:11:47 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3120 (Wed Jul 18 09:11:48 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "40b5c852", "local_conf_timestamp": 3120, "host-ts": 3118}, "global_maintenance": true} lago.ssh: DEBUG: start task:d8cc3c5a-b0d8-4186-90df-91775cea0ac3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:d8cc3c5a-b0d8-4186-90df-91775cea0ac3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 28c43fe6 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 28c43fe6 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 28c43fe6 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3124 (Wed Jul 18 09:11:52 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3125 (Wed Jul 18 09:11:53 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "88ff0ed6", "local_conf_timestamp": 3125, "host-ts": 3124}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3129 (Wed Jul 18 09:11:57 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3130 (Wed Jul 18 09:11:59 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "901341fa", "local_conf_timestamp": 3130, "host-ts": 3129}, "global_maintenance": true} lago.ssh: DEBUG: start task:c32033d7-f5e4-4252-afb6-27596b37bb3c:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:c32033d7-f5e4-4252-afb6-27596b37bb3c:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 2b1d6880 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 2b1d6880 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 2b1d6880 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3124 (Wed Jul 18 09:11:52 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3125 (Wed Jul 18 09:11:53 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "88ff0ed6", "local_conf_timestamp": 3125, "host-ts": 3124}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3129 (Wed Jul 18 09:11:57 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3130 (Wed Jul 18 09:11:59 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "901341fa", "local_conf_timestamp": 3130, "host-ts": 3129}, "global_maintenance": true} lago.ssh: DEBUG: start task:ee7c6357-7275-42f0-b5bc-a598e6d1a4f6:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:ee7c6357-7275-42f0-b5bc-a598e6d1a4f6:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 2d746944 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 2d746944 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 2d746944 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3134 (Wed Jul 18 09:12:03 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3135 (Wed Jul 18 09:12:04 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e5e2c502", "local_conf_timestamp": 3135, "host-ts": 3134}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3139 (Wed Jul 18 09:12:07 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3140 (Wed Jul 18 09:12:08 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "3c06ecdd", "local_conf_timestamp": 3140, "host-ts": 3139}, "global_maintenance": true} lago.ssh: DEBUG: start task:e8d073f3-a6a2-40fc-9e7c-ea0fc1c7cde9:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:e8d073f3-a6a2-40fc-9e7c-ea0fc1c7cde9:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 2fda5b76 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 2fda5b76 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 2fda5b76 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3134 (Wed Jul 18 09:12:03 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3135 (Wed Jul 18 09:12:04 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e5e2c502", "local_conf_timestamp": 3135, "host-ts": 3134}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3139 (Wed Jul 18 09:12:07 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3140 (Wed Jul 18 09:12:08 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "3c06ecdd", "local_conf_timestamp": 3140, "host-ts": 3139}, "global_maintenance": true} lago.ssh: DEBUG: start task:9ffa1747-8783-4db9-b45e-c29956ed6eb7:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:9ffa1747-8783-4db9-b45e-c29956ed6eb7:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 32366d06 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 32366d06 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 32366d06 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3134 (Wed Jul 18 09:12:03 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3135 (Wed Jul 18 09:12:04 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e5e2c502", "local_conf_timestamp": 3135, "host-ts": 3134}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3139 (Wed Jul 18 09:12:07 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3140 (Wed Jul 18 09:12:08 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "3c06ecdd", "local_conf_timestamp": 3140, "host-ts": 3139}, "global_maintenance": true} lago.ssh: DEBUG: start task:bd7d0591-1e53-46fc-b16c-49eb90583fe3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:bd7d0591-1e53-46fc-b16c-49eb90583fe3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 349ba110 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 349ba110 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 349ba110 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3144 (Wed Jul 18 09:12:12 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3145 (Wed Jul 18 09:12:14 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3dc2b06f", "local_conf_timestamp": 3145, "host-ts": 3144}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3149 (Wed Jul 18 09:12:17 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3150 (Wed Jul 18 09:12:19 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e02274ff", "local_conf_timestamp": 3150, "host-ts": 3149}, "global_maintenance": true} lago.ssh: DEBUG: start task:1f80d5c0-d005-4c54-875c-491af599b7b2:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:1f80d5c0-d005-4c54-875c-491af599b7b2:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 36f60144 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 36f60144 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 36f60144 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3144 (Wed Jul 18 09:12:12 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3145 (Wed Jul 18 09:12:14 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3dc2b06f", "local_conf_timestamp": 3145, "host-ts": 3144}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3149 (Wed Jul 18 09:12:17 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3150 (Wed Jul 18 09:12:19 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e02274ff", "local_conf_timestamp": 3150, "host-ts": 3149}, "global_maintenance": true} lago.ssh: DEBUG: start task:c5b3a63e-7360-4277-b376-7d3f4f881b93:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:c5b3a63e-7360-4277-b376-7d3f4f881b93:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 3957bcd4 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 3957bcd4 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 3957bcd4 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3154 (Wed Jul 18 09:12:23 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3156 (Wed Jul 18 09:12:24 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c9d62a01", "local_conf_timestamp": 3156, "host-ts": 3154}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3149 (Wed Jul 18 09:12:17 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3150 (Wed Jul 18 09:12:19 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e02274ff", "local_conf_timestamp": 3150, "host-ts": 3149}, "global_maintenance": true} lago.ssh: DEBUG: start task:8de3c2fc-8610-4306-87f0-561d5b2c6eeb:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:8de3c2fc-8610-4306-87f0-561d5b2c6eeb:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 3be3733a on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 3be3733a on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 3be3733a on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3154 (Wed Jul 18 09:12:23 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3156 (Wed Jul 18 09:12:24 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c9d62a01", "local_conf_timestamp": 3156, "host-ts": 3154}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3159 (Wed Jul 18 09:12:28 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3161 (Wed Jul 18 09:12:29 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "5f5c2c4a", "local_conf_timestamp": 3161, "host-ts": 3159}, "global_maintenance": true} lago.ssh: DEBUG: start task:b2823e06-aac4-490a-a062-ef0079d35e7d:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:b2823e06-aac4-490a-a062-ef0079d35e7d:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 3e48d7fa on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 3e48d7fa on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 3e48d7fa on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3154 (Wed Jul 18 09:12:23 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3156 (Wed Jul 18 09:12:24 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c9d62a01", "local_conf_timestamp": 3156, "host-ts": 3154}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3159 (Wed Jul 18 09:12:28 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3161 (Wed Jul 18 09:12:29 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "5f5c2c4a", "local_conf_timestamp": 3161, "host-ts": 3159}, "global_maintenance": true} lago.ssh: DEBUG: start task:1b0ae1ee-3f60-40fe-8184-fb658b662138:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:1b0ae1ee-3f60-40fe-8184-fb658b662138:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 40eb2f6c on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 40eb2f6c on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 40eb2f6c on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3164 (Wed Jul 18 09:12:32 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3165 (Wed Jul 18 09:12:34 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e7f927c7", "local_conf_timestamp": 3165, "host-ts": 3164}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3169 (Wed Jul 18 09:12:37 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3170 (Wed Jul 18 09:12:38 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "cfcd67fc", "local_conf_timestamp": 3170, "host-ts": 3169}, "global_maintenance": true} lago.ssh: DEBUG: start task:47bdd477-6f0a-4cdd-9475-7d15348c3639:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:47bdd477-6f0a-4cdd-9475-7d15348c3639:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 43462b54 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 43462b54 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 43462b54 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3164 (Wed Jul 18 09:12:32 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3165 (Wed Jul 18 09:12:34 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e7f927c7", "local_conf_timestamp": 3165, "host-ts": 3164}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3169 (Wed Jul 18 09:12:37 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3170 (Wed Jul 18 09:12:38 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "cfcd67fc", "local_conf_timestamp": 3170, "host-ts": 3169}, "global_maintenance": true} lago.ssh: DEBUG: start task:4f149310-7fed-4e2c-9f24-e9c5461b98c7:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:4f149310-7fed-4e2c-9f24-e9c5461b98c7:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 45a29cac on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 45a29cac on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 45a29cac on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3174 (Wed Jul 18 09:12:43 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3176 (Wed Jul 18 09:12:44 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "13edbda9", "local_conf_timestamp": 3176, "host-ts": 3174}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3179 (Wed Jul 18 09:12:47 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3181 (Wed Jul 18 09:12:49 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "dc067045", "local_conf_timestamp": 3181, "host-ts": 3179}, "global_maintenance": true} lago.ssh: DEBUG: start task:171fc35c-3326-42cb-b9ed-13e1143d482e:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:171fc35c-3326-42cb-b9ed-13e1143d482e:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 48003126 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 48003126 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 48003126 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3174 (Wed Jul 18 09:12:43 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3176 (Wed Jul 18 09:12:44 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "13edbda9", "local_conf_timestamp": 3176, "host-ts": 3174}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3179 (Wed Jul 18 09:12:47 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3181 (Wed Jul 18 09:12:49 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "dc067045", "local_conf_timestamp": 3181, "host-ts": 3179}, "global_maintenance": true} lago.ssh: DEBUG: start task:503c37d7-2145-4ea4-b48b-479bac426729:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:503c37d7-2145-4ea4-b48b-479bac426729:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 4a6e21ca on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 4a6e21ca on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 4a6e21ca on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3174 (Wed Jul 18 09:12:43 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3176 (Wed Jul 18 09:12:44 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "13edbda9", "local_conf_timestamp": 3176, "host-ts": 3174}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3179 (Wed Jul 18 09:12:47 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3181 (Wed Jul 18 09:12:49 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "dc067045", "local_conf_timestamp": 3181, "host-ts": 3179}, "global_maintenance": true} lago.ssh: DEBUG: start task:e86dd41b-f6bb-49e1-bc32-5aa61e8029c7:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:e86dd41b-f6bb-49e1-bc32-5aa61e8029c7:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 4cdc98e2 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 4cdc98e2 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 4cdc98e2 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3184 (Wed Jul 18 09:12:52 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3185 (Wed Jul 18 09:12:54 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8cc8cb5c", "local_conf_timestamp": 3185, "host-ts": 3184}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3189 (Wed Jul 18 09:12:57 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3190 (Wed Jul 18 09:12:59 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "00401ef5", "local_conf_timestamp": 3190, "host-ts": 3189}, "global_maintenance": true} lago.ssh: DEBUG: start task:8390f130-4999-453a-bb46-21e5a7ddb3f1:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:8390f130-4999-453a-bb46-21e5a7ddb3f1:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 4f464876 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 4f464876 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 4f464876 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3184 (Wed Jul 18 09:12:52 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3185 (Wed Jul 18 09:12:54 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8cc8cb5c", "local_conf_timestamp": 3185, "host-ts": 3184}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3189 (Wed Jul 18 09:12:57 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3190 (Wed Jul 18 09:12:59 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "00401ef5", "local_conf_timestamp": 3190, "host-ts": 3189}, "global_maintenance": true} lago.ssh: DEBUG: start task:fb33bb18-1b65-46f3-8af8-eeb6a392a72c:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:fb33bb18-1b65-46f3-8af8-eeb6a392a72c:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 51b411a6 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 51b411a6 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 51b411a6 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3194 (Wed Jul 18 09:13:02 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3195 (Wed Jul 18 09:13:03 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e1d50088", "local_conf_timestamp": 3195, "host-ts": 3194}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3199 (Wed Jul 18 09:13:08 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3201 (Wed Jul 18 09:13:09 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "47971093", "local_conf_timestamp": 3201, "host-ts": 3199}, "global_maintenance": true} lago.ssh: DEBUG: start task:7bdd9889-7191-4dbc-aebb-b236d9797fee:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:7bdd9889-7191-4dbc-aebb-b236d9797fee:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 541e759e on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 541e759e on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 541e759e on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3194 (Wed Jul 18 09:13:02 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3195 (Wed Jul 18 09:13:03 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e1d50088", "local_conf_timestamp": 3195, "host-ts": 3194}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3199 (Wed Jul 18 09:13:08 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3201 (Wed Jul 18 09:13:09 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "47971093", "local_conf_timestamp": 3201, "host-ts": 3199}, "global_maintenance": true} lago.ssh: DEBUG: start task:a80f8f50-266b-41e6-9f71-3f4af26fd8cb:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:a80f8f50-266b-41e6-9f71-3f4af26fd8cb:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 568077b0 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 568077b0 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 568077b0 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3194 (Wed Jul 18 09:13:02 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3195 (Wed Jul 18 09:13:03 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e1d50088", "local_conf_timestamp": 3195, "host-ts": 3194}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3199 (Wed Jul 18 09:13:08 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3201 (Wed Jul 18 09:13:09 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "47971093", "local_conf_timestamp": 3201, "host-ts": 3199}, "global_maintenance": true} lago.ssh: DEBUG: start task:8962e5e9-d38c-41bf-a967-711df46f9878:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:8962e5e9-d38c-41bf-a967-711df46f9878:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 58f2c57a on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 58f2c57a on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 58f2c57a on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3204 (Wed Jul 18 09:13:12 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3205 (Wed Jul 18 09:13:14 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0bc08235", "local_conf_timestamp": 3205, "host-ts": 3204}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3209 (Wed Jul 18 09:13:17 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3210 (Wed Jul 18 09:13:19 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "87f13024", "local_conf_timestamp": 3210, "host-ts": 3209}, "global_maintenance": true} lago.ssh: DEBUG: start task:55f51fc1-90ea-4146-b762-373c884f8bed:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:55f51fc1-90ea-4146-b762-373c884f8bed:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 5b4c5200 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 5b4c5200 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 5b4c5200 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3204 (Wed Jul 18 09:13:12 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3205 (Wed Jul 18 09:13:14 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0bc08235", "local_conf_timestamp": 3205, "host-ts": 3204}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3209 (Wed Jul 18 09:13:17 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3210 (Wed Jul 18 09:13:19 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "87f13024", "local_conf_timestamp": 3210, "host-ts": 3209}, "global_maintenance": true} lago.ssh: DEBUG: start task:dabfb3de-c763-4318-8856-63703d62e124:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:dabfb3de-c763-4318-8856-63703d62e124:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 5db2bc82 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 5db2bc82 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 5db2bc82 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3214 (Wed Jul 18 09:13:23 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3216 (Wed Jul 18 09:13:24 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "ffd4185b", "local_conf_timestamp": 3216, "host-ts": 3214}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3219 (Wed Jul 18 09:13:27 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3220 (Wed Jul 18 09:13:28 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "4f885807", "local_conf_timestamp": 3220, "host-ts": 3219}, "global_maintenance": true} lago.ssh: DEBUG: start task:4d2c9a76-a2d3-492a-9750-cf1521b3b885:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:4d2c9a76-a2d3-492a-9750-cf1521b3b885:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 600541bc on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 600541bc on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 600541bc on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3214 (Wed Jul 18 09:13:23 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3216 (Wed Jul 18 09:13:24 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "ffd4185b", "local_conf_timestamp": 3216, "host-ts": 3214}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3219 (Wed Jul 18 09:13:27 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3220 (Wed Jul 18 09:13:28 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "4f885807", "local_conf_timestamp": 3220, "host-ts": 3219}, "global_maintenance": true} lago.ssh: DEBUG: start task:68189bb7-b483-4cd9-87db-30428f466083:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:68189bb7-b483-4cd9-87db-30428f466083:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 626d7a78 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 626d7a78 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 626d7a78 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3224 (Wed Jul 18 09:13:32 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3225 (Wed Jul 18 09:13:33 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "d1fb159d", "local_conf_timestamp": 3225, "host-ts": 3224}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3219 (Wed Jul 18 09:13:27 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3220 (Wed Jul 18 09:13:28 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "4f885807", "local_conf_timestamp": 3220, "host-ts": 3219}, "global_maintenance": true} lago.ssh: DEBUG: start task:fef83987-fe3e-4535-93af-b88a25e33f8b:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:fef83987-fe3e-4535-93af-b88a25e33f8b:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 651100ec on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 651100ec on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 651100ec on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3224 (Wed Jul 18 09:13:32 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3225 (Wed Jul 18 09:13:33 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "d1fb159d", "local_conf_timestamp": 3225, "host-ts": 3224}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3229 (Wed Jul 18 09:13:38 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3231 (Wed Jul 18 09:13:39 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "df1913b1", "local_conf_timestamp": 3231, "host-ts": 3229}, "global_maintenance": true} lago.ssh: DEBUG: start task:e2d6c6c6-2f24-49fc-bb4e-070f68966b93:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:e2d6c6c6-2f24-49fc-bb4e-070f68966b93:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 6774065e on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 6774065e on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 6774065e on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3224 (Wed Jul 18 09:13:32 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3225 (Wed Jul 18 09:13:33 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "d1fb159d", "local_conf_timestamp": 3225, "host-ts": 3224}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3229 (Wed Jul 18 09:13:38 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3231 (Wed Jul 18 09:13:39 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "df1913b1", "local_conf_timestamp": 3231, "host-ts": 3229}, "global_maintenance": true} lago.ssh: DEBUG: start task:003b8141-4943-40c0-b8ed-6800a2c08852:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:003b8141-4943-40c0-b8ed-6800a2c08852:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 69d4ea58 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 69d4ea58 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 69d4ea58 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3234 (Wed Jul 18 09:13:43 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3235 (Wed Jul 18 09:13:44 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "bce6de49", "local_conf_timestamp": 3235, "host-ts": 3234}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3239 (Wed Jul 18 09:13:47 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3240 (Wed Jul 18 09:13:49 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "040b8e00", "local_conf_timestamp": 3240, "host-ts": 3239}, "global_maintenance": true} lago.ssh: DEBUG: start task:301c74fb-94ea-4fa1-93a8-6485430d1d51:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:301c74fb-94ea-4fa1-93a8-6485430d1d51:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 6c2ae2f8 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 6c2ae2f8 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 6c2ae2f8 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3234 (Wed Jul 18 09:13:43 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3235 (Wed Jul 18 09:13:44 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "bce6de49", "local_conf_timestamp": 3235, "host-ts": 3234}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3239 (Wed Jul 18 09:13:47 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3240 (Wed Jul 18 09:13:49 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "040b8e00", "local_conf_timestamp": 3240, "host-ts": 3239}, "global_maintenance": true} lago.ssh: DEBUG: start task:93ddbb97-86e2-48e9-9f01-58907bfe4361:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:93ddbb97-86e2-48e9-9f01-58907bfe4361:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 6e917a34 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 6e917a34 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 6e917a34 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3244 (Wed Jul 18 09:13:52 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3245 (Wed Jul 18 09:13:53 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "64c6ab24", "local_conf_timestamp": 3245, "host-ts": 3244}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3249 (Wed Jul 18 09:13:57 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3250 (Wed Jul 18 09:13:58 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d82f1622", "local_conf_timestamp": 3250, "host-ts": 3249}, "global_maintenance": true} lago.ssh: DEBUG: start task:7f848a13-9bd4-41d9-b8ef-494de3545e5a:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:7f848a13-9bd4-41d9-b8ef-494de3545e5a:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 710498fa on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 710498fa on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 710498fa on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3244 (Wed Jul 18 09:13:52 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3245 (Wed Jul 18 09:13:53 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "64c6ab24", "local_conf_timestamp": 3245, "host-ts": 3244}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3249 (Wed Jul 18 09:13:57 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3250 (Wed Jul 18 09:13:58 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d82f1622", "local_conf_timestamp": 3250, "host-ts": 3249}, "global_maintenance": true} lago.ssh: DEBUG: start task:9dd7b6f0-ba5b-482d-a54e-eddef4911114:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:9dd7b6f0-ba5b-482d-a54e-eddef4911114:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 7362045c on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 7362045c on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 7362045c on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3244 (Wed Jul 18 09:13:52 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3245 (Wed Jul 18 09:13:53 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "64c6ab24", "local_conf_timestamp": 3245, "host-ts": 3244}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3249 (Wed Jul 18 09:13:57 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3250 (Wed Jul 18 09:13:58 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d82f1622", "local_conf_timestamp": 3250, "host-ts": 3249}, "global_maintenance": true} lago.ssh: DEBUG: start task:3704d426-12e9-4ff9-a3ad-9e6c789c9ad3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:3704d426-12e9-4ff9-a3ad-9e6c789c9ad3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 75bf955c on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 75bf955c on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 75bf955c on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3254 (Wed Jul 18 09:14:03 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3255 (Wed Jul 18 09:14:04 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "09db60f0", "local_conf_timestamp": 3255, "host-ts": 3254}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3259 (Wed Jul 18 09:14:08 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3261 (Wed Jul 18 09:14:09 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "67514e97", "local_conf_timestamp": 3261, "host-ts": 3259}, "global_maintenance": true} lago.ssh: DEBUG: start task:fdd17b68-9c2d-407a-af6f-db0b31f320a0:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: end task:fdd17b68-9c2d-407a-af6f-db0b31f320a0:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1: lago.ssh: DEBUG: Running 782d00f4 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 782d00f4 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 782d00f4 on lago-he-basic-iscsi-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3254 (Wed Jul 18 09:14:03 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=3255 (Wed Jul 18 09:14:04 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "09db60f0", "local_conf_timestamp": 3255, "host-ts": 3254}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=3259 (Wed Jul 18 09:14:08 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=3261 (Wed Jul 18 09:14:09 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=GlobalMaintenance\nstopped=False\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "67514e97", "local_conf_timestamp": 3261, "host-ts": 3259}, "global_maintenance": true} --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-basic-iscsi-suite-4.2/ovirt-system-tests/he-basic-iscsi-suite-4.2/test-scenarios/008_restart_he_vm.py", line 77, in clear_global_maintenance lambda: _get_he_status(host)['global_maintenance'] is False File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 267, in assert_true_within_short assert_equals_within_short(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 251, in assert_equals_within_short func, value, SHORT_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 237, in assert_equals_within '%s != %s after %s seconds' % (res, value, timeout) 'False != True after 180 seconds\n-------------------- >> begin captured logging << --------------------\nlago.ssh: DEBUG: start task:15ccab7d-106b-4b4d-95b2-ce1dfa23366e:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:15ccab7d-106b-4b4d-95b2-ce1dfa23366e:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 0e77e8ea on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --set-maintenance --mode=none\nlago.ssh: DEBUG: Command 0e77e8ea on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: start task:a1659d8b-d08b-49d8-a36a-ba5721b70b27:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:a1659d8b-d08b-49d8-a36a-ba5721b70b27:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 0f18dbb0 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 0f18dbb0 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 0f18dbb0 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3084 (Wed Jul 18 09:11:12 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3086 (Wed Jul 18 09:11:15 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "941291e0", "local_conf_timestamp": 3086, "host-ts": 3084}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3088 (Wed Jul 18 09:11:16 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3089 (Wed Jul 18 09:11:17 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "f69cb9ec", "local_conf_timestamp": 3089, "host-ts": 3088}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:34d3fd30-f2f7-432b-920a-022658886559:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:34d3fd30-f2f7-432b-920a-022658886559:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 15e0de84 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 15e0de84 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 15e0de84 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3094 (Wed Jul 18 09:11:23 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3096 (Wed Jul 18 09:11:25 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f90f5a34", "local_conf_timestamp": 3096, "host-ts": 3094}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3098 (Wed Jul 18 09:11:27 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3100 (Wed Jul 18 09:11:28 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a50fda97", "local_conf_timestamp": 3100, "host-ts": 3098}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:ad7780e2-3a1f-488f-a117-7a2e8a6f96dd:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:ad7780e2-3a1f-488f-a117-7a2e8a6f96dd:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 18337cd2 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 18337cd2 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 18337cd2 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3094 (Wed Jul 18 09:11:23 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3096 (Wed Jul 18 09:11:25 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f90f5a34", "local_conf_timestamp": 3096, "host-ts": 3094}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3098 (Wed Jul 18 09:11:27 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3100 (Wed Jul 18 09:11:28 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a50fda97", "local_conf_timestamp": 3100, "host-ts": 3098}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:25014fed-2416-40ea-bcb7-ad65d6d17157:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:25014fed-2416-40ea-bcb7-ad65d6d17157:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 1a9a025c on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 1a9a025c on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 1a9a025c on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3104 (Wed Jul 18 09:11:32 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3105 (Wed Jul 18 09:11:33 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "52c4997e", "local_conf_timestamp": 3105, "host-ts": 3104}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3108 (Wed Jul 18 09:11:36 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3109 (Wed Jul 18 09:11:38 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e80b2994", "local_conf_timestamp": 3109, "host-ts": 3108}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:6ea72486-d2a0-473e-8a57-bf803749dbeb:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:6ea72486-d2a0-473e-8a57-bf803749dbeb:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 1cf379c0 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 1cf379c0 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 1cf379c0 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3104 (Wed Jul 18 09:11:32 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3105 (Wed Jul 18 09:11:33 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "52c4997e", "local_conf_timestamp": 3105, "host-ts": 3104}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3108 (Wed Jul 18 09:11:36 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3109 (Wed Jul 18 09:11:38 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e80b2994", "local_conf_timestamp": 3109, "host-ts": 3108}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:4dd7a176-6380-40a6-bee6-6d259c976218:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:4dd7a176-6380-40a6-bee6-6d259c976218:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 1f551db8 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 1f551db8 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 1f551db8 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3104 (Wed Jul 18 09:11:32 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3105 (Wed Jul 18 09:11:33 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "52c4997e", "local_conf_timestamp": 3105, "host-ts": 3104}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3108 (Wed Jul 18 09:11:36 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3109 (Wed Jul 18 09:11:38 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e80b2994", "local_conf_timestamp": 3109, "host-ts": 3108}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:e46da9b9-a030-46b9-bc27-0931971187f3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:e46da9b9-a030-46b9-bc27-0931971187f3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 21af0704 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 21af0704 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 21af0704 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3114 (Wed Jul 18 09:11:43 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3115 (Wed Jul 18 09:11:44 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3fd952aa", "local_conf_timestamp": 3115, "host-ts": 3114}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3118 (Wed Jul 18 09:11:47 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3120 (Wed Jul 18 09:11:48 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "40b5c852", "local_conf_timestamp": 3120, "host-ts": 3118}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:80fea0ca-925d-4596-969f-6fafa82613f0:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:80fea0ca-925d-4596-969f-6fafa82613f0:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 2400fcf6 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 2400fcf6 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 2400fcf6 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3114 (Wed Jul 18 09:11:43 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3115 (Wed Jul 18 09:11:44 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3fd952aa", "local_conf_timestamp": 3115, "host-ts": 3114}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3118 (Wed Jul 18 09:11:47 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3120 (Wed Jul 18 09:11:48 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "40b5c852", "local_conf_timestamp": 3120, "host-ts": 3118}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:5b8166e3-5b36-44db-bc42-6a88e72a8552:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:5b8166e3-5b36-44db-bc42-6a88e72a8552:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 26606bda on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 26606bda on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 26606bda on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3114 (Wed Jul 18 09:11:43 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3115 (Wed Jul 18 09:11:44 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3fd952aa", "local_conf_timestamp": 3115, "host-ts": 3114}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3118 (Wed Jul 18 09:11:47 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3120 (Wed Jul 18 09:11:48 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "40b5c852", "local_conf_timestamp": 3120, "host-ts": 3118}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:d8cc3c5a-b0d8-4186-90df-91775cea0ac3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:d8cc3c5a-b0d8-4186-90df-91775cea0ac3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 28c43fe6 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 28c43fe6 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 28c43fe6 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3124 (Wed Jul 18 09:11:52 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3125 (Wed Jul 18 09:11:53 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "88ff0ed6", "local_conf_timestamp": 3125, "host-ts": 3124}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3129 (Wed Jul 18 09:11:57 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3130 (Wed Jul 18 09:11:59 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "901341fa", "local_conf_timestamp": 3130, "host-ts": 3129}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:c32033d7-f5e4-4252-afb6-27596b37bb3c:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:c32033d7-f5e4-4252-afb6-27596b37bb3c:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 2b1d6880 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 2b1d6880 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 2b1d6880 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3124 (Wed Jul 18 09:11:52 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3125 (Wed Jul 18 09:11:53 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "88ff0ed6", "local_conf_timestamp": 3125, "host-ts": 3124}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3129 (Wed Jul 18 09:11:57 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3130 (Wed Jul 18 09:11:59 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "901341fa", "local_conf_timestamp": 3130, "host-ts": 3129}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:ee7c6357-7275-42f0-b5bc-a598e6d1a4f6:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:ee7c6357-7275-42f0-b5bc-a598e6d1a4f6:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 2d746944 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 2d746944 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 2d746944 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3134 (Wed Jul 18 09:12:03 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3135 (Wed Jul 18 09:12:04 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e5e2c502", "local_conf_timestamp": 3135, "host-ts": 3134}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3139 (Wed Jul 18 09:12:07 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3140 (Wed Jul 18 09:12:08 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "3c06ecdd", "local_conf_timestamp": 3140, "host-ts": 3139}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:e8d073f3-a6a2-40fc-9e7c-ea0fc1c7cde9:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:e8d073f3-a6a2-40fc-9e7c-ea0fc1c7cde9:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 2fda5b76 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 2fda5b76 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 2fda5b76 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3134 (Wed Jul 18 09:12:03 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3135 (Wed Jul 18 09:12:04 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e5e2c502", "local_conf_timestamp": 3135, "host-ts": 3134}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3139 (Wed Jul 18 09:12:07 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3140 (Wed Jul 18 09:12:08 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "3c06ecdd", "local_conf_timestamp": 3140, "host-ts": 3139}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:9ffa1747-8783-4db9-b45e-c29956ed6eb7:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:9ffa1747-8783-4db9-b45e-c29956ed6eb7:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 32366d06 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 32366d06 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 32366d06 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3134 (Wed Jul 18 09:12:03 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3135 (Wed Jul 18 09:12:04 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e5e2c502", "local_conf_timestamp": 3135, "host-ts": 3134}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3139 (Wed Jul 18 09:12:07 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3140 (Wed Jul 18 09:12:08 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "3c06ecdd", "local_conf_timestamp": 3140, "host-ts": 3139}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:bd7d0591-1e53-46fc-b16c-49eb90583fe3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:bd7d0591-1e53-46fc-b16c-49eb90583fe3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 349ba110 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 349ba110 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 349ba110 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3144 (Wed Jul 18 09:12:12 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3145 (Wed Jul 18 09:12:14 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3dc2b06f", "local_conf_timestamp": 3145, "host-ts": 3144}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3149 (Wed Jul 18 09:12:17 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3150 (Wed Jul 18 09:12:19 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e02274ff", "local_conf_timestamp": 3150, "host-ts": 3149}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:1f80d5c0-d005-4c54-875c-491af599b7b2:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:1f80d5c0-d005-4c54-875c-491af599b7b2:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 36f60144 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 36f60144 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 36f60144 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3144 (Wed Jul 18 09:12:12 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3145 (Wed Jul 18 09:12:14 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "3dc2b06f", "local_conf_timestamp": 3145, "host-ts": 3144}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3149 (Wed Jul 18 09:12:17 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3150 (Wed Jul 18 09:12:19 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e02274ff", "local_conf_timestamp": 3150, "host-ts": 3149}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:c5b3a63e-7360-4277-b376-7d3f4f881b93:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:c5b3a63e-7360-4277-b376-7d3f4f881b93:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 3957bcd4 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 3957bcd4 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 3957bcd4 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3154 (Wed Jul 18 09:12:23 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3156 (Wed Jul 18 09:12:24 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c9d62a01", "local_conf_timestamp": 3156, "host-ts": 3154}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3149 (Wed Jul 18 09:12:17 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3150 (Wed Jul 18 09:12:19 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e02274ff", "local_conf_timestamp": 3150, "host-ts": 3149}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:8de3c2fc-8610-4306-87f0-561d5b2c6eeb:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:8de3c2fc-8610-4306-87f0-561d5b2c6eeb:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 3be3733a on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 3be3733a on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 3be3733a on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3154 (Wed Jul 18 09:12:23 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3156 (Wed Jul 18 09:12:24 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c9d62a01", "local_conf_timestamp": 3156, "host-ts": 3154}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3159 (Wed Jul 18 09:12:28 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3161 (Wed Jul 18 09:12:29 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "5f5c2c4a", "local_conf_timestamp": 3161, "host-ts": 3159}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:b2823e06-aac4-490a-a062-ef0079d35e7d:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:b2823e06-aac4-490a-a062-ef0079d35e7d:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 3e48d7fa on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 3e48d7fa on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 3e48d7fa on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3154 (Wed Jul 18 09:12:23 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3156 (Wed Jul 18 09:12:24 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c9d62a01", "local_conf_timestamp": 3156, "host-ts": 3154}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3159 (Wed Jul 18 09:12:28 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3161 (Wed Jul 18 09:12:29 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "5f5c2c4a", "local_conf_timestamp": 3161, "host-ts": 3159}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:1b0ae1ee-3f60-40fe-8184-fb658b662138:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:1b0ae1ee-3f60-40fe-8184-fb658b662138:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 40eb2f6c on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 40eb2f6c on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 40eb2f6c on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3164 (Wed Jul 18 09:12:32 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3165 (Wed Jul 18 09:12:34 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e7f927c7", "local_conf_timestamp": 3165, "host-ts": 3164}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3169 (Wed Jul 18 09:12:37 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3170 (Wed Jul 18 09:12:38 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "cfcd67fc", "local_conf_timestamp": 3170, "host-ts": 3169}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:47bdd477-6f0a-4cdd-9475-7d15348c3639:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:47bdd477-6f0a-4cdd-9475-7d15348c3639:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 43462b54 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 43462b54 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 43462b54 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3164 (Wed Jul 18 09:12:32 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3165 (Wed Jul 18 09:12:34 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e7f927c7", "local_conf_timestamp": 3165, "host-ts": 3164}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3169 (Wed Jul 18 09:12:37 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3170 (Wed Jul 18 09:12:38 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "cfcd67fc", "local_conf_timestamp": 3170, "host-ts": 3169}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:4f149310-7fed-4e2c-9f24-e9c5461b98c7:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:4f149310-7fed-4e2c-9f24-e9c5461b98c7:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 45a29cac on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 45a29cac on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 45a29cac on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3174 (Wed Jul 18 09:12:43 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3176 (Wed Jul 18 09:12:44 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "13edbda9", "local_conf_timestamp": 3176, "host-ts": 3174}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3179 (Wed Jul 18 09:12:47 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3181 (Wed Jul 18 09:12:49 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "dc067045", "local_conf_timestamp": 3181, "host-ts": 3179}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:171fc35c-3326-42cb-b9ed-13e1143d482e:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:171fc35c-3326-42cb-b9ed-13e1143d482e:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 48003126 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 48003126 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 48003126 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3174 (Wed Jul 18 09:12:43 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3176 (Wed Jul 18 09:12:44 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "13edbda9", "local_conf_timestamp": 3176, "host-ts": 3174}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3179 (Wed Jul 18 09:12:47 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3181 (Wed Jul 18 09:12:49 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "dc067045", "local_conf_timestamp": 3181, "host-ts": 3179}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:503c37d7-2145-4ea4-b48b-479bac426729:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:503c37d7-2145-4ea4-b48b-479bac426729:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 4a6e21ca on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 4a6e21ca on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 4a6e21ca on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3174 (Wed Jul 18 09:12:43 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3176 (Wed Jul 18 09:12:44 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "13edbda9", "local_conf_timestamp": 3176, "host-ts": 3174}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3179 (Wed Jul 18 09:12:47 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3181 (Wed Jul 18 09:12:49 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "dc067045", "local_conf_timestamp": 3181, "host-ts": 3179}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:e86dd41b-f6bb-49e1-bc32-5aa61e8029c7:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:e86dd41b-f6bb-49e1-bc32-5aa61e8029c7:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 4cdc98e2 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 4cdc98e2 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 4cdc98e2 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3184 (Wed Jul 18 09:12:52 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3185 (Wed Jul 18 09:12:54 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8cc8cb5c", "local_conf_timestamp": 3185, "host-ts": 3184}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3189 (Wed Jul 18 09:12:57 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3190 (Wed Jul 18 09:12:59 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "00401ef5", "local_conf_timestamp": 3190, "host-ts": 3189}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:8390f130-4999-453a-bb46-21e5a7ddb3f1:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:8390f130-4999-453a-bb46-21e5a7ddb3f1:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 4f464876 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 4f464876 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 4f464876 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3184 (Wed Jul 18 09:12:52 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3185 (Wed Jul 18 09:12:54 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8cc8cb5c", "local_conf_timestamp": 3185, "host-ts": 3184}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3189 (Wed Jul 18 09:12:57 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3190 (Wed Jul 18 09:12:59 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "00401ef5", "local_conf_timestamp": 3190, "host-ts": 3189}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:fb33bb18-1b65-46f3-8af8-eeb6a392a72c:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:fb33bb18-1b65-46f3-8af8-eeb6a392a72c:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 51b411a6 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 51b411a6 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 51b411a6 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3194 (Wed Jul 18 09:13:02 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3195 (Wed Jul 18 09:13:03 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e1d50088", "local_conf_timestamp": 3195, "host-ts": 3194}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3199 (Wed Jul 18 09:13:08 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3201 (Wed Jul 18 09:13:09 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "47971093", "local_conf_timestamp": 3201, "host-ts": 3199}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:7bdd9889-7191-4dbc-aebb-b236d9797fee:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:7bdd9889-7191-4dbc-aebb-b236d9797fee:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 541e759e on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 541e759e on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 541e759e on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3194 (Wed Jul 18 09:13:02 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3195 (Wed Jul 18 09:13:03 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e1d50088", "local_conf_timestamp": 3195, "host-ts": 3194}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3199 (Wed Jul 18 09:13:08 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3201 (Wed Jul 18 09:13:09 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "47971093", "local_conf_timestamp": 3201, "host-ts": 3199}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:a80f8f50-266b-41e6-9f71-3f4af26fd8cb:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:a80f8f50-266b-41e6-9f71-3f4af26fd8cb:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 568077b0 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 568077b0 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 568077b0 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3194 (Wed Jul 18 09:13:02 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3195 (Wed Jul 18 09:13:03 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "e1d50088", "local_conf_timestamp": 3195, "host-ts": 3194}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3199 (Wed Jul 18 09:13:08 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3201 (Wed Jul 18 09:13:09 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "47971093", "local_conf_timestamp": 3201, "host-ts": 3199}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:8962e5e9-d38c-41bf-a967-711df46f9878:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:8962e5e9-d38c-41bf-a967-711df46f9878:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 58f2c57a on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 58f2c57a on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 58f2c57a on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3204 (Wed Jul 18 09:13:12 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3205 (Wed Jul 18 09:13:14 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0bc08235", "local_conf_timestamp": 3205, "host-ts": 3204}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3209 (Wed Jul 18 09:13:17 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3210 (Wed Jul 18 09:13:19 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "87f13024", "local_conf_timestamp": 3210, "host-ts": 3209}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:55f51fc1-90ea-4146-b762-373c884f8bed:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:55f51fc1-90ea-4146-b762-373c884f8bed:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 5b4c5200 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 5b4c5200 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 5b4c5200 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3204 (Wed Jul 18 09:13:12 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3205 (Wed Jul 18 09:13:14 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0bc08235", "local_conf_timestamp": 3205, "host-ts": 3204}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3209 (Wed Jul 18 09:13:17 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3210 (Wed Jul 18 09:13:19 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "87f13024", "local_conf_timestamp": 3210, "host-ts": 3209}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:dabfb3de-c763-4318-8856-63703d62e124:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:dabfb3de-c763-4318-8856-63703d62e124:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 5db2bc82 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 5db2bc82 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 5db2bc82 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3214 (Wed Jul 18 09:13:23 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3216 (Wed Jul 18 09:13:24 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "ffd4185b", "local_conf_timestamp": 3216, "host-ts": 3214}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3219 (Wed Jul 18 09:13:27 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3220 (Wed Jul 18 09:13:28 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "4f885807", "local_conf_timestamp": 3220, "host-ts": 3219}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:4d2c9a76-a2d3-492a-9750-cf1521b3b885:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:4d2c9a76-a2d3-492a-9750-cf1521b3b885:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 600541bc on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 600541bc on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 600541bc on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3214 (Wed Jul 18 09:13:23 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3216 (Wed Jul 18 09:13:24 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "ffd4185b", "local_conf_timestamp": 3216, "host-ts": 3214}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3219 (Wed Jul 18 09:13:27 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3220 (Wed Jul 18 09:13:28 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "4f885807", "local_conf_timestamp": 3220, "host-ts": 3219}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:68189bb7-b483-4cd9-87db-30428f466083:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:68189bb7-b483-4cd9-87db-30428f466083:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 626d7a78 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 626d7a78 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 626d7a78 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3224 (Wed Jul 18 09:13:32 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3225 (Wed Jul 18 09:13:33 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "d1fb159d", "local_conf_timestamp": 3225, "host-ts": 3224}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3219 (Wed Jul 18 09:13:27 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3220 (Wed Jul 18 09:13:28 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "4f885807", "local_conf_timestamp": 3220, "host-ts": 3219}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:fef83987-fe3e-4535-93af-b88a25e33f8b:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:fef83987-fe3e-4535-93af-b88a25e33f8b:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 651100ec on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 651100ec on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 651100ec on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3224 (Wed Jul 18 09:13:32 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3225 (Wed Jul 18 09:13:33 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "d1fb159d", "local_conf_timestamp": 3225, "host-ts": 3224}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3229 (Wed Jul 18 09:13:38 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3231 (Wed Jul 18 09:13:39 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "df1913b1", "local_conf_timestamp": 3231, "host-ts": 3229}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:e2d6c6c6-2f24-49fc-bb4e-070f68966b93:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:e2d6c6c6-2f24-49fc-bb4e-070f68966b93:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 6774065e on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6774065e on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 6774065e on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3224 (Wed Jul 18 09:13:32 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3225 (Wed Jul 18 09:13:33 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "d1fb159d", "local_conf_timestamp": 3225, "host-ts": 3224}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3229 (Wed Jul 18 09:13:38 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3231 (Wed Jul 18 09:13:39 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "df1913b1", "local_conf_timestamp": 3231, "host-ts": 3229}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:003b8141-4943-40c0-b8ed-6800a2c08852:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:003b8141-4943-40c0-b8ed-6800a2c08852:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 69d4ea58 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 69d4ea58 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 69d4ea58 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3234 (Wed Jul 18 09:13:43 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3235 (Wed Jul 18 09:13:44 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "bce6de49", "local_conf_timestamp": 3235, "host-ts": 3234}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3239 (Wed Jul 18 09:13:47 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3240 (Wed Jul 18 09:13:49 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "040b8e00", "local_conf_timestamp": 3240, "host-ts": 3239}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:301c74fb-94ea-4fa1-93a8-6485430d1d51:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:301c74fb-94ea-4fa1-93a8-6485430d1d51:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 6c2ae2f8 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6c2ae2f8 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 6c2ae2f8 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3234 (Wed Jul 18 09:13:43 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3235 (Wed Jul 18 09:13:44 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "bce6de49", "local_conf_timestamp": 3235, "host-ts": 3234}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3239 (Wed Jul 18 09:13:47 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3240 (Wed Jul 18 09:13:49 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "040b8e00", "local_conf_timestamp": 3240, "host-ts": 3239}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:93ddbb97-86e2-48e9-9f01-58907bfe4361:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:93ddbb97-86e2-48e9-9f01-58907bfe4361:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 6e917a34 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6e917a34 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 6e917a34 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3244 (Wed Jul 18 09:13:52 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3245 (Wed Jul 18 09:13:53 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "64c6ab24", "local_conf_timestamp": 3245, "host-ts": 3244}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3249 (Wed Jul 18 09:13:57 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3250 (Wed Jul 18 09:13:58 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d82f1622", "local_conf_timestamp": 3250, "host-ts": 3249}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:7f848a13-9bd4-41d9-b8ef-494de3545e5a:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:7f848a13-9bd4-41d9-b8ef-494de3545e5a:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 710498fa on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 710498fa on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 710498fa on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3244 (Wed Jul 18 09:13:52 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3245 (Wed Jul 18 09:13:53 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "64c6ab24", "local_conf_timestamp": 3245, "host-ts": 3244}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3249 (Wed Jul 18 09:13:57 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3250 (Wed Jul 18 09:13:58 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d82f1622", "local_conf_timestamp": 3250, "host-ts": 3249}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:9dd7b6f0-ba5b-482d-a54e-eddef4911114:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:9dd7b6f0-ba5b-482d-a54e-eddef4911114:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 7362045c on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 7362045c on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 7362045c on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3244 (Wed Jul 18 09:13:52 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3245 (Wed Jul 18 09:13:53 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "64c6ab24", "local_conf_timestamp": 3245, "host-ts": 3244}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3249 (Wed Jul 18 09:13:57 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3250 (Wed Jul 18 09:13:58 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "d82f1622", "local_conf_timestamp": 3250, "host-ts": 3249}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:3704d426-12e9-4ff9-a3ad-9e6c789c9ad3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:3704d426-12e9-4ff9-a3ad-9e6c789c9ad3:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 75bf955c on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 75bf955c on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 75bf955c on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3254 (Wed Jul 18 09:14:03 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3255 (Wed Jul 18 09:14:04 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "09db60f0", "local_conf_timestamp": 3255, "host-ts": 3254}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3259 (Wed Jul 18 09:14:08 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3261 (Wed Jul 18 09:14:09 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "67514e97", "local_conf_timestamp": 3261, "host-ts": 3259}, "global_maintenance": true}\n\nlago.ssh: DEBUG: start task:fdd17b68-9c2d-407a-af6f-db0b31f320a0:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:fdd17b68-9c2d-407a-af6f-db0b31f320a0:Get ssh client for lago-he-basic-iscsi-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 782d00f4 on lago-he-basic-iscsi-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 782d00f4 on lago-he-basic-iscsi-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 782d00f4 on lago-he-basic-iscsi-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3254 (Wed Jul 18 09:14:03 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=3255 (Wed Jul 18 09:14:04 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-0.lago.local", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "09db60f0", "local_conf_timestamp": 3255, "host-ts": 3254}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=3259 (Wed Jul 18 09:14:08 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=3261 (Wed Jul 18 09:14:09 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=GlobalMaintenance\\nstopped=False\\n", "hostname": "lago-he-basic-iscsi-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "67514e97", "local_conf_timestamp": 3261, "host-ts": 3259}, "global_maintenance": true}\n\n--------------------- >> end captured logging << ---------------------'

1 1

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-4.2 - Build # 360 - Failure!
by jenkins＠jenkins.phx.ovirt.org 18 Jul '18

18 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/360/ Build Number: 360 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #360 [Dafna Ron] ovirt-master: skipping deactivae/activate storage tests ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: Host lago-hc-basic-suite-4-2-host1 is in non responsive state -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7f6ae84355f0> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 263, in _host_is_up_4 raise RuntimeError('Host %s is in non responsive state' % api_host.name) RuntimeError: Host lago-hc-basic-suite-4-2-host1 is in non responsive state --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 229, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 273, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 263, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 263, in _host_is_up_4 raise RuntimeError('Host %s is in non responsive state' % api_host.name) 'Host lago-hc-basic-suite-4-2-host1 is in non responsive state\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7f6ae84355f0>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 263, in _host_is_up_4\n raise RuntimeError(\'Host %s is in non responsive state\' % api_host.name)\nRuntimeError: Host lago-hc-basic-suite-4-2-host1 is in non responsive state\n--------------------- >> end captured logging << ---------------------'

1 3

[oVirt Jenkins] ovirt-system-tests_he-basic-suite-4.2 - Build # 391 - Failure!
by jenkins＠jenkins.phx.ovirt.org 18 Jul '18

18 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-4.2/391/ Build Number: 391 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #391 [Dafna Ron] ovirt-master: skipping deactivae/activate storage tests ----------------- Failed Tests: ----------------- All tests passed

1 1

[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-4.2 - Build # 137 - Failure!
by jenkins＠jenkins.phx.ovirt.org 18 Jul '18

18 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/137/ Build Number: 137 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #137 [Dafna Ron] ovirt-master: skipping deactivae/activate storage tests ----------------- Failed Tests: ----------------- No tests ran.

1 1

[JIRA] (OVIRT-2345) Allow parallel reposyncs
by Daniel Belenky (oVirt JIRA) 18 Jul '18

18 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2345?page=com.atlassian.jira.… ] Daniel Belenky updated OVIRT-2345: ---------------------------------- Description: Since we're going to run multiple suites in parallel on the same host, the repolock may become a bottle neck. We probably will need per-container cache or something similar. > Allow parallel reposyncs > ------------------------ > > Key: OVIRT-2345 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2345 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Daniel Belenky > Assignee: infra > > Since we're going to run multiple suites in parallel on the same host, the repolock may become a bottle neck. We probably will need per-container cache or something similar. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2345) Allow parallel reposyncs
by Daniel Belenky (oVirt JIRA) 18 Jul '18

18 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2345?page=com.atlassian.jira.… ] Daniel Belenky updated OVIRT-2345: ---------------------------------- Epic Link: OVIRT-2326 > Allow parallel reposyncs > ------------------------ > > Key: OVIRT-2345 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2345 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Daniel Belenky > Assignee: infra > -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2345) Allow parallel reposyncs
by Daniel Belenky (oVirt JIRA) 18 Jul '18

18 Jul '18

Daniel Belenky created OVIRT-2345: ------------------------------------- Summary: Allow parallel reposyncs Key: OVIRT-2345 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2345 Project: oVirt - virtualization made easy Issue Type: Task Reporter: Daniel Belenky Assignee: infra -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2264) Cannot deactivate Storage while there are running tasks on this Storage
by Dafna Ron (oVirt JIRA) 18 Jul '18

18 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2264?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2264: ---------------------------------- [~gbenhaim(a)redhat.com] can you please merge? > Cannot deactivate Storage while there are running tasks on this Storage > ----------------------------------------------------------------------- > > Key: OVIRT-2264 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2264 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_failures, ost_race > > we failed test: 007_sd_reattach.deactivate_storage_domain in vdsm project with error: Cannot deactivate Storage while there are running tasks on this Storage. -Please wait until tasks will finish and try again.]". HTTP response code is 409. > I am opening this as a race in case something changed in OST tests which would cause this to repeat. > https://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/2506 > https://gerrit.ovirt.org/#/c/92313/2 -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2338) resources got stuck
by Barak Korren (oVirt JIRA) 18 Jul '18

18 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2338?page=com.atlassian.jira.… ] Barak Korren commented on OVIRT-2338: ------------------------------------- [~dron] no, we want this ticket to track immediate setup of a watchdog device. > resources got stuck > ------------------- > > Key: OVIRT-2338 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2338 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Emil Natan > Assignee: infra > Labels: ost_failures, ost_infra > > resources.ovirt.org got stuck. Initially we received different nagios alerts about number of processes and filesystems usage, but the root cause was "Socket timeout after 10 seconds". There was not ssh connectivity, so reset of the VM through the engine UI helped to get it running again. > The issue affected few CQ tests. > Possible improvement could be to set watchdog to automatically reboot the VM if it gets stuck. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2338) resources got stuck
by Dafna Ron (oVirt JIRA) 18 Jul '18

18 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2338?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2338: ---------------------------------- [~bkorren(a)redhat.com] [~ena(a)redhat.com] based on the mail, can we close this jira as resolved and continue follow through the epic? > resources got stuck > ------------------- > > Key: OVIRT-2338 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2338 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Emil Natan > Assignee: infra > Labels: ost_failures, ost_infra > > resources.ovirt.org got stuck. Initially we received different nagios alerts about number of processes and filesystems usage, but the root cause was "Socket timeout after 10 seconds". There was not ssh connectivity, so reset of the VM through the engine UI helped to get it running again. > The issue affected few CQ tests. > Possible improvement could be to set watchdog to automatically reboot the VM if it gets stuck. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

Failure if resources.ovirt.org on Tuesday
by Barak Korren 18 Jul '18

18 Jul '18

We had an issue with resources.ovirt.org becoming unresponsive to all network access on Tuesday, July 17th. Tracking of the issue was done using: https://ovirt-jira.atlassian.net/browse/OVIRT-2338 During the attempt to analyse and fix this issue we came across several other issues the have to do with out ability to gain access to the production VMs. Thos issues hade been documented and collected in the following epic: https://ovirt-jira.atlassian.net/browse/OVIRT-2337 We need to resolve these issues ASAP to ensure that next time such a production outage occurs we don't end up struggling for many minutes to get basic access. In the end we reached the conclusion that the server itself was stuck and needed a hard-reset. This raises the question why didn't we have a watchdog device configured on the VM to automatically detect and deal with such issues. This experience led us to the understanding that resources is fulfilling far too many critical roles ATM for us to be able to responsibly keep it as a simple single VM. I've created the following Epic to track and discuss work for improving the infrastructure behind resources.ovirt.org to make it less fragile and more reliable: https://ovirt-jira.atlassian.net/browse/OVIRT-2344 -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted

1 0

[JIRA] (OVIRT-2337) Ensure emergency access to PHX production VMs
by Barak Korren (oVirt JIRA) 18 Jul '18

18 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2337?page=com.atlassian.jira.… ] Barak Korren updated OVIRT-2337: -------------------------------- Summary: Ensure emergency access to PHX production VMs (was: Ensure emergency access to PHC production VMs) > Ensure emergency access to PHX production VMs > --------------------------------------------- > > Key: OVIRT-2337 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2337 > Project: oVirt - virtualization made easy > Issue Type: Epic > Components: oVirt Infra > Reporter: Barak Korren > Assignee: infra > Priority: High > > Make sure that in case of malfunction we have multiple fail-safe ways of gaining access to the PHX production VMs to resolve issues. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2287) ovirt-system-tests_he-node-ng-suite-master is failing on not enough memory to run VMs
by Dafna Ron (oVirt JIRA) 18 Jul '18

18 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2287?page=com.atlassian.jira.… ] Dafna Ron reassigned OVIRT-2287: -------------------------------- Assignee: Gal Ben Haim (was: infra) > ovirt-system-tests_he-node-ng-suite-master is failing on not enough memory to run VMs > ------------------------------------------------------------------------------------- > > Key: OVIRT-2287 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2287 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: sbonazzo > Assignee: Gal Ben Haim > Priority: Highest > Labels: ost_failures, ost_lago > Attachments: srv.log > > > https://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/16… > Cannot run VM. There is no host that satisfies current scheduling > constraints. See below for details:, The host > lago-he-node-ng-suite-master-host-0 did not satisfy internal filter Memory > because its available memory is too low (656 MB) to run the VM. > -- > SANDRO BONAZZOLA > MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV > Red Hat EMEA <https://www.redhat.com/> > sbonazzo(a)redhat.com > <https://red.ht/sig> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2311) ovirt-master vdsm failure - extend disk test times out
by Dafna Ron (oVirt JIRA) 18 Jul '18

18 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2311?page=com.atlassian.jira.… ] Dafna Ron reassigned OVIRT-2311: -------------------------------- Assignee: danken (was: infra) > ovirt-master vdsm failure - extend disk test times out > ------------------------------------------------------- > > Key: OVIRT-2311 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2311 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: danken > Labels: ost_failures > > There is no failure of a test but we can see a gap of an hour from start of extend_disk1 until unhanded exception is thrown. > Although the error is reported on 004_basic_sanity the logs stop on post-003_basic_networking.py. > looking at the available logs it may be a task that is not cleared. > I do not see a connection between the patch and the timeout unless something in the tests is looking ERROR: InterpreterNotFound: python3.6 errors in order to exit. > patch that failed: https://gerrit.ovirt.org/#/c/92847/ > job: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8648/ > Error I can see in the logs is: > 2018-07-12 01:23:14,863-04 ERROR [org.ovirt.engine.core.bll.storage.domain.AttachStorageDomainToPoolCommand] (default task-1) [] An error occurred while fetching unregistered disks from Storage Domain id '597bfe1f-d88c-4961-b1dc-f6c771af9 > fff' > but I can't see an error in vdsm that would suggest we had a failure. > you can see the gap in the job: > 05:31:45 [basic-suit] # extend_disk1: > 06:31:56 [basic-suit] * Unhandled exception in <function <lambda> at 0x7f5dd403c5f0> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2344) Re-engineer the oVirt resources server
by Barak Korren (oVirt JIRA) 18 Jul '18

18 Jul '18

Barak Korren created OVIRT-2344: ----------------------------------- Summary: Re-engineer the oVirt resources server Key: OVIRT-2344 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2344 Project: oVirt - virtualization made easy Issue Type: Epic Components: Repositories Mgmt Reporter: Barak Korren Assignee: infra resources.ovirt.org is one of the most important servers in our infrastructure, but its current configuration is quite fragile and prone to fialure. This EPIC is eant to consolidate and track work we do to make resources.ovirt.org more reliable, and maintainable. Among the things we can try to do: # Have multiple redundant front-ends serving package content to users # Separate test and production package serving # Separate package serving and backed repository building # Host resources on 3rd party infrastructure. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2264) Cannot deactivate Storage while there are running tasks on this Storage
by Dafna Ron (oVirt JIRA) 18 Jul '18

18 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2264?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2264: ---------------------------------- https://gerrit.ovirt.org/#/c/93106/ > Cannot deactivate Storage while there are running tasks on this Storage > ----------------------------------------------------------------------- > > Key: OVIRT-2264 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2264 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_failures, ost_race > > we failed test: 007_sd_reattach.deactivate_storage_domain in vdsm project with error: Cannot deactivate Storage while there are running tasks on this Storage. -Please wait until tasks will finish and try again.]". HTTP response code is 409. > I am opening this as a race in case something changed in OST tests which would cause this to repeat. > https://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/2506 > https://gerrit.ovirt.org/#/c/92313/2 -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2264) Cannot deactivate Storage while there are running tasks on this Storage
by Dafna Ron (oVirt JIRA) 18 Jul '18

18 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2264?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2264: ---------------------------------- This failure also happened in 4.2 I'll submit a patch to skip in 4.2 as well. > Cannot deactivate Storage while there are running tasks on this Storage > ----------------------------------------------------------------------- > > Key: OVIRT-2264 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2264 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_failures, ost_race > > we failed test: 007_sd_reattach.deactivate_storage_domain in vdsm project with error: Cannot deactivate Storage while there are running tasks on this Storage. -Please wait until tasks will finish and try again.]". HTTP response code is 409. > I am opening this as a race in case something changed in OST tests which would cause this to repeat. > https://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/2506 > https://gerrit.ovirt.org/#/c/92313/2 -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[CQ]: 93052,3 (ovirt-engine) failed "ovirt-4.2" system tests
by oVirt Jenkins 18 Jul '18

18 Jul '18

Change 93052,3 (ovirt-engine) is probably the reason behind recent system test failures in the "ovirt-4.2" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/93052/3 For failed test results see: http://jenkins.ovirt.org/job/ovirt-4.2_change-queue-tester/2661/

3 2

[oVirt Jenkins] ovirt-node-ng_ovirt-4.2_build-artifacts-el7-x86_64 - Build # 343 - Failure!
by jenkins＠jenkins.phx.ovirt.org 18 Jul '18

18 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-node-ng_ovirt-4.2_build-artifacts-el7-x8… Build: http://jenkins.ovirt.org/job/ovirt-node-ng_ovirt-4.2_build-artifacts-el7-x8… Build Number: 343 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #343 [Ryan Barry] kickstart: let VDSM reconfigure itself ----------------- Failed Tests: ----------------- No tests ran.

1 1

[oVirt Jenkins] ovirt-node-ng_4.2_build-artifacts-el7-x86_64 - Build # 137 - Failure!
by jenkins＠jenkins.phx.ovirt.org 18 Jul '18

18 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-node-ng_4.2_build-artifacts-el7-x86_64/ Build: http://jenkins.ovirt.org/job/ovirt-node-ng_4.2_build-artifacts-el7-x86_64/1… Build Number: 137 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #137 [Ryan Barry] kickstart: let VDSM reconfigure itself ----------------- Failed Tests: ----------------- No tests ran.

1 1

[JIRA] (OVIRT-2343) Make STDCI reporting UI configurable fir GitHub jobs
by Barak Korren (oVirt JIRA) 18 Jul '18

18 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2343?page=com.atlassian.jira.… ] Barak Korren reassigned OVIRT-2343: ----------------------------------- Assignee: Barak Korren (was: infra) > Make STDCI reporting UI configurable fir GitHub jobs > ---------------------------------------------------- > > Key: OVIRT-2343 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2343 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: Standard CI (Pipelines), STDCI Build Report, STDCI DSL > Reporter: Barak Korren > Assignee: Barak Korren > Priority: High > > Make it so developers in GitHub projects can select the UI the see build results in from the STDCI DSL. > h3. Acceptance Criteria > # The is a "reporting" option in the STDCI DSL > # The reporting option is a dictionary for which we now support only the "style" key > # The style key can have one of 3 values - "classic", "blue ocean" or "stdci" mapping to appropriate UIs. > # The default value for the style key is "default" which keeps existing behaviour. > # Setting the reporting style makes "details" links from GitHub point to the the selected UI. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2343) Make STDCI reporting UI configurable fir GitHub jobs
by Barak Korren (oVirt JIRA) 18 Jul '18

18 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2343?page=com.atlassian.jira.… ] Barak Korren updated OVIRT-2343: -------------------------------- Epic Link: OVIRT-2339 > Make STDCI reporting UI configurable fir GitHub jobs > ---------------------------------------------------- > > Key: OVIRT-2343 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2343 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: Standard CI (Pipelines), STDCI Build Report, STDCI DSL > Reporter: Barak Korren > Assignee: infra > Priority: High > > Make it so developers in GitHub projects can select the UI the see build results in from the STDCI DSL. > h3. Acceptance Criteria > # The is a "reporting" option in the STDCI DSL > # The reporting option is a dictionary for which we now support only the "style" key > # The style key can have one of 3 values - "classic", "blue ocean" or "stdci" mapping to appropriate UIs. > # The default value for the style key is "default" which keeps existing behaviour. > # Setting the reporting style makes "details" links from GitHub point to the the selected UI. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2343) Make STDCI reporting UI configurable fir GitHub jobs
by Barak Korren (oVirt JIRA) 18 Jul '18

18 Jul '18

Barak Korren created OVIRT-2343: ----------------------------------- Summary: Make STDCI reporting UI configurable fir GitHub jobs Key: OVIRT-2343 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2343 Project: oVirt - virtualization made easy Issue Type: Bug Components: Standard CI (Pipelines), STDCI Build Report, STDCI DSL Reporter: Barak Korren Assignee: infra Priority: High Make it so developers in GitHub projects can select the UI the see build results in from the STDCI DSL. h3. Acceptance Criteria # The is a "reporting" option in the STDCI DSL # The reporting option is a dictionary for which we now support only the "style" key # The style key can have one of 3 values - "classic", "blue ocean" or "stdci" mapping to appropriate UIs. # The default value for the style key is "default" which keeps existing behaviour. # Setting the reporting style makes "details" links from GitHub point to the the selected UI. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

Fwd: No automatic handling for ovirt-setup-lib in bugzilla
by Yedidyah Bar David 18 Jul '18

18 Jul '18

Hi all, Sent this to infra-support two days ago, didn't get an automatic reply (should I have?), can't find it in jira. Any clue? Thanks, -- Didi ---------- Forwarded message ---------- From: Yedidyah Bar David <didi(a)redhat.com> Date: Sun, Jul 15, 2018 at 11:42 AM Subject: No automatic handling for ovirt-setup-lib in bugzilla To: infra-support(a)ovirt.org Hi all, I have [1] in ASSIGNED. I pushed some patches for it, including e.g. [2]. The patch wasn't added as an external tracker, nor the bug moved to POST. Please add ovirt-setup-lib to wherever needed so that it's handled like other projects. Thanks. [1] https://bugzilla.redhat.com/show_bug.cgi?id=1295041 [2] https://gerrit.ovirt.org/#/c/92832/ -- Didi

1 0

[oVirt Jenkins] ovirt-system-tests_he-basic-iscsi-suite-4.2 - Build # 134 - Failure!
by jenkins＠jenkins.phx.ovirt.org 18 Jul '18

18 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-4.2/13… Build Number: 134 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #134 [Dafna Ron] ovirt-master: skipping deactivae/activate storage tests ----------------- Failed Tests: ----------------- All tests passed

1 1

oVirt infra daily report - unstable production jobs - 524
by jenkins＠jenkins.phx.ovirt.org 18 Jul '18

18 Jul '18

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/524//artifact/exported-a… Cheers, Jenkins

1 0

[JIRA] (OVIRT-1993) Looking for a new task to help with
by sailesh baskar (oVirt JIRA) 17 Jul '18

17 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-1993?page=com.atlassian.jira.… ] sailesh baskar commented on OVIRT-1993: --------------------------------------- How to join the infra weekly meetings?? > Looking for a new task to help with > ----------------------------------- > > Key: OVIRT-1993 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-1993 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: sailesh baskar > Assignee: infra > > I would like to open a new ticket in the infrastructure team. Can you help > in the process? -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100089)

1 0

[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-4.2 - Build # 134 - Failure!
by jenkins＠jenkins.phx.ovirt.org 17 Jul '18

17 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/134/ Build Number: 134 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #134 [Dafna Ron] ovirt-master: skipping deactivae/activate storage tests ----------------- Failed Tests: ----------------- No tests ran.

1 1

[oVirt Jenkins] ovirt-system-tests_he-basic-ansible-suite-4.2 - Build # 383 - Failure!
by jenkins＠jenkins.phx.ovirt.org 17 Jul '18

17 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-4.2/… Build Number: 383 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #383 [Dafna Ron] ovirt-master: skipping deactivae/activate storage tests ----------------- Failed Tests: ----------------- No tests ran.

1 1

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 579 - Failure!
by jenkins＠jenkins.phx.ovirt.org 17 Jul '18

17 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/579/ Build Number: 579 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #579 [Dafna Ron] ovirt-master: skipping deactivae/activate storage tests ----------------- Failed Tests: ----------------- No tests ran.

1 1

[oVirt Jenkins] ovirt-system-tests_performance-suite-master - Build # 499 - Failure!
by jenkins＠jenkins.phx.ovirt.org 17 Jul '18

17 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/49… Build Number: 499 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #499 [Dafna Ron] ovirt-master: skipping deactivae/activate storage tests ----------------- Failed Tests: ----------------- No tests ran.

1 1

[oVirt Jenkins] ovirt-system-tests_he-basic-ansible-suite-master - Build # 453 - Failure!
by jenkins＠jenkins.phx.ovirt.org 17 Jul '18

17 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-mast… Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-mast… Build Number: 453 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #453 [Dafna Ron] ovirt-master: skipping deactivae/activate storage tests ----------------- Failed Tests: ----------------- No tests ran.

1 1

Re: [CQ]: 144186, 1 (ds-vdsm) failed "rhv-master" system tests, but isn't the failure root cause
by Emil Natan 17 Jul '18

17 Jul '18

It look like we hit https://projects.engineering.redhat.com/browse/RHEVINTEG-2523 or at least it looks like it: <error type="ovirtsdk.infrastructure.errors.RequestError" message=" status: 409 reason: Conflict detail: Cannot add VM. The VM name is already in use, please choose a unique name and try again."> re-trigger? On Tue, Jul 17, 2018 at 5:04 PM RHV-CI Jenkins <jenkins(a)ovirt.org> wrote: > A system test invoked by the "rhv-master" change queue including change > 144186,1 (ds-vdsm) failed. However, this change seems not to be the root > cause > for this failure. Change 128563,2 (ds-vdsm) that this change depends on or > is > based on, was detected as the cause of the testing failures. > > This change had been removed from the testing queue. Artifacts built from > this > change will not be released until either change 128563,2 (ds-vdsm) is > fixed and > this change is updated to refer to or rebased on the fixed version, or this > change is modified to no longer depend on it. > > For further details about the change see: > https://code.engineering.redhat.com/gerrit/#/c/144186/1 > > For further details about the change that seems to be the root cause > behind the > testing failures see: > https://code.engineering.redhat.com/gerrit/#/c/128563/2 > > For failed test results see: > > https://rhv-devops-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/job/rhv-master_c… > > -- Emil Natan RHV DevOps

2 1

[JIRA] (OVIRT-2342) Create a repo called ovirt-engine-config
by Tareq Alayan (oVirt JIRA) 17 Jul '18

17 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2342?page=com.atlassian.jira.… ] Tareq Alayan commented on OVIRT-2342: ------------------------------------- ovirt-ansible-engine-config [~omachace(a)redhat.com] what do you think? > Create a repo called ovirt-engine-config > ----------------------------------------- > > Key: OVIRT-2342 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2342 > Project: oVirt - virtualization made easy > Issue Type: Task > Components: GitHub > Reporter: Tareq Alayan > Assignee: infra > > the repo will contain the ansible role representing the ovirt-engine-config utility -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100089)

1 0

[JIRA] (OVIRT-2342) Create a repo called ovirt-engine-config
by Barak Korren (oVirt JIRA) 17 Jul '18

17 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2342?page=com.atlassian.jira.… ] Barak Korren commented on OVIRT-2342: ------------------------------------- So should this be on Github? If its an Ansible role, shouldn't it be called "ovirt-ansible-<something*>" ? > Create a repo called ovirt-engine-config > ----------------------------------------- > > Key: OVIRT-2342 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2342 > Project: oVirt - virtualization made easy > Issue Type: Task > Components: GitHub > Reporter: Tareq Alayan > Assignee: infra > > the repo will contain the ansible role representing the ovirt-engine-config utility -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100089)

1 0

[oVirt Jenkins] ovirt-system-tests_he-basic-suite-master - Build # 611 - Failure!
by jenkins＠jenkins.phx.ovirt.org 17 Jul '18

17 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-suite-master/611/ Build Number: 611 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #611 [Dafna Ron] ovirt-master: skipping deactivae/activate storage tests ----------------- Failed Tests: ----------------- No tests ran.

1 1

[JIRA] (OVIRT-2342) Create a repo called ovirt-engine-config
by Tareq Alayan (oVirt JIRA) 17 Jul '18

17 Jul '18

Tareq Alayan created OVIRT-2342: ----------------------------------- Summary: Create a repo called ovirt-engine-config Key: OVIRT-2342 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2342 Project: oVirt - virtualization made easy Issue Type: Task Components: GitHub Reporter: Tareq Alayan Assignee: infra the repo will contain the ansible role representing the ovirt-engine-config utility -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100089)

1 0

[CQ]: 82352, 28 (ovirt-hosted-engine-ha) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 17 Jul '18

17 Jul '18

A system test invoked by the "ovirt-master" change queue including change 82352,28 (ovirt-hosted-engine-ha) failed. However, this change seems not to be the root cause for this failure. Change 92836,2 (ovirt-hosted-engine-ha) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 92836,2 (ovirt-hosted-engine- ha) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/82352/28 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/92836/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8702/

2 1

[JIRA] (OVIRT-2341) Move OST open bugs to Jira and disable product in bugzilla
by Eyal Edri (oVirt JIRA) 17 Jul '18

17 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2341?page=com.atlassian.jira.… ] Eyal Edri reassigned OVIRT-2341: -------------------------------- Assignee: Gal Ben Haim (was: infra) Gal, Can you please open a ticket to Bugzilla team to remove the OST component so future issues won't be opened there? > Move OST open bugs to Jira and disable product in bugzilla > ---------------------------------------------------------- > > Key: OVIRT-2341 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2341 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: sbonazzo > Assignee: Gal Ben Haim > > According to Eyal, OST issues are not to be tracked anymore in bugzilla. > Please move > https://bugzilla.redhat.com/buglist.cgi?quicksearch=product%3Aovirt-system-… > to https://ovirt-jira.atlassian.net/projects/OST/issues > Then request to disable ovirt-system-tests product from Community > classification on bugzilla.redhat.com to prevent further bugs to be opened > there. > Thanks > -- > SANDRO BONAZZOLA > MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV > Red Hat EMEA <https://www.redhat.com/> > sbonazzo(a)redhat.com > <https://red.ht/sig> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100089)

1 0

[JIRA] (OVIRT-2341) Move OST open bugs to Jira and disable product in bugzilla
by sbonazzo (oVirt JIRA) 17 Jul '18

17 Jul '18

sbonazzo created OVIRT-2341: ------------------------------- Summary: Move OST open bugs to Jira and disable product in bugzilla Key: OVIRT-2341 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2341 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: sbonazzo Assignee: infra According to Eyal, OST issues are not to be tracked anymore in bugzilla. Please move https://bugzilla.redhat.com/buglist.cgi?quicksearch=product%3Aovirt-system-… to https://ovirt-jira.atlassian.net/projects/OST/issues Then request to disable ovirt-system-tests product from Community classification on bugzilla.redhat.com to prevent further bugs to be opened there. Thanks -- SANDRO BONAZZOLA MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100089)

1 0

[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-master - Build # 198 - Failure!
by jenkins＠jenkins.phx.ovirt.org 17 Jul '18

17 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/198/ Build Number: 198 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #198 [Dafna Ron] ovirt-master: skipping deactivae/activate storage tests ----------------- Failed Tests: ----------------- No tests ran.

1 1

[oVirt Jenkins] ovirt-system-tests_he-basic-iscsi-suite-4.2 - Build # 132 - Failure!
by jenkins＠jenkins.phx.ovirt.org 17 Jul '18

17 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-4.2/13… Build Number: 132 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #132 [Dafna Ron] ovirt-master: skipping deactivae/activate storage tests ----------------- Failed Tests: ----------------- No tests ran.

1 1

[oVirt Jenkins] ovirt-system-tests_network-suite-4.2 - Build # 398 - Failure!
by jenkins＠jenkins.phx.ovirt.org 17 Jul '18

17 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_network-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_network-suite-4.2/398/ Build Number: 398 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #398 [Dafna Ron] ovirt-master: skipping deactivae/activate storage tests ----------------- Failed Tests: ----------------- No tests ran.

1 1

[oVirt Jenkins] ovirt-system-tests_he-basic-iscsi-suite-master - Build # 339 - Failure!
by jenkins＠jenkins.phx.ovirt.org 17 Jul '18

17 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-iscsi-suite-master… Build Number: 339 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #339 [Dafna Ron] ovirt-master: skipping deactivae/activate storage tests ----------------- Failed Tests: ----------------- All tests passed

1 3

[JIRA] (OVIRT-2340) Unable to run containers with the '-p' option
by Barak Korren (oVirt JIRA) 17 Jul '18

17 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2340?page=com.atlassian.jira.… ] Barak Korren reassigned OVIRT-2340: ----------------------------------- Assignee: Barak Korren (was: infra) > Unable to run containers with the '-p' option > --------------------------------------------- > > Key: OVIRT-2340 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2340 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: Jenkins Slaves > Reporter: Barak Korren > Assignee: Barak Korren > Priority: High > > When trying to run containers that expose ports we can get the following error: > {code} > /usr/bin/docker-current: Error response from daemon: driver failed programming external connectivity on endpoint silly_sammet (90b600ff5b0e6c2e708e8cd5086b518596dbe7ac4fa2735bec52d3a88e1ae004): (iptables failed: iptables --wait -t nat -A DOCKER -p tcp -d 0/0 --dport 4444 -j DNAT --to-destination 172.17.0.2:3333 ! -i docker0: iptables: No chain/target/match by that name. > (exit status 1)). > {code} > We can reproduce this for example wiht the following command: > {code} > sudo docker run -it --rm -p 4444:3333 centos > {code} > Further information: > # This seems to be happening because the "DOCKER" chain is missing in iptables. > # We've seen this happen constantly on FC28 slaves but not on EL7 slaves > # Restarting the docker service recreates the iptables chain and effectively resolves the issue -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100089)

1 0

[JIRA] (OVIRT-2340) Unable to run containers with the '-p' option
by Barak Korren (oVirt JIRA) 17 Jul '18

17 Jul '18

Barak Korren created OVIRT-2340: ----------------------------------- Summary: Unable to run containers with the '-p' option Key: OVIRT-2340 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2340 Project: oVirt - virtualization made easy Issue Type: Bug Components: Jenkins Slaves Reporter: Barak Korren Assignee: infra Priority: High When trying to run containers that expose ports we can get the following error: {code} /usr/bin/docker-current: Error response from daemon: driver failed programming external connectivity on endpoint silly_sammet (90b600ff5b0e6c2e708e8cd5086b518596dbe7ac4fa2735bec52d3a88e1ae004): (iptables failed: iptables --wait -t nat -A DOCKER -p tcp -d 0/0 --dport 4444 -j DNAT --to-destination 172.17.0.2:3333 ! -i docker0: iptables: No chain/target/match by that name. (exit status 1)). {code} We can reproduce this for example wiht the following command: {code} sudo docker run -it --rm -p 4444:3333 centos {code} Further information: # This seems to be happening because the "DOCKER" chain is missing in iptables. # We've seen this happen constantly on FC28 slaves but not on EL7 slaves # Restarting the docker service recreates the iptables chain and effectively resolves the issue -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100089)

1 0

[JIRA] (OVIRT-2340) Unable to run containers with the '-p' option
by Barak Korren (oVirt JIRA) 17 Jul '18

17 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2340?page=com.atlassian.jira.… ] Barak Korren updated OVIRT-2340: -------------------------------- Epic Link: OVIRT-2339 > Unable to run containers with the '-p' option > --------------------------------------------- > > Key: OVIRT-2340 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2340 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: Jenkins Slaves > Reporter: Barak Korren > Assignee: infra > Priority: High > > When trying to run containers that expose ports we can get the following error: > {code} > /usr/bin/docker-current: Error response from daemon: driver failed programming external connectivity on endpoint silly_sammet (90b600ff5b0e6c2e708e8cd5086b518596dbe7ac4fa2735bec52d3a88e1ae004): (iptables failed: iptables --wait -t nat -A DOCKER -p tcp -d 0/0 --dport 4444 -j DNAT --to-destination 172.17.0.2:3333 ! -i docker0: iptables: No chain/target/match by that name. > (exit status 1)). > {code} > We can reproduce this for example wiht the following command: > {code} > sudo docker run -it --rm -p 4444:3333 centos > {code} > Further information: > # This seems to be happening because the "DOCKER" chain is missing in iptables. > # We've seen this happen constantly on FC28 slaves but not on EL7 slaves > # Restarting the docker service recreates the iptables chain and effectively resolves the issue -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100089)

1 0

[JIRA] (OVIRT-2339) Enabe Kubevirt to use oVirt infra for CI
by Barak Korren (oVirt JIRA) 17 Jul '18

17 Jul '18

Barak Korren created OVIRT-2339: ----------------------------------- Summary: Enabe Kubevirt to use oVirt infra for CI Key: OVIRT-2339 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2339 Project: oVirt - virtualization made easy Issue Type: Epic Components: oVirt Infra Reporter: Barak Korren Assignee: infra Priority: High Enabe Kubevirt to use oVirt infra for CI -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100089)

1 0

Build failed in Jenkins: deploy-to_ovirt-master_tested #4318
by jenkins＠jenkins.phx.ovirt.org 17 Jul '18

17 Jul '18

See <http://jenkins.ovirt.org/job/deploy-to_ovirt-master_tested/4318/display/red…> ------------------------------------------ Started by upstream project "ovirt-release_master_build-artifacts-fc28-x86_64" build number 42 originally caused by: Started by timer [EnvInject] - Loading node environment variables. Building remotely on vm0061.workers-phx.ovirt.org (libvirt phx fc28 nested) in workspace <http://jenkins.ovirt.org/job/deploy-to_ovirt-master_tested/ws/> [ssh-agent] Looking for ssh-agent implementation... [ssh-agent] Exec ssh-agent (binary ssh-agent on a remote machine) $ ssh-agent SSH_AUTH_SOCK=/tmp/ssh-HziZu3o10sRC/agent.29245 SSH_AGENT_PID=29247 [ssh-agent] Started. $ ssh-add <http://jenkins.ovirt.org/job/deploy-to_ovirt-master_tested/ws/@tmp/private_…> Identity added: <http://jenkins.ovirt.org/job/deploy-to_ovirt-master_tested/ws/@tmp/private_…> (<http://jenkins.ovirt.org/job/deploy-to_ovirt-master_tested/ws/@tmp/private_…)> [ssh-agent] Using credentials deploy-ovirt-experimental (SSH key for deploying to the tested repo) [deploy-to_ovirt-master_tested] $ /bin/bash -xe /tmp/jenkins5390467149633363503.sh + [[ http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-fc28-x86_… == '' ]] + queue_name=ovirt-master + echo repo-extra-dir:master + ssh -o StrictHostKeyChecking=no deploy-ovirt-experimental(a)resources.ovirt.org + echo http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-fc28-x86_… Pseudo-terminal will not be allocated because stdin is not a terminal. + BASE_DIR=/srv/resources/repos/ovirt/tested + PUBLISH_MD_COPIES=50 + main + local tmp_dir + mkdir -p /srv/resources/repos/ovirt/tested ++ mktemp -d /srv/resources/repos/ovirt/tested/.deploy.XXXXXXXXXX Collecting packages + tmp_dir=/srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA + trap 'rm -rf '\''/srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA'\''' EXIT HUP + echo 'Collecting packages' + collect_packages /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA + local repoman_dst=/srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA + repoman --temp-dir generate-in-repo --option main.allowed_repo_paths=/srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA --option main.on_empty_source=warn /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA add conf:stdin 2018-07-17 00:55:48,462::INFO::repoman.cmd:: 2018-07-17 00:55:48,474::INFO::repoman.cmd::Adding artifacts to the repo /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA 2018-07-17 00:55:48,475::INFO::repoman.common.repo::Adding repo extra dir master 2018-07-17 00:55:48,486::INFO::repoman.common.stores.RPM::Loading repo /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master 2018-07-17 00:55:48,502::INFO::repoman.common.stores.RPM::Repo /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master loaded 2018-07-17 00:55:48,505::INFO::repoman.common.stores.iso::Loading repo /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master 2018-07-17 00:55:48,506::INFO::repoman.common.stores.iso::Repo /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master loaded 2018-07-17 00:55:48,527::INFO::repoman.common.repo::Resolving artifact source http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-fc28-x86_… 2018-07-17 00:55:52,001::INFO::repoman.common.sources.jenkins::Parsing jenkins URL: http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-fc28-x86_… 2018-07-17 00:55:52,051::INFO::repoman.common.sources.jenkins:: Got URL: http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-fc28-x86_… 2018-07-17 00:55:52,054::INFO::repoman.common.sources.jenkins:: Got URL: http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-fc28-x86_… 2018-07-17 00:55:52,055::INFO::repoman.common.sources.jenkins:: Got URL: http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-fc28-x86_… 2018-07-17 00:55:52,055::INFO::repoman.common.sources.jenkins:: Got URL: http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-fc28-x86_… 2018-07-17 00:55:52,056::INFO::repoman.common.sources.jenkins:: Got URL: http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-fc28-x86_… 2018-07-17 00:55:52,059::INFO::root:: Done 2018-07-17 00:55:52,415::INFO::root::Downloading http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-fc28-x86_…, length 7K ... %[-----------------------25------------------------50-----------------------75------------------------] %[====================================================================================================] 2018-07-17 00:55:53,687::INFO::repoman.common.stores.RPM::Adding package /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/.lago_tmp/tmpWP_RB9/tmpL9w0Pq/ovirt-node-ng-image-update-placeholder-4.3.0-0.1.master.20180717005427.git356809a.fc28.noarch.rpm to repo /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master 2018-07-17 00:55:53,916::INFO::root::Downloading http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-fc28-x86_…, length 327K ... %[-----------------------25------------------------50-----------------------75------------------------] %[====================================================================================================] 2018-07-17 00:55:55,133::INFO::repoman.common.stores.RPM::Adding package /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/.lago_tmp/tmpWP_RB9/tmpL9w0Pq/ovirt-release-host-node-4.3.0-0.1.master.20180717005427.git356809a.fc28.noarch.rpm to repo /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master 2018-07-17 00:55:55,557::INFO::root::Downloading http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-fc28-x86_…, length 11K ... %[-----------------------25------------------------50-----------------------75------------------------] %[====================================================================================================] 2018-07-17 00:55:56,551::INFO::repoman.common.stores.RPM::Adding package /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/.lago_tmp/tmpWP_RB9/tmpL9w0Pq/ovirt-release-master-4.3.0-0.1.master.20180717005427.git356809a.fc28.noarch.rpm to repo /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master 2018-07-17 00:55:56,672::INFO::root::Downloading http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-fc28-x86_…, length 396K ... %[-----------------------25------------------------50-----------------------75------------------------] %[====================================================================================================] 2018-07-17 00:55:57,928::INFO::repoman.common.stores.RPM::Adding package /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/.lago_tmp/tmpWP_RB9/tmpL9w0Pq/ovirt-release-master-4.3.0-0.1.master.20180717005427.git356809a.fc28.src.rpm to repo /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master 2018-07-17 00:55:58,034::INFO::root::Downloading http://jenkins.ovirt.org/job/ovirt-release_master_build-artifacts-fc28-x86_…, length 11K ... %[-----------------------25------------------------50-----------------------75------------------------] %[====================================================================================================] 2018-07-17 00:55:59,386::INFO::repoman.common.stores.RPM::Adding package /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/.lago_tmp/tmpWP_RB9/tmpL9w0Pq/ovirt-release-master-tested-4.3.0-0.1.master.20180717005427.git356809a.fc28.noarch.rpm to repo /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master 2018-07-17 00:55:59,523::INFO::repoman.cmd:: 2018-07-17 00:55:59,529::INFO::repoman.common.stores.RPM::Saving new added rpms into /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master 2018-07-17 00:55:59,533::INFO::root::Saving /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master/rpm/fc28/noarch/ovirt-node-ng-image-update-placeholder-4.3.0-0.1.master.20180717005427.git356809a.fc28.noarch.rpm 2018-07-17 00:55:59,546::INFO::root::Saving /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master/rpm/fc28/noarch/ovirt-release-host-node-4.3.0-0.1.master.20180717005427.git356809a.fc28.noarch.rpm 2018-07-17 00:55:59,548::INFO::root::Saving /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master/rpm/fc28/noarch/ovirt-release-master-4.3.0-0.1.master.20180717005427.git356809a.fc28.noarch.rpm 2018-07-17 00:55:59,548::INFO::root::Saving /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master/rpm/fc28/SRPMS/ovirt-release-master-4.3.0-0.1.master.20180717005427.git356809a.fc28.src.rpm 2018-07-17 00:55:59,549::INFO::root::Saving /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master/rpm/fc28/noarch/ovirt-release-master-tested-4.3.0-0.1.master.20180717005427.git356809a.fc28.noarch.rpm 2018-07-17 00:55:59,568::INFO::repoman.common.stores.RPM:: 2018-07-17 00:55:59,568::INFO::repoman.common.stores.RPM::Updating metadata 2018-07-17 00:55:59,568::INFO::repoman.common.stores.RPM:: Creating metadata for fc28 2018-07-17 00:56:09,579::INFO::repoman.common.stores.RPM:: 2018-07-17 00:56:09,811::INFO::repoman.common.stores.RPM::Creating symlinks 2018-07-17 00:56:09,948::INFO::repoman.common.stores.RPM:: 2018-07-17 00:56:09,967::INFO::repoman.common.stores.RPM::Saved /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master 2018-07-17 00:56:10,020::INFO::repoman.common.stores.iso::Saving new added isos into /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master 2018-07-17 00:56:10,041::INFO::repoman.common.stores.iso:: 2018-07-17 00:56:10,042::INFO::repoman.common.stores.iso::Saved /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/master 2018-07-17 00:56:10,188::INFO::repoman.common.repo::Cleaning up temporary dir /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/.lago_tmp/tmpWP_RB9/tmpL9w0Pq 2018-07-17 00:56:10,204::INFO::repoman.common.repo::Cleaning up temporary dir /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA/.lago_tmp/tmpWP_RB9 Publishing to repo + echo 'Publishing to repo' + push_to_tested /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA /srv/resources/repos/ovirt/tested + local pkg_src=/srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA + local pkg_dst=/srv/resources/repos/ovirt/tested + cd /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA + find . -type d '!' -name repodata + tac + read dir + install -o deploy-ovirt-experimental -m 755 -d /srv/resources/repos/ovirt/tested/./.lago_tmp + xargs -0 -r cp -RPplf -t /srv/resources/repos/ovirt/tested/./.lago_tmp + find ./.lago_tmp -maxdepth 1 '!' -type d -print0 + [[ -d ./.lago_tmp/repodata ]] + read dir + install -o deploy-ovirt-experimental -m 755 -d /srv/resources/repos/ovirt/tested/./master/rpm/fc28/noarch + find ./master/rpm/fc28/noarch -maxdepth 1 '!' -type d -print0 + xargs -0 -r cp -RPplf -t /srv/resources/repos/ovirt/tested/./master/rpm/fc28/noarch + [[ -d ./master/rpm/fc28/noarch/repodata ]] + read dir + install -o deploy-ovirt-experimental -m 755 -d /srv/resources/repos/ovirt/tested/./master/rpm/fc28/SRPMS + find ./master/rpm/fc28/SRPMS -maxdepth 1 '!' -type d -print0 + xargs -0 -r cp -RPplf -t /srv/resources/repos/ovirt/tested/./master/rpm/fc28/SRPMS + [[ -d ./master/rpm/fc28/SRPMS/repodata ]] + createrepo_c --update --retain-old-md 50 --workers 8 /srv/resources/repos/ovirt/tested/./master/rpm/fc28/SRPMS Directory walk started Directory walk done - 398 packages Loaded information about 397 packages Temporary output repo path: /srv/resources/repos/ovirt/tested/./master/rpm/fc28/SRPMS/.repodata/ Preparing sqlite DBs Pool started (with 8 workers) Pool finished + read dir + install -o deploy-ovirt-experimental -m 755 -d /srv/resources/repos/ovirt/tested/./master/rpm/fc28 + find ./master/rpm/fc28 -maxdepth 1 '!' -type d -print0 + xargs -0 -r cp -RPplf -t /srv/resources/repos/ovirt/tested/./master/rpm/fc28 + [[ -d ./master/rpm/fc28/repodata ]] + createrepo_c --update --retain-old-md 50 --workers 8 /srv/resources/repos/ovirt/tested/./master/rpm/fc28 /home/deploy-ovirt-experimental/deploy-to-tested.sh: line 33: 3023 Killed createrepo_c --update --retain-old-md "$PUBLISH_MD_COPIES" --workers 8 "$pkg_dst/$dir" + rm -rf /srv/resources/repos/ovirt/tested/.deploy.rPNQeXyoiA Build step 'Execute shell' marked build as failure $ ssh-agent -k unset SSH_AUTH_SOCK; unset SSH_AGENT_PID; echo Agent pid 29247 killed; [ssh-agent] Stopped.

1 3

[CQ]: 92782, 3 (ovirt-hosted-engine-ha) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 17 Jul '18

17 Jul '18

A system test invoked by the "ovirt-master" change queue including change 92782,3 (ovirt-hosted-engine-ha) failed. However, this change seems not to be the root cause for this failure. Change 92836,2 (ovirt-hosted-engine-ha) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 92836,2 (ovirt-hosted-engine- ha) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/92782/3 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/92836/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8699/

2 1