- Infra - oVirt List Archives

[oVirt Jenkins] ovirt-appliance_master_build-artifacts-fc28-x86_64 - Build # 91 - Failure!
by jenkins＠jenkins.phx.ovirt.org 15 Oct '18

15 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-appliance_master_build-artifacts-fc28-x8… Build: http://jenkins.ovirt.org/job/ovirt-appliance_master_build-artifacts-fc28-x8… Build Number: 91 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #91 [Yuval Turgeman] automation: remove build-artifacts* from stdci-v2 ----------------- Failed Tests: ----------------- No tests ran.

1 2

oVirt infra daily report - unstable production jobs - 613
by jenkins＠jenkins.phx.ovirt.org 15 Oct '18

15 Oct '18

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/613//artifact/exported-a… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 783 - Failure!
by jenkins＠jenkins.phx.ovirt.org 15 Oct '18

15 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/783/ Build Number: 783 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #783 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: Host lago-hc-basic-suite-master-host-1 is in non operational state -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7fb2e4ac8230> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 258, in _host_is_up_4 raise RuntimeError('Host %s is in non operational state' % api_host.name) RuntimeError: Host lago-hc-basic-suite-master-host-1 is in non operational state --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 228, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 275, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 278, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 258, in _host_is_up_4 raise RuntimeError('Host %s is in non operational state' % api_host.name) 'Host lago-hc-basic-suite-master-host-1 is in non operational state\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7fb2e4ac8230>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 258, in _host_is_up_4\n raise RuntimeError(\'Host %s is in non operational state\' % api_host.name)\nRuntimeError: Host lago-hc-basic-suite-master-host-1 is in non operational state\n--------------------- >> end captured logging << ---------------------'

1 2

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-4.2 - Build # 563 - Failure!
by jenkins＠jenkins.phx.ovirt.org 14 Oct '18

14 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/563/ Build Number: 563 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #563 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: Failed to read response: [(<pycurl.Curl object at 0x7f9985ee0050>, 7, 'TCP connection reset by peer')] -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7f9985e83578> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37093, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 54, in wait response = self._connection.wait(self._context) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 496, in wait return self.__wait(context, failed_auth) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 510, in __wait raise Error("Failed to read response: {}".format(err_list)) Error: Failed to read response: [(<pycurl.Curl object at 0x7f9985ee0050>, 7, 'TCP connection reset by peer')] --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 229, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 273, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 278, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37093, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 54, in wait response = self._connection.wait(self._context) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 496, in wait return self.__wait(context, failed_auth) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 510, in __wait raise Error("Failed to read response: {}".format(err_list)) 'Failed to read response: [(<pycurl.Curl object at 0x7f9985ee0050>, 7, \'TCP connection reset by peer\')]\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7f9985e83578>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4\n host_obj = host_service.get()\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37093, in get\n return self._internal_get(headers, query, wait)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get\n return future.wait() if wait else future\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 54, in wait\n response = self._connection.wait(self._context)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 496, in wait\n return self.__wait(context, failed_auth)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 510, in __wait\n raise Error("Failed to read response: {}".format(err_list))\nError: Failed to read response: [(<pycurl.Curl object at 0x7f9985ee0050>, 7, \'TCP connection reset by peer\')]\n--------------------- >> end captured logging << ---------------------'

1 1

[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-4.2 - Build # 347 - Failure!
by jenkins＠jenkins.phx.ovirt.org 14 Oct '18

14 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/347/ Build Number: 347 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #347 [Dafna Ron] ovirt-4.2: block external links from running in ost ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 010_local_maintenance_cli.local_maintenance Error Message: 143 -------------------- >> begin captured logging << -------------------- root: INFO: * Waiting For System Stability... lago.ssh: DEBUG: start task:90555ac6-a749-4c6d-97d0-ca20f9ee7e56:Get ssh client for lago-he-node-ng-suite-4-2-host-1: lago.ssh: DEBUG: end task:90555ac6-a749-4c6d-97d0-ca20f9ee7e56:Get ssh client for lago-he-node-ng-suite-4-2-host-1: lago.ssh: DEBUG: Running 4d4a6eae on lago-he-node-ng-suite-4-2-host-1: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 4d4a6eae on lago-he-node-ng-suite-4-2-host-1 returned with 0 lago.ssh: DEBUG: Command 4d4a6eae on lago-he-node-ng-suite-4-2-host-1 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4241 (Wed Sep 26 17:40:36 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=4241 (Wed Sep 26 17:40:36 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "49ba6ea7", "local_conf_timestamp": 4241, "host-ts": 4241}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4247 (Wed Sep 26 17:40:41 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4247 (Wed Sep 26 17:40:41 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e8286b5a", "local_conf_timestamp": 4247, "host-ts": 4247}, "global_maintenance": false} lago.ssh: DEBUG: start task:cdd8bc8a-3f38-4e62-9699-7ef8e4864f9a:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:cdd8bc8a-3f38-4e62-9699-7ef8e4864f9a:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 4e65c50e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --set-maintenance --mode=local lago.ssh: DEBUG: Command 4e65c50e on lago-he-node-ng-suite-4-2-host-0 returned with 0 root: INFO: * Waiting for engine to migrate... lago.ssh: DEBUG: start task:cdb61607-0d9d-4531-931e-e2a2c02f6b15:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:cdb61607-0d9d-4531-931e-e2a2c02f6b15:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 4fac57de on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 4fac57de on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 4fac57de on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4251 (Wed Sep 26 17:40:46 2018)\nhost-id=1\nscore=3400\nvm_conf_refresh_time=4251 (Wed Sep 26 17:40:46 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "95dd2e98", "local_conf_timestamp": 4251, "host-ts": 4251}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4247 (Wed Sep 26 17:40:41 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4247 (Wed Sep 26 17:40:41 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e8286b5a", "local_conf_timestamp": 4247, "host-ts": 4247}, "global_maintenance": false} lago.ssh: DEBUG: start task:1fc0139b-3d03-4e0a-8168-69c54559563d:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:1fc0139b-3d03-4e0a-8168-69c54559563d:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 56ec62dc on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 56ec62dc on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 56ec62dc on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4262 (Wed Sep 26 17:40:56 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4262 (Wed Sep 26 17:40:56 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "01cda987", "local_conf_timestamp": 4262, "host-ts": 4262}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4257 (Wed Sep 26 17:40:51 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4257 (Wed Sep 26 17:40:52 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ec6e945f", "local_conf_timestamp": 4257, "host-ts": 4257}, "global_maintenance": false} lago.ssh: DEBUG: start task:12189e9a-68f8-42d0-ba7a-126282d28b98:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:12189e9a-68f8-42d0-ba7a-126282d28b98:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 5aec01a8 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 5aec01a8 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 5aec01a8 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4272 (Wed Sep 26 17:41:07 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4272 (Wed Sep 26 17:41:07 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "03cc6058", "local_conf_timestamp": 4272, "host-ts": 4272}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4267 (Wed Sep 26 17:41:02 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4267 (Wed Sep 26 17:41:02 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e0a59550", "local_conf_timestamp": 4267, "host-ts": 4267}, "global_maintenance": false} lago.ssh: DEBUG: start task:6e63e48d-6a63-41da-92db-73b872e79e0a:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:6e63e48d-6a63-41da-92db-73b872e79e0a:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 5e4ddc0e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 5e4ddc0e on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 5e4ddc0e on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4272 (Wed Sep 26 17:41:07 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4272 (Wed Sep 26 17:41:07 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "03cc6058", "local_conf_timestamp": 4272, "host-ts": 4272}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4267 (Wed Sep 26 17:41:02 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4267 (Wed Sep 26 17:41:02 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e0a59550", "local_conf_timestamp": 4267, "host-ts": 4267}, "global_maintenance": false} lago.ssh: DEBUG: start task:b30d6158-ccd3-4752-8b2f-cad0c236e420:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:b30d6158-ccd3-4752-8b2f-cad0c236e420:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 6147daf4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 6147daf4 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 6147daf4 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4282 (Wed Sep 26 17:41:17 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4283 (Wed Sep 26 17:41:17 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f97e01d5", "local_conf_timestamp": 4283, "host-ts": 4282}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4277 (Wed Sep 26 17:41:12 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4277 (Wed Sep 26 17:41:12 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "93de5fcd", "local_conf_timestamp": 4277, "host-ts": 4277}, "global_maintenance": false} lago.ssh: DEBUG: start task:634c9638-320f-4848-ad7f-30ba5f612b08:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:634c9638-320f-4848-ad7f-30ba5f612b08:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 6443f238 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 6443f238 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 6443f238 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4292 (Wed Sep 26 17:41:26 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4292 (Wed Sep 26 17:41:27 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "204a0f81", "local_conf_timestamp": 4292, "host-ts": 4292}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4287 (Wed Sep 26 17:41:21 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4287 (Wed Sep 26 17:41:21 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ac395afe", "local_conf_timestamp": 4287, "host-ts": 4287}, "global_maintenance": false} lago.ssh: DEBUG: start task:e6c602be-6983-4556-98c4-4b57f63c7006:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:e6c602be-6983-4556-98c4-4b57f63c7006:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 674f8cc6 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 674f8cc6 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 674f8cc6 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4292 (Wed Sep 26 17:41:26 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4292 (Wed Sep 26 17:41:27 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "204a0f81", "local_conf_timestamp": 4292, "host-ts": 4292}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4287 (Wed Sep 26 17:41:21 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4287 (Wed Sep 26 17:41:21 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ac395afe", "local_conf_timestamp": 4287, "host-ts": 4287}, "global_maintenance": false} lago.ssh: DEBUG: start task:4beec84d-e882-43d6-9fab-667e4e81cbda:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:4beec84d-e882-43d6-9fab-667e4e81cbda:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 6a680c80 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 6a680c80 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 6a680c80 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4302 (Wed Sep 26 17:41:37 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4302 (Wed Sep 26 17:41:37 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8a734436", "local_conf_timestamp": 4302, "host-ts": 4302}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4297 (Wed Sep 26 17:41:31 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4297 (Wed Sep 26 17:41:31 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a87fa5fb", "local_conf_timestamp": 4297, "host-ts": 4297}, "global_maintenance": false} lago.ssh: DEBUG: start task:7cd1cc45-58d8-4c69-92e3-62a2d08a6904:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:7cd1cc45-58d8-4c69-92e3-62a2d08a6904:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 6d5c6b66 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 6d5c6b66 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 6d5c6b66 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4302 (Wed Sep 26 17:41:37 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4302 (Wed Sep 26 17:41:37 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8a734436", "local_conf_timestamp": 4302, "host-ts": 4302}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4297 (Wed Sep 26 17:41:31 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4297 (Wed Sep 26 17:41:31 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a87fa5fb", "local_conf_timestamp": 4297, "host-ts": 4297}, "global_maintenance": false} lago.ssh: DEBUG: start task:a81b0359-b525-41fa-9906-7f21f0f27dd6:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:a81b0359-b525-41fa-9906-7f21f0f27dd6:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 704b805a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 704b805a on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 704b805a on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4302 (Wed Sep 26 17:41:37 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4302 (Wed Sep 26 17:41:37 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8a734436", "local_conf_timestamp": 4302, "host-ts": 4302}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4307 (Wed Sep 26 17:41:42 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4307 (Wed Sep 26 17:41:42 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4d44c828", "local_conf_timestamp": 4307, "host-ts": 4307}, "global_maintenance": false} lago.ssh: DEBUG: start task:e51f9ed4-1717-44c9-b0ee-37ea5e05676a:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:e51f9ed4-1717-44c9-b0ee-37ea5e05676a:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 7349afde on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 7349afde on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 7349afde on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4312 (Wed Sep 26 17:41:47 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4313 (Wed Sep 26 17:41:47 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "53474a62", "local_conf_timestamp": 4313, "host-ts": 4312}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4307 (Wed Sep 26 17:41:42 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4307 (Wed Sep 26 17:41:42 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4d44c828", "local_conf_timestamp": 4307, "host-ts": 4307}, "global_maintenance": false} lago.ssh: DEBUG: start task:243d2486-a3ca-4ca5-8fff-878978118a3d:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:243d2486-a3ca-4ca5-8fff-878978118a3d:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 76684004 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 76684004 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 76684004 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4322 (Wed Sep 26 17:41:56 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4322 (Wed Sep 26 17:41:57 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0d643ff3", "local_conf_timestamp": 4322, "host-ts": 4322}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4317 (Wed Sep 26 17:41:52 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4317 (Wed Sep 26 17:41:52 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4902372d", "local_conf_timestamp": 4317, "host-ts": 4317}, "global_maintenance": false} lago.ssh: DEBUG: start task:c1b8be35-3faa-4959-8a52-56991f4fa241:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:c1b8be35-3faa-4959-8a52-56991f4fa241:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 7999ef0c on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 7999ef0c on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 7999ef0c on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4322 (Wed Sep 26 17:41:56 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4322 (Wed Sep 26 17:41:57 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineMigratingAway\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0d643ff3", "local_conf_timestamp": 4322, "host-ts": 4322}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4317 (Wed Sep 26 17:41:52 2018)\nhost-id=2\nscore=3000\nvm_conf_refresh_time=4317 (Wed Sep 26 17:41:52 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4902372d", "local_conf_timestamp": 4317, "host-ts": 4317}, "global_maintenance": false} lago.ssh: DEBUG: start task:c6947cc4-e42c-4461-a2ca-e144eed75f88:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:c6947cc4-e42c-4461-a2ca-e144eed75f88:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 7c7e5744 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 7c7e5744 on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 7c7e5744 on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4332 (Wed Sep 26 17:42:07 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4332 (Wed Sep 26 17:42:07 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "VM migrated away successfully", "health": "bad", "vm": "down", "detail": "Down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c23b8814", "local_conf_timestamp": 4332, "host-ts": 4332}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4327 (Wed Sep 26 17:42:01 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4327 (Wed Sep 26 17:42:01 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "4488c592", "local_conf_timestamp": 4327, "host-ts": 4327}, "global_maintenance": false} lago.ssh: DEBUG: start task:25677b7b-0a3f-4018-9a2d-399570c4f390:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: end task:25677b7b-0a3f-4018-9a2d-399570c4f390:Get ssh client for lago-he-node-ng-suite-4-2-host-0: lago.ssh: DEBUG: Running 7d97c89a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json lago.ssh: DEBUG: Command 7d97c89a on lago-he-node-ng-suite-4-2-host-0 returned with 0 lago.ssh: DEBUG: Command 7d97c89a on lago-he-node-ng-suite-4-2-host-0 output: {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4332 (Wed Sep 26 17:42:07 2018)\nhost-id=1\nscore=3000\nvm_conf_refresh_time=4332 (Wed Sep 26 17:42:07 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineDown\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "VM migrated away successfully", "health": "bad", "vm": "down", "detail": "Down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c23b8814", "local_conf_timestamp": 4332, "host-ts": 4332}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\nmetadata_feature_version=1\ntimestamp=4327 (Wed Sep 26 17:42:01 2018)\nhost-id=2\nscore=3400\nvm_conf_refresh_time=4327 (Wed Sep 26 17:42:01 2018)\nconf_on_shared_storage=True\nmaintenance=False\nstate=EngineUp\nstopped=False\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "4488c592", "local_conf_timestamp": 4327, "host-ts": 4327}, "global_maintenance": false} root: INFO: * Engine has migrated. root: INFO: * Waiting For System Stability... cli: DEBUG: signal 15 was caught --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/010_local_maintenance_cli.py", line 125, in local_maintenance _wait_for_engine_migration(host, he_index, "bad", "Migration Destination") File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-4.2/ovirt-system-tests/he-node-ng-suite-4.2/test-scenarios/010_local_maintenance_cli.py", line 45, in _wait_for_engine_migration time.sleep(wait_value) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in exit_handler sys.exit(128 + signum) '143\n-------------------- >> begin captured logging << --------------------\nroot: INFO: * Waiting For System Stability...\nlago.ssh: DEBUG: start task:90555ac6-a749-4c6d-97d0-ca20f9ee7e56:Get ssh client for lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: end task:90555ac6-a749-4c6d-97d0-ca20f9ee7e56:Get ssh client for lago-he-node-ng-suite-4-2-host-1:\nlago.ssh: DEBUG: Running 4d4a6eae on lago-he-node-ng-suite-4-2-host-1: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 4d4a6eae on lago-he-node-ng-suite-4-2-host-1 returned with 0\nlago.ssh: DEBUG: Command 4d4a6eae on lago-he-node-ng-suite-4-2-host-1 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4241 (Wed Sep 26 17:40:36 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=4241 (Wed Sep 26 17:40:36 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "49ba6ea7", "local_conf_timestamp": 4241, "host-ts": 4241}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4247 (Wed Sep 26 17:40:41 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4247 (Wed Sep 26 17:40:41 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e8286b5a", "local_conf_timestamp": 4247, "host-ts": 4247}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:cdd8bc8a-3f38-4e62-9699-7ef8e4864f9a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:cdd8bc8a-3f38-4e62-9699-7ef8e4864f9a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 4e65c50e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --set-maintenance --mode=local\nlago.ssh: DEBUG: Command 4e65c50e on lago-he-node-ng-suite-4-2-host-0 returned with 0\nroot: INFO: * Waiting for engine to migrate...\nlago.ssh: DEBUG: start task:cdb61607-0d9d-4531-931e-e2a2c02f6b15:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:cdb61607-0d9d-4531-931e-e2a2c02f6b15:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 4fac57de on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 4fac57de on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 4fac57de on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4251 (Wed Sep 26 17:40:46 2018)\\nhost-id=1\\nscore=3400\\nvm_conf_refresh_time=4251 (Wed Sep 26 17:40:46 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "95dd2e98", "local_conf_timestamp": 4251, "host-ts": 4251}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4247 (Wed Sep 26 17:40:41 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4247 (Wed Sep 26 17:40:41 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e8286b5a", "local_conf_timestamp": 4247, "host-ts": 4247}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:1fc0139b-3d03-4e0a-8168-69c54559563d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:1fc0139b-3d03-4e0a-8168-69c54559563d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 56ec62dc on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 56ec62dc on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 56ec62dc on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4262 (Wed Sep 26 17:40:56 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4262 (Wed Sep 26 17:40:56 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "01cda987", "local_conf_timestamp": 4262, "host-ts": 4262}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4257 (Wed Sep 26 17:40:51 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4257 (Wed Sep 26 17:40:52 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ec6e945f", "local_conf_timestamp": 4257, "host-ts": 4257}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:12189e9a-68f8-42d0-ba7a-126282d28b98:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:12189e9a-68f8-42d0-ba7a-126282d28b98:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 5aec01a8 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 5aec01a8 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 5aec01a8 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4272 (Wed Sep 26 17:41:07 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4272 (Wed Sep 26 17:41:07 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "03cc6058", "local_conf_timestamp": 4272, "host-ts": 4272}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4267 (Wed Sep 26 17:41:02 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4267 (Wed Sep 26 17:41:02 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e0a59550", "local_conf_timestamp": 4267, "host-ts": 4267}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:6e63e48d-6a63-41da-92db-73b872e79e0a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:6e63e48d-6a63-41da-92db-73b872e79e0a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 5e4ddc0e on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 5e4ddc0e on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 5e4ddc0e on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4272 (Wed Sep 26 17:41:07 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4272 (Wed Sep 26 17:41:07 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "03cc6058", "local_conf_timestamp": 4272, "host-ts": 4272}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4267 (Wed Sep 26 17:41:02 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4267 (Wed Sep 26 17:41:02 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "vm not running on this host", "health": "bad", "vm": "down", "detail": "unknown"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "e0a59550", "local_conf_timestamp": 4267, "host-ts": 4267}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:b30d6158-ccd3-4752-8b2f-cad0c236e420:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:b30d6158-ccd3-4752-8b2f-cad0c236e420:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 6147daf4 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6147daf4 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 6147daf4 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4282 (Wed Sep 26 17:41:17 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4283 (Wed Sep 26 17:41:17 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "f97e01d5", "local_conf_timestamp": 4283, "host-ts": 4282}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4277 (Wed Sep 26 17:41:12 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4277 (Wed Sep 26 17:41:12 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "93de5fcd", "local_conf_timestamp": 4277, "host-ts": 4277}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:634c9638-320f-4848-ad7f-30ba5f612b08:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:634c9638-320f-4848-ad7f-30ba5f612b08:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 6443f238 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6443f238 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 6443f238 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4292 (Wed Sep 26 17:41:26 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4292 (Wed Sep 26 17:41:27 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "204a0f81", "local_conf_timestamp": 4292, "host-ts": 4292}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4287 (Wed Sep 26 17:41:21 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4287 (Wed Sep 26 17:41:21 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ac395afe", "local_conf_timestamp": 4287, "host-ts": 4287}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:e6c602be-6983-4556-98c4-4b57f63c7006:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:e6c602be-6983-4556-98c4-4b57f63c7006:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 674f8cc6 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 674f8cc6 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 674f8cc6 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4292 (Wed Sep 26 17:41:26 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4292 (Wed Sep 26 17:41:27 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "204a0f81", "local_conf_timestamp": 4292, "host-ts": 4292}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4287 (Wed Sep 26 17:41:21 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4287 (Wed Sep 26 17:41:21 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "ac395afe", "local_conf_timestamp": 4287, "host-ts": 4287}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:4beec84d-e882-43d6-9fab-667e4e81cbda:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:4beec84d-e882-43d6-9fab-667e4e81cbda:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 6a680c80 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6a680c80 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 6a680c80 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4302 (Wed Sep 26 17:41:37 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4302 (Wed Sep 26 17:41:37 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8a734436", "local_conf_timestamp": 4302, "host-ts": 4302}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4297 (Wed Sep 26 17:41:31 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4297 (Wed Sep 26 17:41:31 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a87fa5fb", "local_conf_timestamp": 4297, "host-ts": 4297}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:7cd1cc45-58d8-4c69-92e3-62a2d08a6904:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:7cd1cc45-58d8-4c69-92e3-62a2d08a6904:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 6d5c6b66 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 6d5c6b66 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 6d5c6b66 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4302 (Wed Sep 26 17:41:37 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4302 (Wed Sep 26 17:41:37 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8a734436", "local_conf_timestamp": 4302, "host-ts": 4302}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4297 (Wed Sep 26 17:41:31 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4297 (Wed Sep 26 17:41:31 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "a87fa5fb", "local_conf_timestamp": 4297, "host-ts": 4297}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:a81b0359-b525-41fa-9906-7f21f0f27dd6:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:a81b0359-b525-41fa-9906-7f21f0f27dd6:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 704b805a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 704b805a on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 704b805a on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4302 (Wed Sep 26 17:41:37 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4302 (Wed Sep 26 17:41:37 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "8a734436", "local_conf_timestamp": 4302, "host-ts": 4302}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4307 (Wed Sep 26 17:41:42 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4307 (Wed Sep 26 17:41:42 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4d44c828", "local_conf_timestamp": 4307, "host-ts": 4307}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:e51f9ed4-1717-44c9-b0ee-37ea5e05676a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:e51f9ed4-1717-44c9-b0ee-37ea5e05676a:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 7349afde on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 7349afde on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 7349afde on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4312 (Wed Sep 26 17:41:47 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4313 (Wed Sep 26 17:41:47 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "53474a62", "local_conf_timestamp": 4313, "host-ts": 4312}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4307 (Wed Sep 26 17:41:42 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4307 (Wed Sep 26 17:41:42 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4d44c828", "local_conf_timestamp": 4307, "host-ts": 4307}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:243d2486-a3ca-4ca5-8fff-878978118a3d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:243d2486-a3ca-4ca5-8fff-878978118a3d:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 76684004 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 76684004 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 76684004 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4322 (Wed Sep 26 17:41:56 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4322 (Wed Sep 26 17:41:57 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0d643ff3", "local_conf_timestamp": 4322, "host-ts": 4322}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4317 (Wed Sep 26 17:41:52 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4317 (Wed Sep 26 17:41:52 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4902372d", "local_conf_timestamp": 4317, "host-ts": 4317}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:c1b8be35-3faa-4959-8a52-56991f4fa241:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:c1b8be35-3faa-4959-8a52-56991f4fa241:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 7999ef0c on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 7999ef0c on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 7999ef0c on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4322 (Wed Sep 26 17:41:56 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4322 (Wed Sep 26 17:41:57 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineMigratingAway\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"health": "good", "vm": "up", "detail": "Migration Source"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "0d643ff3", "local_conf_timestamp": 4322, "host-ts": 4322}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4317 (Wed Sep 26 17:41:52 2018)\\nhost-id=2\\nscore=3000\\nvm_conf_refresh_time=4317 (Wed Sep 26 17:41:52 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"reason": "bad vm status", "health": "bad", "vm": "down", "detail": "Migration Destination"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "4902372d", "local_conf_timestamp": 4317, "host-ts": 4317}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:c6947cc4-e42c-4461-a2ca-e144eed75f88:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:c6947cc4-e42c-4461-a2ca-e144eed75f88:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 7c7e5744 on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 7c7e5744 on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 7c7e5744 on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4332 (Wed Sep 26 17:42:07 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4332 (Wed Sep 26 17:42:07 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "VM migrated away successfully", "health": "bad", "vm": "down", "detail": "Down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c23b8814", "local_conf_timestamp": 4332, "host-ts": 4332}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4327 (Wed Sep 26 17:42:01 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4327 (Wed Sep 26 17:42:01 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "4488c592", "local_conf_timestamp": 4327, "host-ts": 4327}, "global_maintenance": false}\n\nlago.ssh: DEBUG: start task:25677b7b-0a3f-4018-9a2d-399570c4f390:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: end task:25677b7b-0a3f-4018-9a2d-399570c4f390:Get ssh client for lago-he-node-ng-suite-4-2-host-0:\nlago.ssh: DEBUG: Running 7d97c89a on lago-he-node-ng-suite-4-2-host-0: hosted-engine --vm-status --json\nlago.ssh: DEBUG: Command 7d97c89a on lago-he-node-ng-suite-4-2-host-0 returned with 0\nlago.ssh: DEBUG: Command 7d97c89a on lago-he-node-ng-suite-4-2-host-0 output:\n {"1": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4332 (Wed Sep 26 17:42:07 2018)\\nhost-id=1\\nscore=3000\\nvm_conf_refresh_time=4332 (Wed Sep 26 17:42:07 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineDown\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-0", "host-id": 1, "engine-status": {"reason": "VM migrated away successfully", "health": "bad", "vm": "down", "detail": "Down"}, "score": 3000, "stopped": false, "maintenance": false, "crc32": "c23b8814", "local_conf_timestamp": 4332, "host-ts": 4332}, "2": {"conf_on_shared_storage": true, "live-data": true, "extra": "metadata_parse_version=1\\nmetadata_feature_version=1\\ntimestamp=4327 (Wed Sep 26 17:42:01 2018)\\nhost-id=2\\nscore=3400\\nvm_conf_refresh_time=4327 (Wed Sep 26 17:42:01 2018)\\nconf_on_shared_storage=True\\nmaintenance=False\\nstate=EngineUp\\nstopped=False\\n", "hostname": "lago-he-node-ng-suite-4-2-host-1", "host-id": 2, "engine-status": {"health": "good", "vm": "up", "detail": "Up"}, "score": 3400, "stopped": false, "maintenance": false, "crc32": "4488c592", "local_conf_timestamp": 4327, "host-ts": 4327}, "global_maintenance": false}\n\nroot: INFO: * Engine has migrated.\nroot: INFO: * Waiting For System Stability...\ncli: DEBUG: signal 15 was caught\n--------------------- >> end captured logging << ---------------------'

1 53

[JIRA] (OVIRT-2537) Gerrit 500 Internal server error
by danken (oVirt JIRA) 14 Oct '18

14 Oct '18

danken created OVIRT-2537: ----------------------------- Summary: Gerrit 500 Internal server error Key: OVIRT-2537 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2537 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: danken Assignee: infra Trying to view https://gerrit.ovirt.org/#/c/91400/ gerrit returns "Gerrit 500 Internal server error". This reminds me of a db curruption of many year ago. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-4.2 - Build # 561 - Failure!
by jenkins＠jenkins.phx.ovirt.org 14 Oct '18

14 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/561/ Build Number: 561 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #561 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: Failed to read response: [(<pycurl.Curl object at 0x7f7dc1d10050>, 7, 'TCP connection reset by peer')] -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7f7dc1cb2578> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37093, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 54, in wait response = self._connection.wait(self._context) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 496, in wait return self.__wait(context, failed_auth) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 510, in __wait raise Error("Failed to read response: {}".format(err_list)) Error: Failed to read response: [(<pycurl.Curl object at 0x7f7dc1d10050>, 7, 'TCP connection reset by peer')] --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 229, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 273, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 278, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37093, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 54, in wait response = self._connection.wait(self._context) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 496, in wait return self.__wait(context, failed_auth) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 510, in __wait raise Error("Failed to read response: {}".format(err_list)) 'Failed to read response: [(<pycurl.Curl object at 0x7f7dc1d10050>, 7, \'TCP connection reset by peer\')]\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7f7dc1cb2578>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4\n host_obj = host_service.get()\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37093, in get\n return self._internal_get(headers, query, wait)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get\n return future.wait() if wait else future\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 54, in wait\n response = self._connection.wait(self._context)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 496, in wait\n return self.__wait(context, failed_auth)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 510, in __wait\n raise Error("Failed to read response: {}".format(err_list))\nError: Failed to read response: [(<pycurl.Curl object at 0x7f7dc1d10050>, 7, \'TCP connection reset by peer\')]\n--------------------- >> end captured logging << ---------------------'

1 1

oVirt infra daily report - unstable production jobs - 612
by jenkins＠jenkins.phx.ovirt.org 14 Oct '18

14 Oct '18

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/612//artifact/exported-a… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-master - Build # 456 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/456/ Build Number: 456 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #456 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 012_local_maintenance_sdk.local_maintenance Error Message: 143 -------------------- >> begin captured logging << -------------------- root: INFO: * Waiting For System Stability... root: INFO: * Performing Deactivation... root: INFO: * Performing Activation... root: INFO: * Waiting For System Stability... cli: DEBUG: signal 15 was caught --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-master/ovirt-system-tests/he-node-ng-suite-master/test-scenarios/012_local_maintenance_sdk.py", line 79, in local_maintenance time.sleep(wait_value) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in exit_handler sys.exit(128 + signum) '143\n-------------------- >> begin captured logging << --------------------\nroot: INFO: * Waiting For System Stability...\nroot: INFO: * Performing Deactivation...\nroot: INFO: * Performing Activation...\nroot: INFO: * Waiting For System Stability...\ncli: DEBUG: signal 15 was caught\n--------------------- >> end captured logging << ---------------------'

1 8

[oVirt Jenkins] ovirt-system-tests_compat-4.2-suite-master - Build # 249 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.2-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.2-suite-master/249/ Build Number: 249 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #249 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 008_basic_ui_sanity.initialize_chrome_42 Error Message: Message: Error forwarding the new session cannot find : Capabilities {browserName: chrome, platform: LINUX, version: 64.0.3282.140} Stacktrace: at org.openqa.grid.web.servlet.handler.RequestHandler.process (RequestHandler.java:117) at org.openqa.grid.web.servlet.DriverServlet.process (DriverServlet.java:84) at org.openqa.grid.web.servlet.DriverServlet.doPost (DriverServlet.java:68) at javax.servlet.http.HttpServlet.service (HttpServlet.java:707) at javax.servlet.http.HttpServlet.service (HttpServlet.java:790) at org.seleniumhq.jetty9.servlet.ServletHolder.handle (ServletHolder.java:860) at org.seleniumhq.jetty9.servlet.ServletHandler.doHandle (ServletHandler.java:535) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188) at org.seleniumhq.jetty9.server.session.SessionHandler.doHandle (SessionHandler.java:1595) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188) at org.seleniumhq.jetty9.server.handler.ContextHandler.doHandle (ContextHandler.java:1253) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:168) at org.seleniumhq.jetty9.servlet.ServletHandler.doScope (ServletHandler.java:473) at org.seleniumhq.jetty9.server.session.SessionHandler.doScope (SessionHandler.java:1564) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:166) at org.seleniumhq.jetty9.server.handler.ContextHandler.doScope (ContextHandler.java:1155) at org.seleniumhq.jetty9.server.handler.ScopedHandler.handle (ScopedHandler.java:141) at org.seleniumhq.jetty9.server.handler.HandlerWrapper.handle (HandlerWrapper.java:132) at org.seleniumhq.jetty9.server.Server.handle (Server.java:530) at org.seleniumhq.jetty9.server.HttpChannel.handle (HttpChannel.java:347) at org.seleniumhq.jetty9.server.HttpConnection.onFillable (HttpConnection.java:256) at org.seleniumhq.jetty9.io.AbstractConnection$ReadCallback.succeeded (AbstractConnection.java:279) at org.seleniumhq.jetty9.io.FillInterest.fillable (FillInterest.java:102) at org.seleniumhq.jetty9.io.ChannelEndPoint$2.run (ChannelEndPoint.java:124) at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.doProduce (EatWhatYouKill.java:247) at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.produce (EatWhatYouKill.java:140) at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.run (EatWhatYouKill.java:131) at org.seleniumhq.jetty9.util.thread.ReservedThreadExecutor$ReservedThread.run (ReservedThreadExecutor.java:382) at org.seleniumhq.jetty9.util.thread.QueuedThreadPool.runJob (QueuedThreadPool.java:708) at org.seleniumhq.jetty9.util.thread.QueuedThreadPool$2.run (QueuedThreadPool.java:626) at java.lang.Thread.run (Thread.java:748) -------------------- >> begin captured stdout << --------------------- _init_browser, connecting to hub at http://172.18.0.2:4444/wd/hub Message: Error forwarding the new session cannot find : Capabilities {browserName: chrome, platform: LINUX, version: 64.0.3282.140} Stacktrace: at org.openqa.grid.web.servlet.handler.RequestHandler.process (RequestHandler.java:117) at org.openqa.grid.web.servlet.DriverServlet.process (DriverServlet.java:84) at org.openqa.grid.web.servlet.DriverServlet.doPost (DriverServlet.java:68) at javax.servlet.http.HttpServlet.service (HttpServlet.java:707) at javax.servlet.http.HttpServlet.service (HttpServlet.java:790) at org.seleniumhq.jetty9.servlet.ServletHolder.handle (ServletHolder.java:860) at org.seleniumhq.jetty9.servlet.ServletHandler.doHandle (ServletHandler.java:535) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188) at org.seleniumhq.jetty9.server.session.SessionHandler.doHandle (SessionHandler.java:1595) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188) at org.seleniumhq.jetty9.server.handler.ContextHandler.doHandle (ContextHandler.java:1253) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:168) at org.seleniumhq.jetty9.servlet.ServletHandler.doScope (ServletHandler.java:473) at org.seleniumhq.jetty9.server.session.SessionHandler.doScope (SessionHandler.java:1564) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:166) at org.seleniumhq.jetty9.server.handler.ContextHandler.doScope (ContextHandler.java:1155) at org.seleniumhq.jetty9.server.handler.ScopedHandler.handle (ScopedHandler.java:141) at org.seleniumhq.jetty9.server.handler.HandlerWrapper.handle (HandlerWrapper.java:132) at org.seleniumhq.jetty9.server.Server.handle (Server.java:530) at org.seleniumhq.jetty9.server.HttpChannel.handle (HttpChannel.java:347) at org.seleniumhq.jetty9.server.HttpConnection.onFillable (HttpConnection.java:256) at org.seleniumhq.jetty9.io.AbstractConnection$ReadCallback.succeeded (AbstractConnection.java:279) at org.seleniumhq.jetty9.io.FillInterest.fillable (FillInterest.java:102) at org.seleniumhq.jetty9.io.ChannelEndPoint$2.run (ChannelEndPoint.java:124) at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.doProduce (EatWhatYouKill.java:247) at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.produce (EatWhatYouKill.java:140) at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.run (EatWhatYouKill.java:131) at org.seleniumhq.jetty9.util.thread.ReservedThreadExecutor$ReservedThread.run (ReservedThreadExecutor.java:382) at org.seleniumhq.jetty9.util.thread.QueuedThreadPool.runJob (QueuedThreadPool.java:708) at org.seleniumhq.jetty9.util.thread.QueuedThreadPool$2.run (QueuedThreadPool.java:626) at java.lang.Thread.run (Thread.java:748) WebDriverException in _init_browser connecting to hub --------------------- >> end captured stdout << ---------------------- -------------------- >> begin captured logging << -------------------- selenium.webdriver.remote.remote_connection: DEBUG: POST http://172.18.0.2:4444/wd/hub/session {"capabilities": {"alwaysMatch": {"browserName": "chrome", "platformName": "linux", "browserVersion": "64.0.3282.140"}, "firstMatch": [{}]}, "desiredCapabilities": {"platform": "LINUX", "browserName": "chrome", "version": "64.0.3282.140"}} urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): 172.18.0.2:4444 urllib3.connectionpool: DEBUG: http://172.18.0.2:4444 "POST /wd/hub/session HTTP/1.1" 500 7792 selenium.webdriver.remote.remote_connection: DEBUG: Finished Request --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/home/jenkins/workspace/ovirt-system-tests_compat-4.2-suite-master/ovirt-system-tests/compat-4.2-suite-master/test-scenarios/008_basic_ui_sanity.py", line 213, in initialize_chrome _init_driver(_get_chrome_capabilities()) File "/home/jenkins/workspace/ovirt-system-tests_compat-4.2-suite-master/ovirt-system-tests/compat-4.2-suite-master/test-scenarios/008_basic_ui_sanity.py", line 239, in _init_driver raise e 'Message: Error forwarding the new session cannot find : Capabilities {browserName: chrome, platform: LINUX, version: 64.0.3282.140}\nStacktrace:\n at org.openqa.grid.web.servlet.handler.RequestHandler.process (RequestHandler.java:117)\n at org.openqa.grid.web.servlet.DriverServlet.process (DriverServlet.java:84)\n at org.openqa.grid.web.servlet.DriverServlet.doPost (DriverServlet.java:68)\n at javax.servlet.http.HttpServlet.service (HttpServlet.java:707)\n at javax.servlet.http.HttpServlet.service (HttpServlet.java:790)\n at org.seleniumhq.jetty9.servlet.ServletHolder.handle (ServletHolder.java:860)\n at org.seleniumhq.jetty9.servlet.ServletHandler.doHandle (ServletHandler.java:535)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)\n at org.seleniumhq.jetty9.server.session.SessionHandler.doHandle (SessionHandler.java:1595)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)\n at org.seleniumhq.jetty9.server.handler.ContextHandler.doHandle (ContextHandler.java:1253)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:168)\n at org.seleniumhq.jetty9.servlet.ServletHandler.doScope (ServletHandler.java:473)\n at org.seleniumhq.jetty9.server.session.SessionHandler.doScope (SessionHandler.java:1564)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:166)\n at org.seleniumhq.jetty9.server.handler.ContextHandler.doScope (ContextHandler.java:1155)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.handle (ScopedHandler.java:141)\n at org.seleniumhq.jetty9.server.handler.HandlerWrapper.handle (HandlerWrapper.java:132)\n at org.seleniumhq.jetty9.server.Server.handle (Server.java:530)\n at org.seleniumhq.jetty9.server.HttpChannel.handle (HttpChannel.java:347)\n at org.seleniumhq.jetty9.server.HttpConnection.onFillable (HttpConnection.java:256)\n at org.seleniumhq.jetty9.io.AbstractConnection$ReadCallback.succeeded (AbstractConnection.java:279)\n at org.seleniumhq.jetty9.io.FillInterest.fillable (FillInterest.java:102)\n at org.seleniumhq.jetty9.io.ChannelEndPoint$2.run (ChannelEndPoint.java:124)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.doProduce (EatWhatYouKill.java:247)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.produce (EatWhatYouKill.java:140)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.run (EatWhatYouKill.java:131)\n at org.seleniumhq.jetty9.util.thread.ReservedThreadExecutor$ReservedThread.run (ReservedThreadExecutor.java:382)\n at org.seleniumhq.jetty9.util.thread.QueuedThreadPool.runJob (QueuedThreadPool.java:708)\n at org.seleniumhq.jetty9.util.thread.QueuedThreadPool$2.run (QueuedThreadPool.java:626)\n at java.lang.Thread.run (Thread.java:748)\n-------------------- >> begin captured stdout << ---------------------\n_init_browser, connecting to hub at http://172.18.0.2:4444/wd/hub\nMessage: Error forwarding the new session cannot find : Capabilities {browserName: chrome, platform: LINUX, version: 64.0.3282.140}\nStacktrace:\n at org.openqa.grid.web.servlet.handler.RequestHandler.process (RequestHandler.java:117)\n at org.openqa.grid.web.servlet.DriverServlet.process (DriverServlet.java:84)\n at org.openqa.grid.web.servlet.DriverServlet.doPost (DriverServlet.java:68)\n at javax.servlet.http.HttpServlet.service (HttpServlet.java:707)\n at javax.servlet.http.HttpServlet.service (HttpServlet.java:790)\n at org.seleniumhq.jetty9.servlet.ServletHolder.handle (ServletHolder.java:860)\n at org.seleniumhq.jetty9.servlet.ServletHandler.doHandle (ServletHandler.java:535)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)\n at org.seleniumhq.jetty9.server.session.SessionHandler.doHandle (SessionHandler.java:1595)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)\n at org.seleniumhq.jetty9.server.handler.ContextHandler.doHandle (ContextHandler.java:1253)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:168)\n at org.seleniumhq.jetty9.servlet.ServletHandler.doScope (ServletHandler.java:473)\n at org.seleniumhq.jetty9.server.session.SessionHandler.doScope (SessionHandler.java:1564)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:166)\n at org.seleniumhq.jetty9.server.handler.ContextHandler.doScope (ContextHandler.java:1155)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.handle (ScopedHandler.java:141)\n at org.seleniumhq.jetty9.server.handler.HandlerWrapper.handle (HandlerWrapper.java:132)\n at org.seleniumhq.jetty9.server.Server.handle (Server.java:530)\n at org.seleniumhq.jetty9.server.HttpChannel.handle (HttpChannel.java:347)\n at org.seleniumhq.jetty9.server.HttpConnection.onFillable (HttpConnection.java:256)\n at org.seleniumhq.jetty9.io.AbstractConnection$ReadCallback.succeeded (AbstractConnection.java:279)\n at org.seleniumhq.jetty9.io.FillInterest.fillable (FillInterest.java:102)\n at org.seleniumhq.jetty9.io.ChannelEndPoint$2.run (ChannelEndPoint.java:124)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.doProduce (EatWhatYouKill.java:247)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.produce (EatWhatYouKill.java:140)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.run (EatWhatYouKill.java:131)\n at org.seleniumhq.jetty9.util.thread.ReservedThreadExecutor$ReservedThread.run (ReservedThreadExecutor.java:382)\n at org.seleniumhq.jetty9.util.thread.QueuedThreadPool.runJob (QueuedThreadPool.java:708)\n at org.seleniumhq.jetty9.util.thread.QueuedThreadPool$2.run (QueuedThreadPool.java:626)\n at java.lang.Thread.run (Thread.java:748)\nWebDriverException in _init_browser connecting to hub\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\nselenium.webdriver.remote.remote_connection: DEBUG: POST http://172.18.0.2:4444/wd/hub/session {"capabilities": {"alwaysMatch": {"browserName": "chrome", "platformName": "linux", "browserVersion": "64.0.3282.140"}, "firstMatch": [{}]}, "desiredCapabilities": {"platform": "LINUX", "browserName": "chrome", "version": "64.0.3282.140"}}\nurllib3.connectionpool: DEBUG: Starting new HTTP connection (1): 172.18.0.2:4444\nurllib3.connectionpool: DEBUG: http://172.18.0.2:4444 "POST /wd/hub/session HTTP/1.1" 500 7792\nselenium.webdriver.remote.remote_connection: DEBUG: Finished Request\n--------------------- >> end captured logging << ---------------------'

1 1

[oVirt Jenkins] ovirt-system-tests_network-suite-master - Build # 662 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_network-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_network-suite-master/662/ Build Number: 662 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #662 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 19 tests failed. FAILED: network-suite-master.tests.test_ipv6_support.test_run_vm_over_ipv6_nfs_storage_domain Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_mac_pools.test_set_mac_pool_duplicate_macs_from_true_to_false_while_dup_exists Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_mac_pools.test_assign_vnic_with_full_mac_pool_capacity_fails Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_mac_pools.test_undo_preview_snapshot_when_mac_used_reassigns_a_new_mac Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_mac_pools.test_mac_pools_in_different_clusters_dont_overlap Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_mac_pools.test_restore_snapshot_with_an_used_mac_implicitly_assigns_new_mac Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_mac_pools.test_move_stateless_vm_mac_to_new_vm_fails Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_mac_pools.test_move_mac_to_new_vm Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_qos_configuration.test_setup_net_with_qos Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_required_network.test_required_network_host_non_operational Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_unrestricted_display_network_name.test_run_vm_with_unrestricted_display_network_name Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_vm_operations.test_live_vm_migration_using_dedicated_network Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_vm_operations.test_hot_linking_vnic Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.ovn-provider.test_ovn_provider.test_ovn_provider_create_scenario Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.ovn-provider.test_ovn_provider.test_validate_ovn_provider_connectivity Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.ovn-provider.test_ovn_provider.test_update_network_mtu Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.ovn-provider.test_ovn_provider.test_ovn_provider_cleanup_scenario Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.ovn-provider.test_ovn_provider_integration_with_ovirt.test_connect_vm_to_external_network Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.ovs.test_ovn_physnet.test_connect_vm_to_external_physnet Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout

1 1

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 780 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/780/ Build Number: 780 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #780 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: The response content type 'text/html; charset=iso-8859-1' isn't the expected XML -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7fa6aad1a230> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 253, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 38104, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 208, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 130, in _check_fault body = self._internal_read_body(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 316, in _internal_read_body self._connection.check_xml_content_type(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 850, in check_xml_content_type response.headers File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 890, in _check_content_type raise Error(msg) Error: The response content type 'text/html; charset=iso-8859-1' isn't the expected XML --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 228, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 275, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 278, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 253, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 38104, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 208, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 130, in _check_fault body = self._internal_read_body(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 316, in _internal_read_body self._connection.check_xml_content_type(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 850, in check_xml_content_type response.headers File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 890, in _check_content_type raise Error(msg) 'The response content type \'text/html; charset=iso-8859-1\' isn\'t the expected XML\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7fa6aad1a230>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 253, in _host_is_up_4\n host_obj = host_service.get()\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 38104, in get\n return self._internal_get(headers, query, wait)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get\n return future.wait() if wait else future\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait\n return self._code(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 208, in callback\n self._check_fault(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 130, in _check_fault\n body = self._internal_read_body(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 316, in _internal_read_body\n self._connection.check_xml_content_type(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 850, in check_xml_content_type\n response.headers\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 890, in _check_content_type\n raise Error(msg)\nError: The response content type \'text/html; charset=iso-8859-1\' isn\'t the expected XML\n--------------------- >> end captured logging << ---------------------'

1 1

Build failed in Jenkins: system-sync_mirrors-centos-updates-el7-x86_64 #2034
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 92c04a259244f3206b0c9a92617876fb2e23ec3d (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 92c04a259244f3206b0c9a92617876fb2e23ec3d Commit message: "standard-pipelines: add kubevirt/common-templates" > git rev-list --no-walk 92c04a259244f3206b0c9a92617876fb2e23ec3d # timeout=10 [system-sync_mirrors-centos-updates-el7-x86_64] $ /bin/bash -xe /tmp/jenkins1085267235485600225.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-updates-el7 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/epel-el6 error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/epel-el6' Build step 'Execute shell' marked build as failure

1 1

[JIRA] (OVIRT-2536) Setup root cause analysis in Nagious so it dosn't flood mail in alers in network issues
by Barak Korren (oVirt JIRA) 13 Oct '18

13 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2536?page=com.atlassian.jira.… ] Barak Korren reassigned OVIRT-2536: ----------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > Setup root cause analysis in Nagious so it dosn't flood mail in alers in network issues > --------------------------------------------------------------------------------------- > > Key: OVIRT-2536 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2536 > Project: oVirt - virtualization made easy > Issue Type: New Feature > Components: monitoring > Reporter: Barak Korren > Assignee: Evgheni Dereveanchin > -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2536) Setup root cause analysis in Nagious so it dosn't flood mail in alers in network issues
by Barak Korren (oVirt JIRA) 13 Oct '18

13 Oct '18

Barak Korren created OVIRT-2536: ----------------------------------- Summary: Setup root cause analysis in Nagious so it dosn't flood mail in alers in network issues Key: OVIRT-2536 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2536 Project: oVirt - virtualization made easy Issue Type: New Feature Components: monitoring Reporter: Barak Korren Assignee: infra -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-4.2 - Build # 558 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/558/ Build Number: 558 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #558 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: 143 -------------------- >> begin captured logging << -------------------- cli: DEBUG: signal 15 was caught --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 229, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 273, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 278, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37093, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 54, in wait response = self._connection.wait(self._context) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 496, in wait return self.__wait(context, failed_auth) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 532, in __wait self._multi.select(1.0) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in exit_handler sys.exit(128 + signum) '143\n-------------------- >> begin captured logging << --------------------\ncli: DEBUG: signal 15 was caught\n--------------------- >> end captured logging << ---------------------'

1 1

oVirt infra daily report - unstable production jobs - 611
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/611//artifact/exported-a… Cheers, Jenkins

1 0

[JENKINS] Failed to setup proejct kubevirt_kubevirt_standard-check-pr
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

Failed to run project_setup.sh for: #2208 kubevirt [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on ovirt-srv06.infra-phx.ovirt.org-container-7.

1 0

[oVirt CI] standard-enqueue - Build #16949 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 12 Oct '18

12 Oct '18

Build: http://jenkins.ovirt.org/job/standard-enqueue/16949/ Build Name: #16949 Build Description: Gerrit: 94274 - ovirt-engine (master) Build Status: FAILURE Gerrit change: https://gerrit.ovirt.org/94274 - title: webadmin: VM popup tabs validation is not overridden - project: ovirt-engine - branch: master - author: Andrej Krejcir <akrejcir(a)redhat.com>

1 0

[CQ]: 94701, 18 (ovirt-iso-uploader) failed "ovirt-master" system tests
by oVirt Jenkins 12 Oct '18

12 Oct '18

Change 94701,18 (ovirt-iso-uploader) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/94701/18 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10585/

2 1

[JENKINS] Failed to setup proejct kubevirt_kubevirt_standard-check-pr
by jenkins＠jenkins.phx.ovirt.org 12 Oct '18

12 Oct '18

Failed to run project_setup.sh for: #2204 kubevirt [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on ovirt-srv05.phx.ovirt.org-container-4.

1 0

[oVirt Jenkins] ovirt-node-ng-image_master_build-artifacts-fc28-x86_64 - Build # 80 - Failure!
by jenkins＠jenkins.phx.ovirt.org 12 Oct '18

12 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-node-ng-image_master_build-artifacts-fc2… Build: http://jenkins.ovirt.org/job/ovirt-node-ng-image_master_build-artifacts-fc2… Build Number: 80 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #80 [edwardh(a)redhat.com] Add Bell Levin to the jenkins whitelist [Yuval Turgeman] stdci: move build-artifacts to a v1 job [Daniel Belenky] standard-pipelines: add kubevirt/common-templates ----------------- Failed Tests: ----------------- No tests ran.

1 2

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-4.2 - Build # 555 - Failure!
by jenkins＠jenkins.phx.ovirt.org 12 Oct '18

12 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/555/ Build Number: 555 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #555 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: 143 -------------------- >> begin captured logging << -------------------- cli: DEBUG: signal 15 was caught --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 229, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 273, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 278, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37093, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 54, in wait response = self._connection.wait(self._context) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 496, in wait return self.__wait(context, failed_auth) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 532, in __wait self._multi.select(1.0) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in exit_handler sys.exit(128 + signum) '143\n-------------------- >> begin captured logging << --------------------\ncli: DEBUG: signal 15 was caught\n--------------------- >> end captured logging << ---------------------'

1 2

[JIRA] (OVIRT-2535) merge gerrit accounts for mperina
by Evgheni Dereveanchin (oVirt JIRA) 12 Oct '18

12 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2535?page=com.atlassian.jira.… ] Evgheni Dereveanchin reassigned OVIRT-2535: ------------------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > merge gerrit accounts for mperina > --------------------------------- > > Key: OVIRT-2535 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2535 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Evgheni Dereveanchin > Assignee: Evgheni Dereveanchin > > Martin has two accounts, opening ticket to merge them -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2535) merge gerrit accounts for mperina
by Evgheni Dereveanchin (oVirt JIRA) 12 Oct '18

12 Oct '18

Evgheni Dereveanchin created OVIRT-2535: ------------------------------------------- Summary: merge gerrit accounts for mperina Key: OVIRT-2535 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2535 Project: oVirt - virtualization made easy Issue Type: Task Reporter: Evgheni Dereveanchin Assignee: infra Martin has two accounts, opening ticket to merge them -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[oVirt Jenkins] ovirt-node-ng_4.2_build-artifacts-el7-x86_64 - Build # 226 - Failure!
by jenkins＠jenkins.phx.ovirt.org 12 Oct '18

12 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-node-ng_4.2_build-artifacts-el7-x86_64/ Build: http://jenkins.ovirt.org/job/ovirt-node-ng_4.2_build-artifacts-el7-x86_64/2… Build Number: 226 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #226 [edwardh(a)redhat.com] Add Bell Levin to the jenkins whitelist [Ryan Barry] kickstart: let VDSM reconfigure itself ----------------- Failed Tests: ----------------- No tests ran.

1 1

[CQ]: 94591,7 (vdsm) failed "ovirt-master" system tests
by oVirt Jenkins 12 Oct '18

12 Oct '18

Change 94591,7 (vdsm) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/94591/7 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10575/

1 0

[oVirt Jenkins] ovirt-system-tests_he-basic-ansible-suite-master - Build # 711 - Failure!
by jenkins＠jenkins.phx.ovirt.org 12 Oct '18

12 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-mast… Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-mast… Build Number: 711 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #711 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- No tests ran.

1 1

oVirt infra daily report - unstable production jobs - 610
by jenkins＠jenkins.phx.ovirt.org 12 Oct '18

12 Oct '18

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/610//artifact/exported-a… Cheers, Jenkins

1 0

Build failed in Jenkins: system-sync_mirrors-epel-el6-x86_64 #1945
by jenkins＠jenkins.phx.ovirt.org 11 Oct '18

11 Oct '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/1945/displ…> ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-epel-el6-x86_64/ws/> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 92c04a259244f3206b0c9a92617876fb2e23ec3d (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 92c04a259244f3206b0c9a92617876fb2e23ec3d Commit message: "standard-pipelines: add kubevirt/common-templates" > git rev-list --no-walk 92c04a259244f3206b0c9a92617876fb2e23ec3d # timeout=10 [system-sync_mirrors-epel-el6-x86_64] $ /bin/bash -xe /tmp/jenkins7786540970485227006.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror epel-el6 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 209, in main my.doSackSetup(arches) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 741, in doSackSetup return self._getSacks(archlist=archlist, thisrepo=thisrepo) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 778, in _getSacks self.repos.populateSack(which=repos) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 386, in populateSack sack.populate(repo, mdtype, callback, cacheonly) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 256, in populate ret = misc.repo_gen_decompress(xml, gen, cached=repo.cache) File "/usr/lib/python2.7/site-packages/yum/misc.py", line 1165, in repo_gen_decompress return decompress(filename, dest=dest, check_timestamps=True) File "/usr/lib/python2.7/site-packages/yum/misc.py", line 1150, in decompress _decompress_chunked(filename, out, ztype) File "/usr/lib/python2.7/site-packages/yum/misc.py", line 791, in _decompress_chunked raise Errors.MiscError, msg yum.Errors.MiscError: Error reading from file /home/jenkins/mirrors_cache/epel-el6/eca9094970e672ab4a0ec4d1bc9f76fe245da9549807d711fec1001426d643a9-primary.xml.gz: Not a gzipped file Build step 'Execute shell' marked build as failure

1 1

[JIRA] (OVIRT-2534) imgbased master is failing on build-artifacts of fc28 due to missing deps
by Yuval Turgeman (oVirt JIRA) 11 Oct '18

11 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2534?page=com.atlassian.jira.… ] Yuval Turgeman reassigned OVIRT-2534: ------------------------------------- Assignee: Yuval Turgeman (was: infra) > imgbased master is failing on build-artifacts of fc28 due to missing deps > ------------------------------------------------------------------------- > > Key: OVIRT-2534 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2534 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: Yuval Turgeman > Labels: ost_build-arifacts, ost_failures > > https://pastebin.com/DrKqnrJx > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10567/ > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10564/ > changes: > https://gerrit.ovirt.org/#/c/94844/2 > https://gerrit.ovirt.org/#/c/94500/3 > https://jenkins.ovirt.org/job/imgbased_standard-on-merge/96/consoleFull -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2534) imgbased master is failing on build-artifacts of fc28 due to missing deps
by Yuval Turgeman (oVirt JIRA) 11 Oct '18

11 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2534?page=com.atlassian.jira.… ] Yuval Turgeman commented on OVIRT-2534: --------------------------------------- and here also https://gerrit.ovirt.org/#/c/94875/ :) > imgbased master is failing on build-artifacts of fc28 due to missing deps > ------------------------------------------------------------------------- > > Key: OVIRT-2534 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2534 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_build-arifacts, ost_failures > > https://pastebin.com/DrKqnrJx > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10567/ > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10564/ > changes: > https://gerrit.ovirt.org/#/c/94844/2 > https://gerrit.ovirt.org/#/c/94500/3 > https://jenkins.ovirt.org/job/imgbased_standard-on-merge/96/consoleFull -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[oVirt CI] standard-enqueue - Build #16926 - FAILURE!
by jenkins＠jenkins.phx.ovirt.org 11 Oct '18

11 Oct '18

Build: http://jenkins.ovirt.org/job/standard-enqueue/16926/ Build Name: #16926 Build Description: Gerrit: 94830 - ovirt-vmconsole (4.1, 4.2, master) Build Status: FAILURE Gerrit change: https://gerrit.ovirt.org/94830 - title: host: proxy: tests: utils: extract common code - project: ovirt-vmconsole - branch: master - author: Francesco Romani <fromani(a)redhat.com>

1 1

oVirt infra weekly meeting notes 10.10.2018
by Evgheni Dereveanchin 11 Oct '18

11 Oct '18

Hi everyone, Please find this week's infra updates below: PHX - Jenkins updated OVIRT-2491 <https://ovirt-jira.atlassian.net/browse/OVIRT-2491> - Resources updated, balloon device disabled OVIRT-2523 <https://ovirt-jira.atlassian.net/browse/OVIRT-2523> - All prod hypervisors updated to 4.2.6 and latest BIOS OVIRT-2281 <https://ovirt-jira.atlassian.net/browse/OVIRT-2281> - Backup.phx was running out of space - deleted old backups - Gerrit to be migrated to EL7 OVIRT-2472 <https://ovirt-jira.atlassian.net/browse/OVIRT-2472> - Mirrorchecker config updated OVIRT-2528 <https://ovirt-jira.atlassian.net/browse/OVIRT-2528> - Mirrors.phx moved to storage01 to spread the load - Fcraw removed from mirrors.phx OVIRT-2488 <https://ovirt-jira.atlassian.net/browse/OVIRT-2488> Other topics: - Discussion about splitting up workloads on resources OVIRT-2344 <https://ovirt-jira.atlassian.net/browse/OVIRT-2344> - Gmail corrupts links in mail archive rendering - PR with fix pending Action items: - Add RAM monitoring to resources - Ansiblize gerrit base OS -- Regards, Evgheni Dereveanchin

1 0

[JENKINS] Failed to setup proejct kubevirt_kubevirt_standard-check-pr
by jenkins＠jenkins.phx.ovirt.org 11 Oct '18

11 Oct '18

Failed to run project_setup.sh for: #2184 kubevirt [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on ovirt-srv05.phx.ovirt.org-container-6.

1 0

[JIRA] (OVIRT-2534) imgbased master is failing on build-artifacts of fc28 due to missing deps
by Yuval Turgeman (oVirt JIRA) 11 Oct '18

11 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2534?page=com.atlassian.jira.… ] Yuval Turgeman commented on OVIRT-2534: --------------------------------------- I posted a patch that should solve this - https://gerrit.ovirt.org/#/c/94860/ > imgbased master is failing on build-artifacts of fc28 due to missing deps > ------------------------------------------------------------------------- > > Key: OVIRT-2534 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2534 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_build-arifacts, ost_failures > > https://pastebin.com/DrKqnrJx > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10567/ > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10564/ > changes: > https://gerrit.ovirt.org/#/c/94844/2 > https://gerrit.ovirt.org/#/c/94500/3 > https://jenkins.ovirt.org/job/imgbased_standard-on-merge/96/consoleFull -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2281) Upgrade PHX ovirt-engine to 4.2.6
by Evgheni Dereveanchin (oVirt JIRA) 11 Oct '18

11 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2281?page=com.atlassian.jira.… ] Evgheni Dereveanchin reassigned OVIRT-2281: ------------------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > Upgrade PHX ovirt-engine to 4.2.6 > --------------------------------- > > Key: OVIRT-2281 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2281 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Evgheni Dereveanchin > Assignee: Evgheni Dereveanchin > > oVirt 4.2.4 is out, the PHX engine and hosts need to be upgraded -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2281) Upgrade PHX ovirt-engine to 4.2.6
by Evgheni Dereveanchin (oVirt JIRA) 11 Oct '18

11 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2281?page=com.atlassian.jira.… ] Evgheni Dereveanchin updated OVIRT-2281: ---------------------------------------- Summary: Upgrade PHX ovirt-engine to 4.2.6 (was: Upgrade PHX ovirt-engine to 4.2.4) > Upgrade PHX ovirt-engine to 4.2.6 > --------------------------------- > > Key: OVIRT-2281 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2281 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Evgheni Dereveanchin > Assignee: infra > > oVirt 4.2.4 is out, the PHX engine and hosts need to be upgraded -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2534) imgbased master is failing on build-artifacts of fc28 due to missing deps
by Dafna Ron (oVirt JIRA) 11 Oct '18

11 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2534?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2534: ---------------------------------- [~sbonazzo(a)redhat.com] [~yturgema(a)redhat.com] can you please have a look? > imgbased master is failing on build-artifacts of fc28 due to missing deps > ------------------------------------------------------------------------- > > Key: OVIRT-2534 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2534 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_build-arifacts, ost_failures > > https://pastebin.com/DrKqnrJx > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10567/ > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10564/ > changes: > https://gerrit.ovirt.org/#/c/94844/2 > https://gerrit.ovirt.org/#/c/94500/3 > https://jenkins.ovirt.org/job/imgbased_standard-on-merge/96/consoleFull -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2534) imgbased master is failing on build-artifacts of fc28 due to missing deps
by Dafna Ron (oVirt JIRA) 11 Oct '18

11 Oct '18

Dafna Ron created OVIRT-2534: -------------------------------- Summary: imgbased master is failing on build-artifacts of fc28 due to missing deps Key: OVIRT-2534 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2534 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Dafna Ron Assignee: infra https://pastebin.com/DrKqnrJx http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10567/ http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10564/ changes: https://gerrit.ovirt.org/#/c/94844/2 https://gerrit.ovirt.org/#/c/94500/3 https://jenkins.ovirt.org/job/imgbased_standard-on-merge/96/consoleFull -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[CQ]: 94500, 3 (imgbased) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 11 Oct '18

11 Oct '18

A system test invoked by the "ovirt-master" change queue including change 94500,3 (imgbased) failed. However, this change seems not to be the root cause for this failure. Change 94844,2 (imgbased) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 94844,2 (imgbased) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/94500/3 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/94844/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10567/

1 0

[CQ]: 94844,2 (imgbased) failed "ovirt-master" system tests
by oVirt Jenkins 11 Oct '18

11 Oct '18

Change 94844,2 (imgbased) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/94844/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10564/

1 0

[JENKINS] Failed to setup proejct kubevirt_kubevirt_standard-check-pr
by jenkins＠jenkins.phx.ovirt.org 11 Oct '18

11 Oct '18

Failed to run project_setup.sh for: #2182 kubevirt [check-patch]. It probably means that docker_cleanup.py failed. This step doesn't fail the job, but we do collect data about such failures to find the root cause. Infra owner, ensure that we're not running out of disk space on ovirt-srv05.phx.ovirt.org-container-6.

1 0

[oVirt Jenkins] ovirt-node-ng_ovirt-4.2-pre_build-artifacts-el7-x86_64 - Build # 525 - Failure!
by jenkins＠jenkins.phx.ovirt.org 11 Oct '18

11 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-node-ng_ovirt-4.2-pre_build-artifacts-el… Build: http://jenkins.ovirt.org/job/ovirt-node-ng_ovirt-4.2-pre_build-artifacts-el… Build Number: 525 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #525 [edwardh(a)redhat.com] Add Bell Levin to the jenkins whitelist [Daniel Belenky] standard-pipelines: add kubevirt/common-templates [Ryan Barry] kickstart: let VDSM reconfigure itself ----------------- Failed Tests: ----------------- No tests ran.

1 1

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-4.2 - Build # 553 - Failure!
by jenkins＠jenkins.phx.ovirt.org 11 Oct '18

11 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/553/ Build Number: 553 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #553 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: The response content type 'text/html; charset=iso-8859-1' isn't the expected XML -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7f0395cd6578> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37093, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 208, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 130, in _check_fault body = self._internal_read_body(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 316, in _internal_read_body self._connection.check_xml_content_type(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 849, in check_xml_content_type response.headers File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 889, in _check_content_type raise Error(msg) Error: The response content type 'text/html; charset=iso-8859-1' isn't the expected XML --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 229, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 273, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 278, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37093, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 208, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 130, in _check_fault body = self._internal_read_body(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 316, in _internal_read_body self._connection.check_xml_content_type(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 849, in check_xml_content_type response.headers File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 889, in _check_content_type raise Error(msg) 'The response content type \'text/html; charset=iso-8859-1\' isn\'t the expected XML\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7f0395cd6578>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4\n host_obj = host_service.get()\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37093, in get\n return self._internal_get(headers, query, wait)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get\n return future.wait() if wait else future\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait\n return self._code(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 208, in callback\n self._check_fault(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 130, in _check_fault\n body = self._internal_read_body(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 316, in _internal_read_body\n self._connection.check_xml_content_type(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 849, in check_xml_content_type\n response.headers\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 889, in _check_content_type\n raise Error(msg)\nError: The response content type \'text/html; charset=iso-8859-1\' isn\'t the expected XML\n--------------------- >> end captured logging << ---------------------'

1 1

[JIRA] (OVIRT-2520) ovirt-engine-wildfly and ovirt-engine-wildfly-overlay failing on master because of dependency on each other
by Dafna Ron (oVirt JIRA) 11 Oct '18

11 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2520?page=com.atlassian.jira.… ] Dafna Ron updated OVIRT-2520: ----------------------------- Resolution: Done Status: Done (was: To Do) > ovirt-engine-wildfly and ovirt-engine-wildfly-overlay failing on master because of dependency on each other > ------------------------------------------------------------------------------------------------------------ > > Key: OVIRT-2520 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2520 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_failures, ost_packages > > we have two patches: > https://gerrit.ovirt.org/#/c/94538/2 > https://gerrit.ovirt.org/#/c/94539/2 > They fail on deps on each other. > I will re-add both to try and run them on the same time. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2520) ovirt-engine-wildfly and ovirt-engine-wildfly-overlay failing on master because of dependency on each other
by Dafna Ron (oVirt JIRA) 11 Oct '18

11 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2520?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2520: ---------------------------------- great :) closing this issue > ovirt-engine-wildfly and ovirt-engine-wildfly-overlay failing on master because of dependency on each other > ------------------------------------------------------------------------------------------------------------ > > Key: OVIRT-2520 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2520 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_failures, ost_packages > > we have two patches: > https://gerrit.ovirt.org/#/c/94538/2 > https://gerrit.ovirt.org/#/c/94539/2 > They fail on deps on each other. > I will re-add both to try and run them on the same time. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[CQ]: 94844,2 (imgbased) failed "ovirt-master" system tests
by oVirt Jenkins 11 Oct '18

11 Oct '18

Change 94844,2 (imgbased) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/94844/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10557/

2 1

[CQ]: 94500, 3 (imgbased) failed "ovirt-master" system tests, but isn't the failure root cause
by oVirt Jenkins 11 Oct '18

11 Oct '18

A system test invoked by the "ovirt-master" change queue including change 94500,3 (imgbased) failed. However, this change seems not to be the root cause for this failure. Change 94844,2 (imgbased) that this change depends on or is based on, was detected as the cause of the testing failures. This change had been removed from the testing queue. Artifacts built from this change will not be released until either change 94844,2 (imgbased) is fixed and this change is updated to refer to or rebased on the fixed version, or this change is modified to no longer depend on it. For further details about the change see: https://gerrit.ovirt.org/#/c/94500/3 For further details about the change that seems to be the root cause behind the testing failures see: https://gerrit.ovirt.org/#/c/94844/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10560/

1 0

[JIRA] (OVIRT-2520) ovirt-engine-wildfly and ovirt-engine-wildfly-overlay failing on master because of dependency on each other
by Martin Perina (oVirt JIRA) 11 Oct '18

11 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2520?page=com.atlassian.jira.… ] Martin Perina commented on OVIRT-2520: -------------------------------------- Yes, those are correct. I've also merged both projects into ovirt-engine-wildfly in gerrit and performed other changes on engine side, so upgrades to upcoming releases should not require any manual actions in change queue > ovirt-engine-wildfly and ovirt-engine-wildfly-overlay failing on master because of dependency on each other > ------------------------------------------------------------------------------------------------------------ > > Key: OVIRT-2520 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2520 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_failures, ost_packages > > we have two patches: > https://gerrit.ovirt.org/#/c/94538/2 > https://gerrit.ovirt.org/#/c/94539/2 > They fail on deps on each other. > I will re-add both to try and run them on the same time. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0