October 2018 - Infra - oVirt List Archives

oVirt infra daily report - unstable production jobs - 612
by jenkins＠jenkins.phx.ovirt.org 14 Oct '18

14 Oct '18

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/612//artifact/exported-a… Cheers, Jenkins

1 0

[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-master - Build # 456 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/456/ Build Number: 456 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #456 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 012_local_maintenance_sdk.local_maintenance Error Message: 143 -------------------- >> begin captured logging << -------------------- root: INFO: * Waiting For System Stability... root: INFO: * Performing Deactivation... root: INFO: * Performing Activation... root: INFO: * Waiting For System Stability... cli: DEBUG: signal 15 was caught --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-master/ovirt-system-tests/he-node-ng-suite-master/test-scenarios/012_local_maintenance_sdk.py", line 79, in local_maintenance time.sleep(wait_value) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in exit_handler sys.exit(128 + signum) '143\n-------------------- >> begin captured logging << --------------------\nroot: INFO: * Waiting For System Stability...\nroot: INFO: * Performing Deactivation...\nroot: INFO: * Performing Activation...\nroot: INFO: * Waiting For System Stability...\ncli: DEBUG: signal 15 was caught\n--------------------- >> end captured logging << ---------------------'

1 8

[oVirt Jenkins] ovirt-system-tests_compat-4.2-suite-master - Build # 249 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.2-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_compat-4.2-suite-master/249/ Build Number: 249 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #249 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 008_basic_ui_sanity.initialize_chrome_42 Error Message: Message: Error forwarding the new session cannot find : Capabilities {browserName: chrome, platform: LINUX, version: 64.0.3282.140} Stacktrace: at org.openqa.grid.web.servlet.handler.RequestHandler.process (RequestHandler.java:117) at org.openqa.grid.web.servlet.DriverServlet.process (DriverServlet.java:84) at org.openqa.grid.web.servlet.DriverServlet.doPost (DriverServlet.java:68) at javax.servlet.http.HttpServlet.service (HttpServlet.java:707) at javax.servlet.http.HttpServlet.service (HttpServlet.java:790) at org.seleniumhq.jetty9.servlet.ServletHolder.handle (ServletHolder.java:860) at org.seleniumhq.jetty9.servlet.ServletHandler.doHandle (ServletHandler.java:535) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188) at org.seleniumhq.jetty9.server.session.SessionHandler.doHandle (SessionHandler.java:1595) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188) at org.seleniumhq.jetty9.server.handler.ContextHandler.doHandle (ContextHandler.java:1253) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:168) at org.seleniumhq.jetty9.servlet.ServletHandler.doScope (ServletHandler.java:473) at org.seleniumhq.jetty9.server.session.SessionHandler.doScope (SessionHandler.java:1564) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:166) at org.seleniumhq.jetty9.server.handler.ContextHandler.doScope (ContextHandler.java:1155) at org.seleniumhq.jetty9.server.handler.ScopedHandler.handle (ScopedHandler.java:141) at org.seleniumhq.jetty9.server.handler.HandlerWrapper.handle (HandlerWrapper.java:132) at org.seleniumhq.jetty9.server.Server.handle (Server.java:530) at org.seleniumhq.jetty9.server.HttpChannel.handle (HttpChannel.java:347) at org.seleniumhq.jetty9.server.HttpConnection.onFillable (HttpConnection.java:256) at org.seleniumhq.jetty9.io.AbstractConnection$ReadCallback.succeeded (AbstractConnection.java:279) at org.seleniumhq.jetty9.io.FillInterest.fillable (FillInterest.java:102) at org.seleniumhq.jetty9.io.ChannelEndPoint$2.run (ChannelEndPoint.java:124) at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.doProduce (EatWhatYouKill.java:247) at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.produce (EatWhatYouKill.java:140) at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.run (EatWhatYouKill.java:131) at org.seleniumhq.jetty9.util.thread.ReservedThreadExecutor$ReservedThread.run (ReservedThreadExecutor.java:382) at org.seleniumhq.jetty9.util.thread.QueuedThreadPool.runJob (QueuedThreadPool.java:708) at org.seleniumhq.jetty9.util.thread.QueuedThreadPool$2.run (QueuedThreadPool.java:626) at java.lang.Thread.run (Thread.java:748) -------------------- >> begin captured stdout << --------------------- _init_browser, connecting to hub at http://172.18.0.2:4444/wd/hub Message: Error forwarding the new session cannot find : Capabilities {browserName: chrome, platform: LINUX, version: 64.0.3282.140} Stacktrace: at org.openqa.grid.web.servlet.handler.RequestHandler.process (RequestHandler.java:117) at org.openqa.grid.web.servlet.DriverServlet.process (DriverServlet.java:84) at org.openqa.grid.web.servlet.DriverServlet.doPost (DriverServlet.java:68) at javax.servlet.http.HttpServlet.service (HttpServlet.java:707) at javax.servlet.http.HttpServlet.service (HttpServlet.java:790) at org.seleniumhq.jetty9.servlet.ServletHolder.handle (ServletHolder.java:860) at org.seleniumhq.jetty9.servlet.ServletHandler.doHandle (ServletHandler.java:535) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188) at org.seleniumhq.jetty9.server.session.SessionHandler.doHandle (SessionHandler.java:1595) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188) at org.seleniumhq.jetty9.server.handler.ContextHandler.doHandle (ContextHandler.java:1253) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:168) at org.seleniumhq.jetty9.servlet.ServletHandler.doScope (ServletHandler.java:473) at org.seleniumhq.jetty9.server.session.SessionHandler.doScope (SessionHandler.java:1564) at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:166) at org.seleniumhq.jetty9.server.handler.ContextHandler.doScope (ContextHandler.java:1155) at org.seleniumhq.jetty9.server.handler.ScopedHandler.handle (ScopedHandler.java:141) at org.seleniumhq.jetty9.server.handler.HandlerWrapper.handle (HandlerWrapper.java:132) at org.seleniumhq.jetty9.server.Server.handle (Server.java:530) at org.seleniumhq.jetty9.server.HttpChannel.handle (HttpChannel.java:347) at org.seleniumhq.jetty9.server.HttpConnection.onFillable (HttpConnection.java:256) at org.seleniumhq.jetty9.io.AbstractConnection$ReadCallback.succeeded (AbstractConnection.java:279) at org.seleniumhq.jetty9.io.FillInterest.fillable (FillInterest.java:102) at org.seleniumhq.jetty9.io.ChannelEndPoint$2.run (ChannelEndPoint.java:124) at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.doProduce (EatWhatYouKill.java:247) at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.produce (EatWhatYouKill.java:140) at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.run (EatWhatYouKill.java:131) at org.seleniumhq.jetty9.util.thread.ReservedThreadExecutor$ReservedThread.run (ReservedThreadExecutor.java:382) at org.seleniumhq.jetty9.util.thread.QueuedThreadPool.runJob (QueuedThreadPool.java:708) at org.seleniumhq.jetty9.util.thread.QueuedThreadPool$2.run (QueuedThreadPool.java:626) at java.lang.Thread.run (Thread.java:748) WebDriverException in _init_browser connecting to hub --------------------- >> end captured stdout << ---------------------- -------------------- >> begin captured logging << -------------------- selenium.webdriver.remote.remote_connection: DEBUG: POST http://172.18.0.2:4444/wd/hub/session {"capabilities": {"alwaysMatch": {"browserName": "chrome", "platformName": "linux", "browserVersion": "64.0.3282.140"}, "firstMatch": [{}]}, "desiredCapabilities": {"platform": "LINUX", "browserName": "chrome", "version": "64.0.3282.140"}} urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): 172.18.0.2:4444 urllib3.connectionpool: DEBUG: http://172.18.0.2:4444 "POST /wd/hub/session HTTP/1.1" 500 7792 selenium.webdriver.remote.remote_connection: DEBUG: Finished Request --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/home/jenkins/workspace/ovirt-system-tests_compat-4.2-suite-master/ovirt-system-tests/compat-4.2-suite-master/test-scenarios/008_basic_ui_sanity.py", line 213, in initialize_chrome _init_driver(_get_chrome_capabilities()) File "/home/jenkins/workspace/ovirt-system-tests_compat-4.2-suite-master/ovirt-system-tests/compat-4.2-suite-master/test-scenarios/008_basic_ui_sanity.py", line 239, in _init_driver raise e 'Message: Error forwarding the new session cannot find : Capabilities {browserName: chrome, platform: LINUX, version: 64.0.3282.140}\nStacktrace:\n at org.openqa.grid.web.servlet.handler.RequestHandler.process (RequestHandler.java:117)\n at org.openqa.grid.web.servlet.DriverServlet.process (DriverServlet.java:84)\n at org.openqa.grid.web.servlet.DriverServlet.doPost (DriverServlet.java:68)\n at javax.servlet.http.HttpServlet.service (HttpServlet.java:707)\n at javax.servlet.http.HttpServlet.service (HttpServlet.java:790)\n at org.seleniumhq.jetty9.servlet.ServletHolder.handle (ServletHolder.java:860)\n at org.seleniumhq.jetty9.servlet.ServletHandler.doHandle (ServletHandler.java:535)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)\n at org.seleniumhq.jetty9.server.session.SessionHandler.doHandle (SessionHandler.java:1595)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)\n at org.seleniumhq.jetty9.server.handler.ContextHandler.doHandle (ContextHandler.java:1253)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:168)\n at org.seleniumhq.jetty9.servlet.ServletHandler.doScope (ServletHandler.java:473)\n at org.seleniumhq.jetty9.server.session.SessionHandler.doScope (SessionHandler.java:1564)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:166)\n at org.seleniumhq.jetty9.server.handler.ContextHandler.doScope (ContextHandler.java:1155)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.handle (ScopedHandler.java:141)\n at org.seleniumhq.jetty9.server.handler.HandlerWrapper.handle (HandlerWrapper.java:132)\n at org.seleniumhq.jetty9.server.Server.handle (Server.java:530)\n at org.seleniumhq.jetty9.server.HttpChannel.handle (HttpChannel.java:347)\n at org.seleniumhq.jetty9.server.HttpConnection.onFillable (HttpConnection.java:256)\n at org.seleniumhq.jetty9.io.AbstractConnection$ReadCallback.succeeded (AbstractConnection.java:279)\n at org.seleniumhq.jetty9.io.FillInterest.fillable (FillInterest.java:102)\n at org.seleniumhq.jetty9.io.ChannelEndPoint$2.run (ChannelEndPoint.java:124)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.doProduce (EatWhatYouKill.java:247)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.produce (EatWhatYouKill.java:140)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.run (EatWhatYouKill.java:131)\n at org.seleniumhq.jetty9.util.thread.ReservedThreadExecutor$ReservedThread.run (ReservedThreadExecutor.java:382)\n at org.seleniumhq.jetty9.util.thread.QueuedThreadPool.runJob (QueuedThreadPool.java:708)\n at org.seleniumhq.jetty9.util.thread.QueuedThreadPool$2.run (QueuedThreadPool.java:626)\n at java.lang.Thread.run (Thread.java:748)\n-------------------- >> begin captured stdout << ---------------------\n_init_browser, connecting to hub at http://172.18.0.2:4444/wd/hub\nMessage: Error forwarding the new session cannot find : Capabilities {browserName: chrome, platform: LINUX, version: 64.0.3282.140}\nStacktrace:\n at org.openqa.grid.web.servlet.handler.RequestHandler.process (RequestHandler.java:117)\n at org.openqa.grid.web.servlet.DriverServlet.process (DriverServlet.java:84)\n at org.openqa.grid.web.servlet.DriverServlet.doPost (DriverServlet.java:68)\n at javax.servlet.http.HttpServlet.service (HttpServlet.java:707)\n at javax.servlet.http.HttpServlet.service (HttpServlet.java:790)\n at org.seleniumhq.jetty9.servlet.ServletHolder.handle (ServletHolder.java:860)\n at org.seleniumhq.jetty9.servlet.ServletHandler.doHandle (ServletHandler.java:535)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)\n at org.seleniumhq.jetty9.server.session.SessionHandler.doHandle (SessionHandler.java:1595)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)\n at org.seleniumhq.jetty9.server.handler.ContextHandler.doHandle (ContextHandler.java:1253)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:168)\n at org.seleniumhq.jetty9.servlet.ServletHandler.doScope (ServletHandler.java:473)\n at org.seleniumhq.jetty9.server.session.SessionHandler.doScope (SessionHandler.java:1564)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:166)\n at org.seleniumhq.jetty9.server.handler.ContextHandler.doScope (ContextHandler.java:1155)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.handle (ScopedHandler.java:141)\n at org.seleniumhq.jetty9.server.handler.HandlerWrapper.handle (HandlerWrapper.java:132)\n at org.seleniumhq.jetty9.server.Server.handle (Server.java:530)\n at org.seleniumhq.jetty9.server.HttpChannel.handle (HttpChannel.java:347)\n at org.seleniumhq.jetty9.server.HttpConnection.onFillable (HttpConnection.java:256)\n at org.seleniumhq.jetty9.io.AbstractConnection$ReadCallback.succeeded (AbstractConnection.java:279)\n at org.seleniumhq.jetty9.io.FillInterest.fillable (FillInterest.java:102)\n at org.seleniumhq.jetty9.io.ChannelEndPoint$2.run (ChannelEndPoint.java:124)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.doProduce (EatWhatYouKill.java:247)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.produce (EatWhatYouKill.java:140)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.run (EatWhatYouKill.java:131)\n at org.seleniumhq.jetty9.util.thread.ReservedThreadExecutor$ReservedThread.run (ReservedThreadExecutor.java:382)\n at org.seleniumhq.jetty9.util.thread.QueuedThreadPool.runJob (QueuedThreadPool.java:708)\n at org.seleniumhq.jetty9.util.thread.QueuedThreadPool$2.run (QueuedThreadPool.java:626)\n at java.lang.Thread.run (Thread.java:748)\nWebDriverException in _init_browser connecting to hub\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\nselenium.webdriver.remote.remote_connection: DEBUG: POST http://172.18.0.2:4444/wd/hub/session {"capabilities": {"alwaysMatch": {"browserName": "chrome", "platformName": "linux", "browserVersion": "64.0.3282.140"}, "firstMatch": [{}]}, "desiredCapabilities": {"platform": "LINUX", "browserName": "chrome", "version": "64.0.3282.140"}}\nurllib3.connectionpool: DEBUG: Starting new HTTP connection (1): 172.18.0.2:4444\nurllib3.connectionpool: DEBUG: http://172.18.0.2:4444 "POST /wd/hub/session HTTP/1.1" 500 7792\nselenium.webdriver.remote.remote_connection: DEBUG: Finished Request\n--------------------- >> end captured logging << ---------------------'

1 1

[oVirt Jenkins] ovirt-system-tests_network-suite-master - Build # 662 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_network-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_network-suite-master/662/ Build Number: 662 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #662 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 19 tests failed. FAILED: network-suite-master.tests.test_ipv6_support.test_run_vm_over_ipv6_nfs_storage_domain Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_mac_pools.test_set_mac_pool_duplicate_macs_from_true_to_false_while_dup_exists Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_mac_pools.test_assign_vnic_with_full_mac_pool_capacity_fails Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_mac_pools.test_undo_preview_snapshot_when_mac_used_reassigns_a_new_mac Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_mac_pools.test_mac_pools_in_different_clusters_dont_overlap Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_mac_pools.test_restore_snapshot_with_an_used_mac_implicitly_assigns_new_mac Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_mac_pools.test_move_stateless_vm_mac_to_new_vm_fails Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_mac_pools.test_move_mac_to_new_vm Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_qos_configuration.test_setup_net_with_qos Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_required_network.test_required_network_host_non_operational Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_unrestricted_display_network_name.test_run_vm_with_unrestricted_display_network_name Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_vm_operations.test_live_vm_migration_using_dedicated_network Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.test_vm_operations.test_hot_linking_vnic Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.ovn-provider.test_ovn_provider.test_ovn_provider_create_scenario Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.ovn-provider.test_ovn_provider.test_validate_ovn_provider_connectivity Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.ovn-provider.test_ovn_provider.test_update_network_mtu Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.ovn-provider.test_ovn_provider.test_ovn_provider_cleanup_scenario Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.ovn-provider.test_ovn_provider_integration_with_ovirt.test_connect_vm_to_external_network Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout FAILED: network-suite-master.tests.ovs.test_ovn_physnet.test_connect_vm_to_external_physnet Error Message: test setup failure Stack Trace: fqdn = None, env = <lago.sdk.SDK object at 0x7f64bebb5b90> artifacts_path = '/home/jenkins/workspace/ovirt-system-tests_network-suite-master/ovirt-system-tests/exported-artifacts' @pytest.fixture(scope='session', autouse=True) def engine(fqdn, env, artifacts_path): with suite.collect_artifacts(env, artifacts_path, 'pre-tests'): engine = env.get_vms()[ENGINE_DOMAIN] ANSWER_FILE_TMP = '/tmp/answer-file' engine.copy_to(ANSWER_FILE_SRC, ANSWER_FILE_TMP) engine.ssh( [ 'engine-setup', '--config-append={}'.format(ANSWER_FILE_TMP), '--accept-defaults', ] ) syncutil.sync(exec_func=_get_engine_api, exec_func_args=(engine,), > success_criteria=lambda api: isinstance(api, Connection)) network-suite-master/fixtures/engine.py:56: _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ exec_func = <function _get_engine_api at 0x7f64c1cad6e0> exec_func_args = (<ovirtlago.virt.EngineVM object at 0x7f64be1f3b10>,) success_criteria = <function <lambda> at 0x7f64bd738668> error_criteria = <function <lambda> at 0x7f64c1c8a938>, timeout = 120 def sync(exec_func, exec_func_args, success_criteria=lambda result: True, error_criteria=lambda error: True, timeout=DEFAULT_TIMEOUT): """Sync an operation until it either: - succeeds (according to the success_criteria specified) - fails due to timing out (after the specified timeout) - fails due to a terminal error (according to the error_criteria specified) A caller may specifiy a success_criteria function that should return: - False if the sync should continue to retry - True if the sync should terminate immediately A caller may also specify an error_criteria function if the sync should continue to retry when the operation fails with an anticipated exception. This function will be called back with the exception and should return: - False if the sync should continue to retry - True if the sync should stop and the exception raised back to the caller By default, both success_criteria and error_criteria return True, causing all results and all errors to return and raise respectively. The default timeout is 120 seconds. :param exec_func: callable :param exec_func_args: tuple/dict :param success_criteria: callable :param error_criteria: callable :param timeout: int :return: the result of running the exec_func """ end_time = _monothonic_time() + timeout if isinstance(exec_func_args, collections.Mapping): kwargs = exec_func_args args = () else: args = exec_func_args kwargs = {} try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result while _monothonic_time() < end_time: time.sleep(3) try: result = exec_func(*args, **kwargs) except Exception as e: if error_criteria(e): raise result = e else: if success_criteria(result): return result > raise Timeout(result) E Timeout: Last evaluated result: None network-suite-master/lib/syncutil.py:104: Timeout

1 1

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 780 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/780/ Build Number: 780 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #780 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: The response content type 'text/html; charset=iso-8859-1' isn't the expected XML -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7fa6aad1a230> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 253, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 38104, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 208, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 130, in _check_fault body = self._internal_read_body(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 316, in _internal_read_body self._connection.check_xml_content_type(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 850, in check_xml_content_type response.headers File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 890, in _check_content_type raise Error(msg) Error: The response content type 'text/html; charset=iso-8859-1' isn't the expected XML --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 228, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 275, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 278, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 253, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 38104, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait return self._code(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 208, in callback self._check_fault(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 130, in _check_fault body = self._internal_read_body(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 316, in _internal_read_body self._connection.check_xml_content_type(response) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 850, in check_xml_content_type response.headers File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 890, in _check_content_type raise Error(msg) 'The response content type \'text/html; charset=iso-8859-1\' isn\'t the expected XML\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function _host_is_up_4 at 0x7fa6aad1a230>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/002_bootstrap.py", line 253, in _host_is_up_4\n host_obj = host_service.get()\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 38104, in get\n return self._internal_get(headers, query, wait)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get\n return future.wait() if wait else future\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 55, in wait\n return self._code(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 208, in callback\n self._check_fault(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 130, in _check_fault\n body = self._internal_read_body(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 316, in _internal_read_body\n self._connection.check_xml_content_type(response)\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 850, in check_xml_content_type\n response.headers\n File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 890, in _check_content_type\n raise Error(msg)\nError: The response content type \'text/html; charset=iso-8859-1\' isn\'t the expected XML\n--------------------- >> end captured logging << ---------------------'

1 1

Build failed in Jenkins: system-sync_mirrors-centos-updates-el7-x86_64 #2034
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

See <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> ------------------------------------------ Started by timer [EnvInject] - Loading node environment variables. Building remotely on mirrors.phx.ovirt.org (mirrors) in workspace <http://jenkins.ovirt.org/job/system-sync_mirrors-centos-updates-el7-x86_64/…> > git rev-parse --is-inside-work-tree # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url http://gerrit.ovirt.org/jenkins.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Pruning obsolete local branches Fetching upstream changes from http://gerrit.ovirt.org/jenkins.git > git --version # timeout=10 > git fetch --tags --progress http://gerrit.ovirt.org/jenkins.git +refs/heads/*:refs/remotes/origin/* --prune > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 92c04a259244f3206b0c9a92617876fb2e23ec3d (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 92c04a259244f3206b0c9a92617876fb2e23ec3d Commit message: "standard-pipelines: add kubevirt/common-templates" > git rev-list --no-walk 92c04a259244f3206b0c9a92617876fb2e23ec3d # timeout=10 [system-sync_mirrors-centos-updates-el7-x86_64] $ /bin/bash -xe /tmp/jenkins1085267235485600225.sh + jenkins/scripts/mirror_mgr.sh resync_yum_mirror centos-updates-el7 x86_64 jenkins/data/mirrors-reposync.conf Checking if mirror needs a resync Traceback (most recent call last): File "/usr/bin/reposync", line 343, in <module> main() File "/usr/bin/reposync", line 175, in main my.doRepoSetup() File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 681, in doRepoSetup return self._getRepos(thisrepo, True) File "/usr/lib/python2.7/site-packages/yum/__init__.py", line 721, in _getRepos self._repos.doSetup(thisrepo) File "/usr/lib/python2.7/site-packages/yum/repos.py", line 157, in doSetup self.retrieveAllMD() File "/usr/lib/python2.7/site-packages/yum/repos.py", line 88, in retrieveAllMD dl = repo._async and repo._commonLoadRepoXML(repo) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 1465, in _commonLoadRepoXML local = self.cachedir + '/repomd.xml' File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 774, in <lambda> cachedir = property(lambda self: self._dirGetAttr('cachedir')) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 757, in _dirGetAttr self.dirSetup() File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 735, in dirSetup self._dirSetupMkdir_p(dir) File "/usr/lib/python2.7/site-packages/yum/yumRepo.py", line 712, in _dirSetupMkdir_p raise Errors.RepoError, msg yum.Errors.RepoError: Error making cache directory: /home/jenkins/mirrors_cache/epel-el6 error was: [Errno 17] File exists: '/home/jenkins/mirrors_cache/epel-el6' Build step 'Execute shell' marked build as failure

1 1

[JIRA] (OVIRT-2536) Setup root cause analysis in Nagious so it dosn't flood mail in alers in network issues
by Barak Korren (oVirt JIRA) 13 Oct '18

13 Oct '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2536?page=com.atlassian.jira.… ] Barak Korren reassigned OVIRT-2536: ----------------------------------- Assignee: Evgheni Dereveanchin (was: infra) > Setup root cause analysis in Nagious so it dosn't flood mail in alers in network issues > --------------------------------------------------------------------------------------- > > Key: OVIRT-2536 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2536 > Project: oVirt - virtualization made easy > Issue Type: New Feature > Components: monitoring > Reporter: Barak Korren > Assignee: Evgheni Dereveanchin > -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[JIRA] (OVIRT-2536) Setup root cause analysis in Nagious so it dosn't flood mail in alers in network issues
by Barak Korren (oVirt JIRA) 13 Oct '18

13 Oct '18

Barak Korren created OVIRT-2536: ----------------------------------- Summary: Setup root cause analysis in Nagious so it dosn't flood mail in alers in network issues Key: OVIRT-2536 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2536 Project: oVirt - virtualization made easy Issue Type: New Feature Components: monitoring Reporter: Barak Korren Assignee: infra -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100094)

1 0

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-4.2 - Build # 558 - Failure!
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-4.2/558/ Build Number: 558 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #558 [Eitan Raviv] networking: connect NFS to engine over IPv6 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_hosts Error Message: 143 -------------------- >> begin captured logging << -------------------- cli: DEBUG: signal 15 was caught --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 229, in add_hosts add_hosts_4(prefix) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 273, in add_hosts_4 testlib.assert_true_within(_host_is_up_4, timeout=15*60) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 278, in assert_true_within assert_equals_within(func, True, timeout, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-4.2/ovirt-system-tests/hc-basic-suite-4.2/test-scenarios/002_bootstrap.py", line 254, in _host_is_up_4 host_obj = host_service.get() File "/usr/lib64/python2.7/site-packages/ovirtsdk4/services.py", line 37093, in get return self._internal_get(headers, query, wait) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 211, in _internal_get return future.wait() if wait else future File "/usr/lib64/python2.7/site-packages/ovirtsdk4/service.py", line 54, in wait response = self._connection.wait(self._context) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 496, in wait return self.__wait(context, failed_auth) File "/usr/lib64/python2.7/site-packages/ovirtsdk4/__init__.py", line 532, in __wait self._multi.select(1.0) File "/usr/lib/python2.7/site-packages/lago/cmd.py", line 922, in exit_handler sys.exit(128 + signum) '143\n-------------------- >> begin captured logging << --------------------\ncli: DEBUG: signal 15 was caught\n--------------------- >> end captured logging << ---------------------'

1 1

oVirt infra daily report - unstable production jobs - 611
by jenkins＠jenkins.phx.ovirt.org 13 Oct '18

13 Oct '18

Good morning! Attached is the HTML page with the jenkins status report. You can see it also here: - http://jenkins.ovirt.org/job/system_jenkins-report/611//artifact/exported-a… Cheers, Jenkins

1 0