[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly -
Build # 1291 - Failure!
by jenkins＠jenkins.phx.ovirt.org
Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/
Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_night...
Build Number: 1291
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #1291
[Marcin Sobczyk] network: Add missing 'ansible_hosts' fixture
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: basic-suite-master.test-scenarios.test_004_basic_sanity.test_cold_incremental_backup_vm2
Error Message:
ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Cannot backup VM. The VM is during a backup operation.]". HTTP response code is 409.
Stack Trace:
engine_api = <ovirtsdk4.Connection object at 0x7f1f943c3208>
get_vm_service_for_vm = <function get_vm_service_for_vm.<locals>.service_for at 0x7f1f944e1268>
@order_by(_TEST_LIST)
def test_cold_incremental_backup_vm2(engine_api, get_vm_service_for_vm):
_verify_vm_state(engine_api.system_service(), VM2_NAME, types.VmStatus.DOWN)
vm2_backups_service = get_vm_service_for_vm(VM2_NAME).backups_service()
backup.perform_incremental_vm_backup(
> engine_api, vm2_backups_service, DISK2_NAME, "cold_vm_backup")
basic-suite-master/test-scenarios/test_004_basic_sanity.py:1056:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
ost_utils/ost_utils/storage_utils/backup.py:75: in perform_incremental_vm_backup
correlation_id="incremental_" + correlation_id)
ost_utils/ost_utils/storage_utils/backup.py:34: in perform_vm_backup
), query={'correlation_id': correlation_id}
/usr/lib64/python3.6/site-packages/ovirtsdk4/services.py:34139: in add
return self._internal_add(backup, headers, query, wait)
/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:232: in _internal_add
return future.wait() if wait else future
/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:55: in wait
return self._code(response)
/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:229: in callback
self._check_fault(response)
/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:132: in _check_fault
self._raise_error(response, body)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
response = <ovirtsdk4.http.Response object at 0x7f1f94399c50>
detail = <ovirtsdk4.types.Fault object at 0x7f1f94399f60>
@staticmethod
def _raise_error(response, detail=None):
"""
Creates and raises an error containing the details of the given HTTP
response and fault.
This method is intended for internal use by other components of the
SDK. Refrain from using it directly, as backwards compatibility isn't
guaranteed.
"""
fault = detail if isinstance(detail, types.Fault) else None
msg = ''
if fault:
if fault.reason:
if msg:
msg += ' '
msg = msg + 'Fault reason is "%s".' % fault.reason
if fault.detail:
if msg:
msg += ' '
msg = msg + 'Fault detail is "%s".' % fault.detail
if response:
if response.code:
if msg:
msg += ' '
msg = msg + 'HTTP response code is %s.' % response.code
if response.message:
if msg:
msg += ' '
msg = msg + 'HTTP response message is "%s".' % response.message
if isinstance(detail, six.string_types):
if msg:
msg += ' '
msg = msg + detail + '.'
class_ = Error
if response is not None:
if response.code in [401, 403]:
class_ = AuthError
elif response.code == 404:
class_ = NotFoundError
error = class_(msg)
error.code = response.code if response else None
error.fault = fault
> raise error
E ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Cannot backup VM. The VM is during a backup operation.]". HTTP response code is 409.
/usr/lib64/python3.6/site-packages/ovirtsdk4/service.py:118: Error
2 years, 10 months
[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly -
Build # 1287 - Failure!
by jenkins＠jenkins.phx.ovirt.org
Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/
Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_night...
Build Number: 1287
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #1287
[Marcin Sobczyk] network: Add missing 'ansible_hosts' fixture
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: basic-suite-master.test-scenarios.test_001_initialize_engine.test_initialize_engine
Error Message:
failed on setup with "ost_utils.ansible.module_mappers.AnsibleExecutionError: Error running ansible: rc=2, stdout=lago-basic-suite-master-engine | FAILED! => {
"changed": false,
"elapsed": 120,
"msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.2 port 22: No route to host"
}
lago-basic-suite-master-host-0 | FAILED! => {
"changed": false,
"elapsed": 120,
"msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.3 port 22: No route to host"
}
lago-basic-suite-master-host-1 | FAILED! => {
"changed": false,
"elapsed": 120,
"msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.4 port 22: No route to host"
}"
Stack Trace:
ansible_vms_to_deploy = <ost_utils.ansible.module_mappers.ModuleMapper object at 0x7f2fb1959278>
ansible_hosts = <ost_utils.ansible.module_mappers.ModuleMapper object at 0x7f2fb1959358>
deploy_scripts = {'lago-basic-suite-master-engine': ['$OST_REPO_ROOT/common/deploy-scripts/setup_sar_stat.sh', '$OST_REPO_ROOT/common/d...t-1': ['$OST_REPO_ROOT/common/deploy-scripts/setup_sar_stat.sh', '$OST_REPO_ROOT/common/deploy-scripts/setup_host.sh']}
working_dir = '/home/jenkins/workspace/ovirt-system-tests_basic-suite-master_nightly/ovirt-system-tests/deployment-basic-suite-master'
request = <SubRequest 'deploy' for <Function test_initialize_engine>>
run_scripts = <function run_scripts.<locals>.do_run_scripts at 0x7f2fb191a6a8>
@pytest.fixture(scope="session", autouse=True)
def deploy(
ansible_vms_to_deploy,
ansible_hosts,
deploy_scripts,
working_dir,
request,
run_scripts,
):
if deployment_utils.is_deployed(working_dir):
LOGGER.info("Environment already deployed")
return
LOGGER.info("Waiting for SSH on the VMs")
> ansible_vms_to_deploy.wait_for_connection(timeout=120)
ost_utils/ost_utils/pytest/fixtures/deployment.py:61:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
ost_utils/ost_utils/ansible/module_mappers.py:110: in __call__
return _run_ansible_runner(self.config_builder)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
config_builder = <ost_utils.ansible.config_builder.ConfigBuilder object at 0x7f2fb19595f8>
def _run_ansible_runner(config_builder):
runner = ansible_runner.Runner(config=config_builder.prepare())
LOGGER.debug(f'_run_ansible_runner: before run: {runner}')
runner.run()
LOGGER.debug(f'_run_ansible_runner: after run: {runner}')
if runner.status != 'successful':
raise AnsibleExecutionError(
rc=runner.rc,
> stdout=runner.stdout.read()
)
E ost_utils.ansible.module_mappers.AnsibleExecutionError: Error running ansible: rc=2, stdout=lago-basic-suite-master-engine | FAILED! => {
E "changed": false,
E "elapsed": 120,
E "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.2 port 22: No route to host"
E }
E lago-basic-suite-master-host-0 | FAILED! => {
E "changed": false,
E "elapsed": 120,
E "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.3 port 22: No route to host"
E }
E lago-basic-suite-master-host-1 | FAILED! => {
E "changed": false,
E "elapsed": 120,
E "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.4 port 22: No route to host"
E }
ost_utils/ost_utils/ansible/module_mappers.py:48: AnsibleExecutionError
2 years, 10 months
[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build
# 623 - Failure!
by jenkins＠jenkins.phx.ovirt.org
Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/
Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/...
Build Number: 623
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #623
[parthdhanjal] Updating max click version
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 004_basic_sanity.disk_operations
Error Message:
False != True after 600 seconds
-------------------- >> begin captured logging << --------------------
lago.utils: DEBUG: Error while running thread Thread-63
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue
queue.put({'return': func()})
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper
prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs
File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 508, in live_storage_migration
testlib.assert_true_within_long(lambda: test_utils.all_jobs_finished(engine, correlation_id))
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long
assert_equals_within_long(func, True, allowed_exceptions)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long
func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within
'%s != %s after %s seconds' % (res, value, timeout)
AssertionError: False != True after 600 seconds
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper
prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs
File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 932, in disk_operations
vt.join_all()
File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue
queue.put({'return': func()})
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper
prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs
File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 508, in live_storage_migration
testlib.assert_true_within_long(lambda: test_utils.all_jobs_finished(engine, correlation_id))
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long
assert_equals_within_long(func, True, allowed_exceptions)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long
func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within
'%s != %s after %s seconds' % (res, value, timeout)
'False != True after 600 seconds\n-------------------- >> begin captured logging << --------------------\nlago.utils: DEBUG: Error while running thread Thread-63\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/lago/utils.py", line 58, in _ret_via_queue\n queue.put({\'return\': func()})\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper\n return func(get_test_prefix(), *args, **kwargs)\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 79, in wrapper\n prefix.virt_env.engine_vm().get_api(api_ver=4), *args, **kwargs\n File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/004_basic_sanity.py", line 508, in live_storage_migration\n testlib.assert_true_within_long(lambda: test_utils.all_jobs_finished(engine, correlation_id))\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long\n assert_equals_within_long(func, True, allowed_exceptions)\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long\n func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 252, in assert_equals_within\n \'%s != %s after %s seconds\' % (res, value, timeout)\nAssertionError: False != True after 600 seconds\n--------------------- >> end captured logging << ---------------------'
2 years, 10 months
[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly -
Build # 1284 - Failure!
by jenkins＠jenkins.phx.ovirt.org
Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/
Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_night...
Build Number: 1284
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #1284
[Pavel Bar] backup: fix OST backup test due to change in VM backup behavior
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: basic-suite-master.test-scenarios.test_001_initialize_engine.test_initialize_engine
Error Message:
failed on setup with "ost_utils.ansible.module_mappers.AnsibleExecutionError: Error running ansible: rc=2, stdout=lago-basic-suite-master-host-1 | FAILED! => {
"changed": false,
"elapsed": 120,
"msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.4 port 22: No route to host"
}
lago-basic-suite-master-host-0 | FAILED! => {
"changed": false,
"elapsed": 120,
"msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.3 port 22: No route to host"
}
lago-basic-suite-master-engine | FAILED! => {
"changed": false,
"elapsed": 120,
"msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.2 port 22: No route to host"
}"
Stack Trace:
ansible_vms_to_deploy = <ost_utils.ansible.module_mappers.ModuleMapper object at 0x7f6262b9b0f0>
deploy_scripts = {'lago-basic-suite-master-engine': ['$OST_REPO_ROOT/common/deploy-scripts/setup_sar_stat.sh', '$OST_REPO_ROOT/common/d...t-1': ['$OST_REPO_ROOT/common/deploy-scripts/setup_sar_stat.sh', '$OST_REPO_ROOT/common/deploy-scripts/setup_host.sh']}
working_dir = '/home/jenkins/workspace/ovirt-system-tests_basic-suite-master_nightly/ovirt-system-tests/deployment-basic-suite-master'
request = <SubRequest 'deploy' for <Function test_initialize_engine>>
run_scripts = <function run_scripts.<locals>.do_run_scripts at 0x7f6262bbb268>
@pytest.fixture(scope="session", autouse=True)
def deploy(
ansible_vms_to_deploy,
deploy_scripts,
working_dir,
request,
run_scripts,
):
if deployment_utils.is_deployed(working_dir):
LOGGER.info("Environment already deployed")
return
LOGGER.info("Waiting for SSH on the VMs")
> ansible_vms_to_deploy.wait_for_connection(timeout=120)
ost_utils/ost_utils/pytest/fixtures/deployment.py:59:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
ost_utils/ost_utils/ansible/module_mappers.py:110: in __call__
return _run_ansible_runner(self.config_builder)
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
config_builder = <ost_utils.ansible.config_builder.ConfigBuilder object at 0x7f6262b9b400>
def _run_ansible_runner(config_builder):
runner = ansible_runner.Runner(config=config_builder.prepare())
LOGGER.debug(f'_run_ansible_runner: before run: {runner}')
runner.run()
LOGGER.debug(f'_run_ansible_runner: after run: {runner}')
if runner.status != 'successful':
raise AnsibleExecutionError(
rc=runner.rc,
> stdout=runner.stdout.read()
)
E ost_utils.ansible.module_mappers.AnsibleExecutionError: Error running ansible: rc=2, stdout=lago-basic-suite-master-host-1 | FAILED! => {
E "changed": false,
E "elapsed": 120,
E "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.4 port 22: No route to host"
E }
E lago-basic-suite-master-host-0 | FAILED! => {
E "changed": false,
E "elapsed": 120,
E "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.3 port 22: No route to host"
E }
E lago-basic-suite-master-engine | FAILED! => {
E "changed": false,
E "elapsed": 120,
E "msg": "timed out waiting for ping module test success: Failed to connect to the host via ssh: ssh: connect to host 192.168.200.2 port 22: No route to host"
E }
ost_utils/ost_utils/ansible/module_mappers.py:48: AnsibleExecutionError
2 years, 10 months
