Link to Job: http://jenkins.ovirt.org/job/test-repo_ovirt_experimental_master/6303

OST is failing in the last 50 builds


00:18:22.090 [basic_suit_el7]   # add_secondary_storage_domains: 
00:18:22.090 [basic_suit_el7] Error while running thread
00:18:22.090 [basic_suit_el7] Traceback (most recent call last):
00:18:22.090 [basic_suit_el7]   File "/usr/lib/python2.7/site-packages/lago/utils.py", line 57, in _ret_via_queue
00:18:22.090 [basic_suit_el7]     queue.put({'return': func()})
00:18:22.090 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 427, in add_nfs_storage_domain
00:18:22.090 [basic_suit_el7]     add_generic_nfs_storage_domain(prefix, SD_NFS_NAME, SD_NFS_HOST_NAME, SD_NFS_PATH, nfs_version='v4_2')
00:18:22.091 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 441, in add_generic_nfs_storage_domain
00:18:22.091 [basic_suit_el7]     add_generic_nfs_storage_domain_4(prefix, sd_nfs_name, nfs_host_name, mount_path, sd_format, sd_type, nfs_version)
00:18:22.091 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 490, in add_generic_nfs_storage_domain_4
00:18:22.091 [basic_suit_el7]     host=_random_host_from_dc_4(api, DC_NAME),
00:18:22.091 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 106, in _random_host_from_dc_4
00:18:22.091 [basic_suit_el7]     return random.choice(_hosts_in_dc_4(api, dc_name))
00:18:22.091 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 100, in _hosts_in_dc_4
00:18:22.091 [basic_suit_el7]     raise RuntimeError('Could not find hosts that are up in DC %s' % dc_name)
00:18:22.092 [basic_suit_el7] RuntimeError: Could not find hosts that are up in DC test-dc
00:18:22.092 [basic_suit_el7] Error while running thread
00:18:22.092 [basic_suit_el7] Traceback (most recent call last):
00:18:22.092 [basic_suit_el7]   File "/usr/lib/python2.7/site-packages/lago/utils.py", line 57, in _ret_via_queue
00:18:22.092 [basic_suit_el7]     queue.put({'return': func()})
00:18:22.092 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 583, in add_iso_storage_domain
00:18:22.092 [basic_suit_el7]     add_generic_nfs_storage_domain(prefix, SD_ISO_NAME, SD_ISO_HOST_NAME, SD_ISO_PATH, sd_format='v1', sd_type='iso', nfs_version='v3')
00:18:22.092 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 441, in add_generic_nfs_storage_domain
00:18:22.092 [basic_suit_el7]     add_generic_nfs_storage_domain_4(prefix, sd_nfs_name, nfs_host_name, mount_path, sd_format, sd_type, nfs_version)
00:18:22.093 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 490, in add_generic_nfs_storage_domain_4
00:18:22.093 [basic_suit_el7]     host=_random_host_from_dc_4(api, DC_NAME),
00:18:22.093 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 106, in _random_host_from_dc_4
00:18:22.093 [basic_suit_el7]     return random.choice(_hosts_in_dc_4(api, dc_name))
00:18:22.093 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 100, in _hosts_in_dc_4
00:18:22.093 [basic_suit_el7]     raise RuntimeError('Could not find hosts that are up in DC %s' % dc_name)
00:18:22.093 [basic_suit_el7] RuntimeError: Could not find hosts that are up in DC test-dc
00:18:22.094 [basic_suit_el7] Error while running thread
00:18:22.094 [basic_suit_el7] Traceback (most recent call last):
00:18:22.094 [basic_suit_el7]   File "/usr/lib/python2.7/site-packages/lago/utils.py", line 57, in _ret_via_queue
00:18:22.094 [basic_suit_el7]     queue.put({'return': func()})
00:18:22.094 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 587, in add_templates_storage_domain
00:18:22.094 [basic_suit_el7]     add_generic_nfs_storage_domain(prefix, SD_TEMPLATES_NAME, SD_TEMPLATES_HOST_NAME, SD_TEMPLATES_PATH, sd_format='v1', sd_type='export', nfs_version='v4_1')
00:18:22.094 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 441, in add_generic_nfs_storage_domain
00:18:22.094 [basic_suit_el7]     add_generic_nfs_storage_domain_4(prefix, sd_nfs_name, nfs_host_name, mount_path, sd_format, sd_type, nfs_version)
00:18:22.094 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 490, in add_generic_nfs_storage_domain_4
00:18:22.095 [basic_suit_el7]     host=_random_host_from_dc_4(api, DC_NAME),
00:18:22.095 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 106, in _random_host_from_dc_4
00:18:22.095 [basic_suit_el7]     return random.choice(_hosts_in_dc_4(api, dc_name))
00:18:22.095 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 100, in _hosts_in_dc_4
00:18:22.095 [basic_suit_el7]     raise RuntimeError('Could not find hosts that are up in DC %s' % dc_name)
00:18:22.095 [basic_suit_el7] RuntimeError: Could not find hosts that are up in DC test-dc
00:18:22.095 [basic_suit_el7] Error while running thread
00:18:22.095 [basic_suit_el7] Traceback (most recent call last):
00:18:22.096 [basic_suit_el7]   File "/usr/lib/python2.7/site-packages/lago/utils.py", line 57, in _ret_via_queue
00:18:22.096 [basic_suit_el7]     queue.put({'return': func()})
00:18:22.096 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 436, in add_second_nfs_storage_domain
00:18:22.096 [basic_suit_el7]     SD_NFS_HOST_NAME, SD_SECOND_NFS_PATH)
00:18:22.096 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 441, in add_generic_nfs_storage_domain
00:18:22.096 [basic_suit_el7]     add_generic_nfs_storage_domain_4(prefix, sd_nfs_name, nfs_host_name, mount_path, sd_format, sd_type, nfs_version)
00:18:22.096 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 490, in add_generic_nfs_storage_domain_4
00:18:22.096 [basic_suit_el7]     host=_random_host_from_dc_4(api, DC_NAME),
00:18:22.096 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 106, in _random_host_from_dc_4
00:18:22.097 [basic_suit_el7]     return random.choice(_hosts_in_dc_4(api, dc_name))
00:18:22.097 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 100, in _hosts_in_dc_4
00:18:22.097 [basic_suit_el7]     raise RuntimeError('Could not find hosts that are up in DC %s' % dc_name)
00:18:22.097 [basic_suit_el7] RuntimeError: Could not find hosts that are up in DC test-dc
00:18:22.097 [basic_suit_el7] Error while running thread
00:18:22.097 [basic_suit_el7] Traceback (most recent call last):
00:18:22.097 [basic_suit_el7]   File "/usr/lib/python2.7/site-packages/lago/utils.py", line 57, in _ret_via_queue
00:18:22.098 [basic_suit_el7]     queue.put({'return': func()})
00:18:22.098 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 803, in import_template_from_glance
00:18:22.098 [basic_suit_el7]     generic_import_from_glance(api, image_name=CIRROS_IMAGE_NAME, image_ext='_glance_template', as_template=True)
00:18:22.098 [basic_suit_el7]   File "/home/jenkins/workspace/test-repo_ovirt_experimental_master/ovirt-system-tests/basic-suite-master/test-scenarios/002_bootstrap.py", line 637, in generic_import_from_glance
00:18:22.098 [basic_suit_el7]     target_image.import_image(import_action)
00:18:22.098 [basic_suit_el7]   File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", line 26017, in import_image
00:18:22.098 [basic_suit_el7]     headers={"Correlation-Id":correlation_id}
00:18:22.098 [basic_suit_el7]   File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 122, in request
00:18:22.098 [basic_suit_el7]     persistent_auth=self.__persistent_auth
00:18:22.099 [basic_suit_el7]   File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 79, in do_request
00:18:22.099 [basic_suit_el7]     persistent_auth)
00:18:22.099 [basic_suit_el7]   File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 162, in __do_request
00:18:22.099 [basic_suit_el7]     raise errors.RequestError(response_code, response_reason, response_body)
00:18:22.099 [basic_suit_el7] RequestError: 
00:18:22.099 [basic_suit_el7] status: 400
00:18:22.099 [basic_suit_el7] reason: Bad Request
00:18:22.099 [basic_suit_el7] detail: Cannot import Virtual Disk: Storage Domain cannot be accessed.
00:18:22.099 [basic_suit_el7] -Please check that at least one Host is operational and Data Center state is up.

--

SANDRO BONAZZOLA

ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA ENG VIRTUALIZATION R&D

Red Hat EMEA