[oVirt Jenkins] ovirt-system-tests_performance-suite-master - Build
# 1540 - Failure!
by jenkins＠jenkins.phx.ovirt.org
Project: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/
Build: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master...
Build Number: 1540
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #1540
[Martin Necas] ansible: disable iscsi
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 040_add_hosts_vms.verify_add_hosts
Error Message:
1 hosts failed installation:
lago-performance-suite-master-host-1: install_failed
-------------------- >> begin captured logging << --------------------
ovirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7f585db998c0>
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within
res = func()
File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda>
lambda: _single_host_up(hosts_service, total_hosts)
File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up
_check_problematic_hosts(hosts_service)
File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts
raise RuntimeError(dump_hosts)
RuntimeError: 1 hosts failed installation:
lago-performance-suite-master-host-1: install_failed
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 298, in verify_add_hosts
verify_add_hosts_4(api)
File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in verify_add_hosts_4
lambda: _single_host_up(hosts_service, total_hosts)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 286, in assert_true_within_long
assert_equals_within_long(func, True, allowed_exceptions)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 273, in assert_equals_within_long
func, value, LONG_TIMEOUT, allowed_exceptions=allowed_exceptions
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within
res = func()
File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda>
lambda: _single_host_up(hosts_service, total_hosts)
File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up
_check_problematic_hosts(hosts_service)
File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts
raise RuntimeError(dump_hosts)
'1 hosts failed installation:\nlago-performance-suite-master-host-1: install_failed\n\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7f585db998c0>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 234, in assert_equals_within\n res = func()\n File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 306, in <lambda>\n lambda: _single_host_up(hosts_service, total_hosts)\n File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 197, in _single_host_up\n _check_problematic_hosts(hosts_service)\n File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/040_add_hosts_vms.py", line 206, in _check_problematic_hosts\n raise RuntimeError(dump_hosts)\nRuntimeError: 1 hosts failed installation:\nlago-performance-suite-master-host-1: install_failed\n\n--------------------- >> end captured logging << ---------------------'
3 years, 8 months
[VDSM] Trouble merging patch, related to jenkins whitelist or new
RHEL CI?
by Nir Soffer
I could not merge:
https://gerrit.ovirt.org/c/109402/
Although it was approved and verified, and got +1 from Continuous Integration.
There is a new "RHEL-Continuous-Integration", which does not run with
this change,
even when I trigger the tests manually with "ci test".
I tried to add +1 for "RHEL-Continuous-Integration" but this is not
possible, I see:
RHEL-Continuous-Integration You don't have permission to edit this label.
So finally I downloaded the patch and pushed it manually.
I think this patch will fix the problem:
https://gerrit.ovirt.org/#/c/110576/
But I need CI experts to review this. Since we have 50 projects that need this,
this probably should be fixed elsewhere, and inherited by all projects.
I know that Germano was not able to trigger tests because he was missing in the
jenkins whitelist, but this was fixed last week.
Germano, maybe just to check that everything works for you, you can post some
trivial patch?
Nir
3 years, 8 months
[oVirt Jenkins] ovirt-system-tests_basic-suite-master_nightly -
Build # 245 - Failure!
by jenkins＠jenkins.phx.ovirt.org
Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_nightly/
Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-master_night...
Build Number: 245
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #245
[Marcin Sobczyk] basic: ansible: Port '003_00_metrics_bootstrap_pytest.py' to ansible
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: basic-suite-master.test-scenarios.004_basic_sanity_pytest.test_suspend_resume_vm0
Error Message:
LagoSSHTimeoutException: Timed out (in 116 s) trying to ssh to 192.168.201.149
Stack Trace:
prefix = <ovirtlago.prefix.OvirtPrefix object at 0x7fdfcf775c10>
@order_by(_TEST_LIST)
def test_suspend_resume_vm0(prefix):
vm_host = _vm_host(prefix, VM0_NAME)
ret = vm_host.ssh(['tail', '-1', VDSM_LOG])
assert ret.code == EX_OK
log_items = ret.out.decode('utf-8').split()
global _log_time_before_suspend
_log_time_before_suspend = log_items[0] + ' ' + log_items[1] # date + time
> assert_vm0_is_alive(prefix)
../basic-suite-master/test-scenarios/004_basic_sanity_pytest.py:1210:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
../basic-suite-master/test-scenarios/004_basic_sanity_pytest.py:191: in assert_vm0_is_alive
assert_vm_is_alive(prefix, VM0_NAME)
../basic-suite-master/test-scenarios/004_basic_sanity_pytest.py:199: in assert_vm_is_alive
assert _vm_ssh(prefix, vm_hostname, ['true']).code == EX_OK
../basic-suite-master/test-scenarios/004_basic_sanity_pytest.py:186: in _vm_ssh
tries=tries,
/usr/lib/python2.7/site-packages/lago/ssh.py:46: in ssh
password=password,
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
ip_addr = '192.168.201.149', ssh_key = None, host_name = '192.168.201.149'
ssh_tries = 0, propagate_fail = True, username = 'cirros', password = 'gocubsgo'
def get_ssh_client(
ip_addr,
ssh_key=None,
host_name=None,
ssh_tries=None,
propagate_fail=True,
username='root',
password='123456',
):
"""
Get a connected SSH client
Args:
ip_addr(str): IP address of the endpoint
ssh_key(str or list of str): Path to a file which
contains the private key
hotname(str): The hostname of the endpoint
ssh_tries(int): The number of attempts to connect to the endpoint
propagate_fail(bool): If set to true, this event will be in the log
and fail the outer stage. Otherwise, it will be discarded.
username(str): The username to authenticate with
password(str): Used for password authentication
or for private key decryption
Raises:
:exc:`~LagoSSHTimeoutException`: If the client failed to connect after
"ssh_tries"
"""
host_name = host_name or ip_addr
with LogTask(
'Get ssh client for %s' % host_name,
level='debug',
propagate_fail=propagate_fail,
):
ssh_timeout = int(config.get('ssh_timeout'))
if ssh_tries is None:
ssh_tries = int(config.get('ssh_tries', 10))
start_time = time.time()
client = paramiko.SSHClient()
client.set_missing_host_key_policy(paramiko.AutoAddPolicy(), )
while ssh_tries > 0:
try:
client.connect(
ip_addr,
username=username,
password=password,
key_filename=ssh_key,
timeout=ssh_timeout,
)
break
except (socket.error, socket.timeout) as err:
LOGGER.debug(
'Socket error connecting to %s: %s',
host_name,
err,
)
except paramiko.ssh_exception.SSHException as err:
LOGGER.debug(
'SSH error connecting to %s: %s',
host_name,
err,
)
except EOFError as err:
LOGGER.debug('EOFError connecting to %s: %s', host_name, err)
ssh_tries -= 1
LOGGER.debug(
'Still got %d tries for %s',
ssh_tries,
host_name,
)
time.sleep(1)
else:
end_time = time.time()
raise LagoSSHTimeoutException(
'Timed out (in %d s) trying to ssh to %s' %
> (end_time - start_time, host_name)
)
E LagoSSHTimeoutException: Timed out (in 116 s) trying to ssh to 192.168.201.149
/usr/lib/python2.7/site-packages/lago/ssh.py:388: LagoSSHTimeoutException
3 years, 8 months
[oVirt Jenkins] ovirt-system-tests_basic-suite-4.3_nightly - Build
# 246 - Failure!
by jenkins＠jenkins.phx.ovirt.org
Project: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/
Build: https://jenkins.ovirt.org/job/ovirt-system-tests_basic-suite-4.3_nightly/...
Build Number: 246
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #246
[Marcin Sobczyk] basic: ansible: Port '003_00_metrics_bootstrap_pytest.py' to ansible
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 008_basic_ui_sanity.initialize_chrome
Error Message:
Message: Error forwarding the new session Empty pool of VM for setup Capabilities {browserName: chrome, platform: LINUX, version: 64.0.3282.140}
Stacktrace:
at org.openqa.grid.web.servlet.handler.RequestHandler.process (RequestHandler.java:117)
at org.openqa.grid.web.servlet.DriverServlet.process (DriverServlet.java:84)
at org.openqa.grid.web.servlet.DriverServlet.doPost (DriverServlet.java:68)
at javax.servlet.http.HttpServlet.service (HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service (HttpServlet.java:790)
at org.seleniumhq.jetty9.servlet.ServletHolder.handle (ServletHolder.java:860)
at org.seleniumhq.jetty9.servlet.ServletHandler.doHandle (ServletHandler.java:535)
at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)
at org.seleniumhq.jetty9.server.session.SessionHandler.doHandle (SessionHandler.java:1595)
at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)
at org.seleniumhq.jetty9.server.handler.ContextHandler.doHandle (ContextHandler.java:1253)
at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:168)
at org.seleniumhq.jetty9.servlet.ServletHandler.doScope (ServletHandler.java:473)
at org.seleniumhq.jetty9.server.session.SessionHandler.doScope (SessionHandler.java:1564)
at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:166)
at org.seleniumhq.jetty9.server.handler.ContextHandler.doScope (ContextHandler.java:1155)
at org.seleniumhq.jetty9.server.handler.ScopedHandler.handle (ScopedHandler.java:141)
at org.seleniumhq.jetty9.server.handler.HandlerWrapper.handle (HandlerWrapper.java:132)
at org.seleniumhq.jetty9.server.Server.handle (Server.java:530)
at org.seleniumhq.jetty9.server.HttpChannel.handle (HttpChannel.java:347)
at org.seleniumhq.jetty9.server.HttpConnection.onFillable (HttpConnection.java:256)
at org.seleniumhq.jetty9.io.AbstractConnection$ReadCallback.succeeded (AbstractConnection.java:279)
at org.seleniumhq.jetty9.io.FillInterest.fillable (FillInterest.java:102)
at org.seleniumhq.jetty9.io.ChannelEndPoint$2.run (ChannelEndPoint.java:124)
at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.doProduce (EatWhatYouKill.java:247)
at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.produce (EatWhatYouKill.java:140)
at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.run (EatWhatYouKill.java:131)
at org.seleniumhq.jetty9.util.thread.ReservedThreadExecutor$ReservedThread.run (ReservedThreadExecutor.java:382)
at org.seleniumhq.jetty9.util.thread.QueuedThreadPool.runJob (QueuedThreadPool.java:708)
at org.seleniumhq.jetty9.util.thread.QueuedThreadPool$2.run (QueuedThreadPool.java:626)
at java.lang.Thread.run (Thread.java:748)
-------------------- >> begin captured stdout << ---------------------
_init_browser, connecting to hub at http://172.18.0.2:4444/wd/hub
Message: Error forwarding the new session Empty pool of VM for setup Capabilities {browserName: chrome, platform: LINUX, version: 64.0.3282.140}
Stacktrace:
at org.openqa.grid.web.servlet.handler.RequestHandler.process (RequestHandler.java:117)
at org.openqa.grid.web.servlet.DriverServlet.process (DriverServlet.java:84)
at org.openqa.grid.web.servlet.DriverServlet.doPost (DriverServlet.java:68)
at javax.servlet.http.HttpServlet.service (HttpServlet.java:707)
at javax.servlet.http.HttpServlet.service (HttpServlet.java:790)
at org.seleniumhq.jetty9.servlet.ServletHolder.handle (ServletHolder.java:860)
at org.seleniumhq.jetty9.servlet.ServletHandler.doHandle (ServletHandler.java:535)
at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)
at org.seleniumhq.jetty9.server.session.SessionHandler.doHandle (SessionHandler.java:1595)
at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)
at org.seleniumhq.jetty9.server.handler.ContextHandler.doHandle (ContextHandler.java:1253)
at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:168)
at org.seleniumhq.jetty9.servlet.ServletHandler.doScope (ServletHandler.java:473)
at org.seleniumhq.jetty9.server.session.SessionHandler.doScope (SessionHandler.java:1564)
at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:166)
at org.seleniumhq.jetty9.server.handler.ContextHandler.doScope (ContextHandler.java:1155)
at org.seleniumhq.jetty9.server.handler.ScopedHandler.handle (ScopedHandler.java:141)
at org.seleniumhq.jetty9.server.handler.HandlerWrapper.handle (HandlerWrapper.java:132)
at org.seleniumhq.jetty9.server.Server.handle (Server.java:530)
at org.seleniumhq.jetty9.server.HttpChannel.handle (HttpChannel.java:347)
at org.seleniumhq.jetty9.server.HttpConnection.onFillable (HttpConnection.java:256)
at org.seleniumhq.jetty9.io.AbstractConnection$ReadCallback.succeeded (AbstractConnection.java:279)
at org.seleniumhq.jetty9.io.FillInterest.fillable (FillInterest.java:102)
at org.seleniumhq.jetty9.io.ChannelEndPoint$2.run (ChannelEndPoint.java:124)
at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.doProduce (EatWhatYouKill.java:247)
at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.produce (EatWhatYouKill.java:140)
at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.run (EatWhatYouKill.java:131)
at org.seleniumhq.jetty9.util.thread.ReservedThreadExecutor$ReservedThread.run (ReservedThreadExecutor.java:382)
at org.seleniumhq.jetty9.util.thread.QueuedThreadPool.runJob (QueuedThreadPool.java:708)
at org.seleniumhq.jetty9.util.thread.QueuedThreadPool$2.run (QueuedThreadPool.java:626)
at java.lang.Thread.run (Thread.java:748)
WebDriverException in _init_browser connecting to hub
--------------------- >> end captured stdout << ----------------------
-------------------- >> begin captured logging << --------------------
selenium.webdriver.remote.remote_connection: DEBUG: POST http://172.18.0.2:4444/wd/hub/session {"capabilities": {"alwaysMatch": {"browserName": "chrome", "platformName": "linux", "browserVersion": "64.0.3282.140"}, "firstMatch": [{}]}, "desiredCapabilities": {"platform": "LINUX", "browserName": "chrome", "version": "64.0.3282.140"}}
urllib3.connectionpool: DEBUG: Starting new HTTP connection (1): 172.18.0.2:4444
urllib3.connectionpool: DEBUG: http://172.18.0.2:4444 "POST /wd/hub/session HTTP/1.1" 500 7806
selenium.webdriver.remote.remote_connection: DEBUG: Finished Request
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test
test()
File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/008_basic_ui_sanity.py", line 223, in initialize_chrome
_init_driver(_get_chrome_capabilities())
File "/home/jenkins/agent/workspace/ovirt-system-tests_basic-suite-4.3_nightly/ovirt-system-tests/basic-suite-4.3/test-scenarios/008_basic_ui_sanity.py", line 249, in _init_driver
raise e
'Message: Error forwarding the new session Empty pool of VM for setup Capabilities {browserName: chrome, platform: LINUX, version: 64.0.3282.140}\nStacktrace:\n at org.openqa.grid.web.servlet.handler.RequestHandler.process (RequestHandler.java:117)\n at org.openqa.grid.web.servlet.DriverServlet.process (DriverServlet.java:84)\n at org.openqa.grid.web.servlet.DriverServlet.doPost (DriverServlet.java:68)\n at javax.servlet.http.HttpServlet.service (HttpServlet.java:707)\n at javax.servlet.http.HttpServlet.service (HttpServlet.java:790)\n at org.seleniumhq.jetty9.servlet.ServletHolder.handle (ServletHolder.java:860)\n at org.seleniumhq.jetty9.servlet.ServletHandler.doHandle (ServletHandler.java:535)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)\n at org.seleniumhq.jetty9.server.session.SessionHandler.doHandle (SessionHandler.java:1595)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)\n at org.seleniumhq.jetty9.server.handler.ContextHandler.doHandle (ContextHandler.java:1253)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:168)\n at org.seleniumhq.jetty9.servlet.ServletHandler.doScope (ServletHandler.java:473)\n at org.seleniumhq.jetty9.server.session.SessionHandler.doScope (SessionHandler.java:1564)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:166)\n at org.seleniumhq.jetty9.server.handler.ContextHandler.doScope (ContextHandler.java:1155)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.handle (ScopedHandler.java:141)\n at org.seleniumhq.jetty9.server.handler.HandlerWrapper.handle (HandlerWrapper.java:132)\n at org.seleniumhq.jetty9.server.Server.handle (Server.java:530)\n at org.seleniumhq.jetty9.server.HttpChannel.handle (HttpChannel.java:347)\n at org.seleniumhq.jetty9.server.HttpConnection.onFillable (HttpConnection.java:256)\n at org.seleniumhq.jetty9.io.AbstractConnection$ReadCallback.succeeded (AbstractConnection.java:279)\n at org.seleniumhq.jetty9.io.FillInterest.fillable (FillInterest.java:102)\n at org.seleniumhq.jetty9.io.ChannelEndPoint$2.run (ChannelEndPoint.java:124)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.doProduce (EatWhatYouKill.java:247)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.produce (EatWhatYouKill.java:140)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.run (EatWhatYouKill.java:131)\n at org.seleniumhq.jetty9.util.thread.ReservedThreadExecutor$ReservedThread.run (ReservedThreadExecutor.java:382)\n at org.seleniumhq.jetty9.util.thread.QueuedThreadPool.runJob (QueuedThreadPool.java:708)\n at org.seleniumhq.jetty9.util.thread.QueuedThreadPool$2.run (QueuedThreadPool.java:626)\n at java.lang.Thread.run (Thread.java:748)\n-------------------- >> begin captured stdout << ---------------------\n_init_browser, connecting to hub at http://172.18.0.2:4444/wd/hub\nMessage: Error forwarding the new session Empty pool of VM for setup Capabilities {browserName: chrome, platform: LINUX, version: 64.0.3282.140}\nStacktrace:\n at org.openqa.grid.web.servlet.handler.RequestHandler.process (RequestHandler.java:117)\n at org.openqa.grid.web.servlet.DriverServlet.process (DriverServlet.java:84)\n at org.openqa.grid.web.servlet.DriverServlet.doPost (DriverServlet.java:68)\n at javax.servlet.http.HttpServlet.service (HttpServlet.java:707)\n at javax.servlet.http.HttpServlet.service (HttpServlet.java:790)\n at org.seleniumhq.jetty9.servlet.ServletHolder.handle (ServletHolder.java:860)\n at org.seleniumhq.jetty9.servlet.ServletHandler.doHandle (ServletHandler.java:535)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)\n at org.seleniumhq.jetty9.server.session.SessionHandler.doHandle (SessionHandler.java:1595)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextHandle (ScopedHandler.java:188)\n at org.seleniumhq.jetty9.server.handler.ContextHandler.doHandle (ContextHandler.java:1253)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:168)\n at org.seleniumhq.jetty9.servlet.ServletHandler.doScope (ServletHandler.java:473)\n at org.seleniumhq.jetty9.server.session.SessionHandler.doScope (SessionHandler.java:1564)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.nextScope (ScopedHandler.java:166)\n at org.seleniumhq.jetty9.server.handler.ContextHandler.doScope (ContextHandler.java:1155)\n at org.seleniumhq.jetty9.server.handler.ScopedHandler.handle (ScopedHandler.java:141)\n at org.seleniumhq.jetty9.server.handler.HandlerWrapper.handle (HandlerWrapper.java:132)\n at org.seleniumhq.jetty9.server.Server.handle (Server.java:530)\n at org.seleniumhq.jetty9.server.HttpChannel.handle (HttpChannel.java:347)\n at org.seleniumhq.jetty9.server.HttpConnection.onFillable (HttpConnection.java:256)\n at org.seleniumhq.jetty9.io.AbstractConnection$ReadCallback.succeeded (AbstractConnection.java:279)\n at org.seleniumhq.jetty9.io.FillInterest.fillable (FillInterest.java:102)\n at org.seleniumhq.jetty9.io.ChannelEndPoint$2.run (ChannelEndPoint.java:124)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.doProduce (EatWhatYouKill.java:247)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.produce (EatWhatYouKill.java:140)\n at org.seleniumhq.jetty9.util.thread.strategy.EatWhatYouKill.run (EatWhatYouKill.java:131)\n at org.seleniumhq.jetty9.util.thread.ReservedThreadExecutor$ReservedThread.run (ReservedThreadExecutor.java:382)\n at org.seleniumhq.jetty9.util.thread.QueuedThreadPool.runJob (QueuedThreadPool.java:708)\n at org.seleniumhq.jetty9.util.thread.QueuedThreadPool$2.run (QueuedThreadPool.java:626)\n at java.lang.Thread.run (Thread.java:748)\nWebDriverException in _init_browser connecting to hub\n\n--------------------- >> end captured stdout << ----------------------\n-------------------- >> begin captured logging << --------------------\nselenium.webdriver.remote.remote_connection: DEBUG: POST http://172.18.0.2:4444/wd/hub/session {"capabilities": {"alwaysMatch": {"browserName": "chrome", "platformName": "linux", "browserVersion": "64.0.3282.140"}, "firstMatch": [{}]}, "desiredCapabilities": {"platform": "LINUX", "browserName": "chrome", "version": "64.0.3282.140"}}\nurllib3.connectionpool: DEBUG: Starting new HTTP connection (1): 172.18.0.2:4444\nurllib3.connectionpool: DEBUG: http://172.18.0.2:4444 "POST /wd/hub/session HTTP/1.1" 500 7806\nselenium.webdriver.remote.remote_connection: DEBUG: Finished Request\n--------------------- >> end captured logging << ---------------------'
3 years, 8 months
[oVirt Jenkins] ovirt-system-tests_performance-suite-master - Build
# 1536 - Failure!
by jenkins＠jenkins.phx.ovirt.org
Project: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master/
Build: https://jenkins.ovirt.org/job/ovirt-system-tests_performance-suite-master...
Build Number: 1536
Build Status: Failure
Triggered By: Started by timer
-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #1536
[Marcin Sobczyk] basic: ansible: Port '003_00_metrics_bootstrap_pytest.py' to ansible
-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED: 1000_analyze_postgresql.analyze_postgres
Error Message:
Failed to perform the postgres analysis. Exit code is 1
-------------------- >> begin captured logging << --------------------
lago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/../common/test-scenarios-files/analyze_postgresql.sh to lago-performance-suite-master-engine:/root: ?[0m?[0m
lago.ssh: DEBUG: start task:1c6ed586-2943-4d3c-841a-73107c9668bd:Get ssh client for lago-performance-suite-master-engine:
lago.ssh: DEBUG: end task:1c6ed586-2943-4d3c-841a-73107c9668bd:Get ssh client for lago-performance-suite-master-engine:
lago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/../common/test-scenarios-files/analyze_postgresql.sh to lago-performance-suite-master-engine:/root: ?[32mSuccess?[0m (in 0:00:00)
lago.ssh: DEBUG: start task:ede6f1b0-4462-4dde-a985-63e60a9deabc:Get ssh client for lago-performance-suite-master-engine:
lago.ssh: DEBUG: end task:ede6f1b0-4462-4dde-a985-63e60a9deabc:Get ssh client for lago-performance-suite-master-engine:
lago.ssh: DEBUG: Running 93da8eda on lago-performance-suite-master-engine: /root/analyze_postgresql.sh
lago.ssh: DEBUG: Command 93da8eda on lago-performance-suite-master-engine returned with 1
lago.ssh: DEBUG: Command 93da8eda on lago-performance-suite-master-engine output:
Last metadata expiration check: 0:11:09 ago on Fri 31 Jul 2020 10:59:32 PM EDT.
pgdg-redhat-repo-42.0-11.noarch.rpm 12 kB/s | 11 kB 00:00
Dependencies resolved.
================================================================================
Package Architecture Version Repository Size
================================================================================
Installing:
pgdg-redhat-repo noarch 42.0-11 @commandline 11 k
Transaction Summary
================================================================================
Install 1 Package
Total size: 11 k
Installed size: 11 k
Downloading Packages:
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
Preparing : 1/1
Installing : pgdg-redhat-repo-42.0-11.noarch 1/1
Verifying : pgdg-redhat-repo-42.0-11.noarch 1/1
Installed:
pgdg-redhat-repo-42.0-11.noarch
Complete!
PostgreSQL common RPMs for RHEL/CentOS 8 - x86_ 190 kB/s | 376 kB 00:01
PostgreSQL 12 for RHEL/CentOS 8 - x86_64 112 kB/s | 247 kB 00:02
PostgreSQL 11 for RHEL/CentOS 8 - x86_64 217 kB/s | 424 kB 00:01
PostgreSQL 10 for RHEL/CentOS 8 - x86_64 161 kB/s | 308 kB 00:01
PostgreSQL 9.6 for RHEL/CentOS 8 - x86_64 127 kB/s | 300 kB 00:02
PostgreSQL 9.5 for RHEL/CentOS 8 - x86_64 111 kB/s | 259 kB 00:02
Dependencies resolved.
================================================================================
Package Arch Version Repository Size
================================================================================
Installing:
pgbadger noarch 11.3-1.rhel8 pgdg-common 348 k
pgcluu noarch 3.1-2.rhel8 pgdg-common 356 k
Installing dependencies:
perl-Text-CSV_XS x86_64 1.40-1.el8 epel-el8 145 k
perl-UNIVERSAL-isa noarch 1.20171012-4.el8 epel-el8 24 k
Transaction Summary
================================================================================
Install 4 Packages
Total download size: 874 k
Installed size: 3.5 M
Downloading Packages:
(1/4): perl-Text-CSV_XS-1.40-1.el8.x86_64.rpm 1.4 MB/s | 145 kB 00:00
(2/4): perl-UNIVERSAL-isa-1.20171012-4.el8.noar 523 kB/s | 24 kB 00:00
(3/4): pgbadger-11.3-1.rhel8.noarch.rpm 252 kB/s | 348 kB 00:01
(4/4): pgcluu-3.1-2.rhel8.noarch.rpm 235 kB/s | 356 kB 00:01
--------------------------------------------------------------------------------
Total 561 kB/s | 874 kB 00:01
PostgreSQL common RPMs for RHEL/CentOS 8 - x86_ 1.6 MB/s | 1.7 kB 00:00
Key imported successfully
Extra Packages for Enterprise Linux 8 - x86_64 7.4 kB/s | 1.6 kB 00:00
Key imported successfully
Running transaction check
Transaction check succeeded.
Running transaction test
Transaction test succeeded.
Running transaction
Preparing : 1/1
Installing : perl-UNIVERSAL-isa-1.20171012-4.el8.noarch 1/4
Installing : perl-Text-CSV_XS-1.40-1.el8.x86_64 2/4
Installing : pgbadger-11.3-1.rhel8.noarch 3/4
Installing : pgcluu-3.1-2.rhel8.noarch 4/4
Running scriptlet: pgcluu-3.1-2.rhel8.noarch 4/4
Verifying : pgbadger-11.3-1.rhel8.noarch 1/4
Verifying : pgcluu-3.1-2.rhel8.noarch 2/4
Verifying : perl-Text-CSV_XS-1.40-1.el8.x86_64 3/4
Verifying : perl-UNIVERSAL-isa-1.20171012-4.el8.noarch 4/4
Installed:
perl-Text-CSV_XS-1.40-1.el8.x86_64 perl-UNIVERSAL-isa-1.20171012-4.el8.noarch
pgbadger-11.3-1.rhel8.noarch pgcluu-3.1-2.rhel8.noarch
Complete!
lago.ssh: DEBUG: Command 93da8eda on lago-performance-suite-master-engine errors:
+ pg_datadir=/var/lib/pgsql/data
+ pg_service=postgresql.service
+ pgdg=
+ scl_enable=
++ get_engine_pg_scl
++ engine_pg_scl_conf=(/etc/ovirt-engine/engine.conf.d/*scl-postgres*.conf)
++ local engine_pg_scl_conf
++ local res=
++ [[ -e /etc/ovirt-engine/engine.conf.d/*scl-postgres*.conf ]]
++ echo ''
+ engine_pg_scl=
+ [[ -n '' ]]
++ rpm -q postgresql
+ pgver=postgresql-12.1-2.module_el8.1.0+273+979c16e6.x86_64
+ case "${pgver}" in
+ pgdg=https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_6...
+ [[ -n https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/pgd... ]]
+ yum install -y https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/pgd...
+ yum install -y pgbadger pgcluu
warning: /var/cache/dnf/pgdg-common-38b6c5045045f841/packages/pgbadger-11.3-1.rhel8.noarch.rpm: Header V4 DSA/SHA1 Signature, key ID 442df0f8: NOKEY
Importing GPG key 0x442DF0F8:
Userid : "PostgreSQL RPM Building Project <pgsqlrpms-hackers(a)pgfoundry.org>"
Fingerprint: 68C9 E2B9 1A37 D136 FE74 D176 1F16 D2E1 442D F0F8
From : /etc/pki/rpm-gpg/RPM-GPG-KEY-PGDG
warning: /var/cache/dnf/epel-el8-fe1ce5303067b1fb/packages/perl-Text-CSV_XS-1.40-1.el8.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID 2f86d6a1: NOKEY
Importing GPG key 0x2F86D6A1:
Userid : "Fedora EPEL (8) <epel(a)fedoraproject.org>"
Fingerprint: 94E2 79EB 8D8F 25B2 1810 ADF1 21EA 45AB 2F86 D6A1
From : https://dl.fedoraproject.org/pub/epel/RPM-GPG-KEY-EPEL-8
++ su - postgres -c 'psql postgres postgres -t -c '\''show log_directory'\'''
++ sed 2d
+ pglogdir=' log'
+ pglogdir=log
+ cd /var/lib/pgsql/data/log/
++ su - postgres -c 'psql postgres postgres -t -c '\''show log_filename'\'''
++ sed 2d
+ pglog=' postgresql-%m.log'
++ date +postgresql-%m.log
+ pglog=postgresql-07.log
+ mkdir pgbadger
+ pgbadger -f stderr postgresql-07.log --outdir pgbadger
FATAL: logfile "postgresql-07.log" must exist!
- Error at line 2410
--------------------- >> end captured logging << ---------------------
Stack Trace:
File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
testMethod()
File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
self.test(*self.arg)
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 142, in wrapped_test
test()
File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 60, in wrapper
return func(get_test_prefix(), *args, **kwargs)
File "/home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/test-scenarios/1000_analyze_postgresql.py", line 52, in analyze_postgres
' Exit code is %s' % result.code
File "/usr/lib/python2.7/site-packages/nose/tools/trivial.py", line 29, in eq_
raise AssertionError(msg or "%r != %r" % (a, b))
'Failed to perform the postgres analysis. Exit code is 1\n-------------------- >> begin captured logging << --------------------\nlago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/../common/test-scenarios-files/analyze_postgresql.sh to lago-performance-suite-master-engine:/root: \x1b[0m\x1b[0m\nlago.ssh: DEBUG: start task:1c6ed586-2943-4d3c-841a-73107c9668bd:Get ssh client for lago-performance-suite-master-engine:\nlago.ssh: DEBUG: end task:1c6ed586-2943-4d3c-841a-73107c9668bd:Get ssh client for lago-performance-suite-master-engine:\nlago.plugins.vm: INFO: * Copy /home/jenkins/agent/workspace/ovirt-system-tests_performance-suite-master/ovirt-system-tests/performance-suite-master/../common/test-scenarios-files/analyze_postgresql.sh to lago-performance-suite-master-engine:/root: \x1b[32mSuccess\x1b[0m (in 0:00:00)\nlago.ssh: DEBUG: start task:ede6f1b0-4462-4dde-a985-63e60a9deabc:Get ssh client for lago-performance-suite-master-engine:\nlago.ssh: DEBUG: end task:ede6f1b0-4462-4dde-a985-63e60a9deabc:Get ssh client for lago-performance-suite-master-engine:\nlago.ssh: DEBUG: Running 93da8eda on lago-performance-suite-master-engine: /root/analyze_postgresql.sh\nlago.ssh: DEBUG: Command 93da8eda on lago-performance-suite-master-engine returned with 1\nlago.ssh: DEBUG: Command 93da8eda on lago-performance-suite-master-engine output:\n Last metadata expiration check: 0:11:09 ago on Fri 31 Jul 2020 10:59:32 PM EDT.\npgdg-redhat-repo-42.0-11.noarch.rpm 12 kB/s | 11 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling:\n pgdg-redhat-repo noarch 42.0-11 @commandline 11 k\n\nTransaction Summary\n================================================================================\nInstall 1 Package\n\nTotal size: 11 k\nInstalled size: 11 k\nDownloading Packages:\nRunning transaction check\nTransaction check succeeded.\nRunning transaction test\nTransaction test succeeded.\nRunning transaction\n Preparing : 1/1 \n Installing : pgdg-redhat-repo-42.0-11.noarch 1/1 \n Verifying : pgdg-redhat-repo-42.0-11.noarch 1/1 \n\nInstalled:\n pgdg-redhat-repo-42.0-11.noarch \n\nComplete!\nPostgreSQL common RPMs for RHEL/CentOS 8 - x86_ 190 kB/s | 376 kB 00:01 \nPostgreSQL 12 for RHEL/CentOS 8 - x86_64 112 kB/s | 247 kB 00:02 \nPostgreSQL 11 for RHEL/CentOS 8 - x86_64 217 kB/s | 424 kB 00:01 \nPostgreSQL 10 for RHEL/CentOS 8 - x86_64 161 kB/s | 308 kB 00:01 \nPostgreSQL 9.6 for RHEL/CentOS 8 - x86_64 127 kB/s | 300 kB 00:02 \nPostgreSQL 9.5 for RHEL/CentOS 8 - x86_64 111 kB/s | 259 kB 00:02 \nDependencies resolved.\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n pgbadger noarch 11.3-1.rhel8 pgdg-common 348 k\n pgcluu noarch 3.1-2.rhel8 pgdg-common 356 k\nInstalling dependencies:\n perl-Text-CSV_XS x86_64 1.40-1.el8 epel-el8 145 k\n perl-UNIVERSAL-isa noarch 1.20171012-4.el8 epel-el8 24 k\n\nTransaction Summary\n================================================================================\nInstall 4 Packages\n\nTotal download size: 874 k\nInstalled size: 3.5 M\nDownloading Packages:\n(1/4): perl-Text-CSV_XS-1.40-1.el8.x86_64.rpm 1.4 MB/s | 145 kB 00:00 \n(2/4): perl-UNIVERSAL-isa-1.20171012-4.el8.noar 523 kB/s | 24 kB 00:00 \n(3/4): pgbadger-11.3-1.rhel8.noarch.rpm 252 kB/s | 348 kB 00:01 \n(4/4): pgcluu-3.1-2.rhel8.noarch.rpm 235 kB/s | 356 kB 00:01 \n--------------------------------------------------------------------------------\nTotal 561 kB/s | 874 kB 00:01 \nPostgreSQL common RPMs for RHEL/CentOS 8 - x86_ 1.6 MB/s | 1.7 kB 00:00 \nKey imported successfully\nExtra Packages for Enterprise Linux 8 - x86_64 7.4 kB/s | 1.6 kB 00:00 \nKey imported successfully\nRunning transaction check\nTransaction check succeeded.\nRunning transaction test\nTransaction test succeeded.\nRunning transaction\n Preparing : 1/1 \n Installing : perl-UNIVERSAL-isa-1.20171012-4.el8.noarch 1/4 \n Installing : perl-Text-CSV_XS-1.40-1.el8.x86_64 2/4 \n Installing : pgbadger-11.3-1.rhel8.noarch 3/4 \n Installing : pgcluu-3.1-2.rhel8.noarch 4/4 \n Running scriptlet: pgcluu-3.1-2.rhel8.noarch 4/4 \n Verifying : pgbadger-11.3-1.rhel8.noarch 1/4 \n Verifying : pgcluu-3.1-2.rhel8.noarch 2/4 \n Verifying : perl-Text-CSV_XS-1.40-1.el8.x86_64 3/4 \n Verifying : perl-UNIVERSAL-isa-1.20171012-4.el8.noarch 4/4 \n\nInstalled:\n perl-Text-CSV_XS-1.40-1.el8.x86_64 perl-UNIVERSAL-isa-1.20171012-4.el8.noarch\n pgbadger-11.3-1.rhel8.noarch pgcluu-3.1-2.rhel8.noarch \n\nComplete!\n\nlago.ssh: DEBUG: Command 93da8eda on lago-performance-suite-master-engine errors:\n + pg_datadir=/var/lib/pgsql/data\n+ pg_service=postgresql.service\n+ pgdg=\n+ scl_enable=\n++ get_engine_pg_scl\n++ engine_pg_scl_conf=(/etc/ovirt-engine/engine.conf.d/*scl-postgres*.conf)\n++ local engine_pg_scl_conf\n++ local res=\n++ [[ -e /etc/ovirt-engine/engine.conf.d/*scl-postgres*.conf ]]\n++ echo \'\'\n+ engine_pg_scl=\n+ [[ -n \'\' ]]\n++ rpm -q postgresql\n+ pgver=postgresql-12.1-2.module_el8.1.0+273+979c16e6.x86_64\n+ case "${pgver}" in\n+ pgdg=https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_6... [[ -n https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/pgd... ]]\n+ yum install -y https://download.postgresql.org/pub/repos/yum/12/redhat/rhel-8-x86_64/pgd... yum install -y pgbadger pgcluu\nwarning: /var/cache/dnf/pgdg-common-38b6c5045045f841/packages/pgbadger-11.3-1.rhel8.noarch.rpm: Header V4 DSA/SHA1 Signature, key ID 442df0f8: NOKEY\nImporting GPG key 0x442DF0F8:\n Userid : "PostgreSQL RPM Building Project <pgsqlrpms-hackers(a)pgfoundry.org>"\n Fingerprint: 68C9 E2B9 1A37 D136 FE74 D176 1F16 D2E1 442D F0F8\n From : /etc/pki/rpm-gpg/RPM-GPG-KEY-PGDG\nwarning: /var/cache/dnf/epel-el8-fe1ce5303067b1fb/packages/perl-Text-CSV_XS-1.40-1.el8.x86_64.rpm: Header V3 RSA/SHA256 Signature, key ID 2f86d6a1: NOKEY\nImporting GPG key 0x2F86D6A1:\n Userid : "Fedora EPEL (8) <epel(a)fedoraproject.org>"\n Fingerprint: 94E2 79EB 8D8F 25B2 1810 ADF1 21EA 45AB 2F86 D6A1\n From : https://dl.fedoraproject.org/pub/epel/RPM-GPG-KEY-EPEL-8\n++ su - postgres -c \'psql postgres postgres -t -c \'\\\'\'show log_directory\'\\\'\'\'\n++ sed 2d\n+ pglogdir=\' log\'\n+ pglogdir=log\n+ cd /var/lib/pgsql/data/log/\n++ su - postgres -c \'psql postgres postgres -t -c \'\\\'\'show log_filename\'\\\'\'\'\n++ sed 2d\n+ pglog=\' postgresql-%m.log\'\n++ date +postgresql-%m.log\n+ pglog=postgresql-07.log\n+ mkdir pgbadger\n+ pgbadger -f stderr postgresql-07.log --outdir pgbadger\nFATAL: logfile "postgresql-07.log" must exist!\n - Error at line 2410\n\n--------------------- >> end captured logging << ---------------------'
3 years, 8 months