July 2018 - Infra - oVirt List Archives

[JIRA] (OVIRT-2383) collect server side logs for ost vm's
by Dafna Ron (oVirt JIRA) 31 Jul '18

31 Jul '18

Dafna Ron created OVIRT-2383: -------------------------------- Summary: collect server side logs for ost vm's Key: OVIRT-2383 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2383 Project: oVirt - virtualization made easy Issue Type: Bug Reporter: Dafna Ron Assignee: infra as part of trying to improve the collection of logs during an ost failure, we would like to collect server side information (from CI node) on job's failures. These are the common things that I think we need and would help in debugging: 1. libvirt log 2. qemu vms log 3. running processes 4. top -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2348) 004_basic_sanity.test_gen test failed for ovirt-master in vdsm project
by Dafna Ron (oVirt JIRA) 31 Jul '18

31 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2348?page=com.atlassian.jira.… ] Dafna Ron updated OVIRT-2348: ----------------------------- Resolution: Fixed Status: Done (was: To Do) > 004_basic_sanity.test_gen test failed for ovirt-master in vdsm project > ----------------------------------------------------------------------- > > Key: OVIRT-2348 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2348 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Priority: High > Labels: ost_code_regression, ost_failures > > The patch that CQ marked seems to be related. > [~fromani(a)redhat.com] the patch that failed CQ is: https://gerrit.ovirt.org/#/c/93046/ > you can look at the build's logs here: > https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8725/artifac… > the engine log shows several tasks that fail and then there is an exception: > https://pastebin.com/6f5QTZUH -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2348) 004_basic_sanity.test_gen test failed for ovirt-master in vdsm project
by Dafna Ron (oVirt JIRA) 31 Jul '18

31 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2348?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2348: ---------------------------------- this no longer happens and can be resolved. > 004_basic_sanity.test_gen test failed for ovirt-master in vdsm project > ----------------------------------------------------------------------- > > Key: OVIRT-2348 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2348 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Priority: High > Labels: ost_code_regression, ost_failures > > The patch that CQ marked seems to be related. > [~fromani(a)redhat.com] the patch that failed CQ is: https://gerrit.ovirt.org/#/c/93046/ > you can look at the build's logs here: > https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8725/artifac… > the engine log shows several tasks that fail and then there is an exception: > https://pastebin.com/6f5QTZUH -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2363) 008_basic_ui_sanity.start_grid failure with error "[Errno 2] No such file or directory"
by Dafna Ron (oVirt JIRA) 31 Jul '18

31 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2363?page=com.atlassian.jira.… ] Dafna Ron updated OVIRT-2363: ----------------------------- Resolution: Fixed Status: Done (was: To Do) > 008_basic_ui_sanity.start_grid failure with error "[Errno 2] No such file or directory" > --------------------------------------------------------------------------------------- > > Key: OVIRT-2363 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2363 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Priority: Highest > Labels: ost_failures > > patch that failed is: https://gerrit.ovirt.org/#/c/92882/ - core: hotplug new disk only if VM is up or paused states > I don't think the patch causes a regression but I am looking at the logs and checking to see if there was a behavior change which caused the ost test itself to fail. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2363) 008_basic_ui_sanity.start_grid failure with error "[Errno 2] No such file or directory"
by Dafna Ron (oVirt JIRA) 31 Jul '18

31 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2363?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2363: ---------------------------------- I do not see this issue any longer. I am moving this to resolved, > 008_basic_ui_sanity.start_grid failure with error "[Errno 2] No such file or directory" > --------------------------------------------------------------------------------------- > > Key: OVIRT-2363 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2363 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Priority: Highest > Labels: ost_failures > > patch that failed is: https://gerrit.ovirt.org/#/c/92882/ - core: hotplug new disk only if VM is up or paused states > I don't think the patch causes a regression but I am looking at the logs and checking to see if there was a behavior change which caused the ost test itself to fail. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2376) regression masked by local function setting __name__
by Dafna Ron (oVirt JIRA) 31 Jul '18

31 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2376?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2376: ---------------------------------- This ticket is for lago code so that we check the _name_ usage and make sure it does not mask other tests. this is not a CI infra related issue. > regression masked by local function setting __name__ > ----------------------------------------------------- > > Key: OVIRT-2376 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2376 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Priority: High > Labels: ost_failures, ost_infra, ost_lago > > we had two different cases where a regression was masked by issues caused when setting __name__ as local function. > see: > Jira: https://ovirt-jira.atlassian.net/browse/OVIRT-2348 > Jira: https://ovirt-jira.atlassian.net/browse/OVIRT-2375 -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[oVirt Jenkins] ovirt-system-tests_hc-basic-suite-master - Build # 620 - Failure!
by jenkins＠jenkins.phx.ovirt.org 31 Jul '18

31 Jul '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_hc-basic-suite-master/620/ Build Number: 620 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #620 [Gal Ben Haim] Adjust "list_glance_images" error message ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 004_basic_sanity.add_disk Error Message: status: 500 reason: Internal Server Error detail: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> <html><head> <title>500 Internal Server Error</title> </head><body> <h1>Internal Server Error</h1> <p>The server encountered an internal error or misconfiguration and was unable to complete your request.</p> <p>Please contact the server administrator at root@localhost to inform them of the time this error occurred, and the actions you performed just before this error.</p> <p>More information about this error may be available in the server error log.</p> </body></html> -------------------- >> begin captured logging << -------------------- ovirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7ff28da42e60> Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/004_basic_sanity.py", line 122, in <lambda> api.vms.get(VM0_NAME).disks.get(DISK0_NAME).status.state == 'ok' File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", line 35733, in get headers={"All-Content":all_content} File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 46, in get return self.request(method='GET', url=url, headers=headers, cls=cls) File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 122, in request persistent_auth=self.__persistent_auth File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 79, in do_request persistent_auth) File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 162, in __do_request raise errors.RequestError(response_code, response_reason, response_body) RequestError: status: 500 reason: Internal Server Error detail: <!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN"> <html><head> <title>500 Internal Server Error</title> </head><body> <h1>Internal Server Error</h1> <p>The server encountered an internal error or misconfiguration and was unable to complete your request.</p> <p>Please contact the server administrator at root@localhost to inform them of the time this error occurred, and the actions you performed just before this error.</p> <p>More information about this error may be available in the server error log.</p> </body></html> --------------------- >> end captured logging << --------------------- Stack Trace: File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 68, in wrapper return func(prefix.virt_env.engine_vm().get_api(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/004_basic_sanity.py", line 121, in add_disk lambda: File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 267, in assert_true_within_short assert_equals_within_short(func, True, allowed_exceptions) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 251, in assert_equals_within_short func, value, SHORT_TIMEOUT, allowed_exceptions=allowed_exceptions File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within res = func() File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/004_basic_sanity.py", line 122, in <lambda> api.vms.get(VM0_NAME).disks.get(DISK0_NAME).status.state == 'ok' File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", line 35733, in get headers={"All-Content":all_content} File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 46, in get return self.request(method='GET', url=url, headers=headers, cls=cls) File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 122, in request persistent_auth=self.__persistent_auth File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 79, in do_request persistent_auth) File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 162, in __do_request raise errors.RequestError(response_code, response_reason, response_body) '\r\nstatus: 500\r\nreason: Internal Server Error\r\ndetail: \n<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n root@localhost to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR: * Unhandled exception in <function <lambda> at 0x7ff28da42e60>\nTraceback (most recent call last):\n File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within\n res = func()\n File "/home/jenkins/workspace/ovirt-system-tests_hc-basic-suite-master/ovirt-system-tests/hc-basic-suite-master/test-scenarios/004_basic_sanity.py", line 122, in <lambda>\n api.vms.get(VM0_NAME).disks.get(DISK0_NAME).status.state == \'ok\'\n File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/brokers.py", line 35733, in get\n headers={"All-Content":all_content}\n File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 46, in get\n return self.request(method=\'GET\', url=url, headers=headers, cls=cls)\n File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/proxy.py", line 122, in request\n persistent_auth=self.__persistent_auth\n File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 79, in do_request\n persistent_auth)\n File "/usr/lib/python2.7/site-packages/ovirtsdk/infrastructure/connectionspool.py", line 162, in __do_request\n raise errors.RequestError(response_code, response_reason, response_body)\nRequestError: \r\nstatus: 500\r\nreason: Internal Server Error\r\ndetail: \n<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n root@localhost to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n\n--------------------- >> end captured logging << ---------------------'

1 1

[JIRA] (OVIRT-2359) Set environment variable in jenkins user's env to inidicate it's a container
by Daniel Belenky (oVirt JIRA) 31 Jul '18

31 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2359?page=com.atlassian.jira.… ] Daniel Belenky reassigned OVIRT-2359: ------------------------------------- Assignee: Daniel Belenky (was: infra) > Set environment variable in jenkins user's env to inidicate it's a container > ---------------------------------------------------------------------------- > > Key: OVIRT-2359 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2359 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Daniel Belenky > Assignee: Daniel Belenky > > We need to set a variable under the jenkins user that will indicate we're running inside a container. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2382) Refactor global_setup and slave_cleanup to have different setup/cleanup flows for container slaves
by Daniel Belenky (oVirt JIRA) 31 Jul '18

31 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2382?page=com.atlassian.jira.… ] Daniel Belenky reassigned OVIRT-2382: ------------------------------------- Assignee: Daniel Belenky (was: infra) > Refactor global_setup and slave_cleanup to have different setup/cleanup flows for container slaves > -------------------------------------------------------------------------------------------------- > > Key: OVIRT-2382 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2382 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Daniel Belenky > Assignee: Daniel Belenky > > Since setup/cleanup in a container can end up being very different than for VM/BM, it's better to have different main functions instead of skipping inside individual configuration functions. > So for example, the current main will become main_native and we'll also have main_container while main will just switch between the two. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0

[JIRA] (OVIRT-2382) Refactor global_setup and slave_cleanup to have different setup/cleanup flows for container slaves
by Daniel Belenky (oVirt JIRA) 31 Jul '18

31 Jul '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2382?page=com.atlassian.jira.… ] Daniel Belenky updated OVIRT-2382: ---------------------------------- Epic Link: OVIRT-2326 > Refactor global_setup and slave_cleanup to have different setup/cleanup flows for container slaves > -------------------------------------------------------------------------------------------------- > > Key: OVIRT-2382 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2382 > Project: oVirt - virtualization made easy > Issue Type: Task > Reporter: Daniel Belenky > Assignee: infra > > Since setup/cleanup in a container can end up being very different than for VM/BM, it's better to have different main functions instead of skipping inside individual configuration functions. > So for example, the current main will become main_native and we'll also have main_container while main will just switch between the two. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100090)

1 0