December 2018 - Infra - oVirt List Archives

[JIRA] (OVIRT-2326) Use containers to scale bare-metal slaves
by Eyal Edri (oVirt JIRA) 15 Dec '18

15 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2326?page=com.atlassian.jira.… ] Eyal Edri updated OVIRT-2326: ----------------------------- Resolution: Fixed Status: Done (was: To Do) all issues in the Epic are solved. > Use containers to scale bare-metal slaves > ----------------------------------------- > > Key: OVIRT-2326 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2326 > Project: oVirt - virtualization made easy > Issue Type: Epic > Reporter: Gal Ben Haim > Assignee: infra > Priority: Highest > > We want to run containers on the bare-metal hosts so we can use them for multiple tasks in parallel. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2402) ioprocess failed ovirt-master with 500 error from engine
by Eyal Edri (oVirt JIRA) 15 Dec '18

15 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2402?page=com.atlassian.jira.… ] Eyal Edri updated OVIRT-2402: ----------------------------- Resolution: Cannot Reproduce Status: Done (was: To Do) > ioprocess failed ovirt-master with 500 error from engine > -------------------------------------------------------- > > Key: OVIRT-2402 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2402 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_failures, ost_race > > 004_basic_sanity.run_vms failed with Internal Server Error from engine. > Looking at engine and server logs I actually do not see any issue with engine or the machine itself but there is a 500 reply to the API. > I think the issue is that the api got a 500 reply from engine but I am not seeing a reason why so this needs to be investigated further. > I am keeping build logs and will look at it later on > https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8971/ -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2425) ovirt-guest-agent missing in 4.2 tested / snapshot repo
by Eyal Edri (oVirt JIRA) 15 Dec '18

15 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2425?page=com.atlassian.jira.… ] Eyal Edri updated OVIRT-2425: ----------------------------- Resolution: Incomplete Status: Done (was: To Do) no reply, please reopen if this is still an issue. > ovirt-guest-agent missing in 4.2 tested / snapshot repo > ------------------------------------------------------- > > Key: OVIRT-2425 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2425 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: sbonazzo > Assignee: infra > > Hi, > ovirt-guest-agent*.rpm > are missing in > https://resources.ovirt.org/pub/ovirt-4.2-snapshot/rpm/el7/noarch/ and in > https://resources.ovirt.org/repos/ovirt/tested/4.2/rpm/el7/noarch/ > The build > https://jenkins.ovirt.org/job/ovirt-guest-agent_4.2_build-artifacts-el7-x86… > completed with success on Feb 6, 2018 and contains it. > can you please check why it's missing and get it published? > can you also please check why we have not been warned a package is missing > from our repos? > Thanks > -- > SANDRO BONAZZOLA > MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV > Red Hat EMEA <https://www.redhat.com/> > sbonazzo(a)redhat.com > <https://red.ht/sig> > <https://www.redhat.com/en/events/red-hat-open-source-day-italia?sc_cid=701f…> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2482) ovirt-node-ng on ovirt-master failure on test verify_suspend_resume_vm0
by Eyal Edri (oVirt JIRA) 15 Dec '18

15 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2482?page=com.atlassian.jira.… ] Eyal Edri updated OVIRT-2482: ----------------------------- Resolution: Cannot Reproduce Status: Done (was: To Do) > ovirt-node-ng on ovirt-master failure on test verify_suspend_resume_vm0 > ----------------------------------------------------------------------- > > Key: OVIRT-2482 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2482 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_failures, ost_race > > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10175/ > The change reported is not related to the failure. > I can see the failure is due to host0 responding with an invalid argument (which many just mean the host is not responding but seems like a reporting exception related to virt team) > https://pastebin.com/pm6x0W62 -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2498) Failing KubeVirt CI
by Eyal Edri (oVirt JIRA) 15 Dec '18

15 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2498?page=com.atlassian.jira.… ] Eyal Edri updated OVIRT-2498: ----------------------------- Resolution: Fixed Status: Done (was: To Do) > Failing KubeVirt CI > ------------------- > > Key: OVIRT-2498 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2498 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: CI client projects > Reporter: Petr Kotas > Assignee: infra > > Hi, > I am working on fixing the issues on the KubeVirt e2e test suites. This > task is directly related to unstable CI, due to unknown errors. > The progress is reported in the CNV trello: > https://trello.com/c/HNXcMEQu/161-epic-improve-ci > I am creating this issue since the KubeVirt experience random timeouts on > random tests most of the times when test suites run. > The issue from outside is showing as timeouts on difference part of tests. > Sometimes the tests fails in set up phase, again due to random timeout. > The example in the link bellow timed out for network connection on > localhost. > [check-patch.k8s-1.11.0-dev.el7.x86_64] > requests.exceptions.ReadTimeout: > UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. > (read timeout=60) > Example of failing test suites is here > https://jenkins.ovirt.org/job/kubevirt_kubevirt_standard-check-pr/1916/cons… > The list of errors related to the failing CI can be found in my notes > https://docs.google.com/document/d/1_ll1DOMHgCRHn_Df9i4uvtRFyMK-bDCHEeGfJFT… > I am not sure whether KubeVirt already shared the resource requirements, so > I provide short summary: > *Resources for KubeVirt e2e tests:* > - at least 12GB of RAM - we start 3 nodes (3 docker images) each require > 4GB of RAM > - exposed /dev/kvm to enable native virtualization > - cached images, since these are used to build the test cluster: > - kubevirtci/os-3.10.0-crio:latest > - kubevirtci/os-3.10.0-multus:latest > - kubevirtci/os-3.10.0:latest > - kubevirtci/k8s-1.10.4:latest > - kubevirtci/k8s-multus-1.11.1:latest > - kubevirtci/k8s-1.11.0:latest > How can we overcome this? Can we work together to build a suitable > requirements for running the tests so it passes each time? > Kind regards, > Petr Kotas -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2498) Failing KubeVirt CI
by Eyal Edri (oVirt JIRA) 15 Dec '18

15 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2498?page=com.atlassian.jira.… ] Eyal Edri commented on OVIRT-2498: ---------------------------------- [~pkotas] we've since then migrated the KubeVirt CI to run inside OpenShift, if you're still interested in the load / stats, reach out to [~ederevea] or [~gbenhaim(a)redhat.com] which are actively working on profiling and monitoring the infra and tests. > Failing KubeVirt CI > ------------------- > > Key: OVIRT-2498 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2498 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: CI client projects > Reporter: Petr Kotas > Assignee: infra > > Hi, > I am working on fixing the issues on the KubeVirt e2e test suites. This > task is directly related to unstable CI, due to unknown errors. > The progress is reported in the CNV trello: > https://trello.com/c/HNXcMEQu/161-epic-improve-ci > I am creating this issue since the KubeVirt experience random timeouts on > random tests most of the times when test suites run. > The issue from outside is showing as timeouts on difference part of tests. > Sometimes the tests fails in set up phase, again due to random timeout. > The example in the link bellow timed out for network connection on > localhost. > [check-patch.k8s-1.11.0-dev.el7.x86_64] > requests.exceptions.ReadTimeout: > UnixHTTPConnectionPool(host='localhost', port=None): Read timed out. > (read timeout=60) > Example of failing test suites is here > https://jenkins.ovirt.org/job/kubevirt_kubevirt_standard-check-pr/1916/cons… > The list of errors related to the failing CI can be found in my notes > https://docs.google.com/document/d/1_ll1DOMHgCRHn_Df9i4uvtRFyMK-bDCHEeGfJFT… > I am not sure whether KubeVirt already shared the resource requirements, so > I provide short summary: > *Resources for KubeVirt e2e tests:* > - at least 12GB of RAM - we start 3 nodes (3 docker images) each require > 4GB of RAM > - exposed /dev/kvm to enable native virtualization > - cached images, since these are used to build the test cluster: > - kubevirtci/os-3.10.0-crio:latest > - kubevirtci/os-3.10.0-multus:latest > - kubevirtci/os-3.10.0:latest > - kubevirtci/k8s-1.10.4:latest > - kubevirtci/k8s-multus-1.11.1:latest > - kubevirtci/k8s-1.11.0:latest > How can we overcome this? Can we work together to build a suitable > requirements for running the tests so it passes each time? > Kind regards, > Petr Kotas -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2478) CQ Master Failure - oVirt engine missing packages
by Eyal Edri (oVirt JIRA) 15 Dec '18

15 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2478?page=com.atlassian.jira.… ] Eyal Edri updated OVIRT-2478: ----------------------------- Resolution: Cannot Reproduce Status: Done (was: To Do) > CQ Master Failure - oVirt engine missing packages > ------------------------------------------------- > > Key: OVIRT-2478 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2478 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Ehud Yonasi > Assignee: infra > > There were failures in installing ovirt-engine for missing packages: > nimbus-jose-jwt > json-smart > Like this failure: > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/10113/console > I've sent a patch to fix that to ost: > https://gerrit.ovirt.org/#/c/94183/ -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2505) ovirt github organization
by Eyal Edri (oVirt JIRA) 15 Dec '18

15 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2505?page=com.atlassian.jira.… ] Eyal Edri commented on OVIRT-2505: ---------------------------------- Is this still needed? > ovirt github organization > ------------------------- > > Key: OVIRT-2505 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2505 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Ahmad Khiet > Assignee: infra > > Hi, > can you please add my github user to ovirt org > https://github.com/NaySoftware > Thanks, > Ahmad. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2506) Accessing logs is sometimes extremely slow even without blueocean
by Eyal Edri (oVirt JIRA) 15 Dec '18

15 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2506?page=com.atlassian.jira.… ] Eyal Edri updated OVIRT-2506: ----------------------------- Resolution: Cannot Reproduce Status: Done (was: To Do) We introduced various improvements for Jenkins master to handle this, also we found a memory leak in one of the blueoceans plugins which we're tracking a fix on GitHub for it. if you can reproduce the slowness please reopen once it happens so we'll be able to debug it on live system. > Accessing logs is sometimes extremely slow even without blueocean > ----------------------------------------------------------------- > > Key: OVIRT-2506 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2506 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Components: Jenkins Master > Reporter: Roman Mohr > Assignee: infra > > Hi, > With the switch from blueocean to the text-based build summary in > kubevirt/kubevirt, in general accessing works much better. Still > especially in the morning hours it can take a long time to access the > logs. > Can it be that the build summary and the logs are still served by > jenkins? If yes, would it help to copied out/cache/serve the build > logs via a dedicated webserver? > Best Regards, > Roman -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0

[JIRA] (OVIRT-2521) enable stdci v2 for ovirt-web-ui
by Eyal Edri (oVirt JIRA) 15 Dec '18

15 Dec '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2521?page=com.atlassian.jira.… ] Eyal Edri commented on OVIRT-2521: ---------------------------------- [~gshereme(a)redhat.com] was this done? any help is still needed? > enable stdci v2 for ovirt-web-ui > -------------------------------- > > Key: OVIRT-2521 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2521 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: Greg Sheremeta > Assignee: infra > > Hi, > I want to enable stdci v2 for ovirt-web-ui, to run alongside travis, so we > can easily make rpms from PRs. > I added automation.yaml [1] and updated standard_pipelines [2]. > 1 - is there anything else I need to do? > 2 - is there a way to configure this to be on-demand only? in other words, > only run when we invoke 'ci build please'? > 2a - if not, is there a way to make ovirt ci non-blocking since travis > would still be our source of truth? > [1] https://github.com/oVirt/ovirt-web-ui/pull/794 > [2] > https://gerrit.ovirt.org/#/c/94639/1/jobs/confs/projects/standard-pipelines… > -- > GREG SHEREMETA > SENIOR SOFTWARE ENGINEER - TEAM LEAD - RHV UX > Red Hat NA > <https://www.redhat.com/> > gshereme(a)redhat.com IRC: gshereme > <https://red.ht/sig> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100095)

1 0