June 2018 - Infra - oVirt List Archives

[CQ]: 92195, 2 (ovirt-engine-metrics) failed "ovirt-master" system tests
by oVirt Jenkins 14 Jun '18

14 Jun '18

Change 92195,2 (ovirt-engine-metrics) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/92195/2 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8213/

1 0

[JIRA] (OVIRT-2201) [regression] STDCI v2 doesn't distinguish jobs for different branches
by Barak Korren (oVirt JIRA) 14 Jun '18

14 Jun '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2201?page=com.atlassian.jira.… ] Barak Korren commented on OVIRT-2201: ------------------------------------- Pasting IRC transcript of me trying to understand the user story behind this {code} <sbonazzo> bkorren: maybe there are better ways, but to me this is a regression that complicates my work experience and make me rethink about the switch to v2 <bkorren> sbonazzo, my point is, that v2 gave you certain ways to do things; but we shouldn't fixate on those, if we can examine the use case and figure out ways to deliver what you really need in a more convenient way <sbonazzo> bkorren: I need an end point in jenkins pointing me to latest successfull build per branch per project * ena has quit (Ping timeout: 622 seconds) <bkorren> sbonazzo, must it be in jenkins? if I put it in resources for example? <bkorren> sbonazzo, does it need to be the build with logs , etc, or just the artifacts? <sbonazzo> bkorren: resources may be ok too. artifacts only may be ok too, including yum repodata directory <sbonazzo> bkorren: but that will make difficult to correlate the artifact to the job <bkorren> sbonazzo, another question - will an HTML page with links be enough, or would you need predictable URLs? <bkorren> sbonazzo, that begs the question about why do you need to correlate the artifact with the job? is the job just a way to get at the patch? or do you need the build logs? <sbonazzo> bkorren: predictable urls would work far better for me. about correlation, it may be needed in the only case latest successful build results older than the packages in testing, requiring an inspection on what happened <bkorren> sbonazzo, I wonder about the root cause for all these requirements, is there a certain work process here we can revisit and modify so it becomes less labor intensive and requires less data gathering and manual correlation? <bkorren> sbonazzo, in other words - is there a way to "short-circuit" these requirements and make a system that will just deliver the end result you need instead of parts you need to gather manually? <sbonazzo> bkorren: there are cases when you merge a patch and the build keeps hanging in change queue for months before landing to tested due to some reason. I want to be aware of this happening in a shorter loop so i want to check that latest build lands in tested within the day. <sbonazzo> bkorren: I also would like to be able to have a quick look to a page (up to now it was a jenkins view) showing me that master was failing while 4.2 was fine and not the other way around <bkorren> sbonazzo, again if the point is to know what landed in 'tested' when - I'll just find one or more ways to deliver that exact info back to gerrit. <bkorren> sbonazzo, when you say 'master failing' here you mean builds for master branch of a certain project, if patches from master branch of said project are passing CQ/OST or if 'ovirt master' is OK from an OST POV? <sbonazzo> bkorren: a master jenkins job failing for a certain project. not sure you can see it, but have a look at: https://jenkins.ovirt.org/user/sbonazzo/my-views/view/Failing%20by%20releas… <bkorren> sbonazzo, what is the purpose of gathering this information? I see a whole mix of things - check patch mixed with build artifats and with check merged... <sbonazzo> bkorren: getting an insight on what's failing per target <sbonazzo> bkorren: since we are not gating the builds on check-merged I need to know if we built something which is not passing check-merged <bkorren> sbonazzo, adding gatting on check-merged to CQ would be quite a low hanging fruit from me if it means you can spend less time monitoring things manually... <bkorren> sbonazzo, I gate on build-artifacts already, actually now that I think of it - v2 already gives me that... <sbonazzo> bkorren: gating will help indeed :-) not sure how RDO managed to do it on their automation, but I really like zuul <bkorren> sbonazzo, I liked zool, until I fugure how rigid was it <bkorren> sbonazzo, but I think we're talking about different things - there is pre-merge gating and post-merge gating <bkorren> sbonazzo, pre-merge gating is VERY expensive to accomplish, and while CQ was designed with that in mind - I don't think its likely we'll go there at this point; but is we say that what you want to know is that a package or a patch that reached 'testing' had passed check-merged, then as I said, we already do that in V2. * sbonazzo is now known as sbonazzo|mtg <bkorren> sbonazzo, the issue with zuul is that it just assumes infinite hardware or very cheap tests... <sbonazzo|mtg> bkorren: so all v2 built packages landing in tested are certified passing check-merged? <bkorren> sbonazzo|mtg, yes. this is a side-effect of both check-merged and build-artifacts running within the same job as opposed to different jobs; I'm surprised this did not occur to me or I would've listed it as a benefit somewhere... :) <sbonazzo|mtg> bkorren: :-D {code} > [regression] STDCI v2 doesn't distinguish jobs for different branches > --------------------------------------------------------------------- > > Key: OVIRT-2201 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2201 > Project: oVirt - virtualization made easy > Issue Type: By-EMAIL > Reporter: sbonazzo > Assignee: infra > > In V1 we had jobs with different name based on branches they were building. > In V2 we have single job building all branches. > As an example for imgbased: > https://jenkins.ovirt.org/job/imgbased_standard-on-merge/lastSuccessfulBuil… > will contain randomly 4.2 or master builds. > This won't allow to filter jenkins to see which branches are failing to > build, forcing developers to check manually. > This also won't allow to check if latest build landed in tested repo > because thee build may be targeted to a different branch than the one under > check. > To me this is a regression that will make me rethink about the switching to > v2 and considering reverting to v1. > -- > SANDRO BONAZZOLA > ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV > Red Hat EMEA <https://www.redhat.com/> > sbonazzo(a)redhat.com > <https://red.ht/sig> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100087)

1 0

[JIRA] (OVIRT-2201) [regression] STDCI v2 doesn't distinguish jobs for different branches
by sbonazzo (oVirt JIRA) 14 Jun '18

14 Jun '18

sbonazzo created OVIRT-2201: ------------------------------- Summary: [regression] STDCI v2 doesn't distinguish jobs for different branches Key: OVIRT-2201 URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2201 Project: oVirt - virtualization made easy Issue Type: By-EMAIL Reporter: sbonazzo Assignee: infra In V1 we had jobs with different name based on branches they were building. In V2 we have single job building all branches. As an example for imgbased: https://jenkins.ovirt.org/job/imgbased_standard-on-merge/lastSuccessfulBuil… will contain randomly 4.2 or master builds. This won't allow to filter jenkins to see which branches are failing to build, forcing developers to check manually. This also won't allow to check if latest build landed in tested repo because thee build may be targeted to a different branch than the one under check. To me this is a regression that will make me rethink about the switching to v2 and considering reverting to v1. -- SANDRO BONAZZOLA ASSOCIATE MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV Red Hat EMEA <https://www.redhat.com/> sbonazzo(a)redhat.com <https://red.ht/sig> -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100087)

1 0

[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-master - Build # 68 - Failure!
by jenkins＠jenkins.phx.ovirt.org 14 Jun '18

14 Jun '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-master/68/ Build Number: 68 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- Changes for Build #68 [Gal Ben Haim] 4.2: Backport tests from master [Barak Korren] Fix mock_cleanup.sh trying to umount bad things [Barak Korren] Switch fabric-ovirt to STDCI v2 ----------------- Failed Tests: ----------------- 1 tests failed. FAILED: 002_bootstrap.add_he_hosts Error Message: Adding HE hosts requires API v4. Stack Trace: Traceback (most recent call last): File "/usr/lib64/python2.7/unittest/case.py", line 369, in run testMethod() File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest self.test(*self.arg) File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test test() File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper return func(get_test_prefix(), *args, **kwargs) File "/home/jenkins/workspace/ovirt-system-tests_he-node-ng-suite-master/ovirt-system-tests/he-node-ng-suite-master/test-scenarios/002_bootstrap.py", line 360, in add_he_hosts raise RuntimeError('Adding HE hosts requires API v4.') RuntimeError: Adding HE hosts requires API v4.

1 32

[JIRA] (OVIRT-2055) failure in suspend resume vm not related to reported change - need to investigate
by Dafna Ron (oVirt JIRA) 14 Jun '18

14 Jun '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2055?page=com.atlassian.jira.… ] Dafna Ron commented on OVIRT-2055: ---------------------------------- I have another build that failed. https://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8204/ I can see that vdsm log on node1 reports: 2018-06-14 00:39:22,368-0400 WARN (qgapoller/0) [virt.periodic.VmDispatcher] could not run <function <lambda> at 0x7fbd68314f50> on ['1c0ed9a0-3430-45fa-8b1e-dd535356e620'] (periodic:289) I am not seeing an actual issue and I will ask someone from virt team look at the logs. > failure in suspend resume vm not related to reported change - need to investigate > --------------------------------------------------------------------------------- > > Key: OVIRT-2055 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2055 > Project: oVirt - virtualization made easy > Issue Type: Bug > Reporter: Dafna Ron > Assignee: infra > Labels: ost_failures, ost_race > > Change 91507,1 (ovirt-engine-sdk-java) is probably the reason behind recent > system test failures in the "ovirt-master" change queue and needs to be fixed. > This change had been removed from the testing queue. Artifacts build from this > change will not be released until it is fixed. > For further details about the change see: > https://gerrit.ovirt.org/#/c/91507/1 > For failed test results see: > http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/7721/ > I think the issue is on qemu/libvirt changed queries: > https://pastebin.com/afyeUAcT > https://pastebin.com/va20Y5Hp > checking his with vdsm people. -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100087)

1 0

Planned restart of production services
by Evgheni Dereveanchin 14 Jun '18

14 Jun '18

Hi everyone, I will be restarting several production systems within the next few hours to perform planned maintenance. The following services will be unreachable for some period of time: - gerrit.ovirt.org - code review - jenkins.ovirt.org - CI master It will not be possible to submit/review patches, clone repositories or run CI jobs during this period. I will announce you once the maintenance is complete. -- Regards, Evgheni Dereveanchin

1 2

[JIRA] (OVIRT-2200) OST network-suite-4.2 does not run in check-patch
by Barak Korren (oVirt JIRA) 14 Jun '18

14 Jun '18

[ https://ovirt-jira.atlassian.net/browse/OVIRT-2200?page=com.atlassian.jira.… ] Barak Korren updated OVIRT-2200: -------------------------------- Component/s: usrc.py > OST network-suite-4.2 does not run in check-patch > ------------------------------------------------- > > Key: OVIRT-2200 > URL: https://ovirt-jira.atlassian.net/browse/OVIRT-2200 > Project: oVirt - virtualization made easy > Issue Type: Bug > Components: STDCI DSL, usrc.py > Reporter: Eitan Raviv > Assignee: infra > > Following my conversation with Barak, we found that when a patch is > pushed to OST/network-suite-master, there are tests results only for > network-suite-master on check-patch job, although it is expected that > network-suite-4.2 would be run as well. > See for example: > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/1208/ > https://jenkins.ovirt.org/job/ovirt-system-tests_standard-check-patch/1173/ > Can you guys please fix? > Thanks > Eitan -- This message was sent by Atlassian Jira (v1001.0.0-SNAPSHOT#100087)

1 0

[CQ]: 01a6c0f (ovirt-ansible-v2v-conversion-host) failed "ovirt-master" system tests
by oVirt Jenkins 14 Jun '18

14 Jun '18

Change 01a6c0f (ovirt-ansible-v2v-conversion-host) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://github.com/oVirt/ovirt-ansible-v2v-conversion-host/commit/01a6c0f54… For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8209/

1 0

[CQ]: 92238, 1 (ovirt-engine-dashboard) failed "ovirt-master" system tests
by oVirt Jenkins 14 Jun '18

14 Jun '18

Change 92238,1 (ovirt-engine-dashboard) is probably the reason behind recent system test failures in the "ovirt-master" change queue and needs to be fixed. This change had been removed from the testing queue. Artifacts build from this change will not be released until it is fixed. For further details about the change see: https://gerrit.ovirt.org/#/c/92238/1 For failed test results see: http://jenkins.ovirt.org/job/ovirt-master_change-queue-tester/8208/

1 0

[oVirt Jenkins] ovirt-system-tests_he-node-ng-suite-4.2 - Build # 1 - Failure!
by jenkins＠jenkins.phx.ovirt.org 14 Jun '18

14 Jun '18

Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/ Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-node-ng-suite-4.2/1/ Build Number: 1 Build Status: Failure Triggered By: Started by timer ------------------------------------- Changes Since Last Success: ------------------------------------- ----------------- Failed Tests: ----------------- No tests ran.

1 33