[ovirt-devel] Moving F21 slaves offline / disabling failing F21 jenkins jobs

[Eyal Edri]

I disagree.

Let me explain what the purpose of CI is, in case it got lost in the noise of the recent failures.
CI is a validation system for PRODUCTION code (at least the jobs that test merged commits),
It is not a DEBUGGING system where you test if you code works or not and try out new untested systems,
Its purpose is to detect regressions in the code and alert developers when it happens.
The normal flow of CI is to be stable all the time and only fail on new regressions,
of course there are infra issues we try to solve all the time, so we don't need extra failures due to new untested system.

Recently unfortunately it has become more a testing/debugging system rather than production,
I think this should stop, since developers are loosing faith in the CI and will eventually ignore 
the failure (some probably are doing that already).

And now to the point in hand - fedora 21. 
I believe that a test should run on a new system only after it run successfully locally (or on a testing jenkins instance),
and approved by the maintainer it works - so i expect each pkg maintainer to test his code / packaging on f21 before deploying 
it to the production jenkins.

Infra team can help with providing test VMs if needed or help in running the code also, but until the code isn't fixed 
for running on the new OS locally, it shouldn't go on jenkins.

The infra team has very little resources in terms of people managing jenkins, and i believe that main focus
should be on making sure we don't break existing supported systems (like EL6/EL7/FC20) rather than chasing
developers to fix fc21 issues and on the way making a lot of noise on the CI.

Once a project has passed localy sanity for a new system, we'd be happy to enable it on CI.

I hope this clarifies the scope and purpose of jenkins in oVirt.

Eyal.




----- Original Message -----
> From: "Nir Soffer" <nsoffer at redhat.com>
> To: "Sandro Bonazzola" <sbonazzo at redhat.com>
> Cc: "infra" <infra at ovirt.org>, devel at ovirt.org
> Sent: Wednesday, November 26, 2014 5:09:58 PM
> Subject: Re: [ovirt-devel] Moving F21 slaves offline / disabling failing	F21	jenkins jobs
> 
> ----- Original Message -----
> > From: "Sandro Bonazzola" <sbonazzo at redhat.com>
> > To: devel at ovirt.org, "infra" <infra at ovirt.org>
> > Sent: Wednesday, November 26, 2014 4:56:23 PM
> > Subject: [ovirt-devel] Moving F21 slaves offline / disabling failing F21
> > 	jenkins jobs
> > 
> > Hi,
> > since Fedora 21 slaves are causing several failures on jobs that works fine
> > on other slaves and some Fedora 21 jobs like ovirt-engine and reports
> > build are known to fail on F21, we're going to disable them until the known
> > issues will be fixed.
> 
> We should not disable them - instead, we should move them out of the pool
> handling patches, so patches are not nacked because the host is running
> a broken fedora version.
> 
> But we would like to know if our tests work on latest fedora, so it would be
> nice
> to run a test for each patch merged into master on latest fedora.
> 
> We need to find issues now so they are resolved when next rhel version
> is ready - unlike the way we missed critical issues that we could find
> on fedora 19 but found only on rhel 7.
> 
> What do you think?
> 
> Nir
> _______________________________________________
> Devel mailing list
> Devel at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/devel
>