Re: [ovirt-devel] Re: Container-based CI backend is now available for use

*Update #2: *We have now merged all the patches that deal with artifact and log collection. And have updated the documentation <https://ovirt-infra-docs.readthedocs.io/en/latest/CI/STDCI-Containers/ind... accordingly. The container-based backend should now be usable for the vast majority of the CI use cases. We do have some more features coming down the line geared towards more sophisticated use cases such as running OST suits and integrating with gating and change-queue flows. those Include: 1. Supporting the use of privileged containers What can I do to actually try this? I am failing because our container is

1. Invoking the container-based backed from the gating jobs 2. Generating and providing the `extra_sources` file 3. Runtime injection of YUM mirror URLs 4. Support for storing and using secret data such as password and auth tokens. I invite everyone to start moving workloads to the new system and enjoy the enhanced speed and reliability. On Sun, 15 Dec 2019 at 14:23, Barak Korren <bkorren(a)redhat.com&gt; wrote: > *Update: *We have now merged the automated cloning support feature, the > currently merged code should already be applicable for a wide range of uses > including running 'check-patch' workloads. > > On Thu, 12 Dec 2019 at 09:00, Barak Korren <bkorren(a)redhat.com&gt; wrote: > >> A little less then a month ago I sent an email to this list telling you >> all about ongoing work to create a new container-based backend for the >> oVirt CI system. >> >> I'm pleased to announce that we have managed to finally merged an >> initial set of patches implementing that backend yesterday, and it is now >> available for general use. >> >> *What? Were? How do I use it?* >> >> Documentation about how to use the new backend is now available in read >> the docs >> <https://ovirt-infra-docs.readthedocs.io/en/latest/CI/STDCI-Containers/ind... >> . >> >> *Wait! I needed it to do X which it doesn't!* >> >> For the time being the new backend lacks some features that some may >> consider to be essential, such as automated cloning of patch source code >> and build artifact collection. We already have implemented patches >> providing a substantial amount of additional functionality, and hopefully >> we will be able to merge them soon. Following is a list of those patches >> and the features they implement: >> >> 1. Automated source cloning support: >> - 104213 <https://gerrit.ovirt.org/104213>;: Implement STDCI DSL >> support for initContainers >> - 104590 <https://gerrit.ovirt.org/104590>;: STDCI DSL: Add the >> `decorate` option >> - 104668 <https://gerrit.ovirt.org/104668>;: Document source >> cloning extension for containers >> 2. Artifact collection support >> - 104690 <https://gerrit.ovirt.org/104690>;: Added NFS server >> container image >> - 104273 <https://gerrit.ovirt.org/104273>;: STDCI PODS: Unique >> UID for each job build's POD >> - 104756 <https://gerrit.ovirt.org/104756>;: pipeline-loader: >> refactor: separate podspec func >> - 104757 <https://gerrit.ovirt.org/104757>;: pipeline-loader: >> refactor: Use podspec struct def >> - 104766 <https://gerrit.ovirt.org/104766>;: STDCI PODs: Add >> artifact collection logic >> - 105522 <https://gerrit.ovirt.org/105522>;: Documented artifact >> collection in containers >> 3. Extended log collection >> - 104842 <https://gerrit.ovirt.org/104842>;: STDCI PODs: Add POD >> log collection >> - 105523 <https://gerrit.ovirt.org/105523>;: Documented log >> collection in containers >> 4. Privileged container support >> - 104786 <https://gerrit.ovirt.org/104786>;: STDCI DSL: Enable >> privileged containers >> 5. Support for using containers in gating jobs: >> - 104804 <https://gerrit.ovirt.org/104804>;: standard-stage: >> refactor: move DSL to a library >> - 104811 <https://gerrit.ovirt.org/104811>;: gate: Support getting >> suits from STDCI DSL >> 6. Providing the `extra_sources` file to OST suit containers: >> - 104843 <https://gerrit.ovirt.org/104843>;: stdci_runner: Create >> extra_sources for PODs >> 7. Support for mirror injection and upstream source cloning >> - 104917 <https://gerrit.ovirt.org/104917>;: Added a container >> with STDCI tools >> - 104918 <https://gerrit.ovirt.org/104918>;: decorate.py: Add >> script >> - 104989 <https://gerrit.ovirt.org/104989>;: STDCI DSL: Use >> `tools` container for `decorate` >> - 104994 <https://gerrit.ovirt.org/104994>;: stdci_runner: Inject >> mirrors in PODs >> >> >> As you can see, we have quite a big pile of reviews to do, as always, >> help is very welcome... >> >> Regards, >> Barak. >> >> -- >> Barak Korren >> RHV DevOps team , RHCE, RHCi >> Red Hat EMEA >> redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted >> > > > -- > Barak Korren > RHV DevOps team , RHCE, RHCi > Red Hat EMEA > redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted > -- Barak Korren RHV DevOps team , RHCE, RHCi Red Hat EMEA redhat.com | TRIED. TESTED. TRUSTED. | redhat.com/trusted _______________________________________________ Devel mailing list -- devel(a)ovirt.org To unsubscribe send an email to devel-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/site/privacy-policy/ oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/devel@ovirt.org/message/HYZVFWHYDNU...