[ovirt-devel] Re: splitting tests for stdci v2

Hi, I'm currently working on paralleling our stdci v2. I've already extracted 'linters' stage, more patches (and more substages) are on the way. This part i.e. : if git diff-tree --no-commit-id --name-only -r HEAD | egrep --quiet 'vdsm.spec.in|Makefile.am|automation' ; then ./automation/build-artifacts.sh" ... seems to be an excellent candidate for extraction to a separate substage. The question is - how should we proceed with tests? I can create substage for each of: tox -e "tests,{storage,lib,network,virt}" But the original 'check-patch' combined the coverage reports into one - we would lose that.

There is a possibility that we could work on something that gathers coverage data from multiple sources (tests, OST) as a completely separate jenkins job or smth, but that will be a bigger effort. What do you think about it? Marcin