I tried to run ovirt-system-tests_manual job for testing some new centos builds and I've the feeling it doesn't work.

In http://jenkins.ovirt.org/job/ovirt-system-tests_manual/2650/

I added custom repo:  https://cbs.centos.org/repos/virt7-ovirt-common-testing/x86_64/os/ which contains ansible 2.5.2 but I can't see it installed on the hosts and engine, I see only 2.5.1 installed.

In http://jenkins.ovirt.org/job/ovirt-system-tests_manual/2651/

I added custom build: http://cbs.centos.org/koji/buildinfo?buildID=22569

which contains openvswitch  2.9.0-4. Looks like it has been installed on the engine but not on the hosts. maybe network suite doesn't use it, but looks weird.

in http://jenkins.ovirt.org/job/ovirt-system-tests_manual/2652/

I added custom repos:

for testing new qemu-kvm-ev 2.10 and CentOS 7.5 beta

but looks like qemu-kvm-ev 2.9 is used instead.

Am I doing it wrong or is the manual job broken?

--