We have a strange behavior adding the second host:

According to http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-master/286/artifact/exported-artifacts/test_logs/he-basic-ansible-suite-master/post-002_bootstrap.py/lago-he-basic-ansible-suite-master-engine/_var_log/ovirt-engine/host-deploy/ovirt-host-deploy-20180522023532-lago-he-basic-ansible-suite-master-host-1-4b5a8bc0.log

It failed with "RuntimeError: Cannot resolve ovirt_hosted_engine_ha module"

Which comes from here:
https://github.com/oVirt/ovirt-host-deploy/blob/master/src/plugins/ovirt-host-common/hosted-engine/configureha.py#L111

but according to
http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-master/286/artifact/exported-artifacts/test_logs/he-basic-ansible-suite-master/post-002_bootstrap.py/lago-he-basic-ansible-suite-master-host-1/_var_log/yum.log

ovirt-hosted-engine-ha-2.3.0-0.0.master.20180423095028.20180423095024.git308874a.el7.centos.noarch was correctly installed on that host

I'll try to reproduce.

On Tue, May 22, 2018 at 12:36 AM, <jenkins@jenkins.phx.ovirt.org> wrote:
Project: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-master/
Build: http://jenkins.ovirt.org/job/ovirt-system-tests_he-basic-ansible-suite-master/285/
Build Number: 285
Build Status:  Still Failing
Triggered By: Started by timer

-------------------------------------
Changes Since Last Success:
-------------------------------------
Changes for Build #284
[Sandro Bonazzola] repos: adding cockpit-machines-ovirt

[Evgheni Dereveanchin] Verify Jenkins user settings from global_setup


Changes for Build #285
[Sandro Bonazzola] repos: adding cockpit-machines-ovirt




-----------------
Failed Tests:
-----------------
1 tests failed.
FAILED:  002_bootstrap.add_he_hosts

Error Message:
Host lago-he-basic-ansible-suite-master-host-1 installation failed
-------------------- >> begin captured logging << --------------------
ovirtlago.testlib: ERROR:     * Unhandled exception in <function _he_host_is_up_4 at 0x7f043411c050>
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within
    res = func()
  File "/home/jenkins/workspace/ovirt-system-tests_he-basic-ansible-suite-master/ovirt-system-tests/he-basic-ansible-suite-master/test-scenarios/002_bootstrap.py", line 391, in _he_host_is_up_4
    raise RuntimeError('Host %s installation failed' % api_host.name)
RuntimeError: Host lago-he-basic-ansible-suite-master-host-1 installation failed
--------------------- >> end captured logging << ---------------------

Stack Trace:
  File "/usr/lib64/python2.7/unittest/case.py", line 369, in run
    testMethod()
  File "/usr/lib/python2.7/site-packages/nose/case.py", line 197, in runTest
    self.test(*self.arg)
  File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 129, in wrapped_test
    test()
  File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 59, in wrapper
    return func(get_test_prefix(), *args, **kwargs)
  File "/home/jenkins/workspace/ovirt-system-tests_he-basic-ansible-suite-master/ovirt-system-tests/he-basic-ansible-suite-master/test-scenarios/002_bootstrap.py", line 358, in add_he_hosts
    add_he_hosts_4(prefix)
  File "/home/jenkins/workspace/ovirt-system-tests_he-basic-ansible-suite-master/ovirt-system-tests/he-basic-ansible-suite-master/test-scenarios/002_bootstrap.py", line 404, in add_he_hosts_4
    testlib.assert_true_within(_he_host_is_up_4, timeout=15*60)
  File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 263, in assert_true_within
    assert_equals_within(func, True, timeout, allowed_exceptions)
  File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within
    res = func()
  File "/home/jenkins/workspace/ovirt-system-tests_he-basic-ansible-suite-master/ovirt-system-tests/he-basic-ansible-suite-master/test-scenarios/002_bootstrap.py", line 391, in _he_host_is_up_4
    raise RuntimeError('Host %s installation failed' % api_host.name)
'Host lago-he-basic-ansible-suite-master-host-1 installation failed\n-------------------- >> begin captured logging << --------------------\novirtlago.testlib: ERROR:     * Unhandled exception in <function _he_host_is_up_4 at 0x7f043411c050>\nTraceback (most recent call last):\n  File "/usr/lib/python2.7/site-packages/ovirtlago/testlib.py", line 219, in assert_equals_within\n    res = func()\n  File "/home/jenkins/workspace/ovirt-system-tests_he-basic-ansible-suite-master/ovirt-system-tests/he-basic-ansible-suite-master/test-scenarios/002_bootstrap.py", line 391, in _he_host_is_up_4\n    raise RuntimeError(\'Host %s installation failed\' % api_host.name)\nRuntimeError: Host lago-he-basic-ansible-suite-master-host-1 installation failed\n--------------------- >> end captured logging << ---------------------'