3:23 a.m.
Hello!
Updated host engine to version 4.4.2. I am trying to add a new host and I get the Host
node2.kvm.test.s1.eirc installation failed error. Failed to execute Ansible host-deploy
role: Internal server error. Please check logs for more details:
/var/log/ovirt-engine/ansible-runner-service.log.
Also updated Hosted Engine to version 4.4.3.3-1.el8, I get the same error.
Only old entries are in the logs. New does not appear
[root@admin ovirt-engine]# tail /var/log/ovirt-engine/ansible-runner-service.log
2020-09-22 18:02:13,943 - runner_service.controllers.jobs - INFO - 127.0.0.1 - GET
/api/v1/jobs/8e369e4c-fce4-11ea-b893-00163e4843d7/events
2020-09-22 18:02:13,943 - runner_service.controllers.jobs - INFO - 127.0.0.1 - GET
/api/v1/jobs/8e3cba7a-fce4-11ea-b893-00163e4843d7/events
2020-09-22 18:02:13,944 - runner_service.services.jobs - DEBUG - Job events for play
8e369e4c-fce4-11ea-b893-00163e4843d7: 25
2020-09-22 18:02:13,944 - runner_service.services.jobs - DEBUG - Job events for play
8e3cba7a-fce4-11ea-b893-00163e4843d7: 25
2020-09-22 18:02:13,944 - runner_service.services.jobs - DEBUG - Active filter is :{}
2020-09-22 18:02:13,944 - runner_service.services.jobs - DEBUG - Active filter is :{}
2020-09-22 18:02:13,948 - runner_service.controllers.jobs - DEBUG - Request received,
content-type :None
2020-09-22 18:02:13,949 - runner_service.controllers.jobs - INFO - 127.0.0.1 - GET
/api/v1/jobs/8e369e4c-fce4-11ea-b893-00163e4843d7/events
2020-09-22 18:02:13,949 - runner_service.services.jobs - DEBUG - Job events for play
8e369e4c-fce4-11ea-b893-00163e4843d7: 25
2020-09-22 18:02:13,949 - runner_service.services.jobs - DEBUG - Active filter is :{}
In file /var/log/ovirt-engine/engine.log
2020-09-24 10:36:36,645+03 INFO [org.ovirt.engine.core.bll.hostdeploy.AddVdsCommand]
(default task-23) [de214fcc-31fc-464c-8ac1-6e111889cd20] Running command: AddVdsCommand
internal: false. Entities affected : ID: 8e827912-a0ef-11ea-826c-00163e4843d7 Type:
ClusterAction group CREATE_HOST with role type ADMIN
2020-09-24 10:36:36,666+03 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default
task-23) [7b77f4da] Before acquiring and wait lock
'EngineLock:{exclusiveLocks='[8e7c3f2a-a0ef-11ea-971b-00163e4843d7=REGISTER_VDS]',
sharedLocks=''}'
2020-09-24 10:36:36,666+03 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default
task-23) [7b77f4da] Lock-wait acquired to object
'EngineLock:{exclusiveLocks='[8e7c3f2a-a0ef-11ea-971b-00163e4843d7=REGISTER_VDS]',
sharedLocks=''}'
2020-09-24 10:36:36,667+03 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default
task-23) [7b77f4da] Running command: AddVdsSpmIdCommand internal: true. Entities affected
: ID: 3a5cbd19-82b7-41ce-870b-5b65184934c9 Type: VDS
2020-09-24 10:36:36,674+03 INFO [org.ovirt.engine.core.bll.AddVdsSpmIdCommand] (default
task-23) [7b77f4da] Lock freed to object
'EngineLock:{exclusiveLocks='[8e7c3f2a-a0ef-11ea-971b-00163e4843d7=REGISTER_VDS]',
sharedLocks=''}'
2020-09-24 10:36:36,678+03 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand]
(default task-23) [7b77f4da] START, RemoveVdsVDSCommand(HostName = node2.kvm.test.s1.eirc,
RemoveVdsVDSCommandParameters:{hostId='3a5cbd19-82b7-41ce-870b-5b65184934c9'}),
log id: 7b990f6d
2020-09-24 10:36:36,678+03 INFO [org.ovirt.engine.core.vdsbroker.RemoveVdsVDSCommand]
(default task-23) [7b77f4da] FINISH, RemoveVdsVDSCommand, return: , log id: 7b990f6d
2020-09-24 10:36:36,680+03 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand]
(default task-23) [7b77f4da] START, AddVdsVDSCommand(HostName = node2.kvm.test.s1.eirc,
AddVdsVDSCommandParameters:{hostId='3a5cbd19-82b7-41ce-870b-5b65184934c9'}), log
id: 20f7b449
2020-09-24 10:36:36,682+03 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand]
(default task-23) [7b77f4da] AddVds - entered , starting logic to add VDS
'3a5cbd19-82b7-41ce-870b-5b65184934c9'
2020-09-24 10:36:36,684+03 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand]
(default task-23) [7b77f4da] AddVds - VDS '3a5cbd19-82b7-41ce-870b-5b65184934c9'
was added, will try to add it to the resource manager
2020-09-24 10:36:36,684+03 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (default
task-23) [7b77f4da] Entered VdsManager constructor
2020-09-24 10:36:36,693+03 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (default
task-23) [7b77f4da] Initialize vdsBroker 'node2.kvm.test.s1.eirc:54321'
2020-09-24 10:36:36,783+03 INFO [org.ovirt.engine.core.vdsbroker.ResourceManager]
(default task-23) [7b77f4da] VDS '3a5cbd19-82b7-41ce-870b-5b65184934c9' was added
to the Resource Manager
2020-09-24 10:36:36,783+03 INFO [org.ovirt.engine.core.vdsbroker.AddVdsVDSCommand]
(default task-23) [7b77f4da] FINISH, AddVdsVDSCommand, return: , log id: 20f7b449
2020-09-24 10:36:36,790+03 WARN
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-23)
[7b77f4da] EVENT_ID: VDS_ALERT_FENCE_IS_NOT_CONFIGURED(9,000), Failed to verify Power
Management configuration for Host node2.kvm.test.s1.eirc.
2020-09-24 10:36:36,805+03 INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (default task-23)
[7b77f4da] EVENT_ID: USER_ADD_VDS(42), Host node2.kvm.test.s1.eirc was added by
admin@internal-authz.
2020-09-24 10:36:36,824+03 INFO
[org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand]
(EE-ManagedThreadFactory-engine-Thread-1271) [5459582a] Lock Acquired to object
'EngineLock:{exclusiveLocks='[3a5cbd19-82b7-41ce-870b-5b65184934c9=VDS]',
sharedLocks=''}'
2020-09-24 10:36:36,830+03 INFO
[org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand]
(EE-ManagedThreadFactory-engine-Thread-1271) [5459582a] Running command:
InstallVdsInternalCommand internal: true. Entities affected : ID:
3a5cbd19-82b7-41ce-870b-5b65184934c9 Type: VDS
2020-09-24 10:36:36,830+03 INFO
[org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand]
(EE-ManagedThreadFactory-engine-Thread-1271) [5459582a] Before Installation host
3a5cbd19-82b7-41ce-870b-5b65184934c9, node2.kvm.test.s1.eirc
2020-09-24 10:36:36,832+03 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-1271) [5459582a] START,
SetVdsStatusVDSCommand(HostName = node2.kvm.test.s1.eirc,
SetVdsStatusVDSCommandParameters:{hostId='3a5cbd19-82b7-41ce-870b-5b65184934c9',
status='Installing', nonOperationalReason='NONE',
stopSpmFailureLogged='false', maintenanceReason='null'}), log id:
2b846a38
2020-09-24 10:36:36,835+03 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-1271) [5459582a] FINISH, SetVdsStatusVDSCommand,
return: , log id: 2b846a38
2020-09-24 10:36:36,842+03 INFO
[org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand]
(EE-ManagedThreadFactory-engine-Thread-1271) [5459582a] Opening ssh-copy-id session on
host node2.kvm.test.s1.eirc
2020-09-24 10:36:37,058+03 INFO
[org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand]
(EE-ManagedThreadFactory-engine-Thread-1271) [5459582a] Executing ssh-copy-id command on
host node2.kvm.test.s1.eirc
2020-09-24 10:36:37,969+03 INFO
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engine-Thread-1271) [5459582a] EVENT_ID:
VDS_ANSIBLE_INSTALL_STARTED(560), Ansible host-deploy playbook execution has started on
host node2.kvm.test.s1.eirc.
2020-09-24 10:36:37,986+03 ERROR
[org.ovirt.engine.core.common.utils.ansible.AnsibleExecutor]
(EE-ManagedThreadFactory-engine-Thread-1271) [5459582a] Exception: Internal server error
2020-09-24 10:36:37,987+03 ERROR
[org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand]
(EE-ManagedThreadFactory-engine-Thread-1271) [5459582a] Host installation failed for host
'3a5cbd19-82b7-41ce-870b-5b65184934c9', 'node2.kvm.test.s1.eirc': Failed
to execute Ansible host-deploy role: Internal server error. Please check logs for more
details: /var/log/ovirt-engine/ansible-runner-service.log
2020-09-24 10:36:37,989+03 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-1271) [5459582a] START,
SetVdsStatusVDSCommand(HostName = node2.kvm.test.s1.eirc,
SetVdsStatusVDSCommandParameters:{hostId='3a5cbd19-82b7-41ce-870b-5b65184934c9',
status='InstallFailed', nonOperationalReason='NONE',
stopSpmFailureLogged='false', maintenanceReason='null'}), log id:
3f5bca62
2020-09-24 10:36:37,994+03 INFO [org.ovirt.engine.core.vdsbroker.SetVdsStatusVDSCommand]
(EE-ManagedThreadFactory-engine-Thread-1271) [5459582a] FINISH, SetVdsStatusVDSCommand,
return: , log id: 3f5bca62
2020-09-24 10:36:37,997+03 ERROR
[org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector]
(EE-ManagedThreadFactory-engine-Thread-1271) [5459582a] EVENT_ID: VDS_INSTALL_FAILED(505),
Host node2.kvm.test.s1.eirc installation failed. Failed to execute Ansible host-deploy
role: Internal server error. Please check logs for more details:
/var/log/ovirt-engine/ansible-runner-service.log.
2020-09-24 10:36:38,001+03 INFO
[org.ovirt.engine.core.bll.hostdeploy.InstallVdsInternalCommand]
(EE-ManagedThreadFactory-engine-Thread-1271) [5459582a] Lock freed to object
'EngineLock:{exclusiveLocks='[3a5cbd19-82b7-41ce-870b-5b65184934c9=VDS]',
sharedLocks=''}'
P.S. Sorry. This is google translate..