On Wed, Jun 3, 2020 at 4:15 PM Yedidyah Bar David <didi(a)redhat.com> wrote:
[snip]
This looks simply like libvirt was restarted too much too quickly. Did
you restart it yourself before deploy?
No. I installed from iso and after restart I connected to cockpit and run
the gluster wizard for single host
If not, and it's only due to the deploy process restarting it,
then either:
1. That's ok, and we should simply configure systemd to allow that,
2. or there is some other problem, and restarting libvirt is just a
symptom.
> Jun 03 15:13:35 ovirt01.mydomain.local systemd[1]: libvirtd.service:
Failed with result 'exit-code'.
> Jun 03 15:13:35 ovirt01.mydomain.local systemd[1]: Failed to start
Virtualization daemon.
> [root@ovirt01 g.cecchi]#
>
> Let me know what files do you want to analyze the problem
> Under /var/log/ovirt-hosted-engine-setup I have:
>
> [root@ovirt01 ovirt-hosted-engine-setup]# ls -lrt
> total 632
> -rw-r--r--. 1 root root 123814 Jun 3 15:07
ovirt-hosted-engine-setup-ansible-get_network_interfaces-20205315737-ooohyb.log
> -rw-r--r--. 1 root root 126674 Jun 3 15:08
ovirt-hosted-engine-setup-ansible-validate_hostnames-20205315737-oqixuw.log
> -rw-r--r--. 1 root root 127548 Jun 3 15:10
ovirt-hosted-engine-setup-ansible-validate_hostnames-202053151022-yls4qo.log
> -rw-r--r--. 1 root root 261482 Jun 3 15:13
ovirt-hosted-engine-setup-ansible-initial_clean-20205315123-7x25zv.log
> [root@ovirt01 ovirt-hosted-engine-setup]#
Perhaps check these for libvirt restarts, also /var/log/messages (or
journalctl).
Do you see there other errors?
The latest file contains these last lines with the summary:
2020-06-03 15:13:34,567+0200 INFO SUMMARY:
Duration Task Name
-------- --------
[ < 1 sec ] Execute just a specific set of steps
[ 00:01 ] Force facts gathering
[ 00:01 ] Install oVirt Hosted Engine packages
[ < 1 sec ] System configuration validations
[ 00:01 ] Get all active network interfaces
[ < 1 sec ] Filter bonds with bad naming
[ < 1 sec ] Generate output list
[ 00:01 ] Collect interface types
[ < 1 sec ] Get list of Team devices
[ < 1 sec ] Filter unsupported interface types
[ < 1 sec ] Prepare getent key
[ < 1 sec ] Get full hostname
[ < 1 sec ] Set hostname variable if not defined
[ < 1 sec ] Define host address variable if not defined
[ < 1 sec ] Get host address resolution
[ < 1 sec ] Parse host address resolution
[ < 1 sec ] Get target address from selected interface (IPv4)
[ < 1 sec ] Get target address from selected interface (IPv6)
[ < 1 sec ] Check for alias
[ < 1 sec ] Filter resolved address list
[ < 1 sec ] Get engine FQDN resolution
[ < 1 sec ] Parse engine he_fqdn resolution
[ < 1 sec ] Define he_cloud_init_host_name
[ < 1 sec ] Get uuid
[ < 1 sec ] Set he_vm_uuid
[ < 1 sec ] Get uuid
[ < 1 sec ] Set he_nic_uuid
[ < 1 sec ] Get uuid
[ < 1 sec ] Set he_cdrom_uuid
[ < 1 sec ] get timezone
[ < 1 sec ] Set he_time_zone
[ 00:01 ] Check firewalld status
[ < 1 sec ] Get default gateway IPv4
[ < 1 sec ] Get default gateway IPv6
[ < 1 sec ] Set he_gateway
[ < 1 sec ] Generate unicast MAC address
[ < 1 sec ] Set he_vm_mac_addr
[ < 1 sec ] Get free memory
[ < 1 sec ] Get cached memory
[ < 1 sec ] Set Max memory
[ < 1 sec ] set he_mem_size_MB to max available if not defined
[ < 1 sec ] Populate service facts
[ < 1 sec ] get max cpus
[ < 1 sec ] Set he_maxvcpus
[ < 1 sec ] Set he_vcpus to maximum amount if not defined
[ < 1 sec ] Stop libvirt service
[ 00:01 ] Drop vdsm config statements
[ 00:01 ] Restore initial abrt config files
[ 00:01 ] Restart abrtd service
[ 00:01 ] Drop libvirt sasl2 configuration by vdsm
[ 00:01 ] Stop and disable services
[ < 1 sec ] Restore initial libvirt default network configuration
[ FAILED ] Start libvirt
2020-06-03 15:13:34,567+0200 DEBUG ansible on_any args
<ansible.executor.stats.AggregateStats object at 0x7f7156a11b70> kwargs
Previous lines of the same file contain:
...
2020-06-03 15:13:23,336+0200 DEBUG ansible on_any args localhostTASK:
ovirt.hosted_engine_setup : Check number of chosen CPUs kwargs
2020-06-03 15:13:23,631+0200 INFO ansible skipped {'status': 'SKIPPED',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-
hosted-engine-setup/ansible/trigger_role.yml', 'ansible_task': 'Check
number of chosen CPUs', 'ansible_host': 'localhost'}
2020-06-03 15:13:23,632+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f7154057748> kwargs
2020-06-03 15:13:23,944+0200 INFO ansible task start {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_task': 'ovirt.hosted_engine_setup : Stop libvirt service'}
2020-06-03 15:13:23,945+0200 DEBUG ansible on_any args TASK:
ovirt.hosted_engine_setup : Stop libvirt service kwargs
is_conditional:False
2020-06-03 15:13:23,945+0200 DEBUG ansible on_any args localhostTASK:
ovirt.hosted_engine_setup : Stop libvirt service kwargs
2020-06-03 15:13:24,625+0200 INFO ansible ok {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_host': 'localhost', 'ansible_task': 'Stop libvirt
service',
'task_duration': 0}
2020-06-03 15:13:24,626+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f71541c4f98> kwargs
2020-06-03 15:13:24,930+0200 INFO ansible task start {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_task': 'ovirt.hosted_engine_setup : Drop vdsm config
statements'}
2020-06-03 15:13:24,930+0200 DEBUG ansible on_any args TASK:
ovirt.hosted_engine_setup : Drop vdsm config statements kwargs
is_conditional:False
2020-06-03 15:13:24,930+0200 DEBUG ansible on_any args localhostTASK:
ovirt.hosted_engine_setup : Drop vdsm config statements kwargs
2020-06-03 15:13:25,166+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f715412fbe0> kwargs
2020-06-03 15:13:25,385+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f715412f198> kwargs
2020-06-03 15:13:25,600+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f71540e8668> kwargs
2020-06-03 15:13:25,815+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f715412fb38> kwargs
2020-06-03 15:13:26,096+0200 INFO ansible ok {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_host': 'localhost', 'ansible_task': 'Drop vdsm config
statements',
'task_duration': 1}
2020-06-03 15:13:26,096+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f715402c780> kwargs
2020-06-03 15:13:26,417+0200 INFO ansible task start {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_task': 'ovirt.hosted_engine_setup : Restore initial abrt config
files'}
2020-06-03 15:13:26,417+0200 DEBUG ansible on_any args TASK:
ovirt.hosted_engine_setup : Restore initial abrt config files kwargs
is_conditional:False
2020-06-03 15:13:26,417+0200 DEBUG ansible on_any args localhostTASK:
ovirt.hosted_engine_setup : Restore initial abrt config files kwargs
2020-06-03 15:13:26,878+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f715404ba20> kwargs
2020-06-03 15:13:27,138+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f7154138320> kwargs
2020-06-03 15:13:27,391+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f7154061588> kwargs
2020-06-03 15:13:27,643+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f715404b278> kwargs
2020-06-03 15:13:27,945+0200 INFO ansible ok {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_host': 'localhost', 'ansible_task': 'Restore initial
abrt config
files', 'task_duration': 1}
2020-06-03 15:13:27,945+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f7154061ac8> kwargs
2020-06-03 15:13:28,268+0200 INFO ansible task start {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_task': 'ovirt.hosted_engine_setup : Restart abrtd service'}
2020-06-03 15:13:28,268+0200 DEBUG ansible on_any args TASK:
ovirt.hosted_engine_setup : Restart abrtd service kwargs
is_conditional:False
2020-06-03 15:13:28,268+0200 DEBUG ansible on_any args localhostTASK:
ovirt.hosted_engine_setup : Restart abrtd service kwargs
2020-06-03 15:13:29,045+0200 INFO ansible ok {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_host': 'localhost', 'ansible_task': 'Restart abrtd
service',
'task_duration': 1}
2020-06-03 15:13:29,046+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f715413e860> kwargs
2020-06-03 15:13:29,358+0200 INFO ansible task start {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_task': 'ovirt.hosted_engine_setup : Drop libvirt sasl2
configuration by vdsm'}
2020-06-03 15:13:29,358+0200 DEBUG ansible on_any args TASK:
ovirt.hosted_engine_setup : Drop libvirt sasl2 configuration by vdsm kwargs
is_conditional:False
2020-06-03 15:13:29,358+0200 DEBUG ansible on_any args localhostTASK:
ovirt.hosted_engine_setup : Drop libvirt sasl2 configuration by vdsm kwargs
2020-06-03 15:13:30,873+0200 INFO ansible ok {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_host': 'localhost', 'ansible_task': 'Drop libvirt
sasl2
configuration by vdsm', 'task_duration': 1}
2020-06-03 15:13:30,873+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f71541f2d30> kwargs
2020-06-03 15:13:31,212+0200 INFO ansible task start {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_task': 'ovirt.hosted_engine_setup : Stop and disable services'}
2020-06-03 15:13:31,212+0200 DEBUG ansible on_any args TASK:
ovirt.hosted_engine_setup : Stop and disable services kwargs
is_conditional:False
2020-06-03 15:13:31,212+0200 DEBUG ansible on_any args localhostTASK:
ovirt.hosted_engine_setup : Stop and disable services kwargs
2020-06-03 15:13:31,614+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f71541c4518> kwargs
2020-06-03 15:13:31,978+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f714ffc0c88> kwargs
2020-06-03 15:13:32,353+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f714ffc0128> kwargs
2020-06-03 15:13:32,644+0200 INFO ansible ok {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_host': 'localhost', 'ansible_task': 'Stop and disable
services',
'task_duration': 1}
2020-06-03 15:13:32,644+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f7154199240> kwargs
2020-06-03 15:13:32,955+0200 INFO ansible task start {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_task': 'ovirt.hosted_engine_setup : Restore initial libvirt
default network configuration'}
2020-06-03 15:13:32,956+0200 DEBUG ansible on_any args TASK:
ovirt.hosted_engine_setup : Restore initial libvirt default network
configuration kwargs is_conditional:False
2020-06-03 15:13:32,956+0200 DEBUG ansible on_any args localhostTASK:
ovirt.hosted_engine_setup : Restore initial libvirt default network
configuration kwargs
2020-06-03 15:13:33,475+0200 INFO ansible ok {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_host': 'localhost', 'ansible_task': 'Restore initial
libvirt
default network configuration', 'task_duration': 0}
2020-06-03 15:13:33,476+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f71541380f0> kwargs
2020-06-03 15:13:33,785+0200 INFO ansible task start {'status': 'OK',
'ansible_type': 'task', 'ansible_playbook':
'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml',
'ansible_task': 'ovirt.hosted_engine_setup : Start libvirt'}
2020-06-03 15:13:33,786+0200 DEBUG ansible on_any args TASK:
ovirt.hosted_engine_setup : Start libvirt kwargs is_conditional:False
2020-06-03 15:13:33,786+0200 DEBUG ansible on_any args localhostTASK:
ovirt.hosted_engine_setup : Start libvirt kwargs
2020-06-03 15:13:34,564+0200 DEBUG var changed: host "localhost" var
"ansible_play_hosts" type "<class 'list'>" value:
"[]"
2020-06-03 15:13:34,565+0200 DEBUG var changed: host "localhost" var
"ansible_play_batch" type "<class 'list'>" value:
"[]"
2020-06-03 15:13:34,565+0200 DEBUG var changed: host "localhost" var
"play_hosts" type "<class 'list'>" value:
"[]"
2020-06-03 15:13:34,565+0200 ERROR ansible failed {
"ansible_host": "localhost",
"ansible_playbook":
"/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml",
"ansible_result": {
"_ansible_no_log": false,
"changed": false,
"invocation": {
"module_args": {
"daemon_reexec": false,
"daemon_reload": false,
"enabled": true,
"force": null,
"masked": null,
"name": "libvirtd",
"no_block": false,
"scope": null,
"state": "started",
"user": null
}
},
"msg": "Unable to start service libvirtd: Job for libvirtd.service
failed because the control process exited with error code.\nSee \"systemctl
status libvirtd.service\" and \"journalctl -xe\" for details.\n"
},
"ansible_task": "Start libvirt",
"ansible_type": "task",
"status": "FAILED",
"task_duration": 1
}
2020-06-03 15:13:34,565+0200 DEBUG ansible on_any args
<ansible.executor.task_result.TaskResult object at 0x7f71541c4240> kwargs
ignore_errors:None
2020-06-03 15:13:34,567+0200 INFO ansible stats {
"ansible_playbook":
"/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml",
"ansible_playbook_duration": "01:29 Minutes",
"ansible_result": "type: <class 'dict'>\nstr:
{'localhost': {'ok': 96,
'failures': 1, 'unreachable': 0, 'changed': 23, 'skipped':
37, 'rescued':
0, 'ignored': 0}}",
"ansible_type": "finish",
"status": "FAILED"
I confirm that what suggested by Joop worked for me too:
"
I have had this too and saw that during the test week it was also reported.
The 'solution' was to run /usr/sbin/ovirt-hosted-engine-cleanup and let the
wizard stay where it is and afterwards click Redeploy VM and then it will
run to its conclusion. Don't know what precisely it fixes. Had a look and
couldn't find it.
"
I confirm also the eventi for host already reported and due to missing
packages:
Gluster command [<UNKNOWN>] failed on server <UNKNOWN>.
Gianluca