Hi,
I am still fighting with oVirt 4.4 installation in HCI single host
configuration. Seems to be hard fighter... ;-)
It looks like there is no 4.4 HCI single host installation guide so I am
using compilation of this sources
*
https://www.ovirt.org/download/
*
https://www.ovirt.org/documentation/gluster-hyperconverged/chap-Single_no...
I did
* clean minimal install of CentOS 8.1
* setup networks (I am using vlans on bond for internal traffic)
dnf update -y
dnf install
https://resources.ovirt.org/pub/yum-repo/ovirt-release44.rpm
dnf install cockpit cockpit-ovirt-dashboard vdsm-gluster
ovirt-engine-appliance glusterfs-server gluster-ansible-roles
systemctl enable --now cockpit.socket
firewall-cmd --add-service=cockpit
firewall-cmd --add-service=cockpit --permanent
ssh-keygen
ssh-copy-id root(a)10.0.4.11
ssh root(a)10.0.4.11
(10.0.4.11 is local address on vlan which I would like use as storage
network)
I would like to run gluster-ansible-roles from command line but I am not
sure how exactly do it right way so I am going the cockpit way and the
gluster part works like expected.
Next Boss is HE install
Round 1, Fight!
The hosted engine wizzard ends with missing ca-cert.pem (unfortunately I
close the window and cannot find that log anymore). But it looks to me
like problem mentioned in
https://lists.ovirt.org/archives/list/users@ovirt.org/message/4PUIES2JGAF...
I have switched to command line...
Round 2, Fight!
ovirt-hosted-engine-cleanup
ovirt-hosted-engine-setup
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg":
"The
host has been set in non_operational status, deployment errors: code
505: Host ovirt-hci01.stud.slu.cz installation failed. Failed to
configure management network on the host., code 9000: Failed to
verify Power Management configuration for Host ovirt-hci01.stud.slu.cz.,
fix accordingly and re-deploy."}
/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20200526210340-h7waks.log
interesting thing is the vm looks like running in some way
ps aux | grep kvm
qemu 26790 58.2 6.6 6927972 3295760 ? Sl 21:28 12:40
/usr/libexec/qemu-kvm -name guest=HostedEngineLocal,debug-threads=on -S
-object
secret,id=masterKey0,format=raw,file=/var/lib/libvirt/qemu/domain-1-HostedEngineLocal/master-key.aes
-machine pc-q35-rhel8.1.0,accel=kvm,usb=off,dump-guest-core=off -cpu
Nehalem-IBRS,vme=on,ss=on,x2apic=on,tsc...
...
but
hosted-engine --vm-status
It seems like a previous attempt to deploy hosted-engine failed or it's
still in progress. Please clean it up before trying again
hosted-engine --check-deployed
The hosted engine has not been deployed
ok...
Round 3, Fight!
ovirt-hosted-engine-cleanup
ovirt-hosted-engine-setup --config-append=/root/answers-20200526214934.conf
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": true, "cmd":
["virt-install", "-n", "HostedEngineLocal",
"--os-variant", "rhel8.0",
"--virt-type", "kvm", "--memory", "4096",
"--vcpus", "2", "--network",
"network=default,mac=00:16:3e:7a:ce:77,model=virtio", "--disk",
"/var/tmp/localvmc7szuw4y/images/6c7c4d4b-9c11-485d-98e0-466a09888515/c16b87ac-f9d4-491d-a972-7dc333a324a0",
"--import", "--disk",
"path=/var/tmp/localvmc7szuw4y/seed.iso,device=cdrom",
"--noautoconsole", "--rng", "/dev/random",
"--graphics", "vnc",
"--video", "vga", "--sound", "none",
"--controller", "usb,model=none",
"--memballoon", "none", "--boot", "hd,menu=off",
"--clock",
"kvmclock_present=yes"], "delta": "0:00:04.419991",
"end": "2020-05-26
22:27:20.730780", "msg": "non-zero return code", "rc":
1, "start":
"2020-05-26 22:27:16.310789", "stderr": "ERROR internal
error:
process exited while connecting to monitor: 2020-05-26T20:27:19.254675Z
qemu-kvm: -object
tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/vdsm/libvirt-vnc,endpoint=server,verify-peer=no:
Unable to access credentials /etc/pki/vdsm/libvirt-vnc/ca-cert.pem: No
such file or directory\nDomain installation does not appear to have been
successful.\nIf it was, you can restart your domain by running:\n virsh
--connect qemu:///system start HostedEngineLocal\notherwise, please
restart your installation.", "stderr_lines": ["ERROR internal
error:
process exited while connecting to monitor: 2020-05-26T20:27:19.254675Z
qemu-kvm: -object
tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/vdsm/libvirt-vnc,endpoint=server,verify-peer=no:
Unable to access credentials /etc/pki/vdsm/libvirt-vnc/ca-cert.pem: No
such file or directory", "Domain installation does not appear to have
been successful.", "If it was, you can restart your domain by running:",
" virsh --connect qemu:///system start HostedEngineLocal", "otherwise,
please restart your installation."], "stdout": "\nStarting
install...",
"stdout_lines": ["", "Starting install..."]}
...and this error I get every round
relevant lines from
/var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20200526223648-dvejcr.log
2020-05-26 22:49:15,303+0200 DEBUG
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:103 {'msg': 'non-zero return code',
'cmd':
['virt-install', '-n', 'HostedEngineLocal',
'--os-variant', 'rhel8.0',
'--virt-type', 'kvm', '--memory', '4096',
'--vcpus', '2', '--network',
'network=default,mac=00:16:3e:7a:ce:77,model=virtio', '--disk',
'/var/tmp/localvm93c7hrj2/images/6c7c4d4b-9c11-485d-98e0-466a09888515/c16b87ac-f9d4-491d-a972-7dc333a324a0',
'--import', '--disk',
'path=/var/tmp/localvm93c7hrj2/seed.iso,device=cdrom',
'--noautoconsole', '--rng', '/dev/random', '--graphics',
'vnc',
'--video', 'vga', '--sound', 'none',
'--controller', 'usb,model=none',
'--memballoon', 'none', '--boot', 'hd,menu=off',
'--clock',
'kvmclock_present=yes'], 'stdout': '\nStarting install...',
'stderr':
'ERROR internal error: process exited while connecting to monitor:
2020-05-26T20:49:12.368712Z qemu-kvm: -object
tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/vdsm/libvirt-vnc,endpoint=server,verify-peer=no:
Unable to access credentials /etc/pki/vdsm/libvirt-vnc/ca-cert.pem: No
such file or directory\nDomain installation does not appear to have been
successful.\nIf it was, you can restart your domain by running:\n virsh
--connect qemu:///system start HostedEngineLocal\notherwise, please
restart your installation.', 'rc': 1, 'start': '2020-05-26
22:49:09.336828', 'end': '2020-05-26 22:49:15.046389',
'delta':
'0:00:05.709561', 'changed': True, 'invocation':
{'module_args':
{'_raw_params': 'virt-install -n HostedEngineLocal --os-variant rhel8.0
--virt-type kvm --memory 4096 --vcpus 2 --network
network=default,mac=00:16:3e:7a:ce:77,model=virtio --disk
/var/tmp/localvm93c7hrj2/images/6c7c4d4b-9c11-485d-98e0-466a09888515/c16b87ac-f9d4-491d-a972-7dc333a324a0
--import --disk path=/var/tmp/localvm93c7hrj2/seed.iso,device=cdrom
--noautoconsole --rng /dev/random --graphics vnc --video vga --sound
none --controller usb,model=none --memballoon none --boot hd,menu=off
--clock kvmclock_present=yes', 'warn': True, '_uses_shell': False,
'stdin_add_newline': True, 'strip_empty_ends': True, 'argv':
None,
'chdir': None, 'executable': None, 'creates': None,
'removes': None,
'stdin': None}}, 'stdout_lines': ['', 'Starting
install...'],
'stderr_lines': ['ERROR internal error: process exited while
connecting to monitor: 2020-05-26T20:49:12.368712Z qemu-kvm: -object
tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/vdsm/libvirt-vnc,endpoint=server,verify-peer=no:
Unable to access credentials /etc/pki/vdsm/libvirt-vnc/ca-cert.pem: No
such file or directory', 'Domain installation does not appear to have
been successful.', 'If it was, you can restart your domain by running:',
' virsh --connect qemu:///system start HostedEngineLocal', 'otherwise,
please restart your installation.'], '_ansible_no_log': False}
2020-05-26 22:49:15,404+0200 ERROR
otopi.ovirt_hosted_engine_setup.ansible_utils
ansible_utils._process_output:107 fatal: [localhost]: FAILED! =>
{"changed": true, "cmd": ["virt-install", "-n",
"HostedEngineLocal",
"--os-variant", "rhel8.0", "--virt-type", "kvm",
"--memory", "4096",
"--vcpus", "2", "--network",
"network=default,mac=00:16:3e:7a:ce:77,model=virtio", "--disk",
"/var/tmp/localvm93c7hrj2/images/6c7c4d4b-9c11-485d-98e0-466a09888515/c16b87ac-f9d4-491d-a972-7dc333a324a0",
"--import", "--disk",
"path=/var/tmp/localvm93c7hrj2/seed.iso,device=cdrom",
"--noautoconsole", "--rng", "/dev/random",
"--graphics", "vnc",
"--video", "vga", "--sound", "none",
"--controller", "usb,model=none",
"--memballoon", "none", "--boot", "hd,menu=off",
"--clock",
"kvmclock_present=yes"], "delta": "0:00:05.709561",
"end": "2020-05-26
22:49:15.046389", "msg": "non-zero return code", "rc":
1, "start":
"2020-05-26 22:49:09.336828", "stderr": "ERROR internal
error:
process exited while connecting to monitor: 2020-05-26T20:49:12.368712Z
qemu-kvm: -object
tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/vdsm/libvirt-vnc,endpoint=server,verify-peer=no:
Unable to access credentials /etc/pki/vdsm/libvirt-vnc/ca-cert.pem: No
such file or directory\nDomain installation does not appear to have been
successful.\nIf it was, you can restart your domain by running:\n virsh
--connect qemu:///system start HostedEngineLocal\notherwise, please
restart your installation.", "stderr_lines": ["ERROR internal
error:
process exited while connecting to monitor: 2020-05-26T20:49:12.368712Z
qemu-kvm: -object
tls-creds-x509,id=vnc-tls-creds0,dir=/etc/pki/vdsm/libvirt-vnc,endpoint=server,verify-peer=no:
Unable to access credentials /etc/pki/vdsm/libvirt-vnc/ca-cert.pem: No
such file or directory", "Domain installation does not appear to have
been successful.", "If it was, you can restart your domain by running:",
" virsh --connect qemu:///system start HostedEngineLocal", "otherwise,
please restart your installation."], "stdout": "\nStarting
install...",
"stdout_lines": ["", "Starting install..."]}
ll /etc/pki/vdsm/libvirt-vnc/
total 0
solved by manually removing
## beginning of configuration section for VNC encryption
vnc_tls=1
vnc_tls_x509_cert_dir="/etc/pki/vdsm/libvirt-vnc"
## end of configuration section for VNC encryption
from
/etc/libvirt/qemu.conf
but redeploy still failed on
[ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg":
"The
host has been set in non_operational status, deployment errors: code
505: Host ovirt-hci01.stud.slu.cz installation failed. Failed to
configure management network on the host., code 9000: Failed to
verify Power Management configuration for Host ovirt-hci01.stud.slu.cz.,
fix accordingly and re-deploy."}
...but at the end it was because I prepared ovirtmgmt bridge after OS
installation by hand and ovirt-hosted-engine-setup doesn't like it and
ovirt-hosted-engine-cleanup can't clean it...
After removing ovirtmgmt bridge and clean everything I was able to
deploy HE... ufff :-)
Cheers,
Jiri