10:26 a.m.
Hi!
I have banged my head against deploying the ovirt 4.4 self-hosted engine
on Centos 8.2 for last couple of days.
First I was astonished that resources.ovirt.org has no IPv6
connectivity, which made my initial plan for a mostly IPv6-only
deployment impossible.
CentOS was installed from scratch using the ks.cgf Kickstart file below,
which also adds the ovirt 4.4 repo and installs cockpit-ovirt-dashboard
& ovirt-engine-appliance.
When deploying the hosted-engine from cockpit while logged in as a
non-root (although privileged) user, the "(3) Prepare VM" step instantly
fails with a nondescript error message and without generating any logs.
By using the browser dev tools it was determined that this was because
the ansible vars file could not be created as the non-root user did not
have write permissions in '/var/lib/ovirt-hosted-engine-setup/cockpit/'
. Shouldn't cockpit be capable of using sudo when appropriate, or at
least give a more descriptive error message?
After login into cockpit as root, or when using the command line
ovirt-hosted-engine-setup tool, the deployment fails with "Failed to
download metadata for repo 'AppStream'".
This seems to be because a) the dnsmasq running on the host does not
forward dns queries, even though the host itself can resolve dns queries
just fine, and b) there also does not seem to be any functioning routing
setup to reach anything outside the host.
Regarding a) it is strange that dnsmasq is running with a config file
'/var/lib/libvirt/dnsmasq/default.conf' containing the 'no-resolv'
option. Could the operation of systemd-resolved be interfering with
dnsmasq (see ss -tulpen output)? I tried to manually stop
systemd-resolved, but got the same behaviour as before.
I hope someone could give me a hint how I could get past this problem,
as so far my ovirt experience has been a little bit sub-par. :D
Also when running ovirt-hosted-engine-cleanup, the extracted engine VMs
in /var/tmp/localvm* are not removed, leading to a "disk-memory-leak"
with subsequent runs.
Best regards
Jonas
--- ss -tulpen output post deploy-run ---
[root@nxtvirt ~]# ss -tulpen | grep ':53 '
udp UNCONN 0 0 127.0.0.53%lo:53
0.0.0.0:* users:(("systemd-resolve",pid=1379,fd=18)) uid:193
ino:32910 sk:6 <->
udp UNCONN 0 0 [fd00:1234:5678:900::1]:53
[::]:* users:(("dnsmasq",pid=13525,fd=15)) uid:979 ino:113580
sk:d v6only:1 <->
udp UNCONN 0 0 [fe80::5054:ff:fe94:f314]%virbr0:53
[::]:* users:(("dnsmasq",pid=13525,fd=12)) uid:979 ino:113575
sk:e v6only:1 <->
tcp LISTEN 0 32 [fd00:1234:5678:900::1]:53
[::]:* users:(("dnsmasq",pid=13525,fd=16)) uid:979 ino:113581
sk:20 v6only:1 <->
tcp LISTEN 0 32 [fe80::5054:ff:fe94:f314]%virbr0:53
[::]:* users:(("dnsmasq",pid=13525,fd=13)) uid:979 ino:113576
sk:21 v6only:1 <->
--- running dnsmasq processes on host ('nxtvirt') post deploy-run ---
dnsmasq 13525 0.0 0.0 71888 2344 ? S 12:31 0:00
/usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf
--leasefile-ro --dhcp-script=/usr/libexec/libvirt_leaseshelper
root 13526 0.0 0.0 71860 436 ? S 12:31 0:00
/usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf
--leasefile-ro --dhcp-script=/usr/libexec/libvirt_leaseshelper
--- var/lib/libvirt/dnsmasq/default.conf ---
##WARNING: THIS IS AN AUTO-GENERATED FILE. CHANGES TO IT ARE LIKELY TO
BE
##OVERWRITTEN AND LOST. Changes to this configuration should be made
using:
## virsh net-edit default
## or other application using the libvirt API.
##
## dnsmasq conf file created by libvirt
strict-order
pid-file=/run/libvirt/network/default.pid
except-interface=lo
bind-dynamic
interface=virbr0
dhcp-option=3
no-resolv
ra-param=*,0,0
dhcp-range=fd00:1234:5678:900::10,fd00:1234:5678:900::ff,64
dhcp-lease-max=240
dhcp-hostsfile=/var/lib/libvirt/dnsmasq/default.hostsfile
addn-hosts=/var/lib/libvirt/dnsmasq/default.addnhosts
enable-ra
--- cockpit wizard overview before the 'Prepare VM' step ---
VM
Engine FQDN:engine.*REDACTED*
MAC Address:00:16:3e:20:13:b3
Network Configuration:Static
VM IP Address:*REDACTED*:1099:babe::3/64
Gateway Address:*REDACTED*:1099::1
DNS Servers:*REDACTED*:1052::11
Root User SSH Access:yes
Number of Virtual CPUs:4
Memory Size (MiB):4096
Root User SSH Public Key:(None)
Add Lines to /etc/hosts:yes
Bridge Name:ovirtmgmt
Apply OpenSCAP profile:no
Engine
SMTP Server Name:localhost
SMTP Server Port Number:25
Sender E-Mail Address:root@localhost
Recipient E-Mail Addresses:root@localhost
--- ks.cgf ---
#version=RHEL8
ignoredisk --only-use=vda
autopart --type=lvm
# Partition clearing information
clearpart --drives=vda --all --initlabel
# Use graphical install
#graphical
text
# Use CDROM installation media
cdrom
# Keyboard layouts
keyboard --vckeymap=de --xlayouts='de','us'
# System language
lang en_US.UTF-8
# Network information
network --bootproto=static --device=enp1s0 --ip=192.168.199.250
--netmask=255.255.255.0 --gateway=192.168.199.10
--ipv6=*REDACTED*:1090:babe::250/64 --ipv6gateway=*REDACTED*:1090::1
--hostname=nxtvirt.*REDACTED* --nameserver=*REDACTED*:1052::11
--activate
network --hostname=nxtvirt.*REDACTED*
# Root password
rootpw --iscrypted $6$*REDACTED*
firewall --enabled --service=cockpit --service=ssh
# Run the Setup Agent on first boot
firstboot --enable
# Do not configure the X Window System
skipx
# System services
services --enabled="chronyd"
# System timezone
timezone Etc/UTC --isUtc --ntpservers=ntp.*REDACTED*,ntp2.*REDACTED*
user --name=nonrootuser --groups=wheel --password=$6$*REDACTED*
--iscrypted
# KVM Users/Groups
group --name=kvm --gid=36
user --name=vdsm --uid=36 --gid=36
%packages
@^server-product-environment
#@graphical-admin-tools
@headless-management
kexec-tools
cockpit
%end
%addon com_redhat_kdump --enable --reserve-mb='auto'
%end
%anaconda
pwpolicy root --minlen=6 --minquality=1 --notstrict --nochanges
--notempty
pwpolicy user --minlen=6 --minquality=1 --notstrict --nochanges
--emptyok
pwpolicy luks --minlen=6 --minquality=1 --notstrict --nochanges
--notempty
%end
%post --erroronfail --log=/root/ks-post.log
#!/bin/sh
dnf update -y
# NFS storage
mkdir -p /opt/ovirt/nfs-storage
chown -R 36:36 /opt/ovirt/nfs-storage
chmod 0755 /opt/ovirt/nfs-storage
echo "/opt/ovirt/nfs-storage localhost" > /etc/exports
echo "/opt/ovirt/nfs-storage engine.*REDACTED*" >> /etc/exports
dnf install -y nfs-utils
systemctl enable nfs-server.service
# Install ovirt packages
dnf install -y
https://resources.ovirt.org/pub/yum-repo/ovirt-release44.rpm
dnf install -y cockpit-ovirt-dashboard ovirt-engine-appliance
# Enable cockpit
systemctl enable cockpit.socket
%end
#reboot --eject --kexec
reboot --eject
--- Host (nxtvirt) ip -a post deploy-run ---
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: enp1s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel
state UP group default qlen 1000
link/ether 52:54:00:ad:79:1b brd ff:ff:ff:ff:ff:ff
inet 192.168.199.250/24 brd 192.168.199.255 scope global
noprefixroute enp1s0
valid_lft forever preferred_lft forever
inet6 *REDACTED*:1099:babe::250/64 scope global noprefixroute
valid_lft forever preferred_lft forever
inet6 fe80::5054:ff:fead:791b/64 scope link noprefixroute
valid_lft forever preferred_lft forever
5: virbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
state UP group default qlen 1000
link/ether 52:54:00:94:f3:14 brd ff:ff:ff:ff:ff:ff
inet6 fd00:1234:5678:900::1/64 scope global
valid_lft forever preferred_lft forever
inet6 fe80::5054:ff:fe94:f314/64 scope link
valid_lft forever preferred_lft forever
6: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel master
virbr0 state DOWN group default qlen 1000
link/ether 52:54:00:94:f3:14 brd ff:ff:ff:ff:ff:ff
7: vnet0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel
master virbr0 state UNKNOWN group default qlen 1000
link/ether fe:16:3e:68:d3:8a brd ff:ff:ff:ff:ff:ff
inet6 fe80::fc16:3eff:fe68:d38a/64 scope link
valid_lft forever preferred_lft forever
--- iptables-save post deploy-run ---
# Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
*filter
:INPUT ACCEPT [4007:8578553]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [3920:7633249]
:LIBVIRT_INP - [0:0]
:LIBVIRT_OUT - [0:0]
:LIBVIRT_FWO - [0:0]
:LIBVIRT_FWI - [0:0]
:LIBVIRT_FWX - [0:0]
-A INPUT -j LIBVIRT_INP
-A FORWARD -j LIBVIRT_FWX
-A FORWARD -j LIBVIRT_FWI
-A FORWARD -j LIBVIRT_FWO
-A OUTPUT -j LIBVIRT_OUT
-A LIBVIRT_INP -i virbr0 -p udp -m udp --dport 53 -j ACCEPT
-A LIBVIRT_INP -i virbr0 -p tcp -m tcp --dport 53 -j ACCEPT
-A LIBVIRT_INP -i virbr0 -p udp -m udp --dport 67 -j ACCEPT
-A LIBVIRT_INP -i virbr0 -p tcp -m tcp --dport 67 -j ACCEPT
-A LIBVIRT_OUT -o virbr0 -p udp -m udp --dport 53 -j ACCEPT
-A LIBVIRT_OUT -o virbr0 -p tcp -m tcp --dport 53 -j ACCEPT
-A LIBVIRT_OUT -o virbr0 -p udp -m udp --dport 68 -j ACCEPT
-A LIBVIRT_OUT -o virbr0 -p tcp -m tcp --dport 68 -j ACCEPT
-A LIBVIRT_FWO -i virbr0 -j REJECT --reject-with icmp-port-unreachable
-A LIBVIRT_FWI -o virbr0 -j REJECT --reject-with icmp-port-unreachable
-A LIBVIRT_FWX -i virbr0 -o virbr0 -j ACCEPT
COMMIT
# Completed on Sun Jun 28 13:20:53 2020
# Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
*security
:INPUT ACCEPT [3959:8576054]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [3920:7633249]
COMMIT
# Completed on Sun Jun 28 13:20:53 2020
# Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
*raw
:PREROUTING ACCEPT [4299:8608260]
:OUTPUT ACCEPT [3920:7633249]
COMMIT
# Completed on Sun Jun 28 13:20:53 2020
# Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
*mangle
:PREROUTING ACCEPT [4299:8608260]
:INPUT ACCEPT [4007:8578553]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [3920:7633249]
:POSTROUTING ACCEPT [3923:7633408]
:LIBVIRT_PRT - [0:0]
-A POSTROUTING -j LIBVIRT_PRT
COMMIT
# Completed on Sun Jun 28 13:20:53 2020
# Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
*nat
:PREROUTING ACCEPT [337:32047]
:INPUT ACCEPT [0:0]
:POSTROUTING ACCEPT [159:9351]
:OUTPUT ACCEPT [159:9351]
:LIBVIRT_PRT - [0:0]
-A POSTROUTING -j LIBVIRT_PRT
COMMIT
# Completed on Sun Jun 28 13:20:53 2020
9:15 a.m.
New subject: Lots of problems with deploying the hosted-engine (ovirt 4.4 | CentOS 8.2.2004)
Hi!
A short addendum:
I have now also tried to perform the installation using the oVirt Node
distribution as a basis, but that also ended with the same problem. So
it does not seam to be an issue with the underlying CentOS installation,
but rather with my general setup or parameters.
Regards
Jonas
On 2020-06-28 16:26, jonas wrote:
> Hi!
>
> I have banged my head against deploying the ovirt 4.4 self-hosted
> engine on Centos 8.2 for last couple of days.
>
> First I was astonished that resources.ovirt.org has no IPv6
> connectivity, which made my initial plan for a mostly IPv6-only
> deployment impossible.
>
> CentOS was installed from scratch using the ks.cgf Kickstart file
> below, which also adds the ovirt 4.4 repo and installs
> cockpit-ovirt-dashboard & ovirt-engine-appliance.
>
> When deploying the hosted-engine from cockpit while logged in as a
> non-root (although privileged) user, the "(3) Prepare VM" step
> instantly fails with a nondescript error message and without
> generating any logs. By using the browser dev tools it was determined
> that this was because the ansible vars file could not be created as
> the non-root user did not have write permissions in
> '/var/lib/ovirt-hosted-engine-setup/cockpit/' . Shouldn't cockpit be
> capable of using sudo when appropriate, or at least give a more
> descriptive error message?
>
> After login into cockpit as root, or when using the command line
> ovirt-hosted-engine-setup tool, the deployment fails with "Failed to
> download metadata for repo 'AppStream'".
> This seems to be because a) the dnsmasq running on the host does not
> forward dns queries, even though the host itself can resolve dns
> queries just fine, and b) there also does not seem to be any
> functioning routing setup to reach anything outside the host.
> Regarding a) it is strange that dnsmasq is running with a config file
> '/var/lib/libvirt/dnsmasq/default.conf' containing the 'no-resolv'
> option. Could the operation of systemd-resolved be interfering with
> dnsmasq (see ss -tulpen output)? I tried to manually stop
> systemd-resolved, but got the same behaviour as before.
>
> I hope someone could give me a hint how I could get past this problem,
> as so far my ovirt experience has been a little bit sub-par. :D
>
> Also when running ovirt-hosted-engine-cleanup, the extracted engine
> VMs in /var/tmp/localvm* are not removed, leading to a
> "disk-memory-leak" with subsequent runs.
>
> Best regards
> Jonas
>
> --- ss -tulpen output post deploy-run ---
> [root@nxtvirt ~]# ss -tulpen | grep ':53 '
> udp UNCONN 0 0 127.0.0.53%lo:53
> 0.0.0.0:* users:(("systemd-resolve",pid=1379,fd=18)) uid:193
> ino:32910 sk:6 <->
> udp UNCONN 0 0 [fd00:1234:5678:900::1]:53
> [::]:* users:(("dnsmasq",pid=13525,fd=15)) uid:979 ino:113580
> sk:d v6only:1 <->
> udp UNCONN 0 0 [fe80::5054:ff:fe94:f314]%virbr0:53
> [::]:* users:(("dnsmasq",pid=13525,fd=12)) uid:979 ino:113575
> sk:e v6only:1 <->
> tcp LISTEN 0 32 [fd00:1234:5678:900::1]:53
> [::]:* users:(("dnsmasq",pid=13525,fd=16)) uid:979 ino:113581
> sk:20 v6only:1 <->
> tcp LISTEN 0 32 [fe80::5054:ff:fe94:f314]%virbr0:53
> [::]:* users:(("dnsmasq",pid=13525,fd=13)) uid:979 ino:113576
> sk:21 v6only:1 <->
>
>
> --- running dnsmasq processes on host ('nxtvirt') post deploy-run ---
>
> dnsmasq 13525 0.0 0.0 71888 2344 ? S 12:31 0:00
> /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf
> --leasefile-ro --dhcp-script=/usr/libexec/libvirt_leaseshelper
> root 13526 0.0 0.0 71860 436 ? S 12:31 0:00
> /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf
> --leasefile-ro --dhcp-script=/usr/libexec/libvirt_leaseshelper
>
>
> --- var/lib/libvirt/dnsmasq/default.conf ---
>
> ##WARNING: THIS IS AN AUTO-GENERATED FILE. CHANGES TO IT ARE LIKELY TO
> BE
> ##OVERWRITTEN AND LOST. Changes to this configuration should be made
> using:
> ## virsh net-edit default
> ## or other application using the libvirt API.
> ##
> ## dnsmasq conf file created by libvirt
> strict-order
> pid-file=/run/libvirt/network/default.pid
> except-interface=lo
> bind-dynamic
> interface=virbr0
> dhcp-option=3
> no-resolv
> ra-param=*,0,0
> dhcp-range=fd00:1234:5678:900::10,fd00:1234:5678:900::ff,64
> dhcp-lease-max=240
> dhcp-hostsfile=/var/lib/libvirt/dnsmasq/default.hostsfile
> addn-hosts=/var/lib/libvirt/dnsmasq/default.addnhosts
> enable-ra
>
> --- cockpit wizard overview before the 'Prepare VM' step ---
>
> VM
> Engine FQDN:engine.*REDACTED*
> MAC Address:00:16:3e:20:13:b3
> Network Configuration:Static
> VM IP Address:*REDACTED*:1099:babe::3/64
> Gateway Address:*REDACTED*:1099::1
> DNS Servers:*REDACTED*:1052::11
> Root User SSH Access:yes
> Number of Virtual CPUs:4
> Memory Size (MiB):4096
> Root User SSH Public Key:(None)
> Add Lines to /etc/hosts:yes
> Bridge Name:ovirtmgmt
> Apply OpenSCAP profile:no
> Engine
> SMTP Server Name:localhost
> SMTP Server Port Number:25
> Sender E-Mail Address:root@localhost
> Recipient E-Mail Addresses:root@localhost
>
> --- ks.cgf ---
>
> #version=RHEL8
> ignoredisk --only-use=vda
> autopart --type=lvm
> # Partition clearing information
> clearpart --drives=vda --all --initlabel
> # Use graphical install
> #graphical
> text
> # Use CDROM installation media
> cdrom
> # Keyboard layouts
> keyboard --vckeymap=de --xlayouts='de','us'
> # System language
> lang en_US.UTF-8
>
> # Network information
> network --bootproto=static --device=enp1s0 --ip=192.168.199.250
> --netmask=255.255.255.0 --gateway=192.168.199.10
> --ipv6=*REDACTED*:1090:babe::250/64 --ipv6gateway=*REDACTED*:1090::1
> --hostname=nxtvirt.*REDACTED* --nameserver=*REDACTED*:1052::11
> --activate
> network --hostname=nxtvirt.*REDACTED*
> # Root password
> rootpw --iscrypted $6$*REDACTED*
>
> firewall --enabled --service=cockpit --service=ssh
>
>
> # Run the Setup Agent on first boot
> firstboot --enable
> # Do not configure the X Window System
> skipx
> # System services
> services --enabled="chronyd"
> # System timezone
> timezone Etc/UTC --isUtc --ntpservers=ntp.*REDACTED*,ntp2.*REDACTED*
> user --name=nonrootuser --groups=wheel --password=$6$*REDACTED*
> --iscrypted
>
> # KVM Users/Groups
> group --name=kvm --gid=36
> user --name=vdsm --uid=36 --gid=36
>
> %packages
> @^server-product-environment
> #@graphical-admin-tools
> @headless-management
> kexec-tools
> cockpit
>
> %end
>
> %addon com_redhat_kdump --enable --reserve-mb='auto'
>
> %end
>
> %anaconda
> pwpolicy root --minlen=6 --minquality=1 --notstrict --nochanges
> --notempty
> pwpolicy user --minlen=6 --minquality=1 --notstrict --nochanges
> --emptyok
> pwpolicy luks --minlen=6 --minquality=1 --notstrict --nochanges
> --notempty
> %end
>
> %post --erroronfail --log=/root/ks-post.log
> #!/bin/sh
>
> dnf update -y
>
> # NFS storage
> mkdir -p /opt/ovirt/nfs-storage
> chown -R 36:36 /opt/ovirt/nfs-storage
> chmod 0755 /opt/ovirt/nfs-storage
> echo "/opt/ovirt/nfs-storage localhost" > /etc/exports
> echo "/opt/ovirt/nfs-storage engine.*REDACTED*" >> /etc/exports
> dnf install -y nfs-utils
> systemctl enable nfs-server.service
>
> # Install ovirt packages
> dnf install -y
> https://resources.ovirt.org/pub/yum-repo/ovirt-release44.rpm
> dnf install -y cockpit-ovirt-dashboard ovirt-engine-appliance
>
> # Enable cockpit
> systemctl enable cockpit.socket
>
> %end
>
> #reboot --eject --kexec
> reboot --eject
>
>
> --- Host (nxtvirt) ip -a post deploy-run ---
>
> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
> group default qlen 1000
> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
> inet 127.0.0.1/8 scope host lo
> valid_lft forever preferred_lft forever
> inet6 ::1/128 scope host
> valid_lft forever preferred_lft forever
> 2: enp1s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel
> state UP group default qlen 1000
> link/ether 52:54:00:ad:79:1b brd ff:ff:ff:ff:ff:ff
> inet 192.168.199.250/24 brd 192.168.199.255 scope global
> noprefixroute enp1s0
> valid_lft forever preferred_lft forever
> inet6 *REDACTED*:1099:babe::250/64 scope global noprefixroute
> valid_lft forever preferred_lft forever
> inet6 fe80::5054:ff:fead:791b/64 scope link noprefixroute
> valid_lft forever preferred_lft forever
> 5: virbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
> state UP group default qlen 1000
> link/ether 52:54:00:94:f3:14 brd ff:ff:ff:ff:ff:ff
> inet6 fd00:1234:5678:900::1/64 scope global
> valid_lft forever preferred_lft forever
> inet6 fe80::5054:ff:fe94:f314/64 scope link
> valid_lft forever preferred_lft forever
> 6: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel master
> virbr0 state DOWN group default qlen 1000
> link/ether 52:54:00:94:f3:14 brd ff:ff:ff:ff:ff:ff
> 7: vnet0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel
> master virbr0 state UNKNOWN group default qlen 1000
> link/ether fe:16:3e:68:d3:8a brd ff:ff:ff:ff:ff:ff
> inet6 fe80::fc16:3eff:fe68:d38a/64 scope link
> valid_lft forever preferred_lft forever
>
>
> --- iptables-save post deploy-run ---
>
> # Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
> *filter
> :INPUT ACCEPT [4007:8578553]
> :FORWARD ACCEPT [0:0]
> :OUTPUT ACCEPT [3920:7633249]
> :LIBVIRT_INP - [0:0]
> :LIBVIRT_OUT - [0:0]
> :LIBVIRT_FWO - [0:0]
> :LIBVIRT_FWI - [0:0]
> :LIBVIRT_FWX - [0:0]
> -A INPUT -j LIBVIRT_INP
> -A FORWARD -j LIBVIRT_FWX
> -A FORWARD -j LIBVIRT_FWI
> -A FORWARD -j LIBVIRT_FWO
> -A OUTPUT -j LIBVIRT_OUT
> -A LIBVIRT_INP -i virbr0 -p udp -m udp --dport 53 -j ACCEPT
> -A LIBVIRT_INP -i virbr0 -p tcp -m tcp --dport 53 -j ACCEPT
> -A LIBVIRT_INP -i virbr0 -p udp -m udp --dport 67 -j ACCEPT
> -A LIBVIRT_INP -i virbr0 -p tcp -m tcp --dport 67 -j ACCEPT
> -A LIBVIRT_OUT -o virbr0 -p udp -m udp --dport 53 -j ACCEPT
> -A LIBVIRT_OUT -o virbr0 -p tcp -m tcp --dport 53 -j ACCEPT
> -A LIBVIRT_OUT -o virbr0 -p udp -m udp --dport 68 -j ACCEPT
> -A LIBVIRT_OUT -o virbr0 -p tcp -m tcp --dport 68 -j ACCEPT
> -A LIBVIRT_FWO -i virbr0 -j REJECT --reject-with icmp-port-unreachable
> -A LIBVIRT_FWI -o virbr0 -j REJECT --reject-with icmp-port-unreachable
> -A LIBVIRT_FWX -i virbr0 -o virbr0 -j ACCEPT
> COMMIT
> # Completed on Sun Jun 28 13:20:53 2020
> # Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
> *security
> :INPUT ACCEPT [3959:8576054]
> :FORWARD ACCEPT [0:0]
> :OUTPUT ACCEPT [3920:7633249]
> COMMIT
> # Completed on Sun Jun 28 13:20:53 2020
> # Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
> *raw
> :PREROUTING ACCEPT [4299:8608260]
> :OUTPUT ACCEPT [3920:7633249]
> COMMIT
> # Completed on Sun Jun 28 13:20:53 2020
> # Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
> *mangle
> :PREROUTING ACCEPT [4299:8608260]
> :INPUT ACCEPT [4007:8578553]
> :FORWARD ACCEPT [0:0]
> :OUTPUT ACCEPT [3920:7633249]
> :POSTROUTING ACCEPT [3923:7633408]
> :LIBVIRT_PRT - [0:0]
> -A POSTROUTING -j LIBVIRT_PRT
> COMMIT
> # Completed on Sun Jun 28 13:20:53 2020
> # Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
> *nat
> :PREROUTING ACCEPT [337:32047]
> :INPUT ACCEPT [0:0]
> :POSTROUTING ACCEPT [159:9351]
> :OUTPUT ACCEPT [159:9351]
> :LIBVIRT_PRT - [0:0]
> -A POSTROUTING -j LIBVIRT_PRT
> COMMIT
> # Completed on Sun Jun 28 13:20:53 2020
>
> _______________________________________________
> Users mailing list -- users(a)ovirt.org
> To unsubscribe send an email to users-leave(a)ovirt.org
> Privacy Statement: https://www.ovirt.org/privacy-policy.html
> oVirt Code of Conduct:
> https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
>
https://lists.ovirt.org/archives/list/users@ovirt.org/message/G452P2BN7Z7...
4:47 p.m.
New subject: Lots of problems with deploying the hosted-engine (ovirt 4.4 | CentOS 8.2.2004)
Yes i also had a lot of problems installing ovirt 4.4 .I think it was not tested enough.
I am upgrading from ovirt 4.3 to 4.4 using shared storage glusterfs, which makes things
more difficult.
Regarding your error, i believe is something with the rpm ovirt 4.4 repository(sometimes
it times out and sometimes it's not).
First as you said check your disk space, before running the hosted-engine deploy.If the
setup fails there is no ansible disk cleanup task for /var/tmp, the clean task is only at
the end of the ansible playbook when the deploy is with success.
What i tried with success is to clear the rpm packages metadata, just before the deploy
started run : "dnf clean all" , then "dnf update" .
8:35 p.m.
New subject: Lots of problems with deploying the hosted-engine (ovirt 4.4 | CentOS 8.2.2004)
Hi!
Thanks for your comments! I am unsure regarding your hunch that the oVirt Repo is to
blame, as from inside the engine after the botched deployment, absolutely nothing outside
of the engine and its host is reachable via IPv4/v6, and a manual "dnf update"
also produces a failure that the AppStream metadata can't be fetched. Therefore I
still believe it's a bug with he temporary networking/dns setup used when deploying
the hosted engine.
I have sufficient space on the host, even after the engine was (half-)deployed there is
still 80% free space available.
The only connection problems I had with the oVirt repo were that it is not IPv6 ready.
4:27 a.m.
New subject: Lots of problems with deploying the hosted-engine (ovirt 4.4 | CentOS 8.2.2004)
I am using command line hosted-engine --deploy for install, no cockpit.
I had problems with rpm metadata and the deployed failed, but yes in your case might be
IPv6 problems.
I am using IPv4, never tried IPv6 on Ovirt.
7:31 a.m.
New subject: Lots of problems with deploying the hosted-engine (ovirt 4.4 | CentOS 8.2.2004)
Hi Jonas,
Can you please share the full log file located in
/var/log/ovirt-hosted-engine-setup ?
My guess you hit [1], this is the fix for that [2] (not merged yet).
You can install the rpm with the fix from Jenkins CI [3] and then run the
following command:
hosted-engine --deploy --ansible-extra-vars=he_offline_deployment=true
Regarding the "disk-memory-leak", can you please open a bug for that?
Regards,
Asaf
[1] https://bugzilla.redhat.com/show_bug.cgi?id=1849517
[2] https://gerrit.ovirt.org/109730
[3]
https://jenkins.ovirt.org/job/ovirt-hosted-engine-setup_standard-check-pa...
On Tue, Jul 7, 2020 at 4:24 PM jonas <jonas(a)selfnet.de> wrote:
Hi!
A short addendum:
I have now also tried to perform the installation using the oVirt Node
distribution as a basis, but that also ended with the same problem. So
it does not seam to be an issue with the underlying CentOS installation,
but rather with my general setup or parameters.
Regards
Jonas
On 2020-06-28 16:26, jonas wrote:
> Hi!
>
> I have banged my head against deploying the ovirt 4.4 self-hosted
> engine on Centos 8.2 for last couple of days.
>
> First I was astonished that resources.ovirt.org has no IPv6
> connectivity, which made my initial plan for a mostly IPv6-only
> deployment impossible.
>
> CentOS was installed from scratch using the ks.cgf Kickstart file
> below, which also adds the ovirt 4.4 repo and installs
> cockpit-ovirt-dashboard & ovirt-engine-appliance.
>
> When deploying the hosted-engine from cockpit while logged in as a
> non-root (although privileged) user, the "(3) Prepare VM" step
> instantly fails with a nondescript error message and without
> generating any logs. By using the browser dev tools it was determined
> that this was because the ansible vars file could not be created as
> the non-root user did not have write permissions in
> '/var/lib/ovirt-hosted-engine-setup/cockpit/' . Shouldn't cockpit be
> capable of using sudo when appropriate, or at least give a more
> descriptive error message?
>
> After login into cockpit as root, or when using the command line
> ovirt-hosted-engine-setup tool, the deployment fails with "Failed to
> download metadata for repo 'AppStream'".
> This seems to be because a) the dnsmasq running on the host does not
> forward dns queries, even though the host itself can resolve dns
> queries just fine, and b) there also does not seem to be any
> functioning routing setup to reach anything outside the host.
> Regarding a) it is strange that dnsmasq is running with a config file
> '/var/lib/libvirt/dnsmasq/default.conf' containing the 'no-resolv'
> option. Could the operation of systemd-resolved be interfering with
> dnsmasq (see ss -tulpen output)? I tried to manually stop
> systemd-resolved, but got the same behaviour as before.
>
> I hope someone could give me a hint how I could get past this problem,
> as so far my ovirt experience has been a little bit sub-par. :D
>
> Also when running ovirt-hosted-engine-cleanup, the extracted engine
> VMs in /var/tmp/localvm* are not removed, leading to a
> "disk-memory-leak" with subsequent runs.
>
> Best regards
> Jonas
>
> --- ss -tulpen output post deploy-run ---
> [root@nxtvirt ~]# ss -tulpen | grep ':53 '
> udp UNCONN 0 0 127.0.0.53%lo:53
> 0.0.0.0:* users:(("systemd-resolve",pid=1379,fd=18)) uid:193
> ino:32910 sk:6 <->
> udp UNCONN 0 0 [fd00:1234:5678:900::1]:53
> [::]:* users:(("dnsmasq",pid=13525,fd=15)) uid:979 ino:113580
> sk:d v6only:1 <->
> udp UNCONN 0 0 [fe80::5054:ff:fe94:f314]%virbr0:53
> [::]:* users:(("dnsmasq",pid=13525,fd=12)) uid:979 ino:113575
> sk:e v6only:1 <->
> tcp LISTEN 0 32 [fd00:1234:5678:900::1]:53
> [::]:* users:(("dnsmasq",pid=13525,fd=16)) uid:979 ino:113581
> sk:20 v6only:1 <->
> tcp LISTEN 0 32 [fe80::5054:ff:fe94:f314]%virbr0:53
> [::]:* users:(("dnsmasq",pid=13525,fd=13)) uid:979 ino:113576
> sk:21 v6only:1 <->
>
>
> --- running dnsmasq processes on host ('nxtvirt') post deploy-run ---
>
> dnsmasq 13525 0.0 0.0 71888 2344 ? S 12:31 0:00
> /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf
> --leasefile-ro --dhcp-script=/usr/libexec/libvirt_leaseshelper
> root 13526 0.0 0.0 71860 436 ? S 12:31 0:00
> /usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf
> --leasefile-ro --dhcp-script=/usr/libexec/libvirt_leaseshelper
>
>
> --- var/lib/libvirt/dnsmasq/default.conf ---
>
> ##WARNING: THIS IS AN AUTO-GENERATED FILE. CHANGES TO IT ARE LIKELY TO
> BE
> ##OVERWRITTEN AND LOST. Changes to this configuration should be made
> using:
> ## virsh net-edit default
> ## or other application using the libvirt API.
> ##
> ## dnsmasq conf file created by libvirt
> strict-order
> pid-file=/run/libvirt/network/default.pid
> except-interface=lo
> bind-dynamic
> interface=virbr0
> dhcp-option=3
> no-resolv
> ra-param=*,0,0
> dhcp-range=fd00:1234:5678:900::10,fd00:1234:5678:900::ff,64
> dhcp-lease-max=240
> dhcp-hostsfile=/var/lib/libvirt/dnsmasq/default.hostsfile
> addn-hosts=/var/lib/libvirt/dnsmasq/default.addnhosts
> enable-ra
>
> --- cockpit wizard overview before the 'Prepare VM' step ---
>
> VM
> Engine FQDN:engine.*REDACTED*
> MAC Address:00:16:3e:20:13:b3
> Network Configuration:Static
> VM IP Address:*REDACTED*:1099:babe::3/64
> Gateway Address:*REDACTED*:1099::1
> DNS Servers:*REDACTED*:1052::11
> Root User SSH Access:yes
> Number of Virtual CPUs:4
> Memory Size (MiB):4096
> Root User SSH Public Key:(None)
> Add Lines to /etc/hosts:yes
> Bridge Name:ovirtmgmt
> Apply OpenSCAP profile:no
> Engine
> SMTP Server Name:localhost
> SMTP Server Port Number:25
> Sender E-Mail Address:root@localhost
> Recipient E-Mail Addresses:root@localhost
>
> --- ks.cgf ---
>
> #version=RHEL8
> ignoredisk --only-use=vda
> autopart --type=lvm
> # Partition clearing information
> clearpart --drives=vda --all --initlabel
> # Use graphical install
> #graphical
> text
> # Use CDROM installation media
> cdrom
> # Keyboard layouts
> keyboard --vckeymap=de --xlayouts='de','us'
> # System language
> lang en_US.UTF-8
>
> # Network information
> network --bootproto=static --device=enp1s0 --ip=192.168.199.250
> --netmask=255.255.255.0 --gateway=192.168.199.10
> --ipv6=*REDACTED*:1090:babe::250/64 --ipv6gateway=*REDACTED*:1090::1
> --hostname=nxtvirt.*REDACTED* --nameserver=*REDACTED*:1052::11
> --activate
> network --hostname=nxtvirt.*REDACTED*
> # Root password
> rootpw --iscrypted $6$*REDACTED*
>
> firewall --enabled --service=cockpit --service=ssh
>
>
> # Run the Setup Agent on first boot
> firstboot --enable
> # Do not configure the X Window System
> skipx
> # System services
> services --enabled="chronyd"
> # System timezone
> timezone Etc/UTC --isUtc --ntpservers=ntp.*REDACTED*,ntp2.*REDACTED*
> user --name=nonrootuser --groups=wheel --password=$6$*REDACTED*
> --iscrypted
>
> # KVM Users/Groups
> group --name=kvm --gid=36
> user --name=vdsm --uid=36 --gid=36
>
> %packages
> @^server-product-environment
> #@graphical-admin-tools
> @headless-management
> kexec-tools
> cockpit
>
> %end
>
> %addon com_redhat_kdump --enable --reserve-mb='auto'
>
> %end
>
> %anaconda
> pwpolicy root --minlen=6 --minquality=1 --notstrict --nochanges
> --notempty
> pwpolicy user --minlen=6 --minquality=1 --notstrict --nochanges
> --emptyok
> pwpolicy luks --minlen=6 --minquality=1 --notstrict --nochanges
> --notempty
> %end
>
> %post --erroronfail --log=/root/ks-post.log
> #!/bin/sh
>
> dnf update -y
>
> # NFS storage
> mkdir -p /opt/ovirt/nfs-storage
> chown -R 36:36 /opt/ovirt/nfs-storage
> chmod 0755 /opt/ovirt/nfs-storage
> echo "/opt/ovirt/nfs-storage localhost" > /etc/exports
> echo "/opt/ovirt/nfs-storage engine.*REDACTED*" >> /etc/exports
> dnf install -y nfs-utils
> systemctl enable nfs-server.service
>
> # Install ovirt packages
> dnf install -y
> https://resources.ovirt.org/pub/yum-repo/ovirt-release44.rpm
> dnf install -y cockpit-ovirt-dashboard ovirt-engine-appliance
>
> # Enable cockpit
> systemctl enable cockpit.socket
>
> %end
>
> #reboot --eject --kexec
> reboot --eject
>
>
> --- Host (nxtvirt) ip -a post deploy-run ---
>
> 1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
> group default qlen 1000
> link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
> inet 127.0.0.1/8 scope host lo
> valid_lft forever preferred_lft forever
> inet6 ::1/128 scope host
> valid_lft forever preferred_lft forever
> 2: enp1s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel
> state UP group default qlen 1000
> link/ether 52:54:00:ad:79:1b brd ff:ff:ff:ff:ff:ff
> inet 192.168.199.250/24 brd 192.168.199.255 scope global
> noprefixroute enp1s0
> valid_lft forever preferred_lft forever
> inet6 *REDACTED*:1099:babe::250/64 scope global noprefixroute
> valid_lft forever preferred_lft forever
> inet6 fe80::5054:ff:fead:791b/64 scope link noprefixroute
> valid_lft forever preferred_lft forever
> 5: virbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
> state UP group default qlen 1000
> link/ether 52:54:00:94:f3:14 brd ff:ff:ff:ff:ff:ff
> inet6 fd00:1234:5678:900::1/64 scope global
> valid_lft forever preferred_lft forever
> inet6 fe80::5054:ff:fe94:f314/64 scope link
> valid_lft forever preferred_lft forever
> 6: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel master
> virbr0 state DOWN group default qlen 1000
> link/ether 52:54:00:94:f3:14 brd ff:ff:ff:ff:ff:ff
> 7: vnet0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel
> master virbr0 state UNKNOWN group default qlen 1000
> link/ether fe:16:3e:68:d3:8a brd ff:ff:ff:ff:ff:ff
> inet6 fe80::fc16:3eff:fe68:d38a/64 scope link
> valid_lft forever preferred_lft forever
>
>
> --- iptables-save post deploy-run ---
>
> # Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
> *filter
> :INPUT ACCEPT [4007:8578553]
> :FORWARD ACCEPT [0:0]
> :OUTPUT ACCEPT [3920:7633249]
> :LIBVIRT_INP - [0:0]
> :LIBVIRT_OUT - [0:0]
> :LIBVIRT_FWO - [0:0]
> :LIBVIRT_FWI - [0:0]
> :LIBVIRT_FWX - [0:0]
> -A INPUT -j LIBVIRT_INP
> -A FORWARD -j LIBVIRT_FWX
> -A FORWARD -j LIBVIRT_FWI
> -A FORWARD -j LIBVIRT_FWO
> -A OUTPUT -j LIBVIRT_OUT
> -A LIBVIRT_INP -i virbr0 -p udp -m udp --dport 53 -j ACCEPT
> -A LIBVIRT_INP -i virbr0 -p tcp -m tcp --dport 53 -j ACCEPT
> -A LIBVIRT_INP -i virbr0 -p udp -m udp --dport 67 -j ACCEPT
> -A LIBVIRT_INP -i virbr0 -p tcp -m tcp --dport 67 -j ACCEPT
> -A LIBVIRT_OUT -o virbr0 -p udp -m udp --dport 53 -j ACCEPT
> -A LIBVIRT_OUT -o virbr0 -p tcp -m tcp --dport 53 -j ACCEPT
> -A LIBVIRT_OUT -o virbr0 -p udp -m udp --dport 68 -j ACCEPT
> -A LIBVIRT_OUT -o virbr0 -p tcp -m tcp --dport 68 -j ACCEPT
> -A LIBVIRT_FWO -i virbr0 -j REJECT --reject-with icmp-port-unreachable
> -A LIBVIRT_FWI -o virbr0 -j REJECT --reject-with icmp-port-unreachable
> -A LIBVIRT_FWX -i virbr0 -o virbr0 -j ACCEPT
> COMMIT
> # Completed on Sun Jun 28 13:20:53 2020
> # Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
> *security
> :INPUT ACCEPT [3959:8576054]
> :FORWARD ACCEPT [0:0]
> :OUTPUT ACCEPT [3920:7633249]
> COMMIT
> # Completed on Sun Jun 28 13:20:53 2020
> # Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
> *raw
> :PREROUTING ACCEPT [4299:8608260]
> :OUTPUT ACCEPT [3920:7633249]
> COMMIT
> # Completed on Sun Jun 28 13:20:53 2020
> # Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
> *mangle
> :PREROUTING ACCEPT [4299:8608260]
> :INPUT ACCEPT [4007:8578553]
> :FORWARD ACCEPT [0:0]
> :OUTPUT ACCEPT [3920:7633249]
> :POSTROUTING ACCEPT [3923:7633408]
> :LIBVIRT_PRT - [0:0]
> -A POSTROUTING -j LIBVIRT_PRT
> COMMIT
> # Completed on Sun Jun 28 13:20:53 2020
> # Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
> *nat
> :PREROUTING ACCEPT [337:32047]
> :INPUT ACCEPT [0:0]
> :POSTROUTING ACCEPT [159:9351]
> :OUTPUT ACCEPT [159:9351]
> :LIBVIRT_PRT - [0:0]
> -A POSTROUTING -j LIBVIRT_PRT
> COMMIT
> # Completed on Sun Jun 28 13:20:53 2020
>
> _______________________________________________
> Users mailing list -- users(a)ovirt.org
> To unsubscribe send an email to users-leave(a)ovirt.org
> Privacy Statement: https://www.ovirt.org/privacy-policy.html
> oVirt Code of Conduct:
> https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
>
https://lists.ovirt.org/archives/list/users@ovirt.org/message/G452P2BN7Z7...
_______________________________________________
Users mailing list -- users(a)ovirt.org
To unsubscribe send an email to users-leave(a)ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/LDMPLC4622A...
10:49 a.m.
New subject: Lots of problems with deploying the hosted-engine (ovirt 4.4 | CentOS 8.2.2004)
Il giorno dom 28 giu 2020 alle ore 16:38 jonas <jonas(a)selfnet.de> ha
scritto:
Hi!
I have banged my head against deploying the ovirt 4.4 self-hosted engine
on Centos 8.2 for last couple of days.
First I was astonished that resources.ovirt.org has no IPv6
connectivity, which made my initial plan for a mostly IPv6-only
deployment impossible.
We have an open ticket about it here:
https://ovirt-jira.atlassian.net/browse/OVIRT-2268
You can try using one of the mirrors:
https://resources.ovirt.org/pub/yum-repo/mirrorlist
One of them may have IPv6 enabled.
CentOS was installed from scratch using the ks.cgf Kickstart file below,
which also adds the ovirt 4.4 repo and installs cockpit-ovirt-dashboard
& ovirt-engine-appliance.
When deploying the hosted-engine from cockpit while logged in as a
non-root (although privileged) user, the "(3) Prepare VM" step instantly
fails with a nondescript error message and without generating any logs.
By using the browser dev tools it was determined that this was because
the ansible vars file could not be created as the non-root user did not
have write permissions in '/var/lib/ovirt-hosted-engine-setup/cockpit/'
. Shouldn't cockpit be capable of using sudo when appropriate, or at
least give a more descriptive error message?
oVirt doesn't support running hosted engine deployment as non-root user.
After login into cockpit as root, or when using the command line
ovirt-hosted-engine-setup tool, the deployment fails with "Failed to
download metadata for repo 'AppStream'".
This seems to be because a) the dnsmasq running on the host does not
forward dns queries, even though the host itself can resolve dns queries
just fine, and b) there also does not seem to be any functioning routing
setup to reach anything outside the host.
Regarding a) it is strange that dnsmasq is running with a config file
'/var/lib/libvirt/dnsmasq/default.conf' containing the 'no-resolv'
option. Could the operation of systemd-resolved be interfering with
dnsmasq (see ss -tulpen output)? I tried to manually stop
systemd-resolved, but got the same behaviour as before.
Never seen something like this happening, +Dominik Holler
<dholler(a)redhat.com> can you help here?
I hope someone could give me a hint how I could get past this problem,
as so far my ovirt experience has been a little bit sub-par. :D
Also when running ovirt-hosted-engine-cleanup, the extracted engine VMs
in /var/tmp/localvm* are not removed, leading to a "disk-memory-leak"
with subsequent runs.
yes the recomendation is to run again the deployment from scratch, the
cleanup tool has no guarantee to remove everything from the host so it may
have some file left around on the system.
Best regards
Jonas
--- ss -tulpen output post deploy-run ---
[root@nxtvirt ~]# ss -tulpen | grep ':53 '
udp UNCONN 0 0 127.0.0.53%lo:53
0.0.0.0:* users:(("systemd-resolve",pid=1379,fd=18)) uid:193
ino:32910 sk:6 <->
udp UNCONN 0 0 [fd00:1234:5678:900::1]:53
[::]:* users:(("dnsmasq",pid=13525,fd=15)) uid:979 ino:113580
sk:d v6only:1 <->
udp UNCONN 0 0 [fe80::5054:ff:fe94:f314]%virbr0:53
[::]:* users:(("dnsmasq",pid=13525,fd=12)) uid:979 ino:113575
sk:e v6only:1 <->
tcp LISTEN 0 32 [fd00:1234:5678:900::1]:53
[::]:* users:(("dnsmasq",pid=13525,fd=16)) uid:979 ino:113581
sk:20 v6only:1 <->
tcp LISTEN 0 32 [fe80::5054:ff:fe94:f314]%virbr0:53
[::]:* users:(("dnsmasq",pid=13525,fd=13)) uid:979 ino:113576
sk:21 v6only:1 <->
--- running dnsmasq processes on host ('nxtvirt') post deploy-run ---
dnsmasq 13525 0.0 0.0 71888 2344 ? S 12:31 0:00
/usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf
--leasefile-ro --dhcp-script=/usr/libexec/libvirt_leaseshelper
root 13526 0.0 0.0 71860 436 ? S 12:31 0:00
/usr/sbin/dnsmasq --conf-file=/var/lib/libvirt/dnsmasq/default.conf
--leasefile-ro --dhcp-script=/usr/libexec/libvirt_leaseshelper
--- var/lib/libvirt/dnsmasq/default.conf ---
##WARNING: THIS IS AN AUTO-GENERATED FILE. CHANGES TO IT ARE LIKELY TO
BE
##OVERWRITTEN AND LOST. Changes to this configuration should be made
using:
## virsh net-edit default
## or other application using the libvirt API.
##
## dnsmasq conf file created by libvirt
strict-order
pid-file=/run/libvirt/network/default.pid
except-interface=lo
bind-dynamic
interface=virbr0
dhcp-option=3
no-resolv
ra-param=*,0,0
dhcp-range=fd00:1234:5678:900::10,fd00:1234:5678:900::ff,64
dhcp-lease-max=240
dhcp-hostsfile=/var/lib/libvirt/dnsmasq/default.hostsfile
addn-hosts=/var/lib/libvirt/dnsmasq/default.addnhosts
enable-ra
--- cockpit wizard overview before the 'Prepare VM' step ---
VM
Engine FQDN:engine.*REDACTED*
MAC Address:00:16:3e:20:13:b3
Network Configuration:Static
VM IP Address:*REDACTED*:1099:babe::3/64
Gateway Address:*REDACTED*:1099::1
DNS Servers:*REDACTED*:1052::11
Root User SSH Access:yes
Number of Virtual CPUs:4
Memory Size (MiB):4096
Root User SSH Public Key:(None)
Add Lines to /etc/hosts:yes
Bridge Name:ovirtmgmt
Apply OpenSCAP profile:no
Engine
SMTP Server Name:localhost
SMTP Server Port Number:25
Sender E-Mail Address:root@localhost
Recipient E-Mail Addresses:root@localhost
--- ks.cgf ---
#version=RHEL8
ignoredisk --only-use=vda
autopart --type=lvm
# Partition clearing information
clearpart --drives=vda --all --initlabel
# Use graphical install
#graphical
text
# Use CDROM installation media
cdrom
# Keyboard layouts
keyboard --vckeymap=de --xlayouts='de','us'
# System language
lang en_US.UTF-8
# Network information
network --bootproto=static --device=enp1s0 --ip=192.168.199.250
--netmask=255.255.255.0 --gateway=192.168.199.10
--ipv6=*REDACTED*:1090:babe::250/64 --ipv6gateway=*REDACTED*:1090::1
--hostname=nxtvirt.*REDACTED* --nameserver=*REDACTED*:1052::11
--activate
network --hostname=nxtvirt.*REDACTED*
# Root password
rootpw --iscrypted $6$*REDACTED*
firewall --enabled --service=cockpit --service=ssh
# Run the Setup Agent on first boot
firstboot --enable
# Do not configure the X Window System
skipx
# System services
services --enabled="chronyd"
# System timezone
timezone Etc/UTC --isUtc --ntpservers=ntp.*REDACTED*,ntp2.*REDACTED*
user --name=nonrootuser --groups=wheel --password=$6$*REDACTED*
--iscrypted
# KVM Users/Groups
group --name=kvm --gid=36
user --name=vdsm --uid=36 --gid=36
%packages
@^server-product-environment
#@graphical-admin-tools
@headless-management
kexec-tools
cockpit
%end
%addon com_redhat_kdump --enable --reserve-mb='auto'
%end
%anaconda
pwpolicy root --minlen=6 --minquality=1 --notstrict --nochanges
--notempty
pwpolicy user --minlen=6 --minquality=1 --notstrict --nochanges
--emptyok
pwpolicy luks --minlen=6 --minquality=1 --notstrict --nochanges
--notempty
%end
%post --erroronfail --log=/root/ks-post.log
#!/bin/sh
dnf update -y
# NFS storage
mkdir -p /opt/ovirt/nfs-storage
chown -R 36:36 /opt/ovirt/nfs-storage
chmod 0755 /opt/ovirt/nfs-storage
echo "/opt/ovirt/nfs-storage localhost" > /etc/exports
echo "/opt/ovirt/nfs-storage engine.*REDACTED*" >> /etc/exports
dnf install -y nfs-utils
systemctl enable nfs-server.service
# Install ovirt packages
dnf install -y
https://resources.ovirt.org/pub/yum-repo/ovirt-release44.rpm
dnf install -y cockpit-ovirt-dashboard ovirt-engine-appliance
# Enable cockpit
systemctl enable cockpit.socket
%end
#reboot --eject --kexec
reboot --eject
--- Host (nxtvirt) ip -a post deploy-run ---
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN
group default qlen 1000
link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
inet 127.0.0.1/8 scope host lo
valid_lft forever preferred_lft forever
inet6 ::1/128 scope host
valid_lft forever preferred_lft forever
2: enp1s0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel
state UP group default qlen 1000
link/ether 52:54:00:ad:79:1b brd ff:ff:ff:ff:ff:ff
inet 192.168.199.250/24 brd 192.168.199.255 scope global
noprefixroute enp1s0
valid_lft forever preferred_lft forever
inet6 *REDACTED*:1099:babe::250/64 scope global noprefixroute
valid_lft forever preferred_lft forever
inet6 fe80::5054:ff:fead:791b/64 scope link noprefixroute
valid_lft forever preferred_lft forever
5: virbr0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue
state UP group default qlen 1000
link/ether 52:54:00:94:f3:14 brd ff:ff:ff:ff:ff:ff
inet6 fd00:1234:5678:900::1/64 scope global
valid_lft forever preferred_lft forever
inet6 fe80::5054:ff:fe94:f314/64 scope link
valid_lft forever preferred_lft forever
6: virbr0-nic: <BROADCAST,MULTICAST> mtu 1500 qdisc fq_codel master
virbr0 state DOWN group default qlen 1000
link/ether 52:54:00:94:f3:14 brd ff:ff:ff:ff:ff:ff
7: vnet0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc fq_codel
master virbr0 state UNKNOWN group default qlen 1000
link/ether fe:16:3e:68:d3:8a brd ff:ff:ff:ff:ff:ff
inet6 fe80::fc16:3eff:fe68:d38a/64 scope link
valid_lft forever preferred_lft forever
--- iptables-save post deploy-run ---
# Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
*filter
:INPUT ACCEPT [4007:8578553]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [3920:7633249]
:LIBVIRT_INP - [0:0]
:LIBVIRT_OUT - [0:0]
:LIBVIRT_FWO - [0:0]
:LIBVIRT_FWI - [0:0]
:LIBVIRT_FWX - [0:0]
-A INPUT -j LIBVIRT_INP
-A FORWARD -j LIBVIRT_FWX
-A FORWARD -j LIBVIRT_FWI
-A FORWARD -j LIBVIRT_FWO
-A OUTPUT -j LIBVIRT_OUT
-A LIBVIRT_INP -i virbr0 -p udp -m udp --dport 53 -j ACCEPT
-A LIBVIRT_INP -i virbr0 -p tcp -m tcp --dport 53 -j ACCEPT
-A LIBVIRT_INP -i virbr0 -p udp -m udp --dport 67 -j ACCEPT
-A LIBVIRT_INP -i virbr0 -p tcp -m tcp --dport 67 -j ACCEPT
-A LIBVIRT_OUT -o virbr0 -p udp -m udp --dport 53 -j ACCEPT
-A LIBVIRT_OUT -o virbr0 -p tcp -m tcp --dport 53 -j ACCEPT
-A LIBVIRT_OUT -o virbr0 -p udp -m udp --dport 68 -j ACCEPT
-A LIBVIRT_OUT -o virbr0 -p tcp -m tcp --dport 68 -j ACCEPT
-A LIBVIRT_FWO -i virbr0 -j REJECT --reject-with icmp-port-unreachable
-A LIBVIRT_FWI -o virbr0 -j REJECT --reject-with icmp-port-unreachable
-A LIBVIRT_FWX -i virbr0 -o virbr0 -j ACCEPT
COMMIT
# Completed on Sun Jun 28 13:20:53 2020
# Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
*security
:INPUT ACCEPT [3959:8576054]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [3920:7633249]
COMMIT
# Completed on Sun Jun 28 13:20:53 2020
# Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
*raw
:PREROUTING ACCEPT [4299:8608260]
:OUTPUT ACCEPT [3920:7633249]
COMMIT
# Completed on Sun Jun 28 13:20:53 2020
# Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
*mangle
:PREROUTING ACCEPT [4299:8608260]
:INPUT ACCEPT [4007:8578553]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [3920:7633249]
:POSTROUTING ACCEPT [3923:7633408]
:LIBVIRT_PRT - [0:0]
-A POSTROUTING -j LIBVIRT_PRT
COMMIT
# Completed on Sun Jun 28 13:20:53 2020
# Generated by iptables-save v1.8.4 on Sun Jun 28 13:20:53 2020
*nat
:PREROUTING ACCEPT [337:32047]
:INPUT ACCEPT [0:0]
:POSTROUTING ACCEPT [159:9351]
:OUTPUT ACCEPT [159:9351]
:LIBVIRT_PRT - [0:0]
-A POSTROUTING -j LIBVIRT_PRT
COMMIT
# Completed on Sun Jun 28 13:20:53 2020
_______________________________________________
Users mailing list -- users(a)ovirt.org
To unsubscribe send an email to users-leave(a)ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/G452P2BN7Z7...
--
Sandro Bonazzola
MANAGER, SOFTWARE ENGINEERING, EMEA R&D RHV
Red Hat EMEA <https://www.redhat.com/>
sbonazzo(a)redhat.com
<https://www.redhat.com/>
*Red Hat respects your work life balance. Therefore there is no need to
answer this email out of your office hours.
<https://mojo.redhat.com/docs/DOC-1199578>*
1624
days inactive
1639
days old
6 comments
5 participants
participants (5)
-
Asaf Rachmani -
jonas -
jonas＠selfnet.de
-
Sandro Bonazzola -
shadow emy