Single Node Hyperconverged - Failing Engine Deployment - Network setup?
Ovirt newbie here - installing v 4.4.4 (well, trying to!) Following my post about failing Gluster setup, I can't get the self hosted engine to deploy. I'm installing on my HP DL380p G6. I have 2 disk 170GB Raid 0 for OS and 6 x 330GB disk Raid 5 for Gluster. DNS all set up, but Im realizing I'm missing something here. I have a feeling my problems with Gluster/Engine were caused by incorrect network setup. Seems I'm not the 1st to fall at this hurdle - some people in the community are saying RH have made it's deliberately difficult to get these 'free' set-ups working. It does feel a little like that! Most instructions just say that a 'self hosted, hyperconverged, single node setup requires 2 nics' - and that's about it! That is the 'Networking Pre-requisites'! I've had some help on here and Reddit which eventually made me find a solution some had had to use - editing lvm.conf to make sure my drive (sdb) was being blacklisted correctly. So, with that, Gluster installs, with following DNS settings: The kvm host (ovirt-kvm.whichelo.com) is fixed ip 192.168.0.40 on my 1st nic (Enp0s7) ovirt-engine.whichelo.com - 192.168.0.50 and ovirt-gluster.whichelo.com on 192.168.0.60 - I created I VLAN linked to the nic i want to use for gluster (Enp0s8) and gluster install worked. So now hosted engine won't install,, and pretty sure it's because I don't know how to set the network up properly. I'm seeing virbr0 coming up with different ip's - sometimes 192.168.1.1, sometimes 192.168.222.1. From what I've read, this is something to do with the Engine's network, but I really don't know! Am I still missing something? I can't find any decent instructions on how to do this - how (exactly) to configure the 2 'minimum required' nics? I came to Ovirt after realizing Oracle were dumping their own Virtualization platform in favour of KVM. Couldn't set it up from Oracle so moved to Red Hat - that was a no, and I was at the point where it made most sense to just run an Ovirt node for my KVM. I've got much further with Ovirt, but instructions do not work as easily as they looked! (example 'just click on single node hyperconverged' which didn't work straight off the bat until removing that LVM filter, which took days to find out! The single node HC server is a great match for a home lab/server like mine. I don't want another server, let alone another 2! I'm doing this partly as hobby, but also to update my skills during lockdown. Surely if we can get people using things like this at home, they're more likely to end up using it for work one day? Any help, or just pointing in the right direction, gratefully received! Hopefully I'm a biit clearer here. Happy to provide any logs or anything else.... Thank you!
On Thu, Feb 11, 2021 at 1:08 AM <jhamiltonactually@gmail.com> wrote:
Ovirt newbie here - installing v 4.4.4 (well, trying to!)
Following my post about failing Gluster setup, I can't get the self hosted engine to deploy. I'm installing on my HP DL380p G6. I have 2 disk 170GB Raid 0 for OS and 6 x 330GB disk Raid 5 for Gluster. DNS all set up, but Im realizing I'm missing something here. I have a feeling my problems with Gluster/Engine were caused by incorrect network setup. Seems I'm not the 1st to fall at this hurdle - some people in the community are saying RH have made it's deliberately difficult to get these 'free' set-ups working. It does feel a little like that!
Most instructions just say that a 'self hosted, hyperconverged, single node setup requires 2 nics' - and that's about it! That is the 'Networking Pre-requisites'!
I've had some help on here and Reddit which eventually made me find a solution some had had to use - editing lvm.conf to make sure my drive (sdb) was being blacklisted correctly.
So, with that, Gluster installs, with following DNS settings: The kvm host (ovirt-kvm.whichelo.com) is fixed ip 192.168.0.40 on my 1st nic (Enp0s7) ovirt-engine.whichelo.com - 192.168.0.50 and ovirt-gluster.whichelo.com on 192.168.0.60 - I created I VLAN linked to the nic i want to use for gluster (Enp0s8) and gluster install worked.
So now hosted engine won't install,, and pretty sure it's because I don't know how to set the network up properly. I'm seeing virbr0 coming up with different ip's - sometimes 192.168.1.1, sometimes 192.168.222.1. From what I've read, this is something to do with the Engine's network, but I really don't know!
You can/should ignore these - they are temporary, only relevant during the deployment process.
Am I still missing something? I can't find any decent instructions on how to do this - how (exactly) to configure the 2 'minimum required' nics?
I came to Ovirt after realizing Oracle were dumping their own Virtualization platform in favour of KVM. Couldn't set it up from Oracle so moved to Red Hat - that was a no, and I was at the point where it made most sense to just run an Ovirt node for my KVM. I've got much further with Ovirt, but instructions do not work as easily as they looked! (example 'just click on single node hyperconverged' which didn't work straight off the bat until removing that LVM filter, which took days to find out!
The single node HC server is a great match for a home lab/server like mine. I don't want another server, let alone another 2! I'm doing this partly as hobby, but also to update my skills during lockdown. Surely if we can get people using things like this at home, they're more likely to end up using it for work one day?
Any help, or just pointing in the right direction, gratefully received! Hopefully I'm a biit clearer here. Happy to provide any logs or anything else....
Please share: 1. Exact detailed flow 2. Relevant logs 3. What error messages you got and when. Thanks and best regards, -- Didi
Many thanks Didi I will do this later - I think it may be of benefit to others. I'll start a fresh install on my server and detailed (I'm basically following the Ovirt flow) flow. I'll try get the logs into my gdrive so as not to leave messy posts. I've got my desktop plugged into the same switch as the server. The switch is running DNSMasq and runs the DNS on 192.168.0.2. Network gateway and DHCP server is 192.168.0.1, which is where my internet comes in. DHCP runs from 192.168.0.3 - 30. I assign static IPs for the server services from 192.168.0.40 onwards. I have 2 x 2 port 1Gb nics (4 ports total) on the server. 2 are connected to the router. I'll post everything else later today. Most grateful!
Hi This is a far as I could get today..... frustrating! I can't connect to ovirt-gluster.whichelo.com after install. I can ping the ip no successfully, everything is correct in DNS.... [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for the storage interface to be up] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check local VM dir stat] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enforce local VM dir existence] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Obtain SSO token using username/password credentials] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch host facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch cluster ID] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch cluster facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch Datacenter facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch Datacenter ID] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch Datacenter name] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add NFS storage domain] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add glusterfs storage domain] [ ERROR ] ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Failed to fetch Gluster Volume List]". HTTP response code is 400. [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Fault reason is \"Operation Failed\". Fault detail is \"[Failed to fetch Gluster Volume List]\". HTTP response code is 400."}
You can check /etc/hosts on all nodes.Also verify 'gluster volume list' output from all hosts. Best Regards,Strahil Nikolov Hi This is a far as I could get today..... frustrating! I can't connect to ovirt-gluster.whichelo.com after install. I can ping the ip no successfully, everything is correct in DNS.... [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Execute just a specific set of steps] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Force facts gathering] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Wait for the storage interface to be up] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Check local VM dir stat] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Enforce local VM dir existence] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : include_tasks] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Obtain SSO token using username/password credentials] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch host facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch cluster ID] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch cluster facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch Datacenter facts] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch Datacenter ID] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Fetch Datacenter name] [ INFO ] ok: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add NFS storage domain] [ INFO ] skipping: [localhost] [ INFO ] TASK [ovirt.ovirt.hosted_engine_setup : Add glusterfs storage domain] [ ERROR ] ovirtsdk4.Error: Fault reason is "Operation Failed". Fault detail is "[Failed to fetch Gluster Volume List]". HTTP response code is 400. [ ERROR ] fatal: [localhost]: FAILED! => {"changed": false, "msg": "Fault reason is \"Operation Failed\". Fault detail is \"[Failed to fetch Gluster Volume List]\". HTTP response code is 400."} _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/7ZCXBA7QAKCNKJ...
Hi Sorry about the delay! Here is what I did - which for some reason got further than before, but still failed at the last hurdle! Maybe just doing this exercise of commenting my workflow helped me to fix errors I'd not seen before - I don't know! Have any packages been updated I don't know about? https://docs.google.com/document/d/1SslZJYokA-Ho8SN8Vr5IzTnItuIDA6ACjilvLgCL... Here are the logs from the failed gluster deploy, before I commented out the filter in lvm.conf.... https://docs.google.com/document/d/1uvICx4NBMjC68hhPN98f-LAykyHUPvX5ipr-dUKk... I will update this thread as may be of use to some. Is there anywhere I should post it that other might find easier? Any advice on this final hurdle would be very gratefully received! I have to go do some family stuff, but will update later if I find a solution!
participants (3)
-
jhamiltonactually＠gmail.com -
Strahil Nikolov -
Yedidyah Bar David