Re: [ovirt-users] Hyper converged network setup

From each node. Maybe post to pastebin or something so its easier to read

Hi, I've reinstalled Centos minimal on 3 hosts. Configured replica 3 gluster storage for engine & data. Configured dns entry in /etc/hosts for all three host and ovirt engine also. *yum install ovirt-engine-appliance* *hosted-engine --deploy* Choose glusterfs storage for engine. Installation failed at last step "This system is not reliable". My host have low memory & processor so don't know it might be the issue. Please help. Regrards Bharat Kumar G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad Udaipur (Raj.) 313001 Mob: +91-9950-9960-25 On Fri, Sep 15, 2017 at 12:51 PM, Tailor, Bharat < bharat(a)synergysystemsindia.com&gt; wrote: > Hi, > > Any help from you guys would be appreciated. > > Regrards > Bharat Kumar > > G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad > Udaipur (Raj.) > 313001 > Mob: +91-9950-9960-25 > > > > > > On Thu, Sep 14, 2017 at 7:02 PM, Tailor, Bharat < > bharat(a)synergysystemsindia.com&gt; wrote: > >> Hi, >> >> I've reinstall Centos7 Minimal on all three hosts. Installed Ovirt self >> hosted ova 4.1 on test1.localdomain. >> After installation completed, I got an error like engine vm is >> unreachable. I am able to ping engine from both IP and FQDN but unable to >> access it in browser. When I check engine VM status I got an error "Failed >> to connect to broker". >> I've enclosed engine-vm config snap and Error snap for more details. >> Kind help to resolve it. >> >> >> Regrards >> Bharat Kumar >> >> G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad >> Udaipur (Raj.) >> 313001 >> Mob: +91-9950-9960-25 >> >> >> >> >> >> On Wed, Sep 13, 2017 at 5:14 PM, Tailor, Bharat < >> bharat(a)synergysystemsindia.com&gt; wrote: >> >>> I can't. I've destroyed that VM and clean all files. Now I am trying to >>> reinstall new engine VM. >>> >>> Regrards >>> Bharat Kumar >>> >>> G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad >>> Udaipur (Raj.) >>> 313001 >>> Mob: +91-9950-9960-25 >>> >>> >>> >>> >>> >>> On Wed, Sep 13, 2017 at 5:12 PM, Donny Davis <donny(a)fortnebula.com&gt; >>> wrote: >>> >>>> Can you ping the VM when it comes up? >>>> >>>> On Wed, Sep 13, 2017 at 7:40 AM, Tailor, Bharat < >>>> bharat(a)synergysystemsindia.com&gt; wrote: >>>> >>>>> I am not using any DNS server. I have made entries in /etc/hosts for >>>>> all Nodes and for engine VM also. >>>>> >>>>> Regrards >>>>> Bharat Kumar >>>>> >>>>> G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad >>>>> Udaipur (Raj.) >>>>> 313001 >>>>> Mob: +91-9950-9960-25 >>>>> >>>>> >>>>> >>>>> >>>>> >>>>> On Wed, Sep 13, 2017 at 5:02 PM, Donny Davis <donny(a)fortnebula.com&gt; >>>>> wrote: >>>>> >>>>>> Bharat, >>>>>> >>>>>> Are you using DNS for host names or /etc/hosts >>>>>> >>>>>> I personally place the engines hostname with ip address in >>>>>> /etc/hosts on all the hypervisors in case my DNS services go down. >>>>>> I also put the hypervisors in /etc/hosts too >>>>>> >>>>>> Hope this helps. >>>>>> >>>>>> On Wed, Sep 13, 2017 at 6:04 AM, Yaniv Kaul <ykaul(a)redhat.com&gt; >>>>>> wrote: >>>>>> >>>>>>> >>>>>>> >>>>>>> On Wed, Sep 13, 2017 at 8:42 AM, Tailor, Bharat < >>>>>>> bharat(a)synergysystemsindia.com&gt; wrote: >>>>>>> >>>>>>>> Hi Charles & Donny, >>>>>>>> >>>>>>>> Thank you so much. >>>>>>>> >>>>>>>> @Donny my 3rd node's IP is 192.168.100.17(Mentioned wrong in above >>>>>>>> mail). >>>>>>>> I was trying to install ovirt ova on test2.localdomain. I've >>>>>>>> cleared all the steps and at last I got a message like "Engine is still >>>>>>>> unreachable". Kindly help me to troubleshoot it. >>>>>>>> >>>>>>>> @Ykaul How can I register myself in mailing list? >>>>>>>> >>>>>>> >>>>>>> http://lists.ovirt.org/mailman/listinfo/users >>>>>>> >>>>>>> Y. >>>>>>> >>>>>>> >>>>>>>> >>>>>>>> Regrards >>>>>>>> Bharat Kumar >>>>>>>> >>>>>>>> G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad >>>>>>>> Udaipur (Raj.) >>>>>>>> 313001 >>>>>>>> Mob: +91-9950-9960-25 >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> On Wed, Sep 13, 2017 at 3:06 AM, Charles Kozler < >>>>>>>> ckozleriii(a)gmail.com&gt; wrote: >>>>>>>> >>>>>>>>> Bharat - >>>>>>>>> >>>>>>>>> 1. Yes. Will need to configure switch port as a trunk and setup >>>>>>>>> your VLANs and VLAN ID's >>>>>>>>> 2. Yes >>>>>>>>> 3. You can still access the hosts. The engine itself crashing or >>>>>>>>> being down wont stop your VMs or hosts or anything (unless fencing). You >>>>>>>>> can use virsh >>>>>>>>> 4. My suggestion here is start immediately after a fresh server >>>>>>>>> install and yum update. Installer does a lot and checks a lot and wont like >>>>>>>>> things: ex - you setup ovirtmgmt bridged network yourself >>>>>>>>> 5. Yes. See #1, usually what I do is each ovirt node I have I set >>>>>>>>> an IP of .5, then .6, and so on. This way I can be sure my network itself >>>>>>>>> is working before adding a VM and attaching that NIC to it >>>>>>>>> >>>>>>>>> On Tue, Sep 12, 2017 at 4:41 PM, Donny Davis < >>>>>>>>> donny(a)fortnebula.com&gt; wrote: >>>>>>>>> >>>>>>>>>> 1. Yes, you can do this >>>>>>>>>> 2. Yes, In linux it's called bonding and this can be done from >>>>>>>>>> the UI >>>>>>>>>> 3. You can get around using the Engine machine if required with >>>>>>>>>> virsh or virt-manager - however I would just wait for the manager to >>>>>>>>>> migrate and start on another host in the cluster >>>>>>>>>> 4. The deployment will take care of everything for you. You >>>>>>>>>> just need an IP >>>>>>>>>> 5. Yes, you can use vlans or virtual networking(NSXish) called >>>>>>>>>> OVS in oVirt. >>>>>>>>>> >>>>>>>>>> I noticed on your deployment machines 2 and 3 have the same IP. >>>>>>>>>> Might want to fix that before deploying >>>>>>>>>> >>>>>>>>>> Happy trails >>>>>>>>>> ~D >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Tue, Sep 12, 2017 at 2:00 PM, Tailor, Bharat < >>>>>>>>>> bharat(a)synergysystemsindia.com&gt; wrote: >>>>>>>>>> >>>>>>>>>>> Hi Charles, >>>>>>>>>>> >>>>>>>>>>> Thank you so much to share a cool stuff with us. >>>>>>>>>>> >>>>>>>>>>> My doubts are still not cleared. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> 1. What If I have only single Physical network adaptor? >>>>>>>>>>> Can't I use it for management network & production network both. >>>>>>>>>>> 2. If I have two Physical network adaptor, Can I configure >>>>>>>>>>> NIC teaming as like Vmware ESXi. >>>>>>>>>>> 3. What If my ovirt machine fails during production period? >>>>>>>>>>> In vmware we can access ESXi hosts and VM without Vcenter and do all the >>>>>>>>>>> stuffs. Can we do the same with Ovirt & KVM. >>>>>>>>>>> 4. To deploy ovirt engine VM, what kind of configuration >>>>>>>>>>> I'll have to do on network adaptors? (eg. just configure IP on physical >>>>>>>>>>> network or have to create br0 for it.) >>>>>>>>>>> 5. Can I make multiple VM networks for vlan configuration? >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> Regrards >>>>>>>>>>> Bharat Kumar >>>>>>>>>>> >>>>>>>>>>> G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad >>>>>>>>>>> Udaipur (Raj.) >>>>>>>>>>> 313001 >>>>>>>>>>> Mob: +91-9950-9960-25 >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Tue, Sep 12, 2017 at 9:30 PM, Charles Kozler < >>>>>>>>>>> ckozleriii(a)gmail.com&gt; wrote: >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> Interestingly enough I literally just went through this same >>>>>>>>>>>> thing with a slight variation. >>>>>>>>>>>> >>>>>>>>>>>> Note to the below: I am not sure if this would be considerd >>>>>>>>>>>> best practice or good for something long term support but I made due with >>>>>>>>>>>> what I had >>>>>>>>>>>> >>>>>>>>>>>> I had 10Gb cards for my storage network but no 10Gb switch, so >>>>>>>>>>>> I direct connected them with some fun routing and /etc/hosts settings. I >>>>>>>>>>>> also didnt want my storage network on a routed network (have firewalls in >>>>>>>>>>>> the way of VLANs) and I wanted the network separate from my ovirtmgmt - >>>>>>>>>>>> and, as I said, had no switches for 10Gb. Here is what you need at a bare >>>>>>>>>>>> minimum. Adapt / change it as you need >>>>>>>>>>>> >>>>>>>>>>>> 1 dedicated NIC on each node for ovirtmgmt. Ex: eth0 >>>>>>>>>>>> >>>>>>>>>>>> 1 dedicated NIC to direct connect node 1 and node 2 - eth1 >>>>>>>>>>>> node1 >>>>>>>>>>>> 1 dedicated NIC to direct connect node 1 and node 3 - eth2 >>>>>>>>>>>> node1 >>>>>>>>>>>> >>>>>>>>>>>> 1 dedicated NIC to direct connect node 2 and node 1 - eth1 >>>>>>>>>>>> node2 >>>>>>>>>>>> 1 dedicated NIC to direct connect node 2 and node 3 - eth2 >>>>>>>>>>>> node2 >>>>>>>>>>>> >>>>>>>>>>>> 1 dedicated NIC to direct connect node 3 and node 1 - eth1 >>>>>>>>>>>> node3 >>>>>>>>>>>> 1 dedicated NIC to direct connect node 3 and node 2 - eth2 >>>>>>>>>>>> node3 >>>>>>>>>>>> >>>>>>>>>>>> You'll need custom routes too: >>>>>>>>>>>> >>>>>>>>>>>> Route to node 3 from node 1 via eth2 >>>>>>>>>>>> Route to node 3 from node 2 via eth2 >>>>>>>>>>>> Route to node 2 from node 3 via eth2 >>>>>>>>>>>> >>>>>>>>>>>> Finally, entries in your /etc/hosts which match to your routes >>>>>>>>>>>> above >>>>>>>>>>>> >>>>>>>>>>>> Then, advisably, a dedicated NIC per box for VM network but >>>>>>>>>>>> you can leverage ovirtmgmt if you are just proofing this out >>>>>>>>>>>> >>>>>>>>>>>> At this point if you can reach all of your nodes via this >>>>>>>>>>>> direct connect IPs then you setup gluster as you normally would referencing >>>>>>>>>>>> your entries in /etc/hosts when you call "gluster volume create" >>>>>>>>>>>> >>>>>>>>>>>> In my setup, as I said, I had 2x 2 port PCIe 10Gb cards per >>>>>>>>>>>> server so I setup LACP as well as you can see below >>>>>>>>>>>> >>>>>>>>>>>> This is what my Frankenstein POC looked like: >>>>>>>>>>>> http://i.imgur.com/iURL9jv.png >>>>>>>>>>>> >>>>>>>>>>>> You can optionally choose to setup this network in ovirt as >>>>>>>>>>>> well (and add the NICs to each host) but dont configure it as a VM network. >>>>>>>>>>>> Then you can also, with some other minor tweaks, use these direct connects >>>>>>>>>>>> as migration networks rather than ovirtmgmt or VM network >>>>>>>>>>>> >>>>>>>>>>>> On Tue, Sep 12, 2017 at 9:12 AM, Tailor, Bharat < >>>>>>>>>>>> bharat(a)synergysystemsindia.com&gt; wrote: >>>>>>>>>>>> >>>>>>>>>>>>> Hi, >>>>>>>>>>>>> >>>>>>>>>>>>> I am trying to deploy 3 hosts hyper converged setup. >>>>>>>>>>>>> I am using Centos and installed KVM on all hosts. >>>>>>>>>>>>> >>>>>>>>>>>>> Host-1 >>>>>>>>>>>>> Hostname - test1.localdomain >>>>>>>>>>>>> eth0 - 192.168.100.15/24 >>>>>>>>>>>>> GW - 192.168.100.1 >>>>>>>>>>>>> >>>>>>>>>>>>> Hoat-2 >>>>>>>>>>>>> Hostname - test2.localdomain >>>>>>>>>>>>> eth0 - 192.168.100.16/24 >>>>>>>>>>>>> GW - 192.168.100.1 >>>>>>>>>>>>> >>>>>>>>>>>>> Host-3 >>>>>>>>>>>>> Hostname - test3.localdomain >>>>>>>>>>>>> eth0 - 192.168.100.16/24 >>>>>>>>>>>>> GW - 192.168.100.1 >>>>>>>>>>>>> >>>>>>>>>>>>> I have created two gluster volume "engine" & "data" with >>>>>>>>>>>>> replica 3. >>>>>>>>>>>>> I have add fqdn entry in /etc/hosts for all host for DNS >>>>>>>>>>>>> resolution. >>>>>>>>>>>>> >>>>>>>>>>>>> I want to deploy Ovirt engine self hosted OVA to manage all >>>>>>>>>>>>> the hosts and production VM and my ovirt-engine VM should have HA enabled. >>>>>>>>>>>>> >>>>>>>>>>>>> I found multiple docs over internet to deply >>>>>>>>>>>>> Self-hosted-engine-ova but I don't what kind of network configuration I've >>>>>>>>>>>>> to do on Centos network card & KVM. As KVM docs suggest that I've to create >>>>>>>>>>>>> a bridge network for Pnic to Vnic bridge. If I configure a bridge br0 for >>>>>>>>>>>>> eth0 bridge that I can't see eth0 while deploying ovirt-engine setup at NIC >>>>>>>>>>>>> card choice. >>>>>>>>>>>>> >>>>>>>>>>>>> Kindly help me to do correct configuration for Centos hosts, >>>>>>>>>>>>> KVM & ovirt-engine-vm for HA enabled DC. >>>>>>>>>>>>> Regrards >>>>>>>>>>>>> Bharat Kumar >>>>>>>>>>>>> >>>>>>>>>>>>> G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad >>>>>>>>>>>>> Udaipur (Raj.) >>>>>>>>>>>>> 313001 >>>>>>>>>>>>> Mob: +91-9950-9960-25 >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> _______________________________________________ >>>>>>>>>>>>> Users mailing list >>>>>>>>>>>>> Users(a)ovirt.org >>>>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> _______________________________________________ >>>>>>>>>>> Users mailing list >>>>>>>>>>> Users(a)ovirt.org >>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>> >>>>>> >>>>> >>>> >>> >> > _______________________________________________ Users mailing list Users(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/users