[ovirt-users] Hyper converged network setup

Tue Sep 26 12:21:33 UTC 2017

Bharat -

Can you supply the following

grep -i processor /proc/cpuinfo
free -m
gluster volume info

>From each node. Maybe post to pastebin or something so its easier to read

On Tue, Sep 26, 2017 at 3:54 AM, Tailor, Bharat <
bharat at synergysystemsindia.com> wrote:

> Hi,
>
> I've reinstalled Centos minimal on 3 hosts.
> Configured replica 3 gluster storage for engine & data.
> Configured dns entry in /etc/hosts for all three host and ovirt engine
> also.
> *yum install ovirt-engine-appliance*
> *hosted-engine --deploy*
>
> Choose glusterfs storage for engine. Installation failed at last step
> "This system is not reliable".
>
> My host have low memory & processor so don't know it might be the issue.
>
>
> Please help.
>
>
> Regrards
> Bharat Kumar
>
> G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad
> Udaipur (Raj.)
> 313001
> Mob: +91-9950-9960-25
>
>
>
>
>
> On Fri, Sep 15, 2017 at 12:51 PM, Tailor, Bharat <
> bharat at synergysystemsindia.com> wrote:
>
>> Hi,
>>
>> Any help from you guys would be appreciated.
>>
>> Regrards
>> Bharat Kumar
>>
>> G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad
>> Udaipur (Raj.)
>> 313001
>> Mob: +91-9950-9960-25
>>
>>
>>
>>
>>
>> On Thu, Sep 14, 2017 at 7:02 PM, Tailor, Bharat <
>> bharat at synergysystemsindia.com> wrote:
>>
>>> Hi,
>>>
>>> I've reinstall Centos7 Minimal on all three hosts. Installed Ovirt self
>>> hosted ova 4.1 on test1.localdomain.
>>> After installation completed, I got an error like engine vm is
>>> unreachable. I am able to ping engine from both IP and FQDN but unable to
>>> access it in browser. When I check engine VM status I got an error "Failed
>>> to connect to broker".
>>> I've enclosed engine-vm config snap and Error snap for more details.
>>> Kind help to resolve it.
>>>
>>>
>>> Regrards
>>> Bharat Kumar
>>>
>>> G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad
>>> Udaipur (Raj.)
>>> 313001
>>> Mob: +91-9950-9960-25
>>>
>>>
>>>
>>>
>>>
>>> On Wed, Sep 13, 2017 at 5:14 PM, Tailor, Bharat <
>>> bharat at synergysystemsindia.com> wrote:
>>>
>>>> I can't. I've destroyed that VM and clean all files. Now I am trying to
>>>> reinstall new engine VM.
>>>>
>>>> Regrards
>>>> Bharat Kumar
>>>>
>>>> G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad
>>>> Udaipur (Raj.)
>>>> 313001
>>>> Mob: +91-9950-9960-25
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> On Wed, Sep 13, 2017 at 5:12 PM, Donny Davis <donny at fortnebula.com>
>>>> wrote:
>>>>
>>>>> Can you ping the VM when it comes up?
>>>>>
>>>>> On Wed, Sep 13, 2017 at 7:40 AM, Tailor, Bharat <
>>>>> bharat at synergysystemsindia.com> wrote:
>>>>>
>>>>>> I am not using any DNS server. I have made entries in /etc/hosts for
>>>>>> all Nodes and for engine VM also.
>>>>>>
>>>>>> Regrards
>>>>>> Bharat Kumar
>>>>>>
>>>>>> G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad
>>>>>> Udaipur (Raj.)
>>>>>> 313001
>>>>>> Mob: +91-9950-9960-25
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Wed, Sep 13, 2017 at 5:02 PM, Donny Davis <donny at fortnebula.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Bharat,
>>>>>>>
>>>>>>> Are you using DNS for host names or /etc/hosts
>>>>>>>
>>>>>>> I personally place the engines hostname with ip address in
>>>>>>> /etc/hosts on all the hypervisors in case my DNS services go down.
>>>>>>> I also put the hypervisors in /etc/hosts too
>>>>>>>
>>>>>>> Hope this helps.
>>>>>>>
>>>>>>> On Wed, Sep 13, 2017 at 6:04 AM, Yaniv Kaul <ykaul at redhat.com>
>>>>>>> wrote:
>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> On Wed, Sep 13, 2017 at 8:42 AM, Tailor, Bharat <
>>>>>>>> bharat at synergysystemsindia.com> wrote:
>>>>>>>>
>>>>>>>>> Hi Charles & Donny,
>>>>>>>>>
>>>>>>>>> Thank you so much.
>>>>>>>>>
>>>>>>>>> @Donny my 3rd node's IP is 192.168.100.17(Mentioned wrong in above
>>>>>>>>> mail).
>>>>>>>>> I was trying to install ovirt ova on test2.localdomain. I've
>>>>>>>>> cleared all the steps and at last I got a message like "Engine is still
>>>>>>>>> unreachable". Kindly help me to troubleshoot it.
>>>>>>>>>
>>>>>>>>> @Ykaul How can I register myself in mailing list?
>>>>>>>>>
>>>>>>>>
>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>>>
>>>>>>>> Y.
>>>>>>>>
>>>>>>>>
>>>>>>>>>
>>>>>>>>> Regrards
>>>>>>>>> Bharat Kumar
>>>>>>>>>
>>>>>>>>> G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad
>>>>>>>>> Udaipur (Raj.)
>>>>>>>>> 313001
>>>>>>>>> Mob: +91-9950-9960-25
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> On Wed, Sep 13, 2017 at 3:06 AM, Charles Kozler <
>>>>>>>>> ckozleriii at gmail.com> wrote:
>>>>>>>>>
>>>>>>>>>> Bharat -
>>>>>>>>>>
>>>>>>>>>> 1. Yes. Will need to configure switch port as a trunk and setup
>>>>>>>>>> your VLANs and VLAN ID's
>>>>>>>>>> 2. Yes
>>>>>>>>>> 3. You can still access the hosts. The engine itself crashing or
>>>>>>>>>> being down wont stop your VMs or hosts or anything (unless fencing). You
>>>>>>>>>> can use virsh
>>>>>>>>>> 4. My suggestion here is start immediately after a fresh server
>>>>>>>>>> install and yum update. Installer does a lot and checks a lot and wont like
>>>>>>>>>> things: ex - you setup ovirtmgmt bridged network yourself
>>>>>>>>>> 5. Yes. See #1, usually what I do is each ovirt node I have I set
>>>>>>>>>> an IP of .5, then .6, and so on. This way I can be sure my network itself
>>>>>>>>>> is working before adding a VM and attaching that NIC to it
>>>>>>>>>>
>>>>>>>>>> On Tue, Sep 12, 2017 at 4:41 PM, Donny Davis <
>>>>>>>>>> donny at fortnebula.com> wrote:
>>>>>>>>>>
>>>>>>>>>>> 1. Yes, you can do this
>>>>>>>>>>> 2. Yes, In linux it's called bonding and this can be done from
>>>>>>>>>>> the UI
>>>>>>>>>>> 3. You can get around using the Engine machine if required with
>>>>>>>>>>> virsh or virt-manager - however I would just wait for the manager to
>>>>>>>>>>> migrate and start on another host in the cluster
>>>>>>>>>>> 4.  The deployment will take care of everything for you. You
>>>>>>>>>>> just need an IP
>>>>>>>>>>> 5. Yes, you can use vlans or virtual networking(NSXish) called
>>>>>>>>>>> OVS in oVirt.
>>>>>>>>>>>
>>>>>>>>>>> I noticed on your deployment machines 2 and 3 have the same IP.
>>>>>>>>>>> Might want to fix that before deploying
>>>>>>>>>>>
>>>>>>>>>>> Happy trails
>>>>>>>>>>> ~D
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> On Tue, Sep 12, 2017 at 2:00 PM, Tailor, Bharat <
>>>>>>>>>>> bharat at synergysystemsindia.com> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi Charles,
>>>>>>>>>>>>
>>>>>>>>>>>> Thank you so much to share a cool stuff with us.
>>>>>>>>>>>>
>>>>>>>>>>>> My doubts are still not cleared.
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>    1. What If I have only single Physical network adaptor?
>>>>>>>>>>>>    Can't I use it for management network & production network both.
>>>>>>>>>>>>    2. If I have two Physical network adaptor, Can I configure
>>>>>>>>>>>>    NIC teaming as like Vmware ESXi.
>>>>>>>>>>>>    3. What If my ovirt machine fails during production period?
>>>>>>>>>>>>    In vmware we can access ESXi hosts and VM without Vcenter and do all the
>>>>>>>>>>>>    stuffs. Can we do the same with Ovirt & KVM.
>>>>>>>>>>>>    4. To deploy ovirt engine VM, what kind of configuration
>>>>>>>>>>>>    I'll have to do on network adaptors? (eg. just configure IP on physical
>>>>>>>>>>>>    network or have to create br0 for it.)
>>>>>>>>>>>>    5. Can I make multiple VM networks for vlan configuration?
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Regrards
>>>>>>>>>>>> Bharat Kumar
>>>>>>>>>>>>
>>>>>>>>>>>> G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad
>>>>>>>>>>>> Udaipur (Raj.)
>>>>>>>>>>>> 313001
>>>>>>>>>>>> Mob: +91-9950-9960-25
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> On Tue, Sep 12, 2017 at 9:30 PM, Charles Kozler <
>>>>>>>>>>>> ckozleriii at gmail.com> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> Interestingly enough I literally just went through this same
>>>>>>>>>>>>> thing with a slight variation.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Note to the below: I am not sure if this would be considerd
>>>>>>>>>>>>> best practice or good for something long term support but I made due with
>>>>>>>>>>>>> what I had
>>>>>>>>>>>>>
>>>>>>>>>>>>> I had 10Gb cards for my storage network but no 10Gb switch, so
>>>>>>>>>>>>> I direct connected them with some fun routing and /etc/hosts settings. I
>>>>>>>>>>>>> also didnt want my storage network on a routed network (have firewalls in
>>>>>>>>>>>>> the way of VLANs) and I wanted the network separate from my ovirtmgmt -
>>>>>>>>>>>>> and, as I said, had no switches for 10Gb. Here is what you need at a bare
>>>>>>>>>>>>> minimum. Adapt / change it as you need
>>>>>>>>>>>>>
>>>>>>>>>>>>> 1 dedicated NIC on each node for ovirtmgmt. Ex: eth0
>>>>>>>>>>>>>
>>>>>>>>>>>>> 1 dedicated NIC to direct connect node 1 and node 2 - eth1
>>>>>>>>>>>>> node1
>>>>>>>>>>>>> 1 dedicated NIC to direct connect node 1 and node 3 - eth2
>>>>>>>>>>>>> node1
>>>>>>>>>>>>>
>>>>>>>>>>>>> 1 dedicated NIC to direct connect node 2 and node 1 - eth1
>>>>>>>>>>>>> node2
>>>>>>>>>>>>> 1 dedicated NIC to direct connect node 2 and node 3 - eth2
>>>>>>>>>>>>> node2
>>>>>>>>>>>>>
>>>>>>>>>>>>> 1 dedicated NIC to direct connect node 3 and node 1 - eth1
>>>>>>>>>>>>> node3
>>>>>>>>>>>>> 1 dedicated NIC to direct connect node 3 and node 2 - eth2
>>>>>>>>>>>>> node3
>>>>>>>>>>>>>
>>>>>>>>>>>>> You'll need custom routes too:
>>>>>>>>>>>>>
>>>>>>>>>>>>> Route to node 3 from node 1 via eth2
>>>>>>>>>>>>> Route to node 3 from node 2 via eth2
>>>>>>>>>>>>> Route to node 2 from node 3 via eth2
>>>>>>>>>>>>>
>>>>>>>>>>>>> Finally, entries in your /etc/hosts which match to your routes
>>>>>>>>>>>>> above
>>>>>>>>>>>>>
>>>>>>>>>>>>> Then, advisably, a dedicated NIC per box for VM network but
>>>>>>>>>>>>> you can leverage ovirtmgmt if you are just proofing this out
>>>>>>>>>>>>>
>>>>>>>>>>>>> At this point if you can reach all of your nodes via this
>>>>>>>>>>>>> direct connect IPs then you setup gluster as you normally would referencing
>>>>>>>>>>>>> your entries in /etc/hosts when you call "gluster volume create"
>>>>>>>>>>>>>
>>>>>>>>>>>>> In my setup, as I said, I had 2x 2 port PCIe 10Gb cards per
>>>>>>>>>>>>> server so I setup LACP as well as you can see below
>>>>>>>>>>>>>
>>>>>>>>>>>>> This is what my Frankenstein POC looked like:
>>>>>>>>>>>>> http://i.imgur.com/iURL9jv.png
>>>>>>>>>>>>>
>>>>>>>>>>>>> You can optionally choose to setup this network in ovirt as
>>>>>>>>>>>>> well (and add the NICs to each host) but dont configure it as a VM network.
>>>>>>>>>>>>> Then you can also, with some other minor tweaks, use these direct connects
>>>>>>>>>>>>> as migration networks rather than ovirtmgmt or VM network
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Tue, Sep 12, 2017 at 9:12 AM, Tailor, Bharat <
>>>>>>>>>>>>> bharat at synergysystemsindia.com> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I am trying to deploy 3 hosts hyper converged setup.
>>>>>>>>>>>>>> I am using Centos and installed KVM on all hosts.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Host-1
>>>>>>>>>>>>>> Hostname - test1.localdomain
>>>>>>>>>>>>>>  eth0 - 192.168.100.15/24
>>>>>>>>>>>>>> GW - 192.168.100.1
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hoat-2
>>>>>>>>>>>>>> Hostname - test2.localdomain
>>>>>>>>>>>>>> eth0 - 192.168.100.16/24
>>>>>>>>>>>>>> GW - 192.168.100.1
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Host-3
>>>>>>>>>>>>>> Hostname - test3.localdomain
>>>>>>>>>>>>>> eth0 - 192.168.100.16/24
>>>>>>>>>>>>>> GW - 192.168.100.1
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I have created two gluster volume "engine" & "data" with
>>>>>>>>>>>>>> replica 3.
>>>>>>>>>>>>>> I have add fqdn entry in /etc/hosts for all host for DNS
>>>>>>>>>>>>>> resolution.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I want to deploy Ovirt engine self hosted OVA to manage all
>>>>>>>>>>>>>> the hosts and production VM and my ovirt-engine VM should have HA enabled.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I found multiple docs over internet to deply
>>>>>>>>>>>>>> Self-hosted-engine-ova but I don't what kind of network configuration I've
>>>>>>>>>>>>>> to do on Centos network card & KVM. As KVM docs suggest that I've to create
>>>>>>>>>>>>>> a bridge network for Pnic to Vnic bridge. If I configure a bridge br0 for
>>>>>>>>>>>>>> eth0 bridge that I can't see eth0 while deploying ovirt-engine setup at NIC
>>>>>>>>>>>>>> card choice.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Kindly help me to do correct configuration for Centos hosts,
>>>>>>>>>>>>>> KVM & ovirt-engine-vm for HA enabled DC.
>>>>>>>>>>>>>> Regrards
>>>>>>>>>>>>>> Bharat Kumar
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> G15- Vinayak Nagar complex,Opp.Maa Satiya, ayad
>>>>>>>>>>>>>> Udaipur (Raj.)
>>>>>>>>>>>>>> 313001
>>>>>>>>>>>>>> Mob: +91-9950-9960-25
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>>>> Users mailing list
>>>>>>>>>>>>>> Users at ovirt.org
>>>>>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>> Users mailing list
>>>>>>>>>>>> Users at ovirt.org
>>>>>>>>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>
>>
>
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20170926/658230a6/attachment.html>