Trouble Adding Gluster Host in oVirt Manager

--_000_MWHPR09MB14214B6FA5B51503BE74D70787130MWHPR09MB1421namp_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hello oVirt Community, This may be my first time writing in. Although, I've been reviewing and pla= ying with oVirt for the past 3 years. My name is Robert Langley and I work = for a local Government in Southern California. My agency (with me as the pr= imary/lead IT person) has been using VMWare vSphere to host our server envi= ronment for 6 years. I have a few different reasons I want to jump the VMWa= re ship and I've been pleased with the progression oVirt has been making. I= do not care to jump from VMWare to Microsoft's Hyper-V, so this had lead m= e to look into Xen for a while, then dropped anchor with oVirt. I'm determi= ned to see this implementation through. I have moved over from the test (workstation class) environment, where I wa= s really just getting familiar with the commands and UI, and now I am worki= ng on implementation with server class hardware. I have the engine up and running. I'll get into more specifics below. I'm running into an issue where I have not been able to add my Gluster host= s or add the Storage Domain (I had tried adding the storage domain first). For my new oVirt and GlusterFS hosts I have the following: * I want to first mention that I do have a DNS server for the separat= ed/private networks and those are configured and working properly (forward = & reverse). Dell PE R830 and I would like this to be a failover server housed in a sepa= rate building where we have an Emergency Operations Center and Datacenter (= server room). - Has bonded gigabit (2 port) network that is connected to our main n= etwork & internet, configured to be used for ovirtmgnt. Name =3D gsaov08.en= t... o As far as all the various names, oVirt Hosted Engine Deployment com= plained that the Main network name was seen on more than one interface, or = something to that effect. o I did originally have DNS for the separated/private networks config= ured for forwarding DNS from our main network DNS servers. Which has been r= emoved and the Hosted Engine Deployment stopped complaining at that point. = I was going to use the forwarding DNS for another private network I use for= some management traffic, but that is not as important or an absolute need = either. - Has 2nd bonded gigabit (4 port) network (separate/private) for engi= ne storage. Name =3D gsaov08e.engine.local - Has 3rd bonded 10G (2 port) network (separate/private) for VM Guest= storage. Name =3D gsaov08s.stor.local - Will have a 4th network (separate/private) configured for security = related devices that are managed by a couple of our VM guests. As far as storage in this same server. - I have split up the local storage to be hosted by GlusterFS and thi= s host is a peer with the other two dedicated GlusterFS storage servers. Th= at is for the failover piece. o Engine volume (currently being used for the Hosted Engine) and setu= p as a replica 3 with the two dedicated GlusterFS storage servers. o VM Guest "Data" volume. The volume is created, configured and start= ed. Setup as a replica 3 with the two dedicated GlusterFS storage servers. So far, this is the only host I have hosting the engine. Now, onto the othe= r host I am about to run Hosted-Engine -Deploy on. Dell PE R730 - It has the same network setup as the R830. Storage is a bit = different. I would like to run another VM Guest GlusterFS volume from here,= along with 2 other hosts I have. They are currently serving as the vSphere= ESX hosts and have the same total size of storage to create another replic= a 3. The Dedicated GlusterFS Hosts are custom AMD Opteron G2 builds with ASUS se= rver motherboards. Strictly designed to be dedicated storage servers. - I'm using the onboard NICs to connect to my management network only= for the purpose of getting updates. So, internet is served to these hosts = via a NAT router. Since I figured they don't otherwise need access to our m= ain network. The primary names =3D gsa-stor1 & gsa-stor2 - They both have a bonded (4 port) gigabit network for the Engine sto= rage network. Names =3D gsa-stor1e.engine.local & gsa-stor2e.engine.local - They both have a bonded (2 port) 10G network for the VM Guest stora= ge network. Names =3D gsa-stor2s.stor.local & gsa-stor2s.stor.local As far as storage in these servers. - It is the same as the R830, as these servers are the peers to the R= 830. First, I added an ISO Storage Domain (NFS). That was successful. Next, I wa= s trying to add the GlusterFS VM Guest Data Storage Domain. I receive an Op= eration Canceled: Error while executing action AddGlusterFsStorageDomain: E= rror creating a storage domain. When I try to add the Gluster hosts as hosts in the oVirt Manager, I get a = message stating that SSH has failed, verify that the host is reachable (IP = address, routable address etc.) You may refer to the engine.log file for fu= rther details. I can otherwise communicate with the hosts and the engine.log does not appe= ar to have specifics to this particular failure. But, there are other clues= that I don't understand. So, I can follow up with the engine log. It conta= ins "WARN" entries. They seem to be because I do not have the hosts, for th= e engine volume, added to the cluster. Oh, one thing I should mention, I did select the option to enable the Glust= er service in the default cluster. So, both virt and Gluster are enabled. A= fter I did so, I wasn't so sure that was a good thing or not. It seems that= documentation is outdated on whether that is now supported. I noticed from= screenshots that the selection used to be radio buttons and now they are c= heck boxes. I did read the release notes for 4.0.1, which seem to talk as t= hough support for both in a cluster has been added. Thank you for any help that can be extended. Robert --_000_MWHPR09MB14214B6FA5B51503BE74D70787130MWHPR09MB1421namp_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
<meta name=3D"Generator" content=3D"Microsoft Exchange Server"> <!-- converted from rtf --> <style><!-- .EmailQuote { margin-left: 1pt; padding-left: 4pt; border-left:= #800000 2px solid; } --></style> </head> <body> <font face=3D"Calibri" size=3D"2"><span style=3D"font-size:11pt;"> <div>Hello oVirt Community,</div> <div> </div> <div>This may be my first time writing in. Although, I’ve been review= ing and playing with oVirt for the past 3 years. My name is Robert Langley = and I work for a local Government in Southern California. My agency (with m= e as the primary/lead IT person) has been using VMWare vSphere to host our server environment for 6 years. I have a f= ew different reasons I want to jump the VMWare ship and I’ve been ple= ased with the progression oVirt has been making. I do not care to jump from= VMWare to Microsoft’s Hyper-V, so this had lead me to look into Xen for a while, then dropped anchor with oVirt. I= ’m determined to see this implementation through.</div> <div> </div> <div>I have moved over from the test (workstation class) environment, where= I was really just getting familiar with the commands and UI, and now I am = working on implementation with server class hardware.</div> <div>I have the engine up and running. I’ll get into more specifics b= elow.</div> <div>I’m running into an issue where I have not been able to add my G= luster hosts or add the Storage Domain (I had tried adding the storage doma= in first).</div> <div>For my new oVirt and GlusterFS hosts I have the following:</div> <ul style=3D"margin:0;padding-left:36pt;"> <li>I want to first mention that I do have a DNS server for the separated/p= rivate networks and those are configured and working properly (forward &= ; reverse).</li></ul> <div>Dell PE R830 and I would like this to be a failover server housed in a= separate building where we have an Emergency Operations Center and Datacen= ter (server room).</div> <ul style=3D"margin:0;padding-left:43pt;"> <li>Has bonded gigabit (2 port) network that is connected to our main netwo= rk & internet, configured to be used for ovirtmgnt. Name =3D gsaov08.en= t…</li></ul> <ul style=3D"margin:0;padding-left:79pt;"> <li>As far as all the various names, oVirt Hosted Engine Deployment complai= ned that the Main network name was seen on more than one interface, or some= thing to that effect.</li><li>I did originally have DNS for the separated/p= rivate networks configured for forwarding DNS from our main network DNS ser= vers. Which has been removed and the Hosted Engine Deployment stopped compl= aining at that point. I was going to use the forwarding DNS for another private network I use for some management traffic, but that is = not as important or an absolute need either.</li></ul> <ul style=3D"margin:0;padding-left:43pt;"> <li>Has 2<font size=3D"1"><span style=3D"font-size:7.3pt;"><sup>nd</sup></s= pan></font> bonded gigabit (4 port) network (separate/private) for engine s= torage. Name =3D gsaov08e.engine.local</li><li>Has 3<font size=3D"1"><span = style=3D"font-size:7.3pt;"><sup>rd</sup></span></font> bonded 10G (2 port) = network (separate/private) for VM Guest storage. Name =3D gsaov08s.stor.loc= al</li><li>Will have a 4<font size=3D"1"><span style=3D"font-size:7.3pt;"><= sup>th</sup></span></font> network (separate/private) configured for securi= ty related devices that are managed by a couple of our VM guests.</li></ul> <div style=3D"padding-left:25pt;">As far as storage in this same server.</d= iv> <ul style=3D"margin:0;padding-left:43pt;"> <li>I have split up the local storage to be hosted by GlusterFS and this ho= st is a peer with the other two dedicated GlusterFS storage servers. That i= s for the failover piece.</li></ul> <ul style=3D"margin:0;padding-left:79pt;"> <li>Engine volume (currently being used for the Hosted Engine) and setup as= a replica 3 with the two dedicated GlusterFS storage servers.</li><li>VM G= uest “Data” volume. The volume is created, configured and start= ed. Setup as a replica 3 with the two dedicated GlusterFS storage servers.<= /li></ul> <div style=3D"text-indent:36pt;">So far, this is the only host I have hosti= ng the engine. Now, onto the other host I am about to run Hosted-Engine -De= ploy on.</div> <div>Dell PE R730 – It has the same network setup as the R830. Storag= e is a bit different. I would like to run another VM Guest GlusterFS volume= from here, along with 2 other hosts I have. They are currently serving as = the vSphere ESX hosts and have the same total size of storage to create another replica 3.</div> <div> </div> <div>The Dedicated GlusterFS Hosts are custom AMD Opteron G2 builds with AS= US server motherboards. Strictly designed to be dedicated storage servers.<= /div> <ul style=3D"margin:0;padding-left:43pt;"> <li>I’m using the onboard NICs to connect to my management network on= ly for the purpose of getting updates. So, internet is served to these host= s via a NAT router. Since I figured they don’t otherwise need access = to our main network. The primary names =3D gsa-stor1 & gsa-stor2</li><li>They both have a bonded (4 port) gigabit network fo= r the Engine storage network. Names =3D gsa-stor1e.engine.local & gsa-s= tor2e.engine.local</li><li>They both have a bonded (2 port) 10G network for= the VM Guest storage network. Names =3D gsa-stor2s.stor.local & gsa-st= or2s.stor.local</li></ul> <div style=3D"padding-left:25pt;">As far as storage in these servers.</div> <ul style=3D"margin:0;padding-left:43pt;"> <li>It is the same as the R830, as these servers are the peers to the R830.= </li></ul> <div style=3D"padding-left:43pt;"> </div> <div>First, I added an ISO Storage Domain (NFS). That was successful. Next,= I was trying to add the GlusterFS VM Guest Data Storage Domain. I receive = an Operation Canceled: Error while executing action AddGlusterFsStorageDoma= in: Error creating a storage domain.</div> <div>When I try to add the Gluster hosts as hosts in the oVirt Manager, I g= et a message stating that SSH has failed, verify that the host is reachable= (IP address, routable address etc.) You may refer to the engine.log file f= or further details.</div> <div>I can otherwise communicate with the hosts and the engine.log does not= appear to have specifics to this particular failure. But, there are other = clues that I don’t understand. So, I can follow up with the engine lo= g. It contains “WARN” entries. They seem to be because I do not have the hosts, for the engine volume, added to the = cluster.</div> <div>Oh, one thing I should mention, I did select the option to enable the = Gluster service in the default cluster. So, both virt and Gluster are enabl= ed. After I did so, I wasn’t so sure that was a good thing or not. It= seems that documentation is outdated on whether that is now supported. I noticed from screenshots that the selec= tion used to be radio buttons and now they are check boxes. I did read the = release notes for 4.0.1, which seem to talk as though support for both in a= cluster has been added.</div> <div> </div> <div>Thank you for any help that can be extended.</div> <div>Robert</div> <div> </div> </span></font> </body> </html> --_000_MWHPR09MB14214B6FA5B51503BE74D70787130MWHPR09MB1421namp_--

Robert hi, Can you please provide the logs , engine and VDSM ? Thanks, Fred On Fri, Apr 28, 2017 at 9:45 PM, Langley, Robert <Robert.Langley@ventura.org
wrote:
Hello oVirt Community,
This may be my first time writing in. Although, I’ve been reviewing and playing with oVirt for the past 3 years. My name is Robert Langley and I work for a local Government in Southern California. My agency (with me as the primary/lead IT person) has been using VMWare vSphere to host our server environment for 6 years. I have a few different reasons I want to jump the VMWare ship and I’ve been pleased with the progression oVirt has been making. I do not care to jump from VMWare to Microsoft’s Hyper-V, so this had lead me to look into Xen for a while, then dropped anchor with oVirt. I’m determined to see this implementation through.
I have moved over from the test (workstation class) environment, where I was really just getting familiar with the commands and UI, and now I am working on implementation with server class hardware. I have the engine up and running. I’ll get into more specifics below. I’m running into an issue where I have not been able to add my Gluster hosts or add the Storage Domain (I had tried adding the storage domain first). For my new oVirt and GlusterFS hosts I have the following:
- I want to first mention that I do have a DNS server for the separated/private networks and those are configured and working properly (forward & reverse).
Dell PE R830 and I would like this to be a failover server housed in a separate building where we have an Emergency Operations Center and Datacenter (server room).
- Has bonded gigabit (2 port) network that is connected to our main network & internet, configured to be used for ovirtmgnt. Name = gsaov08.ent…
- As far as all the various names, oVirt Hosted Engine Deployment complained that the Main network name was seen on more than one interface, or something to that effect. - I did originally have DNS for the separated/private networks configured for forwarding DNS from our main network DNS servers. Which has been removed and the Hosted Engine Deployment stopped complaining at that point. I was going to use the forwarding DNS for another private network I use for some management traffic, but that is not as important or an absolute need either.
- Has 2nd bonded gigabit (4 port) network (separate/private) for engine storage. Name = gsaov08e.engine.local - Has 3rd bonded 10G (2 port) network (separate/private) for VM Guest storage. Name = gsaov08s.stor.local - Will have a 4th network (separate/private) configured for security related devices that are managed by a couple of our VM guests.
As far as storage in this same server.
- I have split up the local storage to be hosted by GlusterFS and this host is a peer with the other two dedicated GlusterFS storage servers. That is for the failover piece.
- Engine volume (currently being used for the Hosted Engine) and setup as a replica 3 with the two dedicated GlusterFS storage servers. - VM Guest “Data” volume. The volume is created, configured and started. Setup as a replica 3 with the two dedicated GlusterFS storage servers.
So far, this is the only host I have hosting the engine. Now, onto the other host I am about to run Hosted-Engine -Deploy on. Dell PE R730 – It has the same network setup as the R830. Storage is a bit different. I would like to run another VM Guest GlusterFS volume from here, along with 2 other hosts I have. They are currently serving as the vSphere ESX hosts and have the same total size of storage to create another replica 3.
The Dedicated GlusterFS Hosts are custom AMD Opteron G2 builds with ASUS server motherboards. Strictly designed to be dedicated storage servers.
- I’m using the onboard NICs to connect to my management network only for the purpose of getting updates. So, internet is served to these hosts via a NAT router. Since I figured they don’t otherwise need access to our main network. The primary names = gsa-stor1 & gsa-stor2 - They both have a bonded (4 port) gigabit network for the Engine storage network. Names = gsa-stor1e.engine.local & gsa-stor2e.engine.local - They both have a bonded (2 port) 10G network for the VM Guest storage network. Names = gsa-stor2s.stor.local & gsa-stor2s.stor.local
As far as storage in these servers.
- It is the same as the R830, as these servers are the peers to the R830.
First, I added an ISO Storage Domain (NFS). That was successful. Next, I was trying to add the GlusterFS VM Guest Data Storage Domain. I receive an Operation Canceled: Error while executing action AddGlusterFsStorageDomain: Error creating a storage domain. When I try to add the Gluster hosts as hosts in the oVirt Manager, I get a message stating that SSH has failed, verify that the host is reachable (IP address, routable address etc.) You may refer to the engine.log file for further details. I can otherwise communicate with the hosts and the engine.log does not appear to have specifics to this particular failure. But, there are other clues that I don’t understand. So, I can follow up with the engine log. It contains “WARN” entries. They seem to be because I do not have the hosts, for the engine volume, added to the cluster. Oh, one thing I should mention, I did select the option to enable the Gluster service in the default cluster. So, both virt and Gluster are enabled. After I did so, I wasn’t so sure that was a good thing or not. It seems that documentation is outdated on whether that is now supported. I noticed from screenshots that the selection used to be radio buttons and now they are check boxes. I did read the release notes for 4.0.1, which seem to talk as though support for both in a cluster has been added.
Thank you for any help that can be extended. Robert
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
participants (2)
-
Fred Rolland
-
Langley, Robert