[Users] 2 node cluster with local storage?
Hi All, Is there any supported way (or advice on the best unsupported way) to provision a 2-node cluster using local storage? I've deployed RHEV 3.0 against both NFS and FC storage, and would like to bring up a 2 node oVirt 3.2 playground. I don't have access to a real storage server for this setup, but the hypervisor nodes have several spindles of 15K RPM SAS drives each so I'm assuming I can use DRBD and bond some 1GBPS ether links to provide a shared block device with adequate performance. Ideally I'd like to use the regular CLVM storage pool but on local DRBD instead of FC, but I don't see any way to make oVirt use a volume group that it didn't create itself. Another possibility would be POSIX FS on GFS2 which looks like it should be supported but (afaict) would require doubling up on the cluster management layer. Is there any way (even if not "production ready") to have a storage pool use a clvm vg that has been created outside of oVirt? Has anyone used the POSIX FS pool type against GFS2? Any other suggestions about how to put this together? cheers Russell
On 04/01/2013 12:33 PM, russell muetzelfeldt wrote:
Hi All,
Is there any supported way (or advice on the best unsupported way) to provision a 2-node cluster using local storage?
I've deployed RHEV 3.0 against both NFS and FC storage, and would like to bring up a 2 node oVirt 3.2 playground. I don't have access to a real storage server for this setup, but the hypervisor nodes have several spindles of 15K RPM SAS drives each so I'm assuming I can use DRBD and bond some 1GBPS ether links to provide a shared block device with adequate performance.
Ideally I'd like to use the regular CLVM storage pool but on local DRBD instead of FC, but I don't see any way to make oVirt use a volume group that it didn't create itself. Another possibility would be POSIX FS on GFS2 which looks like it should be supported but (afaict) would require doubling up on the cluster management layer.
Is there any way (even if not "production ready") to have a storage pool use a clvm vg that has been created outside of oVirt? Has anyone used the POSIX FS pool type against GFS2? Any other suggestions about how to put this together?
have you considered using gluster? if you setup the cluster as 'gluster' as well, it should be installed, you should be able to create a volume on it, then create a posixfs storage domain using it (and in ovirt 3.3, a glusterfs storage domain, which will provide better performance)?
On 01/04/2013, at 8:53 PM, Itamar Heim <iheim@redhat.com> wrote:
On 04/01/2013 12:33 PM, russell muetzelfeldt wrote:
Is there any supported way (or advice on the best unsupported way) to provision a 2-node cluster using local storage?
have you considered using gluster? if you setup the cluster as 'gluster' as well, it should be installed, you should be able to create a volume on it, then create a posixfs storage domain using it (and in ovirt 3.3, a glusterfs storage domain, which will provide better performance)?
I've got to admit I'd discounted gluster mainly because I've never touched it before and assumed the learning curve would distract me from what I actually want to be doing (getting a reasonably functional cluster to use as a target for programming against the REST API). Is the gluster support reasonably straightforward out of the box? If so I might give that a go and see how it pans out. cheers Russell
On 04/01/2013 06:13 PM, russell muetzelfeldt wrote:
On 01/04/2013, at 8:53 PM, Itamar Heim <iheim@redhat.com> wrote:
On 04/01/2013 12:33 PM, russell muetzelfeldt wrote:
Is there any supported way (or advice on the best unsupported way) to provision a 2-node cluster using local storage?
have you considered using gluster? if you setup the cluster as 'gluster' as well, it should be installed, you should be able to create a volume on it, then create a posixfs storage domain using it (and in ovirt 3.3, a glusterfs storage domain, which will provide better performance)?
I've got to admit I'd discounted gluster mainly because I've never touched it before and assumed the learning curve would distract me from what I actually want to be doing (getting a reasonably functional cluster to use as a target for programming against the REST API).
Is the gluster support reasonably straightforward out of the box? If so I might give that a go and see how it pans out.
Yes, setting up gluster is considered relatively easy. You can reach out for support here and/or on gluster-users mailing list. Cheers, Vijay
On 04/01/2013 04:13 PM, Vijay Bellur wrote:
On 04/01/2013 06:13 PM, russell muetzelfeldt wrote:
On 01/04/2013, at 8:53 PM, Itamar Heim <iheim@redhat.com> wrote:
On 04/01/2013 12:33 PM, russell muetzelfeldt wrote:
Is there any supported way (or advice on the best unsupported way) to provision a 2-node cluster using local storage?
have you considered using gluster? if you setup the cluster as 'gluster' as well, it should be installed, you should be able to create a volume on it, then create a posixfs storage domain using it (and in ovirt 3.3, a glusterfs storage domain, which will provide better performance)?
I've got to admit I'd discounted gluster mainly because I've never touched it before and assumed the learning curve would distract me from what I actually want to be doing (getting a reasonably functional cluster to use as a target for programming against the REST API).
Is the gluster support reasonably straightforward out of the box? If so I might give that a go and see how it pans out.
Yes, setting up gluster is considered relatively easy. You can reach out for support here and/or on gluster-users mailing list.
or not try to do something like two hosts with local storage in same DC/Cluster... if this is just for some tests, either put them in different ones, or say, enable NFS on one of them and compromise on not using the storage from the other one (or NFS on each, and use two NFS storage domains in the same DC) - of course a failure of each node in this case will mean VMs hosted on it won't be able to run, so it would be similar to just having a local storage host alone...
On 04/01/2013 05:26 PM, Itamar Heim wrote:
On 04/01/2013 04:13 PM, Vijay Bellur wrote:
On 04/01/2013 06:13 PM, russell muetzelfeldt wrote:
On 01/04/2013, at 8:53 PM, Itamar Heim <iheim@redhat.com> wrote:
On 04/01/2013 12:33 PM, russell muetzelfeldt wrote:
Is there any supported way (or advice on the best unsupported way) to provision a 2-node cluster using local storage?
have you considered using gluster? if you setup the cluster as 'gluster' as well, it should be installed, you should be able to create a volume on it, then create a posixfs storage domain using it (and in ovirt 3.3, a glusterfs storage domain, which will provide better performance)?
I've got to admit I'd discounted gluster mainly because I've never touched it before and assumed the learning curve would distract me from what I actually want to be doing (getting a reasonably functional cluster to use as a target for programming against the REST API).
Is the gluster support reasonably straightforward out of the box? If so I might give that a go and see how it pans out.
Yes, setting up gluster is considered relatively easy. You can reach out for support here and/or on gluster-users mailing list.
or not try to do something like two hosts with local storage in same DC/Cluster... if this is just for some tests, either put them in different ones, or say, enable NFS on one of them and compromise on not using the storage from the other one (or NFS on each, and use two NFS storage domains in the same DC) - of course a failure of each node in this case will mean VMs hosted on it won't be able to run, so it would be similar to just having a local storage host alone...
btw, this will hold for gluster as well, unless you use replication. so in any case you are limited in capacity.
participants (3)
-
Itamar Heim -
russell muetzelfeldt -
Vijay Bellur