12:37 p.m.
Sorry, I meant to reply-all, to Strahil's most recent message.
So I'm doing so now.
In addition to my comments below, this StackOverflow thread summarizes what I have in
mind: https://stackoverflow.com/questions/43756405/extend-glusterfs-on-top-of-lvm
Sent with ProtonMail Secure Email.
‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Friday, April 16, 2021 5:33 AM, David White <dmwhite823(a)protonmail.com> wrote:
I don't think I would have the capability to take on the expense
of adding two more servers to my environment, on top of the 4th server I already have,
right now.
I realize the following isn't recommended, but would it be
possible to, instead, intentionally degrade the gluster cluster by shutting 1 of the hosts
down (put it in maintenance mode), add storage, and bring it back online?
Perhaps that would be a better approach, rather than try to shift
things around with a 4th server.
Sent with ProtonMail Secure Email.
‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Thursday, April 15, 2021 7:36 PM, Strahil Nikolov hunter86_bg(a)yahoo.com wrote:
> Gluster allows converting from replicted to
distributed-replicated (so called expansion) of the volume.
> Of course you need to add the same amount of bricks as the replica count (which
should be either 'replica 3' or 'replica 3 arbiter 1').
> The Gluster documentation on the topic is quite extensive , but it's worth
mentioning that you need to 'rebalance' your cluster after the expansion or you
risk filling the old bricks - while having free space on the new bricks.
> That is expected ,as each file/dir's name is hashed and each subvolume (new vs
old bricks) will have it's own range of hashes. When you expand the volume, some of
the files/dirs on the old bricks have hashes that match to the new "triplet".
> Also , if you do not rebalance - that will have some performance impact as gluster
will search the new bricks (for the files' whose hash matches the new subvolume)
before searching the old bricks.
> P.S: I think that the Engine's web interface fully supports that operation,
although I'm used to the cli.
> Best Regards,
> Strahil Nikolov
> В четвъртък, 15 април 2021 г., 20:05:50 ч. Гринуич+3, David White via Users
users(a)ovirt.org написа:
> Is it possible to expand an existing gluster volume?
> I have a hyperconverged environment, and have enough space right now, but I'm
going to have to significantly over-provision my environment. The vast majority of our
customers are using a small fraction of the amount of space that they are technically
allocated, but we still need to make that space available to them.
> As a result, I'd like to plan ahead, and go ahead and have a plan to add storage
later down the road.
> I'd like to plan to shut down each server in the cluster (individually, not at
once), add storage, and then bring them back online. Once all 3 are back online with the
additional storage, I'd like to expand the gluster volume to use the additional space.
Is that possible? How?
> Sent with ProtonMail Secure Email.
> Users mailing list -- users(a)ovirt.org
> To unsubscribe send an email to users-leave(a)ovirt.org
> Privacy Statement: https://www.ovirt.org/privacy-policy.html
> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/A7C3X2PW4D4...
12:50 p.m.
New subject: Expand gluster volumes
Ah, you got free space on lvm.Just 'lvextend -r -l +xxx vg/lv' on all bricks and
you are good to go.
Best Regards,Strahil Nikolov
On Fri, Apr 16, 2021 at 12:39, David White via Users<users(a)ovirt.org> wrote:
Sorry, I meant to reply-all, to Strahil's most recent message.
So I'm doing so now.
In addition to my comments below, this StackOverflow thread summarizes what I have in
mind: https://stackoverflow.com/questions/43756405/extend-glusterfs-on-top-of-lvm
Sent with ProtonMail Secure Email.
‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Friday, April 16, 2021 5:33 AM, David White <dmwhite823(a)protonmail.com> wrote:
I don't think I would have the capability to take on the expense
of adding two more servers to my environment, on top of the 4th server I already have,
right now.
I realize the following isn't recommended, but would it be
possible to, instead, intentionally degrade the gluster cluster by shutting 1 of the hosts
down (put it in maintenance mode), add storage, and bring it back online?
Perhaps that would be a better approach, rather than try to shift
things around with a 4th server.
Sent with ProtonMail Secure Email.
‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Thursday, April 15, 2021 7:36 PM, Strahil Nikolov hunter86_bg(a)yahoo.com wrote:
> Gluster allows converting from replicted to
distributed-replicated (so called expansion) of the volume.
> Of course you need to add the same amount of bricks as the replica count (which
should be either 'replica 3' or 'replica 3 arbiter 1').
> The Gluster documentation on the topic is quite extensive , but it's worth
mentioning that you need to 'rebalance' your cluster after the expansion or you
risk filling the old bricks - while having free space on the new bricks.
> That is expected ,as each file/dir's name is hashed and each subvolume (new vs
old bricks) will have it's own range of hashes. When you expand the volume, some of
the files/dirs on the old bricks have hashes that match to the new "triplet".
> Also , if you do not rebalance - that will have some performance impact as gluster
will search the new bricks (for the files' whose hash matches the new subvolume)
before searching the old bricks.
> P.S: I think that the Engine's web interface fully supports that operation,
although I'm used to the cli.
> Best Regards,
> Strahil Nikolov
> В четвъртък, 15 април 2021 г., 20:05:50 ч. Гринуич+3, David White via Users
users(a)ovirt.org написа:
> Is it possible to expand an existing gluster volume?
> I have a hyperconverged environment, and have enough space right now, but I'm
going to have to significantly over-provision my environment. The vast majority of our
customers are using a small fraction of the amount of space that they are technically
allocated, but we still need to make that space available to them.
> As a result, I'd like to plan ahead, and go ahead and have a plan to add storage
later down the road.
> I'd like to plan to shut down each server in the cluster (individually, not at
once), add storage, and then bring them back online. Once all 3 are back online with the
additional storage, I'd like to expand the gluster volume to use the additional space.
Is that possible? How?
> Sent with ProtonMail Secure Email.
> Users mailing list -- users(a)ovirt.org
> To unsubscribe send an email to users-leave(a)ovirt.org
> Privacy Statement: https://www.ovirt.org/privacy-policy.html
> oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/A7C3X2PW4D4...
1:21 p.m.
New subject: Expand gluster volumes
Sort of. :)
It'll be a dance, as I'm going to need to do 1 of 2 things:
- Put the host into Maintenance mode inside oVirt Engine, then intentionally degrade
each RAID array, add the larger disks, and heal the RAID. Then take the host out of
maintenance mode. This would take some time, as my RAID is 1-disk fail tolerant, and I
have 6 disks in the RAID.
- Put the host into maintenance mode, bring the server down completely, completely
replace the storage, (re)install the base OS, and use oVirt engine to add it back into the
cluster.This would involved intentionally degrading the gluster cluster during the
maintenance. Honestly, I would probably prefer this approach, because oddly enough, I
think it would go faster, and I could do more of the work remote without having to be at
the datacenter constantly.
I guess bullet point #2 brings up another good point:
I need to learn how to heal gluster in the event of a catastrophic failure on 1 of the
hosts. It would be good to know how to do that before a failure occurs. :)
Sent with ProtonMail Secure Email.
‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Friday, April 16, 2021 5:50 AM, Strahil Nikolov via Users <users(a)ovirt.org>
wrote:
Ah, you got free space on lvm.
Just 'lvextend -r -l +xxx vg/lv' on all bricks and you are good to go.
Best Regards,
Strahil Nikolov
> On Fri, Apr 16, 2021 at 12:39, David White via Users
> <users(a)ovirt.org> wrote:
> Sorry, I meant to reply-all, to Strahil's most recent message.
> So I'm doing so now.
>
> In addition to my comments below, this StackOverflow thread
summarizes what I have in mind:
https://stackoverflow.com/questions/43756405/extend-glusterfs-on-top-of-lvm
>
> Sent with ProtonMail Secure Email.
>
> ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
>
> On Friday, April 16, 2021 5:33 AM, David White
<dmwhite823(a)protonmail.com> wrote:
>
> > I don't think I would have the capability to take on
the expense of adding two more servers to my environment, on top of the 4th server I
already have, right now.
> >
>
> > I realize the following isn't recommended, but would it
be possible to, instead, intentionally degrade the gluster cluster by shutting 1 of the
hosts down (put it in maintenance mode), add storage, and bring it back online?
> >
>
> > Perhaps that would be a better approach, rather than try to
shift things around with a 4th server.
> >
>
> > Sent with ProtonMail Secure Email.
> >
>
> > ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
> > On Thursday, April 15, 2021 7:36 PM, Strahil Nikolov hunter86_bg(a)yahoo.com
wrote:
> >
>
> > > Gluster allows converting from replicted to
distributed-replicated (so called expansion) of the volume.
> > > Of course you need to add the same amount of bricks as the replica count
(which should be either 'replica 3' or 'replica 3 arbiter 1').
> > > The Gluster documentation on the topic is quite extensive , but it's
worth mentioning that you need to 'rebalance' your cluster after the expansion or
you risk filling the old bricks - while having free space on the new bricks.
> > > That is expected ,as each file/dir's name is hashed and each subvolume
(new vs old bricks) will have it's own range of hashes. When you expand the volume,
some of the files/dirs on the old bricks have hashes that match to the new
"triplet".
> > > Also , if you do not rebalance - that will have some performance impact as
gluster will search the new bricks (for the files' whose hash matches the new
subvolume) before searching the old bricks.
> > > P.S: I think that the Engine's web interface fully supports that
operation, although I'm used to the cli.
> > > Best Regards,
> > > Strahil Nikolov
> > > В четвъртък, 15 април 2021 г., 20:05:50 ч. Гринуич+3, David White via
Users users(a)ovirt.org написа:
> > > Is it possible to expand an existing gluster volume?
> > > I have a hyperconverged environment, and have enough space right now, but
I'm going to have to significantly over-provision my environment. The vast majority of
our customers are using a small fraction of the amount of space that they are technically
allocated, but we still need to make that space available to them.
> > > As a result, I'd like to plan ahead, and go ahead and have a plan to
add storage later down the road.
> > > I'd like to plan to shut down each server in the cluster
(individually, not at once), add storage, and then bring them back online. Once all 3 are
back online with the additional storage, I'd like to expand the gluster volume to use
the additional space. Is that possible? How?
> > > Sent with ProtonMail Secure Email.
> > > Users mailing list -- users(a)ovirt.org
> > > To unsubscribe send an email to users-leave(a)ovirt.org
> > > Privacy Statement: https://www.ovirt.org/privacy-policy.html
> > > oVirt Code of Conduct:
https://www.ovirt.org/community/about/community-guidelines/
> > > List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/A7C3X2PW4D4...
1:39 p.m.
New subject: Expand gluster volumes
Have you thought about copying the data via rsync/scp to the new disks (assuming that you
have similar machine) ?
Best Regards,Strahil Nikolov
1:59 p.m.
New subject: Expand gluster volumes
‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Friday, April 16, 2021 6:39 AM, Strahil Nikolov via Users <users(a)ovirt.org>
wrote:
Have you thought about copying the data via rsync/scp to the new
disks (assuming that you have similar machine) ?
But this would still require that I remove a host from the cluster, and add the new host
back in though, right?
My goal is to have a 3-node (replica 3) cluster before the maintenance as well as after
the maintenance.
So I think my earlier question about putting the host into maintenance mode, reinstalling
everything from scratch, and adding it back to the cluster, is still valid - unless
I'm missing something.
Or, are you suggesting that I do the fresh install on the new host, manually setup the
new gluster volumes, and rsync everything over before I put the old host into maintenance
mode?
And then I guess, just shut down the old host, re-IP the new host to the original host,
and viola?
Best Regards,
Strahil Nikolov
3:12 p.m.
New subject: Expand gluster volumes
More like:Prepare a new linux host + a brickSet the donor into maintenance and then remove
it from oVirt & GlusterExpand with the new brick ( new host)
Put the big disks on the old donor and use it as a new host ...
Best Regards,Strahil Nikolov
On Fri, Apr 16, 2021 at 14:01, David White via Users<users(a)ovirt.org> wrote:
_______________________________________________
Users mailing list -- users(a)ovirt.org
To unsubscribe send an email to users-leave(a)ovirt.org
Privacy Statement: https://www.ovirt.org/privacy-policy.html
oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/
List Archives:
https://lists.ovirt.org/archives/list/users@ovirt.org/message/E6XJTWAJXX2...
1316
days inactive
1316
days old
5 comments
2 participants
participants (2)
-
David White -
Strahil Nikolov