add fourth full gluster node and remove arbiter: ovirt 4.1 with hosted engine
Hi at all, we have a 3 node cluster with this configuration: ovirtzz 4.1 with 3 node hyperconverged with gluster. 2 node are "full replicated" and 1 node is the arbiter. Now we have a new server to add to cluster then we want to add this new server and remove the arbiter (or, make this new server a "full replicated" gluster with arbiter role? I don't know) Can you please help me to know what is the right way to do this? Or, Can you give me any doc or link that explain the steps to do this? Thank you in advance!
This is a multi-part message in MIME format. --------------D1A898CD7D5AD3746390C59C Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit On 06/30/2017 02:18 PM, yayo (j) wrote:
Hi at all,
we have a 3 node cluster with this configuration:
ovirtzz 4.1 with 3 node hyperconverged with gluster. 2 node are "full replicated" and 1 node is the arbiter.
Now we have a new server to add to cluster then we want to add this new server and remove the arbiter (or, make this new server a "full replicated" gluster with arbiter role? I don't know) You do not need to remove the arbiter node as you are getting the advantage of saving on space by having this config.
Since you have a new you can add this as fourth node and create another gluster volume (replica 3) out of this node plus the other two nodes and run vm images there as well.
Can you please help me to know what is the right way to do this? Or, Can you give me any doc or link that explain the steps to do this?
Thank you in advance!
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--------------D1A898CD7D5AD3746390C59C Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=windows-1252" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <div class="moz-cite-prefix">On 06/30/2017 02:18 PM, yayo (j) wrote:<br> </div> <blockquote cite="mid:CAGK=3kz4161ynyWCnnr5zLnpFJm8gPkMQhYTqy0vunHJQjOYxQ@mail.gmail.com" type="cite"> <div dir="ltr"> <div> <div> <div>Hi at all,</div> <div><br> </div> <div>we have a 3 node cluster with this configuration:</div> <div><br> </div> <div>ovirtzz 4.1 with 3 node hyperconverged with gluster. 2 node are "full replicated" and 1 node is the arbiter. </div> <div><br> </div> <div>Now we have a new server to add to cluster then we want to add this new server and remove the arbiter (or, make this new server a "full replicated" gluster with arbiter role? I don't know)</div> </div> </div> </div> </blockquote> You do not need to remove the arbiter node as you are getting the advantage of saving on space by having this config. <br> <br> Since you have a new you can add this as fourth node and create another gluster volume (replica 3) out of this node plus the other two nodes and run vm images there as well.<br> <blockquote cite="mid:CAGK=3kz4161ynyWCnnr5zLnpFJm8gPkMQhYTqy0vunHJQjOYxQ@mail.gmail.com" type="cite"> <div dir="ltr"> <div> <div> <div><br> </div> <div>Can you please help me to know what is the right way to do this? Or, Can you give me any doc or link that explain the steps to do this?</div> <div><br> </div> <div>Thank you in advance!</div> <div><br> </div> </div> </div> </div> <br> <fieldset class="mimeAttachmentHeader"></fieldset> <br> <pre wrap="">_______________________________________________ Users mailing list <a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a> <a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a> </pre> </blockquote> <p><br> </p> </body> </html> --------------D1A898CD7D5AD3746390C59C--
2017-06-30 11:01 GMT+02:00 knarra <knarra@redhat.com>:
You do not need to remove the arbiter node as you are getting the advantage of saving on space by having this config.
Since you have a new you can add this as fourth node and create another gluster volume (replica 3) out of this node plus the other two nodes and run vm images there as well.
Hi, And thanks for the answer. The actual arbiter must be removed because is too obsolete. So, I needs to add the new "full replicated" node but I want to know what are the steps for add a new "full replicated" node and remove the arbiter node (Also a way to move the arbiter role to the new node, If needed) . Extra info: I want to know if I can do this on an existing ovirt gluster Data Domain (called Data01) because we have many vm runnig on it. thank you
2017-06-30 12:54 GMT+02:00 yayo (j) <jaganz@gmail.com>:
The actual arbiter must be removed because is too obsolete. So, I needs to add the new "full replicated" node but I want to know what are the steps for add a new "full replicated" node and remove the arbiter node (Also a way to move the arbiter role to the new node, If needed) . Extra info: I want to know if I can do this on an existing ovirt gluster Data Domain (called Data01) because we have many vm runnig on it.
Hi, I have found this doc from RH about replacing host in a gluster env: https://access.redhat.com/documentation/en-US/Red_Hat_Storage/3/html/Adminis... I can use the command described at point 7 ? # *gluster volume replace-brick vol sys0.example.com:/rhs/brick1/b1 sys5.example.com:/rhs/brick1/b1 commit force* *volume replace-brick: success: replace-brick commit successful* The question is: The replaced node will be a data node (a "full replicated" node) or will be again an arbiter? Thank you
This is a multi-part message in MIME format. --------------332BFCB5728E9F105D670C85 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit On 06/30/2017 04:53 PM, yayo (j) wrote:
2017-06-30 12:54 GMT+02:00 yayo (j) <jaganz@gmail.com <mailto:jaganz@gmail.com>>:
The actual arbiter must be removed because is too obsolete. So, I needs to add the new "full replicated" node but I want to know what are the steps for add a new "full replicated" node and remove the arbiter node (Also a way to move the arbiter role to the new node, If needed) . Extra info: I want to know if I can do this on an existing ovirt gluster Data Domain (called Data01) because we have many vm runnig on it.
Hi,
I have found this doc from RH about replacing host in a gluster env: https://access.redhat.com/documentation/en-US/Red_Hat_Storage/3/html/Adminis...
I can use the command described at point 7 ?
# *gluster volume replace-brick vol sys0.example.com:/rhs/brick1/b1 sys5.example.com:/rhs/brick1/b1 commit force* *volume replace-brick: success: replace-brick commit successful*
The question is: The replaced node will be a data node (a "full replicated" node) or will be again an arbiter?
It will be an arbiter again.
Thank you
--------------332BFCB5728E9F105D670C85 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=utf-8" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <div class="moz-cite-prefix">On 06/30/2017 04:53 PM, yayo (j) wrote:<br> </div> <blockquote cite="mid:CAGK=3kxqK1Y5VbrrdYQ-nidMzXXH1cEiQ09_En=Hu4MV=PZhAg@mail.gmail.com" type="cite"> <div dir="ltr"> <div class="gmail_extra"><br> <div class="gmail_quote">2017-06-30 12:54 GMT+02:00 yayo (j) <span dir="ltr"><<a moz-do-not-send="true" href="mailto:jaganz@gmail.com" target="_blank">jaganz@gmail.com</a>></span>:<br> <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"> <div class="gmail_extra">The actual arbiter must be removed because is too obsolete. So, I needs to add the new "full replicated" node but I want to know what are the steps for add a new "full replicated" node and remove the arbiter node (Also a way to move the arbiter role to the new node, If needed) . Extra info: I want to know if I can do this on an existing ovirt gluster Data Domain (called Data01) because we have many vm runnig on it.</div> </blockquote> </div> <br> Hi,</div> <div class="gmail_extra"><br> </div> <div class="gmail_extra">I have found this doc from RH about replacing host in a gluster env: <a moz-do-not-send="true" href="https://access.redhat.com/documentation/en-US/Red_Hat_Storage/3/html/Administration_Guide/sect-Replacing_Hosts.html">https://access.redhat.com/documentation/en-US/Red_Hat_Storage/3/html/Administration_Guide/sect-Replacing_Hosts.html</a></div> <div class="gmail_extra"><br> </div> <div class="gmail_extra">I can use the command described at point 7 ? </div> <br> <div> <div class="hljs apache" style="display:block;overflow-x:auto;padding:0.5em;color:rgb(51,51,51);background:rgb(248,248,248);font-family:monospace"> <div class="gmail_extra"><br> </div> <div class="gmail_extra"> <div class="gmail_extra"><span class="hljs-comment" style="color:rgb(136,136,136)"># <b>gluster volume replace-brick vol sys0.example.com:/rhs/brick1/b1 sys5.example.com:/rhs/brick1/b1 commit force</b></span></div> <div class="gmail_extra"><span class="hljs-comment" style="color:rgb(136,136,136)"><b>volume replace-brick: success: replace-brick commit successful</b></span></div> </div> </div> </div> <br> <div class="gmail_extra"><br> </div> <div class="gmail_extra">The question is: The replaced node will be a data node (a "full replicated" node) or will be again an arbiter?</div> </div> </blockquote> It will be an arbiter again. <br> <blockquote cite="mid:CAGK=3kxqK1Y5VbrrdYQ-nidMzXXH1cEiQ09_En=Hu4MV=PZhAg@mail.gmail.com" type="cite"> <div dir="ltr"> <div class="gmail_extra"><br> </div> <div class="gmail_extra">Thank you</div> </div> </blockquote> <p><br> </p> </body> </html> --------------332BFCB5728E9F105D670C85--
This is a multi-part message in MIME format. --------------82E81368194F4601F67DAE1A Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit On 06/30/2017 04:24 PM, yayo (j) wrote:
2017-06-30 11:01 GMT+02:00 knarra <knarra@redhat.com <mailto:knarra@redhat.com>>:
You do not need to remove the arbiter node as you are getting the advantage of saving on space by having this config.
Since you have a new you can add this as fourth node and create another gluster volume (replica 3) out of this node plus the other two nodes and run vm images there as well.
Hi,
And thanks for the answer. The actual arbiter must be removed because is too obsolete. So, I needs to add the new "full replicated" node but I want to know what are the steps for add a new "full replicated" node
and remove the arbiter node (Also a way to move the arbiter role to the new node, If needed) To move arbiter role to a new node you can move the node to maintenance , add new node and replace old brick with new brick. You can follow
To add a fully replicated node you need to reduce the replica count to 2 and add new brick to the volume so that it becomes replica 3. Reducing replica count by removing a brick from replica / arbiter cannot be done from UI currently and this has to be done using gluster CLI. AFAIR, there was an issue where vm's were going to paused state when reducing the replica count and increasing it to 3. Not sure if this still holds good with the latest release. Any specific reason why you want to move to full replication instead of using an arbiter node ? the steps below to do that. * Move the node to be replaced into Maintenance mode * Prepare the replacement node * Prepare bricks on that node. * Create replacement brick directories * Ensure the new directories are owned by the vdsm user and the kvm group. * # mkdir /rhgs/bricks/engine * # chmod vdsm:kvm /rhgs/bricks/engine * # mkdir /rhgs/bricks/data * # chmod vdsm:kvm /rhgs/bricks/data * Run the following command from one of the healthy cluster members: * # gluster peer probe <new_node> * add the new host to the cluster. * Add new host address to gluster network * Click Network Interfaces sub-tab. * Click Set up Host Networks. * Drag and drop the glusternw network onto the IP address of the new host. * Click OK * Replace the old brick with the brick on the new host * Click the Bricks sub-tab. * Verify that brick heal completes successfully. * In the Hosts tab, right-click on the old host and click Remove. * Clean old host metadata * # hosted-engine --clean-metadata --host-id=<old_host_id> --force-clean
. Extra info: I want to know if I can do this on an existing ovirt gluster Data Domain (called Data01) because we have many vm runnig on it. When you move your node to maintenance all the vms running on that node will be migrated to another node and since you have two nodes up and running there should not be any problem.
thank you
--------------82E81368194F4601F67DAE1A Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=utf-8" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <div class="moz-cite-prefix">On 06/30/2017 04:24 PM, yayo (j) wrote:<br> </div> <blockquote cite="mid:CAGK=3ky808BwVy2=sEjA2rR0PZviY0fF9CbfWiWu9o0-U=Z04A@mail.gmail.com" type="cite"> <div dir="ltr"> <div class="gmail_extra"><br> <div class="gmail_quote">2017-06-30 11:01 GMT+02:00 knarra <span dir="ltr"><<a moz-do-not-send="true" href="mailto:knarra@redhat.com" target="_blank">knarra@redhat.com</a>></span>:<br> <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"> <div bgcolor="#FFFFFF">You do not need to remove the arbiter node as you are getting the advantage of saving on space by having this config. <br> <br> Since you have a new you can add this as fourth node and create another gluster volume (replica 3) out of this node plus the other two nodes and run vm images there as well.</div> </blockquote> </div> </div> <div class="gmail_extra"> <div class="gmail_extra"><br> </div> <div class="gmail_extra">Hi,</div> <div class="gmail_extra"><br> </div> <div class="gmail_extra">And thanks for the answer. The actual arbiter must be removed because is too obsolete. So, I needs to add the new "full replicated" node but I want to know what are the steps for add a new "full replicated" node </div> </div> </div> </blockquote> To add a fully replicated node you need to reduce the replica count to 2 and add new brick to the volume so that it becomes replica 3. Reducing replica count by removing a brick from replica / arbiter cannot be done from UI currently and this has to be done using gluster CLI. <br> AFAIR, there was an issue where vm's were going to paused state when reducing the replica count and increasing it to 3. Not sure if this still holds good with the latest release. <br> <br> Any specific reason why you want to move to full replication instead of using an arbiter node ?<br> <br> <br> <br> <blockquote cite="mid:CAGK=3ky808BwVy2=sEjA2rR0PZviY0fF9CbfWiWu9o0-U=Z04A@mail.gmail.com" type="cite"> <div dir="ltr"> <div class="gmail_extra"> <div class="gmail_extra">and remove the arbiter node (Also a way to move the arbiter role to the new node, If needed) </div> </div> </div> </blockquote> To move arbiter role to a new node you can move the node to maintenance , add new node and replace old brick with new brick. You can follow the steps below to do that.<br> <br> <ul> <li>Move the node to be replaced into Maintenance mode</li> <li>Prepare the replacement node</li> <li>Prepare bricks on that node.</li> <li>Create replacement brick directories</li> <li>Ensure the new directories are owned by the vdsm user and the kvm group.</li> <li># mkdir /rhgs/bricks/engine</li> <li># chmod vdsm:kvm /rhgs/bricks/engine</li> <li># mkdir /rhgs/bricks/data</li> <li># chmod vdsm:kvm /rhgs/bricks/data</li> <li>Run the following command from one of the healthy cluster members:</li> <li># gluster peer probe <new_node></li> <li> add the new host to the cluster.</li> <li>Add new host address to gluster network</li> <li>Click Network Interfaces sub-tab.</li> <li>Click Set up Host Networks.</li> <li>Drag and drop the glusternw network onto the IP address of the new host.</li> <li>Click OK</li> <li>Replace the old brick with the brick on the new host</li> <li>Click the Bricks sub-tab.</li> <li>Verify that brick heal completes successfully.</li> <li>In the Hosts tab, right-click on the old host and click Remove.</li> <li>Clean old host metadata</li> <li># hosted-engine --clean-metadata --host-id=<old_host_id> --force-clean</li> </ul> <br> <br> <blockquote cite="mid:CAGK=3ky808BwVy2=sEjA2rR0PZviY0fF9CbfWiWu9o0-U=Z04A@mail.gmail.com" type="cite"> <div dir="ltr"> <div class="gmail_extra"> <div class="gmail_extra">. Extra info: I want to know if I can do this on an existing ovirt gluster Data Domain (called Data01) because we have many vm runnig on it.</div> </div> </div> </blockquote> When you move your node to maintenance all the vms running on that node will be migrated to another node and since you have two nodes up and running there should not be any problem.<br> <blockquote cite="mid:CAGK=3ky808BwVy2=sEjA2rR0PZviY0fF9CbfWiWu9o0-U=Z04A@mail.gmail.com" type="cite"> <div dir="ltr"> <div class="gmail_extra"> <div class="gmail_extra"><br> </div> <div class="gmail_extra">thank you </div> </div> </div> </blockquote> <br> </body> </html> --------------82E81368194F4601F67DAE1A--
Hi, And sorry for delay 2017-06-30 14:09 GMT+02:00 knarra <knarra@redhat.com>:
To add a fully replicated node you need to reduce the replica count to 2 and add new brick to the volume so that it becomes replica 3. Reducing replica count by removing a brick from replica / arbiter cannot be done from UI currently and this has to be done using gluster CLI. AFAIR, there was an issue where vm's were going to paused state when reducing the replica count and increasing it to 3. Not sure if this still holds good with the latest release.
Any specific reason why you want to move to full replication instead of using an arbiter node ?
We have a new server with the same hard disk size of other two node, so, why not? Why join the cluster as an arbiter when we can have the same disk capacity to add extra replication?
and remove the arbiter node (Also a way to move the arbiter role to the new node, If needed)
To move arbiter role to a new node you can move the node to maintenance , add new node and replace old brick with new brick. You can follow the steps below to do that.
- Move the node to be replaced into Maintenance mode - Prepare the replacement node - Prepare bricks on that node. - Create replacement brick directories - Ensure the new directories are owned by the vdsm user and the kvm group. - # mkdir /rhgs/bricks/engine - # chmod vdsm:kvm /rhgs/bricks/engine - # mkdir /rhgs/bricks/data - # chmod vdsm:kvm /rhgs/bricks/data - Run the following command from one of the healthy cluster members: - # gluster peer probe <new_node> - add the new host to the cluster. - Add new host address to gluster network - Click Network Interfaces sub-tab. - Click Set up Host Networks. - Drag and drop the glusternw network onto the IP address of the new host. - Click OK - Replace the old brick with the brick on the new host - Click the Bricks sub-tab. - Verify that brick heal completes successfully. - In the Hosts tab, right-click on the old host and click Remove. - Clean old host metadata - # hosted-engine --clean-metadata --host-id=<old_host_id> --force-clean
I need this (reads: I need the arbiter role) if I reduce replica count then I add the new node as full replica and increasing replica count again to 3? (As you expained above) Thank you
This is a multi-part message in MIME format. --------------A57F4257A1EE9A2CA7556540 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit On 07/03/2017 06:53 PM, yayo (j) wrote:
Hi,
And sorry for delay
2017-06-30 14:09 GMT+02:00 knarra <knarra@redhat.com <mailto:knarra@redhat.com>>:
To add a fully replicated node you need to reduce the replica count to 2 and add new brick to the volume so that it becomes replica 3. Reducing replica count by removing a brick from replica / arbiter cannot be done from UI currently and this has to be done using gluster CLI. AFAIR, there was an issue where vm's were going to paused state when reducing the replica count and increasing it to 3. Not sure if this still holds good with the latest release.
Any specific reason why you want to move to full replication instead of using an arbiter node ?
We have a new server with the same hard disk size of other two node, so, why not? Why join the cluster as an arbiter when we can have the same disk capacity to add extra replication?
and remove the arbiter node (Also a way to move the arbiter role to the new node, If needed)
To move arbiter role to a new node you can move the node to maintenance , add new node and replace old brick with new brick. You can follow the steps below to do that.
* Move the node to be replaced into Maintenance mode * Prepare the replacement node * Prepare bricks on that node. * Create replacement brick directories * Ensure the new directories are owned by the vdsm user and the kvm group. * # mkdir /rhgs/bricks/engine * # chmod vdsm:kvm /rhgs/bricks/engine * # mkdir /rhgs/bricks/data * # chmod vdsm:kvm /rhgs/bricks/data * Run the following command from one of the healthy cluster members: * # gluster peer probe <new_node> * add the new host to the cluster. * Add new host address to gluster network * Click Network Interfaces sub-tab. * Click Set up Host Networks. * Drag and drop the glusternw network onto the IP address of the new host. * Click OK * Replace the old brick with the brick on the new host * Click the Bricks sub-tab. * Verify that brick heal completes successfully. * In the Hosts tab, right-click on the old host and click Remove. * Clean old host metadata * # hosted-engine --clean-metadata --host-id=<old_host_id> --force-clean
I need this (reads: I need the arbiter role) if I reduce replica count then I add the new node as full replica and increasing replica count again to 3? (As you expained above)
Above steps hold good if you want to move the arbiter role to a new node. If you want to move to full replica, reducing the replica count will work fine but increasing it again back to 3 might cause vm pause issues.
Thank you
--------------A57F4257A1EE9A2CA7556540 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=utf-8" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <div class="moz-cite-prefix">On 07/03/2017 06:53 PM, yayo (j) wrote:<br> </div> <blockquote cite="mid:CAGK=3kwU7VbyQjLyvG5TS0LtozOkBpGidOsBYeoyp_eOapTB6g@mail.gmail.com" type="cite"> <div dir="ltr"> <div class="gmail_extra">Hi,</div> <div class="gmail_extra"><br> </div> <div class="gmail_extra">And sorry for delay</div> <div class="gmail_extra"><br> <div class="gmail_quote">2017-06-30 14:09 GMT+02:00 knarra <span dir="ltr"><<a moz-do-not-send="true" href="mailto:knarra@redhat.com" target="_blank">knarra@redhat.com</a>></span>:<br> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div bgcolor="#FFFFFF" text="#000000">To <span class="il">add</span> a fully replicated <span class="il">node</span> you need to reduce the replica count to 2 and <span class="il">add</span> new brick to the volume so that it becomes replica 3. Reducing replica count by removing a brick from replica / arbiter cannot be done from UI currently and this has to be done using <span class="il">gluster</span> CLI. <br> AFAIR, there was an issue where vm's were going to paused state when reducing the replica count and increasing it to 3. Not sure if this still holds good with the latest release. <br> <br> Any specific reason why you want to move to <span class="il">full</span> replication instead of using an arbiter <span class="il">node</span> ?<span class=""><br> <br> </span></div> </blockquote> <div><br> </div> <div>We have a new server with the same hard disk size of other two node, so, why not? Why join the cluster as an arbiter when we can have the same disk capacity to add extra replication? </div> <div><br> </div> <div> </div> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div bgcolor="#FFFFFF" text="#000000"><span class=""> <br> <blockquote type="cite"> <div dir="ltr"> <div class="gmail_extra"> <div class="gmail_extra">and remove the arbiter <span class="il">node</span> (Also a way to move the arbiter role to the new <span class="il">node</span>, If needed) </div> </div> </div> </blockquote> </span> To move arbiter role to a new <span class="il">node</span> you can move the <span class="il">node</span> to maintenance , <span class="il">add</span> new <span class="il">node</span> and replace old brick with new brick. You can follow the steps below to do that.<br> <br> <ul> <li>Move the <span class="il">node</span> to be replaced into Maintenance mode</li> <li>Prepare the replacement <span class="il">node</span></li> <li>Prepare bricks on that <span class="il">node</span>.</li> <li>Create replacement brick directories</li> <li>Ensure the new directories are owned by the vdsm user and the kvm group.</li> <li># mkdir /rhgs/bricks/engine</li> <li># chmod vdsm:kvm /rhgs/bricks/engine</li> <li># mkdir /rhgs/bricks/data</li> <li># chmod vdsm:kvm /rhgs/bricks/data</li> <li>Run the following command from one of the healthy cluster members:</li> <li># <span class="il">gluster</span> peer probe <new_node></li> <li> <span class="il">add</span> the new host to the cluster.</li> <li><span class="il">Add</span> new host address to <span class="il">gluster</span> network</li> <li>Click Network Interfaces sub-tab.</li> <li>Click Set up Host Networks.</li> <li>Drag and drop the glusternw network onto the IP address of the new host.</li> <li>Click OK</li> <li>Replace the old brick with the brick on the new host</li> <li>Click the Bricks sub-tab.</li> <li>Verify that brick heal completes successfully.</li> <li>In the Hosts tab, right-click on the old host and click Remove.</li> <li>Clean old host metadata</li> <li># hosted-engine --clean-metadata --host-id=<old_host_id> --force-clean</li> </ul> <span class=""> <br> </span></div> </blockquote> <div><br> </div> <div>I need this (reads: I need the arbiter role) if I reduce replica count then I add the new node as full replica and increasing replica count again to 3? (As you expained above)</div> <div><br> </div> </div> </div> </div> </blockquote> Above steps hold good if you want to move the arbiter role to a new node.<br> <br> If you want to move to full replica, reducing the replica count will work fine but increasing it again back to 3 might cause vm pause issues.<br> <br> <br> <br> <br> <blockquote cite="mid:CAGK=3kwU7VbyQjLyvG5TS0LtozOkBpGidOsBYeoyp_eOapTB6g@mail.gmail.com" type="cite"> <div dir="ltr"> <div class="gmail_extra"> <div class="gmail_quote"> <div>Thank you</div> </div> </div> </div> </blockquote> <p><br> </p> </body> </html> --------------A57F4257A1EE9A2CA7556540--
This is a multi-part message in MIME format. --------------56CA6FB1F9701F8632DD2EEF Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit On 07/03/2017 06:58 PM, knarra wrote:
On 07/03/2017 06:53 PM, yayo (j) wrote:
Hi,
And sorry for delay
2017-06-30 14:09 GMT+02:00 knarra <knarra@redhat.com <mailto:knarra@redhat.com>>:
To add a fully replicated node you need to reduce the replica count to 2 and add new brick to the volume so that it becomes replica 3. Reducing replica count by removing a brick from replica / arbiter cannot be done from UI currently and this has to be done using gluster CLI. AFAIR, there was an issue where vm's were going to paused state when reducing the replica count and increasing it to 3. Not sure if this still holds good with the latest release.
Any specific reason why you want to move to full replication instead of using an arbiter node ?
We have a new server with the same hard disk size of other two node, so, why not? Why join the cluster as an arbiter when we can have the same disk capacity to add extra replication?
and remove the arbiter node (Also a way to move the arbiter role to the new node, If needed)
To move arbiter role to a new node you can move the node to maintenance , add new node and replace old brick with new brick. You can follow the steps below to do that.
* Move the node to be replaced into Maintenance mode * Prepare the replacement node * Prepare bricks on that node. * Create replacement brick directories * Ensure the new directories are owned by the vdsm user and the kvm group. * # mkdir /rhgs/bricks/engine * # chmod vdsm:kvm /rhgs/bricks/engine * # mkdir /rhgs/bricks/data * # chmod vdsm:kvm /rhgs/bricks/data * Run the following command from one of the healthy cluster members: * # gluster peer probe <new_node> * add the new host to the cluster. * Add new host address to gluster network * Click Network Interfaces sub-tab. * Click Set up Host Networks. * Drag and drop the glusternw network onto the IP address of the new host. * Click OK * Replace the old brick with the brick on the new host * Click the Bricks sub-tab. * Verify that brick heal completes successfully. * In the Hosts tab, right-click on the old host and click Remove. * Clean old host metadata * # hosted-engine --clean-metadata --host-id=<old_host_id> --force-clean
I need this (reads: I need the arbiter role) if I reduce replica count then I add the new node as full replica and increasing replica count again to 3? (As you expained above)
Above steps hold good if you want to move the arbiter role to a new node.
If you want to move to full replica, reducing the replica count will work fine but increasing it again back to 3 might cause vm pause issues. So, please poweroff your vms while performing this.
Thank you
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--------------56CA6FB1F9701F8632DD2EEF Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=windows-1252" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <div class="moz-cite-prefix">On 07/03/2017 06:58 PM, knarra wrote:<br> </div> <blockquote cite="mid:12869870-7d3a-1b80-4199-d336dfb8570c@redhat.com" type="cite"> <meta content="text/html; charset=windows-1252" http-equiv="Content-Type"> <div class="moz-cite-prefix">On 07/03/2017 06:53 PM, yayo (j) wrote:<br> </div> <blockquote cite="mid:CAGK=3kwU7VbyQjLyvG5TS0LtozOkBpGidOsBYeoyp_eOapTB6g@mail.gmail.com" type="cite"> <div dir="ltr"> <div class="gmail_extra">Hi,</div> <div class="gmail_extra"><br> </div> <div class="gmail_extra">And sorry for delay</div> <div class="gmail_extra"><br> <div class="gmail_quote">2017-06-30 14:09 GMT+02:00 knarra <span dir="ltr"><<a moz-do-not-send="true" href="mailto:knarra@redhat.com" target="_blank">knarra@redhat.com</a>></span>:<br> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div bgcolor="#FFFFFF" text="#000000">To <span class="il">add</span> a fully replicated <span class="il">node</span> you need to reduce the replica count to 2 and <span class="il">add</span> new brick to the volume so that it becomes replica 3. Reducing replica count by removing a brick from replica / arbiter cannot be done from UI currently and this has to be done using <span class="il">gluster</span> CLI. <br> AFAIR, there was an issue where vm's were going to paused state when reducing the replica count and increasing it to 3. Not sure if this still holds good with the latest release. <br> <br> Any specific reason why you want to move to <span class="il">full</span> replication instead of using an arbiter <span class="il">node</span> ?<span class=""><br> <br> </span></div> </blockquote> <div><br> </div> <div>We have a new server with the same hard disk size of other two node, so, why not? Why join the cluster as an arbiter when we can have the same disk capacity to add extra replication? </div> <div><br> </div> <div> </div> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> <div bgcolor="#FFFFFF" text="#000000"><span class=""> <br> <blockquote type="cite"> <div dir="ltr"> <div class="gmail_extra"> <div class="gmail_extra">and remove the arbiter <span class="il">node</span> (Also a way to move the arbiter role to the new <span class="il">node</span>, If needed) </div> </div> </div> </blockquote> </span> To move arbiter role to a new <span class="il">node</span> you can move the <span class="il">node</span> to maintenance , <span class="il">add</span> new <span class="il">node</span> and replace old brick with new brick. You can follow the steps below to do that.<br> <br> <ul> <li>Move the <span class="il">node</span> to be replaced into Maintenance mode</li> <li>Prepare the replacement <span class="il">node</span></li> <li>Prepare bricks on that <span class="il">node</span>.</li> <li>Create replacement brick directories</li> <li>Ensure the new directories are owned by the vdsm user and the kvm group.</li> <li># mkdir /rhgs/bricks/engine</li> <li># chmod vdsm:kvm /rhgs/bricks/engine</li> <li># mkdir /rhgs/bricks/data</li> <li># chmod vdsm:kvm /rhgs/bricks/data</li> <li>Run the following command from one of the healthy cluster members:</li> <li># <span class="il">gluster</span> peer probe <new_node></li> <li> <span class="il">add</span> the new host to the cluster.</li> <li><span class="il">Add</span> new host address to <span class="il">gluster</span> network</li> <li>Click Network Interfaces sub-tab.</li> <li>Click Set up Host Networks.</li> <li>Drag and drop the glusternw network onto the IP address of the new host.</li> <li>Click OK</li> <li>Replace the old brick with the brick on the new host</li> <li>Click the Bricks sub-tab.</li> <li>Verify that brick heal completes successfully.</li> <li>In the Hosts tab, right-click on the old host and click Remove.</li> <li>Clean old host metadata</li> <li># hosted-engine --clean-metadata --host-id=<old_host_id> --force-clean</li> </ul> <span class=""> <br> </span></div> </blockquote> <div><br> </div> <div>I need this (reads: I need the arbiter role) if I reduce replica count then I add the new node as full replica and increasing replica count again to 3? (As you expained above)</div> <div><br> </div> </div> </div> </div> </blockquote> Above steps hold good if you want to move the arbiter role to a new node.<br> <br> If you want to move to full replica, reducing the replica count will work fine but increasing it again back to 3 might cause vm pause issues.<br> </blockquote> So, please poweroff your vms while performing this.<br> <blockquote cite="mid:12869870-7d3a-1b80-4199-d336dfb8570c@redhat.com" type="cite"> <br> <br> <br> <br> <blockquote cite="mid:CAGK=3kwU7VbyQjLyvG5TS0LtozOkBpGidOsBYeoyp_eOapTB6g@mail.gmail.com" type="cite"> <div dir="ltr"> <div class="gmail_extra"> <div class="gmail_quote"> <div>Thank you</div> </div> </div> </div> </blockquote> <p><br> </p> <br> <fieldset class="mimeAttachmentHeader"></fieldset> <br> <pre wrap="">_______________________________________________ Users mailing list <a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a> <a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a> </pre> </blockquote> <p><br> </p> </body> </html> --------------56CA6FB1F9701F8632DD2EEF--
participants (2)
-
knarra -
yayo (j)