3:46 a.m.
--_000_DB6P190MB0280EC7A213B057A1E6FE48AC88B0DB6P190MB0280EURP_
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
That is great Kasturi, thanks!
I will go over these steps just to make sure nothing is missing. But it loo=
ks the right way to do it. The only step that looks strange is the step 6 t=
o shutdown. I always though that if I shutdown a HA protected machine oVirt=
would then launch it back again. So in my thoughts I would do the step 6 b=
efore step 4. This said, am I missing something?
Moacir
________________________________
From: Kasturi Narra <knarra(a)redhat.com Sent:
Wednesday, August 9, 2017 5:51 AM
To: Moacir Ferreira
Cc: Erekle Magradze; users(a)ovirt.org
Subject: Re: [ovirt-users] How to shutdown an oVirt cluster with Gluster an=
d hosted engine
Hi,
You can follow the steps below to do that.
1) Stop all the virtual machines.
2) Move all the storage domains other than hosted_storage to maintenance wh=
ich will unmount them from all the nodes.
3) Move HE to global maintenance 'hosted-engine --set-maintenance --mode =
=3Dglobal'
4) stop HE vm by running the command 'hosted-engine --vm-shutdown'
5) confirm that engine is down using the command 'hosted-engine --vm-status=
'
6) stop ha agent and broker services on all the nodes by running the comman=
d 'systemctl stop ovirt-ha-broker' ; 'systemctl stop ovirt-ha-agent'
7) umount hosted-engine from all the hypervisors 'hosted-engine --disconnec=
t-storage'
8) stop all the volumes.
9) power off all the hypervisors.
To bring it up back again below steps will help.
1) Power on all the hypervisors.
2) start all the volumes
3) start ha agent and broker services on all the nodes by running the comma=
nd 'systemctl start ovirt-ha-broker' ; 'systemctl start ovirt-ha-agent'
4) Move hosted-engine out of global maintenance by running the command host=
ed-engine --set-maintenance --mode =3Dnone
5) give some time for the HE to come up. check for hosted-engine --vm-statu=
s to see if HE vm is up.
6) Activate all storage domains from UI.
7) start all virtual machines.
Hope this helps !!!
Thanks
kasturi.
On Tue, Aug 8, 2017 at 2:27 AM, Moacir Ferreira <moacirferreira(a)hotmail.com=
<mailto:moacirferreira@hotmail.com>> wrote:
Sorry Erekle, I am just a beginner...
Sent: Monday, August 7, 2017 9:12
PM
To: Moacir Ferreira; users@ovirt.org<mailto:users@ovirt.org Subject: Re: [ovirt-users] How to shutdown an oVirt cluster
with Gluster an=
d hosted engine
Hi Moacir,
First switch off all VMs.
Second you need to declare hosts maintenance mode, don't start with SRM (of=
course if you are able use the ovirt-engine), it will ask you to shutdown =
the glusterfs on a machine.
Third if all machines are in maintenance mode, you can start shutting down =
them.
If you have hosted engine setup follow this [1]
Cheers
Erekle
[1] https://github.com/rharmonson/richtech/wiki/OSVDC-Series:-oVirt-3.6-Clu=
ster-Shutdown-and-Startup
[https://avatars1.githubusercontent.com/u/7966126?v=3D4&s=3D400]<ht...
thub.com/rharmonson/richtech/wiki/OSVDC-Series:-oVirt-3.6-Cluster-Shutdown-=
and-Startup
OSVDC Series: oVirt 3.6 Cluster Shutdown and Startup ...<https://github.com=
/rharmonson/richtech/wiki/OSVDC-Series:-oVirt-3.6-Cluster-Shutdown-and-Star=
tup github.com<http://github.com
Contribute to richtech development by creating an account on GitHub.
On 08/07/2017 08:58 PM, Moacir Ferreira wrote:
I have installed a oVirt cluster in a KVM virtualized test environment. Now=
, how do I properly shutdown the oVirt cluster, with Gluster and the hosted=
engine?
I.e.: I want to install a cluster of 3 servers and then send it to a remote=
office. How do I do it properly? I noticed that glusterd is not enabled to=
start automatically. And how do I deal with the hosted engine?
Thanks,
Moacir
_______________________________________________
Users mailing list
Users@ovirt.org<mailto:Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--
Recogizer Group GmbH
Dr.rer.nat. Erekle Magradze
Lead Big Data Engineering & DevOps
Rheinwerkallee 2, 53227 Bonn
Tel: +49 228 29974555
E-Mail erekle.magradze@recogizer.de<mailto:erekle.magradze@recogizer.de Web: www.recogizer.com<http://www.recogizer.com
Recogizer auf LinkedIn https://www.linkedin.com/company-beta/10039182/
Folgen Sie uns auf Twitter https://twitter.com/recogizer
-----------------------------------------------------------------
Recogizer Group GmbH
Gesch=E4ftsf=FChrer: Oliver Habisch, Carsten Kreutze
Handelsregister: Amtsgericht Bonn HRB 20724
Sitz der Gesellschaft: Bonn; USt-ID-Nr.: DE294195993
Diese E-Mail enth=E4lt vertrauliche und/oder rechtlich gesch=FCtzte Informa=
tionen.
Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrt=FCmlich er=
halten haben,
informieren Sie bitte sofort den Absender und l=F6schen Sie diese Mail.
Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail und der =
darin enthaltenen Informationen ist nicht gestattet.
_______________________________________________
Users mailing list
Users@ovirt.org<mailto:Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--_000_DB6P190MB0280EC7A213B057A1E6FE48AC88B0DB6P190MB0280EURP_
Content-Type: text/html; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
<html <head <meta http-equiv=3D"Content-Type"
content=3D"text/html; charset=3Diso-8859-=
1" <style type=3D"text/css"
style=3D"display:none;"><!-- P {margin-top:0;margi=
n-bottom:0;} --></style </head <body dir=3D"ltr" <div
id=3D"divtagdefaultwrapper" style=3D"font-size:12pt;color:#000000;font=
-family:Calibri,Helvetica,sans-serif;" dir=3D"ltr" <p>That is great Kasturi, thanks!</p <p <p>I will go over these steps just to make sure nothing
is missing. But it =
looks the right way to do it. The only step that looks strange is the step =
6 to shutdown. I always though that if I shutdown a HA protected machine oV=
irt would then launch it back again.
So in my thoughts I would do the step 6 before step 4. This said, am I mis=
sing something?<br </p
<br Moacir<br <br <div style=3D"color: rgb(49,
55, 57);" <hr tabindex=3D"-1"
style=3D"display:inline-block; width:98%" <div
id=3D"divRplyFwdMsg" dir=3D"ltr"><font
style=3D"font-size:11pt" face=
=3D"Calibri, sans-serif" color=3D"#000000"><b>From:</b>
Kasturi Narra <k=
narra(a)redhat.com&gt;<br <b>Sent:</b> Wednesday,
August 9, 2017 5:51 AM<br <b>To:</b> Moacir
Ferreira<br <b>Cc:</b> Erekle
Magradze; users(a)ovirt.org<br <b>Subject:</b> Re:
[ovirt-users] How to shutdown an oVirt cluster with Glu=
ster and hosted engine</font <div> </div </div
<div <div
dir=3D"ltr">Hi,
<div><span style=3D"font-size:12.8px">
You can fo=
llow the steps below to do that.</span <p
style=3D"font-size:12.8px">1) Stop all the virtual machines.<br </p <p
style=3D"font-size:12.8px">2) Move all the storage domains other than ho=
sted_storage to maintenance which will unmount them from all the nodes.<br </p <p
style=3D"font-size:12.8px">3) Move HE to global maintenance
'hoste=
d-engine --set-maintenance --mode =3Dglobal'</p <p
style=3D"font-size:12.8px">4) stop HE vm by running the command
'hosted-=
engine --vm-shutdown'</p <p
style=3D"font-size:12.8px">5) confirm that engine is down using the comm=
and 'hosted-engine --vm-status'</p <p
style=3D"font-size:12.8px">6) stop ha agent and broker services on all t=
he nodes by running the command 'systemctl stop ovirt-ha-broker' ; 'systemc=
tl stop ovirt-ha-agent'</p <p
style=3D"font-size:12.8px">7) umount hosted-engine from all the hypervis=
ors 'hosted-engine --disconnect-storage'</p <p
style=3D"font-size:12.8px">8) stop all the volumes.</p <p style=3D"font-size:12.8px">9) power off all
the hypervisors.</p <p
style=3D"font-size:12.8px" <p
style=3D"font-size:12.8px">To bring it up back again below steps will he=
lp.</p <p
style=3D"font-size:12.8px" <p
style=3D"font-size:12.8px">1) Power on all the hypervisors.</p <p style=3D"font-size:12.8px">2) start all the
volumes</p <p
style=3D"font-size:12.8px">3) <span
style=3D"font-size:12.8px">star=
t ha agent and broker services on all the nodes by running the command 'sys=
temctl start ovirt-ha-broker' ; 'systemctl start
ovirt-ha-agent'</span></p <p
style=3D"font-size:12.8px"><span
style=3D"font-size:12.8px">4) Move host=
ed-engine out of global maintenance by running the command </span><spa=
n style=3D"font-size:12.8px">hosted-engine --set-maintenance --mode =3Dnone=
</span></p <p
style=3D"font-size:12.8px"><span
style=3D"font-size:12.8px">5) give some=
time for the HE to come up. check for hosted-engine --vm-status to see if =
HE vm is up.</span></p <p
style=3D"font-size:12.8px"><span
style=3D"font-size:12.8px">6) Activate =
all storage domains from UI.</span></p <p
style=3D"font-size:12.8px">7) start all virtual machines.</p <p style=3D"font-size:12.8px">Hope this helps
!!!</p <p
style=3D"font-size:12.8px"><span
style=3D"font-size:12.8px">Thanks</span=
<p
style=3D"font-size:12.8px">kasturi.</p
</div <div
class=3D"gmail_extra" <<a
href=3D"mailto:moacirferreira@hotmail.com"
target=3D"_blank">moacirf=
erreira(a)hotmail.com</a>&gt;</span> wrote:<br <blockquote class=3D"gmail_quote"
style=3D"margin:0 0 0 .8ex; border-left:1=
px #ccc solid; padding-left:1ex" <div
dir=3D"ltr" <div
id=3D"m_3544374521327452776divtagdefaultwrapper" dir=3D"ltr"
style=3D"=
font-size:12pt; color:#000000; font-family:Calibri,Helvetica,sans-serif" <p>Sorry Erekle, I am just a beginner...</p <p <p>From the hosted engine I can put the two other
servers, that are not hos=
ting the hosted-engine, on maintenance, and that was what I did. When I tri=
ed to put the last one on maintenance it did not allow me due to the hosted=
-engine and I force it shunting
down from the ssh CLI.</p <p <p>So, what should I do? My
guess is that I should ssh to the hosted engine=
and shut it down. As it would not have another node to re-launch itself, t=
hen it would stay down. After this I should shutdown the oVirt node. Is it?=
</p <p <p>Anyway, I made a mistake and I forced it. When I try
to bring the cluste=
r back, I noticed that glusterd was not enabled to start when the node powe=
r-on. As I am a beginner, I "think" that there must be a reason t=
o not start glusterd when the node comes up.
So I started glusterd on the arbitrator (3rd server), then on the sec=
ond node and finally on the host that was hosting the hosted-engine. It wor=
ked, but when I try to change the maintenance mode on the two nodes (2nd an=
d 3rd) back to normal, the hosted-engine
went down and I had to start it manually.</p <p
<p>All this said, I would like to know how to bring the cluster down and ho=
w to bring it back on in the "right way" so I don't get problems.=
And yes, no VM is running but the hosted-engine.</p <p
<p>Thanks for sharing your knowledge.</p
<p>Moacir<br </p
<br <br <div
style=3D"color:rgb(49,55,57)" <hr
style=3D"display:inline-block; width:98%" <div
id=3D"m_3544374521327452776divRplyFwdMsg" dir=3D"ltr"><font
style=3D"f=
ont-size:11pt" face=3D"Calibri, sans-serif"
color=3D"#000000"><b>From:</b> =
Erekle Magradze <<a href=3D"mailto:erekle.magradze@recogizer.de"
target=
=3D"_blank">erekle.magradze(a)recogizer.de</a>&gt;<br <b>Sent:</b> Monday, August 7, 2017 9:12
PM<br <b>To:</b> Moacir
Ferreira; <a href=3D"mailto:users@ovirt.org" target=3D"_b=
lank">users(a)ovirt.org</a <div> </div </div
<div><span class=3D""
<p>Hi Moacir,</p <p>First switch off all
VMs.<br </p
<p>Second you need to declare hosts maintenance mode, don't start with SRM
=
(of course if you are able use the ovirt-engine), it will ask you to shutdo=
wn the glusterfs on a machine.<br
</p <p>Third if all machines are
in maintenance mode, you can start shutting do=
wn them.</p <p <p>If you have hosted engine
setup follow this [1]</p <p <p>Cheers</p <p>Erekle</p <p
<p>[1] <a class=3D"m_3544374521327452776moz-txt-link-freetext"
href=3D"http=
s://github.com/rharmonson/richtech/wiki/OSVDC-Series:-oVirt-3.6-Cluster-Shu=
tdown-and-Startup" id=3D"m_3544374521327452776LPlnk698479"
target=3D"_blank=
"
https://github.com/rharmonson/<wbr>richtech/wiki/OSVDC-Series:-<...
.6-Cluster-Shutdown-<wbr>and-Startup</a></p
</span <div
id=3D"m_3544374521327452776LPBorder_GT_15021385378540.4495352676201600=
5" style=3D"margin-bottom:20px; overflow:auto; width:100%;
text-indent:0px"=
<table
id=3D"m_3544374521327452776LPContainer_15021385378430.15570265400959=
15" style=3D"width:90%; background-color:rgb(255,255,255); overflow:auto; p=
adding-top:20px; padding-bottom:20px; margin-top:20px; border-top:1px dotte=
d rgb(200,200,200); border-bottom:1px dotted rgb(200,200,200)" cellspacing=
=3D"0" <tbody <tr style=3D"border-spacing:0px"
valign=3D"top" <td
id=3D"m_3544374521327452776ImageCell_15021385378460.2075482803057317" c=
olspan=3D"1" style=3D"width:250px; display:table-cell;
padding-right:20px" <div
id=3D"m_3544374521327452776LPImageContainer_15021385378460.64019993193=
70751" style=3D"background-color:rgb(255,255,255); height:250px; margin:aut=
o; display:table; width:250px" <a
id=3D"m_3544374521327452776LPImageAnchor_15021385378480.780110251720861"=
href=3D"https://github.com/rharmonson/richtech/wiki/OSVDC-Series:-oV...
6-Cluster-Shutdown-and-Startup" target=3D"_blank"
style=3D"display:table-ce=
ll; text-align:center"><img
id=3D"m_3544374521327452776LPThumbnailImageID_1=
5021385378480.309951069136171" style=3D"display:inline-block; max-width:250=
px; max-height:250px; height:250px; width:250px; border-width:0px; vertical=
-align:bottom" width=3D"250" height=3D"250"
src=3D"https://avatars1.githubu=
sercontent.com/u/7966126?v=3D4&s=3D400"></a></div </td <td
id=3D"m_3544374521327452776TextCell_15021385378500.42406867055408104" c=
olspan=3D"2" style=3D"vertical-align:top; padding:0px;
display:table-cell" <div
id=3D"m_3544374521327452776LPRemovePreviewContainer_15021385378500.096=
48672645925471" </div <div
id=3D"m_3544374521327452776LPTitle_15021385378500.5741607502358855" st=
yle=3D"color:rgb(0,120,215); font-weight:400; font-size:21px; font-family:&=
quot;wf_segoe-ui_light","Segoe UI Light","Segoe WP
Ligh=
t","Segoe UI","Segoe
WP",Tahoma,Arial,sans-serif; =
line-height:21px" <a
id=3D"m_3544374521327452776LPUrlAnchor_15021385378510.9292682478026467" =
href=3D"https://github.com/rharmonson/richtech/wiki/OSVDC-Series:-oV...
-Cluster-Shutdown-and-Startup" target=3D"_blank"
style=3D"text-decoration:n=
one">OSVDC Series: oVirt 3.6 Cluster Shutdown
and Startup ...</a></div <div
id=3D"m_3544374521327452776LPMetadata_15021385378520.7560393279127221"=
style=3D"margin:10px 0px 16px; color:rgb(102,102,102); font-weight:400; fo=
nt-family:"wf_segoe-ui_normal","Segoe
UI","Segoe W=
P",Tahoma,Arial,sans-serif; font-size:14px; line-height:14px" <a href=3D"http://github.com"
target=3D"_blank">github.com</a></div <div
id=3D"m_3544374521327452776LPDescription_15021385378530.76668846647883=
62" style=3D"display:block; color:rgb(102,102,102); font-weight:400; font-f=
amily:"wf_segoe-ui_normal","Segoe UI","Segoe
WP&qu=
ot;,Tahoma,Arial,sans-serif; font-size:14px; line-height:20px; max-height:1=
00px; overflow:hidden" Contribute to richtech development
by creating an account on GitHub.</div
</td </tr
</tbody </table </div
<div <div class=3D"h5" </div <blockquote type=3D"cite" <div
id=3D"m_3544374521327452776divtagdefaultwrapper" dir=3D"ltr"
style=3D"=
font-size:12pt; color:#000000; font-family:Calibri,Helvetica,sans-serif" <p>I have installed a oVirt cluster in a KVM virtualized
test environment. =
Now, how do I <span>properly shutdown the oVirt cluster, with Gluster =
and the hosted engine</span>?</p
<p>I.e.: I want to install a cluster of 3 servers and then send it to a rem=
ote office. How do I do it properly? I noticed that glusterd is not enabled=
to start automatically. And how do I deal with the hosted engine?</p <p <p>Thanks,<br
</p <p>Moacir<br </p </div <br <fieldset
class=3D"m_3544374521327452776mimeAttachmentHeader"></fieldset> <=
br
<pre>______________________________<wbr>_________________=0A=
Users mailing list=0A=
<a class=3D"m_3544374521327452776moz-txt-link-abbreviated"
href=3D"mailto:U=
sers(a)ovirt.org" target=3D"_blank">Users(a)ovirt.org</a>=0A=
<a class=3D"m_3544374521327452776moz-txt-link-freetext"
href=3D"http://list=
s.ovirt.org/mailman/listinfo/users"
target=3D"_blank">http://lists.ovirt.or=
g/<wbr>mailman/listinfo/users</a>=0A=
</pre </blockquote <br <pre
class=3D"m_3544374521327452776moz-signature" cols=3D"72">-- =0A=
Recogizer Group GmbH=0A=
=0A=
Dr.rer.nat. Erekle Magradze=0A=
Lead Big Data Engineering & DevOps=0A=
Rheinwerkallee 2, 53227 Bonn=0A=
Tel: +49 228 29974555=0A=
=0A=
E-Mail <a class=3D"m_3544374521327452776moz-txt-link-abbreviated"
href=3D"m=
ailto:erekle.magradze@recogizer.de"
target=3D"_blank">erekle.magradze@recog=
izer.de</a>=0A=
Web: <a class=3D"m_3544374521327452776moz-txt-link-abbreviated"
href=3D"htt=
p://www.recogizer.com"
target=3D"_blank">www.recogizer.com</a>=0A=
=0A=
Recogizer auf LinkedIn <a class=3D"m_3544374521327452776moz-txt-link-freete=
xt" href=3D"https://www.linkedin.com/company-beta/10039182/"
target=3D"_bla=
nk">https://www.linkedin.com/<wbr>company-beta/10039182/<...
Folgen Sie uns auf Twitter <a class=3D"m_3544374521327452776moz-txt-link-fr=
eetext" href=3D"https://twitter.com/recogizer"
target=3D"_blank">https://tw=
itter.com/recogizer</a>=0A=
=0A=
------------------------------<wbr>------------------------------<wbr>-----=
=0A=
Recogizer Group GmbH=0A=
Gesch=E4ftsf=FChrer: Oliver Habisch, Carsten Kreutze=0A=
Handelsregister: Amtsgericht Bonn HRB 20724=0A=
Sitz der Gesellschaft: Bonn; USt-ID-Nr.: DE294195993=0A=
=0A=
Diese E-Mail enth=E4lt vertrauliche und/oder rechtlich gesch=FCtzte Informa=
tionen.=0A=
Wenn Sie nicht der richtige Adressat sind oder diese E-Mail irrt=FCmlich er=
halten haben,=0A=
informieren Sie bitte sofort den Absender und l=F6schen Sie diese Mail.=0A=
Das unerlaubte Kopieren sowie die unbefugte Weitergabe dieser Mail und der =
darin enthaltenen Informationen ist nicht gestattet.</pre
</div </div </div
</div </div </div
<br
______________________________<wbr>_________________<br Users mailing list<br <a
href=3D"mailto:Users@ovirt.org">Users@ovirt.org</a <br </blockquote </div
<br </div </div
</div </div </body
</html
--_000_DB6P190MB0280EC7A213B057A1E6FE48AC88B0DB6P190MB0280EURP_--
From the hosted engine I can put the two other servers, that are not
hostin=
g the hosted-engine, on maintenance, and that was what I did. When I tried
=
to put the last one on maintenance it did not allow me due to the hosted-en=
gine and I force it shunting down from the ssh CLI.
So, what should I do? My guess is that I should ssh to the hosted engine an=
d shut it down. As it would not have another node to re-launch itself, then=
it would stay down. After this I should shutdown the oVirt node. Is it?
Anyway, I made a mistake and I forced it. When I try to bring the cluster b=
ack, I noticed that glusterd was not enabled to start when the node power-o=
n. As I am a beginner, I "think" that there must be a reason to not start g=
lusterd when the node comes up. So I started glusterd on the arbitrator (3r=
d server), then on the second node and finally on the host that was hosting=
the hosted-engine. It worked, but when I try to change the maintenance mod=
e on the two nodes (2nd and 3rd) back to normal, the hosted-engine went dow=
n and I had to start it manually.
All this said, I would like to know how to bring the cluster down and how t=
o bring it back on in the "right way" so I don't get problems. And yes, no
=
VM is running but the hosted-engine.
Thanks for sharing your knowledge.
Moacir
________________________________
From: Erekle Magradze <erekle.magradze@recogizer.de<mailto:erekle.magradze@=
recogizer.de><br>
</p<br>
</div<br>
</p<br>
</p<br>
</p<br>
<div
class=3D"gmail_quote">On Tue, Aug 8, 2017 at 2:27 AM, Moacir Ferreira =
<span dir=3D"ltr"<br>
</p<br>
</p<br>
</p<br>
</p<br>
</p<br>
<b>Subject:</b> Re: [ovirt-users] How to shutdown an oVirt cluster with
Glu=
ster and hosted engine</font<br>
</p<br>
</p<br>
</p<br>
<div
class=3D"m_3544374521327452776moz-cite-prefix">On 08/07/2017 08:58 PM,=
Moacir Ferreira wrote:<br<br>
</p<br>
<a
href=3D"http://lists.ovirt.org/mailman/listinfo/users" rel=3D"noreferrer=
"
target=3D"_blank">http://lists.ovirt.org/<wbr>mailman/...
br