Ovirt-3.4.1: How to: Upgrading Hosted Engine Cluster
--=-wlqg4Mk7qpqjBQhvuW3U Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello, failing to find a procedure how to actually upgrade a HA cluster, I did the following witch turned out to be working pretty well. I am somewhat new to oVirt and was amazed how well actually; I did not need to shutdown a single VM (well, one because of mem usage; many of my running VMs have fancy stuff like iscsi and FC luns via a Quantum Stornext HA Cluster): 1. Set cluster to global maintance 2. Login to ovit engine and to the upgrade according to the release nodes. 3. After the upgrade is finished and the engine running, set the first Node in local maintenance. 4. Login the first node and yum update (with the removal of ovirt-release as mentioned in release notes).* I rebooted the node because of the kernel update. 5. Return to oVirt and reinstall the Node from GUI, it will be set to operational automatically** 6. Repeat steps 3-6 for the rest of the Nodes. 7. Remove global maintenance. 8. Update the last Node.*** * I first tried to do this with re-install from GUI. This failed; so I used the yum - update method to update all relevant services ** I do not know if this was necessary. I did this because the hosted-engine --deploy does the same thing when adding a host. *** I found this to be necessary because I had all my Nodes in local maintenance and could not migrate the Hosted engine from the last node any more. The host activation in oVirt did not remove the local maintenance set prior to the update (witch it should, IMHO). It might be desirable to have a hosted-engine command option to remove local maintenance for that reason. --=20 Daniel Helgenberger=20 m box bewegtbild GmbH=20 P: +49/30/2408781-22 F: +49/30/2408781-10 ACKERSTR. 19=20 D-10115 BERLIN=20 www.m-box.de www.monkeymen.tv=20 Gesch=C3=A4ftsf=C3=BChrer: Martin Retschitzegger / Michaela G=C3=B6llner Handeslregister: Amtsgericht Charlottenburg / HRB 112767=20 --=-wlqg4Mk7qpqjBQhvuW3U Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Disposition: attachment; filename="smime.p7s" Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIINtjCCBBYw ggL+oAMCAQICCwQAAAAAAS9O4S9SMA0GCSqGSIb3DQEBBQUAMFcxCzAJBgNVBAYTAkJFMRkwFwYD VQQKExBHbG9iYWxTaWduIG52LXNhMRAwDgYDVQQLEwdSb290IENBMRswGQYDVQQDExJHbG9iYWxT aWduIFJvb3QgQ0EwHhcNMTEwNDEzMTAwMDAwWhcNMTkwNDEzMTAwMDAwWjBUMQswCQYDVQQGEwJC RTEZMBcGA1UEChMQR2xvYmFsU2lnbiBudi1zYTEqMCgGA1UEAxMhR2xvYmFsU2lnbiBQZXJzb25h bFNpZ24gMiBDQSAtIEcyMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAwWtB+TXs+BJ9 3SJRaV+3uRNGJ3cUO+MTgW8+5HQXfgy19CzkDI1T1NwwICi/bo4R/mYR5FEWx91//eE0ElC/89iY 7GkL0tDasmVx4TOXnrqrsziUcxEPPqHRE8x4NhtBK7+8o0nsMIJMA1gyZ2FA5To2Ew1BBuvovvDJ +Nua3qOCNBNu+8A+eNpJlVnlu/qB7+XWaPXtUMlsIikxD+gREFVUgYE4VzBuLa2kkg0VLd09XkE2 ceRDm6YgRATuDk6ogUyX4OLxCGIJF8yi6Z37M0wemDA6Uff0EuqdwDQd5HwG/rernUjt1grLdAxq 8BwywRRg0eFHmE+ShhpyO3Fi+wIDAQABo4HlMIHiMA4GA1UdDwEB/wQEAwIBBjASBgNVHRMBAf8E CDAGAQH/AgEAMB0GA1UdDgQWBBQ/FdJtfC/nMZ5DCgaolGwsO8XuZTBHBgNVHSAEQDA+MDwGBFUd IAAwNDAyBggrBgEFBQcCARYmaHR0cHM6Ly93d3cuZ2xvYmFsc2lnbi5jb20vcmVwb3NpdG9yeS8w MwYDVR0fBCwwKjAooCagJIYiaHR0cDovL2NybC5nbG9iYWxzaWduLm5ldC9yb290LmNybDAfBgNV HSMEGDAWgBRge2YaRQ2XyolQL30EzTSo//z9SzANBgkqhkiG9w0BAQUFAAOCAQEAQ3N5zKTMSTED HGFAgd/gu91Kb8AxPHgjq+7dhf7mkCinMqqrLai2XOrz8CP63BPaAx7oGOUBI0MyASBGk5zej9L3 oHtiF2BL01m1sBnT8rQxT2CJd/+jqjUl0p2ew8T3HSyatrsooGvDwf00yCB2JHTNvtQxNO8t6x/+ 048A1Q+0i7uf0nTnyrJLjD04zhL89ytetZspltOpJVYbmwiFjq6PxsdUNthUDme/9pOLmKDnQU0p W/JEwLs2TYCBNKwdgSGAk8/z+s2SCltKIG0Uh5U6t6j7JPuwNP/znImwMrlHDJ1YpW0rkF2PGraV CgDBf9dOB+IIpnwHfIi+LD+eITCCBMowggOyoAMCAQICEQCWaWbA3qWpL+Qmn6I16DynMA0GCSqG SIb3DQEBBQUAMFQxCzAJBgNVBAYTAkJFMRkwFwYDVQQKExBHbG9iYWxTaWduIG52LXNhMSowKAYD VQQDEyFHbG9iYWxTaWduIFBlcnNvbmFsU2lnbiAyIENBIC0gRzIwHhcNMTMwODI3MTY1NzU4WhcN MTYwODI3MTY1NzU4WjBYMQswCQYDVQQGEwJERTEcMBoGA1UEAxMTRGFuaWVsIEhlbGdlbmJlcmdl cjErMCkGCSqGSIb3DQEJARYcZGFuaWVsLmhlbGdlbmJlcmdlckBtLWJveC5kZTCCASIwDQYJKoZI hvcNAQEBBQADggEPADCCAQoCggEBAM4BQ5vPknk1OGLd1qKSUIKmQLrjccjJcYj7qtAtA+fNYKF8 9p1VY4UwiFcF9jKlmA9Q8o8tYSx16LYYFoGWokNRAeKFXZiBZiHyI0ekpEfxo8N5cTMCcxKcSYWV 8sqzmBPCoMNpmiVoC8ec8Nv5SqXH34VVtDmNLfiVlsTyomBXAJkJ2/n5XqJzPLFGWWREtPLkVVS+ u426vt/hNsQi5akNoidYeXo98JcrmeApFJ3zB2KxvMziHx8LD4q1gAl9NumtX5YLbCpdWL9AkWdX Oaro3D9zj6Q6LyGwa/UQUrZdg3BXc07hjHZn6d9vet1SzpbyqQpTzM63yXiX1meEMlMCAwEAAaOC AZEwggGNMA4GA1UdDwEB/wQEAwIFoDBMBgNVHSAERTBDMEEGCSsGAQQBoDIBKDA0MDIGCCsGAQUF BwIBFiZodHRwczovL3d3dy5nbG9iYWxzaWduLmNvbS9yZXBvc2l0b3J5LzAnBgNVHREEIDAegRxk YW5pZWwuaGVsZ2VuYmVyZ2VyQG0tYm94LmRlMAkGA1UdEwQCMAAwHQYDVR0lBBYwFAYIKwYBBQUH AwIGCCsGAQUFBwMEMEMGA1UdHwQ8MDowOKA2oDSGMmh0dHA6Ly9jcmwuZ2xvYmFsc2lnbi5jb20v Z3MvZ3NwZXJzb25hbHNpZ24yZzIuY3JsMFUGCCsGAQUFBwEBBEkwRzBFBggrBgEFBQcwAoY5aHR0 cDovL3NlY3VyZS5nbG9iYWxzaWduLmNvbS9jYWNlcnQvZ3NwZXJzb25hbHNpZ24yZzIuY3J0MB0G A1UdDgQWBBS8NFA/upd+Wipw2nj8RD/Ct+R2GTAfBgNVHSMEGDAWgBQ/FdJtfC/nMZ5DCgaolGws O8XuZTANBgkqhkiG9w0BAQUFAAOCAQEAXVTpu4fhOLETAW0zdbQiIwBIMZgeVNJnWV3GsMxByycU 63P+WBQTBl9qj47vHLmVdeF7MzH0QSXZSc9Tnfr6CYIImpyIZxRAGpAsWmtZf3JieRA0+j4GQJF2 zAea1NXYXoG9+ZSSZHBSxKUdrRdVdE320nuVGTT2HjEI2LEYbOvaXyi6HhpuHUiyu4LD0+RIT3fi T8jUiKKLTsApTD+Ak8SLF0IESOSA6htirv69mDDC7Klg9dT7QBPO7dpoKIUOldV3VhahndVfsDff KD7pkUUvG5XftYEQOxlWDJzuTBeqf/4hxXMtzFU9OaI6oKJjLfr6B+XBc6xwOtc/NMWmejCCBMow ggOyoAMCAQICEQCWaWbA3qWpL+Qmn6I16DynMA0GCSqGSIb3DQEBBQUAMFQxCzAJBgNVBAYTAkJF MRkwFwYDVQQKExBHbG9iYWxTaWduIG52LXNhMSowKAYDVQQDEyFHbG9iYWxTaWduIFBlcnNvbmFs U2lnbiAyIENBIC0gRzIwHhcNMTMwODI3MTY1NzU4WhcNMTYwODI3MTY1NzU4WjBYMQswCQYDVQQG EwJERTEcMBoGA1UEAxMTRGFuaWVsIEhlbGdlbmJlcmdlcjErMCkGCSqGSIb3DQEJARYcZGFuaWVs LmhlbGdlbmJlcmdlckBtLWJveC5kZTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAM4B Q5vPknk1OGLd1qKSUIKmQLrjccjJcYj7qtAtA+fNYKF89p1VY4UwiFcF9jKlmA9Q8o8tYSx16LYY FoGWokNRAeKFXZiBZiHyI0ekpEfxo8N5cTMCcxKcSYWV8sqzmBPCoMNpmiVoC8ec8Nv5SqXH34VV tDmNLfiVlsTyomBXAJkJ2/n5XqJzPLFGWWREtPLkVVS+u426vt/hNsQi5akNoidYeXo98JcrmeAp FJ3zB2KxvMziHx8LD4q1gAl9NumtX5YLbCpdWL9AkWdXOaro3D9zj6Q6LyGwa/UQUrZdg3BXc07h jHZn6d9vet1SzpbyqQpTzM63yXiX1meEMlMCAwEAAaOCAZEwggGNMA4GA1UdDwEB/wQEAwIFoDBM BgNVHSAERTBDMEEGCSsGAQQBoDIBKDA0MDIGCCsGAQUFBwIBFiZodHRwczovL3d3dy5nbG9iYWxz aWduLmNvbS9yZXBvc2l0b3J5LzAnBgNVHREEIDAegRxkYW5pZWwuaGVsZ2VuYmVyZ2VyQG0tYm94 LmRlMAkGA1UdEwQCMAAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMEMGA1UdHwQ8MDow OKA2oDSGMmh0dHA6Ly9jcmwuZ2xvYmFsc2lnbi5jb20vZ3MvZ3NwZXJzb25hbHNpZ24yZzIuY3Js MFUGCCsGAQUFBwEBBEkwRzBFBggrBgEFBQcwAoY5aHR0cDovL3NlY3VyZS5nbG9iYWxzaWduLmNv bS9jYWNlcnQvZ3NwZXJzb25hbHNpZ24yZzIuY3J0MB0GA1UdDgQWBBS8NFA/upd+Wipw2nj8RD/C t+R2GTAfBgNVHSMEGDAWgBQ/FdJtfC/nMZ5DCgaolGwsO8XuZTANBgkqhkiG9w0BAQUFAAOCAQEA XVTpu4fhOLETAW0zdbQiIwBIMZgeVNJnWV3GsMxByycU63P+WBQTBl9qj47vHLmVdeF7MzH0QSXZ Sc9Tnfr6CYIImpyIZxRAGpAsWmtZf3JieRA0+j4GQJF2zAea1NXYXoG9+ZSSZHBSxKUdrRdVdE32 0nuVGTT2HjEI2LEYbOvaXyi6HhpuHUiyu4LD0+RIT3fiT8jUiKKLTsApTD+Ak8SLF0IESOSA6hti rv69mDDC7Klg9dT7QBPO7dpoKIUOldV3VhahndVfsDffKD7pkUUvG5XftYEQOxlWDJzuTBeqf/4h xXMtzFU9OaI6oKJjLfr6B+XBc6xwOtc/NMWmejGCAucwggLjAgEBMGkwVDELMAkGA1UEBhMCQkUx GTAXBgNVBAoTEEdsb2JhbFNpZ24gbnYtc2ExKjAoBgNVBAMTIUdsb2JhbFNpZ24gUGVyc29uYWxT aWduIDIgQ0EgLSBHMgIRAJZpZsDepakv5CafojXoPKcwCQYFKw4DAhoFAKCCAVMwGAYJKoZIhvcN AQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTQwNTA5MTU0NTM2WjAjBgkqhkiG9w0B CQQxFgQUh4SYqCls4KDw7Nqrkc2z4amOSccweAYJKwYBBAGCNxAEMWswaTBUMQswCQYDVQQGEwJC RTEZMBcGA1UEChMQR2xvYmFsU2lnbiBudi1zYTEqMCgGA1UEAxMhR2xvYmFsU2lnbiBQZXJzb25h bFNpZ24gMiBDQSAtIEcyAhEAlmlmwN6lqS/kJp+iNeg8pzB6BgsqhkiG9w0BCRACCzFroGkwVDEL MAkGA1UEBhMCQkUxGTAXBgNVBAoTEEdsb2JhbFNpZ24gbnYtc2ExKjAoBgNVBAMTIUdsb2JhbFNp Z24gUGVyc29uYWxTaWduIDIgQ0EgLSBHMgIRAJZpZsDepakv5CafojXoPKcwDQYJKoZIhvcNAQEB BQAEggEAxi+0oO90JtVaCtiXXazuNXIq6kkZQfGovMfzYbS0koowg65fyM14d6hzODNGJOFWib7P RBsQEFpx2OBs+Ckk77NByk6r0VnWqb+vE9AtyODk6UJx0yQ6nEKVwiQ1uJlOf1MNpRThrSNYP0GK xq2YGvVvCYN6f+VW+h+YvisaTN8p3/a6lwOszImvFvAYmNafTnBCYug54j7ujUZQ5JgM5cLlwL6T Nv5mblgnujoO+uVi7oQOXiGNoIOU7TIUKxH28QdJmu26GbYDGuemZcFgiTnku9bDguULXVKHp2co OyuoNqmMnvwkQK9agYRK5n2Punr62kekcWvzHyOXfovO4gAAAAAAAA== --=-wlqg4Mk7qpqjBQhvuW3U--
----- Original Message -----
From: "Daniel Helgenberger" <daniel.helgenberger@m-box.de> To: users@ovirt.org Sent: Friday, May 9, 2014 6:45:36 PM Subject: [ovirt-users] Ovirt-3.4.1: How to: Upgrading Hosted Engine Cluster
Hello,
failing to find a procedure how to actually upgrade a HA cluster, I did the following witch turned out to be working pretty well.
I am somewhat new to oVirt and was amazed how well actually; I did not need to shutdown a single VM (well, one because of mem usage; many of my running VMs have fancy stuff like iscsi and FC luns via a Quantum Stornext HA Cluster):
1. Set cluster to global maintance 2. Login to ovit engine and to the upgrade according to the release nodes. 3. After the upgrade is finished and the engine running, set the first Node in local maintenance. 4. Login the first node and yum update (with the removal of ovirt-release as mentioned in release notes).* I rebooted the node because of the kernel update. 5. Return to oVirt and reinstall the Node from GUI, it will be set to operational automatically** 6. Repeat steps 3-6 for the rest of the Nodes. 7. Remove global maintenance. 8. Update the last Node.***
* I first tried to do this with re-install from GUI. This failed; so I used the yum - update method to update all relevant services
** I do not know if this was necessary. I did this because the hosted-engine --deploy does the same thing when adding a host.
*** I found this to be necessary because I had all my Nodes in local maintenance and could not migrate the Hosted engine from the last node any more. The host activation in oVirt did not remove the local maintenance set prior to the update (witch it should, IMHO). It might be desirable to have a hosted-engine command option to remove local maintenance for that reason.
--
Daniel Helgenberger m box bewegtbild GmbH
P: +49/30/2408781-22 F: +49/30/2408781-10
ACKERSTR. 19 D-10115 BERLIN
www.m-box.de www.monkeymen.tv
Geschäftsführer: Martin Retschitzegger / Michaela Göllner Handeslregister: Amtsgericht Charlottenburg / HRB 112767
Hi Martin, Thanks for sharing! A few notes on your nice 8 steps ;) - There are 2 maintenance modes to cover host maintenance (local) and VM maintenance (global). Global maintenance disarms all HA hosts in the cluster, so use it with caution as there's no fail over in this mode. - Initially these were available only as a command line[1]. Since 3.4.0, this was integrated into the UI, so all you need to do is move a host to maintenance in order to achieve local maintenance, and activate it to remove the maintenance mode. For global maintenance, right click the engine VM, and you will see enable/disable ha-maintenance for the global mode. - No need to re-install nodes. All you need to do is activate it. - Basically a standard procedure should include: * Move host to maintenance, login and update the host, activate the host. * Follow the above for all other HA hosts * Set the engine VM to ha maintenance (global), login to the vm and upgrade it, unset vm's ha-maintenance. Appreciate your feedback. Also, were you aware of [1] or did you look for info elsewhere? I'd like to know what we can do to improve documentation. Thanks again, Doron [1] http://www.ovirt.org/Hosted_Engine_Howto#Maintaining_the_setup
----- Original Message -----
From: "Doron Fediuck" <dfediuck@redhat.com> To: "Daniel Helgenberger" <daniel.helgenberger@m-box.de> Cc: users@ovirt.org Sent: Saturday, May 10, 2014 9:47:29 AM Subject: Re: [ovirt-users] Ovirt-3.4.1: How to: Upgrading Hosted Engine Cluster
----- Original Message -----
From: "Daniel Helgenberger" <daniel.helgenberger@m-box.de> To: users@ovirt.org Sent: Friday, May 9, 2014 6:45:36 PM Subject: [ovirt-users] Ovirt-3.4.1: How to: Upgrading Hosted Engine Cluster
Hello,
failing to find a procedure how to actually upgrade a HA cluster, I did the following witch turned out to be working pretty well.
I am somewhat new to oVirt and was amazed how well actually; I did not need to shutdown a single VM (well, one because of mem usage; many of my running VMs have fancy stuff like iscsi and FC luns via a Quantum Stornext HA Cluster):
1. Set cluster to global maintance 2. Login to ovit engine and to the upgrade according to the release nodes. 3. After the upgrade is finished and the engine running, set the first Node in local maintenance. 4. Login the first node and yum update (with the removal of ovirt-release as mentioned in release notes).* I rebooted the node because of the kernel update. 5. Return to oVirt and reinstall the Node from GUI, it will be set to operational automatically** 6. Repeat steps 3-6 for the rest of the Nodes. 7. Remove global maintenance. 8. Update the last Node.***
* I first tried to do this with re-install from GUI. This failed; so I used the yum - update method to update all relevant services
** I do not know if this was necessary. I did this because the hosted-engine --deploy does the same thing when adding a host.
*** I found this to be necessary because I had all my Nodes in local maintenance and could not migrate the Hosted engine from the last node any more. The host activation in oVirt did not remove the local maintenance set prior to the update (witch it should, IMHO). It might be desirable to have a hosted-engine command option to remove local maintenance for that reason.
--
Daniel Helgenberger m box bewegtbild GmbH
P: +49/30/2408781-22 F: +49/30/2408781-10
ACKERSTR. 19 D-10115 BERLIN
www.m-box.de www.monkeymen.tv
Geschäftsführer: Martin Retschitzegger / Michaela Göllner Handeslregister: Amtsgericht Charlottenburg / HRB 112767
Hi Martin, Thanks for sharing!
A few notes on your nice 8 steps ;)
- There are 2 maintenance modes to cover host maintenance (local) and VM maintenance (global). Global maintenance disarms all HA hosts in the cluster, so use it with caution as there's no fail over in this mode.
- Initially these were available only as a command line[1]. Since 3.4.0, this was integrated into the UI, so all you need to do is move a host to maintenance in order to achieve local maintenance, and activate it to remove the maintenance mode. For global maintenance, right click the engine VM, and you will see enable/disable ha-maintenance for the global mode.
- No need to re-install nodes. All you need to do is activate it.
- Basically a standard procedure should include: * Move host to maintenance, login and update the host, activate the host. * Follow the above for all other HA hosts * Set the engine VM to ha maintenance (global), login to the vm and upgrade it, unset vm's ha-maintenance.
Appreciate your feedback. Also, were you aware of [1] or did you look for info elsewhere? I'd like to know what we can do to improve documentation.
Thanks again, Doron
[1] http://www.ovirt.org/Hosted_Engine_Howto#Maintaining_the_setup
My apologies- s/Martin/Daniel.
On May 10, 2014, at 1:47 AM, Doron Fediuck <dfediuck@redhat.com> wrote:
----- Original Message -----
From: "Daniel Helgenberger" <daniel.helgenberger@m-box.de> To: users@ovirt.org Sent: Friday, May 9, 2014 6:45:36 PM Subject: [ovirt-users] Ovirt-3.4.1: How to: Upgrading Hosted Engine Cluster
1. Set cluster to global maintance 2. Login to ovit engine and to the upgrade according to the release nodes. 3. After the upgrade is finished and the engine running, set the first Node in local maintenance. 4. Login the first node and yum update (with the removal of ovirt-release as mentioned in release notes).* I rebooted the node because of the kernel update. 5. Return to oVirt and reinstall the Node from GUI, it will be set to operational automatically** 6. Repeat steps 3-6 for the rest of the Nodes. 7. Remove global maintenance. 8. Update the last Node.***
Hi Martin, Thanks for sharing!
A few notes on your nice 8 steps ;)
- There are 2 maintenance modes to cover host maintenance (local) and VM maintenance (global). Global maintenance disarms all HA hosts in the cluster, so use it with caution as there's no fail over in this mode.
- Initially these were available only as a command line[1]. Since 3.4.0, this was integrated into the UI, so all you need to do is move a host to maintenance in order to achieve local maintenance, and activate it to remove the maintenance mode. For global maintenance, right click the engine VM, and you will see enable/disable ha-maintenance for the global mode.
- No need to re-install nodes. All you need to do is activate it.
- Basically a standard procedure should include: * Move host to maintenance, login and update the host, activate the host. * Follow the above for all other HA hosts * Set the engine VM to ha maintenance (global), login to the vm and upgrade it, unset vm's ha-maintenance.
Appreciate your feedback. Also, were you aware of [1] or did you look for info elsewhere? I'd like to know what we can do to improve documentation.
One thing that’s still unclear to me in this this setup is what’s needed to ensure all the nodes or get updates? Just do yum updates? I’ve have mixed success with the “reinstall or update” link in the GUI, seemed like it worked properly when I updated to 3.4.0, but trying to do the 3.4.1 update it failed for no apparent reason and I wound up doing yum updates on the host nodes… -Darrell
----- Original Message -----
From: "Darrell Budic" <darrell.budic@zenfire.com> To: "Doron Fediuck" <dfediuck@redhat.com> Cc: "users" <users@ovirt.org> Sent: Monday, May 12, 2014 10:15:53 PM Subject: Re: [ovirt-users] Ovirt-3.4.1: How to: Upgrading Hosted Engine Cluster
On May 10, 2014, at 1:47 AM, Doron Fediuck <dfediuck@redhat.com> wrote:
----- Original Message -----
From: "Daniel Helgenberger" <daniel.helgenberger@m-box.de> To: users@ovirt.org Sent: Friday, May 9, 2014 6:45:36 PM Subject: [ovirt-users] Ovirt-3.4.1: How to: Upgrading Hosted Engine Cluster
1. Set cluster to global maintance 2. Login to ovit engine and to the upgrade according to the release nodes. 3. After the upgrade is finished and the engine running, set the first Node in local maintenance. 4. Login the first node and yum update (with the removal of ovirt-release as mentioned in release notes).* I rebooted the node because of the kernel update. 5. Return to oVirt and reinstall the Node from GUI, it will be set to operational automatically** 6. Repeat steps 3-6 for the rest of the Nodes. 7. Remove global maintenance. 8. Update the last Node.***
Hi Martin, Thanks for sharing!
A few notes on your nice 8 steps ;)
- There are 2 maintenance modes to cover host maintenance (local) and VM maintenance (global). Global maintenance disarms all HA hosts in the cluster, so use it with caution as there's no fail over in this mode.
- Initially these were available only as a command line[1]. Since 3.4.0, this was integrated into the UI, so all you need to do is move a host to maintenance in order to achieve local maintenance, and activate it to remove the maintenance mode. For global maintenance, right click the engine VM, and you will see enable/disable ha-maintenance for the global mode.
- No need to re-install nodes. All you need to do is activate it.
- Basically a standard procedure should include: * Move host to maintenance, login and update the host, activate the host. * Follow the above for all other HA hosts * Set the engine VM to ha maintenance (global), login to the vm and upgrade it, unset vm's ha-maintenance.
Appreciate your feedback. Also, were you aware of [1] or did you look for info elsewhere? I'd like to know what we can do to improve documentation.
One thing that’s still unclear to me in this this setup is what’s needed to ensure all the nodes or get updates? Just do yum updates? I’ve have mixed success with the “reinstall or update” link in the GUI, seemed like it worked properly when I updated to 3.4.0, but trying to do the 3.4.1 update it failed for no apparent reason and I wound up doing yum updates on the host nodes…
-Darrell
Hi Darrel, the flow you described should work, and if not there's possibly a bug in the host deployment. We need more details from your log files to better understand what happened. For example, did you have your repositories set correctly? Did you notice an error in the events pane? The above scenario is generic regardless to manual or UI-based updates. Doron
--=-LYvGPzZHtKxAgDjAcPaA Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mo, 2014-05-12 at 16:02 -0400, Doron Fediuck wrote: >=20 > ----- Original Message ----- > > From: "Darrell Budic" <darrell.budic@zenfire.com> > > To: "Doron Fediuck" <dfediuck@redhat.com> > > Cc: "users" <users@ovirt.org> > > Sent: Monday, May 12, 2014 10:15:53 PM > > Subject: Re: [ovirt-users] Ovirt-3.4.1: How to: Upgrading Hosted Engine= Cluster > >=20 > >=20 > > On May 10, 2014, at 1:47 AM, Doron Fediuck <dfediuck@redhat.com> wrote: > >=20 > > >=20 > > >=20 > > > ----- Original Message ----- > > >> From: "Daniel Helgenberger" <daniel.helgenberger@m-box.de> > > >> To: users@ovirt.org > > >> Sent: Friday, May 9, 2014 6:45:36 PM > > >> Subject: [ovirt-users] Ovirt-3.4.1: How to: Upgrading Hosted Engine > > >> Cluster > > >>=20 > > >> 1. Set cluster to global maintance > > >> 2. Login to ovit engine and to the upgrade according to the rele= ase > > >> nodes. > > >> 3. After the upgrade is finished and the engine running, set the > > >> first Node in local maintenance. > > >> 4. Login the first node and yum update (with the removal of > > >> ovirt-release as mentioned in release notes).* I rebooted the > > >> node because of the kernel update. > > >> 5. Return to oVirt and reinstall the Node from GUI, it will be s= et > > >> to operational automatically** > > >> 6. Repeat steps 3-6 for the rest of the Nodes. > > >> 7. Remove global maintenance. > > >> 8. Update the last Node.*** > > >>=20 > > >=20 > > > Hi Martin, > > > Thanks for sharing! > > >=20 > > > A few notes on your nice 8 steps ;) > > >=20 > > > - There are 2 maintenance modes to cover host maintenance (local) and > > > VM maintenance (global). Global maintenance disarms all HA hosts in > > > the cluster, so use it with caution as there's no fail over in this > > > mode. > > >=20 > > > - Initially these were available only as a command line[1]. Since 3.4= .0, > > > this was integrated into the UI, so all you need to do is move a hos= t > > > to maintenance in order to achieve local maintenance, and activate i= t > > > to remove the maintenance mode. For global maintenance, right click > > > the engine VM, and you will see enable/disable ha-maintenance for > > > the global mode. > > >=20 > > > - No need to re-install nodes. All you need to do is activate it. > > >=20 > > > - Basically a standard procedure should include: > > > * Move host to maintenance, login and update the host, activate the = host. > > > * Follow the above for all other HA hosts > > > * Set the engine VM to ha maintenance (global), login to the vm and > > > upgrade it, unset vm's ha-maintenance. > > >=20 > > > Appreciate your feedback. > > > Also, were you aware of [1] or did you look for info elsewhere? I'd l= ike > > > to know what we can do to improve documentation. Hi Doron, thanks for pointing out [1]. I was not aware of this, basically these are the steps I wrote ;)=20 Thanks for pointing out the availability of the maintenance mode in the GUI; I noticed local maint. being transparent (from GUI -> command line, though not the other way around). Also, I need the global maintenance for step one because of the engine upgrade because I suspect ha-agent would interfere because of necessary service restarts/downtime. It could have been reactivated much earlier though! Cheers, Daniel --=20 Daniel Helgenberger=20 m box bewegtbild GmbH=20 P: +49/30/2408781-22 F: +49/30/2408781-10 ACKERSTR. 19=20 D-10115 BERLIN=20 www.m-box.de www.monkeymen.tv=20 Gesch=C3=A4ftsf=C3=BChrer: Martin Retschitzegger / Michaela G=C3=B6llner Handeslregister: Amtsgericht Charlottenburg / HRB 112767=20 --=-LYvGPzZHtKxAgDjAcPaA Content-Type: application/x-pkcs7-signature; name="smime.p7s" Content-Disposition: attachment; filename="smime.p7s" Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIINtjCCBBYw ggL+oAMCAQICCwQAAAAAAS9O4S9SMA0GCSqGSIb3DQEBBQUAMFcxCzAJBgNVBAYTAkJFMRkwFwYD VQQKExBHbG9iYWxTaWduIG52LXNhMRAwDgYDVQQLEwdSb290IENBMRswGQYDVQQDExJHbG9iYWxT aWduIFJvb3QgQ0EwHhcNMTEwNDEzMTAwMDAwWhcNMTkwNDEzMTAwMDAwWjBUMQswCQYDVQQGEwJC RTEZMBcGA1UEChMQR2xvYmFsU2lnbiBudi1zYTEqMCgGA1UEAxMhR2xvYmFsU2lnbiBQZXJzb25h bFNpZ24gMiBDQSAtIEcyMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAwWtB+TXs+BJ9 3SJRaV+3uRNGJ3cUO+MTgW8+5HQXfgy19CzkDI1T1NwwICi/bo4R/mYR5FEWx91//eE0ElC/89iY 7GkL0tDasmVx4TOXnrqrsziUcxEPPqHRE8x4NhtBK7+8o0nsMIJMA1gyZ2FA5To2Ew1BBuvovvDJ +Nua3qOCNBNu+8A+eNpJlVnlu/qB7+XWaPXtUMlsIikxD+gREFVUgYE4VzBuLa2kkg0VLd09XkE2 ceRDm6YgRATuDk6ogUyX4OLxCGIJF8yi6Z37M0wemDA6Uff0EuqdwDQd5HwG/rernUjt1grLdAxq 8BwywRRg0eFHmE+ShhpyO3Fi+wIDAQABo4HlMIHiMA4GA1UdDwEB/wQEAwIBBjASBgNVHRMBAf8E CDAGAQH/AgEAMB0GA1UdDgQWBBQ/FdJtfC/nMZ5DCgaolGwsO8XuZTBHBgNVHSAEQDA+MDwGBFUd IAAwNDAyBggrBgEFBQcCARYmaHR0cHM6Ly93d3cuZ2xvYmFsc2lnbi5jb20vcmVwb3NpdG9yeS8w MwYDVR0fBCwwKjAooCagJIYiaHR0cDovL2NybC5nbG9iYWxzaWduLm5ldC9yb290LmNybDAfBgNV HSMEGDAWgBRge2YaRQ2XyolQL30EzTSo//z9SzANBgkqhkiG9w0BAQUFAAOCAQEAQ3N5zKTMSTED HGFAgd/gu91Kb8AxPHgjq+7dhf7mkCinMqqrLai2XOrz8CP63BPaAx7oGOUBI0MyASBGk5zej9L3 oHtiF2BL01m1sBnT8rQxT2CJd/+jqjUl0p2ew8T3HSyatrsooGvDwf00yCB2JHTNvtQxNO8t6x/+ 048A1Q+0i7uf0nTnyrJLjD04zhL89ytetZspltOpJVYbmwiFjq6PxsdUNthUDme/9pOLmKDnQU0p W/JEwLs2TYCBNKwdgSGAk8/z+s2SCltKIG0Uh5U6t6j7JPuwNP/znImwMrlHDJ1YpW0rkF2PGraV CgDBf9dOB+IIpnwHfIi+LD+eITCCBMowggOyoAMCAQICEQCWaWbA3qWpL+Qmn6I16DynMA0GCSqG SIb3DQEBBQUAMFQxCzAJBgNVBAYTAkJFMRkwFwYDVQQKExBHbG9iYWxTaWduIG52LXNhMSowKAYD VQQDEyFHbG9iYWxTaWduIFBlcnNvbmFsU2lnbiAyIENBIC0gRzIwHhcNMTMwODI3MTY1NzU4WhcN MTYwODI3MTY1NzU4WjBYMQswCQYDVQQGEwJERTEcMBoGA1UEAxMTRGFuaWVsIEhlbGdlbmJlcmdl cjErMCkGCSqGSIb3DQEJARYcZGFuaWVsLmhlbGdlbmJlcmdlckBtLWJveC5kZTCCASIwDQYJKoZI hvcNAQEBBQADggEPADCCAQoCggEBAM4BQ5vPknk1OGLd1qKSUIKmQLrjccjJcYj7qtAtA+fNYKF8 9p1VY4UwiFcF9jKlmA9Q8o8tYSx16LYYFoGWokNRAeKFXZiBZiHyI0ekpEfxo8N5cTMCcxKcSYWV 8sqzmBPCoMNpmiVoC8ec8Nv5SqXH34VVtDmNLfiVlsTyomBXAJkJ2/n5XqJzPLFGWWREtPLkVVS+ u426vt/hNsQi5akNoidYeXo98JcrmeApFJ3zB2KxvMziHx8LD4q1gAl9NumtX5YLbCpdWL9AkWdX Oaro3D9zj6Q6LyGwa/UQUrZdg3BXc07hjHZn6d9vet1SzpbyqQpTzM63yXiX1meEMlMCAwEAAaOC AZEwggGNMA4GA1UdDwEB/wQEAwIFoDBMBgNVHSAERTBDMEEGCSsGAQQBoDIBKDA0MDIGCCsGAQUF BwIBFiZodHRwczovL3d3dy5nbG9iYWxzaWduLmNvbS9yZXBvc2l0b3J5LzAnBgNVHREEIDAegRxk YW5pZWwuaGVsZ2VuYmVyZ2VyQG0tYm94LmRlMAkGA1UdEwQCMAAwHQYDVR0lBBYwFAYIKwYBBQUH AwIGCCsGAQUFBwMEMEMGA1UdHwQ8MDowOKA2oDSGMmh0dHA6Ly9jcmwuZ2xvYmFsc2lnbi5jb20v Z3MvZ3NwZXJzb25hbHNpZ24yZzIuY3JsMFUGCCsGAQUFBwEBBEkwRzBFBggrBgEFBQcwAoY5aHR0 cDovL3NlY3VyZS5nbG9iYWxzaWduLmNvbS9jYWNlcnQvZ3NwZXJzb25hbHNpZ24yZzIuY3J0MB0G A1UdDgQWBBS8NFA/upd+Wipw2nj8RD/Ct+R2GTAfBgNVHSMEGDAWgBQ/FdJtfC/nMZ5DCgaolGws O8XuZTANBgkqhkiG9w0BAQUFAAOCAQEAXVTpu4fhOLETAW0zdbQiIwBIMZgeVNJnWV3GsMxByycU 63P+WBQTBl9qj47vHLmVdeF7MzH0QSXZSc9Tnfr6CYIImpyIZxRAGpAsWmtZf3JieRA0+j4GQJF2 zAea1NXYXoG9+ZSSZHBSxKUdrRdVdE320nuVGTT2HjEI2LEYbOvaXyi6HhpuHUiyu4LD0+RIT3fi T8jUiKKLTsApTD+Ak8SLF0IESOSA6htirv69mDDC7Klg9dT7QBPO7dpoKIUOldV3VhahndVfsDff KD7pkUUvG5XftYEQOxlWDJzuTBeqf/4hxXMtzFU9OaI6oKJjLfr6B+XBc6xwOtc/NMWmejCCBMow ggOyoAMCAQICEQCWaWbA3qWpL+Qmn6I16DynMA0GCSqGSIb3DQEBBQUAMFQxCzAJBgNVBAYTAkJF MRkwFwYDVQQKExBHbG9iYWxTaWduIG52LXNhMSowKAYDVQQDEyFHbG9iYWxTaWduIFBlcnNvbmFs U2lnbiAyIENBIC0gRzIwHhcNMTMwODI3MTY1NzU4WhcNMTYwODI3MTY1NzU4WjBYMQswCQYDVQQG EwJERTEcMBoGA1UEAxMTRGFuaWVsIEhlbGdlbmJlcmdlcjErMCkGCSqGSIb3DQEJARYcZGFuaWVs LmhlbGdlbmJlcmdlckBtLWJveC5kZTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAM4B Q5vPknk1OGLd1qKSUIKmQLrjccjJcYj7qtAtA+fNYKF89p1VY4UwiFcF9jKlmA9Q8o8tYSx16LYY FoGWokNRAeKFXZiBZiHyI0ekpEfxo8N5cTMCcxKcSYWV8sqzmBPCoMNpmiVoC8ec8Nv5SqXH34VV tDmNLfiVlsTyomBXAJkJ2/n5XqJzPLFGWWREtPLkVVS+u426vt/hNsQi5akNoidYeXo98JcrmeAp FJ3zB2KxvMziHx8LD4q1gAl9NumtX5YLbCpdWL9AkWdXOaro3D9zj6Q6LyGwa/UQUrZdg3BXc07h jHZn6d9vet1SzpbyqQpTzM63yXiX1meEMlMCAwEAAaOCAZEwggGNMA4GA1UdDwEB/wQEAwIFoDBM BgNVHSAERTBDMEEGCSsGAQQBoDIBKDA0MDIGCCsGAQUFBwIBFiZodHRwczovL3d3dy5nbG9iYWxz aWduLmNvbS9yZXBvc2l0b3J5LzAnBgNVHREEIDAegRxkYW5pZWwuaGVsZ2VuYmVyZ2VyQG0tYm94 LmRlMAkGA1UdEwQCMAAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMEMGA1UdHwQ8MDow OKA2oDSGMmh0dHA6Ly9jcmwuZ2xvYmFsc2lnbi5jb20vZ3MvZ3NwZXJzb25hbHNpZ24yZzIuY3Js MFUGCCsGAQUFBwEBBEkwRzBFBggrBgEFBQcwAoY5aHR0cDovL3NlY3VyZS5nbG9iYWxzaWduLmNv bS9jYWNlcnQvZ3NwZXJzb25hbHNpZ24yZzIuY3J0MB0GA1UdDgQWBBS8NFA/upd+Wipw2nj8RD/C t+R2GTAfBgNVHSMEGDAWgBQ/FdJtfC/nMZ5DCgaolGwsO8XuZTANBgkqhkiG9w0BAQUFAAOCAQEA XVTpu4fhOLETAW0zdbQiIwBIMZgeVNJnWV3GsMxByycU63P+WBQTBl9qj47vHLmVdeF7MzH0QSXZ Sc9Tnfr6CYIImpyIZxRAGpAsWmtZf3JieRA0+j4GQJF2zAea1NXYXoG9+ZSSZHBSxKUdrRdVdE32 0nuVGTT2HjEI2LEYbOvaXyi6HhpuHUiyu4LD0+RIT3fiT8jUiKKLTsApTD+Ak8SLF0IESOSA6hti rv69mDDC7Klg9dT7QBPO7dpoKIUOldV3VhahndVfsDffKD7pkUUvG5XftYEQOxlWDJzuTBeqf/4h xXMtzFU9OaI6oKJjLfr6B+XBc6xwOtc/NMWmejGCAucwggLjAgEBMGkwVDELMAkGA1UEBhMCQkUx GTAXBgNVBAoTEEdsb2JhbFNpZ24gbnYtc2ExKjAoBgNVBAMTIUdsb2JhbFNpZ24gUGVyc29uYWxT aWduIDIgQ0EgLSBHMgIRAJZpZsDepakv5CafojXoPKcwCQYFKw4DAhoFAKCCAVMwGAYJKoZIhvcN AQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTQwNTEzMDkwNzAyWjAjBgkqhkiG9w0B CQQxFgQU5ImtwZO2T/rx1HGV9fB+8aJo9cUweAYJKwYBBAGCNxAEMWswaTBUMQswCQYDVQQGEwJC RTEZMBcGA1UEChMQR2xvYmFsU2lnbiBudi1zYTEqMCgGA1UEAxMhR2xvYmFsU2lnbiBQZXJzb25h bFNpZ24gMiBDQSAtIEcyAhEAlmlmwN6lqS/kJp+iNeg8pzB6BgsqhkiG9w0BCRACCzFroGkwVDEL MAkGA1UEBhMCQkUxGTAXBgNVBAoTEEdsb2JhbFNpZ24gbnYtc2ExKjAoBgNVBAMTIUdsb2JhbFNp Z24gUGVyc29uYWxTaWduIDIgQ0EgLSBHMgIRAJZpZsDepakv5CafojXoPKcwDQYJKoZIhvcNAQEB BQAEggEAbdUIVcbf9gmENoBGCNv/so7T6nEvB1/ALukF8Y3QtyseYOxZfAFV8cG8h5w/jMADHk3o X5adXgXK+XWgVPIxkHCQ0fshfuyE2ewI5KWiUMGwO2wYPbvQeS6qPEjR4+HYARV3DMUscU6zH2vu ejLV6A3ndpNuCcCFAti7Y5yKsJrNszAoJL2WV2wbag5YFvK/NOACAGQxX/hvw+hzZD5U5akUb2zO uwj3w/DpZNF5UUSVbwyUgr9Qoe9XycIYxbNt58YJepDxq3IuudILzp0q9Kpa5/p3PED2g8BMaQ26 j794WkQmp+3D0a2/somMh4lD7NOwk6ooIdBvwbovDOlkKwAAAAAAAA== --=-LYvGPzZHtKxAgDjAcPaA--
participants (3)
-
Daniel Helgenberger -
Darrell Budic -
Doron Fediuck