oVirt-Gluster Hyperconvergence: Graceful shutdown and startup

This is a cryptographically signed message in MIME format. --------------ms050505050407040006080208 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable Hi all and a happy new year, I am just testing oVirt 4.2 using a three node gluster hyperconvergence and self hosted engine setup. How should this setup be shutdown and started again? Here is what tried an experienced: Shutdown: 1. Shutdown all VMs 2. Enable global ha maintenance 3. Wait for all VM 4. Shutdown hosted-engine using "hosted-engine --vm-shutdown" 5. Wait for stopped hosted engine 6. Shutdown all nodes Startup: 1. Switch on all nodes 2. Start glusterd on all nodes since it does not start by default (is this a bug?) using "systemctl start glusterd*"* 3. Check volume status using "gluster peer status" and "gluster volume status all" on one of the nodes 4. Wait for ovrt-ha-agent until "hosted-engine --vm-status" does not fail anymore printing "The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable." 4. Start hosted engine "hosted-engine --vm-start" on one of the nodes 5. Check status using "hosted-engine --vm-status" and wait until health reports good 6. Wait until a host got the SPM role 7. Start VMs Is this the best/correct way? Kind regards, Bernhard --------------ms050505050407040006080208 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC CzIwggTTMIIDu6ADAgECAhBm2u8D24RhkWsluoP7F04TMA0GCSqGSIb3DQEBCwUAMH4xCzAJ BgNVBAYTAlBMMSIwIAYDVQQKExlVbml6ZXRvIFRlY2hub2xvZ2llcyBTLkEuMScwJQYDVQQL Ex5DZXJ0dW0gQ2VydGlmaWNhdGlvbiBBdXRob3JpdHkxIjAgBgNVBAMTGUNlcnR1bSBUcnVz dGVkIE5ldHdvcmsgQ0EwHhcNMTUwNDIxMTI0NTI2WhcNMjcwNjA5MTI0NTI2WjCBijELMAkG A1UEBhMCUEwxIjAgBgNVBAoMGVVuaXpldG8gVGVjaG5vbG9naWVzIFMuQS4xJzAlBgNVBAsM HkNlcnR1bSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTEuMCwGA1UEAwwlQ2VydHVtIERpZ2l0 YWwgSWRlbnRpZmljYXRpb24gQ0EgU0hBMjCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoC ggEBAMXgVrv+CZfjKNqcnk5TvUOn3z6o4OTx4yA5BWu3CqgW7mEez4WlFuPdCVTshvZ+28Yl 5lmZ3v/44J+DCI3/nVr7729zaucJI4UsJVPYmp+5dJfy4NmraGKrhhe7GSxIPFJihexNItJF l36wj3n1Gzggk81/i6LjT7lsDvOifiuBPxGiL4QxOxL6nQlVmydHNydqx8hA8n2GTDxIzZ6E RQWcNLxJgHCu+BtEMP+L57n8NEjVbW/2J3pUIrS8Esm2rlkYPFF6aJON6zOWvntQ2+aenJ0x Cip7Y+xvsL74+eVenAKRBVTMzMLevIaE799+7GkfbwYiX9j/GQorMHSzo2UCAwEAAaOCAT4w ggE6MA8GA1UdEwEB/wQFMAMBAf8wHQYDVR0OBBYEFD/KWOrxyQl+bjPBI61OrT49bEWnMB8G A1UdIwQYMBaAFAh2zcsH/yT2xc3tu5C84oQ3RnX3MA4GA1UdDwEB/wQEAwIBBjAvBgNVHR8E KDAmMCSgIqAghh5odHRwOi8vY3JsLmNlcnR1bS5wbC9jdG5jYS5jcmwwawYIKwYBBQUHAQEE XzBdMCgGCCsGAQUFBzABhhxodHRwOi8vc3ViY2Eub2NzcC1jZXJ0dW0uY29tMDEGCCsGAQUF BzAChiVodHRwOi8vcmVwb3NpdG9yeS5jZXJ0dW0ucGwvY3RuY2EuY2VyMDkGA1UdIAQyMDAw LgYEVR0gADAmMCQGCCsGAQUFBwIBFhhodHRwOi8vd3d3LmNlcnR1bS5wbC9DUFMwDQYJKoZI hvcNAQELBQADggEBAAu9CcEJlt/B/nZI1fXxhekorONITDb7P93cFmK7kgZ239iLT81i82C0 gjPesCQOL7LejnVmP3bM2NSLwYMiUp+pUgblyKC/5nWaRBaakyL+kfbIpd4zmaVHUK+ZMhTc l40F6CgGLmsXlHiLqsbCVEqG1Z+wPp3Jx4aO2JyyYu3eRZbV3FapB9jUTKF2YPGU1dHbTtHN PsSKypHEcHiuub5YNjqSe294eUupVQR4+wEHewz4OCNjFczvJ1EUj9l6v0Epl8pb+/V/QZA2 2HYN+xXkxSzwrLPDoCoMJHHse7AA533JrsRhs6t4yLwdvb3nmmajpWFqrYo++M9igLcpKmUw ggZXMIIFP6ADAgECAhBUQSC40nObpwSFv3zd83IWMA0GCSqGSIb3DQEBCwUAMIGKMQswCQYD VQQGEwJQTDEiMCAGA1UECgwZVW5pemV0byBUZWNobm9sb2dpZXMgUy5BLjEnMCUGA1UECwwe Q2VydHVtIENlcnRpZmljYXRpb24gQXV0aG9yaXR5MS4wLAYDVQQDDCVDZXJ0dW0gRGlnaXRh bCBJZGVudGlmaWNhdGlvbiBDQSBTSEEyMB4XDTE3MDcxMjA4Mzk0MVoXDTIwMDcxMTA4Mzk0 MVowfzELMAkGA1UEBhMCREUxFzAVBgNVBAoMDkJlcm5oYXJkIFNlaWRsMRcwFQYDVQQLDA5C ZXJuaGFyZCBTZWlkbDEXMBUGA1UEAwwOQmVybmhhcmQgU2VpZGwxJTAjBgkqhkiG9w0BCQEW FmluZm9AYmVybmhhcmQtc2VpZGwuZGUwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoIC AQDuUx5b/tjym2cI+X/TllNg5h8zZA8o1WfS2Pn2eF+ptlYYbEyvG9NHOO0C1NZoxuIFLsRT eDctxqGFSepqHIoCn30D7vKklHpvGKYscJqqrjfvh9FozxDzB5R3BuRU+tjfvBJypzRw3EbI +R+7JHN1h/QulBKoH9+2vPssOBw7ITIUoUFhBSK196M0QPdx4zPLwUD0Of5MHLsLRCC+fYkd RGzgwUqjPBS/FSiC6M1RaMxHKDPeKqMPLDx9J10o3Z69UevSS6KrxGMwivuqQ27/s92IJ+o+ PCp8BSy7WvDyTZmNM6pma1WeLGyaW6PaRPbjVKQ9Vi/oLvArXtCzjOeHZD+kUMy885TRpsTw 1OqiCujOI/7rWTnJwK94qUFWLm3KtlpX/Z2MZBBgXnUV2GrYRQ0Fdd8H1UTg1tmcz+mLcg6o hV9QUE6ftT73ss+wkFWExRvdy5KHbsNPONshiKKOjD8RcbZugmzXQTRq88unQTVaqTLo0yVw Zh1WDMeEVx1Dqs2zkaFpRexJfCaUCsr4TuJ3mVv6C7u4Uqactq/tVvZ/T+Sqc2C5ili03JDS K56WgObH3Cs9EY7pUGQErEwYHlvEnEr0kWN7+2Bloecdk0ngQ0ScKsKdM5FtTRT6qXNZ1U5k +jpt83X5TcLSYVGcZYacoCR3LU7daToumErGywIDAQABo4IBwTCCAb0wDAYDVR0TAQH/BAIw ADAyBgNVHR8EKzApMCegJaAjhiFodHRwOi8vY3JsLmNlcnR1bS5wbC9kaWNhc2hhMi5jcmww cQYIKwYBBQUHAQEEZTBjMCsGCCsGAQUFBzABhh9odHRwOi8vZGljYXNoYTIub2NzcC1jZXJ0 dW0uY29tMDQGCCsGAQUFBzAChihodHRwOi8vcmVwb3NpdG9yeS5jZXJ0dW0ucGwvZGljYXNo YTIuY2VyMB8GA1UdIwQYMBaAFD/KWOrxyQl+bjPBI61OrT49bEWnMB0GA1UdDgQWBBTY8Cp7 x4aR7azR2iOtSNEZTRkU1TAdBgNVHRIEFjAUgRJkaWNhc2hhMkBjZXJ0dW0ucGwwDgYDVR0P AQH/BAQDAgTwMEIGA1UdIAQ7MDkwNwYMKoRoAYb2dwIFAQYNMCcwJQYIKwYBBQUHAgEWGWh0 dHBzOi8vd3d3LmNlcnR1bS5wbC9DUFMwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwME MBEGCWCGSAGG+EIBAQQEAwIFoDAhBgNVHREEGjAYgRZpbmZvQGJlcm5oYXJkLXNlaWRsLmRl MA0GCSqGSIb3DQEBCwUAA4IBAQCHpuTGNpFqadkLmRAdTswEaF8KIC8YSPkxfnK+CBjMTZmV Im/GF8EnL9JNV5RSfZraCDd41/16JXbUYeF8WMMdMYdnp/2emdxIOOUEmJroMi3z0fbzLltg F4YDD+uondpywRE5kUWxLfwMXNdk+bC+cXJ7NjiaZDBZyDpeXQD3VE2SprcBlN4oCHE8G8qq ThMNh8x2fiUigvAreSANPTWYSedC02zvrrUfX9Ws4eX2eSUngYJ2/jWBalX73CooOvJ/sfPu J++P07DzOrr4RLnk9xBrT7Yaz9faoe/A6672gZ1SXImv5tXTIu4b8hwdN0SelGQ5dTReeS96 d2/1aU/oMYIFLjCCBSoCAQEwgZ8wgYoxCzAJBgNVBAYTAlBMMSIwIAYDVQQKDBlVbml6ZXRv IFRlY2hub2xvZ2llcyBTLkEuMScwJQYDVQQLDB5DZXJ0dW0gQ2VydGlmaWNhdGlvbiBBdXRo b3JpdHkxLjAsBgNVBAMMJUNlcnR1bSBEaWdpdGFsIElkZW50aWZpY2F0aW9uIENBIFNIQTIC EFRBILjSc5unBIW/fN3zchYwDQYJYIZIAWUDBAIDBQCgggJfMBgGCSqGSIb3DQEJAzELBgkq hkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTE4MDEwMzE1NTc1NlowTwYJKoZIhvcNAQkEMUIE QKiFVHhgjTS5W+jW+xvbx63jgK/szO7OkBroG0XsmbeAtFQanyy75ZW7yJ6vqy3FUKkAZxR8 95LSeZ0zadCLSNgwbAYJKoZIhvcNAQkPMV8wXTALBglghkgBZQMEASowCwYJYIZIAWUDBAEC MAoGCCqGSIb3DQMHMA4GCCqGSIb3DQMCAgIAgDANBggqhkiG9w0DAgIBQDAHBgUrDgMCBzAN BggqhkiG9w0DAgIBKDCBsAYJKwYBBAGCNxAEMYGiMIGfMIGKMQswCQYDVQQGEwJQTDEiMCAG A1UECgwZVW5pemV0byBUZWNobm9sb2dpZXMgUy5BLjEnMCUGA1UECwweQ2VydHVtIENlcnRp ZmljYXRpb24gQXV0aG9yaXR5MS4wLAYDVQQDDCVDZXJ0dW0gRGlnaXRhbCBJZGVudGlmaWNh dGlvbiBDQSBTSEEyAhBUQSC40nObpwSFv3zd83IWMIGyBgsqhkiG9w0BCRACCzGBoqCBnzCB ijELMAkGA1UEBhMCUEwxIjAgBgNVBAoMGVVuaXpldG8gVGVjaG5vbG9naWVzIFMuQS4xJzAl BgNVBAsMHkNlcnR1bSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTEuMCwGA1UEAwwlQ2VydHVt IERpZ2l0YWwgSWRlbnRpZmljYXRpb24gQ0EgU0hBMgIQVEEguNJzm6cEhb983fNyFjANBgkq hkiG9w0BAQEFAASCAgChLf80WvJ9ltAv8Gt4qSbdhH1W1BCiIb65HWZagO1xRE/DnGLsMNk+ wqff0Ub84h9IH/JPy9MFSCvwcS3Vf9EsIBlx3QAnKweIxMHX8tyI06TPuOkd7eaxyG7K5hci pa1dsjJSJh9DxUsnMkP3Yf+rVlP1PtKyNcwaBgr8aeHDGmgzXkLw+Q12WkYGgw2yRoLD0PA1 Numqp1Y5Hd7d6Bm+8NfAX+p60HhaXkQoq6Wi4t60uysmgWMuop+O4zEGJGdEwefgWerZRtcZ iGEwz3pOkOrTAZPMtpyHVOxf8i9mIcyS0pN3rGhK/M0CIp8YkDIK6HIYYu/mtE6c+vwlEu81 /KuiSChidb5x5luHfK6b+iMg2WxMmWd4uTHyTV9yDBtXIEvw/hyZpx3IkptSXkbpxxkctSCo cVX2R3OQ25A1PBfi7j+QHP7gQ/H0zMWbGuaf7rzhYE7iEKQbnxsiYY7eL+WJQCa1MW0jTxGA gV4LQ8LGY4ITp4+vTNYvKYIr6wdcxq5W7GirpHMgb1ToGREGlxasZhhOLSzbH4Fl27dYNpke Qooo30hZXbVky/ZMQf2uH0UrRioz8Qo1lekSyylANUm/SsFqLCLwCRlqCZDRMvAiH3FlBMDg eCzld1aSSc3tdnU/J1MjmMBhQh6LRx0dpKq1qduU34KlQYbNytAZSgAAAAAAAA== --------------ms050505050407040006080208--

On Wed, Jan 3, 2018 at 9:27 PM, Bernhard Seidl <info@bernhard-seidl.de> wrote:
Hi all and a happy new year,
I am just testing oVirt 4.2 using a three node gluster hyperconvergence and self hosted engine setup. How should this setup be shutdown and started again? Here is what tried an experienced:
The approach you outlined is correct.
Shutdown:
1. Shutdown all VMs
2. Enable global ha maintenance
3. Wait for all VM
4. Shutdown hosted-engine using "hosted-engine --vm-shutdown"
5. Wait for stopped hosted engine
6. Shutdown all nodes
Startup:
1. Switch on all nodes
2. Start glusterd on all nodes since it does not start by default (is this a bug?) using "systemctl start glusterd*"*
Can you log a bug?
3. Check volume status using "gluster peer status" and "gluster volume status all" on one of the nodes
4. Wait for ovrt-ha-agent until "hosted-engine --vm-status" does not fail anymore printing "The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable."
4. Start hosted engine "hosted-engine --vm-start" on one of the nodes
5. Check status using "hosted-engine --vm-status" and wait until health reports good
6. Wait until a host got the SPM role
7. Start VMs
Is this the best/correct way?
Kind regards, Bernhard
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users

Am 04.01.2018 um 11:56 schrieb Sahina Bose:
On Wed, Jan 3, 2018 at 9:27 PM, Bernhard Seidl <info@bernhard-seidl.de <mailto:info@bernhard-seidl.de>> wrote:
Hi all and a happy new year,
I am just testing oVirt 4.2 using a three node gluster hyperconvergence and self hosted engine setup. How should this setup be shutdown and started again? Here is what tried an experienced:
The approach you outlined is correct.
Shutdown:
1. Shutdown all VMs
2. Enable global ha maintenance
3. Wait for all VM
4. Shutdown hosted-engine using "hosted-engine --vm-shutdown"
5. Wait for stopped hosted engine
6. Shutdown all nodes
Startup:
1. Switch on all nodes
2. Start glusterd on all nodes since it does not start by default (is this a bug?) using "systemctl start glusterd*"*
Can you log a bug?
There it is: https://bugzilla.redhat.com/show_bug.cgi?id=1531052
3. Check volume status using "gluster peer status" and "gluster volume status all" on one of the nodes
4. Wait for ovrt-ha-agent until "hosted-engine --vm-status" does not fail anymore printing "The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent is running and the storage server is reachable."
4. Start hosted engine "hosted-engine --vm-start" on one of the nodes
5. Check status using "hosted-engine --vm-status" and wait until health reports good
6. Wait until a host got the SPM role
I think that I missed a step here: 6a. Disable global ha maintenance
7. Start VMs
Is this the best/correct way?
Kind regards, Bernhard
participants (2)
-
Bernhard Seidl
-
Sahina Bose