--_002_CY1PR0301MB12434052BADC56AC63153044DA200CY1PR0301MB1243_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable -----BEGIN PGP SIGNED MESSAGE-----=0A= Hash: SHA1=0A= =0A= Magnanimous Ladies and Gentlemen=0A= =0A= Due to an overly aggressive n00b rush, an ungraceful shutdown of our=0A= Hosted Engine ensued.=0A= =0A= We were able to restore the Hosted Engine via RTFM.=0A= =0A= However the RHEL Host 6.6, upon which the Hosted Engine's integrity=0A= depends, seems to have lost its network scripts. Forgive me for=0A= inquiring about a topic that's probably been discussed many times.=0A= =0A= I restored the iSCSI and Management, Display, and VM VLAN's by=0A= reconstructing the ifcfg scripts. However we're not able to get vdsm=0A= to restore what should exist. So once RHEV-M returns the Host is of=0A= course Non Operational.=0A= =0A= On the Host we have net_persistence =3D unified set in vdsm.conf.=0A= =0A= /var/run/vdsm/netconf/{nets,bonds} are empty.=0A= =0A= Though /var/lib/vdsm/persistence/netconf/{nets,bonds} contains=0A= wonderful JSON.=0A= =0A= If files are copied from /var/run/vdsm/netconf/* to=0A= /var/lib/vdsm/persistence/netconf/* then does this present a problem?=0A= =0A= How does persistence work with a stateful RHEL Host?=0A= =0A= I did not set up this Host so cannot vouch for its proper configuration.=0A= =0A= We've concerned about letting RHEV-M reconfigure the network of this=0A= Host since if we lose the iSCSI bond that would be bad for the=0A= manager. We do not have another Hosted Engine capable Host at this=0A= time :)=0A= =0A= If could you please assist I promise a cocktail or two the next time=0A= you visit New Orleans.=0A= =0A= Thanks=0A= Doug=0A= =0A= - -- =0A= Thanks=0A= =0A= Douglas Charles Duckworth=0A= Unix Administrator=0A= Tulane University=0A= Technology Services=0A= 1555 Poydras Ave=0A= NOLA -- 70112=0A= =0A= E: duckd@tulane.edu=0A= O: 504-988-9341=0A= F: 504-988-8505=0A= -----BEGIN PGP SIGNATURE-----=0A= Version: GnuPG v2.0.22 (GNU/Linux)=0A= =0A= iQIcBAEBAgAGBQJWMpeOAAoJEP/Xbmk1axQpFK4P/jhjc7NuFtOgDw+V0bsFsG/j=0A= EUxpIYh3Z6j70K/rhQUFHirbebl5VRJBNcfuy6yT/NGhy7hykYNIGRaxgW2SI93q=0A= AteKSXX7oPcvmv6yyl6l7cmynC2lepCsO20geGOwbThaVSnjaXXDr/6SfMPXXpz4=0A= VVw6YuIBtSG6uvOKJjm3idEw+o2J1lg4EZdylIb7s5ygMZYrBCznSywT8Q3QNe2Z=0A= 1uG9EK9yUthAoPfVaRZbawcwX4xDwdtNPqCuvZvkENW+WxgBGJmDLBpbkK3ZNpe8=0A= yBoVCI34wkn0RUIIlPsbhOQDuX+Zb+nF24oeIF6KyUXxW8KMnpjCkpX6P+qZ+UjS=0A= jaXTev4YzH9Apz6wLu/ZVojqLDr8U9ALKbv+GP6l+NY2UiuziDGczsSSY/DgOiCa=0A= nhoiN2w1+sX5Nhqigjvbj8Q90AzwRdFyrIJIyDNatJ+8xiMUBHNf3giO1gowB+Ey=0A= W3uKDvFRP5h5FKUcbPzcHrkCbZawl6tkQ1I/7ZDrcPz6kAJ7Ou/SfXi3UOpncTPX=0A= AHmJOHwGw4VIxqtRJYxdVU215VnYplYw1wuZm17rHOHJ+O/+C+MUMIde3rC7iNcN=0A= mLkQH3U6d2hGimUuYkwDLnqRUp/Ep22x3KSxNM2L2ah+NKfeJ1NrJPqcUwjmvjTY=0A= Wmcy6AJJMEqnvIJCZIUO=0A= =3DnNqA=0A= -----END PGP SIGNATURE-----=0A= --_002_CY1PR0301MB12434052BADC56AC63153044DA200CY1PR0301MB1243_ Content-Type: application/pgp-keys; name="0x356B1429.asc" Content-Description: 0x356B1429.asc Content-Disposition: attachment; filename="0x356B1429.asc"; size=3129; creation-date="Thu, 29 Oct 2015 22:04:06 GMT"; modification-date="Thu, 29 Oct 2015 22:04:06 GMT" Content-Transfer-Encoding: base64 LS0tLS1CRUdJTiBQR1AgUFVCTElDIEtFWSBCTE9DSy0tLS0tClZlcnNpb246IEdudVBHIHYyLjAu MjIgKEdOVS9MaW51eCkKCm1RSU5CRlNCMWxnQkVBRFJ0TWlQaXVKVFJLSFZveWxUcmdVVGRzQkdu aGhNV2oveTczZmtYMzUvSzRwUVdvR1QKSk1vc3M1TEJWaHl2M2tyY3JTQkowaVR3SzdjL3lQZHNx c1hQMStKSGZSVXZwL3lhS29EV2IrVnZZVGRhQU84eQpQbjNKMWtaNTFMWk04V2ZzTFZFQVA4UjBh ZFdyd2htSk5XSHplVFI0ZmxldlphS1VHY29STHJYS3l6NjNDSzNkCmVQWGIvQU9uaml2b1RJTXdk YSsvS00vR2RQZUlFUVVxWWxxSDBpRzVwOWw0OG1SOXk4ZmpYNWFJNlJSd0w5bEgKRWVGRVJ1Qkty amZhYkRCM3UveGhnSkhjYUZLd3lSWnNmempSdHlCZUFQdlYveGlOTHB6MjZHd2dGbVNtcEp6Vgpz TkxhOE9BcFZEamZFckRpekJxbFgzTG1qRHdYZFlWQzRKNTZ0bEFSbVdzNVRBZDZXbXB1RURyOGpW c0lMcUdsClpWdTkwOVEreVRLejBxbUt5WmlmelBDSWJieU5yS2VVdlJOM0lmcE5zTEpHbnFiM2N4 NFlhU1FZZlAvSHVhUmUKQlNNd2dDaXRqQ0M4VDlhZXBMOStmZWg2UjBuZXhjUWF4OUJxblQ3VzZu a0VKT2JzcThmTDVXWmFvMDZRYldlVgpyNXRIeHN0SmQvcUxkdC9hMHQ2RUhJaEQ5am14K0Flc1hB Uk05bUdQSXdVMlZGSzBTZEQwMVpCQjU5VTNzcHhmClo2QnY2VXV4cDlodjhmajRWbHNCY3ZvYTdo WUFSVzBIWjBLOFdvNWQvWkRtNUdpMFVCbFpkaTJLb21GTmpxQ3kKbVNUOW84T0hqVUNDdkJiTHky YlFGWEpnd0UydkNibXA2aUdaektkZkptV292Z3NBTmpHNkRUOHFRUUFSQVFBQgp0Q2RFZFdOcmQy OXlkR2dzSUVSdmRXZHNZWE1nUXlBOFpIVmphMlJBZEhWc1lXNWxMbVZrZFQ2SkFqNEVFd0VDCkFD Z0ZBbFNCMWxnQ0d5TUZDUWxtQVlBR0N3a0lCd01DQmhVSUFna0tDd1FXQWdNQkFoNEJBaGVBQUFv SkVQL1gKYm1rMWF4UXBDdDhQLzBaOEEwVXJYUVdOUkdVZFh4N0doL3Riek51bFR1YTFGT0lZY2Jl L05UV0VkTUxnc254Rgp6RzZvMVlrZnFtcm9KR1grQm4zTFJ0YWpIekZadWgvZEFzdEtJSXJJUnRW bzhjNXZPZ0VWeW80SkhaSGh6RXNBCjF3eHJpWEtlZThtWjcrWEFPMUJmbWJjdFVrRE92dzhpdTEr NXFzd0lkc2l1NVI5aXFkN0dxUjg3bVF1SlZTYUIKRTJ5Z1FRc0tqdUdpL293Nkg3RFBSdFU5cHll dkdVV3dsWUNKZlhXYnRHYmJjZzRqM3k4WENDQTN0YmtoOHBtNwpJNjAxQkNFT3R3MVZXRFcrQlI5 cjZEMVhOaWVNeEp4NHU4d1AzMzRUQ2hCdUFSVDB2RDZndGprK3BCTmIyNlQ1ClcyTWVDQ3NPN2FJ SU5KNVRVOTJjcmhCdTlkakJsQ2x2aExabksyb0JyYytIUUcwWWVBVExVS003M0lMWWxPK00KT2Fu NVl5R2Z3WDBlTk5hMTFOMVV0NTUrS2ozNzRsWlVjK0t2ZWg5akp0NTYvSGRJY2lPS1hucjNwajVY YzEyaAoyeldqZVU2UmVSbkhhUVZESWUrWDQ1eDRUSFVPVkFHTGI3UzBnVjFDTVFINTNFYkVzaU1m ZHo0VWlsb1NGQXZECjhacmlmOWtFM08zQWpOWnFuRGFlLy9kbGZmRVd6eWloK3VCcmg1VW1KeG1K NHpRS09RUzQxeGtZV3Z2OTNZRzYKRm9IMTJKL2tOSFQyUEFEK2g4NGNRUzJNRTRlSmNEdEh0OVNW cHN5alhBb1BoWDZRSCtWdnVIUzFZYy9uZFZnSApodmIvVXQ5eTRTL3hnZTR0c0M2ZDBLcjliQzNz Z01kOVJRTmJuU2ppT1JRN0xoSjd6enA0YUlycnVRSU5CRlNCCjFsZ0JFQURPRGhKenRGalVnWkg4 REZRc1VjOW5EU25GR0l2c2hld3dsOERFcU5XbE5BRHd2VFNIZ0IrR2RsZU8KNDJ2Q2JqWjZnL21E WnF3bHhTd0VYRE5BSmRLSjBwTllCZ0JmTmgwZGJnUHdvZ0VwaytDUWJYY0pmMzR1S3ltMQpNcWE5 ZnBuUHE4WERzV1ZKUndHZjc0eTRxTEsxbFhnME8wOUk2eWZJS0J4SUYwdkxUVVVEdnpiM3dUZzRk YitCCisxd2xhN2hDVHdpcC95VHNMYUpEM214NndERnRmS25uWjM2aGV0eTkvNGVGaU5IMHVaYnpo aDFoUHBIcGRMa0YKV0pKV2NqSk1LVWwwWWxDLzRwenVLRndEMzhtTVZ3R3NlTE5OeVJPR0RIMTE4 Yy9EVi9DNm54T3pHRDZXTEZiVwprQUY3K0pHVy9MOFlmMXYwaTA3STg2NXVCMFVRb3B2MVMvbzN0 M1hPam9nYmFSUjF1ZU5uYmd5WFY4RjZqUlJVCnQ3RTZ4bStzRWxubThjditRMkFkK2tscEdvTnVZ ZmF6ZHdEQ1BYU3lTVld6a0xSb1VTVUhzbU5aS1l5QlZEMjUKeUt5RGRKdE53QWZVM05UQU1jN3NX V0dOUmgwYXR3d0Q4cVZUMmpQTFh6SWk1QWdrYytlTEg5d1RJenhSVzJXcgorTlczNzNDbDZvUURY VnJJNFltZmpqVFFaQTlIb1BDQk9zcVVkek1vZXFVbDBHRHd4VkZEMUF3STFSN2lrL2JsClJxL1Zi N25XOGFVU0VPSUFHSG91NmVrbFRIYXZJd2lWUzBlRWxtcUkyUXpGem1VRmJnS090Z3ZSanhld3hZ emwKa1h4ZlJWd2I4VDUxWTV0aGlRWk96dlpXa1J2aUlHZkwwWVJPVGU3YUgzWUJwODBra3dBUkFR QUJpUUlsQkJnQgpBZ0FQQlFKVWdkWllBaHNNQlFrSlpnR0FBQW9KRVAvWGJtazFheFFwanlFUUFM dENMS2pzWjVHYUZGMUhHa1pSCkZxbnFkTTdwRmE5OXhIMkNkdmJRSmVCek8zZW9JSWdOOC9EVDgx d3ptN0swOTVyMEJ2MDd4THQ4WWxoWnRhei8KWnRWa0Y3TGRvYWNnUXhOOFdqVTNuSktRQ3NhREFx d0lFRUtDOGRqMGRYdHdhZDVFN3kwOStuVWtUYUU5QTR0Nwpxb3lYRG9uZGtSN2sxYy9NbkRQU0Rn V0s5U0JZRkF1YjNLNDN6V1lvb2xMWWJYTTRmQ3NRUW1FMDRhYnpVOW1OCmpTWG93QnJOendsK3J6 ZjRxaEJ1cHNVS1hLdFVtTTJkczBQT0EvQms3clhIZ2FyeFZXS3BENm1wL2l0aWdGdXQKOTlwWngz U0tTRzViRFNqUjZpMjB6T08zVkxWY29TSnVoRHgxY01IbFhXKzJPWHhKWWJVL0ZBN29pQUN4bjAr UgpweFZ0dHZjZEZWYUVUTFcvVzZWL3VrOGd2NEZrQjJFSGtSOFh3Zis3d21uYXVJall2dmgrTlBa Y1RRdXYvMW1LCnVYTHRlTk9oQlgwQkpKZlREZDdHcEVOZXY5SFp6Y0xvQWhzU0syR1ZNdmNMYmJV RUZRTithMWpNT2NER2xjaU0KYVBqUURuc29hL0oxa1JuTVhiSW1nL1RHamszM0ZkRkp3SFZsenNL K3BxWkdnNDlOZDBiemRaQmNRNVVaZlVoMAowdi8wYWdNU0ZSNEc4enhiRmdvRUtNNUpyajVwM044 T1BsM1Z1T2VSQW9LY1pKQlQvblB1RzdwQ1JmNUQ3WUtYCnlBY1ZUMldtYzRFY3VHUXBxSlI4MUNG Ui9QVXpoT0NaNlFNZUM2eER6YlVUZ1B6aURld3pCTUNRQXVkMHdveFQKR1ZlN3dxU1A1b0g0bzVY RFovYjUzbHI3Cj1tWFhyCi0tLS0tRU5EIFBHUCBQVUJMSUMgS0VZIEJMT0NLLS0tLS0K --_002_CY1PR0301MB12434052BADC56AC63153044DA200CY1PR0301MB1243_--
On Fri, Oct 30, 2015 at 12:04 AM, Duckworth, Douglas C <duckd@tulane.edu> wrote:
Doug
Hi Doug, You haven't sated your vdsm/oVirt version so I my answers might be somewhat generic. 1) once a network configuration (net-conf) is given by the engine, and is configured by vdsm, vdsm stores it under /var/run/vdsm/netconf/{nets,bonds}. This is used as an intermediate place fro this configuration, and allows the user to verify that his requested net-conf indeed serves his goals. If the worst has happen, and all communication is now broken, and since this path does not survive a reboot, it leaves the user with the emergency ultimate option of rebooting the host and let it restooe the last knownworking net-conf (see2). 2) once engine calls setSafeNetworkConfig API verb, this info is copied into /var/lib/vdsm/persistence/netconf/ in an atomic operation. Since this path survives a host reboot, the host will restore all networks from that place. If I am not mistaking, the engine defaults to call this API immediately after each netwrok setup (it can be toggled in a checkbox in the UI). In general, the ultimate knoledge about the required networks sits in the administrator mind, and hopefully, in the engine database. So the best options you guys have is adding the required netwroks one by one from the engine, and call setSafeNetworkConfig after each verified successful state. This will ensure a proper state+backup on your host. -- Thanks, Ido Barkan
Ido We are using RHEV 3.5.4 with 6.7 Hosts. I deployed another Host for the Hosted Engine VM, moved the Hosted Engine VM to that new Host, then fixed the networks on that bad Host. Setting the Bad host to "Local" Maintenance Mode did not trigger VM startup on the other Host. So we shut it down manually as described under section "Maintenance Flows:" http://www.ovirt.org/Features/Self_Hosted_Engine All is now good in our DR site Cluster. Thank you for your informative explanation! Best Doug -- Thanks Douglas Charles Duckworth Unix Administrator Tulane University Technology Services 1555 Poydras Ave NOLA -- 70112 E: duckd@tulane.edu O: 504-988-9341 F: 504-988-8505 On 11/01/2015 01:25 AM, Ido Barkan wrote:
On Fri, Oct 30, 2015 at 12:04 AM, Duckworth, Douglas C <duckd@tulane.edu <mailto:duckd@tulane.edu>> wrote:
Doug
Hi Doug, You haven't sated your vdsm/oVirt version so I my answers might be somewhat generic. 1) once a network configuration (net-conf) is given by the engine, and is configured by vdsm, vdsm stores it under /var/run/vdsm/netconf/{nets,bonds}. This is used as an intermediate place fro this configuration, and allows the user to verify that his requested net-conf indeed serves his goals. If the worst has happen, and all communication is now broken, and since this path does not survive a reboot, it leaves the user with the emergency ultimate option of rebooting the host and let it restooe the last knownworking net-conf (see2). 2) once engine calls setSafeNetworkConfig API verb, this info is copied into /var/lib/vdsm/persistence/netconf/ in an atomic operation. Since this path survives a host reboot, the host will restore all networks from that place. If I am not mistaking, the engine defaults to call this API immediately after each netwrok setup (it can be toggled in a checkbox in the UI).
In general, the ultimate knoledge about the required networks sits in the administrator mind, and hopefully, in the engine database. So the best options you guys have is adding the required netwroks one by one from the engine, and call setSafeNetworkConfig after each verified successful state. This will ensure a proper state+backup on your host.
-- Thanks, Ido Barkan
participants (2)
-
Duckworth, Douglas C -
Ido Barkan