The above was all last couple of weeks.=3DC= 2=3DA0

This week I performed some yum updates on the Eng= =3D ine VM. No reboot.=3DC2=3DA0

Today noticed that the Ovirt service= s in =3D the Engine VM were in a endless restart loop. They would be up for a 5 min= =3D utes and then die.=3DC2=3DA0

Looking into=3DC2=3DA0/var/log/ovirt= -engine/=3D engine.log and I could only see errors relating to host02. Ovirt was trying= =3D to find it and failing. Then falling over.=3DC2=3DA0

I ran "hoste= d-e=3D ngine --clean-metadata" thinking it would cleanup and remove bad references= =3D to hosts, but now realise that was a really bad idea as it didn't do what= =3D I'd hoped.=3DC2=3DA0

At this point the sequence below worked, I = could =3D login to Ovirt UI but after 5 minutes the services would be off

= =3D

service ovirt-engine restart

service ovirt-websocket-p= ro=3D xy restart

service httpd restart

I saw some reference= =3D to having to remove hosts from the database by hand in situations where un= =3D der the hood of Ovirt a decommission host was still listed, but wasn't show= =3D ing in the GUI.=3DC2=3DA0

So I removed reference to host02 (vds_i= d an=3D d host_id) in the following tables in this order.=3DC2=3DA0

vds_dynamic

vds_statistics

=3D

vds_sta= ti=3D c

host_device

Now when I try to start= =3D ovirt-websocket it will not start

service ovirt-websocket start<= =3D br />Redirecting to /bin/systemctl start =3DC2=3DA0ovirt-websocket.service<= br /=3D >Failed to start ovirt-websocket.service: Unit not found.

<= =3D /div>

I'm now thinking that I need to do the following in the engine VM= =3D

#=3DC2=3DA0engine-cleanup
#=3DC2=3DA0yum=3DC2=3DA0remove=3DC2=3DA0ovirt-engine
#=3DC2=3DA0yum=3DC2=3DA0install=3DC2=3DA0ovirt-engine
#=3DC2=3DA0engine-setup=3DC2=3DA0

But to run e= ngine-cl=3D eanup I need to put the engine-vm into maintenance mode and because of the= =3D --clean-metadata that I ran earlier on host01 I cannot do that.=3DC2=3DA0<= /div>=3D

What is the best course of action from here?

<=3D p class=3D3D"MsoNormal">Cheers

Andrew=3D

--------=3D_MBFFB0EF4D-0CCB-43B8-B6B6-961FF15C7403-- --===============1297766554726593898== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS0tLS0tLS09X01CRkZCMEVGNEQtMENDQi00M0I4LUI2QjYtOTYxRkYxNUM3NDAzCkNvbnRlbnQt VHlwZTogdGV4dC9wbGFpbjsgZm9ybWF0PWZsb3dlZDsgY2hhcnNldD11dGYtOApDb250ZW50LVRy YW5zZmVyLUVuY29kaW5nOiBxdW90ZWQtcHJpbnRhYmxlCgpIaQoKV2VsbCBJJ3ZlIGdvdCBteXNl bGYgaW50byBhIGZpbmUgbWVzcy4KCmhvc3QwMSB3YXMgc2V0dXAgd2l0aCBob3N0ZWQtZW5naW5l IHY0LjEuIFRoaXMgd2FzIHN1Y2Nlc3NmdWwuCkltcG9ydGVkIDMgVk1zIGZyb20gYSB2My42IE9W aXJ0IEFJTyBpbnN0YW5jZS4gKFRoaXMgT1ZpcnQgMy42IGlzIHN0aWxsPTIwCnJ1bm5pbmcgd2l0 aCBtb3JlIFZNcyBvbiBpdCkKVHJpZWQgdG8gYWRkIGhvc3QwMiB0byB0aGUgbmV3IE92aXJ0IDQu MSBzZXR1cC4gVGhpcyBwYXJ0aWFsbHkgc3VjY2VlZGVkPTIwCmJ1dCBJIGNvdWxkbid0IGFkZCBh bnkgc3RvcmFnZSBkb21haW5zIHRvIGl0LiBDYW5ub3QgcmVtZW1iZXIgd2h5LgpJbiBPdmlydCBl bmdpbmUgVUkgSSByZW1vdmVkIGhvc3QwMi4KSSByZWluc3RhbGxlZCBob3N0MDIgd2l0aCBDZW50 b3M3LCB0cmllZCB0byBhZGQgaXQgYW5kIE92aXJ0IFVJIHRvbGQgbWU9MjAKaXQgd2FzIGFscmVh ZHkgdGhlcmUgKGJ1dCBpdCB3YXNuJ3QgbGlzdGVkIGluIHRoZSBVSSkuClJlbmFtZWQgdGhlIHJl aW5zdGFsbGVkIGhvc3QwMiB0byBob3N0MDMsIGNoYW5nZWQgdGhlIGlwYWRkcmVzcyw9MjAKcmVj b25maWcgdGhlIEROUyBzZXJ2ZXIgYW5kIGFkZGVkIGhvc3QwMyBpbnRvIHRoZSBPdmlydCBFbmdp bmUgVUkuCkFsbCBnb29kLCBhbmQgSSB3YXMgYWJsZSB0byBpbXBvcnQgbW9yZSBWTXMgdG8gaXQu Ckkgd2FzIGFsc28gYWJsZSB0byBzaHV0ZG93biBhIFZNIG9uIGhvc3QwMSBhc3NpZ24gaXQgdG8g aG9zdDAzIGFuZCBzdGFydD0yMAp0aGUgVk0uIENvb2wsIGV2ZXJ5dGhpbmcgd29ya2luZy4KVGhl IGFib3ZlIHdhcyBhbGwgbGFzdCBjb3VwbGUgb2Ygd2Vla3MuCgpUaGlzIHdlZWsgSSBwZXJmb3Jt ZWQgc29tZSB5dW0gdXBkYXRlcyBvbiB0aGUgRW5naW5lIFZNLiBObyByZWJvb3QuClRvZGF5IG5v dGljZWQgdGhhdCB0aGUgT3ZpcnQgc2VydmljZXMgaW4gdGhlIEVuZ2luZSBWTSB3ZXJlIGluIGEg ZW5kbGVzcz0yMApyZXN0YXJ0IGxvb3AuIFRoZXkgd291bGQgYmUgdXAgZm9yIGEgNSBtaW51dGVz IGFuZCB0aGVuIGRpZS4KTG9va2luZyBpbnRvIC92YXIvbG9nL292aXJ0LWVuZ2luZS9lbmdpbmUu bG9nIGFuZCBJIGNvdWxkIG9ubHkgc2VlPTIwCmVycm9ycyByZWxhdGluZyB0byBob3N0MDIuIE92 aXJ0IHdhcyB0cnlpbmcgdG8gZmluZCBpdCBhbmQgZmFpbGluZy4gVGhlbj0yMApmYWxsaW5nIG92 ZXIuCkkgcmFuICJob3N0ZWQtZW5naW5lIC0tY2xlYW4tbWV0YWRhdGEiIHRoaW5raW5nIGl0IHdv dWxkIGNsZWFudXAgYW5kPTIwCnJlbW92ZSBiYWQgcmVmZXJlbmNlcyB0byBob3N0cywgYnV0IG5v dyByZWFsaXNlIHRoYXQgd2FzIGEgcmVhbGx5IGJhZD0yMAppZGVhIGFzIGl0IGRpZG4ndCBkbyB3 aGF0IEknZCBob3BlZC4KQXQgdGhpcyBwb2ludCB0aGUgc2VxdWVuY2UgYmVsb3cgd29ya2VkLCBJ IGNvdWxkIGxvZ2luIHRvIE92aXJ0IFVJIGJ1dD0yMAphZnRlciA1IG1pbnV0ZXMgdGhlIHNlcnZp Y2VzIHdvdWxkIGJlIG9mZgpzZXJ2aWNlIG92aXJ0LWVuZ2luZSByZXN0YXJ0CnNlcnZpY2Ugb3Zp cnQtd2Vic29ja2V0LXByb3h5IHJlc3RhcnQKc2VydmljZSBodHRwZCByZXN0YXJ0CgpJIHNhdyBz b21lIHJlZmVyZW5jZSB0byBoYXZpbmcgdG8gcmVtb3ZlIGhvc3RzIGZyb20gdGhlIGRhdGFiYXNl IGJ5IGhhbmQ9MjAKaW4gc2l0dWF0aW9ucyB3aGVyZSB1bmRlciB0aGUgaG9vZCBvZiBPdmlydCBh IGRlY29tbWlzc2lvbiBob3N0IHdhcz0yMApzdGlsbCBsaXN0ZWQsIGJ1dCB3YXNuJ3Qgc2hvd2lu ZyBpbiB0aGUgR1VJLgpTbyBJIHJlbW92ZWQgcmVmZXJlbmNlIHRvIGhvc3QwMiAodmRzX2lkIGFu ZCBob3N0X2lkKSBpbiB0aGUgZm9sbG93aW5nPTIwCnRhYmxlcyBpbiB0aGlzIG9yZGVyLgp2ZHNf ZHluYW1pYwp2ZHNfc3RhdGlzdGljcwp2ZHNfc3RhdGljCmhvc3RfZGV2aWNlCgpOb3cgd2hlbiBJ IHRyeSB0byBzdGFydCBvdmlydC13ZWJzb2NrZXQgaXQgd2lsbCBub3Qgc3RhcnQKc2VydmljZSBv dmlydC13ZWJzb2NrZXQgc3RhcnQKUmVkaXJlY3RpbmcgdG8gL2Jpbi9zeXN0ZW1jdGwgc3RhcnQg IG92aXJ0LXdlYnNvY2tldC5zZXJ2aWNlCkZhaWxlZCB0byBzdGFydCBvdmlydC13ZWJzb2NrZXQu c2VydmljZTogVW5pdCBub3QgZm91bmQuCgpJJ20gbm93IHRoaW5raW5nIHRoYXQgSSBuZWVkIHRv IGRvIHRoZSBmb2xsb3dpbmcgaW4gdGhlIGVuZ2luZSBWTQojIGVuZ2luZS1jbGVhbnVwICMgeXVt IHJlbW92ZSBvdmlydC1lbmdpbmUgIyB5dW0gaW5zdGFsbCBvdmlydC1lbmdpbmUgIz0yMAplbmdp bmUtc2V0dXAKQnV0IHRvIHJ1biBlbmdpbmUtY2xlYW51cCBJIG5lZWQgdG8gcHV0IHRoZSBlbmdp bmUtdm0gaW50byBtYWludGVuYW5jZT0yMAptb2RlIGFuZCBiZWNhdXNlIG9mIHRoZSAtLWNsZWFu LW1ldGFkYXRhIHRoYXQgSSByYW4gZWFybGllciBvbiBob3N0MDEgST0yMApjYW5ub3QgZG8gdGhh dC4KCldoYXQgaXMgdGhlIGJlc3QgY291cnNlIG9mIGFjdGlvbiBmcm9tIGhlcmU/CgpDaGVlcnMK CgoKQW5kcmV3CgotLS0tLS0tLT1fTUJGRkIwRUY0RC0wQ0NCLTQzQjgtQjZCNi05NjFGRjE1Qzc0 MDMKQ29udGVudC1UeXBlOiB0ZXh0L2h0bWw7IGNoYXJzZXQ9dXRmLTgKQ29udGVudC1UcmFuc2Zl ci1FbmNvZGluZzogcXVvdGVkLXByaW50YWJsZQoKPD94bWwgdmVyc2lvbj0zRCIxLjAiIGVuY29k aW5nPTNEInV0Zi0xNiI/PjxodG1sPjxoZWFkPgoKPHN0eWxlIGlkPTNEInNpZ25hdHVyZVN0eWxl Ij48IS0tI3hiYWYzNmQ5OTdiN2Y0OTcsICN4YmFmMzZkOTk3YjdmNDk3LCAjeGJhPQpmMzZkOTk3 YjdmNDk3LCAjeGJhZjM2ZDk5N2I3ZjQ5NyAjeGI3MTIyNGY5MjAyMzQ5NzhhY2M3NGY0ZDIzMTQz MDY5LCAjeGJhZjM9CjZkOTk3YjdmNDk3Cntmb250LWZhbWlseTogVGFob21hOyBmb250LXNpemU6 IDEycHQ7fQojeGJhZjM2ZDk5N2I3ZjQ5NywgI3hiYWYzNmQ5OTdiN2Y0OTcKe2ZvbnQtZmFtaWx5 OiAnU2Vnb2UgVUknOyBmb250LXNpemU6IDEycHQ7fQojeGJhZjM2ZDk5N2I3ZjQ5NyAjeGI3MTIy NGY5MjAyMzQ5NzhhY2M3NGY0ZDIzMTQzMDY5IHAuTXNvTm9ybWFsLCAjeGJhZjM2ZDk9Cjk3Yjdm NDk3IHAuTXNvTm9ybWFsCnttYXJnaW46IDBjbSAwY20gMC4wMDAxcHQ7IGZvbnQtc2l6ZTogMTFw dDsgZm9udC1mYW1pbHk6IENhbGlicmksIHNhbnMtc2VyaT0KZjt9CiN4YmFmMzZkOTk3YjdmNDk3 ICN4YjcxMjI0ZjkyMDIzNDk3OGFjYzc0ZjRkMjMxNDMwNjkgZGl2LldvcmRTZWN0aW9uMSwgI3hi YT0KZjM2ZDk5N2I3ZjQ5NyBkaXYuV29yZFNlY3Rpb24xCntwYWdlOiBXb3JkU2VjdGlvbjE7fQoj eGJhZjM2ZDk5N2I3ZjQ5NyBhOmxpbmsKe2NvbG9yOiByZ2IoNSwgOTksIDE5Myk7IHRleHQtZGVj b3JhdGlvbjogdW5kZXJsaW5lO30KLS0+PC9zdHlsZT4KPHN0eWxlPjwhW0NEQVRBWyN4ODdkOTc4 YzU2ODgwNDE1ZTk1OTRkN2ZlMzE3ZjMwZjMgI3gwZWMxMjg5OTg2OTk0ZmI1YWMzMDk4PQoyN2Vk ZDMzYWJlLCN4ODdkOTc4YzU2ODgwNDE1ZTk1OTRkN2ZlMzE3ZjMwZjN7Cglmb250LWZhbWlseTpU YWhvbWE7Cglmb250LXNpemU6MTJwdDsKfSN4MGVjMTI4OTk4Njk5NGZiNWFjMzA5ODI3ZWRkMzNh YmUgI3hiYWYzNmQ5OTdiN2Y0OTcsI3gwZWMxMjg5OTg2OTk0ZmI1YWMzPQowOTgyN2VkZDMzYWJl ICN4YmFmMzZkOTk3YjdmNDk3LCN4MGVjMTI4OTk4Njk5NGZiNWFjMzA5ODI3ZWRkMzNhYmUgI3hi YWYzNmQ9Cjk5N2I3ZjQ5NywjeDBlYzEyODk5ODY5OTRmYjVhYzMwOTgyN2VkZDMzYWJlICN4YmFm MzZkOTk3YjdmNDk3ICN4YjcxMjI0ZjkyMD0KMjM0OTc4YWNjNzRmNGQyMzE0MzA2OSwjeDBlYzEy ODk5ODY5OTRmYjVhYzMwOTgyN2VkZDMzYWJlICN4YmFmMzZkOTk3YjdmNDk3PQp7Cglmb250LWZh bWlseTpUYWhvbWE7Cglmb250LXNpemU6MTJwdDsKfQojeDBlYzEyODk5ODY5OTRmYjVhYzMwOTgy N2VkZDMzYWJlICN4YmFmMzZkOTk3YjdmNDk3LCN4MGVjMTI4OTk4Njk5NGZiNWFjMzA9Cjk4Mjdl ZGQzM2FiZSAjeGJhZjM2ZDk5N2I3ZjQ5N3sKCWZvbnQtZmFtaWx5OidTZWdvZSBVSSc7Cglmb250 LXNpemU6MTJwdDsKfQojeDBlYzEyODk5ODY5OTRmYjVhYzMwOTgyN2VkZDMzYWJlICN4YmFmMzZk OTk3YjdmNDk3ICN4YjcxMjI0ZjkyMDIzNDk3OGFjYzc9CjRmNGQyMzE0MzA2OSBwLk1zb05vcm1h bCwjeDBlYzEyODk5ODY5OTRmYjVhYzMwOTgyN2VkZDMzYWJlICN4YmFmMzZkOTk3YjdmND0KOTcg cC5Nc29Ob3JtYWx7CgltYXJnaW46MGNtIDBjbSAwLjAwMDFwdDsKCWZvbnQtc2l6ZToxMXB0OwoJ Zm9udC1mYW1pbHk6Q2FsaWJyaSxzYW5zLXNlcmlmOwp9CiN4MGVjMTI4OTk4Njk5NGZiNWFjMzA5 ODI3ZWRkMzNhYmUgI3hiYWYzNmQ5OTdiN2Y0OTcgI3hiNzEyMjRmOTIwMjM0OTc4YWNjNz0KNGY0 ZDIzMTQzMDY5IGRpdi5Xb3JkU2VjdGlvbjEsI3gwZWMxMjg5OTg2OTk0ZmI1YWMzMDk4MjdlZGQz M2FiZSAjeGJhZjM2ZDk5PQo3YjdmNDk3IGRpdi5Xb3JkU2VjdGlvbjF7CglwYWdlOldvcmRTZWN0 aW9uMTsKfQojeDBlYzEyODk5ODY5OTRmYjVhYzMwOTgyN2VkZDMzYWJlewoJZm9udC1mYW1pbHk6 VGFob21hOwoJZm9udC1zaXplOjEycHQ7Cn1dXT48IS0tYm9keQp7Zm9udC1mYW1pbHk6IFRhaG9t YTsgZm9udC1zaXplOiAxMnB0O30KLS0+PC9zdHlsZT4KPC9oZWFkPgo8Ym9keT48ZGl2PkhpPC9k aXY+PGRpdj48YnIgLz48L2Rpdj48ZGl2PldlbGwgSSd2ZSBnb3QgbXlzZWxmIGludG8gYSBmaW5l IG09CmVzcy49QzI9QTA8L2Rpdj48ZGl2PjxiciAvPjwvZGl2PjxkaXY+aG9zdDAxIHdhcyBzZXR1 cCB3aXRoIGhvc3RlZC1lbmdpbmUgdj0KNC4xLj1DMj1BMDxzcGFuIHN0eWxlPTNEImZvbnQtc2l6 ZTogMTJwdDsiPlRoaXMgd2FzIHN1Y2Nlc3NmdWwuPUMyPUEwPC9zcGFuPQo+PC9kaXY+PGRpdj48 c3BhbiBzdHlsZT0zRCJmb250LXNpemU6IDEycHQ7Ij5JbXBvcnRlZCAzIFZNcyBmcm9tIGEgdjMu NiBPVmk9CnJ0IEFJTyBpbnN0YW5jZS4gKFRoaXMgT1ZpcnQgMy42IGlzIHN0aWxsIHJ1bm5pbmcg d2l0aCBtb3JlIFZNcyBvbiBpdCk8L3NwYT0Kbj48L2Rpdj48ZGl2PlRyaWVkIHRvIGFkZCBob3N0 MDIgdG8gdGhlIG5ldyBPdmlydCA0LjEgc2V0dXAuIFRoaXMgcGFydGlhbGx5ID0Kc3VjY2VlZGVk IGJ1dCBJIGNvdWxkbid0IGFkZCBhbnkgc3RvcmFnZSBkb21haW5zIHRvIGl0LiBDYW5ub3QgcmVt ZW1iZXIgd2g9CnkuPUMyPUEwPC9kaXY+PGRpdj5JbiBPdmlydCBlbmdpbmUgVUkgSSByZW1vdmVk IGhvc3QwMi49QzI9QTA8L2Rpdj48ZGl2Pkkgcj0KZWluc3RhbGxlZCBob3N0MDIgd2l0aCBDZW50 b3M3LCB0cmllZCB0byBhZGQgaXQgYW5kIE92aXJ0IFVJIHRvbGQgbWUgaXQgd2FzID0KYWxyZWFk eSB0aGVyZSAoYnV0IGl0IHdhc24ndCBsaXN0ZWQgaW4gdGhlIFVJKS49QzI9QTA8L2Rpdj48ZGl2 PlJlbmFtZWQgdGg9CmUgcmVpbnN0YWxsZWQgaG9zdDAyIHRvIGhvc3QwMywgY2hhbmdlZCB0aGUg aXBhZGRyZXNzLCByZWNvbmZpZyB0aGUgRE5TIHNlcj0KdmVyIGFuZCBhZGRlZCBob3N0MDMgaW50 byB0aGUgT3ZpcnQgRW5naW5lIFVJLj1DMj1BMDwvZGl2PjxkaXY+QWxsIGdvb2QsIGFuPQpkIEkg d2FzIGFibGUgdG8gaW1wb3J0IG1vcmUgVk1zIHRvIGl0Lj1DMj1BMDwvZGl2PjxkaXY+SSB3YXMg YWxzbyBhYmxlIHRvIHM9Cmh1dGRvd24gYSBWTSBvbiBob3N0MDEgYXNzaWduIGl0IHRvIGhvc3Qw MyBhbmQgc3RhcnQgdGhlIFZNLiBDb29sLCBldmVyeXRoaT0Kbmcgd29ya2luZy49QzI9QTA8L2Rp dj48ZGl2PlRoZSBhYm92ZSB3YXMgYWxsIGxhc3QgY291cGxlIG9mIHdlZWtzLj1DMj1BMDwvPQpk aXY+PGRpdj48YnIgLz48L2Rpdj48ZGl2PlRoaXMgd2VlayBJIHBlcmZvcm1lZCBzb21lIHl1bSB1 cGRhdGVzIG9uIHRoZSBFbmc9CmluZSBWTS4gTm8gcmVib290Lj1DMj1BMDwvZGl2PjxkaXY+VG9k YXkgbm90aWNlZCB0aGF0IHRoZSBPdmlydCBzZXJ2aWNlcyBpbiA9CnRoZSBFbmdpbmUgVk0gd2Vy ZSBpbiBhIGVuZGxlc3MgcmVzdGFydCBsb29wLiBUaGV5IHdvdWxkIGJlIHVwIGZvciBhIDUgbWlu PQp1dGVzIGFuZCB0aGVuIGRpZS49QzI9QTA8L2Rpdj48ZGl2Pkxvb2tpbmcgaW50bz1DMj1BMC92 YXIvbG9nL292aXJ0LWVuZ2luZS89CmVuZ2luZS5sb2cgYW5kIEkgY291bGQgb25seSBzZWUgZXJy b3JzIHJlbGF0aW5nIHRvIGhvc3QwMi4gT3ZpcnQgd2FzIHRyeWluZyA9CnRvIGZpbmQgaXQgYW5k IGZhaWxpbmcuIFRoZW4gZmFsbGluZyBvdmVyLj1DMj1BMDwvZGl2PjxkaXY+SSByYW4gImhvc3Rl ZC1lPQpuZ2luZSAtLWNsZWFuLW1ldGFkYXRhIiB0aGlua2luZyBpdCB3b3VsZCBjbGVhbnVwIGFu ZCByZW1vdmUgYmFkIHJlZmVyZW5jZXMgPQp0byBob3N0cywgYnV0IG5vdyByZWFsaXNlIHRoYXQg d2FzIGEgcmVhbGx5IGJhZCBpZGVhIGFzIGl0IGRpZG4ndCBkbyB3aGF0PQogSSdkIGhvcGVkLj1D Mj1BMDwvZGl2PjxkaXY+QXQgdGhpcyBwb2ludCB0aGUgc2VxdWVuY2UgYmVsb3cgd29ya2VkLCBJ IGNvdWxkID0KbG9naW4gdG8gT3ZpcnQgVUkgYnV0IGFmdGVyIDUgbWludXRlcyB0aGUgc2Vydmlj ZXMgd291bGQgYmUgb2ZmPC9kaXY+PGRpdj49CjxkaXY+Cgo8c3BhbiBzdHlsZT0zRCJjb2xvcjog cmdiKDM0LCAzNCwgMzQpOyBmb250LWZhbWlseTogVmVyZGFuYSwgQXJpYWwsIEhlbHZldGk9CmNh LCBzYW5zLXNlcmlmOyBmb250LXZhcmlhbnQtbGlnYXR1cmVzOiBub3JtYWw7IG9ycGhhbnM6IDI7 IHdpZG93czogMjsgYmFjaz0KZ3JvdW5kLWNvbG9yOiByZ2IoMjU1LCAyNTUsIDI1NSk7Ij5zZXJ2 aWNlIG92aXJ0LWVuZ2luZSByZXN0YXJ0PC9zcGFuPjwvZGl2PQo+PC9kaXY+PGRpdj48c3BhbiBz dHlsZT0zRCJjb2xvcjogcmdiKDM0LCAzNCwgMzQpOyBmb250LWZhbWlseTogVmVyZGFuYSwgQXI9 CmlhbCwgSGVsdmV0aWNhLCBzYW5zLXNlcmlmOyBmb250LXZhcmlhbnQtbGlnYXR1cmVzOiBub3Jt YWw7IG9ycGhhbnM6IDI7IHdpZD0Kb3dzOiAyOyBiYWNrZ3JvdW5kLWNvbG9yOiByZ2IoMjU1LCAy NTUsIDI1NSk7Ij48ZGl2PgoKPHNwYW4gc3R5bGU9M0QiZm9udC12YXJpYW50LWxpZ2F0dXJlczog bm9ybWFsOyI+c2VydmljZSBvdmlydC13ZWJzb2NrZXQtcHJvPQp4eSByZXN0YXJ0PC9zcGFuPjwv ZGl2PjxkaXY+PHNwYW4gc3R5bGU9M0QiZm9udC12YXJpYW50LWxpZ2F0dXJlczogbm9ybWFsOyI9 Cj48ZGl2PgoKPHNwYW4gc3R5bGU9M0QiZm9udC12YXJpYW50LWxpZ2F0dXJlczogbm9ybWFsOyI+ c2VydmljZSBodHRwZCByZXN0YXJ0PC9zcGFuPQo+PC9kaXY+PC9zcGFuPjwvZGl2Pjwvc3Bhbj48 L2Rpdj48ZGl2PjxiciAvPjwvZGl2PjxkaXY+SSBzYXcgc29tZSByZWZlcmVuY2UgPQp0byBoYXZp bmcgdG8gcmVtb3ZlIGhvc3RzIGZyb20gdGhlIGRhdGFiYXNlIGJ5IGhhbmQgaW4gc2l0dWF0aW9u cyB3aGVyZSB1bj0KZGVyIHRoZSBob29kIG9mIE92aXJ0IGEgZGVjb21taXNzaW9uIGhvc3Qgd2Fz IHN0aWxsIGxpc3RlZCwgYnV0IHdhc24ndCBzaG93PQppbmcgaW4gdGhlIEdVSS49QzI9QTA8L2Rp dj48ZGl2PlNvIEkgcmVtb3ZlZCByZWZlcmVuY2UgdG8gaG9zdDAyICh2ZHNfaWQgYW49CmQgaG9z dF9pZCkgaW4gdGhlIGZvbGxvd2luZyB0YWJsZXMgaW4gdGhpcyBvcmRlci49QzI9QTA8L2Rpdj48 ZGl2PjxzcGFuIHN0eT0KbGU9M0QiZm9udC1zaXplOiAxMnB0OyI+dmRzX2R5bmFtaWM8L3NwYW4+ PC9kaXY+PGRpdj48ZGl2IGlkPTNEIngwZWMxMjg5OTg2PQo5OTRmYjVhYzMwOTgyN2VkZDMzYWJl Ij4KCjxkaXY+PGRpdj48c3BhbiBzdHlsZT0zRCJmb250LXNpemU6IDEycHQ7Ij52ZHNfc3RhdGlz dGljczwvc3Bhbj48L2Rpdj48ZGl2Pj0KPGRpdiBpZD0zRCJ4ODdkOTc4YzU2ODgwNDE1ZTk1OTRk N2ZlMzE3ZjMwZjMiPgoKPGRpdj48ZGl2PjxkaXYgaWQ9M0QieDBlYzEyODk5ODY5OTRmYjVhYzMw OTgyN2VkZDMzYWJlIj48ZGl2PjxkaXY+dmRzX3N0YXRpPQpjPC9kaXY+PGRpdj48L2Rpdj48L2Rp dj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48ZGl2PjwvZGl2PjwvZGl2PjwvZGk9CnY+ PC9kaXY+PGRpdj5ob3N0X2RldmljZTwvZGl2PjxkaXY+PGJyIC8+PC9kaXY+PGRpdj5Ob3cgd2hl biBJIHRyeSB0byBzdGFydCA9Cm92aXJ0LXdlYnNvY2tldCBpdCB3aWxsIG5vdCBzdGFydDwvZGl2 PjxkaXY+c2VydmljZSBvdmlydC13ZWJzb2NrZXQgc3RhcnQ8PQpiciAvPlJlZGlyZWN0aW5nIHRv IC9iaW4vc3lzdGVtY3RsIHN0YXJ0ID1DMj1BMG92aXJ0LXdlYnNvY2tldC5zZXJ2aWNlPGJyIC89 Cj5GYWlsZWQgdG8gc3RhcnQgb3ZpcnQtd2Vic29ja2V0LnNlcnZpY2U6IFVuaXQgbm90IGZvdW5k LjwvZGl2PjxkaXY+PGJyIC8+PD0KL2Rpdj48ZGl2PkknbSBub3cgdGhpbmtpbmcgdGhhdCBJIG5l ZWQgdG8gZG8gdGhlIGZvbGxvd2luZyBpbiB0aGUgZW5naW5lIFZNPQo8L2Rpdj48ZGl2PjxkaXY+ CjxwcmUgY2xhc3M9M0QiaGlnaGxpZ2h0IHBsYWludGV4dCI+PGNvZGU+Iz1DMj1BMGVuZ2luZS1j bGVhbnVwCiM9QzI9QTB5dW09QzI9QTByZW1vdmU9QzI9QTBvdmlydC1lbmdpbmUKIz1DMj1BMHl1 bT1DMj1BMGluc3RhbGw9QzI9QTBvdmlydC1lbmdpbmUKIz1DMj1BMGVuZ2luZS1zZXR1cD1DMj1B MDwvY29kZT48L3ByZT48L2Rpdj48L2Rpdj48ZGl2PkJ1dCB0byBydW4gZW5naW5lLWNsPQplYW51 cCBJIG5lZWQgdG8gcHV0IHRoZSBlbmdpbmUtdm0gaW50byBtYWludGVuYW5jZSBtb2RlIGFuZCBi ZWNhdXNlIG9mIHRoZT0KIC0tY2xlYW4tbWV0YWRhdGEgdGhhdCBJIHJhbiBlYXJsaWVyIG9uIGhv c3QwMSBJIGNhbm5vdCBkbyB0aGF0Lj1DMj1BMDwvZGl2Pj0KPGRpdj48YnIgLz48L2Rpdj48ZGl2 PldoYXQgaXMgdGhlIGJlc3QgY291cnNlIG9mIGFjdGlvbiBmcm9tIGhlcmU/PC9kaXY+PGRpPQp2 PjxiciAvPjwvZGl2PjxkaXYgaWQ9M0Qic2lnbmF0dXJlX29sZCI+PGRpdiBpZD0zRCJ4YmFmMzZk OTk3YjdmNDk3Ij4KCjxkaXYgY2xhc3M9M0QiV29yZFNlY3Rpb24xIj4KCjxkaXYgaWQ9M0QieGI3 MTIyNGY5MjAyMzQ5NzhhY2M3NGY0ZDIzMTQzMDY5Ij48ZGl2IGNsYXNzPTNEIldvcmRTZWN0aW9u MSI+PD0KcCBjbGFzcz0zRCJNc29Ob3JtYWwiPjxmb250IGZhY2U9M0QiVGFob21hIj48c3BhbiBz dHlsZT0zRCJmb250LXNpemU6IDE2cHg7PQoiPkNoZWVyczwvc3Bhbj48L2ZvbnQ+PC9wPjxwIGNs YXNzPTNEIk1zb05vcm1hbCI+PGJyIC8+PC9wPjxwIGNsYXNzPTNEIk1zb049Cm9ybWFsIj48Zm9u dCBmYWNlPTNEIlRhaG9tYSI+PHNwYW4gc3R5bGU9M0QiZm9udC1zaXplOiAxNnB4OyI+QW5kcmV3 PC9zcGFuPj0KPC9mb250PjwvcD48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj4KPC9ib2R5 PjwvaHRtbD4KLS0tLS0tLS09X01CRkZCMEVGNEQtMENDQi00M0I4LUI2QjYtOTYxRkYxNUM3NDAz LS0KCg== --===============1297766554726593898==-- From ykaul at redhat.com Fri Jun 16 20:54:49 2017 Content-Type: multipart/mixed; boundary="===============1368062474834700450==" MIME-Version: 1.0 From: Yaniv Kaul To: users at ovirt.org Subject: Re: [ovirt-users] hosted-engine VM and services not working Date: Fri, 16 Jun 2017 23:54:06 +0300 Message-ID: In-Reply-To: em7bf46ca3-de46-4119-a265-33bcb59b6684@hp650-1 --===============1368062474834700450== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On Fri, Jun 16, 2017 at 9:11 AM, Andrew Dent wro= te: > Hi > > Well I've got myself into a fine mess. > > host01 was setup with hosted-engine v4.1. This was successful. > Imported 3 VMs from a v3.6 OVirt AIO instance. (This OVirt 3.6 is still > running with more VMs on it) > Tried to add host02 to the new Ovirt 4.1 setup. This partially succeeded > but I couldn't add any storage domains to it. Cannot remember why. > In Ovirt engine UI I removed host02. > I reinstalled host02 with Centos7, tried to add it and Ovirt UI told me it > was already there (but it wasn't listed in the UI). > Renamed the reinstalled host02 to host03, changed the ipaddress, reconfig > the DNS server and added host03 into the Ovirt Engine UI. > All good, and I was able to import more VMs to it. > I was also able to shutdown a VM on host01 assign it to host03 and start > the VM. Cool, everything working. > The above was all last couple of weeks. > > This week I performed some yum updates on the Engine VM. No reboot. > Today noticed that the Ovirt services in the Engine VM were in a endless > restart loop. They would be up for a 5 minutes and then die. > Looking into /var/log/ovirt-engine/engine.log and I could only see errors > relating to host02. Ovirt was trying to find it and failing. Then falling > over. > I ran "hosted-engine --clean-metadata" thinking it would cleanup and > remove bad references to hosts, but now realise that was a really bad idea > as it didn't do what I'd hoped. > At this point the sequence below worked, I could login to Ovirt UI but > after 5 minutes the services would be off > service ovirt-engine restart > service ovirt-websocket-proxy restart > service httpd restart > > I saw some reference to having to remove hosts from the database by hand > in situations where under the hood of Ovirt a decommission host was still > listed, but wasn't showing in the GUI. > So I removed reference to host02 (vds_id and host_id) in the following > tables in this order. > vds_dynamic > vds_statistics > vds_static > host_device > > Now when I try to start ovirt-websocket it will not start > service ovirt-websocket start > Redirecting to /bin/systemctl start ovirt-websocket.service > Failed to start ovirt-websocket.service: Unit not found. > > I'm now thinking that I need to do the following in the engine VM > > # engine-cleanup > # yum remove ovirt-engine > # yum install ovirt-engine > # engine-setup > > But to run engine-cleanup I need to put the engine-vm into maintenance > mode and because of the --clean-metadata that I ran earlier on host01 I > cannot do that. > > What is the best course of action from here? > To be honest, with all the steps taken above, I'd install everything (including OS) from scratch... There's a bit too much mess to try to clean up properly here. Y. > > Cheers > > > Andrew > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > --===============1368062474834700450== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGJyPjxkaXYgY2xhc3M9ImdtYWlsX2V4dHJhIj48YnI+PGRpdiBjbGFz cz0iZ21haWxfcXVvdGUiPk9uIEZyaSwgSnVuIDE2LCAyMDE3IGF0IDk6MTEgQU0sIEFuZHJldyBE ZW50IDxzcGFuIGRpcj0ibHRyIj4mbHQ7PGEgaHJlZj0ibWFpbHRvOmFkZW50QGN0Y3JveWRvbi5j b20uYXUiIHRhcmdldD0iX2JsYW5rIj5hZGVudEBjdGNyb3lkb24uY29tLmF1PC9hPiZndDs8L3Nw YW4+IHdyb3RlOjxicj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0eWxlPSJtYXJn aW46MCAwIDAgLjhleDtib3JkZXItbGVmdDoxcHggI2NjYyBzb2xpZDtwYWRkaW5nLWxlZnQ6MWV4 Ij48dT48L3U+CgoKCgo8ZGl2PjxkaXY+SGk8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PldlbGwg SSYjMzk7dmUgZ290IG15c2VsZiBpbnRvIGEgZmluZSBtZXNzLsKgPC9kaXY+PGRpdj48YnI+PC9k aXY+PGRpdj5ob3N0MDEgd2FzIHNldHVwIHdpdGggaG9zdGVkLWVuZ2luZSB2NC4xLsKgPHNwYW4g c3R5bGU9ImZvbnQtc2l6ZToxMnB0Ij5UaGlzIHdhcyBzdWNjZXNzZnVsLsKgPC9zcGFuPjwvZGl2 PjxkaXY+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMnB0Ij5JbXBvcnRlZCAzIFZNcyBmcm9tIGEg djMuNiBPVmlydCBBSU8gaW5zdGFuY2UuIChUaGlzIE9WaXJ0IDMuNiBpcyBzdGlsbCBydW5uaW5n IHdpdGggbW9yZSBWTXMgb24gaXQpPC9zcGFuPjwvZGl2PjxkaXY+VHJpZWQgdG8gYWRkIGhvc3Qw MiB0byB0aGUgbmV3IE92aXJ0IDQuMSBzZXR1cC4gVGhpcyBwYXJ0aWFsbHkgc3VjY2VlZGVkIGJ1 dCBJIGNvdWxkbiYjMzk7dCBhZGQgYW55IHN0b3JhZ2UgZG9tYWlucyB0byBpdC4gQ2Fubm90IHJl bWVtYmVyIHdoeS7CoDwvZGl2PjxkaXY+SW4gT3ZpcnQgZW5naW5lIFVJIEkgcmVtb3ZlZCBob3N0 MDIuwqA8L2Rpdj48ZGl2PkkgcmVpbnN0YWxsZWQgaG9zdDAyIHdpdGggQ2VudG9zNywgdHJpZWQg dG8gYWRkIGl0IGFuZCBPdmlydCBVSSB0b2xkIG1lIGl0IHdhcyBhbHJlYWR5IHRoZXJlIChidXQg aXQgd2FzbiYjMzk7dCBsaXN0ZWQgaW4gdGhlIFVJKS7CoDwvZGl2PjxkaXY+UmVuYW1lZCB0aGUg cmVpbnN0YWxsZWQgaG9zdDAyIHRvIGhvc3QwMywgY2hhbmdlZCB0aGUgaXBhZGRyZXNzLCByZWNv bmZpZyB0aGUgRE5TIHNlcnZlciBhbmQgYWRkZWQgaG9zdDAzIGludG8gdGhlIE92aXJ0IEVuZ2lu ZSBVSS7CoDwvZGl2PjxkaXY+QWxsIGdvb2QsIGFuZCBJIHdhcyBhYmxlIHRvIGltcG9ydCBtb3Jl IFZNcyB0byBpdC7CoDwvZGl2PjxkaXY+SSB3YXMgYWxzbyBhYmxlIHRvIHNodXRkb3duIGEgVk0g b24gaG9zdDAxIGFzc2lnbiBpdCB0byBob3N0MDMgYW5kIHN0YXJ0IHRoZSBWTS4gQ29vbCwgZXZl cnl0aGluZyB3b3JraW5nLsKgPC9kaXY+PGRpdj5UaGUgYWJvdmUgd2FzIGFsbCBsYXN0IGNvdXBs ZSBvZiB3ZWVrcy7CoDwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+VGhpcyB3ZWVrIEkgcGVyZm9y bWVkIHNvbWUgeXVtIHVwZGF0ZXMgb24gdGhlIEVuZ2luZSBWTS4gTm8gcmVib290LsKgPC9kaXY+ PGRpdj5Ub2RheSBub3RpY2VkIHRoYXQgdGhlIE92aXJ0IHNlcnZpY2VzIGluIHRoZSBFbmdpbmUg Vk0gd2VyZSBpbiBhIGVuZGxlc3MgcmVzdGFydCBsb29wLiBUaGV5IHdvdWxkIGJlIHVwIGZvciBh IDUgbWludXRlcyBhbmQgdGhlbiBkaWUuwqA8L2Rpdj48ZGl2Pkxvb2tpbmcgaW50b8KgL3Zhci9s b2cvb3ZpcnQtZW5naW5lLzx3YnI+ZW5naW5lLmxvZyBhbmQgSSBjb3VsZCBvbmx5IHNlZSBlcnJv cnMgcmVsYXRpbmcgdG8gaG9zdDAyLiBPdmlydCB3YXMgdHJ5aW5nIHRvIGZpbmQgaXQgYW5kIGZh aWxpbmcuIFRoZW4gZmFsbGluZyBvdmVyLsKgPC9kaXY+PGRpdj5JIHJhbiAmcXVvdDtob3N0ZWQt ZW5naW5lIC0tY2xlYW4tbWV0YWRhdGEmcXVvdDsgdGhpbmtpbmcgaXQgd291bGQgY2xlYW51cCBh bmQgcmVtb3ZlIGJhZCByZWZlcmVuY2VzIHRvIGhvc3RzLCBidXQgbm93IHJlYWxpc2UgdGhhdCB3 YXMgYSByZWFsbHkgYmFkIGlkZWEgYXMgaXQgZGlkbiYjMzk7dCBkbyB3aGF0IEkmIzM5O2QgaG9w ZWQuwqA8L2Rpdj48ZGl2PkF0IHRoaXMgcG9pbnQgdGhlIHNlcXVlbmNlIGJlbG93IHdvcmtlZCwg SSBjb3VsZCBsb2dpbiB0byBPdmlydCBVSSBidXQgYWZ0ZXIgNSBtaW51dGVzIHRoZSBzZXJ2aWNl cyB3b3VsZCBiZSBvZmY8L2Rpdj48ZGl2PjxkaXY+Cgo8c3BhbiBzdHlsZT0iY29sb3I6cmdiKDM0 LDM0LDM0KTtmb250LWZhbWlseTpWZXJkYW5hLEFyaWFsLEhlbHZldGljYSxzYW5zLXNlcmlmO2Zv bnQtdmFyaWFudC1saWdhdHVyZXM6bm9ybWFsO2JhY2tncm91bmQtY29sb3I6cmdiKDI1NSwyNTUs MjU1KSI+c2VydmljZSBvdmlydC1lbmdpbmUgcmVzdGFydDwvc3Bhbj48L2Rpdj48L2Rpdj48ZGl2 PjxzcGFuIHN0eWxlPSJjb2xvcjpyZ2IoMzQsMzQsMzQpO2ZvbnQtZmFtaWx5OlZlcmRhbmEsQXJp YWwsSGVsdmV0aWNhLHNhbnMtc2VyaWY7Zm9udC12YXJpYW50LWxpZ2F0dXJlczpub3JtYWw7YmFj a2dyb3VuZC1jb2xvcjpyZ2IoMjU1LDI1NSwyNTUpIj48ZGl2PgoKPHNwYW4gc3R5bGU9ImZvbnQt dmFyaWFudC1saWdhdHVyZXM6bm9ybWFsIj5zZXJ2aWNlIG92aXJ0LXdlYnNvY2tldC1wcm94eSBy ZXN0YXJ0PC9zcGFuPjwvZGl2PjxkaXY+PHNwYW4gc3R5bGU9ImZvbnQtdmFyaWFudC1saWdhdHVy ZXM6bm9ybWFsIj48ZGl2PgoKPHNwYW4gc3R5bGU9ImZvbnQtdmFyaWFudC1saWdhdHVyZXM6bm9y bWFsIj5zZXJ2aWNlIGh0dHBkIHJlc3RhcnQ8L3NwYW4+PC9kaXY+PC9zcGFuPjwvZGl2Pjwvc3Bh bj48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2Pkkgc2F3IHNvbWUgcmVmZXJlbmNlIHRvIGhhdmlu ZyB0byByZW1vdmUgaG9zdHMgZnJvbSB0aGUgZGF0YWJhc2UgYnkgaGFuZCBpbiBzaXR1YXRpb25z IHdoZXJlIHVuZGVyIHRoZSBob29kIG9mIE92aXJ0IGEgZGVjb21taXNzaW9uIGhvc3Qgd2FzIHN0 aWxsIGxpc3RlZCwgYnV0IHdhc24mIzM5O3Qgc2hvd2luZyBpbiB0aGUgR1VJLsKgPC9kaXY+PGRp dj5TbyBJIHJlbW92ZWQgcmVmZXJlbmNlIHRvIGhvc3QwMiAodmRzX2lkIGFuZCBob3N0X2lkKSBp biB0aGUgZm9sbG93aW5nIHRhYmxlcyBpbiB0aGlzIG9yZGVyLsKgPC9kaXY+PGRpdj48c3BhbiBz dHlsZT0iZm9udC1zaXplOjEycHQiPnZkc19keW5hbWljPC9zcGFuPjwvZGl2PjxkaXY+PGRpdiBp ZD0ibV8tMjAwMjgxMjIyMTQ3MDI2MTkyM3gwZWMxMjg5OTg2OTk0ZmI1YWMzMDk4MjdlZGQzM2Fi ZSI+Cgo8ZGl2PjxkaXY+PHNwYW4gc3R5bGU9ImZvbnQtc2l6ZToxMnB0Ij52ZHNfc3RhdGlzdGlj czwvc3Bhbj48L2Rpdj48ZGl2PjxkaXYgaWQ9Im1fLTIwMDI4MTIyMjE0NzAyNjE5MjN4ODdkOTc4 YzU2ODgwNDE1ZTk1OTRkN2ZlMzE3ZjMwZjMiPgoKPGRpdj48ZGl2PjxkaXYgaWQ9Im1fLTIwMDI4 MTIyMjE0NzAyNjE5MjN4MGVjMTI4OTk4Njk5NGZiNWFjMzA5ODI3ZWRkMzNhYmUiPjxkaXY+PGRp dj52ZHNfc3RhdGljPC9kaXY+PGRpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rp dj48L2Rpdj48ZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjwvZGl2PjxkaXY+aG9zdF9kZXZpY2U8L2Rp dj48ZGl2Pjxicj48L2Rpdj48ZGl2Pk5vdyB3aGVuIEkgdHJ5IHRvIHN0YXJ0IG92aXJ0LXdlYnNv Y2tldCBpdCB3aWxsIG5vdCBzdGFydDwvZGl2PjxkaXY+c2VydmljZSBvdmlydC13ZWJzb2NrZXQg c3RhcnQ8YnI+UmVkaXJlY3RpbmcgdG8gL2Jpbi9zeXN0ZW1jdGwgc3RhcnQgwqBvdmlydC13ZWJz b2NrZXQuc2VydmljZTxicj5GYWlsZWQgdG8gc3RhcnQgb3ZpcnQtd2Vic29ja2V0LnNlcnZpY2U6 IFVuaXQgbm90IGZvdW5kLjwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+SSYjMzk7bSBub3cgdGhp bmtpbmcgdGhhdCBJIG5lZWQgdG8gZG8gdGhlIGZvbGxvd2luZyBpbiB0aGUgZW5naW5lIFZNPC9k aXY+PGRpdj48ZGl2Pgo8cHJlIGNsYXNzPSJtXy0yMDAyODEyMjIxNDcwMjYxOTIzaGlnaGxpZ2h0 IG1fLTIwMDI4MTIyMjE0NzAyNjE5MjNwbGFpbnRleHQiPjxjb2RlPiPCoGVuZ2luZS1jbGVhbnVw CiPCoHl1bcKgcmVtb3ZlwqBvdmlydC1lbmdpbmUKI8KgeXVtwqBpbnN0YWxswqBvdmlydC1lbmdp bmUKI8KgZW5naW5lLXNldHVwwqA8L2NvZGU+PC9wcmU+PC9kaXY+PC9kaXY+PGRpdj5CdXQgdG8g cnVuIGVuZ2luZS1jbGVhbnVwIEkgbmVlZCB0byBwdXQgdGhlIGVuZ2luZS12bSBpbnRvIG1haW50 ZW5hbmNlIG1vZGUgYW5kIGJlY2F1c2Ugb2YgdGhlIC0tY2xlYW4tbWV0YWRhdGEgdGhhdCBJIHJh biBlYXJsaWVyIG9uIGhvc3QwMSBJIGNhbm5vdCBkbyB0aGF0LsKgPC9kaXY+PGRpdj48YnI+PC9k aXY+PGRpdj5XaGF0IGlzIHRoZSBiZXN0IGNvdXJzZSBvZiBhY3Rpb24gZnJvbSBoZXJlPzwvZGl2 PjwvZGl2PjwvYmxvY2txdW90ZT48ZGl2Pjxicj48L2Rpdj48ZGl2PlRvIGJlIGhvbmVzdCwgd2l0 aCBhbGwgdGhlIHN0ZXBzIHRha2VuIGFib3ZlLCBJJiMzOTtkIGluc3RhbGwgZXZlcnl0aGluZyAo aW5jbHVkaW5nIE9TKSBmcm9tIHNjcmF0Y2guLi48L2Rpdj48ZGl2PlRoZXJlJiMzOTtzIGEgYml0 IHRvbyBtdWNoIG1lc3MgdG8gdHJ5IHRvIGNsZWFuIHVwIHByb3Blcmx5IGhlcmUuPC9kaXY+PGRp dj5ZLjwvZGl2PjxkaXY+wqA8L2Rpdj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0 eWxlPSJtYXJnaW46MCAwIDAgLjhleDtib3JkZXItbGVmdDoxcHggI2NjYyBzb2xpZDtwYWRkaW5n LWxlZnQ6MWV4Ij48ZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXYgaWQ9Im1fLTIwMDI4MTIyMjE0NzAy NjE5MjNzaWduYXR1cmVfb2xkIj48ZGl2IGlkPSJtXy0yMDAyODEyMjIxNDcwMjYxOTIzeGJhZjM2 ZDk5N2I3ZjQ5NyI+Cgo8ZGl2IGNsYXNzPSJtXy0yMDAyODEyMjIxNDcwMjYxOTIzV29yZFNlY3Rp b24xIj4KCjxkaXYgaWQ9Im1fLTIwMDI4MTIyMjE0NzAyNjE5MjN4YjcxMjI0ZjkyMDIzNDk3OGFj Yzc0ZjRkMjMxNDMwNjkiPjxkaXYgY2xhc3M9Im1fLTIwMDI4MTIyMjE0NzAyNjE5MjNXb3JkU2Vj dGlvbjEiPjxwIGNsYXNzPSJNc29Ob3JtYWwiPjxmb250IGZhY2U9IlRhaG9tYSI+PHNwYW4gc3R5 bGU9ImZvbnQtc2l6ZToxNnB4Ij5DaGVlcnM8L3NwYW4+PC9mb250PjwvcD48c3BhbiBjbGFzcz0i SE9FblpiIj48Zm9udCBjb2xvcj0iIzg4ODg4OCI+PHAgY2xhc3M9Ik1zb05vcm1hbCI+PGJyPjwv cD48cCBjbGFzcz0iTXNvTm9ybWFsIj48Zm9udCBmYWNlPSJUYWhvbWEiPjxzcGFuIHN0eWxlPSJm b250LXNpemU6MTZweCI+QW5kcmV3PC9zcGFuPjwvZm9udD48L3A+PC9mb250Pjwvc3Bhbj48L2Rp dj48L2Rpdj48L2Rpdj48L2Rpdj48L2Rpdj4KPC9kaXY+PGJyPl9fX19fX19fX19fX19fX19fX19f X19fX19fX19fXzx3YnI+X19fX19fX19fX19fX19fX188YnI+ClVzZXJzIG1haWxpbmcgbGlzdDxi cj4KPGEgaHJlZj0ibWFpbHRvOlVzZXJzQG92aXJ0Lm9yZyI+VXNlcnNAb3ZpcnQub3JnPC9hPjxi cj4KPGEgaHJlZj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJz IiByZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5odHRwOi8vbGlzdHMub3ZpcnQub3Jn Lzx3YnI+bWFpbG1hbi9saXN0aW5mby91c2VyczwvYT48YnI+Cjxicj48L2Jsb2NrcXVvdGU+PC9k aXY+PGJyPjwvZGl2PjwvZGl2Pgo= --===============1368062474834700450==--