From wee.s at forest.go.th Mon May 2 23:05:54 2016 Content-Type: multipart/mixed; boundary="===============6580364383911028960==" MIME-Version: 1.0 From: Wee Sritippho To: users at ovirt.org Subject: [ovirt-users] Additional hosted-engine host deployment failed due to message timeout Date: Tue, 03 May 2016 10:05:48 +0700 Message-ID: <5728158C.4070305@forest.go.th> --===============6580364383911028960== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------080805070702090104010500 Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed Content-Transfer-Encoding: 7bit Hi, I'm making a fresh hosted-engine installation on 3 hosts. First 2 hosts = succeeded, but the 3rd one stuck at termination state "Installing Host = hosted_engine_3. Stage: Termination.", then, 3 minutes later, "VDSM = hosted_engine_3 command failed: Message timeout which can be caused by = communication issues". Currently, the 3rd host status in web UI is stuck = at "Installing". How can I proceed? Could I just run this script = = in the 3rd host, and run "hosted-engine --deploy" again? log files: https://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6 [me(a)host03 ~]$ rpm -qa | grep ovirt ovirt-release36-007-1.noarch ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch libgovirt-0.3.3-1.el7_2.1.x86_64 ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch ovirt-setup-lib-1.0.1-1.el7.centos.noarch ovirt-vmconsole-1.0.0-1.el7.centos.noarch ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch ovirt-host-deploy-1.4.1-1.el7.centos.noarch ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch [me(a)host03 ~]$ rpm -qa | grep vdsm vdsm-hook-vmfex-dev-4.17.26-1.el7.noarch vdsm-xmlrpc-4.17.26-1.el7.noarch vdsm-infra-4.17.26-1.el7.noarch vdsm-yajsonrpc-4.17.26-1.el7.noarch vdsm-python-4.17.26-1.el7.noarch vdsm-4.17.26-1.el7.noarch vdsm-cli-4.17.26-1.el7.noarch vdsm-jsonrpc-4.17.26-1.el7.noarch [root(a)engine ~]# rpm -qa | grep ovirt ovirt-engine-wildfly-8.2.1-1.el7.x86_64 ovirt-engine-setup-plugin-ovirt-engine-common-3.6.5.3-1.el7.centos.noarch ovirt-vmconsole-1.0.0-1.el7.centos.noarch ovirt-engine-cli-3.6.2.0-1.el7.centos.noarch ovirt-engine-setup-plugin-ovirt-engine-3.6.5.3-1.el7.centos.noarch ovirt-engine-backend-3.6.5.3-1.el7.centos.noarch ovirt-iso-uploader-3.6.0-1.el7.centos.noarch ovirt-engine-extensions-api-impl-3.6.5.3-1.el7.centos.noarch ovirt-host-deploy-1.4.1-1.el7.centos.noarch ovirt-release36-007-1.noarch ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch ovirt-image-uploader-3.6.0-1.el7.centos.noarch ovirt-engine-extension-aaa-jdbc-1.0.6-1.el7.noarch ovirt-setup-lib-1.0.1-1.el7.centos.noarch ovirt-host-deploy-java-1.4.1-1.el7.centos.noarch ovirt-engine-setup-base-3.6.5.3-1.el7.centos.noarch ovirt-engine-setup-plugin-websocket-proxy-3.6.5.3-1.el7.centos.noarch ovirt-engine-tools-backup-3.6.5.3-1.el7.centos.noarch ovirt-vmconsole-proxy-1.0.0-1.el7.centos.noarch ovirt-engine-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch ovirt-engine-setup-3.6.5.3-1.el7.centos.noarch ovirt-engine-webadmin-portal-3.6.5.3-1.el7.centos.noarch ovirt-engine-tools-3.6.5.3-1.el7.centos.noarch ovirt-engine-restapi-3.6.5.3-1.el7.centos.noarch ovirt-engine-3.6.5.3-1.el7.centos.noarch ovirt-engine-wildfly-overlay-8.0.5-1.el7.noarch ovirt-engine-lib-3.6.5.3-1.el7.centos.noarch ovirt-engine-websocket-proxy-3.6.5.3-1.el7.centos.noarch ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch ovirt-engine-userportal-3.6.5.3-1.el7.centos.noarch ovirt-engine-dbscripts-3.6.5.3-1.el7.centos.noarch Thanks, -- = Wee --------------080805070702090104010500 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 7bit Hi,

I'm making a fresh hosted-engine installation on 3 hosts. First 2 hosts succeeded, but the 3rd one stuck at termination state "Installing Host hosted_engine_3. Stage: Termination.", then, 3 minutes later, "VDSM hosted_engine_3 command failed: Message timeout which can be caused by communication issues". Currently, the 3rd host status in web UI is stuck at "Installing".

How can I proceed? Could I just run this script in the 3rd host, and run "hosted-engine --deploy" again?

log files: https://app.box.com/s/a5typfe6cbozs9= uo9osg68gtmq8793t6

[me(a)host03 ~]$ rpm -qa | grep ovirt
ovirt-release36-007-1.noarch
ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch
libgovirt-0.3.3-1.el7_2.1.x86_64
ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch
ovirt-setup-lib-1.0.1-1.el7.centos.noarch
ovirt-vmconsole-1.0.0-1.el7.centos.noarch
ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch
ovirt-host-deploy-1.4.1-1.el7.centos.noarch
ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch

[me(a)host03 ~]$ rpm -qa | grep vdsm
vdsm-hook-vmfex-dev-4.17.26-1.el7.noarch
vdsm-xmlrpc-4.17.26-1.el7.noarch
vdsm-infra-4.17.26-1.el7.noarch
vdsm-yajsonrpc-4.17.26-1.el7.noarch
vdsm-python-4.17.26-1.el7.noarch
vdsm-4.17.26-1.el7.noarch
vdsm-cli-4.17.26-1.el7.noarch
vdsm-jsonrpc-4.17.26-1.el7.noarch

[root(a)engine ~]# rpm -qa | grep ovirt
ovirt-engine-wildfly-8.2.1-1.el7.x86_64
ovirt-engine-setup-plugin-ovirt-engine-common-3.6.5.3-1.el7.centos.noarch ovirt-vmconsole-1.0.0-1.el7.centos.noarch
ovirt-engine-cli-3.6.2.0-1.el7.centos.noarch
ovirt-engine-setup-plugin-ovirt-engine-3.6.5.3-1.el7.centos.noarch
ovirt-engine-backend-3.6.5.3-1.el7.centos.noarch
ovirt-iso-uploader-3.6.0-1.el7.centos.noarch
ovirt-engine-extensions-api-impl-3.6.5.3-1.el7.centos.noarch
ovirt-host-deploy-1.4.1-1.el7.centos.noarch
ovirt-release36-007-1.noarch
ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch
ovirt-image-uploader-3.6.0-1.el7.centos.noarch
ovirt-engine-extension-aaa-jdbc-1.0.6-1.el7.noarch
ovirt-setup-lib-1.0.1-1.el7.centos.noarch
ovirt-host-deploy-java-1.4.1-1.el7.centos.noarch
ovirt-engine-setup-base-3.6.5.3-1.el7.centos.noarch
ovirt-engine-setup-plugin-websocket-proxy-3.6.5.3-1.el7.centos.noarch
ovirt-engine-tools-backup-3.6.5.3-1.el7.centos.noarch
ovirt-vmconsole-proxy-1.0.0-1.el7.centos.noarch
ovirt-engine-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch
ovirt-engine-setup-3.6.5.3-1.el7.centos.noarch
ovirt-engine-webadmin-portal-3.6.5.3-1.el7.centos.noarch
ovirt-engine-tools-3.6.5.3-1.el7.centos.noarch
ovirt-engine-restapi-3.6.5.3-1.el7.centos.noarch
ovirt-engine-3.6.5.3-1.el7.centos.noarch
ovirt-engine-wildfly-overlay-8.0.5-1.el7.noarch
ovirt-engine-lib-3.6.5.3-1.el7.centos.noarch
ovirt-engine-websocket-proxy-3.6.5.3-1.el7.centos.noarch
ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarc= h
ovirt-engine-userportal-3.6.5.3-1.el7.centos.noarch
ovirt-engine-dbscripts-3.6.5.3-1.el7.centos.noarch

Thanks,
-- =

Wee
--------------080805070702090104010500-- --===============6580364383911028960== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS0wODA4MDUwNzA3MDIwOTAxMDQwMTA1MDAKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXV0Zi04OyBmb3JtYXQ9Zmxvd2VkCkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDdiaXQK CkhpLAoKSSdtIG1ha2luZyBhIGZyZXNoIGhvc3RlZC1lbmdpbmUgaW5zdGFsbGF0aW9uIG9uIDMg aG9zdHMuIEZpcnN0IDIgaG9zdHMgCnN1Y2NlZWRlZCwgYnV0IHRoZSAzcmQgb25lIHN0dWNrIGF0 IHRlcm1pbmF0aW9uIHN0YXRlICJJbnN0YWxsaW5nIEhvc3QgCmhvc3RlZF9lbmdpbmVfMy4gU3Rh Z2U6IFRlcm1pbmF0aW9uLiIsIHRoZW4sIDMgbWludXRlcyBsYXRlciwgIlZEU00gCmhvc3RlZF9l bmdpbmVfMyBjb21tYW5kIGZhaWxlZDogTWVzc2FnZSB0aW1lb3V0IHdoaWNoIGNhbiBiZSBjYXVz ZWQgYnkgCmNvbW11bmljYXRpb24gaXNzdWVzIi4gQ3VycmVudGx5LCB0aGUgM3JkIGhvc3Qgc3Rh dHVzIGluIHdlYiBVSSBpcyBzdHVjayAKYXQgIkluc3RhbGxpbmciLgoKSG93IGNhbiBJIHByb2Nl ZWQ/IENvdWxkIEkganVzdCBydW4gdGhpcyBzY3JpcHQgCjxodHRwczovL3d3dy5vdmlydC5vcmcv ZG9jdW1lbnRhdGlvbi9ob3ctdG8vaG9zdGVkLWVuZ2luZS8jcmVjb3ZpbmctZnJvbS1mYWlsZWQt aW5zdGFsbD4gCmluIHRoZSAzcmQgaG9zdCwgYW5kIHJ1biAiaG9zdGVkLWVuZ2luZSAtLWRlcGxv eSIgYWdhaW4/Cgpsb2cgZmlsZXM6IGh0dHBzOi8vYXBwLmJveC5jb20vcy9hNXR5cGZlNmNib3pz OXVvOW9zZzY4Z3RtcTg3OTN0NgoKW21lQGhvc3QwMyB+XSQgcnBtIC1xYSB8IGdyZXAgb3ZpcnQK b3ZpcnQtcmVsZWFzZTM2LTAwNy0xLm5vYXJjaApvdmlydC1ob3N0ZWQtZW5naW5lLXNldHVwLTEu My41LjAtMS4xLmVsNy5ub2FyY2gKbGliZ292aXJ0LTAuMy4zLTEuZWw3XzIuMS54ODZfNjQKb3Zp cnQtZW5naW5lLXNkay1weXRob24tMy42LjUuMC0xLmVsNy5jZW50b3Mubm9hcmNoCm92aXJ0LXNl dHVwLWxpYi0xLjAuMS0xLmVsNy5jZW50b3Mubm9hcmNoCm92aXJ0LXZtY29uc29sZS0xLjAuMC0x LmVsNy5jZW50b3Mubm9hcmNoCm92aXJ0LXZtY29uc29sZS1ob3N0LTEuMC4wLTEuZWw3LmNlbnRv cy5ub2FyY2gKb3ZpcnQtaG9zdC1kZXBsb3ktMS40LjEtMS5lbDcuY2VudG9zLm5vYXJjaApvdmly dC1ob3N0ZWQtZW5naW5lLWhhLTEuMy41LjMtMS4xLmVsNy5ub2FyY2gKClttZUBob3N0MDMgfl0k IHJwbSAtcWEgfCBncmVwIHZkc20KdmRzbS1ob29rLXZtZmV4LWRldi00LjE3LjI2LTEuZWw3Lm5v YXJjaAp2ZHNtLXhtbHJwYy00LjE3LjI2LTEuZWw3Lm5vYXJjaAp2ZHNtLWluZnJhLTQuMTcuMjYt MS5lbDcubm9hcmNoCnZkc20teWFqc29ucnBjLTQuMTcuMjYtMS5lbDcubm9hcmNoCnZkc20tcHl0 aG9uLTQuMTcuMjYtMS5lbDcubm9hcmNoCnZkc20tNC4xNy4yNi0xLmVsNy5ub2FyY2gKdmRzbS1j bGktNC4xNy4yNi0xLmVsNy5ub2FyY2gKdmRzbS1qc29ucnBjLTQuMTcuMjYtMS5lbDcubm9hcmNo Cgpbcm9vdEBlbmdpbmUgfl0jIHJwbSAtcWEgfCBncmVwIG92aXJ0Cm92aXJ0LWVuZ2luZS13aWxk Zmx5LTguMi4xLTEuZWw3Lng4Nl82NApvdmlydC1lbmdpbmUtc2V0dXAtcGx1Z2luLW92aXJ0LWVu Z2luZS1jb21tb24tMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCm92aXJ0LXZtY29uc29sZS0x LjAuMC0xLmVsNy5jZW50b3Mubm9hcmNoCm92aXJ0LWVuZ2luZS1jbGktMy42LjIuMC0xLmVsNy5j ZW50b3Mubm9hcmNoCm92aXJ0LWVuZ2luZS1zZXR1cC1wbHVnaW4tb3ZpcnQtZW5naW5lLTMuNi41 LjMtMS5lbDcuY2VudG9zLm5vYXJjaApvdmlydC1lbmdpbmUtYmFja2VuZC0zLjYuNS4zLTEuZWw3 LmNlbnRvcy5ub2FyY2gKb3ZpcnQtaXNvLXVwbG9hZGVyLTMuNi4wLTEuZWw3LmNlbnRvcy5ub2Fy Y2gKb3ZpcnQtZW5naW5lLWV4dGVuc2lvbnMtYXBpLWltcGwtMy42LjUuMy0xLmVsNy5jZW50b3Mu bm9hcmNoCm92aXJ0LWhvc3QtZGVwbG95LTEuNC4xLTEuZWw3LmNlbnRvcy5ub2FyY2gKb3ZpcnQt cmVsZWFzZTM2LTAwNy0xLm5vYXJjaApvdmlydC1lbmdpbmUtc2RrLXB5dGhvbi0zLjYuNS4wLTEu ZWw3LmNlbnRvcy5ub2FyY2gKb3ZpcnQtaW1hZ2UtdXBsb2FkZXItMy42LjAtMS5lbDcuY2VudG9z Lm5vYXJjaApvdmlydC1lbmdpbmUtZXh0ZW5zaW9uLWFhYS1qZGJjLTEuMC42LTEuZWw3Lm5vYXJj aApvdmlydC1zZXR1cC1saWItMS4wLjEtMS5lbDcuY2VudG9zLm5vYXJjaApvdmlydC1ob3N0LWRl cGxveS1qYXZhLTEuNC4xLTEuZWw3LmNlbnRvcy5ub2FyY2gKb3ZpcnQtZW5naW5lLXNldHVwLWJh c2UtMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCm92aXJ0LWVuZ2luZS1zZXR1cC1wbHVnaW4t d2Vic29ja2V0LXByb3h5LTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaApvdmlydC1lbmdpbmUt dG9vbHMtYmFja3VwLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaApvdmlydC12bWNvbnNvbGUt cHJveHktMS4wLjAtMS5lbDcuY2VudG9zLm5vYXJjaApvdmlydC1lbmdpbmUtdm1jb25zb2xlLXBy b3h5LWhlbHBlci0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2gKb3ZpcnQtZW5naW5lLXNldHVw LTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaApvdmlydC1lbmdpbmUtd2ViYWRtaW4tcG9ydGFs LTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaApvdmlydC1lbmdpbmUtdG9vbHMtMy42LjUuMy0x LmVsNy5jZW50b3Mubm9hcmNoCm92aXJ0LWVuZ2luZS1yZXN0YXBpLTMuNi41LjMtMS5lbDcuY2Vu dG9zLm5vYXJjaApvdmlydC1lbmdpbmUtMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCm92aXJ0 LWVuZ2luZS13aWxkZmx5LW92ZXJsYXktOC4wLjUtMS5lbDcubm9hcmNoCm92aXJ0LWVuZ2luZS1s aWItMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCm92aXJ0LWVuZ2luZS13ZWJzb2NrZXQtcHJv eHktMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCm92aXJ0LWVuZ2luZS1zZXR1cC1wbHVnaW4t dm1jb25zb2xlLXByb3h5LWhlbHBlci0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2gKb3ZpcnQt ZW5naW5lLXVzZXJwb3J0YWwtMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCm92aXJ0LWVuZ2lu ZS1kYnNjcmlwdHMtMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCgpUaGFua3MsCgotLSAKV2Vl CgoKLS0tLS0tLS0tLS0tLS0wODA4MDUwNzA3MDIwOTAxMDQwMTA1MDAKQ29udGVudC1UeXBlOiB0 ZXh0L2h0bWw7IGNoYXJzZXQ9dXRmLTgKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogN2JpdAoK PGh0bWw+CiAgPGhlYWQ+CgogICAgPG1ldGEgaHR0cC1lcXVpdj0iY29udGVudC10eXBlIiBjb250 ZW50PSJ0ZXh0L2h0bWw7IGNoYXJzZXQ9dXRmLTgiPgogIDwvaGVhZD4KICA8Ym9keSBiZ2NvbG9y PSIjRkZGRkZGIiB0ZXh0PSIjMDAwMDAwIj4KICAgIEhpLDxicj4KICAgIDxicj4KICAgIEknbSBt YWtpbmcgYSBmcmVzaCBob3N0ZWQtZW5naW5lIGluc3RhbGxhdGlvbiBvbiAzIGhvc3RzLiBGaXJz dCAyCiAgICBob3N0cyBzdWNjZWVkZWQsIGJ1dCB0aGUgM3JkIG9uZSBzdHVjayBhdCB0ZXJtaW5h dGlvbiBzdGF0ZQogICAgIkluc3RhbGxpbmcgSG9zdCBob3N0ZWRfZW5naW5lXzMuIFN0YWdlOiBU ZXJtaW5hdGlvbi4iLCB0aGVuLCAzCiAgICBtaW51dGVzIGxhdGVyLCAiVkRTTSBob3N0ZWRfZW5n aW5lXzMgY29tbWFuZCBmYWlsZWQ6IE1lc3NhZ2UgdGltZW91dAogICAgd2hpY2ggY2FuIGJlIGNh dXNlZCBieSBjb21tdW5pY2F0aW9uIGlzc3VlcyIuIEN1cnJlbnRseSwgdGhlIDNyZAogICAgaG9z dCBzdGF0dXMgaW4gd2ViIFVJIGlzIHN0dWNrIGF0ICJJbnN0YWxsaW5nIi48YnI+CiAgICA8YnI+ CiAgICBIb3cgY2FuIEkgcHJvY2VlZD8gQ291bGQgSSBqdXN0IHJ1biA8YQpocmVmPSJodHRwczov L3d3dy5vdmlydC5vcmcvZG9jdW1lbnRhdGlvbi9ob3ctdG8vaG9zdGVkLWVuZ2luZS8jcmVjb3Zp bmctZnJvbS1mYWlsZWQtaW5zdGFsbCI+dGhpcwogICAgICBzY3JpcHQ8L2E+IGluIHRoZSAzcmQg aG9zdCwgYW5kIHJ1biAiaG9zdGVkLWVuZ2luZSAtLWRlcGxveSIKICAgIGFnYWluPzxicj4KICAg IDxicj4KICAgIGxvZyBmaWxlczogPGEgY2xhc3M9Im1vei10eHQtbGluay1mcmVldGV4dCIgaHJl Zj0iaHR0cHM6Ly9hcHAuYm94LmNvbS9zL2E1dHlwZmU2Y2JvenM5dW85b3NnNjhndG1xODc5M3Q2 Ij5odHRwczovL2FwcC5ib3guY29tL3MvYTV0eXBmZTZjYm96czl1bzlvc2c2OGd0bXE4NzkzdDY8 L2E+PGJyPgogICAgPGJyPgogICAgW21lQGhvc3QwMyB+XSQgcnBtIC1xYSB8IGdyZXAgb3ZpcnQ8 YnI+CiAgICBvdmlydC1yZWxlYXNlMzYtMDA3LTEubm9hcmNoPGJyPgogICAgb3ZpcnQtaG9zdGVk LWVuZ2luZS1zZXR1cC0xLjMuNS4wLTEuMS5lbDcubm9hcmNoPGJyPgogICAgbGliZ292aXJ0LTAu My4zLTEuZWw3XzIuMS54ODZfNjQ8YnI+CiAgICBvdmlydC1lbmdpbmUtc2RrLXB5dGhvbi0zLjYu NS4wLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICBvdmlydC1zZXR1cC1saWItMS4wLjEtMS5l bDcuY2VudG9zLm5vYXJjaDxicj4KICAgIG92aXJ0LXZtY29uc29sZS0xLjAuMC0xLmVsNy5jZW50 b3Mubm9hcmNoPGJyPgogICAgb3ZpcnQtdm1jb25zb2xlLWhvc3QtMS4wLjAtMS5lbDcuY2VudG9z Lm5vYXJjaDxicj4KICAgIG92aXJ0LWhvc3QtZGVwbG95LTEuNC4xLTEuZWw3LmNlbnRvcy5ub2Fy Y2g8YnI+CiAgICBvdmlydC1ob3N0ZWQtZW5naW5lLWhhLTEuMy41LjMtMS4xLmVsNy5ub2FyY2g8 YnI+CiAgICA8YnI+CiAgICBbbWVAaG9zdDAzIH5dJCBycG0gLXFhIHwgZ3JlcCB2ZHNtPGJyPgog ICAgdmRzbS1ob29rLXZtZmV4LWRldi00LjE3LjI2LTEuZWw3Lm5vYXJjaDxicj4KICAgIHZkc20t eG1scnBjLTQuMTcuMjYtMS5lbDcubm9hcmNoPGJyPgogICAgdmRzbS1pbmZyYS00LjE3LjI2LTEu ZWw3Lm5vYXJjaDxicj4KICAgIHZkc20teWFqc29ucnBjLTQuMTcuMjYtMS5lbDcubm9hcmNoPGJy PgogICAgdmRzbS1weXRob24tNC4xNy4yNi0xLmVsNy5ub2FyY2g8YnI+CiAgICB2ZHNtLTQuMTcu MjYtMS5lbDcubm9hcmNoPGJyPgogICAgdmRzbS1jbGktNC4xNy4yNi0xLmVsNy5ub2FyY2g8YnI+ CiAgICB2ZHNtLWpzb25ycGMtNC4xNy4yNi0xLmVsNy5ub2FyY2g8YnI+CiAgICA8YnI+CiAgICBb cm9vdEBlbmdpbmUgfl0jIHJwbSAtcWEgfCBncmVwIG92aXJ0PGJyPgogICAgb3ZpcnQtZW5naW5l LXdpbGRmbHktOC4yLjEtMS5lbDcueDg2XzY0PGJyPgpvdmlydC1lbmdpbmUtc2V0dXAtcGx1Z2lu LW92aXJ0LWVuZ2luZS1jb21tb24tMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoPGJyPgogICAg b3ZpcnQtdm1jb25zb2xlLTEuMC4wLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICBvdmlydC1l bmdpbmUtY2xpLTMuNi4yLjAtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgIG92aXJ0LWVuZ2lu ZS1zZXR1cC1wbHVnaW4tb3ZpcnQtZW5naW5lLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxi cj4KICAgIG92aXJ0LWVuZ2luZS1iYWNrZW5kLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxi cj4KICAgIG92aXJ0LWlzby11cGxvYWRlci0zLjYuMC0xLmVsNy5jZW50b3Mubm9hcmNoPGJyPgog ICAgb3ZpcnQtZW5naW5lLWV4dGVuc2lvbnMtYXBpLWltcGwtMy42LjUuMy0xLmVsNy5jZW50b3Mu bm9hcmNoPGJyPgogICAgb3ZpcnQtaG9zdC1kZXBsb3ktMS40LjEtMS5lbDcuY2VudG9zLm5vYXJj aDxicj4KICAgIG92aXJ0LXJlbGVhc2UzNi0wMDctMS5ub2FyY2g8YnI+CiAgICBvdmlydC1lbmdp bmUtc2RrLXB5dGhvbi0zLjYuNS4wLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICBvdmlydC1p bWFnZS11cGxvYWRlci0zLjYuMC0xLmVsNy5jZW50b3Mubm9hcmNoPGJyPgogICAgb3ZpcnQtZW5n aW5lLWV4dGVuc2lvbi1hYWEtamRiYy0xLjAuNi0xLmVsNy5ub2FyY2g8YnI+CiAgICBvdmlydC1z ZXR1cC1saWItMS4wLjEtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgIG92aXJ0LWhvc3QtZGVw bG95LWphdmEtMS40LjEtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgIG92aXJ0LWVuZ2luZS1z ZXR1cC1iYXNlLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4Kb3ZpcnQtZW5naW5lLXNl dHVwLXBsdWdpbi13ZWJzb2NrZXQtcHJveHktMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoPGJy PgogICAgb3ZpcnQtZW5naW5lLXRvb2xzLWJhY2t1cC0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2Fy Y2g8YnI+CiAgICBvdmlydC12bWNvbnNvbGUtcHJveHktMS4wLjAtMS5lbDcuY2VudG9zLm5vYXJj aDxicj4KICAgIG92aXJ0LWVuZ2luZS12bWNvbnNvbGUtcHJveHktaGVscGVyLTMuNi41LjMtMS5l bDcuY2VudG9zLm5vYXJjaDxicj4KICAgIG92aXJ0LWVuZ2luZS1zZXR1cC0zLjYuNS4zLTEuZWw3 LmNlbnRvcy5ub2FyY2g8YnI+CiAgICBvdmlydC1lbmdpbmUtd2ViYWRtaW4tcG9ydGFsLTMuNi41 LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgIG92aXJ0LWVuZ2luZS10b29scy0zLjYuNS4z LTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICBvdmlydC1lbmdpbmUtcmVzdGFwaS0zLjYuNS4z LTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICBvdmlydC1lbmdpbmUtMy42LjUuMy0xLmVsNy5j ZW50b3Mubm9hcmNoPGJyPgogICAgb3ZpcnQtZW5naW5lLXdpbGRmbHktb3ZlcmxheS04LjAuNS0x LmVsNy5ub2FyY2g8YnI+CiAgICBvdmlydC1lbmdpbmUtbGliLTMuNi41LjMtMS5lbDcuY2VudG9z Lm5vYXJjaDxicj4KICAgIG92aXJ0LWVuZ2luZS13ZWJzb2NrZXQtcHJveHktMy42LjUuMy0xLmVs Ny5jZW50b3Mubm9hcmNoPGJyPgpvdmlydC1lbmdpbmUtc2V0dXAtcGx1Z2luLXZtY29uc29sZS1w cm94eS1oZWxwZXItMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoPGJyPgogICAgb3ZpcnQtZW5n aW5lLXVzZXJwb3J0YWwtMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoPGJyPgogICAgb3ZpcnQt ZW5naW5lLWRic2NyaXB0cy0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICA8YnI+ CiAgICBUaGFua3MsPGJyPgogICAgPHByZSBjbGFzcz0ibW96LXNpZ25hdHVyZSIgY29scz0iNzIi Pi0tIApXZWU8L3ByZT4KICA8L2JvZHk+CjwvaHRtbD4KCi0tLS0tLS0tLS0tLS0tMDgwODA1MDcw NzAyMDkwMTA0MDEwNTAwLS0K --===============6580364383911028960==-- From knarra at redhat.com Tue May 3 02:25:20 2016 Content-Type: multipart/mixed; boundary="===============2771927814288885096==" MIME-Version: 1.0 From: knarra To: users at ovirt.org Subject: Re: [ovirt-users] Additional hosted-engine host deployment failed due to message timeout Date: Tue, 03 May 2016 11:55:17 +0530 Message-ID: <5728444D.7000705@redhat.com> In-Reply-To: 5728158C.4070305@forest.go.th --===============2771927814288885096== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------030304010602020000040400 Content-Type: text/plain; charset=3Dwindows-1252; format=3Dflowed Content-Transfer-Encoding: 7bit On 05/03/2016 08:35 AM, Wee Sritippho wrote: > Hi, > > I'm making a fresh hosted-engine installation on 3 hosts. First 2 = > hosts succeeded, but the 3rd one stuck at termination state = > "Installing Host hosted_engine_3. Stage: Termination.", then, 3 = > minutes later, "VDSM hosted_engine_3 command failed: Message timeout = > which can be caused by communication issues". Currently, the 3rd host = > status in web UI is stuck at "Installing". > > How can I proceed? Could I just run this script = > = > in the 3rd host, and run "hosted-engine --deploy" again? You could do service ovirt-engine restart and remove the host from the = UI. Redeploying the second time should work fine. > > log files: https://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6 > > [me(a)host03 ~]$ rpm -qa | grep ovirt > ovirt-release36-007-1.noarch > ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch > libgovirt-0.3.3-1.el7_2.1.x86_64 > ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch > ovirt-setup-lib-1.0.1-1.el7.centos.noarch > ovirt-vmconsole-1.0.0-1.el7.centos.noarch > ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch > ovirt-host-deploy-1.4.1-1.el7.centos.noarch > ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch > > [me(a)host03 ~]$ rpm -qa | grep vdsm > vdsm-hook-vmfex-dev-4.17.26-1.el7.noarch > vdsm-xmlrpc-4.17.26-1.el7.noarch > vdsm-infra-4.17.26-1.el7.noarch > vdsm-yajsonrpc-4.17.26-1.el7.noarch > vdsm-python-4.17.26-1.el7.noarch > vdsm-4.17.26-1.el7.noarch > vdsm-cli-4.17.26-1.el7.noarch > vdsm-jsonrpc-4.17.26-1.el7.noarch > > [root(a)engine ~]# rpm -qa | grep ovirt > ovirt-engine-wildfly-8.2.1-1.el7.x86_64 > ovirt-engine-setup-plugin-ovirt-engine-common-3.6.5.3-1.el7.centos.noarch > ovirt-vmconsole-1.0.0-1.el7.centos.noarch > ovirt-engine-cli-3.6.2.0-1.el7.centos.noarch > ovirt-engine-setup-plugin-ovirt-engine-3.6.5.3-1.el7.centos.noarch > ovirt-engine-backend-3.6.5.3-1.el7.centos.noarch > ovirt-iso-uploader-3.6.0-1.el7.centos.noarch > ovirt-engine-extensions-api-impl-3.6.5.3-1.el7.centos.noarch > ovirt-host-deploy-1.4.1-1.el7.centos.noarch > ovirt-release36-007-1.noarch > ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch > ovirt-image-uploader-3.6.0-1.el7.centos.noarch > ovirt-engine-extension-aaa-jdbc-1.0.6-1.el7.noarch > ovirt-setup-lib-1.0.1-1.el7.centos.noarch > ovirt-host-deploy-java-1.4.1-1.el7.centos.noarch > ovirt-engine-setup-base-3.6.5.3-1.el7.centos.noarch > ovirt-engine-setup-plugin-websocket-proxy-3.6.5.3-1.el7.centos.noarch > ovirt-engine-tools-backup-3.6.5.3-1.el7.centos.noarch > ovirt-vmconsole-proxy-1.0.0-1.el7.centos.noarch > ovirt-engine-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch > ovirt-engine-setup-3.6.5.3-1.el7.centos.noarch > ovirt-engine-webadmin-portal-3.6.5.3-1.el7.centos.noarch > ovirt-engine-tools-3.6.5.3-1.el7.centos.noarch > ovirt-engine-restapi-3.6.5.3-1.el7.centos.noarch > ovirt-engine-3.6.5.3-1.el7.centos.noarch > ovirt-engine-wildfly-overlay-8.0.5-1.el7.noarch > ovirt-engine-lib-3.6.5.3-1.el7.centos.noarch > ovirt-engine-websocket-proxy-3.6.5.3-1.el7.centos.noarch > ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noa= rch > ovirt-engine-userportal-3.6.5.3-1.el7.centos.noarch > ovirt-engine-dbscripts-3.6.5.3-1.el7.centos.noarch > > Thanks, > -- = > Wee > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --------------030304010602020000040400 Content-Type: text/html; charset=3Dwindows-1252 Content-Transfer-Encoding: 7bit
On 05/03/2016 08:35 AM, Wee Sritippho wrote:
Hi,

I'm making a fresh hosted-engine installation on 3 hosts. First 2 hosts succeeded, but the 3rd one stuck at termination state "Installing Host hosted_engine_3. Stage: Termination.", then, 3 minutes later, "VDSM hosted_engine_3 command failed: Message timeout which can be caused by communication issues". Currently, the 3rd host status in web UI is stuck at "Installing".

How can I proceed? Could I just run this script in the 3rd host, and run "hosted-engine --deploy" again?
You could do service ovirt-engine restart and remove the host from the UI. Redeploying the second time should work fine.
=
log files: htt= ps://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6

[me(a)host03 ~]$ rpm -qa | grep ovirt
ovirt-release36-007-1.noarch
ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch
libgovirt-0.3.3-1.el7_2.1.x86_64
ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch
ovirt-setup-lib-1.0.1-1.el7.centos.noarch
ovirt-vmconsole-1.0.0-1.el7.centos.noarch
ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch
ovirt-host-deploy-1.4.1-1.el7.centos.noarch
ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch

[me(a)host03 ~]$ rpm -qa | grep vdsm
vdsm-hook-vmfex-dev-4.17.26-1.el7.noarch
vdsm-xmlrpc-4.17.26-1.el7.noarch
vdsm-infra-4.17.26-1.el7.noarch
vdsm-yajsonrpc-4.17.26-1.el7.noarch
vdsm-python-4.17.26-1.el7.noarch
vdsm-4.17.26-1.el7.noarch
vdsm-cli-4.17.26-1.el7.noarch
vdsm-jsonrpc-4.17.26-1.el7.noarch

[root(a)engine ~]# rpm -qa | grep ovirt
ovirt-engine-wildfly-8.2.1-1.el7.x86_64
ovirt-engine-setup-plugin-ovirt-engine-common-3.6.5.3-1.el7.centos.noarch ovirt-vmconsole-1.0.0-1.el7.centos.noarch
ovirt-engine-cli-3.6.2.0-1.el7.centos.noarch
ovirt-engine-setup-plugin-ovirt-engine-3.6.5.3-1.el7.centos.noarch
ovirt-engine-backend-3.6.5.3-1.el7.centos.noarch
ovirt-iso-uploader-3.6.0-1.el7.centos.noarch
ovirt-engine-extensions-api-impl-3.6.5.3-1.el7.centos.noarch
ovirt-host-deploy-1.4.1-1.el7.centos.noarch
ovirt-release36-007-1.noarch
ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch
ovirt-image-uploader-3.6.0-1.el7.centos.noarch
ovirt-engine-extension-aaa-jdbc-1.0.6-1.el7.noarch
ovirt-setup-lib-1.0.1-1.el7.centos.noarch
ovirt-host-deploy-java-1.4.1-1.el7.centos.noarch
ovirt-engine-setup-base-3.6.5.3-1.el7.centos.noarch
ovirt-engine-setup-plugin-websocket-proxy-3.6.5.3-1.el7.centos.noarch
ovirt-engine-tools-backup-3.6.5.3-1.el7.centos.noarch
ovirt-vmconsole-proxy-1.0.0-1.el7.centos.noarch
ovirt-engine-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch
ovirt-engine-setup-3.6.5.3-1.el7.centos.noarch
ovirt-engine-webadmin-portal-3.6.5.3-1.el7.centos.noarch
ovirt-engine-tools-3.6.5.3-1.el7.centos.noarch
ovirt-engine-restapi-3.6.5.3-1.el7.centos.noarch
ovirt-engine-3.6.5.3-1.el7.centos.noarch
ovirt-engine-wildfly-overlay-8.0.5-1.el7.noarch
ovirt-engine-lib-3.6.5.3-1.el7.centos.noarch
ovirt-engine-websocket-proxy-3.6.5.3-1.el7.centos.noarch
ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarc= h
ovirt-engine-userportal-3.6.5.3-1.el7.centos.noarch
ovirt-engine-dbscripts-3.6.5.3-1.el7.centos.noarch

Thanks,
-- =

Wee


_______________________________________________
Users mailing list
Use=
rs(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

--------------030304010602020000040400-- --===============2771927814288885096== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS0wMzAzMDQwMTA2MDIwMjAwMDAwNDA0MDAKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXdpbmRvd3MtMTI1MjsgZm9ybWF0PWZsb3dlZApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5n OiA3Yml0CgpPbiAwNS8wMy8yMDE2IDA4OjM1IEFNLCBXZWUgU3JpdGlwcGhvIHdyb3RlOgo+IEhp LAo+Cj4gSSdtIG1ha2luZyBhIGZyZXNoIGhvc3RlZC1lbmdpbmUgaW5zdGFsbGF0aW9uIG9uIDMg aG9zdHMuIEZpcnN0IDIgCj4gaG9zdHMgc3VjY2VlZGVkLCBidXQgdGhlIDNyZCBvbmUgc3R1Y2sg YXQgdGVybWluYXRpb24gc3RhdGUgCj4gIkluc3RhbGxpbmcgSG9zdCBob3N0ZWRfZW5naW5lXzMu IFN0YWdlOiBUZXJtaW5hdGlvbi4iLCB0aGVuLCAzIAo+IG1pbnV0ZXMgbGF0ZXIsICJWRFNNIGhv c3RlZF9lbmdpbmVfMyBjb21tYW5kIGZhaWxlZDogTWVzc2FnZSB0aW1lb3V0IAo+IHdoaWNoIGNh biBiZSBjYXVzZWQgYnkgY29tbXVuaWNhdGlvbiBpc3N1ZXMiLiBDdXJyZW50bHksIHRoZSAzcmQg aG9zdCAKPiBzdGF0dXMgaW4gd2ViIFVJIGlzIHN0dWNrIGF0ICJJbnN0YWxsaW5nIi4KPgo+IEhv dyBjYW4gSSBwcm9jZWVkPyBDb3VsZCBJIGp1c3QgcnVuIHRoaXMgc2NyaXB0IAo+IDxodHRwczov L3d3dy5vdmlydC5vcmcvZG9jdW1lbnRhdGlvbi9ob3ctdG8vaG9zdGVkLWVuZ2luZS8jcmVjb3Zp bmctZnJvbS1mYWlsZWQtaW5zdGFsbD4gCj4gaW4gdGhlIDNyZCBob3N0LCBhbmQgcnVuICJob3N0 ZWQtZW5naW5lIC0tZGVwbG95IiBhZ2Fpbj8KWW91IGNvdWxkIGRvIHNlcnZpY2Ugb3ZpcnQtZW5n aW5lIHJlc3RhcnQgYW5kIHJlbW92ZSB0aGUgaG9zdCBmcm9tIHRoZSAKVUkuIFJlZGVwbG95aW5n IHRoZSBzZWNvbmQgdGltZSBzaG91bGQgd29yayBmaW5lLgo+Cj4gbG9nIGZpbGVzOiBodHRwczov L2FwcC5ib3guY29tL3MvYTV0eXBmZTZjYm96czl1bzlvc2c2OGd0bXE4NzkzdDYKPgo+IFttZUBo b3N0MDMgfl0kIHJwbSAtcWEgfCBncmVwIG92aXJ0Cj4gb3ZpcnQtcmVsZWFzZTM2LTAwNy0xLm5v YXJjaAo+IG92aXJ0LWhvc3RlZC1lbmdpbmUtc2V0dXAtMS4zLjUuMC0xLjEuZWw3Lm5vYXJjaAo+ IGxpYmdvdmlydC0wLjMuMy0xLmVsN18yLjEueDg2XzY0Cj4gb3ZpcnQtZW5naW5lLXNkay1weXRo b24tMy42LjUuMC0xLmVsNy5jZW50b3Mubm9hcmNoCj4gb3ZpcnQtc2V0dXAtbGliLTEuMC4xLTEu ZWw3LmNlbnRvcy5ub2FyY2gKPiBvdmlydC12bWNvbnNvbGUtMS4wLjAtMS5lbDcuY2VudG9zLm5v YXJjaAo+IG92aXJ0LXZtY29uc29sZS1ob3N0LTEuMC4wLTEuZWw3LmNlbnRvcy5ub2FyY2gKPiBv dmlydC1ob3N0LWRlcGxveS0xLjQuMS0xLmVsNy5jZW50b3Mubm9hcmNoCj4gb3ZpcnQtaG9zdGVk LWVuZ2luZS1oYS0xLjMuNS4zLTEuMS5lbDcubm9hcmNoCj4KPiBbbWVAaG9zdDAzIH5dJCBycG0g LXFhIHwgZ3JlcCB2ZHNtCj4gdmRzbS1ob29rLXZtZmV4LWRldi00LjE3LjI2LTEuZWw3Lm5vYXJj aAo+IHZkc20teG1scnBjLTQuMTcuMjYtMS5lbDcubm9hcmNoCj4gdmRzbS1pbmZyYS00LjE3LjI2 LTEuZWw3Lm5vYXJjaAo+IHZkc20teWFqc29ucnBjLTQuMTcuMjYtMS5lbDcubm9hcmNoCj4gdmRz bS1weXRob24tNC4xNy4yNi0xLmVsNy5ub2FyY2gKPiB2ZHNtLTQuMTcuMjYtMS5lbDcubm9hcmNo Cj4gdmRzbS1jbGktNC4xNy4yNi0xLmVsNy5ub2FyY2gKPiB2ZHNtLWpzb25ycGMtNC4xNy4yNi0x LmVsNy5ub2FyY2gKPgo+IFtyb290QGVuZ2luZSB+XSMgcnBtIC1xYSB8IGdyZXAgb3ZpcnQKPiBv dmlydC1lbmdpbmUtd2lsZGZseS04LjIuMS0xLmVsNy54ODZfNjQKPiBvdmlydC1lbmdpbmUtc2V0 dXAtcGx1Z2luLW92aXJ0LWVuZ2luZS1jb21tb24tMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNo Cj4gb3ZpcnQtdm1jb25zb2xlLTEuMC4wLTEuZWw3LmNlbnRvcy5ub2FyY2gKPiBvdmlydC1lbmdp bmUtY2xpLTMuNi4yLjAtMS5lbDcuY2VudG9zLm5vYXJjaAo+IG92aXJ0LWVuZ2luZS1zZXR1cC1w bHVnaW4tb3ZpcnQtZW5naW5lLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaAo+IG92aXJ0LWVu Z2luZS1iYWNrZW5kLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaAo+IG92aXJ0LWlzby11cGxv YWRlci0zLjYuMC0xLmVsNy5jZW50b3Mubm9hcmNoCj4gb3ZpcnQtZW5naW5lLWV4dGVuc2lvbnMt YXBpLWltcGwtMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCj4gb3ZpcnQtaG9zdC1kZXBsb3kt MS40LjEtMS5lbDcuY2VudG9zLm5vYXJjaAo+IG92aXJ0LXJlbGVhc2UzNi0wMDctMS5ub2FyY2gK PiBvdmlydC1lbmdpbmUtc2RrLXB5dGhvbi0zLjYuNS4wLTEuZWw3LmNlbnRvcy5ub2FyY2gKPiBv dmlydC1pbWFnZS11cGxvYWRlci0zLjYuMC0xLmVsNy5jZW50b3Mubm9hcmNoCj4gb3ZpcnQtZW5n aW5lLWV4dGVuc2lvbi1hYWEtamRiYy0xLjAuNi0xLmVsNy5ub2FyY2gKPiBvdmlydC1zZXR1cC1s aWItMS4wLjEtMS5lbDcuY2VudG9zLm5vYXJjaAo+IG92aXJ0LWhvc3QtZGVwbG95LWphdmEtMS40 LjEtMS5lbDcuY2VudG9zLm5vYXJjaAo+IG92aXJ0LWVuZ2luZS1zZXR1cC1iYXNlLTMuNi41LjMt MS5lbDcuY2VudG9zLm5vYXJjaAo+IG92aXJ0LWVuZ2luZS1zZXR1cC1wbHVnaW4td2Vic29ja2V0 LXByb3h5LTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaAo+IG92aXJ0LWVuZ2luZS10b29scy1i YWNrdXAtMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCj4gb3ZpcnQtdm1jb25zb2xlLXByb3h5 LTEuMC4wLTEuZWw3LmNlbnRvcy5ub2FyY2gKPiBvdmlydC1lbmdpbmUtdm1jb25zb2xlLXByb3h5 LWhlbHBlci0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2gKPiBvdmlydC1lbmdpbmUtc2V0dXAt My42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCj4gb3ZpcnQtZW5naW5lLXdlYmFkbWluLXBvcnRh bC0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2gKPiBvdmlydC1lbmdpbmUtdG9vbHMtMy42LjUu My0xLmVsNy5jZW50b3Mubm9hcmNoCj4gb3ZpcnQtZW5naW5lLXJlc3RhcGktMy42LjUuMy0xLmVs Ny5jZW50b3Mubm9hcmNoCj4gb3ZpcnQtZW5naW5lLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJj aAo+IG92aXJ0LWVuZ2luZS13aWxkZmx5LW92ZXJsYXktOC4wLjUtMS5lbDcubm9hcmNoCj4gb3Zp cnQtZW5naW5lLWxpYi0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2gKPiBvdmlydC1lbmdpbmUt d2Vic29ja2V0LXByb3h5LTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaAo+IG92aXJ0LWVuZ2lu ZS1zZXR1cC1wbHVnaW4tdm1jb25zb2xlLXByb3h5LWhlbHBlci0zLjYuNS4zLTEuZWw3LmNlbnRv cy5ub2FyY2gKPiBvdmlydC1lbmdpbmUtdXNlcnBvcnRhbC0zLjYuNS4zLTEuZWw3LmNlbnRvcy5u b2FyY2gKPiBvdmlydC1lbmdpbmUtZGJzY3JpcHRzLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJj aAo+Cj4gVGhhbmtzLAo+IC0tIAo+IFdlZQo+Cj4KPiBfX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fXwo+IFVzZXJzIG1haWxpbmcgbGlzdAo+IFVzZXJzQG92aXJ0 Lm9yZwo+IGh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycwoKCi0t LS0tLS0tLS0tLS0tMDMwMzA0MDEwNjAyMDIwMDAwMDQwNDAwCkNvbnRlbnQtVHlwZTogdGV4dC9o dG1sOyBjaGFyc2V0PXdpbmRvd3MtMTI1MgpDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA3Yml0 Cgo8aHRtbD4KICA8aGVhZD4KICAgIDxtZXRhIGNvbnRlbnQ9InRleHQvaHRtbDsgY2hhcnNldD13 aW5kb3dzLTEyNTIiCiAgICAgIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSI+CiAgPC9oZWFkPgog IDxib2R5IGJnY29sb3I9IiNGRkZGRkYiIHRleHQ9IiMwMDAwMDAiPgogICAgPGRpdiBjbGFzcz0i bW96LWNpdGUtcHJlZml4Ij5PbiAwNS8wMy8yMDE2IDA4OjM1IEFNLCBXZWUgU3JpdGlwcGhvCiAg ICAgIHdyb3RlOjxicj4KICAgIDwvZGl2PgogICAgPGJsb2NrcXVvdGUgY2l0ZT0ibWlkOjU3Mjgx NThDLjQwNzAzMDVAZm9yZXN0LmdvLnRoIiB0eXBlPSJjaXRlIj4KICAgICAgPG1ldGEgaHR0cC1l cXVpdj0iQ29udGV4dC1UeXBlIiBjb250ZW50PSJ0ZXh0L2h0bWw7IGNoYXJzZXQ9dXRmLTgiPgog ICAgICBIaSw8YnI+CiAgICAgIDxicj4KICAgICAgSSdtIG1ha2luZyBhIGZyZXNoIGhvc3RlZC1l bmdpbmUgaW5zdGFsbGF0aW9uIG9uIDMgaG9zdHMuIEZpcnN0IDIKICAgICAgaG9zdHMgc3VjY2Vl ZGVkLCBidXQgdGhlIDNyZCBvbmUgc3R1Y2sgYXQgdGVybWluYXRpb24gc3RhdGUKICAgICAgIklu c3RhbGxpbmcgSG9zdCBob3N0ZWRfZW5naW5lXzMuIFN0YWdlOiBUZXJtaW5hdGlvbi4iLCB0aGVu LCAzCiAgICAgIG1pbnV0ZXMgbGF0ZXIsICJWRFNNIGhvc3RlZF9lbmdpbmVfMyBjb21tYW5kIGZh aWxlZDogTWVzc2FnZQogICAgICB0aW1lb3V0IHdoaWNoIGNhbiBiZSBjYXVzZWQgYnkgY29tbXVu aWNhdGlvbiBpc3N1ZXMiLiBDdXJyZW50bHksCiAgICAgIHRoZSAzcmQgaG9zdCBzdGF0dXMgaW4g d2ViIFVJIGlzIHN0dWNrIGF0ICJJbnN0YWxsaW5nIi48YnI+CiAgICAgIDxicj4KICAgICAgSG93 IGNhbiBJIHByb2NlZWQ/IENvdWxkIEkganVzdCBydW4gPGEgbW96LWRvLW5vdC1zZW5kPSJ0cnVl IgpocmVmPSJodHRwczovL3d3dy5vdmlydC5vcmcvZG9jdW1lbnRhdGlvbi9ob3ctdG8vaG9zdGVk LWVuZ2luZS8jcmVjb3ZpbmctZnJvbS1mYWlsZWQtaW5zdGFsbCI+dGhpcwoKICAgICAgICBzY3Jp cHQ8L2E+IGluIHRoZSAzcmQgaG9zdCwgYW5kIHJ1biAiaG9zdGVkLWVuZ2luZSAtLWRlcGxveSIK ICAgICAgYWdhaW4/PGJyPgogICAgPC9ibG9ja3F1b3RlPgogICAgWW91IGNvdWxkIGRvIHNlcnZp Y2Ugb3ZpcnQtZW5naW5lIHJlc3RhcnQgYW5kIHJlbW92ZSB0aGUgaG9zdCBmcm9tCiAgICB0aGUg VUkuIFJlZGVwbG95aW5nIHRoZSBzZWNvbmQgdGltZSBzaG91bGQgd29yayBmaW5lLjxicj4KICAg IDxibG9ja3F1b3RlIGNpdGU9Im1pZDo1NzI4MTU4Qy40MDcwMzA1QGZvcmVzdC5nby50aCIgdHlw ZT0iY2l0ZSI+IDxicj4KICAgICAgbG9nIGZpbGVzOiA8YSBtb3otZG8tbm90LXNlbmQ9InRydWUi CiAgICAgICAgY2xhc3M9Im1vei10eHQtbGluay1mcmVldGV4dCIKICAgICAgICBocmVmPSJodHRw czovL2FwcC5ib3guY29tL3MvYTV0eXBmZTZjYm96czl1bzlvc2c2OGd0bXE4NzkzdDYiPmh0dHBz Oi8vYXBwLmJveC5jb20vcy9hNXR5cGZlNmNib3pzOXVvOW9zZzY4Z3RtcTg3OTN0NjwvYT48YnI+ CiAgICAgIDxicj4KICAgICAgW21lQGhvc3QwMyB+XSQgcnBtIC1xYSB8IGdyZXAgb3ZpcnQ8YnI+ CiAgICAgIG92aXJ0LXJlbGVhc2UzNi0wMDctMS5ub2FyY2g8YnI+CiAgICAgIG92aXJ0LWhvc3Rl ZC1lbmdpbmUtc2V0dXAtMS4zLjUuMC0xLjEuZWw3Lm5vYXJjaDxicj4KICAgICAgbGliZ292aXJ0 LTAuMy4zLTEuZWw3XzIuMS54ODZfNjQ8YnI+CiAgICAgIG92aXJ0LWVuZ2luZS1zZGstcHl0aG9u LTMuNi41LjAtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgb3ZpcnQtc2V0dXAtbGliLTEu MC4xLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgIG92aXJ0LXZtY29uc29sZS0xLjAuMC0x LmVsNy5jZW50b3Mubm9hcmNoPGJyPgogICAgICBvdmlydC12bWNvbnNvbGUtaG9zdC0xLjAuMC0x LmVsNy5jZW50b3Mubm9hcmNoPGJyPgogICAgICBvdmlydC1ob3N0LWRlcGxveS0xLjQuMS0xLmVs Ny5jZW50b3Mubm9hcmNoPGJyPgogICAgICBvdmlydC1ob3N0ZWQtZW5naW5lLWhhLTEuMy41LjMt MS4xLmVsNy5ub2FyY2g8YnI+CiAgICAgIDxicj4KICAgICAgW21lQGhvc3QwMyB+XSQgcnBtIC1x YSB8IGdyZXAgdmRzbTxicj4KICAgICAgdmRzbS1ob29rLXZtZmV4LWRldi00LjE3LjI2LTEuZWw3 Lm5vYXJjaDxicj4KICAgICAgdmRzbS14bWxycGMtNC4xNy4yNi0xLmVsNy5ub2FyY2g8YnI+CiAg ICAgIHZkc20taW5mcmEtNC4xNy4yNi0xLmVsNy5ub2FyY2g8YnI+CiAgICAgIHZkc20teWFqc29u cnBjLTQuMTcuMjYtMS5lbDcubm9hcmNoPGJyPgogICAgICB2ZHNtLXB5dGhvbi00LjE3LjI2LTEu ZWw3Lm5vYXJjaDxicj4KICAgICAgdmRzbS00LjE3LjI2LTEuZWw3Lm5vYXJjaDxicj4KICAgICAg dmRzbS1jbGktNC4xNy4yNi0xLmVsNy5ub2FyY2g8YnI+CiAgICAgIHZkc20tanNvbnJwYy00LjE3 LjI2LTEuZWw3Lm5vYXJjaDxicj4KICAgICAgPGJyPgogICAgICBbcm9vdEBlbmdpbmUgfl0jIHJw bSAtcWEgfCBncmVwIG92aXJ0PGJyPgogICAgICBvdmlydC1lbmdpbmUtd2lsZGZseS04LjIuMS0x LmVsNy54ODZfNjQ8YnI+Cm92aXJ0LWVuZ2luZS1zZXR1cC1wbHVnaW4tb3ZpcnQtZW5naW5lLWNv bW1vbi0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgIG92aXJ0LXZtY29uc29s ZS0xLjAuMC0xLmVsNy5jZW50b3Mubm9hcmNoPGJyPgogICAgICBvdmlydC1lbmdpbmUtY2xpLTMu Ni4yLjAtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgb3ZpcnQtZW5naW5lLXNldHVwLXBs dWdpbi1vdmlydC1lbmdpbmUtMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoPGJyPgogICAgICBv dmlydC1lbmdpbmUtYmFja2VuZC0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAg IG92aXJ0LWlzby11cGxvYWRlci0zLjYuMC0xLmVsNy5jZW50b3Mubm9hcmNoPGJyPgogICAgICBv dmlydC1lbmdpbmUtZXh0ZW5zaW9ucy1hcGktaW1wbC0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2Fy Y2g8YnI+CiAgICAgIG92aXJ0LWhvc3QtZGVwbG95LTEuNC4xLTEuZWw3LmNlbnRvcy5ub2FyY2g8 YnI+CiAgICAgIG92aXJ0LXJlbGVhc2UzNi0wMDctMS5ub2FyY2g8YnI+CiAgICAgIG92aXJ0LWVu Z2luZS1zZGstcHl0aG9uLTMuNi41LjAtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgb3Zp cnQtaW1hZ2UtdXBsb2FkZXItMy42LjAtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgb3Zp cnQtZW5naW5lLWV4dGVuc2lvbi1hYWEtamRiYy0xLjAuNi0xLmVsNy5ub2FyY2g8YnI+CiAgICAg IG92aXJ0LXNldHVwLWxpYi0xLjAuMS0xLmVsNy5jZW50b3Mubm9hcmNoPGJyPgogICAgICBvdmly dC1ob3N0LWRlcGxveS1qYXZhLTEuNC4xLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgIG92 aXJ0LWVuZ2luZS1zZXR1cC1iYXNlLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4Kb3Zp cnQtZW5naW5lLXNldHVwLXBsdWdpbi13ZWJzb2NrZXQtcHJveHktMy42LjUuMy0xLmVsNy5jZW50 b3Mubm9hcmNoPGJyPgogICAgICBvdmlydC1lbmdpbmUtdG9vbHMtYmFja3VwLTMuNi41LjMtMS5l bDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgb3ZpcnQtdm1jb25zb2xlLXByb3h5LTEuMC4wLTEu ZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgIG92aXJ0LWVuZ2luZS12bWNvbnNvbGUtcHJveHkt aGVscGVyLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgb3ZpcnQtZW5naW5l LXNldHVwLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgb3ZpcnQtZW5naW5l LXdlYmFkbWluLXBvcnRhbC0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgIG92 aXJ0LWVuZ2luZS10b29scy0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgIG92 aXJ0LWVuZ2luZS1yZXN0YXBpLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAg b3ZpcnQtZW5naW5lLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgb3ZpcnQt ZW5naW5lLXdpbGRmbHktb3ZlcmxheS04LjAuNS0xLmVsNy5ub2FyY2g8YnI+CiAgICAgIG92aXJ0 LWVuZ2luZS1saWItMy42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoPGJyPgogICAgICBvdmlydC1l bmdpbmUtd2Vic29ja2V0LXByb3h5LTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4Kb3Zp cnQtZW5naW5lLXNldHVwLXBsdWdpbi12bWNvbnNvbGUtcHJveHktaGVscGVyLTMuNi41LjMtMS5l bDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgb3ZpcnQtZW5naW5lLXVzZXJwb3J0YWwtMy42LjUu My0xLmVsNy5jZW50b3Mubm9hcmNoPGJyPgogICAgICBvdmlydC1lbmdpbmUtZGJzY3JpcHRzLTMu Ni41LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgPGJyPgogICAgICBUaGFua3MsPGJy PgogICAgICA8cHJlIGNsYXNzPSJtb3otc2lnbmF0dXJlIiBjb2xzPSI3MiI+LS0gCldlZTwvcHJl PgogICAgICA8YnI+CiAgICAgIDxmaWVsZHNldCBjbGFzcz0ibWltZUF0dGFjaG1lbnRIZWFkZXIi PjwvZmllbGRzZXQ+CiAgICAgIDxicj4KICAgICAgPHByZSB3cmFwPSIiPl9fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fClVzZXJzIG1haWxpbmcgbGlzdAo8YSBj bGFzcz0ibW96LXR4dC1saW5rLWFiYnJldmlhdGVkIiBocmVmPSJtYWlsdG86VXNlcnNAb3ZpcnQu b3JnIj5Vc2Vyc0BvdmlydC5vcmc8L2E+CjxhIGNsYXNzPSJtb3otdHh0LWxpbmstZnJlZXRleHQi IGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycyI+aHR0 cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzPC9hPgo8L3ByZT4KICAg IDwvYmxvY2txdW90ZT4KICAgIDxicj4KICA8L2JvZHk+CjwvaHRtbD4KCi0tLS0tLS0tLS0tLS0t MDMwMzA0MDEwNjAyMDIwMDAwMDQwNDAwLS0K --===============2771927814288885096==-- From stirabos at redhat.com Tue May 3 03:29:59 2016 Content-Type: multipart/mixed; boundary="===============2394279060440059766==" MIME-Version: 1.0 From: Simone Tiraboschi To: users at ovirt.org Subject: Re: [ovirt-users] Additional hosted-engine host deployment failed due to message timeout Date: Tue, 03 May 2016 09:29:29 +0200 Message-ID: In-Reply-To: 5728158C.4070305@forest.go.th --===============2394279060440059766== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On Tue, May 3, 2016 at 5:05 AM, Wee Sritippho wrote: > Hi, > > I'm making a fresh hosted-engine installation on 3 hosts. First 2 hosts > succeeded, but the 3rd one stuck at termination state "Installing Host > hosted_engine_3. Stage: Termination.", then, 3 minutes later, "VDSM > hosted_engine_3 command failed: Message timeout which can be caused by > communication issues". Currently, the 3rd host status in web UI is stuck = at > "Installing". > > How can I proceed? Could I just run this script in the 3rd host, and run > "hosted-engine --deploy" again? > > log files: https://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6 The error is here: 2016-05-03 08:43:49,760 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-9) [454e2dc8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM hosted_engine_3 command failed: Message timeout which can be caused by communication issues 2016-05-03 08:43:49,760 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-8-thread-9) [454e2dc8] Command 'PollVDSCommand(HostName =3D hosted_engine_3, VdsIdVDSCommandParametersBase:{runAsync=3D'true', hostId=3D'ed3526a1-6a03-44a7-a9a5-e3b346384ac4'})' execution failed: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues 2016-05-03 08:43:49,760 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-8-thread-9) [454e2dc8] Error: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues 2016-05-03 08:43:49,760 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-8-thread-9) [454e2dc8] Exception: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxy= ReturnValue(BrokerCommandBase.java:188) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.FutureVDSCommand.get(FutureVDS= Command.java:73) [vdsbroker.jar:] at org.ovirt.engine.core.bll.network.host.HostSetupNetworkPoller.poll(HostS= etupNetworkPoller.java:30) [bll.jar:] at org.ovirt.engine.core.bll.network.host.HostSetupNetworksCommand.invokeSe= tupNetworksCommand(HostSetupNetworksCommand.java:423) [bll.jar:] at org.ovirt.engine.core.bll.network.host.HostSetupNetworksCommand.executeC= ommand(HostSetupNetworksCommand.java:256) [bll.jar:] This is something that happens after the engine called setupNetworks and, due to some side effects, it loose the communication with the host. The issue is tracked here: https://bugzilla.redhat.com/1323465 we are going to solve for 3.6.6 As Knarra said, you can simply try redeploying it and it could work: this issue is not fully systematic. In order to retry you need to remove your host from the engine and in order to do that you probably need to move it to maintenance mode. > [me(a)host03 ~]$ rpm -qa | grep ovirt > ovirt-release36-007-1.noarch > ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch > libgovirt-0.3.3-1.el7_2.1.x86_64 > ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch > ovirt-setup-lib-1.0.1-1.el7.centos.noarch > ovirt-vmconsole-1.0.0-1.el7.centos.noarch > ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch > ovirt-host-deploy-1.4.1-1.el7.centos.noarch > ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch > > [me(a)host03 ~]$ rpm -qa | grep vdsm > vdsm-hook-vmfex-dev-4.17.26-1.el7.noarch > vdsm-xmlrpc-4.17.26-1.el7.noarch > vdsm-infra-4.17.26-1.el7.noarch > vdsm-yajsonrpc-4.17.26-1.el7.noarch > vdsm-python-4.17.26-1.el7.noarch > vdsm-4.17.26-1.el7.noarch > vdsm-cli-4.17.26-1.el7.noarch > vdsm-jsonrpc-4.17.26-1.el7.noarch > > [root(a)engine ~]# rpm -qa | grep ovirt > ovirt-engine-wildfly-8.2.1-1.el7.x86_64 > ovirt-engine-setup-plugin-ovirt-engine-common-3.6.5.3-1.el7.centos.noarch > ovirt-vmconsole-1.0.0-1.el7.centos.noarch > ovirt-engine-cli-3.6.2.0-1.el7.centos.noarch > ovirt-engine-setup-plugin-ovirt-engine-3.6.5.3-1.el7.centos.noarch > ovirt-engine-backend-3.6.5.3-1.el7.centos.noarch > ovirt-iso-uploader-3.6.0-1.el7.centos.noarch > ovirt-engine-extensions-api-impl-3.6.5.3-1.el7.centos.noarch > ovirt-host-deploy-1.4.1-1.el7.centos.noarch > ovirt-release36-007-1.noarch > ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch > ovirt-image-uploader-3.6.0-1.el7.centos.noarch > ovirt-engine-extension-aaa-jdbc-1.0.6-1.el7.noarch > ovirt-setup-lib-1.0.1-1.el7.centos.noarch > ovirt-host-deploy-java-1.4.1-1.el7.centos.noarch > ovirt-engine-setup-base-3.6.5.3-1.el7.centos.noarch > ovirt-engine-setup-plugin-websocket-proxy-3.6.5.3-1.el7.centos.noarch > ovirt-engine-tools-backup-3.6.5.3-1.el7.centos.noarch > ovirt-vmconsole-proxy-1.0.0-1.el7.centos.noarch > ovirt-engine-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch > ovirt-engine-setup-3.6.5.3-1.el7.centos.noarch > ovirt-engine-webadmin-portal-3.6.5.3-1.el7.centos.noarch > ovirt-engine-tools-3.6.5.3-1.el7.centos.noarch > ovirt-engine-restapi-3.6.5.3-1.el7.centos.noarch > ovirt-engine-3.6.5.3-1.el7.centos.noarch > ovirt-engine-wildfly-overlay-8.0.5-1.el7.noarch > ovirt-engine-lib-3.6.5.3-1.el7.centos.noarch > ovirt-engine-websocket-proxy-3.6.5.3-1.el7.centos.noarch > ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noa= rch > ovirt-engine-userportal-3.6.5.3-1.el7.centos.noarch > ovirt-engine-dbscripts-3.6.5.3-1.el7.centos.noarch > > Thanks, > > -- > Wee > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > --===============2394279060440059766==-- From wee.s at forest.go.th Tue May 3 04:03:39 2016 Content-Type: multipart/mixed; boundary="===============1886439265194544800==" MIME-Version: 1.0 From: Wee Sritippho To: users at ovirt.org Subject: Re: [ovirt-users] Additional hosted-engine host deployment failed due to message timeout Date: Tue, 03 May 2016 15:03:32 +0700 Message-ID: <57285B54.2060507@forest.go.th> In-Reply-To: 5728444D.7000705@redhat.com --===============1886439265194544800== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------050000000201060001020000 Content-Type: text/plain; charset=3DUTF-8; format=3Dflowed Content-Transfer-Encoding: 7bit On 3/5/2559 13:25, knarra wrote: > On 05/03/2016 08:35 AM, Wee Sritippho wrote: >> Hi, >> >> I'm making a fresh hosted-engine installation on 3 hosts. First 2 = >> hosts succeeded, but the 3rd one stuck at termination state = >> "Installing Host hosted_engine_3. Stage: Termination.", then, 3 = >> minutes later, "VDSM hosted_engine_3 command failed: Message timeout = >> which can be caused by communication issues". Currently, the 3rd host = >> status in web UI is stuck at "Installing". >> >> How can I proceed? Could I just run this script = >> = >> in the 3rd host, and run "hosted-engine --deploy" again? > You could do service ovirt-engine restart and remove the host from the = > UI. Redeploying the second time should work fine. Thank you. This is what I've done and succeeded: 1. Set host03 to maintenance. 2. Remove host03. 3. redeploy host03 with "hosted-engine --deploy" but failed with "[ = ERROR ] Failed to execute stage 'Programs detection': Hosted Engine HA = services are already running on this system. Hosted Engine cannot be = deployed on a host already running those services." 4. Run the script from = https://www.ovirt.org/documentation/how-to/hosted-engine/#recoving-from-fai= led-install 5. Install ovirt-hosted-engine-setup again. 6. Redeploy again. >> >> log files: https://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6 >> >> [me(a)host03 ~]$ rpm -qa | grep ovirt >> ovirt-release36-007-1.noarch >> ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch >> libgovirt-0.3.3-1.el7_2.1.x86_64 >> ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch >> ovirt-setup-lib-1.0.1-1.el7.centos.noarch >> ovirt-vmconsole-1.0.0-1.el7.centos.noarch >> ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch >> ovirt-host-deploy-1.4.1-1.el7.centos.noarch >> ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch >> >> [me(a)host03 ~]$ rpm -qa | grep vdsm >> vdsm-hook-vmfex-dev-4.17.26-1.el7.noarch >> vdsm-xmlrpc-4.17.26-1.el7.noarch >> vdsm-infra-4.17.26-1.el7.noarch >> vdsm-yajsonrpc-4.17.26-1.el7.noarch >> vdsm-python-4.17.26-1.el7.noarch >> vdsm-4.17.26-1.el7.noarch >> vdsm-cli-4.17.26-1.el7.noarch >> vdsm-jsonrpc-4.17.26-1.el7.noarch >> >> [root(a)engine ~]# rpm -qa | grep ovirt >> ovirt-engine-wildfly-8.2.1-1.el7.x86_64 >> ovirt-engine-setup-plugin-ovirt-engine-common-3.6.5.3-1.el7.centos.noarch >> ovirt-vmconsole-1.0.0-1.el7.centos.noarch >> ovirt-engine-cli-3.6.2.0-1.el7.centos.noarch >> ovirt-engine-setup-plugin-ovirt-engine-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-backend-3.6.5.3-1.el7.centos.noarch >> ovirt-iso-uploader-3.6.0-1.el7.centos.noarch >> ovirt-engine-extensions-api-impl-3.6.5.3-1.el7.centos.noarch >> ovirt-host-deploy-1.4.1-1.el7.centos.noarch >> ovirt-release36-007-1.noarch >> ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch >> ovirt-image-uploader-3.6.0-1.el7.centos.noarch >> ovirt-engine-extension-aaa-jdbc-1.0.6-1.el7.noarch >> ovirt-setup-lib-1.0.1-1.el7.centos.noarch >> ovirt-host-deploy-java-1.4.1-1.el7.centos.noarch >> ovirt-engine-setup-base-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-setup-plugin-websocket-proxy-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-tools-backup-3.6.5.3-1.el7.centos.noarch >> ovirt-vmconsole-proxy-1.0.0-1.el7.centos.noarch >> ovirt-engine-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-setup-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-webadmin-portal-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-tools-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-restapi-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-wildfly-overlay-8.0.5-1.el7.noarch >> ovirt-engine-lib-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-websocket-proxy-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.no= arch >> ovirt-engine-userportal-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-dbscripts-3.6.5.3-1.el7.centos.noarch >> >> Thanks, >> -- = >> Wee >> >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users > -- = Wee --------------050000000201060001020000 Content-Type: text/html; charset=3DUTF-8 Content-Transfer-Encoding: 7bit On 3/5/2559 13:25, knarra wrote:
On 05/03/2016 08:35 AM, Wee Sritippho wrote:
Hi,

I'm making a fresh hosted-engine installation on 3 hosts. First 2 hosts succeeded, but the 3rd one stuck at termination state "Installing Host hosted_engine_3. Stage: Termination.", then, 3 minutes later, "VDSM hosted_engine_3 command failed: Message timeout which can be caused by communication issues". Currently, the 3rd host status in web UI is stuck at "Installing".

How can I proceed? Could I just run this script in the 3rd host, and run "hosted-engine --deploy" again?
You could do service ovirt-engine restart and remove the host from the UI. Redeploying the second time should work fine.
Thank you. This is what I've done and succeeded:
1. Set host03 to maintenance.
2. Remove host03.
3. redeploy host03 with "hosted-engine --deploy" but failed with "[ ERROR ] Failed to execute stage 'Programs detection': Hosted Engine HA services are already running on this system. Hosted Engine cannot be deployed on a host already running those services."
4. Run the script from https://www.ovirt.o= rg/documentation/how-to/hosted-engine/#recoving-from-failed-install
5. Install ovirt-hosted-engine-setup again.
6. Redeploy again.

log files: h= ttps://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6

[me(a)host03 ~]$ rpm -qa | grep ovirt
ovirt-release36-007-1.noarch
ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch
libgovirt-0.3.3-1.el7_2.1.x86_64
ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch
ovirt-setup-lib-1.0.1-1.el7.centos.noarch
ovirt-vmconsole-1.0.0-1.el7.centos.noarch
ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch
ovirt-host-deploy-1.4.1-1.el7.centos.noarch
ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch

[me(a)host03 ~]$ rpm -qa | grep vdsm
vdsm-hook-vmfex-dev-4.17.26-1.el7.noarch
vdsm-xmlrpc-4.17.26-1.el7.noarch
vdsm-infra-4.17.26-1.el7.noarch
vdsm-yajsonrpc-4.17.26-1.el7.noarch
vdsm-python-4.17.26-1.el7.noarch
vdsm-4.17.26-1.el7.noarch
vdsm-cli-4.17.26-1.el7.noarch
vdsm-jsonrpc-4.17.26-1.el7.noarch

[root(a)engine ~]# rpm -qa | grep ovirt
ovirt-engine-wildfly-8.2.1-1.el7.x86_64
ovirt-engine-setup-plugin-ovirt-engine-common-3.6.5.3-1.el7.centos.noarch ovirt-vmconsole-1.0.0-1.el7.centos.noarch
ovirt-engine-cli-3.6.2.0-1.el7.centos.noarch
ovirt-engine-setup-plugin-ovirt-engine-3.6.5.3-1.el7.centos.noarch
ovirt-engine-backend-3.6.5.3-1.el7.centos.noarch
ovirt-iso-uploader-3.6.0-1.el7.centos.noarch
ovirt-engine-extensions-api-impl-3.6.5.3-1.el7.centos.noarch
ovirt-host-deploy-1.4.1-1.el7.centos.noarch
ovirt-release36-007-1.noarch
ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch
ovirt-image-uploader-3.6.0-1.el7.centos.noarch
ovirt-engine-extension-aaa-jdbc-1.0.6-1.el7.noarch
ovirt-setup-lib-1.0.1-1.el7.centos.noarch
ovirt-host-deploy-java-1.4.1-1.el7.centos.noarch
ovirt-engine-setup-base-3.6.5.3-1.el7.centos.noarch
ovirt-engine-setup-plugin-websocket-proxy-3.6.5.3-1.el7.centos.noarch
ovirt-engine-tools-backup-3.6.5.3-1.el7.centos.noarch
ovirt-vmconsole-proxy-1.0.0-1.el7.centos.noarch
ovirt-engine-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch
ovirt-engine-setup-3.6.5.3-1.el7.centos.noarch
ovirt-engine-webadmin-portal-3.6.5.3-1.el7.centos.noarch
ovirt-engine-tools-3.6.5.3-1.el7.centos.noarch
ovirt-engine-restapi-3.6.5.3-1.el7.centos.noarch
ovirt-engine-3.6.5.3-1.el7.centos.noarch
ovirt-engine-wildfly-overlay-8.0.5-1.el7.noarch
ovirt-engine-lib-3.6.5.3-1.el7.centos.noarch
ovirt-engine-websocket-proxy-3.6.5.3-1.el7.centos.noarch
ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarc= h
ovirt-engine-userportal-3.6.5.3-1.el7.centos.noarch
ovirt-engine-dbscripts-3.6.5.3-1.el7.centos.noarch

Thanks,
-- =

Wee


_______________________________________________
Users mailing list
Users(a)ovirt.org
http://lists.ovirt.org/mailman/list=
info/users



-- =

Wee
--------------050000000201060001020000-- --===============1886439265194544800== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS0wNTAwMDAwMDAyMDEwNjAwMDEwMjAwMDAKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PVVURi04OyBmb3JtYXQ9Zmxvd2VkCkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDdiaXQK Ck9uIDMvNS8yNTU5IDEzOjI1LCBrbmFycmEgd3JvdGU6Cj4gT24gMDUvMDMvMjAxNiAwODozNSBB TSwgV2VlIFNyaXRpcHBobyB3cm90ZToKPj4gSGksCj4+Cj4+IEknbSBtYWtpbmcgYSBmcmVzaCBo b3N0ZWQtZW5naW5lIGluc3RhbGxhdGlvbiBvbiAzIGhvc3RzLiBGaXJzdCAyIAo+PiBob3N0cyBz dWNjZWVkZWQsIGJ1dCB0aGUgM3JkIG9uZSBzdHVjayBhdCB0ZXJtaW5hdGlvbiBzdGF0ZSAKPj4g Ikluc3RhbGxpbmcgSG9zdCBob3N0ZWRfZW5naW5lXzMuIFN0YWdlOiBUZXJtaW5hdGlvbi4iLCB0 aGVuLCAzIAo+PiBtaW51dGVzIGxhdGVyLCAiVkRTTSBob3N0ZWRfZW5naW5lXzMgY29tbWFuZCBm YWlsZWQ6IE1lc3NhZ2UgdGltZW91dCAKPj4gd2hpY2ggY2FuIGJlIGNhdXNlZCBieSBjb21tdW5p Y2F0aW9uIGlzc3VlcyIuIEN1cnJlbnRseSwgdGhlIDNyZCBob3N0IAo+PiBzdGF0dXMgaW4gd2Vi IFVJIGlzIHN0dWNrIGF0ICJJbnN0YWxsaW5nIi4KPj4KPj4gSG93IGNhbiBJIHByb2NlZWQ/IENv dWxkIEkganVzdCBydW4gdGhpcyBzY3JpcHQgCj4+IDxodHRwczovL3d3dy5vdmlydC5vcmcvZG9j dW1lbnRhdGlvbi9ob3ctdG8vaG9zdGVkLWVuZ2luZS8jcmVjb3ZpbmctZnJvbS1mYWlsZWQtaW5z dGFsbD4gCj4+IGluIHRoZSAzcmQgaG9zdCwgYW5kIHJ1biAiaG9zdGVkLWVuZ2luZSAtLWRlcGxv eSIgYWdhaW4/Cj4gWW91IGNvdWxkIGRvIHNlcnZpY2Ugb3ZpcnQtZW5naW5lIHJlc3RhcnQgYW5k IHJlbW92ZSB0aGUgaG9zdCBmcm9tIHRoZSAKPiBVSS4gUmVkZXBsb3lpbmcgdGhlIHNlY29uZCB0 aW1lIHNob3VsZCB3b3JrIGZpbmUuClRoYW5rIHlvdS4gVGhpcyBpcyB3aGF0IEkndmUgZG9uZSBh bmQgc3VjY2VlZGVkOgoxLiBTZXQgaG9zdDAzIHRvIG1haW50ZW5hbmNlLgoyLiBSZW1vdmUgaG9z dDAzLgozLiByZWRlcGxveSBob3N0MDMgd2l0aCAiaG9zdGVkLWVuZ2luZSAtLWRlcGxveSIgYnV0 IGZhaWxlZCB3aXRoICJbIApFUlJPUiBdIEZhaWxlZCB0byBleGVjdXRlIHN0YWdlICdQcm9ncmFt cyBkZXRlY3Rpb24nOiBIb3N0ZWQgRW5naW5lIEhBIApzZXJ2aWNlcyBhcmUgYWxyZWFkeSBydW5u aW5nIG9uIHRoaXMgc3lzdGVtLiBIb3N0ZWQgRW5naW5lIGNhbm5vdCBiZSAKZGVwbG95ZWQgb24g YSBob3N0IGFscmVhZHkgcnVubmluZyB0aG9zZSBzZXJ2aWNlcy4iCjQuIFJ1biB0aGUgc2NyaXB0 IGZyb20gCmh0dHBzOi8vd3d3Lm92aXJ0Lm9yZy9kb2N1bWVudGF0aW9uL2hvdy10by9ob3N0ZWQt ZW5naW5lLyNyZWNvdmluZy1mcm9tLWZhaWxlZC1pbnN0YWxsCjUuIEluc3RhbGwgb3ZpcnQtaG9z dGVkLWVuZ2luZS1zZXR1cCBhZ2Fpbi4KNi4gUmVkZXBsb3kgYWdhaW4uCj4+Cj4+IGxvZyBmaWxl czogaHR0cHM6Ly9hcHAuYm94LmNvbS9zL2E1dHlwZmU2Y2JvenM5dW85b3NnNjhndG1xODc5M3Q2 Cj4+Cj4+IFttZUBob3N0MDMgfl0kIHJwbSAtcWEgfCBncmVwIG92aXJ0Cj4+IG92aXJ0LXJlbGVh c2UzNi0wMDctMS5ub2FyY2gKPj4gb3ZpcnQtaG9zdGVkLWVuZ2luZS1zZXR1cC0xLjMuNS4wLTEu MS5lbDcubm9hcmNoCj4+IGxpYmdvdmlydC0wLjMuMy0xLmVsN18yLjEueDg2XzY0Cj4+IG92aXJ0 LWVuZ2luZS1zZGstcHl0aG9uLTMuNi41LjAtMS5lbDcuY2VudG9zLm5vYXJjaAo+PiBvdmlydC1z ZXR1cC1saWItMS4wLjEtMS5lbDcuY2VudG9zLm5vYXJjaAo+PiBvdmlydC12bWNvbnNvbGUtMS4w LjAtMS5lbDcuY2VudG9zLm5vYXJjaAo+PiBvdmlydC12bWNvbnNvbGUtaG9zdC0xLjAuMC0xLmVs Ny5jZW50b3Mubm9hcmNoCj4+IG92aXJ0LWhvc3QtZGVwbG95LTEuNC4xLTEuZWw3LmNlbnRvcy5u b2FyY2gKPj4gb3ZpcnQtaG9zdGVkLWVuZ2luZS1oYS0xLjMuNS4zLTEuMS5lbDcubm9hcmNoCj4+ Cj4+IFttZUBob3N0MDMgfl0kIHJwbSAtcWEgfCBncmVwIHZkc20KPj4gdmRzbS1ob29rLXZtZmV4 LWRldi00LjE3LjI2LTEuZWw3Lm5vYXJjaAo+PiB2ZHNtLXhtbHJwYy00LjE3LjI2LTEuZWw3Lm5v YXJjaAo+PiB2ZHNtLWluZnJhLTQuMTcuMjYtMS5lbDcubm9hcmNoCj4+IHZkc20teWFqc29ucnBj LTQuMTcuMjYtMS5lbDcubm9hcmNoCj4+IHZkc20tcHl0aG9uLTQuMTcuMjYtMS5lbDcubm9hcmNo Cj4+IHZkc20tNC4xNy4yNi0xLmVsNy5ub2FyY2gKPj4gdmRzbS1jbGktNC4xNy4yNi0xLmVsNy5u b2FyY2gKPj4gdmRzbS1qc29ucnBjLTQuMTcuMjYtMS5lbDcubm9hcmNoCj4+Cj4+IFtyb290QGVu Z2luZSB+XSMgcnBtIC1xYSB8IGdyZXAgb3ZpcnQKPj4gb3ZpcnQtZW5naW5lLXdpbGRmbHktOC4y LjEtMS5lbDcueDg2XzY0Cj4+IG92aXJ0LWVuZ2luZS1zZXR1cC1wbHVnaW4tb3ZpcnQtZW5naW5l LWNvbW1vbi0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2gKPj4gb3ZpcnQtdm1jb25zb2xlLTEu MC4wLTEuZWw3LmNlbnRvcy5ub2FyY2gKPj4gb3ZpcnQtZW5naW5lLWNsaS0zLjYuMi4wLTEuZWw3 LmNlbnRvcy5ub2FyY2gKPj4gb3ZpcnQtZW5naW5lLXNldHVwLXBsdWdpbi1vdmlydC1lbmdpbmUt My42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCj4+IG92aXJ0LWVuZ2luZS1iYWNrZW5kLTMuNi41 LjMtMS5lbDcuY2VudG9zLm5vYXJjaAo+PiBvdmlydC1pc28tdXBsb2FkZXItMy42LjAtMS5lbDcu Y2VudG9zLm5vYXJjaAo+PiBvdmlydC1lbmdpbmUtZXh0ZW5zaW9ucy1hcGktaW1wbC0zLjYuNS4z LTEuZWw3LmNlbnRvcy5ub2FyY2gKPj4gb3ZpcnQtaG9zdC1kZXBsb3ktMS40LjEtMS5lbDcuY2Vu dG9zLm5vYXJjaAo+PiBvdmlydC1yZWxlYXNlMzYtMDA3LTEubm9hcmNoCj4+IG92aXJ0LWVuZ2lu ZS1zZGstcHl0aG9uLTMuNi41LjAtMS5lbDcuY2VudG9zLm5vYXJjaAo+PiBvdmlydC1pbWFnZS11 cGxvYWRlci0zLjYuMC0xLmVsNy5jZW50b3Mubm9hcmNoCj4+IG92aXJ0LWVuZ2luZS1leHRlbnNp b24tYWFhLWpkYmMtMS4wLjYtMS5lbDcubm9hcmNoCj4+IG92aXJ0LXNldHVwLWxpYi0xLjAuMS0x LmVsNy5jZW50b3Mubm9hcmNoCj4+IG92aXJ0LWhvc3QtZGVwbG95LWphdmEtMS40LjEtMS5lbDcu Y2VudG9zLm5vYXJjaAo+PiBvdmlydC1lbmdpbmUtc2V0dXAtYmFzZS0zLjYuNS4zLTEuZWw3LmNl bnRvcy5ub2FyY2gKPj4gb3ZpcnQtZW5naW5lLXNldHVwLXBsdWdpbi13ZWJzb2NrZXQtcHJveHkt My42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCj4+IG92aXJ0LWVuZ2luZS10b29scy1iYWNrdXAt My42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCj4+IG92aXJ0LXZtY29uc29sZS1wcm94eS0xLjAu MC0xLmVsNy5jZW50b3Mubm9hcmNoCj4+IG92aXJ0LWVuZ2luZS12bWNvbnNvbGUtcHJveHktaGVs cGVyLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaAo+PiBvdmlydC1lbmdpbmUtc2V0dXAtMy42 LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCj4+IG92aXJ0LWVuZ2luZS13ZWJhZG1pbi1wb3J0YWwt My42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoCj4+IG92aXJ0LWVuZ2luZS10b29scy0zLjYuNS4z LTEuZWw3LmNlbnRvcy5ub2FyY2gKPj4gb3ZpcnQtZW5naW5lLXJlc3RhcGktMy42LjUuMy0xLmVs Ny5jZW50b3Mubm9hcmNoCj4+IG92aXJ0LWVuZ2luZS0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2Fy Y2gKPj4gb3ZpcnQtZW5naW5lLXdpbGRmbHktb3ZlcmxheS04LjAuNS0xLmVsNy5ub2FyY2gKPj4g b3ZpcnQtZW5naW5lLWxpYi0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2gKPj4gb3ZpcnQtZW5n aW5lLXdlYnNvY2tldC1wcm94eS0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2gKPj4gb3ZpcnQt ZW5naW5lLXNldHVwLXBsdWdpbi12bWNvbnNvbGUtcHJveHktaGVscGVyLTMuNi41LjMtMS5lbDcu Y2VudG9zLm5vYXJjaAo+PiBvdmlydC1lbmdpbmUtdXNlcnBvcnRhbC0zLjYuNS4zLTEuZWw3LmNl bnRvcy5ub2FyY2gKPj4gb3ZpcnQtZW5naW5lLWRic2NyaXB0cy0zLjYuNS4zLTEuZWw3LmNlbnRv cy5ub2FyY2gKPj4KPj4gVGhhbmtzLAo+PiAtLSAKPj4gV2VlCj4+Cj4+Cj4+IF9fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCj4+IFVzZXJzIG1haWxpbmcgbGlz dAo+PiBVc2Vyc0BvdmlydC5vcmcKPj4gaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xp c3RpbmZvL3VzZXJzCj4KCi0tIApXZWUKCgotLS0tLS0tLS0tLS0tLTA1MDAwMDAwMDIwMTA2MDAw MTAyMDAwMApDb250ZW50LVR5cGU6IHRleHQvaHRtbDsgY2hhcnNldD1VVEYtOApDb250ZW50LVRy YW5zZmVyLUVuY29kaW5nOiA3Yml0Cgo8aHRtbD4KICA8aGVhZD4KICAgIDxtZXRhIGNvbnRlbnQ9 InRleHQvaHRtbDsgY2hhcnNldD1VVEYtOCIgaHR0cC1lcXVpdj0iQ29udGVudC1UeXBlIj4KICA8 L2hlYWQ+CiAgPGJvZHkgYmdjb2xvcj0iI0ZGRkZGRiIgdGV4dD0iIzAwMDAwMCI+CiAgICBPbiAz LzUvMjU1OSAxMzoyNSwga25hcnJhIHdyb3RlOjxicj4KICAgIDxibG9ja3F1b3RlIGNpdGU9Im1p ZDo1NzI4NDQ0RC43MDAwNzA1QHJlZGhhdC5jb20iIHR5cGU9ImNpdGUiPgogICAgICA8bWV0YSBj b250ZW50PSJ0ZXh0L2h0bWw7IGNoYXJzZXQ9VVRGLTgiIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlw ZSI+CiAgICAgIDxkaXYgY2xhc3M9Im1vei1jaXRlLXByZWZpeCI+T24gMDUvMDMvMjAxNiAwODoz NSBBTSwgV2VlIFNyaXRpcHBobwogICAgICAgIHdyb3RlOjxicj4KICAgICAgPC9kaXY+CiAgICAg IDxibG9ja3F1b3RlIGNpdGU9Im1pZDo1NzI4MTU4Qy40MDcwMzA1QGZvcmVzdC5nby50aCIgdHlw ZT0iY2l0ZSI+CiAgICAgICAgPG1ldGEgaHR0cC1lcXVpdj0iQ29udGV4dC1UeXBlIiBjb250ZW50 PSJ0ZXh0L2h0bWw7ICI+CiAgICAgICAgSGksPGJyPgogICAgICAgIDxicj4KICAgICAgICBJJ20g bWFraW5nIGEgZnJlc2ggaG9zdGVkLWVuZ2luZSBpbnN0YWxsYXRpb24gb24gMyBob3N0cy4gRmly c3QKICAgICAgICAyIGhvc3RzIHN1Y2NlZWRlZCwgYnV0IHRoZSAzcmQgb25lIHN0dWNrIGF0IHRl cm1pbmF0aW9uIHN0YXRlCiAgICAgICAgIkluc3RhbGxpbmcgSG9zdCBob3N0ZWRfZW5naW5lXzMu IFN0YWdlOiBUZXJtaW5hdGlvbi4iLCB0aGVuLCAzCiAgICAgICAgbWludXRlcyBsYXRlciwgIlZE U00gaG9zdGVkX2VuZ2luZV8zIGNvbW1hbmQgZmFpbGVkOiBNZXNzYWdlCiAgICAgICAgdGltZW91 dCB3aGljaCBjYW4gYmUgY2F1c2VkIGJ5IGNvbW11bmljYXRpb24gaXNzdWVzIi4gQ3VycmVudGx5 LAogICAgICAgIHRoZSAzcmQgaG9zdCBzdGF0dXMgaW4gd2ViIFVJIGlzIHN0dWNrIGF0ICJJbnN0 YWxsaW5nIi48YnI+CiAgICAgICAgPGJyPgogICAgICAgIEhvdyBjYW4gSSBwcm9jZWVkPyBDb3Vs ZCBJIGp1c3QgcnVuIDxhIG1vei1kby1ub3Qtc2VuZD0idHJ1ZSIKaHJlZj0iaHR0cHM6Ly93d3cu b3ZpcnQub3JnL2RvY3VtZW50YXRpb24vaG93LXRvL2hvc3RlZC1lbmdpbmUvI3JlY292aW5nLWZy b20tZmFpbGVkLWluc3RhbGwiPnRoaXMKCgogICAgICAgICAgc2NyaXB0PC9hPiBpbiB0aGUgM3Jk IGhvc3QsIGFuZCBydW4gImhvc3RlZC1lbmdpbmUgLS1kZXBsb3kiCiAgICAgICAgYWdhaW4/PGJy PgogICAgICA8L2Jsb2NrcXVvdGU+CiAgICAgIFlvdSBjb3VsZCBkbyBzZXJ2aWNlIG92aXJ0LWVu Z2luZSByZXN0YXJ0IGFuZCByZW1vdmUgdGhlIGhvc3QgZnJvbQogICAgICB0aGUgVUkuIFJlZGVw bG95aW5nIHRoZSBzZWNvbmQgdGltZSBzaG91bGQgd29yayBmaW5lLjxicj4KICAgIDwvYmxvY2tx dW90ZT4KICAgIFRoYW5rIHlvdS4gVGhpcyBpcyB3aGF0IEkndmUgZG9uZSBhbmQgc3VjY2VlZGVk Ojxicj4KICAgIDEuIFNldCBob3N0MDMgdG8gbWFpbnRlbmFuY2UuPGJyPgogICAgMi4gUmVtb3Zl IGhvc3QwMy48YnI+CiAgICAzLiByZWRlcGxveSBob3N0MDMgd2l0aCAiaG9zdGVkLWVuZ2luZSAt LWRlcGxveSIgYnV0IGZhaWxlZCB3aXRoICJbCiAgICBFUlJPUiBdIEZhaWxlZCB0byBleGVjdXRl IHN0YWdlICdQcm9ncmFtcyBkZXRlY3Rpb24nOiBIb3N0ZWQgRW5naW5lCiAgICBIQSBzZXJ2aWNl cyBhcmUgYWxyZWFkeSBydW5uaW5nIG9uIHRoaXMgc3lzdGVtLiBIb3N0ZWQgRW5naW5lIGNhbm5v dAogICAgYmUgZGVwbG95ZWQgb24gYSBob3N0IGFscmVhZHkgcnVubmluZyB0aG9zZSBzZXJ2aWNl cy4iPGJyPgogICAgNC4gUnVuIHRoZSBzY3JpcHQgZnJvbQo8YSBjbGFzcz0ibW96LXR4dC1saW5r LWZyZWV0ZXh0IiBocmVmPSJodHRwczovL3d3dy5vdmlydC5vcmcvZG9jdW1lbnRhdGlvbi9ob3ct dG8vaG9zdGVkLWVuZ2luZS8jcmVjb3ZpbmctZnJvbS1mYWlsZWQtaW5zdGFsbCI+aHR0cHM6Ly93 d3cub3ZpcnQub3JnL2RvY3VtZW50YXRpb24vaG93LXRvL2hvc3RlZC1lbmdpbmUvI3JlY292aW5n LWZyb20tZmFpbGVkLWluc3RhbGw8L2E+PGJyPgogICAgNS4gSW5zdGFsbCBvdmlydC1ob3N0ZWQt ZW5naW5lLXNldHVwIGFnYWluLjxicj4KICAgIDYuIFJlZGVwbG95IGFnYWluLjxicj4KICAgIDxi bG9ja3F1b3RlIGNpdGU9Im1pZDo1NzI4NDQ0RC43MDAwNzA1QHJlZGhhdC5jb20iIHR5cGU9ImNp dGUiPgogICAgICA8YmxvY2txdW90ZSBjaXRlPSJtaWQ6NTcyODE1OEMuNDA3MDMwNUBmb3Jlc3Qu Z28udGgiIHR5cGU9ImNpdGUiPgogICAgICAgIDxicj4KICAgICAgICBsb2cgZmlsZXM6IDxhIG1v ei1kby1ub3Qtc2VuZD0idHJ1ZSIKICAgICAgICAgIGNsYXNzPSJtb3otdHh0LWxpbmstZnJlZXRl eHQiCiAgICAgICAgICBocmVmPSJodHRwczovL2FwcC5ib3guY29tL3MvYTV0eXBmZTZjYm96czl1 bzlvc2c2OGd0bXE4NzkzdDYiPmh0dHBzOi8vYXBwLmJveC5jb20vcy9hNXR5cGZlNmNib3pzOXVv OW9zZzY4Z3RtcTg3OTN0NjwvYT48YnI+CiAgICAgICAgPGJyPgogICAgICAgIFttZUBob3N0MDMg fl0kIHJwbSAtcWEgfCBncmVwIG92aXJ0PGJyPgogICAgICAgIG92aXJ0LXJlbGVhc2UzNi0wMDct MS5ub2FyY2g8YnI+CiAgICAgICAgb3ZpcnQtaG9zdGVkLWVuZ2luZS1zZXR1cC0xLjMuNS4wLTEu MS5lbDcubm9hcmNoPGJyPgogICAgICAgIGxpYmdvdmlydC0wLjMuMy0xLmVsN18yLjEueDg2XzY0 PGJyPgogICAgICAgIG92aXJ0LWVuZ2luZS1zZGstcHl0aG9uLTMuNi41LjAtMS5lbDcuY2VudG9z Lm5vYXJjaDxicj4KICAgICAgICBvdmlydC1zZXR1cC1saWItMS4wLjEtMS5lbDcuY2VudG9zLm5v YXJjaDxicj4KICAgICAgICBvdmlydC12bWNvbnNvbGUtMS4wLjAtMS5lbDcuY2VudG9zLm5vYXJj aDxicj4KICAgICAgICBvdmlydC12bWNvbnNvbGUtaG9zdC0xLjAuMC0xLmVsNy5jZW50b3Mubm9h cmNoPGJyPgogICAgICAgIG92aXJ0LWhvc3QtZGVwbG95LTEuNC4xLTEuZWw3LmNlbnRvcy5ub2Fy Y2g8YnI+CiAgICAgICAgb3ZpcnQtaG9zdGVkLWVuZ2luZS1oYS0xLjMuNS4zLTEuMS5lbDcubm9h cmNoPGJyPgogICAgICAgIDxicj4KICAgICAgICBbbWVAaG9zdDAzIH5dJCBycG0gLXFhIHwgZ3Jl cCB2ZHNtPGJyPgogICAgICAgIHZkc20taG9vay12bWZleC1kZXYtNC4xNy4yNi0xLmVsNy5ub2Fy Y2g8YnI+CiAgICAgICAgdmRzbS14bWxycGMtNC4xNy4yNi0xLmVsNy5ub2FyY2g8YnI+CiAgICAg ICAgdmRzbS1pbmZyYS00LjE3LjI2LTEuZWw3Lm5vYXJjaDxicj4KICAgICAgICB2ZHNtLXlhanNv bnJwYy00LjE3LjI2LTEuZWw3Lm5vYXJjaDxicj4KICAgICAgICB2ZHNtLXB5dGhvbi00LjE3LjI2 LTEuZWw3Lm5vYXJjaDxicj4KICAgICAgICB2ZHNtLTQuMTcuMjYtMS5lbDcubm9hcmNoPGJyPgog ICAgICAgIHZkc20tY2xpLTQuMTcuMjYtMS5lbDcubm9hcmNoPGJyPgogICAgICAgIHZkc20tanNv bnJwYy00LjE3LjI2LTEuZWw3Lm5vYXJjaDxicj4KICAgICAgICA8YnI+CiAgICAgICAgW3Jvb3RA ZW5naW5lIH5dIyBycG0gLXFhIHwgZ3JlcCBvdmlydDxicj4KICAgICAgICBvdmlydC1lbmdpbmUt d2lsZGZseS04LjIuMS0xLmVsNy54ODZfNjQ8YnI+Cm92aXJ0LWVuZ2luZS1zZXR1cC1wbHVnaW4t b3ZpcnQtZW5naW5lLWNvbW1vbi0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAg ICAgb3ZpcnQtdm1jb25zb2xlLTEuMC4wLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgICAg b3ZpcnQtZW5naW5lLWNsaS0zLjYuMi4wLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+Cm92aXJ0LWVu Z2luZS1zZXR1cC1wbHVnaW4tb3ZpcnQtZW5naW5lLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJj aDxicj4KICAgICAgICBvdmlydC1lbmdpbmUtYmFja2VuZC0zLjYuNS4zLTEuZWw3LmNlbnRvcy5u b2FyY2g8YnI+CiAgICAgICAgb3ZpcnQtaXNvLXVwbG9hZGVyLTMuNi4wLTEuZWw3LmNlbnRvcy5u b2FyY2g8YnI+CiAgICAgICAgb3ZpcnQtZW5naW5lLWV4dGVuc2lvbnMtYXBpLWltcGwtMy42LjUu My0xLmVsNy5jZW50b3Mubm9hcmNoPGJyPgogICAgICAgIG92aXJ0LWhvc3QtZGVwbG95LTEuNC4x LTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgICAgb3ZpcnQtcmVsZWFzZTM2LTAwNy0xLm5v YXJjaDxicj4KICAgICAgICBvdmlydC1lbmdpbmUtc2RrLXB5dGhvbi0zLjYuNS4wLTEuZWw3LmNl bnRvcy5ub2FyY2g8YnI+CiAgICAgICAgb3ZpcnQtaW1hZ2UtdXBsb2FkZXItMy42LjAtMS5lbDcu Y2VudG9zLm5vYXJjaDxicj4KICAgICAgICBvdmlydC1lbmdpbmUtZXh0ZW5zaW9uLWFhYS1qZGJj LTEuMC42LTEuZWw3Lm5vYXJjaDxicj4KICAgICAgICBvdmlydC1zZXR1cC1saWItMS4wLjEtMS5l bDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgICBvdmlydC1ob3N0LWRlcGxveS1qYXZhLTEuNC4x LTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgICAgb3ZpcnQtZW5naW5lLXNldHVwLWJhc2Ut My42LjUuMy0xLmVsNy5jZW50b3Mubm9hcmNoPGJyPgpvdmlydC1lbmdpbmUtc2V0dXAtcGx1Z2lu LXdlYnNvY2tldC1wcm94eS0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgICAg b3ZpcnQtZW5naW5lLXRvb2xzLWJhY2t1cC0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+ CiAgICAgICAgb3ZpcnQtdm1jb25zb2xlLXByb3h5LTEuMC4wLTEuZWw3LmNlbnRvcy5ub2FyY2g8 YnI+CiAgICAgICAgb3ZpcnQtZW5naW5lLXZtY29uc29sZS1wcm94eS1oZWxwZXItMy42LjUuMy0x LmVsNy5jZW50b3Mubm9hcmNoPGJyPgogICAgICAgIG92aXJ0LWVuZ2luZS1zZXR1cC0zLjYuNS4z LTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgICAgb3ZpcnQtZW5naW5lLXdlYmFkbWluLXBv cnRhbC0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgICAgb3ZpcnQtZW5naW5l LXRvb2xzLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgICBvdmlydC1lbmdp bmUtcmVzdGFwaS0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgICAgb3ZpcnQt ZW5naW5lLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgICBvdmlydC1lbmdp bmUtd2lsZGZseS1vdmVybGF5LTguMC41LTEuZWw3Lm5vYXJjaDxicj4KICAgICAgICBvdmlydC1l bmdpbmUtbGliLTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgICBvdmlydC1l bmdpbmUtd2Vic29ja2V0LXByb3h5LTMuNi41LjMtMS5lbDcuY2VudG9zLm5vYXJjaDxicj4Kb3Zp cnQtZW5naW5lLXNldHVwLXBsdWdpbi12bWNvbnNvbGUtcHJveHktaGVscGVyLTMuNi41LjMtMS5l bDcuY2VudG9zLm5vYXJjaDxicj4KICAgICAgICBvdmlydC1lbmdpbmUtdXNlcnBvcnRhbC0zLjYu NS4zLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgICAgb3ZpcnQtZW5naW5lLWRic2NyaXB0 cy0zLjYuNS4zLTEuZWw3LmNlbnRvcy5ub2FyY2g8YnI+CiAgICAgICAgPGJyPgogICAgICAgIFRo YW5rcyw8YnI+CiAgICAgICAgPHByZSBjbGFzcz0ibW96LXNpZ25hdHVyZSIgY29scz0iNzIiPi0t IApXZWU8L3ByZT4KICAgICAgICA8YnI+CiAgICAgICAgPGZpZWxkc2V0IGNsYXNzPSJtaW1lQXR0 YWNobWVudEhlYWRlciI+PC9maWVsZHNldD4KICAgICAgICA8YnI+CiAgICAgICAgPHByZSB3cmFw PSIiPl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fClVzZXJz IG1haWxpbmcgbGlzdAo8YSBtb3otZG8tbm90LXNlbmQ9InRydWUiIGNsYXNzPSJtb3otdHh0LWxp bmstYWJicmV2aWF0ZWQiIGhyZWY9Im1haWx0bzpVc2Vyc0BvdmlydC5vcmciPlVzZXJzQG92aXJ0 Lm9yZzwvYT4KPGEgbW96LWRvLW5vdC1zZW5kPSJ0cnVlIiBjbGFzcz0ibW96LXR4dC1saW5rLWZy ZWV0ZXh0IiBocmVmPSJodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNl cnMiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VyczwvYT4KPC9w cmU+CiAgICAgIDwvYmxvY2txdW90ZT4KICAgICAgPGJyPgogICAgPC9ibG9ja3F1b3RlPgogICAg PGJyPgogICAgPHByZSBjbGFzcz0ibW96LXNpZ25hdHVyZSIgY29scz0iNzIiPi0tIApXZWU8L3By ZT4KICA8L2JvZHk+CjwvaHRtbD4KCi0tLS0tLS0tLS0tLS0tMDUwMDAwMDAwMjAxMDYwMDAxMDIw MDAwLS0K --===============1886439265194544800==--