Additional hosted-engine host deployment failed due to message timeout

This is a multi-part message in MIME format. --------------080805070702090104010500 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Hi, I'm making a fresh hosted-engine installation on 3 hosts. First 2 hosts succeeded, but the 3rd one stuck at termination state "Installing Host hosted_engine_3. Stage: Termination.", then, 3 minutes later, "VDSM hosted_engine_3 command failed: Message timeout which can be caused by communication issues". Currently, the 3rd host status in web UI is stuck at "Installing". How can I proceed? Could I just run this script <https://www.ovirt.org/documentation/how-to/hosted-engine/#recoving-from-failed-install> in the 3rd host, and run "hosted-engine --deploy" again? log files: https://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6 [me@host03 ~]$ rpm -qa | grep ovirt ovirt-release36-007-1.noarch ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch libgovirt-0.3.3-1.el7_2.1.x86_64 ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch ovirt-setup-lib-1.0.1-1.el7.centos.noarch ovirt-vmconsole-1.0.0-1.el7.centos.noarch ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch ovirt-host-deploy-1.4.1-1.el7.centos.noarch ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch [me@host03 ~]$ rpm -qa | grep vdsm vdsm-hook-vmfex-dev-4.17.26-1.el7.noarch vdsm-xmlrpc-4.17.26-1.el7.noarch vdsm-infra-4.17.26-1.el7.noarch vdsm-yajsonrpc-4.17.26-1.el7.noarch vdsm-python-4.17.26-1.el7.noarch vdsm-4.17.26-1.el7.noarch vdsm-cli-4.17.26-1.el7.noarch vdsm-jsonrpc-4.17.26-1.el7.noarch [root@engine ~]# rpm -qa | grep ovirt ovirt-engine-wildfly-8.2.1-1.el7.x86_64 ovirt-engine-setup-plugin-ovirt-engine-common-3.6.5.3-1.el7.centos.noarch ovirt-vmconsole-1.0.0-1.el7.centos.noarch ovirt-engine-cli-3.6.2.0-1.el7.centos.noarch ovirt-engine-setup-plugin-ovirt-engine-3.6.5.3-1.el7.centos.noarch ovirt-engine-backend-3.6.5.3-1.el7.centos.noarch ovirt-iso-uploader-3.6.0-1.el7.centos.noarch ovirt-engine-extensions-api-impl-3.6.5.3-1.el7.centos.noarch ovirt-host-deploy-1.4.1-1.el7.centos.noarch ovirt-release36-007-1.noarch ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch ovirt-image-uploader-3.6.0-1.el7.centos.noarch ovirt-engine-extension-aaa-jdbc-1.0.6-1.el7.noarch ovirt-setup-lib-1.0.1-1.el7.centos.noarch ovirt-host-deploy-java-1.4.1-1.el7.centos.noarch ovirt-engine-setup-base-3.6.5.3-1.el7.centos.noarch ovirt-engine-setup-plugin-websocket-proxy-3.6.5.3-1.el7.centos.noarch ovirt-engine-tools-backup-3.6.5.3-1.el7.centos.noarch ovirt-vmconsole-proxy-1.0.0-1.el7.centos.noarch ovirt-engine-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch ovirt-engine-setup-3.6.5.3-1.el7.centos.noarch ovirt-engine-webadmin-portal-3.6.5.3-1.el7.centos.noarch ovirt-engine-tools-3.6.5.3-1.el7.centos.noarch ovirt-engine-restapi-3.6.5.3-1.el7.centos.noarch ovirt-engine-3.6.5.3-1.el7.centos.noarch ovirt-engine-wildfly-overlay-8.0.5-1.el7.noarch ovirt-engine-lib-3.6.5.3-1.el7.centos.noarch ovirt-engine-websocket-proxy-3.6.5.3-1.el7.centos.noarch ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch ovirt-engine-userportal-3.6.5.3-1.el7.centos.noarch ovirt-engine-dbscripts-3.6.5.3-1.el7.centos.noarch Thanks, -- Wee --------------080805070702090104010500 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 7bit <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> </head> <body bgcolor="#FFFFFF" text="#000000"> Hi,<br> <br> I'm making a fresh hosted-engine installation on 3 hosts. First 2 hosts succeeded, but the 3rd one stuck at termination state "Installing Host hosted_engine_3. Stage: Termination.", then, 3 minutes later, "VDSM hosted_engine_3 command failed: Message timeout which can be caused by communication issues". Currently, the 3rd host status in web UI is stuck at "Installing".<br> <br> How can I proceed? Could I just run <a href="https://www.ovirt.org/documentation/how-to/hosted-engine/#recoving-from-failed-install">this script</a> in the 3rd host, and run "hosted-engine --deploy" again?<br> <br> log files: <a class="moz-txt-link-freetext" href="https://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6">https://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6</a><br> <br> [me@host03 ~]$ rpm -qa | grep ovirt<br> ovirt-release36-007-1.noarch<br> ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch<br> libgovirt-0.3.3-1.el7_2.1.x86_64<br> ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch<br> ovirt-setup-lib-1.0.1-1.el7.centos.noarch<br> ovirt-vmconsole-1.0.0-1.el7.centos.noarch<br> ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch<br> ovirt-host-deploy-1.4.1-1.el7.centos.noarch<br> ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch<br> <br> [me@host03 ~]$ rpm -qa | grep vdsm<br> vdsm-hook-vmfex-dev-4.17.26-1.el7.noarch<br> vdsm-xmlrpc-4.17.26-1.el7.noarch<br> vdsm-infra-4.17.26-1.el7.noarch<br> vdsm-yajsonrpc-4.17.26-1.el7.noarch<br> vdsm-python-4.17.26-1.el7.noarch<br> vdsm-4.17.26-1.el7.noarch<br> vdsm-cli-4.17.26-1.el7.noarch<br> vdsm-jsonrpc-4.17.26-1.el7.noarch<br> <br> [root@engine ~]# rpm -qa | grep ovirt<br> ovirt-engine-wildfly-8.2.1-1.el7.x86_64<br> ovirt-engine-setup-plugin-ovirt-engine-common-3.6.5.3-1.el7.centos.noarch<br> ovirt-vmconsole-1.0.0-1.el7.centos.noarch<br> ovirt-engine-cli-3.6.2.0-1.el7.centos.noarch<br> ovirt-engine-setup-plugin-ovirt-engine-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-backend-3.6.5.3-1.el7.centos.noarch<br> ovirt-iso-uploader-3.6.0-1.el7.centos.noarch<br> ovirt-engine-extensions-api-impl-3.6.5.3-1.el7.centos.noarch<br> ovirt-host-deploy-1.4.1-1.el7.centos.noarch<br> ovirt-release36-007-1.noarch<br> ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch<br> ovirt-image-uploader-3.6.0-1.el7.centos.noarch<br> ovirt-engine-extension-aaa-jdbc-1.0.6-1.el7.noarch<br> ovirt-setup-lib-1.0.1-1.el7.centos.noarch<br> ovirt-host-deploy-java-1.4.1-1.el7.centos.noarch<br> ovirt-engine-setup-base-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-setup-plugin-websocket-proxy-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-tools-backup-3.6.5.3-1.el7.centos.noarch<br> ovirt-vmconsole-proxy-1.0.0-1.el7.centos.noarch<br> ovirt-engine-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-setup-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-webadmin-portal-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-tools-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-restapi-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-wildfly-overlay-8.0.5-1.el7.noarch<br> ovirt-engine-lib-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-websocket-proxy-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-userportal-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-dbscripts-3.6.5.3-1.el7.centos.noarch<br> <br> Thanks,<br> <pre class="moz-signature" cols="72">-- Wee</pre> </body> </html> --------------080805070702090104010500--

This is a multi-part message in MIME format. --------------030304010602020000040400 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit On 05/03/2016 08:35 AM, Wee Sritippho wrote:
Hi,
I'm making a fresh hosted-engine installation on 3 hosts. First 2 hosts succeeded, but the 3rd one stuck at termination state "Installing Host hosted_engine_3. Stage: Termination.", then, 3 minutes later, "VDSM hosted_engine_3 command failed: Message timeout which can be caused by communication issues". Currently, the 3rd host status in web UI is stuck at "Installing".
How can I proceed? Could I just run this script <https://www.ovirt.org/documentation/how-to/hosted-engine/#recoving-from-failed-install> in the 3rd host, and run "hosted-engine --deploy" again? You could do service ovirt-engine restart and remove the host from the UI. Redeploying the second time should work fine.
log files: https://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6
[me@host03 ~]$ rpm -qa | grep ovirt ovirt-release36-007-1.noarch ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch libgovirt-0.3.3-1.el7_2.1.x86_64 ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch ovirt-setup-lib-1.0.1-1.el7.centos.noarch ovirt-vmconsole-1.0.0-1.el7.centos.noarch ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch ovirt-host-deploy-1.4.1-1.el7.centos.noarch ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch
[me@host03 ~]$ rpm -qa | grep vdsm vdsm-hook-vmfex-dev-4.17.26-1.el7.noarch vdsm-xmlrpc-4.17.26-1.el7.noarch vdsm-infra-4.17.26-1.el7.noarch vdsm-yajsonrpc-4.17.26-1.el7.noarch vdsm-python-4.17.26-1.el7.noarch vdsm-4.17.26-1.el7.noarch vdsm-cli-4.17.26-1.el7.noarch vdsm-jsonrpc-4.17.26-1.el7.noarch
[root@engine ~]# rpm -qa | grep ovirt ovirt-engine-wildfly-8.2.1-1.el7.x86_64 ovirt-engine-setup-plugin-ovirt-engine-common-3.6.5.3-1.el7.centos.noarch ovirt-vmconsole-1.0.0-1.el7.centos.noarch ovirt-engine-cli-3.6.2.0-1.el7.centos.noarch ovirt-engine-setup-plugin-ovirt-engine-3.6.5.3-1.el7.centos.noarch ovirt-engine-backend-3.6.5.3-1.el7.centos.noarch ovirt-iso-uploader-3.6.0-1.el7.centos.noarch ovirt-engine-extensions-api-impl-3.6.5.3-1.el7.centos.noarch ovirt-host-deploy-1.4.1-1.el7.centos.noarch ovirt-release36-007-1.noarch ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch ovirt-image-uploader-3.6.0-1.el7.centos.noarch ovirt-engine-extension-aaa-jdbc-1.0.6-1.el7.noarch ovirt-setup-lib-1.0.1-1.el7.centos.noarch ovirt-host-deploy-java-1.4.1-1.el7.centos.noarch ovirt-engine-setup-base-3.6.5.3-1.el7.centos.noarch ovirt-engine-setup-plugin-websocket-proxy-3.6.5.3-1.el7.centos.noarch ovirt-engine-tools-backup-3.6.5.3-1.el7.centos.noarch ovirt-vmconsole-proxy-1.0.0-1.el7.centos.noarch ovirt-engine-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch ovirt-engine-setup-3.6.5.3-1.el7.centos.noarch ovirt-engine-webadmin-portal-3.6.5.3-1.el7.centos.noarch ovirt-engine-tools-3.6.5.3-1.el7.centos.noarch ovirt-engine-restapi-3.6.5.3-1.el7.centos.noarch ovirt-engine-3.6.5.3-1.el7.centos.noarch ovirt-engine-wildfly-overlay-8.0.5-1.el7.noarch ovirt-engine-lib-3.6.5.3-1.el7.centos.noarch ovirt-engine-websocket-proxy-3.6.5.3-1.el7.centos.noarch ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch ovirt-engine-userportal-3.6.5.3-1.el7.centos.noarch ovirt-engine-dbscripts-3.6.5.3-1.el7.centos.noarch
Thanks, -- Wee
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--------------030304010602020000040400 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: 7bit <html> <head> <meta content="text/html; charset=windows-1252" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <div class="moz-cite-prefix">On 05/03/2016 08:35 AM, Wee Sritippho wrote:<br> </div> <blockquote cite="mid:5728158C.4070305@forest.go.th" type="cite"> <meta http-equiv="Context-Type" content="text/html; charset=utf-8"> Hi,<br> <br> I'm making a fresh hosted-engine installation on 3 hosts. First 2 hosts succeeded, but the 3rd one stuck at termination state "Installing Host hosted_engine_3. Stage: Termination.", then, 3 minutes later, "VDSM hosted_engine_3 command failed: Message timeout which can be caused by communication issues". Currently, the 3rd host status in web UI is stuck at "Installing".<br> <br> How can I proceed? Could I just run <a moz-do-not-send="true" href="https://www.ovirt.org/documentation/how-to/hosted-engine/#recoving-from-failed-install">this script</a> in the 3rd host, and run "hosted-engine --deploy" again?<br> </blockquote> You could do service ovirt-engine restart and remove the host from the UI. Redeploying the second time should work fine.<br> <blockquote cite="mid:5728158C.4070305@forest.go.th" type="cite"> <br> log files: <a moz-do-not-send="true" class="moz-txt-link-freetext" href="https://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6">https://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6</a><br> <br> [me@host03 ~]$ rpm -qa | grep ovirt<br> ovirt-release36-007-1.noarch<br> ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch<br> libgovirt-0.3.3-1.el7_2.1.x86_64<br> ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch<br> ovirt-setup-lib-1.0.1-1.el7.centos.noarch<br> ovirt-vmconsole-1.0.0-1.el7.centos.noarch<br> ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch<br> ovirt-host-deploy-1.4.1-1.el7.centos.noarch<br> ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch<br> <br> [me@host03 ~]$ rpm -qa | grep vdsm<br> vdsm-hook-vmfex-dev-4.17.26-1.el7.noarch<br> vdsm-xmlrpc-4.17.26-1.el7.noarch<br> vdsm-infra-4.17.26-1.el7.noarch<br> vdsm-yajsonrpc-4.17.26-1.el7.noarch<br> vdsm-python-4.17.26-1.el7.noarch<br> vdsm-4.17.26-1.el7.noarch<br> vdsm-cli-4.17.26-1.el7.noarch<br> vdsm-jsonrpc-4.17.26-1.el7.noarch<br> <br> [root@engine ~]# rpm -qa | grep ovirt<br> ovirt-engine-wildfly-8.2.1-1.el7.x86_64<br> ovirt-engine-setup-plugin-ovirt-engine-common-3.6.5.3-1.el7.centos.noarch<br> ovirt-vmconsole-1.0.0-1.el7.centos.noarch<br> ovirt-engine-cli-3.6.2.0-1.el7.centos.noarch<br> ovirt-engine-setup-plugin-ovirt-engine-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-backend-3.6.5.3-1.el7.centos.noarch<br> ovirt-iso-uploader-3.6.0-1.el7.centos.noarch<br> ovirt-engine-extensions-api-impl-3.6.5.3-1.el7.centos.noarch<br> ovirt-host-deploy-1.4.1-1.el7.centos.noarch<br> ovirt-release36-007-1.noarch<br> ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch<br> ovirt-image-uploader-3.6.0-1.el7.centos.noarch<br> ovirt-engine-extension-aaa-jdbc-1.0.6-1.el7.noarch<br> ovirt-setup-lib-1.0.1-1.el7.centos.noarch<br> ovirt-host-deploy-java-1.4.1-1.el7.centos.noarch<br> ovirt-engine-setup-base-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-setup-plugin-websocket-proxy-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-tools-backup-3.6.5.3-1.el7.centos.noarch<br> ovirt-vmconsole-proxy-1.0.0-1.el7.centos.noarch<br> ovirt-engine-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-setup-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-webadmin-portal-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-tools-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-restapi-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-wildfly-overlay-8.0.5-1.el7.noarch<br> ovirt-engine-lib-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-websocket-proxy-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-userportal-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-dbscripts-3.6.5.3-1.el7.centos.noarch<br> <br> Thanks,<br> <pre class="moz-signature" cols="72">-- Wee</pre> <br> <fieldset class="mimeAttachmentHeader"></fieldset> <br> <pre wrap="">_______________________________________________ Users mailing list <a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a> <a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a> </pre> </blockquote> <br> </body> </html> --------------030304010602020000040400--

This is a multi-part message in MIME format. --------------050000000201060001020000 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 3/5/2559 13:25, knarra wrote: > On 05/03/2016 08:35 AM, Wee Sritippho wrote: >> Hi, >> >> I'm making a fresh hosted-engine installation on 3 hosts. First 2 >> hosts succeeded, but the 3rd one stuck at termination state >> "Installing Host hosted_engine_3. Stage: Termination.", then, 3 >> minutes later, "VDSM hosted_engine_3 command failed: Message timeout >> which can be caused by communication issues". Currently, the 3rd host >> status in web UI is stuck at "Installing". >> >> How can I proceed? Could I just run this script >> <https://www.ovirt.org/documentation/how-to/hosted-engine/#recoving-from-failed-install> >> in the 3rd host, and run "hosted-engine --deploy" again? > You could do service ovirt-engine restart and remove the host from the > UI. Redeploying the second time should work fine. Thank you. This is what I've done and succeeded: 1. Set host03 to maintenance. 2. Remove host03. 3. redeploy host03 with "hosted-engine --deploy" but failed with "[ ERROR ] Failed to execute stage 'Programs detection': Hosted Engine HA services are already running on this system. Hosted Engine cannot be deployed on a host already running those services." 4. Run the script from https://www.ovirt.org/documentation/how-to/hosted-engine/#recoving-from-failed-install 5. Install ovirt-hosted-engine-setup again. 6. Redeploy again. >> >> log files: https://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6 >> >> [me@host03 ~]$ rpm -qa | grep ovirt >> ovirt-release36-007-1.noarch >> ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch >> libgovirt-0.3.3-1.el7_2.1.x86_64 >> ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch >> ovirt-setup-lib-1.0.1-1.el7.centos.noarch >> ovirt-vmconsole-1.0.0-1.el7.centos.noarch >> ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch >> ovirt-host-deploy-1.4.1-1.el7.centos.noarch >> ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch >> >> [me@host03 ~]$ rpm -qa | grep vdsm >> vdsm-hook-vmfex-dev-4.17.26-1.el7.noarch >> vdsm-xmlrpc-4.17.26-1.el7.noarch >> vdsm-infra-4.17.26-1.el7.noarch >> vdsm-yajsonrpc-4.17.26-1.el7.noarch >> vdsm-python-4.17.26-1.el7.noarch >> vdsm-4.17.26-1.el7.noarch >> vdsm-cli-4.17.26-1.el7.noarch >> vdsm-jsonrpc-4.17.26-1.el7.noarch >> >> [root@engine ~]# rpm -qa | grep ovirt >> ovirt-engine-wildfly-8.2.1-1.el7.x86_64 >> ovirt-engine-setup-plugin-ovirt-engine-common-3.6.5.3-1.el7.centos.noarch >> ovirt-vmconsole-1.0.0-1.el7.centos.noarch >> ovirt-engine-cli-3.6.2.0-1.el7.centos.noarch >> ovirt-engine-setup-plugin-ovirt-engine-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-backend-3.6.5.3-1.el7.centos.noarch >> ovirt-iso-uploader-3.6.0-1.el7.centos.noarch >> ovirt-engine-extensions-api-impl-3.6.5.3-1.el7.centos.noarch >> ovirt-host-deploy-1.4.1-1.el7.centos.noarch >> ovirt-release36-007-1.noarch >> ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch >> ovirt-image-uploader-3.6.0-1.el7.centos.noarch >> ovirt-engine-extension-aaa-jdbc-1.0.6-1.el7.noarch >> ovirt-setup-lib-1.0.1-1.el7.centos.noarch >> ovirt-host-deploy-java-1.4.1-1.el7.centos.noarch >> ovirt-engine-setup-base-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-setup-plugin-websocket-proxy-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-tools-backup-3.6.5.3-1.el7.centos.noarch >> ovirt-vmconsole-proxy-1.0.0-1.el7.centos.noarch >> ovirt-engine-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-setup-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-webadmin-portal-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-tools-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-restapi-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-wildfly-overlay-8.0.5-1.el7.noarch >> ovirt-engine-lib-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-websocket-proxy-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-userportal-3.6.5.3-1.el7.centos.noarch >> ovirt-engine-dbscripts-3.6.5.3-1.el7.centos.noarch >> >> Thanks, >> -- >> Wee >> >> >> _______________________________________________ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users > -- Wee --------------050000000201060001020000 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 7bit <html> <head> <meta content="text/html; charset=UTF-8" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> On 3/5/2559 13:25, knarra wrote:<br> <blockquote cite="mid:5728444D.7000705@redhat.com" type="cite"> <meta content="text/html; charset=UTF-8" http-equiv="Content-Type"> <div class="moz-cite-prefix">On 05/03/2016 08:35 AM, Wee Sritippho wrote:<br> </div> <blockquote cite="mid:5728158C.4070305@forest.go.th" type="cite"> <meta http-equiv="Context-Type" content="text/html; "> Hi,<br> <br> I'm making a fresh hosted-engine installation on 3 hosts. First 2 hosts succeeded, but the 3rd one stuck at termination state "Installing Host hosted_engine_3. Stage: Termination.", then, 3 minutes later, "VDSM hosted_engine_3 command failed: Message timeout which can be caused by communication issues". Currently, the 3rd host status in web UI is stuck at "Installing".<br> <br> How can I proceed? Could I just run <a moz-do-not-send="true" href="https://www.ovirt.org/documentation/how-to/hosted-engine/#recoving-from-failed-install">this script</a> in the 3rd host, and run "hosted-engine --deploy" again?<br> </blockquote> You could do service ovirt-engine restart and remove the host from the UI. Redeploying the second time should work fine.<br> </blockquote> Thank you. This is what I've done and succeeded:<br> 1. Set host03 to maintenance.<br> 2. Remove host03.<br> 3. redeploy host03 with "hosted-engine --deploy" but failed with "[ ERROR ] Failed to execute stage 'Programs detection': Hosted Engine HA services are already running on this system. Hosted Engine cannot be deployed on a host already running those services."<br> 4. Run the script from <a class="moz-txt-link-freetext" href="https://www.ovirt.org/documentation/how-to/hosted-engine/#recoving-from-failed-install">https://www.ovirt.org/documentation/how-to/hosted-engine/#recoving-from-failed-install</a><br> 5. Install ovirt-hosted-engine-setup again.<br> 6. Redeploy again.<br> <blockquote cite="mid:5728444D.7000705@redhat.com" type="cite"> <blockquote cite="mid:5728158C.4070305@forest.go.th" type="cite"> <br> log files: <a moz-do-not-send="true" class="moz-txt-link-freetext" href="https://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6">https://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6</a><br> <br> [me@host03 ~]$ rpm -qa | grep ovirt<br> ovirt-release36-007-1.noarch<br> ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch<br> libgovirt-0.3.3-1.el7_2.1.x86_64<br> ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch<br> ovirt-setup-lib-1.0.1-1.el7.centos.noarch<br> ovirt-vmconsole-1.0.0-1.el7.centos.noarch<br> ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch<br> ovirt-host-deploy-1.4.1-1.el7.centos.noarch<br> ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch<br> <br> [me@host03 ~]$ rpm -qa | grep vdsm<br> vdsm-hook-vmfex-dev-4.17.26-1.el7.noarch<br> vdsm-xmlrpc-4.17.26-1.el7.noarch<br> vdsm-infra-4.17.26-1.el7.noarch<br> vdsm-yajsonrpc-4.17.26-1.el7.noarch<br> vdsm-python-4.17.26-1.el7.noarch<br> vdsm-4.17.26-1.el7.noarch<br> vdsm-cli-4.17.26-1.el7.noarch<br> vdsm-jsonrpc-4.17.26-1.el7.noarch<br> <br> [root@engine ~]# rpm -qa | grep ovirt<br> ovirt-engine-wildfly-8.2.1-1.el7.x86_64<br> ovirt-engine-setup-plugin-ovirt-engine-common-3.6.5.3-1.el7.centos.noarch<br> ovirt-vmconsole-1.0.0-1.el7.centos.noarch<br> ovirt-engine-cli-3.6.2.0-1.el7.centos.noarch<br> ovirt-engine-setup-plugin-ovirt-engine-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-backend-3.6.5.3-1.el7.centos.noarch<br> ovirt-iso-uploader-3.6.0-1.el7.centos.noarch<br> ovirt-engine-extensions-api-impl-3.6.5.3-1.el7.centos.noarch<br> ovirt-host-deploy-1.4.1-1.el7.centos.noarch<br> ovirt-release36-007-1.noarch<br> ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch<br> ovirt-image-uploader-3.6.0-1.el7.centos.noarch<br> ovirt-engine-extension-aaa-jdbc-1.0.6-1.el7.noarch<br> ovirt-setup-lib-1.0.1-1.el7.centos.noarch<br> ovirt-host-deploy-java-1.4.1-1.el7.centos.noarch<br> ovirt-engine-setup-base-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-setup-plugin-websocket-proxy-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-tools-backup-3.6.5.3-1.el7.centos.noarch<br> ovirt-vmconsole-proxy-1.0.0-1.el7.centos.noarch<br> ovirt-engine-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-setup-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-webadmin-portal-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-tools-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-restapi-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-wildfly-overlay-8.0.5-1.el7.noarch<br> ovirt-engine-lib-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-websocket-proxy-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-userportal-3.6.5.3-1.el7.centos.noarch<br> ovirt-engine-dbscripts-3.6.5.3-1.el7.centos.noarch<br> <br> Thanks,<br> <pre class="moz-signature" cols="72">-- Wee</pre> <br> <fieldset class="mimeAttachmentHeader"></fieldset> <br> <pre wrap="">_______________________________________________ Users mailing list <a moz-do-not-send="true" class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a> <a moz-do-not-send="true" class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a> </pre> </blockquote> <br> </blockquote> <br> <pre class="moz-signature" cols="72">-- Wee</pre> </body> </html> --------------050000000201060001020000--

On Tue, May 3, 2016 at 5:05 AM, Wee Sritippho <wee.s@forest.go.th> wrote:
Hi,
I'm making a fresh hosted-engine installation on 3 hosts. First 2 hosts succeeded, but the 3rd one stuck at termination state "Installing Host hosted_engine_3. Stage: Termination.", then, 3 minutes later, "VDSM hosted_engine_3 command failed: Message timeout which can be caused by communication issues". Currently, the 3rd host status in web UI is stuck at "Installing".
How can I proceed? Could I just run this script in the 3rd host, and run "hosted-engine --deploy" again?
log files: https://app.box.com/s/a5typfe6cbozs9uo9osg68gtmq8793t6
The error is here: 2016-05-03 08:43:49,760 ERROR [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (org.ovirt.thread.pool-8-thread-9) [454e2dc8] Correlation ID: null, Call Stack: null, Custom Event ID: -1, Message: VDSM hosted_engine_3 command failed: Message timeout which can be caused by communication issues 2016-05-03 08:43:49,760 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-8-thread-9) [454e2dc8] Command 'PollVDSCommand(HostName = hosted_engine_3, VdsIdVDSCommandParametersBase:{runAsync='true', hostId='ed3526a1-6a03-44a7-a9a5-e3b346384ac4'})' execution failed: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues 2016-05-03 08:43:49,760 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-8-thread-9) [454e2dc8] Error: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues 2016-05-03 08:43:49,760 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (org.ovirt.thread.pool-8-thread-9) [454e2dc8] Exception: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: VDSGenericException: VDSNetworkException: Message timeout which can be caused by communication issues at org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase.proceedProxyReturnValue(BrokerCommandBase.java:188) [vdsbroker.jar:] at org.ovirt.engine.core.vdsbroker.vdsbroker.FutureVDSCommand.get(FutureVDSCommand.java:73) [vdsbroker.jar:] at org.ovirt.engine.core.bll.network.host.HostSetupNetworkPoller.poll(HostSetupNetworkPoller.java:30) [bll.jar:] at org.ovirt.engine.core.bll.network.host.HostSetupNetworksCommand.invokeSetupNetworksCommand(HostSetupNetworksCommand.java:423) [bll.jar:] at org.ovirt.engine.core.bll.network.host.HostSetupNetworksCommand.executeCommand(HostSetupNetworksCommand.java:256) [bll.jar:] This is something that happens after the engine called setupNetworks and, due to some side effects, it loose the communication with the host. The issue is tracked here: https://bugzilla.redhat.com/1323465 we are going to solve for 3.6.6 As Knarra said, you can simply try redeploying it and it could work: this issue is not fully systematic. In order to retry you need to remove your host from the engine and in order to do that you probably need to move it to maintenance mode.
[me@host03 ~]$ rpm -qa | grep ovirt ovirt-release36-007-1.noarch ovirt-hosted-engine-setup-1.3.5.0-1.1.el7.noarch libgovirt-0.3.3-1.el7_2.1.x86_64 ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch ovirt-setup-lib-1.0.1-1.el7.centos.noarch ovirt-vmconsole-1.0.0-1.el7.centos.noarch ovirt-vmconsole-host-1.0.0-1.el7.centos.noarch ovirt-host-deploy-1.4.1-1.el7.centos.noarch ovirt-hosted-engine-ha-1.3.5.3-1.1.el7.noarch
[me@host03 ~]$ rpm -qa | grep vdsm vdsm-hook-vmfex-dev-4.17.26-1.el7.noarch vdsm-xmlrpc-4.17.26-1.el7.noarch vdsm-infra-4.17.26-1.el7.noarch vdsm-yajsonrpc-4.17.26-1.el7.noarch vdsm-python-4.17.26-1.el7.noarch vdsm-4.17.26-1.el7.noarch vdsm-cli-4.17.26-1.el7.noarch vdsm-jsonrpc-4.17.26-1.el7.noarch
[root@engine ~]# rpm -qa | grep ovirt ovirt-engine-wildfly-8.2.1-1.el7.x86_64 ovirt-engine-setup-plugin-ovirt-engine-common-3.6.5.3-1.el7.centos.noarch ovirt-vmconsole-1.0.0-1.el7.centos.noarch ovirt-engine-cli-3.6.2.0-1.el7.centos.noarch ovirt-engine-setup-plugin-ovirt-engine-3.6.5.3-1.el7.centos.noarch ovirt-engine-backend-3.6.5.3-1.el7.centos.noarch ovirt-iso-uploader-3.6.0-1.el7.centos.noarch ovirt-engine-extensions-api-impl-3.6.5.3-1.el7.centos.noarch ovirt-host-deploy-1.4.1-1.el7.centos.noarch ovirt-release36-007-1.noarch ovirt-engine-sdk-python-3.6.5.0-1.el7.centos.noarch ovirt-image-uploader-3.6.0-1.el7.centos.noarch ovirt-engine-extension-aaa-jdbc-1.0.6-1.el7.noarch ovirt-setup-lib-1.0.1-1.el7.centos.noarch ovirt-host-deploy-java-1.4.1-1.el7.centos.noarch ovirt-engine-setup-base-3.6.5.3-1.el7.centos.noarch ovirt-engine-setup-plugin-websocket-proxy-3.6.5.3-1.el7.centos.noarch ovirt-engine-tools-backup-3.6.5.3-1.el7.centos.noarch ovirt-vmconsole-proxy-1.0.0-1.el7.centos.noarch ovirt-engine-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch ovirt-engine-setup-3.6.5.3-1.el7.centos.noarch ovirt-engine-webadmin-portal-3.6.5.3-1.el7.centos.noarch ovirt-engine-tools-3.6.5.3-1.el7.centos.noarch ovirt-engine-restapi-3.6.5.3-1.el7.centos.noarch ovirt-engine-3.6.5.3-1.el7.centos.noarch ovirt-engine-wildfly-overlay-8.0.5-1.el7.noarch ovirt-engine-lib-3.6.5.3-1.el7.centos.noarch ovirt-engine-websocket-proxy-3.6.5.3-1.el7.centos.noarch ovirt-engine-setup-plugin-vmconsole-proxy-helper-3.6.5.3-1.el7.centos.noarch ovirt-engine-userportal-3.6.5.3-1.el7.centos.noarch ovirt-engine-dbscripts-3.6.5.3-1.el7.centos.noarch
Thanks,
-- Wee
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
participants (3)
-
knarra
-
Simone Tiraboschi
-
Wee Sritippho