How to deploy hosted-engine to the second and later host machines

Hi, I'm running oVirt 4.1.0.4-1. I'm building oVirt+GlusterFS(replica 3 Volume) configuration for testing. Each machine spec is as follows. CPU: 2core Memory: 8GB Disk: 120GB OS: CentOS7.3 Each host name is host1, host2, host3. I installed Hosted Engine successfully in host1, but I couldn't install it in host2 and host3. In version 4.0, as described below, since it is asked whether or not it is an additional host at the time of deployment, hosted_engine could be added to the second and later node without any error. *** oVirt 4.0 *** [root@host2 ~]# hosted-engine --deploy --config-append=answers.conf ... The specified storage location already contains a data domain. Is this an additional host setup (Yes, No)[Yes]? [ INFO ] Installing on additional host Please specify the Host ID [Must be integer, default: 2]: iptables was detected on your computer, do you wish setup to configure it? (Yes, No)[Yes]: No Enter engine admin password: Confirm engine admin password: Enter the name which will be used to identify this host inside the Administrator Portal [hosted_engine_2]: Enter engine admin password: Confirm engine admin password: Enter the name which will be used to identify this host inside the Administrator Portal [hosted_engine_2]: [ INFO ] Stage: Setup validation Please provide the fully qualified domain name of this host. Note: The engine VM and all the other hosts should be able to correctly resolve it. Host FQDN: [host2.jitaku.test]: [WARNING] Failed to resolve host2.jitaku.test using DNS, it can be resolved only locally --== CONFIGURATION PREVIEW ==-- Engine FQDN : ovirt-engine.jitaku.test Bridge name : ovirtmgmt Host address : host2.jitaku.test SSH daemon port : 22 Gateway address : 192.168.12.1 Host name for web application : hosted_engine_2 Storage Domain type : glusterfs Host ID : 2 Image size GB : 10 Storage connection : host1.jitaku.test:/engine Console type : vnc Memory size MB : 6144 MAC address : 00:16:3e:XX:XX:XX Boot type : disk Number of CPUs : 2 CPU Type : model_Nehalem But oVirt 4.1 asks for nothing and return error that host1 already has data. *** oVirt 4.1 *** [root@host2 ~]# hosted-engine --deploy --config-append=answers.conf [ INFO ] Stage: Initializing [ INFO ] Generating a temporary VNC password. [ INFO ] Stage: Environment setup During customization use CTRL-D to abort. [ INFO ] Hardware supports virtualization Configuration files: ['/root/answers.conf'] Log file: /var/log/ovirt-hosted-engine-s etup/ovirt-hosted-engine-setup-20170319010957-2gp4od.log Version: otopi-1.6.1 (otopi-1.6.1-1.el7) [ INFO ] Detecting available oVirt engine appliances [ INFO ] Stage: Environment packages setup [ INFO ] Stage: Programs detection [ INFO ] Stage: Environment setup [ INFO ] Stage: Environment customization --== STORAGE CONFIGURATION ==-- [ INFO ] Please note that Replica 3 support is required for the shared storage. [ INFO ] GlusterFS replica 3 Volume detected [ ERROR ] The selected device already contains a storage domain. [ ERROR ] Setup of additional hosts using this software is not allowed anymore. Please use the engine web interface to deploy any additional hosts. [ ERROR ] Failed to execute stage 'Environment customization': Setup of additional hosts using this software is not allowed anymore. Please use the engine web interface to deploy any additional hosts. [ INFO ] Stage: Clean up [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine- setup/answers/answers-20170319011017.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Hosted Engine deployment failed Log file is located at /var/log/ovirt-hosted-engine-s etup/ovirt-hosted-engine-setup-20170319010957-2gp4od.log I tried it from Virtualization> Hosted Engine> Standard of Cockpit UI, but I received the similar error. How can I deploy hosted-engine on multiple hosts? I'm sorry if I made something misunderstood. Thanks.

On Sat, Mar 18, 2017 at 7:08 PM, Tatsuya <suginami@gmail.com> wrote:
Hi,
I'm running oVirt 4.1.0.4-1. I'm building oVirt+GlusterFS(replica 3 Volume) configuration for testing.
Each machine spec is as follows. CPU: 2core Memory: 8GB Disk: 120GB OS: CentOS7.3
Each host name is host1, host2, host3.
I installed Hosted Engine successfully in host1, but I couldn't install it in host2 and host3.
In version 4.0, as described below, since it is asked whether or not it is an additional host at the time of deployment, hosted_engine could be added to the second and later node without any error.
*** oVirt 4.0 ***
[root@host2 ~]# hosted-engine --deploy --config-append=answers.conf ... The specified storage location already contains a data domain. Is this an additional host setup (Yes, No)[Yes]? [ INFO ] Installing on additional host Please specify the Host ID [Must be integer, default: 2]: iptables was detected on your computer, do you wish setup to configure it? (Yes, No)[Yes]: No
Enter engine admin password: Confirm engine admin password:
Enter the name which will be used to identify this host inside the Administrator Portal [hosted_engine_2]:
Enter engine admin password: Confirm engine admin password: Enter the name which will be used to identify this host inside the Administrator Portal [hosted_engine_2]: [ INFO ] Stage: Setup validation Please provide the fully qualified domain name of this host. Note: The engine VM and all the other hosts should be able to correctly resolve it. Host FQDN: [host2.jitaku.test]: [WARNING] Failed to resolve host2.jitaku.test using DNS, it can be resolved only locally
--== CONFIGURATION PREVIEW ==--
Engine FQDN : ovirt-engine.jitaku.test Bridge name : ovirtmgmt Host address : host2.jitaku.test SSH daemon port : 22 Gateway address : 192.168.12.1 Host name for web application : hosted_engine_2 Storage Domain type : glusterfs Host ID : 2 Image size GB : 10 Storage connection : host1.jitaku.test:/engine Console type : vnc Memory size MB : 6144 MAC address : 00:16:3e:XX:XX:XX Boot type : disk Number of CPUs : 2 CPU Type : model_Nehalem
But oVirt 4.1 asks for nothing and return error that host1 already has data.
*** oVirt 4.1 ***
[root@host2 ~]# hosted-engine --deploy --config-append=answers.conf [ INFO ] Stage: Initializing [ INFO ] Generating a temporary VNC password. [ INFO ] Stage: Environment setup During customization use CTRL-D to abort. [ INFO ] Hardware supports virtualization Configuration files: ['/root/answers.conf'] Log file: /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20170319010957-2gp4od.log Version: otopi-1.6.1 (otopi-1.6.1-1.el7) [ INFO ] Detecting available oVirt engine appliances [ INFO ] Stage: Environment packages setup [ INFO ] Stage: Programs detection [ INFO ] Stage: Environment setup [ INFO ] Stage: Environment customization
--== STORAGE CONFIGURATION ==--
[ INFO ] Please note that Replica 3 support is required for the shared storage. [ INFO ] GlusterFS replica 3 Volume detected [ ERROR ] The selected device already contains a storage domain. [ ERROR ] Setup of additional hosts using this software is not allowed anymore. Please use the engine web interface to deploy any additional hosts. [ ERROR ] Failed to execute stage 'Environment customization': Setup of additional hosts using this software is not allowed anymore. Please use the engine web interface to deploy any additional hosts. [ INFO ] Stage: Clean up [ INFO ] Generating answer file '/var/lib/ovirt-hosted-engine-setup/answers/answers-20170319011017.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Hosted Engine deployment failed Log file is located at /var/log/ovirt-hosted-engine-setup/ovirt-hosted-engine-setup-20170319010957-2gp4od.log
I tried it from Virtualization> Hosted Engine> Standard of Cockpit UI, but I received the similar error. How can I deploy hosted-engine on multiple hosts? I'm sorry if I made something misunderstood.
There is an option to configure hosted-engine when adding a host from the web ui. In 4.1 this is the only way to add a hosted-engine host: https://bugzilla.redhat.com/1366183 Best, -- Didi

Hello Didi. Thank you for the information.
There is an option to configure hosted-engine when adding a host from the web ui. In 4.1 this is the only way to add a hosted-engine host:
Does web ui include Cockpit UI? I tried to install additional Hosted Engine from Cockpit UI but I received a same error which I received on cli.
[ ERROR ] The selected device already contains a storage domain.
I tried from "Start" link, but must I use "Deploy with Gluster *" like following link? http://www.ovirt.org/images/wiki/Deploy-With-Gluster.png?1475063791 * In my case, it's "Hosted Engine with Gluster" I also tried "Hosted Engine with Gluster", but when I ran "deploy" after option selection, "Deployment failed" was displayed in a moment and I could not find a log, so I gave up. Also, when running "Hosted Engine with Gluster", many things are done automatically (create LV and create GlusterFS volume etc.), so I believe there is just another way to simply add hosted engine. If you know, could you please tell me which link should be executed to add hosted-engine? Thanks, Tatsuya

Having same issue here also. hosted-engine --deploy via cli is no longer available and hosted deploy via UI does not work. Host 2 is present in the engine manager and can be controlled via GUI, however engine manager vm cannot be moved to host 2 due to hosted-engine --deploy needing to be run. On 20 March 2017 at 01:41, Tatsuya <suginami@gmail.com> wrote:
Hello Didi.
Thank you for the information.
There is an option to configure hosted-engine when adding a host from the web ui. In 4.1 this is the only way to add a hosted-engine host:
Does web ui include Cockpit UI?
I tried to install additional Hosted Engine from Cockpit UI but I received a same error which I received on cli.
[ ERROR ] The selected device already contains a storage domain.
I tried from "Start" link, but must I use "Deploy with Gluster *" like following link? http://www.ovirt.org/images/wiki/Deploy-With-Gluster.png?1475063791
* In my case, it's "Hosted Engine with Gluster"
I also tried "Hosted Engine with Gluster", but when I ran "deploy" after option selection, "Deployment failed" was displayed in a moment and I could not find a log, so I gave up.
Also, when running "Hosted Engine with Gluster", many things are done automatically (create LV and create GlusterFS volume etc.), so I believe there is just another way to simply add hosted engine.
If you know, could you please tell me which link should be executed to add hosted-engine?
Thanks, Tatsuya
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
-- Ian Neilsen Mobile: 0424 379 762 Linkedin: http://au.linkedin.com/in/ianneilsen Twitter : ineilsen

Found a working option to get second and subsequent hosts deployed with ovirt 4.1 1-Set second host into maintenance 2-highlight second host and choose "Installation --> Reinstall", edit params in popup and click OK 3-Ignore warning that pops up and watch the vdsm.log or look for "Installing" status in webui 4-It should show you that the install is running, keep watching vdsm.log. 5-Click 'ok' on warning and wait patiently for install to finish. Second node comes up and is active. Ian On 20 March 2017 at 09:13, Ian Neilsen <ian.neilsen@gmail.com> wrote:
Having same issue here also.
hosted-engine --deploy via cli is no longer available and hosted deploy via UI does not work. Host 2 is present in the engine manager and can be controlled via GUI, however engine manager vm cannot be moved to host 2 due to hosted-engine --deploy needing to be run.
On 20 March 2017 at 01:41, Tatsuya <suginami@gmail.com> wrote:
Hello Didi.
Thank you for the information.
There is an option to configure hosted-engine when adding a host from the web ui. In 4.1 this is the only way to add a hosted-engine host:
Does web ui include Cockpit UI?
I tried to install additional Hosted Engine from Cockpit UI but I received a same error which I received on cli.
[ ERROR ] The selected device already contains a storage domain.
I tried from "Start" link, but must I use "Deploy with Gluster *" like following link? http://www.ovirt.org/images/wiki/Deploy-With-Gluster.png?1475063791
* In my case, it's "Hosted Engine with Gluster"
I also tried "Hosted Engine with Gluster", but when I ran "deploy" after option selection, "Deployment failed" was displayed in a moment and I could not find a log, so I gave up.
Also, when running "Hosted Engine with Gluster", many things are done automatically (create LV and create GlusterFS volume etc.), so I believe there is just another way to simply add hosted engine.
If you know, could you please tell me which link should be executed to add hosted-engine?
Thanks, Tatsuya
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
-- Ian Neilsen
Mobile: 0424 379 762 Linkedin: http://au.linkedin.com/in/ianneilsen Twitter : ineilsen
-- Ian Neilsen Mobile: 0424 379 762 Linkedin: http://au.linkedin.com/in/ianneilsen Twitter : ineilsen

On Mon, Mar 20, 2017 at 4:52 AM, Ian Neilsen <ian.neilsen@gmail.com> wrote:
Found a working option to get second and subsequent hosts deployed with ovirt 4.1
1-Set second host into maintenance 2-highlight second host and choose "Installation --> Reinstall", edit params in popup and click OK 3-Ignore warning that pops up and watch the vdsm.log or look for "Installing" status in webui 4-It should show you that the install is running, keep watching vdsm.log. 5-Click 'ok' on warning and wait patiently for install to finish.
Second node comes up and is active.
Ian
On 20 March 2017 at 09:13, Ian Neilsen <ian.neilsen@gmail.com> wrote:
Having same issue here also.
hosted-engine --deploy via cli is no longer available and hosted deploy via UI does not work. Host 2 is present in the engine manager and can be controlled via GUI, however engine manager vm cannot be moved to host 2 due to hosted-engine --deploy needing to be run.
On 20 March 2017 at 01:41, Tatsuya <suginami@gmail.com> wrote:
Hello Didi.
Thank you for the information.
There is an option to configure hosted-engine when adding a host from the web ui. In 4.1 this is the only way to add a hosted-engine host:
Does web ui include Cockpit UI?
No, sorry for not being clear. I referred to the engine web admin ui (and also API/SDK). Thanks, Ian, for your reply explaining this.
I tried to install additional Hosted Engine from Cockpit UI but I received a same error which I received on cli.
[ ERROR ] The selected device already contains a storage domain.
I tried from "Start" link, but must I use "Deploy with Gluster *" like following link? http://www.ovirt.org/images/wiki/Deploy-With-Gluster.png?1475063791
* In my case, it's "Hosted Engine with Gluster"
I also tried "Hosted Engine with Gluster", but when I ran "deploy" after option selection, "Deployment failed" was displayed in a moment and I could not find a log, so I gave up.
Also, when running "Hosted Engine with Gluster", many things are done automatically (create LV and create GlusterFS volume etc.), so I believe there is just another way to simply add hosted engine.
If you know, could you please tell me which link should be executed to add hosted-engine?
Thanks, Tatsuya
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
-- Ian Neilsen
Mobile: 0424 379 762 Linkedin: http://au.linkedin.com/in/ianneilsen Twitter : ineilsen
-- Ian Neilsen
Mobile: 0424 379 762 Linkedin: http://au.linkedin.com/in/ianneilsen Twitter : ineilsen
-- Didi

Found a working option to get second and subsequent hosts deployed with ovirt 4.1
1-Set second host into maintenance 2-highlight second host and choose "Installation --> Reinstall", edit
Dear lan and Didi params in popup and click OK
3-Ignore warning that pops up and watch the vdsm.log or look for "Installing" status in webui 4-It should show you that the install is running, keep watching vdsm.log. 5-Click 'ok' on warning and wait patiently for install to finish.
Second node comes up and is active.
No, sorry for not being clear. I referred to the engine web admin ui (and also API/SDK). Thanks, Ian, for your reply explaining this.
I apologize for this late reply.I had been trying again from reinstalling the host. Thanks to you, I was able to install HostedEngine in second and subsequent hosts. I think that I could not find this option by myself. I'm grateful for your support. Regards tatsuya 2017-03-20 16:05 GMT+09:00 Yedidyah Bar David <didi@redhat.com>:
Found a working option to get second and subsequent hosts deployed with ovirt 4.1
1-Set second host into maintenance 2-highlight second host and choose "Installation --> Reinstall", edit
On Mon, Mar 20, 2017 at 4:52 AM, Ian Neilsen <ian.neilsen@gmail.com> wrote: params
in popup and click OK 3-Ignore warning that pops up and watch the vdsm.log or look for "Installing" status in webui 4-It should show you that the install is running, keep watching vdsm.log. 5-Click 'ok' on warning and wait patiently for install to finish.
Second node comes up and is active.
Ian
On 20 March 2017 at 09:13, Ian Neilsen <ian.neilsen@gmail.com> wrote:
Having same issue here also.
hosted-engine --deploy via cli is no longer available and hosted deploy via UI does not work. Host 2 is present in the engine manager and can be controlled via GUI, however engine manager vm cannot be moved to host 2 due to hosted-engine --deploy needing to be run.
On 20 March 2017 at 01:41, Tatsuya <suginami@gmail.com> wrote:
Hello Didi.
Thank you for the information.
There is an option to configure hosted-engine when adding a host from the web ui. In 4.1 this is the only way to add a hosted-engine host:
Does web ui include Cockpit UI?
No, sorry for not being clear. I referred to the engine web admin ui (and also API/SDK). Thanks, Ian, for your reply explaining this.
I tried to install additional Hosted Engine from Cockpit UI but I received a same error which I received on cli.
[ ERROR ] The selected device already contains a storage domain.
I tried from "Start" link, but must I use "Deploy with Gluster *" like following link? http://www.ovirt.org/images/wiki/Deploy-With-Gluster.png?1475063791
* In my case, it's "Hosted Engine with Gluster"
I also tried "Hosted Engine with Gluster", but when I ran "deploy"
after
option selection, "Deployment failed" was displayed in a moment and I could not find a log, so I gave up.
Also, when running "Hosted Engine with Gluster", many things are done automatically (create LV and create GlusterFS volume etc.), so I believe there is just another way to simply add hosted engine.
If you know, could you please tell me which link should be executed to add hosted-engine?
Thanks, Tatsuya
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
-- Ian Neilsen
Mobile: 0424 379 762 Linkedin: http://au.linkedin.com/in/ianneilsen Twitter : ineilsen
-- Ian Neilsen
Mobile: 0424 379 762 Linkedin: http://au.linkedin.com/in/ianneilsen Twitter : ineilsen
-- Didi

On Mon, Mar 20, 2017 at 5:44 PM, Tatsuya <suginami@gmail.com> wrote:
Dear lan and Didi
Found a working option to get second and subsequent hosts deployed with ovirt 4.1
1-Set second host into maintenance 2-highlight second host and choose "Installation --> Reinstall", edit params in popup and click OK 3-Ignore warning that pops up and watch the vdsm.log or look for "Installing" status in webui 4-It should show you that the install is running, keep watching vdsm.log. 5-Click 'ok' on warning and wait patiently for install to finish.
Second node comes up and is active.
No, sorry for not being clear. I referred to the engine web admin ui (and also API/SDK). Thanks, Ian, for your reply explaining this.
I apologize for this late reply.I had been trying again from reinstalling the host.
Thanks to you, I was able to install HostedEngine in second and subsequent hosts. I think that I could not find this option by myself.
Even if you never heard about hosted-engine in previous versions and 4.1 was your first attempt? Any suggestions for improvement to make it easier to find?
I'm grateful for your support.
You might want to open one or more RFEs for some clarifications in the interface - both command line and cockpit - e.g. that if the storage domain is not empty, a message will be emitted saying something like: "To add this host as an additional one to an existing hosted-engine HA cluster, please use the engine web administration ui or the API/SDK". Best, -- Didi
participants (3)
-
Ian Neilsen
-
Tatsuya
-
Yedidyah Bar David