
last dec i installed hosted-engine seems to be working, we can migrate the engine to different host. but we need to reinstall everything because of gluster additional configuration. so we did installed hosted-engine. but as per checking. we cannot migrate the engine to other hosts. and the ovirt-ha-agent and ovirt-ha-broker is status is inactive (dead) what are we missing?

В 02:29 +0000 на 16.01.2021 (сб), Ariez Ahito написа:
last dec i installed hosted-engine seems to be working, we can migrate the engine to different host. but we need to reinstall everything because of gluster additional configuration. so we did installed hosted-engine. but as per checking. we cannot migrate the engine to other hosts. and the ovirt-ha-agent and ovirt- ha-broker is status is inactive (dead) what are we missing?
First fix the 2 services before you can move it. Check /var/log/ovirt- hosted-engine-ha/{agent,broker}.log for clues. Start with the broker first. Best Regards, Strahil Nikolov

On Sat, Jan 16, 2021 at 4:31 AM Ariez Ahito <aristotleahito@gmail.com> wrote:
last dec i installed hosted-engine seems to be working, we can migrate the engine to different host. but we need to reinstall everything because of gluster additional configuration. so we did installed hosted-engine. but as per checking. we cannot migrate the engine to other hosts. and the ovirt-ha-agent and ovirt-ha-broker is status is inactive (dead) what are we missing?
Please clarify what exact steps you took. Did you reinstall everything? How? Did you reinstall just one host? How? Best regards, -- Didi

Hi Yedidyah. yep we reinstall everything from scratch even the operating system we reinstalled it. so technically its a fresh install. after successfully setting up the hosted-engine we did add the rest of the node. when i check the node status. its says ovirt agent HA N/A On Sun, 17 Jan 2021, 15:32 Yedidyah Bar David, <didi@redhat.com> wrote:
On Sat, Jan 16, 2021 at 4:31 AM Ariez Ahito <aristotleahito@gmail.com> wrote:
last dec i installed hosted-engine seems to be working, we can migrate
the engine to different host. but we need to reinstall everything because of gluster additional configuration.
so we did installed hosted-engine. but as per checking. we cannot migrate the engine to other hosts. and the ovirt-ha-agent and ovirt-ha-broker is status is inactive (dead) what are we missing?
Please clarify what exact steps you took.
Did you reinstall everything? How?
Did you reinstall just one host? How?
Best regards, -- Didi

On Sun, Jan 17, 2021 at 9:41 AM Aries Ahito <aristotleahito@gmail.com> wrote:
Hi Yedidyah. yep we reinstall everything from scratch even the operating system we reinstalled it. so technically its a fresh install.
after successfully setting up the hosted-engine we did add the rest of the node. when i check the node status. its says ovirt agent HA N/A
Let me understand: 1. You had a hosted-engine setup. You started this by deploying on one host, let's call it host1, and then added another one, let's call it host2. Right? Perhaps you had more than 2, that's not the point, for now. 2. At this point, you could migrate engine VM from host1 to host2 and back and it all worked. 3. Then you decided to reinstall. It sounds like you reinstalled the OS on host1, and then did another hosted-engine deployment there. Did you also use backup? --restore-from-file? Did you use new storage? Existing? If existing, did you clear it before reinstalling? 4. Assuming that you somehow got to a good state re host1, host2 now still points at the old hosted-engine storage domain, so does not "see" the new deployment. You should reinstall the OS there, and then add it as a host to the new engine. Make sure you mark the checkbox "hosted-engine" in "Add host" dialog. Best regards,
On Sun, 17 Jan 2021, 15:32 Yedidyah Bar David, <didi@redhat.com> wrote:
On Sat, Jan 16, 2021 at 4:31 AM Ariez Ahito <aristotleahito@gmail.com> wrote:
last dec i installed hosted-engine seems to be working, we can migrate the engine to different host. but we need to reinstall everything because of gluster additional configuration. so we did installed hosted-engine. but as per checking. we cannot migrate the engine to other hosts. and the ovirt-ha-agent and ovirt-ha-broker is status is inactive (dead) what are we missing?
Please clarify what exact steps you took.
Did you reinstall everything? How?
Did you reinstall just one host? How?
Best regards, -- Didi
-- Didi

1. yes 2. yes it can migrate any of the hosts 3. yes we just tried the new ovirt 4.4. then we decided to used fiber ports and have it bonded. so we reinstalled everything from sratch. 4. Host 1 and the rest of the hosta was completely reinstalled from sratch. even our separate glusterfs storage we deleted the volumes bricks and redo everything. ok ill check it later thanks for your prompt response. On Sun, 17 Jan 2021, 16:01 Yedidyah Bar David, <didi@redhat.com> wrote:
On Sun, Jan 17, 2021 at 9:41 AM Aries Ahito <aristotleahito@gmail.com> wrote:
Hi Yedidyah. yep we reinstall everything from scratch even the operating
system we reinstalled it. so technically its a fresh install.
after successfully setting up the hosted-engine we did add the rest of
the node. when i check the node status. its says ovirt agent HA N/A
Let me understand:
1. You had a hosted-engine setup. You started this by deploying on one host, let's call it host1, and then added another one, let's call it host2. Right? Perhaps you had more than 2, that's not the point, for now.
2. At this point, you could migrate engine VM from host1 to host2 and back and it all worked.
3. Then you decided to reinstall. It sounds like you reinstalled the OS on host1, and then did another hosted-engine deployment there. Did you also use backup? --restore-from-file? Did you use new storage? Existing? If existing, did you clear it before reinstalling?
4. Assuming that you somehow got to a good state re host1, host2 now still points at the old hosted-engine storage domain, so does not "see" the new deployment. You should reinstall the OS there, and then add it as a host to the new engine. Make sure you mark the checkbox "hosted-engine" in "Add host" dialog.
Best regards,
On Sun, 17 Jan 2021, 15:32 Yedidyah Bar David, <didi@redhat.com> wrote:
On Sat, Jan 16, 2021 at 4:31 AM Ariez Ahito <aristotleahito@gmail.com>
wrote:
last dec i installed hosted-engine seems to be working, we can
migrate the engine to different host. but we need to reinstall everything because of gluster additional configuration.
so we did installed hosted-engine. but as per checking. we cannot migrate the engine to other hosts. and the ovirt-ha-agent and ovirt-ha-broker is status is inactive (dead) what are we missing?
Please clarify what exact steps you took.
Did you reinstall everything? How?
Did you reinstall just one host? How?
Best regards, -- Didi
-- Didi

i tried all to remove all the hosts. run clean self hosted engine deployment. then i tried to add host again. and in hosted-engine tab. i tick drop down and chose "deploy". after adding all host have active ovirt-ha-agent and have score of (3400) when i tried to migrate the hosted-engine it keeps on failing. except for number 8 hosts. i can now migrated from host 1 and host 8. but rest of the hosts keeps failing.. On Sun, Jan 17, 2021 at 4:15 PM Aries Ahito <aristotleahito@gmail.com> wrote:
1. yes
2. yes it can migrate any of the hosts
3. yes we just tried the new ovirt 4.4. then we decided to used fiber ports and have it bonded. so we reinstalled everything from sratch.
4. Host 1 and the rest of the hosta was completely reinstalled from sratch. even our separate glusterfs storage we deleted the volumes bricks and redo everything. ok ill check it later thanks for your prompt response.
On Sun, 17 Jan 2021, 16:01 Yedidyah Bar David, <didi@redhat.com> wrote:
On Sun, Jan 17, 2021 at 9:41 AM Aries Ahito <aristotleahito@gmail.com> wrote:
Hi Yedidyah. yep we reinstall everything from scratch even the
operating system we reinstalled it. so technically its a fresh install.
after successfully setting up the hosted-engine we did add the rest of
the node. when i check the node status. its says ovirt agent HA N/A
Let me understand:
1. You had a hosted-engine setup. You started this by deploying on one host, let's call it host1, and then added another one, let's call it host2. Right? Perhaps you had more than 2, that's not the point, for now.
2. At this point, you could migrate engine VM from host1 to host2 and back and it all worked.
3. Then you decided to reinstall. It sounds like you reinstalled the OS on host1, and then did another hosted-engine deployment there. Did you also use backup? --restore-from-file? Did you use new storage? Existing? If existing, did you clear it before reinstalling?
4. Assuming that you somehow got to a good state re host1, host2 now still points at the old hosted-engine storage domain, so does not "see" the new deployment. You should reinstall the OS there, and then add it as a host to the new engine. Make sure you mark the checkbox "hosted-engine" in "Add host" dialog.
Best regards,
On Sun, 17 Jan 2021, 15:32 Yedidyah Bar David, <didi@redhat.com> wrote:
On Sat, Jan 16, 2021 at 4:31 AM Ariez Ahito <aristotleahito@gmail.com>
wrote:
last dec i installed hosted-engine seems to be working, we can
migrate the engine to different host. but we need to reinstall everything because of gluster additional configuration.
so we did installed hosted-engine. but as per checking. we cannot migrate the engine to other hosts. and the ovirt-ha-agent and ovirt-ha-broker is status is inactive (dead) what are we missing?
Please clarify what exact steps you took.
Did you reinstall everything? How?
Did you reinstall just one host? How?
Best regards, -- Didi
-- Didi
-- Aristotle D. Ahito --------------------------

After you removed the hosts, and before you added them again: Did you reinstall the OS? If not, there might be some mess left behind. I suggest to try again: Remove a host, reinstall the OS on it, then add it back and make sure you choose "Deploy". Then give it some time to update (should not be more than a few minutes, let's say 1 hour). If it still does not look good, please check/share all relevant logs. Thanks. Best regards, On Mon, Jan 18, 2021 at 3:14 PM Aries Ahito <aristotleahito@gmail.com> wrote:
i tried all to remove all the hosts. run clean self hosted engine deployment. then i tried to add host again. and in hosted-engine tab. i tick drop down and chose "deploy".
after adding all host have active ovirt-ha-agent and have score of (3400) when i tried to migrate the hosted-engine it keeps on failing. except for number 8 hosts. i can now migrated from host 1 and host 8. but rest of the hosts keeps failing..
On Sun, Jan 17, 2021 at 4:15 PM Aries Ahito <aristotleahito@gmail.com> wrote:
1. yes
2. yes it can migrate any of the hosts
3. yes we just tried the new ovirt 4.4. then we decided to used fiber ports and have it bonded. so we reinstalled everything from sratch.
4. Host 1 and the rest of the hosta was completely reinstalled from sratch. even our separate glusterfs storage we deleted the volumes bricks and redo everything. ok ill check it later thanks for your prompt response.
On Sun, 17 Jan 2021, 16:01 Yedidyah Bar David, <didi@redhat.com> wrote:
On Sun, Jan 17, 2021 at 9:41 AM Aries Ahito <aristotleahito@gmail.com> wrote:
Hi Yedidyah. yep we reinstall everything from scratch even the operating system we reinstalled it. so technically its a fresh install.
after successfully setting up the hosted-engine we did add the rest of the node. when i check the node status. its says ovirt agent HA N/A
Let me understand:
1. You had a hosted-engine setup. You started this by deploying on one host, let's call it host1, and then added another one, let's call it host2. Right? Perhaps you had more than 2, that's not the point, for now.
2. At this point, you could migrate engine VM from host1 to host2 and back and it all worked.
3. Then you decided to reinstall. It sounds like you reinstalled the OS on host1, and then did another hosted-engine deployment there. Did you also use backup? --restore-from-file? Did you use new storage? Existing? If existing, did you clear it before reinstalling?
4. Assuming that you somehow got to a good state re host1, host2 now still points at the old hosted-engine storage domain, so does not "see" the new deployment. You should reinstall the OS there, and then add it as a host to the new engine. Make sure you mark the checkbox "hosted-engine" in "Add host" dialog.
Best regards,
On Sun, 17 Jan 2021, 15:32 Yedidyah Bar David, <didi@redhat.com> wrote:
On Sat, Jan 16, 2021 at 4:31 AM Ariez Ahito <aristotleahito@gmail.com> wrote:
last dec i installed hosted-engine seems to be working, we can migrate the engine to different host. but we need to reinstall everything because of gluster additional configuration. so we did installed hosted-engine. but as per checking. we cannot migrate the engine to other hosts. and the ovirt-ha-agent and ovirt-ha-broker is status is inactive (dead) what are we missing?
Please clarify what exact steps you took.
Did you reinstall everything? How?
Did you reinstall just one host? How?
Best regards, -- Didi
-- Didi
-- Aristotle D. Ahito --------------------------
-- Didi

its fine now. i just shutdown and start the engine using hosted-engine --vm-shutdown hosted-engine --vm-start thank you very much On Mon, 18 Jan 2021, 21:19 Yedidyah Bar David, <didi@redhat.com> wrote:
After you removed the hosts, and before you added them again: Did you reinstall the OS? If not, there might be some mess left behind. I suggest to try again: Remove a host, reinstall the OS on it, then add it back and make sure you choose "Deploy". Then give it some time to update (should not be more than a few minutes, let's say 1 hour). If it still does not look good, please check/share all relevant logs. Thanks.
Best regards,
On Mon, Jan 18, 2021 at 3:14 PM Aries Ahito <aristotleahito@gmail.com> wrote:
i tried all to remove all the hosts. run clean self hosted engine
deployment. then i tried to add host again. and in hosted-engine tab. i tick drop down and chose "deploy".
after adding all host have active ovirt-ha-agent and have score of
(3400) when i tried to migrate the hosted-engine it keeps on failing. except for number 8 hosts. i can now migrated from host 1 and host 8. but rest of the hosts keeps failing..
On Sun, Jan 17, 2021 at 4:15 PM Aries Ahito <aristotleahito@gmail.com>
1. yes
2. yes it can migrate any of the hosts
3. yes we just tried the new ovirt 4.4. then we decided to used fiber
wrote: ports and have it bonded. so we reinstalled everything from sratch.
4. Host 1 and the rest of the hosta was completely reinstalled from
sratch. even our separate glusterfs storage we deleted the volumes bricks and redo everything. ok ill check it later thanks for your prompt response.
On Sun, 17 Jan 2021, 16:01 Yedidyah Bar David, <didi@redhat.com> wrote:
On Sun, Jan 17, 2021 at 9:41 AM Aries Ahito <aristotleahito@gmail.com>
wrote:
Hi Yedidyah. yep we reinstall everything from scratch even the
operating system we reinstalled it. so technically its a fresh install.
after successfully setting up the hosted-engine we did add the rest
of the node. when i check the node status. its says ovirt agent HA N/A
Let me understand:
1. You had a hosted-engine setup. You started this by deploying on one host, let's call it host1, and then added another one, let's call it host2. Right? Perhaps you had more than 2, that's not the point, for now.
2. At this point, you could migrate engine VM from host1 to host2 and back and it all worked.
3. Then you decided to reinstall. It sounds like you reinstalled the OS on host1, and then did another hosted-engine deployment there. Did you also use backup? --restore-from-file? Did you use new storage? Existing? If existing, did you clear it before reinstalling?
4. Assuming that you somehow got to a good state re host1, host2 now still points at the old hosted-engine storage domain, so does not "see" the new deployment. You should reinstall the OS there, and then add it as a host to the new engine. Make sure you mark the checkbox "hosted-engine" in "Add host" dialog.
Best regards,
On Sun, 17 Jan 2021, 15:32 Yedidyah Bar David, <didi@redhat.com>
wrote:
On Sat, Jan 16, 2021 at 4:31 AM Ariez Ahito <
aristotleahito@gmail.com> wrote:
> > last dec i installed hosted-engine seems to be working, we can migrate the engine to different host. but we need to reinstall everything because of gluster additional configuration. > so we did installed hosted-engine. but as per checking. we cannot migrate the engine to other hosts. and the ovirt-ha-agent and ovirt-ha-broker is status is inactive (dead) what are we missing?
Please clarify what exact steps you took.
Did you reinstall everything? How?
Did you reinstall just one host? How?
Best regards, -- Didi
-- Didi
-- Aristotle D. Ahito --------------------------
-- Didi

I was avoiding reloading the OS. This to me was like "reboot as a fix"... to wipe environment out and restart, vs repair where I learn how to debug. But after weeks... I am running out of time.

On Mon, Jan 18, 2021 at 10:29 PM penguin pages <jeremey.wise@gmail.com> wrote:
I was avoiding reloading the OS. This to me was like "reboot as a fix"... to wipe environment out and restart, vs repair where I learn how to debug.
There is no simple and reliable way to undo 'hosted-engine --deploy'. It's not designed for that. 'ovirt-hosted-engine-cleanup' is only a partial solution, and if it does not work for you, an OS reinstall should usually be quick and easy (especially if you have PXE setup, etc.). This is unlike 'engine-setup'. engine-setup is used also for upgrades, so it's very important that it cleanly rolls back to a previous clean state if it runs into a problem. In that regard, 'engine-cleanup' is not that important as well, although we do fix bugs in it. 'hosted-engine --deploy' should always be ran on a clean and new system anyway, so if it runs into a problem, it should not be a loss to reinstall the OS.
But after weeks... I am running out of time.
Exactly. It's a tradeoff. It's simply not worth it. Sorry for the time you wasted. Please reinstall :-). That said, if you run into concrete bugs that can reliably be reproduced, including in ovirt-hosted-engine-cleanup, please report them! Thanks. Good luck and best regards, -- Didi

So.. redeploy of three physical systems with CentOS8-Stream ... And was gearing up to install oVirt via cockpit or CLI.... but got a bug response back from RH on bugzilla... need input from oVirt team https://bugzilla.redhat.com/show_bug.cgi?id=1917011 Question: 1) For those of us who need more advanced channels the "free RHEL..." CentOS streams is our only path.. or to move to something like Ubuntu etc.. which has its own set of issues.. Does the oVirt team have issues with centOS streams or am I sticking my neck out to get chopped off 2) When I run HCI deployment... is their any work or means to scan the data volume and import VMs it finds? To rebuild my five or six VMs that keeping would be helpful would take a few hours.. .. My concern is what it would take when I have a few dozen.. or... how many tid-bits of disks / files will be left around because maybe I did not clean it up manually very well. 3) In future.. I think I need to export VMs to a dedicated "backup volume" on some kind of schedule. Is their any tools or thoughts on this. Ex: My two node DNS/LDAP/Kerberos / IPLB / DHCP / Plex .. VMs.. I just can't afford this recovery time to happen again because of a patch.

2) When I run HCI deployment... is their any work or means to scan the data volume and import VMs it finds? To rebuild my five or six VMs that keeping would be helpful would take a few hours.. .. My concern is what it would take when I have a few dozen.. or... how many tid-bits of disks / files will be left around because maybe I did not clean it up manually very well. Ovirt can import VMs and templates from any storage it has previously created. The only hicup is when you have your VM split between storage domains (for example disk1 - storage1, disk2 - storage2) , but there are workarounds for that too. Stream is still buggy and I'm considering using RHEL 8 with the new DEV subscription.
Best Regards, Strahil Nikolov
participants (5)
-
Aries Ahito
-
Ariez Ahito
-
penguin pages
-
Strahil Nikolov
-
Yedidyah Bar David