Status Update:

During migration between Host1 and Host3, links are being created and I see no Errors as before in the agent/broker logs.

Having all links in place, and having waited 24hours, for potential Engine updates, I tried to deploy HE on Host2:

Part1:

• From oVirt UI – HostedEngine Deploy
• Imeddiately on Host2 started seeing messages like “ Is the HostedEngine deployed ?”
• hosted-engine.conf got populated only with host_id and ca_path
• it failed

Part2:

• I noticed that during deployment no links in /var/rund/vdsm/storage/<hosted_storage_id> were created
• Copied hosted-engine.conf from Host1 to Host2
• Replace the host_id with correct value
• Reran the deployment
• Noticed that /var/rund/vdsm/storage/<hosted_storage_id> two links got created, one of them being the link to metadata_image
• Host1 and Host3 hosted-engine –vm-status was showing Host2 but with status unknown/stale data
• Deployment failed

Part3:

• Since link to conf_image was not created in first phase, I added it manually
• Populated the hosted-engine.conf
• Reran the deployment
• Same result
• Hosted-engine.conf on Host2 would end up with only host_id and ca_path values and deployment would fail

At this point, I cleaned up all hosted-engie remains from Host2 using ovirt-hosted-engine-cleanup and removed metadata of Host2 from host1 and Host3

I am out of ideas. It seems that Host1 and Host3 are happily operating, but I am unable to add any other hosts to HE pool.

Please assist if you have any ideas.

I am open to executing restore – but I would much rather like to at least discover where or what is the problem, before moving to planning restore.

-----

kind regards/met vriendelijke groeten

Marko Vrgotic
Sr. System Engineer @ System Administration

ActiveVideo

o: +31 (35) 6774131

m: +31 (65) 5734174

e: m.vrgotic@activevideo.com
w: www.activevideo.com

ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited.  If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message.

From: Marko Vrgotic <M.Vrgotic@activevideo.com>
Date: Wednesday, 5 May 2021 at 12:16
To: Strahil Nikolov <hunter86_bg@yahoo.com>, Yedidyah Bar David <didi@redhat.com>
Cc: users@ovirt.org <users@ovirt.org>
Subject: Re: [ovirt-users] Re: Unable to migrate Engine to another HE Host

Both hosts have same agent.conf:

❯ cat <(ssh root@ovirt-sj-01.ictv.com 'cat /etc/ovirt-hosted-engine-ha/agent.conf')

[score]

# NOTE: These values must be the same for all hosts in the HA cluster!

base-score=3400

network-score-penalty=1600

not-uptodate-config-penalty=1000

mgmt-bridge-score-penalty=600

free-memory-score-penalty=400

cpu-load-score-penalty=1000

engine-retry-score-penalty=50

cpu-load-penalty-min=0.4

cpu-load-penalty-max=0.9

❯ cat <(ssh root@ovirt-sj-03.ictv.com 'cat /etc/ovirt-hosted-engine-ha/agent.conf')

[score]

# NOTE: These values must be the same for all hosts in the HA cluster!

base-score=3400

network-score-penalty=1600

not-uptodate-config-penalty=1000

mgmt-bridge-score-penalty=600

free-memory-score-penalty=400

cpu-load-score-penalty=1000

engine-retry-score-penalty=50

cpu-load-penalty-min=0.4

cpu-load-penalty-max=0.9

And its same on the good platform:

❯ ssh root@ovirt-hv-01.avinity.tv 'cat /etc/ovirt-hosted-engine-ha/agent.conf'

[score]

# NOTE: These values must be the same for all hosts in the HA cluster!

base-score=3400

network-score-penalty=1600

not-uptodate-config-penalty=1000

mgmt-bridge-score-penalty=600

free-memory-score-penalty=400

cpu-load-score-penalty=1000

engine-retry-score-penalty=50

cpu-load-penalty-min=0.4

cpu-load-penalty-max=0.9

-----

kind regards/met vriendelijke groeten

Marko Vrgotic
Sr. System Engineer @ System Administration

ActiveVideo

o: +31 (35) 6774131

m: +31 (65) 5734174

e: m.vrgotic@activevideo.com
w: www.activevideo.com

ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The Netherlands. The information contained in this message may be legally privileged and confidential. It is intended to be read only by the individual or entity to whom it is addressed or by their designee. If the reader of this message is not the intended recipient, you are on notice that any distribution of this message, in any form, is strictly prohibited.  If you have received this message in error, please immediately notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and delete or destroy any copy of this message.

From: Strahil Nikolov <hunter86_bg@yahoo.com>
Date: Wednesday, 5 May 2021 at 00:08
To: Marko Vrgotic <M.Vrgotic@activevideo.com>, Marko Vrgotic <M.Vrgotic@activevideo.com>, Yedidyah Bar David <didi@redhat.com>
Cc: users@ovirt.org <users@ovirt.org>
Subject: Re: [ovirt-users] Re: Unable to migrate Engine to another HE Host

***CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender!!!***

Yes,

/etc/ovirt-hosted-engine-ha/agent.conf should be enough.

Best Regards,

Strahil Nikolov