Many thanks again for taking the time to try and help me recover this machine (even though it would have been far easier to simply redeploy it...)
>
>
> Sadly enough, it seems that --clean-metadata requires an active agent.
> E.g.
> $ hosted-engine --clean-metadata
> The hosted engine configuration has not been retrieved from shared storage. Please ensure that ovirt-ha-agent
> is running and the storage server is reachable.
Did you try to search the net/list archives?
Yes. All of them seem to repeat the same clean-metadata command (which fails).
>
> Can I manually delete the metadata state files?
Yes, see e.g.:
https://lists.ovirt.org/pipermail/users/2016-April/072676.html
As an alternative to the 'find' command there, you can also find the IDs with:
$ grep metadata /etc/ovirt-hosted-engine/hosted-engine.conf
Best regards,
--
Didi
Yippie! Success (At least it seems that way...)
I stopped the broker and agent services, archived the existing hosted metadata files, created an empty 1GB metadata file using dd, (dd if=/dev/zero of=/run/vdsm/storage/<uuid>/<uuid> bs=1M count=1024), making double sure permissions (0660 / 0644), owner (vdsm:kvm) and SELinux labels (restorecon, just incase) stay the same.
Let everything settle down.
Restarted the services....
... and everything is up again :)
I plan to let the engine run overnight with zero VMs (making sure all backups are fully up-to-date).
Once done, I'll return to normal (until I replace this setup with a normal multi-node setup).
Many thanks again!
- Gilboa