Hi Stefan,
it seems that there is some conflict on brick level (that's why it is ?????????).
Just move the files in the brick to another location and then restart the broker and agent:
[root@kvm380 ~]# mkdir /root/broken_stuff; mv /gluster_bricks/engine/engine/36663740-576a-4498-b28e-0a402628c6a7/ha_agent/* /root/broken_stuff/
Then repeat for the rest of the gluster bricks.
Next, list the contents from your post again and it should be empty - > then you can stop and then start ovirt-ha-broker and ovirt-ha-agent:
hosted-engine --set-maintenance --mode=global
systemctl stop ovirt-ha-broker ovirt-ha-agent
systemctl start ovirt-ha-broker; systemctl start ovirt-ha-agent
Next observe what is going on:
tail -f /var/log/ovirt-hosted-engine-ha/{agent,broker}.log
After several minutes the links will be created and the agent will know what to do with the engine.
Don't forget to remove the maintenance , once you verify that all hosts have running ovirt-ha-broker & ovirt-ha-agent.
Best Regards,
Strahil Nikolov