[ovirt-users] 3.5 to 3.6 upgrade stuck

[Robert Story]

I have a 3.5 hosted-engine with 5 el7 nodes. Today I tried upgrading to 3.6.
The engine upgrade went great, no problems.

I had a host in maintenance mode, so I added the 3.6 repos and ran yum
update. I waited for the upgrade successful message. I checked the score
for the node, and it was still 2400, not 3400. Tried rebooting, but no
luck. So I put another host in maintenance mode, and had the same result.

Both nodes are getting this error:

MainThread::ERROR::2016-07-21 01:05:04,187::brokerlink::279::ovirt_hosted_engine_ha.lib.brokerlink.BrokerLink::(_communicate) Connection closed: Connection timed out
MainThread::ERROR::2016-07-21 01:05:04,188::agent::205::ovirt_hosted_engine_ha.agent.agent.Agent::(_run_agent) Error: 'Failed to start monitor <type 'type'>, options {'hostname': 'poseidon.netsec'}: Connection timed out' - trying to restart agent

I've attached logs from the second host coming up after a reboot, along
with engine log from the same timeframe.

Any suggestions on a way forward would be greatly appreciated.


Robert

-- 
Senior Software Engineer @ Parsons
-------------- next part --------------
A non-text attachment was scrubbed...
Name: agent.log
Type: text/x-log
Size: 58837 bytes
Desc: not available
URL: <http://lists.ovirt.org/pipermail/users/attachments/20160721/61bc49a5/attachment-0003.bin>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: engine.log
Type: text/x-log
Size: 109576 bytes
Desc: not available
URL: <http://lists.ovirt.org/pipermail/users/attachments/20160721/61bc49a5/attachment-0004.bin>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: vdsm.log
Type: text/x-log
Size: 2734083 bytes
Desc: not available
URL: <http://lists.ovirt.org/pipermail/users/attachments/20160721/61bc49a5/attachment-0005.bin>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: not available
Type: application/pgp-signature
Size: 181 bytes
Desc: OpenPGP digital signature
URL: <http://lists.ovirt.org/pipermail/users/attachments/20160721/61bc49a5/attachment-0001.sig>