[ovirt-users] ovirt-ha-broker issue after upgrade CentOS 7.1 => 7.2 and oVirt 3.6.0 => 3.6.1

Thu Dec 17 21:36:34 UTC 2015

On Thu, Dec 17, 2015 at 9:49 PM, Bello Florent <
florent.bello at ville-kourou.fr> wrote:

> Hi,
>
> I upgrade my 3 servers to CentOS 7.2 and oVirt 3.6.1, the oVirt engine
> works fine and my first host upgraded too. However, my second and third
> host have a ovirt-ha-broker issue and is doesn't start.
> When i try to start the broker service, it failed with timeout.
>
> Here my logs of my second upgraded server :
>
> [root at ovirt01 ~]# systemctl status  ovirt-ha-broker
> ● ovirt-ha-broker.service - oVirt Hosted Engine High Availability
> Communications Broker
>    Loaded: loaded (/usr/lib/systemd/system/ovirt-ha-broker.service;
> enabled; vendor preset: disabled)
>    Active: activating (start) since jeu. 2015-12-17 17:41:46 GFT; 1min 3s
> ago
>   Process: 15245 ExecStart=/usr/lib/systemd/systemd-ovirt-ha-broker start
> (code=exited, status=0/SUCCESS)
>    CGroup: /system.slice/ovirt-ha-broker.service
>            └─15259 /usr/bin/python
> /usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker
>
> déc. 17 17:41:46 ovirt01 systemd[1]: Starting oVirt Hosted Engine High
> Availability Communications Broker...
> déc. 17 17:41:46 ovirt01 systemd[1]: PID 15252 read from file
> /run/ovirt-hosted-engine-ha/broker.pid does not exist or is a zombie.
>
>
>
> [root at ovirt01 ~]# systemctl start  ovirt-ha-broker
> Job for ovirt-ha-broker.service failed because a timeout was exceeded. See
> "systemctl status ovirt-ha-broker.service" and "journalctl -xe" for details.
>
>
>

Thanks for the report Florent,
just today I experimented it too: we are checking if it's related to this
last minute patch from this morning:
https://gerrit.ovirt.org/#/c/50662/

Adding Fabian and Martin.

> [root at ovirt01 ~]# tail -f /var/log/ovirt-hosted-engine-ha/broker.log
> MainThread::INFO::2015-12-17
> 17:44:28,562::broker::57::ovirt_hosted_engine_ha.broker.broker.Broker::(run)
> ovirt-hosted-engine-ha broker 1.3.3.4 started
> MainThread::INFO::2015-12-17
> 17:44:28,588::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Searching for submonitors in
> /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/submonitors
> MainThread::INFO::2015-12-17
> 17:44:28,588::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Loaded submonitor cpu-load
> MainThread::INFO::2015-12-17
> 17:44:28,590::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Loaded submonitor cpu-load-no-engine
> MainThread::INFO::2015-12-17
> 17:44:28,591::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Loaded submonitor engine-health
> MainThread::INFO::2015-12-17
> 17:44:28,591::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Loaded submonitor mem-free
> MainThread::INFO::2015-12-17
> 17:44:28,591::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Loaded submonitor mem-load
> MainThread::INFO::2015-12-17
> 17:44:28,591::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Loaded submonitor mgmt-bridge
> MainThread::INFO::2015-12-17
> 17:44:28,592::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Loaded submonitor ping
> MainThread::INFO::2015-12-17
> 17:44:28,592::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Loaded submonitor cpu-load
> MainThread::INFO::2015-12-17
> 17:44:28,593::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Loaded submonitor cpu-load-no-engine
> MainThread::INFO::2015-12-17
> 17:44:28,593::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Loaded submonitor engine-health
> MainThread::INFO::2015-12-17
> 17:44:28,593::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Loaded submonitor mem-free
> MainThread::INFO::2015-12-17
> 17:44:28,594::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Loaded submonitor mem-load
> MainThread::INFO::2015-12-17
> 17:44:28,594::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Loaded submonitor mgmt-bridge
> MainThread::INFO::2015-12-17
> 17:44:28,594::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Loaded submonitor ping
> MainThread::INFO::2015-12-17
> 17:44:28,594::monitor::50::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors)
> Finished loading submonitors
> MainThread::INFO::2015-12-17
> 17:44:28,595::listener::41::ovirt_hosted_engine_ha.broker.listener.Listener::(__init__)
> Initializing SocketServer
> MainThread::INFO::2015-12-17
> 17:44:28,595::listener::56::ovirt_hosted_engine_ha.broker.listener.Listener::(__init__)
> SocketServer ready
> MainThread::INFO::2015-12-17
> 17:45:59,215::broker::114::ovirt_hosted_engine_ha.broker.broker.Broker::(run)
> Server shutting down
>
>
>
> [root at ovirt01 ~]# tail -f /var/log/vdsm/vdsm.log
> Reactor thread::INFO::2015-12-17
> 17:48:19,800::protocoldetector::72::ProtocolDetector.AcceptorImpl::(handle_accept)
> Accepting connection from 127.0.0.1:44498
> Reactor thread::DEBUG::2015-12-17
> 17:48:19,808::protocoldetector::82::ProtocolDetector.Detector::(__init__)
> Using required_size=11
> Reactor thread::INFO::2015-12-17
> 17:48:19,808::protocoldetector::118::ProtocolDetector.Detector::(handle_read)
> Detected protocol xml from 127.0.0.1:44498
> Reactor thread::DEBUG::2015-12-17
> 17:48:19,809::bindingxmlrpc::1297::XmlDetector::(handle_socket) xml over
> http detected from ('127.0.0.1', 44498)
> BindingXMLRPC::INFO::2015-12-17
> 17:48:19,809::xmlrpc::73::vds.XMLRPCServer::(handle_request) Starting
> request handler for 127.0.0.1:44498
> Thread-185::INFO::2015-12-17
> 17:48:19,810::xmlrpc::84::vds.XMLRPCServer::(_process_requests) Request
> handler for 127.0.0.1:44498 started
> Thread-185::INFO::2015-12-17
> 17:48:19,811::xmlrpc::92::vds.XMLRPCServer::(_process_requests) Request
> handler for 127.0.0.1:44498 stopped
> Cordialement,
>
> Florent BELLO
>
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20151217/76da4318/attachment-0001.html>