On Thu, Dec 17, 2015 at 9:49 PM, Bello Florent <florent.bello@ville-kourou.fr> wrote:

Hi,

I upgrade my 3 servers to CentOS 7.2 and oVirt 3.6.1, the oVirt engine works fine and my first host upgraded too. However, my second and third host have a ovirt-ha-broker issue and is doesn't start.
When i try to start the broker service, it failed with timeout.

Here my logs of my second upgraded server :

[root@ovirt01 ~]# systemctl status  ovirt-ha-broker
● ovirt-ha-broker.service - oVirt Hosted Engine High Availability Communications Broker
   Loaded: loaded (/usr/lib/systemd/system/ovirt-ha-broker.service; enabled; vendor preset: disabled)
   Active: activating (start) since jeu. 2015-12-17 17:41:46 GFT; 1min 3s ago
  Process: 15245 ExecStart=/usr/lib/systemd/systemd-ovirt-ha-broker start (code=exited, status=0/SUCCESS)
   CGroup: /system.slice/ovirt-ha-broker.service
           └─15259 /usr/bin/python /usr/share/ovirt-hosted-engine-ha/ovirt-ha-broker

déc. 17 17:41:46 ovirt01 systemd[1]: Starting oVirt Hosted Engine High Availability Communications Broker...
déc. 17 17:41:46 ovirt01 systemd[1]: PID 15252 read from file /run/ovirt-hosted-engine-ha/broker.pid does not exist or is a zombie.

 

[root@ovirt01 ~]# systemctl start  ovirt-ha-broker
Job for ovirt-ha-broker.service failed because a timeout was exceeded. See "systemctl status ovirt-ha-broker.service" and "journalctl -xe" for details.

 


Thanks for the report Florent,
just today I experimented it too: we are checking if it's related to this last minute patch from this morning:
https://gerrit.ovirt.org/#/c/50662/

Adding Fabian and Martin.
 

[root@ovirt01 ~]# tail -f /var/log/ovirt-hosted-engine-ha/broker.log
MainThread::INFO::2015-12-17 17:44:28,562::broker::57::ovirt_hosted_engine_ha.broker.broker.Broker::(run) ovirt-hosted-engine-ha broker 1.3.3.4 started
MainThread::INFO::2015-12-17 17:44:28,588::monitor::40::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Searching for submonitors in /usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/broker/submonitors
MainThread::INFO::2015-12-17 17:44:28,588::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load
MainThread::INFO::2015-12-17 17:44:28,590::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine
MainThread::INFO::2015-12-17 17:44:28,591::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health
MainThread::INFO::2015-12-17 17:44:28,591::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free
MainThread::INFO::2015-12-17 17:44:28,591::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-load
MainThread::INFO::2015-12-17 17:44:28,591::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge
MainThread::INFO::2015-12-17 17:44:28,592::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor ping
MainThread::INFO::2015-12-17 17:44:28,592::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load
MainThread::INFO::2015-12-17 17:44:28,593::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor cpu-load-no-engine
MainThread::INFO::2015-12-17 17:44:28,593::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor engine-health
MainThread::INFO::2015-12-17 17:44:28,593::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-free
MainThread::INFO::2015-12-17 17:44:28,594::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mem-load
MainThread::INFO::2015-12-17 17:44:28,594::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor mgmt-bridge
MainThread::INFO::2015-12-17 17:44:28,594::monitor::49::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Loaded submonitor ping
MainThread::INFO::2015-12-17 17:44:28,594::monitor::50::ovirt_hosted_engine_ha.broker.monitor.Monitor::(_discover_submonitors) Finished loading submonitors
MainThread::INFO::2015-12-17 17:44:28,595::listener::41::ovirt_hosted_engine_ha.broker.listener.Listener::(__init__) Initializing SocketServer
MainThread::INFO::2015-12-17 17:44:28,595::listener::56::ovirt_hosted_engine_ha.broker.listener.Listener::(__init__) SocketServer ready
MainThread::INFO::2015-12-17 17:45:59,215::broker::114::ovirt_hosted_engine_ha.broker.broker.Broker::(run) Server shutting down

 

[root@ovirt01 ~]# tail -f /var/log/vdsm/vdsm.log
Reactor thread::INFO::2015-12-17 17:48:19,800::protocoldetector::72::ProtocolDetector.AcceptorImpl::(handle_accept) Accepting connection from 127.0.0.1:44498
Reactor thread::DEBUG::2015-12-17 17:48:19,808::protocoldetector::82::ProtocolDetector.Detector::(__init__) Using required_size=11
Reactor thread::INFO::2015-12-17 17:48:19,808::protocoldetector::118::ProtocolDetector.Detector::(handle_read) Detected protocol xml from 127.0.0.1:44498
Reactor thread::DEBUG::2015-12-17 17:48:19,809::bindingxmlrpc::1297::XmlDetector::(handle_socket) xml over http detected from ('127.0.0.1', 44498)
BindingXMLRPC::INFO::2015-12-17 17:48:19,809::xmlrpc::73::vds.XMLRPCServer::(handle_request) Starting request handler for 127.0.0.1:44498
Thread-185::INFO::2015-12-17 17:48:19,810::xmlrpc::84::vds.XMLRPCServer::(_process_requests) Request handler for 127.0.0.1:44498 started
Thread-185::INFO::2015-12-17 17:48:19,811::xmlrpc::92::vds.XMLRPCServer::(_process_requests) Request handler for 127.0.0.1:44498 stopped

Cordialement,

Florent BELLO


_______________________________________________
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users