Re: [Users] hosted engine help

From: "Jiri Moskovcak" <jmoskovc(a)redhat.com&gt; To: "Jason Brooks" <jbrooks(a)redhat.com&gt;, "Greg Padgett" <gpadgett(a)redhat.com&gt; Cc: users(a)ovirt.org Sent: Tuesday, March 25, 2014 10:34:16 AM Subject: Re: [Users] hosted engine help On 03/13/2014 05:25 PM, Jason Brooks wrote: > > > ----- Original Message ----- >> From: "Greg Padgett" <gpadgett(a)redhat.com&gt; >> To: "Jason Brooks" <jbrooks(a)redhat.com&gt; >> Cc: "Sandro Bonazzola" <sbonazzo(a)redhat.com&gt;, users(a)ovirt.org, "Martin >> Sivak" <msivak(a)redhat.com&gt; >> Sent: Tuesday, March 11, 2014 7:52:42 AM >> Subject: Re: [Users] hosted engine help >> >> On 03/11/2014 04:09 PM, Sandro Bonazzola wrote: >>> Il 07/03/2014 01:10, Jason Brooks ha scritto: >>>> Hey everyone, I've been testing out oVirt 3.4 w/ hosted engine, and >>>> while I've managed to bring the engine up, I've only been able to do it >>>> manually, using "hosted-engine --vm-start". >>>> >>>> The ovirt-ha-agent service fails reliably for me, erroring out with >>>> "RequestError: Request failed: success." >>>> >>>> I've pasted error passages from the ha agent and vdsm logs below. >>>> >>>> Any pointers? >>>> >>>> Regards, Jason >>>> >>>> *** >>>> >>>> ovirt-ha-agent.log >>>> >>>> MainThread::CRITICAL::2014-03-06 >>>> 18:48:30,622::agent::103::ovirt_hosted_engine_ha.agent.agent.Agent::(run) >>>> Could not start ha-agent >>>> Traceback (most recent call last): >>>> File >>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", >>>> line 97, in run >>>> self._run_agent() >>>> File >>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", >>>> line 154, in _run_agent >>>> >>>> hosted_engine.HostedEngine(self.shutdown_requested).start_monitoring() >>>> File >>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", >>>> line 303, in start_monitoring >>>> for old_state, state, delay in self.fsm: >>>> File >>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py", >>>> line 125, in next >>>> new_data = self.refresh(self._state.data) >>>> File >>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py", >>>> line 77, in refresh >>>> stats.update(self.hosted_engine.collect_stats()) >>>> File >>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", >>>> line 623, in collect_stats >>>> constants.SERVICE_TYPE) >>>> File >>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", >>>> line 171, in get_stats_from_storage >>>> result = self._checked_communicate(request) >>>> File >>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", >>>> line 198, in _checked_communicate >>>> raise RequestError("Request failed: {0}".format(msg)) >>>> RequestError: Request failed: success >>>> >>>> >>>> vdsm.log >>>> >>>> Thread-29::ERROR::2014-03-06 18:48:11,101::API::1607::vds::(_getHaInfo) >>>> failed to retrieve Hosted Engine HA info >>>> Traceback (most recent call last): >>>> File "/usr/share/vdsm/API.py", line 1598, in _getHaInfo >>>> stats = instance.get_all_stats() >>>> File >>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py", >>>> line 86, in get_all_stats >>>> constants.SERVICE_TYPE) >>>> File >>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", >>>> line 171, in get_stats_from_storage >>>> result = self._checked_communicate(request) >>>> File >>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", >>>> line 198, in _checked_communicate >>>> raise RequestError("Request failed: {0}".format(msg)) >>>> RequestError: Request failed: success >>> >>> >>> Greg, Martin, "Request failed: success" ? >> >> Hi Jason, >> >> I talked to Martin about this and opened a bug [1]/submitted a patch [2]. >> Based on your mail, I'm not sure if you experienced a race condition or >> some other issue. This patch should help the former case, but if you're >> still experiencing problems then we would need to investigate further. > > I made these changes to my install and now I get a different error: > > MainThread::CRITICAL::2014-03-13 > 12:05:47,749::agent::103::ovirt_hosted_engine_ha.agent.agent.Agent::(run) > Could not start ha-agent > Traceback (most recent call last): > File > "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", > line 97, in run > self._run_agent() > File > "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", > line 154, in _run_agent > hosted_engine.HostedEngine(self.shutdown_requested).start_monitoring() > File > "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", > line 303, in start_monitoring > for old_state, state, delay in self.fsm: > File > "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py", > line 125, in next > new_data = self.refresh(self._state.data) > File > "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py", > line 77, in refresh > stats.update(self.hosted_engine.collect_stats()) > File > "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", > line 623, in collect_stats > constants.SERVICE_TYPE) > File > "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", > line 171, in get_stats_from_storage > result = self._checked_communicate(request) > File > "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", > line 191, in _checked_communicate > return parts[1] > IndexError: list index out of range > > I'm attaching my vdsm.log, agent.log and broker.log. > > Jason Hi Jason, this bug is already fixed in the latest builds. I was able to successfully install the hosted engine with the following rpms installed.

1. Install and enable the preview repo as described here: http://www.ovirt.org/OVirt_3.4_Test_Day and then install the following packages: http://jenkins.ovirt.org/view/Packaging/job/ovirt-hosted-engine-ha_create... http://jenkins.ovirt.org/view/Packaging/job/ovirt-hosted-engine-setup_cre... --Jirka > > >> >> Thanks, >> Greg >> >> [1] https://bugzilla.redhat.com/show_bug.cgi?id=1075126 >> [2] http://gerrit.ovirt.org/#/c/25621/ >> >>>> >>>> >>>> _______________________________________________ >>>> Users mailing list >>>> Users(a)ovirt.org >>>> http://lists.ovirt.org/mailman/listinfo/users >>>> >>> >>> >> >> >> >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users