[Users] hosted engine help

[Jason Brooks]

----- Original Message -----
> From: "Greg Padgett" <gpadgett at redhat.com>
> To: "Jason Brooks" <jbrooks at redhat.com>
> Cc: "Sandro Bonazzola" <sbonazzo at redhat.com>, users at ovirt.org, "Martin Sivak" <msivak at redhat.com>
> Sent: Tuesday, March 11, 2014 7:52:42 AM
> Subject: Re: [Users] hosted engine help
> 
> On 03/11/2014 04:09 PM, Sandro Bonazzola wrote:
> > Il 07/03/2014 01:10, Jason Brooks ha scritto:
> >> Hey everyone, I've been testing out oVirt 3.4 w/ hosted engine, and
> >> while I've managed to bring the engine up, I've only been able to do it
> >> manually, using "hosted-engine --vm-start".
> >>
> >> The ovirt-ha-agent service fails reliably for me, erroring out with
> >> "RequestError: Request failed: success."
> >>
> >> I've pasted error passages from the ha agent and vdsm logs below.
> >>
> >> Any pointers?
> >>
> >> Regards, Jason
> >>
> >> ***
> >>
> >> ovirt-ha-agent.log
> >>
> >> MainThread::CRITICAL::2014-03-06
> >> 18:48:30,622::agent::103::ovirt_hosted_engine_ha.agent.agent.Agent::(run)
> >> Could not start ha-agent
> >> Traceback (most recent call last):
> >>    File
> >> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py",
> >> line 97, in run
> >>      self._run_agent()
> >>    File
> >> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py",
> >> line 154, in _run_agent
> >>
> >> hosted_engine.HostedEngine(self.shutdown_requested).start_monitoring()
> >>    File
> >> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py",
> >> line 303, in start_monitoring
> >>      for old_state, state, delay in self.fsm:
> >>    File
> >> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py",
> >> line 125, in next
> >>      new_data = self.refresh(self._state.data)
> >>    File
> >> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py",
> >> line 77, in refresh
> >>      stats.update(self.hosted_engine.collect_stats())
> >>    File
> >> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py",
> >> line 623, in collect_stats
> >>      constants.SERVICE_TYPE)
> >>    File
> >> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py",
> >> line 171, in get_stats_from_storage
> >>      result = self._checked_communicate(request)
> >>    File
> >> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py",
> >> line 198, in _checked_communicate
> >>      raise RequestError("Request failed: {0}".format(msg))
> >> RequestError: Request failed: success
> >>
> >>
> >> vdsm.log
> >>
> >> Thread-29::ERROR::2014-03-06 18:48:11,101::API::1607::vds::(_getHaInfo)
> >> failed to retrieve Hosted Engine HA info
> >> Traceback (most recent call last):
> >>    File "/usr/share/vdsm/API.py", line 1598, in _getHaInfo
> >>      stats = instance.get_all_stats()
> >>    File
> >> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py",
> >> line 86, in get_all_stats
> >>      constants.SERVICE_TYPE)
> >>    File
> >> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py",
> >> line 171, in get_stats_from_storage
> >>      result = self._checked_communicate(request)
> >>    File
> >> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py",
> >> line 198, in _checked_communicate
> >>      raise RequestError("Request failed: {0}".format(msg))
> >> RequestError: Request failed: success
> >
> >
> > Greg, Martin, "Request failed: success" ?
> 
> Hi Jason,
> 
> I talked to Martin about this and opened a bug [1]/submitted a patch [2].
>   Based on your mail, I'm not sure if you experienced a race condition or
> some other issue.  This patch should help the former case, but if you're
> still experiencing problems then we would need to investigate further.

I made these changes to my install and now I get a different error:

MainThread::CRITICAL::2014-03-13 12:05:47,749::agent::103::ovirt_hosted_engine_ha.agent.agent.Agent::(run) Could not start ha-agent
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 97, in run
    self._run_agent()
  File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py", line 154, in _run_agent
    hosted_engine.HostedEngine(self.shutdown_requested).start_monitoring()
  File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 303, in start_monitoring
    for old_state, state, delay in self.fsm:
  File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py", line 125, in next
    new_data = self.refresh(self._state.data)
  File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py", line 77, in refresh
    stats.update(self.hosted_engine.collect_stats())
  File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py", line 623, in collect_stats
    constants.SERVICE_TYPE)
  File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 171, in get_stats_from_storage
    result = self._checked_communicate(request)
  File "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py", line 191, in _checked_communicate
    return parts[1]
IndexError: list index out of range

I'm attaching my vdsm.log, agent.log and broker.log.

Jason


> 
> Thanks,
> Greg
> 
> [1] https://bugzilla.redhat.com/show_bug.cgi?id=1075126
> [2] http://gerrit.ovirt.org/#/c/25621/
> 
> >>
> >>
> >> _______________________________________________
> >> Users mailing list
> >> Users at ovirt.org
> >> http://lists.ovirt.org/mailman/listinfo/users
> >>
> >
> >
> 
> 
-------------- next part --------------
A non-text attachment was scrubbed...
Name: hosted-logs.tar.gz
Type: application/x-compressed-tar
Size: 206269 bytes
Desc: not available
URL: <http://lists.ovirt.org/pipermail/users/attachments/20140313/0d05be32/attachment-0001.bin>