[Users] hosted engine help

Jiri Moskovcak jmoskovc at redhat.com
Tue Mar 25 13:45:44 EDT 2014 

On 03/25/2014 06:34 PM, Jiri Moskovcak wrote:
> On 03/13/2014 05:25 PM, Jason Brooks wrote:
>>
>>
>> ----- Original Message -----
>>> From: "Greg Padgett" <gpadgett at redhat.com>
>>> To: "Jason Brooks" <jbrooks at redhat.com>
>>> Cc: "Sandro Bonazzola" <sbonazzo at redhat.com>, users at ovirt.org,
>>> "Martin Sivak" <msivak at redhat.com>
>>> Sent: Tuesday, March 11, 2014 7:52:42 AM
>>> Subject: Re: [Users] hosted engine help
>>>
>>> On 03/11/2014 04:09 PM, Sandro Bonazzola wrote:
>>>> Il 07/03/2014 01:10, Jason Brooks ha scritto:
>>>>> Hey everyone, I've been testing out oVirt 3.4 w/ hosted engine, and
>>>>> while I've managed to bring the engine up, I've only been able to
>>>>> do it
>>>>> manually, using "hosted-engine --vm-start".
>>>>>
>>>>> The ovirt-ha-agent service fails reliably for me, erroring out with
>>>>> "RequestError: Request failed: success."
>>>>>
>>>>> I've pasted error passages from the ha agent and vdsm logs below.
>>>>>
>>>>> Any pointers?
>>>>>
>>>>> Regards, Jason
>>>>>
>>>>> ***
>>>>>
>>>>> ovirt-ha-agent.log
>>>>>
>>>>> MainThread::CRITICAL::2014-03-06
>>>>> 18:48:30,622::agent::103::ovirt_hosted_engine_ha.agent.agent.Agent::(run)
>>>>>
>>>>> Could not start ha-agent
>>>>> Traceback (most recent call last):
>>>>>     File
>>>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py",
>>>>>
>>>>> line 97, in run
>>>>>       self._run_agent()
>>>>>     File
>>>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py",
>>>>>
>>>>> line 154, in _run_agent
>>>>>
>>>>> hosted_engine.HostedEngine(self.shutdown_requested).start_monitoring()
>>>>>     File
>>>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py",
>>>>>
>>>>> line 303, in start_monitoring
>>>>>       for old_state, state, delay in self.fsm:
>>>>>     File
>>>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py",
>>>>>
>>>>> line 125, in next
>>>>>       new_data = self.refresh(self._state.data)
>>>>>     File
>>>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py",
>>>>>
>>>>> line 77, in refresh
>>>>>       stats.update(self.hosted_engine.collect_stats())
>>>>>     File
>>>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py",
>>>>>
>>>>> line 623, in collect_stats
>>>>>       constants.SERVICE_TYPE)
>>>>>     File
>>>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py",
>>>>>
>>>>> line 171, in get_stats_from_storage
>>>>>       result = self._checked_communicate(request)
>>>>>     File
>>>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py",
>>>>>
>>>>> line 198, in _checked_communicate
>>>>>       raise RequestError("Request failed: {0}".format(msg))
>>>>> RequestError: Request failed: success
>>>>>
>>>>>
>>>>> vdsm.log
>>>>>
>>>>> Thread-29::ERROR::2014-03-06
>>>>> 18:48:11,101::API::1607::vds::(_getHaInfo)
>>>>> failed to retrieve Hosted Engine HA info
>>>>> Traceback (most recent call last):
>>>>>     File "/usr/share/vdsm/API.py", line 1598, in _getHaInfo
>>>>>       stats = instance.get_all_stats()
>>>>>     File
>>>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/client/client.py",
>>>>>
>>>>> line 86, in get_all_stats
>>>>>       constants.SERVICE_TYPE)
>>>>>     File
>>>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py",
>>>>>
>>>>> line 171, in get_stats_from_storage
>>>>>       result = self._checked_communicate(request)
>>>>>     File
>>>>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py",
>>>>>
>>>>> line 198, in _checked_communicate
>>>>>       raise RequestError("Request failed: {0}".format(msg))
>>>>> RequestError: Request failed: success
>>>>
>>>>
>>>> Greg, Martin, "Request failed: success" ?
>>>
>>> Hi Jason,
>>>
>>> I talked to Martin about this and opened a bug [1]/submitted a patch
>>> [2].
>>>    Based on your mail, I'm not sure if you experienced a race
>>> condition or
>>> some other issue.  This patch should help the former case, but if you're
>>> still experiencing problems then we would need to investigate further.
>>
>> I made these changes to my install and now I get a different error:
>>
>> MainThread::CRITICAL::2014-03-13
>> 12:05:47,749::agent::103::ovirt_hosted_engine_ha.agent.agent.Agent::(run)
>> Could not start ha-agent
>> Traceback (most recent call last):
>>    File
>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py",
>> line 97, in run
>>      self._run_agent()
>>    File
>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/agent.py",
>> line 154, in _run_agent
>>
>> hosted_engine.HostedEngine(self.shutdown_requested).start_monitoring()
>>    File
>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py",
>> line 303, in start_monitoring
>>      for old_state, state, delay in self.fsm:
>>    File
>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/fsm/machine.py",
>> line 125, in next
>>      new_data = self.refresh(self._state.data)
>>    File
>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/state_machine.py",
>> line 77, in refresh
>>      stats.update(self.hosted_engine.collect_stats())
>>    File
>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/agent/hosted_engine.py",
>> line 623, in collect_stats
>>      constants.SERVICE_TYPE)
>>    File
>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py",
>> line 171, in get_stats_from_storage
>>      result = self._checked_communicate(request)
>>    File
>> "/usr/lib/python2.7/site-packages/ovirt_hosted_engine_ha/lib/brokerlink.py",
>> line 191, in _checked_communicate
>>      return parts[1]
>> IndexError: list index out of range
>>
>> I'm attaching my vdsm.log, agent.log and broker.log.
>>
>> Jason
>
> Hi Jason,
> this bug is already fixed in the latest builds.
>
> I was able to successfully install the hosted engine with the following
> rpms installed.
>
> 1. Install and enable the preview repo as described here:
> http://www.ovirt.org/OVirt_3.4_Test_Day
>
> and then install the following packages:
>
> http://jenkins.ovirt.org/view/Packaging/job/ovirt-hosted-engine-ha_create_rpms/label=fedora19/lastSuccessfulBuild/artifact/exported-artifacts/ovirt-hosted-engine-ha-1.2.0-0.0.master.20140324152134.20140324.git24efa6a.fc19.noarch.rpm
>
>
> http://jenkins.ovirt.org/view/Packaging/job/ovirt-hosted-engine-setup_create_rpms/label=fedora19/lastSuccessfulBuild/artifact/exported-artifacts/ovirt-hosted-engine-setup-1.2.0-0.0.master.20140324112909.gitc0e9c96.fc19.noarch.rpm
>
>
> --Jirka

I forgot to mention that I've not succeeded on F19 completely. One more 
problem you might run into is [1]. AFAIK it doesn't have a fix yet, so 
the installation will be interrupted. But after the host reboots you 
might try running this:

hosted-engine --connect-storage
hosted-engine --start-pool
hosted-engine --vm-start


[1] https://bugzilla.redhat.com/show_bug.cgi?id=1064991 which
>
>
>>
>>
>>>
>>> Thanks,
>>> Greg
>>>
>>> [1] https://bugzilla.redhat.com/show_bug.cgi?id=1075126
>>> [2] http://gerrit.ovirt.org/#/c/25621/
>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Users mailing list
>>>>> Users at ovirt.org
>>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>>>
>>>>
>>>>
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> Users mailing list
>>> Users at ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/users
>
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users

More information about the Users mailing list