<div dir="ltr">The problem changed a little since I initially posted this to the list. It is getting past the lockspace task now. I posted again with the new situation but did it separate from this. Simone has responded to that one and if you want I can add you to that loop.<div><br></div><div>Using the --noansible flag seems to cause it to fail even sooner. It fails almost right off the bat, which is interesting to say the least.</div></div><div class="gmail_extra"><br><div class="gmail_quote">On Mon, Mar 12, 2018 at 6:39 AM, Yedidyah Bar David <span dir="ltr"><<a href="mailto:didi@redhat.com" target="_blank">didi@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div class="HOEnZb"><div class="h5">On Tue, Mar 6, 2018 at 6:42 PM, Kristian Petersen <<a href="mailto:nesretep@chem.byu.edu">nesretep@chem.byu.edu</a>> wrote:<br>
> I am trying to setup Ovirt with a self hosted engine and NFS storage for<br>
> said engine. The storage appears to mounting OK, but when it gets to the<br>
> point that it is initializing the lockspace it fails spectacularly and shows<br>
> a Python traceback which I cleaned up and have included below:<br>
><br>
> Traceback (most recent call last):<br>
> File "/usr/lib64/python2.7/runpy.<wbr>py", line 162, in _run_module_as_main<br>
> "__main__", fname, loader, pkg_name)<br>
> File "/usr/lib64/python2.7/runpy.<wbr>py", line 72, in _run_code<br>
> exec code in run_globals<br>
> File<br>
> "/usr/lib/python2.7/site-<wbr>packages/ovirt_hosted_engine_<wbr>setup/reinitialize_lockspace.<wbr>py",<br>
> line 30, in <module><br>
> ha_cli.reset_lockspace(force)<br>
> File<br>
> "/usr/lib/python2.7/site-<wbr>packages/ovirt_hosted_engine_<wbr>ha/client/client.py",<br>
> line 270, in reset_lockspace<br>
> stats = broker.get_stats_from_storage(<wbr>)<br>
> File<br>
> "/usr/lib/python2.7/site-<wbr>packages/ovirt_hosted_engine_<wbr>ha/lib/brokerlink.py",<br>
> line 135, in get_stats_from_storage<br>
> result = self._proxy.get_stats()<br>
> File "/usr/lib64/python2.7/<wbr>xmlrpclib.py", line 1233, in __call__<br>
> return self.__send(self.__name, args)<br>
> File "/usr/lib64/python2.7/<wbr>xmlrpclib.py", line 1587, in __request<br>
> verbose=self.__verbose<br>
> File "/usr/lib64/python2.7/<wbr>xmlrpclib.py", line 1273, in request<br>
> return self.single_request(host, handler, request_body, verbose)<br>
> File "/usr/lib64/python2.7/<wbr>xmlrpclib.py", line 1301, in single_request<br>
> self.send_content(h, request_body)<br>
> File "/usr/lib64/python2.7/<wbr>xmlrpclib.py", line 1448, in send_content<br>
> connection.endheaders(request_<wbr>body)<br>
> File "/usr/lib64/python2.7/httplib.<wbr>py", line 1013, in endheaders<br>
> self._send_output(message_<wbr>body)<br>
> File "/usr/lib64/python2.7/httplib.<wbr>py", line 864, in _send_output<br>
> self.send(msg)<br>
> File "/usr/lib64/python2.7/httplib.<wbr>py", line 826, in send<br>
> self.connect()<br>
> File<br>
> "/usr/lib/python2.7/site-<wbr>packages/ovirt_hosted_engine_<wbr>ha/lib/unixrpc.py",<br>
> line 52, in connect<br>
> self.sock.connect(base64.<wbr>b16decode(self.host))<br>
> File "/usr/lib64/python2.7/socket.<wbr>py", line 224, in meth<br>
> return getattr(self._sock,name)(*<wbr>args)<br>
> socket.error: [Errno 2] No such file or directory<br>
><br>
> The messier ansible output is below:<br>
> [ INFO ] TASK [Initialize lockspace volume]<br>
> [ ERROR ] fatal: [localhost]: FAILED! => {"attempts": 5, "changed": true,<br>
> "cmd": ["hosted-engine", "--reinitialize-lockspace", "--force"], "<br>
> delta": "0:00:01.007879", "end": "2018-03-05 14:03:00.474295", "msg":<br>
> "non-zero return code", "rc": 1, "start": "2018-03-05 14:02:59.466416"<br>
> , "stderr": "Traceback (most recent call last):\n File<br>
> \"/usr/lib64/python2.7/runpy.<wbr>py\", line 162, in _run_module_as_main\n<br>
> \"__main__\<br>
> ", fname, loader, pkg_name)\n File \"/usr/lib64/python2.7/runpy.<wbr>py\", line<br>
> 72, in _run_code\n exec code in run_globals\n File \"/usr/li<br>
> b/python2.7/site-packages/<wbr>ovirt_hosted_engine_setup/<wbr>reinitialize_lockspace.py\",<br>
> line 30, in <module>\n ha_cli.reset_lockspace(force)\<wbr>n<br>
> File<br>
> \"/usr/lib/python2.7/site-<wbr>packages/ovirt_hosted_engine_<wbr>ha/client/client.py\",<br>
> line 270, in reset_lockspace\n stats = broker.get_stat<br>
> s_from_storage()\n File<br>
> \"/usr/lib/python2.7/site-<wbr>packages/ovirt_hosted_engine_<wbr>ha/lib/brokerlink.py\",<br>
> line 135, in get_stats_from_storage\<br>
> n result = self._proxy.get_stats()\n File<br>
> \"/usr/lib64/python2.7/<wbr>xmlrpclib.py\", line 1233, in __call__\n return<br>
> self.__send(self.__n<br>
> ame, args)\n File \"/usr/lib64/python2.7/<wbr>xmlrpclib.py\", line 1587, in<br>
> __request\n verbose=self.__verbose\n File \"/usr/lib64/python2.7<br>
> /xmlrpclib.py\", line 1273, in request\n return self.single_request(host,<br>
> handler, request_body, verbose)\n File \"/usr/lib64/python2.7/<br>
> xmlrpclib.py\", line 1301, in single_request\n self.send_content(h,<br>
> request_body)\n File \"/usr/lib64/python2.7/<wbr>xmlrpclib.py\", line 144<br>
> 8, in send_content\n connection.endheaders(request_<wbr>body)\n File<br>
> \"/usr/lib64/python2.7/<wbr>httplib.py\", line 1013, in endheaders\n self.<br>
> _send_output(message_body)\n File \"/usr/lib64/python2.7/<wbr>httplib.py\", line<br>
> 864, in _send_output\n self.send(msg)\n File \"/usr/lib64/p<br>
> ython2.7/httplib.py\", line 826, in send\n self.connect()\n File<br>
> \"/usr/lib/python2.7/site-<wbr>packages/ovirt_hosted_engine_<wbr>ha/lib/unixrpc.p<br>
> y\", line 52, in connect\n<br>
> self.sock.connect(base64.<wbr>b16decode(self.host))\n File<br>
> \"/usr/lib64/python2.7/socket.<wbr>py\", line 224, in meth\n<br>
> return getattr(self._sock,name)(*<wbr>args)\nsocket.error: [Errno 2] No such<br>
> file or directory", "stderr_lines": ["Traceback (most recent cal<br>
> l last):", " File \"/usr/lib64/python2.7/runpy.<wbr>py\", line 162, in<br>
> _run_module_as_main", " \"__main__\", fname, loader, pkg_name)", " Fi<br>
> le \"/usr/lib64/python2.7/runpy.<wbr>py\", line 72, in _run_code", " exec code<br>
> in run_globals", " File \"/usr/lib/python2.7/site-<wbr>packages/ovi<br>
> rt_hosted_engine_setup/<wbr>reinitialize_lockspace.py\", line 30, in <module>", "<br>
> ha_cli.reset_lockspace(force)"<wbr>, " File \"/usr/lib/python2.7<br>
> /site-packages/ovirt_hosted_<wbr>engine_ha/client/client.py\", line 270, in<br>
> reset_lockspace", " stats = broker.get_stats_from_storage(<wbr>)", " F<br>
> ile<br>
> \"/usr/lib/python2.7/site-<wbr>packages/ovirt_hosted_engine_<wbr>ha/lib/brokerlink.py\",<br>
> line 135, in get_stats_from_storage", " result = self.<br>
> _proxy.get_stats()", " File \"/usr/lib64/python2.7/<wbr>xmlrpclib.py\", line<br>
> 1233, in __call__", " return self.__send(self.__name, args)", "<br>
> File \"/usr/lib64/python2.7/<wbr>xmlrpclib.py\", line 1587, in __request", "<br>
> verbose=self.__verbose", " File \"/usr/lib64/python2.7/<wbr>xmlrpcli<br>
> b.py\", line 1273, in request", " return self.single_request(host,<br>
> handler, request_body, verbose)", " File \"/usr/lib64/python2.7/xmlrp<br>
> clib.py\", line 1301, in single_request", " self.send_content(h,<br>
> request_body)", " File \"/usr/lib64/python2.7/<wbr>xmlrpclib.py\", line 1448<br>
> , in send_content", " connection.endheaders(request_<wbr>body)", " File<br>
> \"/usr/lib64/python2.7/<wbr>httplib.py\", line 1013, in endheaders", "<br>
> self._send_output(message_<wbr>body)", " File<br>
> \"/usr/lib64/python2.7/<wbr>httplib.py\", line 864, in _send_output", "<br>
> self.send(msg)", " File \"/<br>
> usr/lib64/python2.7/httplib.<wbr>py\", line 826, in send", " self.connect()",<br>
> " File \"/usr/lib/python2.7/site-<wbr>packages/ovirt_hosted_engine_h<br>
> a/lib/unixrpc.py\", line 52, in connect", "<br>
> self.sock.connect(base64.<wbr>b16decode(self.host))", " File<br>
> \"/usr/lib64/python2.7/socket.<wbr>py\",<br>
> line 224, in meth", " return getattr(self._sock,name)(*<wbr>args)",<br>
> "socket.error: [Errno 2] No such file or directory"], "stdout": "", "stdou<br>
> t_lines": []}<br>
> [ ERROR ] Failed to execute stage 'Closing up': Failed executing<br>
> ansible-playbook<br>
<br>
</div></div>Adding Simone.<br>
<br>
Can you please check/share these logs:<br>
<br>
/var/log/ovirt-hosted-engine-<wbr>setup/*<br>
/var/log/ovirt-hosted-engine-<wbr>ha/*<br>
/var/log/vdsm/*<br>
<span class=""><br>
><br>
><br>
> I am a bit lost on how to proceed as I haven't implemented a self-hosted<br>
> engine before and I haven't found anything that helps online so far. Thanks<br>
> in advance for any assistance.<br>
<br>
</span>The new ansible-based setup was enabled by default only very recently, so<br>
there is not much experience with it, nor can you find much online.<br>
<br>
You can try the old behavior by running:<br>
<br>
hosted-engine --deploy --noansible<br>
<br>
However, if the failure is due to some misconfiguration on the storage,<br>
such as wrong permissions or whatever, this won't help much.<br>
<br>
Best regards,<br>
<span class="HOEnZb"><font color="#888888">--<br>
Didi<br>
</font></span></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr">Kristian Petersen<div>System Administrator</div><div>BYU Dept. of Chemistry and Biochemistry</div></div></div></div></div></div></div>
</div>