<div dir="ltr"><div>From the host-deploy logs - the error seems to be "RuntimeError: Failed to start service 'glusterd'"<br><br></div>Can you try to start the glusterd service (systemctl start glusterd) on the failed nodes? Please attach /var/log/glusterfs/etc-glusterfs-glusterd.vol.log to analyze the failure.<br></div><div class="gmail_extra"><br><div class="gmail_quote">On Wed, Nov 2, 2016 at 4:31 AM, Thing <span dir="ltr"><<a href="mailto:thing.thing@gmail.com" target="_blank">thing.thing@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div><div>DNS responds fine,<br><br>==========<br>[root@ovirt1 host-deploy]# host 192.168.1.31<br>31.1.168.192.in-addr.arpa domain name pointer <a href="http://glusterp1.ods.graywitch.co.nz" target="_blank">glusterp1.ods.graywitch.co.nz</a>.<br>[root@ovirt1 host-deploy]# host 192.168.1.32<br>32.1.168.192.in-addr.arpa domain name pointer <a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a>.<br>[root@ovirt1 host-deploy]# host 192.168.1.33<br>33.1.168.192.in-addr.arpa domain name pointer <a href="http://glusterp3.ods.graywitch.co.nz" target="_blank">glusterp3.ods.graywitch.co.nz</a>.<br>[root@ovirt1 host-deploy]# host 192.168.1.34<br>34.1.168.192.in-addr.arpa domain name pointer <a href="http://ovirt1.ods.graywitch.co.nz" target="_blank">ovirt1.ods.graywitch.co.nz</a>.<br>[root@ovirt1 host-deploy]# host <a href="http://glusterp1.ods.graywitch.co.nz" target="_blank">glusterp1.ods.graywitch.co.nz</a><br><a href="http://glusterp1.ods.graywitch.co.nz" target="_blank">glusterp1.ods.graywitch.co.nz</a> has address 192.168.1.31<br>[root@ovirt1 host-deploy]# host <a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a><br><a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a> has address 192.168.1.32<br>[root@ovirt1 host-deploy]# host <a href="http://glusterp3.ods.graywitch.co.nz" target="_blank">glusterp3.ods.graywitch.co.nz</a><br><a href="http://glusterp3.ods.graywitch.co.nz" target="_blank">glusterp3.ods.graywitch.co.nz</a> has address 192.168.1.33<br>[root@ovirt1 host-deploy]# more /etc/hosts<br>127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4<br>::1 localhost localhost.localdomain localhost6 localhost6.localdomain6<br>192.168.1.31 <a href="http://glusterp1.ods.graywitch.co.nz" target="_blank">glusterp1.ods.graywitch.co.nz</a> <wbr> glusterp1<br>192.168.1.32 <a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a> <wbr> glusterp2<br>192.168.1.33 <a href="http://glusterp3.ods.graywitch.co.nz" target="_blank">glusterp3.ods.graywitch.co.nz</a> <wbr> glusterp3<br>192.168.1.34 <a href="http://ovirt1.ods.graywitch.co.nz" target="_blank">ovirt1.ods.graywitch.co.nz</a> ovirt1<br>[root@ovirt1 host-deploy]# host <a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a> <a href="http://glusterp1.ods.graywitch.co.nz" target="_blank">glusterp1.ods.graywitch.co.nz</a><br>Using domain server:<br>Name: <a href="http://glusterp1.ods.graywitch.co.nz" target="_blank">glusterp1.ods.graywitch.co.nz</a><br>Address: 192.168.1.31#53<br>Aliases: <br><br><a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a> has address 192.168.1.32<br>[root@ovirt1 host-deploy]# host <a href="http://glusterp1.ods.graywitch.co.nz" target="_blank">glusterp1.ods.graywitch.co.nz</a> <a href="http://glusterp1.ods.graywitch.co.nz" target="_blank">glusterp1.ods.graywitch.co.nz</a><br>Using domain server:<br>Name: <a href="http://glusterp1.ods.graywitch.co.nz" target="_blank">glusterp1.ods.graywitch.co.nz</a><br>Address: 192.168.1.31#53<br>Aliases: <br><br><a href="http://glusterp1.ods.graywitch.co.nz" target="_blank">glusterp1.ods.graywitch.co.nz</a> has address 192.168.1.31<br>[root@ovirt1 host-deploy]# host <a href="http://glusterp3.ods.graywitch.co.nz" target="_blank">glusterp3.ods.graywitch.co.nz</a> <a href="http://glusterp1.ods.graywitch.co.nz" target="_blank">glusterp1.ods.graywitch.co.nz</a><br>Using domain server:<br>Name: <a href="http://glusterp1.ods.graywitch.co.nz" target="_blank">glusterp1.ods.graywitch.co.nz</a><br>Address: 192.168.1.31#53<br>Aliases: <br><br><a href="http://glusterp3.ods.graywitch.co.nz" target="_blank">glusterp3.ods.graywitch.co.nz</a> has address 192.168.1.33<br>[root@ovirt1 host-deploy]# host <a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a> <a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a><br>Using domain server:<br>Name: <a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a><br>Address: 192.168.1.32#53<br>Aliases: <br><br><a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a> has address 192.168.1.32<br>[root@ovirt1 host-deploy]# host <a href="http://glusterp1.ods.graywitch.co.nz" target="_blank">glusterp1.ods.graywitch.co.nz</a> <a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a><br>Using domain server:<br>Name: <a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a><br>Address: 192.168.1.32#53<br>Aliases: <br><br><a href="http://glusterp1.ods.graywitch.co.nz" target="_blank">glusterp1.ods.graywitch.co.nz</a> has address 192.168.1.31<br>[root@ovirt1 host-deploy]# host <a href="http://glusterp3.ods.graywitch.co.nz" target="_blank">glusterp3.ods.graywitch.co.nz</a> <a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a><br>Using domain server:<br>Name: <a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a><br>Address: 192.168.1.32#53<br>Aliases: <br><br><a href="http://glusterp3.ods.graywitch.co.nz" target="_blank">glusterp3.ods.graywitch.co.nz</a> has address 192.168.1.33<br>[root@ovirt1 host-deploy]# host <a href="http://ovirt1.ods.graywitch.co.nz" target="_blank">ovirt1.ods.graywitch.co.nz</a> <a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a><br>Using domain server:<br>Name: <a href="http://glusterp2.ods.graywitch.co.nz" target="_blank">glusterp2.ods.graywitch.co.nz</a><br>Address: 192.168.1.32#53<br>Aliases: <br><br><a href="http://ovirt1.ods.graywitch.co.nz" target="_blank">ovirt1.ods.graywitch.co.nz</a> has address 192.168.1.34<br>[root@ovirt1 host-deploy]#<br>==========<br><br></div>ssh keys work fine from the command line,<br><br>==========<br>[root@ovirt1 host-deploy]# uname -a<br>Linux <a href="http://ovirt1.ods.graywitch.co.nz" target="_blank">ovirt1.ods.graywitch.co.nz</a> 3.10.0-327.36.2.el7.x86_64 #1 SMP Mon Oct 10 23:08:37 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux<br>[root@ovirt1 host-deploy]# ssh glusterp1<br>Last login: Wed Nov 2 10:46:58 2016 from <a href="http://ovirt1.ods.graywitch.co.nz" target="_blank">ovirt1.ods.graywitch.co.nz</a><br>[root@glusterp1 ~]# ^C<br>[root@glusterp1 ~]# logout<br>Connection to glusterp1 closed.<br>[root@ovirt1 host-deploy]# ssh glusterp2<br>Last login: Wed Nov 2 10:14:09 2016<br>[root@glusterp2 ~]# logout<br>Connection to glusterp2 closed.<br>[root@ovirt1 host-deploy]# ssh glusterp3<br>Last login: Wed Nov 2 10:14:19 2016<br>[root@glusterp3 ~]# logout<br>Connection to glusterp3 closed.<br>[root@ovirt1 host-deploy]#<br>==========<br><br></div>iptables is disabled,<br><br>========<br>[root@glusterp2 log]# iptables -L -n<br>Chain INPUT (policy ACCEPT)<br>target prot opt source destination <br><br>Chain FORWARD (policy ACCEPT)<br>target prot opt source destination <br><br>Chain OUTPUT (policy ACCEPT)<br>target prot opt source destination <br>[root@glusterp2 log]# <br>=========<br><br></div><br><br><br><br><div><div><br></div></div></div><div class="HOEnZb"><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On 2 November 2016 at 11:24, Thing <span dir="ltr"><<a href="mailto:thing.thing@gmail.com" target="_blank">thing.thing@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>I have 3 gluster nodes, 1 and 2 repeatedly fail to come in to ovirt but node 3 worked first time.<br><br></div>It appears to be saying ssh-keys / root password is failing, but I can ssh in fine from teh command line so this message makes no sense.<br><br></div>attached is a host deploy log<br><div><br><br><br><br></div></div>
</blockquote></div><br></div>
</div></div><br>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/<wbr>mailman/listinfo/users</a><br>
<br></blockquote></div><br></div>