<div dir="ltr"><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:rgb(0,0,0)">Hello all,</div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:rgb(0,0,0)">We recently had a network event where we lost access to our storage for a period of time. The Cluster basically shut down all our VM's and in the process we had three HV's that went offline and would not communicate properly with the cluster.</div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:rgb(0,0,0)">We have since completely reinstalled CentOS on the hosts and attempted to install them into the cluster with no joy. We've gotten to the point where we generally get an error message in the web gui:</div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:rgb(0,0,0)">Stage: Misc Configuration</div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:rgb(0,0,0)">
<div style="outline-style:none" tabindex="0" title=""><div class="gmail-" style="overflow:hidden;text-overflow:ellipsis;white-space:nowrap" id="gmail-gwt-uid-509_col2_row48">Host hv-ausa-02 installation failed. Command returned failure code 1 during SSH session '<a href="mailto:root@10.1.90.154">root@10.1.90.154</a>'.</div></div>
<br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:rgb(0,0,0)">the following is what we are seeing in the messages log:</div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:rgb(0,0,0)"><br></div><div class="gmail_default" style="font-family:verdana,sans-serif;font-size:small;color:rgb(0,0,0)"><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: libvirt: XML-RPC error : authentication failed: authentication failed</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 libvirtd: 2018-02-16 16:39:53.761+0000: 15231: error : virNetSASLSessionListMechanisms:390 : internal error: cannot list SASL mechanisms -4 (SASL(-4): no mechanism available: Internal Error -4 in server.c near line 1757)</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 libvirtd: 2018-02-16 16:39:53.761+0000: 15231: error : remoteDispatchAuthSaslInit:3411 : authentication failed: authentication failed</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 libvirtd: 2018-02-16 16:39:53.761+0000: 15226: error : virNetSocketReadWire:1808 : End of file while reading data: Input/output error</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: libvirt: XML-RPC error : authentication failed: authentication failed</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 libvirtd: 2018-02-16 16:39:53.962+0000: 15233: error : virNetSASLSessionListMechanisms:390 : internal error: cannot list SASL mechanisms -4 (SASL(-4): no mechanism available: Internal Error -4 in server.c near line 1757)</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 libvirtd: 2018-02-16 16:39:53.963+0000: 15233: error : remoteDispatchAuthSaslInit:3411 : authentication failed: authentication failed</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 libvirtd: 2018-02-16 16:39:53.963+0000: 15226: error : virNetSocketReadWire:1808 : End of file while reading data: Input/output error</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: libvirt: XML-RPC error : authentication failed: authentication failed</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: Traceback (most recent call last):</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: File "/usr/bin/vdsm-tool", line 219, in main</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: return tool_command[cmd]["command"](*args)</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: File "/usr/lib/python2.7/site-packages/vdsm/tool/upgrade_300_networks.py", line 83, in upgrade_networks</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: networks = netinfo.networks()</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: File "/usr/lib/python2.7/site-packages/vdsm/netinfo.py", line 112, in networks</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: conn = libvirtconnection.get()</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 159, in get</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: conn = _open_qemu_connection()</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: File "/usr/lib/python2.7/site-packages/vdsm/libvirtconnection.py", line 95, in _open_qemu_connection</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: return utils.retry(libvirtOpen, timeout=10, sleep=0.2)</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: File "/usr/lib/python2.7/site-packages/vdsm/utils.py", line 1108, in retry</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: return func()</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: File "/usr/lib64/python2.7/site-packages/libvirt.py", line 105, in openAuth</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: if ret is None:raise libvirtError('virConnectOpenAuth() failed')</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 vdsm-tool: libvirtError: authentication failed: authentication failed</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 systemd: vdsm-network.service: control process exited, code=exited status=1</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 systemd: Failed to start Virtual Desktop Server Manager network restoration.</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 systemd: Dependency failed for Virtual Desktop Server Manager.</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 systemd: Job vdsmd.service/start failed with result 'dependency'.</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 systemd: Unit vdsm-network.service entered failed state.</div><div class="gmail_default">Feb 16 11:39:53 hv-ausa-02 systemd: vdsm-network.service failed.</div><div class="gmail_default">Feb 16 11:40:01 hv-ausa-02 systemd: Started Session 10 of user root.</div><div class="gmail_default">Feb 16 11:40:01 hv-ausa-02 systemd: Starting Session 10 of user root.</div><div class="gmail_default">Feb 16 11:40:01 hv-ausa-02 systemd: Started Session 11 of user root.</div><div class="gmail_default">Feb 16 11:40:01 hv-ausa-02 systemd: Starting Session 11 of user root.</div><div class="gmail_default"><br></div><div class="gmail_default">Can someone point me in the right direction to resolve this - it seems to be a SASL issue perhaps?</div></div><div><div class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div dir="ltr"><div dir="ltr"><div><br></div><div><font color="#000000" face="verdana, sans-serif">***</font></div><div><b style="font-family:verdana,sans-serif;color:rgb(0,0,0)"><font size="2">Mark Steele</font></b><br></div><div><font face="verdana, sans-serif"><span style="color:rgb(0,0,0)">CIO / VP Technical Operations | TelVue Corporation</span></font></div><div><font face="verdana, sans-serif"><span style="font-size:x-small;color:rgb(0,0,0)">TelVue - We Share Your Vision</span></font></div><div><font face="verdana, sans-serif"><span style="font-size:x-small;color:rgb(0,0,0)">16000 Horizon Way, Suite 100 | Mt. Laurel, NJ 08054</span></font></div><div><font face="verdana, sans-serif"><span style="font-size:x-small;color:rgb(0,0,0)">800.885.8886 x128 | <a href="mailto:msteele@telvue.com" target="_blank">msteele@telvue.com</a> | </span><a href="http://www.telvue.com/" style="font-size:x-small" target="_blank">http://www.telvue.com</a></font></div><div><font face="verdana, sans-serif"><span style="font-size:x-small">twitter: </span><a href="http://twitter.com/telvue" style="font-size:x-small" target="_blank">http://twitter.com/telvue</a><span style="font-size:x-small"> | facebook: </span><a href="https://www.facebook.com/telvue" style="font-size:x-small" target="_blank">https://www.facebook.com/telvue</a></font></div></div></div></div></div></div></div></div></div></div></div></div></div></div>
</div>