4:46 a.m.
Hello,
after restart we had problem with manager to connect to nodes. All nodes
are down and not reachable. When I try to remove and readd to engine it
fails too.
10 days ago we changed SSL certs of rhev-m apache to IPA's generated.
We have this in logs:
2015-02-19 11:41:33,491 ERROR
[org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
(DefaultQuartzScheduler_Worker-30) Failure to refresh Vds runtime info:
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
java.io.EOFException: SSL peer shut down incorrectly
at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.createNetworkException(VdsBrokerCommand.java:126)
[vdsbroker.jar:]
at
org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:101)
[vdsbroker.jar:]
at
org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56)
[vdsbroker.jar:]
at
org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31)
[dal.jar:]
at
org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:571)
[vdsbroker.jar:]
at
org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:648)
[vdsbroker.jar:]
at
org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:494)
[vdsbroker.jar:]
at
org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:236)
[vdsbroker.jar:]
at sun.reflect.GeneratedMethodAccessor10.invoke(Unknown Source)
[:1.7.0_75]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.7.0_75]
at java.lang.reflect.Method.invoke(Method.java:606)
[rt.jar:1.7.0_75]
at
org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60)
[scheduler.jar:]
at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
[quartz.jar:]
at
org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
[quartz.jar:]
Caused by: java.io.EOFException: SSL peer shut down incorrectly
at sun.security.ssl.InputRecord.read(InputRecord.java:482)
[jsse.jar:1.7.0_75]
at
sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:934)
[jsse.jar:1.7.0_75]
at
sun.security.ssl.SSLSocketImpl.performInitialHandshake(SSLSocketImpl.java:1332)
[jsse.jar:1.7.0_75]
at
sun.security.ssl.SSLSocketImpl.writeRecord(SSLSocketImpl.java:709)
[jsse.jar:1.7.0_75]
at
sun.security.ssl.AppOutputStream.write(AppOutputStream.java:122)
[jsse.jar:1.7.0_75]
at
java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:82)
[rt.jar:1.7.0_75]
at
java.io.BufferedOutputStream.flush(BufferedOutputStream.java:140)
[rt.jar:1.7.0_75]
at java.io.FilterOutputStream.flush(FilterOutputStream.java:140)
[rt.jar:1.7.0_75]
at java.io.FilterOutputStream.flush(FilterOutputStream.java:140)
[rt.jar:1.7.0_75]
at
org.apache.xmlrpc.client.XmlRpcCommonsTransport$1$1.close(XmlRpcCommonsTransport.java:204)
[xmlrpc-client.jar:3.1.3]
at
org.apache.xmlrpc.client.XmlRpcHttpTransport$ByteArrayReqWriter.write(XmlRpcHttpTransport.java:55)
[xmlrpc-client.jar:3.1.3]
at
org.apache.xmlrpc.client.XmlRpcCommonsTransport$1.writeRequest(XmlRpcCommonsTransport.java:214)
[xmlrpc-client.jar:3.1.3]
at
org.apache.commons.httpclient.methods.EntityEnclosingMethod.writeRequestBody(EntityEnclosingMethod.java:499)
[commons-httpclient.jar:]
at
org.apache.commons.httpclient.HttpMethodBase.writeRequest(HttpMethodBase.java:2114)
[commons-httpclient.jar:]
at
org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1096)
[commons-httpclient.jar:]
at
org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398)
[commons-httpclient.jar:]
at
org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171)
[commons-httpclient.jar:]
at
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397)
[commons-httpclient.jar:]
at
org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323)
[commons-httpclient.jar:]
at
org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227)
[xmlrpc-client.jar:3.1.3]
at
org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151)
[xmlrpc-client.jar:3.1.3]
at
org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143)
[xmlrpc-client.jar:3.1.3]
at
org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56)
[xmlrpc-client.jar:3.1.3]
at
org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167)
[xmlrpc-client.jar:3.1.3]
at
org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137)
[xmlrpc-client.jar:3.1.3]
at
org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126)
[xmlrpc-client.jar:3.1.3]
at
org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140)
[xmlrpc-client.jar:3.1.3]
at com.sun.proxy.$Proxy97.getVdsCapabilities(Unknown Source)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[rt.jar:1.7.0_75]
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
[rt.jar:1.7.0_75]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
[rt.jar:1.7.0_75]
at java.lang.reflect.Method.invoke(Method.java:606)
[rt.jar:1.7.0_75]
at
org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:255)
[vdsbroker.jar:]
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[rt.jar:1.7.0_75]
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
[rt.jar:1.7.0_75]
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
[rt.jar:1.7.0_75]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
[rt.jar:1.7.0_75]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
[rt.jar:1.7.0_75]
at java.lang.Thread.run(Thread.java:745) [rt.jar:1.7.0_75]
2015-02-19 11:41:33,506 WARN
[org.ovirt.engine.core.vdsbroker.VdsManager]
(DefaultQuartzScheduler_Worker-30) Failed to refresh VDS , vds =
3c9f5126-8c0e-4037-ab61-29de6d02d487 : nodep01.example.com, VDS Network
Error, continuing.