Re: [ovirt-users] Help....

Somthing else from the engine.log: 2014-06-18 14:07:52,850 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-8) Initializing Host: mercury1 2014-06-18 14:07:52,866 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.GetCapabilitiesVDSCommand] (DefaultQuartzScheduler_Worker-27) Command GetCapabilitiesVDSCommand(HostName = mercury2, HostId = dfddc678-f8ee-45eb-897a-885c83de870e, vds=Host[mercury2,dfddc678-f8ee-45eb-897a-885c83de870e]) execution failed. Exception: VDSNetworkException: java.net.ConnectException: Connection refused 2014-06-18 14:07:52,911 INFO [org.ovirt.engine.core.vdsbroker.VdsManager] (DefaultQuartzScheduler_Worker-27) Server failed to respond, vds_id = dfddc678-f8ee-45eb-897a-885c83de870e, vds_name = mercury2, vm_count = 0, spm_status = None, non-responsive_timeout (seconds) = 30, error = java.net.ConnectException: Connection refused 2014-06-18 14:07:53,298 INFO [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] (DefaultQuartzScheduler_Worker-27) Correlation ID: null, Call Stack: org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException: java.net.ConnectException: Connection refused at org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerCommand.executeVDSCommand(VdsBrokerCommand.java:102) at org.ovirt.engine.core.vdsbroker.VDSCommandBase.executeCommand(VDSCommandBase.java:56) at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandBase.java:31) at org.ovirt.engine.core.vdsbroker.VdsManager.refreshCapabilities(VdsManager.java:512) at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refreshVdsRunTimeInfo(VdsUpdateRunTimeInfo.java:489) at org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:344) at org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:231) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) at org.quartz.core.JobRunShell.run(JobRunShell.java:213) at org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) Caused by: java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:200) at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:182) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392) at java.net.Socket.connect(Socket.java:579) at sun.security.ssl.SSLSocketImpl.connect(SSLSocketImpl.java:618) at org.ovirt.engine.core.utils.ssl.AuthSSLProtocolSocketFactory.createSocket(AuthSSLProtocolSocketFactory.java:288) at org.apache.commons.httpclient.HttpConnection.open(HttpConnection.java:707) at org.apache.commons.httpclient.MultiThreadedHttpConnectionManager$HttpConnectionAdapter.open(MultiThreadedHttpConnectionManager.java:1361) at org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:387) at org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) at org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) at org.apache.xmlrpc.client.XmlRpcCommonsTransport.writeRequest(XmlRpcCommonsTransport.java:227) at org.apache.xmlrpc.client.XmlRpcStreamTransport.sendRequest(XmlRpcStreamTransport.java:151) at org.apache.xmlrpc.client.XmlRpcHttpTransport.sendRequest(XmlRpcHttpTransport.java:143) at org.apache.xmlrpc.client.XmlRpcClientWorker.execute(XmlRpcClientWorker.java:56) at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:167) at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:137) at org.apache.xmlrpc.client.XmlRpcClient.execute(XmlRpcClient.java:126) at org.apache.xmlrpc.client.util.ClientFactory$1.invoke(ClientFactory.java:140) at com.sun.proxy.$Proxy54.getVdsCapabilities(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.ovirt.engine.core.vdsbroker.xmlrpc.XmlRpcUtils$AsyncProxy$InternalCallable.call(XmlRpcUtils.java:225) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) , Custom Event ID: -1, Message: Host mercury2 is non responsive. 2014-06-18 14:07:53,394 INFO [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] (DefaultQuartzScheduler_Worker-15) VM ifw01prod 713ba1f7-3948-4d13-928a-6fdabb744a57 moved from MigratingFrom --> NotResponding 2014-06-18 14:06 GMT+02:00 Koen Vanoppen <vanoppen.koen(a)gmail.com&gt;: Crap... > Problem NOT SOLVED. Attached the log files. Thanx... > > > 2014-06-18 12:57 GMT+02:00 Koen Vanoppen <vanoppen.koen(a)gmail.com&gt;: > > Ok, BIG THANX!!! >> >> >> 2014-06-18 12:38 GMT+02:00 Roy Golan <rgolan(a)redhat.com&gt;: >> >> On 06/18/2014 01:00 PM, Koen Vanoppen wrote: >>> >>> Ok, thanks. Can you tell me which engine-config this is? (Just so I >>> don't take the wrong one ;-) ) >>> >>> >>> /usr/share/ovirt-engine/services/ovirt-engine/ovirt-engine.xml.in >>> >>> <deployment-scanner scan-interval="5000" path="$tempdir/deployments" >>> deployment-timeout="1200"/> >>> >>> >>> upstream value seems to be 1200 already. >>> >>> >>> >>> 2014-06-18 10:38 GMT+02:00 Roy Golan <rgolan(a)redhat.com&gt;: >>> >>>> On 06/18/2014 08:36 AM, Yair Zaslavsky wrote: >>>> >>>>> Please provide full engine.log and full server.log >>>>> >>>>> Thanks! >>>>> >>>>> In addition, what version did you upgrade from? >>>>> >>>> >>>> Koen the deployment timeout of the application exceeded 60 sec. so it >>>> rolled back the engine components and this is the reason why you >>>> see all these errors >>>> >>>> from server.log >>>> 2014-06-18 07:31:49,094 ERROR [org.jboss.as.server.deployment.scanner] >>>> (DeploymentScanner-threads - 1) JBAS015052: Did not receive a response to >>>> the deployment operation within the allowed timeout period [60 >>>> >>>> The deployment is a composition of the engine modules and >>>> sub-modules(core modules,webadmin, userportal, api etc...) AND the >>>> jasper reports. >>>> >>>> typically it shouldn't exceed 60 sec but slow network may cause some >>>> inits to delay. essentially this is configurable so if its constant you may >>>> want to change it. >>>> >>>> Thanks, >>>> Roy >>>> >>>> >>>> >>>>> ----- Original Message ----- >>>>> >>>>>> From: "Koen Vanoppen" <vanoppen.koen(a)gmail.com&gt; >>>>>> To: users(a)ovirt.org >>>>>> Sent: Wednesday, June 18, 2014 7:55:15 AM >>>>>> Subject: [ovirt-users] Help.... >>>>>> >>>>>> This happend after the update to 3.4.2 when I start the engine. I >>>>>> can't >>>>>> login anymore... This is the error. Any Idea's? PLease.... >>>>>> >>>>>> 2014-06-18 06:51:45,728 ERROR >>>>>> [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] >>>>>> (DefaultQuartzScheduler_Worker-79) >>>>>> ResourceManager::refreshVdsRunTimeInfo: >>>>>> Error: IllegalStateException: JBAS011049: Component is stopped, vds = >>>>>> b34902ea-ad11-45d3-96ee-47de1864e4e0 : mercury1 >>>>>> 2014-06-18 06:51:45,736 ERROR >>>>>> [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] >>>>>> (DefaultQuartzScheduler_Worker-79) IllegalStateException: JBAS011049: >>>>>> Component is stopped: java.lang.IllegalStateException: JBAS011049: >>>>>> Component is stopped >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.BasicComponent.waitForComponentStart(BasicComponent.java:104) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:127) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.BasicComponent.createInstance(BasicComponent.java:85) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:66) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:63) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> org.jboss.as.ejb3.pool.AbstractPool.create(AbstractPool.java:60) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.pool.strictmax.StrictMaxPool.get(StrictMaxPool.java:123) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:47) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.ovirt.engine.core.common.businessentities.IVdsEventListener$$$view6.addExternallyManagedVms(Unknown >>>>>> Source) >>>>>> at >>>>>> >>>>>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.saveDataToDb(VdsUpdateRunTimeInfo.java:175) >>>>>> [vdsbroker.jar:] >>>>>> at >>>>>> >>>>>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:359) >>>>>> [vdsbroker.jar:] >>>>>> at >>>>>> >>>>>> org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:231) >>>>>> [vdsbroker.jar:] >>>>>> at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown Source) >>>>>> [:1.7.0_51] >>>>>> at >>>>>> >>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>>>> [rt.jar:1.7.0_51] >>>>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>>>> [rt.jar:1.7.0_51] >>>>>> at >>>>>> >>>>>> org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) >>>>>> [scheduler.jar:] >>>>>> at org.quartz.core.JobRunShell.run(JobRunShell.java:213) >>>>>> [quartz.jar:] >>>>>> at >>>>>> >>>>>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >>>>>> [quartz.jar:] >>>>>> >>>>>> 2014-06-18 06:51:45,952 ERROR >>>>>> [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] >>>>>> (DefaultQuartzScheduler_Worker-79) >>>>>> ResourceManager::RerunFailedCommand: >>>>>> Error: IllegalStateException: JBAS011049: Component is stopped, vds = >>>>>> b34902ea-ad11-45d3-96ee-47de1864e4e0 : mercury1 >>>>>> 2014-06-18 06:51:45,955 ERROR >>>>>> [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo] >>>>>> (DefaultQuartzScheduler_Worker-79) IllegalStateException: JBAS011049: >>>>>> Component is stopped: java.lang.IllegalStateException: JBAS011049: >>>>>> Component is stopped >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.BasicComponent.waitForComponentStart(BasicComponent.java:104) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:127) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.BasicComponent.createInstance(BasicComponent.java:85) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:66) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:63) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> org.jboss.as.ejb3.pool.AbstractPool.create(AbstractPool.java:60) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.pool.strictmax.StrictMaxPool.get(StrictMaxPool.java:123) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:47) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.ovirt.engine.core.common.businessentities.IVdsEventListener$$$view6.runFailedAutoStartVMs(Unknown >>>>>> Source) >>>>>> at >>>>>> >>>>>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.afterRefreshTreatment(VdsUpdateRunTimeInfo.java:433) >>>>>> [vdsbroker.jar:] >>>>>> at >>>>>> >>>>>> org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:251) >>>>>> [vdsbroker.jar:] >>>>>> at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown Source) >>>>>> [:1.7.0_51] >>>>>> at >>>>>> >>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>>>> [rt.jar:1.7.0_51] >>>>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>>>> [rt.jar:1.7.0_51] >>>>>> at >>>>>> >>>>>> org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) >>>>>> [scheduler.jar:] >>>>>> at org.quartz.core.JobRunShell.run(JobRunShell.java:213) >>>>>> [quartz.jar:] >>>>>> at >>>>>> >>>>>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >>>>>> [quartz.jar:] >>>>>> >>>>>> 2014-06-18 06:51:46,134 ERROR >>>>>> [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] >>>>>> (DefaultQuartzScheduler_Worker-79) Failed to invoke scheduled method >>>>>> onTimer: java.lang.reflect.InvocationTargetException >>>>>> at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown Source) >>>>>> [:1.7.0_51] >>>>>> at >>>>>> >>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) >>>>>> [rt.jar:1.7.0_51] >>>>>> at java.lang.reflect.Method.invoke(Method.java:606) >>>>>> [rt.jar:1.7.0_51] >>>>>> at >>>>>> >>>>>> org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60) >>>>>> [scheduler.jar:] >>>>>> at org.quartz.core.JobRunShell.run(JobRunShell.java:213) >>>>>> [quartz.jar:] >>>>>> at >>>>>> >>>>>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >>>>>> [quartz.jar:] >>>>>> Caused by: java.lang.IllegalStateException: JBAS011049: Component is >>>>>> stopped >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.BasicComponent.waitForComponentStart(BasicComponent.java:104) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:127) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.BasicComponent.createInstance(BasicComponent.java:85) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.component.singleton.SingletonComponent.getComponentInstance(SingletonComponent.java:116) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:48) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.notSupported(CMTTxInterceptor.java:288) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:188) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59) >>>>>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61) >>>>>> [jboss-invocation-1.1.1.Final.jar:1.1.1.Final] >>>>>> at >>>>>> >>>>>> org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72) >>>>>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final] >>>>>> at >>>>>> >>>>>> org.ovirt.engine.core.utils.lock.LockManager$$$view3.releaseLock(Unknown >>>>>> Source) >>>>>> at >>>>>> >>>>>> org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:285) >>>>>> [vdsbroker.jar:] >>>>>> ... 6 more >>>>>> >>>>>> 2014-06-18 06:51:46,263 ERROR >>>>>> [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl] >>>>>> (DefaultQuartzScheduler_Worker-79) failed to reschedule the job: >>>>>> org.quartz.SchedulerException: The Scheduler has been shutdown. >>>>>> at >>>>>> >>>>>> org.quartz.core.QuartzScheduler.validateState(QuartzScheduler.java:749) >>>>>> [quartz.jar:] >>>>>> at >>>>>> >>>>>> org.quartz.core.QuartzScheduler.rescheduleJob(QuartzScheduler.java:1060) >>>>>> [quartz.jar:] >>>>>> at >>>>>> org.quartz.impl.StdScheduler.rescheduleJob(StdScheduler.java:312) >>>>>> [quartz.jar:] >>>>>> at >>>>>> >>>>>> org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl.rescheduleAJob(SchedulerUtilQuartzImpl.java:331) >>>>>> [scheduler.jar:] >>>>>> at >>>>>> >>>>>> org.ovirt.engine.core.utils.timer.FixedDelayJobListener.jobWasExecuted(FixedDelayJobListener.java:91) >>>>>> [scheduler.jar:] >>>>>> at >>>>>> >>>>>> org.quartz.core.QuartzScheduler.notifyJobListenersWasExecuted(QuartzScheduler.java:1936) >>>>>> [quartz.jar:] >>>>>> at >>>>>> >>>>>> org.quartz.core.JobRunShell.notifyJobListenersComplete(JobRunShell.java:361) >>>>>> [quartz.jar:] >>>>>> at org.quartz.core.JobRunShell.run(JobRunShell.java:235) >>>>>> [quartz.jar:] >>>>>> at >>>>>> >>>>>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557) >>>>>> [quartz.jar:] >>>>>> >>>>>> _______________________________________________ >>>>>> Users mailing list >>>>>> Users(a)ovirt.org >>>>>> http://lists.ovirt.org/mailman/listinfo/users >>>>>> >>>>>> _______________________________________________ >>>>> Users mailing list >>>>> Users(a)ovirt.org >>>>> http://lists.ovirt.org/mailman/listinfo/users >>>>> >>>> >>>> >>> >>> >> >