[Users] Engine constantly trying to remove disks that aren´t there
Maor Lipchuk
mlipchuk at redhat.com
Sun Oct 28 05:40:44 UTC 2012
On 10/26/2012 04:20 PM, Greg Padgett wrote:
> On 10/26/2012 08:21 AM, Karli Sjöberg wrote:
>> Hi,
>>
>> today I had a VM that had a couple of hard drives created, that I wanted
>> destroyed, so I shift-clicked to mark all of them:
>>
>>
>> This screen showed up:
>>
>>
>> I clicked "OK", the disks were deleted, but ever since then, these
>> messages keep appearing in the event log:
>>
>>
>> engine.log keeps printing this:
>> 2012-10-26 14:14:50,285 INFO
>> [org.ovirt.engine.core.bll.AsyncTaskManager]
>> (QuartzScheduler_Worker-63) AsyncTaskManager::PollAndUpdateAsyncTasks: 1
>> tasks, 1 tasks to poll now
>> 2012-10-26 14:14:50,441 INFO [org.ovirt.engine.core.bll.SPMAsyncTask]
>> (QuartzScheduler_Worker-63) BaseAsyncTask::OnTaskEndSuccess: Task
>> a50a874d-5a81-4268-a085-2602df29def1 (Parent Command RemoveDisk,
>> Parameters Type
>> org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended
>> successfully.
>> 2012-10-26 14:14:50,442 INFO [org.ovirt.engine.core.bll.EntityAsyncTask]
>> (QuartzScheduler_Worker-63) EntityAsyncTask::EndActionIfNecessary: All
>> tasks of entity d9d60b31-c8e4-4d24-8b2e-29b654789057 has ended ->
>> executing EndAction
>> 2012-10-26 14:14:50,443 INFO [org.ovirt.engine.core.bll.EntityAsyncTask]
>> (QuartzScheduler_Worker-63) EntityAsyncTask::EndAction: Ending action for
>> 1 tasks (entity ID: d9d60b31-c8e4-4d24-8b2e-29b654789057): calling
>> EndAction for action type RemoveDisk.
>> 2012-10-26 14:14:50,445 INFO [org.ovirt.engine.core.bll.EntityAsyncTask]
>> (pool-3-thread-47) EntityAsyncTask::EndCommandAction [within
>> thread]context: Attempting to EndAction RemoveDisk
>> 2012-10-26 14:14:50,471 INFO
>> [org.ovirt.engine.core.bll.RemoveDiskCommand] (pool-3-thread-47) Ending
>> command successfully: org.ovirt.engine.core.bll.RemoveDiskCommand
>> 2012-10-26 14:14:50,484 WARN
>> [org.ovirt.engine.core.compat.backendcompat.TypeCompat]
>> (pool-3-thread-47) Unable to get value of property: diskAlias for class
>> org.ovirt.engine.core.bll.RemoveDiskCommand
>> 2012-10-26 14:14:50,510 ERROR [org.ovirt.engine.core.bll.EntityAsyncTask]
>> (pool-3-thread-47) EntityAsyncTask::EndCommandAction [within thread]:
>> EndAction for action type RemoveDisk threw an exception:
>> java.lang.NullPointerException
>> at
>> org.ovirt.engine.core.bll.RemoveDiskCommand.getVmsForDiskId(RemoveDiskCommand.java:146)
>>
>> [engine-bll.jar:]
>> at
>> org.ovirt.engine.core.bll.RemoveDiskCommand.endCommand(RemoveDiskCommand.java:281)
>>
>> [engine-bll.jar:]
>> at
>> org.ovirt.engine.core.bll.RemoveDiskCommand.EndSuccessfully(RemoveDiskCommand.java:272)
>>
>> [engine-bll.jar:]
>> at
>> org.ovirt.engine.core.bll.CommandBase.InternalEndSuccessfully(CommandBase.java:465)
>>
>> [engine-bll.jar:]
>> at
>> org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:420)
>>
>> [engine-bll.jar:]
>> at
>> org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1205)
>>
>> [engine-bll.jar:]
>> at
>> org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168)
>>
>> [engine-utils.jar:]
>> at
>> org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107)
>>
>> [engine-utils.jar:]
>> at org.ovirt.engine.core.bll.CommandBase.EndAction(CommandBase.java:366)
>> [engine-bll.jar:]
>> at org.ovirt.engine.core.bll.Backend.endAction(Backend.java:356)
>> [engine-bll.jar:]
>> at sun.reflect.GeneratedMethodAccessor149.invoke(Unknown Source)
>> [:1.7.0_06-icedtea]
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>
>> [rt.jar:1.7.0_06-icedtea]
>> at java.lang.reflect.Method.invoke(Method.java:601)
>> [rt.jar:1.7.0_06-icedtea]
>> at
>> org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72)
>>
>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.ovirt.engine.core.utils.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:11)
>>
>> [engine-utils.jar:]
>> at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
>> [:1.7.0_06-icedtea]
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>
>> [rt.jar:1.7.0_06-icedtea]
>> at java.lang.reflect.Method.invoke(Method.java:601)
>> [rt.jar:1.7.0_06-icedtea]
>> at
>> org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123)
>>
>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36)
>>
>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53)
>>
>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53)
>>
>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211)
>>
>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363)
>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194)
>>
>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41)
>>
>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59)
>>
>> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50)
>>
>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45)
>>
>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165)
>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173)
>>
>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
>>
>> [jboss-invocation.jar:1.1.1.Final]
>> at
>> org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72)
>>
>> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>> at
>> org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.endAction(Unknown
>>
>> Source) [engine-bll.jar:]
>> at
>> org.ovirt.engine.core.bll.EntityAsyncTask.EndCommandAction(EntityAsyncTask.java:134)
>>
>> [engine-bll.jar:]
>> at
>> org.ovirt.engine.core.bll.EntityAsyncTask.access$000(EntityAsyncTask.java:23)
>>
>> [engine-bll.jar:]
>> at
>> org.ovirt.engine.core.bll.EntityAsyncTask$1.run(EntityAsyncTask.java:104)
>> [engine-bll.jar:]
>> at
>> org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64)
>>
>> [engine-utils.jar:]
>> at
>> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> [rt.jar:1.7.0_06-icedtea]
>> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>> [rt.jar:1.7.0_06-icedtea]
>> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>> [rt.jar:1.7.0_06-icedtea]
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
>>
>> [rt.jar:1.7.0_06-icedtea]
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
>>
>> [rt.jar:1.7.0_06-icedtea]
>> at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_06-icedtea]
>>
>> 2012-10-26 14:14:50,540 INFO [org.ovirt.engine.core.bll.EntityAsyncTask]
>> (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within
>> thread]:
>> EndAction for action type RemoveDisk completed, handling the result.
>> 2012-10-26 14:14:50,541 INFO [org.ovirt.engine.core.bll.EntityAsyncTask]
>> (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within
>> thread]:
>> EndAction for action type RemoveDisk hasnt succeeded, not clearing tasks,
>> will attempt again next polling.
>>
>>
>> Engine feels slower than usual from having to constantly try to delete
>> disks that aren´t there. I have tried restarting it, but when it starts,
>> it remembers that "Oh yeah, there was these disks I absolutely *have* to
>> delete, better pick up where I left off!" and loops this forever.
>>
>> Is there a way to make it forget?
>
> Hi Karli,
>
> It looks like the issue that was fixed in [1]. If you can upgrade, I
> believe it would resolve itself. If not, then you can manually remove
> the task from the async_tasks table of the engine db; something like [2]
> should do.
Please also restart jboss after executing [2].
Regards,
Maor
>
> HTH,
> Greg
>
> [1] http://gerrit.ovirt.org/#/c/5621/2
> [2] delete from async_tasks where task_id =
> 'a50a874d-5a81-4268-a085-2602df29def1';
>
>>
>>
>> Med Vänliga Hälsningar
>> -------------------------------------------------------------------------------
>>
>> Karli Sjöberg
>> Swedish University of Agricultural Sciences
>> Box 7079 (Visiting Address Kronåsvägen 8)
>> S-750 07 Uppsala, Sweden
>> Phone: +46-(0)18-67 15 66
>> karli.sjoberg at slu.se <mailto:karli.sjoberg at adm.slu.se>
>>
>>
>>
>> _______________________________________________
>> Users mailing list
>> Users at ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>>
>
>
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
More information about the Users
mailing list