[Users] Engine constantly trying to remove disks that aren´t there

Fri Oct 26 14:20:22 UTC 2012

On 10/26/2012 08:21 AM, Karli Sjöberg wrote:
> Hi,
>
> today I had a VM that had a couple of hard drives created, that I wanted
> destroyed, so I shift-clicked to mark all of them:
>
>
> This screen showed up:
>
>
> I clicked "OK", the disks were deleted, but ever since then, these
> messages keep appearing in the event log:
>
>
> engine.log keeps printing this:
> 2012-10-26 14:14:50,285 INFO  [org.ovirt.engine.core.bll.AsyncTaskManager]
> (QuartzScheduler_Worker-63) AsyncTaskManager::PollAndUpdateAsyncTasks: 1
> tasks, 1 tasks to poll now
> 2012-10-26 14:14:50,441 INFO  [org.ovirt.engine.core.bll.SPMAsyncTask]
> (QuartzScheduler_Worker-63) BaseAsyncTask::OnTaskEndSuccess: Task
> a50a874d-5a81-4268-a085-2602df29def1 (Parent Command RemoveDisk,
> Parameters Type
> org.ovirt.engine.core.common.asynctasks.AsyncTaskParameters) ended
> successfully.
> 2012-10-26 14:14:50,442 INFO  [org.ovirt.engine.core.bll.EntityAsyncTask]
> (QuartzScheduler_Worker-63) EntityAsyncTask::EndActionIfNecessary: All
> tasks of entity d9d60b31-c8e4-4d24-8b2e-29b654789057 has ended ->
> executing EndAction
> 2012-10-26 14:14:50,443 INFO  [org.ovirt.engine.core.bll.EntityAsyncTask]
> (QuartzScheduler_Worker-63) EntityAsyncTask::EndAction: Ending action for
> 1 tasks (entity ID: d9d60b31-c8e4-4d24-8b2e-29b654789057): calling
> EndAction for action type RemoveDisk.
> 2012-10-26 14:14:50,445 INFO  [org.ovirt.engine.core.bll.EntityAsyncTask]
> (pool-3-thread-47) EntityAsyncTask::EndCommandAction [within
> thread]context: Attempting to EndAction RemoveDisk
> 2012-10-26 14:14:50,471 INFO
>   [org.ovirt.engine.core.bll.RemoveDiskCommand] (pool-3-thread-47) Ending
> command successfully: org.ovirt.engine.core.bll.RemoveDiskCommand
> 2012-10-26 14:14:50,484 WARN
>   [org.ovirt.engine.core.compat.backendcompat.TypeCompat]
> (pool-3-thread-47) Unable to get value of property: diskAlias for class
> org.ovirt.engine.core.bll.RemoveDiskCommand
> 2012-10-26 14:14:50,510 ERROR [org.ovirt.engine.core.bll.EntityAsyncTask]
> (pool-3-thread-47) EntityAsyncTask::EndCommandAction [within thread]:
> EndAction for action type RemoveDisk threw an exception:
> java.lang.NullPointerException
> at
> org.ovirt.engine.core.bll.RemoveDiskCommand.getVmsForDiskId(RemoveDiskCommand.java:146)
> [engine-bll.jar:]
> at
> org.ovirt.engine.core.bll.RemoveDiskCommand.endCommand(RemoveDiskCommand.java:281)
> [engine-bll.jar:]
> at
> org.ovirt.engine.core.bll.RemoveDiskCommand.EndSuccessfully(RemoveDiskCommand.java:272)
> [engine-bll.jar:]
> at
> org.ovirt.engine.core.bll.CommandBase.InternalEndSuccessfully(CommandBase.java:465)
> [engine-bll.jar:]
> at
> org.ovirt.engine.core.bll.CommandBase.endActionInTransactionScope(CommandBase.java:420)
> [engine-bll.jar:]
> at
> org.ovirt.engine.core.bll.CommandBase.runInTransaction(CommandBase.java:1205)
> [engine-bll.jar:]
> at
> org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInSuppressed(TransactionSupport.java:168)
> [engine-utils.jar:]
> at
> org.ovirt.engine.core.utils.transaction.TransactionSupport.executeInScope(TransactionSupport.java:107)
> [engine-utils.jar:]
> at org.ovirt.engine.core.bll.CommandBase.EndAction(CommandBase.java:366)
> [engine-bll.jar:]
> at org.ovirt.engine.core.bll.Backend.endAction(Backend.java:356)
> [engine-bll.jar:]
> at sun.reflect.GeneratedMethodAccessor149.invoke(Unknown Source)
> [:1.7.0_06-icedtea]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [rt.jar:1.7.0_06-icedtea]
> at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_06-icedtea]
> at
> org.jboss.as.ee.component.ManagedReferenceMethodInterceptorFactory$ManagedReferenceMethodInterceptor.processInvocation(ManagedReferenceMethodInterceptorFactory.java:72)
> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
> at
> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:374)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.ovirt.engine.core.utils.ThreadLocalSessionCleanerInterceptor.injectWebContextToThreadLocal(ThreadLocalSessionCleanerInterceptor.java:11)
> [engine-utils.jar:]
> at sun.reflect.GeneratedMethodAccessor68.invoke(Unknown Source)
> [:1.7.0_06-icedtea]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> [rt.jar:1.7.0_06-icedtea]
> at java.lang.reflect.Method.invoke(Method.java:601) [rt.jar:1.7.0_06-icedtea]
> at
> org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptorFactory$ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptorFactory.java:123)
> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
> at
> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.invocation.WeavedInterceptor.processInvocation(WeavedInterceptor.java:53)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.as.ee.component.interceptors.UserInterceptorFactory$1.processInvocation(UserInterceptorFactory.java:36)
> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
> at
> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.invocation.InitialInterceptor.processInvocation(InitialInterceptor.java:21)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.as.ee.component.interceptors.ComponentDispatcherInterceptor.processInvocation(ComponentDispatcherInterceptor.java:53)
> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
> at
> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:53)
> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
> at
> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211)
> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
> at
> org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363)
> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
> at
> org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194)
> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
> at
> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41)
> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
> at
> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59)
> [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
> at
> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50)
> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
> at
> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45)
> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
> at
> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
> [jboss-invocation.jar:1.1.1.Final]
> at org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165)
> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
> at
> org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173)
> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
> at
> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
> [jboss-invocation.jar:1.1.1.Final]
> at
> org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72)
> [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
> at
> org.ovirt.engine.core.bll.interfaces.BackendInternal$$$view9.endAction(Unknown
> Source) [engine-bll.jar:]
> at
> org.ovirt.engine.core.bll.EntityAsyncTask.EndCommandAction(EntityAsyncTask.java:134)
> [engine-bll.jar:]
> at
> org.ovirt.engine.core.bll.EntityAsyncTask.access$000(EntityAsyncTask.java:23)
> [engine-bll.jar:]
> at
> org.ovirt.engine.core.bll.EntityAsyncTask$1.run(EntityAsyncTask.java:104)
> [engine-bll.jar:]
> at
> org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil$InternalWrapperRunnable.run(ThreadPoolUtil.java:64)
> [engine-utils.jar:]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> [rt.jar:1.7.0_06-icedtea]
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> [rt.jar:1.7.0_06-icedtea]
> at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> [rt.jar:1.7.0_06-icedtea]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110)
> [rt.jar:1.7.0_06-icedtea]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603)
> [rt.jar:1.7.0_06-icedtea]
> at java.lang.Thread.run(Thread.java:722) [rt.jar:1.7.0_06-icedtea]
>
> 2012-10-26 14:14:50,540 INFO  [org.ovirt.engine.core.bll.EntityAsyncTask]
> (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]:
> EndAction for action type RemoveDisk completed, handling the result.
> 2012-10-26 14:14:50,541 INFO  [org.ovirt.engine.core.bll.EntityAsyncTask]
> (pool-3-thread-47) EntityAsyncTask::HandleEndActionResult [within thread]:
> EndAction for action type RemoveDisk hasnt succeeded, not clearing tasks,
> will attempt again next polling.
>
>
> Engine feels slower than usual from having to constantly try to delete
> disks that aren´t there. I have tried restarting it, but when it starts,
> it remembers that "Oh yeah, there was these disks I absolutely *have* to
> delete, better pick up where I left off!" and loops this forever.
>
> Is there a way to make it forget?

Hi Karli,

It looks like the issue that was fixed in [1].  If you can upgrade, I 
believe it would resolve itself.  If not, then you can manually remove the 
task from the async_tasks table of the engine db; something like [2] 
should do.

HTH,
Greg

[1] http://gerrit.ovirt.org/#/c/5621/2
[2] delete from async_tasks where task_id = 
'a50a874d-5a81-4268-a085-2602df29def1';

>
>
> Med Vänliga Hälsningar
> -------------------------------------------------------------------------------
> Karli Sjöberg
> Swedish University of Agricultural Sciences
> Box 7079 (Visiting Address Kronåsvägen 8)
> S-750 07 Uppsala, Sweden
> Phone:  +46-(0)18-67 15 66
> karli.sjoberg at slu.se <mailto:karli.sjoberg at adm.slu.se>
>
>
>
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
>