[ovirt-users] Help....

Koen Vanoppen vanoppen.koen at gmail.com
Wed Jun 18 07:43:14 UTC 2014


OK.. I figured out the issue... Apparently something on mercury hypervisor
was holding back the engine. I restarted the vdsm service on mercury2 and
THAT solved the issue. Still don't know what it was exactly but... For now
I'm relieved and happy :-). Thank guys.
On Jun 18, 2014 9:07 AM, "Koen Vanoppen" <vanoppen.koen at gmail.com> wrote:

> This is the error log from vdsm.log on the mercury2:
>
> ummy-46::DEBUG::2014-06-18
> 09:05:44,358::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB)
> copied, 0.0472852 s, 21.7 MB/s\n'; <rc> = 0
> Dummy-46::DEBUG::2014-06-18
> 09:05:46,384::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> 'dd
> if=/rhev/data-center/1d03dc05-008b-4d14-97ce-b17bd714183d/mastersd/dom_md/inbox
> iflag=direct,fullblock count=1 bs=1024000' (cwd None)
> Dummy-46::DEBUG::2014-06-18
> 09:05:46,510::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB)
> copied, 0.0573396 s, 17.9 MB/s\n'; <rc> = 0
> Dummy-46::DEBUG::2014-06-18
> 09:05:48,526::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> 'dd
> if=/rhev/data-center/1d03dc05-008b-4d14-97ce-b17bd714183d/mastersd/dom_md/inbox
> iflag=direct,fullblock count=1 bs=1024000' (cwd None)
> Dummy-46::DEBUG::2014-06-18
> 09:05:48,657::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB)
> copied, 0.0441559 s, 23.2 MB/s\n'; <rc> = 0
> Thread-18::DEBUG::2014-06-18
> 09:05:49,088::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd
> iflag=direct if=/dev/f130d166-546e-4905-8b8f-55a1c1dd2e4f/metadata bs=4096
> count=1' (cwd None)
> Thread-18::DEBUG::2014-06-18
> 09:05:49,101::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS:
> <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied,
> 0.000388207 s, 10.6 MB/s\n'; <rc> = 0
> Thread-17::DEBUG::2014-06-18
> 09:05:49,389::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd
> iflag=direct if=/dev/2d289011-8671-4995-8015-d5bdf6a7e9dc/metadata bs=4096
> count=1' (cwd None)
> Thread-17::DEBUG::2014-06-18
> 09:05:49,405::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS:
> <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied,
> 0.000418019 s, 9.8 MB/s\n'; <rc> = 0
> Dummy-46::DEBUG::2014-06-18
> 09:05:50,683::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> 'dd
> if=/rhev/data-center/1d03dc05-008b-4d14-97ce-b17bd714183d/mastersd/dom_md/inbox
> iflag=direct,fullblock count=1 bs=1024000' (cwd None)
> Dummy-46::DEBUG::2014-06-18
> 09:05:50,823::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB)
> copied, 0.046615 s, 22.0 MB/s\n'; <rc> = 0
> Dummy-46::DEBUG::2014-06-18
> 09:05:52,852::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> 'dd
> if=/rhev/data-center/1d03dc05-008b-4d14-97ce-b17bd714183d/mastersd/dom_md/inbox
> iflag=direct,fullblock count=1 bs=1024000' (cwd None)
> Thread-14253::WARNING::2014-06-18
> 09:05:53,305::fileSD::639::scanDomains::(collectMetaFiles) Metadata
> collection for domain path /rhev/data-center/mnt/vega.brusselsairport.aero:_var_lib_exports_iso
> timedout
> Traceback (most recent call last):
>   File "/usr/share/vdsm/storage/fileSD.py", line 628, in collectMetaFiles
>     sd.DOMAIN_META_DATA))
>   File "/usr/share/vdsm/storage/remoteFileHandler.py", line 297, in
> callCrabRPCFunction
>     *args, **kwargs)
>   File "/usr/share/vdsm/storage/remoteFileHandler.py", line 184, in
> callCrabRPCFunction
>     rawLength = self._recvAll(LENGTH_STRUCT_LENGTH, timeout)
>   File "/usr/share/vdsm/storage/remoteFileHandler.py", line 150, in
> _recvAll
>     raise Timeout()
> Timeout
> Thread-14253::DEBUG::2014-06-18
> 09:05:53,313::remoteFileHandler::260::RepoFileHelper.PoolHandler::(stop)
> Pool handler existed, OUT: '' ERR: ''
> Thread-19::ERROR::2014-06-18
> 09:05:53,317::sdc::143::Storage.StorageDomainCache::(_findDomain) domain
> 50cf24a4-d1ef-4105-a9a5-b81d91339175 not found
> Traceback (most recent call last):
>   File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>     dom = findMethod(sdUUID)
>   File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>     return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>   File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>     raise se.StorageDomainDoesNotExist(sdUUID)
> StorageDomainDoesNotExist: Storage domain does not exist:
> (u'50cf24a4-d1ef-4105-a9a5-b81d91339175',)
> Thread-19::ERROR::2014-06-18
> 09:05:53,321::domainMonitor::239::Storage.DomainMonitorThread::(_monitorDomain)
> Error while collecting domain 50cf24a4-d1ef-4105-a9a5-b81d91339175
> monitoring information
> Traceback (most recent call last):
>   File "/usr/share/vdsm/storage/domainMonitor.py", line 215, in
> _monitorDomain
>     self.domain.selftest()
>   File "/usr/share/vdsm/storage/sdc.py", line 49, in __getattr__
>     return getattr(self.getRealDomain(), attrName)
>   File "/usr/share/vdsm/storage/sdc.py", line 52, in getRealDomain
>     return self._cache._realProduce(self._sdUUID)
>   File "/usr/share/vdsm/storage/sdc.py", line 122, in _realProduce
>     domain = self._findDomain(sdUUID)
>   File "/usr/share/vdsm/storage/sdc.py", line 141, in _findDomain
>     dom = findMethod(sdUUID)
>   File "/usr/share/vdsm/storage/nfsSD.py", line 132, in findDomain
>     return NfsStorageDomain(NfsStorageDomain.findDomainPath(sdUUID))
>   File "/usr/share/vdsm/storage/nfsSD.py", line 122, in findDomainPath
>     raise se.StorageDomainDoesNotExist(sdUUID)
> StorageDomainDoesNotExist: Storage domain does not exist:
> (u'50cf24a4-d1ef-4105-a9a5-b81d91339175',)
> Dummy-46::DEBUG::2014-06-18
> 09:05:53,365::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB)
> copied, 0.237283 s, 4.3 MB/s\n'; <rc> = 0
> Dummy-46::DEBUG::2014-06-18
> 09:05:55,378::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> 'dd
> if=/rhev/data-center/1d03dc05-008b-4d14-97ce-b17bd714183d/mastersd/dom_md/inbox
> iflag=direct,fullblock count=1 bs=1024000' (cwd None)
> Dummy-46::DEBUG::2014-06-18
> 09:05:55,502::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB)
> copied, 0.050056 s, 20.5 MB/s\n'; <rc> = 0
> Dummy-46::DEBUG::2014-06-18
> 09:05:57,517::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> 'dd
> if=/rhev/data-center/1d03dc05-008b-4d14-97ce-b17bd714183d/mastersd/dom_md/inbox
> iflag=direct,fullblock count=1 bs=1024000' (cwd None)
> Dummy-46::DEBUG::2014-06-18
> 09:05:57,724::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB)
> copied, 0.119198 s, 8.6 MB/s\n'; <rc> = 0
> Thread-18::DEBUG::2014-06-18
> 09:05:59,109::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd
> iflag=direct if=/dev/f130d166-546e-4905-8b8f-55a1c1dd2e4f/metadata bs=4096
> count=1' (cwd None)
> Thread-18::DEBUG::2014-06-18
> 09:05:59,121::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS:
> <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied,
> 0.000346888 s, 11.8 MB/s\n'; <rc> = 0
> Thread-17::DEBUG::2014-06-18
> 09:05:59,420::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd
> iflag=direct if=/dev/2d289011-8671-4995-8015-d5bdf6a7e9dc/metadata bs=4096
> count=1' (cwd None)
> Thread-17::DEBUG::2014-06-18
> 09:05:59,436::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS:
> <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied,
> 0.000418941 s, 9.8 MB/s\n'; <rc> = 0
> Dummy-46::DEBUG::2014-06-18
> 09:05:59,755::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> 'dd
> if=/rhev/data-center/1d03dc05-008b-4d14-97ce-b17bd714183d/mastersd/dom_md/inbox
> iflag=direct,fullblock count=1 bs=1024000' (cwd None)
> Dummy-46::DEBUG::2014-06-18
> 09:05:59,890::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB)
> copied, 0.0545321 s, 18.8 MB/s\n'; <rc> = 0
> Dummy-46::DEBUG::2014-06-18
> 09:06:01,916::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> 'dd
> if=/rhev/data-center/1d03dc05-008b-4d14-97ce-b17bd714183d/mastersd/dom_md/inbox
> iflag=direct,fullblock count=1 bs=1024000' (cwd None)
> Dummy-46::DEBUG::2014-06-18
> 09:06:02,040::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB)
> copied, 0.0435774 s, 23.5 MB/s\n'; <rc> = 0
> Dummy-46::DEBUG::2014-06-18
> 09:06:04,065::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> 'dd
> if=/rhev/data-center/1d03dc05-008b-4d14-97ce-b17bd714183d/mastersd/dom_md/inbox
> iflag=direct,fullblock count=1 bs=1024000' (cwd None)
> Dummy-46::DEBUG::2014-06-18
> 09:06:04,213::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB)
> copied, 0.054666 s, 18.7 MB/s\n'; <rc> = 0
> Dummy-46::DEBUG::2014-06-18
> 09:06:06,233::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> 'dd
> if=/rhev/data-center/1d03dc05-008b-4d14-97ce-b17bd714183d/mastersd/dom_md/inbox
> iflag=direct,fullblock count=1 bs=1024000' (cwd None)
> Dummy-46::DEBUG::2014-06-18
> 09:06:06,369::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB)
> copied, 0.0491731 s, 20.8 MB/s\n'; <rc> = 0
> Dummy-46::DEBUG::2014-06-18
> 09:06:08,395::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> 'dd
> if=/rhev/data-center/1d03dc05-008b-4d14-97ce-b17bd714183d/mastersd/dom_md/inbox
> iflag=direct,fullblock count=1 bs=1024000' (cwd None)
> Dummy-46::DEBUG::2014-06-18
> 09:06:08,521::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB)
> copied, 0.0436811 s, 23.4 MB/s\n'; <rc> = 0
> Thread-18::DEBUG::2014-06-18
> 09:06:09,130::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd
> iflag=direct if=/dev/f130d166-546e-4905-8b8f-55a1c1dd2e4f/metadata bs=4096
> count=1' (cwd None)
> Thread-18::DEBUG::2014-06-18
> 09:06:09,144::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS:
> <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied,
> 0.000437903 s, 9.4 MB/s\n'; <rc> = 0
> Thread-17::DEBUG::2014-06-18
> 09:06:09,450::blockSD::605::Storage.Misc.excCmd::(getReadDelay) '/bin/dd
> iflag=direct if=/dev/2d289011-8671-4995-8015-d5bdf6a7e9dc/metadata bs=4096
> count=1' (cwd None)
> Thread-17::DEBUG::2014-06-18
> 09:06:09,466::blockSD::605::Storage.Misc.excCmd::(getReadDelay) SUCCESS:
> <err> = '1+0 records in\n1+0 records out\n4096 bytes (4.1 kB) copied,
> 0.000364545 s, 11.2 MB/s\n'; <rc> = 0
> Dummy-46::DEBUG::2014-06-18
> 09:06:10,547::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> 'dd
> if=/rhev/data-center/1d03dc05-008b-4d14-97ce-b17bd714183d/mastersd/dom_md/inbox
> iflag=direct,fullblock count=1 bs=1024000' (cwd None)
> Dummy-46::DEBUG::2014-06-18
> 09:06:10,675::storage_mailbox::731::Storage.Misc.excCmd::(_checkForMail)
> SUCCESS: <err> = '1+0 records in\n1+0 records out\n1024000 bytes (1.0 MB)
> copied, 0.0454138 s, 22.5 MB/s\n'; <rc> = 0
>
>
>
> 2014-06-18 9:04 GMT+02:00 Koen Vanoppen <vanoppen.koen at gmail.com>:
>
>> Nope, THe Hypervisors DO excist... They where recently added...
>>
>>
>> 2014-06-18 9:03 GMT+02:00 Koen Vanoppen <vanoppen.koen at gmail.com>:
>>
>> Can I delete this one from the database without breaking anything?
>>>
>>> engine=# select vds_id from vds_static where vds_name='mercury2';
>>>                 vds_id
>>> --------------------------------------
>>>  dfddc678-f8ee-45eb-897a-885c83de870e
>>> (1 row)
>>>
>>> The host has been renamed as mentioned before....
>>>
>>>
>>> 2014-06-18 8:41 GMT+02:00 Koen Vanoppen <vanoppen.koen at gmail.com>:
>>>
>>> Maybe also important. This "ResourceManager::refreshVdsRunTimeInfo:
>>>> Error: IllegalStateException: JBAS011049: Component is stopped, vds =
>>>> dfddc678-f8ee-45eb-897a-885c83de870e : mercury2" We have no host mercury2
>>>> anymore... LOOONG time ago we renamed the server from mercury2 to
>>>> saturnus2.... This also comes right before the error...
>>>>
>>>>
>>>> 2014-06-18 8:30 GMT+02:00 Koen Vanoppen <vanoppen.koen at gmail.com>:
>>>>
>>>> Don't know if this has anything to do with it. But this comes right
>>>>> before the error comes up:
>>>>>
>>>>> 2014-06-18 08:29:17,181 WARN
>>>>> [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
>>>>> (org.ovirt.thread.pool-6-thread-45) Executing a command:
>>>>> java.util.concurrent.FutureTask , but note that there are 3 tasks in the
>>>>> queue.
>>>>> 2014-06-18 08:29:17,182 WARN
>>>>> [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
>>>>> (org.ovirt.thread.pool-6-thread-36) Executing a command:
>>>>> java.util.concurrent.FutureTask , but note that there are 2 tasks in the
>>>>> queue.
>>>>> 2014-06-18 08:29:17,183 WARN
>>>>> [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
>>>>> (org.ovirt.thread.pool-6-thread-37) Executing a command:
>>>>> java.util.concurrent.FutureTask , but note that there are 1 tasks in the
>>>>> queue.
>>>>> 2014-06-18 08:29:20,407 WARN
>>>>> [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
>>>>> (org.ovirt.thread.pool-6-thread-47) Executing a command:
>>>>> java.util.concurrent.FutureTask , but note that there are 2 tasks in the
>>>>> queue.
>>>>> 2014-06-18 08:29:20,408 WARN
>>>>> [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
>>>>> (org.ovirt.thread.pool-6-thread-11) Executing a command:
>>>>> java.util.concurrent.FutureTask , but note that there are 1 tasks in the
>>>>> queue.
>>>>> 2014-06-18 08:29:20,974 WARN
>>>>> [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
>>>>> (org.ovirt.thread.pool-6-thread-10) Executing a command:
>>>>> java.util.concurrent.FutureTask , but note that there are 1 tasks in the
>>>>> queue.
>>>>> 2014-06-18 08:29:21,169 WARN
>>>>> [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
>>>>> (org.ovirt.thread.pool-6-thread-9) Executing a command:
>>>>> java.util.concurrent.FutureTask , but note that there are 1 tasks in the
>>>>> queue.
>>>>> 2014-06-18 08:29:24,391 WARN
>>>>> [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
>>>>> (org.ovirt.thread.pool-6-thread-18) Executing a command:
>>>>> java.util.concurrent.FutureTask , but note that there are 1 tasks in the
>>>>> queue.
>>>>> 2014-06-18 08:29:26,811 WARN
>>>>> [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
>>>>> (org.ovirt.thread.pool-6-thread-19) Executing a command:
>>>>> java.util.concurrent.FutureTask , but note that there are 1 tasks in the
>>>>> queue.
>>>>> 2014-06-18 08:29:27,612 WARN
>>>>> [org.ovirt.engine.core.utils.threadpool.ThreadPoolUtil]
>>>>> (org.ovirt.thread.pool-6-thread-4) Executing a command:
>>>>> java.util.concurrent.FutureTask , but note that there are 1 tasks in the
>>>>> queue.
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> 2014-06-18 7:51 GMT+02:00 Yair Zaslavsky <yzaslavs at redhat.com>:
>>>>>
>>>>>
>>>>>> Roy, Omer - can you take a look?
>>>>>> I saw some error at adding external managed vms?
>>>>>>
>>>>>>
>>>>>> ----- Original Message -----
>>>>>> > From: "Koen Vanoppen" <vanoppen.koen at gmail.com>
>>>>>> > To: "Yair Zaslavsky" <yzaslavs at redhat.com>
>>>>>> > Sent: Wednesday, June 18, 2014 8:41:35 AM
>>>>>> > Subject: Re: [ovirt-users] Help....
>>>>>> >
>>>>>> > I've update from 3.4.0.
>>>>>> > Logs attached. Thanx!!
>>>>>> >
>>>>>> >
>>>>>> > 2014-06-18 7:36 GMT+02:00 Yair Zaslavsky <yzaslavs at redhat.com>:
>>>>>> >
>>>>>> > > Please provide full engine.log and full server.log
>>>>>> > >
>>>>>> > > Thanks!
>>>>>> > >
>>>>>> > > In addition, what version did you upgrade from?
>>>>>> > >
>>>>>> > >
>>>>>> > > ----- Original Message -----
>>>>>> > > > From: "Koen Vanoppen" <vanoppen.koen at gmail.com>
>>>>>> > > > To: users at ovirt.org
>>>>>> > > > Sent: Wednesday, June 18, 2014 7:55:15 AM
>>>>>> > > > Subject: [ovirt-users] Help....
>>>>>> > > >
>>>>>> > > > This happend after the update to 3.4.2 when I start the engine.
>>>>>> I can't
>>>>>> > > > login anymore... This is the error. Any Idea's? PLease....
>>>>>> > > >
>>>>>> > > > 2014-06-18 06:51:45,728 ERROR
>>>>>> > > > [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
>>>>>> > > > (DefaultQuartzScheduler_Worker-79)
>>>>>> > > ResourceManager::refreshVdsRunTimeInfo:
>>>>>> > > > Error: IllegalStateException: JBAS011049: Component is stopped,
>>>>>> vds =
>>>>>> > > > b34902ea-ad11-45d3-96ee-47de1864e4e0 : mercury1
>>>>>> > > > 2014-06-18 06:51:45,736 ERROR
>>>>>> > > > [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
>>>>>> > > > (DefaultQuartzScheduler_Worker-79) IllegalStateException:
>>>>>> JBAS011049:
>>>>>> > > > Component is stopped: java.lang.IllegalStateException:
>>>>>> JBAS011049:
>>>>>> > > > Component is stopped
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.BasicComponent.waitForComponentStart(BasicComponent.java:104)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:127)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.BasicComponent.createInstance(BasicComponent.java:85)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:66)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:63)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> org.jboss.as.ejb3.pool.AbstractPool.create(AbstractPool.java:60)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.pool.strictmax.StrictMaxPool.get(StrictMaxPool.java:123)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:47)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.ovirt.engine.core.common.businessentities.IVdsEventListener$$$view6.addExternallyManagedVms(Unknown
>>>>>> > > > Source)
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.saveDataToDb(VdsUpdateRunTimeInfo.java:175)
>>>>>> > > > [vdsbroker.jar:]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.refresh(VdsUpdateRunTimeInfo.java:359)
>>>>>> > > > [vdsbroker.jar:]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:231)
>>>>>> > > > [vdsbroker.jar:]
>>>>>> > > >     at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown
>>>>>> Source)
>>>>>> > > > [:1.7.0_51]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>>> > > > [rt.jar:1.7.0_51]
>>>>>> > > >     at java.lang.reflect.Method.invoke(Method.java:606)
>>>>>> [rt.jar:1.7.0_51]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60)
>>>>>> > > > [scheduler.jar:]
>>>>>> > > >     at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
>>>>>> > > [quartz.jar:]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
>>>>>> > > > [quartz.jar:]
>>>>>> > > >
>>>>>> > > > 2014-06-18 06:51:45,952 ERROR
>>>>>> > > > [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
>>>>>> > > > (DefaultQuartzScheduler_Worker-79)
>>>>>> ResourceManager::RerunFailedCommand:
>>>>>> > > > Error: IllegalStateException: JBAS011049: Component is stopped,
>>>>>> vds =
>>>>>> > > > b34902ea-ad11-45d3-96ee-47de1864e4e0 : mercury1
>>>>>> > > > 2014-06-18 06:51:45,955 ERROR
>>>>>> > > > [org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo]
>>>>>> > > > (DefaultQuartzScheduler_Worker-79) IllegalStateException:
>>>>>> JBAS011049:
>>>>>> > > > Component is stopped: java.lang.IllegalStateException:
>>>>>> JBAS011049:
>>>>>> > > > Component is stopped
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.BasicComponent.waitForComponentStart(BasicComponent.java:104)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:127)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.BasicComponent.createInstance(BasicComponent.java:85)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:66)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.component.stateless.StatelessSessionComponent$1.create(StatelessSessionComponent.java:63)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> org.jboss.as.ejb3.pool.AbstractPool.create(AbstractPool.java:60)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.pool.strictmax.StrictMaxPool.get(StrictMaxPool.java:123)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.component.pool.PooledInstanceInterceptor.processInvocation(PooledInstanceInterceptor.java:47)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:363)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:194)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.ovirt.engine.core.common.businessentities.IVdsEventListener$$$view6.runFailedAutoStartVMs(Unknown
>>>>>> > > > Source)
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.ovirt.engine.core.vdsbroker.VdsUpdateRunTimeInfo.afterRefreshTreatment(VdsUpdateRunTimeInfo.java:433)
>>>>>> > > > [vdsbroker.jar:]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:251)
>>>>>> > > > [vdsbroker.jar:]
>>>>>> > > >     at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown
>>>>>> Source)
>>>>>> > > > [:1.7.0_51]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>>> > > > [rt.jar:1.7.0_51]
>>>>>> > > >     at java.lang.reflect.Method.invoke(Method.java:606)
>>>>>> [rt.jar:1.7.0_51]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60)
>>>>>> > > > [scheduler.jar:]
>>>>>> > > >     at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
>>>>>> > > [quartz.jar:]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
>>>>>> > > > [quartz.jar:]
>>>>>> > > >
>>>>>> > > > 2014-06-18 06:51:46,134 ERROR
>>>>>> > > > [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl]
>>>>>> > > > (DefaultQuartzScheduler_Worker-79) Failed to invoke scheduled
>>>>>> method
>>>>>> > > > onTimer: java.lang.reflect.InvocationTargetException
>>>>>> > > >     at sun.reflect.GeneratedMethodAccessor138.invoke(Unknown
>>>>>> Source)
>>>>>> > > > [:1.7.0_51]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>>>>> > > > [rt.jar:1.7.0_51]
>>>>>> > > >     at java.lang.reflect.Method.invoke(Method.java:606)
>>>>>> [rt.jar:1.7.0_51]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> org.ovirt.engine.core.utils.timer.JobWrapper.execute(JobWrapper.java:60)
>>>>>> > > > [scheduler.jar:]
>>>>>> > > >     at org.quartz.core.JobRunShell.run(JobRunShell.java:213)
>>>>>> > > [quartz.jar:]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
>>>>>> > > > [quartz.jar:]
>>>>>> > > > Caused by: java.lang.IllegalStateException: JBAS011049:
>>>>>> Component is
>>>>>> > > stopped
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.BasicComponent.waitForComponentStart(BasicComponent.java:104)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.BasicComponent.constructComponentInstance(BasicComponent.java:127)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.BasicComponent.createInstance(BasicComponent.java:85)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.component.singleton.SingletonComponent.getComponentInstance(SingletonComponent.java:116)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.component.singleton.SingletonComponentInstanceAssociationInterceptor.processInvocation(SingletonComponentInstanceAssociationInterceptor.java:48)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:211)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.notSupported(CMTTxInterceptor.java:288)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTTxInterceptor.java:188)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.component.interceptors.CurrentInvocationContextInterceptor.processInvocation(CurrentInvocationContextInterceptor.java:41)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ejb3.component.interceptors.LoggingInterceptor.processInvocation(LoggingInterceptor.java:59)
>>>>>> > > > [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.TCCLInterceptor.processInvocation(TCCLInterceptor.java:45)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> org.jboss.as.ee.component.ViewService$View.invoke(ViewService.java:165)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.ViewDescription$1.processInvocation(ViewDescription.java:173)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:288)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.invocation.ChainedInterceptor.processInvocation(ChainedInterceptor.java:61)
>>>>>> > > > [jboss-invocation-1.1.1.Final.jar:1.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.jboss.as.ee.component.ProxyInvocationHandler.invoke(ProxyInvocationHandler.java:72)
>>>>>> > > > [jboss-as-ee-7.1.1.Final.jar:7.1.1.Final]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> org.ovirt.engine.core.utils.lock.LockManager$$$view3.releaseLock(Unknown
>>>>>> > > > Source)
>>>>>> > > >     at
>>>>>> > > >
>>>>>> org.ovirt.engine.core.vdsbroker.VdsManager.onTimer(VdsManager.java:285)
>>>>>> > > > [vdsbroker.jar:]
>>>>>> > > >     ... 6 more
>>>>>> > > >
>>>>>> > > > 2014-06-18 06:51:46,263 ERROR
>>>>>> > > > [org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl]
>>>>>> > > > (DefaultQuartzScheduler_Worker-79) failed to reschedule the job:
>>>>>> > > > org.quartz.SchedulerException: The Scheduler has been shutdown.
>>>>>> > > >     at
>>>>>> > > >
>>>>>> org.quartz.core.QuartzScheduler.validateState(QuartzScheduler.java:749)
>>>>>> > > > [quartz.jar:]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> org.quartz.core.QuartzScheduler.rescheduleJob(QuartzScheduler.java:1060)
>>>>>> > > > [quartz.jar:]
>>>>>> > > >     at
>>>>>> org.quartz.impl.StdScheduler.rescheduleJob(StdScheduler.java:312)
>>>>>> > > > [quartz.jar:]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl.rescheduleAJob(SchedulerUtilQuartzImpl.java:331)
>>>>>> > > > [scheduler.jar:]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.ovirt.engine.core.utils.timer.FixedDelayJobListener.jobWasExecuted(FixedDelayJobListener.java:91)
>>>>>> > > > [scheduler.jar:]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.quartz.core.QuartzScheduler.notifyJobListenersWasExecuted(QuartzScheduler.java:1936)
>>>>>> > > > [quartz.jar:]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.quartz.core.JobRunShell.notifyJobListenersComplete(JobRunShell.java:361)
>>>>>> > > > [quartz.jar:]
>>>>>> > > >     at org.quartz.core.JobRunShell.run(JobRunShell.java:235)
>>>>>> > > [quartz.jar:]
>>>>>> > > >     at
>>>>>> > > >
>>>>>> > >
>>>>>> org.quartz.simpl.SimpleThreadPool$WorkerThread.run(SimpleThreadPool.java:557)
>>>>>> > > > [quartz.jar:]
>>>>>> > > >
>>>>>> > > > _______________________________________________
>>>>>> > > > Users mailing list
>>>>>> > > > Users at ovirt.org
>>>>>> > > > http://lists.ovirt.org/mailman/listinfo/users
>>>>>> > > >
>>>>>> > >
>>>>>> >
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20140618/8cbbb6fb/attachment-0001.html>


More information about the Users mailing list