2016-12-22 08:43:37,134-05 DEBUG [org.ovirt.vdsm.jsonrpc.client.reactors.stomp.impl.Message] (SSL Stomp Reactor) [188ab77c] MESSAGE
content-length:743
destination:jms.queue.events
content-type:application/json
subscription:db78fa50-cfb9-462e-860f-871ea935d645
{"params": {"notify_time": 4295938370, "09f862a9-9531-4c4c-b846-0d95d374f29c": {"status": "Down", "timeOffset": "0", "exitReason": 1, "exitMessage": "internal error: qemu unexpectedly closed the monitor: 2016-12-22T13:43:35.791590Z qemu-kvm: warning: CPU(s) not present in any NUMA nodes: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15\n2016-12-22T13:43:35.791854Z qemu-kvm: warning: All CPU(s) up to maxcpus should be described in NUMA config\n2016-12-22T13:43:35.840363Z qemu-kvm: -device usb-ccid,id=ccid0,bus=usb.0,port=1: Warning: speed mismatch trying to attach usb device \"QEMU USB CCID\" (full speed) to bus \"usb.0\", port \"1\" (high speed)", "exitCode": 1}}, "jsonrpc": "2.0", "method": "|virt|VM_status|09f862a9-9531-4c4c-b846-0d95d374f29c"}�
2016-12-22 08:43:37,134-05 DEBUG [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) [] Message received: {"params": {"notify_time": 4295938370, "09f862a9-9531-4c4c-b846-0d95d374f29c": {"status": "Down", "timeOffset": "0", "exitReason": 1, "exitMessage": "internal error: qemu unexpectedly closed the monitor: 2016-12-22T13:43:35.791590Z qemu-kvm: warning: CPU(s) not present in any NUMA nodes: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15\n2016-12-22T13:43:35.791854Z qemu-kvm: warning: All CPU(s) up to maxcpus should be described in NUMA config\n2016-12-22T13:43:35.840363Z qemu-kvm: -device usb-ccid,id=ccid0,bus=usb.0,port=1: Warning: speed mismatch trying to attach usb device \"QEMU USB CCID\" (full speed) to bus \"usb.0\", port \"1\" (high speed)", "exitCode": 1}}, "jsonrpc": "2.0", "method": "|virt|VM_status|09f862a9-9531-4c4c-b846-0d95d374f29c"}
2016-12-22 08:43:37,136-05 DEBUG [org.ovirt.vdsm.jsonrpc.client.internal.ResponseWorker] (ResponseWorker) [] Event arrived from 192.168.201.4 containing {"notify_time":4295938370,"09f862a9-9531-4c4c-b846-0d95d374f29c":{"status":"Down","timeOffset":"0","exitReason":1,"exitMessage":"internal error: qemu unexpectedly closed the monitor: 2016-12-22T13:43:35.791590Z qemu-kvm: warning: CPU(s) not present in any NUMA nodes: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15\n2016-12-22T13:43:35.791854Z qemu-kvm: warning: All CPU(s) up to maxcpus should be described in NUMA config\n2016-12-22T13:43:35.840363Z qemu-kvm: -device usb-ccid,id=ccid0,bus=usb.0,port=1: Warning: speed mismatch trying to attach usb device \"QEMU USB CCID\" (full speed) to bus \"usb.0\", port \"1\" (high speed)","exitCode":1}}
2016-12-22 08:43:37,140-05 DEBUG [org.ovirt.engine.core.vdsbroker.monitoring.EventVmStatsRefresher] (ForkJoinPool-1-worker-4) [] processing event for host lago-basic-suite-4-1-host0 data:
notify_time = 4295938370
09f862a9-9531-4c4c-b846-0d95d374f29c:
status = Down
timeOffset = 0
exitReason = 1
exitMessage = internal error: qemu unexpectedly closed the monitor: 2016-12-22T13:43:35.791590Z qemu-kvm: warning: CPU(s) not present in any NUMA nodes: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15
2016-12-22T13:43:35.791854Z qemu-kvm: warning: All CPU(s) up to maxcpus should be described in NUMA config
2016-12-22T13:43:35.840363Z qemu-kvm: -device usb-ccid,id=ccid0,bus=usb.0,port=1: Warning: speed mismatch trying to attach usb device "QEMU USB CCID" (full speed) to bus "usb.0", port "1" (high speed)
exitCode = 1
2016-12-22 08:43:37,143-05 DEBUG [org.ovirt.engine.core.vdsbroker.vdsbroker.VdsBrokerObjectsBuilder] (ForkJoinPool-1-worker-4) [] graphics data missing in XML.
2016-12-22 08:43:37,149-05 INFO [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] (ForkJoinPool-1-worker-4) [] VM '09f862a9-9531-4c4c-b846-0d95d374f29c' was reported as Down on VDS '6337f989-31cd-4462-b4f6-448237c05cab'(lago-basic-suite-4-1-host0)
2016-12-22 0
On Thu, Dec 22, 2016 at 11:59 AM, Michal Skrivanek <mskrivan@redhat.com> wrote:On 22 Dec 2016, at 10:46, Michal Skrivanek <michal.skrivanek@redhat.com> wrote:
On 22 Dec 2016, at 08:57, Doron Fediuck <dfediuck@redhat.com> wrote:On Thu, Dec 22, 2016 at 9:48 AM, Michal Skrivanek <michal.skrivanek@redhat.com > wrote:On 21 Dec 2016, at 20:52, Eyal Edri <eedri@redhat.com> wrote:Not as easy at it sounds, the current flow of ost is much more complicated than just build artifacts. I'm not saving we won't do it, but it won't be ready tomorrow and we designed lago exactly for being independent of any ci system so anyone can run it on their laptop.+1we just need to improve a little bit to make it possible for everyone. Almost there.So maybe using Jenkins might be simpler but people shouldn't skip verification just because such a job doesn't exist yet.On Dec 21, 2016 9:02 PM, "Oved Ourfali" <oourfali@redhat.com> wrote:Why not run it via Jenkins for patches?
Like, if you add a comment saying "run: ost" it will run it?please don’t add more. Even the Rerun-hooks thing is hard to remember. Even after years I always keep asking is it "Re-run hooks” or “Rerun-Hooks” or “rerun hooks”, does case matter…..blehEither add the button or maybe add it as a link in the automated comments (that would actually work good enough)Thanks,michalIt do it automatically based on another thing?
On Dec 21, 2016 17:42, "Eyal Edri" <eedri@redhat.com> wrote:
>
>
>
> On Wed, Dec 21, 2016 at 5:36 PM, Michal Skrivanek <michal.skrivanek@redhat.com> wrote:
>>
>>
>>> On 21 Dec 2016, at 16:25, Yaniv Kaul <ykaul@redhat.com> wrote:
>>>
>>>
>>>
>>> On Wed, Dec 21, 2016 at 5:19 PM, Michal Skrivanek <michal.skrivanek@redhat.com> wrote:
>>>>
>>>>
>>>>> On 21 Dec 2016, at 14:56, Michal Skrivanek <michal.skrivanek@redhat.com> wrote:
>>>>>
>>>>>
>>>>>> On 21 Dec 2016, at 12:19, Eyal Edri <eedri@redhat.com> wrote:
>>>>>>
>>>>>>
>>>>>>
>>>>>> On Wed, Dec 21, 2016 at 12:56 PM, Vinzenz Feenstra <vfeenstr@redhat.com> wrote:
>>>>>>>
>>>>>>>
>>>>>>>> On Dec 21, 2016, at 11:17 AM, Barak Korren <bkorren@redhat.com> wrote:
>>>>>>>>
>>>>>>>> The test for running VMs had been failing since yesterday.
>>>>>>>>
>>>>>>>> The patch merged before the failures started was:
>>>>>>>> https://gerrit.ovirt.org/#/c/68826/
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>>
>>>>>>>> The error we`re seeing is a time-out (after two minutes) while running
>>>>>>>> this API call:
>>>>>>>>
>>>>>>>> api.vms.get(VM0_NAME).status.state == ‘up'
>>>>>>>
>>>>>>>
>>>>>>> This is a REST API call, the patch above is Frontend. So this is unrelated.
>>>>>>>
>>>>>>> However on Host 0 I can see this:
>>>>>>>
>>>>>>> 2016-12-20 16:54:43,544 ERROR (vm/d299ab29) [virt.vm] (vmId='d299ab29-284a-435c-a50f-183a6e54def2') The vm start process failed (vm:615) Traceback (most recent call last): File "/usr/share/vdsm/virt/vm.py", line 551, in _startUnderlyingVm self._run() File "/usr/share/vdsm/virt/vm.py", line 1991, in _run self._connection.createXML(dom xml, flags), File "/usr/lib/python2.7/site-packa ges/vdsm/libvirtconnection.py" , line 123, in wrapper ret = f(*args, **kwargs) File "/usr/lib/python2.7/site-packa ges/vdsm/utils.py", line 941, in wrapper return func(inst, *args, **kwargs) File "/usr/lib64/python2.7/site-pac kages/libvirt.py", line 3782, in createXML if ret is None:raise libvirtError('virDomainCreateX ML() failed', conn=self) libvirtError: internal error: process exited while connecting to monitor: 2016-12-20T21:54:43.044971Z qemu-kvm: warning: CPU(s) not present in any NUMA nodes: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 2016-12-20T21:54:43.045164Z qemu-kvm: warning: All CPU(s) up to maxcpus should be described in NUMA config 2016-12-20T21:54:43.101886Z qemu-kvm: -device usb-ccid,id=ccid0,bus=usb.0,po rt=1: Warning: speed mismatch trying to attach usb device "QEMU USB CCID" (full speed) to bus "usb.0", port "1" (high speed)
>>>>>
>>>>>
>>>>> it is likely related to the recent USB patches
>>>>> investigating
>>>>
>>>>
>>>> hm, there are multiple problems (features/bugs depending on prefferred point of view:)
>>>> but there is an easy “fix” taking care of this particular problem, so we can start with that and figure out the proper approach later
>>>> arik will push that and merge it soon, likely today
>>>
>>>
>>> Thanks - if there is a quicker way to resolve this by reverting, I think it's a better option.
>>
>>
>> I really need to talk you out of this approach:-)
>> It does sound tempting and logical, but with our development model of large patch series combined with late detection it really is quite risky. Here it wouldn’t help much…and figuring out the right revert patch is more complicated then fixing it.
>
>
> Can we start asking developers run OST before they merge so it will be early detection and not late detection?
> We have video sessions on how to use OST, so it shouldn't be any issues in running it on a patch.
>
>>
>> I believe the best is to identify it early and notify the maintainer who merged that patch ASAP, as that person is in the best position to asses if revert is safe or if there is a simple follow up patch he can push right away
>>
>> We can surely improve on reporting, so Barak, how/why did you point to that particular patch in your email? It should start failing on 16c2ec236184b3152f1df8e874b43115f78d0989 (CommitDate: Fri Dec 16 01:56:07 2016 -0500)
>> Even though it may be that it was hidden because of c46f653a7846c3c2a76507b8dcf5bc0391ec5709 (CommitDate: Mon Dec 19 15:16:40 2016 -0500)
>>
>> (fix is ready, waiting on CI now)
>>
>> Thanks,
>> michal
>>
>>> Y.
>>>
>>>>
>>>>
>>>>>>> 2016-12-20 16:54:43,550 INFO (vm/d299ab29) [virt.vm] (vmId='d299ab29-284a-435c-a50f-183a6e54def2') Changed state to Down: internal error: process exited while connecting to monitor: 2016-12-20T21:54:43.044971Z qemu-kvm: warning: CPU(s) not present in any NUMA nodes: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 2016-12-20T21:54:43.045164Z qemu-kvm: warning: All CPU(s) up to maxcpus should be described in NUMA config 2016-12-20T21:54:43.101886Z qemu-kvm: -device usb-ccid,id=ccid0,bus=usb.0,po rt=1: Warning: speed mismatch trying to attach usb device "QEMU USB CCID" (full speed) to bus "usb.0", port "1" (high speed) (code=1) (vm:1197) 2016-12-20 16:54:43,550 INFO (vm/d299ab29) [virt.vm] (vmId='d299ab29-284a-435c-a50f -183a6e54def2') Stopping connection (guestagent:430)
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> And on The engine loads of these:
>>>>>>>
>>>>>>> 2016-12-20 16:53:57,844-05 ERROR [org.ovirt.engine.core.vdsbroker.vdsbroker.PollVDSCommand] (default task-17) [5ecd5a55-2b7a-4dd6-b42b-cc49b bfb3962] Command 'PollVDSCommand(HostName = lago-basic-suite-4-1-host0, VdsIdVDSCommandParametersBase: {runAsync='true', hostId='994b5d79-605f-4415-94f 2-02c79cfa246e'})' execution failed: VDSGenericException: VDSNetworkException: Timeout during rpc call 2016-12-20 16:53:57,849-05 DEBUG [org.ovirt.vdsm.jsonrpc.client .reactors.stomp.impl.Message] (SSL Stomp Reactor) [7971dfb4] MESSAGE content-length:80 destination:jms.topic.vdsm_res ponses content-type:application/json subscription:5b6494d5-d5a0-477 1-941c-a8be70f72450 {"jsonrpc": "2.0", "id": "3c95fdb0-5b77-4927-9f6e-adc73 95c122d", "result": true}� 2016-12-20 16:53:57,850-05 DEBUG [org.ovirt.vdsm.jsonrpc.client .internal.ResponseWorker] (ResponseWorker) [] Message received: {"jsonrpc": "2.0", "id": "3c95fdb0-5b77-4927-9f6e-adc73 95c122d", "result": true} 2016-12-20 16:53:57,850-05 ERROR [org.ovirt.vdsm.jsonrpc.client .JsonRpcClient] (ResponseWorker) [] Not able to update response for "3c95fdb0-5b77-4927-9f6e-adc73 95c122d" 2016-12-20 16:53:57,844-05 DEBUG [org.ovirt.engine.core.vdsbrok er.vdsbroker.PollVDSCommand] (default task-17) [5ecd5a55-2b7a-4dd6-b42b-cc49b bfb3962] Exception: org.ovirt.engine.core.vdsbroke r.vdsbroker.VDSNetworkExceptio n: VDSGenericException: VDSNetworkException: Timeout during rpc call at org.ovirt.engine.core.vdsbroke r.vdsbroker.FutureVDSCommand.g et(FutureVDSCommand.java:73) [vdsbroker.jar:] at org.ovirt.engine.core.bll.netw ork.host.HostSetupNetworkPolle r.getValue(HostSetupNetworkPol ler.java:56) [bll.jar:] at org.ovirt.engine.core.bll.netw ork.host.HostSetupNetworkPolle r.poll(HostSetupNetworkPoller. java:41) [bll.jar:] at org.ovirt.engine.core.bll.netw ork.host.HostSetupNetworksComm and.invokeSetupNetworksCommand (HostSetupNetworksCommand.java :426) [bll.jar:] at org.ovirt.engine.core.bll.netw ork.host.HostSetupNetworksComm and.executeCommand(HostSetupNe tworksCommand.java:287) [bll.jar:] at org.ovirt.engine.core.bll.Comm andBase.executeWithoutTransact ion(CommandBase.java:1249) [bll.jar:] at org.ovirt.engine.core.bll.Comm andBase.executeActionInTransac tionScope(CommandBase.java:138 9) [bll.jar:] at org.ovirt.engine.core.bll.Comm andBase.runInTransaction(Comma ndBase.java:2053) [bll.jar:] at org.ovirt.engine.core.utils .tr ansaction.TransactionSupport.executeInSuppressed( TransactionSupport.java:164) [utils.jar:] at org.ovirt.engine.core.utils .tr ansaction.TransactionSupport.executeInScope( TransactionSupport.java:103) [utils.jar:] at org.ovirt.engine.core.bll.Comm andBase.execute(CommandBase.ja va:1449) [bll.jar:] at org.ovirt.engine.core.bll.Comm andBase.executeAction(CommandB ase.java:395) [bll.jar:] at org.ovirt.engine.core.bll.exec utor.DefaultBackendActionExecu tor.execute(DefaultBackendActi onExecutor.java:13) [bll.jar:] at org.ovirt.engine.core.bll.Back end.runAction(Backend.java:511 ) [bll.jar:] at org.ovirt.engine.core.bll.Back end.runActionImpl(Backend.java :493) [bll.jar:] at org.ovirt.engine.core.bll.Back end.runAction(Backend.java:446 ) [bll.jar:] at sun.reflect.GeneratedMethodAcc essor232.invoke(Unknown Source) [:1.8.0_111] at sun.reflect.DelegatingMethodAc cessorImpl.invoke(DelegatingMe thodAccessorImpl.java:43) [rt.jar:1.8.0_111] at java.lang.reflect.Method.invok e(Method.java:498) [rt.jar:1.8.0_111] at org.jboss.as.ee.component.Mana gedReferenceMethodInterceptor. processInvocation(ManagedRefer enceMethodInterceptor.java:52) at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.invocation.Intercept orContext$Invocation.proceed(I nterceptorContext.java:437) at org.jboss.as.weld.ejb.Jsr299Bi ndingsInterceptor.delegateInte rception(Jsr299BindingsInterce ptor.java:70) [wildfly-weld-10.1.0.Final.jar :10.1.0.Final] at org.jboss.as.weld.ejb.Jsr299Bi ndingsInterceptor.doMethodInte rception(Jsr299BindingsInterce ptor.java:80) [wildfly-weld-10.1.0.Final.jar :10.1.0.Final] at org.jboss.as.weld.ejb.Jsr299Bi ndingsInterceptor.processInvoc ation(Jsr299BindingsIntercepto r.java:93) [wildfly-weld-10.1.0.Final.jar :10.1.0.Final] at org.jboss.as.ee.component.inte rceptors.UserInterceptorFactor y$1.processInvocation(UserInte rceptorFactory.java:63) at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.invocation.Intercept orContext$Invocation.proceed(I nterceptorContext.java:437) at org.ovirt.engine.core.bll.inte rceptors.CorrelationIdTrackerI nterceptor.aroundInvoke(Correl ationIdTrackerInterceptor.java :13) [bll.jar:] at sun.reflect.GeneratedMethodAcc essor64.invoke(Unknown Source) [:1.8.0_111] at sun.reflect.DelegatingMethodAc cessorImpl.invoke(DelegatingMe thodAccessorImpl.java:43) [rt.jar:1.8.0_111] at java.lang.reflect.Method.invok e(Method.java:498) [rt.jar:1.8.0_111] at org.jboss.as.ee.component.Mana gedReferenceLifecycleMethodInt erceptor.processInvocation(Man agedReferenceLifecycleMethodIn terceptor.java:89) at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.as.ejb3.component .in vocationmetrics.ExecutionTimeInterceptor.processInvocatio n(ExecutionTimeInterceptor. java:43) [wildfly-ejb3-10.1.0.Final.jar :10.1.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.invocation.Intercept orContext$Invocation.proceed(I nterceptorContext.java:437) at org.jboss.weld.ejb.AbstractEJB RequestScopeActivationIntercep tor.aroundInvoke(AbstractEJBRe questScopeActivationIntercepto r.java:73) [weld-core-impl-2.3.5.Final.ja r:2.3.5.Final] at org.jboss.as.weld.ejb.EjbReque stScopeActivationInterceptor.p rocessInvocation(EjbRequestSco peActivationInterceptor.java:8 3) [wildfly-weld-10.1.0.Final.jar :10.1.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.as.ee.concurrent.Con currentContextInterceptor.proc essInvocation(ConcurrentContex tInterceptor.java:45) [wildfly-ee-10.1.0.Final.jar:1 0.1.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.invocation.InitialIn terceptor.processInvocation(In itialInterceptor.java:21) at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.invocation.ChainedIn terceptor.processInvocation(Ch ainedInterceptor.java:61) at org.jboss.as.ee.component.inte rceptors.ComponentDispatcherIn terceptor.processInvocation(Co mponentDispatcherInterceptor.j ava:52) at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.as.ejb3.component .si ngleton.SingletonComponentInstanceAssociationInterceptor. processInvocation( SingletonComponentInstanceAsso ciationInterceptor.java:53) [wildfly-ejb3-10.1.0.Final.jar :10.1.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.as.ejb3.tx.CMTTxInte rceptor.invokeInNoTx(CMTTxInte rceptor.java:263) [wildfly-ejb3-10.1.0.Final.jar :10.1.0.Final] at org.jboss.as.ejb3.tx.CMTTxInte rceptor.supports(CMTTxIntercep tor.java:374) [wildfly-ejb3-10.1.0.Final.jar :10.1.0.Final] at org.jboss.as.ejb3.tx.CMTTxInte rceptor.processInvocation(CMTT xInterceptor.java:243) [wildfly-ejb3-10.1.0.Final.jar :10.1.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.as.ejb3.component .in terceptors.CurrentInvocationContextInterceptor. processInvocation(CurrentInvoc ationContextInterceptor.java: 41) [wildfly-ejb3-10.1.0.Final.jar :10.1.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.as.ejb3.component .in vocationmetrics.WaitTimeInterceptor.processInvocation( WaitTimeInterceptor.java:47) [wildfly-ejb3-10.1.0.Final.jar :10.1.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.as.ejb3.security.Sec urityContextInterceptor.proces sInvocation(SecurityContextInt erceptor.java:100) [wildfly-ejb3-10.1.0.Final.jar :10.1.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.as.ejb3.deployment.p rocessors.StartupAwaitIntercep tor.processInvocation(StartupA waitInterceptor.java:22) [wildfly-ejb3-10.1.0.Final.jar :10.1.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.as.ejb3.component .in terceptors.ShutDownInterceptorFactory$1.processInvocation (ShutDownInterceptorFactory. java:64) [wildfly-ejb3-10.1.0.Final.jar :10.1.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.as.ejb3.component .in terceptors.LoggingInterceptor.processInvocation( LoggingInterceptor.java:67) [wildfly-ejb3-10.1.0.Final.jar :10.1.0.Final] at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.as.ee.component.N ame spaceContextInterceptor.processInvocation(NamespaceContex tInterceptor.java:50) at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.invocation.ContextCl assLoaderInterceptor.processIn vocation(ContextClassLoaderInt erceptor.java:64) at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.invocation.Intercept orContext.run(InterceptorConte xt.java:356) at org.wildfly.security.manager.W ildFlySecurityManager.doChecke d(WildFlySecurityManager.java: 636) at org.jboss.invocation.AccessChe ckingInterceptor.processInvoca tion(AccessCheckingInterceptor .java:61) at org.jboss.invocation.Intercept orContext.proceed(InterceptorC ontext.java:340) at org.jboss.invocation.Intercept