<div dir="ltr"><div><div><div>Ok no problem,<br><br></div> This is a testlab setup, I'll give the nightly a go.<br><br></div>Thanks,<br></div>Brett<br></div><div class="gmail_extra"><br><div class="gmail_quote">On 10 October 2017 at 07:48, Martin Perina <span dir="ltr"><<a href="mailto:mperina@redhat.com" target="_blank">mperina@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Hi,<br><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">according to error and source codes you are using either oVirt 4.2 Alpha or some nightly build, right? The error has already been fixed, so you need to wait for oVirt 4.2 Beta or upgrade to some recent nighlty build.<br><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Anyway please be aware that we cannot yet recommend using 4.2 Alpha/nightly in production, so use at your won risk.<br><br></div><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Regards<span class="HOEnZb"><font color="#888888"><br><br></font></span></div><span class="HOEnZb"><font color="#888888"><div class="gmail_default" style="font-family:arial,helvetica,sans-serif">Martin<br><br></div></font></span><div><div class="h5"><div class="gmail_extra"><br><div class="gmail_quote">On Tue, Oct 10, 2017 at 7:56 AM, Maton, Brett <span dir="ltr"><<a href="mailto:matonb@ltresources.co.uk" target="_blank">matonb@ltresources.co.uk</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div><div>Hi Martin,<br><br></div> Storage isn't an issue, that was me trying to force fix another problem (removing 'dead' hosted engine hosts)<br><br></div> This just popped up in engine.log:<br><br><font face="monospace,monospace">2017-10-10 06:53:09,022+01 ERROR [org.ovirt.engine.core.bll.Get<wbr>AgentFenceOptionsQuery] (default task-62) [3bfc7ef1-bede-40b4-8a97-a8cd1<wbr>cf2a0f6] Exception: java.lang.IllegalArgumentExcep<wbr>tion: VdsFenceOptionMapping has no value for version: general<br> at org.ovirt.engine.core.dal.dbbr<wbr>oker.generic.DBConfigUtils.<wbr>getValue(DBConfigUtils.java:<wbr>65) [dal.jar:]<br> at org.ovirt.engine.core.common.c<wbr>onfig.Config.getValue(Config.j<wbr>ava:28) [common.jar:]<br> at <a href="http://org.ovirt.engine.core.utils.pm">org.ovirt.engine.core.utils.pm</a><wbr>.FenceConfigHelper.getFenceCon<wbr>figurationValue(FenceConfigHel<wbr>per.java:96) [utils.jar:]<br> at <a href="http://org.ovirt.engine.core.utils.pm">org.ovirt.engine.core.utils.pm</a><wbr>.VdsFenceOptions.cacheFenceAge<wbr>ntsOptionMapping(VdsFenceOptio<wbr>ns.java:78) [utils.jar:]<br> at <a href="http://org.ovirt.engine.core.utils.pm">org.ovirt.engine.core.utils.pm</a><wbr>.VdsFenceOptions.initCache(Vds<wbr>FenceOptions.java:236) [utils.jar:]<br> at <a href="http://org.ovirt.engine.core.utils.pm">org.ovirt.engine.core.utils.pm</a><wbr>.VdsFenceOptions.<init>(VdsFen<wbr>ceOptions.java:63) [utils.jar:]<br> at <a href="http://org.ovirt.engine.core.utils.pm">org.ovirt.engine.core.utils.pm</a><wbr>.VdsFenceOptions.<init>(VdsFen<wbr>ceOptions.java:47) [utils.jar:]<br> at org.ovirt.engine.core.bll.GetA<wbr>gentFenceOptionsQuery.executeQ<wbr>ueryCommand(GetAgentFenceOptio<wbr>nsQuery.java:18) [bll.jar:]<br> at org.ovirt.engine.core.bll.Quer<wbr>iesCommandBase.executeCommand(<wbr>QueriesCommandBase.java:106) [bll.jar:]<br> at org.ovirt.engine.core.dal.VdcC<wbr>ommandBase.execute(VdcCommandB<wbr>ase.java:33) [dal.jar:]<br> at org.ovirt.engine.core.bll.exec<wbr>utor.DefaultBackendQueryExecut<wbr>or.execute(DefaultBackendQuery<wbr>Executor.java:14) [bll.jar:]<br> at org.ovirt.engine.core.bll.Back<wbr>end.runQueryImpl(Backend.java:<wbr>570) [bll.jar:]<br> at org.ovirt.engine.core.bll.Back<wbr>end.runQuery(Backend.java:539) [bll.jar:]<br> at sun.reflect.GeneratedMethodAcc<wbr>essor154.invoke(Unknown Source) [:1.8.0_144]<br> at sun.reflect.DelegatingMethodAc<wbr>cessorImpl.invoke(DelegatingMe<wbr>thodAccessorImpl.java:43) [rt.jar:1.8.0_144]<br> at java.lang.reflect.Method.invok<wbr>e(Method.java:498) [rt.jar:1.8.0_144]<br> at org.jboss.as.ee.component.Mana<wbr>gedReferenceMethodInterceptor.<wbr>processInvocation(ManagedRefer<wbr>enceMethodInterceptor.java:52)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.Intercept<wbr>orContext$Invocation.proceed(<wbr>InterceptorContext.java:509)<br> at org.jboss.as.weld.ejb.Delegati<wbr>ngInterceptorInvocationContext<wbr>.proceed(DelegatingInterceptor<wbr>InvocationContext.java:92) [wildfly-weld-ejb-11.0.0.CR1.j<wbr>ar:11.0.0.CR1]<br> at <a href="http://org.jboss.weld.interceptor.pro">org.jboss.weld.interceptor.pro</a><wbr>xy.WeldInvocationContext.inter<wbr>ceptorChainCompleted(WeldInvoc<wbr>ationContext.java:98) [weld-core-impl-2.4.3.Final.ja<wbr>r:2.4.3.Final]<br> at <a href="http://org.jboss.weld.interceptor.pro">org.jboss.weld.interceptor.pro</a><wbr>xy.WeldInvocationContext.proce<wbr>ed(WeldInvocationContext.java:<wbr>117) [weld-core-impl-2.4.3.Final.ja<wbr>r:2.4.3.Final]<br> at org.ovirt.engine.core.common.d<wbr>i.interceptor.LoggingIntercept<wbr>or.apply(LoggingInterceptor.<wbr>java:12) [common.jar:]<br> at sun.reflect.GeneratedMethodAcc<wbr>essor69.invoke(Unknown Source) [:1.8.0_144]<br> at sun.reflect.DelegatingMethodAc<wbr>cessorImpl.invoke(DelegatingMe<wbr>thodAccessorImpl.java:43) [rt.jar:1.8.0_144]<br> at java.lang.reflect.Method.invok<wbr>e(Method.java:498) [rt.jar:1.8.0_144]<br> at org.jboss.weld.interceptor.rea<wbr>der.SimpleInterceptorInvocatio<wbr>n$SimpleMethodInvocation.<wbr>invoke(SimpleInterceptorInvoca<wbr>tion.java:73) [weld-core-impl-2.4.3.Final.ja<wbr>r:2.4.3.Final]<br> at <a href="http://org.jboss.weld.interceptor.pro">org.jboss.weld.interceptor.pro</a><wbr>xy.WeldInvocationContext.invok<wbr>eNext(WeldInvocationContext.<wbr>java:83) [weld-core-impl-2.4.3.Final.ja<wbr>r:2.4.3.Final]<br> at <a href="http://org.jboss.weld.interceptor.pro">org.jboss.weld.interceptor.pro</a><wbr>xy.WeldInvocationContext.proce<wbr>ed(WeldInvocationContext.java:<wbr>115) [weld-core-impl-2.4.3.Final.ja<wbr>r:2.4.3.Final]<br> at org.jboss.weld.bean.Intercepto<wbr>rImpl.intercept(InterceptorImp<wbr>l.java:108) [weld-core-impl-2.4.3.Final.ja<wbr>r:2.4.3.Final]<br> at org.jboss.as.weld.ejb.Delegati<wbr>ngInterceptorInvocationContext<wbr>.proceed(DelegatingInterceptor<wbr>InvocationContext.java:82) [wildfly-weld-ejb-11.0.0.CR1.j<wbr>ar:11.0.0.CR1]<br> at org.jboss.as.weld.interceptors<wbr>.EjbComponentInterceptorSuppor<wbr>t.delegateInterception(EjbComp<wbr>onentInterceptorSupport.java:<wbr>60)<br> at org.jboss.as.weld.interceptors<wbr>.Jsr299BindingsInterceptor.del<wbr>egateInterception(Jsr299Bindin<wbr>gsInterceptor.java:76)<br> at org.jboss.as.weld.interceptors<wbr>.Jsr299BindingsInterceptor.doM<wbr>ethodInterception(Jsr299Bindin<wbr>gsInterceptor.java:88)<br> at org.jboss.as.weld.interceptors<wbr>.Jsr299BindingsInterceptor.pro<wbr>cessInvocation(Jsr299BindingsI<wbr>nterceptor.java:101)<br> at org.jboss.as.ee.component.inte<wbr>rceptors.UserInterceptorFactor<wbr>y$1.processInvocation(UserInte<wbr>rceptorFactory.java:63)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.Intercept<wbr>orContext$Invocation.proceed(<wbr>InterceptorContext.java:509)<br> at org.ovirt.engine.core.bll.inte<wbr>rceptors.CorrelationIdTrackerI<wbr>nterceptor.aroundInvoke(Correl<wbr>ationIdTrackerInterceptor.<wbr>java:13) [bll.jar:]<br> at sun.reflect.GeneratedMethodAcc<wbr>essor150.invoke(Unknown Source) [:1.8.0_144]<br> at sun.reflect.DelegatingMethodAc<wbr>cessorImpl.invoke(DelegatingMe<wbr>thodAccessorImpl.java:43) [rt.jar:1.8.0_144]<br> at java.lang.reflect.Method.invok<wbr>e(Method.java:498) [rt.jar:1.8.0_144]<br> at org.jboss.as.ee.component.Mana<wbr>gedReferenceLifecycleMethodInt<wbr>erceptor.processInvocation(Man<wbr>agedReferenceLifecycleMethodIn<wbr>terceptor.java:89)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at <a href="http://org.jboss.as.ejb3.component.in">org.jboss.as.ejb3.component.in</a><wbr>vocationmetrics.ExecutionTimeI<wbr>nterceptor.processInvocation(E<wbr>xecutionTimeInterceptor.java:4<wbr>3) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.as.ee.concurrent.Con<wbr>currentContextInterceptor.proc<wbr>essInvocation(ConcurrentContex<wbr>tInterceptor.java:45) [wildfly-ee-11.0.0.CR1.jar:11.<wbr>0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.InitialIn<wbr>terceptor.processInvocation(In<wbr>itialInterceptor.java:40)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.ChainedIn<wbr>terceptor.processInvocation(Ch<wbr>ainedInterceptor.java:53)<br> at org.jboss.as.ee.component.inte<wbr>rceptors.ComponentDispatcherIn<wbr>terceptor.processInvocation(Co<wbr>mponentDispatcherInterceptor.<wbr>java:52)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at <a href="http://org.jboss.as.ejb3.component.si">org.jboss.as.ejb3.component.si</a><wbr>ngleton.SingletonComponentInst<wbr>anceAssociationInterceptor.pro<wbr>cessInvocation(SingletonCompon<wbr>entInstanceAssociationIntercep<wbr>tor.java:53) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.as.ejb3.tx.CMTTxInte<wbr>rceptor.invokeInNoTx(CMTTxInte<wbr>rceptor.java:264) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.as.ejb3.tx.CMTTxInte<wbr>rceptor.supports(CMTTxIntercep<wbr>tor.java:379) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.as.ejb3.tx.CMTTxInte<wbr>rceptor.processInvocation(CMTT<wbr>xInterceptor.java:244) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.Intercept<wbr>orContext$Invocation.proceed(<wbr>InterceptorContext.java:509)<br> at org.jboss.weld.ejb.AbstractEJB<wbr>RequestScopeActivationIntercep<wbr>tor.aroundInvoke(AbstractEJBRe<wbr>questScopeActivationIntercepto<wbr>r.java:73) [weld-core-impl-2.4.3.Final.ja<wbr>r:2.4.3.Final]<br> at org.jboss.as.weld.ejb.EjbReque<wbr>stScopeActivationInterceptor.<wbr>processInvocation(EjbRequestSc<wbr>opeActivationInterceptor.java:<wbr>89)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at <a href="http://org.jboss.as.ejb3.component.in">org.jboss.as.ejb3.component.in</a><wbr>terceptors.CurrentInvocationCo<wbr>ntextInterceptor.<wbr>processInvocation(CurrentInvoc<wbr>ationContextInterceptor.java:<wbr>41) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at <a href="http://org.jboss.as.ejb3.component.in">org.jboss.as.ejb3.component.in</a><wbr>vocationmetrics.WaitTimeInterc<wbr>eptor.processInvocation(WaitTi<wbr>meInterceptor.java:47) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.as.ejb3.security.Sec<wbr>urityContextInterceptor.proces<wbr>sInvocation(SecurityContextInt<wbr>erceptor.java:100) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.as.ejb3.deployment.p<wbr>rocessors.StartupAwaitIntercep<wbr>tor.processInvocation(StartupA<wbr>waitInterceptor.java:22) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at <a href="http://org.jboss.as.ejb3.component.in">org.jboss.as.ejb3.component.in</a><wbr>terceptors.ShutDownInterceptor<wbr>Factory$1.processInvocation(Sh<wbr>utDownInterceptorFactory.java:<wbr>64) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at <a href="http://org.jboss.as.ejb3.component.in">org.jboss.as.ejb3.component.in</a><wbr>terceptors.LoggingInterceptor.<wbr>processInvocation(LoggingInter<wbr>ceptor.java:67) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at <a href="http://org.jboss.as.ee.component.Name">org.jboss.as.ee.component.Name</a><wbr>spaceContextInterceptor.proces<wbr>sInvocation(NamespaceContextIn<wbr>terceptor.java:50)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.ContextCl<wbr>assLoaderInterceptor.processIn<wbr>vocation(ContextClassLoaderInt<wbr>erceptor.java:60)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.Intercept<wbr>orContext.run(InterceptorConte<wbr>xt.java:438)<br> at org.wildfly.security.manager.W<wbr>ildFlySecurityManager.doChecke<wbr>d(WildFlySecurityManager.java:<wbr>609)<br> at org.jboss.invocation.AccessChe<wbr>ckingInterceptor.processInvoca<wbr>tion(AccessCheckingInterceptor<wbr>.java:57)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.ChainedIn<wbr>terceptor.processInvocation(Ch<wbr>ainedInterceptor.java:53)<br> at org.jboss.as.ee.component.View<wbr>Service$View.invoke(ViewServic<wbr>e.java:198)<br> at org.jboss.as.ee.component.View<wbr>Description$1.processInvocatio<wbr>n(ViewDescription.java:185)<br> at org.jboss.as.ee.component.Prox<wbr>yInvocationHandler.invoke(Prox<wbr>yInvocationHandler.java:81)<br> at org.ovirt.engine.core.common.i<wbr>nterfaces.BackendLocal$$$view3<wbr>.runQuery(Unknown Source) [common.jar:]<br> at org.ovirt.engine.ui.frontend.s<wbr>erver.gwt.GenericApiGWTService<wbr>Impl.runQuery(GenericApiGWTSer<wbr>viceImpl.java:90)<br> at org.ovirt.engine.ui.frontend.s<wbr>erver.gwt.GenericApiGWTService<wbr>Impl.runMultipleQueries(Generi<wbr>cApiGWTServiceImpl.java:121)<br> at sun.reflect.GeneratedMethodAcc<wbr>essor161.invoke(Unknown Source) [:1.8.0_144]<br> at sun.reflect.DelegatingMethodAc<wbr>cessorImpl.invoke(DelegatingMe<wbr>thodAccessorImpl.java:43) [rt.jar:1.8.0_144]<br> at java.lang.reflect.Method.invok<wbr>e(Method.java:498) [rt.jar:1.8.0_144]<br> at com.google.gwt.user.server.rpc<wbr>.RPC.invokeAndEncodeResponse(<wbr>RPC.java:587)<br> at com.google.gwt.user.server.rpc<wbr>.RemoteServiceServlet.processC<wbr>all(RemoteServiceServlet.java:<wbr>333)<br> at com.google.gwt.user.server.rpc<wbr>.RemoteServiceServlet.processC<wbr>all(RemoteServiceServlet.java:<wbr>303)<br> at com.google.gwt.user.server.rpc<wbr>.RemoteServiceServlet.processP<wbr>ost(RemoteServiceServlet.java:<wbr>373)<br> at com.google.gwt.user.server.rpc<wbr>.AbstractRemoteServiceServlet.<wbr>doPost(AbstractRemoteServiceSe<wbr>rvlet.java:62)<br> at javax.servlet.http.HttpServlet<wbr>.service(HttpServlet.java:707) [jboss-servlet-api_3.1_spec-1.<wbr>0.0.Final.jar:1.0.0.Final]<br> at org.ovirt.engine.ui.frontend.s<wbr>erver.gwt.GenericApiGWTService<wbr>Impl.service(GenericApiGWTServ<wbr>iceImpl.java:78)<br> at javax.servlet.http.HttpServlet<wbr>.service(HttpServlet.java:790) [jboss-servlet-api_3.1_spec-1.<wbr>0.0.Final.jar:1.0.0.Final]<br> at io.undertow.servlet.handlers.S<wbr>ervletHandler.handleRequest(Se<wbr>rvletHandler.java:85)<br> at io.undertow.servlet.handlers.F<wbr>ilterHandler$FilterChainImpl.d<wbr>oFilter(FilterHandler.java:129<wbr>)<br> at <a href="http://org.ovirt.engine.core.utils.se">org.ovirt.engine.core.utils.se</a><wbr>rvlet.HeaderFilter.doFilter(He<wbr>aderFilter.java:94) [utils.jar:]<br> at io.undertow.servlet.core.Manag<wbr>edFilter.doFilter(ManagedFilte<wbr>r.java:61)<br> at io.undertow.servlet.handlers.F<wbr>ilterHandler$FilterChainImpl.d<wbr>oFilter(FilterHandler.java:131<wbr>)<br> at org.ovirt.engine.ui.frontend.s<wbr>erver.gwt.GwtCachingFilter.doF<wbr>ilter(GwtCachingFilter.java:<wbr>132)<br> at io.undertow.servlet.core.Manag<wbr>edFilter.doFilter(ManagedFilte<wbr>r.java:61)<br> at io.undertow.servlet.handlers.F<wbr>ilterHandler$FilterChainImpl.d<wbr>oFilter(FilterHandler.java:131<wbr>)<br> at org.ovirt.engine.core.branding<wbr>.BrandingFilter.doFilter(<wbr>BrandingFilter.java:73) [branding.jar:]<br> at io.undertow.servlet.core.Manag<wbr>edFilter.doFilter(ManagedFilte<wbr>r.java:61)<br> at io.undertow.servlet.handlers.F<wbr>ilterHandler$FilterChainImpl.d<wbr>oFilter(FilterHandler.java:131<wbr>)<br> at <a href="http://org.ovirt.engine.core.utils.se">org.ovirt.engine.core.utils.se</a><wbr>rvlet.LocaleFilter.doFilter(Lo<wbr>caleFilter.java:66) [utils.jar:]<br> at io.undertow.servlet.core.Manag<wbr>edFilter.doFilter(ManagedFilte<wbr>r.java:61)<br> at io.undertow.servlet.handlers.F<wbr>ilterHandler$FilterChainImpl.d<wbr>oFilter(FilterHandler.java:131<wbr>)<br> at io.undertow.servlet.handlers.F<wbr>ilterHandler.handleRequest(Fil<wbr>terHandler.java:84)<br> at io.undertow.servlet.handlers.s<wbr>ecurity.ServletSecurityRoleHan<wbr>dler.handleRequest(ServletSecu<wbr>rityRoleHandler.java:62)<br> at io.undertow.servlet.handlers.S<wbr>ervletDispatchingHandler.handl<wbr>eRequest(ServletDispatchingHan<wbr>dler.java:36)<br> at org.wildfly.extension.undertow<wbr>.security.SecurityContextAssoc<wbr>iationHandler.handleRequest(Se<wbr>curityContextAssociationHandle<wbr>r.java:78)<br> at <a href="http://io.undertow.server.handlers.Pr">io.undertow.server.handlers.Pr</a><wbr>edicateHandler.handleRequest(P<wbr>redicateHandler.java:43)<br> at io.undertow.servlet.handlers.s<wbr>ecurity.SSLInformationAssociat<wbr>ionHandler.handleRequest(SSLIn<wbr>formationAssociationHandler.<wbr>java:131)<br> at io.undertow.servlet.handlers.s<wbr>ecurity.ServletAuthenticationC<wbr>allHandler.handleRequest(Servl<wbr>etAuthenticationCallHandler.<wbr>java:57)<br> at <a href="http://io.undertow.server.handlers.Pr">io.undertow.server.handlers.Pr</a><wbr>edicateHandler.handleRequest(P<wbr>redicateHandler.java:43)<br> at io.undertow.security.handlers.<wbr>AuthenticationConstraintHandle<wbr>r.handleRequest(Authentication<wbr>ConstraintHandler.java:53)<br> at io.undertow.security.handlers.<wbr>AbstractConfidentialityHandler<wbr>.handleRequest(AbstractConfide<wbr>ntialityHandler.java:46)<br> at io.undertow.servlet.handlers.s<wbr>ecurity.ServletConfidentiality<wbr>ConstraintHandler.<wbr>handleRequest(ServletConfident<wbr>ialityConstraintHandler.java:<wbr>64)<br> at io.undertow.servlet.handlers.s<wbr>ecurity.ServletSecurityConstra<wbr>intHandler.handleRequest(Servl<wbr>etSecurityConstraintHandler.<wbr>java:59)<br> at io.undertow.security.handlers.<wbr>AuthenticationMechanismsHandle<wbr>r.handleRequest(Authentication<wbr>MechanismsHandler.java:60)<br> at io.undertow.servlet.handlers.s<wbr>ecurity.CachedAuthenticatedSes<wbr>sionHandler.handleRequest(Cach<wbr>edAuthenticatedSessionHandler.<wbr>java:77)<br> at io.undertow.security.handlers.<wbr>NotificationReceiverHandler.ha<wbr>ndleRequest(NotificationReceiv<wbr>erHandler.java:50)<br> at io.undertow.security.handlers.<wbr>AbstractSecurityContextAssocia<wbr>tionHandler.handleRequest(Abst<wbr>ractSecurityContextAssociation<wbr>Handler.java:43)<br> at <a href="http://io.undertow.server.handlers.Pr">io.undertow.server.handlers.Pr</a><wbr>edicateHandler.handleRequest(P<wbr>redicateHandler.java:43)<br> at org.wildfly.extension.undertow<wbr>.security.jacc.JACCContextIdHa<wbr>ndler.handleRequest(JACCContex<wbr>tIdHandler.java:61)<br> at <a href="http://io.undertow.server.handlers.Pr">io.undertow.server.handlers.Pr</a><wbr>edicateHandler.handleRequest(P<wbr>redicateHandler.java:43)<br> at <a href="http://io.undertow.server.handlers.Pr">io.undertow.server.handlers.Pr</a><wbr>edicateHandler.handleRequest(P<wbr>redicateHandler.java:43)<br> at io.undertow.servlet.handlers.S<wbr>ervletInitialHandler.handleFir<wbr>stRequest(ServletInitialHandle<wbr>r.java:292)<br> at io.undertow.servlet.handlers.S<wbr>ervletInitialHandler.access$10<wbr>0(ServletInitialHandler.java:<wbr>81)<br> at io.undertow.servlet.handlers.S<wbr>ervletInitialHandler$2.call(Se<wbr>rvletInitialHandler.java:138)<br> at io.undertow.servlet.handlers.S<wbr>ervletInitialHandler$2.call(Se<wbr>rvletInitialHandler.java:135)<br> at io.undertow.servlet.core.Servl<wbr>etRequestContextThreadSetupAct<wbr>ion$1.call(ServletRequestConte<wbr>xtThreadSetupAction.java:48)<br> at io.undertow.servlet.core.Conte<wbr>xtClassLoaderSetupAction$1.<wbr>call(ContextClassLoaderSetupAc<wbr>tion.java:43)<br> at org.wildfly.extension.undertow<wbr>.security.SecurityContextThrea<wbr>dSetupAction.lambda$create$0(S<wbr>ecurityContextThreadSetupActio<wbr>n.java:105)<br> at org.wildfly.extension.undertow<wbr>.deployment.UndertowDeployment<wbr>InfoService$UndertowThreadSetu<wbr>pAction.lambda$create$0(Undert<wbr>owDeploymentInfoService.java:<wbr>1508)<br> at org.wildfly.extension.undertow<wbr>.deployment.UndertowDeployment<wbr>InfoService$UndertowThreadSetu<wbr>pAction.lambda$create$0(Undert<wbr>owDeploymentInfoService.java:<wbr>1508)<br> at org.wildfly.extension.undertow<wbr>.deployment.UndertowDeployment<wbr>InfoService$UndertowThreadSetu<wbr>pAction.lambda$create$0(Undert<wbr>owDeploymentInfoService.java:<wbr>1508)<br> at io.undertow.servlet.handlers.S<wbr>ervletInitialHandler.dispatchR<wbr>equest(ServletInitialHandler.<wbr>java:272)<br> at io.undertow.servlet.handlers.S<wbr>ervletInitialHandler.access$00<wbr>0(ServletInitialHandler.java:<wbr>81)<br> at io.undertow.servlet.handlers.S<wbr>ervletInitialHandler$1.handleR<wbr>equest(ServletInitialHandler.<wbr>java:104)<br> at io.undertow.server.Connectors.<wbr>executeRootHandler(Connectors.<wbr>java:326)<br> at io.undertow.server.HttpServerE<wbr>xchange$1.run(HttpServerExchan<wbr>ge.java:812)<br> at java.util.concurrent.ThreadPoo<wbr>lExecutor.runWorker(ThreadPool<wbr>Executor.java:1149) [rt.jar:1.8.0_144]<br> at java.util.concurrent.ThreadPoo<wbr>lExecutor$Worker.run(ThreadPoo<wbr>lExecutor.java:624) [rt.jar:1.8.0_144]<br> at java.lang.Thread.run(Thread.ja<wbr>va:748) [rt.jar:1.8.0_144]<br><br>2017-10-10 06:53:09,032+01 ERROR [org.ovirt.engine.core.bll.Get<wbr>AgentFenceOptionsQuery] (default task-62) [3bfc7ef1-bede-40b4-8a97-a8cd1<wbr>cf2a0f6] Query 'GetAgentFenceOptionsQuery' failed: VdsFenceOptionMapping has no value for version: general<br>2017-10-10 06:53:09,032+01 ERROR [org.ovirt.engine.core.bll.Get<wbr>AgentFenceOptionsQuery] (default task-62) [3bfc7ef1-bede-40b4-8a97-a8cd1<wbr>cf2a0f6] Exception: java.lang.IllegalArgumentExcep<wbr>tion: VdsFenceOptionMapping has no value for version: general<br> at org.ovirt.engine.core.dal.dbbr<wbr>oker.generic.DBConfigUtils.<wbr>getValue(DBConfigUtils.java:<wbr>65) [dal.jar:]<br> at org.ovirt.engine.core.common.c<wbr>onfig.Config.getValue(Config.j<wbr>ava:28) [common.jar:]<br> at <a href="http://org.ovirt.engine.core.utils.pm">org.ovirt.engine.core.utils.pm</a><wbr>.FenceConfigHelper.getFenceCon<wbr>figurationValue(FenceConfigHel<wbr>per.java:96) [utils.jar:]<br> at <a href="http://org.ovirt.engine.core.utils.pm">org.ovirt.engine.core.utils.pm</a><wbr>.VdsFenceOptions.cacheFenceAge<wbr>ntsOptionMapping(VdsFenceOptio<wbr>ns.java:78) [utils.jar:]<br> at <a href="http://org.ovirt.engine.core.utils.pm">org.ovirt.engine.core.utils.pm</a><wbr>.VdsFenceOptions.initCache(Vds<wbr>FenceOptions.java:236) [utils.jar:]<br> at <a href="http://org.ovirt.engine.core.utils.pm">org.ovirt.engine.core.utils.pm</a><wbr>.VdsFenceOptions.<init>(VdsFen<wbr>ceOptions.java:63) [utils.jar:]<br> at <a href="http://org.ovirt.engine.core.utils.pm">org.ovirt.engine.core.utils.pm</a><wbr>.VdsFenceOptions.<init>(VdsFen<wbr>ceOptions.java:47) [utils.jar:]<br> at org.ovirt.engine.core.bll.GetA<wbr>gentFenceOptionsQuery.executeQ<wbr>ueryCommand(GetAgentFenceOptio<wbr>nsQuery.java:18) [bll.jar:]<br> at org.ovirt.engine.core.bll.Quer<wbr>iesCommandBase.executeCommand(<wbr>QueriesCommandBase.java:106) [bll.jar:]<br> at org.ovirt.engine.core.dal.VdcC<wbr>ommandBase.execute(VdcCommandB<wbr>ase.java:33) [dal.jar:]<br> at org.ovirt.engine.core.bll.exec<wbr>utor.DefaultBackendQueryExecut<wbr>or.execute(DefaultBackendQuery<wbr>Executor.java:14) [bll.jar:]<br> at org.ovirt.engine.core.bll.Back<wbr>end.runQueryImpl(Backend.java:<wbr>570) [bll.jar:]<br> at org.ovirt.engine.core.bll.Back<wbr>end.runQuery(Backend.java:539) [bll.jar:]<br> at sun.reflect.GeneratedMethodAcc<wbr>essor154.invoke(Unknown Source) [:1.8.0_144]<br> at sun.reflect.DelegatingMethodAc<wbr>cessorImpl.invoke(DelegatingMe<wbr>thodAccessorImpl.java:43) [rt.jar:1.8.0_144]<br> at java.lang.reflect.Method.invok<wbr>e(Method.java:498) [rt.jar:1.8.0_144]<br> at org.jboss.as.ee.component.Mana<wbr>gedReferenceMethodInterceptor.<wbr>processInvocation(ManagedRefer<wbr>enceMethodInterceptor.java:52)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.Intercept<wbr>orContext$Invocation.proceed(<wbr>InterceptorContext.java:509)<br> at org.jboss.as.weld.ejb.Delegati<wbr>ngInterceptorInvocationContext<wbr>.proceed(DelegatingInterceptor<wbr>InvocationContext.java:92) [wildfly-weld-ejb-11.0.0.CR1.j<wbr>ar:11.0.0.CR1]<br> at <a href="http://org.jboss.weld.interceptor.pro">org.jboss.weld.interceptor.pro</a><wbr>xy.WeldInvocationContext.inter<wbr>ceptorChainCompleted(WeldInvoc<wbr>ationContext.java:98) [weld-core-impl-2.4.3.Final.ja<wbr>r:2.4.3.Final]<br> at <a href="http://org.jboss.weld.interceptor.pro">org.jboss.weld.interceptor.pro</a><wbr>xy.WeldInvocationContext.proce<wbr>ed(WeldInvocationContext.java:<wbr>117) [weld-core-impl-2.4.3.Final.ja<wbr>r:2.4.3.Final]<br> at org.ovirt.engine.core.common.d<wbr>i.interceptor.LoggingIntercept<wbr>or.apply(LoggingInterceptor.<wbr>java:12) [common.jar:]<br> at sun.reflect.GeneratedMethodAcc<wbr>essor69.invoke(Unknown Source) [:1.8.0_144]<br> at sun.reflect.DelegatingMethodAc<wbr>cessorImpl.invoke(DelegatingMe<wbr>thodAccessorImpl.java:43) [rt.jar:1.8.0_144]<br> at java.lang.reflect.Method.invok<wbr>e(Method.java:498) [rt.jar:1.8.0_144]<br> at org.jboss.weld.interceptor.rea<wbr>der.SimpleInterceptorInvocatio<wbr>n$SimpleMethodInvocation.<wbr>invoke(SimpleInterceptorInvoca<wbr>tion.java:73) [weld-core-impl-2.4.3.Final.ja<wbr>r:2.4.3.Final]<br> at <a href="http://org.jboss.weld.interceptor.pro">org.jboss.weld.interceptor.pro</a><wbr>xy.WeldInvocationContext.invok<wbr>eNext(WeldInvocationContext.<wbr>java:83) [weld-core-impl-2.4.3.Final.ja<wbr>r:2.4.3.Final]<br> at <a href="http://org.jboss.weld.interceptor.pro">org.jboss.weld.interceptor.pro</a><wbr>xy.WeldInvocationContext.proce<wbr>ed(WeldInvocationContext.java:<wbr>115) [weld-core-impl-2.4.3.Final.ja<wbr>r:2.4.3.Final]<br> at org.jboss.weld.bean.Intercepto<wbr>rImpl.intercept(InterceptorImp<wbr>l.java:108) [weld-core-impl-2.4.3.Final.ja<wbr>r:2.4.3.Final]<br> at org.jboss.as.weld.ejb.Delegati<wbr>ngInterceptorInvocationContext<wbr>.proceed(DelegatingInterceptor<wbr>InvocationContext.java:82) [wildfly-weld-ejb-11.0.0.CR1.j<wbr>ar:11.0.0.CR1]<br> at org.jboss.as.weld.interceptors<wbr>.EjbComponentInterceptorSuppor<wbr>t.delegateInterception(EjbComp<wbr>onentInterceptorSupport.java:<wbr>60)<br> at org.jboss.as.weld.interceptors<wbr>.Jsr299BindingsInterceptor.del<wbr>egateInterception(Jsr299Bindin<wbr>gsInterceptor.java:76)<br> at org.jboss.as.weld.interceptors<wbr>.Jsr299BindingsInterceptor.doM<wbr>ethodInterception(Jsr299Bindin<wbr>gsInterceptor.java:88)<br> at org.jboss.as.weld.interceptors<wbr>.Jsr299BindingsInterceptor.pro<wbr>cessInvocation(Jsr299BindingsI<wbr>nterceptor.java:101)<br> at org.jboss.as.ee.component.inte<wbr>rceptors.UserInterceptorFactor<wbr>y$1.processInvocation(UserInte<wbr>rceptorFactory.java:63)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.Intercept<wbr>orContext$Invocation.proceed(<wbr>InterceptorContext.java:509)<br> at org.ovirt.engine.core.bll.inte<wbr>rceptors.CorrelationIdTrackerI<wbr>nterceptor.aroundInvoke(Correl<wbr>ationIdTrackerInterceptor.<wbr>java:13) [bll.jar:]<br> at sun.reflect.GeneratedMethodAcc<wbr>essor150.invoke(Unknown Source) [:1.8.0_144]<br> at sun.reflect.DelegatingMethodAc<wbr>cessorImpl.invoke(DelegatingMe<wbr>thodAccessorImpl.java:43) [rt.jar:1.8.0_144]<br> at java.lang.reflect.Method.invok<wbr>e(Method.java:498) [rt.jar:1.8.0_144]<br> at org.jboss.as.ee.component.Mana<wbr>gedReferenceLifecycleMethodInt<wbr>erceptor.processInvocation(Man<wbr>agedReferenceLifecycleMethodIn<wbr>terceptor.java:89)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at <a href="http://org.jboss.as.ejb3.component.in">org.jboss.as.ejb3.component.in</a><wbr>vocationmetrics.ExecutionTimeI<wbr>nterceptor.processInvocation(E<wbr>xecutionTimeInterceptor.java:4<wbr>3) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.as.ee.concurrent.Con<wbr>currentContextInterceptor.proc<wbr>essInvocation(ConcurrentContex<wbr>tInterceptor.java:45) [wildfly-ee-11.0.0.CR1.jar:11.<wbr>0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.InitialIn<wbr>terceptor.processInvocation(In<wbr>itialInterceptor.java:40)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.ChainedIn<wbr>terceptor.processInvocation(Ch<wbr>ainedInterceptor.java:53)<br> at org.jboss.as.ee.component.inte<wbr>rceptors.ComponentDispatcherIn<wbr>terceptor.processInvocation(Co<wbr>mponentDispatcherInterceptor.<wbr>java:52)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at <a href="http://org.jboss.as.ejb3.component.si">org.jboss.as.ejb3.component.si</a><wbr>ngleton.SingletonComponentInst<wbr>anceAssociationInterceptor.pro<wbr>cessInvocation(SingletonCompon<wbr>entInstanceAssociationIntercep<wbr>tor.java:53) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.as.ejb3.tx.CMTTxInte<wbr>rceptor.invokeInNoTx(CMTTxInte<wbr>rceptor.java:264) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.as.ejb3.tx.CMTTxInte<wbr>rceptor.supports(CMTTxIntercep<wbr>tor.java:379) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.as.ejb3.tx.CMTTxInte<wbr>rceptor.processInvocation(CMTT<wbr>xInterceptor.java:244) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.Intercept<wbr>orContext$Invocation.proceed(<wbr>InterceptorContext.java:509)<br> at org.jboss.weld.ejb.AbstractEJB<wbr>RequestScopeActivationIntercep<wbr>tor.aroundInvoke(AbstractEJBRe<wbr>questScopeActivationIntercepto<wbr>r.java:73) [weld-core-impl-2.4.3.Final.ja<wbr>r:2.4.3.Final]<br> at org.jboss.as.weld.ejb.EjbReque<wbr>stScopeActivationInterceptor.<wbr>processInvocation(EjbRequestSc<wbr>opeActivationInterceptor.java:<wbr>89)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at <a href="http://org.jboss.as.ejb3.component.in">org.jboss.as.ejb3.component.in</a><wbr>terceptors.CurrentInvocationCo<wbr>ntextInterceptor.<wbr>processInvocation(CurrentInvoc<wbr>ationContextInterceptor.java:<wbr>41) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at <a href="http://org.jboss.as.ejb3.component.in">org.jboss.as.ejb3.component.in</a><wbr>vocationmetrics.WaitTimeInterc<wbr>eptor.processInvocation(WaitTi<wbr>meInterceptor.java:47) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.as.ejb3.security.Sec<wbr>urityContextInterceptor.proces<wbr>sInvocation(SecurityContextInt<wbr>erceptor.java:100) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.as.ejb3.deployment.p<wbr>rocessors.StartupAwaitIntercep<wbr>tor.processInvocation(StartupA<wbr>waitInterceptor.java:22) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at <a href="http://org.jboss.as.ejb3.component.in">org.jboss.as.ejb3.component.in</a><wbr>terceptors.ShutDownInterceptor<wbr>Factory$1.processInvocation(Sh<wbr>utDownInterceptorFactory.java:<wbr>64) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at <a href="http://org.jboss.as.ejb3.component.in">org.jboss.as.ejb3.component.in</a><wbr>terceptors.LoggingInterceptor.<wbr>processInvocation(LoggingInter<wbr>ceptor.java:67) [wildfly-ejb3-11.0.0.CR1.jar:1<wbr>1.0.0.CR1]<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at <a href="http://org.jboss.as.ee.component.Name">org.jboss.as.ee.component.Name</a><wbr>spaceContextInterceptor.proces<wbr>sInvocation(NamespaceContextIn<wbr>terceptor.java:50)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.ContextCl<wbr>assLoaderInterceptor.processIn<wbr>vocation(ContextClassLoaderInt<wbr>erceptor.java:60)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.Intercept<wbr>orContext.run(InterceptorConte<wbr>xt.java:438)<br> at org.wildfly.security.manager.W<wbr>ildFlySecurityManager.doChecke<wbr>d(WildFlySecurityManager.java:<wbr>609)<br> at org.jboss.invocation.AccessChe<wbr>ckingInterceptor.processInvoca<wbr>tion(AccessCheckingInterceptor<wbr>.java:57)<br> at org.jboss.invocation.Intercept<wbr>orContext.proceed(InterceptorC<wbr>ontext.java:422)<br> at org.jboss.invocation.ChainedIn<wbr>terceptor.processInvocation(Ch<wbr>ainedInterceptor.java:53)<br> at org.jboss.as.ee.component.View<wbr>Service$View.invoke(ViewServic<wbr>e.java:198)<br> at org.jboss.as.ee.component.View<wbr>Description$1.processInvocatio<wbr>n(ViewDescription.java:185)<br> at org.jboss.as.ee.component.Prox<wbr>yInvocationHandler.invoke(Prox<wbr>yInvocationHandler.java:81)<br> at org.ovirt.engine.core.common.i<wbr>nterfaces.BackendLocal$$$view3<wbr>.runQuery(Unknown Source) [common.jar:]<br> at org.ovirt.engine.ui.frontend.s<wbr>erver.gwt.GenericApiGWTService<wbr>Impl.runQuery(GenericApiGWTSer<wbr>viceImpl.java:90)<br> at org.ovirt.engine.ui.frontend.s<wbr>erver.gwt.GenericApiGWTService<wbr>Impl.runMultipleQueries(Generi<wbr>cApiGWTServiceImpl.java:121)<br> at sun.reflect.GeneratedMethodAcc<wbr>essor161.invoke(Unknown Source) [:1.8.0_144]<br> at sun.reflect.DelegatingMethodAc<wbr>cessorImpl.invoke(DelegatingMe<wbr>thodAccessorImpl.java:43) [rt.jar:1.8.0_144]<br> at java.lang.reflect.Method.invok<wbr>e(Method.java:498) [rt.jar:1.8.0_144]<br> at com.google.gwt.user.server.rpc<wbr>.RPC.invokeAndEncodeResponse(<wbr>RPC.java:587)<br> at com.google.gwt.user.server.rpc<wbr>.RemoteServiceServlet.processC<wbr>all(RemoteServiceServlet.java:<wbr>333)<br> at com.google.gwt.user.server.rpc<wbr>.RemoteServiceServlet.processC<wbr>all(RemoteServiceServlet.java:<wbr>303)<br> at com.google.gwt.user.server.rpc<wbr>.RemoteServiceServlet.processP<wbr>ost(RemoteServiceServlet.java:<wbr>373)<br> at com.google.gwt.user.server.rpc<wbr>.AbstractRemoteServiceServlet.<wbr>doPost(AbstractRemoteServiceSe<wbr>rvlet.java:62)<br> at javax.servlet.http.HttpServlet<wbr>.service(HttpServlet.java:707) [jboss-servlet-api_3.1_spec-1.<wbr>0.0.Final.jar:1.0.0.Final]<br> at org.ovirt.engine.ui.frontend.s<wbr>erver.gwt.GenericApiGWTService<wbr>Impl.service(GenericApiGWTServ<wbr>iceImpl.java:78)<br> at javax.servlet.http.HttpServlet<wbr>.service(HttpServlet.java:790) [jboss-servlet-api_3.1_spec-1.<wbr>0.0.Final.jar:1.0.0.Final]<br> at io.undertow.servlet.handlers.S<wbr>ervletHandler.handleRequest(Se<wbr>rvletHandler.java:85)<br> at io.undertow.servlet.handlers.F<wbr>ilterHandler$FilterChainImpl.d<wbr>oFilter(FilterHandler.java:129<wbr>)<br> at <a href="http://org.ovirt.engine.core.utils.se">org.ovirt.engine.core.utils.se</a><wbr>rvlet.HeaderFilter.doFilter(He<wbr>aderFilter.java:94) [utils.jar:]<br> at io.undertow.servlet.core.Manag<wbr>edFilter.doFilter(ManagedFilte<wbr>r.java:61)<br> at io.undertow.servlet.handlers.F<wbr>ilterHandler$FilterChainImpl.d<wbr>oFilter(FilterHandler.java:131<wbr>)<br> at org.ovirt.engine.ui.frontend.s<wbr>erver.gwt.GwtCachingFilter.doF<wbr>ilter(GwtCachingFilter.java:<wbr>132)<br> at io.undertow.servlet.core.Manag<wbr>edFilter.doFilter(ManagedFilte<wbr>r.java:61)<br> at io.undertow.servlet.handlers.F<wbr>ilterHandler$FilterChainImpl.d<wbr>oFilter(FilterHandler.java:131<wbr>)<br> at org.ovirt.engine.core.branding<wbr>.BrandingFilter.doFilter(<wbr>BrandingFilter.java:73) [branding.jar:]<br> at io.undertow.servlet.core.Manag<wbr>edFilter.doFilter(ManagedFilte<wbr>r.java:61)<br> at io.undertow.servlet.handlers.F<wbr>ilterHandler$FilterChainImpl.d<wbr>oFilter(FilterHandler.java:131<wbr>)<br> at <a href="http://org.ovirt.engine.core.utils.se">org.ovirt.engine.core.utils.se</a><wbr>rvlet.LocaleFilter.doFilter(Lo<wbr>caleFilter.java:66) [utils.jar:]<br> at io.undertow.servlet.core.Manag<wbr>edFilter.doFilter(ManagedFilte<wbr>r.java:61)<br> at io.undertow.servlet.handlers.F<wbr>ilterHandler$FilterChainImpl.d<wbr>oFilter(FilterHandler.java:131<wbr>)<br> at io.undertow.servlet.handlers.F<wbr>ilterHandler.handleRequest(Fil<wbr>terHandler.java:84)<br> at io.undertow.servlet.handlers.s<wbr>ecurity.ServletSecurityRoleHan<wbr>dler.handleRequest(ServletSecu<wbr>rityRoleHandler.java:62)<br> at io.undertow.servlet.handlers.S<wbr>ervletDispatchingHandler.handl<wbr>eRequest(ServletDispatchingHan<wbr>dler.java:36)<br> at org.wildfly.extension.undertow<wbr>.security.SecurityContextAssoc<wbr>iationHandler.handleRequest(Se<wbr>curityContextAssociationHandle<wbr>r.java:78)<br> at <a href="http://io.undertow.server.handlers.Pr">io.undertow.server.handlers.Pr</a><wbr>edicateHandler.handleRequest(P<wbr>redicateHandler.java:43)<br> at io.undertow.servlet.handlers.s<wbr>ecurity.SSLInformationAssociat<wbr>ionHandler.handleRequest(SSLIn<wbr>formationAssociationHandler.<wbr>java:131)<br> at io.undertow.servlet.handlers.s<wbr>ecurity.ServletAuthenticationC<wbr>allHandler.handleRequest(Servl<wbr>etAuthenticationCallHandler.<wbr>java:57)<br> at <a href="http://io.undertow.server.handlers.Pr">io.undertow.server.handlers.Pr</a><wbr>edicateHandler.handleRequest(P<wbr>redicateHandler.java:43)<br> at io.undertow.security.handlers.<wbr>AuthenticationConstraintHandle<wbr>r.handleRequest(Authentication<wbr>ConstraintHandler.java:53)<br> at io.undertow.security.handlers.<wbr>AbstractConfidentialityHandler<wbr>.handleRequest(AbstractConfide<wbr>ntialityHandler.java:46)<br> at io.undertow.servlet.handlers.s<wbr>ecurity.ServletConfidentiality<wbr>ConstraintHandler.<wbr>handleRequest(ServletConfident<wbr>ialityConstraintHandler.java:<wbr>64)<br> at io.undertow.servlet.handlers.s<wbr>ecurity.ServletSecurityConstra<wbr>intHandler.handleRequest(Servl<wbr>etSecurityConstraintHandler.<wbr>java:59)<br> at io.undertow.security.handlers.<wbr>AuthenticationMechanismsHandle<wbr>r.handleRequest(Authentication<wbr>MechanismsHandler.java:60)<br> at io.undertow.servlet.handlers.s<wbr>ecurity.CachedAuthenticatedSes<wbr>sionHandler.handleRequest(Cach<wbr>edAuthenticatedSessionHandler.<wbr>java:77)<br> at io.undertow.security.handlers.<wbr>NotificationReceiverHandler.ha<wbr>ndleRequest(NotificationReceiv<wbr>erHandler.java:50)<br> at io.undertow.security.handlers.<wbr>AbstractSecurityContextAssocia<wbr>tionHandler.handleRequest(Abst<wbr>ractSecurityContextAssociation<wbr>Handler.java:43)<br> at <a href="http://io.undertow.server.handlers.Pr">io.undertow.server.handlers.Pr</a><wbr>edicateHandler.handleRequest(P<wbr>redicateHandler.java:43)<br> at org.wildfly.extension.undertow<wbr>.security.jacc.JACCContextIdHa<wbr>ndler.handleRequest(JACCContex<wbr>tIdHandler.java:61)<br> at <a href="http://io.undertow.server.handlers.Pr">io.undertow.server.handlers.Pr</a><wbr>edicateHandler.handleRequest(P<wbr>redicateHandler.java:43)<br> at <a href="http://io.undertow.server.handlers.Pr">io.undertow.server.handlers.Pr</a><wbr>edicateHandler.handleRequest(P<wbr>redicateHandler.java:43)<br> at io.undertow.servlet.handlers.S<wbr>ervletInitialHandler.handleFir<wbr>stRequest(ServletInitialHandle<wbr>r.java:292)<br> at io.undertow.servlet.handlers.S<wbr>ervletInitialHandler.access$10<wbr>0(ServletInitialHandler.java:<wbr>81)<br> at io.undertow.servlet.handlers.S<wbr>ervletInitialHandler$2.call(Se<wbr>rvletInitialHandler.java:138)<br> at io.undertow.servlet.handlers.S<wbr>ervletInitialHandler$2.call(Se<wbr>rvletInitialHandler.java:135)<br> at io.undertow.servlet.core.Servl<wbr>etRequestContextThreadSetupAct<wbr>ion$1.call(ServletRequestConte<wbr>xtThreadSetupAction.java:48)<br> at io.undertow.servlet.core.Conte<wbr>xtClassLoaderSetupAction$1.<wbr>call(ContextClassLoaderSetupAc<wbr>tion.java:43)<br> at org.wildfly.extension.undertow<wbr>.security.SecurityContextThrea<wbr>dSetupAction.lambda$create$0(S<wbr>ecurityContextThreadSetupActio<wbr>n.java:105)<br> at org.wildfly.extension.undertow<wbr>.deployment.UndertowDeployment<wbr>InfoService$UndertowThreadSetu<wbr>pAction.lambda$create$0(Undert<wbr>owDeploymentInfoService.java:<wbr>1508)<br> at org.wildfly.extension.undertow<wbr>.deployment.UndertowDeployment<wbr>InfoService$UndertowThreadSetu<wbr>pAction.lambda$create$0(Undert<wbr>owDeploymentInfoService.java:<wbr>1508)<br> at org.wildfly.extension.undertow<wbr>.deployment.UndertowDeployment<wbr>InfoService$UndertowThreadSetu<wbr>pAction.lambda$create$0(Undert<wbr>owDeploymentInfoService.java:<wbr>1508)<br> at io.undertow.servlet.handlers.S<wbr>ervletInitialHandler.dispatchR<wbr>equest(ServletInitialHandler.<wbr>java:272)<br> at io.undertow.servlet.handlers.S<wbr>ervletInitialHandler.access$00<wbr>0(ServletInitialHandler.java:<wbr>81)<br> at io.undertow.servlet.handlers.S<wbr>ervletInitialHandler$1.handleR<wbr>equest(ServletInitialHandler.<wbr>java:104)<br> at io.undertow.server.Connectors.<wbr>executeRootHandler(Connectors.<wbr>java:326)<br> at io.undertow.server.HttpServerE<wbr>xchange$1.run(HttpServerExchan<wbr>ge.java:812)<br> at java.util.concurrent.ThreadPoo<wbr>lExecutor.runWorker(ThreadPool<wbr>Executor.java:1149) [rt.jar:1.8.0_144]<br> at java.util.concurrent.ThreadPoo<wbr>lExecutor$Worker.run(ThreadPoo<wbr>lExecutor.java:624) [rt.jar:1.8.0_144]<br> at java.lang.Thread.run(Thread.ja<wbr>va:748) [rt.jar:1.8.0_144]<br></font><br><br><br></div><div class="gmail_extra"><br><div class="gmail_quote">On 9 October 2017 at 19:21, Martin Perina <span dir="ltr"><<a href="mailto:mperina@redhat.com" target="_blank">mperina@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_extra"><br><div class="gmail_quote"><span>On Mon, Oct 9, 2017 at 6:00 PM, Maton, Brett <span dir="ltr"><<a href="mailto:matonb@ltresources.co.uk" target="_blank">matonb@ltresources.co.uk</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">Hope this is enough of the log, no idea why it's saying invalid fence agents:<br><br><font face="monospace,monospace">2017-10-09 16:01:01,535+01 ERROR [org.ovirt.engine.core.dal.dbb<wbr>roker.auditloghandling.AuditLo<wbr>gDirector] (org.ovirt.thread.EE-ManagedTh<wbr>readFactory-engine-Thread-184) [] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10,<wbr>802), VDSM <a href="http://ov_host.example.com" target="_blank">ov_host.example.com</a> command ConnectStoragePoolVDS failed: Cannot find master domain: u'spUUID=47d12516-a41c-41a7-9d<wbr>a4-320f08fda147, msdUUID=a28ebb26-98be-4850-8e8<wbr>8-0ac2c3d6037a'<br>2017-10-09 16:01:01,535+01 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.ConnectStoragePoo<wbr>lVDSCommand] (org.ovirt.thread.EE-ManagedTh<wbr>readFactory-engine-Thread-184) [] HostName = <a href="http://ov_host.example.com" target="_blank">ov_host.example.com</a><br>2017-10-09 16:01:01,535+01 ERROR [org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.ConnectStoragePoo<wbr>lVDSCommand] (org.ovirt.thread.EE-ManagedTh<wbr>readFactory-engine-Thread-184) [] Command 'ConnectStoragePoolVDSCommand(<wbr>HostName = <a href="http://ov_host.example.com" target="_blank">ov_host.example.com</a>, ConnectStoragePoolVDSCommandPa<wbr>rameters:{hostId='9390df92-5c7<wbr>9-4a25-9e94-1ca2d4aedc74', vdsId='9390df92-5c79-4a25-9e94<wbr>-1ca2d4aedc74', storagePoolId='47d12516-a41c-4<wbr>1a7-9da4-320f08fda147', masterVersion='2'})' execution failed: IRSGenericException: IRSErrorException: IRSNoMasterDomainException: Cannot find master domain: u'spUUID=47d12516-a41c-41a7-9d<wbr>a4-320f08fda147, msdUUID=a28ebb26-98be-4850-8e8<wbr>8-0ac2c3d6037a'<br>2017-10-09 16:01:01,535+01 INFO [org.ovirt.engine.core.bll.Ini<wbr>tVdsOnUpCommand] (org.ovirt.thread.EE-ManagedTh<wbr>readFactory-engine-Thread-184) [] Could not connect host '<a href="http://ov_host.example.com" target="_blank">ov_host.example.com</a>' to pool 'GHDC', as the master domain is in inactive/unknown status - not failing the operation<br></font></div></blockquote></span><div><br><div><div>This seems like severe storage issue</div>, if your master storage domain is inactive/unknown, then your VMs cannot run. You would need to check VDSM logs to find the real cause of the issue. Are you sure there are no storage or network issues on your setup?<br></div><br> </div><span><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><font face="monospace,monospace">2017-10-09 16:01:01,565+01 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.SetMOMPolicyParam<wbr>etersVDSCommand] (EE-ManagedThreadFactory-engin<wbr>eScheduled-Thread-1) [594458d4] START, SetMOMPolicyParametersVDSComma<wbr>nd(HostName = <a href="http://ov_host.example.com" target="_blank">ov_host.example.com</a>, MomPolicyVDSParameters:{hostId<wbr>='9390df92-5c79-4a25-9e94-1ca2<wbr>d4aedc74'}), log id: 43532a7a<br>2017-10-09 16:01:01,595+01 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.SpmStopVDSCommand<wbr>] (org.ovirt.thread.EE-ManagedTh<wbr>readFactory-engine-Thread-210) [6eeda756] START, SpmStopVDSCommand(HostName = <a href="http://ov_host.example.com" target="_blank">ov_host.example.com</a>, SpmStopVDSCommandParameters:{h<wbr>ostId='9390df92-5c79-4a25-9e94<wbr>-1ca2d4aedc74', storagePoolId='47d12516-a41c-4<wbr>1a7-9da4-320f08fda147'}), log id: 3861bb24<br>2017-10-09 16:01:01,602+01 ERROR [org.ovirt.engine.core.dal.dbb<wbr>roker.auditloghandling.AuditLo<wbr>gDirector] (org.ovirt.thread.EE-ManagedTh<wbr>readFactory-engine-Thread-210) [6eeda756] EVENT_ID: VDS_BROKER_COMMAND_FAILURE(10,<wbr>802), VDSM <a href="http://ov_host.example.com" target="_blank">ov_host.example.com</a> command HSMGetAllTasksStatusesVDS failed: Not SPM: ()<br>2017-10-09 16:01:01,602+01 INFO [org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.HSMGetAllTasksSta<wbr>tusesVDSCommand] (org.ovirt.thread.EE-ManagedTh<wbr>readFactory-engine-Thread-210) [6eeda756] HostName = <a href="http://ov_host.example.com" target="_blank">ov_host.example.com</a><br>2017-10-09 16:01:01,602+01 ERROR [org.ovirt.engine.core.vdsbrok<wbr>er.vdsbroker.HSMGetAllTasksSta<wbr>tusesVDSCommand] (org.ovirt.thread.EE-ManagedTh<wbr>readFactory-engine-Thread-210) [6eeda756] Command 'HSMGetAllTasksStatusesVDSComm<wbr>and(HostName = <a href="http://ov_host.example.com" target="_blank">ov_host.example.com</a>, VdsIdVDSCommandParametersBase:<wbr>{hostId='9390df92-5c79-4a25-9e<wbr>94-1ca2d4aedc74'})' execution failed: IRSGenericException: IRSErrorException: IRSNonOperationalException: Not SPM: ()<br>2017-10-09 16:01:01,653+01 INFO [org.ovirt.engine.core.dal.dbb<wbr>roker.auditloghandling.AuditLo<wbr>gDirector] (EE-ManagedThreadFactory-engin<wbr>eScheduled-Thread-1) [2e03c9cf] EVENT_ID: VDS_DETECTED(13), Status of host <a href="http://ov_host.example.com" target="_blank">ov_host.example.com</a> was set to Up.<br>2017-10-09 16:01:01,656+01 WARN [org.ovirt.engine.core.dal.dbb<wbr>roker.auditloghandling.AuditLo<wbr>gDirector] (EE-ManagedThreadFactory-engin<wbr>eScheduled-Thread-1) [2e03c9cf] EVENT_ID: VDS_ALERT_FENCE_TEST_FAILED(9,<wbr>001), Power Management test failed for Host ov_host.example.com.Invalid fence agents defined for host '192.168.1.12'.<br>2017-10-09 16:01:01,659+01 ERROR [org.ovirt.engine.core.dal.dbb<wbr>roker.auditloghandling.AuditLo<wbr>gDirector] (EE-ManagedThreadFactory-engin<wbr>eScheduled-Thread-1) [2e03c9cf] EVENT_ID: VDS_FENCE_STATUS_FAILED(497), Failed to verify Host <a href="http://ov_host.example.com" target="_blank">ov_host.example.com</a> power management.</font></div></blockquote></span><div><br><div>We are trying to get power management status of the host, when activating the host. In that case there was an error trying when getting power management status, more details should be in VDSM logs of the host that acted as fence proxy.<br></div> </div><span><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><br><br><br></div><div class="gmail_extra"><br><div class="gmail_quote">On 9 October 2017 at 14:41, Maton, Brett <span dir="ltr"><<a href="mailto:matonb@ltresources.co.uk" target="_blank">matonb@ltresources.co.uk</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div><div>Hi Martin,<br><br></div> Sure is there a way to trigger the check (I cleared the alerts), or do I just need to have a poke around the engine log next time it happens?<br></div></div></div></blockquote></div></div></blockquote></span><div><br><div>Yes, please take a look at engine-config option PMHealthCheckIntervalInSec:<br><br></div><div> engine-config -l | grep</div> <div>PMHealthCheckIntervalInSec<br><br></div><div>After updating this value you need to restart ovirt-engine service.<br></div></div><span><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div class="gmail_extra"><div class="gmail_quote"><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div><br></div>Regards,<br></div>Brett<br></div><div class="m_7945675371463611935m_-6282395597148609370m_-2415001188524693181gmail-m_-529701472995525469HOEnZb"><div class="m_7945675371463611935m_-6282395597148609370m_-2415001188524693181gmail-m_-529701472995525469h5"><div class="gmail_extra"><br><div class="gmail_quote">On 9 October 2017 at 14:26, Martin Perina <span dir="ltr"><<a href="mailto:mperina@redhat.com" target="_blank">mperina@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div style="font-family:arial,helvetica,sans-serif"><br></div><div class="gmail_extra"><br><div class="gmail_quote"><span>On Mon, Oct 9, 2017 at 2:40 PM, Maton, Brett <span dir="ltr"><<a href="mailto:matonb@ltresources.co.uk" target="_blank">matonb@ltresources.co.uk</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div><div><div><div><div>Hi,<br><br></div> I recently upgraded my testlab to oVirt 4.2-pre and have been having some issues.<br><br></div> One of which is fencing with Dell Drac 8 remote access cards.<br></div> The configuration I'm using works fine on my other (4.1.6) cluster...<br><br></div> Error:<br><span style="font-family:monospace,monospace"><span class="m_7945675371463611935m_-6282395597148609370m_-2415001188524693181gmail-m_-529701472995525469m_-462825152066870607m_-8110768790926482745m_-3397316486640587687m_-9187427046456573381gmail-drawer-pf-notification-message">Health check on Host <a href="http://host.example.com" target="_blank">host.example.com</a> indicates that future attempts to Start this
host using Power-Management are expected to fail.</span></span></div></div></blockquote></span><div><br><div>Hi, </div><br><div>Could you please share engine.log around above message? We are executing get power management status call to check, so if this get PM status failed, the above error is raised.<br><br></div><div>Thanks<br><br></div><div>Martin<br></div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span><div dir="ltr"><div><br><br></div> Fence agent setup for the host appears to be working though:<br><br> <img src="cid:ii_j8k5zvzu0_15f0125c52b42821" width="510" height="508"><br><br><div><br></div><div> Which logs would be helpful in debugging this issue ?</div><div><br></div><div>Regards,</div><div>Brett<br></div></div>
<br></span>______________________________<wbr>_________________<br>
Users mailing list<br>
<a href="mailto:Users@ovirt.org" target="_blank">Users@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/users" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/users</a><br>
<br></blockquote></div><br></div></div>
</blockquote></div><br></div>
</div></div></blockquote></div><br></div>
</blockquote></span></div><br></div></div>
</blockquote></div><br></div>
</blockquote></div><br></div></div></div></div>
</blockquote></div><br></div>