------=_Part_117131_1593059334.1495576400315 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit I downgraded the jdbc to 9.2.1002 and it's working again. Thank you for your help! The full setup is as such in case it helps anyone in the future: OS: CentOS 7.3.1611 Backend: Ceph via Cinder oVirt: 4.0.6.3 Postgres is remote and 9.5.7 on client and server Postgres jdbc: 9.2.1002 Logan
On May 23, 2017 at 4:15 PM Yedidyah Bar David <didi@redhat.com> wrote:
On Wed, May 24, 2017 at 12:06 AM, <support@jac-properties.com> wrote:
> >
Wow, that looks almost exactly like what we're seeing.
Unfortunately, downgrading from postgresql-jdbc-42.1.1 to 42.0.0, restarting ovirt-engine and rerunning engine-setup produces the same error messages.
>
Please try 9.2. Thanks!
> >
Logan
> > >
On May 23, 2017 at 3:39 PM Yedidyah Bar David <didi@redhat.com> wrote:
On Tue, May 23, 2017 at 11:19 PM, Logan Kuhn <support@jac-properties.com> wrote:
> > > >
Hi
We recently upgraded from postgres 9.5.4 to 9.5.6 and then to 9.5.7. We restarted ovirt-engine between 9.5.4 and it worked as expected. After we updated to 9.5.7 we have started to get postgres errors in engine.log and a 404 error in the browser when we try to start ovirt-engine.
Updates were done on client and server to keep them in sync.
The error is complaining about a missing function, but we can verify that the function exists in the database. We've also restored engine and ovirt_engine_history from a backup at 8am this morning when it was working and before we upgraded to 9.5.7 with no apparent help and run engine-setup afterwards, still no luck.
2017-05-23 15:07:48,418 INFO [org.ovirt.engine.core.dal.dbbroker.DbFacade] (ServerService Thread Pool -- 51) [] Initializing the DbFacade 2017-05-23 15:07:48,480 INFO [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 51) [] Start initializing Backend 2017-05-23 15:07:48,502 ERROR [org.ovirt.engine.core.bll.network.macpool.MacPoolPerDc] (ServerService Thread Pool -- 46) [] Error initializing: PreparedStatementCallback; bad SQL grammar [select * from getallmacpoolrangesbymacpoolid()]; nested exception is org.postgresql.util.PSQL Exception: ERROR: function getallmacpoolrangesbymacpoolid() does not exist Hint: No function matches the given name and argument types. You might need to add explicit type casts. Position: 16 2017-05-23 15:07:48,517 ERROR [org.ovirt.engine.core.bll.Backend] (ServerService Thread Pool -- 51) [] Error during initialization: org.jboss.weld.exceptions.WeldException: WELD-000049: Unable to invoke public void org.ovirt.engine.core.bll.hostedengine.PreviousHostedEngineHost.cre ate() on org.ovirt.engine.core.bll.hostedengine.PreviousHostedEngineHost@3a35f461 at org.jboss.weld.injection.producer.DefaultLifecycleCallbackInvoker.invokeMethods(DefaultLifecycleCallbackInvoker.java:100) [weld-core-impl-2.3.5.Final.jar:2.3.5.Final] at org.jboss.weld.injection.producer.DefaultLifecycleCallbackInvoker.postConstruct(DefaultLifecycleCallbackInvoker.java:81) [weld-core-impl-2.3.5.Final.jar:2.3.5.Final] at org.jboss.weld.injection.producer.BasicInjectionTarget.postConstruct(BasicInjectionTarget.java:126) [weld-core-impl-2.3.5.Final.jar:2.3.5.Final] at org.jboss.weld.bean.ManagedBean.create(ManagedBean.java:162) [weld-core-impl-2.3.5.Final.jar:2.3.5.Final] at org.jboss.weld.context.AbstractContext.get(AbstractContext.java:96) [weld-core-impl-2.3.5.Final.jar:2.3.5.Final] at org.jboss.weld.bean.ContextualInstanceStrategy$DefaultContextualInstanceStrategy.get(ContextualInstanceStrategy.java:101) [weld-core-impl-2.3.5.Final.jar:2.3.5.Final] at org.jboss.weld.bean.ContextualInstanceStrategy$ApplicationScopedContextualInstanceStrategy.get(ContextualInstanceStrategy.java:141) [weld-core-impl-2.3.5.Final.jar:2.3.5.Final] at org.jboss.weld.bean.ContextualInstance.get(ContextualInstance.java:50) [weld-core-impl-2.3.5.Final.jar:2.3.5.Final] at org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:742) [weld-core-impl-2.3.5.Final.jar:2.3.5.Final] at org.jboss.weld.bean.builtin.InstanceImpl.getBeanInstance(InstanceImpl.java:189) [weld-core-impl-2.3.5.Final.jar:2.3.5.Final] at org.jboss.weld.bean.builtin.InstanceImpl.get(InstanceImpl.java:100) [weld-core-impl-2.3.5.Final.jar:2.3.5.Final] at org.ovirt.engine.core.bll.Backend.loadService(Backend.java:301) [bll.jar:] at org.ovirt.engine.core.bll.Backend.initialize(Backend.java:212) [bll.jar:] at org.ovirt.engine.core.bll.Backend.create(Backend.java:159) [bll.jar:] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) [rt.jar:1.8.0_131] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) [rt.jar:1.8.0_131] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) [rt.jar:1.8.0_131] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_131] at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptor.java:96) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:70) [wildfly-weld-10.1.0.Final.jar:10.1.0.Final] at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doLifecycleInterception(Jsr299BindingsInterceptor.java:117) [wildfly-weld-10.1.0.Final.jar:10.1.0.Final] at org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:103) [wildfly-weld-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73) [weld-core-impl-2.3.5.Final.jar:2.3.5.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:83) [wildfly-weld-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.injection.WeldInjectionInterceptor.processInvocation(WeldInjectionInterceptor.java:53) [wildfly-weld-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.AroundConstructInterceptorFactory$1.processInvocation(AroundConstructInterceptorFactory.java:28) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.injection.WeldInterceptorInjectionInterceptor.processInvocation(WeldInterceptorInjectionInterceptor.java:56) [wildfly-weld-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.ComponentInstantiatorInterceptor.processInvocation(ComponentInstantiatorInterceptor.java:74) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.weld.ejb.Jsr299BindingsCreateInterceptor.processInvocation(Jsr299BindingsCreateInterceptor.java:100) [wildfly-weld-10.1.0.Final.jar:10.1.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:263) [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:374) [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final] at org.jboss.as.ejb3.tx.LifecycleCMTTxInterceptor.processInvocation(LifecycleCMTTxInterceptor.java:70) [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final]
> > >
A very similar report [1] was solved by downgrading postgresql-jdbc.
[1] http://lists.ovirt.org/pipermail/users/2017-April/081517.html
Best, -- Didi
> >
>
-- Didi
------=_Part_117131_1593059334.1495576400315 MIME-Version: 1.0 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable <!DOCTYPE html> <html><head> <meta charset=3D"UTF-8"> </head><body><p>I downgraded the jdbc to 9.2.1002 and it's working agai= n. Thank you for your help!</p><p>The full setup is as such in case i= t helps anyone in the future:</p><p>OS: CentOS 7.3.1611</p><p>Backend: Ceph= via Cinder</p><p>oVirt: 4.0.6.3</p><p>Postgres is remote and 9.5.7 on clie= nt and server</p><p>Postgres jdbc: 9.2.1002</p><p>Logan</p><blockquote><p>O= n May 23, 2017 at 4:15 PM Yedidyah Bar David <didi@redhat.com> wrot= e:</p><p>On Wed, May 24, 2017 at 12:06 AM, <support@jac-properties.com&= #62; wrote:</p><blockquote><p>Wow, that looks almost exactly like what we&#= 39;re seeing.</p><p>Unfortunately, downgrading from postgresql-jdbc-42.1.1 = to 42.0.0, restarting ovirt-engine and rerunning engine-setup produces the = same error messages.</p></blockquote><p>Please try 9.2. Thanks!</p><blockqu= ote><p>Logan</p><blockquote><p>On May 23, 2017 at 3:39 PM Yedidyah Bar Davi= d <didi@redhat.com> wrote:</p><p>On Tue, May 23, 2017 at 11:19 PM, = Logan Kuhn <support@jac-properties.com> wrote:</p><blockquote><p>Hi= </p><p>We recently upgraded from postgres 9.5.4 to 9.5.6 and then to 9.5.7.= We<br>restarted ovirt-engine between 9.5.4 and it worked as expected. Afte= r we<br>updated to 9.5.7 we have started to get postgres errors in engine.l= og and a<br>404 error in the browser when we try to start ovirt-engine.</p>= <p>Updates were done on client and server to keep them in sync.</p><p>The e= rror is complaining about a missing function, but we can verify that<br>the= function exists in the database. We've also restored engine and<br>ovi= rt_engine_history from a backup at 8am this morning when it was working<br>= and before we upgraded to 9.5.7 with no apparent help and run engine-setup<= br>afterwards, still no luck.</p><p>2017-05-23 15:07:48,418 INFO [org.ovirt= .engine.core.dal.dbbroker.DbFacade]<br>(ServerService Thread Pool -- 51) []= Initializing the DbFacade<br>2017-05-23 15:07:48,480 INFO [org.ovirt.engin= e.core.bll.Backend]<br>(ServerService Thread Pool -- 51) [] Start initializ= ing Backend<br>2017-05-23 15:07:48,502 ERROR<br>[org.ovirt.engine.core.bll.= network.macpool.MacPoolPerDc] (ServerService<br>Thread Pool -- 46) [] Error= initializing: PreparedStatementCallback; bad SQL<br>grammar [select * from= getallmacpoolrangesbymacpoolid()]; nested exception<br>is org.postgresql.u= til.PSQL<br>Exception: ERROR: function getallmacpoolrangesbymacpoolid() doe= s not exist<br> Hint: No function matches the given name and argument types= . You might need<br>to add explicit type casts.<br> Position: 16<br>2017-05= -23 15:07:48,517 ERROR [org.ovirt.engine.core.bll.Backend]<br>(ServerServic= e Thread Pool -- 51) [] Error during initialization:<br>org.jboss.weld.exce= ptions.WeldException: WELD-000049: Unable to invoke<br>public void<br>org.o= virt.engine.core.bll.hostedengine.PreviousHostedEngineHost.cre<br>ate() on<= br>org.ovirt.engine.core.bll.hostedengine.PreviousHostedEngineHost@3a35f461= <br> at<br>org.jboss.weld.injection.producer.DefaultLifecycleCallbackInvoke= r.invokeMethods(DefaultLifecycleCallbackInvoker.java:100)<br>[weld-core-imp= l-2.3.5.Final.jar:2.3.5.Final]<br> at<br>org.jboss.weld.injection.producer.= DefaultLifecycleCallbackInvoker.postConstruct(DefaultLifecycleCallbackInvok= er.java:81)<br>[weld-core-impl-2.3.5.Final.jar:2.3.5.Final]<br> at<br>org.j= boss.weld.injection.producer.BasicInjectionTarget.postConstruct(BasicInject= ionTarget.java:126)<br>[weld-core-impl-2.3.5.Final.jar:2.3.5.Final]<br> at = org.jboss.weld.bean.ManagedBean.create(ManagedBean.java:162)<br>[weld-core-= impl-2.3.5.Final.jar:2.3.5.Final]<br> at<br>org.jboss.weld.context.Abstract= Context.get(AbstractContext.java:96)<br>[weld-core-impl-2.3.5.Final.jar:2.3= .5.Final]<br> at<br>org.jboss.weld.bean.ContextualInstanceStrategy$DefaultC= ontextualInstanceStrategy.get(ContextualInstanceStrategy.java:101)<br>[weld= -core-impl-2.3.5.Final.jar:2.3.5.Final]<br> at<br>org.jboss.weld.bean.Conte= xtualInstanceStrategy$ApplicationScopedContextualInstanceStrategy.get(Conte= xtualInstanceStrategy.java:141)<br>[weld-core-impl-2.3.5.Final.jar:2.3.5.Fi= nal]<br> at<br>org.jboss.weld.bean.ContextualInstance.get(ContextualInstanc= e.java:50)<br>[weld-core-impl-2.3.5.Final.jar:2.3.5.Final]<br> at<br>org.jb= oss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:742)<br>= [weld-core-impl-2.3.5.Final.jar:2.3.5.Final]<br> at<br>org.jboss.weld.bean.= builtin.InstanceImpl.getBeanInstance(InstanceImpl.java:189)<br>[weld-core-i= mpl-2.3.5.Final.jar:2.3.5.Final]<br> at<br>org.jboss.weld.bean.builtin.Inst= anceImpl.get(InstanceImpl.java:100)<br>[weld-core-impl-2.3.5.Final.jar:2.3.= 5.Final]<br> at org.ovirt.engine.core.bll.Backend.loadService(Backend.java:= 301)<br>[bll.jar:]<br> at org.ovirt.engine.core.bll.Backend.initialize(Back= end.java:212)<br>[bll.jar:]<br> at org.ovirt.engine.core.bll.Backend.create= (Backend.java:159)<br>[bll.jar:]<br> at sun.reflect.NativeMethodAccessorImp= l.invoke0(Native Method)<br>[rt.jar:1.8.0_131]<br> at<br>sun.reflect.Native= MethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)<br>[rt.jar:1.8.= 0_131]<br> at<br>sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegating= MethodAccessorImpl.java:43)<br>[rt.jar:1.8.0_131]<br> at java.lang.reflect.= Method.invoke(Method.java:498)<br>[rt.jar:1.8.0_131]<br> at<br>org.jboss.as= .ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(= ManagedReferenceLifecycleMethodInterceptor.java:96)<br> at<br>org.jboss.inv= ocation.InterceptorContext.proceed(InterceptorContext.java:340)<br> at<br>o= rg.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContex= t.java:437)<br> at<br>org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.deleg= ateInterception(Jsr299BindingsInterceptor.java:70)<br>[wildfly-weld-10.1.0.= Final.jar:10.1.0.Final]<br> at<br>org.jboss.as.weld.ejb.Jsr299BindingsInter= ceptor.doLifecycleInterception(Jsr299BindingsInterceptor.java:117)<br>[wild= fly-weld-10.1.0.Final.jar:10.1.0.Final]<br> at<br>org.jboss.as.weld.ejb.Jsr= 299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:103= )<br>[wildfly-weld-10.1.0.Final.jar:10.1.0.Final]<br> at<br>org.jboss.invoc= ation.InterceptorContext.proceed(InterceptorContext.java:340)<br> at<br>org= .jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.= java:437)<br> at<br>org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInt= erceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73)= <br>[weld-core-impl-2.3.5.Final.jar:2.3.5.Final]<br> at<br>org.jboss.as.wel= d.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScop= eActivationInterceptor.java:83)<br>[wildfly-weld-10.1.0.Final.jar:10.1.0.Fi= nal]<br> at<br>org.jboss.invocation.InterceptorContext.proceed(InterceptorC= ontext.java:340)<br> at<br>org.jboss.as.weld.injection.WeldInjectionInterce= ptor.processInvocation(WeldInjectionInterceptor.java:53)<br>[wildfly-weld-1= 0.1.0.Final.jar:10.1.0.Final]<br> at<br>org.jboss.invocation.InterceptorCon= text.proceed(InterceptorContext.java:340)<br> at<br>org.jboss.as.ee.compone= nt.AroundConstructInterceptorFactory$1.processInvocation(AroundConstructInt= erceptorFactory.java:28)<br> at<br>org.jboss.invocation.InterceptorContext.= proceed(InterceptorContext.java:340)<br> at<br>org.jboss.as.weld.injection.= WeldInterceptorInjectionInterceptor.processInvocation(WeldInterceptorInject= ionInterceptor.java:56)<br>[wildfly-weld-10.1.0.Final.jar:10.1.0.Final]<br>= at<br>org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.j= ava:340)<br> at<br>org.jboss.as.ee.component.ComponentInstantiatorIntercept= or.processInvocation(ComponentInstantiatorInterceptor.java:74)<br> at<br>or= g.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)<= br> at<br>org.jboss.as.weld.ejb.Jsr299BindingsCreateInterceptor.processInvo= cation(Jsr299BindingsCreateInterceptor.java:100)<br>[wildfly-weld-10.1.0.Fi= nal.jar:10.1.0.Final]<br> at<br>org.jboss.invocation.InterceptorContext.pro= ceed(InterceptorContext.java:340)<br> at<br>org.jboss.as.ee.component.Names= paceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:5= 0)<br> at<br>org.jboss.invocation.InterceptorContext.proceed(InterceptorCon= text.java:340)<br> at<br>org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx= (CMTTxInterceptor.java:263)<br>[wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final]= <br> at<br>org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.= java:374)<br>[wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final]<br> at<br>org.jbo= ss.as.ejb3.tx.LifecycleCMTTxInterceptor.processInvocation(LifecycleCMTTxInt= erceptor.java:70)<br>[wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final]</p></bloc= kquote><p>A very similar report [1] was solved by downgrading postgresql-jd= bc.</p><p>[1] <a href=3D"http://lists.ovirt.org/pipermail/users/2017-April/= 081517.html">http://lists.ovirt.org/pipermail/users/2017-April/081517.html<= /a></p><p>Best,<br>--<br>Didi</p></blockquote></blockquote><p>--<br>Didi</p=
</blockquote></body></html> =20 ------=_Part_117131_1593059334.1495576400315--