12:53 a.m.
------=_Part_117131_1593059334.1495576400315
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 7bit
I downgraded the jdbc to 9.2.1002 and it's working again. Thank you for your help!
The full setup is as such in case it helps anyone in the future:
OS: CentOS 7.3.1611
Backend: Ceph via Cinder
oVirt: 4.0.6.3
Postgres is remote and 9.5.7 on client and server
Postgres jdbc: 9.2.1002
Logan
On May 23, 2017 at 4:15 PM Yedidyah Bar David <didi(a)redhat.com> wrote:
On Wed, May 24, 2017 at 12:06 AM, <support(a)jac-properties.com> wrote:
> >
> Wow, that looks almost exactly like what we're seeing.
>
> Unfortunately, downgrading from postgresql-jdbc-42.1.1 to 42.0.0, restarting
ovirt-engine and rerunning engine-setup produces the same error messages.
>
> >
Please try 9.2. Thanks!
> >
> Logan
>
> > > >
> > On May 23, 2017 at 3:39 PM Yedidyah Bar David
<didi(a)redhat.com> wrote:
> >
> > On Tue, May 23, 2017 at 11:19 PM, Logan Kuhn
<support(a)jac-properties.com> wrote:
> >
> > > > > >
> > > Hi
> > >
> > > We recently upgraded from postgres 9.5.4 to 9.5.6 and then
to 9.5.7. We
> > > restarted ovirt-engine between 9.5.4 and it worked as
expected. After we
> > > updated to 9.5.7 we have started to get postgres errors in
engine.log and a
> > > 404 error in the browser when we try to start
ovirt-engine.
> > >
> > > Updates were done on client and server to keep them in
sync.
> > >
> > > The error is complaining about a missing function, but we
can verify that
> > > the function exists in the database. We've also
restored engine and
> > > ovirt_engine_history from a backup at 8am this morning
when it was working
> > > and before we upgraded to 9.5.7 with no apparent help and
run engine-setup
> > > afterwards, still no luck.
> > >
> > > 2017-05-23 15:07:48,418 INFO
[org.ovirt.engine.core.dal.dbbroker.DbFacade]
> > > (ServerService Thread Pool -- 51) [] Initializing the
DbFacade
> > > 2017-05-23 15:07:48,480 INFO
[org.ovirt.engine.core.bll.Backend]
> > > (ServerService Thread Pool -- 51) [] Start initializing
Backend
> > > 2017-05-23 15:07:48,502 ERROR
> > > [org.ovirt.engine.core.bll.network.macpool.MacPoolPerDc]
(ServerService
> > > Thread Pool -- 46) [] Error initializing:
PreparedStatementCallback; bad SQL
> > > grammar [select * from getallmacpoolrangesbymacpoolid()];
nested exception
> > > is org.postgresql.util.PSQL
> > > Exception: ERROR: function
getallmacpoolrangesbymacpoolid() does not exist
> > > Hint: No function matches the given name and argument
types. You might need
> > > to add explicit type casts.
> > > Position: 16
> > > 2017-05-23 15:07:48,517 ERROR
[org.ovirt.engine.core.bll.Backend]
> > > (ServerService Thread Pool -- 51) [] Error during
initialization:
> > > org.jboss.weld.exceptions.WeldException: WELD-000049:
Unable to invoke
> > > public void
> > >
org.ovirt.engine.core.bll.hostedengine.PreviousHostedEngineHost.cre
> > > ate() on
> > >
org.ovirt.engine.core.bll.hostedengine.PreviousHostedEngineHost@3a35f461
> > > at
> > >
org.jboss.weld.injection.producer.DefaultLifecycleCallbackInvoker.invokeMethods(DefaultLifecycleCallbackInvoker.java:100)
> > > [weld-core-impl-2.3.5.Final.jar:2.3.5.Final]
> > > at
> > >
org.jboss.weld.injection.producer.DefaultLifecycleCallbackInvoker.postConstruct(DefaultLifecycleCallbackInvoker.java:81)
> > > [weld-core-impl-2.3.5.Final.jar:2.3.5.Final]
> > > at
> > >
org.jboss.weld.injection.producer.BasicInjectionTarget.postConstruct(BasicInjectionTarget.java:126)
> > > [weld-core-impl-2.3.5.Final.jar:2.3.5.Final]
> > > at
org.jboss.weld.bean.ManagedBean.create(ManagedBean.java:162)
> > > [weld-core-impl-2.3.5.Final.jar:2.3.5.Final]
> > > at
> > >
org.jboss.weld.context.AbstractContext.get(AbstractContext.java:96)
> > > [weld-core-impl-2.3.5.Final.jar:2.3.5.Final]
> > > at
> > >
org.jboss.weld.bean.ContextualInstanceStrategy$DefaultContextualInstanceStrategy.get(ContextualInstanceStrategy.java:101)
> > > [weld-core-impl-2.3.5.Final.jar:2.3.5.Final]
> > > at
> > >
org.jboss.weld.bean.ContextualInstanceStrategy$ApplicationScopedContextualInstanceStrategy.get(ContextualInstanceStrategy.java:141)
> > > [weld-core-impl-2.3.5.Final.jar:2.3.5.Final]
> > > at
> > >
org.jboss.weld.bean.ContextualInstance.get(ContextualInstance.java:50)
> > > [weld-core-impl-2.3.5.Final.jar:2.3.5.Final]
> > > at
> > >
org.jboss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:742)
> > > [weld-core-impl-2.3.5.Final.jar:2.3.5.Final]
> > > at
> > >
org.jboss.weld.bean.builtin.InstanceImpl.getBeanInstance(InstanceImpl.java:189)
> > > [weld-core-impl-2.3.5.Final.jar:2.3.5.Final]
> > > at
> > >
org.jboss.weld.bean.builtin.InstanceImpl.get(InstanceImpl.java:100)
> > > [weld-core-impl-2.3.5.Final.jar:2.3.5.Final]
> > > at
org.ovirt.engine.core.bll.Backend.loadService(Backend.java:301)
> > > [bll.jar:]
> > > at
org.ovirt.engine.core.bll.Backend.initialize(Backend.java:212)
> > > [bll.jar:]
> > > at
org.ovirt.engine.core.bll.Backend.create(Backend.java:159)
> > > [bll.jar:]
> > > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native
Method)
> > > [rt.jar:1.8.0_131]
> > > at
> > >
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> > > [rt.jar:1.8.0_131]
> > > at
> > >
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> > > [rt.jar:1.8.0_131]
> > > at java.lang.reflect.Method.invoke(Method.java:498)
> > > [rt.jar:1.8.0_131]
> > > at
> > >
org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(ManagedReferenceLifecycleMethodInterceptor.java:96)
> > > at
> > >
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
> > > at
> > >
org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437)
> > > at
> > >
org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.delegateInterception(Jsr299BindingsInterceptor.java:70)
> > > [wildfly-weld-10.1.0.Final.jar:10.1.0.Final]
> > > at
> > >
org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.doLifecycleInterception(Jsr299BindingsInterceptor.java:117)
> > > [wildfly-weld-10.1.0.Final.jar:10.1.0.Final]
> > > at
> > >
org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:103)
> > > [wildfly-weld-10.1.0.Final.jar:10.1.0.Final]
> > > at
> > >
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
> > > at
> > >
org.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.java:437)
> > > at
> > >
org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInterceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73)
> > > [weld-core-impl-2.3.5.Final.jar:2.3.5.Final]
> > > at
> > >
org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScopeActivationInterceptor.java:83)
> > > [wildfly-weld-10.1.0.Final.jar:10.1.0.Final]
> > > at
> > >
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
> > > at
> > >
org.jboss.as.weld.injection.WeldInjectionInterceptor.processInvocation(WeldInjectionInterceptor.java:53)
> > > [wildfly-weld-10.1.0.Final.jar:10.1.0.Final]
> > > at
> > >
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
> > > at
> > >
org.jboss.as.ee.component.AroundConstructInterceptorFactory$1.processInvocation(AroundConstructInterceptorFactory.java:28)
> > > at
> > >
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
> > > at
> > >
org.jboss.as.weld.injection.WeldInterceptorInjectionInterceptor.processInvocation(WeldInterceptorInjectionInterceptor.java:56)
> > > [wildfly-weld-10.1.0.Final.jar:10.1.0.Final]
> > > at
> > >
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
> > > at
> > >
org.jboss.as.ee.component.ComponentInstantiatorInterceptor.processInvocation(ComponentInstantiatorInterceptor.java:74)
> > > at
> > >
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
> > > at
> > >
org.jboss.as.weld.ejb.Jsr299BindingsCreateInterceptor.processInvocation(Jsr299BindingsCreateInterceptor.java:100)
> > > [wildfly-weld-10.1.0.Final.jar:10.1.0.Final]
> > > at
> > >
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
> > > at
> > >
org.jboss.as.ee.component.NamespaceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:50)
> > > at
> > >
org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)
> > > at
> > >
org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInterceptor.java:263)
> > > [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final]
> > > at
> > >
org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.java:374)
> > > [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final]
> > > at
> > >
org.jboss.as.ejb3.tx.LifecycleCMTTxInterceptor.processInvocation(LifecycleCMTTxInterceptor.java:70)
> > > [wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final]
> > >
> > > > > >
> > A very similar report [1] was solved by downgrading
postgresql-jdbc.
> >
> > [1] http://lists.ovirt.org/pipermail/users/2017-April/081517.html
> >
> > Best,
> > --
> > Didi
> >
> > > >
> >
--
Didi
------=_Part_117131_1593059334.1495576400315
MIME-Version: 1.0
Content-Type: text/html; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
<!DOCTYPE html>
<html><head>
<meta charset=3D"UTF-8">
</head><body><p>I downgraded the jdbc to 9.2.1002 and it's
working agai=
n.  Thank you for your help!</p><p>The full setup is as such in case
i=
t helps anyone in the future:</p><p>OS: CentOS
7.3.1611</p><p>Backend: Ceph=
via Cinder</p><p>oVirt: 4.0.6.3</p><p>Postgres is remote and
9.5.7 on clie=
nt and server</p><p>Postgres jdbc:
9.2.1002</p><p>Logan</p><blockquote><p>O=
n May 23, 2017 at 4:15 PM Yedidyah Bar David &#60;didi(a)redhat.com&#62; wrot=
e:</p><p>On Wed, May 24, 2017 at 12:06 AM,
&#60;support(a)jac-properties.com&=
#62; wrote:</p><blockquote><p>Wow, that looks almost exactly like what
we&#=
39;re seeing.</p><p>Unfortunately, downgrading from postgresql-jdbc-42.1.1 =
to 42.0.0, restarting ovirt-engine and rerunning engine-setup produces the =
same error messages.</p></blockquote><p>Please try 9.2.
Thanks!</p><blockqu=
ote><p>Logan</p><blockquote><p>On May 23, 2017 at 3:39 PM
Yedidyah Bar Davi=
d &#60;didi(a)redhat.com&#62; wrote:</p><p>On Tue, May 23, 2017 at 11:19
PM, =
Logan Kuhn &#60;support(a)jac-properties.com&#62;
wrote:</p><blockquote><p>Hi=
</p><p>We recently upgraded from postgres 9.5.4 to 9.5.6 and then to 9.5.7.=
We<br>restarted ovirt-engine between 9.5.4 and it worked as expected. Afte=
r we<br>updated to 9.5.7 we have started to get postgres errors in engine.l=
og and a<br>404 error in the browser when we try to start ovirt-engine.</p>=
<p>Updates were done on client and server to keep them in
sync.</p><p>The e=
rror is complaining about a missing function, but we can verify that<br>the=
function exists in the database. We've also restored engine and<br>ovi=
rt_engine_history from a backup at 8am this morning when it was working<br>=
and before we upgraded to 9.5.7 with no apparent help and run engine-setup<=
br>afterwards, still no luck.</p><p>2017-05-23 15:07:48,418 INFO
[org.ovirt=
.engine.core.dal.dbbroker.DbFacade]<br>(ServerService Thread Pool -- 51) []=
Initializing the DbFacade<br>2017-05-23 15:07:48,480 INFO [org.ovirt.engin=
e.core.bll.Backend]<br>(ServerService Thread Pool -- 51) [] Start initializ=
ing Backend<br>2017-05-23 15:07:48,502 ERROR<br>[org.ovirt.engine.core.bll.=
network.macpool.MacPoolPerDc] (ServerService<br>Thread Pool -- 46) [] Error=
initializing: PreparedStatementCallback; bad SQL<br>grammar [select * from=
getallmacpoolrangesbymacpoolid()]; nested exception<br>is org.postgresql.u=
til.PSQL<br>Exception: ERROR: function getallmacpoolrangesbymacpoolid() doe=
s not exist<br> Hint: No function matches the given name and argument types=
. You might need<br>to add explicit type casts.<br> Position:
16<br>2017-05=
-23 15:07:48,517 ERROR [org.ovirt.engine.core.bll.Backend]<br>(ServerServic=
e Thread Pool -- 51) [] Error during initialization:<br>org.jboss.weld.exce=
ptions.WeldException: WELD-000049: Unable to invoke<br>public void<br>org.o=
virt.engine.core.bll.hostedengine.PreviousHostedEngineHost.cre<br>ate() on<=
br>org.ovirt.engine.core.bll.hostedengine.PreviousHostedEngineHost@3a35f461=
<br> at<br>org.jboss.weld.injection.producer.DefaultLifecycleCallbackInvoke=
r.invokeMethods(DefaultLifecycleCallbackInvoker.java:100)<br>[weld-core-imp=
l-2.3.5.Final.jar:2.3.5.Final]<br> at<br>org.jboss.weld.injection.producer.=
DefaultLifecycleCallbackInvoker.postConstruct(DefaultLifecycleCallbackInvok=
er.java:81)<br>[weld-core-impl-2.3.5.Final.jar:2.3.5.Final]<br>
at<br>org.j=
boss.weld.injection.producer.BasicInjectionTarget.postConstruct(BasicInject=
ionTarget.java:126)<br>[weld-core-impl-2.3.5.Final.jar:2.3.5.Final]<br> at =
org.jboss.weld.bean.ManagedBean.create(ManagedBean.java:162)<br>[weld-core-=
impl-2.3.5.Final.jar:2.3.5.Final]<br> at<br>org.jboss.weld.context.Abstract=
Context.get(AbstractContext.java:96)<br>[weld-core-impl-2.3.5.Final.jar:2.3=
.5.Final]<br> at<br>org.jboss.weld.bean.ContextualInstanceStrategy$DefaultC=
ontextualInstanceStrategy.get(ContextualInstanceStrategy.java:101)<br>[weld=
-core-impl-2.3.5.Final.jar:2.3.5.Final]<br> at<br>org.jboss.weld.bean.Conte=
xtualInstanceStrategy$ApplicationScopedContextualInstanceStrategy.get(Conte=
xtualInstanceStrategy.java:141)<br>[weld-core-impl-2.3.5.Final.jar:2.3.5.Fi=
nal]<br> at<br>org.jboss.weld.bean.ContextualInstance.get(ContextualInstanc=
e.java:50)<br>[weld-core-impl-2.3.5.Final.jar:2.3.5.Final]<br>
at<br>org.jb=
oss.weld.manager.BeanManagerImpl.getReference(BeanManagerImpl.java:742)<br>=
[weld-core-impl-2.3.5.Final.jar:2.3.5.Final]<br> at<br>org.jboss.weld.bean.=
builtin.InstanceImpl.getBeanInstance(InstanceImpl.java:189)<br>[weld-core-i=
mpl-2.3.5.Final.jar:2.3.5.Final]<br> at<br>org.jboss.weld.bean.builtin.Inst=
anceImpl.get(InstanceImpl.java:100)<br>[weld-core-impl-2.3.5.Final.jar:2.3.=
5.Final]<br> at org.ovirt.engine.core.bll.Backend.loadService(Backend.java:=
301)<br>[bll.jar:]<br> at org.ovirt.engine.core.bll.Backend.initialize(Back=
end.java:212)<br>[bll.jar:]<br> at org.ovirt.engine.core.bll.Backend.create=
(Backend.java:159)<br>[bll.jar:]<br> at sun.reflect.NativeMethodAccessorImp=
l.invoke0(Native Method)<br>[rt.jar:1.8.0_131]<br>
at<br>sun.reflect.Native=
MethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)<br>[rt.jar:1.8.=
0_131]<br> at<br>sun.reflect.DelegatingMethodAccessorImpl.invoke(Delegating=
MethodAccessorImpl.java:43)<br>[rt.jar:1.8.0_131]<br> at java.lang.reflect.=
Method.invoke(Method.java:498)<br>[rt.jar:1.8.0_131]<br>
at<br>org.jboss.as=
.ee.component.ManagedReferenceLifecycleMethodInterceptor.processInvocation(=
ManagedReferenceLifecycleMethodInterceptor.java:96)<br> at<br>org.jboss.inv=
ocation.InterceptorContext.proceed(InterceptorContext.java:340)<br> at<br>o=
rg.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContex=
t.java:437)<br> at<br>org.jboss.as.weld.ejb.Jsr299BindingsInterceptor.deleg=
ateInterception(Jsr299BindingsInterceptor.java:70)<br>[wildfly-weld-10.1.0.=
Final.jar:10.1.0.Final]<br> at<br>org.jboss.as.weld.ejb.Jsr299BindingsInter=
ceptor.doLifecycleInterception(Jsr299BindingsInterceptor.java:117)<br>[wild=
fly-weld-10.1.0.Final.jar:10.1.0.Final]<br> at<br>org.jboss.as.weld.ejb.Jsr=
299BindingsInterceptor.processInvocation(Jsr299BindingsInterceptor.java:103=
)<br>[wildfly-weld-10.1.0.Final.jar:10.1.0.Final]<br>
at<br>org.jboss.invoc=
ation.InterceptorContext.proceed(InterceptorContext.java:340)<br> at<br>org=
.jboss.invocation.InterceptorContext$Invocation.proceed(InterceptorContext.=
java:437)<br> at<br>org.jboss.weld.ejb.AbstractEJBRequestScopeActivationInt=
erceptor.aroundInvoke(AbstractEJBRequestScopeActivationInterceptor.java:73)=
<br>[weld-core-impl-2.3.5.Final.jar:2.3.5.Final]<br>
at<br>org.jboss.as.wel=
d.ejb.EjbRequestScopeActivationInterceptor.processInvocation(EjbRequestScop=
eActivationInterceptor.java:83)<br>[wildfly-weld-10.1.0.Final.jar:10.1.0.Fi=
nal]<br> at<br>org.jboss.invocation.InterceptorContext.proceed(InterceptorC=
ontext.java:340)<br> at<br>org.jboss.as.weld.injection.WeldInjectionInterce=
ptor.processInvocation(WeldInjectionInterceptor.java:53)<br>[wildfly-weld-1=
0.1.0.Final.jar:10.1.0.Final]<br> at<br>org.jboss.invocation.InterceptorCon=
text.proceed(InterceptorContext.java:340)<br> at<br>org.jboss.as.ee.compone=
nt.AroundConstructInterceptorFactory$1.processInvocation(AroundConstructInt=
erceptorFactory.java:28)<br> at<br>org.jboss.invocation.InterceptorContext.=
proceed(InterceptorContext.java:340)<br> at<br>org.jboss.as.weld.injection.=
WeldInterceptorInjectionInterceptor.processInvocation(WeldInterceptorInject=
ionInterceptor.java:56)<br>[wildfly-weld-10.1.0.Final.jar:10.1.0.Final]<br>=
at<br>org.jboss.invocation.InterceptorContext.proceed(InterceptorContext.j=
ava:340)<br> at<br>org.jboss.as.ee.component.ComponentInstantiatorIntercept=
or.processInvocation(ComponentInstantiatorInterceptor.java:74)<br> at<br>or=
g.jboss.invocation.InterceptorContext.proceed(InterceptorContext.java:340)<=
br> at<br>org.jboss.as.weld.ejb.Jsr299BindingsCreateInterceptor.processInvo=
cation(Jsr299BindingsCreateInterceptor.java:100)<br>[wildfly-weld-10.1.0.Fi=
nal.jar:10.1.0.Final]<br> at<br>org.jboss.invocation.InterceptorContext.pro=
ceed(InterceptorContext.java:340)<br> at<br>org.jboss.as.ee.component.Names=
paceContextInterceptor.processInvocation(NamespaceContextInterceptor.java:5=
0)<br> at<br>org.jboss.invocation.InterceptorContext.proceed(InterceptorCon=
text.java:340)<br> at<br>org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx=
(CMTTxInterceptor.java:263)<br>[wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final]=
<br> at<br>org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxInterceptor.=
java:374)<br>[wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final]<br>
at<br>org.jbo=
ss.as.ejb3.tx.LifecycleCMTTxInterceptor.processInvocation(LifecycleCMTTxInt=
erceptor.java:70)<br>[wildfly-ejb3-10.1.0.Final.jar:10.1.0.Final]</p></bloc=
kquote><p>A very similar report [1] was solved by downgrading postgresql-jd=
bc.</p><p>[1] <a
href=3D"http://lists.ovirt.org/pipermail/users/2017-April/=
081517.html">http://lists.ovirt.org/pipermail/users/2017-April/08...
/a></p><p>Best,<br>--<br>Didi</p></blockquote></blockquote><p>--<br>Didi</p=
</blockquote></body></html>
=20
------=_Part_117131_1593059334.1495576400315--