Hi Filip,could you please share with us complete engine logs using SOS log collector [1] and, if possible, engine database dump, so we can investigate the issue? Also do you remember any steps you have performed before this issue happened?ThanksMartinFrom: Filip Goll <biohazardik@gmail.com>
Date: Thu, 19 Jul 2018 at 13:19
Subject: ERROR: integer out of range
To: <users-owner@ovirt.org>Dear guru’s,Do you have any idea how to fix it? I can’t list any storage domain = no data storage domain is up, so the datacenter is also down.Thats why I understand this error:On startup any virtual machine this error:
- Action failed due to database connection failure. Please check connectivity to your Database server
Using: Software Version:4.2.4.5-1.el7PSQL:engine=# select * fromstorage_domains_for_search;ERROR: integer out of rangeIn vdsm.log is everything, but on:engine.log:2018-07-19 11:36:51,166+02 ERROR [org.ovirt.engine.core.bll.SearchQuery] (default task-251) [0d583ed2-fcbd-4d2d-b12c-0f053 2a00a85] Query 'SearchQuery' failed: StatementCallback; SQL [SELECT * FROM ((SELECT distinct storage_domains_for_search.* FROM storage_domains_for_search ) ORDER BY storage_name ASC ) as T1 OFFSET (1 -1) LIMIT 100]; ERROR: integer out of range; nested exception is org.postgresql.util.PSQLExcept ion: ERROR: integer out of range 2018-07-19 11:36:51,166+02 ERROR [org.ovirt.engine.core.bll.SearchQuery] (default task-251) [0d583ed2-fcbd-4d2d-b12c-0f053 2a00a85] Exception: org.springframework.dao.DataIn tegrityViolationException: StatementCallback; SQL [SELECT * FROM ((SELECT distinct storage_domains_for_search.* FROM storage_domains_for_search ) ORDER BY storage_name ASC ) as T1 OFFSET (1 -1) LIMIT 100]; ERROR: integer out of range; nested exception is org.postgresql.util.PSQLExcept ion: ERROR: integer out of range at org.springframework.jdbc.support.SQLStateSQLExceptionTransla tor.doTranslate(SQLStateSQLExc eptionTranslator.java:102) [spring-jdbc.jar:4.3.9.RELEASE ] at org.springframework.jdbc.support.AbstractFallbackSQLExceptio nTranslator.translate(Abstract FallbackSQLExceptionTranslator .java:73) [spring-jdbc.jar:4.3.9.RELEASE ] at org.springframework.jdbc.support.AbstractFallbackSQLExceptio nTranslator.translate(Abstract FallbackSQLExceptionTranslator .java:81) [spring-jdbc.jar:4.3.9.RELEASE ] at org.springframework.jdbc.support.AbstractFallbackSQLExceptio nTranslator.translate(Abstract FallbackSQLExceptionTranslator .java:81) [spring-jdbc.jar:4.3.9.RELEASE ] at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTempl ate.java:419) [spring-jdbc.jar:4.3.9.RELEASE ] at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplat e.java:474) [spring-jdbc.jar:4.3.9.RELEASE ] at org.springframework.jdbc.core.JdbcTemplate.query(JdbcTemplat e.java:484) [spring-jdbc.jar:4.3.9.RELEASE ] at org.ovirt.engine.core.dao.StorageDomainDaoImpl.getAllWithQue ry(StorageDomainDaoImpl.java: 115) [dal.jar:] at org.ovirt.engine.core.bll.SearchQuery.genericSearch(SearchQu ery.java:344) [bll.jar:] at org.ovirt.engine.core.bll.SearchQuery.searchStorageDomain(Se archQuery.java:393) [bll.jar:] at org.ovirt.engine.core.bll.SearchQuery.executeQueryCommand(Se archQuery.java:204) [bll.jar:] at org.ovirt.engine.core.bll.QueriesCommandBase.executeCommand( QueriesCommandBase.java:106) [bll.jar:] at org.ovirt.engine.core.dal.VdcCommandBase.execute(VdcCommandB ase.java:33) [dal.jar:] at org.ovirt.engine.core.bll.executor.DefaultBackendQueryExecut or.execute(DefaultBackendQuery Executor.java:14) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runQueryImpl(Backend.java: 538) [bll.jar:] at org.ovirt.engine.core.bll.Backend.runQuery(Backend.java:507) [bll.jar:] at sun.reflect.GeneratedMethodAccessor82.invoke(Unknown Source) [:1.8.0_171] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe thodAccessorImpl.java:43) [rt.jar:1.8.0_171] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_171] at org.jboss.as.ee.component.ManagedReferenceMethodInterceptor. processInvocation(ManagedRefer enceMethodInterceptor.java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed( InterceptorContext.java:509) at org.jboss.as.weld.ejb.DelegatingInterceptorInvocationContext .proceed(DelegatingInterceptor InvocationContext.java:92) [wildfly-weld-ejb-11.0.0.Final .jar:11.0.0.Final] at org.jboss.weld.interceptor.proxy.WeldInvocationContext.inter ceptorChainCompleted(WeldInvoc ationContext.java:98) [weld-core-impl-2.4.3.Final.ja r:2.4.3.Final] at org.jboss.weld.interceptor.proxy.WeldInvocationContext.proce ed(WeldInvocationContext.java: 117) [weld-core-impl-2.4.3.Final.ja r:2.4.3.Final] at org.ovirt.engine.core.common.di.interceptor.LoggingIntercept or.apply(LoggingInterceptor. java:12) [common.jar:] at sun.reflect.GeneratedMethodAccessor66.invoke(Unknown Source) [:1.8.0_171] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe thodAccessorImpl.java:43) [rt.jar:1.8.0_171] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_171] at org.jboss.weld.interceptor.reader.SimpleInterceptorInvocatio n$SimpleMethodInvocation. invoke(SimpleInterceptorInvoca tion.java:73) [weld-core-impl-2.4.3.Final.ja r:2.4.3.Final] at org.jboss.weld.interceptor.proxy.WeldInvocationContext.invok eNext(WeldInvocationContext. java:83) [weld-core-impl-2.4.3.Final.ja r:2.4.3.Final] at org.jboss.weld.interceptor.proxy.WeldInvocationContext.proce ed(WeldInvocationContext.java: 115) [weld-core-impl-2.4.3.Final.ja r:2.4.3.Final] at org.jboss.weld.bean.InterceptorImpl.intercept(InterceptorImp l.java:108) [weld-core-impl-2.4.3.Final.ja r:2.4.3.Final] at org.jboss.as.weld.ejb.DelegatingInterceptorInvocationContext .proceed(DelegatingInterceptor InvocationContext.java:82) [wildfly-weld-ejb-11.0.0.Final .jar:11.0.0.Final] at org.jboss.as.weld.interceptors.EjbComponentInterceptorSuppor t.delegateInterception(EjbComp onentInterceptorSupport.java: 60) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.del egateInterception(Jsr299Bindin gsInterceptor.java:76) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.doM ethodInterception(Jsr299Bindin gsInterceptor.java:88) at org.jboss.as.weld.interceptors.Jsr299BindingsInterceptor.pro cessInvocation(Jsr299BindingsI nterceptor.java:101) at org.jboss.as.ee.component.interceptors.UserInterceptorFactor y$1.processInvocation(UserInte rceptorFactory.java:63) at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed( InterceptorContext.java:509) at org.ovirt.engine.core.bll.interceptors.CorrelationIdTrackerI nterceptor.aroundInvoke(Correl ationIdTrackerInterceptor. java:13) [bll.jar:] at sun.reflect.GeneratedMethodAccessor78.invoke(Unknown Source) [:1.8.0_171] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe thodAccessorImpl.java:43) [rt.jar:1.8.0_171] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_171] at org.jboss.as.ee.component.ManagedReferenceLifecycleMethodInt erceptor.processInvocation(Man agedReferenceLifecycleMethodIn terceptor.java:89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.ExecutionTimeI nterceptor.processInvocation(E xecutionTimeInterceptor.java:4 3) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ee.concurrent.ConcurrentContextInterceptor.proc essInvocation(ConcurrentContex tInterceptor.java:45) [wildfly-ee-11.0.0.Final.jar:1 1.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.invocation.InitialInterceptor.processInvocation(In itialInterceptor.java:40) at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(Ch ainedInterceptor.java:53) at org.jboss.as.ee.component.interceptors.ComponentDispatcherIn terceptor.processInvocation(Co mponentDispatcherInterceptor. java:52) at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ejb3.component.singleton.SingletonComponentInst anceAssociationInterceptor.pro cessInvocation(SingletonCompon entInstanceAssociationIntercep tor.java:53) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ejb3.tx.CMTTxInterceptor.invokeInNoTx(CMTTxInte rceptor.java:264) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.supports(CMTTxIntercep tor.java:379) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.as.ejb3.tx.CMTTxInterceptor.processInvocation(CMTT xInterceptor.java:244) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.invocation.InterceptorContext$Invocation.proceed( InterceptorContext.java:509) at org.jboss.weld.ejb.AbstractEJBRequestScopeActivationIntercep tor.aroundInvoke(AbstractEJBRe questScopeActivationIntercepto r.java:73) [weld-core-impl-2.4.3.Final.ja r:2.4.3.Final] at org.jboss.as.weld.ejb.EjbRequestScopeActivationInterceptor. processInvocation(EjbRequestSc opeActivationInterceptor.java: 89) at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ejb3.component.interceptors.CurrentInvocationCo ntextInterceptor. processInvocation(CurrentInvoc ationContextInterceptor.java: 41) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ejb3.component.invocationmetrics.WaitTimeInterc eptor.processInvocation(WaitTi meInterceptor.java:47) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ejb3.security.SecurityContextInterceptor.proces sInvocation(SecurityContextInt erceptor.java:100) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ejb3.deployment.processors.StartupAwaitIntercep tor.processInvocation(StartupA waitInterceptor.java:22) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ejb3.component.interceptors.ShutDownInterceptor Factory$1.processInvocation(Sh utDownInterceptorFactory.java: 64) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ejb3.component.interceptors.LoggingInterceptor. processInvocation(LoggingInter ceptor.java:67) [wildfly-ejb3-11.0.0.Final.jar :11.0.0.Final] at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.as.ee.component.NamespaceContextInterceptor.proces sInvocation(NamespaceContextIn terceptor.java:50) at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.invocation.ContextClassLoaderInterceptor.processIn vocation(ContextClassLoaderInt erceptor.java:60) at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.invocation.InterceptorContext.run(InterceptorConte xt.java:438) at org.wildfly.security.manager.WildFlySecurityManager.doChecke d(WildFlySecurityManager.java: 609) at org.jboss.invocation.AccessCheckingInterceptor.processInvoca tion(AccessCheckingInterceptor .java:57) at org.jboss.invocation.InterceptorContext.proceed(InterceptorC ontext.java:422) at org.jboss.invocation.ChainedInterceptor.processInvocation(Ch ainedInterceptor.java:53) at org.jboss.as.ee.component.ViewService$View.invoke(ViewServic e.java:198) at org.jboss.as.ee.component.ViewDescription$1.processInvocatio n(ViewDescription.java:185) at org.jboss.as.ee.component.ProxyInvocationHandler.invoke(Prox yInvocationHandler.java:81) at org.ovirt.engine.core.common.interfaces.BackendLocal$$$view4 .runQuery(Unknown Source) [common.jar:] at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTService Impl.runQuery(GenericApiGWTSer viceImpl.java:90) at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTService Impl.runMultipleQueries(Generi cApiGWTServiceImpl.java:121) at sun.reflect.GeneratedMethodAccessor109.invoke(Unknown Source) [:1.8.0_171] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMe thodAccessorImpl.java:43) [rt.jar:1.8.0_171] at java.lang.reflect.Method.invoke(Method.java:498) [rt.jar:1.8.0_171] at com.google.gwt.user.server.rpc.RPC.invokeAndEncodeResponse( RPC.java:587) at com.google.gwt.user.server.rpc.RemoteServiceServlet.processC all(RemoteServiceServlet.java: 333) at com.google.gwt.user.server.rpc.RemoteServiceServlet.processC all(RemoteServiceServlet.java: 303) at com.google.gwt.user.server.rpc.RemoteServiceServlet.processP ost(RemoteServiceServlet.java: 373) at com.google.gwt.user.server.rpc.AbstractRemoteServiceServlet. doPost(AbstractRemoteServiceSe rvlet.java:62) at javax.servlet.http.HttpServlet.service(HttpServlet.java:707) [jboss-servlet-api_3.1_spec-1. 0.0.Final.jar:1.0.0.Final] at org.ovirt.engine.ui.frontend.server.gwt.GenericApiGWTService Impl.service(GenericApiGWTServ iceImpl.java:78) at javax.servlet.http.HttpServlet.service(HttpServlet.java:790) [jboss-servlet-api_3.1_spec-1. 0.0.Final.jar:1.0.0.Final] at io.undertow.servlet.handlers.ServletHandler.handleRequest(Se rvletHandler.java:85) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.d oFilter(FilterHandler.java:129 ) at org.ovirt.engine.core.utils.servlet.HeaderFilter.doFilter(He aderFilter.java:94) [utils.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilte r.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.d oFilter(FilterHandler.java:131 ) at org.ovirt.engine.core.utils.servlet.CachingFilter.doFilter( CachingFilter.java:133) [utils.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilte r.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.d oFilter(FilterHandler.java:131 ) at org.ovirt.engine.core.branding.BrandingFilter.doFilter( BrandingFilter.java:73) [branding.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilte r.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.d oFilter(FilterHandler.java:131 ) at org.ovirt.engine.core.utils.servlet.LocaleFilter.doFilter(Lo caleFilter.java:65) [utils.jar:] at io.undertow.servlet.core.ManagedFilter.doFilter(ManagedFilte r.java:61) at io.undertow.servlet.handlers.FilterHandler$FilterChainImpl.d oFilter(FilterHandler.java:131 ) at io.undertow.servlet.handlers.FilterHandler.handleRequest(Fil terHandler.java:84) at io.undertow.servlet.handlers.security.ServletSecurityRoleHan dler.handleRequest(ServletSecu rityRoleHandler.java:62) at io.undertow.servlet.handlers.ServletDispatchingHandler.handl eRequest(ServletDispatchingHan dler.java:36) at org.wildfly.extension.undertow.security.SecurityContextAssoc iationHandler.handleRequest(Se curityContextAssociationHandle r.java:78) at io.undertow.server.handlers.PredicateHandler.handleRequest(P redicateHandler.java:43) at io.undertow.servlet.handlers.security.SSLInformationAssociat ionHandler.handleRequest(SSLIn formationAssociationHandler. java:131) at io.undertow.servlet.handlers.security.ServletAuthenticationC allHandler.handleRequest(Servl etAuthenticationCallHandler. java:57) at io.undertow.server.handlers.PredicateHandler.handleRequest(P redicateHandler.java:43) at io.undertow.security.handlers.AuthenticationConstraintHandle r.handleRequest(Authentication ConstraintHandler.java:53) at io.undertow.security.handlers.AbstractConfidentialityHandler .handleRequest(AbstractConfide ntialityHandler.java:46) at io.undertow.servlet.handlers.security.ServletConfidentiality ConstraintHandler. handleRequest(ServletConfident ialityConstraintHandler.java: 64) at io.undertow.servlet.handlers.security.ServletSecurityConstra intHandler.handleRequest(Servl etSecurityConstraintHandler. java:59) at io.undertow.security.handlers.AuthenticationMechanismsHandle r.handleRequest(Authentication MechanismsHandler.java:60) at io.undertow.servlet.handlers.security.CachedAuthenticatedSes sionHandler.handleRequest(Cach edAuthenticatedSessionHandler. java:77) at io.undertow.security.handlers.NotificationReceiverHandler.ha ndleRequest(NotificationReceiv erHandler.java:50) at io.undertow.security.handlers.AbstractSecurityContextAssocia tionHandler.handleRequest(Abst ractSecurityContextAssociation Handler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(P redicateHandler.java:43) at org.wildfly.extension.undertow.security.jacc.JACCContextIdHa ndler.handleRequest(JACCContex tIdHandler.java:61) at io.undertow.server.handlers.PredicateHandler.handleRequest(P redicateHandler.java:43) at io.undertow.server.handlers.PredicateHandler.handleRequest(P redicateHandler.java:43) at io.undertow.servlet.handlers.ServletInitialHandler.handleFir stRequest(ServletInitialHandle r.java:292) at io.undertow.servlet.handlers.ServletInitialHandler.access$10 0(ServletInitialHandler.java: 81) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(Se rvletInitialHandler.java:138) at io.undertow.servlet.handlers.ServletInitialHandler$2.call(Se rvletInitialHandler.java:135) at io.undertow.servlet.core.ServletRequestContextThreadSetupAct ion$1.call(ServletRequestConte xtThreadSetupAction.java:48) at io.undertow.servlet.core.ContextClassLoaderSetupAction$1. call(ContextClassLoaderSetupAc tion.java:43) at org.wildfly.extension.undertow.security.SecurityContextThrea dSetupAction.lambda$create$0(S ecurityContextThreadSetupActio n.java:105) at org.wildfly.extension.undertow.deployment.UndertowDeployment InfoService$UndertowThreadSetu pAction.lambda$create$0(Undert owDeploymentInfoService.java: 1508) at org.wildfly.extension.undertow.deployment.UndertowDeployment InfoService$UndertowThreadSetu pAction.lambda$create$0(Undert owDeploymentInfoService.java: 1508) at org.wildfly.extension.undertow.deployment.UndertowDeployment InfoService$UndertowThreadSetu pAction.lambda$create$0(Undert owDeploymentInfoService.java: 1508) at io.undertow.servlet.handlers.ServletInitialHandler.dispatchR equest(ServletInitialHandler. java:272) at io.undertow.servlet.handlers.ServletInitialHandler.access$00 0(ServletInitialHandler.java: 81) at io.undertow.servlet.handlers.ServletInitialHandler$1.handleR equest(ServletInitialHandler. java:104) at io.undertow.server.Connectors.executeRootHandler(Connectors. java:326) at io.undertow.server.HttpServerExchange$1.run(HttpServerExchan ge.java:812) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPool Executor.java:1149) [rt.jar:1.8.0_171] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo lExecutor.java:624) [rt.jar:1.8.0_171] at java.lang.Thread.run(Thread.java:748) [rt.jar:1.8.0_171] Caused by: org.postgresql.util.PSQLException: ERROR: integer out of range at org.postgresql.core.v3.QueryExecutorImpl.receiveErrorRespons e(QueryExecutorImpl.java:2157) at org.postgresql.core.v3.QueryExecutorImpl.processResults(Quer yExecutorImpl.java:1886) at org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecut orImpl.java:255) at org.postgresql.jdbc2.AbstractJdbc2Statement.execute(Abstract Jdbc2Statement.java:555) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags (AbstractJdbc2Statement.java:4 03) at org.postgresql.jdbc2.AbstractJdbc2Statement.executeQuery(Abs tractJdbc2Statement.java:283) at org.jboss.jca.adapters.jdbc.WrappedStatement.executeQuery(Wr appedStatement.java:397) at org.springframework.jdbc.core.JdbcTemplate$1QueryStatementCa llback.doInStatement( JdbcTemplate.java:458) [spring-jdbc.jar:4.3.9.RELEASE ] at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTempl ate.java:408) [spring-jdbc.jar:4.3.9.RELEASE ] ... 151 more
--Martin Perina
Associate Manager, Software Engineering
Red Hat Czech s.r.o.