Hi, I found some weird repeating errors in my server.log including some SQL Exceptions. here are some excerpts: 2014-03-28 17:12:56,755 ERROR [org.jboss.as.ejb3.tx.CMTTxInterceptor] (pool-6-thread-48) javax.ejb.EJBTransactionRolledbackException: Could not get JDBC Connection; nested exception is java.sql.SQLException: jav ax.resource.ResourceException: IJ000460: Error checking for a transaction 2014-03-28 17:12:56,757 ERROR [org.jboss.ejb3.invocation] (pool-6-thread-48) JBAS014134: EJB Invocation failed on component Backend for method public abstract org.ovirt.engine.core.common.action.VdcReturnValueBa se org.ovirt.engine.core.bll.interfaces.BackendInternal.runInternalAction(org.ovirt.engine.core.common.action.VdcActionType,org.ovirt.engine.core.common.action.VdcActionParametersBase,org.ovirt.engine.core.bll.c ontext.CommandContext): javax.ejb.EJBTransactionRolledbackException: Could not get JDBC Connection; nested exception is java.sql.SQLException: javax.resource.ResourceException: IJ000460: Error checking for a tra nsaction at org.jboss.as.ejb3.tx.CMTTxInterceptor.handleInCallerTx(CMTTxInterceptor.java:139) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final] 2014-03-27 13:55:29,022 WARN [org.jboss.resteasy.core.SynchronousDispatcher] (ajp--127.0.0.1-8702-4) Unknown exception while executing GET : java.lang.IllegalStateException: setAttribute: Session already invali dated at org.apache.catalina.session.StandardSession.setAttribute(StandardSession.java:1289) [jbossweb-7.0.13.Final.jar:] I got ldap/kerberos locally setup on the engine host. this is centos 6.5 the total numbers are way to high I guess: grep "ERROR" /var/log/ovirt-engine/server.log | wc -l 65734 I can provide complete logs if someone can debug this with me. -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen
On 04/25/2014 10:38 AM, Sven Kieske wrote:
Hi,
I found some weird repeating errors in my server.log including some SQL Exceptions.
here are some excerpts:
2014-03-28 17:12:56,755 ERROR [org.jboss.as.ejb3.tx.CMTTxInterceptor] (pool-6-thread-48) javax.ejb.EJBTransactionRolledbackException: Could not get JDBC Connection; nested exception is java.sql.SQLException: jav ax.resource.ResourceException: IJ000460: Error checking for a transaction 2014-03-28 17:12:56,757 ERROR [org.jboss.ejb3.invocation] (pool-6-thread-48) JBAS014134: EJB Invocation failed on component Backend for method public abstract org.ovirt.engine.core.common.action.VdcReturnValueBa se org.ovirt.engine.core.bll.interfaces.BackendInternal.runInternalAction(org.ovirt.engine.core.common.action.VdcActionType,org.ovirt.engine.core.common.action.VdcActionParametersBase,org.ovirt.engine.core.bll.c ontext.CommandContext): javax.ejb.EJBTransactionRolledbackException: Could not get JDBC Connection; nested exception is java.sql.SQLException: javax.resource.ResourceException: IJ000460: Error checking for a tra nsaction at org.jboss.as.ejb3.tx.CMTTxInterceptor.handleInCallerTx(CMTTxInterceptor.java:139) [jboss-as-ejb3-7.1.1.Final.jar:7.1.1.Final]
2014-03-27 13:55:29,022 WARN [org.jboss.resteasy.core.SynchronousDispatcher] (ajp--127.0.0.1-8702-4) Unknown exception while executing GET : java.lang.IllegalStateException: setAttribute: Session already invali dated at org.apache.catalina.session.StandardSession.setAttribute(StandardSession.java:1289) [jbossweb-7.0.13.Final.jar:]
Not sure about the other, but these "session already invalidated" errors and warnings are a bug: https://bugzilla.redhat.com/1091371 If you are using the Python SDK you will get one of these "session already invalidated" messages each time that you call "api.disconnect()".
I got ldap/kerberos locally setup on the engine host. this is centos 6.5
the total numbers are way to high I guess:
grep "ERROR" /var/log/ovirt-engine/server.log | wc -l 65734
I can provide complete logs if someone can debug this with me.
-- Dirección Comercial: C/Jose Bardasano Baos, 9, Edif. Gorbea 3, planta 3ºD, 28016 Madrid, Spain Inscrita en el Reg. Mercantil de Madrid – C.I.F. B82657941 - Red Hat S.L.
Thanks for the reply! Am 25.04.2014 14:49, schrieb Juan Hernandez:
Not sure about the other, but these "session already invalidated" errors and warnings are a bug:
https://bugzilla.redhat.com/1091371
If you are using the Python SDK you will get one of these "session already invalidated" messages each time that you call "api.disconnect()".
I'm using REST, without session handling (stateless). Should I then too, get this warning? Every REST-Action I do should be with a new authentication, so there should be no warning, should it? -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen
On 04/25/2014 03:08 PM, Sven Kieske wrote:
Thanks for the reply!
Am 25.04.2014 14:49, schrieb Juan Hernandez:
Not sure about the other, but these "session already invalidated" errors and warnings are a bug:
https://bugzilla.redhat.com/1091371
If you are using the Python SDK you will get one of these "session already invalidated" messages each time that you call "api.disconnect()".
I'm using REST, without session handling (stateless). Should I then too, get this warning? Every REST-Action I do should be with a new authentication, so there should be no warning, should it?
If you aren't using sessions then this shouldn't happen, unless you are manually accessing the RESTAPI from the same browser where you are using webadmin, in that case these errors will also happen from time to time, but this shouldn't result in thousands of errors in the log. Can you see how many of these you have? # grep 'ERROR.*: Session already invalidated' /var/log/ovirt-engine/server.log | wc -l -- Dirección Comercial: C/Jose Bardasano Baos, 9, Edif. Gorbea 3, planta 3ºD, 28016 Madrid, Spain Inscrita en el Reg. Mercantil de Madrid – C.I.F. B82657941 - Red Hat S.L.
root@server:~ > grep 'ERROR.*: Session already invalidated' /var/log/ovirt-engine/server.log | wc -l 177 root@server:~ > grep "ERROR" /var/log/ovirt-engine/server.log | wc -l 65796 so there are plenty of other errors. I thank you for your answers. I'd like to go through all errors and eliminate them one by one either by fixing my setup/use or by reporting bugs / upgrading. But I'll need some help to interpret what goes wrong where. If someone is willing to commit the time, I can send full logs in private (19 MB atm). Am 25.04.2014 15:23, schrieb Juan Hernandez:
If you aren't using sessions then this shouldn't happen, unless you are manually accessing the RESTAPI from the same browser where you are using webadmin, in that case these errors will also happen from time to time, but this shouldn't result in thousands of errors in the log. Can you see how many of these you have?
# grep 'ERROR.*: Session already invalidated' /var/log/ovirt-engine/server.log | wc -l
-- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen
On 04/25/2014 03:35 PM, Sven Kieske wrote:
root@server:~ > grep 'ERROR.*: Session already invalidated' /var/log/ovirt-engine/server.log | wc -l 177
Will, this is a low number compared to the total of errors. I would assume that is due to tests from the browser. I won't focus on that as we already know the root cause.
root@server:~ > grep "ERROR" /var/log/ovirt-engine/server.log | wc -l 65796
This is more worrying. I would suggest to try to make a summary of the different types of errors, so that we can focus on those that are more frequent.
so there are plenty of other errors.
I thank you for your answers.
I'd like to go through all errors and eliminate them one by one either by fixing my setup/use or by reporting bugs / upgrading.
But I'll need some help to interpret what goes wrong where.
If someone is willing to commit the time, I can send full logs in private (19 MB atm).
Am 25.04.2014 15:23, schrieb Juan Hernandez:
If you aren't using sessions then this shouldn't happen, unless you are manually accessing the RESTAPI from the same browser where you are using webadmin, in that case these errors will also happen from time to time, but this shouldn't result in thousands of errors in the log. Can you see how many of these you have?
# grep 'ERROR.*: Session already invalidated' /var/log/ovirt-engine/server.log | wc -l
-- Dirección Comercial: C/Jose Bardasano Baos, 9, Edif. Gorbea 3, planta 3ºD, 28016 Madrid, Spain Inscrita en el Reg. Mercantil de Madrid – C.I.F. B82657941 - Red Hat S.L.
Am 25.04.2014 15:23, schrieb Juan Hernandez:
If you aren't using sessions then this shouldn't happen, unless you are manually accessing the RESTAPI from the same browser where you are using webadmin, in that case these errors will also happen from time to time
to answer this more precisely: I think there where some tests so it might very well be that these errors are from rest access from same IP than logged in browser session but I can't say that for sure. -- Mit freundlichen Grüßen / Regards Sven Kieske Systemadministrator Mittwald CM Service GmbH & Co. KG Königsberger Straße 6 32339 Espelkamp T: +49-5772-293-100 F: +49-5772-293-333 https://www.mittwald.de Geschäftsführer: Robert Meyer St.Nr.: 331/5721/1033, USt-IdNr.: DE814773217, HRA 6640, AG Bad Oeynhausen Komplementärin: Robert Meyer Verwaltungs GmbH, HRB 13260, AG Bad Oeynhausen
participants (2)
-
Juan Hernandez -
Sven Kieske