uncaught exception with engine vm in 3.6.1 selecting hosted_storage
Hello after updating from 3.6.0 to 3.6.1 my HE environment, I'm not able to import/activate the hosted_storage domain because it results anattached Moreover I get the popup message Uncaught exception occurred. Please try reloading the page. Details: (TypeError) __gwt$exception: <skipped>: c is null when I select the line of hosted_storage domain in storage tab. See: https://drive.google.com/file/d/0BwoPbcrMv8mvVlc1XzNUZ18yWWs/view?usp=sharin... I don't find apparently ERROR messages wen I do this, so I don't know where to watch. On engine, where the db lives, I have under /var/lib/pgsql/data/pg_log [root@ractorshe pg_log]# ls -lrt total 12 -rw-------. 1 postgres postgres 0 Dec 16 01:00 postgresql-Wed.log -rw-------. 1 postgres postgres 0 Dec 17 01:00 postgresql-Thu.log -rw-------. 1 postgres postgres 0 Dec 18 01:00 postgresql-Fri.log -rw-------. 1 postgres postgres 7480 Dec 20 00:39 postgresql-Sat.log -rw-------. 1 postgres postgres 3488 Dec 20 01:29 postgresql-Sun.log -rw-------. 1 postgres postgres 0 Dec 21 01:00 postgresql-Mon.log -rw-------. 1 postgres postgres 0 Dec 22 01:00 postgresql-Tue.log On Sunday logs, when the engine was started I see LOG: database system was not properly shut down; automatic recovery in progress LOG: redo starts at 1/254C6710 LOG: record with zero length at 1/254EB6B8 LOG: redo done at 1/254EB688 LOG: last completed transaction was at log time 2015-12-19 23:49:47.920147+00 LOG: database system is ready to accept connections LOG: autovacuum launcher started ERROR: insert or update on table "storage_domain_dynamic" violates foreign key constraint "fk_stora ge_domain_dynamic_storage_domain_static" DETAIL: Key (id)=(00000000-0000-0000-0000-000000000000) is not present in table "storage_domain_static". CONTEXT: SQL statement "INSERT INTO storage_domain_dynamic(available_disk_size, id, used_disk_size) VALUES(v_available_disk_size, v_id, v_used_disk_size)" PL/pgSQL function insertstorage_domain_dynamic(integer,uuid,integer) line 3 at SQL statement STATEMENT: select * from insertstorage_domain_dynamic($1, $2, $3) as result and then many lines of kind LOG: autovacuum: found orphan temp table "pg_temp_8"."tt_temp22" in database "engine" so messages related to domains and could be the reason of the exception and of the inability of importing/attaching my HE storage domain. Let me know if I can provide more logs or output of queries from the database. Gianluca
On Tue, Dec 22, 2015 at 10:32 AM, Gianluca Cecchi <gianluca.cecchi@gmail.com
wrote:
Hello after updating from 3.6.0 to 3.6.1 my HE environment, I'm not able to import/activate the hosted_storage domain because it results anattached
Thanks for your report Gianluca, adding Roy here.
Moreover I get the popup message
Uncaught exception occurred. Please try reloading the page. Details: (TypeError) __gwt$exception: <skipped>: c is null
when I select the line of hosted_storage domain in storage tab. See:
https://drive.google.com/file/d/0BwoPbcrMv8mvVlc1XzNUZ18yWWs/view?usp=sharin...
I don't find apparently ERROR messages wen I do this, so I don't know where to watch.
On engine, where the db lives, I have under /var/lib/pgsql/data/pg_log
[root@ractorshe pg_log]# ls -lrt total 12 -rw-------. 1 postgres postgres 0 Dec 16 01:00 postgresql-Wed.log -rw-------. 1 postgres postgres 0 Dec 17 01:00 postgresql-Thu.log -rw-------. 1 postgres postgres 0 Dec 18 01:00 postgresql-Fri.log -rw-------. 1 postgres postgres 7480 Dec 20 00:39 postgresql-Sat.log -rw-------. 1 postgres postgres 3488 Dec 20 01:29 postgresql-Sun.log -rw-------. 1 postgres postgres 0 Dec 21 01:00 postgresql-Mon.log -rw-------. 1 postgres postgres 0 Dec 22 01:00 postgresql-Tue.log
On Sunday logs, when the engine was started I see
LOG: database system was not properly shut down; automatic recovery in progress LOG: redo starts at 1/254C6710 LOG: record with zero length at 1/254EB6B8 LOG: redo done at 1/254EB688 LOG: last completed transaction was at log time 2015-12-19 23:49:47.920147+00 LOG: database system is ready to accept connections LOG: autovacuum launcher started ERROR: insert or update on table "storage_domain_dynamic" violates foreign key constraint "fk_stora ge_domain_dynamic_storage_domain_static" DETAIL: Key (id)=(00000000-0000-0000-0000-000000000000) is not present in table "storage_domain_static". CONTEXT: SQL statement "INSERT INTO storage_domain_dynamic(available_disk_size, id, used_disk_size) VALUES(v_available_disk_size, v_id, v_used_disk_size)" PL/pgSQL function insertstorage_domain_dynamic(integer,uuid,integer) line 3 at SQL statement STATEMENT: select * from insertstorage_domain_dynamic($1, $2, $3) as result
and then many lines of kind
LOG: autovacuum: found orphan temp table "pg_temp_8"."tt_temp22" in database "engine"
so messages related to domains and could be the reason of the exception and of the inability of importing/attaching my HE storage domain.
Let me know if I can provide more logs or output of queries from the database.
Gianluca
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
On Tuesday, December 22, 2015 10:32:22 AM Gianluca Cecchi wrote:
Hello after updating from 3.6.0 to 3.6.1 my HE environment, I'm not able to import/activate the hosted_storage domain because it results anattached Moreover I get the popup message
Uncaught exception occurred. Please try reloading the page. Details: (TypeError) __gwt$exception: <skipped>: c is null
Hi, this is a browser side exception so you won't find anything about it in the logs on the server. However all is not lost. If you hover your mouse over the popup it should show you a tooltip with the entire stack trace (alternatively you can open up the browsers development tools (usually ctrl-shift-i) and look at the console, the stack trace will be there too). The stack trace will most likely look completely useless as well since all the Javascript is obfuscated. However if you install the following package: ovirt-engine-webadmin-portal-debuginfo That will contain a symbolMap file. This file has a mapping from the obfuscated symbols to the original code. Once you have the mapping file you can use the obfuscated string in the stack trace to look up the original code. That will help us determine exactly where the problem is. I am guessing something went wrong on the backend causing the unattached storage domain, which resulted in some unexpected state on the frontend that caused the null pointer exception. If you can provide us with the obfuscated stack trace, we can point to you what to look for in the mapping file.
when I select the line of hosted_storage domain in storage tab. See: https://drive.google.com/file/d/0BwoPbcrMv8mvVlc1XzNUZ18yWWs/view?usp=sharin g
I don't find apparently ERROR messages wen I do this, so I don't know where to watch.
On engine, where the db lives, I have under /var/lib/pgsql/data/pg_log
[root@ractorshe pg_log]# ls -lrt total 12 -rw-------. 1 postgres postgres 0 Dec 16 01:00 postgresql-Wed.log -rw-------. 1 postgres postgres 0 Dec 17 01:00 postgresql-Thu.log -rw-------. 1 postgres postgres 0 Dec 18 01:00 postgresql-Fri.log -rw-------. 1 postgres postgres 7480 Dec 20 00:39 postgresql-Sat.log -rw-------. 1 postgres postgres 3488 Dec 20 01:29 postgresql-Sun.log -rw-------. 1 postgres postgres 0 Dec 21 01:00 postgresql-Mon.log -rw-------. 1 postgres postgres 0 Dec 22 01:00 postgresql-Tue.log
On Sunday logs, when the engine was started I see
LOG: database system was not properly shut down; automatic recovery in progress LOG: redo starts at 1/254C6710 LOG: record with zero length at 1/254EB6B8 LOG: redo done at 1/254EB688 LOG: last completed transaction was at log time 2015-12-19 23:49:47.920147+00 LOG: database system is ready to accept connections LOG: autovacuum launcher started ERROR: insert or update on table "storage_domain_dynamic" violates foreign key constraint "fk_stora ge_domain_dynamic_storage_domain_static" DETAIL: Key (id)=(00000000-0000-0000-0000-000000000000) is not present in table "storage_domain_static". CONTEXT: SQL statement "INSERT INTO storage_domain_dynamic(available_disk_size, id, used_disk_size) VALUES(v_available_disk_size, v_id, v_used_disk_size)" PL/pgSQL function insertstorage_domain_dynamic(integer,uuid,integer) line 3 at SQL statement STATEMENT: select * from insertstorage_domain_dynamic($1, $2, $3) as result
and then many lines of kind
LOG: autovacuum: found orphan temp table "pg_temp_8"."tt_temp22" in database "engine"
so messages related to domains and could be the reason of the exception and of the inability of importing/attaching my HE storage domain.
Let me know if I can provide more logs or output of queries from the database.
Gianluca
On Tue, Dec 22, 2015 at 2:54 PM, Alexander Wels <awels@redhat.com> wrote:
If you can provide us with the obfuscated stack trace, we can point to you what to look for in the mapping file.
Hello, I'm going to try. In the mean time, do you think it could be related somehow with what below? After engine upgrade to 3.6.1 from 3.6.0 I updated via yum the package ovirt-engine-extension-aaa-jdbc, without running its own update phase (in practice another engine-setup as I only have internal profile) And this caused problems with the internal profile. See also https://bugzilla.redhat.com/show_bug.cgi?id=1293338 So I reverted the package to its previous version. I'm now testing upgrade internal profile passing from ---> Package ovirt-engine-extension-aaa-jdbc.noarch 0:1.0.1-1.el7 will be updated to ---> Package ovirt-engine-extension-aaa-jdbc.noarch 0:1.0.4-1.el7 will be an update and following /usr/share/doc/ovirt-engine-extension-aaa-jdbc-1.0.4/README.admin So I put env in global maintenance, stopped engine and then run engine-setup But it seems it remains stuck at ... Please confirm installation settings (OK, Cancel) [OK]: [ INFO ] Cleaning async tasks and compensations The following system tasks have been found running in the system: The following commands have been found running in the system: The following compensations have been found running in the system: org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainStatic org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainDynamic org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainDynamic Would you like to try to wait for that? (Answering "no" will stop the upgrade (Yes, No) Yes Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. With "Ctrl+C" I interrupt engine-setup: ^C[ ERROR ] Failed to execute stage 'Setup validation': SIG2 [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20151222145043-phm0eh.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20151222145643-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed If I see the log and compare with the output and execute the query indicated inside the log I can effectively see inside the database: engine=# select command_type, entity_type engine-# from business_entity_snapshot engine-# ; command_type | entity_type -----------------------------------------------------------------------+---------------------------- ---------------------------------------- org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainStatic org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainDynamic org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainDynamic (3 rows) Can this in some way influence the exception I'm getting? O that perhaps it is better to first solve this problem? Let me know. I can downgrade again the ovirt-engine-extension-aaa-jdbc package and try your suggestions instead and let see after the problem with the extension. Gianluca
In the mean time as I can go ahead ad back with ovirt-engine-extension-aaa-jdbc package downgrade and upgrade, see these screenshots taken with firefox console and also firebug extension (after installing debuginfo package and restarting ovirt-engine service). But I don't know correct way to get the stack trace.... sot guide me because I don't understand what are the obfuscated symbols expected to be.... https://drive.google.com/file/d/0BwoPbcrMv8mvTkNGWTNyT0RjYVU/view?usp=sharin... https://drive.google.com/file/d/0BwoPbcrMv8mvQXpUekdXYnZtOUk/view?usp=sharin... https://drive.google.com/file/d/0BwoPbcrMv8mvVE1GOFhla1VJSlk/view?usp=sharin... https://drive.google.com/file/d/0BwoPbcrMv8mvclA3dmdMaG5QMjg/view?usp=sharin... Gianluca
On Tuesday, December 22, 2015 03:17:40 PM Gianluca Cecchi wrote:
On Tue, Dec 22, 2015 at 2:54 PM, Alexander Wels <awels@redhat.com> wrote:
If you can provide us with the obfuscated stack trace, we can point to you what to look for in the mapping file.
Hello, I'm going to try. In the mean time, do you think it could be related somehow with what below?
I don't think so, I think something went wrong on the backend which caused some empty object or null object to be returned, which caused the UI to blow up. Using the stack trace we can figure out what part of the UI blew up and maybe from that figure out what went wrong on the backend.
After engine upgrade to 3.6.1 from 3.6.0 I updated via yum the package ovirt-engine-extension-aaa-jdbc, without running its own update phase (in practice another engine-setup as I only have internal profile) And this caused problems with the internal profile. See also https://bugzilla.redhat.com/show_bug.cgi?id=1293338
So I reverted the package to its previous version. I'm now testing upgrade internal profile passing from ---> Package ovirt-engine-extension-aaa-jdbc.noarch 0:1.0.1-1.el7 will be updated
to ---> Package ovirt-engine-extension-aaa-jdbc.noarch 0:1.0.4-1.el7 will be an update
and following /usr/share/doc/ovirt-engine-extension-aaa-jdbc-1.0.4/README.admin
So I put env in global maintenance, stopped engine and then run engine-setup
But it seems it remains stuck at ... Please confirm installation settings (OK, Cancel) [OK]: [ INFO ] Cleaning async tasks and compensations The following system tasks have been found running in the system: The following commands have been found running in the system: The following compensations have been found running in the system:
org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainStatic
org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainDynamic
org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainDynamic Would you like to try to wait for that? (Answering "no" will stop the upgrade (Yes, No) Yes Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt.
With "Ctrl+C" I interrupt engine-setup: ^C[ ERROR ] Failed to execute stage 'Setup validation': SIG2 [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20151222145043-phm0eh.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20151222145643-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed
If I see the log and compare with the output and execute the query indicated inside the log I can effectively see inside the database: engine=# select command_type, entity_type engine-# from business_entity_snapshot engine-# ; command_type |
entity_type -----------------------------------------------------------------------+---- ------------------------ ---------------------------------------- org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainStatic org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainDynamic org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainDynamic (3 rows)
Can this in some way influence the exception I'm getting? O that perhaps it is better to first solve this problem?
Let me know. I can downgrade again the ovirt-engine-extension-aaa-jdbc package and try your suggestions instead and let see after the problem with the extension.
Gianluca
On Tue, Dec 22, 2015 at 8:23 PM, Alexander Wels <awels@redhat.com> wrote:
On Tuesday, December 22, 2015 03:17:40 PM Gianluca Cecchi wrote:
On Tue, Dec 22, 2015 at 2:54 PM, Alexander Wels <awels@redhat.com> wrote:
If you can provide us with the obfuscated stack trace, we can point to you what to look for in the mapping file.
Hello, I'm going to try. In the mean time, do you think it could be related somehow with what below?
I don't think so, I think something went wrong on the backend which caused some empty object or null object to be returned, which caused the UI to blow up. Using the stack trace we can figure out what part of the UI blew up and maybe from that figure out what went wrong on the backend.
It happens also here: Tue Dec 22 23:25:46 GMT+100 2015 SEVERE: Uncaught exception: com.google.gwt.core.client.JavaScriptException: (TypeError) __gwt$exception: <skipped>: Cannot read property 'k' of null at Unknown.twq( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.lNn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.oNn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.fRn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.iRn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.NPn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.QPn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.cIe( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.nwk( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.L3( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.c4( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.<anonymous>( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown._t( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.du( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.<anonymous>( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... )
After engine upgrade to 3.6.1 from 3.6.0 I updated via yum the package ovirt-engine-extension-aaa-jdbc, without running its own update phase (in practice another engine-setup as I only have internal profile) And this caused problems with the internal profile. See also https://bugzilla.redhat.com/show_bug.cgi?id=1293338
So I reverted the package to its previous version. I'm now testing upgrade internal profile passing from ---> Package ovirt-engine-extension-aaa-jdbc.noarch 0:1.0.1-1.el7 will be updated
to ---> Package ovirt-engine-extension-aaa-jdbc.noarch 0:1.0.4-1.el7 will be an update
and following /usr/share/doc/ovirt-engine-extension-aaa-jdbc-1.0.4/README.admin
So I put env in global maintenance, stopped engine and then run engine-setup
But it seems it remains stuck at ... Please confirm installation settings (OK, Cancel) [OK]: [ INFO ] Cleaning async tasks and compensations The following system tasks have been found running in the system: The following commands have been found running in the system: The following compensations have been found running in the system:
org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainStatic
org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainDynamic
org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainDynamic Would you like to try to wait for that? (Answering "no" will stop the upgrade (Yes, No) Yes Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt.
With "Ctrl+C" I interrupt engine-setup: ^C[ ERROR ] Failed to execute stage 'Setup validation': SIG2 [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20151222145043-phm0eh.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20151222145643-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed
If I see the log and compare with the output and execute the query indicated inside the log I can effectively see inside the database: engine=# select command_type, entity_type engine-# from business_entity_snapshot engine-# ; command_type |
entity_type
-----------------------------------------------------------------------+----
------------------------ ---------------------------------------- org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainStatic org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainDynamic org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainDynamic (3 rows)
Can this in some way influence the exception I'm getting? O that perhaps it is better to first solve this problem?
Let me know. I can downgrade again the ovirt-engine-extension-aaa-jdbc package and try your suggestions instead and let see after the problem with the extension.
Gianluca
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Simon/Gianluca[/all], Many thanks for reporting the issues that you have encountered. In order to better track them, please file a BZ for each scenario in which you encounter such an alert in the UI. For each such BZ, please include: - Exact oVirt version in which the alert has appeared. - Steps to reproduce (that lead to the displayed alert). - The full exception stack-trace from the client side (javascript) log [like the one that Simone has provided in his last response [1] / like the one that appears in the screen-shot provided by Gianluca [2]] - please provide the actual text though, rather than a screen-shot of the text, as it will ease the problem- tracing process for us. - If relevant: server side engine.log. ---- Regards, Einav [1] ... Tue Dec 22 23:25:46 GMT+100 2015 SEVERE: Uncaught exception: com.google.gwt.core.client.JavaScriptException: (TypeError) __gwt$exception: <skipped>: Cannot read property 'k' of null at Unknown.twq(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) at Unknown.lNn(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) at Unknown.oNn(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) at Unknown.fRn(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) at Unknown.iRn(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) at Unknown.NPn(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) at Unknown.QPn(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) at Unknown.cIe(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) at Unknown.nwk(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) at Unknown.L3(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) at Unknown.c4(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) at Unknown.<anonymous>(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) at Unknown._t(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) at Unknown.du(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) at Unknown.<anonymous>(https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...) ... [2] https://drive.google.com/file/d/0BwoPbcrMv8mvclA3dmdMaG5QMjg/view?usp=sharin... ----- Original Message -----
From: "Simone Tiraboschi" <stirabos@redhat.com> To: "Alexander Wels" <awels@redhat.com> Cc: "users" <users@ovirt.org> Sent: Tuesday, December 22, 2015 5:27:31 PM Subject: Re: [ovirt-users] uncaught exception with engine vm in 3.6.1 selecting hosted_storage
On Tue, Dec 22, 2015 at 8:23 PM, Alexander Wels < awels@redhat.com > wrote:
On Tuesday, December 22, 2015 03:17:40 PM Gianluca Cecchi wrote:
On Tue, Dec 22, 2015 at 2:54 PM, Alexander Wels < awels@redhat.com > wrote:
If you can provide us with the obfuscated stack trace, we can point to you what to look for in the mapping file.
Hello, I'm going to try. In the mean time, do you think it could be related somehow with what below?
I don't think so, I think something went wrong on the backend which caused some empty object or null object to be returned, which caused the UI to blow up. Using the stack trace we can figure out what part of the UI blew up and maybe from that figure out what went wrong on the backend.
It happens also here:
Tue Dec 22 23:25:46 GMT+100 2015 SEVERE: Uncaught exception: com.google.gwt.core.client.JavaScriptException: (TypeError) __gwt$exception: <skipped>: Cannot read property 'k' of null at Unknown.twq( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.lNn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.oNn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.fRn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.iRn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.NPn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.QPn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.cIe( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.nwk( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.L3( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.c4( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.<anonymous>( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown._t( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.du( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.<anonymous>( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... )
After engine upgrade to 3.6.1 from 3.6.0 I updated via yum the package ovirt-engine-extension-aaa-jdbc, without running its own update phase (in practice another engine-setup as I only have internal profile) And this caused problems with the internal profile. See also https://bugzilla.redhat.com/show_bug.cgi?id=1293338
So I reverted the package to its previous version. I'm now testing upgrade internal profile passing from ---> Package ovirt-engine-extension-aaa-jdbc.noarch 0:1.0.1-1.el7 will be updated
to ---> Package ovirt-engine-extension-aaa-jdbc.noarch 0:1.0.4-1.el7 will be an update
and following /usr/share/doc/ovirt-engine-extension-aaa-jdbc-1.0.4/README.admin
So I put env in global maintenance, stopped engine and then run engine-setup
But it seems it remains stuck at ... Please confirm installation settings (OK, Cancel) [OK]: [ INFO ] Cleaning async tasks and compensations The following system tasks have been found running in the system: The following commands have been found running in the system: The following compensations have been found running in the system:
org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainStatic
org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainDynamic
org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainDynamic Would you like to try to wait for that? (Answering "no" will stop the upgrade (Yes, No) Yes Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt.
With "Ctrl+C" I interrupt engine-setup: ^C[ ERROR ] Failed to execute stage 'Setup validation': SIG2 [ INFO ] Stage: Clean up Log file is located at /var/log/ovirt-engine/setup/ovirt-engine-setup-20151222145043-phm0eh.log [ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20151222145643-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed
If I see the log and compare with the output and execute the query indicated inside the log I can effectively see inside the database: engine=# select command_type, entity_type engine-# from business_entity_snapshot engine-# ; command_type |
entity_type -----------------------------------------------------------------------+---- ------------------------ ---------------------------------------- org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainStatic org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainDynamic org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainDynamic (3 rows)
Can this in some way influence the exception I'm getting? O that perhaps it is better to first solve this problem?
Let me know. I can downgrade again the ovirt-engine-extension-aaa-jdbc package and try your suggestions instead and let see after the problem with the extension.
Gianluca
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
On Wed, Dec 23, 2015 at 5:13 AM, Einav Cohen <ecohen@redhat.com> wrote:
Hi Simon/Gianluca[/all],
Many thanks for reporting the issues that you have encountered.
In order to better track them, please file a BZ for each scenario in which you encounter such an alert in the UI.
Thanks, done: https://bugzilla.redhat.com/show_bug.cgi?id=1293853
For each such BZ, please include:
- Exact oVirt version in which the alert has appeared.
- Steps to reproduce (that lead to the displayed alert).
- The full exception stack-trace from the client side (javascript) log [like the one that Simone has provided in his last response [1] / like the one that appears in the screen-shot provided by Gianluca [2]] - please provide the actual text though, rather than a screen-shot of the text, as it will ease the problem- tracing process for us.
- If relevant: server side engine.log.
---- Regards, Einav
[1] ... Tue Dec 22 23:25:46 GMT+100 2015 SEVERE: Uncaught exception: com.google.gwt.core.client.JavaScriptException: (TypeError) __gwt$exception: <skipped>: Cannot read property 'k' of null at Unknown.twq( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.lNn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.oNn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.fRn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.iRn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.NPn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.QPn( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.cIe( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.nwk( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.L3( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.c4( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.<anonymous>( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown._t( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.du( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) at Unknown.<anonymous>( https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... ) ...
[2] https://drive.google.com/file/d/0BwoPbcrMv8mvclA3dmdMaG5QMjg/view?usp=sharin...
----- Original Message -----
From: "Simone Tiraboschi" <stirabos@redhat.com> To: "Alexander Wels" <awels@redhat.com> Cc: "users" <users@ovirt.org> Sent: Tuesday, December 22, 2015 5:27:31 PM Subject: Re: [ovirt-users] uncaught exception with engine vm in 3.6.1 selecting hosted_storage
On Tue, Dec 22, 2015 at 8:23 PM, Alexander Wels < awels@redhat.com > wrote:
On Tuesday, December 22, 2015 03:17:40 PM Gianluca Cecchi wrote:
On Tue, Dec 22, 2015 at 2:54 PM, Alexander Wels < awels@redhat.com > wrote:
If you can provide us with the obfuscated stack trace, we can point to you what to look for in the mapping file.
Hello, I'm going to try. In the mean time, do you think it could be related somehow with what below?
I don't think so, I think something went wrong on the backend which caused some empty object or null object to be returned, which caused the UI to blow up. Using the stack trace we can figure out what part of the UI blew up and maybe from that figure out what went wrong on the backend.
It happens also here:
Tue Dec 22 23:25:46 GMT+100 2015 SEVERE: Uncaught exception: com.google.gwt.core.client.JavaScriptException: (TypeError) __gwt$exception: <skipped>: Cannot read property 'k' of null at Unknown.twq(
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...
) at Unknown.lNn(
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...
) at Unknown.oNn(
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...
) at Unknown.fRn(
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...
) at Unknown.iRn(
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...
) at Unknown.NPn(
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...
) at Unknown.QPn(
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...
) at Unknown.cIe(
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...
) at Unknown.nwk(
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...
) at Unknown.L3(
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...
) at Unknown.c4(
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...
) at Unknown.<anonymous>(
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...
) at Unknown._t(
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...
) at Unknown.du(
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846...
) at Unknown.<anonymous>(
)
After engine upgrade to 3.6.1 from 3.6.0 I updated via yum the package ovirt-engine-extension-aaa-jdbc, without running its own update phase (in practice another engine-setup as I only have internal profile) And this caused problems with the internal profile. See also https://bugzilla.redhat.com/show_bug.cgi?id=1293338
So I reverted the package to its previous version. I'm now testing upgrade internal profile passing from ---> Package ovirt-engine-extension-aaa-jdbc.noarch 0:1.0.1-1.el7 will be updated
to ---> Package ovirt-engine-extension-aaa-jdbc.noarch 0:1.0.4-1.el7 will be an update
and following /usr/share/doc/ovirt-engine-extension-aaa-jdbc-1.0.4/README.admin
So I put env in global maintenance, stopped engine and then run engine-setup
But it seems it remains stuck at ... Please confirm installation settings (OK, Cancel) [OK]: [ INFO ] Cleaning async tasks and compensations The following system tasks have been found running in the system: The following commands have been found running in the system: The following compensations have been found running in the system:
org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainStatic
org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainDynamic
org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand org.ovirt.engine.core.common.businessentities.StorageDomainDynamic Would you like to try to wait for that? (Answering "no" will stop the upgrade (Yes, No) Yes Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt. Waiting for the completion of 3 running tasks during the next 20 seconds. Press Ctrl+C to interrupt.
With "Ctrl+C" I interrupt engine-setup: ^C[ ERROR ] Failed to execute stage 'Setup validation': SIG2 [ INFO ] Stage: Clean up Log file is located at
/var/log/ovirt-engine/setup/ovirt-engine-setup-20151222145043-phm0eh.log
[ INFO ] Generating answer file '/var/lib/ovirt-engine/setup/answers/20151222145643-setup.conf' [ INFO ] Stage: Pre-termination [ INFO ] Stage: Termination [ ERROR ] Execution of setup failed
If I see the log and compare with the output and execute the query indicated inside the log I can effectively see inside the database: engine=# select command_type, entity_type engine-# from business_entity_snapshot engine-# ; command_type |
entity_type
-----------------------------------------------------------------------+----
------------------------ ---------------------------------------- org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainStatic org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainDynamic org.ovirt.engine.core.bll.storage.AddExistingFileStorageDomainCommand | org.ovirt.engine.core.commo n.businessentities.StorageDomainDynamic (3 rows)
Can this in some way influence the exception I'm getting? O that
https://192.168.1.207/ovirt-engine/webadmin/407923C7C0980987EE42F541B756E846... perhaps it
is better to first solve this problem?
Let me know. I can downgrade again the ovirt-engine-extension-aaa-jdbc package and try your suggestions instead and let see after the problem with the extension.
Gianluca
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
participants (4)
-
Alexander Wels -
Einav Cohen -
Gianluca Cecchi -
Simone Tiraboschi