Re: [ovirt-users] dwh not receiving any data

Also is there a chance the vm was shutdown? On 02/03/2015 01:29 PM, Yaniv Dary wrote: > The logs seem ok, is there a chance you simply don't have activity after > 17:00? > try to hover around the bottom of the graph a tool tip should appear if > the value and if it's 0%. > > > On 02/03/2015 08:31 AM, Punit Dambiwal wrote: > >> Hi Shirly, >> >> Please find the attached log files... >> >> On Tue, Feb 3, 2015 at 1:56 PM, Shirly Radco <sradco(a)redhat.com <mailto: >> sradco(a)redhat.com&gt;&gt; wrote: >> >> Hi Punit, >> >> Please send me first the logs so we can see if this is still the >> same issue. >> /var/log/ovirt-engine >> /var/log/ovirt-engine-dwh >> /var/log/ovirt-engine-reports >> >> Best regards, >> --- >> Shirly Radco >> BI Software Engineer >> Red Hat Israel Ltd. >> >> >> ----- Original Message ----- >> > From: "Punit Dambiwal" <hypunit(a)gmail.com >> <mailto:hypunit@gmail.com>> >> > To: "Shirly Radco" <sradco(a)redhat.com <mailto:sradco@redhat.com>> >> > Cc: "David van zeebroeck" <david(a)analytics.brusselsairport.be >> <mailto:david@analytics.brusselsairport.be>>, "Joop" >> <jvdwege(a)xs4all.nl <mailto:jvdwege@xs4all.nl>>, users(a)ovirt.org >> <mailto:users@ovirt.org> >> > Sent: Tuesday, February 3, 2015 5:50:57 AM >> > Subject: Re: [ovirt-users] dwh not receiving any data >> > >> > Hi Shirly, >> > >> > It seems resolved but actually not....again after 12 hours it >> stopped >> > working... >> > >> > [image: Inline image 1] >> > [image: Inline image 3] >> > >> > It stopped working after 5:00 AM....yesterday (2nd Feb) started >> at evening >> > 17:00 PM...and stopped today 3rd Feb 5:00 AM.... >> > >> > [image: Inline image 4] >> > >> > Please let me know how i can take the dump of engine and dwh to >> you.... >> > >> > Thanks, >> > Punit >> > >> > On Tue, Feb 3, 2015 at 9:34 AM, Punit Dambiwal >> <hypunit(a)gmail.com <mailto:hypunit@gmail.com>> wrote: >> > >> > > Hi, >> > > >> > > My issue resolved by remove the dwh and reports and reinstall >> > > again......also i found that my server time was correct and >> updated but the >> > > postgresql time was different form the server time.....above >> two changes >> > > made it work... >> > > >> > > Thanks, >> > > punit >> > > >> > > On Mon, Feb 2, 2015 at 8:25 PM, Shirly Radco >> <sradco(a)redhat.com <mailto:sradco@redhat.com>> wrote: >> > > >> > >> Hi, >> > >> >> > >> If any of you can send me the engine and ovirt_engine_dwh dump, >> > >> I will upload them in my development environment and see what >> is the >> > >> issue. >> > >> >> > >> Best regards, >> > >> --- >> > >> Shirly Radco >> > >> BI Software Engineer >> > >> Red Hat Israel Ltd. >> > >> >> > >> >> > >> ----- Original Message ----- >> > >> > From: "Shirly Radco" <sradco(a)redhat.com >> <mailto:sradco@redhat.com>> >> > >> > To: "David van zeebroeck" >> <david(a)analytics.brusselsairport.be >> <mailto:david@analytics.brusselsairport.be>> >> > >> > Cc: users(a)ovirt.org <mailto:users@ovirt.org> >> > >> > Sent: Monday, February 2, 2015 1:04:24 PM >> > >> > Subject: Re: [ovirt-users] dwh not receiving any data >> > >> > >> > >> > Hi David, >> > >> > >> > >> > Please update me on what you found. >> > >> > >> > >> > Best regards, >> > >> > --- >> > >> > Shirly Radco >> > >> > BI Software Engineer >> > >> > Red Hat Israel Ltd. >> > >> > >> > >> > >> > >> > ----- Original Message ----- >> > >> > > From: "Shirly Radco" <sradco(a)redhat.com >> <mailto:sradco@redhat.com>> >> > >> > > To: "David van zeebroeck" >> <david(a)analytics.brusselsairport.be >> <mailto:david@analytics.brusselsairport.be>> >> > >> > > Cc: users(a)ovirt.org <mailto:users@ovirt.org> >> > >> > > Sent: Sunday, February 1, 2015 11:24:10 AM >> > >> > > Subject: Re: [ovirt-users] dwh not receiving any data >> > >> > > >> > >> > > Hi David, >> > >> > > >> > >> > > It means that for some reason user with user_id >> > >> > > ab932902-cead-4435-a2b6-8b88576feab6 >> > >> > > was not added to users_details_history. >> > >> > > And this is why the etl can't update the >> vm_samples_history table on >> > >> the >> > >> > > ovirt_engine_history database. >> > >> > > >> > >> > > Please check if this user_id >> ab932902-cead-4435-a2b6-8b88576feab6 >> > >> exists in >> > >> > > the "dwh_users_history_view" or in the users table in the >> engine >> > >> database. >> > >> > > >> > >> > > Select * From dwh_users_history_view >> > >> > > Where user_id = 'ab932902-cead-4435-a2b6-8b88576feab6'; >> > >> > > >> > >> > > Best regards, >> > >> > > --- >> > >> > > Shirly Radco >> > >> > > BI Software Engineer >> > >> > > Red Hat Israel Ltd. >> > >> > > >> > >> > > >> > >> > > ----- Original Message ----- >> > >> > > > From: "David van zeebroeck" >> <david(a)analytics.brusselsairport.be >> <mailto:david@analytics.brusselsairport.be>> >> > >> > > > To: users(a)ovirt.org <mailto:users@ovirt.org> >> > >> > > > Sent: Thursday, January 29, 2015 5:10:01 PM >> > >> > > > Subject: [ovirt-users] dwh not receiving any data >> > >> > > > >> > >> > > > hi >> > >> > > > we are running ovirt 3.5.1 and we are trying to setup >> the dwh part >> > >> > > > install and setup appears to run fine but when starting >> the service >> > >> we >> > >> > > > see >> > >> > > > following error in the log file : >> > >> > > > >> > >> > > > 2015-01-29 16:06:26|ETL Service Started >> > >> > > > Exception in component tJDBCOutput_5 >> > >> > > > org.postgresql.util.PSQLException: ERROR: insert or >> update on table >> > >> > > > "vm_samples_history" violates foreign key constraint >> > >> > > > "vm_samples_history_current_user_id_fkey" >> > >> > > > Detail: Key >> > >> (current_user_id)=(ab932902-cead-4435-a2b6-8b88576feab6) is >> > >> > > > not >> > >> > > > present in table "users_details_history". >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse( >> QueryExecutorImpl.java:2062) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.core.v3.QueryExecutorImpl.processResults( >> QueryExecutorImpl.java:1795) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.core.v3.QueryExecutorImpl.execute( >> QueryExecutorImpl.java:257) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.jdbc2.AbstractJdbc2Statement.execute( >> AbstractJdbc2Statement.java:479) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags( >> AbstractJdbc2Statement.java:367) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate( >> AbstractJdbc2Statement.java:321) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_ >> 10Process(StatisticsSync.java:10482) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$6.run( >> StatisticsSync.java:17437) >> > >> > > > Exception in component tJDBCOutput_6 >> > >> > > > org.postgresql.util.PSQLException: ERROR: current >> transaction is >> > >> aborted, >> > >> > > > commands ignored until end of transaction block >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse( >> QueryExecutorImpl.java:2062) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.core.v3.QueryExecutorImpl.processResults( >> QueryExecutorImpl.java:1795) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.core.v3.QueryExecutorImpl.execute( >> QueryExecutorImpl.java:257) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.jdbc2.AbstractJdbc2Statement.execute( >> AbstractJdbc2Statement.java:479) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags( >> AbstractJdbc2Statement.java:367) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate( >> AbstractJdbc2Statement.java:321) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_ >> 12Process(StatisticsSync.java:12689) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$7.run( >> StatisticsSync.java:17483) >> > >> > > > Exception in component tJDBCOutput_7 >> > >> > > > org.postgresql.util.PSQLException: ERROR: current >> transaction is >> > >> aborted, >> > >> > > > commands ignored until end of transaction block >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse( >> QueryExecutorImpl.java:2062) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.core.v3.QueryExecutorImpl.processResults( >> QueryExecutorImpl.java:1795) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.core.v3.QueryExecutorImpl.execute( >> QueryExecutorImpl.java:257) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.jdbc2.AbstractJdbc2Statement.execute( >> AbstractJdbc2Statement.java:479) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags( >> AbstractJdbc2Statement.java:367) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate( >> AbstractJdbc2Statement.java:321) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_ >> 18Process(StatisticsSync.java:14806) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$8.run( >> StatisticsSync.java:17529) >> > >> > > > Exception in component tJDBCOutput_4 >> > >> > > > org.postgresql.util.PSQLException: ERROR: current >> transaction is >> > >> aborted, >> > >> > > > commands ignored until end of transaction block >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse( >> QueryExecutorImpl.java:2062) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.core.v3.QueryExecutorImpl.processResults( >> QueryExecutorImpl.java:1795) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.core.v3.QueryExecutorImpl.execute( >> QueryExecutorImpl.java:257) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.jdbc2.AbstractJdbc2Statement.execute( >> AbstractJdbc2Statement.java:479) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags( >> AbstractJdbc2Statement.java:367) >> > >> > > > at >> > >> > > > >> > >> >> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate( >> AbstractJdbc2Statement.java:321) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_ >> 8Process(StatisticsSync.java:7788) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$5.run( >> StatisticsSync.java:17391) >> > >> > > > 2015-01-29 >> > >> > > > >> > >> >> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH| >> StatisticsSync|Default|6|Java >> > >> > > > >> Exception|tJDBCOutput_7|org.postgresql.util.PSQLException:ERROR: >> > >> current >> > >> > > > transaction is aborted, commands ignored until end of >> transaction >> > >> block|1 >> > >> > > > 2015-01-29 >> > >> > > > >> > >> >> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH| >> StatisticsSync|Default|6|Java >> > >> > > > >> Exception|tJDBCOutput_5|org.postgresql.util.PSQLException:ERROR: >> > >> insert >> > >> > > > or >> > >> > > > update on table "vm_samples_history" violates foreign >> key constraint >> > >> > > > "vm_samples_history_current_user_id_fkey" >> > >> > > > Detail: Key >> > >> (current_user_id)=(ab932902-cead-4435-a2b6-8b88576feab6) is >> > >> > > > not >> > >> > > > present in table "users_details_history".|1 >> > >> > > > 2015-01-29 >> > >> > > > >> > >> >> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH| >> StatisticsSync|Default|6|Java >> > >> > > > >> Exception|tJDBCOutput_6|org.postgresql.util.PSQLException:ERROR: >> > >> current >> > >> > > > transaction is aborted, commands ignored until end of >> transaction >> > >> block|1 >> > >> > > > 2015-01-29 >> > >> > > > >> > >> >> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH| >> StatisticsSync|Default|6|Java >> > >> > > > >> Exception|tJDBCOutput_4|org.postgresql.util.PSQLException:ERROR: >> > >> current >> > >> > > > transaction is aborted, commands ignored until end of >> transaction >> > >> block|1 >> > >> > > > Exception in component tRunJob_5 >> > >> > > > java.lang.RuntimeException: Child job running failed >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_ >> 5Process(SampleRunJobs.java:1598) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_ >> 6Process(SampleRunJobs.java:1412) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_ >> 1Process(SampleRunJobs.java:1197) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_ >> 4Process(SampleRunJobs.java:982) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tJDBCConnection_ >> 2Process(SampleRunJobs.java:762) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tJDBCConnection_ >> 1Process(SampleRunJobs.java:641) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs$2.run( >> SampleRunJobs.java:2560) >> > >> > > > 2015-01-29 >> > >> > > > >> > >> >> 16:07:04|VVdF7H|YhA1NE|XpLXfK|OVIRT_ENGINE_DWH| >> SampleRunJobs|Default|6|Java >> > >> > > > Exception|tRunJob_5|java.lang.RuntimeException:Child >> job running >> > >> failed|1 >> > >> > > > Exception in component tRunJob_1 >> > >> > > > java.lang.RuntimeException: Child job running failed >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tRunJob_ >> 1Process(SampleTimeKeepingJob.java:5941) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob. >> tJDBCInput_2Process(SampleTimeKeepingJob.java:5707) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob. >> tJDBCConnection_1Process(SampleTimeKeepingJob.java:4340) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob. >> tJDBCConnection_2Process(SampleTimeKeepingJob.java:4219) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob. >> tRowGenerator_2Process(SampleTimeKeepingJob.java:4092) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob. >> tJDBCInput_3Process(SampleTimeKeepingJob.java:3505) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob. >> tJDBCInput_5Process(SampleTimeKeepingJob.java:2877) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob. >> tJDBCInput_4Process(SampleTimeKeepingJob.java:2191) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob. >> tJDBCConnection_3Process(SampleTimeKeepingJob.java:1537) >> > >> > > > at >> > >> > > > >> > >> >> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob$2.run( >> SampleTimeKeepingJob.java:9546) >> > >> > > > >> > >> > > > >> > >> > > > _______________________________________________ >> > >> > > > Users mailing list >> > >> > > > Users(a)ovirt.org <mailto:Users@ovirt.org> >> > >> > > > http://lists.ovirt.org/mailman/listinfo/users >> > >> > > > >> > >> > > _______________________________________________ >> > >> > > Users mailing list >> > >> > > Users(a)ovirt.org <mailto:Users@ovirt.org> >> > >> > > http://lists.ovirt.org/mailman/listinfo/users >> > >> > > >> > >> > _______________________________________________ >> > >> > Users mailing list >> > >> > Users(a)ovirt.org <mailto:Users@ovirt.org> >> > >> > http://lists.ovirt.org/mailman/listinfo/users >> > >> > >> > >> >> > > >> > > >> > >> >> >> >> >> _______________________________________________ >> Users mailing list >> Users(a)ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users >> > > -- Yaniv Dary Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109 Tel : +972 (9) 7692306 8272306 Email: ydary(a)redhat.com IRC : ydary