[ovirt-users] dwh not receiving any data

Yaniv Dary ydary at redhat.com
Tue Feb 3 11:29:58 UTC 2015


The logs seem ok, is there a chance you simply don't have activity after 
17:00?
try to hover around the bottom of the graph a tool tip should appear if 
the value and if it's 0%.


On 02/03/2015 08:31 AM, Punit Dambiwal wrote:
> Hi Shirly,
>
> Please find the attached log files...
>
> On Tue, Feb 3, 2015 at 1:56 PM, Shirly Radco <sradco at redhat.com 
> <mailto:sradco at redhat.com>> wrote:
>
>     Hi Punit,
>
>     Please send me first the logs so we can see if this is still the
>     same issue.
>     /var/log/ovirt-engine
>     /var/log/ovirt-engine-dwh
>     /var/log/ovirt-engine-reports
>
>     Best regards,
>     ---
>     Shirly Radco
>     BI Software Engineer
>     Red Hat Israel Ltd.
>
>
>     ----- Original Message -----
>     > From: "Punit Dambiwal" <hypunit at gmail.com
>     <mailto:hypunit at gmail.com>>
>     > To: "Shirly Radco" <sradco at redhat.com <mailto:sradco at redhat.com>>
>     > Cc: "David van zeebroeck" <david at analytics.brusselsairport.be
>     <mailto:david at analytics.brusselsairport.be>>, "Joop"
>     <jvdwege at xs4all.nl <mailto:jvdwege at xs4all.nl>>, users at ovirt.org
>     <mailto:users at ovirt.org>
>     > Sent: Tuesday, February 3, 2015 5:50:57 AM
>     > Subject: Re: [ovirt-users] dwh not receiving any data
>     >
>     > Hi Shirly,
>     >
>     > It seems resolved but actually not....again after 12 hours it
>     stopped
>     > working...
>     >
>     > [image: Inline image 1]
>     > [image: Inline image 3]
>     >
>     > It stopped working after 5:00 AM....yesterday (2nd Feb) started
>     at evening
>     > 17:00 PM...and stopped today 3rd Feb 5:00 AM....
>     >
>     > [image: Inline image 4]
>     >
>     > Please let me know how i can take the dump of engine and dwh to
>     you....
>     >
>     > Thanks,
>     > Punit
>     >
>     > On Tue, Feb 3, 2015 at 9:34 AM, Punit Dambiwal
>     <hypunit at gmail.com <mailto:hypunit at gmail.com>> wrote:
>     >
>     > > Hi,
>     > >
>     > > My issue resolved by remove the dwh and reports and reinstall
>     > > again......also i found that my server time was correct and
>     updated but the
>     > > postgresql time was different form the server time.....above
>     two changes
>     > > made it work...
>     > >
>     > > Thanks,
>     > > punit
>     > >
>     > > On Mon, Feb 2, 2015 at 8:25 PM, Shirly Radco
>     <sradco at redhat.com <mailto:sradco at redhat.com>> wrote:
>     > >
>     > >> Hi,
>     > >>
>     > >> If any of you can send me the engine and ovirt_engine_dwh dump,
>     > >> I will upload them in my development environment and see what
>     is the
>     > >> issue.
>     > >>
>     > >> Best regards,
>     > >> ---
>     > >> Shirly Radco
>     > >> BI Software Engineer
>     > >> Red Hat Israel Ltd.
>     > >>
>     > >>
>     > >> ----- Original Message -----
>     > >> > From: "Shirly Radco" <sradco at redhat.com
>     <mailto:sradco at redhat.com>>
>     > >> > To: "David van zeebroeck"
>     <david at analytics.brusselsairport.be
>     <mailto:david at analytics.brusselsairport.be>>
>     > >> > Cc: users at ovirt.org <mailto:users at ovirt.org>
>     > >> > Sent: Monday, February 2, 2015 1:04:24 PM
>     > >> > Subject: Re: [ovirt-users] dwh not receiving any data
>     > >> >
>     > >> > Hi David,
>     > >> >
>     > >> > Please update me on what you found.
>     > >> >
>     > >> > Best regards,
>     > >> > ---
>     > >> > Shirly Radco
>     > >> > BI Software Engineer
>     > >> > Red Hat Israel Ltd.
>     > >> >
>     > >> >
>     > >> > ----- Original Message -----
>     > >> > > From: "Shirly Radco" <sradco at redhat.com
>     <mailto:sradco at redhat.com>>
>     > >> > > To: "David van zeebroeck"
>     <david at analytics.brusselsairport.be
>     <mailto:david at analytics.brusselsairport.be>>
>     > >> > > Cc: users at ovirt.org <mailto:users at ovirt.org>
>     > >> > > Sent: Sunday, February 1, 2015 11:24:10 AM
>     > >> > > Subject: Re: [ovirt-users] dwh not receiving any data
>     > >> > >
>     > >> > > Hi David,
>     > >> > >
>     > >> > > It means that for some reason user with user_id
>     > >> > > ab932902-cead-4435-a2b6-8b88576feab6
>     > >> > > was not added to users_details_history.
>     > >> > > And this is why the etl can't update the
>     vm_samples_history table on
>     > >> the
>     > >> > > ovirt_engine_history database.
>     > >> > >
>     > >> > > Please check if this user_id
>     ab932902-cead-4435-a2b6-8b88576feab6
>     > >> exists in
>     > >> > > the "dwh_users_history_view" or in the users table in the
>     engine
>     > >> database.
>     > >> > >
>     > >> > > Select * From dwh_users_history_view
>     > >> > > Where user_id = 'ab932902-cead-4435-a2b6-8b88576feab6';
>     > >> > >
>     > >> > > Best regards,
>     > >> > > ---
>     > >> > > Shirly Radco
>     > >> > > BI Software Engineer
>     > >> > > Red Hat Israel Ltd.
>     > >> > >
>     > >> > >
>     > >> > > ----- Original Message -----
>     > >> > > > From: "David van zeebroeck"
>     <david at analytics.brusselsairport.be
>     <mailto:david at analytics.brusselsairport.be>>
>     > >> > > > To: users at ovirt.org <mailto:users at ovirt.org>
>     > >> > > > Sent: Thursday, January 29, 2015 5:10:01 PM
>     > >> > > > Subject: [ovirt-users] dwh not receiving any data
>     > >> > > >
>     > >> > > > hi
>     > >> > > > we are running ovirt 3.5.1 and we are trying to setup
>     the dwh part
>     > >> > > > install and setup appears to run fine but when starting
>     the service
>     > >> we
>     > >> > > > see
>     > >> > > > following error in the log file :
>     > >> > > >
>     > >> > > > 2015-01-29 16:06:26|ETL Service Started
>     > >> > > > Exception in component tJDBCOutput_5
>     > >> > > > org.postgresql.util.PSQLException: ERROR: insert or
>     update on table
>     > >> > > > "vm_samples_history" violates foreign key constraint
>     > >> > > > "vm_samples_history_current_user_id_fkey"
>     > >> > > > Detail: Key
>     > >> (current_user_id)=(ab932902-cead-4435-a2b6-8b88576feab6) is
>     > >> > > > not
>     > >> > > > present in table "users_details_history".
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_10Process(StatisticsSync.java:10482)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$6.run(StatisticsSync.java:17437)
>     > >> > > > Exception in component tJDBCOutput_6
>     > >> > > > org.postgresql.util.PSQLException: ERROR: current
>     transaction is
>     > >> aborted,
>     > >> > > > commands ignored until end of transaction block
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_12Process(StatisticsSync.java:12689)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$7.run(StatisticsSync.java:17483)
>     > >> > > > Exception in component tJDBCOutput_7
>     > >> > > > org.postgresql.util.PSQLException: ERROR: current
>     transaction is
>     > >> aborted,
>     > >> > > > commands ignored until end of transaction block
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_18Process(StatisticsSync.java:14806)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$8.run(StatisticsSync.java:17529)
>     > >> > > > Exception in component tJDBCOutput_4
>     > >> > > > org.postgresql.util.PSQLException: ERROR: current
>     transaction is
>     > >> aborted,
>     > >> > > > commands ignored until end of transaction block
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
>     > >> > > > at
>     > >> > > >
>     > >>
>     org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_8Process(StatisticsSync.java:7788)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$5.run(StatisticsSync.java:17391)
>     > >> > > > 2015-01-29
>     > >> > > >
>     > >>
>     16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|StatisticsSync|Default|6|Java
>     > >> > > >
>     Exception|tJDBCOutput_7|org.postgresql.util.PSQLException:ERROR:
>     > >> current
>     > >> > > > transaction is aborted, commands ignored until end of
>     transaction
>     > >> block|1
>     > >> > > > 2015-01-29
>     > >> > > >
>     > >>
>     16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|StatisticsSync|Default|6|Java
>     > >> > > >
>     Exception|tJDBCOutput_5|org.postgresql.util.PSQLException:ERROR:
>     > >> insert
>     > >> > > > or
>     > >> > > > update on table "vm_samples_history" violates foreign
>     key constraint
>     > >> > > > "vm_samples_history_current_user_id_fkey"
>     > >> > > > Detail: Key
>     > >> (current_user_id)=(ab932902-cead-4435-a2b6-8b88576feab6) is
>     > >> > > > not
>     > >> > > > present in table "users_details_history".|1
>     > >> > > > 2015-01-29
>     > >> > > >
>     > >>
>     16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|StatisticsSync|Default|6|Java
>     > >> > > >
>     Exception|tJDBCOutput_6|org.postgresql.util.PSQLException:ERROR:
>     > >> current
>     > >> > > > transaction is aborted, commands ignored until end of
>     transaction
>     > >> block|1
>     > >> > > > 2015-01-29
>     > >> > > >
>     > >>
>     16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|StatisticsSync|Default|6|Java
>     > >> > > >
>     Exception|tJDBCOutput_4|org.postgresql.util.PSQLException:ERROR:
>     > >> current
>     > >> > > > transaction is aborted, commands ignored until end of
>     transaction
>     > >> block|1
>     > >> > > > Exception in component tRunJob_5
>     > >> > > > java.lang.RuntimeException: Child job running failed
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_5Process(SampleRunJobs.java:1598)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_6Process(SampleRunJobs.java:1412)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_1Process(SampleRunJobs.java:1197)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_4Process(SampleRunJobs.java:982)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tJDBCConnection_2Process(SampleRunJobs.java:762)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tJDBCConnection_1Process(SampleRunJobs.java:641)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs$2.run(SampleRunJobs.java:2560)
>     > >> > > > 2015-01-29
>     > >> > > >
>     > >>
>     16:07:04|VVdF7H|YhA1NE|XpLXfK|OVIRT_ENGINE_DWH|SampleRunJobs|Default|6|Java
>     > >> > > > Exception|tRunJob_5|java.lang.RuntimeException:Child
>     job running
>     > >> failed|1
>     > >> > > > Exception in component tRunJob_1
>     > >> > > > java.lang.RuntimeException: Child job running failed
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tRunJob_1Process(SampleTimeKeepingJob.java:5941)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCInput_2Process(SampleTimeKeepingJob.java:5707)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCConnection_1Process(SampleTimeKeepingJob.java:4340)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCConnection_2Process(SampleTimeKeepingJob.java:4219)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tRowGenerator_2Process(SampleTimeKeepingJob.java:4092)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCInput_3Process(SampleTimeKeepingJob.java:3505)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCInput_5Process(SampleTimeKeepingJob.java:2877)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCInput_4Process(SampleTimeKeepingJob.java:2191)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCConnection_3Process(SampleTimeKeepingJob.java:1537)
>     > >> > > > at
>     > >> > > >
>     > >>
>     ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob$2.run(SampleTimeKeepingJob.java:9546)
>     > >> > > >
>     > >> > > >
>     > >> > > > _______________________________________________
>     > >> > > > Users mailing list
>     > >> > > > Users at ovirt.org <mailto:Users at ovirt.org>
>     > >> > > > http://lists.ovirt.org/mailman/listinfo/users
>     > >> > > >
>     > >> > > _______________________________________________
>     > >> > > Users mailing list
>     > >> > > Users at ovirt.org <mailto:Users at ovirt.org>
>     > >> > > http://lists.ovirt.org/mailman/listinfo/users
>     > >> > >
>     > >> > _______________________________________________
>     > >> > Users mailing list
>     > >> > Users at ovirt.org <mailto:Users at ovirt.org>
>     > >> > http://lists.ovirt.org/mailman/listinfo/users
>     > >> >
>     > >>
>     > >
>     > >
>     >
>
>
>
>
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users

-- 
Yaniv Dary
Red Hat Israel Ltd.
34 Jerusalem Road
Building A, 4th floor
Ra'anana, Israel 4350109

Tel : +972 (9) 7692306
8272306
Email: ydary at redhat.com
IRC : ydary




More information about the Users mailing list