[ovirt-users] dwh not receiving any data

Yaniv Dary ydary at redhat.com
Tue Feb 3 11:30:58 UTC 2015


Also is there a chance the vm was shutdown?


On 02/03/2015 01:29 PM, Yaniv Dary wrote:
> The logs seem ok, is there a chance you simply don't have activity 
> after 17:00?
> try to hover around the bottom of the graph a tool tip should appear 
> if the value and if it's 0%.
>
>
> On 02/03/2015 08:31 AM, Punit Dambiwal wrote:
>> Hi Shirly,
>>
>> Please find the attached log files...
>>
>> On Tue, Feb 3, 2015 at 1:56 PM, Shirly Radco <sradco at redhat.com 
>> <mailto:sradco at redhat.com>> wrote:
>>
>>     Hi Punit,
>>
>>     Please send me first the logs so we can see if this is still the
>>     same issue.
>>     /var/log/ovirt-engine
>>     /var/log/ovirt-engine-dwh
>>     /var/log/ovirt-engine-reports
>>
>>     Best regards,
>>     ---
>>     Shirly Radco
>>     BI Software Engineer
>>     Red Hat Israel Ltd.
>>
>>
>>     ----- Original Message -----
>>     > From: "Punit Dambiwal" <hypunit at gmail.com
>>     <mailto:hypunit at gmail.com>>
>>     > To: "Shirly Radco" <sradco at redhat.com <mailto:sradco at redhat.com>>
>>     > Cc: "David van zeebroeck" <david at analytics.brusselsairport.be
>>     <mailto:david at analytics.brusselsairport.be>>, "Joop"
>>     <jvdwege at xs4all.nl <mailto:jvdwege at xs4all.nl>>, users at ovirt.org
>>     <mailto:users at ovirt.org>
>>     > Sent: Tuesday, February 3, 2015 5:50:57 AM
>>     > Subject: Re: [ovirt-users] dwh not receiving any data
>>     >
>>     > Hi Shirly,
>>     >
>>     > It seems resolved but actually not....again after 12 hours it
>>     stopped
>>     > working...
>>     >
>>     > [image: Inline image 1]
>>     > [image: Inline image 3]
>>     >
>>     > It stopped working after 5:00 AM....yesterday (2nd Feb) started
>>     at evening
>>     > 17:00 PM...and stopped today 3rd Feb 5:00 AM....
>>     >
>>     > [image: Inline image 4]
>>     >
>>     > Please let me know how i can take the dump of engine and dwh to
>>     you....
>>     >
>>     > Thanks,
>>     > Punit
>>     >
>>     > On Tue, Feb 3, 2015 at 9:34 AM, Punit Dambiwal
>>     <hypunit at gmail.com <mailto:hypunit at gmail.com>> wrote:
>>     >
>>     > > Hi,
>>     > >
>>     > > My issue resolved by remove the dwh and reports and reinstall
>>     > > again......also i found that my server time was correct and
>>     updated but the
>>     > > postgresql time was different form the server time.....above
>>     two changes
>>     > > made it work...
>>     > >
>>     > > Thanks,
>>     > > punit
>>     > >
>>     > > On Mon, Feb 2, 2015 at 8:25 PM, Shirly Radco
>>     <sradco at redhat.com <mailto:sradco at redhat.com>> wrote:
>>     > >
>>     > >> Hi,
>>     > >>
>>     > >> If any of you can send me the engine and ovirt_engine_dwh dump,
>>     > >> I will upload them in my development environment and see what
>>     is the
>>     > >> issue.
>>     > >>
>>     > >> Best regards,
>>     > >> ---
>>     > >> Shirly Radco
>>     > >> BI Software Engineer
>>     > >> Red Hat Israel Ltd.
>>     > >>
>>     > >>
>>     > >> ----- Original Message -----
>>     > >> > From: "Shirly Radco" <sradco at redhat.com
>>     <mailto:sradco at redhat.com>>
>>     > >> > To: "David van zeebroeck"
>>     <david at analytics.brusselsairport.be
>>     <mailto:david at analytics.brusselsairport.be>>
>>     > >> > Cc: users at ovirt.org <mailto:users at ovirt.org>
>>     > >> > Sent: Monday, February 2, 2015 1:04:24 PM
>>     > >> > Subject: Re: [ovirt-users] dwh not receiving any data
>>     > >> >
>>     > >> > Hi David,
>>     > >> >
>>     > >> > Please update me on what you found.
>>     > >> >
>>     > >> > Best regards,
>>     > >> > ---
>>     > >> > Shirly Radco
>>     > >> > BI Software Engineer
>>     > >> > Red Hat Israel Ltd.
>>     > >> >
>>     > >> >
>>     > >> > ----- Original Message -----
>>     > >> > > From: "Shirly Radco" <sradco at redhat.com
>>     <mailto:sradco at redhat.com>>
>>     > >> > > To: "David van zeebroeck"
>>     <david at analytics.brusselsairport.be
>>     <mailto:david at analytics.brusselsairport.be>>
>>     > >> > > Cc: users at ovirt.org <mailto:users at ovirt.org>
>>     > >> > > Sent: Sunday, February 1, 2015 11:24:10 AM
>>     > >> > > Subject: Re: [ovirt-users] dwh not receiving any data
>>     > >> > >
>>     > >> > > Hi David,
>>     > >> > >
>>     > >> > > It means that for some reason user with user_id
>>     > >> > > ab932902-cead-4435-a2b6-8b88576feab6
>>     > >> > > was not added to users_details_history.
>>     > >> > > And this is why the etl can't update the
>>     vm_samples_history table on
>>     > >> the
>>     > >> > > ovirt_engine_history database.
>>     > >> > >
>>     > >> > > Please check if this user_id
>>     ab932902-cead-4435-a2b6-8b88576feab6
>>     > >> exists in
>>     > >> > > the "dwh_users_history_view" or in the users table in the
>>     engine
>>     > >> database.
>>     > >> > >
>>     > >> > > Select * From dwh_users_history_view
>>     > >> > > Where user_id = 'ab932902-cead-4435-a2b6-8b88576feab6';
>>     > >> > >
>>     > >> > > Best regards,
>>     > >> > > ---
>>     > >> > > Shirly Radco
>>     > >> > > BI Software Engineer
>>     > >> > > Red Hat Israel Ltd.
>>     > >> > >
>>     > >> > >
>>     > >> > > ----- Original Message -----
>>     > >> > > > From: "David van zeebroeck"
>>     <david at analytics.brusselsairport.be
>>     <mailto:david at analytics.brusselsairport.be>>
>>     > >> > > > To: users at ovirt.org <mailto:users at ovirt.org>
>>     > >> > > > Sent: Thursday, January 29, 2015 5:10:01 PM
>>     > >> > > > Subject: [ovirt-users] dwh not receiving any data
>>     > >> > > >
>>     > >> > > > hi
>>     > >> > > > we are running ovirt 3.5.1 and we are trying to setup
>>     the dwh part
>>     > >> > > > install and setup appears to run fine but when starting
>>     the service
>>     > >> we
>>     > >> > > > see
>>     > >> > > > following error in the log file :
>>     > >> > > >
>>     > >> > > > 2015-01-29 16:06:26|ETL Service Started
>>     > >> > > > Exception in component tJDBCOutput_5
>>     > >> > > > org.postgresql.util.PSQLException: ERROR: insert or
>>     update on table
>>     > >> > > > "vm_samples_history" violates foreign key constraint
>>     > >> > > > "vm_samples_history_current_user_id_fkey"
>>     > >> > > > Detail: Key
>>     > >> (current_user_id)=(ab932902-cead-4435-a2b6-8b88576feab6) is
>>     > >> > > > not
>>     > >> > > > present in table "users_details_history".
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_10Process(StatisticsSync.java:10482)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$6.run(StatisticsSync.java:17437)
>>     > >> > > > Exception in component tJDBCOutput_6
>>     > >> > > > org.postgresql.util.PSQLException: ERROR: current
>>     transaction is
>>     > >> aborted,
>>     > >> > > > commands ignored until end of transaction block
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_12Process(StatisticsSync.java:12689)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$7.run(StatisticsSync.java:17483)
>>     > >> > > > Exception in component tJDBCOutput_7
>>     > >> > > > org.postgresql.util.PSQLException: ERROR: current
>>     transaction is
>>     > >> aborted,
>>     > >> > > > commands ignored until end of transaction block
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_18Process(StatisticsSync.java:14806)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$8.run(StatisticsSync.java:17529)
>>     > >> > > > Exception in component tJDBCOutput_4
>>     > >> > > > org.postgresql.util.PSQLException: ERROR: current
>>     transaction is
>>     > >> aborted,
>>     > >> > > > commands ignored until end of transaction block
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_8Process(StatisticsSync.java:7788)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$5.run(StatisticsSync.java:17391)
>>     > >> > > > 2015-01-29
>>     > >> > > >
>>     > >>
>> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|StatisticsSync|Default|6|Java
>>     > >> > > >
>> Exception|tJDBCOutput_7|org.postgresql.util.PSQLException:ERROR:
>>     > >> current
>>     > >> > > > transaction is aborted, commands ignored until end of
>>     transaction
>>     > >> block|1
>>     > >> > > > 2015-01-29
>>     > >> > > >
>>     > >>
>> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|StatisticsSync|Default|6|Java
>>     > >> > > >
>> Exception|tJDBCOutput_5|org.postgresql.util.PSQLException:ERROR:
>>     > >> insert
>>     > >> > > > or
>>     > >> > > > update on table "vm_samples_history" violates foreign
>>     key constraint
>>     > >> > > > "vm_samples_history_current_user_id_fkey"
>>     > >> > > > Detail: Key
>>     > >> (current_user_id)=(ab932902-cead-4435-a2b6-8b88576feab6) is
>>     > >> > > > not
>>     > >> > > > present in table "users_details_history".|1
>>     > >> > > > 2015-01-29
>>     > >> > > >
>>     > >>
>> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|StatisticsSync|Default|6|Java
>>     > >> > > >
>> Exception|tJDBCOutput_6|org.postgresql.util.PSQLException:ERROR:
>>     > >> current
>>     > >> > > > transaction is aborted, commands ignored until end of
>>     transaction
>>     > >> block|1
>>     > >> > > > 2015-01-29
>>     > >> > > >
>>     > >>
>> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|StatisticsSync|Default|6|Java
>>     > >> > > >
>> Exception|tJDBCOutput_4|org.postgresql.util.PSQLException:ERROR:
>>     > >> current
>>     > >> > > > transaction is aborted, commands ignored until end of
>>     transaction
>>     > >> block|1
>>     > >> > > > Exception in component tRunJob_5
>>     > >> > > > java.lang.RuntimeException: Child job running failed
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_5Process(SampleRunJobs.java:1598)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_6Process(SampleRunJobs.java:1412)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_1Process(SampleRunJobs.java:1197)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_4Process(SampleRunJobs.java:982)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tJDBCConnection_2Process(SampleRunJobs.java:762)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tJDBCConnection_1Process(SampleRunJobs.java:641)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs$2.run(SampleRunJobs.java:2560)
>>     > >> > > > 2015-01-29
>>     > >> > > >
>>     > >>
>> 16:07:04|VVdF7H|YhA1NE|XpLXfK|OVIRT_ENGINE_DWH|SampleRunJobs|Default|6|Java
>>     > >> > > > Exception|tRunJob_5|java.lang.RuntimeException:Child
>>     job running
>>     > >> failed|1
>>     > >> > > > Exception in component tRunJob_1
>>     > >> > > > java.lang.RuntimeException: Child job running failed
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tRunJob_1Process(SampleTimeKeepingJob.java:5941)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCInput_2Process(SampleTimeKeepingJob.java:5707)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCConnection_1Process(SampleTimeKeepingJob.java:4340)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCConnection_2Process(SampleTimeKeepingJob.java:4219)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tRowGenerator_2Process(SampleTimeKeepingJob.java:4092)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCInput_3Process(SampleTimeKeepingJob.java:3505)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCInput_5Process(SampleTimeKeepingJob.java:2877)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCInput_4Process(SampleTimeKeepingJob.java:2191)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCConnection_3Process(SampleTimeKeepingJob.java:1537)
>>     > >> > > > at
>>     > >> > > >
>>     > >>
>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob$2.run(SampleTimeKeepingJob.java:9546)
>>     > >> > > >
>>     > >> > > >
>>     > >> > > > _______________________________________________
>>     > >> > > > Users mailing list
>>     > >> > > > Users at ovirt.org <mailto:Users at ovirt.org>
>>     > >> > > > http://lists.ovirt.org/mailman/listinfo/users
>>     > >> > > >
>>     > >> > > _______________________________________________
>>     > >> > > Users mailing list
>>     > >> > > Users at ovirt.org <mailto:Users at ovirt.org>
>>     > >> > > http://lists.ovirt.org/mailman/listinfo/users
>>     > >> > >
>>     > >> > _______________________________________________
>>     > >> > Users mailing list
>>     > >> > Users at ovirt.org <mailto:Users at ovirt.org>
>>     > >> > http://lists.ovirt.org/mailman/listinfo/users
>>     > >> >
>>     > >>
>>     > >
>>     > >
>>     >
>>
>>
>>
>>
>> _______________________________________________
>> Users mailing list
>> Users at ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>

-- 
Yaniv Dary
Red Hat Israel Ltd.
34 Jerusalem Road
Building A, 4th floor
Ra'anana, Israel 4350109

Tel : +972 (9) 7692306
8272306
Email: ydary at redhat.com
IRC : ydary




More information about the Users mailing list