[ovirt-users] dwh not receiving any data
Yaniv Dary
ydary at redhat.com
Wed Feb 4 11:11:15 UTC 2015
About this issue, our best practice is to use UTC time for all the
machines and sync them with nfp.
We have a bug open on moving to ISO time to resolve some issues with
date pattern, but it's not in yet.
Yaniv
On 02/04/2015 03:33 AM, Punit Dambiwal wrote:
> Hi,
>
> VM is up and running and to make the graph....i manually make some dd
> and cpu stress on the VM....
>
> I created the dump with Ovirt backup tool....
>
> engine-backup --mode=backup --scope=db --file=BACKUP_FILE --log=LOG_FILE
>
> I also communicated with ovirt-china community...they found that there
> is some time difference between postgres and jdk...
>
> Inline image 1
>
> Thanks,
> Punit
>
> Thanks,
> Punit
>
> On Tue, Feb 3, 2015 at 7:30 PM, Yaniv Dary <ydary at redhat.com
> <mailto:ydary at redhat.com>> wrote:
>
> Also is there a chance the vm was shutdown?
>
>
>
> On 02/03/2015 01:29 PM, Yaniv Dary wrote:
>
> The logs seem ok, is there a chance you simply don't have
> activity after 17:00?
> try to hover around the bottom of the graph a tool tip should
> appear if the value and if it's 0%.
>
>
> On 02/03/2015 08:31 AM, Punit Dambiwal wrote:
>
> Hi Shirly,
>
> Please find the attached log files...
>
> On Tue, Feb 3, 2015 at 1:56 PM, Shirly Radco
> <sradco at redhat.com <mailto:sradco at redhat.com>
> <mailto:sradco at redhat.com <mailto:sradco at redhat.com>>> wrote:
>
> Hi Punit,
>
> Please send me first the logs so we can see if this is
> still the
> same issue.
> /var/log/ovirt-engine
> /var/log/ovirt-engine-dwh
> /var/log/ovirt-engine-reports
>
> Best regards,
> ---
> Shirly Radco
> BI Software Engineer
> Red Hat Israel Ltd.
>
>
> ----- Original Message -----
> > From: "Punit Dambiwal" <hypunit at gmail.com
> <mailto:hypunit at gmail.com>
> <mailto:hypunit at gmail.com <mailto:hypunit at gmail.com>>>
> > To: "Shirly Radco" <sradco at redhat.com
> <mailto:sradco at redhat.com> <mailto:sradco at redhat.com
> <mailto:sradco at redhat.com>>>
> > Cc: "David van zeebroeck"
> <david at analytics.brusselsairport.be
> <mailto:david at analytics.brusselsairport.be>
> <mailto:david at analytics.brusselsairport.be
> <mailto:david at analytics.brusselsairport.be>>>, "Joop"
> <jvdwege at xs4all.nl <mailto:jvdwege at xs4all.nl>
> <mailto:jvdwege at xs4all.nl <mailto:jvdwege at xs4all.nl>>>,
> users at ovirt.org <mailto:users at ovirt.org>
> <mailto:users at ovirt.org <mailto:users at ovirt.org>>
> > Sent: Tuesday, February 3, 2015 5:50:57 AM
> > Subject: Re: [ovirt-users] dwh not receiving any data
> >
> > Hi Shirly,
> >
> > It seems resolved but actually not....again after 12
> hours it
> stopped
> > working...
> >
> > [image: Inline image 1]
> > [image: Inline image 3]
> >
> > It stopped working after 5:00 AM....yesterday (2nd
> Feb) started
> at evening
> > 17:00 PM...and stopped today 3rd Feb 5:00 AM....
> >
> > [image: Inline image 4]
> >
> > Please let me know how i can take the dump of engine
> and dwh to
> you....
> >
> > Thanks,
> > Punit
> >
> > On Tue, Feb 3, 2015 at 9:34 AM, Punit Dambiwal
> <hypunit at gmail.com <mailto:hypunit at gmail.com>
> <mailto:hypunit at gmail.com <mailto:hypunit at gmail.com>>> wrote:
> >
> > > Hi,
> > >
> > > My issue resolved by remove the dwh and reports
> and reinstall
> > > again......also i found that my server time was
> correct and
> updated but the
> > > postgresql time was different form the server
> time.....above
> two changes
> > > made it work...
> > >
> > > Thanks,
> > > punit
> > >
> > > On Mon, Feb 2, 2015 at 8:25 PM, Shirly Radco
> <sradco at redhat.com <mailto:sradco at redhat.com>
> <mailto:sradco at redhat.com <mailto:sradco at redhat.com>>> wrote:
> > >
> > >> Hi,
> > >>
> > >> If any of you can send me the engine and
> ovirt_engine_dwh dump,
> > >> I will upload them in my development environment
> and see what
> is the
> > >> issue.
> > >>
> > >> Best regards,
> > >> ---
> > >> Shirly Radco
> > >> BI Software Engineer
> > >> Red Hat Israel Ltd.
> > >>
> > >>
> > >> ----- Original Message -----
> > >> > From: "Shirly Radco" <sradco at redhat.com
> <mailto:sradco at redhat.com>
> <mailto:sradco at redhat.com <mailto:sradco at redhat.com>>>
> > >> > To: "David van zeebroeck"
> <david at analytics.brusselsairport.be
> <mailto:david at analytics.brusselsairport.be>
> <mailto:david at analytics.brusselsairport.be
> <mailto:david at analytics.brusselsairport.be>>>
> > >> > Cc: users at ovirt.org <mailto:users at ovirt.org>
> <mailto:users at ovirt.org <mailto:users at ovirt.org>>
> > >> > Sent: Monday, February 2, 2015 1:04:24 PM
> > >> > Subject: Re: [ovirt-users] dwh not receiving
> any data
> > >> >
> > >> > Hi David,
> > >> >
> > >> > Please update me on what you found.
> > >> >
> > >> > Best regards,
> > >> > ---
> > >> > Shirly Radco
> > >> > BI Software Engineer
> > >> > Red Hat Israel Ltd.
> > >> >
> > >> >
> > >> > ----- Original Message -----
> > >> > > From: "Shirly Radco" <sradco at redhat.com
> <mailto:sradco at redhat.com>
> <mailto:sradco at redhat.com <mailto:sradco at redhat.com>>>
> > >> > > To: "David van zeebroeck"
> <david at analytics.brusselsairport.be
> <mailto:david at analytics.brusselsairport.be>
> <mailto:david at analytics.brusselsairport.be
> <mailto:david at analytics.brusselsairport.be>>>
> > >> > > Cc: users at ovirt.org <mailto:users at ovirt.org>
> <mailto:users at ovirt.org <mailto:users at ovirt.org>>
> > >> > > Sent: Sunday, February 1, 2015 11:24:10 AM
> > >> > > Subject: Re: [ovirt-users] dwh not receiving
> any data
> > >> > >
> > >> > > Hi David,
> > >> > >
> > >> > > It means that for some reason user with user_id
> > >> > > ab932902-cead-4435-a2b6-8b88576feab6
> > >> > > was not added to users_details_history.
> > >> > > And this is why the etl can't update the
> vm_samples_history table on
> > >> the
> > >> > > ovirt_engine_history database.
> > >> > >
> > >> > > Please check if this user_id
> ab932902-cead-4435-a2b6-8b88576feab6
> > >> exists in
> > >> > > the "dwh_users_history_view" or in the users
> table in the
> engine
> > >> database.
> > >> > >
> > >> > > Select * From dwh_users_history_view
> > >> > > Where user_id =
> 'ab932902-cead-4435-a2b6-8b88576feab6';
> > >> > >
> > >> > > Best regards,
> > >> > > ---
> > >> > > Shirly Radco
> > >> > > BI Software Engineer
> > >> > > Red Hat Israel Ltd.
> > >> > >
> > >> > >
> > >> > > ----- Original Message -----
> > >> > > > From: "David van zeebroeck"
> <david at analytics.brusselsairport.be
> <mailto:david at analytics.brusselsairport.be>
> <mailto:david at analytics.brusselsairport.be
> <mailto:david at analytics.brusselsairport.be>>>
> > >> > > > To: users at ovirt.org
> <mailto:users at ovirt.org> <mailto:users at ovirt.org
> <mailto:users at ovirt.org>>
> > >> > > > Sent: Thursday, January 29, 2015 5:10:01 PM
> > >> > > > Subject: [ovirt-users] dwh not receiving
> any data
> > >> > > >
> > >> > > > hi
> > >> > > > we are running ovirt 3.5.1 and we are
> trying to setup
> the dwh part
> > >> > > > install and setup appears to run fine but
> when starting
> the service
> > >> we
> > >> > > > see
> > >> > > > following error in the log file :
> > >> > > >
> > >> > > > 2015-01-29 16:06:26|ETL Service Started
> > >> > > > Exception in component tJDBCOutput_5
> > >> > > > org.postgresql.util.PSQLException: ERROR:
> insert or
> update on table
> > >> > > > "vm_samples_history" violates foreign key
> constraint
> > >> > > > "vm_samples_history_current_user_id_fkey"
> > >> > > > Detail: Key
> > >>
> (current_user_id)=(ab932902-cead-4435-a2b6-8b88576feab6) is
> > >> > > > not
> > >> > > > present in table "users_details_history".
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_10Process(StatisticsSync.java:10482)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$6.run(StatisticsSync.java:17437)
> > >> > > > Exception in component tJDBCOutput_6
> > >> > > > org.postgresql.util.PSQLException: ERROR:
> current
> transaction is
> > >> aborted,
> > >> > > > commands ignored until end of transaction block
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_12Process(StatisticsSync.java:12689)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$7.run(StatisticsSync.java:17483)
> > >> > > > Exception in component tJDBCOutput_7
> > >> > > > org.postgresql.util.PSQLException: ERROR:
> current
> transaction is
> > >> aborted,
> > >> > > > commands ignored until end of transaction block
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_18Process(StatisticsSync.java:14806)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$8.run(StatisticsSync.java:17529)
> > >> > > > Exception in component tJDBCOutput_4
> > >> > > > org.postgresql.util.PSQLException: ERROR:
> current
> transaction is
> > >> aborted,
> > >> > > > commands ignored until end of transaction block
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2062)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:1795)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:257)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(AbstractJdbc2Statement.java:479)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(AbstractJdbc2Statement.java:367)
> > >> > > > at
> > >> > > >
> > >>
> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(AbstractJdbc2Statement.java:321)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_8Process(StatisticsSync.java:7788)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$5.run(StatisticsSync.java:17391)
> > >> > > > 2015-01-29
> > >> > > >
> > >>
> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|StatisticsSync|Default|6|Java
> > >> > > >
> Exception|tJDBCOutput_7|org.postgresql.util.PSQLException:ERROR:
> > >> current
> > >> > > > transaction is aborted, commands ignored
> until end of
> transaction
> > >> block|1
> > >> > > > 2015-01-29
> > >> > > >
> > >>
> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|StatisticsSync|Default|6|Java
> > >> > > >
> Exception|tJDBCOutput_5|org.postgresql.util.PSQLException:ERROR:
> > >> insert
> > >> > > > or
> > >> > > > update on table "vm_samples_history"
> violates foreign
> key constraint
> > >> > > > "vm_samples_history_current_user_id_fkey"
> > >> > > > Detail: Key
> > >>
> (current_user_id)=(ab932902-cead-4435-a2b6-8b88576feab6) is
> > >> > > > not
> > >> > > > present in table "users_details_history".|1
> > >> > > > 2015-01-29
> > >> > > >
> > >>
> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|StatisticsSync|Default|6|Java
> > >> > > >
> Exception|tJDBCOutput_6|org.postgresql.util.PSQLException:ERROR:
> > >> current
> > >> > > > transaction is aborted, commands ignored
> until end of
> transaction
> > >> block|1
> > >> > > > 2015-01-29
> > >> > > >
> > >>
> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|StatisticsSync|Default|6|Java
> > >> > > >
> Exception|tJDBCOutput_4|org.postgresql.util.PSQLException:ERROR:
> > >> current
> > >> > > > transaction is aborted, commands ignored
> until end of
> transaction
> > >> block|1
> > >> > > > Exception in component tRunJob_5
> > >> > > > java.lang.RuntimeException: Child job
> running failed
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_5Process(SampleRunJobs.java:1598)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_6Process(SampleRunJobs.java:1412)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_1Process(SampleRunJobs.java:1197)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_4Process(SampleRunJobs.java:982)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tJDBCConnection_2Process(SampleRunJobs.java:762)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tJDBCConnection_1Process(SampleRunJobs.java:641)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs$2.run(SampleRunJobs.java:2560)
> > >> > > > 2015-01-29
> > >> > > >
> > >>
> 16:07:04|VVdF7H|YhA1NE|XpLXfK|OVIRT_ENGINE_DWH|SampleRunJobs|Default|6|Java
> > >> > > >
> Exception|tRunJob_5|java.lang.RuntimeException:Child
> job running
> > >> failed|1
> > >> > > > Exception in component tRunJob_1
> > >> > > > java.lang.RuntimeException: Child job
> running failed
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tRunJob_1Process(SampleTimeKeepingJob.java:5941)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCInput_2Process(SampleTimeKeepingJob.java:5707)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCConnection_1Process(SampleTimeKeepingJob.java:4340)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCConnection_2Process(SampleTimeKeepingJob.java:4219)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tRowGenerator_2Process(SampleTimeKeepingJob.java:4092)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCInput_3Process(SampleTimeKeepingJob.java:3505)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCInput_5Process(SampleTimeKeepingJob.java:2877)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCInput_4Process(SampleTimeKeepingJob.java:2191)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tJDBCConnection_3Process(SampleTimeKeepingJob.java:1537)
> > >> > > > at
> > >> > > >
> > >>
> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob$2.run(SampleTimeKeepingJob.java:9546)
> > >> > > >
> > >> > > >
> > >> > > > _______________________________________________
> > >> > > > Users mailing list
> > >> > > > Users at ovirt.org <mailto:Users at ovirt.org>
> <mailto:Users at ovirt.org <mailto:Users at ovirt.org>>
> > >> > > > http://lists.ovirt.org/mailman/listinfo/users
> > >> > > >
> > >> > > _______________________________________________
> > >> > > Users mailing list
> > >> > > Users at ovirt.org <mailto:Users at ovirt.org>
> <mailto:Users at ovirt.org <mailto:Users at ovirt.org>>
> > >> > > http://lists.ovirt.org/mailman/listinfo/users
> > >> > >
> > >> > _______________________________________________
> > >> > Users mailing list
> > >> > Users at ovirt.org <mailto:Users at ovirt.org>
> <mailto:Users at ovirt.org <mailto:Users at ovirt.org>>
> > >> > http://lists.ovirt.org/mailman/listinfo/users
> > >> >
> > >>
> > >
> > >
> >
>
>
>
>
> _______________________________________________
> Users mailing list
> Users at ovirt.org <mailto:Users at ovirt.org>
> http://lists.ovirt.org/mailman/listinfo/users
>
>
>
> --
> Yaniv Dary
> Red Hat Israel Ltd.
> 34 Jerusalem Road
> Building A, 4th floor
> Ra'anana, Israel 4350109
>
> Tel : +972 (9) 7692306 <tel:%2B972%20%289%29%207692306>
> 8272306
> Email: ydary at redhat.com <mailto:ydary at redhat.com>
> IRC : ydary
>
>
--
Yaniv Dary
Red Hat Israel Ltd.
34 Jerusalem Road
Building A, 4th floor
Ra'anana, Israel 4350109
Tel : +972 (9) 7692306
8272306
Email: ydary at redhat.com
IRC : ydary
More information about the Users
mailing list