Re: [ovirt-users] dwh not receiving any data

4 Feb 2015

      Hi,

VM is up and running and to make the graph....i manually make some dd and
cpu stress on the VM....

I created the dump with Ovirt backup tool....

engine-backup --mode=backup --scope=db --file=BACKUP_FILE --log=LOG_FILE

I also communicated with ovirt-china community...they found that there is
some time difference between postgres and  jdk...

[image: Inline image 1]

Thanks,
Punit

Thanks,
Punit

On Tue, Feb 3, 2015 at 7:30 PM, Yaniv Dary <ydary@redhat.com> wrote:
...
Also is there a chance the vm was shutdown?
On 02/03/2015 01:29 PM, Yaniv Dary wrote:
...
The logs seem ok, is there a chance you simply don't have activity after
17:00?
try to hover around the bottom of the graph a tool tip should appear if
the value and if it's 0%.
On 02/03/2015 08:31 AM, Punit Dambiwal wrote:
...
Hi Shirly,
Please find the attached log files...
On Tue, Feb 3, 2015 at 1:56 PM, Shirly Radco <sradco@redhat.com <mailto:
sradco@redhat.com>> wrote:
Hi Punit,
Please send me first the logs so we can see if this is still the
    same issue.
    /var/log/ovirt-engine
    /var/log/ovirt-engine-dwh
    /var/log/ovirt-engine-reports
Best regards,
    ---
    Shirly Radco
    BI Software Engineer
    Red Hat Israel Ltd.
----- Original Message -----
    > From: "Punit Dambiwal" <hypunit@gmail.com
    <mailto:hypunit@gmail.com>>
    > To: "Shirly Radco" <sradco@redhat.com <mailto:sradco@redhat.com>>
    > Cc: "David van zeebroeck" <david@analytics.brusselsairport.be
    <mailto:david@analytics.brusselsairport.be>>, "Joop"
    <jvdwege@xs4all.nl <mailto:jvdwege@xs4all.nl>>, users@ovirt.org
    <mailto:users@ovirt.org>
    > Sent: Tuesday, February 3, 2015 5:50:57 AM
    > Subject: Re: [ovirt-users] dwh not receiving any data
    >
    > Hi Shirly,
    >
    > It seems resolved but actually not....again after 12 hours it
    stopped
    > working...
    >
    > [image: Inline image 1]
    > [image: Inline image 3]
    >
    > It stopped working after 5:00 AM....yesterday (2nd Feb) started
    at evening
    > 17:00 PM...and stopped today 3rd Feb 5:00 AM....
    >
    > [image: Inline image 4]
    >
    > Please let me know how i can take the dump of engine and dwh to
    you....
    >
    > Thanks,
    > Punit
    >
    > On Tue, Feb 3, 2015 at 9:34 AM, Punit Dambiwal
    <hypunit@gmail.com <mailto:hypunit@gmail.com>> wrote:
    >
    > > Hi,
    > >
    > > My issue resolved by remove the dwh and reports and reinstall
    > > again......also i found that my server time was correct and
    updated but the
    > > postgresql time was different form the server time.....above
    two changes
    > > made it work...
    > >
    > > Thanks,
    > > punit
    > >
    > > On Mon, Feb 2, 2015 at 8:25 PM, Shirly Radco
    <sradco@redhat.com <mailto:sradco@redhat.com>> wrote:
    > >
    > >> Hi,
    > >>
    > >> If any of you can send me the engine and ovirt_engine_dwh dump,
    > >> I will upload them in my development environment and see what
    is the
    > >> issue.
    > >>
    > >> Best regards,
    > >> ---
    > >> Shirly Radco
    > >> BI Software Engineer
    > >> Red Hat Israel Ltd.
    > >>
    > >>
    > >> ----- Original Message -----
    > >> > From: "Shirly Radco" <sradco@redhat.com
    <mailto:sradco@redhat.com>>
    > >> > To: "David van zeebroeck"
    <david@analytics.brusselsairport.be
    <mailto:david@analytics.brusselsairport.be>>
    > >> > Cc: users@ovirt.org <mailto:users@ovirt.org>
    > >> > Sent: Monday, February 2, 2015 1:04:24 PM
    > >> > Subject: Re: [ovirt-users] dwh not receiving any data
    > >> >
    > >> > Hi David,
    > >> >
    > >> > Please update me on what you found.
    > >> >
    > >> > Best regards,
    > >> > ---
    > >> > Shirly Radco
    > >> > BI Software Engineer
    > >> > Red Hat Israel Ltd.
    > >> >
    > >> >
    > >> > ----- Original Message -----
    > >> > > From: "Shirly Radco" <sradco@redhat.com
    <mailto:sradco@redhat.com>>
    > >> > > To: "David van zeebroeck"
    <david@analytics.brusselsairport.be
    <mailto:david@analytics.brusselsairport.be>>
    > >> > > Cc: users@ovirt.org <mailto:users@ovirt.org>
    > >> > > Sent: Sunday, February 1, 2015 11:24:10 AM
    > >> > > Subject: Re: [ovirt-users] dwh not receiving any data
    > >> > >
    > >> > > Hi David,
    > >> > >
    > >> > > It means that for some reason user with user_id
    > >> > > ab932902-cead-4435-a2b6-8b88576feab6
    > >> > > was not added to users_details_history.
    > >> > > And this is why the etl can't update the
    vm_samples_history table on
    > >> the
    > >> > > ovirt_engine_history database.
    > >> > >
    > >> > > Please check if this user_id
    ab932902-cead-4435-a2b6-8b88576feab6
    > >> exists in
    > >> > > the "dwh_users_history_view" or in the users table in the
    engine
    > >> database.
    > >> > >
    > >> > > Select * From dwh_users_history_view
    > >> > > Where user_id = 'ab932902-cead-4435-a2b6-8b88576feab6';
    > >> > >
    > >> > > Best regards,
    > >> > > ---
    > >> > > Shirly Radco
    > >> > > BI Software Engineer
    > >> > > Red Hat Israel Ltd.
    > >> > >
    > >> > >
    > >> > > ----- Original Message -----
    > >> > > > From: "David van zeebroeck"
    <david@analytics.brusselsairport.be
    <mailto:david@analytics.brusselsairport.be>>
    > >> > > > To: users@ovirt.org <mailto:users@ovirt.org>
    > >> > > > Sent: Thursday, January 29, 2015 5:10:01 PM
    > >> > > > Subject: [ovirt-users] dwh not receiving any data
    > >> > > >
    > >> > > > hi
    > >> > > > we are running ovirt 3.5.1 and we are trying to setup
    the dwh part
    > >> > > > install and setup appears to run fine but when starting
    the service
    > >> we
    > >> > > > see
    > >> > > > following error in the log file :
    > >> > > >
    > >> > > > 2015-01-29 16:06:26|ETL Service Started
    > >> > > > Exception in component tJDBCOutput_5
    > >> > > > org.postgresql.util.PSQLException: ERROR: insert or
    update on table
    > >> > > > "vm_samples_history" violates foreign key constraint
    > >> > > > "vm_samples_history_current_user_id_fkey"
    > >> > > > Detail: Key
    > >> (current_user_id)=(ab932902-cead-4435-a2b6-8b88576feab6) is
    > >> > > > not
    > >> > > > present in table "users_details_history".
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(
QueryExecutorImpl.java:2062)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.core.v3.QueryExecutorImpl.processResults(
QueryExecutorImpl.java:1795)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.core.v3.QueryExecutorImpl.execute(
QueryExecutorImpl.java:257)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.jdbc2.AbstractJdbc2Statement.execute(
AbstractJdbc2Statement.java:479)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(
AbstractJdbc2Statement.java:367)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(
AbstractJdbc2Statement.java:321)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_
10Process(StatisticsSync.java:10482)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$6.run(
StatisticsSync.java:17437)
    > >> > > > Exception in component tJDBCOutput_6
    > >> > > > org.postgresql.util.PSQLException: ERROR: current
    transaction is
    > >> aborted,
    > >> > > > commands ignored until end of transaction block
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(
QueryExecutorImpl.java:2062)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.core.v3.QueryExecutorImpl.processResults(
QueryExecutorImpl.java:1795)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.core.v3.QueryExecutorImpl.execute(
QueryExecutorImpl.java:257)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.jdbc2.AbstractJdbc2Statement.execute(
AbstractJdbc2Statement.java:479)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(
AbstractJdbc2Statement.java:367)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(
AbstractJdbc2Statement.java:321)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_
12Process(StatisticsSync.java:12689)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$7.run(
StatisticsSync.java:17483)
    > >> > > > Exception in component tJDBCOutput_7
    > >> > > > org.postgresql.util.PSQLException: ERROR: current
    transaction is
    > >> aborted,
    > >> > > > commands ignored until end of transaction block
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(
QueryExecutorImpl.java:2062)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.core.v3.QueryExecutorImpl.processResults(
QueryExecutorImpl.java:1795)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.core.v3.QueryExecutorImpl.execute(
QueryExecutorImpl.java:257)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.jdbc2.AbstractJdbc2Statement.execute(
AbstractJdbc2Statement.java:479)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(
AbstractJdbc2Statement.java:367)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(
AbstractJdbc2Statement.java:321)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_
18Process(StatisticsSync.java:14806)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$8.run(
StatisticsSync.java:17529)
    > >> > > > Exception in component tJDBCOutput_4
    > >> > > > org.postgresql.util.PSQLException: ERROR: current
    transaction is
    > >> aborted,
    > >> > > > commands ignored until end of transaction block
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(
QueryExecutorImpl.java:2062)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.core.v3.QueryExecutorImpl.processResults(
QueryExecutorImpl.java:1795)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.core.v3.QueryExecutorImpl.execute(
QueryExecutorImpl.java:257)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.jdbc2.AbstractJdbc2Statement.execute(
AbstractJdbc2Statement.java:479)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(
AbstractJdbc2Statement.java:367)
    > >> > > > at
    > >> > > >
    > >>
org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(
AbstractJdbc2Statement.java:321)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_
8Process(StatisticsSync.java:7788)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$5.run(
StatisticsSync.java:17391)
    > >> > > > 2015-01-29
    > >> > > >
    > >>
16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|
StatisticsSync|Default|6|Java
    > >> > > >
Exception|tJDBCOutput_7|org.postgresql.util.PSQLException:ERROR:
    > >> current
    > >> > > > transaction is aborted, commands ignored until end of
    transaction
    > >> block|1
    > >> > > > 2015-01-29
    > >> > > >
    > >>
16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|
StatisticsSync|Default|6|Java
    > >> > > >
Exception|tJDBCOutput_5|org.postgresql.util.PSQLException:ERROR:
    > >> insert
    > >> > > > or
    > >> > > > update on table "vm_samples_history" violates foreign
    key constraint
    > >> > > > "vm_samples_history_current_user_id_fkey"
    > >> > > > Detail: Key
    > >> (current_user_id)=(ab932902-cead-4435-a2b6-8b88576feab6) is
    > >> > > > not
    > >> > > > present in table "users_details_history".|1
    > >> > > > 2015-01-29
    > >> > > >
    > >>
16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|
StatisticsSync|Default|6|Java
    > >> > > >
Exception|tJDBCOutput_6|org.postgresql.util.PSQLException:ERROR:
    > >> current
    > >> > > > transaction is aborted, commands ignored until end of
    transaction
    > >> block|1
    > >> > > > 2015-01-29
    > >> > > >
    > >>
16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|
StatisticsSync|Default|6|Java
    > >> > > >
Exception|tJDBCOutput_4|org.postgresql.util.PSQLException:ERROR:
    > >> current
    > >> > > > transaction is aborted, commands ignored until end of
    transaction
    > >> block|1
    > >> > > > Exception in component tRunJob_5
    > >> > > > java.lang.RuntimeException: Child job running failed
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_
5Process(SampleRunJobs.java:1598)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_
6Process(SampleRunJobs.java:1412)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_
1Process(SampleRunJobs.java:1197)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_
4Process(SampleRunJobs.java:982)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tJDBCConnection_
2Process(SampleRunJobs.java:762)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tJDBCConnection_
1Process(SampleRunJobs.java:641)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs$2.run(
SampleRunJobs.java:2560)
    > >> > > > 2015-01-29
    > >> > > >
    > >>
16:07:04|VVdF7H|YhA1NE|XpLXfK|OVIRT_ENGINE_DWH|
SampleRunJobs|Default|6|Java
    > >> > > > Exception|tRunJob_5|java.lang.RuntimeException:Child
    job running
    > >> failed|1
    > >> > > > Exception in component tRunJob_1
    > >> > > > java.lang.RuntimeException: Child job running failed
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tRunJob_
1Process(SampleTimeKeepingJob.java:5941)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
tJDBCInput_2Process(SampleTimeKeepingJob.java:5707)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
tJDBCConnection_1Process(SampleTimeKeepingJob.java:4340)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
tJDBCConnection_2Process(SampleTimeKeepingJob.java:4219)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
tRowGenerator_2Process(SampleTimeKeepingJob.java:4092)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
tJDBCInput_3Process(SampleTimeKeepingJob.java:3505)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
tJDBCInput_5Process(SampleTimeKeepingJob.java:2877)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
tJDBCInput_4Process(SampleTimeKeepingJob.java:2191)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
tJDBCConnection_3Process(SampleTimeKeepingJob.java:1537)
    > >> > > > at
    > >> > > >
    > >>
ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob$2.run(
SampleTimeKeepingJob.java:9546)
    > >> > > >
    > >> > > >
    > >> > > > _______________________________________________
    > >> > > > Users mailing list
    > >> > > > Users@ovirt.org <mailto:Users@ovirt.org>
    > >> > > > http://lists.ovirt.org/mailman/listinfo/users
    > >> > > >
    > >> > > _______________________________________________
    > >> > > Users mailing list
    > >> > > Users@ovirt.org <mailto:Users@ovirt.org>
    > >> > > http://lists.ovirt.org/mailman/listinfo/users
    > >> > >
    > >> > _______________________________________________
    > >> > Users mailing list
    > >> > Users@ovirt.org <mailto:Users@ovirt.org>
    > >> > http://lists.ovirt.org/mailman/listinfo/users
    > >> >
    > >>
    > >
    > >
    >
_______________________________________________
Users mailing list
Users@ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
--
Yaniv Dary
Red Hat Israel Ltd.
34 Jerusalem Road
Building A, 4th floor
Ra'anana, Israel 4350109
Tel : +972 (9) 7692306
8272306
Email: ydary@redhat.com
IRC : ydary