[ovirt-users] dwh not receiving any data
Punit Dambiwal
hypunit at gmail.com
Wed Feb 4 01:33:24 UTC 2015
Hi,
VM is up and running and to make the graph....i manually make some dd and
cpu stress on the VM....
I created the dump with Ovirt backup tool....
engine-backup --mode=backup --scope=db --file=BACKUP_FILE --log=LOG_FILE
I also communicated with ovirt-china community...they found that there is
some time difference between postgres and jdk...
[image: Inline image 1]
Thanks,
Punit
Thanks,
Punit
On Tue, Feb 3, 2015 at 7:30 PM, Yaniv Dary <ydary at redhat.com> wrote:
> Also is there a chance the vm was shutdown?
>
>
>
> On 02/03/2015 01:29 PM, Yaniv Dary wrote:
>
>> The logs seem ok, is there a chance you simply don't have activity after
>> 17:00?
>> try to hover around the bottom of the graph a tool tip should appear if
>> the value and if it's 0%.
>>
>>
>> On 02/03/2015 08:31 AM, Punit Dambiwal wrote:
>>
>>> Hi Shirly,
>>>
>>> Please find the attached log files...
>>>
>>> On Tue, Feb 3, 2015 at 1:56 PM, Shirly Radco <sradco at redhat.com <mailto:
>>> sradco at redhat.com>> wrote:
>>>
>>> Hi Punit,
>>>
>>> Please send me first the logs so we can see if this is still the
>>> same issue.
>>> /var/log/ovirt-engine
>>> /var/log/ovirt-engine-dwh
>>> /var/log/ovirt-engine-reports
>>>
>>> Best regards,
>>> ---
>>> Shirly Radco
>>> BI Software Engineer
>>> Red Hat Israel Ltd.
>>>
>>>
>>> ----- Original Message -----
>>> > From: "Punit Dambiwal" <hypunit at gmail.com
>>> <mailto:hypunit at gmail.com>>
>>> > To: "Shirly Radco" <sradco at redhat.com <mailto:sradco at redhat.com>>
>>> > Cc: "David van zeebroeck" <david at analytics.brusselsairport.be
>>> <mailto:david at analytics.brusselsairport.be>>, "Joop"
>>> <jvdwege at xs4all.nl <mailto:jvdwege at xs4all.nl>>, users at ovirt.org
>>> <mailto:users at ovirt.org>
>>> > Sent: Tuesday, February 3, 2015 5:50:57 AM
>>> > Subject: Re: [ovirt-users] dwh not receiving any data
>>> >
>>> > Hi Shirly,
>>> >
>>> > It seems resolved but actually not....again after 12 hours it
>>> stopped
>>> > working...
>>> >
>>> > [image: Inline image 1]
>>> > [image: Inline image 3]
>>> >
>>> > It stopped working after 5:00 AM....yesterday (2nd Feb) started
>>> at evening
>>> > 17:00 PM...and stopped today 3rd Feb 5:00 AM....
>>> >
>>> > [image: Inline image 4]
>>> >
>>> > Please let me know how i can take the dump of engine and dwh to
>>> you....
>>> >
>>> > Thanks,
>>> > Punit
>>> >
>>> > On Tue, Feb 3, 2015 at 9:34 AM, Punit Dambiwal
>>> <hypunit at gmail.com <mailto:hypunit at gmail.com>> wrote:
>>> >
>>> > > Hi,
>>> > >
>>> > > My issue resolved by remove the dwh and reports and reinstall
>>> > > again......also i found that my server time was correct and
>>> updated but the
>>> > > postgresql time was different form the server time.....above
>>> two changes
>>> > > made it work...
>>> > >
>>> > > Thanks,
>>> > > punit
>>> > >
>>> > > On Mon, Feb 2, 2015 at 8:25 PM, Shirly Radco
>>> <sradco at redhat.com <mailto:sradco at redhat.com>> wrote:
>>> > >
>>> > >> Hi,
>>> > >>
>>> > >> If any of you can send me the engine and ovirt_engine_dwh dump,
>>> > >> I will upload them in my development environment and see what
>>> is the
>>> > >> issue.
>>> > >>
>>> > >> Best regards,
>>> > >> ---
>>> > >> Shirly Radco
>>> > >> BI Software Engineer
>>> > >> Red Hat Israel Ltd.
>>> > >>
>>> > >>
>>> > >> ----- Original Message -----
>>> > >> > From: "Shirly Radco" <sradco at redhat.com
>>> <mailto:sradco at redhat.com>>
>>> > >> > To: "David van zeebroeck"
>>> <david at analytics.brusselsairport.be
>>> <mailto:david at analytics.brusselsairport.be>>
>>> > >> > Cc: users at ovirt.org <mailto:users at ovirt.org>
>>> > >> > Sent: Monday, February 2, 2015 1:04:24 PM
>>> > >> > Subject: Re: [ovirt-users] dwh not receiving any data
>>> > >> >
>>> > >> > Hi David,
>>> > >> >
>>> > >> > Please update me on what you found.
>>> > >> >
>>> > >> > Best regards,
>>> > >> > ---
>>> > >> > Shirly Radco
>>> > >> > BI Software Engineer
>>> > >> > Red Hat Israel Ltd.
>>> > >> >
>>> > >> >
>>> > >> > ----- Original Message -----
>>> > >> > > From: "Shirly Radco" <sradco at redhat.com
>>> <mailto:sradco at redhat.com>>
>>> > >> > > To: "David van zeebroeck"
>>> <david at analytics.brusselsairport.be
>>> <mailto:david at analytics.brusselsairport.be>>
>>> > >> > > Cc: users at ovirt.org <mailto:users at ovirt.org>
>>> > >> > > Sent: Sunday, February 1, 2015 11:24:10 AM
>>> > >> > > Subject: Re: [ovirt-users] dwh not receiving any data
>>> > >> > >
>>> > >> > > Hi David,
>>> > >> > >
>>> > >> > > It means that for some reason user with user_id
>>> > >> > > ab932902-cead-4435-a2b6-8b88576feab6
>>> > >> > > was not added to users_details_history.
>>> > >> > > And this is why the etl can't update the
>>> vm_samples_history table on
>>> > >> the
>>> > >> > > ovirt_engine_history database.
>>> > >> > >
>>> > >> > > Please check if this user_id
>>> ab932902-cead-4435-a2b6-8b88576feab6
>>> > >> exists in
>>> > >> > > the "dwh_users_history_view" or in the users table in the
>>> engine
>>> > >> database.
>>> > >> > >
>>> > >> > > Select * From dwh_users_history_view
>>> > >> > > Where user_id = 'ab932902-cead-4435-a2b6-8b88576feab6';
>>> > >> > >
>>> > >> > > Best regards,
>>> > >> > > ---
>>> > >> > > Shirly Radco
>>> > >> > > BI Software Engineer
>>> > >> > > Red Hat Israel Ltd.
>>> > >> > >
>>> > >> > >
>>> > >> > > ----- Original Message -----
>>> > >> > > > From: "David van zeebroeck"
>>> <david at analytics.brusselsairport.be
>>> <mailto:david at analytics.brusselsairport.be>>
>>> > >> > > > To: users at ovirt.org <mailto:users at ovirt.org>
>>> > >> > > > Sent: Thursday, January 29, 2015 5:10:01 PM
>>> > >> > > > Subject: [ovirt-users] dwh not receiving any data
>>> > >> > > >
>>> > >> > > > hi
>>> > >> > > > we are running ovirt 3.5.1 and we are trying to setup
>>> the dwh part
>>> > >> > > > install and setup appears to run fine but when starting
>>> the service
>>> > >> we
>>> > >> > > > see
>>> > >> > > > following error in the log file :
>>> > >> > > >
>>> > >> > > > 2015-01-29 16:06:26|ETL Service Started
>>> > >> > > > Exception in component tJDBCOutput_5
>>> > >> > > > org.postgresql.util.PSQLException: ERROR: insert or
>>> update on table
>>> > >> > > > "vm_samples_history" violates foreign key constraint
>>> > >> > > > "vm_samples_history_current_user_id_fkey"
>>> > >> > > > Detail: Key
>>> > >> (current_user_id)=(ab932902-cead-4435-a2b6-8b88576feab6) is
>>> > >> > > > not
>>> > >> > > > present in table "users_details_history".
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(
>>> QueryExecutorImpl.java:2062)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.core.v3.QueryExecutorImpl.processResults(
>>> QueryExecutorImpl.java:1795)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.core.v3.QueryExecutorImpl.execute(
>>> QueryExecutorImpl.java:257)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(
>>> AbstractJdbc2Statement.java:479)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(
>>> AbstractJdbc2Statement.java:367)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(
>>> AbstractJdbc2Statement.java:321)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_
>>> 10Process(StatisticsSync.java:10482)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$6.run(
>>> StatisticsSync.java:17437)
>>> > >> > > > Exception in component tJDBCOutput_6
>>> > >> > > > org.postgresql.util.PSQLException: ERROR: current
>>> transaction is
>>> > >> aborted,
>>> > >> > > > commands ignored until end of transaction block
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(
>>> QueryExecutorImpl.java:2062)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.core.v3.QueryExecutorImpl.processResults(
>>> QueryExecutorImpl.java:1795)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.core.v3.QueryExecutorImpl.execute(
>>> QueryExecutorImpl.java:257)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(
>>> AbstractJdbc2Statement.java:479)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(
>>> AbstractJdbc2Statement.java:367)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(
>>> AbstractJdbc2Statement.java:321)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_
>>> 12Process(StatisticsSync.java:12689)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$7.run(
>>> StatisticsSync.java:17483)
>>> > >> > > > Exception in component tJDBCOutput_7
>>> > >> > > > org.postgresql.util.PSQLException: ERROR: current
>>> transaction is
>>> > >> aborted,
>>> > >> > > > commands ignored until end of transaction block
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(
>>> QueryExecutorImpl.java:2062)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.core.v3.QueryExecutorImpl.processResults(
>>> QueryExecutorImpl.java:1795)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.core.v3.QueryExecutorImpl.execute(
>>> QueryExecutorImpl.java:257)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(
>>> AbstractJdbc2Statement.java:479)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(
>>> AbstractJdbc2Statement.java:367)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(
>>> AbstractJdbc2Statement.java:321)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_
>>> 18Process(StatisticsSync.java:14806)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$8.run(
>>> StatisticsSync.java:17529)
>>> > >> > > > Exception in component tJDBCOutput_4
>>> > >> > > > org.postgresql.util.PSQLException: ERROR: current
>>> transaction is
>>> > >> aborted,
>>> > >> > > > commands ignored until end of transaction block
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(
>>> QueryExecutorImpl.java:2062)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.core.v3.QueryExecutorImpl.processResults(
>>> QueryExecutorImpl.java:1795)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.core.v3.QueryExecutorImpl.execute(
>>> QueryExecutorImpl.java:257)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.jdbc2.AbstractJdbc2Statement.execute(
>>> AbstractJdbc2Statement.java:479)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeWithFlags(
>>> AbstractJdbc2Statement.java:367)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> org.postgresql.jdbc2.AbstractJdbc2Statement.executeUpdate(
>>> AbstractJdbc2Statement.java:321)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync.tJDBCInput_
>>> 8Process(StatisticsSync.java:7788)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.statisticssync_3_5.StatisticsSync$5.run(
>>> StatisticsSync.java:17391)
>>> > >> > > > 2015-01-29
>>> > >> > > >
>>> > >>
>>> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|
>>> StatisticsSync|Default|6|Java
>>> > >> > > >
>>> Exception|tJDBCOutput_7|org.postgresql.util.PSQLException:ERROR:
>>> > >> current
>>> > >> > > > transaction is aborted, commands ignored until end of
>>> transaction
>>> > >> block|1
>>> > >> > > > 2015-01-29
>>> > >> > > >
>>> > >>
>>> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|
>>> StatisticsSync|Default|6|Java
>>> > >> > > >
>>> Exception|tJDBCOutput_5|org.postgresql.util.PSQLException:ERROR:
>>> > >> insert
>>> > >> > > > or
>>> > >> > > > update on table "vm_samples_history" violates foreign
>>> key constraint
>>> > >> > > > "vm_samples_history_current_user_id_fkey"
>>> > >> > > > Detail: Key
>>> > >> (current_user_id)=(ab932902-cead-4435-a2b6-8b88576feab6) is
>>> > >> > > > not
>>> > >> > > > present in table "users_details_history".|1
>>> > >> > > > 2015-01-29
>>> > >> > > >
>>> > >>
>>> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|
>>> StatisticsSync|Default|6|Java
>>> > >> > > >
>>> Exception|tJDBCOutput_6|org.postgresql.util.PSQLException:ERROR:
>>> > >> current
>>> > >> > > > transaction is aborted, commands ignored until end of
>>> transaction
>>> > >> block|1
>>> > >> > > > 2015-01-29
>>> > >> > > >
>>> > >>
>>> 16:07:04|kGEf8p|YhA1NE|VVdF7H|OVIRT_ENGINE_DWH|
>>> StatisticsSync|Default|6|Java
>>> > >> > > >
>>> Exception|tJDBCOutput_4|org.postgresql.util.PSQLException:ERROR:
>>> > >> current
>>> > >> > > > transaction is aborted, commands ignored until end of
>>> transaction
>>> > >> block|1
>>> > >> > > > Exception in component tRunJob_5
>>> > >> > > > java.lang.RuntimeException: Child job running failed
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_
>>> 5Process(SampleRunJobs.java:1598)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_
>>> 6Process(SampleRunJobs.java:1412)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_
>>> 1Process(SampleRunJobs.java:1197)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tRunJob_
>>> 4Process(SampleRunJobs.java:982)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tJDBCConnection_
>>> 2Process(SampleRunJobs.java:762)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs.tJDBCConnection_
>>> 1Process(SampleRunJobs.java:641)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.samplerunjobs_3_5.SampleRunJobs$2.run(
>>> SampleRunJobs.java:2560)
>>> > >> > > > 2015-01-29
>>> > >> > > >
>>> > >>
>>> 16:07:04|VVdF7H|YhA1NE|XpLXfK|OVIRT_ENGINE_DWH|
>>> SampleRunJobs|Default|6|Java
>>> > >> > > > Exception|tRunJob_5|java.lang.RuntimeException:Child
>>> job running
>>> > >> failed|1
>>> > >> > > > Exception in component tRunJob_1
>>> > >> > > > java.lang.RuntimeException: Child job running failed
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.tRunJob_
>>> 1Process(SampleTimeKeepingJob.java:5941)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
>>> tJDBCInput_2Process(SampleTimeKeepingJob.java:5707)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
>>> tJDBCConnection_1Process(SampleTimeKeepingJob.java:4340)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
>>> tJDBCConnection_2Process(SampleTimeKeepingJob.java:4219)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
>>> tRowGenerator_2Process(SampleTimeKeepingJob.java:4092)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
>>> tJDBCInput_3Process(SampleTimeKeepingJob.java:3505)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
>>> tJDBCInput_5Process(SampleTimeKeepingJob.java:2877)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
>>> tJDBCInput_4Process(SampleTimeKeepingJob.java:2191)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob.
>>> tJDBCConnection_3Process(SampleTimeKeepingJob.java:1537)
>>> > >> > > > at
>>> > >> > > >
>>> > >>
>>> ovirt_engine_dwh.sampletimekeepingjob_3_5.SampleTimeKeepingJob$2.run(
>>> SampleTimeKeepingJob.java:9546)
>>> > >> > > >
>>> > >> > > >
>>> > >> > > > _______________________________________________
>>> > >> > > > Users mailing list
>>> > >> > > > Users at ovirt.org <mailto:Users at ovirt.org>
>>> > >> > > > http://lists.ovirt.org/mailman/listinfo/users
>>> > >> > > >
>>> > >> > > _______________________________________________
>>> > >> > > Users mailing list
>>> > >> > > Users at ovirt.org <mailto:Users at ovirt.org>
>>> > >> > > http://lists.ovirt.org/mailman/listinfo/users
>>> > >> > >
>>> > >> > _______________________________________________
>>> > >> > Users mailing list
>>> > >> > Users at ovirt.org <mailto:Users at ovirt.org>
>>> > >> > http://lists.ovirt.org/mailman/listinfo/users
>>> > >> >
>>> > >>
>>> > >
>>> > >
>>> >
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> Users mailing list
>>> Users at ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/users
>>>
>>
>>
> --
> Yaniv Dary
> Red Hat Israel Ltd.
> 34 Jerusalem Road
> Building A, 4th floor
> Ra'anana, Israel 4350109
>
> Tel : +972 (9) 7692306
> 8272306
> Email: ydary at redhat.com
> IRC : ydary
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20150204/3a348427/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 28397 bytes
Desc: not available
URL: <http://lists.ovirt.org/pipermail/users/attachments/20150204/3a348427/attachment-0001.png>
More information about the Users
mailing list