Re: [ovirt-devel] Fwd: DWH cannot gain hourly history data from db because of the bloody time problem.

From: "张亚琪" <zhangyingyun001(a)gmail.com&gt; To: Devel(a)ovirt.org Sent: Monday, November 17, 2014 3:51:07 AM Subject: [ovirt-devel] Fwd: DWH cannot gain hourly history data from db because of the bloody time problem. ---------- Forwarded message ---------- From: 张亚琪 < zhangyingyun001(a)gmail.com > Date: 2014-11-16 20:04 GMT+08:00 Subject: Re: [ovirt-devel] DWH cannot gain hourly history data from db because of the bloody time problem. To: Yaniv Dary < ydary(a)redhat.com > hi, Yaniv. Thank you for your reply. However, I think that there is no sync problem in my setup, because the engine, dwh and reports are in the same machine. As a new, I am not familiar with UTM time. And please see the attachment. Looking forward your reply. Thanks a lot. 2014-11-16 7:31 GMT+08:00 Yaniv Dary < ydary(a)redhat.com > : Are all your servers sync to the same ntp and in UTM time? Can you attach logs? Yaniv From: "张亚琪" < zhangyingyun001(a)gmail.com > To: Devel(a)ovirt.org Sent: Friday, November 14, 2014 11:22:38 AM Subject: [ovirt-devel] DWH cannot gain hourly history data from db because of the bloody time problem. hi everybody, Recently, I have tested oVirt Reports. And I encountered a problem about some reports that cannot show data. And then I setup the DWH development environment. I found maybe this reason for missing data is the AggregationToHourly3.5. When data from datacenter_samples_history were inserted to datacenter_hourly_history, u will find nothing happened. Because the select sql before inserting data reads： "SELECT history_id, history_datetime, datacenter_id, datacenter_status, minutes_in_status, datacenter_configuration_version FROM datacenter_samples_history WHERE history_datetime >= '"+context.lastHourAggr+ "' AND history_datetime < '"+TalendDate.addDate(context.lastHourAggr, 1,"HH")+"' ORDER BY history_datetime, datacenter_id, datacenter_status" And then I queried the table of datacenter_samples_history & history_configuration (has the field of lastHourAggr) in the db of ovirt_engine_history. The results are as follows: ovirt_engine_history=# select * from history_configuration; var_name | var_value | var_datetime -------------------+-----------+------------------------ MinimalETLVersion | 3.5.0 | default_language | en_US | firstSync | false | 2014-10-13 19:42:00+08 lastDayAggr | | 2014-11-14 00:00:00+08 lastHourAggr | | 2014- 11-15 06:00:00+08 HourlyAggFailed | false | (6 rows) ovirt_engine_history=# select history_datetime from datacenter_samples_history; history_datetime ---------------------------- 2014- 11-13 03:07:00.23+08 2014-11-13 03:08:00.238+08 2014-11-13 03:09:00.229+08 2014-11-13 03:10:00.221+08 2014-11-13 03:11:00.229+08 2014-11-13 03:12:00.221+08 2014-11-13 03:13:00.237+08 2014-11-13 03:14:00.22+08 2014-11-13 03:15:00.221+08 2014-11-13 03:16:00.238+08 2014-11-13 03:17:00.238+08 Obviously， history_datetime < lastHourAggr , the data will never be inserted to the datacenter_hourly_history. And the place where I bold is the root cause of the error. Then , I try to update the lastHourAggr in the table of history_configuration. Reports works successfully. However, the lastHourAggr will change to 2014-11-15 afterwards. But u know Today is 2014-11-14 ! I have no idea about why the value of lastHourAggr is 2014-11-15. Would u help me solve this problem. Thanks a lot ! _______________________________________________ Devel mailing list Devel(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/devel _______________________________________________ Devel mailing list Devel(a)ovirt.org http://lists.ovirt.org/mailman/listinfo/devel