Fwd: DWH cannot gain hourly history data from db because of the bloody time problem.
by 张亚琪
---------- Forwarded message ----------
From: 张亚琪 <zhangyingyun001(a)gmail.com>
Date: 2014-11-16 20:04 GMT+08:00
Subject: Re: [ovirt-devel] DWH cannot gain hourly history data from db
because of the bloody time problem.
To: Yaniv Dary <ydary(a)redhat.com>
hi, Yaniv. Thank you for your reply. However, I think that there is no sync
problem in my setup, because the engine, dwh and reports are in the same
machine. As a new, I am not familiar with UTM time.
And please see the attachment. Looking forward your reply. Thanks a lot.
2014-11-16 7:31 GMT+08:00 Yaniv Dary <ydary(a)redhat.com>:
> Are all your servers sync to the same ntp and in UTM time?
> Can you attach logs?
>
>
> Yaniv
>
> ------------------------------
>
> *From: *"张亚琪" <zhangyingyun001(a)gmail.com>
> *To: *Devel(a)ovirt.org
> *Sent: *Friday, November 14, 2014 11:22:38 AM
> *Subject: *[ovirt-devel] DWH cannot gain hourly history data from db
> because of the bloody time problem.
>
>
> hi everybody,
>
> Recently, I have tested oVirt Reports. And I encountered a problem
> about some reports that cannot show data. And then I setup the DWH
> development environment. I found maybe this reason for missing data is the
> AggregationToHourly3.5. When data from datacenter_samples_history were
> inserted to datacenter_hourly_history, u will find nothing happened.
> Because the select sql before inserting data reads：
>
> "SELECT history_id,
>>
>> history_datetime,
>>
>> datacenter_id,
>>
>> datacenter_status,
>>
>> minutes_in_status,
>>
>> datacenter_configuration_version
>>
>> FROM datacenter_samples_history
>>
>> WHERE *history_datetime >= '"+context.lastHourAggr+*"'
>>
>> AND history_datetime < '"+TalendDate.addDate(context.lastHourAggr,
>>> 1,"HH")+"'
>>
>> ORDER BY history_datetime,
>>
>> datacenter_id,
>>
>> datacenter_status"
>>
>>
>
> And then I queried the table of datacenter_samples_history &
> history_configuration (has the field of lastHourAggr) in the db
> of ovirt_engine_history. The results are as follows:
>
> ovirt_engine_history=# select * from history_configuration;
>>
>> var_name | var_value | var_datetime
>>
>> -------------------+-----------+------------------------
>>
>> MinimalETLVersion | 3.5.0 |
>>
>> default_language | en_US |
>>
>> firstSync | false | 2014-10-13 19:42:00+08
>>
>> lastDayAggr | | 2014-11-14 00:00:00+08
>>
>> * lastHourAggr | | *2014-*11-15* 06:00:00+08
>>
>> HourlyAggFailed | false |
>>
>> (6 rows)
>>
>>
>>
>
>
> ovirt_engine_history=# select *history_datetime* from
>> datacenter_samples_history;
>
> history_datetime
>
> ----------------------------
>
> 2014-*11-13* 03:07:00.23+08
>
> 2014-11-13 03:08:00.238+08
>
> 2014-11-13 03:09:00.229+08
>
> 2014-11-13 03:10:00.221+08
>
> 2014-11-13 03:11:00.229+08
>
> 2014-11-13 03:12:00.221+08
>
> 2014-11-13 03:13:00.237+08
>
> 2014-11-13 03:14:00.22+08
>
> 2014-11-13 03:15:00.221+08
>
> 2014-11-13 03:16:00.238+08
>
> 2014-11-13 03:17:00.238+08
>
>
>>
>
>
> Obviously， history_datetime < lastHourAggr , the data will never be
> inserted to the datacenter_hourly_history. And the place where I bold is
> the root cause of the error. Then , I try to update the *lastHourAggr *in
> the table of history_configuration. Reports works successfully. However,
> the lastHourAggr will change to 2014-11-15 afterwards. But u know Today is
> 2014-11-14 ! I have no idea about why the value of lastHourAggr is
> 2014-11-15. Would u help me solve this problem. Thanks a lot !
>
> _______________________________________________
> Devel mailing list
> Devel(a)ovirt.org
> http://lists.ovirt.org/mailman/listinfo/devel
>
>
>
10 years
[ATN] - on going outage in phx lab infra
by Eyal Edri
fyi,
there is an issue with the ovirt-engine server on phx lab, which causes some
of the jenkins vms to be inaccessible.
we've contacted the local team to help, but it might take some time since
they are in the US.
till then, jobs might be queued for a long time and possibly failing.
If you have an urgent patch to commit and can't wait, please verify it
locally (maybe bit more than you are used to) before merging.
the jenkins won't block you on if it's an infra issue.
we'll update once the outage is over.
Eyal.
10 years
Migrating from Fedora 19 to Fedora 20 with oVirt 3.5.0
by Sandro Bonazzola
Hi,
just finished testing migration path from F19 to F20 for systems running oVirt.
F19 is going EOL one month after F21 release which is currently planned for December 2nd.
If you're running oVirt on Fedora 19 I suggest you to do it once finished to upgrade oVirt to 3.5.0.
I've saved some notes in the test request bug[1]:
Bug 1131828 - Test upgrade path from Fedora 19 with oVirt 3.5.z to Fedora 20
Enjoy!
[1] https://bugzilla.redhat.com/show_bug.cgi?id=1131828
--
Sandro Bonazzola
Better technology. Faster innovation. Powered by community collaboration.
See how it works at redhat.com
10 years
DWH cannot gain hourly history data from db because of the bloody time problem.
by 张亚琪
hi everybody,
Recently, I have tested oVirt Reports. And I encountered a problem
about some reports that cannot show data. And then I setup the DWH
development environment. I found maybe this reason for missing data is the
AggregationToHourly3.5. When data from datacenter_samples_history were
inserted to datacenter_hourly_history, u will find nothing happened.
Because the select sql before inserting data reads：
"SELECT history_id,
>
> history_datetime,
>
> datacenter_id,
>
> datacenter_status,
>
> minutes_in_status,
>
> datacenter_configuration_version
>
> FROM datacenter_samples_history
>
> WHERE *history_datetime >= '"+context.lastHourAggr+*"'
>
> AND history_datetime < '"+TalendDate.addDate(context.lastHourAggr,
>> 1,"HH")+"'
>
> ORDER BY history_datetime,
>
> datacenter_id,
>
> datacenter_status"
>
>
And then I queried the table of datacenter_samples_history &
history_configuration (has the field of lastHourAggr) in the db
of ovirt_engine_history. The results are as follows:
ovirt_engine_history=# select * from history_configuration;
>
> var_name | var_value | var_datetime
>
> -------------------+-----------+------------------------
>
> MinimalETLVersion | 3.5.0 |
>
> default_language | en_US |
>
> firstSync | false | 2014-10-13 19:42:00+08
>
> lastDayAggr | | 2014-11-14 00:00:00+08
>
> * lastHourAggr | | *2014-*11-15* 06:00:00+08
>
> HourlyAggFailed | false |
>
> (6 rows)
>
>
>
ovirt_engine_history=# select *history_datetime* from
> datacenter_samples_history;
history_datetime
----------------------------
2014-*11-13* 03:07:00.23+08
2014-11-13 03:08:00.238+08
2014-11-13 03:09:00.229+08
2014-11-13 03:10:00.221+08
2014-11-13 03:11:00.229+08
2014-11-13 03:12:00.221+08
2014-11-13 03:13:00.237+08
2014-11-13 03:14:00.22+08
2014-11-13 03:15:00.221+08
2014-11-13 03:16:00.238+08
2014-11-13 03:17:00.238+08
>
Obviously， history_datetime < lastHourAggr , the data will never be
inserted to the datacenter_hourly_history. And the place where I bold is
the root cause of the error. Then , I try to update the *lastHourAggr *in
the table of history_configuration. Reports works successfully. However,
the lastHourAggr will change to 2014-11-15 afterwards. But u know Today is
2014-11-14 ! I have no idea about why the value of lastHourAggr is
2014-11-15. Would u help me solve this problem. Thanks a lot !
10 years
Error while building ovirt upstream
by Shubhendu Tripathi
Hi,
Today I rebased with master and getting below error while building the
engine.
[INFO] --- maven-compiler-plugin:2.3.2:compile (default-compile) @
vdsbroker ---
[INFO] Compiling 312 source files to
<Home>/work/ovirt-engine/backend/manager/modules/vdsbroker/target/classes
[INFO] -------------------------------------------------------------
[ERROR] COMPILATION ERROR :
[INFO] -------------------------------------------------------------
[ERROR] error: error reading
<Home>/.m2/repository/org/ovirt/vdsm-jsonrpc-java/vdsm-jsonrpc-java-client/1.1.0-SNAPSHOT/vdsm-jsonrpc-java-client-1.1.0-SNAPSHOT.jar;
error in opening zip file
[INFO] 1 error
Kindly help resolving the same.
Regards,
Shubhendu
10 years
[VOTE NEEDED] oVirt meetings schedule change proposal
by Sandro Bonazzola
Hi,
last oVirt sync meeting was skipped and the previous one was at risk due to a bit of confusion on DST changes.
oVirt sync meeting is the only meeting we have bound to UTC without DST changes.
Current scheduled meeting list is available here: http://www.ovirt.org/Meetings#Meeting_Time_and_Place
We don't have a reference timezone, we use: UTC, EDT, Asia/Jerusalem.
The UTC time zone has been deemed obsolete. It has been replaced by Etc/UTC and it doesn't use DST.
EDT is currently not observed in North America since DST isn't active. Locations are currently observing EST instead.
Asia/Jerusalem is following DST changes.
I suggest to unify the reference timezone.
Since it seems that using UTC causes issues in re-scheduling other local timezone tasks, I guess best solution is to follow the DST changes.
As nearest to UTC following DST I suggest Europe/London as timezone.
Comments are welcome.
--
Sandro Bonazzola
Better technology. Faster innovation. Powered by community collaboration.
See how it works at redhat.com
10 years
[QE][ACTION NEEDED] oVirt 3.5.1 RC status - branching
by Sandro Bonazzola
Hi,
We're going to start composing oVirt 3.5.1 RC on *2014-11-25 08:00 UTC* from 3.5 branch.
In order to stabilize the release a new branch ovirt-engine-3.5.1 will be created from the same git hash used for composing the RC.
Maintainers:
- Please be sure that 3.5 snapshot allow to create VMs before *2014-11-24 15:00 UTC*
- Please be sure that no pending patches are going to block the release before *2014-11-24 15:00 UTC*
- If any patch must block the RC release please raise the issue as soon as possible.
A bug tracker [1] has been opened and shows 2 open blocker:
Bug ID Whiteboard Status Summary
1142710 integration POST Volume creation failed while deploying Hosted Engine on iSCSI
1160846 sla NEW Can't add disk to VM without specifying disk profile when the storage domain has more than one disk profile
The following bugs have been keyworded as Regression and not marked as blockers:
Bug ID Whiteboard Status Summary
1106435 infra POST [AAA] builtin kerbldap provider does not show error if search fails
1138144 storage NEW [BLOCKED]Failed to autorecover storage domain after unblocking connection with host
1118349 storage NEW [vdsm] Creating DataCenter 3.5 using master domain V1 fails with InquireNotSupportedError
There are still 162 bugs [2] targeted to 3.5.1.
Excluding node and documentation bugs we still have 134 bugs [3] targeted to 3.5.1.
Maintainers / Assignee:
- Please review bugs marked as Regression and add to blocker if they're real regressions.
- Please add the bugs to the tracker if you think that 3.5.1 should not be released without them fixed.
- Please update the target to 3.5.2 or later for bugs that won't be in 3.5.1:
it will ease gathering the blocking bugs for next releases.
- Please fill release notes, the page has been created here [4]
Community:
- If you're testing oVirt 3.5 nightly snapshot, please add yourself to the test page [5]
[1] http://bugzilla.redhat.com/1155170
[2] http://goo.gl/7G0PDV
[3] http://goo.gl/6gUbVr
[4] http://www.ovirt.org/OVirt_3.5.1_Release_Notes
[5] http://www.ovirt.org/Testing/oVirt_3.5.1_Testing
--
Sandro Bonazzola
Better technology. Faster innovation. Powered by community collaboration.
See how it works at redhat.com
10 years
[ANN] oVirt snapshots available for testing on EL7
by Sandro Bonazzola
The oVirt team is pleased to announce that the 3.5 and master nightly snapshot repositories[1] have been update including builds for
Red Hat Enterprise Linux 7 (or similar) for testing.
Please note that mirrors may need usually one day before being synchronized.
If you want to be sure to use latest rpms and don't want to wait for the mirrors,
you can edit /etc/yum.repos.d/ovirt-3.5-snapshot.repo or /etc/yum.repos.d/ovirt-master-snapshot.repo commenting the mirror line and
removing the comment on baseurl line.
Thanks to everyone who will join us testing oVirt!
If you're testing oVirt 3.5 nightly snapshot, please add yourself to the test page [2]
[1] http://www.ovirt.org/Install_nightly_snapshot
[2] http://www.ovirt.org/Testing/oVirt_3.5.1_Testing
--
Sandro Bonazzola
Better technology. Faster innovation. Powered by community collaboration.
See how it works at redhat.com
10 years
