[ovirt-users] Large DWH Database, how to empty

[Matt .]

Hi Shirly,

OK, great! thanks for the clearification!

This might be updated and made more clear in the docs.

Thanks!

Matt

2017-01-25 14:41 GMT+01:00 Shirly Radco <sradco at redhat.com>:
> Please see at the to of this section:
> "The following is a list of options for configuring application settings for
> the Data Warehouse service. These options are available in the
> /usr/share/ovirt-engine-dwh/services/ovirt-engine-dwhd/ovirt-engine-dwhd.conf
> file. Configure any changes to the default values in an override file under
> /etc/ovirt-engine-dwh/ovirt-engine-dwhd.conf.d/. Restart the Data Warehouse
> service after saving the changes."
>
> So you need to add a file under
> /etc/ovirt-engine-dwh/ovirt-engine-dwhd.conf.d/
> The file name is not important. It should end with ".conf"
>
> Best regards,
>
> Shirly Radco
>
> BI Software Engineer
> Red Hat Israel Ltd.
> 34 Jerusalem Road
> Building A, 4th floor
> Ra'anana, Israel 4350109
>
>
> On Wed, Jan 25, 2017 at 1:06 PM, Matt . <yamakasi.014 at gmail.com> wrote:
>>
>> Hi Shirly,
>>
>> The reason why I ask is because the explanation here:
>>
>>
>> https://access.redhat.com/documentation/en/red-hat-virtualization/4.0/single/data-warehouse-guide/#Application_Settings_for_the_Data_Warehouse_service_in_ovirt-engine-dwhd.conf
>>
>>
>> 2017-01-24 10:49 GMT+01:00 Shirly Radco <sradco at redhat.com>:
>> > Hi,
>> >
>> > We don't update the ovirt-engine-dwhd.conf directly.
>> >
>> > You need to add the new file to  /ovirt-engine-dwhd.conf.d/ with the
>> > lines
>> > DWH_TABLES_KEEP_SAMPLES=
>> > DWH_TABLES_KEEP_HOURLY=
>> > DWH_TABLES_KEEP_DAILY=0
>> >
>> > and set the values for how much time you want the data to be kept.
>> > Keep in mind that the dashboards use the information from the samples
>> > and
>> > hourly tables for the last 24 hours.
>> >
>> > This file will overwrite the default configurations after you restart
>> > ovirt-engine-dwhd.
>> >
>> >
>> >
>> > Best regards,
>> >
>> > Shirly Radco
>> >
>> > BI Software Engineer
>> > Red Hat Israel Ltd.
>> > 34 Jerusalem Road
>> > Building A, 4th floor
>> > Ra'anana, Israel 4350109
>> >
>> >
>> > On Tue, Jan 24, 2017 at 11:43 AM, Matt . <yamakasi.014 at gmail.com> wrote:
>> >>
>> >> Shirly,
>> >>
>> >> I'm checking this out and aren't you sure the file is
>> >> update_time_to_keep_records.conf and not ovirt-engine-dwhd.conf ?
>> >>
>> >> 2017-01-09 14:01 GMT+01:00 Matt . <yamakasi.014 at gmail.com>:
>> >> > I think it did. Cluster exists 4 years now, hosted engine 7 months.
>> >> >
>> >> > 2017-01-08 13:50 GMT+01:00 Shirly Radco <sradco at redhat.com>:
>> >> >> No. But the delete process might have kicked in.
>> >> >> How long does you environment exist?
>> >> >>
>> >> >> Best regards,
>> >> >>
>> >> >> Shirly Radco
>> >> >>
>> >> >> BI Software Engineer
>> >> >> Red Hat Israel Ltd.
>> >> >> 34 Jerusalem Road
>> >> >> Building A, 4th floor
>> >> >> Ra'anana, Israel 4350109
>> >> >>
>> >> >>
>> >> >> On Sun, Jan 8, 2017 at 2:42 PM, Matt . <yamakasi.014 at gmail.com>
>> >> >> wrote:
>> >> >>>
>> >> >>> Hi,
>> >> >>>
>> >> >>> OK thanks! I saw that after upgrading to 4.0.5 from 4.0.4 the DB
>> >> >>> already dropped with around 500MB directly and is now at 2GB
>> >> >>> smaller.
>> >> >>>
>> >> >>> Does this sounds familiar to you with other settings in 4.0.5 ?
>> >> >>>
>> >> >>>
>> >> >>> Thanks,
>> >> >>>
>> >> >>> Matt
>> >> >>>
>> >> >>>
>> >> >>>
>> >> >>> 2017-01-08 10:45 GMT+01:00 Shirly Radco <sradco at redhat.com>:
>> >> >>> > No. That will corrupt your database.
>> >> >>> >
>> >> >>> > Are you using the full dwh or the smaller version for the
>> >> >>> > dashboards?
>> >> >>> >
>> >> >>> > Please set the delete thresholds to save less data and the data
>> >> >>> > older
>> >> >>> > then
>> >> >>> > the time you set will be deleted.
>> >> >>> > Add a file to /ovirt-engine-dwhd.conf.d/
>> >> >>> > update_time_to_keep_records.conf
>> >> >>> >
>> >> >>> > Add these lines with the new configurations. The numbers
>> >> >>> > represent
>> >> >>> > the
>> >> >>> > hours
>> >> >>> > to keep the data.
>> >> >>> >
>> >> >>> > DWH_TABLES_KEEP_SAMPLES=24
>> >> >>> > DWH_TABLES_KEEP_HOURLY=1440
>> >> >>> > DWH_TABLES_KEEP_DAILY=43800
>> >> >>> >
>> >> >>> >
>> >> >>> > These are the configurations for a full dwh.
>> >> >>> >
>> >> >>> > The smaller version configurations are:
>> >> >>> > DWH_TABLES_KEEP_SAMPLES=24
>> >> >>> > DWH_TABLES_KEEP_HOURLY=720
>> >> >>> > DWH_TABLES_KEEP_DAILY=0
>> >> >>> >
>> >> >>> > The delete process by default at 3am every day
>> >> >>> > (DWH_DELETE_JOB_HOUR=3)
>> >> >>> >
>> >> >>> > Best regards,
>> >> >>> >
>> >> >>> > Shirly Radco
>> >> >>> >
>> >> >>> > BI Software Engineer
>> >> >>> > Red Hat Israel Ltd.
>> >> >>> > 34 Jerusalem Road
>> >> >>> > Building A, 4th floor
>> >> >>> > Ra'anana, Israel 4350109
>> >> >>> >
>> >> >>> >
>> >> >>> > On Fri, Jan 6, 2017 at 6:35 PM, Matt . <yamakasi.014 at gmail.com>
>> >> >>> > wrote:
>> >> >>> >>
>> >> >>> >> Hi,
>> >> >>> >>
>> >> >>> >> I seem to have some large database for the DWH logging and I
>> >> >>> >> wonder
>> >> >>> >> how I can empty it safely.
>> >> >>> >>
>> >> >>> >> Can I just simply empty the database ?
>> >> >>> >>
>> >> >>> >> Have a good weekend!
>> >> >>> >>
>> >> >>> >> Cheers,
>> >> >>> >>
>> >> >>> >> Matt
>> >> >>> >> _______________________________________________
>> >> >>> >> Users mailing list
>> >> >>> >> Users at ovirt.org
>> >> >>> >> http://lists.ovirt.org/mailman/listinfo/users
>> >> >>> >
>> >> >>> >
>> >> >>
>> >> >>
>> >
>> >
>
>