Re: [ovirt-users] Large DWH Database, how to empty
No. But the delete process might have kicked in. How long does you environment exist? Best regards, Shirly Radco BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109 On Sun, Jan 8, 2017 at 2:42 PM, Matt . <yamakasi.014@gmail.com> wrote:
Hi,
OK thanks! I saw that after upgrading to 4.0.5 from 4.0.4 the DB already dropped with around 500MB directly and is now at 2GB smaller.
Does this sounds familiar to you with other settings in 4.0.5 ?
Thanks,
Matt
No. That will corrupt your database.
Are you using the full dwh or the smaller version for the dashboards?
Please set the delete thresholds to save less data and the data older
2017-01-08 10:45 GMT+01:00 Shirly Radco <sradco@redhat.com>: then
the time you set will be deleted. Add a file to /ovirt-engine-dwhd.conf.d/ update_time_to_keep_records.conf
Add these lines with the new configurations. The numbers represent the hours to keep the data.
DWH_TABLES_KEEP_SAMPLES=24 DWH_TABLES_KEEP_HOURLY=1440 DWH_TABLES_KEEP_DAILY=43800
These are the configurations for a full dwh.
The smaller version configurations are: DWH_TABLES_KEEP_SAMPLES=24 DWH_TABLES_KEEP_HOURLY=720 DWH_TABLES_KEEP_DAILY=0
The delete process by default at 3am every day (DWH_DELETE_JOB_HOUR=3)
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Fri, Jan 6, 2017 at 6:35 PM, Matt . <yamakasi.014@gmail.com> wrote:
Hi,
I seem to have some large database for the DWH logging and I wonder how I can empty it safely.
Can I just simply empty the database ?
Have a good weekend!
Cheers,
Matt _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
I think it did. Cluster exists 4 years now, hosted engine 7 months. 2017-01-08 13:50 GMT+01:00 Shirly Radco <sradco@redhat.com>:
No. But the delete process might have kicked in. How long does you environment exist?
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Sun, Jan 8, 2017 at 2:42 PM, Matt . <yamakasi.014@gmail.com> wrote:
Hi,
OK thanks! I saw that after upgrading to 4.0.5 from 4.0.4 the DB already dropped with around 500MB directly and is now at 2GB smaller.
Does this sounds familiar to you with other settings in 4.0.5 ?
Thanks,
Matt
2017-01-08 10:45 GMT+01:00 Shirly Radco <sradco@redhat.com>:
No. That will corrupt your database.
Are you using the full dwh or the smaller version for the dashboards?
Please set the delete thresholds to save less data and the data older then the time you set will be deleted. Add a file to /ovirt-engine-dwhd.conf.d/ update_time_to_keep_records.conf
Add these lines with the new configurations. The numbers represent the hours to keep the data.
DWH_TABLES_KEEP_SAMPLES=24 DWH_TABLES_KEEP_HOURLY=1440 DWH_TABLES_KEEP_DAILY=43800
These are the configurations for a full dwh.
The smaller version configurations are: DWH_TABLES_KEEP_SAMPLES=24 DWH_TABLES_KEEP_HOURLY=720 DWH_TABLES_KEEP_DAILY=0
The delete process by default at 3am every day (DWH_DELETE_JOB_HOUR=3)
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Fri, Jan 6, 2017 at 6:35 PM, Matt . <yamakasi.014@gmail.com> wrote:
Hi,
I seem to have some large database for the DWH logging and I wonder how I can empty it safely.
Can I just simply empty the database ?
Have a good weekend!
Cheers,
Matt _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Shirly, I'm checking this out and aren't you sure the file is update_time_to_keep_records.conf and not ovirt-engine-dwhd.conf ? 2017-01-09 14:01 GMT+01:00 Matt . <yamakasi.014@gmail.com>:
I think it did. Cluster exists 4 years now, hosted engine 7 months.
2017-01-08 13:50 GMT+01:00 Shirly Radco <sradco@redhat.com>:
No. But the delete process might have kicked in. How long does you environment exist?
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Sun, Jan 8, 2017 at 2:42 PM, Matt . <yamakasi.014@gmail.com> wrote:
Hi,
OK thanks! I saw that after upgrading to 4.0.5 from 4.0.4 the DB already dropped with around 500MB directly and is now at 2GB smaller.
Does this sounds familiar to you with other settings in 4.0.5 ?
Thanks,
Matt
2017-01-08 10:45 GMT+01:00 Shirly Radco <sradco@redhat.com>:
No. That will corrupt your database.
Are you using the full dwh or the smaller version for the dashboards?
Please set the delete thresholds to save less data and the data older then the time you set will be deleted. Add a file to /ovirt-engine-dwhd.conf.d/ update_time_to_keep_records.conf
Add these lines with the new configurations. The numbers represent the hours to keep the data.
DWH_TABLES_KEEP_SAMPLES=24 DWH_TABLES_KEEP_HOURLY=1440 DWH_TABLES_KEEP_DAILY=43800
These are the configurations for a full dwh.
The smaller version configurations are: DWH_TABLES_KEEP_SAMPLES=24 DWH_TABLES_KEEP_HOURLY=720 DWH_TABLES_KEEP_DAILY=0
The delete process by default at 3am every day (DWH_DELETE_JOB_HOUR=3)
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Fri, Jan 6, 2017 at 6:35 PM, Matt . <yamakasi.014@gmail.com> wrote:
Hi,
I seem to have some large database for the DWH logging and I wonder how I can empty it safely.
Can I just simply empty the database ?
Have a good weekend!
Cheers,
Matt _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi, We don't update the ovirt-engine-dwhd.conf directly. You need to add the new file to /ovirt-engine-dwhd.conf.d/ with the lines DWH_TABLES_KEEP_SAMPLES= DWH_TABLES_KEEP_HOURLY= DWH_TABLES_KEEP_DAILY=0 and set the values for how much time you want the data to be kept. Keep in mind that the dashboards use the information from the samples and hourly tables for the last 24 hours. This file will overwrite the default configurations after you restart ovirt-engine-dwhd. Best regards, Shirly Radco BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109 On Tue, Jan 24, 2017 at 11:43 AM, Matt . <yamakasi.014@gmail.com> wrote:
Shirly,
I'm checking this out and aren't you sure the file is update_time_to_keep_records.conf and not ovirt-engine-dwhd.conf ?
I think it did. Cluster exists 4 years now, hosted engine 7 months.
2017-01-08 13:50 GMT+01:00 Shirly Radco <sradco@redhat.com>:
No. But the delete process might have kicked in. How long does you environment exist?
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Sun, Jan 8, 2017 at 2:42 PM, Matt . <yamakasi.014@gmail.com> wrote:
Hi,
OK thanks! I saw that after upgrading to 4.0.5 from 4.0.4 the DB already dropped with around 500MB directly and is now at 2GB smaller.
Does this sounds familiar to you with other settings in 4.0.5 ?
Thanks,
Matt
2017-01-08 10:45 GMT+01:00 Shirly Radco <sradco@redhat.com>:
No. That will corrupt your database.
Are you using the full dwh or the smaller version for the dashboards?
Please set the delete thresholds to save less data and the data older then the time you set will be deleted. Add a file to /ovirt-engine-dwhd.conf.d/ update_time_to_keep_records.conf
Add these lines with the new configurations. The numbers represent
2017-01-09 14:01 GMT+01:00 Matt . <yamakasi.014@gmail.com>: the
hours to keep the data.
DWH_TABLES_KEEP_SAMPLES=24 DWH_TABLES_KEEP_HOURLY=1440 DWH_TABLES_KEEP_DAILY=43800
These are the configurations for a full dwh.
The smaller version configurations are: DWH_TABLES_KEEP_SAMPLES=24 DWH_TABLES_KEEP_HOURLY=720 DWH_TABLES_KEEP_DAILY=0
The delete process by default at 3am every day (DWH_DELETE_JOB_HOUR=3)
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Fri, Jan 6, 2017 at 6:35 PM, Matt . <yamakasi.014@gmail.com> wrote:
Hi,
I seem to have some large database for the DWH logging and I wonder how I can empty it safely.
Can I just simply empty the database ?
Have a good weekend!
Cheers,
Matt _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Shirly, The reason why I ask is because the explanation here: https://access.redhat.com/documentation/en/red-hat-virtualization/4.0/single... 2017-01-24 10:49 GMT+01:00 Shirly Radco <sradco@redhat.com>:
Hi,
We don't update the ovirt-engine-dwhd.conf directly.
You need to add the new file to /ovirt-engine-dwhd.conf.d/ with the lines DWH_TABLES_KEEP_SAMPLES= DWH_TABLES_KEEP_HOURLY= DWH_TABLES_KEEP_DAILY=0
and set the values for how much time you want the data to be kept. Keep in mind that the dashboards use the information from the samples and hourly tables for the last 24 hours.
This file will overwrite the default configurations after you restart ovirt-engine-dwhd.
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Tue, Jan 24, 2017 at 11:43 AM, Matt . <yamakasi.014@gmail.com> wrote:
Shirly,
I'm checking this out and aren't you sure the file is update_time_to_keep_records.conf and not ovirt-engine-dwhd.conf ?
2017-01-09 14:01 GMT+01:00 Matt . <yamakasi.014@gmail.com>:
I think it did. Cluster exists 4 years now, hosted engine 7 months.
2017-01-08 13:50 GMT+01:00 Shirly Radco <sradco@redhat.com>:
No. But the delete process might have kicked in. How long does you environment exist?
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Sun, Jan 8, 2017 at 2:42 PM, Matt . <yamakasi.014@gmail.com> wrote:
Hi,
OK thanks! I saw that after upgrading to 4.0.5 from 4.0.4 the DB already dropped with around 500MB directly and is now at 2GB smaller.
Does this sounds familiar to you with other settings in 4.0.5 ?
Thanks,
Matt
2017-01-08 10:45 GMT+01:00 Shirly Radco <sradco@redhat.com>:
No. That will corrupt your database.
Are you using the full dwh or the smaller version for the dashboards?
Please set the delete thresholds to save less data and the data older then the time you set will be deleted. Add a file to /ovirt-engine-dwhd.conf.d/ update_time_to_keep_records.conf
Add these lines with the new configurations. The numbers represent the hours to keep the data.
DWH_TABLES_KEEP_SAMPLES=24 DWH_TABLES_KEEP_HOURLY=1440 DWH_TABLES_KEEP_DAILY=43800
These are the configurations for a full dwh.
The smaller version configurations are: DWH_TABLES_KEEP_SAMPLES=24 DWH_TABLES_KEEP_HOURLY=720 DWH_TABLES_KEEP_DAILY=0
The delete process by default at 3am every day (DWH_DELETE_JOB_HOUR=3)
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Fri, Jan 6, 2017 at 6:35 PM, Matt . <yamakasi.014@gmail.com> wrote: > > Hi, > > I seem to have some large database for the DWH logging and I wonder > how I can empty it safely. > > Can I just simply empty the database ? > > Have a good weekend! > > Cheers, > > Matt > _______________________________________________ > Users mailing list > Users@ovirt.org > http://lists.ovirt.org/mailman/listinfo/users
Please see at the to of this section: "The following is a list of options for configuring application settings for the Data Warehouse service. These options are available in the /usr/share/ovirt-engine-dwh/services/ovirt-engine-dwhd/ovirt-engine-dwhd.conf file. *Configure any changes to the default values in an override file under /etc/ovirt-engine-dwh/ovirt-engine-dwhd.conf.d/. Restart the Data Warehouse service after saving the changes."* So you need to add a file under */etc/ovirt-engine-dwh/ovirt-engine-dwhd.conf.d/* The file name is not important. It should end with ".conf" Best regards, Shirly Radco BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109 On Wed, Jan 25, 2017 at 1:06 PM, Matt . <yamakasi.014@gmail.com> wrote:
Hi Shirly,
The reason why I ask is because the explanation here:
https://access.redhat.com/documentation/en/red-hat- virtualization/4.0/single/data-warehouse-guide/# Application_Settings_for_the_Data_Warehouse_service_in_ ovirt-engine-dwhd.conf
Hi,
We don't update the ovirt-engine-dwhd.conf directly.
You need to add the new file to /ovirt-engine-dwhd.conf.d/ with the
2017-01-24 10:49 GMT+01:00 Shirly Radco <sradco@redhat.com>: lines
DWH_TABLES_KEEP_SAMPLES= DWH_TABLES_KEEP_HOURLY= DWH_TABLES_KEEP_DAILY=0
and set the values for how much time you want the data to be kept. Keep in mind that the dashboards use the information from the samples and hourly tables for the last 24 hours.
This file will overwrite the default configurations after you restart ovirt-engine-dwhd.
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Tue, Jan 24, 2017 at 11:43 AM, Matt . <yamakasi.014@gmail.com> wrote:
Shirly,
I'm checking this out and aren't you sure the file is update_time_to_keep_records.conf and not ovirt-engine-dwhd.conf ?
2017-01-09 14:01 GMT+01:00 Matt . <yamakasi.014@gmail.com>:
I think it did. Cluster exists 4 years now, hosted engine 7 months.
2017-01-08 13:50 GMT+01:00 Shirly Radco <sradco@redhat.com>:
No. But the delete process might have kicked in. How long does you environment exist?
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Sun, Jan 8, 2017 at 2:42 PM, Matt . <yamakasi.014@gmail.com>
wrote:
Hi,
OK thanks! I saw that after upgrading to 4.0.5 from 4.0.4 the DB already dropped with around 500MB directly and is now at 2GB
smaller.
Does this sounds familiar to you with other settings in 4.0.5 ?
Thanks,
Matt
2017-01-08 10:45 GMT+01:00 Shirly Radco <sradco@redhat.com>: > No. That will corrupt your database. > > Are you using the full dwh or the smaller version for the > dashboards? > > Please set the delete thresholds to save less data and the data > older > then > the time you set will be deleted. > Add a file to /ovirt-engine-dwhd.conf.d/ > update_time_to_keep_records.conf > > Add these lines with the new configurations. The numbers represent > the > hours > to keep the data. > > DWH_TABLES_KEEP_SAMPLES=24 > DWH_TABLES_KEEP_HOURLY=1440 > DWH_TABLES_KEEP_DAILY=43800 > > > These are the configurations for a full dwh. > > The smaller version configurations are: > DWH_TABLES_KEEP_SAMPLES=24 > DWH_TABLES_KEEP_HOURLY=720 > DWH_TABLES_KEEP_DAILY=0 > > The delete process by default at 3am every day > (DWH_DELETE_JOB_HOUR=3) > > Best regards, > > Shirly Radco > > BI Software Engineer > Red Hat Israel Ltd. > 34 Jerusalem Road > Building A, 4th floor > Ra'anana, Israel 4350109 > > > On Fri, Jan 6, 2017 at 6:35 PM, Matt . <yamakasi.014@gmail.com> > wrote: >> >> Hi, >> >> I seem to have some large database for the DWH logging and I
wonder
>> how I can empty it safely. >> >> Can I just simply empty the database ? >> >> Have a good weekend! >> >> Cheers, >> >> Matt >> _______________________________________________ >> Users mailing list >> Users@ovirt.org >> http://lists.ovirt.org/mailman/listinfo/users > >
Hi Shirly, OK, great! thanks for the clearification! This might be updated and made more clear in the docs. Thanks! Matt 2017-01-25 14:41 GMT+01:00 Shirly Radco <sradco@redhat.com>:
Please see at the to of this section: "The following is a list of options for configuring application settings for the Data Warehouse service. These options are available in the /usr/share/ovirt-engine-dwh/services/ovirt-engine-dwhd/ovirt-engine-dwhd.conf file. Configure any changes to the default values in an override file under /etc/ovirt-engine-dwh/ovirt-engine-dwhd.conf.d/. Restart the Data Warehouse service after saving the changes."
So you need to add a file under /etc/ovirt-engine-dwh/ovirt-engine-dwhd.conf.d/ The file name is not important. It should end with ".conf"
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Wed, Jan 25, 2017 at 1:06 PM, Matt . <yamakasi.014@gmail.com> wrote:
Hi Shirly,
The reason why I ask is because the explanation here:
https://access.redhat.com/documentation/en/red-hat-virtualization/4.0/single...
2017-01-24 10:49 GMT+01:00 Shirly Radco <sradco@redhat.com>:
Hi,
We don't update the ovirt-engine-dwhd.conf directly.
You need to add the new file to /ovirt-engine-dwhd.conf.d/ with the lines DWH_TABLES_KEEP_SAMPLES= DWH_TABLES_KEEP_HOURLY= DWH_TABLES_KEEP_DAILY=0
and set the values for how much time you want the data to be kept. Keep in mind that the dashboards use the information from the samples and hourly tables for the last 24 hours.
This file will overwrite the default configurations after you restart ovirt-engine-dwhd.
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Tue, Jan 24, 2017 at 11:43 AM, Matt . <yamakasi.014@gmail.com> wrote:
Shirly,
I'm checking this out and aren't you sure the file is update_time_to_keep_records.conf and not ovirt-engine-dwhd.conf ?
2017-01-09 14:01 GMT+01:00 Matt . <yamakasi.014@gmail.com>:
I think it did. Cluster exists 4 years now, hosted engine 7 months.
2017-01-08 13:50 GMT+01:00 Shirly Radco <sradco@redhat.com>:
No. But the delete process might have kicked in. How long does you environment exist?
Best regards,
Shirly Radco
BI Software Engineer Red Hat Israel Ltd. 34 Jerusalem Road Building A, 4th floor Ra'anana, Israel 4350109
On Sun, Jan 8, 2017 at 2:42 PM, Matt . <yamakasi.014@gmail.com> wrote: > > Hi, > > OK thanks! I saw that after upgrading to 4.0.5 from 4.0.4 the DB > already dropped with around 500MB directly and is now at 2GB > smaller. > > Does this sounds familiar to you with other settings in 4.0.5 ? > > > Thanks, > > Matt > > > > 2017-01-08 10:45 GMT+01:00 Shirly Radco <sradco@redhat.com>: > > No. That will corrupt your database. > > > > Are you using the full dwh or the smaller version for the > > dashboards? > > > > Please set the delete thresholds to save less data and the data > > older > > then > > the time you set will be deleted. > > Add a file to /ovirt-engine-dwhd.conf.d/ > > update_time_to_keep_records.conf > > > > Add these lines with the new configurations. The numbers > > represent > > the > > hours > > to keep the data. > > > > DWH_TABLES_KEEP_SAMPLES=24 > > DWH_TABLES_KEEP_HOURLY=1440 > > DWH_TABLES_KEEP_DAILY=43800 > > > > > > These are the configurations for a full dwh. > > > > The smaller version configurations are: > > DWH_TABLES_KEEP_SAMPLES=24 > > DWH_TABLES_KEEP_HOURLY=720 > > DWH_TABLES_KEEP_DAILY=0 > > > > The delete process by default at 3am every day > > (DWH_DELETE_JOB_HOUR=3) > > > > Best regards, > > > > Shirly Radco > > > > BI Software Engineer > > Red Hat Israel Ltd. > > 34 Jerusalem Road > > Building A, 4th floor > > Ra'anana, Israel 4350109 > > > > > > On Fri, Jan 6, 2017 at 6:35 PM, Matt . <yamakasi.014@gmail.com> > > wrote: > >> > >> Hi, > >> > >> I seem to have some large database for the DWH logging and I > >> wonder > >> how I can empty it safely. > >> > >> Can I just simply empty the database ? > >> > >> Have a good weekend! > >> > >> Cheers, > >> > >> Matt > >> _______________________________________________ > >> Users mailing list > >> Users@ovirt.org > >> http://lists.ovirt.org/mailman/listinfo/users > > > >
participants (2)
-
Matt . -
Shirly Radco