New subject: oVirt 4.3 DWH with Grafana

Wednesday, 15 September 2021

Thank you!

I tried it, and I can import the json after replace the 4.4 with 4.3, but still have some
errors like this:

pq: column "count_threads_as_cores" does not exist

Object

status:400

statusText:"Bad Request"

data:Object

results:Object

message:"pq: column "count_threads_as_cores" does not exist"

message:"pq: column "count_threads_as_cores" does not exist"

Many of the other reports worked fine, with only a few similar errors.

Is this caused by version incompatibility?

After all, 4.4 in the original document was replaced with 4.3 before the import.

From: Matthew.Stier(a)fujitsu.com <Matthew.Stier(a)fujitsu.com&gt; 
Sent: Wednesday, September 15, 2021 3:28 AM
To: Tommy Sway <sz_cuitao(a)163.com>; 'Michal Gutowski'
<michal.gutowski(a)oracle.com>; 'Vrgotic, Marko'
<M.Vrgotic(a)activevideo.com&gt;
Cc: users(a)ovirt.org
Subject: RE: [ovirt-users] Re: oVirt 4.3 DWH with Grafana

The instructions to modify the json files are missing. (Using find and sed to change all
instances of v4_4_ to v4_3_ before importing them into Grafana)

This is from an Oracle Blog on the doing this with OLVM 4.3 (which is basically a
repackaged oVirt 4.3)

Build Grafana Dashboard for Oracle Linux Virtualization Manager 4.3
<https://blogs.oracle.com/scoter/post/build-grafana-dashboard-for-oracle-l...

From: Tommy Sway <sz_cuitao(a)163.com <mailto:sz_cuitao@163.com> > 
Sent: Tuesday, September 14, 2021 3:01 AM
To: 'Michal Gutowski' <michal.gutowski(a)oracle.com
<mailto:michal.gutowski@oracle.com> >; 'Vrgotic, Marko'
<M.Vrgotic(a)activevideo.com <mailto:M.Vrgotic@activevideo.com> >
Cc: users(a)ovirt.org <mailto:users@ovirt.org> 
Subject: [ovirt-users] Re: oVirt 4.3 DWH with Grafana

The oVirt version I'm using is 4.3, and I get an error when I import JSON.

pq: relation"v4_4_latest_configuration_datacenters" does not exist.

From: users-bounces(a)ovirt.org <mailto:users-bounces@ovirt.org> 
<users-bounces(a)ovirt.org <mailto:users-bounces@ovirt.org> > On Behalf Of
Michal Gutowski
Sent: Wednesday, November 25, 2020 12:26 AM
To: Vrgotic, Marko <M.Vrgotic(a)activevideo.com <mailto:M.Vrgotic@activevideo.com>
>
Cc: users(a)ovirt.org <mailto:users@ovirt.org> 
Subject: [ovirt-users] Re: oVirt 4.3 DWH with Grafana

Hi Marko,

I've tested this myself as I like playing with various Grafana use-cases and following
steps allow you to set up Grafana Monitoring for your oVirt 4.3 environment and re-use all
Grafana Dashboards from latest oVirt 4.4 on a previous release.

1. Allowing Grafana to connect to oVirt DWH database (Data Warehouse)

Login to the oVirt engine 4.3 and create a user "grafana" with password
"grafana" that will get a read-only access to the ovirt_engine_history database
and will be able to use public schema

# su - postgres -c 'scl enable rh-postgresql10 bash'

# psql -U postgres -c "CREATE ROLE grafana WITH LOGIN ENCRYPTED PASSWORD
'grafana';" -d ovirt_engine_history

# psql -U postgres -c "GRANT CONNECT ON DATABASE ovirt_engine_history TO
grafana;"

# psql -U postgres -c "GRANT USAGE ON SCHEMA public TO grafana;"
ovirt_engine_history

Generate the rest of the permissions that will be granted to the newly created user and
save them to a file:

# psql -U postgres -c "SELECT 'GRANT SELECT ON ' || relname || ' TO
grafana;' FROM pg_class JOIN pg_namespace ON pg_namespace.oid = pg_class.relnamespace
WHERE nspname = 'public' AND relkind IN ('r', 'v');"
--pset=tuples_only=on  ovirt_engine_history > grant.sql

Use the file you created in the previous step to grant permissions to the newly created
user:

# psql -U postgres -f grant.sql ovirt_engine_history

Remove the file you used to grant permissions:

# rm grant.sql

Exit the postgres user shell by pressing Ctrl+d

Add the following lines for the newly created user to
/var/opt/rh/rh-postgresql10/lib/pgsql/data/pg_hba.conf preceding the line beginning local
all all

host    ovirt_engine_history grafana 0.0.0.0/0               md5

host    ovirt_engine_history grafana ::0/0                   md5

Reload postgres service

# systemctl reload rh-postgresql10-postgresql

2. Installing Grafana

You can install Grafana directly on the oVirt Engine machine (this is how it's done in
oVirt 4.4) or on a separate machine. Following steps shows how you can install Grafana on
a Oracle Linux 7 server. Note: Oracle provides Grafana in the OLCNE yum repository - you
only need to install the repository definition package to pickup Grafana and it's
dependencies.

# yum install oraclelinux-release-el7

# yum install oracle-olcne-release-el7

# yum-config-manager --enable ol7_optional_latest ol7_olcne11

# yum install grafana

# systemctl enable --now grafana-server

3. Adding oVirt DWH database as Data Source in Grafana

Login to Grafana (default port 3000) and navigate to Configuration -> DataSources and
click on Add Data Source button.

Select PostgreSQL source and use the following settings (adjust the Host IP address to
match your oVirt Engine IP but do not change the Name):

Name: oVirt DWH

Host: your-engine-ip-address:5432

user: grafana

pass: grafana

SSL mode: disable

4. Importing Dashboards from oVirt 4.4

Download Grafana Dashboards from oVirt 4.4 repository:
https://github.com/oVirt/ovirt-dwh/tree/master/packaging/conf/grafana-das...

You can now import them in Grafana by navigating to Create -> Import and clicking on
Upload .json file or by simply pasting JSON content.

I've tested this on my OLVM/oVirt 4.3 and works perfectly well.

Have fun!

Michal

Michał Gutowski

Principal Solutions Engineer, EMEA 

+48 665 222 979

Oracle Open Cloud Infrastructure Software - Linux & Virtualization

On 24 Nov 2020, at 11:53, Vrgotic, Marko <M.Vrgotic(a)activevideo.com
<mailto:M.Vrgotic@activevideo.com> > wrote:

Dear oVirt folks,

Thank you all for suggestions.

I will give it a go and see how far I get.

-----

kind regards/met vriendelijke groeten

Marko Vrgotic
Sr. System Engineer @ System Administration

ActiveVideo

o: +31 (35) 6774131

m: +31 (65) 5734174

e:  <mailto:m.vrgotic@activevideo.com> m.vrgotic(a)activevideo.com
w: 
<https://urldefense.com/v3/__http:/www.activevideo.com__;!!GqivPVa7Brio!MN...
www.activevideo.com

ActiveVideo Networks BV. Mediacentrum 3745 Joop van den Endeplein 1.1217 WJ Hilversum, The
Netherlands. The information contained in this message may be legally privileged and
confidential. It is intended to be read only by the individual or entity to whom it is
addressed or by their designee. If the reader of this message is not the intended
recipient, you are on notice that any distribution of this message, in any form, is
strictly prohibited.  If you have received this message in error, please immediately
notify the sender and/or ActiveVideo Networks, LLC by telephone at +1 408.931.9200 and
delete or destroy any copy of this message.

From: Yedidyah Bar David <didi(a)redhat.com <mailto:didi@redhat.com> >
Date: Sunday, 22 November 2020 at 08:39
To: "Vrgotic, Marko" <M.Vrgotic(a)activevideo.com
<mailto:M.Vrgotic@activevideo.com> >
Cc: &quot;users(a)ovirt.org <mailto:users@ovirt.org> " <users(a)ovirt.org
<mailto:users@ovirt.org> >
Subject: Re: [ovirt-users] oVirt 4.3 DWH with Grafana

***CAUTION: This email originated from outside of the organization. Do not click links or
open attachments unless you recognize the sender!!!***

On Fri, Nov 20, 2020 at 8:45 AM Vrgotic, Marko <M.Vrgotic(a)activevideo.com
<mailto:M.Vrgotic@activevideo.com> > wrote:

Dear oVirt,

We are currently running oVirt 4.3 and upgrade/migration to 4.4 won’t be possible for few
more months.

I am looking into guidelines, how to, for setting up Grafana using DataWarehouse as data
source.

Did anyone already did this, and would be willing to share the steps?

AFAIU this is definitely not tested/recommended/supported, but the current (4.4)
dashboards use only 4.3 dwh compatibility views. So in theory, 4.4 grafana setup can work
against your 4.3 engine/dwh without problems. So you can try something like:

1. Install el8 on some machine

2. Install ovirt-release (4.4!)

3. Install ovirt-engine-dwh-grafana-integration-setup. I *think*, didn't try, that it
would carry with it all the dependencies it needs.

4. Run engine-setup. When prompted, only accept "Configure grafana?", and reply
"No" to everything else

5. Follow the other prompts as applicable

This should be enough.

Not sure about the commands to add SSO on the engine machine. Perhaps better verify this
first against a test engine (can be on another el7/ovirt4.3 VM with no hosts).

But, repeating: this isn't recommended.

Did you consider upgrading only your engine, and keep your hosts 4.3 until you can upgrade
them later?

Best regards,

-- 

Didi

_______________________________________________
Users mailing list --  <mailto:users@ovirt.org> users(a)ovirt.org
To unsubscribe send an email to  <mailto:users-leave@ovirt.org>
users-leave(a)ovirt.org
Privacy Statement: 
<https://urldefense.com/v3/__https:/www.ovirt.org/privacy-policy.html__;!!...
https://urldefense.com/v3/__https://www.ovirt.org/privacy-policy.html__;!...

oVirt Code of Conduct: 
<https://urldefense.com/v3/__https:/www.ovirt.org/community/about/communit...
https://urldefense.com/v3/__https://www.ovirt.org/community/about/communi...

List Archives: 
<https://urldefense.com/v3/__https:/lists.ovirt.org/archives/list/users@ov...
https://urldefense.com/v3/__https://lists.ovirt.org/archives/list/users@o...

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

Re: oVirt 4.3 DWH with Grafana