data flow for statistics for hosts and vms
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi, I'm trying to understand the flow how the stats from the VM and HOSTS are imported into the engine. On each host there is VDSM. Using the vsdm-client I'm able to get HOST and VM stats vdsm-client Host getAllVmStats vdsm-client Host getStats Are the hosts pushing the data to the engine or vice versa? On the engine side there is java based vdsm-jsonrpc client so I guess the data are pulled from the hosts to the engine database. And of course the question is which component on engine side is getting/requesting the data. I'm trying to get the stat less painless as query the API. Maybe the engine/dwh database could help but the scheme could change between releases, isn't it. or the engine DB. regards Peter - -- *Peter Hudec* Infraštruktúrny architekt phudec@cnc.sk <mailto:phudec@cnc.sk> *CNC, a.s.* Borská 6, 841 04 Bratislava Recepcia: +421 2 35 000 100 Mobil:+421 905 997 203 *www.cnc.sk* <http:///www.cnc.sk> -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEqSUbhuEwhryifNeVQnvVWOJ35BAFAlr63zYACgkQQnvVWOJ3 5BC1BxAApSg29lv1KohiVeJNsFdF4i77e2H77drLe9Ffq1kg/+VESh6+ggeZIH1U W5e06PJeifoZbtWL2enaJsml9JZM/3kvqU5TC93sR8chvhfRo3GXS50tWCEe5b0R UPdpjgyYipN+i3Xibl/YxHMu9fwpFIH+VY+JWn70Dz5pjvgwn71ogCcRUA6Itvom 700Pwv4yV31hWyE6qXiWOth0Rfey3+QkEXtNhRrEOHeAzpNABS5Zixjocr9c5xhz AdLkUAGVvEQEYy/Nzyv8A8KRSY1z63Ijyv5hgQIpGkKfbXhRYrotY6EeqdJ6PYsF tQvkjjT+kJ5SBYClK/et9X4y2ZMe+4YX7lrsZnk8V/Oj3YYw2y1XlvXcrt0pZlHA G9QIhcn/chtBTslGOW0t4B603YRykausunc9XXq1IGKNyLHb/lrDiDh+x2dCg5vT sGJE/gQffSNSwk5oFBlG2U9aOgWvZ8m3nVCDdGo+1a9fc/KR8toQi9axsiIMVYb/ dzbDmaYlXbKNwWdVirftTetxuwn44j2Kgv4b048ZmGwTvwc79UuoS8H9hv9LlBM6 7E7iqaGfKbExg0/EMZurd90P62zn8nIGnYEJUrxVU3aJ4E2gWflfSelYMymNtE+u aZAMxvK6gILQP2n45AVkKOTacQwX07QCzlvJ2sL4gNzQQ+UL52c= =RNAH -----END PGP SIGNATURE-----
Hi Peter, The dwh views do not change, we support legacy views fro 3.6, so we recommend using DWH to get the statistics you want. It is possible to connect grafana directly with DWH if that interest you. Also, We have a new feature called "oVirt metrics store" that collectd many statistics using and logs using fluentd to a central Elasticsearch and Kibana. I can elaborate on that if you want. Best, -- SHIRLY RADCO BI SeNIOR SOFTWARE ENGINEER Red Hat Israel <https://www.redhat.com/> <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> On Tue, May 15, 2018 at 4:23 PM, Peter Hudec <phudec@cnc.sk> wrote:
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512
Hi,
I'm trying to understand the flow how the stats from the VM and HOSTS are imported into the engine.
On each host there is VDSM. Using the vsdm-client I'm able to get HOST and VM stats
vdsm-client Host getAllVmStats vdsm-client Host getStats
Are the hosts pushing the data to the engine or vice versa? On the engine side there is java based vdsm-jsonrpc client so I guess the data are pulled from the hosts to the engine database.
Yes. Engine pulls the stats from the hosts every 15 seconds.
And of course the question is which component on engine side is getting/requesting the data.
I'm trying to get the stat less painless as query the API. Maybe the engine/dwh database could help but the scheme could change between releases, isn't it. or the engine DB.
regards Peter
- -- *Peter Hudec* Infraštruktúrny architekt phudec@cnc.sk <mailto:phudec@cnc.sk>
*CNC, a.s.* Borská 6, 841 04 Bratislava Recepcia: +421 2 35 000 100
Mobil:+421 905 997 203 *www.cnc.sk* <http:///www.cnc.sk>
-----BEGIN PGP SIGNATURE-----
iQIzBAEBCgAdFiEEqSUbhuEwhryifNeVQnvVWOJ35BAFAlr63zYACgkQQnvVWOJ3 5BC1BxAApSg29lv1KohiVeJNsFdF4i77e2H77drLe9Ffq1kg/+VESh6+ggeZIH1U W5e06PJeifoZbtWL2enaJsml9JZM/3kvqU5TC93sR8chvhfRo3GXS50tWCEe5b0R UPdpjgyYipN+i3Xibl/YxHMu9fwpFIH+VY+JWn70Dz5pjvgwn71ogCcRUA6Itvom 700Pwv4yV31hWyE6qXiWOth0Rfey3+QkEXtNhRrEOHeAzpNABS5Zixjocr9c5xhz AdLkUAGVvEQEYy/Nzyv8A8KRSY1z63Ijyv5hgQIpGkKfbXhRYrotY6EeqdJ6PYsF tQvkjjT+kJ5SBYClK/et9X4y2ZMe+4YX7lrsZnk8V/Oj3YYw2y1XlvXcrt0pZlHA G9QIhcn/chtBTslGOW0t4B603YRykausunc9XXq1IGKNyLHb/lrDiDh+x2dCg5vT sGJE/gQffSNSwk5oFBlG2U9aOgWvZ8m3nVCDdGo+1a9fc/KR8toQi9axsiIMVYb/ dzbDmaYlXbKNwWdVirftTetxuwn44j2Kgv4b048ZmGwTvwc79UuoS8H9hv9LlBM6 7E7iqaGfKbExg0/EMZurd90P62zn8nIGnYEJUrxVU3aJ4E2gWflfSelYMymNtE+u aZAMxvK6gILQP2n45AVkKOTacQwX07QCzlvJ2sL4gNzQQ+UL52c= =RNAH -----END PGP SIGNATURE----- _______________________________________________ Users mailing list -- users@ovirt.org To unsubscribe send an email to users-leave@ovirt.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA512 Hi Shirly, I know about the grafana integration with the DWH. I know about oVirt Metrics, I saw the video with you presenting this product and read the docs. I also tried to install the Metrics store. You could find some mail in in this mailing list about that. I was not able to run it successfully. You were included in that communication. I could try it again, but this is too big for or needs ;( The basic idea is to integrate it into zabbix, which is our primary monitoring system for whole datacenter, infrastructure, VmWare, .. I do not want to add new screen for our NOC to watch on. Generally I was interested in data flow how the data are collected from HOSTS to ENGINE database. The flow for metrics I guess is libirt or vdsm(host) <- collectd (host) -> log files?? (host) <- fluend (host) -> elk (metrics). This is really nice example how to glue the components together. ;) On 16/05/2018 11:04, Shirly Radco wrote:
Hi Peter,
The dwh views do not change, we support legacy views fro 3.6, so we recommend using DWH to get the statistics you want. It is possible to connect grafana directly with DWH if that interest you.
Also, We have a new feature called "oVirt metrics store" that collectd many statistics using and logs using fluentd to a central Elasticsearch and Kibana. I can elaborate on that if you want.
Best,
--
SHIRLY RADCO
BI SeNIOR SOFTWARE ENGINEER
Red Hat Israel <https://www.redhat.com/>
<https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted>
On Tue, May 15, 2018 at 4:23 PM, Peter Hudec <phudec@cnc.sk <mailto:phudec@cnc.sk>> wrote:
Hi,
I'm trying to understand the flow how the stats from the VM and HOSTS are imported into the engine.
On each host there is VDSM. Using the vsdm-client I'm able to get HOST and VM stats
vdsm-client Host getAllVmStats vdsm-client Host getStats
Are the hosts pushing the data to the engine or vice versa? On the engine side there is java based vdsm-jsonrpc client so I guess the data are pulled from the hosts to the engine database.
Yes. Engine pulls the stats from the hosts every 15 seconds.
And of course the question is which component on engine side is getting/requesting the data.
I'm trying to get the stat less painless as query the API. Maybe the engine/dwh database could help but the scheme could change between releases, isn't it. or the engine DB.
regards Peter
_______________________________________________ Users mailing list -- users@ovirt.org <mailto:users@ovirt.org> To unsubscribe send an email to users-leave@ovirt.org <mailto:users-leave@ovirt.org>
- -- *Peter Hudec* Infraštruktúrny architekt phudec@cnc.sk <mailto:phudec@cnc.sk> *CNC, a.s.* Borská 6, 841 04 Bratislava Recepcia: +421 2 35 000 100 Mobil:+421 905 997 203 *www.cnc.sk* <http:///www.cnc.sk> -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEERCwM7E/ZOYb1ejhCbZu8qDuIhFsFAlr+xwQACgkQbZu8qDuI hFu8jw//cB+3lf+MolpOR4oyDLr+GXvSXkv91ZtL85RVobX3mf/Zbd0VQuJkSr2w sS0VSUK4PRASHUOGjNrMz6AByvZF1P7fdG23rXnJkWdM5xu09FJphIWsjfXqwdSM PxAcxZZQv+wKgoXKjnHnGcbb8VdAkZSlHwH0egycwXpzIfvDFPrc7DeVwndC6Ibz yIwUdpTyzm+KZ9EqTjdx0qb7AgYihtJXC7GWntEuook/ZOYrsN6dOoQ46KgzznXw FhPWzMSrdl73wzXyqmvjSQo0PoXuNzXLSNqXyGTQuJTg8yYaiPkREo8LFj4SX7bB Uc3s5/NGCiEr1+tEyk6tSeVM3cdIimN0O8kE3QFpIv6R6RjFC+K7WNkGBWxlc05S CDCkpU921o6oTvd0bd9F3XT5TRVuME48yYuLvcT6GY8g837tkSinNLTZvYpr8yq7 iEm4500mF2cSBUhPYtgcxVfZ+0SeMoDdsbLqjM19voHGP8DvtMXOOUoFee/qwiJJ 2Kcjnid32db4EEdInwphFiAryhTy/GC6LB/6KunNqVXq5C/1FIyAi7UiceZO7YwU r/RqxMvSkgW/rdMyBuPZ+3GP72l4yTOdm7cwcfplDDgWL67C5uyii7zG+ApTUmre wuz86ECe/QIWAvw/hoTmu4WXxGxT6ErUzfjh1/v4Kfx+/S+V3WI= =/KT/ -----END PGP SIGNATURE-----
participants (2)
-
Peter Hudec -
Shirly Radco