[ovirt-devel] Proposal: Hystrix for realtime command monitoring

Tue Dec 15 09:50:05 UTC 2015

On Fri, Dec 11, 2015 at 10:28 AM, Roman Mohr <rmohr at redhat.com> wrote:

> Hi,
>
> a status update, a request and a question:
>
> [...]
>
>>
>>>> A first implementation can be found on gerrit[3].
>>>>
>>>> The implementation should be almost ready. The new rpms for hystrix are
> also moving forward. I would need some people which can give me karma on
> bodhi. See be
>
>  [...]
>
>> # How to monitor the engine?
>>>>
>>>> It is as easy as starting a hystrix-dashboard [2] with
>>>>
>>>>   $ git clone https://github.com/Netflix/Hystrix.git
>>>>   $ cd Hystrix/hystrix-dashboard
>>>>   $ ../gradlew jettyRun
>>>>
>>>>
> As part of the hystrix rpms there is now also a 'hystrix-dashboard' rpm.
> Using it is pretty simple. Just install it with 'dnf install
> hystrix-dashboard' and start jetty with 'systemctrl start jetty'. Jetty
> will then listen on 8080 by default (and if you told selinux that jetty is
> allowed to access the network).
>
> [...]
>
>
>>>> # Security?
>>>>
>>>> In the provided patches the hystrix-metrics-servlet is accessible at
>>>> /ovirt-engine/api/hystrix.stream. It is protected by basic auth but
>>>> accessible
>>>> for everyone who can authenticate. We should probably restrict it to
>>>> admins.
>>>>
>>>> that would be great if it doesn't require too much work. If it does
>>>> then we can start with enabling/disabling via JMX using Roy's recent patch
>>>> [8]
>>>>
>>>>
> Since I had to implement JMX support anyway to enable and disable hystrix
> (disabled by default) I am wondering if I can remove the authentication
> part. There is no sensible data in the hystrix stream and all other
> services like the db health check are not protected either. It would make
> it again a little bit easier to use.
>
>  [...]
>
>> 3) Three unpackaged dependencies: archaius, hystrix-core, hystrix-contrib
>>>>
>>>>
>>>>
> All required packages will be available in rawhide the next few hours. All
> builds on koji succeeded.
> Also all packages for f23 were successfully build.
>
> I would appreciate if some of you find the time to give these f23 pacakges
> some karma:
>
> archaius-0.7.3-3.fc23
> <https://bodhi.fedoraproject.org/updates/FEDORA-2015-3ae4cc39c5> [9]
> (includes archaius-core and archaius-zookeeper)
> hystrix-1.4.21-4.fc23
> <https://bodhi.fedoraproject.org/updates/FEDORA-2015-35994552ed>  [10]
> (includes hystrix-core, hystrix-metrics-event-stream and hystrix-dashboard)
>
> On el7 I had to package a little bit more and the final hystrix package
> itself is still missing, but some karma on the first round of packages
> would be very helpful:
>
> archaius-0.4.1-1.el7
> <https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-dd72806724>
> [11] (includes archaius-core)
> mockito-1.9.0-19.el7
> <https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-7bf9b82936> [12]
> assertj-core-2.2.0-2.el7
> <https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-f02466a5da> [13]
> jctools-1.1-0.3.alpha.el7
> <https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-27b59f8bf2> [14]
> rxjava-1.0.13-2.el7
> <https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-37400bf69d>
> [15]
>
>

All additional packages for el7 are now also available on testing:

jackson-core-2.6.3-1.el7 [16]
<https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-b711a01041>
hystrix-1.4.21-5.el7
<https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-d770404d8b> [17]

As always, I am grateful for every karma!

>
>>>>
>>>>
>>>>
>>> Since you yesterday volunteered to package them I think this should not
>>>> stop us!:-)
>>>>
>>>> thanks a lot for the effort, I miss a proper analysis for soooo long.
>>>> Thanks for stepping up!
>>>>
>>>> michal
>>>>
>>>>
>>>> # References
>>>>
>>>> [1] https://github.com/Netflix/Hystrix
>>>> [2] https://github.com/Netflix/Hystrix/tree/master/hystrix-dashboard
>>>> [3] https://gerrit.ovirt.org/#/q/topic:hystrix
>>>> [4]
>>>> http://www.nurkiewicz.com/2015/02/storing-months-of-historical-metrics.html
>>>> [5]
>>>> https://github.com/Netflix/Hystrix/wiki/FAQ#what-is-the-processing-overhead-of-using-hystrix
>>>> [5] https://bugzilla.redhat.com/show_bug.cgi?id=1268216
>>>> [6] https://bugzilla.redhat.com/show_bug.cgi?id=1268224
>>>> [7] http://graphite.wikidot.com
>>>>
>>>> [8] https://gerrit.ovirt.org/#/c/29693/
>>>>
>>>>
> [9]   https://bodhi.fedoraproject.org/updates/FEDORA-2015-3ae4cc39c5
> [10] https://bodhi.fedoraproject.org/updates/FEDORA-2015-35994552ed
> [11] https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-dd72806724
> [12] https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-7bf9b82936
> [13] https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-f02466a5da
> [14] https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-27b59f8bf2
> [15] https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-37400bf69d
>
[16] https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-b711a01041
[17] https://bodhi.fedoraproject.org/updates/FEDORA-EPEL-2015-d770404d8b

>
>
> _______________________________________________
>>>> Devel mailing list
>>>> Devel at ovirt.org
>>>> http://lists.ovirt.org/mailman/listinfo/devel
>>>>
>>>>
>>>>
>>>
>>> _______________________________________________
>>> Devel mailing list
>>> Devel at ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/devel
>>>
>>
>>
> Thanks,
> Roman
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/devel/attachments/20151215/0476a5e5/attachment-0001.html>