[ovirt-devel] Introducing engine micro-benchmarks

[Roy Golan]

On Thu, Mar 23, 2017 at 3:17 PM Greg Sheremeta <gshereme at redhat.com> wrote:

> +1, any plans to get this into CI and perhaps using statistics (standard
> deviation) to give us warnings?
>
> Still didn't work the details of producing reports from that. There is a
jenkins-jmh plugin  that can help https://github.com/blackboard/jmh-jenkins
. If anyone has experience with something similar I'd be happy to hear
about it.

I still want to build something like BrowserLab [4], and I'm currently
> working on
>
selenium + phantomjs in OST.
>

I'm very interested in this work. Thanks.


>
> Greg
>
> [4]
> https://code.facebook.com/posts/1368798036482517/browserlab-automated-regression-detection-for-the-web/
>
> On Thu, Mar 23, 2017 at 6:40 AM, Eldad Marciano <emarcian at redhat.com>
> wrote:
>
> very cool!
> In terms of scale that sounds great for unit test | benchmarks,
> assume we have some loaded DB. we can create some benchmarks for launching
> vms for example, what do you think will be the challenge ?
>
> On Thu, Mar 23, 2017 at 12:25 PM Martin Sivak <msivak at redhat.com> wrote:
>
> Hi,
>
> I am just wondering whether you tried Roman's Hystrix integration to
> see what command was so slow?
>
> Martin
>
> On Thu, Mar 23, 2017 at 11:05 AM, Roy Golan <rgolan at redhat.com> wrote:
> > Lately we came across an interesting case where multi-host+mult-networks
> > resulted editing a host to conclude in minutes. One assumption that was
> > raised which we wanted to eliminate was that the decryption we perform
> on a
> > fence agent password might be taking too long.
> >
> > So these days it's an easy task thanks to JMH[1], supplied by the jdk
> > itself. I kickstarted [2] and added a 'DecryptionBenchmark', see the
> output
> > as an example[3]
> >
> > Although The JMH project recommends to create a separate project I find
> it
> > would be less trivial to people to contribute benchmarks let alone just
> > playing around with current code they want to test.
> >
> > - So, (when it will be merged) you add your benchmark under
> >  backend/manager/modules/benchmarks/MyBenchmark.java
> >
> > - run it from intellij using the jmh plugin exactly like a unit-test
> > OR
> > - mvn test -P benchmarks -pl org.ovirt.engine:benchmarks
> > OR
> > - java -jar benchmarks.jar
> >
> > I hope this would serve all of us well, please review and add your
> > benchmarks.
> >
> > PS - this will not run in the CI atm.
> >
> > [1] http://openjdk.java.net/projects/code-tools/jmh/
> > [2] https://gerrit.ovirt.org/74537 microbenchmarks: Introduce
> > microbenchmarks using JMH
> > [3] DecryptionBenchmark output (short version):
> >
> > # Run complete. Total time: 00:09:06
> >
> > Benchmark                             Mode  Samples    Score  Score error
> > Units
> > b.DecryptionBenchmark.decryption     thrpt       50  101.258        1.270
> > ops/s
> > b.DecryptionBenchmark.encryption     thrpt       50  238.587        4.667
> > ops/s
> > b.DecryptionBenchmark.decryption      avgt       50    0.010        0.000
> > s/op
> > b.DecryptionBenchmark.encryption      avgt       50    0.004        0.000
> > s/op
> > b.DecryptionBenchmark.decryption    sample     5544    0.010        0.000
> > s/op
> > b.DecryptionBenchmark.encryption    sample    13067    0.004        0.000
> > s/op
> > b.DecryptionBenchmark.decryption        ss       50    0.014        0.001
> > s
> > b.DecryptionBenchmark.encryption        ss       50    0.009        0.001
> > s
> >
> > Process finished with exit code 0
> >
> >
> > _______________________________________________
> > Devel mailing list
> > Devel at ovirt.org
> > http://lists.ovirt.org/mailman/listinfo/devel
> _______________________________________________
> Devel mailing list
> Devel at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/devel
>
>
> _______________________________________________
> Devel mailing list
> Devel at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/devel
>
>
>
>
> --
> Greg Sheremeta, MBA
> Red Hat, Inc.
> Sr. Software Engineer
> gshereme at redhat.com
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/devel/attachments/20170323/d3bd6505/attachment-0001.html>