<div dir="ltr"><br><br><div class="gmail_quote"><div dir="ltr">On Thu, Mar 23, 2017 at 3:17 PM Greg Sheremeta <<a href="mailto:gshereme@redhat.com">gshereme@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr" class="gmail_msg">+1, any plans to get this into CI and perhaps using statistics (standard deviation) to give us warnings?<div class="gmail_msg"><br class="gmail_msg"></div></div></blockquote><div>Still didn't work the details of producing reports from that. There is a jenkins-jmh plugin that can help <a href="https://github.com/blackboard/jmh-jenkins">https://github.com/blackboard/jmh-jenkins</a> . If anyone has experience with something similar I'd be happy to hear about it.<br><br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr" class="gmail_msg"><div class="gmail_msg"></div><div>I still want to build something like BrowserLab [4], and I'm currently working on <br></div></div></blockquote><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr" class="gmail_msg"><div class="gmail_msg">selenium + phantomjs in OST.</div></div></blockquote><div><br></div><div>I'm very interested in this work. Thanks.<br> <br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr" class="gmail_msg"><div class="gmail_msg"><br class="gmail_msg"></div><div class="gmail_msg">Greg</div><div class="gmail_msg"><br class="gmail_msg"></div><div class="gmail_msg">[4] <a href="https://code.facebook.com/posts/1368798036482517/browserlab-automated-regression-detection-for-the-web/" class="gmail_msg" target="_blank">https://code.facebook.com/posts/1368798036482517/browserlab-automated-regression-detection-for-the-web/</a><br class="gmail_msg"><div class="gmail_extra gmail_msg"></div></div></div><div dir="ltr" class="gmail_msg"><div class="gmail_msg"><div class="gmail_extra gmail_msg"><br class="gmail_msg"><div class="gmail_quote gmail_msg">On Thu, Mar 23, 2017 at 6:40 AM, Eldad Marciano <span dir="ltr" class="gmail_msg"><<a href="mailto:emarcian@redhat.com" class="gmail_msg" target="_blank">emarcian@redhat.com</a>></span> wrote:<br class="gmail_msg"><blockquote class="gmail_quote gmail_msg" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr" class="gmail_msg">very cool!<div class="gmail_msg">In terms of scale that sounds great for unit test | benchmarks,</div><div class="gmail_msg">assume we have some loaded DB. we can create some benchmarks for launching vms for example, what do you think will be the challenge ?</div></div><div class="m_-6206585686755088462gmail-m_5473273020916528631HOEnZb gmail_msg"><div class="m_-6206585686755088462gmail-m_5473273020916528631h5 gmail_msg"><br class="gmail_msg"><div class="gmail_quote gmail_msg"><div dir="ltr" class="gmail_msg">On Thu, Mar 23, 2017 at 12:25 PM Martin Sivak <<a href="mailto:msivak@redhat.com" class="gmail_msg" target="_blank">msivak@redhat.com</a>> wrote:<br class="gmail_msg"></div><blockquote class="gmail_quote gmail_msg" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi,<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
I am just wondering whether you tried Roman's Hystrix integration to<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
see what command was so slow?<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
Martin<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
On Thu, Mar 23, 2017 at 11:05 AM, Roy Golan <<a href="mailto:rgolan@redhat.com" class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg" target="_blank">rgolan@redhat.com</a>> wrote:<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> Lately we came across an interesting case where multi-host+mult-networks<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> resulted editing a host to conclude in minutes. One assumption that was<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> raised which we wanted to eliminate was that the decryption we perform on a<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> fence agent password might be taking too long.<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> So these days it's an easy task thanks to JMH[1], supplied by the jdk<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> itself. I kickstarted [2] and added a 'DecryptionBenchmark', see the output<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> as an example[3]<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> Although The JMH project recommends to create a separate project I find it<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> would be less trivial to people to contribute benchmarks let alone just<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> playing around with current code they want to test.<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> - So, (when it will be merged) you add your benchmark under<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> backend/manager/modules/benchmarks/MyBenchmark.java<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> - run it from intellij using the jmh plugin exactly like a unit-test<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> OR<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> - mvn test -P benchmarks -pl org.ovirt.engine:benchmarks<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> OR<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> - java -jar benchmarks.jar<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> I hope this would serve all of us well, please review and add your<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> benchmarks.<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> PS - this will not run in the CI atm.<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> [1] <a href="http://openjdk.java.net/projects/code-tools/jmh/" rel="noreferrer" class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg" target="_blank">http://openjdk.java.net/projects/code-tools/jmh/</a><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> [2] <a href="https://gerrit.ovirt.org/74537" rel="noreferrer" class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg" target="_blank">https://gerrit.ovirt.org/74537</a> microbenchmarks: Introduce<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> microbenchmarks using JMH<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> [3] DecryptionBenchmark output (short version):<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> # Run complete. Total time: 00:09:06<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> Benchmark Mode Samples Score Score error<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> Units<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> b.DecryptionBenchmark.decryption thrpt 50 101.258 1.270<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> ops/s<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> b.DecryptionBenchmark.encryption thrpt 50 238.587 4.667<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> ops/s<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> b.DecryptionBenchmark.decryption avgt 50 0.010 0.000<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> s/op<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> b.DecryptionBenchmark.encryption avgt 50 0.004 0.000<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> s/op<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> b.DecryptionBenchmark.decryption sample 5544 0.010 0.000<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> s/op<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> b.DecryptionBenchmark.encryption sample 13067 0.004 0.000<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> s/op<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> b.DecryptionBenchmark.decryption ss 50 0.014 0.001<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> s<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> b.DecryptionBenchmark.encryption ss 50 0.009 0.001<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> s<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> Process finished with exit code 0<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> _______________________________________________<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> Devel mailing list<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> <a href="mailto:Devel@ovirt.org" class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg" target="_blank">Devel@ovirt.org</a><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
> <a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg" target="_blank">http://lists.ovirt.org/mailman/listinfo/devel</a><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
_______________________________________________<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
Devel mailing list<br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
<a href="mailto:Devel@ovirt.org" class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg" target="_blank">Devel@ovirt.org</a><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg" target="_blank">http://lists.ovirt.org/mailman/listinfo/devel</a><br class="m_-6206585686755088462gmail-m_5473273020916528631m_-2453329783394934049gmail_msg gmail_msg">
</blockquote></div>
</div></div><br class="gmail_msg">_______________________________________________<br class="gmail_msg">
Devel mailing list<br class="gmail_msg">
<a href="mailto:Devel@ovirt.org" class="gmail_msg" target="_blank">Devel@ovirt.org</a><br class="gmail_msg">
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" class="gmail_msg" target="_blank">http://lists.ovirt.org/mailman/listinfo/devel</a><br class="gmail_msg"></blockquote></div><br class="gmail_msg"><br class="gmail_msg" clear="all"><div class="gmail_msg"><br class="gmail_msg"></div></div></div></div><div dir="ltr" class="gmail_msg"><div class="gmail_msg"><div class="gmail_extra gmail_msg">-- <br class="gmail_msg"><div class="m_-6206585686755088462gmail-m_5473273020916528631gmail_signature gmail_msg"><div dir="ltr" class="gmail_msg"><div class="gmail_msg">Greg Sheremeta, MBA<br class="gmail_msg">Red Hat, Inc.<br class="gmail_msg">Sr. Software Engineer<br class="gmail_msg"><a href="mailto:gshereme@redhat.com" class="gmail_msg" target="_blank">gshereme@redhat.com</a><br class="gmail_msg"></div></div></div>
</div></div></div></blockquote></div></div>