<div dir="ltr">+1, any plans to get this into CI and perhaps using statistics (standard deviation) to give us warnings?<div><br></div><div>I still want to build something like BrowserLab [4], and I'm currently working on selenium + phantomjs in OST.</div><div><br></div><div>Greg</div><div><br></div><div>[4] <a href="https://code.facebook.com/posts/1368798036482517/browserlab-automated-regression-detection-for-the-web/">https://code.facebook.com/posts/1368798036482517/browserlab-automated-regression-detection-for-the-web/</a><br><div class="gmail_extra"><br><div class="gmail_quote">On Thu, Mar 23, 2017 at 6:40 AM, Eldad Marciano <span dir="ltr"><<a href="mailto:emarcian@redhat.com" target="_blank">emarcian@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr">very cool!<div>In terms of scale that sounds great for unit test | benchmarks,</div><div>assume we have some loaded DB. we can create some benchmarks for launching vms for example, what do you think will be the challenge ?</div></div><div class="gmail-m_5473273020916528631HOEnZb"><div class="gmail-m_5473273020916528631h5"><br><div class="gmail_quote"><div dir="ltr">On Thu, Mar 23, 2017 at 12:25 PM Martin Sivak <<a href="mailto:msivak@redhat.com" target="_blank">msivak@redhat.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">Hi,<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
I am just wondering whether you tried Roman's Hystrix integration to<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
see what command was so slow?<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
Martin<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
On Thu, Mar 23, 2017 at 11:05 AM, Roy Golan <<a href="mailto:rgolan@redhat.com" class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg" target="_blank">rgolan@redhat.com</a>> wrote:<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> Lately we came across an interesting case where multi-host+mult-networks<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> resulted editing a host to conclude in minutes. One assumption that was<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> raised which we wanted to eliminate was that the decryption we perform on a<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> fence agent password might be taking too long.<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> So these days it's an easy task thanks to JMH[1], supplied by the jdk<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> itself. I kickstarted [2] and added a 'DecryptionBenchmark', see the output<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> as an example[3]<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> Although The JMH project recommends to create a separate project I find it<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> would be less trivial to people to contribute benchmarks let alone just<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> playing around with current code they want to test.<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> - So, (when it will be merged) you add your benchmark under<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> backend/manager/modules/benchm<wbr>arks/MyBenchmark.java<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> - run it from intellij using the jmh plugin exactly like a unit-test<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> OR<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> - mvn test -P benchmarks -pl org.ovirt.engine:benchmarks<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> OR<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> - java -jar benchmarks.jar<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> I hope this would serve all of us well, please review and add your<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> benchmarks.<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> PS - this will not run in the CI atm.<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> [1] <a href="http://openjdk.java.net/projects/code-tools/jmh/" rel="noreferrer" class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg" target="_blank">http://openjdk.java.net/projec<wbr>ts/code-tools/jmh/</a><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> [2] <a href="https://gerrit.ovirt.org/74537" rel="noreferrer" class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg" target="_blank">https://gerrit.ovirt.org/74537</a> microbenchmarks: Introduce<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> microbenchmarks using JMH<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> [3] DecryptionBenchmark output (short version):<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> # Run complete. Total time: 00:09:06<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> Benchmark Mode Samples Score Score error<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> Units<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> b.DecryptionBenchmark.decrypti<wbr>on thrpt 50 101.258 1.270<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> ops/s<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> b.DecryptionBenchmark.encrypti<wbr>on thrpt 50 238.587 4.667<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> ops/s<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> b.DecryptionBenchmark.decrypti<wbr>on avgt 50 0.010 0.000<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> s/op<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> b.DecryptionBenchmark.encrypti<wbr>on avgt 50 0.004 0.000<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> s/op<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> b.DecryptionBenchmark.decrypti<wbr>on sample 5544 0.010 0.000<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> s/op<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> b.DecryptionBenchmark.encrypti<wbr>on sample 13067 0.004 0.000<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> s/op<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> b.DecryptionBenchmark.decrypti<wbr>on ss 50 0.014 0.001<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> s<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> b.DecryptionBenchmark.encrypti<wbr>on ss 50 0.009 0.001<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> s<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> Process finished with exit code 0<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> ______________________________<wbr>_________________<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> Devel mailing list<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> <a href="mailto:Devel@ovirt.org" class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg" target="_blank">Devel@ovirt.org</a><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
> <a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/devel</a><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
______________________________<wbr>_________________<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
Devel mailing list<br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
<a href="mailto:Devel@ovirt.org" class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg" target="_blank">Devel@ovirt.org</a><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/devel</a><br class="gmail-m_5473273020916528631m_-2453329783394934049gmail_msg">
</blockquote></div>
</div></div><br>______________________________<wbr>_________________<br>
Devel mailing list<br>
<a href="mailto:Devel@ovirt.org" target="_blank">Devel@ovirt.org</a><br>
<a href="http://lists.ovirt.org/mailman/listinfo/devel" rel="noreferrer" target="_blank">http://lists.ovirt.org/mailman<wbr>/listinfo/devel</a><br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail-m_5473273020916528631gmail_signature"><div dir="ltr"><div>Greg Sheremeta, MBA<br>Red Hat, Inc.<br>Sr. Software Engineer<br><a href="mailto:gshereme@redhat.com" target="_blank">gshereme@redhat.com</a><br></div></div></div>
</div></div></div>