<html>
<head>
<meta name="generator" content="Windows Mail 17.5.9600.20315">
<style data-externalstyle="true"><!--
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph {
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
}
p.MsoNormal, li.MsoNormal, div.MsoNormal {
margin:0in;
margin-bottom:.0001pt;
}
p.MsoListParagraphCxSpFirst, li.MsoListParagraphCxSpFirst, div.MsoListParagraphCxSpFirst,
p.MsoListParagraphCxSpMiddle, li.MsoListParagraphCxSpMiddle, div.MsoListParagraphCxSpMiddle,
p.MsoListParagraphCxSpLast, li.MsoListParagraphCxSpLast, div.MsoListParagraphCxSpLast {
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
line-height:115%;
}
--></style></head>
<body dir="ltr">
<div data-externalstyle="false" dir="ltr" style="font-family: 'Calibri', 'Segoe UI', 'Meiryo', 'Microsoft YaHei UI', 'Microsoft JhengHei UI', 'Malgun Gothic', 'sans-serif';font-size:12pt;"><div>Steve,</div><div>What is the CPU load of the GlusterFS host when comparing the raw brick test to the gluster mount point test? Give it 30 seconds and see what top reports. You’ll probably have to significantly increase the count on the test so that it runs that long.<br></div><div data-signatureblock="true"><div><br></div><div>- Nick</div><div><br></div></div><div style="padding-top: 5px; border-top-color: rgb(229, 229, 229); border-top-width: 1px; border-top-style: solid;"><div><font face=" 'Calibri', 'Segoe UI', 'Meiryo', 'Microsoft YaHei UI', 'Microsoft JhengHei UI', 'Malgun Gothic', 'sans-serif'" style='line-height: 15pt; letter-spacing: 0.02em; font-family: "Calibri", "Segoe UI", "Meiryo", "Microsoft YaHei UI", "Microsoft JhengHei UI", "Malgun Gothic", "sans-serif"; font-size: 12pt;'><b>From:</b> <a href="mailto:srao@redhat.com" target="_parent">Sanjay Rao</a><br><b>Sent:</b> Friday, January 24, 2014 3:35 PM<br><b>To:</b> <a href="mailto:sdainard@miovision.com" target="_parent">Steve Dainard</a><br><b>Cc:</b> <a href="mailto:rsibley@redhat.com" target="_parent">Bob Sibley</a>, <a href="mailto:users@ovirt.org" target="_parent">oVirt Mailing List</a>, <a href="mailto:rhod@redhat.com" target="_parent">Ronen Hod</a></font></div></div><div><br></div><div dir=""><div style="color: rgb(0, 0, 0); font-family: times new roman, new york, times, serif; font-size: 12pt;"><div>Adding Bob Sibley to this thread. <br></div><div><br></div><div><br></div><hr id="zwchr"><blockquote style="color: rgb(0, 0, 0); padding-left: 5px; font-family: Helvetica,Arial,sans-serif; font-size: 12pt; font-style: normal; font-weight: normal; text-decoration: none; margin-top: 0px; margin-bottom: 0px; margin-left: 5px; border-left-color: rgb(16, 16, 255); border-left-width: 2px; border-left-style: solid;" data-mce-style="border-left: 2px solid #1010FF; margin-left: 5px; padding-left: 5px; color: #000; font-weight: normal; font-style: normal; text-decoration: none; font-family: Helvetica,Arial,sans-serif; font-size: 12pt;"><b>From: </b>"Steve Dainard" <sdainard@miovision.com><br><b>To: </b>"Andrew Cathrow" <acathrow@redhat.com><br><b>Cc: </b>"Ronen Hod" <rhod@redhat.com>, "users" <users@ovirt.org>, "Sanjay Rao" <srao@redhat.com>, "Itamar Heim" <iheim@redhat.com><br><b>Sent: </b>Friday, January 24, 2014 3:01:25 PM<br><b>Subject: </b>Re: [Users] Extremely poor disk access speeds in Windows guest<br><div><br></div><div dir="ltr">Not sure what a good method to bench this would be, but:<div><br></div><div>An NFS mount point on virt host:</div><div><div>[root@ovirt001 iso-store]# dd if=/dev/zero of=test1 bs=4k count=100000</div><div>100000+0 records in</div><div>100000+0 records out</div><div>409600000 bytes (410 MB) copied, 3.95399 s, 104 MB/s</div></div><div><br></div><div>Raw brick performance on gluster server (yes, I know I shouldn't write directly to the brick):</div><div><div>[root@gluster1 iso-store]# dd if=/dev/zero of=test bs=4k count=100000</div><div>100000+0 records in</div><div>100000+0 records out</div><div>409600000 bytes (410 MB) copied, 3.06743 s, 134 MB/s</div></div><div><br></div><div>Gluster mount point on gluster server:</div><div><div>[root@gluster1 iso-store]# dd if=/dev/zero of=test bs=4k count=100000</div><div>100000+0 records in</div><div>100000+0 records out</div><div>409600000 bytes (410 MB) copied, 19.5766 s, 20.9 MB/s</div></div><div><br></div><div>The storage servers are a bit older, but are both dual socket quad core opterons with 4x 7200rpm drives. </div><div><br></div><div>I'm in the process of setting up a share from my desktop and I'll see if I can bench between the two systems. Not sure if my ssd will impact the tests, I've heard there isn't an advantage using ssd storage for glusterfs.</div><div><br></div><div>Does anyone have a hardware reference design for glusterfs as a backend for virt? Or is there a benchmark utility?</div></div><div class="gmail_extra"><br clear="all"><div><div dir="ltr"><span style="font-family: arial,sans-serif; font-size: 16px;" data-mce-style="font-family: arial,sans-serif; font-size: 16px;"><strong>Steve Dainard </strong></span><span style="font-size: 12px;" data-mce-style="font-size: 12px;"></span><br> <span style="font-family: arial,sans-serif; font-size: 12px;" data-mce-style="font-family: arial,sans-serif; font-size: 12px;">IT Infrastructure Manager<br> <a href="http://miovision.com/" target="_parent" data-mce-href="http://miovision.com/">Miovision</a> | <em>Rethink Traffic</em><br> 519-513-2407 ex.250<br> 877-646-8476 (toll-free)<br> <br> <strong style="color: rgb(153, 153, 153); font-family: arial,sans-serif; font-size: 13px;" data-mce-style="font-family: arial,sans-serif; font-size: 13px; color: #999999;"><a href="http://miovision.com/blog" target="_parent" data-mce-href="http://miovision.com/blog">Blog</a> | </strong><span style="color: rgb(153, 153, 153); font-family: arial,sans-serif; font-size: 13px;" data-mce-style="font-family: arial,sans-serif; font-size: 13px; color: #999999;"><strong><a href="https://www.linkedin.com/company/miovision-technologies" target="_parent" data-mce-href="https://www.linkedin.com/company/miovision-technologies">LinkedIn</a> | <a href="https://twitter.com/miovision" target="_parent" data-mce-href="https://twitter.com/miovision">Twitter</a> | <a href="https://www.facebook.com/miovision" target="_parent" data-mce-href="https://www.facebook.com/miovision">Facebook</a></strong></span> </span><hr style="color: rgb(51, 51, 51); clear: both; font-family: arial,sans-serif; font-size: 13px;" data-mce-style="font-family: arial,sans-serif; font-size: 13px; color: #333333; clear: both;"><div style="color: rgb(153, 153, 153); padding-top: 5px; font-family: arial,sans-serif; font-size: 13px;" data-mce-style="color: #999999; font-family: arial,sans-serif; font-size: 13px; padding-top: 5px;"><span style="font-family: arial,sans-serif; font-size: 12px;" data-mce-style="font-family: arial,sans-serif; font-size: 12px;">Miovision Technologies Inc. | 148 Manitou Drive, Suite 101, Kitchener, ON, Canada | N2C 1L3</span><br> <span style="font-family: arial,sans-serif; font-size: 12px;" data-mce-style="font-family: arial,sans-serif; font-size: 12px;">This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately.</span></div></div></div><br><div><br></div><div class="gmail_quote">On Thu, Jan 23, 2014 at 7:18 PM, Andrew Cathrow <span dir="ltr"><<a href="mailto:acathrow@redhat.com" target="_parent" data-mce-href="mailto:acathrow@redhat.com">acathrow@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;" data-mce-style="margin: 0 0 0 .8ex; border-left: 1px #ccc solid; padding-left: 1ex;"><div><div style="font-family: arial,helvetica,sans-serif; font-size: 10pt;" data-mce-style="font-size: 10pt; font-family: arial,helvetica,sans-serif;">Are we sure that the issue is the guest I/O - what's the raw performance on the host accessing the gluster storage?<br><div><br></div><hr><blockquote style="padding-left: 5px; font-family: Helvetica,Arial,sans-serif; font-size: 12pt; font-style: normal; font-weight: normal; text-decoration: none; margin-top: 0px; margin-bottom: 0px; margin-left: 5px; border-left-color: rgb(16, 16, 255); border-left-width: 2px; border-left-style: solid;" data-mce-style="padding-left: 5px; font-size: 12pt; font-style: normal; margin-left: 5px; font-family: Helvetica,Arial,sans-serif; text-decoration: none; font-weight: normal; border-left: 2px solid #1010ff;"><b>From: </b>"Steve Dainard" <<a href="mailto:sdainard@miovision.com" target="_parent" data-mce-href="mailto:sdainard@miovision.com">sdainard@miovision.com</a>><br><b>To: </b>"Itamar Heim" <<a href="mailto:iheim@redhat.com" target="_parent" data-mce-href="mailto:iheim@redhat.com">iheim@redhat.com</a>><br> <b>Cc: </b>"Ronen Hod" <<a href="mailto:rhod@redhat.com" target="_parent" data-mce-href="mailto:rhod@redhat.com">rhod@redhat.com</a>>, "users" <<a href="mailto:users@ovirt.org" target="_parent" data-mce-href="mailto:users@ovirt.org">users@ovirt.org</a>>, "Sanjay Rao" <<a href="mailto:srao@redhat.com" target="_parent" data-mce-href="mailto:srao@redhat.com">srao@redhat.com</a>><br> <b>Sent: </b>Thursday, January 23, 2014 4:56:58 PM<br><b>Subject: </b>Re: [Users] Extremely poor disk access speeds in Windows guest<div><div class="h5"><br><div><br></div><div dir="ltr">I have two options, virtio and virtio-scsi.<div><br></div><div>I was using virtio, and have also attempted virtio-scsi on another Windows guest with the same results.</div><div><br></div><div>Using the newest drivers, virtio-win-0.1-74.iso.</div></div><div class="gmail_extra"><br clear="all"><div><div dir="ltr"><span style="font-family: arial,sans-serif; font-size: 16px;" data-mce-style="font-family: arial,sans-serif; font-size: 16px;"><strong>Steve Dainard </strong></span><span style="font-size: 12px;" data-mce-style="font-size: 12px;"></span><br> <span style="font-family: arial,sans-serif; font-size: 12px;" data-mce-style="font-family: arial,sans-serif; font-size: 12px;">IT Infrastructure Manager<br> <a href="http://miovision.com/" target="_parent" data-mce-href="http://miovision.com/">Miovision</a> | <em>Rethink Traffic</em><br> <a href="tel:519-513-2407" target="_parent" data-mce-href="tel:519-513-2407">519-513-2407</a> ex.250<br> <a href="tel:877-646-8476" target="_parent" data-mce-href="tel:877-646-8476">877-646-8476</a> (toll-free)<br> <br> <strong style="color: rgb(153, 153, 153); font-family: arial,sans-serif; font-size: 13px;" data-mce-style="font-family: arial,sans-serif; font-size: 13px; color: #999999;"><a href="http://miovision.com/blog" target="_parent" data-mce-href="http://miovision.com/blog">Blog</a> | </strong><span style="color: rgb(153, 153, 153); font-family: arial,sans-serif; font-size: 13px;" data-mce-style="font-family: arial,sans-serif; font-size: 13px; color: #999999;"><strong><a href="https://www.linkedin.com/company/miovision-technologies" target="_parent" data-mce-href="https://www.linkedin.com/company/miovision-technologies">LinkedIn</a> | <a href="https://twitter.com/miovision" target="_parent" data-mce-href="https://twitter.com/miovision">Twitter</a> | <a href="https://www.facebook.com/miovision" target="_parent" data-mce-href="https://www.facebook.com/miovision">Facebook</a></strong></span> </span><hr style="color: rgb(51, 51, 51); clear: both; font-family: arial,sans-serif; font-size: 13px;" data-mce-style="font-family: arial,sans-serif; font-size: 13px; color: #333333; clear: both;"><div style="color: rgb(153, 153, 153); padding-top: 5px; font-family: arial,sans-serif; font-size: 13px;" data-mce-style="color: #999999; font-family: arial,sans-serif; font-size: 13px; padding-top: 5px;"><span style="font-family: arial,sans-serif; font-size: 12px;" data-mce-style="font-family: arial,sans-serif; font-size: 12px;">Miovision Technologies Inc. | 148 Manitou Drive, Suite 101, Kitchener, ON, Canada | N2C 1L3</span><br> <span style="font-family: arial,sans-serif; font-size: 12px;" data-mce-style="font-family: arial,sans-serif; font-size: 12px;">This e-mail may contain information that is privileged or confidential. If you are not the intended recipient, please delete the e-mail and any attachments and notify us immediately.</span></div></div></div><br><div><br></div><div class="gmail_quote">On Thu, Jan 23, 2014 at 4:24 PM, Itamar Heim <span dir="ltr"><<a href="mailto:iheim@redhat.com" target="_parent" data-mce-href="mailto:iheim@redhat.com">iheim@redhat.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;" data-mce-style="margin: 0 0 0 .8ex; border-left: 1px #ccc solid; padding-left: 1ex;"><div>On 01/23/2014 07:46 PM, Steve Dainard wrote:<br><blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;" data-mce-style="margin: 0 0 0 .8ex; border-left: 1px #ccc solid; padding-left: 1ex;">Backing Storage: Gluster Replica<br> Storage Domain: NFS<br> Ovirt Hosts: CentOS 6.5<br> Ovirt version: 3.3.2<br> Network: GigE<br> # of VM's: 3 - two Linux guests are idle, one Windows guest is<br> installing updates.<br> <br> I've installed a Windows 2008 R2 guest with virtio disk, and all the<br> drivers from the latest virtio iso. I've also installed the spice agent<br> drivers.<br> <br> Guest disk access is horribly slow, Resource monitor during Windows<br> updates shows Disk peaking at 1MB/sec (scale never increases) and Disk<br> Queue Length Peaking at 5 and looks to be sitting at that level 99% of<br> the time. 113 updates in Windows has been running solidly for about 2.5<br> hours and is at 89/113 updates complete.<br></blockquote><br></div>virtio-block or virtio-scsi?<br> which windows guest driver version for that?<br> <br><blockquote class="gmail_quote" style="margin: 0px 0px 0px 0.8ex; padding-left: 1ex; border-left-color: rgb(204, 204, 204); border-left-width: 1px; border-left-style: solid;" data-mce-style="margin: 0 0 0 .8ex; border-left: 1px #ccc solid; padding-left: 1ex;"><div><br> I can't say my Linux guests are blisteringly fast, but updating a guest<br> from RHEL 6.3 fresh install to 6.5 took about 25 minutes.<br> <br> If anyone has any ideas, please let me know - I haven't found any tuning<br> docs for Windows guests that could explain this issue.<br> <br> Thanks,<br> <br> <br></div>*Steve Dainard *<br> <br> <br> <br> ______________________________<span style="text-decoration: underline;" data-mce-style="text-decoration: underline;"></span>_________________<br> Users mailing list<br> <a href="mailto:Users@ovirt.org" target="_parent" data-mce-href="mailto:Users@ovirt.org">Users@ovirt.org</a><br> <a href="http://lists.ovirt.org/mailman/listinfo/users" target="_parent" data-mce-href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/<span style="text-decoration: underline;" data-mce-style="text-decoration: underline;"></span>mailman/listinfo/users</a><br> <br></blockquote><br></blockquote></div><br></div><br>_______________________________________________<br>Users mailing list<br><a href="mailto:Users@ovirt.org" target="_parent" data-mce-href="mailto:Users@ovirt.org">Users@ovirt.org</a><br><a href="http://lists.ovirt.org/mailman/listinfo/users" target="_parent" data-mce-href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a><br></div></div></blockquote><br></div></div></blockquote></div><br></div></blockquote><div><br><br></div><div><br></div><div>-- <br></div><div><span></span>Sanjay Rao <br>Principal Performance Engineer Phone: 978-392-2479 <br>Red Hat, Inc. FAX: 978-392-1001 <br>314 Littleton Road Email: srao@redhat.com <br>Westford, MA 01886 <span></span><br></div></div></div></div>
</body>
</html>