<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:SimSun;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:SimSun;
panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
@font-face
{font-family:"\@SimSun";
panose-1:2 1 6 0 3 1 1 1 1 1;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0in;
margin-right:0in;
margin-bottom:0in;
margin-left:.5in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
span.EmailStyle20
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:windowtext;}
span.EmailStyle21
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle22
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle23
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle24
{mso-style-type:personal;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.EmailStyle25
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:956259787;
mso-list-type:hybrid;
mso-list-template-ids:-1281328618 683963380 67698691 67698693 67698689 67698691 67698693 67698689 67698691 67698693;}
@list l0:level1
{mso-level-start-at:455;
mso-level-number-format:bullet;
mso-level-text:-;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Calibri","sans-serif";
mso-fareast-font-family:SimSun;
mso-bidi-font-family:"Times New Roman";}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:\F0B7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Symbol;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:o;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:"Courier New";}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:\F0A7;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-.25in;
font-family:Wingdings;}
ol
{margin-bottom:0in;}
ul
{margin-bottom:0in;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='color:#1F497D'>Sure can<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><a href="http://www.gluster.org/community/documentation/index.php/GlusterFS_iSCSI">http://www.gluster.org/community/documentation/index.php/GlusterFS_iSCSI</a><o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>As for tuning, I don’t have enough information about my own system to even say. I know that there are tuning options that you have with glusterFS, and you will have to see what works best for your deployment. <o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Regards<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Donny D<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>cloudspin.me<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Yue, Cong [mailto:Cong_Yue@alliedtelesis.com] <br><b>Sent:</b> Thursday, January 15, 2015 12:30 PM<br><b>To:</b> Donny Davis; users@ovirt.org<br><b>Subject:</b> RE: [ovirt-users] Performance issue for GlusterFS as the block storage for VMs<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><span style='color:#1F497D'>It is just the default configuration. What is your advice for the tuning of I/O performance?<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>For Gluster FS, actually I used Xenserver currently. I justed mounted the gluster as a NFS to XenHost to be used as a SR. Is there any way to use GlusterFS as a iscsi target ?<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Thanks,<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Cong<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Donny Davis [<a href="mailto:donny@cloudspin.me">mailto:donny@cloudspin.me</a>] <br><b>Sent:</b> Thursday, January 15, 2015 11:24 AM<br><b>To:</b> Yue, Cong; <a href="mailto:users@ovirt.org">users@ovirt.org</a><br><b>Subject:</b> RE: [ovirt-users] Performance issue for GlusterFS as the block storage for VMs<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><span style='color:#1F497D'>I see. <o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>So have you done any tuning for IO performance or are the configs straight out of the box. You also said you mounted the volume to a vm. Did you mount it as gluster or use the built in NFS??<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Donny<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Yue, Cong [<a href="mailto:Cong_Yue@alliedtelesis.com">mailto:Cong_Yue@alliedtelesis.com</a>] <br><b>Sent:</b> Thursday, January 15, 2015 11:40 AM<br><b>To:</b> Donny Davis; <a href="mailto:users@ovirt.org">users@ovirt.org</a><br><b>Subject:</b> RE: [ovirt-users] Performance issue for GlusterFS as the block storage for VMs<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><span style='color:#1F497D'>I am using iometer (<a href="http://www.iometer.org/">http://www.iometer.org/</a>) to test the IOPS from one of the vm.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>As for IOPS is more trying to test the performance of block, rather than real file transfer.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>In my environment, I am using 10Gbe to make two gluster nodes be replicated. And I mount it to vm as a volume. I tested the performance both for SAS and SSD.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>This is my current result with iometer. <o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><table class=MsoNormalTable border=0 cellspacing=0 cellpadding=0 width=1111 style='width:833.55pt;margin-left:-1.15pt;border-collapse:collapse'><tr style='height:29.25pt'><td width=49 nowrap style='width:37.0pt;border:solid windowtext 1.0pt;background:#00B0F0;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>Test ID<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border-top:solid windowtext 1.0pt;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:none;background:#00B0F0;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Application<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;background:#00B0F0;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Block Size (Bytes)<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border:solid windowtext 1.0pt;border-left:none;background:#00B0F0;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Read/Write %<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border:solid windowtext 1.0pt;border-left:none;background:#00B0F0;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Random/Sequential %<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border:solid windowtext 1.0pt;border-left:none;background:#00B0F0;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>I/O Performance Metrics<o:p></o:p></span></p></td><td width=84 style='width:63.0pt;border:solid windowtext 1.0pt;border-left:none;background:#00B0F0;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>iscsi-hdd<o:p></o:p></span></p></td><td width=78 style='width:58.5pt;border:solid windowtext 1.0pt;border-left:none;background:#00B0F0;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>iscsi-ssd<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border-top:solid windowtext 1.0pt;border-left:none;border-bottom:none;border-right:solid windowtext 1.0pt;background:#00B0F0;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Guster,HDD<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border-top:solid windowtext 1.0pt;border-left:none;border-bottom:none;border-right:solid windowtext 1.0pt;background:#00B0F0;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Gluster,SSD<o:p></o:p></span></p></td></tr><tr style='height:15.75pt'><td width=49 nowrap valign=bottom style='width:37.0pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>1<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border:none;border-bottom:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Web File Server<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;border-top:none;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>4K<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>95%/5%<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>75%/25%<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>IOPS<o:p></o:p></span></p></td><td width=84 nowrap valign=bottom style='width:63.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>195.28<o:p></o:p></span></p></td><td width=78 nowrap valign=bottom style='width:58.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>2400.63<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border:solid windowtext 1.0pt;border-left:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>208.50<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border:solid windowtext 1.0pt;border-left:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>646.75<o:p></o:p></span></p></td></tr><tr style='height:15.75pt'><td width=49 nowrap valign=bottom style='width:37.0pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>2<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border:none;border-bottom:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Web File Server<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;border-top:none;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>8K<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>95%/5%<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>75%/25%<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>IOPS<o:p></o:p></span></p></td><td width=84 nowrap valign=bottom style='width:63.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>193.97<o:p></o:p></span></p></td><td width=78 nowrap valign=bottom style='width:58.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>2225.73<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>179.89<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>649.93<o:p></o:p></span></p></td></tr><tr style='height:15.75pt'><td width=49 nowrap valign=bottom style='width:37.0pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>3<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border:none;border-bottom:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Web File Server<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;border-top:none;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>64K<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>95%/5%<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>75%/25%<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>IOPS<o:p></o:p></span></p></td><td width=84 nowrap valign=bottom style='width:63.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>180.50<o:p></o:p></span></p></td><td width=78 nowrap valign=bottom style='width:58.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>1055.05<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>158.28<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>402.15<o:p></o:p></span></p></td></tr><tr style='height:29.25pt'><td width=49 nowrap valign=bottom style='width:37.0pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>4<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border:none;border-bottom:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Database Online Transaction Processing<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;border-top:none;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>8K<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>70%/30%<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>100%/0%<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>IOPS<o:p></o:p></span></p></td><td width=84 nowrap valign=bottom style='width:63.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>163.60<o:p></o:p></span></p></td><td width=78 nowrap valign=bottom style='width:58.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>2415.90<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>132.13<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:29.25pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>308.46<o:p></o:p></span></p></td></tr><tr style='height:15.75pt'><td width=49 nowrap valign=bottom style='width:37.0pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>5<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border:none;border-bottom:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Exchange Email<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;border-top:none;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>4K<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>67%/33%<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>100%/0%<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>IOPS<o:p></o:p></span></p></td><td width=84 nowrap valign=bottom style='width:63.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>167.03<o:p></o:p></span></p></td><td width=78 nowrap valign=bottom style='width:58.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>2685.33<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>145.92<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>294.56<o:p></o:p></span></p></td></tr><tr style='height:15.75pt'><td width=49 nowrap valign=bottom style='width:37.0pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>6<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border:none;border-bottom:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>OS Drive<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;border-top:none;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>8K<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>70%/30%<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>100%/0%<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>IOPS<o:p></o:p></span></p></td><td width=84 nowrap valign=bottom style='width:63.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>163.60<o:p></o:p></span></p></td><td width=78 nowrap valign=bottom style='width:58.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>2407.02<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>146.11<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>310.82<o:p></o:p></span></p></td></tr><tr style='height:15.75pt'><td width=49 nowrap valign=bottom style='width:37.0pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>7<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border:none;border-bottom:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Decision Support System<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;border-top:none;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>1M<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>100%/0%<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>100%/0%<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>IOPS<o:p></o:p></span></p></td><td width=84 nowrap valign=bottom style='width:63.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>74.24<o:p></o:p></span></p></td><td width=78 nowrap valign=bottom style='width:58.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>207.42<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>81.14<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>112.20<o:p></o:p></span></p></td></tr><tr style='height:15.75pt'><td width=49 nowrap valign=bottom style='width:37.0pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>8<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border:none;border-bottom:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>File Server<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;border-top:none;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>8K<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>90%/10%<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>75%/25%<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>IOPS<o:p></o:p></span></p></td><td width=84 nowrap valign=bottom style='width:63.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>191.20<o:p></o:p></span></p></td><td width=78 nowrap valign=bottom style='width:58.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>2102.32<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>359.54<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>526.86<o:p></o:p></span></p></td></tr><tr style='height:15.75pt'><td width=49 nowrap valign=bottom style='width:37.0pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>9<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border:none;border-bottom:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Video on Demand<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;border-top:none;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>512K<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>100%/0%<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>100%/0%<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>IOPS<o:p></o:p></span></p></td><td width=84 nowrap valign=bottom style='width:63.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>100.32<o:p></o:p></span></p></td><td width=78 nowrap valign=bottom style='width:58.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>327.19<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>136.66<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>162.48<o:p></o:p></span></p></td></tr><tr style='height:15.75pt'><td width=49 nowrap valign=bottom style='width:37.0pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>10<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border:none;border-bottom:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Traffic Simulation<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;border-top:none;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>8K<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>50%/50%<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>75%/25%<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>IOPS<o:p></o:p></span></p></td><td width=84 nowrap valign=bottom style='width:63.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>238.28<o:p></o:p></span></p></td><td width=78 nowrap valign=bottom style='width:58.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>1923.91<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>301.05<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>297.70<o:p></o:p></span></p></td></tr><tr style='height:15.75pt'><td width=49 nowrap valign=bottom style='width:37.0pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>11<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border:none;border-bottom:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Web Server Logging<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;border-top:none;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>8K<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>0%/100%<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>0%/100%<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>IOPS<o:p></o:p></span></p></td><td width=84 nowrap valign=bottom style='width:63.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>3488.47<o:p></o:p></span></p></td><td width=78 nowrap valign=bottom style='width:58.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>3644.33<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>290.33<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>282.04<o:p></o:p></span></p></td></tr><tr style='height:15.75pt'><td width=49 nowrap valign=bottom style='width:37.0pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>12<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border:none;border-bottom:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>SQL Server Logging<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;border-top:none;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>64K<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>0%/100%<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>0%/100%<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>IOPS<o:p></o:p></span></p></td><td width=84 nowrap valign=bottom style='width:63.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>1423.29<o:p></o:p></span></p></td><td width=78 nowrap valign=bottom style='width:58.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>1375.33<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>182.67<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>168.64<o:p></o:p></span></p></td></tr><tr style='height:15.75pt'><td width=49 nowrap valign=bottom style='width:37.0pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>13<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border:none;border-bottom:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>OS Paging<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;border-top:none;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>64K<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>90%/10%<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>0%/100%<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>IOPS<o:p></o:p></span></p></td><td width=84 nowrap valign=bottom style='width:63.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>1215.74<o:p></o:p></span></p></td><td width=78 nowrap valign=bottom style='width:58.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>1211.01<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>381.17<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>355.99<o:p></o:p></span></p></td></tr><tr style='height:15.75pt'><td width=49 nowrap valign=bottom style='width:37.0pt;border:solid windowtext 1.0pt;border-top:none;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>14<o:p></o:p></span></p></td><td width=198 style='width:148.25pt;border:none;border-bottom:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal><span style='font-size:10.5pt;font-family:Consolas;color:black'>Media Streaming<o:p></o:p></span></p></td><td width=90 style='width:67.5pt;border:solid windowtext 1.0pt;border-top:none;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>64K<o:p></o:p></span></p></td><td width=114 style='width:85.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>98%/2%<o:p></o:p></span></p></td><td width=150 style='width:112.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>0%/100%<o:p></o:p></span></p></td><td width=144 style='width:107.7pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;background:#D9D9D9;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='color:black'>IOPS<o:p></o:p></span></p></td><td width=84 nowrap valign=bottom style='width:63.0pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>1350.96<o:p></o:p></span></p></td><td width=78 nowrap valign=bottom style='width:58.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=right style='text-align:right'><span style='color:black'>1365.22<o:p></o:p></span></p></td><td width=102 style='width:76.5pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>457.28<o:p></o:p></span></p></td><td width=102 style='width:76.8pt;border-top:none;border-left:none;border-bottom:solid windowtext 1.0pt;border-right:solid windowtext 1.0pt;padding:0in 5.4pt 0in 5.4pt;height:15.75pt'><p class=MsoNormal align=center style='text-align:center'><span style='font-size:10.5pt;font-family:Consolas;color:black'>455.49<o:p></o:p></span></p></td></tr></table><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>The issue for GlusterFS I found is <o:p></o:p></span></p><p class=MsoListParagraph style='text-indent:-.25in;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='color:#1F497D'><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span style='color:#1F497D'>It can not retain the nature of SSD and SAS, such as SAS is strong for sequential access. SSD is strong for random access.<o:p></o:p></span></p><p class=MsoListParagraph style='text-indent:-.25in;mso-list:l0 level1 lfo2'><![if !supportLists]><span style='color:#1F497D'><span style='mso-list:Ignore'>-<span style='font:7.0pt "Times New Roman"'> </span></span></span><![endif]><span style='color:#1F497D'>In some case, especially for SSD, the performance is pretty bad.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Thanks,<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Cong<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> Donny Davis [<a href="mailto:donny@cloudspin.me">mailto:donny@cloudspin.me</a>] <br><b>Sent:</b> Thursday, January 15, 2015 10:27 AM<br><b>To:</b> Yue, Cong; <a href="mailto:users@ovirt.org">users@ovirt.org</a><br><b>Subject:</b> RE: [ovirt-users] Performance issue for GlusterFS as the block storage for VMs<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal><span style='color:#1F497D'>Do you have any metrics to give an idea of the difference. I am using NFS right now, and I am migrating to Gluster. I have the gluster system up, and I see that it seems to provision disks faster than my NFS. I haven’t used any real measurement tools to get actual metrics, this is all perceived. <o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Do you have an operational gluster?<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Do what are you using right now?<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Donny D<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>cloudspin.me<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><div><div style='border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in'><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> <a href="mailto:users-bounces@ovirt.org">users-bounces@ovirt.org</a> [<a href="mailto:users-bounces@ovirt.org">mailto:users-bounces@ovirt.org</a>] <b>On Behalf Of </b>Yue, Cong<br><b>Sent:</b> Thursday, January 15, 2015 10:57 AM<br><b>To:</b> <a href="mailto:users@ovirt.org">users@ovirt.org</a><br><b>Subject:</b> [ovirt-users] Performance issue for GlusterFS as the block storage for VMs<o:p></o:p></span></p></div></div><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Hi <o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I have one question about whether GlusterFS is the suitable solution to be used as the block storage for VMs.<o:p></o:p></p><p class=MsoNormal>The failure tolerant and scalability is good for GlusterFS, but in my test, it seems the iops is pretty bad. In some blog, it said, it is even with worse performance than normal NFS.<o:p></o:p></p><p class=MsoNormal>Should I use iscsi+drbd for the block storage for VMs.<o:p></o:p></p><p class=MsoNormal>Can somebody give some advice for this? <o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>Thanks,<br>Cong<o:p></o:p></p><p class=MsoNormal><span style='font-size:12.0pt;font-family:"Times New Roman","serif"'><o:p> </o:p></span></p><div class=MsoNormal align=center style='text-align:center'><span style='font-size:12.0pt;font-family:"Times New Roman","serif"'><hr size=2 width="100%" align=center></span></div><p class=MsoNormal><span style='font-size:7.5pt;font-family:"Arial","sans-serif";color:gray'>This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's e-mail System Administrator.</span><span style='font-size:12.0pt;font-family:"Times New Roman","serif"'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:12.0pt;font-family:"Times New Roman","serif"'><o:p> </o:p></span></p><div class=MsoNormal align=center style='text-align:center'><span style='font-size:12.0pt;font-family:"Times New Roman","serif"'><hr size=2 width="100%" align=center></span></div><p class=MsoNormal><span style='font-size:7.5pt;font-family:"Arial","sans-serif";color:gray'>This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's e-mail System Administrator.</span><span style='font-size:12.0pt;font-family:"Times New Roman","serif"'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:12.0pt;font-family:"Times New Roman","serif"'><o:p> </o:p></span></p><div class=MsoNormal align=center style='text-align:center'><span style='font-size:12.0pt;font-family:"Times New Roman","serif"'><hr size=2 width="100%" align=center></span></div><p class=MsoNormal><span style='font-size:7.5pt;font-family:"Arial","sans-serif";color:gray'>This e-mail message is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply e-mail and destroy all copies of the original message. If you are the intended recipient, please be advised that the content of this message is subject to access, review and disclosure by the sender's e-mail System Administrator.</span><span style='font-size:12.0pt;font-family:"Times New Roman","serif"'><o:p></o:p></span></p></div></body></html>