Clarify NUMA feature and CPU pinning

10 Apr 2014

      --_000_B63C858E777679458338A30A991BB52401613084G1W3647americas_
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hi Gilad & Einav

Thanks for sharing your ideas about NUMA feature and CPU pinning. It makes =
easier for users to understand.

And something I want to clarify:

1.      NUMA tuning feature and CPU pinning feature are individually in lib=
virt ( ovirt backend ).

2.      User could configure VM CPU pining ( NUMA not included ) separately=
.

3.      When configuring NUMA feature, user should configure VM NUMA tuning=
 ( pin to host NUMA node & tuning mode ) and VM CPU pinning ( NUMA included=
 ), otherwise VM will have low performance.

4.      Single virtual NUMA node could pin to multiply host NUMA nodes.

5.      Multiply virtual NUMA nodes could pin to single host NUMA node.

6.      NUMA tuning mode have default value 'strict', and could change to '=
prefer', 'interleave'

Our proposal:
OVirt 3.5

1.      Keep current UX design, add NUMA tuning mode select box in VM dialo=
g.

2.      Keep current BE model, query and action command.

3.      Consider the low performance scene ( user did not configure VM CPU =
pinning )

When VdsBroker check the CPU pinning text is empty, then generate the right=
 CPU pinning text from virtual NUMA nodes ( pin to host NUMA nodes )

The next version

1.      Remove current CPU pinning text feature.

2.      Consider the NUMA node inside CPU pinning design. ( Should consider=
 the individually CPU pining design not includes NUMA )

3.      Add related CPU pinning BE model, query and action command.

4.      Turn off VdsBroker generate function.

Do you agree ?

Best Regards,
Jason Liao

--_000_B63C858E777679458338A30A991BB52401613084G1W3647americas_
Content-Type: text/html; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr=
osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:=
//www.w3.org/TR/REC-html40">
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
...
...
<span lang=3D"EN-US" style=3D"font-family:"HP Simplified","=
sans-serif"">asier
 for users to understand.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-family:"HP S=
implified","sans-serif""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-family:"HP S=
implified","sans-serif"">And something I want to clarify:<o:=
<meta name=3D"Generator" content=3D"Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
	{font-family:SimSun;
	panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
	{font-family:"Cambria Math";
	panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
	{font-family:Calibri;
	panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
	{font-family:SimSun;
	panose-1:2 1 6 0 3 1 1 1 1 1;}
@font-face
	{font-family:"HP Simplified";
	panose-1:2 11 6 4 2 2 4 2 2 4;}
@font-face
	{font-family:"YaHei Consolas Hybrid";
	panose-1:2 11 5 9 2 2 4 2 2 4;}
@font-face
	{font-family:"\@YaHei Consolas Hybrid";
	panose-1:2 11 5 9 2 2 4 2 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0cm;
	margin-bottom:.0001pt;
	text-align:justify;
	text-justify:inter-ideograph;
	font-size:10.5pt;
	font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
	{mso-style-priority:99;
	color:#0563C1;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{mso-style-priority:99;
	color:#954F72;
	text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
	{mso-style-priority:34;
	margin:0cm;
	margin-bottom:.0001pt;
	text-align:justify;
	text-justify:inter-ideograph;
	text-indent:21.0pt;
	font-size:10.5pt;
	font-family:"Calibri","sans-serif";}
span.EmailStyle17
	{mso-style-type:personal-compose;
	font-family:"HP Simplified","sans-serif";
	color:windowtext;}
.MsoChpDefault
	{mso-style-type:export-only;}
/* Page Definitions */
@page WordSection1
	{size:612.0pt 792.0pt;
	margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
	{page:WordSection1;}
/* List Definitions */
@list l0
	{mso-list-id:1429885352;
	mso-list-type:hybrid;
	mso-list-template-ids:1234440334 -680652800 67698713 67698715 67698703 676=
98713 67698715 67698703 67698713 67698715;}
@list l0:level1
	{mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:18.0pt;
	text-indent:-18.0pt;}
@list l0:level2
	{mso-level-number-format:alpha-lower;
	mso-level-text:"%2\)";
	mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:42.0pt;
	text-indent:-21.0pt;}
@list l0:level3
	{mso-level-number-format:roman-lower;
	mso-level-tab-stop:none;
	mso-level-number-position:right;
	margin-left:63.0pt;
	text-indent:-21.0pt;}
@list l0:level4
	{mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:84.0pt;
	text-indent:-21.0pt;}
@list l0:level5
	{mso-level-number-format:alpha-lower;
	mso-level-text:"%5\)";
	mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:105.0pt;
	text-indent:-21.0pt;}
@list l0:level6
	{mso-level-number-format:roman-lower;
	mso-level-tab-stop:none;
	mso-level-number-position:right;
	margin-left:126.0pt;
	text-indent:-21.0pt;}
@list l0:level7
	{mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:147.0pt;
	text-indent:-21.0pt;}
@list l0:level8
	{mso-level-number-format:alpha-lower;
	mso-level-text:"%8\)";
	mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:168.0pt;
	text-indent:-21.0pt;}
@list l0:level9
	{mso-level-number-format:roman-lower;
	mso-level-tab-stop:none;
	mso-level-number-position:right;
	margin-left:189.0pt;
	text-indent:-21.0pt;}
@list l1
	{mso-list-id:1967464245;
	mso-list-type:hybrid;
	mso-list-template-ids:-972662618 875743362 67698713 67698715 67698703 6769=
8713 67698715 67698703 67698713 67698715;}
@list l1:level1
	{mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:18.0pt;
	text-indent:-18.0pt;}
@list l1:level2
	{mso-level-number-format:alpha-lower;
	mso-level-text:"%2\)";
	mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:42.0pt;
	text-indent:-21.0pt;}
@list l1:level3
	{mso-level-number-format:roman-lower;
	mso-level-tab-stop:none;
	mso-level-number-position:right;
	margin-left:63.0pt;
	text-indent:-21.0pt;}
@list l1:level4
	{mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:84.0pt;
	text-indent:-21.0pt;}
@list l1:level5
	{mso-level-number-format:alpha-lower;
	mso-level-text:"%5\)";
	mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:105.0pt;
	text-indent:-21.0pt;}
@list l1:level6
	{mso-level-number-format:roman-lower;
	mso-level-tab-stop:none;
	mso-level-number-position:right;
	margin-left:126.0pt;
	text-indent:-21.0pt;}
@list l1:level7
	{mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:147.0pt;
	text-indent:-21.0pt;}
@list l1:level8
	{mso-level-number-format:alpha-lower;
	mso-level-text:"%8\)";
	mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:168.0pt;
	text-indent:-21.0pt;}
@list l1:level9
	{mso-level-number-format:roman-lower;
	mso-level-tab-stop:none;
	mso-level-number-position:right;
	margin-left:189.0pt;
	text-indent:-21.0pt;}
@list l2
	{mso-list-id:2087145080;
	mso-list-type:hybrid;
	mso-list-template-ids:371114318 -413219158 67698713 67698715 67698703 6769=
8713 67698715 67698703 67698713 67698715;}
@list l2:level1
	{mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:18.0pt;
	text-indent:-18.0pt;}
@list l2:level2
	{mso-level-number-format:alpha-lower;
	mso-level-text:"%2\)";
	mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:42.0pt;
	text-indent:-21.0pt;}
@list l2:level3
	{mso-level-number-format:roman-lower;
	mso-level-tab-stop:none;
	mso-level-number-position:right;
	margin-left:63.0pt;
	text-indent:-21.0pt;}
@list l2:level4
	{mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:84.0pt;
	text-indent:-21.0pt;}
@list l2:level5
	{mso-level-number-format:alpha-lower;
	mso-level-text:"%5\)";
	mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:105.0pt;
	text-indent:-21.0pt;}
@list l2:level6
	{mso-level-number-format:roman-lower;
	mso-level-tab-stop:none;
	mso-level-number-position:right;
	margin-left:126.0pt;
	text-indent:-21.0pt;}
@list l2:level7
	{mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:147.0pt;
	text-indent:-21.0pt;}
@list l2:level8
	{mso-level-number-format:alpha-lower;
	mso-level-text:"%8\)";
	mso-level-tab-stop:none;
	mso-level-number-position:left;
	margin-left:168.0pt;
	text-indent:-21.0pt;}
@list l2:level9
	{mso-level-number-format:roman-lower;
	mso-level-tab-stop:none;
	mso-level-number-position:right;
	margin-left:189.0pt;
	text-indent:-21.0pt;}
ol
	{margin-bottom:0cm;}
ul
	{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext=3D"edit">
<o:idmap v:ext=3D"edit" data=3D"1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang=3D"ZH-CN" link=3D"#0563C1" vlink=3D"#954F72" style=3D"text-justi=
fy-trim:punctuation">
<div class=3D"WordSection1">
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-family:"HP S=
implified","sans-serif"">Hi Gilad & Einav<o:p></o:p></sp=
an></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-family:"HP S=
implified","sans-serif""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-family:"HP S=
implified","sans-serif"">Thanks for sharing your ideas about=
 NUMA feature and CPU pinning.</span><span lang=3D"EN-US"> It makes e</span=
p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"margin-left:18.0pt;text-indent:-18.0=
pt;mso-list:l2 level1 lfo1">
<![if !supportLists]><span lang=3D"EN-US" style=3D"font-family:"HP Sim=
plified","sans-serif""><span style=3D"mso-list:Ignore">1.<sp=
an style=3D"font:7.0pt "Times New Roman"">    =
; 
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-family:&q=
uot;HP Simplified","sans-serif"">NUMA tuning feature and CPU=
 pinning feature are individually in libvirt ( ovirt backend ).<o:p></o:p><=
/span></p>
<p class=3D"MsoListParagraph" style=3D"margin-left:18.0pt;text-indent:-18.0=
pt;mso-list:l2 level1 lfo1">
<![if !supportLists]><span lang=3D"EN-US" style=3D"font-family:"HP Sim=
plified","sans-serif""><span style=3D"mso-list:Ignore">2.<sp=
an style=3D"font:7.0pt "Times New Roman"">    =
; 
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-family:&q=
uot;HP Simplified","sans-serif"">User could configure VM CPU=
 pining ( NUMA not included ) separately.<o:p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"margin-left:18.0pt;text-indent:-18.0=
pt;mso-list:l2 level1 lfo1">
<![if !supportLists]><span lang=3D"EN-US" style=3D"font-family:"HP Sim=
plified","sans-serif""><span style=3D"mso-list:Ignore">3.<sp=
an style=3D"font:7.0pt "Times New Roman"">    =
; 
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-family:&q=
uot;HP Simplified","sans-serif"">When configuring NUMA featu=
re, user should configure VM NUMA tuning ( pin to host NUMA node & tuni=
ng mode ) and VM CPU pinning ( NUMA included ), otherwise VM
 will have low performance.<o:p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"margin-left:18.0pt;text-indent:-18.0=
pt;mso-list:l2 level1 lfo1">
<![if !supportLists]><span lang=3D"EN-US" style=3D"font-family:"HP Sim=
plified","sans-serif""><span style=3D"mso-list:Ignore">4.<sp=
an style=3D"font:7.0pt "Times New Roman"">    =
; 
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-family:&q=
uot;HP Simplified","sans-serif"">Single virtual NUMA node co=
uld pin to multiply host NUMA nodes.<o:p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"margin-left:18.0pt;text-indent:-18.0=
pt;mso-list:l2 level1 lfo1">
<![if !supportLists]><span lang=3D"EN-US" style=3D"font-family:"HP Sim=
plified","sans-serif""><span style=3D"mso-list:Ignore">5.<sp=
an style=3D"font:7.0pt "Times New Roman"">    =
; 
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-family:&q=
uot;HP Simplified","sans-serif"">Multiply virtual NUMA nodes=
 could pin to single host NUMA node.<o:p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"margin-left:18.0pt;text-indent:-18.0=
pt;mso-list:l2 level1 lfo1">
<![if !supportLists]><span lang=3D"EN-US" style=3D"font-family:"HP Sim=
plified","sans-serif""><span style=3D"mso-list:Ignore">6.<sp=
an style=3D"font:7.0pt "Times New Roman"">    =
; 
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-family:&q=
uot;HP Simplified","sans-serif"">NUMA tuning mode have defau=
lt value ‘strict’, and could change to ‘prefer’, &#=
8216;interleave’<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-family:"HP S=
implified","sans-serif""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-family:"HP S=
implified","sans-serif"">Our proposal:<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-family:"HP S=
implified","sans-serif"">OVirt 3.5<o:p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"margin-left:18.0pt;text-indent:-18.0=
pt;mso-list:l1 level1 lfo2">
<![if !supportLists]><span lang=3D"EN-US" style=3D"font-family:"HP Sim=
plified","sans-serif""><span style=3D"mso-list:Ignore">1.<sp=
an style=3D"font:7.0pt "Times New Roman"">    =
; 
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-family:&q=
uot;HP Simplified","sans-serif"">Keep current UX design, add=
 NUMA tuning mode select box in VM dialog.<o:p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"margin-left:18.0pt;text-indent:-18.0=
pt;mso-list:l1 level1 lfo2">
<![if !supportLists]><span lang=3D"EN-US" style=3D"font-family:"HP Sim=
plified","sans-serif""><span style=3D"mso-list:Ignore">2.<sp=
an style=3D"font:7.0pt "Times New Roman"">    =
; 
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-family:&q=
uot;HP Simplified","sans-serif"">Keep current BE model, quer=
y and action command.<o:p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"margin-left:18.0pt;text-indent:-18.0=
pt;mso-list:l1 level1 lfo2">
<![if !supportLists]><span lang=3D"EN-US" style=3D"font-family:"HP Sim=
plified","sans-serif""><span style=3D"mso-list:Ignore">3.<sp=
an style=3D"font:7.0pt "Times New Roman"">    =
; 
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-family:&q=
uot;HP Simplified","sans-serif"">Consider the low performanc=
e scene ( user did not configure VM CPU pinning )<o:p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"margin-left:18.0pt;text-indent:0cm">=
<span lang=3D"EN-US" style=3D"font-family:"HP Simplified","s=
ans-serif"">When VdsBroker check the CPU pinning text is empty, then g=
enerate the right CPU pinning text from virtual NUMA nodes (
 pin to host NUMA nodes )<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-family:"HP S=
implified","sans-serif""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-family:"HP S=
implified","sans-serif"">The next version<o:p></o:p></span><=
/p>
<p class=3D"MsoListParagraph" style=3D"margin-left:18.0pt;text-indent:-18.0=
pt;mso-list:l0 level1 lfo3">
<![if !supportLists]><span lang=3D"EN-US" style=3D"font-family:"HP Sim=
plified","sans-serif""><span style=3D"mso-list:Ignore">1.<sp=
an style=3D"font:7.0pt "Times New Roman"">    =
; 
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-family:&q=
uot;HP Simplified","sans-serif"">Remove current CPU pinning =
text feature.<o:p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"margin-left:18.0pt;text-indent:-18.0=
pt;mso-list:l0 level1 lfo3">
<![if !supportLists]><span lang=3D"EN-US" style=3D"font-family:"HP Sim=
plified","sans-serif""><span style=3D"mso-list:Ignore">2.<sp=
an style=3D"font:7.0pt "Times New Roman"">    =
; 
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-family:&q=
uot;HP Simplified","sans-serif"">Consider the NUMA node insi=
de CPU pinning design. ( Should consider the individually CPU pining design=
 not includes NUMA )<o:p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"margin-left:18.0pt;text-indent:-18.0=
pt;mso-list:l0 level1 lfo3">
<![if !supportLists]><span lang=3D"EN-US" style=3D"font-family:"HP Sim=
plified","sans-serif""><span style=3D"mso-list:Ignore">3.<sp=
an style=3D"font:7.0pt "Times New Roman"">    =
; 
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-family:&q=
uot;HP Simplified","sans-serif"">Add related CPU pinning BE =
model, query and action command.<o:p></o:p></span></p>
<p class=3D"MsoListParagraph" style=3D"margin-left:18.0pt;text-indent:-18.0=
pt;mso-list:l0 level1 lfo3">
<![if !supportLists]><span lang=3D"EN-US" style=3D"font-family:"HP Sim=
plified","sans-serif""><span style=3D"mso-list:Ignore">4.<sp=
an style=3D"font:7.0pt "Times New Roman"">    =
; 
</span></span></span><![endif]><span lang=3D"EN-US" style=3D"font-family:&q=
uot;HP Simplified","sans-serif"">Turn off VdsBroker generate=
 function.<o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-family:"HP S=
implified","sans-serif""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-family:"HP S=
implified","sans-serif"">Do you agree ?<o:p></o:p></span></p=
...
<p class=3D"MsoNormal"><span lang=3D"EN-US" style=3D"font-family:"HP S=
implified","sans-serif""><o:p> </o:p></span></p>
<p class=3D"MsoNormal"><b><span lang=3D"EN-US" style=3D"font-size:9.0pt;fon=
t-family:"HP Simplified","sans-serif";color:black">Best=
 Regards,<br>
</span></b><span lang=3D"EN-US" style=3D"font-size:9.0pt;font-family:"=
HP Simplified","sans-serif";color:#717172">Jason Liao</span>=
<span lang=3D"EN-US"><o:p></o:p></span></p>
<p class=3D"MsoNormal"><span lang=3D"EN-US"><o:p> </o:p></span></p>
</div>
</body>
</html>

--_000_B63C858E777679458338A30A991BB52401613084G1W3647americas_--

Liao, Chuan (Jason Liao, HPservers-Core-OE-PSC)

Gilad Chaplik

tags

participants (2)