4:02 p.m.
--Apple-Mail-4BE130A2-7625-4431-A484-D11585211FAD
Content-Type: multipart/alternative;
boundary=Apple-Mail-3ECBB579-7F0A-4ECB-87BA-F76951FECD32
Content-Transfer-Encoding: 7bit
--Apple-Mail-3ECBB579-7F0A-4ECB-87BA-F76951FECD32
Content-Type: text/plain;
charset=us-ascii
Content-Transfer-Encoding: quoted-printable
Hello Francesco,
--=20
Daniel Helgenberger=20
m box bewegtbild GmbH=20
P: +49/30/2408781-22
F: +49/30/2408781-10
ACKERSTR. 19=20
D-10115 BERLIN=20
www.m-box.de www.monkeymen.tv=20
On 29.09.2014, at 22:19, Francesco Romani <fromani(a)redhat.com>
wrote:
=20
----- Original Message -----
> From: "Daniel Helgenberger" <daniel.helgenberger(a)m-box.de>
> To: "Francesco Romani" <fromani(a)redhat.com>
> Cc: "Dan Kenigsberg" <danken(a)redhat.com>, users(a)ovirt.org
> Sent: Monday, September 29, 2014 2:54:13 PM
> Subject: Re: [ovirt-users] 3.4: VDSM Memory consumption
>=20
> Hello Francesco,
>=20
>> On 29.09.2014 13:55, Francesco Romani wrote:
>> ----- Original Message -----
>>> From: "Daniel Helgenberger" <daniel.helgenberger(a)m-box.de>
>>> To: "Dan Kenigsberg" <danken(a)redhat.com>
>>> Cc: users(a)ovirt.org
>>> Sent: Monday, September 29, 2014 12:25:22 PM
>>> Subject: Re: [ovirt-users] 3.4: VDSM Memory consumption
>>>=20
>>> Dan,
>>>=20
>>> I just reply to the list since I do not want to clutter BZ:
>>>=20
>>> While migrating VMs is easy (and the sampling is already running), can
>>> someone tell me the correct polling port to block with iptables?
>>>=20
>>> Thanks,
>> Hi Daniel,
>>=20
>> there is indeed a memory profiling patch under discussion:
>> http://gerrit.ovirt.org/#/c/32019/
>>=20
>> but for your case we'll need a backport to 3.4.x and clearer install
>> instructions,
>> which I'll prepare as soon as possible.
> I updated the BZ (and are now blocking 54321/tcp on one of my hosts).
> and verified it is not reachable. As general info: This system I am
> using is my LAB / Test / eval setup for a final deployment for ovirt
> (then 3.5) in production; so it will go away some time in the future (a
> few weeks / months). If I am the only one experiencing this problem then
> you might be better of allocating resources elsewhere ;)
=20
Thanks for your understanding :)
=20
Unfortunately it is true that developer resources aren't so abundant,
but it is also true that memleaks should never be discarded easily and wit=
hout
due investigation, considering the nature and the role of VDSM.
=20
So, I'm all in for further investigation regarding this issue.
=20
>> As for your question: if I understood correctly what you are asking
>> (still catching up the thread), if you are trying to rule out the stats
>> polling
>> made by Engine to this bad leak, one simple way to test is just to shutd=
own
>> Engine,
>> and let VDSMs run unguarded on hypervisors. You'll be able to command th=
ese
>> VDSMs using vdsClient or restarting Engine.
> As I said in my BZ comment this is not an option right now, but if
> understand the matter correctly IPTABLES reject should ultimately do the
> same?
=20
Definitely yes! Just do whatever it is more convenient for you.
=20
As you might have already seen in the BZ comment the leak stopped after bloc=
king the port. Though this is clearly no permanent option - please let me kn=
ow if I can be of any more assistance!=20
--=20
Francesco Romani
RedHat Engineering Virtualization R & D
Phone: 8261328
IRC: fromani
--Apple-Mail-3ECBB579-7F0A-4ECB-87BA-F76951FECD32
Content-Type: text/html;
charset=utf-8
Content-Transfer-Encoding: base64
PGh0bWw+PGhlYWQ+PG1ldGEgaHR0cC1lcXVpdj0iY29udGVudC10eXBlIiBjb250ZW50PSJ0ZXh0
L2h0bWw7IGNoYXJzZXQ9dXRmLTgiPjwvaGVhZD48Ym9keSBkaXI9ImF1dG8iPjxkaXY+SGVsbG8g
RnJhbmNlc2NvLDxicj48YnI+PHNwYW4gc3R5bGU9ImJhY2tncm91bmQtY29sb3I6IHJnYmEoMjU1
LCAyNTUsIDI1NSwgMCk7Ij4tLSZuYnNwOzxicj5EYW5pZWwgSGVsZ2VuYmVyZ2VyJm5ic3A7PGJy
Pm0gYm94IGJld2VndGJpbGQgR21iSCZuYnNwOzxicj48YnI+UDombmJzcDs8YSBocmVmPSJ0ZWw6
KzQ5LzMwLzI0MDg3ODEtMjIiIHgtYXBwbGUtZGF0YS1kZXRlY3RvcnM9InRydWUiIHgtYXBwbGUt
ZGF0YS1kZXRlY3RvcnMtdHlwZT0idGVsZXBob25lIiB4LWFwcGxlLWRhdGEtZGV0ZWN0b3JzLXJl
c3VsdD0iNiI+KzQ5LzMwLzI0MDg3ODEtMjI8L2E+PGJyPkY6Jm5ic3A7PGEgaHJlZj0idGVsOis0
OS8zMC8yNDA4NzgxLTEwIiB4LWFwcGxlLWRhdGEtZGV0ZWN0b3JzPSJ0cnVlIiB4LWFwcGxlLWRh
dGEtZGV0ZWN0b3JzLXR5cGU9InRlbGVwaG9uZSIgeC1hcHBsZS1kYXRhLWRldGVjdG9ycy1yZXN1
bHQ9IjciPis0OS8zMC8yNDA4NzgxLTEwPC9hPjxicj5BQ0tFUlNUUi4gMTkmbmJzcDs8YnI+RC0x
MDExNSBCRVJMSU4mbmJzcDs8YnI+PGEgaHJlZj0iaHR0cDovL3d3dy5tLWJveC5kZS8iIHgtYXBw
bGUtZGF0YS1kZXRlY3RvcnM9InRydWUiIHgtYXBwbGUtZGF0YS1kZXRlY3RvcnMtdHlwZT0ibGlu
ayIgeC1hcHBsZS1kYXRhLWRldGVjdG9ycy1yZXN1bHQ9IjgiPnd3dy5tLWJveC5kZTwvYT4mbmJz
cDsmbmJzcDs8YSBocmVmPSJodHRwOi8vd3d3Lm1vbmtleW1lbi50di8iIHgtYXBwbGUtZGF0YS1k
ZXRlY3RvcnM9InRydWUiIHgtYXBwbGUtZGF0YS1kZXRlY3RvcnMtdHlwZT0ibGluayIgeC1hcHBs
ZS1kYXRhLWRldGVjdG9ycy1yZXN1bHQ9IjkiPnd3dy5tb25rZXltZW4udHY8L2E+Jm5ic3A7PGJy
Pjwvc3Bhbj48L2Rpdj48ZGl2Pjxicj5PbiAyOS4wOS4yMDE0LCBhdCAyMjoxOSwgRnJhbmNlc2Nv
IFJvbWFuaSAmbHQ7PGEgaHJlZj0ibWFpbHRvOmZyb21hbmlAcmVkaGF0LmNvbSI+ZnJvbWFuaUBy
ZWRoYXQuY29tPC9hPiZndDsgd3JvdGU6PGJyPjxicj48L2Rpdj48YmxvY2txdW90ZSB0eXBlPSJj
aXRlIj48ZGl2PjxzcGFuPi0tLS0tIE9yaWdpbmFsIE1lc3NhZ2UgLS0tLS08L3NwYW4+PGJyPjxi
bG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxzcGFuPkZyb206ICJEYW5pZWwgSGVsZ2VuYmVyZ2VyIiAm
bHQ7PGEgaHJlZj0ibWFpbHRvOmRhbmllbC5oZWxnZW5iZXJnZXJAbS1ib3guZGUiPmRhbmllbC5o
ZWxnZW5iZXJnZXJAbS1ib3guZGU8L2E+Jmd0Ozwvc3Bhbj48YnI+PC9ibG9ja3F1b3RlPjxibG9j
a3F1b3RlIHR5cGU9ImNpdGUiPjxzcGFuPlRvOiAiRnJhbmNlc2NvIFJvbWFuaSIgJmx0OzxhIGhy
ZWY9Im1haWx0bzpmcm9tYW5pQHJlZGhhdC5jb20iPmZyb21hbmlAcmVkaGF0LmNvbTwvYT4mZ3Q7
PC9zcGFuPjxicj48L2Jsb2NrcXVvdGU+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PHNwYW4+Q2M6
ICJEYW4gS2VuaWdzYmVyZyIgJmx0OzxhIGhyZWY9Im1haWx0bzpkYW5rZW5AcmVkaGF0LmNvbSI+
ZGFua2VuQHJlZGhhdC5jb208L2E+Jmd0OywgPGEgaHJlZj0ibWFpbHRvOnVzZXJzQG92aXJ0Lm9y
ZyI+dXNlcnNAb3ZpcnQub3JnPC9hPjwvc3Bhbj48YnI+PC9ibG9ja3F1b3RlPjxibG9ja3F1b3Rl
IHR5cGU9ImNpdGUiPjxzcGFuPlNlbnQ6IE1vbmRheSwgU2VwdGVtYmVyIDI5LCAyMDE0IDI6NTQ6
MTMgUE08L3NwYW4+PGJyPjwvYmxvY2txdW90ZT48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48c3Bh
bj5TdWJqZWN0OiBSZTogW292aXJ0LXVzZXJzXSAmbmJzcDsgJm5ic3A7My40OiBWRFNNJm5ic3A7
TWVtb3J5IGNvbnN1bXB0aW9uPC9zcGFuPjxicj48L2Jsb2NrcXVvdGU+PGJsb2NrcXVvdGUgdHlw
ZT0iY2l0ZSI+PHNwYW4+PC9zcGFuPjxicj48L2Jsb2NrcXVvdGU+PGJsb2NrcXVvdGUgdHlwZT0i
Y2l0ZSI+PHNwYW4+SGVsbG8gRnJhbmNlc2NvLDwvc3Bhbj48YnI+PC9ibG9ja3F1b3RlPjxibG9j
a3F1b3RlIHR5cGU9ImNpdGUiPjxzcGFuPjwvc3Bhbj48YnI+PC9ibG9ja3F1b3RlPjxibG9ja3F1
b3RlIHR5cGU9ImNpdGUiPjxzcGFuPk9uIDI5LjA5LjIwMTQgMTM6NTUsIEZyYW5jZXNjbyBSb21h
bmkgd3JvdGU6PC9zcGFuPjxicj48L2Jsb2NrcXVvdGU+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+
PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PHNwYW4+LS0tLS0gT3JpZ2luYWwgTWVzc2FnZSAtLS0t
LTwvc3Bhbj48YnI+PC9ibG9ja3F1b3RlPjwvYmxvY2txdW90ZT48YmxvY2txdW90ZSB0eXBlPSJj
aXRlIj48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48c3Bh
bj5Gcm9tOiAiRGFuaWVsIEhlbGdlbmJlcmdlciIgJmx0OzxhIGhyZWY9Im1haWx0bzpkYW5pZWwu
aGVsZ2VuYmVyZ2VyQG0tYm94LmRlIj5kYW5pZWwuaGVsZ2VuYmVyZ2VyQG0tYm94LmRlPC9hPiZn
dDs8L3NwYW4+PGJyPjwvYmxvY2txdW90ZT48L2Jsb2NrcXVvdGU+PC9ibG9ja3F1b3RlPjxibG9j
a3F1b3RlIHR5cGU9ImNpdGUiPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxibG9ja3F1b3RlIHR5
cGU9ImNpdGUiPjxzcGFuPlRvOiAiRGFuIEtlbmlnc2JlcmciICZsdDs8YSBocmVmPSJtYWlsdG86
ZGFua2VuQHJlZGhhdC5jb20iPmRhbmtlbkByZWRoYXQuY29tPC9hPiZndDs8L3NwYW4+PGJyPjwv
YmxvY2txdW90ZT48L2Jsb2NrcXVvdGU+PC9ibG9ja3F1b3RlPjxibG9ja3F1b3RlIHR5cGU9ImNp
dGUiPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxzcGFu
PkNjOiA8YSBocmVmPSJtYWlsdG86dXNlcnNAb3ZpcnQub3JnIj51c2Vyc0BvdmlydC5vcmc8L2E+
PC9zcGFuPjxicj48L2Jsb2NrcXVvdGU+PC9ibG9ja3F1b3RlPjwvYmxvY2txdW90ZT48YmxvY2tx
dW90ZSB0eXBlPSJjaXRlIj48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48YmxvY2txdW90ZSB0eXBl
PSJjaXRlIj48c3Bhbj5TZW50OiBNb25kYXksIFNlcHRlbWJlciAyOSwgMjAxNCAxMjoyNToyMiBQ
TTwvc3Bhbj48YnI+PC9ibG9ja3F1b3RlPjwvYmxvY2txdW90ZT48L2Jsb2NrcXVvdGU+PGJsb2Nr
cXVvdGUgdHlwZT0iY2l0ZSI+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PGJsb2NrcXVvdGUgdHlw
ZT0iY2l0ZSI+PHNwYW4+U3ViamVjdDogUmU6IFtvdmlydC11c2Vyc10gJm5ic3A7ICZuYnNwOzMu
NDogVkRTTSBNZW1vcnkgY29uc3VtcHRpb248L3NwYW4+PGJyPjwvYmxvY2txdW90ZT48L2Jsb2Nr
cXVvdGU+PC9ibG9ja3F1b3RlPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxibG9ja3F1b3RlIHR5
cGU9ImNpdGUiPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxzcGFuPjwvc3Bhbj48YnI+PC9ibG9j
a3F1b3RlPjwvYmxvY2txdW90ZT48L2Jsb2NrcXVvdGU+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+
PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PHNwYW4+RGFu
LDwvc3Bhbj48YnI+PC9ibG9ja3F1b3RlPjwvYmxvY2txdW90ZT48L2Jsb2NrcXVvdGU+PGJsb2Nr
cXVvdGUgdHlwZT0iY2l0ZSI+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PGJsb2NrcXVvdGUgdHlw
ZT0iY2l0ZSI+PHNwYW4+PC9zcGFuPjxicj48L2Jsb2NrcXVvdGU+PC9ibG9ja3F1b3RlPjwvYmxv
Y2txdW90ZT48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48
YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48c3Bhbj5JIGp1c3QgcmVwbHkgdG8gdGhlIGxpc3Qgc2lu
Y2UgSSBkbyBub3Qgd2FudCB0byBjbHV0dGVyIEJaOjwvc3Bhbj48YnI+PC9ibG9ja3F1b3RlPjwv
YmxvY2txdW90ZT48L2Jsb2NrcXVvdGU+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PGJsb2NrcXVv
dGUgdHlwZT0iY2l0ZSI+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PHNwYW4+PC9zcGFuPjxicj48
L2Jsb2NrcXVvdGU+PC9ibG9ja3F1b3RlPjwvYmxvY2txdW90ZT48YmxvY2txdW90ZSB0eXBlPSJj
aXRlIj48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48c3Bh
bj5XaGlsZSBtaWdyYXRpbmcgVk1zIGlzIGVhc3kgKGFuZCB0aGUgc2FtcGxpbmcgaXMgYWxyZWFk
eSBydW5uaW5nKSwgY2FuPC9zcGFuPjxicj48L2Jsb2NrcXVvdGU+PC9ibG9ja3F1b3RlPjwvYmxv
Y2txdW90ZT48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48
YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48c3Bhbj5zb21lb25lIHRlbGwgbWUgdGhlIGNvcnJlY3Qg
cG9sbGluZyBwb3J0IHRvIGJsb2NrIHdpdGggaXB0YWJsZXM/PC9zcGFuPjxicj48L2Jsb2NrcXVv
dGU+PC9ibG9ja3F1b3RlPjwvYmxvY2txdW90ZT48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48Ymxv
Y2txdW90ZSB0eXBlPSJjaXRlIj48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48c3Bhbj48L3NwYW4+
PGJyPjwvYmxvY2txdW90ZT48L2Jsb2NrcXVvdGU+PC9ibG9ja3F1b3RlPjxibG9ja3F1b3RlIHR5
cGU9ImNpdGUiPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUi
PjxzcGFuPlRoYW5rcyw8L3NwYW4+PGJyPjwvYmxvY2txdW90ZT48L2Jsb2NrcXVvdGU+PC9ibG9j
a3F1b3RlPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxz
cGFuPkhpIERhbmllbCw8L3NwYW4+PGJyPjwvYmxvY2txdW90ZT48L2Jsb2NrcXVvdGU+PGJsb2Nr
cXVvdGUgdHlwZT0iY2l0ZSI+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PHNwYW4+PC9zcGFuPjxi
cj48L2Jsb2NrcXVvdGU+PC9ibG9ja3F1b3RlPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxibG9j
a3F1b3RlIHR5cGU9ImNpdGUiPjxzcGFuPnRoZXJlIGlzIGluZGVlZCBhIG1lbW9yeSBwcm9maWxp
bmcgcGF0Y2ggdW5kZXIgZGlzY3Vzc2lvbjo8L3NwYW4+PGJyPjwvYmxvY2txdW90ZT48L2Jsb2Nr
cXVvdGU+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PHNw
YW4+PGEgaHJlZj0iaHR0cDovL2dlcnJpdC5vdmlydC5vcmcvIy9jLzMyMDE5LyI+aHR0cDovL2dl
cnJpdC5vdmlydC5vcmcvIy9jLzMyMDE5LzwvYT48L3NwYW4+PGJyPjwvYmxvY2txdW90ZT48L2Js
b2NrcXVvdGU+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+
PHNwYW4+PC9zcGFuPjxicj48L2Jsb2NrcXVvdGU+PC9ibG9ja3F1b3RlPjxibG9ja3F1b3RlIHR5
cGU9ImNpdGUiPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxzcGFuPmJ1dCBmb3IgeW91ciBjYXNl
IHdlJ2xsIG5lZWQgYSBiYWNrcG9ydCB0byAzLjQueCBhbmQgY2xlYXJlciBpbnN0YWxsPC9zcGFu
Pjxicj48L2Jsb2NrcXVvdGU+PC9ibG9ja3F1b3RlPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxi
bG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxzcGFuPmluc3RydWN0aW9ucyw8L3NwYW4+PGJyPjwvYmxv
Y2txdW90ZT48L2Jsb2NrcXVvdGU+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PGJsb2NrcXVvdGUg
dHlwZT0iY2l0ZSI+PHNwYW4+d2hpY2ggSSdsbCBwcmVwYXJlIGFzIHNvb24gYXMgcG9zc2libGUu
PC9zcGFuPjxicj48L2Jsb2NrcXVvdGU+PC9ibG9ja3F1b3RlPjxibG9ja3F1b3RlIHR5cGU9ImNp
dGUiPjxzcGFuPkkgdXBkYXRlZCB0aGUgQlogKGFuZCBhcmUgbm93IGJsb2NraW5nIDU0MzIxL3Rj
cCBvbiBvbmUgb2YgbXkgaG9zdHMpLjwvc3Bhbj48YnI+PC9ibG9ja3F1b3RlPjxibG9ja3F1b3Rl
IHR5cGU9ImNpdGUiPjxzcGFuPmFuZCB2ZXJpZmllZCBpdCBpcyBub3QgcmVhY2hhYmxlLiBBcyAm
bmJzcDtnZW5lcmFsIGluZm86IFRoaXMgc3lzdGVtIEkgYW08L3NwYW4+PGJyPjwvYmxvY2txdW90
ZT48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48c3Bhbj51c2luZyBpcyBteSBMQUIgLyBUZXN0IC8g
ZXZhbCBzZXR1cCBmb3IgYSBmaW5hbCBkZXBsb3ltZW50IGZvciBvdmlydDwvc3Bhbj48YnI+PC9i
bG9ja3F1b3RlPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxzcGFuPih0aGVuIDMuNSkgaW4gcHJv
ZHVjdGlvbjsgc28gaXQgd2lsbCBnbyBhd2F5IHNvbWUgdGltZSBpbiB0aGUgZnV0dXJlIChhPC9z
cGFuPjxicj48L2Jsb2NrcXVvdGU+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PHNwYW4+ZmV3IHdl
ZWtzIC8gbW9udGhzKS4gSWYgSSBhbSB0aGUgb25seSBvbmUgZXhwZXJpZW5jaW5nIHRoaXMgcHJv
YmxlbSB0aGVuPC9zcGFuPjxicj48L2Jsb2NrcXVvdGU+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+
PHNwYW4+eW91IG1pZ2h0IGJlIGJldHRlciBvZiBhbGxvY2F0aW5nIHJlc291cmNlcyBlbHNld2hl
cmUgOyk8L3NwYW4+PGJyPjwvYmxvY2txdW90ZT48c3Bhbj48L3NwYW4+PGJyPjxzcGFuPlRoYW5r
cyBmb3IgeW91ciB1bmRlcnN0YW5kaW5nIDopPC9zcGFuPjxicj48c3Bhbj48L3NwYW4+PGJyPjxz
cGFuPlVuZm9ydHVuYXRlbHkgaXQgaXMgdHJ1ZSB0aGF0IGRldmVsb3BlciByZXNvdXJjZXMgYXJl
bid0IHNvIGFidW5kYW50LDwvc3Bhbj48YnI+PHNwYW4+YnV0IGl0IGlzIGFsc28gdHJ1ZSB0aGF0
IG1lbWxlYWtzIHNob3VsZCBuZXZlciBiZSBkaXNjYXJkZWQgZWFzaWx5IGFuZCB3aXRob3V0PC9z
cGFuPjxicj48c3Bhbj5kdWUgaW52ZXN0aWdhdGlvbiwgY29uc2lkZXJpbmcgdGhlIG5hdHVyZSBh
bmQgdGhlIHJvbGUgb2YgVkRTTS48L3NwYW4+PGJyPjxzcGFuPjwvc3Bhbj48YnI+PHNwYW4+U28s
IEknbSBhbGwgaW4gZm9yIGZ1cnRoZXIgaW52ZXN0aWdhdGlvbiByZWdhcmRpbmcgdGhpcyBpc3N1
ZS48L3NwYW4+PGJyPjxzcGFuPjwvc3Bhbj48YnI+PGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+PGJs
b2NrcXVvdGUgdHlwZT0iY2l0ZSI+PHNwYW4+QXMgZm9yIHlvdXIgcXVlc3Rpb246IGlmIEkgdW5k
ZXJzdG9vZCBjb3JyZWN0bHkgd2hhdCB5b3UgYXJlIGFza2luZzwvc3Bhbj48YnI+PC9ibG9ja3F1
b3RlPjwvYmxvY2txdW90ZT48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48YmxvY2txdW90ZSB0eXBl
PSJjaXRlIj48c3Bhbj4oc3RpbGwgY2F0Y2hpbmcgdXAgdGhlIHRocmVhZCksIGlmIHlvdSBhcmUg
dHJ5aW5nIHRvIHJ1bGUgb3V0IHRoZSBzdGF0czwvc3Bhbj48YnI+PC9ibG9ja3F1b3RlPjwvYmxv
Y2txdW90ZT48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48
c3Bhbj5wb2xsaW5nPC9zcGFuPjxicj48L2Jsb2NrcXVvdGU+PC9ibG9ja3F1b3RlPjxibG9ja3F1
b3RlIHR5cGU9ImNpdGUiPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxzcGFuPm1hZGUgYnkgRW5n
aW5lIHRvIHRoaXMgYmFkIGxlYWssIG9uZSBzaW1wbGUgd2F5IHRvIHRlc3QgaXMganVzdCB0byBz
aHV0ZG93bjwvc3Bhbj48YnI+PC9ibG9ja3F1b3RlPjwvYmxvY2txdW90ZT48YmxvY2txdW90ZSB0
eXBlPSJjaXRlIj48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48c3Bhbj5FbmdpbmUsPC9zcGFuPjxi
cj48L2Jsb2NrcXVvdGU+PC9ibG9ja3F1b3RlPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxibG9j
a3F1b3RlIHR5cGU9ImNpdGUiPjxzcGFuPmFuZCBsZXQgVkRTTXMgcnVuIHVuZ3VhcmRlZCBvbiBo
eXBlcnZpc29ycy4gWW91J2xsIGJlIGFibGUgdG8gY29tbWFuZCB0aGVzZTwvc3Bhbj48YnI+PC9i
bG9ja3F1b3RlPjwvYmxvY2txdW90ZT48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48YmxvY2txdW90
ZSB0eXBlPSJjaXRlIj48c3Bhbj5WRFNNcyB1c2luZyB2ZHNDbGllbnQgb3IgcmVzdGFydGluZyBF
bmdpbmUuPC9zcGFuPjxicj48L2Jsb2NrcXVvdGU+PC9ibG9ja3F1b3RlPjxibG9ja3F1b3RlIHR5
cGU9ImNpdGUiPjxzcGFuPkFzIEkgc2FpZCBpbiBteSBCWiBjb21tZW50IHRoaXMgaXMgbm90IGFu
IG9wdGlvbiByaWdodCBub3csIGJ1dCBpZjwvc3Bhbj48YnI+PC9ibG9ja3F1b3RlPjxibG9ja3F1
b3RlIHR5cGU9ImNpdGUiPjxzcGFuPnVuZGVyc3RhbmQgdGhlIG1hdHRlciBjb3JyZWN0bHkgSVBU
QUJMRVMgcmVqZWN0IHNob3VsZCB1bHRpbWF0ZWx5IGRvIHRoZTwvc3Bhbj48YnI+PC9ibG9ja3F1
b3RlPjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxzcGFuPnNhbWU/PC9zcGFuPjxicj48L2Jsb2Nr
cXVvdGU+PHNwYW4+PC9zcGFuPjxicj48c3Bhbj5EZWZpbml0ZWx5IHllcyEgSnVzdCBkbyB3aGF0
ZXZlciBpdCBpcyBtb3JlIGNvbnZlbmllbnQgZm9yIHlvdS48L3NwYW4+PGJyPjxzcGFuPjwvc3Bh
bj48YnI+PC9kaXY+PC9ibG9ja3F1b3RlPkFzIHlvdSBtaWdodCBoYXZlIGFscmVhZHkgc2VlbiBp
biB0aGUgQlogY29tbWVudCB0aGUgbGVhayBzdG9wcGVkIGFmdGVyIGJsb2NraW5nIHRoZSBwb3J0
LiBUaG91Z2ggdGhpcyBpcyBjbGVhcmx5IG5vIHBlcm1hbmVudCBvcHRpb24gLSBwbGVhc2UgbGV0
IG1lIGtub3cgaWYgSSBjYW4gYmUgb2YgYW55IG1vcmUgYXNzaXN0YW5jZSEmbmJzcDs8ZGl2Pjxi
cj48YmxvY2txdW90ZSB0eXBlPSJjaXRlIj48ZGl2PjxzcGFuPi0tIDwvc3Bhbj48YnI+PHNwYW4+
RnJhbmNlc2NvIFJvbWFuaTwvc3Bhbj48YnI+PHNwYW4+UmVkSGF0IEVuZ2luZWVyaW5nIFZpcnR1
YWxpemF0aW9uIFIgJmFtcDsgRDwvc3Bhbj48YnI+PHNwYW4+UGhvbmU6IDgyNjEzMjg8L3NwYW4+
PGJyPjxzcGFuPklSQzogZnJvbWFuaTwvc3Bhbj48YnI+PC9kaXY+PC9ibG9ja3F1b3RlPjwvZGl2
PjwvYm9keT48L2h0bWw+
--Apple-Mail-3ECBB579-7F0A-4ECB-87BA-F76951FECD32--
--Apple-Mail-4BE130A2-7625-4431-A484-D11585211FAD
Content-Type: application/pkcs7-signature; name="smime.p7s"
Content-Disposition: attachment; filename="smime.p7s"
Content-Transfer-Encoding: base64
MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIEzjCCBMow
ggOyoAMCAQICEQCWaWbA3qWpL+Qmn6I16DynMA0GCSqGSIb3DQEBBQUAMFQxCzAJBgNVBAYTAkJF
MRkwFwYDVQQKExBHbG9iYWxTaWduIG52LXNhMSowKAYDVQQDEyFHbG9iYWxTaWduIFBlcnNvbmFs
U2lnbiAyIENBIC0gRzIwHhcNMTMwODI3MTY1NzU4WhcNMTYwODI3MTY1NzU4WjBYMQswCQYDVQQG
EwJERTEcMBoGA1UEAxMTRGFuaWVsIEhlbGdlbmJlcmdlcjErMCkGCSqGSIb3DQEJARYcZGFuaWVs
LmhlbGdlbmJlcmdlckBtLWJveC5kZTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAM4B
Q5vPknk1OGLd1qKSUIKmQLrjccjJcYj7qtAtA+fNYKF89p1VY4UwiFcF9jKlmA9Q8o8tYSx16LYY
FoGWokNRAeKFXZiBZiHyI0ekpEfxo8N5cTMCcxKcSYWV8sqzmBPCoMNpmiVoC8ec8Nv5SqXH34VV
tDmNLfiVlsTyomBXAJkJ2/n5XqJzPLFGWWREtPLkVVS+u426vt/hNsQi5akNoidYeXo98JcrmeAp
FJ3zB2KxvMziHx8LD4q1gAl9NumtX5YLbCpdWL9AkWdXOaro3D9zj6Q6LyGwa/UQUrZdg3BXc07h
jHZn6d9vet1SzpbyqQpTzM63yXiX1meEMlMCAwEAAaOCAZEwggGNMA4GA1UdDwEB/wQEAwIFoDBM
BgNVHSAERTBDMEEGCSsGAQQBoDIBKDA0MDIGCCsGAQUFBwIBFiZodHRwczovL3d3dy5nbG9iYWxz
aWduLmNvbS9yZXBvc2l0b3J5LzAnBgNVHREEIDAegRxkYW5pZWwuaGVsZ2VuYmVyZ2VyQG0tYm94
LmRlMAkGA1UdEwQCMAAwHQYDVR0lBBYwFAYIKwYBBQUHAwIGCCsGAQUFBwMEMEMGA1UdHwQ8MDow
OKA2oDSGMmh0dHA6Ly9jcmwuZ2xvYmFsc2lnbi5jb20vZ3MvZ3NwZXJzb25hbHNpZ24yZzIuY3Js
MFUGCCsGAQUFBwEBBEkwRzBFBggrBgEFBQcwAoY5aHR0cDovL3NlY3VyZS5nbG9iYWxzaWduLmNv
bS9jYWNlcnQvZ3NwZXJzb25hbHNpZ24yZzIuY3J0MB0GA1UdDgQWBBS8NFA/upd+Wipw2nj8RD/C
t+R2GTAfBgNVHSMEGDAWgBQ/FdJtfC/nMZ5DCgaolGwsO8XuZTANBgkqhkiG9w0BAQUFAAOCAQEA
XVTpu4fhOLETAW0zdbQiIwBIMZgeVNJnWV3GsMxByycU63P+WBQTBl9qj47vHLmVdeF7MzH0QSXZ
Sc9Tnfr6CYIImpyIZxRAGpAsWmtZf3JieRA0+j4GQJF2zAea1NXYXoG9+ZSSZHBSxKUdrRdVdE32
0nuVGTT2HjEI2LEYbOvaXyi6HhpuHUiyu4LD0+RIT3fiT8jUiKKLTsApTD+Ak8SLF0IESOSA6hti
rv69mDDC7Klg9dT7QBPO7dpoKIUOldV3VhahndVfsDffKD7pkUUvG5XftYEQOxlWDJzuTBeqf/4h
xXMtzFU9OaI6oKJjLfr6B+XBc6xwOtc/NMWmejGCAucwggLjAgEBMGkwVDELMAkGA1UEBhMCQkUx
GTAXBgNVBAoTEEdsb2JhbFNpZ24gbnYtc2ExKjAoBgNVBAMTIUdsb2JhbFNpZ24gUGVyc29uYWxT
aWduIDIgQ0EgLSBHMgIRAJZpZsDepakv5CafojXoPKcwCQYFKw4DAhoFAKCCAVMwGAYJKoZIhvcN
AQkDMQsGCSqGSIb3DQEHATAcBgkqhkiG9w0BCQUxDxcNMTQwOTI5MjEwMjE4WjAjBgkqhkiG9w0B
CQQxFgQUmq33Ebxa8Hw+SDumMF1VUUwEOQoweAYJKwYBBAGCNxAEMWswaTBUMQswCQYDVQQGEwJC
RTEZMBcGA1UEChMQR2xvYmFsU2lnbiBudi1zYTEqMCgGA1UEAxMhR2xvYmFsU2lnbiBQZXJzb25h
bFNpZ24gMiBDQSAtIEcyAhEAlmlmwN6lqS/kJp+iNeg8pzB6BgsqhkiG9w0BCRACCzFroGkwVDEL
MAkGA1UEBhMCQkUxGTAXBgNVBAoTEEdsb2JhbFNpZ24gbnYtc2ExKjAoBgNVBAMTIUdsb2JhbFNp
Z24gUGVyc29uYWxTaWduIDIgQ0EgLSBHMgIRAJZpZsDepakv5CafojXoPKcwDQYJKoZIhvcNAQEB
BQAEggEAnpiCBnBj9daL/ODswwRMUJF3OBOScf9iOEGmJ/TJfLLRohBswpWqx3werPnytSXeJuQi
+/EkwXpRWlP0vPa58badmtxfoYvk9tT0KiD2iZ/MF7RaaRKnGaRvYk7fJySFaqNzNoho+FWy3YCc
BeoKgAUmkdjqZwGTeyrhu1AR9g5kgBFZ3x1wz7rXjbUZs+3KAPtIvbDwS48qqrjZ+h96wguiKHZq
5kG0X3ia2BHFmlTxCMMeYFitmco7IM+2vUFJXukB3Qyg5p/ebVD0S7p89m2c4AVHC+1ufI/uwMqY
cEXwCRJ2xaBjD+eidS65PNGt7gR6426vesx7ZtaCUwDsPQAAAAAAAA==
--Apple-Mail-4BE130A2-7625-4431-A484-D11585211FAD--