From fernando.frediani at upx.com Thu Oct 26 14:00:38 2017 Content-Type: multipart/mixed; boundary="===============5621236509668623116==" MIME-Version: 1.0 From: FERNANDO FREDIANI To: users at ovirt.org Subject: Re: [ovirt-users] Storage Performance Date: Thu, 26 Oct 2017 12:00:32 -0200 Message-ID: In-Reply-To: CALJLebV1NaTUJ3S4LrUCk=BQOznO_1KVofCuBw=BhSZdVhMS3g@mail.gmail.com --===============5621236509668623116== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------B0133BDD10E3DF2F78D4A545 Content-Type: text/plain; charset=3Dutf-8; format=3Dflowed Content-Transfer-Encoding: 8bit That was my impression too, but unfortunately someone told in this mail = list recently that Gluster isn't that clever to work without RAID = Controllers and when disks fail it imposes some difficulties for = replacement. Perhaps someone with more knowledge could clarify this = point which certainly is beneficial to people. Fernando On 26/10/2017 10:59, Juan Pablo wrote: > Hi, can you check IOPS? and state # of VM's ? do : iostat -x 1 for a = > while =3D) > > Isnt RAID discouraged ? AFAIK gluster likes JBOD, am I wrong? > > > regards, > JP > > 2017-10-25 12:05 GMT-03:00 Bryan Sockel >: > > Have a question in regards to storage performance.=C2=A0 I have a > gluster replica 3 volume that we are testing for performance.=C2=A0 In > my current configuration is 1 server has 16X1.2TB( 10K 2.5 > Inch)=C2=A0drives configured in Raid 10 with a 256k stripe. My 2nd > server is configured with 4X6TB (3.5 Inch Drives) configured Raid > 10 with a 256k stripe.=C2=A0 Each server is configured with 802.3 Bond > (4X1GB) network links.=C2=A0 Each server is configured with write-back > on the raid controller. > I am seeing a lot of network usage (solid 3 Gbps)=C2=A0when i perform > file copies on the vm attached to that gluster volume,=C2=A0 But i see > spikes on the disk io when watching the dashboard through the > cockpit interface.=C2=A0 I spikes are up to 1.5 Gbps, but i would say > the average through put is maybe 256 Mbps. > Is this to be expected, or should it be a solid activity in the > graphs for disk IO.=C2=A0 Is it better to use a 256K stripe or a 512 > strip on the hardware raid configuration? > Eventually i plan on having the hardware match up for better > performance. > Thanks > Bryan > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > > > > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --------------B0133BDD10E3DF2F78D4A545 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: 8bit

That was my impression too, but unfortunately someone told in this mail list recently that Gluster isn't that clever to work without RAID Controllers and when disks fail it imposes some difficulties for replacement. Perhaps someone with more knowledge could clarify this point which certainly is beneficial to people.

Fernando

On 26/10/2017 10:59, Juan Pablo wrote:

Hi, can you check IOPS? and state # of VM's ? do : iostat -x 1 for a while =3D)

Isnt RAID discouraged ? AFAIK gluster likes JBOD, am I wrong?

regards,

JP

2017-10-25 12:05 GMT-03:00 Bryan Sockel <Bryan.Sockel(a)alt= n.com>:

Have a question in regards to storage performance.=C2=A0 I have a gluster replica 3 volume that we are testing for performance.=C2=A0 In my current configuration is 1 server has 16X1.2TB( 10K 2.5 Inch)=C2=A0drives configured in Raid 10 with a 256k stripe.= =C2=A0 My 2nd server is configured with 4X6TB (3.5 Inch Drives) configured Raid 10 with a 256k stripe.=C2=A0 Each server is configured with 802.3 Bond (4X1GB) network links.=C2=A0 Each server is configured with write-back on the raid controller.

=C2=A0

I am seeing a lot of network usage (solid 3 Gbps)=C2=A0when i perform file copies on the vm attached = to that gluster volume,=C2=A0 But i see spikes on the disk io when watching the dashboard through the cockpit interface.=C2=A0 I spikes are up to 1.5 Gbps, but i would s= ay the average through put is maybe 256 Mbps.

=C2=A0

Is this to be expected, or should it be a solid activity in the graphs for disk IO.=C2=A0 Is it better to use a 256K stripe or a 512 strip on the hardware raid configuration?

=C2=A0

Eventually i plan on having the hardware match up for better performance.

=C2=A0

=C2=A0

Thanks

=C2=A0

Bryan

_______________________________________________
Users mailing list
U= sers(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________
Users mailing list
Use=
rs(a)ovirt.org
http://lists.ovirt.org/mailman/listinfo/users

--------------B0133BDD10E3DF2F78D4A545-- --===============5621236509668623116== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS1CMDEzM0JERDEwRTNERjJGNzhENEE1NDUKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXV0Zi04OyBmb3JtYXQ9Zmxvd2VkCkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDhiaXQK ClRoYXQgd2FzIG15IGltcHJlc3Npb24gdG9vLCBidXQgdW5mb3J0dW5hdGVseSBzb21lb25lIHRv bGQgaW4gdGhpcyBtYWlsIApsaXN0IHJlY2VudGx5IHRoYXQgR2x1c3RlciBpc24ndCB0aGF0IGNs ZXZlciB0byB3b3JrIHdpdGhvdXQgUkFJRCAKQ29udHJvbGxlcnMgYW5kIHdoZW4gZGlza3MgZmFp bCBpdCBpbXBvc2VzIHNvbWUgZGlmZmljdWx0aWVzIGZvciAKcmVwbGFjZW1lbnQuIFBlcmhhcHMg c29tZW9uZSB3aXRoIG1vcmUga25vd2xlZGdlIGNvdWxkIGNsYXJpZnkgdGhpcyAKcG9pbnQgd2hp Y2ggY2VydGFpbmx5IGlzIGJlbmVmaWNpYWwgdG8gcGVvcGxlLgoKRmVybmFuZG8KCgpPbiAyNi8x MC8yMDE3IDEwOjU5LCBKdWFuIFBhYmxvIHdyb3RlOgo+IEhpLCBjYW4geW91IGNoZWNrIElPUFM/ IGFuZCBzdGF0ZSAjIG9mIFZNJ3MgPyBkbyA6IGlvc3RhdCAteCAxIGZvciBhIAo+IHdoaWxlID0p Cj4KPiBJc250IFJBSUQgZGlzY291cmFnZWQgPyBBRkFJSyBnbHVzdGVyIGxpa2VzIEpCT0QsIGFt IEkgd3Jvbmc/Cj4KPgo+IHJlZ2FyZHMsCj4gSlAKPgo+IDIwMTctMTAtMjUgMTI6MDUgR01ULTAz OjAwIEJyeWFuIFNvY2tlbCA8QnJ5YW4uU29ja2VsQGFsdG4uY29tIAo+IDxtYWlsdG86QnJ5YW4u U29ja2VsQGFsdG4uY29tPj46Cj4KPiAgICAgSGF2ZSBhIHF1ZXN0aW9uIGluIHJlZ2FyZHMgdG8g c3RvcmFnZSBwZXJmb3JtYW5jZS7CoCBJIGhhdmUgYQo+ICAgICBnbHVzdGVyIHJlcGxpY2EgMyB2 b2x1bWUgdGhhdCB3ZSBhcmUgdGVzdGluZyBmb3IgcGVyZm9ybWFuY2UuwqAgSW4KPiAgICAgbXkg Y3VycmVudCBjb25maWd1cmF0aW9uIGlzIDEgc2VydmVyIGhhcyAxNlgxLjJUQiggMTBLIDIuNQo+ ICAgICBJbmNoKcKgZHJpdmVzIGNvbmZpZ3VyZWQgaW4gUmFpZCAxMCB3aXRoIGEgMjU2ayBzdHJp cGUuIE15IDJuZAo+ICAgICBzZXJ2ZXIgaXMgY29uZmlndXJlZCB3aXRoIDRYNlRCICgzLjUgSW5j aCBEcml2ZXMpIGNvbmZpZ3VyZWQgUmFpZAo+ICAgICAxMCB3aXRoIGEgMjU2ayBzdHJpcGUuwqAg RWFjaCBzZXJ2ZXIgaXMgY29uZmlndXJlZCB3aXRoIDgwMi4zIEJvbmQKPiAgICAgKDRYMUdCKSBu ZXR3b3JrIGxpbmtzLsKgIEVhY2ggc2VydmVyIGlzIGNvbmZpZ3VyZWQgd2l0aCB3cml0ZS1iYWNr Cj4gICAgIG9uIHRoZSByYWlkIGNvbnRyb2xsZXIuCj4gICAgIEkgYW0gc2VlaW5nIGEgbG90IG9m IG5ldHdvcmsgdXNhZ2UgKHNvbGlkIDMgR2JwcynCoHdoZW4gaSBwZXJmb3JtCj4gICAgIGZpbGUg Y29waWVzIG9uIHRoZSB2bSBhdHRhY2hlZCB0byB0aGF0IGdsdXN0ZXIgdm9sdW1lLMKgIEJ1dCBp IHNlZQo+ICAgICBzcGlrZXMgb24gdGhlIGRpc2sgaW8gd2hlbiB3YXRjaGluZyB0aGUgZGFzaGJv YXJkIHRocm91Z2ggdGhlCj4gICAgIGNvY2twaXQgaW50ZXJmYWNlLsKgIEkgc3Bpa2VzIGFyZSB1 cCB0byAxLjUgR2JwcywgYnV0IGkgd291bGQgc2F5Cj4gICAgIHRoZSBhdmVyYWdlIHRocm91Z2gg cHV0IGlzIG1heWJlIDI1NiBNYnBzLgo+ICAgICBJcyB0aGlzIHRvIGJlIGV4cGVjdGVkLCBvciBz aG91bGQgaXQgYmUgYSBzb2xpZCBhY3Rpdml0eSBpbiB0aGUKPiAgICAgZ3JhcGhzIGZvciBkaXNr IElPLsKgIElzIGl0IGJldHRlciB0byB1c2UgYSAyNTZLIHN0cmlwZSBvciBhIDUxMgo+ICAgICBz dHJpcCBvbiB0aGUgaGFyZHdhcmUgcmFpZCBjb25maWd1cmF0aW9uPwo+ICAgICBFdmVudHVhbGx5 IGkgcGxhbiBvbiBoYXZpbmcgdGhlIGhhcmR3YXJlIG1hdGNoIHVwIGZvciBiZXR0ZXIKPiAgICAg cGVyZm9ybWFuY2UuCj4gICAgIFRoYW5rcwo+ICAgICBCcnlhbgo+Cj4gICAgIF9fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCj4gICAgIFVzZXJzIG1haWxpbmcg bGlzdAo+ICAgICBVc2Vyc0BvdmlydC5vcmcgPG1haWx0bzpVc2Vyc0BvdmlydC5vcmc+Cj4gICAg IGh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2Vycwo+ICAgICA8aHR0 cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzPgo+Cj4KPgo+Cj4gX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KPiBVc2VycyBtYWls aW5nIGxpc3QKPiBVc2Vyc0BvdmlydC5vcmcKPiBodHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxt YW4vbGlzdGluZm8vdXNlcnMKCgotLS0tLS0tLS0tLS0tLUIwMTMzQkREMTBFM0RGMkY3OEQ0QTU0 NQpDb250ZW50LVR5cGU6IHRleHQvaHRtbDsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVy LUVuY29kaW5nOiA4Yml0Cgo8aHRtbD4KICA8aGVhZD4KICAgIDxtZXRhIGh0dHAtZXF1aXY9IkNv bnRlbnQtVHlwZSIgY29udGVudD0idGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4KICA8L2hlYWQ+ CiAgPGJvZHkgYmdjb2xvcj0iI0ZGRkZGRiIgdGV4dD0iIzAwMDAwMCI+CiAgICA8cD5UaGF0IHdh cyBteSBpbXByZXNzaW9uIHRvbywgYnV0IHVuZm9ydHVuYXRlbHkgc29tZW9uZSB0b2xkIGluCiAg ICAgIHRoaXMgbWFpbCBsaXN0IHJlY2VudGx5IHRoYXQgR2x1c3RlciBpc24ndCB0aGF0IGNsZXZl ciB0byB3b3JrCiAgICAgIHdpdGhvdXQgUkFJRCBDb250cm9sbGVycyBhbmQgd2hlbiBkaXNrcyBm YWlsIGl0IGltcG9zZXMgc29tZQogICAgICBkaWZmaWN1bHRpZXMgZm9yIHJlcGxhY2VtZW50LiBQ ZXJoYXBzIHNvbWVvbmUgd2l0aCBtb3JlIGtub3dsZWRnZQogICAgICBjb3VsZCBjbGFyaWZ5IHRo aXMgcG9pbnQgd2hpY2ggY2VydGFpbmx5IGlzIGJlbmVmaWNpYWwgdG8gcGVvcGxlLjwvcD4KICAg IDxwPkZlcm5hbmRvPGJyPgogICAgPC9wPgogICAgPGJyPgogICAgPGRpdiBjbGFzcz0ibW96LWNp dGUtcHJlZml4Ij5PbiAyNi8xMC8yMDE3IDEwOjU5LCBKdWFuIFBhYmxvIHdyb3RlOjxicj4KICAg IDwvZGl2PgogICAgPGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSIKY2l0ZT0ibWlkOkNBTEpMZWJWMU5h VFVKM1M0THJVQ2s9QlFPem5PXzFLVm9mQ3VCdz1CaFNaZFZoTVMzZ0BtYWlsLmdtYWlsLmNvbSI+ CiAgICAgIDxkaXYgZGlyPSJsdHIiPgogICAgICAgIDxkaXYgY2xhc3M9ImdtYWlsX2RlZmF1bHQi CiAgICAgICAgICBzdHlsZT0iZm9udC1mYW1pbHk6bW9ub3NwYWNlLG1vbm9zcGFjZSI+SGksIGNh biB5b3UgY2hlY2sKICAgICAgICAgIElPUFM/IGFuZCBzdGF0ZSAjIG9mIFZNJ3MgPyBkbyA6IGlv c3RhdCAteCAxIGZvciBhIHdoaWxlID0pIDxicj4KICAgICAgICAgIDxicj4KICAgICAgICA8L2Rp dj4KICAgICAgICA8ZGl2IGNsYXNzPSJnbWFpbF9kZWZhdWx0IgogICAgICAgICAgc3R5bGU9ImZv bnQtZmFtaWx5Om1vbm9zcGFjZSxtb25vc3BhY2UiPklzbnQgUkFJRCBkaXNjb3VyYWdlZAogICAg ICAgICAgPyBBRkFJSyBnbHVzdGVyIGxpa2VzIEpCT0QsIGFtIEkgd3Jvbmc/PGJyPgogICAgICAg ICAgPGJyPgogICAgICAgICAgPGJyPgogICAgICAgIDwvZGl2PgogICAgICAgIDxkaXYgY2xhc3M9 ImdtYWlsX2RlZmF1bHQiCiAgICAgICAgICBzdHlsZT0iZm9udC1mYW1pbHk6bW9ub3NwYWNlLG1v bm9zcGFjZSI+cmVnYXJkcywgPGJyPgogICAgICAgIDwvZGl2PgogICAgICAgIDxkaXYgY2xhc3M9 ImdtYWlsX2RlZmF1bHQiCiAgICAgICAgICBzdHlsZT0iZm9udC1mYW1pbHk6bW9ub3NwYWNlLG1v bm9zcGFjZSI+SlA8YnI+CiAgICAgICAgPC9kaXY+CiAgICAgIDwvZGl2PgogICAgICA8ZGl2IGNs YXNzPSJnbWFpbF9leHRyYSI+PGJyPgogICAgICAgIDxkaXYgY2xhc3M9ImdtYWlsX3F1b3RlIj4y MDE3LTEwLTI1IDEyOjA1IEdNVC0wMzowMCBCcnlhbiBTb2NrZWwKICAgICAgICAgIDxzcGFuIGRp cj0ibHRyIj4mbHQ7PGEgaHJlZj0ibWFpbHRvOkJyeWFuLlNvY2tlbEBhbHRuLmNvbSIKICAgICAg ICAgICAgICB0YXJnZXQ9Il9ibGFuayIgbW96LWRvLW5vdC1zZW5kPSJ0cnVlIj5Ccnlhbi5Tb2Nr ZWxAYWx0bi5jb208L2E+Jmd0Ozwvc3Bhbj46PGJyPgogICAgICAgICAgPGJsb2NrcXVvdGUgY2xh c3M9ImdtYWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAwCiAgICAgICAgICAgIC44ZXg7Ym9y ZGVyLWxlZnQ6MXB4ICNjY2Mgc29saWQ7cGFkZGluZy1sZWZ0OjFleCI+CiAgICAgICAgICAgIDxk aXY+CiAgICAgICAgICAgICAgPGRpdgpzdHlsZT0iZm9udC1zaXplOjEzLjMzMzNweDtmb250LWZh bWlseTpUYWhvbWE7Y29sb3I6cmdiKDAsMCwwKTtmb250LXdlaWdodDo0MDA7Zm9udC1zdHlsZTpu b3JtYWw7YmFja2dyb3VuZDpub25lCiAgICAgICAgICAgICAgICAwJSAwJS9hdXRvIHJlcGVhdCBz Y3JvbGwgcGFkZGluZy1ib3ggYm9yZGVyLWJveAogICAgICAgICAgICAgICAgcmdiYSgwLDAsMCww KSI+SGF2ZSBhIHF1ZXN0aW9uIGluIHJlZ2FyZHMgdG8gc3RvcmFnZQogICAgICAgICAgICAgICAg cGVyZm9ybWFuY2UuwqAgSSBoYXZlIGEgZ2x1c3RlciByZXBsaWNhIDMgdm9sdW1lIHRoYXQgd2UK ICAgICAgICAgICAgICAgIGFyZSB0ZXN0aW5nIGZvciBwZXJmb3JtYW5jZS7CoCBJbiBteSBjdXJy ZW50CiAgICAgICAgICAgICAgICBjb25maWd1cmF0aW9uIGlzIDEgc2VydmVyIGhhcyAxNlgxLjJU QiggMTBLIDIuNQogICAgICAgICAgICAgICAgSW5jaCnCoGRyaXZlcyBjb25maWd1cmVkIGluIFJh aWQgMTAgd2l0aCBhIDI1Nmsgc3RyaXBlLsKgCiAgICAgICAgICAgICAgICBNeSAybmQgc2VydmVy IGlzIGNvbmZpZ3VyZWQgd2l0aCA0WDZUQiAoMy41IEluY2ggRHJpdmVzKQogICAgICAgICAgICAg ICAgY29uZmlndXJlZCBSYWlkIDEwIHdpdGggYSAyNTZrIHN0cmlwZS7CoCBFYWNoIHNlcnZlciBp cwogICAgICAgICAgICAgICAgY29uZmlndXJlZCB3aXRoIDgwMi4zIEJvbmQgKDRYMUdCKSBuZXR3 b3JrIGxpbmtzLsKgIEVhY2gKICAgICAgICAgICAgICAgIHNlcnZlciBpcyBjb25maWd1cmVkIHdp dGggd3JpdGUtYmFjayBvbiB0aGUgcmFpZAogICAgICAgICAgICAgICAgY29udHJvbGxlci48L2Rp dj4KICAgICAgICAgICAgICA8ZGl2CnN0eWxlPSJmb250LXNpemU6MTMuMzMzM3B4O2ZvbnQtZmFt aWx5OlRhaG9tYTtjb2xvcjpyZ2IoMCwwLDApO2ZvbnQtd2VpZ2h0OjQwMDtmb250LXN0eWxlOm5v cm1hbDtiYWNrZ3JvdW5kOm5vbmUKICAgICAgICAgICAgICAgIDAlIDAlL2F1dG8gcmVwZWF0IHNj cm9sbCBwYWRkaW5nLWJveCBib3JkZXItYm94CiAgICAgICAgICAgICAgICByZ2JhKDAsMCwwLDAp Ij7CoDwvZGl2PgogICAgICAgICAgICAgIDxkaXYKc3R5bGU9ImZvbnQtc2l6ZToxMy4zMzMzcHg7 Zm9udC1mYW1pbHk6VGFob21hO2NvbG9yOnJnYigwLDAsMCk7Zm9udC13ZWlnaHQ6NDAwO2ZvbnQt c3R5bGU6bm9ybWFsO2JhY2tncm91bmQ6bm9uZQogICAgICAgICAgICAgICAgMCUgMCUvYXV0byBy ZXBlYXQgc2Nyb2xsIHBhZGRpbmctYm94IGJvcmRlci1ib3gKICAgICAgICAgICAgICAgIHJnYmEo MCwwLDAsMCkiPkkgYW0gc2VlaW5nIGEgbG90IG9mIG5ldHdvcmsgdXNhZ2UgKHNvbGlkCiAgICAg ICAgICAgICAgICAzIEdicHMpwqB3aGVuIGkgcGVyZm9ybSBmaWxlIGNvcGllcyBvbiB0aGUgdm0g YXR0YWNoZWQgdG8KICAgICAgICAgICAgICAgIHRoYXQgZ2x1c3RlciB2b2x1bWUswqAgQnV0IGkg c2VlIHNwaWtlcyBvbiB0aGUgZGlzayBpbwogICAgICAgICAgICAgICAgd2hlbiB3YXRjaGluZyB0 aGUgZGFzaGJvYXJkIHRocm91Z2ggdGhlIGNvY2twaXQKICAgICAgICAgICAgICAgIGludGVyZmFj ZS7CoCBJIHNwaWtlcyBhcmUgdXAgdG8gMS41IEdicHMsIGJ1dCBpIHdvdWxkIHNheQogICAgICAg ICAgICAgICAgdGhlIGF2ZXJhZ2UgdGhyb3VnaCBwdXQgaXMgbWF5YmUgMjU2IE1icHMuPC9kaXY+ CiAgICAgICAgICAgICAgPGRpdgpzdHlsZT0iZm9udC1zaXplOjEzLjMzMzNweDtmb250LWZhbWls eTpUYWhvbWE7Y29sb3I6cmdiKDAsMCwwKTtmb250LXdlaWdodDo0MDA7Zm9udC1zdHlsZTpub3Jt YWw7YmFja2dyb3VuZDpub25lCiAgICAgICAgICAgICAgICAwJSAwJS9hdXRvIHJlcGVhdCBzY3Jv bGwgcGFkZGluZy1ib3ggYm9yZGVyLWJveAogICAgICAgICAgICAgICAgcmdiYSgwLDAsMCwwKSI+ wqA8L2Rpdj4KICAgICAgICAgICAgICA8ZGl2CnN0eWxlPSJmb250LXNpemU6MTMuMzMzM3B4O2Zv bnQtZmFtaWx5OlRhaG9tYTtjb2xvcjpyZ2IoMCwwLDApO2ZvbnQtd2VpZ2h0OjQwMDtmb250LXN0 eWxlOm5vcm1hbDtiYWNrZ3JvdW5kOm5vbmUKICAgICAgICAgICAgICAgIDAlIDAlL2F1dG8gcmVw ZWF0IHNjcm9sbCBwYWRkaW5nLWJveCBib3JkZXItYm94CiAgICAgICAgICAgICAgICByZ2JhKDAs MCwwLDApIj5JcyB0aGlzIHRvIGJlIGV4cGVjdGVkLCBvciBzaG91bGQgaXQgYmUgYQogICAgICAg ICAgICAgICAgc29saWQgYWN0aXZpdHkgaW4gdGhlIGdyYXBocyBmb3IgZGlzayBJTy7CoCBJcyBp dCBiZXR0ZXIKICAgICAgICAgICAgICAgIHRvIHVzZSBhIDI1Nksgc3RyaXBlIG9yIGEgNTEyIHN0 cmlwIG9uIHRoZSBoYXJkd2FyZSByYWlkCiAgICAgICAgICAgICAgICBjb25maWd1cmF0aW9uPzwv ZGl2PgogICAgICAgICAgICAgIDxkaXYKc3R5bGU9ImZvbnQtc2l6ZToxMy4zMzMzcHg7Zm9udC1m YW1pbHk6VGFob21hO2NvbG9yOnJnYigwLDAsMCk7Zm9udC13ZWlnaHQ6NDAwO2ZvbnQtc3R5bGU6 bm9ybWFsO2JhY2tncm91bmQ6bm9uZQogICAgICAgICAgICAgICAgMCUgMCUvYXV0byByZXBlYXQg c2Nyb2xsIHBhZGRpbmctYm94IGJvcmRlci1ib3gKICAgICAgICAgICAgICAgIHJnYmEoMCwwLDAs MCkiPsKgPC9kaXY+CiAgICAgICAgICAgICAgPGRpdgpzdHlsZT0iZm9udC1zaXplOjEzLjMzMzNw eDtmb250LWZhbWlseTpUYWhvbWE7Y29sb3I6cmdiKDAsMCwwKTtmb250LXdlaWdodDo0MDA7Zm9u dC1zdHlsZTpub3JtYWw7YmFja2dyb3VuZDpub25lCiAgICAgICAgICAgICAgICAwJSAwJS9hdXRv IHJlcGVhdCBzY3JvbGwgcGFkZGluZy1ib3ggYm9yZGVyLWJveAogICAgICAgICAgICAgICAgcmdi YSgwLDAsMCwwKSI+RXZlbnR1YWxseSBpIHBsYW4gb24gaGF2aW5nIHRoZSBoYXJkd2FyZQogICAg ICAgICAgICAgICAgbWF0Y2ggdXAgZm9yIGJldHRlciBwZXJmb3JtYW5jZS48L2Rpdj4KICAgICAg ICAgICAgICA8ZGl2CnN0eWxlPSJmb250LXNpemU6MTMuMzMzM3B4O2ZvbnQtZmFtaWx5OlRhaG9t YTtjb2xvcjpyZ2IoMCwwLDApO2ZvbnQtd2VpZ2h0OjQwMDtmb250LXN0eWxlOm5vcm1hbDtiYWNr Z3JvdW5kOm5vbmUKICAgICAgICAgICAgICAgIDAlIDAlL2F1dG8gcmVwZWF0IHNjcm9sbCBwYWRk aW5nLWJveCBib3JkZXItYm94CiAgICAgICAgICAgICAgICByZ2JhKDAsMCwwLDApIj7CoDwvZGl2 PgogICAgICAgICAgICAgIDxkaXYKc3R5bGU9ImZvbnQtc2l6ZToxMy4zMzMzcHg7Zm9udC1mYW1p bHk6VGFob21hO2NvbG9yOnJnYigwLDAsMCk7Zm9udC13ZWlnaHQ6NDAwO2ZvbnQtc3R5bGU6bm9y bWFsO2JhY2tncm91bmQ6bm9uZQogICAgICAgICAgICAgICAgMCUgMCUvYXV0byByZXBlYXQgc2Ny b2xsIHBhZGRpbmctYm94IGJvcmRlci1ib3gKICAgICAgICAgICAgICAgIHJnYmEoMCwwLDAsMCki PsKgPC9kaXY+CiAgICAgICAgICAgICAgPGRpdgpzdHlsZT0iZm9udC1zaXplOjEzLjMzMzNweDtm b250LWZhbWlseTpUYWhvbWE7Y29sb3I6cmdiKDAsMCwwKTtmb250LXdlaWdodDo0MDA7Zm9udC1z dHlsZTpub3JtYWw7YmFja2dyb3VuZDpub25lCiAgICAgICAgICAgICAgICAwJSAwJS9hdXRvIHJl cGVhdCBzY3JvbGwgcGFkZGluZy1ib3ggYm9yZGVyLWJveAogICAgICAgICAgICAgICAgcmdiYSgw LDAsMCwwKSI+VGhhbmtzPC9kaXY+CiAgICAgICAgICAgICAgPHNwYW4gY2xhc3M9IkhPRW5aYiI+ PGZvbnQgY29sb3I9IiM4ODg4ODgiPgogICAgICAgICAgICAgICAgICA8ZGl2CnN0eWxlPSJmb250 LXNpemU6MTMuMzMzM3B4O2ZvbnQtZmFtaWx5OlRhaG9tYTtjb2xvcjpyZ2IoMCwwLDApO2ZvbnQt d2VpZ2h0OjQwMDtmb250LXN0eWxlOm5vcm1hbDtiYWNrZ3JvdW5kOm5vbmUKICAgICAgICAgICAg ICAgICAgICAwJSAwJS9hdXRvIHJlcGVhdCBzY3JvbGwgcGFkZGluZy1ib3ggYm9yZGVyLWJveAog ICAgICAgICAgICAgICAgICAgIHJnYmEoMCwwLDAsMCkiPsKgPC9kaXY+CiAgICAgICAgICAgICAg ICAgIDxkaXYgaWQ9Im1fMjIzOTc4OTk3MzM3OTI3MTg4OXNpZ25hdHVyZSIKc3R5bGU9ImZvbnQt ZmFtaWx5OlRhaG9tYTtjb2xvcjpyZ2IoMCwwLDApO2ZvbnQtc2l6ZToxMy4zMzMzcHg7Zm9udC13 ZWlnaHQ6NDAwO2ZvbnQtc3R5bGU6bm9ybWFsO2JhY2tncm91bmQ6bm9uZQogICAgICAgICAgICAg ICAgICAgIDAlIDAlL2F1dG8gcmVwZWF0IHNjcm9sbCBwYWRkaW5nLWJveCBib3JkZXItYm94CiAg ICAgICAgICAgICAgICAgICAgcmdiYSgwLDAsMCwwKSI+CiAgICAgICAgICAgICAgICAgICAgPGRp dj4KICAgICAgICAgICAgICAgICAgICAgIDxkaXY+CiAgICAgICAgICAgICAgICAgICAgICAgIDxk aXY+QnJ5YW48L2Rpdj4KICAgICAgICAgICAgICAgICAgICAgIDwvZGl2PgogICAgICAgICAgICAg ICAgICAgIDwvZGl2PgogICAgICAgICAgICAgICAgICA8L2Rpdj4KICAgICAgICAgICAgICAgIDwv Zm9udD48L3NwYW4+PC9kaXY+CiAgICAgICAgICAgIDxicj4KICAgICAgICAgICAgX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fPHdicj5fX19fX19fX19fX19fX19fXzxicj4KICAgICAgICAg ICAgVXNlcnMgbWFpbGluZyBsaXN0PGJyPgogICAgICAgICAgICA8YSBocmVmPSJtYWlsdG86VXNl cnNAb3ZpcnQub3JnIiBtb3otZG8tbm90LXNlbmQ9InRydWUiPlVzZXJzQG92aXJ0Lm9yZzwvYT48 YnI+CiAgICAgICAgICAgIDxhIGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9s aXN0aW5mby91c2VycyIKICAgICAgICAgICAgICByZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2Js YW5rIiBtb3otZG8tbm90LXNlbmQ9InRydWUiPmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvPHdicj5t YWlsbWFuL2xpc3RpbmZvL3VzZXJzPC9hPjxicj4KICAgICAgICAgICAgPGJyPgogICAgICAgICAg PC9ibG9ja3F1b3RlPgogICAgICAgIDwvZGl2PgogICAgICAgIDxicj4KICAgICAgPC9kaXY+CiAg ICAgIDxicj4KICAgICAgPGZpZWxkc2V0IGNsYXNzPSJtaW1lQXR0YWNobWVudEhlYWRlciI+PC9m aWVsZHNldD4KICAgICAgPGJyPgogICAgICA8cHJlIHdyYXA9IiI+X19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX18KVXNlcnMgbWFpbGluZyBsaXN0CjxhIGNsYXNz PSJtb3otdHh0LWxpbmstYWJicmV2aWF0ZWQiIGhyZWY9Im1haWx0bzpVc2Vyc0BvdmlydC5vcmci PlVzZXJzQG92aXJ0Lm9yZzwvYT4KPGEgY2xhc3M9Im1vei10eHQtbGluay1mcmVldGV4dCIgaHJl Zj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIj5odHRwOi8v bGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E+CjwvcHJlPgogICAgPC9i bG9ja3F1b3RlPgogICAgPGJyPgogIDwvYm9keT4KPC9odG1sPgoKLS0tLS0tLS0tLS0tLS1CMDEz M0JERDEwRTNERjJGNzhENEE1NDUtLQo= --===============5621236509668623116==--