From contact at makz.me Wed May 25 05:34:25 2016 Content-Type: multipart/mixed; boundary="===============6944076954987348089==" MIME-Version: 1.0 From: Maxence Sartiaux To: users at ovirt.org Subject: [ovirt-users] Network problem with bonding and Windows guests Date: Wed, 25 May 2016 11:28:39 +0200 Message-ID: <569179724.1436.1464168519263.JavaMail.zimbra@makz.me> --===============6944076954987348089== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable ------=3D_Part_1435_2021536601.1464168519260 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: 7bit Hello, = I've a problem, all my ovirt hosts are linked with a bonding mode 4 (802.3a= d LACP) 2x10Gbps = Eveything is okay with unix guest but with Windows guest, i can ping but in= ternet browsing is impossible (sometime i have a part of the page, very rar= e case) = If i remove the bonding and bridge one interface, windows work good. = I've tried with windows 7 and windows 10, guest additions are installed = VirtIO / rtl3189 tested, same problem = My bonding opts : mode=3D4 lacp_rate=3D1 miimon=3D100 = Interface MTU 9000 = Bonding mode 2 also tested = ------=3D_Part_1435_2021536601.1464168519260 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable

Hello,

I've a problem, all my ovirt hosts are linked with a bo= nd=3D ing mode 4 (802.3ad LACP) 2x10Gbps

Eveything is okay with unix&nb= =3D sp;guest but with Windows guest, i can ping but internet browsing is i= =3D mpossible (sometime i have a part of the page, very rare case)

If i remove the bonding and bridge one = in=3D terface, windows work good.

I=3D 've tried with windows 7 and windows 10, guest additions are installed

VirtIO / rtl3189 tested, same problem

My bonding opts : mode=3D3D4 lacp_rate=3D3D1 miimon=3D3D100<= /div><=3D div>Interface MTU 9000

Bond= in=3D g mode 2 also tested

------=3D_Part_1435_2021536601.1464168519260-- --===============6944076954987348089== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS0tLS0tPV9QYXJ0XzE0MzVfMjAyMTUzNjYwMS4xNDY0MTY4NTE5MjYwCkNvbnRlbnQtVHlwZTog dGV4dC9wbGFpbjsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiA3Yml0 CgpIZWxsbywgCgpJJ3ZlIGEgcHJvYmxlbSwgYWxsIG15IG92aXJ0IGhvc3RzIGFyZSBsaW5rZWQg d2l0aCBhIGJvbmRpbmcgbW9kZSA0ICg4MDIuM2FkIExBQ1ApIDJ4MTBHYnBzIApFdmV5dGhpbmcg aXMgb2theSB3aXRoIHVuaXggZ3Vlc3QgYnV0IHdpdGggV2luZG93cyBndWVzdCwgaSBjYW4gcGlu ZyBidXQgaW50ZXJuZXQgYnJvd3NpbmcgaXMgaW1wb3NzaWJsZSAoc29tZXRpbWUgaSBoYXZlIGEg cGFydCBvZiB0aGUgcGFnZSwgdmVyeSByYXJlIGNhc2UpIAoKSWYgaSByZW1vdmUgdGhlIGJvbmRp bmcgYW5kIGJyaWRnZSBvbmUgaW50ZXJmYWNlLCB3aW5kb3dzIHdvcmsgZ29vZC4gCgpJJ3ZlIHRy aWVkIHdpdGggd2luZG93cyA3IGFuZCB3aW5kb3dzIDEwLCBndWVzdCBhZGRpdGlvbnMgYXJlIGlu c3RhbGxlZCAKVmlydElPIC8gcnRsMzE4OSB0ZXN0ZWQsIHNhbWUgcHJvYmxlbSAKCk15IGJvbmRp bmcgb3B0cyA6IG1vZGU9NCBsYWNwX3JhdGU9MSBtaWltb249MTAwIApJbnRlcmZhY2UgTVRVIDkw MDAgCgpCb25kaW5nIG1vZGUgMiBhbHNvIHRlc3RlZCAKCi0tLS0tLT1fUGFydF8xNDM1XzIwMjE1 MzY2MDEuMTQ2NDE2ODUxOTI2MApDb250ZW50LVR5cGU6IHRleHQvaHRtbDsgY2hhcnNldD11dGYt OApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiBxdW90ZWQtcHJpbnRhYmxlCgo8aHRtbD48Ym9k eT48ZGl2IHN0eWxlPTNEImZvbnQtZmFtaWx5OiBhcmlhbCwgaGVsdmV0aWNhLCBzYW5zLXNlcmlm OyBmb250LXM9Cml6ZTogMTJwdDsgY29sb3I6ICMwMDAwMDAiPjxkaXY+SGVsbG8sJm5ic3A7PC9k aXY+PGRpdj48YnIgZGF0YS1tY2UtYm9ndXM9Cj0zRCIxIj48L2Rpdj48ZGl2PkkndmUgYSBwcm9i bGVtLCBhbGwgbXkgb3ZpcnQgaG9zdHMgYXJlIGxpbmtlZCB3aXRoIGEgYm9uZD0KaW5nIG1vZGUg NCAoODAyLjNhZCBMQUNQKSAyeDEwR2JwczwvZGl2PjxkaXY+RXZleXRoaW5nIGlzIG9rYXkgd2l0 aCB1bml4Jm5iPQpzcDtndWVzdCBidXQgd2l0aCBXaW5kb3dzIGd1ZXN0LCBpJm5ic3A7Y2FuIHBp bmcgYnV0IGludGVybmV0IGJyb3dzaW5nIGlzIGk9Cm1wb3NzaWJsZSAoc29tZXRpbWUgaSBoYXZl IGEgcGFydCBvZiB0aGUgcGFnZSwgdmVyeSByYXJlIGNhc2UpPC9kaXY+PGRpdj48Yj0KciBkYXRh LW1jZS1ib2d1cz0zRCIxIj48L2Rpdj48ZGl2PklmIGkgcmVtb3ZlIHRoZSBib25kaW5nIGFuZCBi cmlkZ2Ugb25lIGluPQp0ZXJmYWNlLCB3aW5kb3dzIHdvcmsgZ29vZC48L2Rpdj48ZGl2PjxiciBk YXRhLW1jZS1ib2d1cz0zRCIxIj48L2Rpdj48ZGl2Pkk9Cid2ZSB0cmllZCB3aXRoIHdpbmRvd3Mg NyBhbmQgd2luZG93cyAxMCwgZ3Vlc3QgYWRkaXRpb25zIGFyZSBpbnN0YWxsZWQ8L2Rpdj0KPjxk aXY+VmlydElPIC8gcnRsMzE4OSB0ZXN0ZWQsIHNhbWUgcHJvYmxlbTwvZGl2PjxkaXY+PGJyIGRh dGEtbWNlLWJvZ3VzPTNEPQoiMSI+PC9kaXY+PGRpdj5NeSBib25kaW5nIG9wdHMgOiBtb2RlPTNE NCBsYWNwX3JhdGU9M0QxIG1paW1vbj0zRDEwMDwvZGl2Pjw9CmRpdj5JbnRlcmZhY2UgTVRVIDkw MDA8L2Rpdj48ZGl2PjxiciBkYXRhLW1jZS1ib2d1cz0zRCIxIj48L2Rpdj48ZGl2PkJvbmRpbj0K ZyBtb2RlIDIgYWxzbyB0ZXN0ZWQ8L2Rpdj48L2Rpdj48L2JvZHk+PC9odG1sPgotLS0tLS09X1Bh cnRfMTQzNV8yMDIxNTM2NjAxLjE0NjQxNjg1MTkyNjAtLQo= --===============6944076954987348089==-- From acrow at integrafin.co.uk Wed May 25 05:46:34 2016 Content-Type: multipart/mixed; boundary="===============0357399345238569775==" MIME-Version: 1.0 From: Alex Crow To: users at ovirt.org Subject: Re: [ovirt-users] Network problem with bonding and Windows guests Date: Wed, 25 May 2016 10:37:45 +0100 Message-ID: <57457269.1000205@integrafin.co.uk> In-Reply-To: 569179724.1436.1464168519263.JavaMail.zimbra@makz.me --===============0357399345238569775== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------030001000909050605090606 Content-Type: text/plain; charset=3Dwindows-1252; format=3Dflowed Content-Transfer-Encoding: 7bit On 25/05/16 10:28, Maxence Sartiaux wrote: > Hello, > > I've a problem, all my ovirt hosts are linked with a bonding mode 4 = > (802.3ad LACP) 2x10Gbps > Eveything is okay with unix guest but with Windows guest, i can ping = > but internet browsing is impossible (sometime i have a part of the = > page, very rare case) > > If i remove the bonding and bridge one interface, windows work good. > > I've tried with windows 7 and windows 10, guest additions are installed > VirtIO / rtl3189 tested, same problem > > My bonding opts : mode=3D4 lacp_rate=3D1 miimon=3D100 > Interface MTU 9000 > > Bonding mode 2 also tested On the hosts, try setting LRO off on the members of your bond, see if it = makes a difference eg, ethtool -K ens3f0 lro off ethtool -K ens3f1 lro off Alex -- This message is intended only for the addressee and may contain confidential information. Unless you are that person, you may not disclose its contents or use it in any way and are requested to delete the message along with any attachments and notify us immediately. This email is not intended to, nor should it be taken to, constitute advice. The information provided is correct to our knowledge & belief and must not be used as a substitute for obtaining tax, regulatory, investment, legal or any other appropriate advice. "Transact" is operated by Integrated Financial Arrangements Ltd. 29 Clement's Lane, London EC4N 7AE. Tel: (020) 7608 4900 Fax: (020) 7608 53= 00. (Registered office: as above; Registered in England and Wales under number: 3727592). Authorised and regulated by the Financial Conduct Authority (entered on the Financial Services Register; no. 190856). --------------030001000909050605090606 Content-Type: text/html; charset=3Dwindows-1252 Content-Transfer-Encoding: 8bit On 25/05/16 10:28, Maxence Sartiaux wrote:

Hello,=C2=A0

I've a problem, all my ovirt hosts are linked with a bonding mode 4 (802.3ad LACP) 2x10Gbps

Eveything is okay with unix=C2=A0guest but with Windows guest, i=C2=A0can ping but internet browsing is impossible (sometime i have a part of the page, very rare case)

If i remove the bonding and bridge one interface, windows work good.

I've tried with windows 7 and windows 10, guest additions are installed

VirtIO / rtl3189 tested, same problem

My bonding opts : mode=3D4 lacp_rate=3D1 miimon=3D100

Interface MTU 9000

Bonding mode 2 also tested

On the hosts, try setting LRO off on the members of your bond, see if it makes a difference

eg,

ethtool -K ens3f0 lro off
ethtool -K ens3f1 lro off

Alex

=

--
This message is intended only for the addressee and may contain
confidential information. Unless you are that person, you may not
disclose its contents or use it in any way and are requested to delete
the message along with any attachments and notify us immediately.
This email is not intended to, nor should it be taken to, constitute advice.
The information provided is correct to our knowledge & belief and must not
be used as a substitute for obtaining tax, regulatory, investment, legal or
any other appropriate advice.

"Transact" is operated by Integrated Financial Arrangements Ltd.
29 Clement's Lane, London EC4N 7AE. Tel: (020) 7608 4900 Fax: (020) 7608 53=
00.
(Registered office: as above; Registered in England and Wales under
number: 3727592). Authorised and regulated by the Financial Conduct
Authority (entered on the Financial Services Register; no. 190856).

--------------030001000909050605090606-- --===============0357399345238569775== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS0wMzAwMDEwMDA5MDkwNTA2MDUwOTA2MDYKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PXdpbmRvd3MtMTI1MjsgZm9ybWF0PWZsb3dlZApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5n OiA3Yml0CgpPbiAyNS8wNS8xNiAxMDoyOCwgTWF4ZW5jZSBTYXJ0aWF1eCB3cm90ZToKPiBIZWxs bywKPgo+IEkndmUgYSBwcm9ibGVtLCBhbGwgbXkgb3ZpcnQgaG9zdHMgYXJlIGxpbmtlZCB3aXRo IGEgYm9uZGluZyBtb2RlIDQgCj4gKDgwMi4zYWQgTEFDUCkgMngxMEdicHMKPiBFdmV5dGhpbmcg aXMgb2theSB3aXRoIHVuaXggZ3Vlc3QgYnV0IHdpdGggV2luZG93cyBndWVzdCwgaSBjYW4gcGlu ZyAKPiBidXQgaW50ZXJuZXQgYnJvd3NpbmcgaXMgaW1wb3NzaWJsZSAoc29tZXRpbWUgaSBoYXZl IGEgcGFydCBvZiB0aGUgCj4gcGFnZSwgdmVyeSByYXJlIGNhc2UpCj4KPiBJZiBpIHJlbW92ZSB0 aGUgYm9uZGluZyBhbmQgYnJpZGdlIG9uZSBpbnRlcmZhY2UsIHdpbmRvd3Mgd29yayBnb29kLgo+ Cj4gSSd2ZSB0cmllZCB3aXRoIHdpbmRvd3MgNyBhbmQgd2luZG93cyAxMCwgZ3Vlc3QgYWRkaXRp b25zIGFyZSBpbnN0YWxsZWQKPiBWaXJ0SU8gLyBydGwzMTg5IHRlc3RlZCwgc2FtZSBwcm9ibGVt Cj4KPiBNeSBib25kaW5nIG9wdHMgOiBtb2RlPTQgbGFjcF9yYXRlPTEgbWlpbW9uPTEwMAo+IElu dGVyZmFjZSBNVFUgOTAwMAo+Cj4gQm9uZGluZyBtb2RlIDIgYWxzbyB0ZXN0ZWQKCk9uIHRoZSBo b3N0cywgdHJ5IHNldHRpbmcgTFJPIG9mZiBvbiB0aGUgbWVtYmVycyBvZiB5b3VyIGJvbmQsIHNl ZSBpZiBpdCAKbWFrZXMgYSBkaWZmZXJlbmNlCgplZywKCmV0aHRvb2wgLUsgZW5zM2YwIGxybyBv ZmYKZXRodG9vbCAtSyBlbnMzZjEgbHJvIG9mZgoKQWxleAoKCi0tClRoaXMgbWVzc2FnZSBpcyBp bnRlbmRlZCBvbmx5IGZvciB0aGUgYWRkcmVzc2VlIGFuZCBtYXkgY29udGFpbgpjb25maWRlbnRp YWwgaW5mb3JtYXRpb24uIFVubGVzcyB5b3UgYXJlIHRoYXQgcGVyc29uLCB5b3UgbWF5IG5vdApk aXNjbG9zZSBpdHMgY29udGVudHMgb3IgdXNlIGl0IGluIGFueSB3YXkgYW5kIGFyZSByZXF1ZXN0 ZWQgdG8gZGVsZXRlCnRoZSBtZXNzYWdlIGFsb25nIHdpdGggYW55IGF0dGFjaG1lbnRzIGFuZCBu b3RpZnkgdXMgaW1tZWRpYXRlbHkuClRoaXMgZW1haWwgaXMgbm90IGludGVuZGVkIHRvLCBub3Ig c2hvdWxkIGl0IGJlIHRha2VuIHRvLCBjb25zdGl0dXRlIGFkdmljZS4KVGhlIGluZm9ybWF0aW9u IHByb3ZpZGVkIGlzIGNvcnJlY3QgdG8gb3VyIGtub3dsZWRnZSAmIGJlbGllZiBhbmQgbXVzdCBu b3QKYmUgdXNlZCBhcyBhIHN1YnN0aXR1dGUgZm9yIG9idGFpbmluZyB0YXgsIHJlZ3VsYXRvcnks IGludmVzdG1lbnQsIGxlZ2FsIG9yCmFueSBvdGhlciBhcHByb3ByaWF0ZSBhZHZpY2UuCgoiVHJh bnNhY3QiIGlzIG9wZXJhdGVkIGJ5IEludGVncmF0ZWQgRmluYW5jaWFsIEFycmFuZ2VtZW50cyBM dGQuCjI5IENsZW1lbnQncyBMYW5lLCBMb25kb24gRUM0TiA3QUUuIFRlbDogKDAyMCkgNzYwOCA0 OTAwIEZheDogKDAyMCkgNzYwOCA1MzAwLgooUmVnaXN0ZXJlZCBvZmZpY2U6IGFzIGFib3ZlOyBS ZWdpc3RlcmVkIGluIEVuZ2xhbmQgYW5kIFdhbGVzIHVuZGVyCm51bWJlcjogMzcyNzU5MikuIEF1 dGhvcmlzZWQgYW5kIHJlZ3VsYXRlZCBieSB0aGUgRmluYW5jaWFsIENvbmR1Y3QKQXV0aG9yaXR5 IChlbnRlcmVkIG9uIHRoZSBGaW5hbmNpYWwgU2VydmljZXMgUmVnaXN0ZXI7IG5vLiAxOTA4NTYp LgotLS0tLS0tLS0tLS0tLTAzMDAwMTAwMDkwOTA1MDYwNTA5MDYwNgpDb250ZW50LVR5cGU6IHRl eHQvaHRtbDsgY2hhcnNldD13aW5kb3dzLTEyNTIKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzog OGJpdAoKPGh0bWw+CiAgPGhlYWQ+CiAgICA8bWV0YSBjb250ZW50PSJ0ZXh0L2h0bWw7IGNoYXJz ZXQ9d2luZG93cy0xMjUyIgogICAgICBodHRwLWVxdWl2PSJDb250ZW50LVR5cGUiPgogIDwvaGVh ZD4KICA8Ym9keSB0ZXh0PSIjMDAwMDAwIiBiZ2NvbG9yPSIjRkZGRkZGIj4KICAgIE9uIDI1LzA1 LzE2IDEwOjI4LCBNYXhlbmNlIFNhcnRpYXV4IHdyb3RlOjxicj4KICAgIDxibG9ja3F1b3RlCiAg ICAgIGNpdGU9Im1pZDo1NjkxNzk3MjQuMTQzNi4xNDY0MTY4NTE5MjYzLkphdmFNYWlsLnppbWJy YUBtYWt6Lm1lIgogICAgICB0eXBlPSJjaXRlIj4KICAgICAgPGRpdiBzdHlsZT0iZm9udC1mYW1p bHk6IGFyaWFsLCBoZWx2ZXRpY2EsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZToKICAgICAgICAxMnB0 OyBjb2xvcjogIzAwMDAwMCI+CiAgICAgICAgPGRpdj5IZWxsbyygPC9kaXY+CiAgICAgICAgPGRp dj48YnIgZGF0YS1tY2UtYm9ndXM9IjEiPgogICAgICAgIDwvZGl2PgogICAgICAgIDxkaXY+SSd2 ZSBhIHByb2JsZW0sIGFsbCBteSBvdmlydCBob3N0cyBhcmUgbGlua2VkIHdpdGggYQogICAgICAg ICAgYm9uZGluZyBtb2RlIDQgKDgwMi4zYWQgTEFDUCkgMngxMEdicHM8L2Rpdj4KICAgICAgICA8 ZGl2PkV2ZXl0aGluZyBpcyBva2F5IHdpdGggdW5peKBndWVzdCBidXQgd2l0aCBXaW5kb3dzIGd1 ZXN0LAogICAgICAgICAgaaBjYW4gcGluZyBidXQgaW50ZXJuZXQgYnJvd3NpbmcgaXMgaW1wb3Nz aWJsZSAoc29tZXRpbWUgaQogICAgICAgICAgaGF2ZSBhIHBhcnQgb2YgdGhlIHBhZ2UsIHZlcnkg cmFyZSBjYXNlKTwvZGl2PgogICAgICAgIDxkaXY+PGJyIGRhdGEtbWNlLWJvZ3VzPSIxIj4KICAg ICAgICA8L2Rpdj4KICAgICAgICA8ZGl2PklmIGkgcmVtb3ZlIHRoZSBib25kaW5nIGFuZCBicmlk Z2Ugb25lIGludGVyZmFjZSwgd2luZG93cwogICAgICAgICAgd29yayBnb29kLjwvZGl2PgogICAg ICAgIDxkaXY+PGJyIGRhdGEtbWNlLWJvZ3VzPSIxIj4KICAgICAgICA8L2Rpdj4KICAgICAgICA8 ZGl2PkkndmUgdHJpZWQgd2l0aCB3aW5kb3dzIDcgYW5kIHdpbmRvd3MgMTAsIGd1ZXN0IGFkZGl0 aW9ucwogICAgICAgICAgYXJlIGluc3RhbGxlZDwvZGl2PgogICAgICAgIDxkaXY+VmlydElPIC8g cnRsMzE4OSB0ZXN0ZWQsIHNhbWUgcHJvYmxlbTwvZGl2PgogICAgICAgIDxkaXY+PGJyIGRhdGEt bWNlLWJvZ3VzPSIxIj4KICAgICAgICA8L2Rpdj4KICAgICAgICA8ZGl2Pk15IGJvbmRpbmcgb3B0 cyA6IG1vZGU9NCBsYWNwX3JhdGU9MSBtaWltb249MTAwPC9kaXY+CiAgICAgICAgPGRpdj5JbnRl cmZhY2UgTVRVIDkwMDA8L2Rpdj4KICAgICAgICA8ZGl2PjxiciBkYXRhLW1jZS1ib2d1cz0iMSI+ CiAgICAgICAgPC9kaXY+CiAgICAgICAgPGRpdj5Cb25kaW5nIG1vZGUgMiBhbHNvIHRlc3RlZDwv ZGl2PgogICAgICA8L2Rpdj4KICAgIDwvYmxvY2txdW90ZT4KICAgIDxicj4KICAgIE9uIHRoZSBo b3N0cywgdHJ5IHNldHRpbmcgTFJPIG9mZiBvbiB0aGUgbWVtYmVycyBvZiB5b3VyIGJvbmQsIHNl ZQogICAgaWYgaXQgbWFrZXMgYSBkaWZmZXJlbmNlPGJyPgogICAgPGJyPgogICAgZWcsIDxicj4K ICAgIDxicj4KICAgIGV0aHRvb2wgLUsgZW5zM2YwIGxybyBvZmY8YnI+CiAgICBldGh0b29sIC1L IGVuczNmMSBscm8gb2ZmPGJyPgogICAgPGJyPgogICAgQWxleDxicj4KICAgIDxicj4KICAKPGJy PjxwcmU+Ci0tClRoaXMgbWVzc2FnZSBpcyBpbnRlbmRlZCBvbmx5IGZvciB0aGUgYWRkcmVzc2Vl IGFuZCBtYXkgY29udGFpbgpjb25maWRlbnRpYWwgaW5mb3JtYXRpb24uIFVubGVzcyB5b3UgYXJl IHRoYXQgcGVyc29uLCB5b3UgbWF5IG5vdApkaXNjbG9zZSBpdHMgY29udGVudHMgb3IgdXNlIGl0 IGluIGFueSB3YXkgYW5kIGFyZSByZXF1ZXN0ZWQgdG8gZGVsZXRlCnRoZSBtZXNzYWdlIGFsb25n IHdpdGggYW55IGF0dGFjaG1lbnRzIGFuZCBub3RpZnkgdXMgaW1tZWRpYXRlbHkuClRoaXMgZW1h aWwgaXMgbm90IGludGVuZGVkIHRvLCBub3Igc2hvdWxkIGl0IGJlIHRha2VuIHRvLCBjb25zdGl0 dXRlIGFkdmljZS4KVGhlIGluZm9ybWF0aW9uIHByb3ZpZGVkIGlzIGNvcnJlY3QgdG8gb3VyIGtu b3dsZWRnZSAmIGJlbGllZiBhbmQgbXVzdCBub3QKYmUgdXNlZCBhcyBhIHN1YnN0aXR1dGUgZm9y IG9idGFpbmluZyB0YXgsIHJlZ3VsYXRvcnksIGludmVzdG1lbnQsIGxlZ2FsIG9yCmFueSBvdGhl ciBhcHByb3ByaWF0ZSBhZHZpY2UuCgoiVHJhbnNhY3QiIGlzIG9wZXJhdGVkIGJ5IEludGVncmF0 ZWQgRmluYW5jaWFsIEFycmFuZ2VtZW50cyBMdGQuCjI5IENsZW1lbnQncyBMYW5lLCBMb25kb24g RUM0TiA3QUUuIFRlbDogKDAyMCkgNzYwOCA0OTAwIEZheDogKDAyMCkgNzYwOCA1MzAwLgooUmVn aXN0ZXJlZCBvZmZpY2U6IGFzIGFib3ZlOyBSZWdpc3RlcmVkIGluIEVuZ2xhbmQgYW5kIFdhbGVz IHVuZGVyCm51bWJlcjogMzcyNzU5MikuIEF1dGhvcmlzZWQgYW5kIHJlZ3VsYXRlZCBieSB0aGUg RmluYW5jaWFsIENvbmR1Y3QKQXV0aG9yaXR5IChlbnRlcmVkIG9uIHRoZSBGaW5hbmNpYWwgU2Vy dmljZXMgUmVnaXN0ZXI7IG5vLiAxOTA4NTYpLgo8L3ByZT48YnI+CjwvYm9keT4KPC9odG1sPgoK LS0tLS0tLS0tLS0tLS0wMzAwMDEwMDA5MDkwNTA2MDUwOTA2MDYtLQo= --===============0357399345238569775==-- From contact at makz.me Wed May 25 07:09:58 2016 Content-Type: multipart/mixed; boundary="===============2050138278273959152==" MIME-Version: 1.0 From: Maxence Sartiaux To: users at ovirt.org Subject: Re: [ovirt-users] Network problem with bonding and Windows guests Date: Wed, 25 May 2016 13:10:12 +0200 Message-ID: <1464174612.2049.6.camel@makz.me> In-Reply-To: 57457269.1000205@integrafin.co.uk --===============2050138278273959152== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable Yep work good ! Adding ETHTOOL_OPTIONS=3D'-K iface lro off' to the slave interfaces config file did the job :) Thank you ! On Wed, 2016-05-25 at 10:37 +0100, Alex Crow wrote: > On 25/05/16 10:28, Maxence Sartiaux wrote: > > Hello,=C2=A0 > > = > > = > > I've a problem, all my ovirt hosts are linked with a bonding mode 4 > > (802.3ad LACP) 2x10Gbps > > Eveything is okay with unix=C2=A0guest but with Windows guest, i=C2=A0c= an > > ping but internet browsing is impossible (sometime i have a part of > > the page, very rare case) > > = > > = > > If i remove the bonding and bridge one interface, windows work > > good. > > = > > = > > I've tried with windows 7 and windows 10, guest additions are > > installed > > VirtIO / rtl3189 tested, same problem > > = > > = > > My bonding opts : mode=3D4 lacp_rate=3D1 miimon=3D100 > > Interface MTU 9000 > > = > > = > > Bonding mode 2 also tested > > = > =C2=A0 > On the hosts, try setting LRO off on the members of your bond, see if > it makes a difference > = > eg,=C2=A0 > = > ethtool -K ens3f0 lro off > ethtool -K ens3f1 lro off > = > Alex > = > = > -- > This message is intended only for the addressee and may contain > confidential information. Unless you are that person, you may not > disclose its contents or use it in any way and are requested to > delete > the message along with any attachments and notify us immediately. > This email is not intended to, nor should it be taken to, constitute > advice. > The information provided is correct to our knowledge & belief and > must not > be used as a substitute for obtaining tax, regulatory, investment, > legal or > any other appropriate advice. > = > "Transact" is operated by Integrated Financial Arrangements Ltd. > 29 Clement's Lane, London EC4N 7AE. Tel: (020) 7608 4900 Fax: (020) > 7608 5300. > (Registered office: as above; Registered in England and Wales under > number: 3727592). Authorised and regulated by the Financial Conduct > Authority (entered on the Financial Services Register; no. 190856). > = > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users --===============2050138278273959152== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGh0bWw+PGhlYWQ+CiAgICA8bWV0YSBjb250ZW50PSJ0ZXh0L2h0bWw7IGNoYXJzZXQ9d2luZG93 cy0xMjUyIiBodHRwLWVxdWl2PSJDb250ZW50LVR5cGUiPgogIDwvaGVhZD4KICA8Ym9keT48ZGl2 PlllcCB3b3JrIGdvb2QgITwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+QWRkaW5nPC9kaXY+PGRp dj48YnI+PC9kaXY+PGRpdj5FVEhUT09MX09QVElPTlM9Jy1LIGlmYWNlIGxybyBvZmYnPC9kaXY+ PGRpdj48YnI+PC9kaXY+PGRpdj50byB0aGUgc2xhdmUgaW50ZXJmYWNlcyBjb25maWcgZmlsZSBk aWQgdGhlIGpvYiA6KTwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+VGhhbmsgeW91ICE8L2Rpdj48 ZGl2Pjxicj48L2Rpdj48ZGl2Pk9uIFdlZCwgMjAxNi0wNS0yNSBhdCAxMDozNyArMDEwMCwgQWxl eCBDcm93IHdyb3RlOjwvZGl2PjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPgogICAgT24gMjUvMDUv MTYgMTA6MjgsIE1heGVuY2UgU2FydGlhdXggd3JvdGU6PGJyPgogICAgPGJsb2NrcXVvdGUgY2l0 ZT0ibWlkOjU2OTE3OTcyNC4xNDM2LjE0NjQxNjg1MTkyNjMuSmF2YU1haWwuemltYnJhQG1ha3ou bWUiIHR5cGU9ImNpdGUiPgogICAgICA8ZGl2IHN0eWxlPSJmb250LWZhbWlseTogYXJpYWwsIGhl bHZldGljYSwgc2Fucy1zZXJpZjsgZm9udC1zaXplOgogICAgICAgIDEycHQ7IGNvbG9yOiAjMDAw MDAwIj4KICAgICAgICA8ZGl2PkhlbGxvLCZuYnNwOzwvZGl2PgogICAgICAgIDxkaXY+PGJyIGRh dGEtbWNlLWJvZ3VzPSIxIj4KICAgICAgICA8L2Rpdj4KICAgICAgICA8ZGl2PkkndmUgYSBwcm9i bGVtLCBhbGwgbXkgb3ZpcnQgaG9zdHMgYXJlIGxpbmtlZCB3aXRoIGEKICAgICAgICAgIGJvbmRp bmcgbW9kZSA0ICg4MDIuM2FkIExBQ1ApIDJ4MTBHYnBzPC9kaXY+CiAgICAgICAgPGRpdj5FdmV5 dGhpbmcgaXMgb2theSB3aXRoIHVuaXgmbmJzcDtndWVzdCBidXQgd2l0aCBXaW5kb3dzIGd1ZXN0 LAogICAgICAgICAgaSZuYnNwO2NhbiBwaW5nIGJ1dCBpbnRlcm5ldCBicm93c2luZyBpcyBpbXBv c3NpYmxlIChzb21ldGltZSBpCiAgICAgICAgICBoYXZlIGEgcGFydCBvZiB0aGUgcGFnZSwgdmVy eSByYXJlIGNhc2UpPC9kaXY+CiAgICAgICAgPGRpdj48YnIgZGF0YS1tY2UtYm9ndXM9IjEiPgog ICAgICAgIDwvZGl2PgogICAgICAgIDxkaXY+SWYgaSByZW1vdmUgdGhlIGJvbmRpbmcgYW5kIGJy aWRnZSBvbmUgaW50ZXJmYWNlLCB3aW5kb3dzCiAgICAgICAgICB3b3JrIGdvb2QuPC9kaXY+CiAg ICAgICAgPGRpdj48YnIgZGF0YS1tY2UtYm9ndXM9IjEiPgogICAgICAgIDwvZGl2PgogICAgICAg IDxkaXY+SSd2ZSB0cmllZCB3aXRoIHdpbmRvd3MgNyBhbmQgd2luZG93cyAxMCwgZ3Vlc3QgYWRk aXRpb25zCiAgICAgICAgICBhcmUgaW5zdGFsbGVkPC9kaXY+CiAgICAgICAgPGRpdj5WaXJ0SU8g LyBydGwzMTg5IHRlc3RlZCwgc2FtZSBwcm9ibGVtPC9kaXY+CiAgICAgICAgPGRpdj48YnIgZGF0 YS1tY2UtYm9ndXM9IjEiPgogICAgICAgIDwvZGl2PgogICAgICAgIDxkaXY+TXkgYm9uZGluZyBv cHRzIDogbW9kZT00IGxhY3BfcmF0ZT0xIG1paW1vbj0xMDA8L2Rpdj4KICAgICAgICA8ZGl2Pklu dGVyZmFjZSBNVFUgOTAwMDwvZGl2PgogICAgICAgIDxkaXY+PGJyIGRhdGEtbWNlLWJvZ3VzPSIx Ij4KICAgICAgICA8L2Rpdj4KICAgICAgICA8ZGl2PkJvbmRpbmcgbW9kZSAyIGFsc28gdGVzdGVk PC9kaXY+CiAgICAgIDwvZGl2PgogICAgPC9ibG9ja3F1b3RlPgogICAgPGJyPgogICAgT24gdGhl IGhvc3RzLCB0cnkgc2V0dGluZyBMUk8gb2ZmIG9uIHRoZSBtZW1iZXJzIG9mIHlvdXIgYm9uZCwg c2VlCiAgICBpZiBpdCBtYWtlcyBhIGRpZmZlcmVuY2U8YnI+CiAgICA8YnI+CiAgICBlZywgPGJy PgogICAgPGJyPgogICAgZXRodG9vbCAtSyBlbnMzZjAgbHJvIG9mZjxicj4KICAgIGV0aHRvb2wg LUsgZW5zM2YxIGxybyBvZmY8YnI+CiAgICA8YnI+CiAgICBBbGV4PGJyPgogICAgPGJyPgogIAo8 YnI+PHByZT4tLQpUaGlzIG1lc3NhZ2UgaXMgaW50ZW5kZWQgb25seSBmb3IgdGhlIGFkZHJlc3Nl ZSBhbmQgbWF5IGNvbnRhaW4KY29uZmlkZW50aWFsIGluZm9ybWF0aW9uLiBVbmxlc3MgeW91IGFy ZSB0aGF0IHBlcnNvbiwgeW91IG1heSBub3QKZGlzY2xvc2UgaXRzIGNvbnRlbnRzIG9yIHVzZSBp dCBpbiBhbnkgd2F5IGFuZCBhcmUgcmVxdWVzdGVkIHRvIGRlbGV0ZQp0aGUgbWVzc2FnZSBhbG9u ZyB3aXRoIGFueSBhdHRhY2htZW50cyBhbmQgbm90aWZ5IHVzIGltbWVkaWF0ZWx5LgpUaGlzIGVt YWlsIGlzIG5vdCBpbnRlbmRlZCB0bywgbm9yIHNob3VsZCBpdCBiZSB0YWtlbiB0bywgY29uc3Rp dHV0ZSBhZHZpY2UuClRoZSBpbmZvcm1hdGlvbiBwcm92aWRlZCBpcyBjb3JyZWN0IHRvIG91ciBr bm93bGVkZ2UgJmFtcDsgYmVsaWVmIGFuZCBtdXN0IG5vdApiZSB1c2VkIGFzIGEgc3Vic3RpdHV0 ZSBmb3Igb2J0YWluaW5nIHRheCwgcmVndWxhdG9yeSwgaW52ZXN0bWVudCwgbGVnYWwgb3IKYW55 IG90aGVyIGFwcHJvcHJpYXRlIGFkdmljZS4KCiJUcmFuc2FjdCIgaXMgb3BlcmF0ZWQgYnkgSW50 ZWdyYXRlZCBGaW5hbmNpYWwgQXJyYW5nZW1lbnRzIEx0ZC4KMjkgQ2xlbWVudCdzIExhbmUsIExv bmRvbiBFQzROIDdBRS4gVGVsOiAoMDIwKSA3NjA4IDQ5MDAgRmF4OiAoMDIwKSA3NjA4IDUzMDAu CihSZWdpc3RlcmVkIG9mZmljZTogYXMgYWJvdmU7IFJlZ2lzdGVyZWQgaW4gRW5nbGFuZCBhbmQg V2FsZXMgdW5kZXIKbnVtYmVyOiAzNzI3NTkyKS4gQXV0aG9yaXNlZCBhbmQgcmVndWxhdGVkIGJ5 IHRoZSBGaW5hbmNpYWwgQ29uZHVjdApBdXRob3JpdHkgKGVudGVyZWQgb24gdGhlIEZpbmFuY2lh bCBTZXJ2aWNlcyBSZWdpc3Rlcjsgbm8uIDE5MDg1NikuCjwvcHJlPjxicj4KCgo8cHJlPl9fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fClVzZXJzIG1haWxpbmcg bGlzdAo8YSBocmVmPSJtYWlsdG86VXNlcnNAb3ZpcnQub3JnIj5Vc2Vyc0BvdmlydC5vcmc8L2E+ CjxhIGhyZWY9Imh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9saXN0aW5mby91c2VycyI+ aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzPC9hPgo8L3ByZT48 L2Jsb2NrcXVvdGU+PC9ib2R5PjwvaHRtbD4= --===============2050138278273959152==-- From ehaas at redhat.com Thu May 26 04:04:18 2016 Content-Type: multipart/mixed; boundary="===============1104061197457998468==" MIME-Version: 1.0 From: Edward Haas To: users at ovirt.org Subject: Re: [ovirt-users] Network problem with bonding and Windows guests Date: Thu, 26 May 2016 11:03:38 +0300 Message-ID: In-Reply-To: 1464174612.2049.6.camel@makz.me --===============1104061197457998468== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable On Wed, May 25, 2016 at 2:10 PM, Maxence Sartiaux wrote: > Yep work good ! > > Adding > > ETHTOOL_OPTIONS=3D'-K iface lro off' > > to the slave interfaces config file did the job :) > > Thank you ! > > On Wed, 2016-05-25 at 10:37 +0100, Alex Crow wrote: > > On 25/05/16 10:28, Maxence Sartiaux wrote: > > Hello, > > I've a problem, all my ovirt hosts are linked with a bonding mode 4 > (802.3ad LACP) 2x10Gbps > Eveything is okay with unix guest but with Windows guest, i can ping but > internet browsing is impossible (sometime i have a part of the page, very > rare case) > > If i remove the bonding and bridge one interface, windows work good. > > I've tried with windows 7 and windows 10, guest additions are installed > VirtIO / rtl3189 tested, same problem > > My bonding opts : mode=3D4 lacp_rate=3D1 miimon=3D100 > Interface MTU 9000 > > Bonding mode 2 also tested > > > On the hosts, try setting LRO off on the members of your bond, see if it > makes a difference > > eg, > > ethtool -K ens3f0 lro off > ethtool -K ens3f1 lro off > > Alex > > > -- > This message is intended only for the addressee and may contain > confidential information. Unless you are that person, you may not > disclose its contents or use it in any way and are requested to delete > the message along with any attachments and notify us immediately. > This email is not intended to, nor should it be taken to, constitute advi= ce. > The information provided is correct to our knowledge & belief and must not > be used as a substitute for obtaining tax, regulatory, investment, legal = or > any other appropriate advice. > > "Transact" is operated by Integrated Financial Arrangements Ltd. > 29 Clement's Lane, London EC4N 7AE. Tel: (020) 7608 4900 Fax: (020) 7608 = 5300. > (Registered office: as above; Registered in England and Wales under > number: 3727592). Authorised and regulated by the Financial Conduct > Authority (entered on the Financial Services Register; no. 190856). > > > _______________________________________________ > Users mailing listUsers(a)ovirt.orghttp://lists.ovirt.org/mailman/listinf= o/users > > _______________________________________________ > Users mailing list > Users(a)ovirt.org > http://lists.ovirt.org/mailman/listinfo/users > > There was such a bug with the bonding driver not dropping the LRO when bind to a bridge. Thanks, Edy. --===============1104061197457998468== Content-Type: text/html MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.html" PGRpdiBkaXI9Imx0ciI+PGJyPjxkaXYgY2xhc3M9ImdtYWlsX2V4dHJhIj48YnI+PGRpdiBjbGFz cz0iZ21haWxfcXVvdGUiPk9uIFdlZCwgTWF5IDI1LCAyMDE2IGF0IDI6MTAgUE0sIE1heGVuY2Ug U2FydGlhdXggPHNwYW4gZGlyPSJsdHIiPiZsdDs8YSBocmVmPSJtYWlsdG86Y29udGFjdEBtYWt6 Lm1lIiB0YXJnZXQ9Il9ibGFuayI+Y29udGFjdEBtYWt6Lm1lPC9hPiZndDs8L3NwYW4+IHdyb3Rl Ojxicj48YmxvY2txdW90ZSBjbGFzcz0iZ21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46MCAwIDAg LjhleDtib3JkZXItbGVmdDoxcHggI2NjYyBzb2xpZDtwYWRkaW5nLWxlZnQ6MWV4Ij4KICAgIAog IAogIDxkaXY+PGRpdj5ZZXAgd29yayBnb29kICE8L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2PkFk ZGluZzwvZGl2PjxkaXY+PGJyPjwvZGl2PjxkaXY+RVRIVE9PTF9PUFRJT05TPSYjMzk7LUsgaWZh Y2UgbHJvIG9mZiYjMzk7PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj50byB0aGUgc2xhdmUgaW50 ZXJmYWNlcyBjb25maWcgZmlsZSBkaWQgdGhlIGpvYiA6KTwvZGl2PjxkaXY+PGJyPjwvZGl2Pjxk aXY+VGhhbmsgeW91ICE8L2Rpdj48ZGl2PjxkaXYgY2xhc3M9Img1Ij48ZGl2Pjxicj48L2Rpdj48 ZGl2Pk9uIFdlZCwgMjAxNi0wNS0yNSBhdCAxMDozNyArMDEwMCwgQWxleCBDcm93IHdyb3RlOjwv ZGl2PjwvZGl2PjwvZGl2PjxibG9ja3F1b3RlIHR5cGU9ImNpdGUiPjxkaXY+PGRpdiBjbGFzcz0i aDUiPgogICAgT24gMjUvMDUvMTYgMTA6MjgsIE1heGVuY2UgU2FydGlhdXggd3JvdGU6PGJyPgog ICAgPGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSI+CiAgICAgIDxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5 OmFyaWFsLGhlbHZldGljYSxzYW5zLXNlcmlmO2ZvbnQtc2l6ZToxMnB0O2NvbG9yOiMwMDAwMDAi PgogICAgICAgIDxkaXY+SGVsbG8swqA8L2Rpdj4KICAgICAgICA8ZGl2Pjxicj4KICAgICAgICA8 L2Rpdj4KICAgICAgICA8ZGl2PkkmIzM5O3ZlIGEgcHJvYmxlbSwgYWxsIG15IG92aXJ0IGhvc3Rz IGFyZSBsaW5rZWQgd2l0aCBhCiAgICAgICAgICBib25kaW5nIG1vZGUgNCAoODAyLjNhZCBMQUNQ KSAyeDEwR2JwczwvZGl2PgogICAgICAgIDxkaXY+RXZleXRoaW5nIGlzIG9rYXkgd2l0aCB1bml4 wqBndWVzdCBidXQgd2l0aCBXaW5kb3dzIGd1ZXN0LAogICAgICAgICAgacKgY2FuIHBpbmcgYnV0 IGludGVybmV0IGJyb3dzaW5nIGlzIGltcG9zc2libGUgKHNvbWV0aW1lIGkKICAgICAgICAgIGhh dmUgYSBwYXJ0IG9mIHRoZSBwYWdlLCB2ZXJ5IHJhcmUgY2FzZSk8L2Rpdj4KICAgICAgICA8ZGl2 Pjxicj4KICAgICAgICA8L2Rpdj4KICAgICAgICA8ZGl2PklmIGkgcmVtb3ZlIHRoZSBib25kaW5n IGFuZCBicmlkZ2Ugb25lIGludGVyZmFjZSwgd2luZG93cwogICAgICAgICAgd29yayBnb29kLjwv ZGl2PgogICAgICAgIDxkaXY+PGJyPgogICAgICAgIDwvZGl2PgogICAgICAgIDxkaXY+SSYjMzk7 dmUgdHJpZWQgd2l0aCB3aW5kb3dzIDcgYW5kIHdpbmRvd3MgMTAsIGd1ZXN0IGFkZGl0aW9ucwog ICAgICAgICAgYXJlIGluc3RhbGxlZDwvZGl2PgogICAgICAgIDxkaXY+VmlydElPIC8gcnRsMzE4 OSB0ZXN0ZWQsIHNhbWUgcHJvYmxlbTwvZGl2PgogICAgICAgIDxkaXY+PGJyPgogICAgICAgIDwv ZGl2PgogICAgICAgIDxkaXY+TXkgYm9uZGluZyBvcHRzIDogbW9kZT00IGxhY3BfcmF0ZT0xIG1p aW1vbj0xMDA8L2Rpdj4KICAgICAgICA8ZGl2PkludGVyZmFjZSBNVFUgOTAwMDwvZGl2PgogICAg ICAgIDxkaXY+PGJyPgogICAgICAgIDwvZGl2PgogICAgICAgIDxkaXY+Qm9uZGluZyBtb2RlIDIg YWxzbyB0ZXN0ZWQ8L2Rpdj4KICAgICAgPC9kaXY+CiAgICA8L2Jsb2NrcXVvdGU+CiAgICA8YnI+ CiAgICBPbiB0aGUgaG9zdHMsIHRyeSBzZXR0aW5nIExSTyBvZmYgb24gdGhlIG1lbWJlcnMgb2Yg eW91ciBib25kLCBzZWUKICAgIGlmIGl0IG1ha2VzIGEgZGlmZmVyZW5jZTxicj4KICAgIDxicj4K ICAgIGVnLCA8YnI+CiAgICA8YnI+CiAgICBldGh0b29sIC1LIGVuczNmMCBscm8gb2ZmPGJyPgog ICAgZXRodG9vbCAtSyBlbnMzZjEgbHJvIG9mZjxicj4KICAgIDxicj4KICAgIEFsZXg8YnI+CiAg ICA8YnI+CiAgCjxicj48cHJlPi0tClRoaXMgbWVzc2FnZSBpcyBpbnRlbmRlZCBvbmx5IGZvciB0 aGUgYWRkcmVzc2VlIGFuZCBtYXkgY29udGFpbgpjb25maWRlbnRpYWwgaW5mb3JtYXRpb24uIFVu bGVzcyB5b3UgYXJlIHRoYXQgcGVyc29uLCB5b3UgbWF5IG5vdApkaXNjbG9zZSBpdHMgY29udGVu dHMgb3IgdXNlIGl0IGluIGFueSB3YXkgYW5kIGFyZSByZXF1ZXN0ZWQgdG8gZGVsZXRlCnRoZSBt ZXNzYWdlIGFsb25nIHdpdGggYW55IGF0dGFjaG1lbnRzIGFuZCBub3RpZnkgdXMgaW1tZWRpYXRl bHkuClRoaXMgZW1haWwgaXMgbm90IGludGVuZGVkIHRvLCBub3Igc2hvdWxkIGl0IGJlIHRha2Vu IHRvLCBjb25zdGl0dXRlIGFkdmljZS4KVGhlIGluZm9ybWF0aW9uIHByb3ZpZGVkIGlzIGNvcnJl Y3QgdG8gb3VyIGtub3dsZWRnZSAmYW1wOyBiZWxpZWYgYW5kIG11c3Qgbm90CmJlIHVzZWQgYXMg YSBzdWJzdGl0dXRlIGZvciBvYnRhaW5pbmcgdGF4LCByZWd1bGF0b3J5LCBpbnZlc3RtZW50LCBs ZWdhbCBvcgphbnkgb3RoZXIgYXBwcm9wcmlhdGUgYWR2aWNlLgoKJnF1b3Q7VHJhbnNhY3QmcXVv dDsgaXMgb3BlcmF0ZWQgYnkgSW50ZWdyYXRlZCBGaW5hbmNpYWwgQXJyYW5nZW1lbnRzIEx0ZC4K MjkgQ2xlbWVudCYjMzk7cyBMYW5lLCBMb25kb24gRUM0TiA3QUUuIFRlbDogKDAyMCkgNzYwOCA0 OTAwIEZheDogKDAyMCkgNzYwOCA1MzAwLgooUmVnaXN0ZXJlZCBvZmZpY2U6IGFzIGFib3ZlOyBS ZWdpc3RlcmVkIGluIEVuZ2xhbmQgYW5kIFdhbGVzIHVuZGVyCm51bWJlcjogMzcyNzU5MikuIEF1 dGhvcmlzZWQgYW5kIHJlZ3VsYXRlZCBieSB0aGUgRmluYW5jaWFsIENvbmR1Y3QKQXV0aG9yaXR5 IChlbnRlcmVkIG9uIHRoZSBGaW5hbmNpYWwgU2VydmljZXMgUmVnaXN0ZXI7IG5vLiAxOTA4NTYp Lgo8L3ByZT48YnI+CgoKPC9kaXY+PC9kaXY+PHByZT5fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fXwpVc2VycyBtYWlsaW5nIGxpc3QKPGEgaHJlZj0ibWFpbHRv OlVzZXJzQG92aXJ0Lm9yZyIgdGFyZ2V0PSJfYmxhbmsiPlVzZXJzQG92aXJ0Lm9yZzwvYT4KPGEg aHJlZj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIiB0YXJn ZXQ9Il9ibGFuayI+aHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJz PC9hPgo8L3ByZT48L2Jsb2NrcXVvdGU+PC9kaXY+wqA8L2Jsb2NrcXVvdGU+PGJsb2NrcXVvdGUg Y2xhc3M9ImdtYWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAwIC44ZXg7Ym9yZGVyLWxlZnQ6 MXB4ICNjY2Mgc29saWQ7cGFkZGluZy1sZWZ0OjFleCI+X19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX188YnI+ClVzZXJzIG1haWxpbmcgbGlzdDxicj4KPGEgaHJl Zj0ibWFpbHRvOlVzZXJzQG92aXJ0Lm9yZyI+VXNlcnNAb3ZpcnQub3JnPC9hPjxicj4KPGEgaHJl Zj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIiByZWw9Im5v cmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIj5odHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4v bGlzdGluZm8vdXNlcnM8L2E+PGJyPgo8YnI+PC9ibG9ja3F1b3RlPjwvZGl2Pjxicj48L2Rpdj48 ZGl2IGNsYXNzPSJnbWFpbF9leHRyYSI+VGhlcmUgd2FzIHN1Y2ggYSBidWcgd2l0aCB0aGUgYm9u ZGluZyBkcml2ZXIgbm90IGRyb3BwaW5nIHRoZSBMUk8gd2hlbiBiaW5kIHRvIGEgYnJpZGdlLjxi cj48YnI+PC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZXh0cmEiPlRoYW5rcyw8YnI+PC9kaXY+PGRp diBjbGFzcz0iZ21haWxfZXh0cmEiPkVkeS48YnI+PC9kaXY+PGRpdiBjbGFzcz0iZ21haWxfZXh0 cmEiPjxicj48L2Rpdj48L2Rpdj4K --===============1104061197457998468==--