oVIRT 4.1 / iSCSI Multipathing
I am using the latest release of oVIRT 4.1.3, and I am connecting a Dell Compelent SAN that has 2 fault domains each on a separate VLAN that I have attached to oVIRT. From what I understand I am suppose to go into “iSCSI Multipathing” option and add a BOND of the iSCSI interfaces. I have done this selecting the 2 logical networks together for iSCSI. I notice that there is an option below to select Storage Targets but if I select the storage targets below with the logical networks the the cluster goes crazy and appears to be mad. Storage, Nodes, and everything goes offline even thought I have NFS also attached to the cluster. How should this best be configured. What we notice that happens is when the server reboots it seems to log into the SAN correctly but according the the Dell SAN it is only logged into once controller. So only pulls both fault domains from a single controller. Please Advise. Devin
--_000_91FCC8D5CC5B4062B1ED58FBEB179FB1ifufrjbr_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 SGF2ZSB5b3UgZm91bmQgYW55IHNvbHV0aW9uIGZvciB0aGlzIHByb2JsZW0/DQoNCknigJltIHVz aW5nIGFuIEZyZWVOQVMgbWFjaGluZSB0byBzZXJ2ZXIgaVNDU0kgYnV0IEnigJl2ZSB0aGUgZXhh Y3RseSBzYW1lIHByb2JsZW0uIEnigJl2ZSByZWluc3RhbGxlZCBvVmlydCBhdCBsZWFzdCAzIHRp bWVzIGR1cmluZyB0aGUgd2Vla2VuZCB0cnlpbmcgdG8gc29sdmUgdGhlIGlzc3VlLg0KDQpBdCB0 aGlzIG1vbWVudCBteSBpU0NTSSBNdWx0aXBhdGggdGFiIGlzIGp1c3QgaW5jb25zaXRlbnQuIEkg Y2Fu4oCZdCBzZWUgYm90aCBWTEFO4oCZcyBvbiDigJxMb2dpY2FsIG5ldHdvcmtz4oCdIGJ1dCBv bmx5IG9uZSB0YXJnZXQgc2hvd3MgdXAgb24gU3RvcmFnZSBUYXJnZXRzLg0KDQpXaGVuIEkgd2Fz IGFibGUgdG8gZm91bmQgdHdvIHRhcmdldHMgZXZlcnl0aGluZyB3ZW50IGRvd24gYW5kIEkgbmVl ZGVkIHRvIHJlYm9vdCB0aGUgaG9zdCBhbmQgdGhlIEhvc3RlZCBFbmdpbmUgdG8gcmVnZW5lcmF0 ZSBvVmlydC4NCg0KVi4NCg0KT24gMTEgSnVsIDIwMTcsIGF0IDE5OjI5LCBEZXZpbiBBY29zdGEg PGRldmluQHBhYnN0YXRlbmNpby5jb208bWFpbHRvOmRldmluQHBhYnN0YXRlbmNpby5jb20+PiB3 cm90ZToNCg0KDQpJIGFtIHVzaW5nIHRoZSBsYXRlc3QgcmVsZWFzZSBvZiBvVklSVCA0LjEuMywg YW5kIEkgYW0gY29ubmVjdGluZyBhIERlbGwgQ29tcGVsZW50IFNBTiB0aGF0IGhhcyAyIGZhdWx0 IGRvbWFpbnMgZWFjaCBvbiBhIHNlcGFyYXRlIFZMQU4gdGhhdCBJIGhhdmUgYXR0YWNoZWQgdG8g b1ZJUlQuIEZyb20gd2hhdCBJIHVuZGVyc3RhbmQgSSBhbSBzdXBwb3NlIHRvIGdvIGludG8g4oCc aVNDU0kgTXVsdGlwYXRoaW5n4oCdIG9wdGlvbiBhbmQgYWRkIGEgQk9ORCBvZiB0aGUgaVNDU0kg aW50ZXJmYWNlcy4gSSBoYXZlIGRvbmUgdGhpcyBzZWxlY3RpbmcgdGhlIDIgbG9naWNhbCBuZXR3 b3JrcyB0b2dldGhlciBmb3IgaVNDU0kuIEkgbm90aWNlIHRoYXQgdGhlcmUgaXMgYW4gb3B0aW9u IGJlbG93IHRvIHNlbGVjdCBTdG9yYWdlIFRhcmdldHMgYnV0IGlmIEkgc2VsZWN0IHRoZSBzdG9y YWdlIHRhcmdldHMgYmVsb3cgd2l0aCB0aGUgbG9naWNhbCBuZXR3b3JrcyB0aGUgdGhlIGNsdXN0 ZXIgZ29lcyBjcmF6eSBhbmQgYXBwZWFycyB0byBiZSBtYWQuIFN0b3JhZ2UsIE5vZGVzLCBhbmQg ZXZlcnl0aGluZyBnb2VzIG9mZmxpbmUgZXZlbiB0aG91Z2h0IEkgaGF2ZSBORlMgYWxzbyBhdHRh Y2hlZCB0byB0aGUgY2x1c3Rlci4NCg0KSG93IHNob3VsZCB0aGlzIGJlc3QgYmUgY29uZmlndXJl ZC4gV2hhdCB3ZSBub3RpY2UgdGhhdCBoYXBwZW5zIGlzIHdoZW4gdGhlIHNlcnZlciByZWJvb3Rz IGl0IHNlZW1zIHRvIGxvZyBpbnRvIHRoZSBTQU4gY29ycmVjdGx5IGJ1dCBhY2NvcmRpbmcgdGhl IHRoZSBEZWxsIFNBTiBpdCBpcyBvbmx5IGxvZ2dlZCBpbnRvIG9uY2UgY29udHJvbGxlci4gU28g b25seSBwdWxscyBib3RoIGZhdWx0IGRvbWFpbnMgZnJvbSBhIHNpbmdsZSBjb250cm9sbGVyLg0K DQpQbGVhc2UgQWR2aXNlLg0KDQpEZXZpbg0KDQpfX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fXw0KVXNlcnMgbWFpbGluZyBsaXN0DQpVc2Vyc0BvdmlydC5vcmc8 bWFpbHRvOlVzZXJzQG92aXJ0Lm9yZz4NCmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvbWFpbG1hbi9s aXN0aW5mby91c2Vycw0KDQo= --_000_91FCC8D5CC5B4062B1ED58FBEB179FB1ifufrjbr_ Content-Type: text/html; charset="utf-8" Content-ID: <CA79DD2D1A791E4790CF2357407EA78A@if.ufrj.br> Content-Transfer-Encoding: base64 PGh0bWw+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIgY29udGVudD0i dGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjwvaGVhZD4NCjxib2R5IHN0eWxlPSJ3b3JkLXdy YXA6IGJyZWFrLXdvcmQ7IC13ZWJraXQtbmJzcC1tb2RlOiBzcGFjZTsgLXdlYmtpdC1saW5lLWJy ZWFrOiBhZnRlci13aGl0ZS1zcGFjZTsiIGNsYXNzPSIiPg0KSGF2ZSB5b3UgZm91bmQgYW55IHNv bHV0aW9uIGZvciB0aGlzIHByb2JsZW0/DQo8ZGl2IGNsYXNzPSIiPjxiciBjbGFzcz0iIj4NCjwv ZGl2Pg0KPGRpdiBjbGFzcz0iIj5J4oCZbSB1c2luZyBhbiBGcmVlTkFTIG1hY2hpbmUgdG8gc2Vy dmVyIGlTQ1NJIGJ1dCBJ4oCZdmUgdGhlIGV4YWN0bHkgc2FtZSBwcm9ibGVtLiBJ4oCZdmUgcmVp bnN0YWxsZWQgb1ZpcnQgYXQgbGVhc3QgMyB0aW1lcyBkdXJpbmcgdGhlIHdlZWtlbmQgdHJ5aW5n IHRvIHNvbHZlIHRoZSBpc3N1ZS48L2Rpdj4NCjxkaXYgY2xhc3M9IiI+PGJyIGNsYXNzPSIiPg0K PC9kaXY+DQo8ZGl2IGNsYXNzPSIiPkF0IHRoaXMgbW9tZW50IG15IGlTQ1NJIE11bHRpcGF0aCB0 YWIgaXMganVzdCBpbmNvbnNpdGVudC4gSSBjYW7igJl0IHNlZSBib3RoIFZMQU7igJlzIG9uIOKA nExvZ2ljYWwgbmV0d29ya3PigJ0gYnV0IG9ubHkgb25lIHRhcmdldCBzaG93cyB1cCBvbiBTdG9y YWdlIFRhcmdldHMuPC9kaXY+DQo8ZGl2IGNsYXNzPSIiPjxiciBjbGFzcz0iIj4NCjwvZGl2Pg0K PGRpdiBjbGFzcz0iIj5XaGVuIEkgd2FzIGFibGUgdG8gZm91bmQgdHdvIHRhcmdldHMgZXZlcnl0 aGluZyB3ZW50IGRvd24gYW5kIEkgbmVlZGVkIHRvIHJlYm9vdCB0aGUgaG9zdCBhbmQgdGhlIEhv c3RlZCBFbmdpbmUgdG8gcmVnZW5lcmF0ZSBvVmlydC48L2Rpdj4NCjxkaXYgY2xhc3M9IiI+PGJy IGNsYXNzPSIiPg0KPC9kaXY+DQo8ZGl2IGNsYXNzPSIiPlYuPC9kaXY+DQo8ZGl2IGNsYXNzPSIi PjxiciBjbGFzcz0iIj4NCjxkaXY+DQo8YmxvY2txdW90ZSB0eXBlPSJjaXRlIiBjbGFzcz0iIj4N CjxkaXYgY2xhc3M9IiI+T24gMTEgSnVsIDIwMTcsIGF0IDE5OjI5LCBEZXZpbiBBY29zdGEgJmx0 OzxhIGhyZWY9Im1haWx0bzpkZXZpbkBwYWJzdGF0ZW5jaW8uY29tIiBjbGFzcz0iIj5kZXZpbkBw YWJzdGF0ZW5jaW8uY29tPC9hPiZndDsgd3JvdGU6PC9kaXY+DQo8YnIgY2xhc3M9IkFwcGxlLWlu dGVyY2hhbmdlLW5ld2xpbmUiPg0KPGRpdiBjbGFzcz0iIj4NCjxkaXYgaWQ9ImJsb29wX2N1c3Rv bWZvbnQiIHN0eWxlPSJmb250LWZhbWlseTogSGVsdmV0aWNhLCBBcmlhbDsgZm9udC1zaXplOiAx M3B4OyBmb250LXN0eWxlOiBub3JtYWw7IGZvbnQtdmFyaWFudC1jYXBzOiBub3JtYWw7IGZvbnQt d2VpZ2h0OiBub3JtYWw7IGxldHRlci1zcGFjaW5nOiBub3JtYWw7IHRleHQtYWxpZ246IHN0YXJ0 OyB0ZXh0LWluZGVudDogMHB4OyB0ZXh0LXRyYW5zZm9ybTogbm9uZTsgd2hpdGUtc3BhY2U6IG5v cm1hbDsgd29yZC1zcGFjaW5nOiAwcHg7IC13ZWJraXQtdGV4dC1zdHJva2Utd2lkdGg6IDBweDsg bWFyZ2luOiAwcHg7IiBjbGFzcz0iIj4NCjxiciBjbGFzcz0iQXBwbGUtaW50ZXJjaGFuZ2UtbmV3 bGluZSI+DQpJIGFtIHVzaW5nIHRoZSBsYXRlc3QgcmVsZWFzZSBvZiBvVklSVCA0LjEuMywgYW5k IEkgYW0gY29ubmVjdGluZyBhIERlbGwgQ29tcGVsZW50IFNBTiB0aGF0IGhhcyAyIGZhdWx0IGRv bWFpbnMgZWFjaCBvbiBhIHNlcGFyYXRlIFZMQU4gdGhhdCBJIGhhdmUgYXR0YWNoZWQgdG8gb1ZJ UlQuIEZyb20gd2hhdCBJIHVuZGVyc3RhbmQgSSBhbSBzdXBwb3NlIHRvIGdvIGludG8g4oCcaVND U0kgTXVsdGlwYXRoaW5n4oCdIG9wdGlvbiBhbmQgYWRkIGEgQk9ORA0KIG9mIHRoZSBpU0NTSSBp bnRlcmZhY2VzLiBJIGhhdmUgZG9uZSB0aGlzIHNlbGVjdGluZyB0aGUgMiBsb2dpY2FsIG5ldHdv cmtzIHRvZ2V0aGVyIGZvciBpU0NTSS4gSSBub3RpY2UgdGhhdCB0aGVyZSBpcyBhbiBvcHRpb24g YmVsb3cgdG8gc2VsZWN0IFN0b3JhZ2UgVGFyZ2V0cyBidXQgaWYgSSBzZWxlY3QgdGhlIHN0b3Jh Z2UgdGFyZ2V0cyBiZWxvdyB3aXRoIHRoZSBsb2dpY2FsIG5ldHdvcmtzIHRoZSB0aGUgY2x1c3Rl ciBnb2VzIGNyYXp5IGFuZA0KIGFwcGVhcnMgdG8gYmUgbWFkLiBTdG9yYWdlLCBOb2RlcywgYW5k IGV2ZXJ5dGhpbmcgZ29lcyBvZmZsaW5lIGV2ZW4gdGhvdWdodCBJIGhhdmUgTkZTIGFsc28gYXR0 YWNoZWQgdG8gdGhlIGNsdXN0ZXIuPC9kaXY+DQo8ZGl2IGlkPSJibG9vcF9jdXN0b21mb250IiBz dHlsZT0iZm9udC1mYW1pbHk6IEhlbHZldGljYSwgQXJpYWw7IGZvbnQtc2l6ZTogMTNweDsgZm9u dC1zdHlsZTogbm9ybWFsOyBmb250LXZhcmlhbnQtY2Fwczogbm9ybWFsOyBmb250LXdlaWdodDog bm9ybWFsOyBsZXR0ZXItc3BhY2luZzogbm9ybWFsOyB0ZXh0LWFsaWduOiBzdGFydDsgdGV4dC1p bmRlbnQ6IDBweDsgdGV4dC10cmFuc2Zvcm06IG5vbmU7IHdoaXRlLXNwYWNlOiBub3JtYWw7IHdv cmQtc3BhY2luZzogMHB4OyAtd2Via2l0LXRleHQtc3Ryb2tlLXdpZHRoOiAwcHg7IG1hcmdpbjog MHB4OyIgY2xhc3M9IiI+DQo8YnIgY2xhc3M9IiI+DQo8L2Rpdj4NCjxkaXYgaWQ9ImJsb29wX2N1 c3RvbWZvbnQiIHN0eWxlPSJmb250LWZhbWlseTogSGVsdmV0aWNhLCBBcmlhbDsgZm9udC1zaXpl OiAxM3B4OyBmb250LXN0eWxlOiBub3JtYWw7IGZvbnQtdmFyaWFudC1jYXBzOiBub3JtYWw7IGZv bnQtd2VpZ2h0OiBub3JtYWw7IGxldHRlci1zcGFjaW5nOiBub3JtYWw7IHRleHQtYWxpZ246IHN0 YXJ0OyB0ZXh0LWluZGVudDogMHB4OyB0ZXh0LXRyYW5zZm9ybTogbm9uZTsgd2hpdGUtc3BhY2U6 IG5vcm1hbDsgd29yZC1zcGFjaW5nOiAwcHg7IC13ZWJraXQtdGV4dC1zdHJva2Utd2lkdGg6IDBw eDsgbWFyZ2luOiAwcHg7IiBjbGFzcz0iIj4NCkhvdyBzaG91bGQgdGhpcyBiZXN0IGJlIGNvbmZp Z3VyZWQuIFdoYXQgd2Ugbm90aWNlIHRoYXQgaGFwcGVucyBpcyB3aGVuIHRoZSBzZXJ2ZXIgcmVi b290cyBpdCBzZWVtcyB0byBsb2cgaW50byB0aGUgU0FOIGNvcnJlY3RseSBidXQgYWNjb3JkaW5n IHRoZSB0aGUgRGVsbCBTQU4gaXQgaXMgb25seSBsb2dnZWQgaW50byBvbmNlIGNvbnRyb2xsZXIu IFNvIG9ubHkgcHVsbHMgYm90aCBmYXVsdCBkb21haW5zIGZyb20gYSBzaW5nbGUgY29udHJvbGxl ci4mbmJzcDs8L2Rpdj4NCjxkaXYgaWQ9ImJsb29wX2N1c3RvbWZvbnQiIHN0eWxlPSJmb250LWZh bWlseTogSGVsdmV0aWNhLCBBcmlhbDsgZm9udC1zaXplOiAxM3B4OyBmb250LXN0eWxlOiBub3Jt YWw7IGZvbnQtdmFyaWFudC1jYXBzOiBub3JtYWw7IGZvbnQtd2VpZ2h0OiBub3JtYWw7IGxldHRl ci1zcGFjaW5nOiBub3JtYWw7IHRleHQtYWxpZ246IHN0YXJ0OyB0ZXh0LWluZGVudDogMHB4OyB0 ZXh0LXRyYW5zZm9ybTogbm9uZTsgd2hpdGUtc3BhY2U6IG5vcm1hbDsgd29yZC1zcGFjaW5nOiAw cHg7IC13ZWJraXQtdGV4dC1zdHJva2Utd2lkdGg6IDBweDsgbWFyZ2luOiAwcHg7IiBjbGFzcz0i Ij4NCjxiciBjbGFzcz0iIj4NCjwvZGl2Pg0KPGRpdiBpZD0iYmxvb3BfY3VzdG9tZm9udCIgc3R5 bGU9ImZvbnQtZmFtaWx5OiBIZWx2ZXRpY2EsIEFyaWFsOyBmb250LXNpemU6IDEzcHg7IGZvbnQt c3R5bGU6IG5vcm1hbDsgZm9udC12YXJpYW50LWNhcHM6IG5vcm1hbDsgZm9udC13ZWlnaHQ6IG5v cm1hbDsgbGV0dGVyLXNwYWNpbmc6IG5vcm1hbDsgdGV4dC1hbGlnbjogc3RhcnQ7IHRleHQtaW5k ZW50OiAwcHg7IHRleHQtdHJhbnNmb3JtOiBub25lOyB3aGl0ZS1zcGFjZTogbm9ybWFsOyB3b3Jk LXNwYWNpbmc6IDBweDsgLXdlYmtpdC10ZXh0LXN0cm9rZS13aWR0aDogMHB4OyBtYXJnaW46IDBw eDsiIGNsYXNzPSIiPg0KUGxlYXNlIEFkdmlzZS48L2Rpdj4NCjxkaXYgaWQ9ImJsb29wX2N1c3Rv bWZvbnQiIHN0eWxlPSJmb250LWZhbWlseTogSGVsdmV0aWNhLCBBcmlhbDsgZm9udC1zaXplOiAx M3B4OyBmb250LXN0eWxlOiBub3JtYWw7IGZvbnQtdmFyaWFudC1jYXBzOiBub3JtYWw7IGZvbnQt d2VpZ2h0OiBub3JtYWw7IGxldHRlci1zcGFjaW5nOiBub3JtYWw7IHRleHQtYWxpZ246IHN0YXJ0 OyB0ZXh0LWluZGVudDogMHB4OyB0ZXh0LXRyYW5zZm9ybTogbm9uZTsgd2hpdGUtc3BhY2U6IG5v cm1hbDsgd29yZC1zcGFjaW5nOiAwcHg7IC13ZWJraXQtdGV4dC1zdHJva2Utd2lkdGg6IDBweDsg bWFyZ2luOiAwcHg7IiBjbGFzcz0iIj4NCjxiciBjbGFzcz0iIj4NCjwvZGl2Pg0KPGRpdiBpZD0i Ymxvb3BfY3VzdG9tZm9udCIgc3R5bGU9ImZvbnQtZmFtaWx5OiBIZWx2ZXRpY2EsIEFyaWFsOyBm b250LXNpemU6IDEzcHg7IGZvbnQtc3R5bGU6IG5vcm1hbDsgZm9udC12YXJpYW50LWNhcHM6IG5v cm1hbDsgZm9udC13ZWlnaHQ6IG5vcm1hbDsgbGV0dGVyLXNwYWNpbmc6IG5vcm1hbDsgdGV4dC1h bGlnbjogc3RhcnQ7IHRleHQtaW5kZW50OiAwcHg7IHRleHQtdHJhbnNmb3JtOiBub25lOyB3aGl0 ZS1zcGFjZTogbm9ybWFsOyB3b3JkLXNwYWNpbmc6IDBweDsgLXdlYmtpdC10ZXh0LXN0cm9rZS13 aWR0aDogMHB4OyBtYXJnaW46IDBweDsiIGNsYXNzPSIiPg0KRGV2aW48L2Rpdj4NCjxiciBzdHls ZT0iZm9udC1mYW1pbHk6IEhlbHZldGljYSwgQXJpYWw7IGZvbnQtc2l6ZTogMTNweDsgZm9udC1z dHlsZTogbm9ybWFsOyBmb250LXZhcmlhbnQtY2Fwczogbm9ybWFsOyBmb250LXdlaWdodDogbm9y bWFsOyBsZXR0ZXItc3BhY2luZzogbm9ybWFsOyB0ZXh0LWFsaWduOiBzdGFydDsgdGV4dC1pbmRl bnQ6IDBweDsgdGV4dC10cmFuc2Zvcm06IG5vbmU7IHdoaXRlLXNwYWNlOiBub3JtYWw7IHdvcmQt c3BhY2luZzogMHB4OyAtd2Via2l0LXRleHQtc3Ryb2tlLXdpZHRoOiAwcHg7IiBjbGFzcz0iIj4N CjxkaXYgY2xhc3M9ImJsb29wX3NpZ24iIGlkPSJibG9vcF9zaWduXzE0OTk4MTE5Mzg3MzQzODQx MjgiIHN0eWxlPSJmb250LWZhbWlseTogSGVsdmV0aWNhLCBBcmlhbDsgZm9udC1zaXplOiAxM3B4 OyBmb250LXN0eWxlOiBub3JtYWw7IGZvbnQtdmFyaWFudC1jYXBzOiBub3JtYWw7IGZvbnQtd2Vp Z2h0OiBub3JtYWw7IGxldHRlci1zcGFjaW5nOiBub3JtYWw7IHRleHQtYWxpZ246IHN0YXJ0OyB0 ZXh0LWluZGVudDogMHB4OyB0ZXh0LXRyYW5zZm9ybTogbm9uZTsgd2hpdGUtc3BhY2U6IG5vcm1h bDsgd29yZC1zcGFjaW5nOiAwcHg7IC13ZWJraXQtdGV4dC1zdHJva2Utd2lkdGg6IDBweDsiPg0K PC9kaXY+DQo8c3BhbiBzdHlsZT0iZm9udC1mYW1pbHk6IEhlbHZldGljYSwgQXJpYWw7IGZvbnQt c2l6ZTogMTNweDsgZm9udC1zdHlsZTogbm9ybWFsOyBmb250LXZhcmlhbnQtY2Fwczogbm9ybWFs OyBmb250LXdlaWdodDogbm9ybWFsOyBsZXR0ZXItc3BhY2luZzogbm9ybWFsOyB0ZXh0LWFsaWdu OiBzdGFydDsgdGV4dC1pbmRlbnQ6IDBweDsgdGV4dC10cmFuc2Zvcm06IG5vbmU7IHdoaXRlLXNw YWNlOiBub3JtYWw7IHdvcmQtc3BhY2luZzogMHB4OyAtd2Via2l0LXRleHQtc3Ryb2tlLXdpZHRo OiAwcHg7IGZsb2F0OiBub25lOyBkaXNwbGF5OiBpbmxpbmUgIWltcG9ydGFudDsiIGNsYXNzPSIi Pl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fPC9zcGFuPjxi ciBzdHlsZT0iZm9udC1mYW1pbHk6IEhlbHZldGljYSwgQXJpYWw7IGZvbnQtc2l6ZTogMTNweDsg Zm9udC1zdHlsZTogbm9ybWFsOyBmb250LXZhcmlhbnQtY2Fwczogbm9ybWFsOyBmb250LXdlaWdo dDogbm9ybWFsOyBsZXR0ZXItc3BhY2luZzogbm9ybWFsOyB0ZXh0LWFsaWduOiBzdGFydDsgdGV4 dC1pbmRlbnQ6IDBweDsgdGV4dC10cmFuc2Zvcm06IG5vbmU7IHdoaXRlLXNwYWNlOiBub3JtYWw7 IHdvcmQtc3BhY2luZzogMHB4OyAtd2Via2l0LXRleHQtc3Ryb2tlLXdpZHRoOiAwcHg7IiBjbGFz cz0iIj4NCjxzcGFuIHN0eWxlPSJmb250LWZhbWlseTogSGVsdmV0aWNhLCBBcmlhbDsgZm9udC1z aXplOiAxM3B4OyBmb250LXN0eWxlOiBub3JtYWw7IGZvbnQtdmFyaWFudC1jYXBzOiBub3JtYWw7 IGZvbnQtd2VpZ2h0OiBub3JtYWw7IGxldHRlci1zcGFjaW5nOiBub3JtYWw7IHRleHQtYWxpZ246 IHN0YXJ0OyB0ZXh0LWluZGVudDogMHB4OyB0ZXh0LXRyYW5zZm9ybTogbm9uZTsgd2hpdGUtc3Bh Y2U6IG5vcm1hbDsgd29yZC1zcGFjaW5nOiAwcHg7IC13ZWJraXQtdGV4dC1zdHJva2Utd2lkdGg6 IDBweDsgZmxvYXQ6IG5vbmU7IGRpc3BsYXk6IGlubGluZSAhaW1wb3J0YW50OyIgY2xhc3M9IiI+ VXNlcnMNCiBtYWlsaW5nIGxpc3Q8L3NwYW4+PGJyIHN0eWxlPSJmb250LWZhbWlseTogSGVsdmV0 aWNhLCBBcmlhbDsgZm9udC1zaXplOiAxM3B4OyBmb250LXN0eWxlOiBub3JtYWw7IGZvbnQtdmFy aWFudC1jYXBzOiBub3JtYWw7IGZvbnQtd2VpZ2h0OiBub3JtYWw7IGxldHRlci1zcGFjaW5nOiBu b3JtYWw7IHRleHQtYWxpZ246IHN0YXJ0OyB0ZXh0LWluZGVudDogMHB4OyB0ZXh0LXRyYW5zZm9y bTogbm9uZTsgd2hpdGUtc3BhY2U6IG5vcm1hbDsgd29yZC1zcGFjaW5nOiAwcHg7IC13ZWJraXQt dGV4dC1zdHJva2Utd2lkdGg6IDBweDsiIGNsYXNzPSIiPg0KPGEgaHJlZj0ibWFpbHRvOlVzZXJz QG92aXJ0Lm9yZyIgc3R5bGU9ImZvbnQtZmFtaWx5OiBIZWx2ZXRpY2EsIEFyaWFsOyBmb250LXNp emU6IDEzcHg7IGZvbnQtc3R5bGU6IG5vcm1hbDsgZm9udC12YXJpYW50LWNhcHM6IG5vcm1hbDsg Zm9udC13ZWlnaHQ6IG5vcm1hbDsgbGV0dGVyLXNwYWNpbmc6IG5vcm1hbDsgb3JwaGFuczogYXV0 bzsgdGV4dC1hbGlnbjogc3RhcnQ7IHRleHQtaW5kZW50OiAwcHg7IHRleHQtdHJhbnNmb3JtOiBu b25lOyB3aGl0ZS1zcGFjZTogbm9ybWFsOyB3aWRvd3M6IGF1dG87IHdvcmQtc3BhY2luZzogMHB4 OyAtd2Via2l0LXRleHQtc2l6ZS1hZGp1c3Q6IGF1dG87IC13ZWJraXQtdGV4dC1zdHJva2Utd2lk dGg6IDBweDsiIGNsYXNzPSIiPlVzZXJzQG92aXJ0Lm9yZzwvYT48YnIgc3R5bGU9ImZvbnQtZmFt aWx5OiBIZWx2ZXRpY2EsIEFyaWFsOyBmb250LXNpemU6IDEzcHg7IGZvbnQtc3R5bGU6IG5vcm1h bDsgZm9udC12YXJpYW50LWNhcHM6IG5vcm1hbDsgZm9udC13ZWlnaHQ6IG5vcm1hbDsgbGV0dGVy LXNwYWNpbmc6IG5vcm1hbDsgdGV4dC1hbGlnbjogc3RhcnQ7IHRleHQtaW5kZW50OiAwcHg7IHRl eHQtdHJhbnNmb3JtOiBub25lOyB3aGl0ZS1zcGFjZTogbm9ybWFsOyB3b3JkLXNwYWNpbmc6IDBw eDsgLXdlYmtpdC10ZXh0LXN0cm9rZS13aWR0aDogMHB4OyIgY2xhc3M9IiI+DQo8YSBocmVmPSJo dHRwOi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMiIHN0eWxlPSJmb250 LWZhbWlseTogSGVsdmV0aWNhLCBBcmlhbDsgZm9udC1zaXplOiAxM3B4OyBmb250LXN0eWxlOiBu b3JtYWw7IGZvbnQtdmFyaWFudC1jYXBzOiBub3JtYWw7IGZvbnQtd2VpZ2h0OiBub3JtYWw7IGxl dHRlci1zcGFjaW5nOiBub3JtYWw7IG9ycGhhbnM6IGF1dG87IHRleHQtYWxpZ246IHN0YXJ0OyB0 ZXh0LWluZGVudDogMHB4OyB0ZXh0LXRyYW5zZm9ybTogbm9uZTsgd2hpdGUtc3BhY2U6IG5vcm1h bDsgd2lkb3dzOiBhdXRvOyB3b3JkLXNwYWNpbmc6IDBweDsgLXdlYmtpdC10ZXh0LXNpemUtYWRq dXN0OiBhdXRvOyAtd2Via2l0LXRleHQtc3Ryb2tlLXdpZHRoOiAwcHg7IiBjbGFzcz0iIj5odHRw Oi8vbGlzdHMub3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnM8L2E+PC9kaXY+DQo8L2Js b2NrcXVvdGU+DQo8L2Rpdj4NCjxiciBjbGFzcz0iIj4NCjwvZGl2Pg0KPC9ib2R5Pg0KPC9odG1s Pg0K --_000_91FCC8D5CC5B4062B1ED58FBEB179FB1ifufrjbr_--
V., I am still troubleshooting the issue, I haven’t found any resolution to my issue at this point yet. I need to figure out by this Friday otherwise I need to look at Xen or another solution. iSCSI and oVIRT seems problematic. -- Devin Acosta Red Hat Certified Architect, LinuxStack On July 16, 2017 at 11:53:59 PM, Vinícius Ferrão (ferrao@if.ufrj.br) wrote: Have you found any solution for this problem? I’m using an FreeNAS machine to server iSCSI but I’ve the exactly same problem. I’ve reinstalled oVirt at least 3 times during the weekend trying to solve the issue. At this moment my iSCSI Multipath tab is just inconsitent. I can’t see both VLAN’s on “Logical networks” but only one target shows up on Storage Targets. When I was able to found two targets everything went down and I needed to reboot the host and the Hosted Engine to regenerate oVirt. V. On 11 Jul 2017, at 19:29, Devin Acosta <devin@pabstatencio.com> wrote: I am using the latest release of oVIRT 4.1.3, and I am connecting a Dell Compelent SAN that has 2 fault domains each on a separate VLAN that I have attached to oVIRT. From what I understand I am suppose to go into “iSCSI Multipathing” option and add a BOND of the iSCSI interfaces. I have done this selecting the 2 logical networks together for iSCSI. I notice that there is an option below to select Storage Targets but if I select the storage targets below with the logical networks the the cluster goes crazy and appears to be mad. Storage, Nodes, and everything goes offline even thought I have NFS also attached to the cluster. How should this best be configured. What we notice that happens is when the server reboots it seems to log into the SAN correctly but according the the Dell SAN it is only logged into once controller. So only pulls both fault domains from a single controller. Please Advise. Devin _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi, Please make sure that the hosts can reach the iSCSI targets on your Dell storage using the NICs that are being used by the 2 networks dedicated for iSCSI. You can try check it using 'ping -I <int_name> <target_addr>'. Thanks, ELAD BEN AHARON SENIOR QUALITY ENGINEER Red Hat Israel Ltd. <https://www.redhat.com/> 34 Jerusalem Road, Building A, 1st floor Ra'anana, Israel 4350109 ebenahar@redhat.com T: +972-9-7692007/8272007 <https://red.ht/sig> TRIED. TESTED. TRUSTED. <https://redhat.com/trusted> On Mon, Jul 17, 2017 at 3:11 PM, Devin Acosta <devin@pabstatencio.com> wrote:
V.,
I am still troubleshooting the issue, I haven’t found any resolution to my issue at this point yet. I need to figure out by this Friday otherwise I need to look at Xen or another solution. iSCSI and oVIRT seems problematic.
--
Devin Acosta Red Hat Certified Architect, LinuxStack
On July 16, 2017 at 11:53:59 PM, Vinícius Ferrão (ferrao@if.ufrj.br) wrote:
Have you found any solution for this problem?
I’m using an FreeNAS machine to server iSCSI but I’ve the exactly same problem. I’ve reinstalled oVirt at least 3 times during the weekend trying to solve the issue.
At this moment my iSCSI Multipath tab is just inconsitent. I can’t see both VLAN’s on “Logical networks” but only one target shows up on Storage Targets.
When I was able to found two targets everything went down and I needed to reboot the host and the Hosted Engine to regenerate oVirt.
V.
On 11 Jul 2017, at 19:29, Devin Acosta <devin@pabstatencio.com> wrote:
I am using the latest release of oVIRT 4.1.3, and I am connecting a Dell Compelent SAN that has 2 fault domains each on a separate VLAN that I have attached to oVIRT. From what I understand I am suppose to go into “iSCSI Multipathing” option and add a BOND of the iSCSI interfaces. I have done this selecting the 2 logical networks together for iSCSI. I notice that there is an option below to select Storage Targets but if I select the storage targets below with the logical networks the the cluster goes crazy and appears to be mad. Storage, Nodes, and everything goes offline even thought I have NFS also attached to the cluster.
How should this best be configured. What we notice that happens is when the server reboots it seems to log into the SAN correctly but according the the Dell SAN it is only logged into once controller. So only pulls both fault domains from a single controller.
Please Advise.
Devin
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi, Am 17.07.2017 um 14:11 schrieb Devin Acosta:
I am still troubleshooting the issue, I haven’t found any resolution to my issue at this point yet. I need to figure out by this Friday otherwise I need to look at Xen or another solution. iSCSI and oVIRT seems problematic.
The configuration of iSCSI-Multipathing via OVirt didn't work for me either. IIRC the underlying problem in my case was that I use totally isolated networks for each path. Workaround: to make round robin work you have to enable it by editing "/etc/multipath.conf". Just add the 3 lines for the round robin setting (see comment in the file) and additionally add the "# VDSM PRIVATE" comment to keep vdsmd from overwriting your settings. My multipath.conf:
# VDSM REVISION 1.3 # VDSM PRIVATE
defaults { polling_interval 5 no_path_retry fail user_friendly_names no flush_on_last_del yes fast_io_fail_tmo 5 dev_loss_tmo 30 max_fds 4096 # 3 lines added manually for multipathing: path_selector "round-robin 0" path_grouping_policy multibus failback immediate }
# Remove devices entries when overrides section is available. devices { device { # These settings overrides built-in devices settings. It does not apply # to devices without built-in settings (these use the settings in the # "defaults" section), or to devices defined in the "devices" section. # Note: This is not available yet on Fedora 21. For more info see # https://bugzilla.redhat.com/1253799 all_devs yes no_path_retry fail } }
To enable the settings: systemctl restart multipathd See if it works: multipath -ll HTH, Uwe
Hi, just to avoid misunderstandings: the workaround I suggested means that I don't use OVirt's iSCSI-Bonding at all (because it let's my environment misbehave in the same way you described). cu, Uwe
Hello, I’ve skipped this message entirely yesterday. So this is per design? Because the best practices of iSCSI MPIO, as far as I know, recommends two completely separate paths. If this can’t be achieved with oVirt what’s the point of running MPIO? May we ask for a bug fix or a feature redesign on this? MPIO is part of my datacenter, and it was originally build for running XenServer, but I’m considering the move to oVirt. MPIO isn’t working right and this can be a great no-go for me... I’m willing to wait and hold my DC project if this can be fixed. Any answer from the redhat folks? Thanks, V.
On 18 Jul 2017, at 11:09, Uwe Laverenz <uwe@laverenz.de> wrote:
Hi,
Am 17.07.2017 um 14:11 schrieb Devin Acosta:
I am still troubleshooting the issue, I haven’t found any resolution to my issue at this point yet. I need to figure out by this Friday otherwise I need to look at Xen or another solution. iSCSI and oVIRT seems problematic.
The configuration of iSCSI-Multipathing via OVirt didn't work for me either. IIRC the underlying problem in my case was that I use totally isolated networks for each path.
Workaround: to make round robin work you have to enable it by editing "/etc/multipath.conf". Just add the 3 lines for the round robin setting (see comment in the file) and additionally add the "# VDSM PRIVATE" comment to keep vdsmd from overwriting your settings.
My multipath.conf:
# VDSM REVISION 1.3 # VDSM PRIVATE defaults { polling_interval 5 no_path_retry fail user_friendly_names no flush_on_last_del yes fast_io_fail_tmo 5 dev_loss_tmo 30 max_fds 4096 # 3 lines added manually for multipathing: path_selector "round-robin 0" path_grouping_policy multibus failback immediate } # Remove devices entries when overrides section is available. devices { device { # These settings overrides built-in devices settings. It does not apply # to devices without built-in settings (these use the settings in the # "defaults" section), or to devices defined in the "devices" section. # Note: This is not available yet on Fedora 21. For more info see # https://bugzilla.redhat.com/1253799 all_devs yes no_path_retry fail } }
To enable the settings:
systemctl restart multipathd
See if it works:
multipath -ll
HTH, Uwe _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
On Wed, Jul 19, 2017 at 9:13 PM, Vinícius Ferrão <ferrao@if.ufrj.br> wrote:
Hello,
I’ve skipped this message entirely yesterday. So this is per design? Because the best practices of iSCSI MPIO, as far as I know, recommends two completely separate paths. If this can’t be achieved with oVirt what’s the point of running MPIO?
With regular storage it is quite easy to achieve using 'iSCSI bonding'. I think the Dell storage is a bit different and requires some more investigation - or experience with it. Y.
May we ask for a bug fix or a feature redesign on this?
MPIO is part of my datacenter, and it was originally build for running XenServer, but I’m considering the move to oVirt. MPIO isn’t working right and this can be a great no-go for me...
I’m willing to wait and hold my DC project if this can be fixed.
Any answer from the redhat folks?
Thanks, V.
On 18 Jul 2017, at 11:09, Uwe Laverenz <uwe@laverenz.de> wrote:
Hi,
Am 17.07.2017 um 14:11 schrieb Devin Acosta:
I am still troubleshooting the issue, I haven’t found any resolution to my issue at this point yet. I need to figure out by this Friday otherwise I need to look at Xen or another solution. iSCSI and oVIRT seems problematic.
The configuration of iSCSI-Multipathing via OVirt didn't work for me either. IIRC the underlying problem in my case was that I use totally isolated networks for each path.
Workaround: to make round robin work you have to enable it by editing "/etc/multipath.conf". Just add the 3 lines for the round robin setting (see comment in the file) and additionally add the "# VDSM PRIVATE" comment to keep vdsmd from overwriting your settings.
My multipath.conf:
# VDSM REVISION 1.3 # VDSM PRIVATE defaults { polling_interval 5 no_path_retry fail user_friendly_names no flush_on_last_del yes fast_io_fail_tmo 5 dev_loss_tmo 30 max_fds 4096 # 3 lines added manually for multipathing: path_selector "round-robin 0" path_grouping_policy multibus failback immediate } # Remove devices entries when overrides section is available. devices { device { # These settings overrides built-in devices settings. It does not apply # to devices without built-in settings (these use the settings in the # "defaults" section), or to devices defined in the "devices" section. # Note: This is not available yet on Fedora 21. For more info see # https://bugzilla.redhat.com/1253799 all_devs yes no_path_retry fail } }
To enable the settings:
systemctl restart multipathd
See if it works:
multipath -ll
HTH, Uwe _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--_000_54FF808B215E441D986438DBDD9F32E8ifufrjbr_ Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 DQpPbiAyMSBKdWwgMjAxNywgYXQgMTU6MTIsIFlhbml2IEthdWwgPHlrYXVsQHJlZGhhdC5jb208 bWFpbHRvOnlrYXVsQHJlZGhhdC5jb20+PiB3cm90ZToNCg0KDQoNCk9uIFdlZCwgSnVsIDE5LCAy MDE3IGF0IDk6MTMgUE0sIFZpbsOtY2l1cyBGZXJyw6NvIDxmZXJyYW9AaWYudWZyai5icjxtYWls dG86ZmVycmFvQGlmLnVmcmouYnI+PiB3cm90ZToNCkhlbGxvLA0KDQpJ4oCZdmUgc2tpcHBlZCB0 aGlzIG1lc3NhZ2UgZW50aXJlbHkgeWVzdGVyZGF5LiBTbyB0aGlzIGlzIHBlciBkZXNpZ24/IEJl Y2F1c2UgdGhlIGJlc3QgcHJhY3RpY2VzIG9mIGlTQ1NJIE1QSU8sIGFzIGZhciBhcyBJIGtub3cs IHJlY29tbWVuZHMgdHdvIGNvbXBsZXRlbHkgc2VwYXJhdGUgcGF0aHMuIElmIHRoaXMgY2Fu4oCZ dCBiZSBhY2hpZXZlZCB3aXRoIG9WaXJ0IHdoYXTigJlzIHRoZSBwb2ludCBvZiBydW5uaW5nIE1Q SU8/DQoNCldpdGggcmVndWxhciBzdG9yYWdlIGl0IGlzIHF1aXRlIGVhc3kgdG8gYWNoaWV2ZSB1 c2luZyAnaVNDU0kgYm9uZGluZycuDQpJIHRoaW5rIHRoZSBEZWxsIHN0b3JhZ2UgaXMgYSBiaXQg ZGlmZmVyZW50IGFuZCByZXF1aXJlcyBzb21lIG1vcmUgaW52ZXN0aWdhdGlvbiAtIG9yIGV4cGVy aWVuY2Ugd2l0aCBpdC4NCiBZLg0KDQpZYW5pdiwgdGhhbmsgeW91IGZvciBhbnN3ZXJpbmcgdGhp cy4gSeKAmW0gcmVhbGx5IGhvcGluZyB0aGF0IGEgc29sdXRpb24gd291bGQgYmUgZm91bmQuDQoN CkFjdHVhbGx5IEnigJltIG5vdCBydW5uaW5nIGFueXRoaW5nIGZyb20gREVMTC4gTXkgc3RvcmFn ZSBzeXN0ZW0gaXMgRnJlZU5BUyB3aGljaCBpcyBwcmV0dHkgc3RhbmRhcmQgYW5kLCBhcyBmYXIg YXMgSSBrbm93LCBpU0NTSSBwcmFjdGljZXMgZGljdGF0ZXMgc2VncmVnYXRlIG5ldHdvcmtzIGZv ciBwcm9wZXIgd29ya2luZy4NCg0KQWxsIG90aGVyIG1ham9yIHZpcnR1YWxpemF0aW9uIHByb2R1 Y3RzIHN1cHBvcnRzIGlTQ1NJIHRoaXMgd2F5OiB2U3BoZXJlLCBYZW5TZXJ2ZXIgYW5kIEh5cGVy LVYuIFNvIEkgd2FzIHJlYWxseSBzdXJwcmlzZWQgdGhhdCBvVmlydCAoYW5kIGV2ZW4gUkhWLCBJ IHJlcXVlc3RlZCBhIHRyaWFsIHllc3RlcmRheSkgZG9lcyBub3QgaW1wbGVtZW50IElTQ1NJIHdp dGggdGhlIHdlbGwga25vdyBiZXN0IHByYWN0aWNlcy4NCg0KVGhlcmXigJlzIGEgcGljdHVyZSBv ZiB0aGUgYXJjaGl0ZWN0dXJlIHRoYXQgSSB0YWtlIGZyb20gR29vZ2xlIHdoZW4gc2VhcmNoaW5n IGZvciDigJ1tcGlvIGJlc3QgcHJhY3RpdmVz4oCdOiBodHRwczovL2ltYWdlLnNsaWRlc2hhcmVj ZG4uY29tLzIwMTAtMTItMDYtbWlkd2VzdC1yZWctdm11Zy0xMDEyMDYxMTA1MDYtcGhwYXBwMDEv OTUvbmV4dGdlbmVyYXRpb24tYmVzdC1wcmFjdGljZXMtZm9yLXZtd2FyZS1hbmQtc3RvcmFnZS0x NS03MjguanBnP2NiPTEyOTYzMDE2NDANCg0KQW5zIGFzIHlvdSBjYW4gc2VlIGl04oCZcyBzZWdy ZWdhdGVkIG5ldHdvcmtzIG9uIGEgbWFjaGluZSByZWFjaGluZyB0aGUgc2FtZSB0YXJnZXQuDQoN CkluIG15IGNhc2UsIG15IGRhdGFjZW50ZXIgaGFzIGZpdmUgSHlwZXJ2aXNvciBNYWNoaW5lcywg d2l0aCB0d28gTklDcyBkZWRpY2F0ZWQgZm9yIGlTQ1NJLiBCb3RoIE5JQ3MgY29ubmVjdCB0byBk aWZmZXJlbnQgY29udmVyZ2VkIGV0aGVybmV0IHN3aXRjaGVzIGFuZCB0aGUgaVN0b3JhZ2UgaXMg Y29ubmVjdGVkIHRoZSBzYW1lIHdheS4NCg0KU28gaXQgcmVhbGx5IGRvZXMgbm90IG1ha2Ugc2Vu c2UgdGhhdCBhIHRoZSBmaXJzdCBOSUMgY2FuIHJlYWNoIHRoZSBzZWNvbmQgTklDIHRhcmdldC4g SW4gYSBjYXNlIG9mIGEgc3dpdGNoIGZhaWx1cmUgdGhlIGNsdXN0ZXIgd2lsbCBnbyBkb3duIGFu eXdheSwgc28gd2hhdOKAmXMgdGhlIHBvaW50IG9mIHJ1bm5pbmcgTVBJTz8gUmlnaHQ/DQoNClRo YW5rcyBvbmNlIGFnYWluLA0KVi4NCg0KDQoNCk1heSB3ZSBhc2sgZm9yIGEgYnVnIGZpeCBvciBh IGZlYXR1cmUgcmVkZXNpZ24gb24gdGhpcz8NCg0KTVBJTyBpcyBwYXJ0IG9mIG15IGRhdGFjZW50 ZXIsIGFuZCBpdCB3YXMgb3JpZ2luYWxseSBidWlsZCBmb3IgcnVubmluZyBYZW5TZXJ2ZXIsIGJ1 dCBJ4oCZbSBjb25zaWRlcmluZyB0aGUgbW92ZSB0byBvVmlydC4gTVBJTyBpc27igJl0IHdvcmtp bmcgcmlnaHQgYW5kIHRoaXMgY2FuIGJlIGEgZ3JlYXQgbm8tZ28gZm9yIG1lLi4uDQoNCknigJlt IHdpbGxpbmcgdG8gd2FpdCBhbmQgaG9sZCBteSBEQyBwcm9qZWN0IGlmIHRoaXMgY2FuIGJlIGZp eGVkLg0KDQpBbnkgYW5zd2VyIGZyb20gdGhlIHJlZGhhdCBmb2xrcz8NCg0KVGhhbmtzLA0KVi4N Cg0KPiBPbiAxOCBKdWwgMjAxNywgYXQgMTE6MDksIFV3ZSBMYXZlcmVueiA8dXdlQGxhdmVyZW56 LmRlPG1haWx0bzp1d2VAbGF2ZXJlbnouZGU+PiB3cm90ZToNCj4NCj4gSGksDQo+DQo+DQo+IEFt IDE3LjA3LjIwMTcgdW0gMTQ6MTEgc2NocmllYiBEZXZpbiBBY29zdGE6DQo+DQo+PiBJIGFtIHN0 aWxsIHRyb3VibGVzaG9vdGluZyB0aGUgaXNzdWUsIEkgaGF2ZW7igJl0IGZvdW5kIGFueSByZXNv bHV0aW9uIHRvIG15IGlzc3VlIGF0IHRoaXMgcG9pbnQgeWV0LiBJIG5lZWQgdG8gZmlndXJlIG91 dCBieSB0aGlzIEZyaWRheSBvdGhlcndpc2UgSSBuZWVkIHRvIGxvb2sgYXQgWGVuIG9yIGFub3Ro ZXIgc29sdXRpb24uIGlTQ1NJIGFuZCBvVklSVCBzZWVtcyBwcm9ibGVtYXRpYy4NCj4NCj4gVGhl IGNvbmZpZ3VyYXRpb24gb2YgaVNDU0ktTXVsdGlwYXRoaW5nIHZpYSBPVmlydCBkaWRuJ3Qgd29y ayBmb3IgbWUgZWl0aGVyLiBJSVJDIHRoZSB1bmRlcmx5aW5nIHByb2JsZW0gaW4gbXkgY2FzZSB3 YXMgdGhhdCBJIHVzZSB0b3RhbGx5IGlzb2xhdGVkIG5ldHdvcmtzIGZvciBlYWNoIHBhdGguDQo+ DQo+IFdvcmthcm91bmQ6IHRvIG1ha2Ugcm91bmQgcm9iaW4gd29yayB5b3UgaGF2ZSB0byBlbmFi bGUgaXQgYnkgZWRpdGluZyAiL2V0Yy9tdWx0aXBhdGguY29uZiIuIEp1c3QgYWRkIHRoZSAzIGxp bmVzIGZvciB0aGUgcm91bmQgcm9iaW4gc2V0dGluZyAoc2VlIGNvbW1lbnQgaW4gdGhlIGZpbGUp IGFuZCBhZGRpdGlvbmFsbHkgYWRkIHRoZSAiIyBWRFNNIFBSSVZBVEUiIGNvbW1lbnQgdG8ga2Vl cCB2ZHNtZCBmcm9tIG92ZXJ3cml0aW5nIHlvdXIgc2V0dGluZ3MuDQo+DQo+IE15IG11bHRpcGF0 aC5jb25mOg0KPg0KPg0KPj4gIyBWRFNNIFJFVklTSU9OIDEuMw0KPj4gIyBWRFNNIFBSSVZBVEUN Cj4+IGRlZmF1bHRzIHsNCj4+ICAgIHBvbGxpbmdfaW50ZXJ2YWwgICAgICAgICAgICA1DQo+PiAg ICBub19wYXRoX3JldHJ5ICAgICAgICAgICAgICAgZmFpbA0KPj4gICAgdXNlcl9mcmllbmRseV9u YW1lcyAgICAgICAgIG5vDQo+PiAgICBmbHVzaF9vbl9sYXN0X2RlbCAgICAgICAgICAgeWVzDQo+ PiAgICBmYXN0X2lvX2ZhaWxfdG1vICAgICAgICAgICAgNQ0KPj4gICAgZGV2X2xvc3NfdG1vICAg ICAgICAgICAgICAgIDMwDQo+PiAgICBtYXhfZmRzICAgICAgICAgICAgICAgICAgICAgNDA5Ng0K Pj4gICAgIyAzIGxpbmVzIGFkZGVkIG1hbnVhbGx5IGZvciBtdWx0aXBhdGhpbmc6DQo+PiAgICBw YXRoX3NlbGVjdG9yICAgICAgICAgICAgICAgInJvdW5kLXJvYmluIDAiDQo+PiAgICBwYXRoX2dy b3VwaW5nX3BvbGljeSAgICAgICAgbXVsdGlidXMNCj4+ICAgIGZhaWxiYWNrICAgICAgICAgICAg ICAgICAgICBpbW1lZGlhdGUNCj4+IH0NCj4+ICMgUmVtb3ZlIGRldmljZXMgZW50cmllcyB3aGVu IG92ZXJyaWRlcyBzZWN0aW9uIGlzIGF2YWlsYWJsZS4NCj4+IGRldmljZXMgew0KPj4gICAgZGV2 aWNlIHsNCj4+ICAgICAgICAjIFRoZXNlIHNldHRpbmdzIG92ZXJyaWRlcyBidWlsdC1pbiBkZXZp Y2VzIHNldHRpbmdzLiBJdCBkb2VzIG5vdCBhcHBseQ0KPj4gICAgICAgICMgdG8gZGV2aWNlcyB3 aXRob3V0IGJ1aWx0LWluIHNldHRpbmdzICh0aGVzZSB1c2UgdGhlIHNldHRpbmdzIGluIHRoZQ0K Pj4gICAgICAgICMgImRlZmF1bHRzIiBzZWN0aW9uKSwgb3IgdG8gZGV2aWNlcyBkZWZpbmVkIGlu IHRoZSAiZGV2aWNlcyIgc2VjdGlvbi4NCj4+ICAgICAgICAjIE5vdGU6IFRoaXMgaXMgbm90IGF2 YWlsYWJsZSB5ZXQgb24gRmVkb3JhIDIxLiBGb3IgbW9yZSBpbmZvIHNlZQ0KPj4gICAgICAgICMg aHR0cHM6Ly9idWd6aWxsYS5yZWRoYXQuY29tLzEyNTM3OTkNCj4+ICAgICAgICBhbGxfZGV2cyAg ICAgICAgICAgICAgICB5ZXMNCj4+ICAgICAgICBub19wYXRoX3JldHJ5ICAgICAgICAgICBmYWls DQo+PiAgICB9DQo+PiB9DQo+DQo+DQo+DQo+IFRvIGVuYWJsZSB0aGUgc2V0dGluZ3M6DQo+DQo+ ICBzeXN0ZW1jdGwgcmVzdGFydCBtdWx0aXBhdGhkDQo+DQo+IFNlZSBpZiBpdCB3b3JrczoNCj4N Cj4gIG11bHRpcGF0aCAtbGwNCj4NCj4NCj4gSFRILA0KPiBVd2UNCj4gX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18NCj4gVXNlcnMgbWFpbGluZyBsaXN0DQo+ IFVzZXJzQG92aXJ0Lm9yZzxtYWlsdG86VXNlcnNAb3ZpcnQub3JnPg0KPiBodHRwOi8vbGlzdHMu b3ZpcnQub3JnL21haWxtYW4vbGlzdGluZm8vdXNlcnMNCg0KX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX18NClVzZXJzIG1haWxpbmcgbGlzdA0KVXNlcnNAb3Zp cnQub3JnPG1haWx0bzpVc2Vyc0BvdmlydC5vcmc+DQpodHRwOi8vbGlzdHMub3ZpcnQub3JnL21h aWxtYW4vbGlzdGluZm8vdXNlcnMNCg0KDQo= --_000_54FF808B215E441D986438DBDD9F32E8ifufrjbr_ Content-Type: text/html; charset="utf-8" Content-ID: <2FFF2CDB5B5C03498FD1AD9AC7BDB15B@if.ufrj.br> Content-Transfer-Encoding: base64 PGh0bWw+DQo8aGVhZD4NCjxtZXRhIGh0dHAtZXF1aXY9IkNvbnRlbnQtVHlwZSIgY29udGVudD0i dGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04Ij4NCjwvaGVhZD4NCjxib2R5IHN0eWxlPSJ3b3JkLXdy YXA6IGJyZWFrLXdvcmQ7IC13ZWJraXQtbmJzcC1tb2RlOiBzcGFjZTsgLXdlYmtpdC1saW5lLWJy ZWFrOiBhZnRlci13aGl0ZS1zcGFjZTsiIGNsYXNzPSIiPg0KPGRpdiBjbGFzcz0iIj48YnIgY2xh c3M9IiI+DQo8L2Rpdj4NCjxkaXY+DQo8YmxvY2txdW90ZSB0eXBlPSJjaXRlIiBjbGFzcz0iIj4N CjxkaXYgY2xhc3M9IiI+T24gMjEgSnVsIDIwMTcsIGF0IDE1OjEyLCBZYW5pdiBLYXVsICZsdDs8 YSBocmVmPSJtYWlsdG86eWthdWxAcmVkaGF0LmNvbSIgY2xhc3M9IiI+eWthdWxAcmVkaGF0LmNv bTwvYT4mZ3Q7IHdyb3RlOjwvZGl2Pg0KPGJyIGNsYXNzPSJBcHBsZS1pbnRlcmNoYW5nZS1uZXds aW5lIj4NCjxkaXYgY2xhc3M9IiI+DQo8ZGl2IGRpcj0ibHRyIiBjbGFzcz0iIj48YnIgY2xhc3M9 IiI+DQo8ZGl2IGNsYXNzPSJnbWFpbF9leHRyYSI+PGJyIGNsYXNzPSIiPg0KPGRpdiBjbGFzcz0i Z21haWxfcXVvdGUiPk9uIFdlZCwgSnVsIDE5LCAyMDE3IGF0IDk6MTMgUE0sIFZpbsOtY2l1cyBG ZXJyw6NvIDxzcGFuIGRpcj0ibHRyIiBjbGFzcz0iIj4NCiZsdDs8YSBocmVmPSJtYWlsdG86ZmVy cmFvQGlmLnVmcmouYnIiIHRhcmdldD0iX2JsYW5rIiBjbGFzcz0iIj5mZXJyYW9AaWYudWZyai5i cjwvYT4mZ3Q7PC9zcGFuPiB3cm90ZTo8YnIgY2xhc3M9IiI+DQo8YmxvY2txdW90ZSBjbGFzcz0i Z21haWxfcXVvdGUiIHN0eWxlPSJtYXJnaW46MCAwIDAgLjhleDtib3JkZXItbGVmdDoxcHggI2Nj YyBzb2xpZDtwYWRkaW5nLWxlZnQ6MWV4Ij4NCkhlbGxvLDxiciBjbGFzcz0iIj4NCjxiciBjbGFz cz0iIj4NCknigJl2ZSBza2lwcGVkIHRoaXMgbWVzc2FnZSBlbnRpcmVseSB5ZXN0ZXJkYXkuIFNv IHRoaXMgaXMgcGVyIGRlc2lnbj8gQmVjYXVzZSB0aGUgYmVzdCBwcmFjdGljZXMgb2YgaVNDU0kg TVBJTywgYXMgZmFyIGFzIEkga25vdywgcmVjb21tZW5kcyB0d28gY29tcGxldGVseSBzZXBhcmF0 ZSBwYXRocy4gSWYgdGhpcyBjYW7igJl0IGJlIGFjaGlldmVkIHdpdGggb1ZpcnQgd2hhdOKAmXMg dGhlIHBvaW50IG9mIHJ1bm5pbmcgTVBJTz88YnIgY2xhc3M9IiI+DQo8L2Jsb2NrcXVvdGU+DQo8 ZGl2IGNsYXNzPSIiPjxiciBjbGFzcz0iIj4NCjwvZGl2Pg0KPGRpdiBjbGFzcz0iIj5XaXRoIHJl Z3VsYXIgc3RvcmFnZSBpdCBpcyBxdWl0ZSBlYXN5IHRvIGFjaGlldmUgdXNpbmcgJ2lTQ1NJIGJv bmRpbmcnLjwvZGl2Pg0KPGRpdiBjbGFzcz0iIj5JIHRoaW5rIHRoZSBEZWxsIHN0b3JhZ2UgaXMg YSBiaXQgZGlmZmVyZW50IGFuZCByZXF1aXJlcyBzb21lIG1vcmUgaW52ZXN0aWdhdGlvbiAtIG9y IGV4cGVyaWVuY2Ugd2l0aCBpdC48L2Rpdj4NCjxkaXYgY2xhc3M9IiI+Jm5ic3A7WS48L2Rpdj4N CjwvZGl2Pg0KPC9kaXY+DQo8L2Rpdj4NCjwvZGl2Pg0KPC9ibG9ja3F1b3RlPg0KPGRpdj48YnIg Y2xhc3M9IiI+DQo8L2Rpdj4NCjxkaXY+WWFuaXYsIHRoYW5rIHlvdSBmb3IgYW5zd2VyaW5nIHRo aXMuIEnigJltIHJlYWxseSBob3BpbmcgdGhhdCBhIHNvbHV0aW9uIHdvdWxkIGJlIGZvdW5kLjwv ZGl2Pg0KPGRpdj48YnIgY2xhc3M9IiI+DQo8L2Rpdj4NCjxkaXY+QWN0dWFsbHkgSeKAmW0gbm90 IHJ1bm5pbmcgYW55dGhpbmcgZnJvbSBERUxMLiBNeSBzdG9yYWdlIHN5c3RlbSBpcyBGcmVlTkFT IHdoaWNoIGlzIHByZXR0eSBzdGFuZGFyZCBhbmQsIGFzIGZhciBhcyBJIGtub3csIGlTQ1NJIHBy YWN0aWNlcyBkaWN0YXRlcyBzZWdyZWdhdGUgbmV0d29ya3MgZm9yIHByb3BlciB3b3JraW5nLjwv ZGl2Pg0KPGRpdj48YnIgY2xhc3M9IiI+DQo8L2Rpdj4NCjxkaXY+QWxsIG90aGVyIG1ham9yIHZp cnR1YWxpemF0aW9uIHByb2R1Y3RzIHN1cHBvcnRzIGlTQ1NJIHRoaXMgd2F5OiB2U3BoZXJlLCBY ZW5TZXJ2ZXIgYW5kIEh5cGVyLVYuIFNvIEkgd2FzIHJlYWxseSBzdXJwcmlzZWQgdGhhdCBvVmly dCAoYW5kIGV2ZW4gUkhWLCBJIHJlcXVlc3RlZCBhIHRyaWFsIHllc3RlcmRheSkgZG9lcyBub3Qg aW1wbGVtZW50IElTQ1NJIHdpdGggdGhlIHdlbGwga25vdyBiZXN0IHByYWN0aWNlcy48L2Rpdj4N CjxkaXY+PGJyIGNsYXNzPSIiPg0KPC9kaXY+DQo8ZGl2PlRoZXJl4oCZcyBhIHBpY3R1cmUgb2Yg dGhlIGFyY2hpdGVjdHVyZSB0aGF0IEkgdGFrZSBmcm9tIEdvb2dsZSB3aGVuIHNlYXJjaGluZyBm b3Ig4oCdbXBpbyBiZXN0IHByYWN0aXZlc+KAnToNCjxhIGhyZWY9Imh0dHBzOi8vaW1hZ2Uuc2xp ZGVzaGFyZWNkbi5jb20vMjAxMC0xMi0wNi1taWR3ZXN0LXJlZy12bXVnLTEwMTIwNjExMDUwNi1w aHBhcHAwMS85NS9uZXh0Z2VuZXJhdGlvbi1iZXN0LXByYWN0aWNlcy1mb3Itdm13YXJlLWFuZC1z dG9yYWdlLTE1LTcyOC5qcGc/Y2I9MTI5NjMwMTY0MCIgY2xhc3M9IiI+DQpodHRwczovL2ltYWdl LnNsaWRlc2hhcmVjZG4uY29tLzIwMTAtMTItMDYtbWlkd2VzdC1yZWctdm11Zy0xMDEyMDYxMTA1 MDYtcGhwYXBwMDEvOTUvbmV4dGdlbmVyYXRpb24tYmVzdC1wcmFjdGljZXMtZm9yLXZtd2FyZS1h bmQtc3RvcmFnZS0xNS03MjguanBnP2NiPTEyOTYzMDE2NDA8L2E+PC9kaXY+DQo8ZGl2PjxiciBj bGFzcz0iIj4NCjwvZGl2Pg0KPGRpdj5BbnMgYXMgeW91IGNhbiBzZWUgaXTigJlzIHNlZ3JlZ2F0 ZWQgbmV0d29ya3Mgb24gYSBtYWNoaW5lIHJlYWNoaW5nIHRoZSBzYW1lIHRhcmdldC48L2Rpdj4N CjxkaXY+PGJyIGNsYXNzPSIiPg0KPC9kaXY+DQo8ZGl2PkluIG15IGNhc2UsIG15IGRhdGFjZW50 ZXIgaGFzIGZpdmUgSHlwZXJ2aXNvciBNYWNoaW5lcywgd2l0aCB0d28gTklDcyBkZWRpY2F0ZWQg Zm9yIGlTQ1NJLiBCb3RoIE5JQ3MgY29ubmVjdCB0byBkaWZmZXJlbnQgY29udmVyZ2VkIGV0aGVy bmV0IHN3aXRjaGVzIGFuZCB0aGUgaVN0b3JhZ2UgaXMgY29ubmVjdGVkIHRoZSBzYW1lIHdheS48 L2Rpdj4NCjxkaXY+PGJyIGNsYXNzPSIiPg0KPC9kaXY+DQo8ZGl2PlNvIGl0IHJlYWxseSBkb2Vz IG5vdCBtYWtlIHNlbnNlIHRoYXQgYSB0aGUgZmlyc3QgTklDIGNhbiByZWFjaCB0aGUgc2Vjb25k IE5JQyB0YXJnZXQuIEluIGEgY2FzZSBvZiBhIHN3aXRjaCBmYWlsdXJlIHRoZSBjbHVzdGVyIHdp bGwgZ28gZG93biBhbnl3YXksIHNvIHdoYXTigJlzIHRoZSBwb2ludCBvZiBydW5uaW5nIE1QSU8/ IFJpZ2h0PzwvZGl2Pg0KPGRpdj48YnIgY2xhc3M9IiI+DQo8L2Rpdj4NCjxkaXY+VGhhbmtzIG9u Y2UgYWdhaW4sPC9kaXY+DQo8ZGl2PlYuPC9kaXY+DQo8ZGl2PjxiciBjbGFzcz0iIj4NCjwvZGl2 Pg0KPGJsb2NrcXVvdGUgdHlwZT0iY2l0ZSIgY2xhc3M9IiI+DQo8ZGl2IGNsYXNzPSIiPg0KPGRp diBkaXI9Imx0ciIgY2xhc3M9IiI+DQo8ZGl2IGNsYXNzPSJnbWFpbF9leHRyYSI+DQo8ZGl2IGNs YXNzPSJnbWFpbF9xdW90ZSI+DQo8ZGl2IGNsYXNzPSIiPjxiciBjbGFzcz0iIj4NCjwvZGl2Pg0K PGJsb2NrcXVvdGUgY2xhc3M9ImdtYWlsX3F1b3RlIiBzdHlsZT0ibWFyZ2luOjAgMCAwIC44ZXg7 Ym9yZGVyLWxlZnQ6MXB4ICNjY2Mgc29saWQ7cGFkZGluZy1sZWZ0OjFleCI+DQo8YnIgY2xhc3M9 IiI+DQpNYXkgd2UgYXNrIGZvciBhIGJ1ZyBmaXggb3IgYSBmZWF0dXJlIHJlZGVzaWduIG9uIHRo aXM/PGJyIGNsYXNzPSIiPg0KPGJyIGNsYXNzPSIiPg0KTVBJTyBpcyBwYXJ0IG9mIG15IGRhdGFj ZW50ZXIsIGFuZCBpdCB3YXMgb3JpZ2luYWxseSBidWlsZCBmb3IgcnVubmluZyBYZW5TZXJ2ZXIs IGJ1dCBJ4oCZbSBjb25zaWRlcmluZyB0aGUgbW92ZSB0byBvVmlydC4gTVBJTyBpc27igJl0IHdv cmtpbmcgcmlnaHQgYW5kIHRoaXMgY2FuIGJlIGEgZ3JlYXQgbm8tZ28gZm9yIG1lLi4uPGJyIGNs YXNzPSIiPg0KPGJyIGNsYXNzPSIiPg0KSeKAmW0gd2lsbGluZyB0byB3YWl0IGFuZCBob2xkIG15 IERDIHByb2plY3QgaWYgdGhpcyBjYW4gYmUgZml4ZWQuPGJyIGNsYXNzPSIiPg0KPGJyIGNsYXNz PSIiPg0KQW55IGFuc3dlciBmcm9tIHRoZSByZWRoYXQgZm9sa3M/PGJyIGNsYXNzPSIiPg0KPGJy IGNsYXNzPSIiPg0KVGhhbmtzLDxiciBjbGFzcz0iIj4NClYuPGJyIGNsYXNzPSIiPg0KPGRpdiBj bGFzcz0iSE9FblpiIj4NCjxkaXYgY2xhc3M9Img1Ij48YnIgY2xhc3M9IiI+DQomZ3Q7IE9uIDE4 IEp1bCAyMDE3LCBhdCAxMTowOSwgVXdlIExhdmVyZW56ICZsdDs8YSBocmVmPSJtYWlsdG86dXdl QGxhdmVyZW56LmRlIiBjbGFzcz0iIj51d2VAbGF2ZXJlbnouZGU8L2E+Jmd0OyB3cm90ZTo8YnIg Y2xhc3M9IiI+DQomZ3Q7PGJyIGNsYXNzPSIiPg0KJmd0OyBIaSw8YnIgY2xhc3M9IiI+DQomZ3Q7 PGJyIGNsYXNzPSIiPg0KJmd0OzxiciBjbGFzcz0iIj4NCiZndDsgQW0gMTcuMDcuMjAxNyB1bSAx NDoxMSBzY2hyaWViIERldmluIEFjb3N0YTo8YnIgY2xhc3M9IiI+DQomZ3Q7PGJyIGNsYXNzPSIi Pg0KJmd0OyZndDsgSSBhbSBzdGlsbCB0cm91Ymxlc2hvb3RpbmcgdGhlIGlzc3VlLCBJIGhhdmVu 4oCZdCBmb3VuZCBhbnkgcmVzb2x1dGlvbiB0byBteSBpc3N1ZSBhdCB0aGlzIHBvaW50IHlldC4g SSBuZWVkIHRvIGZpZ3VyZSBvdXQgYnkgdGhpcyBGcmlkYXkgb3RoZXJ3aXNlIEkgbmVlZCB0byBs b29rIGF0IFhlbiBvciBhbm90aGVyIHNvbHV0aW9uLiBpU0NTSSBhbmQgb1ZJUlQgc2VlbXMgcHJv YmxlbWF0aWMuPGJyIGNsYXNzPSIiPg0KJmd0OzxiciBjbGFzcz0iIj4NCiZndDsgVGhlIGNvbmZp Z3VyYXRpb24gb2YgaVNDU0ktTXVsdGlwYXRoaW5nIHZpYSBPVmlydCBkaWRuJ3Qgd29yayBmb3Ig bWUgZWl0aGVyLiBJSVJDIHRoZSB1bmRlcmx5aW5nIHByb2JsZW0gaW4gbXkgY2FzZSB3YXMgdGhh dCBJIHVzZSB0b3RhbGx5IGlzb2xhdGVkIG5ldHdvcmtzIGZvciBlYWNoIHBhdGguPGJyIGNsYXNz PSIiPg0KJmd0OzxiciBjbGFzcz0iIj4NCiZndDsgV29ya2Fyb3VuZDogdG8gbWFrZSByb3VuZCBy b2JpbiB3b3JrIHlvdSBoYXZlIHRvIGVuYWJsZSBpdCBieSBlZGl0aW5nICZxdW90Oy9ldGMvbXVs dGlwYXRoLmNvbmYmcXVvdDsuIEp1c3QgYWRkIHRoZSAzIGxpbmVzIGZvciB0aGUgcm91bmQgcm9i aW4gc2V0dGluZyAoc2VlIGNvbW1lbnQgaW4gdGhlIGZpbGUpIGFuZCBhZGRpdGlvbmFsbHkgYWRk IHRoZSAmcXVvdDsjIFZEU00gUFJJVkFURSZxdW90OyBjb21tZW50IHRvIGtlZXAgdmRzbWQgZnJv bSBvdmVyd3JpdGluZyB5b3VyIHNldHRpbmdzLjxiciBjbGFzcz0iIj4NCiZndDs8YnIgY2xhc3M9 IiI+DQomZ3Q7IE15IG11bHRpcGF0aC5jb25mOjxiciBjbGFzcz0iIj4NCiZndDs8YnIgY2xhc3M9 IiI+DQomZ3Q7PGJyIGNsYXNzPSIiPg0KJmd0OyZndDsgIyBWRFNNIFJFVklTSU9OIDEuMzxiciBj bGFzcz0iIj4NCiZndDsmZ3Q7ICMgVkRTTSBQUklWQVRFPGJyIGNsYXNzPSIiPg0KJmd0OyZndDsg ZGVmYXVsdHMgezxiciBjbGFzcz0iIj4NCiZndDsmZ3Q7Jm5ic3A7ICZuYnNwOyBwb2xsaW5nX2lu dGVydmFsJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgNTxiciBjbGFz cz0iIj4NCiZndDsmZ3Q7Jm5ic3A7ICZuYnNwOyBub19wYXRoX3JldHJ5Jm5ic3A7ICZuYnNwOyAm bmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwO2ZhaWw8YnIgY2xhc3M9IiI+ DQomZ3Q7Jmd0OyZuYnNwOyAmbmJzcDsgdXNlcl9mcmllbmRseV9uYW1lcyZuYnNwOyAmbmJzcDsg Jm5ic3A7ICZuYnNwOyAmbmJzcDtubzxiciBjbGFzcz0iIj4NCiZndDsmZ3Q7Jm5ic3A7ICZuYnNw OyBmbHVzaF9vbl9sYXN0X2RlbCZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5i c3A7eWVzPGJyIGNsYXNzPSIiPg0KJmd0OyZndDsmbmJzcDsgJm5ic3A7IGZhc3RfaW9fZmFpbF90 bW8mbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyA1PGJyIGNsYXNzPSIi Pg0KJmd0OyZndDsmbmJzcDsgJm5ic3A7IGRldl9sb3NzX3RtbyZuYnNwOyAmbmJzcDsgJm5ic3A7 ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgMzA8YnIgY2xhc3M9IiI+DQomZ3Q7 Jmd0OyZuYnNwOyAmbmJzcDsgbWF4X2ZkcyZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJz cDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDs0MDk2PGJyIGNsYXNz PSIiPg0KJmd0OyZndDsmbmJzcDsgJm5ic3A7ICMgMyBsaW5lcyBhZGRlZCBtYW51YWxseSBmb3Ig bXVsdGlwYXRoaW5nOjxiciBjbGFzcz0iIj4NCiZndDsmZ3Q7Jm5ic3A7ICZuYnNwOyBwYXRoX3Nl bGVjdG9yJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZu YnNwOyZxdW90O3JvdW5kLXJvYmluIDAmcXVvdDs8YnIgY2xhc3M9IiI+DQomZ3Q7Jmd0OyZuYnNw OyAmbmJzcDsgcGF0aF9ncm91cGluZ19wb2xpY3kmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsg bXVsdGlidXM8YnIgY2xhc3M9IiI+DQomZ3Q7Jmd0OyZuYnNwOyAmbmJzcDsgZmFpbGJhY2smbmJz cDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNw OyAmbmJzcDsgaW1tZWRpYXRlPGJyIGNsYXNzPSIiPg0KJmd0OyZndDsgfTxiciBjbGFzcz0iIj4N CiZndDsmZ3Q7ICMgUmVtb3ZlIGRldmljZXMgZW50cmllcyB3aGVuIG92ZXJyaWRlcyBzZWN0aW9u IGlzIGF2YWlsYWJsZS48YnIgY2xhc3M9IiI+DQomZ3Q7Jmd0OyBkZXZpY2VzIHs8YnIgY2xhc3M9 IiI+DQomZ3Q7Jmd0OyZuYnNwOyAmbmJzcDsgZGV2aWNlIHs8YnIgY2xhc3M9IiI+DQomZ3Q7Jmd0 OyZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAjIFRoZXNlIHNldHRpbmdzIG92ZXJyaWRlcyBi dWlsdC1pbiBkZXZpY2VzIHNldHRpbmdzLiBJdCBkb2VzIG5vdCBhcHBseTxiciBjbGFzcz0iIj4N CiZndDsmZ3Q7Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICMgdG8gZGV2aWNlcyB3aXRob3V0 IGJ1aWx0LWluIHNldHRpbmdzICh0aGVzZSB1c2UgdGhlIHNldHRpbmdzIGluIHRoZTxiciBjbGFz cz0iIj4NCiZndDsmZ3Q7Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICMgJnF1b3Q7ZGVmYXVs dHMmcXVvdDsgc2VjdGlvbiksIG9yIHRvIGRldmljZXMgZGVmaW5lZCBpbiB0aGUgJnF1b3Q7ZGV2 aWNlcyZxdW90OyBzZWN0aW9uLjxiciBjbGFzcz0iIj4NCiZndDsmZ3Q7Jm5ic3A7ICZuYnNwOyAm bmJzcDsgJm5ic3A7ICMgTm90ZTogVGhpcyBpcyBub3QgYXZhaWxhYmxlIHlldCBvbiBGZWRvcmEg MjEuIEZvciBtb3JlIGluZm8gc2VlPGJyIGNsYXNzPSIiPg0KJmd0OyZndDsmbmJzcDsgJm5ic3A7 ICZuYnNwOyAmbmJzcDsgIyA8YSBocmVmPSJodHRwczovL2J1Z3ppbGxhLnJlZGhhdC5jb20vMTI1 Mzc5OSIgcmVsPSJub3JlZmVycmVyIiB0YXJnZXQ9Il9ibGFuayIgY2xhc3M9IiI+DQpodHRwczov L2J1Z3ppbGxhLnJlZGhhdC5jb20vPHdiciBjbGFzcz0iIj4xMjUzNzk5PC9hPjxiciBjbGFzcz0i Ij4NCiZndDsmZ3Q7Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7IGFsbF9kZXZzJm5ic3A7ICZu YnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyB5ZXM8YnIgY2xh c3M9IiI+DQomZ3Q7Jmd0OyZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyBub19wYXRoX3JldHJ5 Jm5ic3A7ICZuYnNwOyAmbmJzcDsgJm5ic3A7ICZuYnNwOyAmbmJzcDtmYWlsPGJyIGNsYXNzPSIi Pg0KJmd0OyZndDsmbmJzcDsgJm5ic3A7IH08YnIgY2xhc3M9IiI+DQomZ3Q7Jmd0OyB9PGJyIGNs YXNzPSIiPg0KJmd0OzxiciBjbGFzcz0iIj4NCiZndDs8YnIgY2xhc3M9IiI+DQomZ3Q7PGJyIGNs YXNzPSIiPg0KJmd0OyBUbyBlbmFibGUgdGhlIHNldHRpbmdzOjxiciBjbGFzcz0iIj4NCiZndDs8 YnIgY2xhc3M9IiI+DQomZ3Q7Jm5ic3A7IHN5c3RlbWN0bCByZXN0YXJ0IG11bHRpcGF0aGQ8YnIg Y2xhc3M9IiI+DQomZ3Q7PGJyIGNsYXNzPSIiPg0KJmd0OyBTZWUgaWYgaXQgd29ya3M6PGJyIGNs YXNzPSIiPg0KJmd0OzxiciBjbGFzcz0iIj4NCiZndDsmbmJzcDsgbXVsdGlwYXRoIC1sbDxiciBj bGFzcz0iIj4NCiZndDs8YnIgY2xhc3M9IiI+DQomZ3Q7PGJyIGNsYXNzPSIiPg0KJmd0OyBIVEgs PGJyIGNsYXNzPSIiPg0KJmd0OyBVd2U8YnIgY2xhc3M9IiI+DQomZ3Q7IF9fX19fX19fX19fX19f X19fX19fX19fX19fX19fXzx3YnIgY2xhc3M9IiI+X19fX19fX19fX19fX19fX188YnIgY2xhc3M9 IiI+DQomZ3Q7IFVzZXJzIG1haWxpbmcgbGlzdDxiciBjbGFzcz0iIj4NCiZndDsgPGEgaHJlZj0i bWFpbHRvOlVzZXJzQG92aXJ0Lm9yZyIgY2xhc3M9IiI+VXNlcnNAb3ZpcnQub3JnPC9hPjxiciBj bGFzcz0iIj4NCiZndDsgPGEgaHJlZj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xp c3RpbmZvL3VzZXJzIiByZWw9Im5vcmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIiBjbGFzcz0iIj4N Cmh0dHA6Ly9saXN0cy5vdmlydC5vcmcvPHdiciBjbGFzcz0iIj5tYWlsbWFuL2xpc3RpbmZvL3Vz ZXJzPC9hPjxiciBjbGFzcz0iIj4NCjxiciBjbGFzcz0iIj4NCl9fX19fX19fX19fX19fX19fX19f X19fX19fX19fXzx3YnIgY2xhc3M9IiI+X19fX19fX19fX19fX19fX188YnIgY2xhc3M9IiI+DQpV c2VycyBtYWlsaW5nIGxpc3Q8YnIgY2xhc3M9IiI+DQo8YSBocmVmPSJtYWlsdG86VXNlcnNAb3Zp cnQub3JnIiBjbGFzcz0iIj5Vc2Vyc0BvdmlydC5vcmc8L2E+PGJyIGNsYXNzPSIiPg0KPGEgaHJl Zj0iaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL3VzZXJzIiByZWw9Im5v cmVmZXJyZXIiIHRhcmdldD0iX2JsYW5rIiBjbGFzcz0iIj5odHRwOi8vbGlzdHMub3ZpcnQub3Jn Lzx3YnIgY2xhc3M9IiI+bWFpbG1hbi9saXN0aW5mby91c2VyczwvYT48YnIgY2xhc3M9IiI+DQo8 L2Rpdj4NCjwvZGl2Pg0KPC9ibG9ja3F1b3RlPg0KPC9kaXY+DQo8YnIgY2xhc3M9IiI+DQo8L2Rp dj4NCjwvZGl2Pg0KPC9kaXY+DQo8L2Jsb2NrcXVvdGU+DQo8L2Rpdj4NCjxiciBjbGFzcz0iIj4N CjwvYm9keT4NCjwvaHRtbD4NCg== --_000_54FF808B215E441D986438DBDD9F32E8ifufrjbr_--
This is a multi-part message in MIME format. --------------A485472F7B236F6466AB7AEC Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Hello, [Unusual setup] Last week, I eventually managed to make a 4.2.1.7 oVirt work with iscsi-multipathing on both hosts and guest, connected to a Dell Equallogic SAN which is providing one single virtual ip - my hosts have two dedicated NICS for iscsi, but on the same VLAN. Torture-tests showed good resilience. [Classical setup] But this year, we plan to create at least two additional DCs but to connect their hosts to a "classical" SAN, ie which provides TWO IPs on segregated VLANs (not routed), and we'd like to use the same iscsi-multipathing feature. The discussion below could lead to think that oVirt needs the two iscsi VLANs to be routed, allowing the hosts in one VLAN to access to resources in the other. As Vinicius explained, this is not a best practice to say the least. Searching through the mailing list archive, I found no answer to Vinicius' question. May a Redhat storage and/or network expert enlighten us on these points? Regards, -- Nicolas Ecarnot Le 21/07/2017 à 20:56, Vinícius Ferrão a écrit :
On 21 Jul 2017, at 15:12, Yaniv Kaul <ykaul@redhat.com <mailto:ykaul@redhat.com>> wrote:
On Wed, Jul 19, 2017 at 9:13 PM, Vinícius Ferrão <ferrao@if.ufrj.br <mailto:ferrao@if.ufrj.br>> wrote:
Hello,
I’ve skipped this message entirely yesterday. So this is per design? Because the best practices of iSCSI MPIO, as far as I know, recommends two completely separate paths. If this can’t be achieved with oVirt what’s the point of running MPIO?
With regular storage it is quite easy to achieve using 'iSCSI bonding'. I think the Dell storage is a bit different and requires some more investigation - or experience with it. Y.
Yaniv, thank you for answering this. I’m really hoping that a solution would be found.
Actually I’m not running anything from DELL. My storage system is FreeNAS which is pretty standard and, as far as I know, iSCSI practices dictates segregate networks for proper working.
All other major virtualization products supports iSCSI this way: vSphere, XenServer and Hyper-V. So I was really surprised that oVirt (and even RHV, I requested a trial yesterday) does not implement ISCSI with the well know best practices.
There’s a picture of the architecture that I take from Google when searching for ”mpio best practives”: https://image.slidesharecdn.com/2010-12-06-midwest-reg-vmug-101206110506-php...
Ans as you can see it’s segregated networks on a machine reaching the same target.
In my case, my datacenter has five Hypervisor Machines, with two NICs dedicated for iSCSI. Both NICs connect to different converged ethernet switches and the iStorage is connected the same way.
So it really does not make sense that a the first NIC can reach the second NIC target. In a case of a switch failure the cluster will go down anyway, so what’s the point of running MPIO? Right?
Thanks once again, V.
--------------A485472F7B236F6466AB7AEC Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> </head> <body text="#000000" bgcolor="#FFFFFF"> <div class="moz-cite-prefix">Hello,<br> <br> [<font color="#ff0000">Unusual setup</font>]<br> Last week, I eventually managed to make a 4.2.1.7 oVirt work with iscsi-multipathing on both hosts and guest, connected to a Dell Equallogic SAN which is providing one single virtual ip - my hosts have two dedicated NICS for iscsi, but <font color="#ff0000">on the same VLAN</font>. Torture-tests showed good resilience.<br> <br> [<font color="#009900">Classical setup</font>]<br> But this year, we plan to create at least two additional DCs but to connect their hosts to a "classical" SAN, ie which provides TWO IPs <font color="#009900">on segregated VLANs (not routed)</font>, and we'd like to use the same iscsi-multipathing feature.<br> <br> The discussion below could lead to think that oVirt needs the two iscsi VLANs to be routed, allowing the hosts in one VLAN to access to resources in the other.<br> As Vinicius explained, this is not a best practice to say the least.<br> <br> Searching through the mailing list archive, I found no answer to Vinicius' question.<br> <br> May a Redhat storage and/or network expert enlighten us on these points?<br> <br> Regards,<br> <br> -- <br> Nicolas Ecarnot<br> <br> Le 21/07/2017 à 20:56, Vinícius Ferrão a écrit :<br> </div> <blockquote type="cite" cite="mid:54FF808B-215E-441D-9864-38DBDD9F32E8@if.ufrj.br"> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> <div class=""><br class=""> </div> <div> <blockquote type="cite" class=""> <div class="">On 21 Jul 2017, at 15:12, Yaniv Kaul <<a href="mailto:ykaul@redhat.com" class="" moz-do-not-send="true">ykaul@redhat.com</a>> wrote:</div> <br class="Apple-interchange-newline"> <div class=""> <div dir="ltr" class=""><br class=""> <div class="gmail_extra"><br class=""> <div class="gmail_quote">On Wed, Jul 19, 2017 at 9:13 PM, Vinícius Ferrão <span dir="ltr" class=""> <<a href="mailto:ferrao@if.ufrj.br" target="_blank" class="" moz-do-not-send="true">ferrao@if.ufrj.br</a>></span> wrote:<br class=""> <blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"> Hello,<br class=""> <br class=""> I’ve skipped this message entirely yesterday. So this is per design? Because the best practices of iSCSI MPIO, as far as I know, recommends two completely separate paths. If this can’t be achieved with oVirt what’s the point of running MPIO?<br class=""> </blockquote> <div class=""><br class=""> </div> <div class="">With regular storage it is quite easy to achieve using 'iSCSI bonding'.</div> <div class="">I think the Dell storage is a bit different and requires some more investigation - or experience with it.</div> <div class=""> Y.</div> </div> </div> </div> </div> </blockquote> <div><br class=""> </div> <div>Yaniv, thank you for answering this. I’m really hoping that a solution would be found.</div> <div><br class=""> </div> <div>Actually I’m not running anything from DELL. My storage system is FreeNAS which is pretty standard and, as far as I know, iSCSI practices dictates segregate networks for proper working.</div> <div><br class=""> </div> <div>All other major virtualization products supports iSCSI this way: vSphere, XenServer and Hyper-V. So I was really surprised that oVirt (and even RHV, I requested a trial yesterday) does not implement ISCSI with the well know best practices.</div> <div><br class=""> </div> <div>There’s a picture of the architecture that I take from Google when searching for ”mpio best practives”: <a href="https://image.slidesharecdn.com/2010-12-06-midwest-reg-vmug-101206110506-php..." class="" moz-do-not-send="true"> https://image.slidesharecdn.com/2010-12-06-midwest-reg-vmug-101206110506-phpapp01/95/nextgeneration-best-practices-for-vmware-and-storage-15-728.jpg?cb=1296301640</a></div> <div><br class=""> </div> <div>Ans as you can see it’s segregated networks on a machine reaching the same target.</div> <div><br class=""> </div> <div>In my case, my datacenter has five Hypervisor Machines, with two NICs dedicated for iSCSI. Both NICs connect to different converged ethernet switches and the iStorage is connected the same way.</div> <div><br class=""> </div> <div>So it really does not make sense that a the first NIC can reach the second NIC target. In a case of a switch failure the cluster will go down anyway, so what’s the point of running MPIO? Right?</div> <div><br class=""> </div> <div>Thanks once again,</div> <div>V.</div> </div> </blockquote> </body> </html> --------------A485472F7B236F6466AB7AEC--
Hi, Nicolas. As long, as you are able to set up two separate iscsi sessions, which are bount to two separate paths - multipath driver will handle the rest. As I understand, Yaniv is talking about iscsi bonding, which is a bit more broad sort of multipath (per description - https://www.ovirt.org/documentation/admin-guide/chap-Storage/) - it creates all possible paths between all possible initiators and targets within bond. Personally, I don't think it's necessary - it's always better to control the connections the way you described - two vlans, each vlan contains one server NIC and one storage NIC, that's it. Sergei.
participants (7)
-
Devin Acosta -
Elad Ben Aharon -
Nicolas Ecarnot -
Sergei Hanus -
Uwe Laverenz -
Vinícius Ferrão -
Yaniv Kaul