From jvdwege at xs4all.nl Mon Sep 23 09:17:24 2013 Content-Type: multipart/mixed; boundary="===============3852210112892642314==" MIME-Version: 1.0 From: Joop To: users at ovirt.org Subject: Re: [Users] Multiple network interfaces on engine? Date: Mon, 23 Sep 2013 15:17:19 +0200 Message-ID: <52403F5F.2020603@xs4all.nl> In-Reply-To: 1466620074.186584.1379936476705.JavaMail.root@sanuksystems.com --===============3852210112892642314== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable This is a multi-part message in MIME format. --------------010701040300070806060900 Content-Type: text/plain; charset=3DUTF-8; format=3Dflowed Content-Transfer-Encoding: 8bit Rickard Kristiansson wrote: > OK. Maybe I'm asking for something irrelevant, but to answer Ren=C3=A9's = > question; The use case is that there are two separate physical = > networks for general IP and storage IP, and Engine seems to require to = > be able to reach the NFS server to validate the connection when = > configuring mapping. So to be able to configure a NFS server, the = > Engine needs to be connected also to the storage network. > It worked fine after manually tweaking the sysconfig/network-scripts, = > but this config was then shortly overridden by Engine discovering and = > trying to use the second NIC for bonding with ovirtmgmt. I have also more than one interface in my Engine but never had this = problem, I don't have a ovirtmgmt network on my Engine hosts thats not = needed. I can understand the need for the engine server to have a nic/ip = in the managment network AND a nic/ip in the storage network. I also = have a separate access/public network and ilo network. It looks like you have a bond defined somewhere and it looks like you = have vdsm running on your engine server. Just looking at my two engine servers and none has more than one ip. The = one in the test setup doesn't even have storage assigned and doesn't = need it. It sends mount commands to the hosts which DO have a separate = storage network. My engine hosts don't host the iso/export domains so = don't need to be in the storage network. If you have the possibility, go back to a bare machine with = NetworkManager turned off and network turned on. Make sure networking is = working as expected, eth0=3Dip in managment, eth1=3D ip in storage. = Install/setup ovirt-engine-setup, don't install vdsm (gets installed if = you do allinone!) and things should 'just' work. Regards, Joop --------------010701040300070806060900 Content-Type: text/html; charset=3DUTF-8 Content-Transfer-Encoding: 8bit Rickard Kristiansson wrote:
OK. Maybe I'm asking for something irrelevant, but to answer Ren=C3=A9's question; The use case is that there are two separate physical networks for general IP and storage IP, and Engine seems to require to be able to reach the NFS server to validate the connection when configuring mapping. So to be able to configure a NFS server, the Engine needs to be connected also to the storage network.
It worked fine after manually tweaking the sysconfig/network-scripts, but this config was then shortly overridden by Engine discovering and trying to use the second NIC for bonding with ovirtmgmt.
I have also more than one interface in my Engine but never had this problem, I don't have a ovirtmgmt network on my Engine hosts thats not needed. I can understand the need for the engine server to have a nic/ip in the managment network AND a nic/ip in the storage network. I also have a separate access/public network and ilo network.
It looks like you have a bond defined somewhere and it looks like you have vdsm running on your engine server.

Just looking at my two engine servers and none has more than one ip. The one in the test setup doesn't even have storage assigned and doesn't need it. It sends mount commands to the hosts which DO have a separate storage network. My engine hosts don't host the iso/export domains so don't need to be in the storage network.

If you have the possibility, go back to a bare machine with NetworkManager turned off and network turned on. Make sure networking is working as expected, eth0=3Dip in managment, eth1=3D ip in storage. Install/setup ovirt-engine-setup, don't install vdsm (gets installed if you do allinone!) and things should 'just' work.

Regards,

Joop

--------------010701040300070806060900-- --===============3852210112892642314== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" VGhpcyBpcyBhIG11bHRpLXBhcnQgbWVzc2FnZSBpbiBNSU1FIGZvcm1hdC4KLS0tLS0tLS0tLS0t LS0wMTA3MDEwNDAzMDAwNzA4MDYwNjA5MDAKQ29udGVudC1UeXBlOiB0ZXh0L3BsYWluOyBjaGFy c2V0PVVURi04OyBmb3JtYXQ9Zmxvd2VkCkNvbnRlbnQtVHJhbnNmZXItRW5jb2Rpbmc6IDhiaXQK ClJpY2thcmQgS3Jpc3RpYW5zc29uIHdyb3RlOgo+IE9LLiBNYXliZSBJJ20gYXNraW5nIGZvciBz b21ldGhpbmcgaXJyZWxldmFudCwgYnV0IHRvIGFuc3dlciBSZW7DqSdzIAo+IHF1ZXN0aW9uOyBU aGUgdXNlIGNhc2UgaXMgdGhhdCB0aGVyZSBhcmUgdHdvIHNlcGFyYXRlIHBoeXNpY2FsIAo+IG5l dHdvcmtzIGZvciBnZW5lcmFsIElQIGFuZCBzdG9yYWdlIElQLCBhbmQgRW5naW5lIHNlZW1zIHRv IHJlcXVpcmUgdG8gCj4gYmUgYWJsZSB0byByZWFjaCB0aGUgTkZTIHNlcnZlciB0byB2YWxpZGF0 ZSB0aGUgY29ubmVjdGlvbiB3aGVuIAo+IGNvbmZpZ3VyaW5nIG1hcHBpbmcuIFNvIHRvIGJlIGFi bGUgdG8gY29uZmlndXJlIGEgTkZTIHNlcnZlciwgdGhlIAo+IEVuZ2luZSBuZWVkcyB0byBiZSBj b25uZWN0ZWQgYWxzbyB0byB0aGUgc3RvcmFnZSBuZXR3b3JrLgo+IEl0IHdvcmtlZCBmaW5lIGFm dGVyIG1hbnVhbGx5IHR3ZWFraW5nIHRoZSBzeXNjb25maWcvbmV0d29yay1zY3JpcHRzLCAKPiBi dXQgdGhpcyBjb25maWcgd2FzIHRoZW4gc2hvcnRseSBvdmVycmlkZGVuIGJ5IEVuZ2luZSBkaXNj b3ZlcmluZyBhbmQgCj4gdHJ5aW5nIHRvIHVzZSB0aGUgc2Vjb25kIE5JQyBmb3IgYm9uZGluZyB3 aXRoIG92aXJ0bWdtdC4KSSBoYXZlIGFsc28gbW9yZSB0aGFuIG9uZSBpbnRlcmZhY2UgaW4gbXkg RW5naW5lIGJ1dCBuZXZlciBoYWQgdGhpcyAKcHJvYmxlbSwgSSBkb24ndCBoYXZlIGEgb3ZpcnRt Z210IG5ldHdvcmsgb24gbXkgRW5naW5lIGhvc3RzIHRoYXRzIG5vdCAKbmVlZGVkLiBJIGNhbiB1 bmRlcnN0YW5kIHRoZSBuZWVkIGZvciB0aGUgZW5naW5lIHNlcnZlciB0byBoYXZlIGEgbmljL2lw IAppbiB0aGUgbWFuYWdtZW50IG5ldHdvcmsgQU5EIGEgbmljL2lwIGluIHRoZSBzdG9yYWdlIG5l dHdvcmsuIEkgYWxzbyAKaGF2ZSBhIHNlcGFyYXRlIGFjY2Vzcy9wdWJsaWMgbmV0d29yayBhbmQg aWxvIG5ldHdvcmsuCkl0IGxvb2tzIGxpa2UgeW91IGhhdmUgYSBib25kIGRlZmluZWQgc29tZXdo ZXJlIGFuZCBpdCBsb29rcyBsaWtlIHlvdSAKaGF2ZSB2ZHNtIHJ1bm5pbmcgb24geW91ciBlbmdp bmUgc2VydmVyLgoKSnVzdCBsb29raW5nIGF0IG15IHR3byBlbmdpbmUgc2VydmVycyBhbmQgbm9u ZSBoYXMgbW9yZSB0aGFuIG9uZSBpcC4gVGhlIApvbmUgaW4gdGhlIHRlc3Qgc2V0dXAgZG9lc24n dCBldmVuIGhhdmUgc3RvcmFnZSBhc3NpZ25lZCBhbmQgZG9lc24ndCAKbmVlZCBpdC4gSXQgc2Vu ZHMgbW91bnQgY29tbWFuZHMgdG8gdGhlIGhvc3RzIHdoaWNoIERPIGhhdmUgYSBzZXBhcmF0ZSAK c3RvcmFnZSBuZXR3b3JrLiBNeSBlbmdpbmUgaG9zdHMgZG9uJ3QgaG9zdCB0aGUgaXNvL2V4cG9y dCBkb21haW5zIHNvIApkb24ndCBuZWVkIHRvIGJlIGluIHRoZSBzdG9yYWdlIG5ldHdvcmsuCgpJ ZiB5b3UgaGF2ZSB0aGUgcG9zc2liaWxpdHksIGdvIGJhY2sgdG8gYSBiYXJlIG1hY2hpbmUgd2l0 aCAKTmV0d29ya01hbmFnZXIgdHVybmVkIG9mZiBhbmQgbmV0d29yayB0dXJuZWQgb24uIE1ha2Ug c3VyZSBuZXR3b3JraW5nIGlzIAp3b3JraW5nIGFzIGV4cGVjdGVkLCBldGgwPWlwIGluIG1hbmFn bWVudCwgZXRoMT0gaXAgaW4gc3RvcmFnZS4gCkluc3RhbGwvc2V0dXAgb3ZpcnQtZW5naW5lLXNl dHVwLCBkb24ndCBpbnN0YWxsIHZkc20gKGdldHMgaW5zdGFsbGVkIGlmIAp5b3UgZG8gYWxsaW5v bmUhKSBhbmQgdGhpbmdzIHNob3VsZCAnanVzdCcgd29yay4KClJlZ2FyZHMsCgpKb29wCgoKLS0t LS0tLS0tLS0tLS0wMTA3MDEwNDAzMDAwNzA4MDYwNjA5MDAKQ29udGVudC1UeXBlOiB0ZXh0L2h0 bWw7IGNoYXJzZXQ9VVRGLTgKQ29udGVudC1UcmFuc2Zlci1FbmNvZGluZzogOGJpdAoKPCFET0NU WVBFIGh0bWwgUFVCTElDICItLy9XM0MvL0RURCBIVE1MIDQuMDEgVHJhbnNpdGlvbmFsLy9FTiI+ CjxodG1sPgo8aGVhZD4KICA8bWV0YSBjb250ZW50PSJ0ZXh0L2h0bWw7Y2hhcnNldD1VVEYtOCIg aHR0cC1lcXVpdj0iQ29udGVudC1UeXBlIj4KICA8dGl0bGU+PC90aXRsZT4KPC9oZWFkPgo8Ym9k eSBiZ2NvbG9yPSIjZmZmZmZmIiB0ZXh0PSIjMDAwMDAwIj4KUmlja2FyZCBLcmlzdGlhbnNzb24g d3JvdGU6CjxibG9ja3F1b3RlCiBjaXRlPSJtaWQ6MTQ2NjYyMDA3NC4xODY1ODQuMTM3OTkzNjQ3 NjcwNS5KYXZhTWFpbC5yb290QHNhbnVrc3lzdGVtcy5jb20iCiB0eXBlPSJjaXRlIj4KICA8ZGl2 CiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLEhlbHZldGljYSxzYW5zLXNlcmlmOyBmb250LXNp emU6IDEycHQ7IGNvbG9yOiByZ2IoMCwgMCwgMCk7Ij4KICA8ZGl2Pk9LLiBNYXliZSBJJ20gYXNr aW5nIGZvciBzb21ldGhpbmcgaXJyZWxldmFudCwgYnV0IHRvIGFuc3dlcgpSZW7DqSdzIHF1ZXN0 aW9uOyBUaGUgdXNlIGNhc2UgaXMgdGhhdCB0aGVyZSBhcmUgdHdvIHNlcGFyYXRlIHBoeXNpY2Fs Cm5ldHdvcmtzIGZvciBnZW5lcmFsIElQIGFuZCBzdG9yYWdlIElQLCBhbmQgRW5naW5lIHNlZW1z IHRvIHJlcXVpcmUgdG8KYmUgYWJsZSB0byByZWFjaCB0aGUgTkZTIHNlcnZlciB0byB2YWxpZGF0 ZSB0aGUgY29ubmVjdGlvbiB3aGVuCmNvbmZpZ3VyaW5nIG1hcHBpbmcuIFNvIHRvIGJlIGFibGUg dG8gY29uZmlndXJlIGEgTkZTIHNlcnZlciwgdGhlCkVuZ2luZSBuZWVkcyB0byBiZSBjb25uZWN0 ZWQgYWxzbyB0byB0aGUgc3RvcmFnZSBuZXR3b3JrLjxicj4KICA8L2Rpdj4KICA8ZGl2Pkl0IHdv cmtlZCBmaW5lIGFmdGVyIG1hbnVhbGx5IHR3ZWFraW5nIHRoZQpzeXNjb25maWcvbmV0d29yay1z Y3JpcHRzLCBidXQgdGhpcyBjb25maWcgd2FzIHRoZW4gc2hvcnRseSBvdmVycmlkZGVuCmJ5IEVu Z2luZSBkaXNjb3ZlcmluZyBhbmQgdHJ5aW5nIHRvIHVzZSB0aGUgc2Vjb25kIE5JQyBmb3IgYm9u ZGluZyB3aXRoCm92aXJ0bWdtdC4gPGJyPgogIDwvZGl2PgogIDwvZGl2Pgo8L2Jsb2NrcXVvdGU+ CkkgaGF2ZSBhbHNvIG1vcmUgdGhhbiBvbmUgaW50ZXJmYWNlIGluIG15IEVuZ2luZSBidXQgbmV2 ZXIgaGFkIHRoaXMKcHJvYmxlbSwgSSBkb24ndCBoYXZlIGEgb3ZpcnRtZ210IG5ldHdvcmsgb24g bXkgRW5naW5lIGhvc3RzIHRoYXRzIG5vdApuZWVkZWQuIEkgY2FuIHVuZGVyc3RhbmQgdGhlIG5l ZWQgZm9yIHRoZSBlbmdpbmUgc2VydmVyIHRvIGhhdmUgYQpuaWMvaXAgaW4gdGhlIG1hbmFnbWVu dCBuZXR3b3JrIEFORCBhIG5pYy9pcCBpbiB0aGUgc3RvcmFnZSBuZXR3b3JrLiBJCmFsc28gaGF2 ZSBhIHNlcGFyYXRlIGFjY2Vzcy9wdWJsaWMgbmV0d29yayBhbmQgaWxvIG5ldHdvcmsuPGJyPgpJ dCBsb29rcyBsaWtlIHlvdSBoYXZlIGEgYm9uZCBkZWZpbmVkIHNvbWV3aGVyZSBhbmQgaXQgbG9v a3MgbGlrZSB5b3UKaGF2ZSB2ZHNtIHJ1bm5pbmcgb24geW91ciBlbmdpbmUgc2VydmVyLjxicj4K PGJyPgpKdXN0IGxvb2tpbmcgYXQgbXkgdHdvIGVuZ2luZSBzZXJ2ZXJzIGFuZCBub25lIGhhcyBt b3JlIHRoYW4gb25lIGlwLgpUaGUgb25lIGluIHRoZSB0ZXN0IHNldHVwIGRvZXNuJ3QgZXZlbiBo YXZlIHN0b3JhZ2UgYXNzaWduZWQgYW5kCmRvZXNuJ3QgbmVlZCBpdC4gSXQgc2VuZHMgbW91bnQg Y29tbWFuZHMgdG8gdGhlIGhvc3RzIHdoaWNoIERPIGhhdmUgYQpzZXBhcmF0ZSBzdG9yYWdlIG5l dHdvcmsuIE15IGVuZ2luZSBob3N0cyBkb24ndCBob3N0IHRoZSBpc28vZXhwb3J0CmRvbWFpbnMg c28gZG9uJ3QgbmVlZCB0byBiZSBpbiB0aGUgc3RvcmFnZSBuZXR3b3JrLjxicj4KPGJyPgpJZiB5 b3UgaGF2ZSB0aGUgcG9zc2liaWxpdHksIGdvIGJhY2sgdG8gYSBiYXJlIG1hY2hpbmUgd2l0aApO ZXR3b3JrTWFuYWdlciB0dXJuZWQgb2ZmIGFuZCBuZXR3b3JrIHR1cm5lZCBvbi4gTWFrZSBzdXJl IG5ldHdvcmtpbmcKaXMgd29ya2luZyBhcyBleHBlY3RlZCwgZXRoMD1pcCBpbiBtYW5hZ21lbnQs IGV0aDE9IGlwIGluIHN0b3JhZ2UuCkluc3RhbGwvc2V0dXAgb3ZpcnQtZW5naW5lLXNldHVwLCBk b24ndCBpbnN0YWxsIHZkc20gKGdldHMgaW5zdGFsbGVkIGlmCnlvdSBkbyBhbGxpbm9uZSEpIGFu ZCB0aGluZ3Mgc2hvdWxkICdqdXN0JyB3b3JrLjxicj4KPGJyPgpSZWdhcmRzLDxicj4KPGJyPgpK b29wPGJyPgo8YnI+CjwvYm9keT4KPC9odG1sPgoKLS0tLS0tLS0tLS0tLS0wMTA3MDEwNDAzMDAw NzA4MDYwNjA5MDAtLQo= --===============3852210112892642314==--