<div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Tue, Mar 28, 2017 at 6:36 PM, Gianluca Cecchi <span dir="ltr"><<a href="mailto:gianluca.cecchi@gmail.com" target="_blank">gianluca.cecchi@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><div class="gmail_extra"><div class="gmail_quote"><span><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span class="gmail-m_2341196415375697156m_8123946383264997199gmail-"><br>
<br>
</span>Why not building the vlan configuration using oVirt?<br></blockquote><div><br></div></span><div>iSCSI to a DELL PS Series Storage array... no bonding in their minds.... ;-(</div><span><div> </div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">You can try to<br>
ifdown eth3.100 and eth4.100,<br>
configure the ovirtmgmt on top if the bond by ovirt<br>
and ifup eth3.100 and eth4.100 again.<br>
<br>
But that is ugly and you have to test if this works.<br>
</blockquote></span></div><br></div><div class="gmail_extra"><br></div><div class="gmail_extra"><div><br></div></div><div class="gmail_extra">I will see as soon as I will try to add an oVirt network using p1p1 and p1p2</div><div class="gmail_extra"><br></div><div class="gmail_extra"><br></div><div class="gmail_extra"><br></div></div>
</blockquote></div><br></div><div class="gmail_extra">So at the end no way to configure this, neither from web gui nor manually setting some parameter under the oVirt curtains.</div><div class="gmail_extra">Furthermore I discovered that for iSCSI oVirt creates its own interface configuration files (understandable), even if they are already in place (under the usual place /var/lib/iscsi/ifaces)</div><div class="gmail_extra"><br></div><div class="gmail_extra">I abandoned the idea to have both the bonds and the iSCSI setup on the same pair of interfaces.</div><div class="gmail_extra">In the mean time I found a way to have a "correct" (I hope) configuration for multipath iSCSI with Dell PS, all using the oVirt GUI.</div><div class="gmail_extra">Possibly a sort of bug but please don't fix if this is the case.... ;-)</div><div class="gmail_extra">I would like to share and get comments on it.</div><div class="gmail_extra"><br></div><div class="gmail_extra">This is also a sort of follow up to this February thread and other ones:</div><div class="gmail_extra"><a href="http://lists.ovirt.org/pipermail/users/2017-February/079349.html">http://lists.ovirt.org/pipermail/users/2017-February/079349.html</a></div><div class="gmail_extra"><br></div><div class="gmail_extra">The shared files posted by Yura are not available any more, so I don't know if my configuration matches with his one as detailed here:</div><div class="gmail_extra"><a href="http://lists.ovirt.org/pipermail/users/2017-February/079355.html">http://lists.ovirt.org/pipermail/users/2017-February/079355.html</a><br></div><div class="gmail_extra"><br></div><div class="gmail_extra">At the end I have this config:</div><div class="gmail_extra"><br></div><div class="gmail_extra">- Host network interfaces:</div><div class="gmail_extra"><a href="https://drive.google.com/file/d/0BwoPbcrMv8mvV1QxbnBaakstME0/view?usp=sharing">https://drive.google.com/file/d/0BwoPbcrMv8mvV1QxbnBaakstME0/view?usp=sharing</a><br></div><div class="gmail_extra"><br></div><div class="gmail_extra">- Setup Host netowrks page</div><div class="gmail_extra"><a href="https://drive.google.com/file/d/0BwoPbcrMv8mvWUpHTlBwWWJxeVE/view?usp=sharing">https://drive.google.com/file/d/0BwoPbcrMv8mvWUpHTlBwWWJxeVE/view?usp=sharing</a><br></div><div class="gmail_extra"><br></div><div class="gmail_extra">- iSCSI Multipathing under datacenter pane</div><div class="gmail_extra"><a href="https://drive.google.com/file/d/0BwoPbcrMv8mvQjgyR2lfcmFiQUU/view?usp=sharing">https://drive.google.com/file/d/0BwoPbcrMv8mvQjgyR2lfcmFiQUU/view?usp=sharing</a><br></div><div class="gmail_extra"><br></div><div class="gmail_extra">- iscsi1 network</div><div class="gmail_extra"><a href="https://drive.google.com/file/d/0BwoPbcrMv8mvYzlubnpWdFJIRlk/view?usp=sharing">https://drive.google.com/file/d/0BwoPbcrMv8mvYzlubnpWdFJIRlk/view?usp=sharing</a><br></div><div class="gmail_extra"><br></div><div class="gmail_extra">- iscsi2 network</div><div class="gmail_extra"><a href="https://drive.google.com/file/d/0BwoPbcrMv8mvQjdOSmxnSTFaSUU/view?usp=sharing">https://drive.google.com/file/d/0BwoPbcrMv8mvQjdOSmxnSTFaSUU/view?usp=sharing</a><br></div><div class="gmail_extra"><br></div><div class="gmail_extra">It seems oVirt doesn't check the "network subnet" where the adapter are on, but only the vlan id.</div><div class="gmail_extra"><br></div><div class="gmail_extra">The requirements are:</div><div class="gmail_extra">- your iSCSI network has to be on vlan (tipical configuration I think): say it is 100</div><div class="gmail_extra">- you configure the switch port of one network card (say p1p1) so that it has a tag 100</div><div class="gmail_extra">On oVirt Host OS you will have an iscsi1 network, with p1p1.100 interface configured by oVirt for iSCSI connection</div><div class="gmail_extra">- you configure the switch port of one network card (say p1p2) so that its native vlan is 100</div><div class="gmail_extra">If the packet is not tagged, it will actually transit on vlan 100.</div><div class="gmail_extra">On oVirt host OS you will have an iscsi2 network (not tagged), with p1p2 interface configured by oVirt for iSCSI connection</div><div class="gmail_extra"><br></div><div class="gmail_extra">With this workaround you initially create the iSCSI storage domain and it will do discovery with only one path (for example the tagged iscsi1 p1p1.100 path) to the unique ip portal (10.10.100.9 in my case).</div><div class="gmail_extra">Then you will go configuring the iSCSI multipathing using iscsi1 and iscsi2.</div><div class="gmail_extra"><br></div><div class="gmail_extra">My multipath custom configuration is found here:</div><div class="gmail_extra"><a href="http://lists.ovirt.org/pipermail/users/2017-March/080898.html">http://lists.ovirt.org/pipermail/users/2017-March/080898.html</a></div><div class="gmail_extra"><br></div><div class="gmail_extra">Ovirt already sets this in /etc/sysctl.d/vdsm.conf </div><div class="gmail_extra"><div class="gmail_extra">net.ipv4.conf.default.arp_ignore = 1</div><div class="gmail_extra">net.ipv4.conf.default.arp_announce = 2</div><div><br></div></div><div class="gmail_extra">I created the sysctl.d/50-iscsi.conf configuration like this:<br></div><div class="gmail_extra"><br></div><div class="gmail_extra"><div class="gmail_extra">net.ipv4.conf.p1p1/100.arp_announce=2</div><div class="gmail_extra"># p1p2 not on vlan, using /etc/sysctl.d/vdsm.conf configuration</div><div class="gmail_extra">#<br></div><div class="gmail_extra"><br></div><div class="gmail_extra">net.ipv4.conf.p1p1/100.arp_ignore=1</div><div class="gmail_extra"># p1p2 not on vlan, using /etc/sysctl.d/vdsm.conf configuration</div><div class="gmail_extra">#</div><div class="gmail_extra"><br></div><div class="gmail_extra">net.ipv4.conf.p1p1/100.rp_filter=2<br></div><div class="gmail_extra"># p1p2 not on vlan</div><div class="gmail_extra">net.ipv4.conf.p1p2.rp_filter=2<br></div><div class="gmail_extra">#</div><div class="gmail_extra"><br></div><div class="gmail_extra">At OS level, with host and storage domain up I have:</div><div class="gmail_extra"><br></div><div class="gmail_extra"><div class="gmail_extra">[root@ov300 ~]# iscsiadm -m node</div><div class="gmail_extra"><a href="http://10.10.100.9:3260">10.10.100.9:3260</a>,1 iqn.2001-05.com.equallogic:4-771816-e5d0dfb59-1c9b240297958d53-ovsd3910</div><div class="gmail_extra"><a href="http://10.10.100.9:3260">10.10.100.9:3260</a>,1 iqn.2001-05.com.equallogic:4-771816-e5d0dfb59-1c9b240297958d53-ovsd3910</div><div class="gmail_extra">[root@ov300 ~]# </div><div><br></div><div><div>[root@ov300 ~]# iscsiadm -m session</div><div>tcp: [4] <a href="http://10.10.100.9:3260">10.10.100.9:3260</a>,1 iqn.2001-05.com.equallogic:4-771816-e5d0dfb59-1c9b240297958d53-ovsd3910 (non-flash)</div><div>tcp: [5] <a href="http://10.10.100.9:3260">10.10.100.9:3260</a>,1 iqn.2001-05.com.equallogic:4-771816-e5d0dfb59-1c9b240297958d53-ovsd3910 (non-flash)</div><div>[root@ov300 ~]# </div></div><div><br></div><div><div>[root@ov300 ~]# iscsiadm -m session -P 1</div><div>Target: iqn.2001-05.com.equallogic:4-771816-e5d0dfb59-1c9b240297958d53-ovsd3910 (non-flash)</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Current Portal: <a href="http://10.10.100.41:3260">10.10.100.41:3260</a>,1</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Persistent Portal: <a href="http://10.10.100.9:3260">10.10.100.9:3260</a>,1</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>**********</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Interface:</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>**********</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Iface Name: p1p1.100</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Iface Transport: tcp</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Iface Initiatorname: iqn.1994-05.com.redhat:f2d7fc1e2fc</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Iface IPaddress: 10.10.100.87</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Iface HWaddress: <empty></div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Iface Netdev: p1p1.100</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>SID: 4</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>iSCSI Connection State: LOGGED IN</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>iSCSI Session State: LOGGED_IN</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Internal iscsid Session State: NO CHANGE</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Current Portal: <a href="http://10.10.100.42:3260">10.10.100.42:3260</a>,1</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Persistent Portal: <a href="http://10.10.100.9:3260">10.10.100.9:3260</a>,1</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>**********</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Interface:</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>**********</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Iface Name: p1p2</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Iface Transport: tcp</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Iface Initiatorname: iqn.1994-05.com.redhat:f2d7fc1e2fc</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Iface IPaddress: 10.10.100.88</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Iface HWaddress: <empty></div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Iface Netdev: p1p2</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>SID: 5</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>iSCSI Connection State: LOGGED IN</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>iSCSI Session State: LOGGED_IN</div><div><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>Internal iscsid Session State: NO CHANGE</div><div>[root@ov300 ~]# </div></div><div><br></div><div><div>[root@ov300 ~]# multipath -l</div><div>364817197b5dfd0e5538d959702249b1c dm-2 EQLOGIC ,100E-00 </div><div>size=1.0T features='0' hwhandler='0' wp=rw</div><div>`-+- policy='round-robin 0' prio=0 status=active</div><div> |- 12:0:0:0 sde 8:64 active undef running</div><div> `- 13:0:0:0 sdf 8:80 active undef running</div><div>[root@ov300 ~]# </div></div><div><br></div></div><div class="gmail_extra">I only got to have VM vlans on the 1Gbit bond, so I dediced, as this will be a test cluster, to create the live migration vlan 187 on only one of the 10Gbit/s interfaces and one other 162 vlan used for NFS on the other 10Gbit/s interface.</div><div class="gmail_extra"><br></div><div>Cheers,</div><div>Gianluca</div></div><div><br></div><div class="gmail_extra"><br></div><div class="gmail_extra"> <br></div></div>