<div dir="ltr"><div class="gmail_extra"><div class="gmail_quote">On Fri, Jan 13, 2017 at 12:10 AM, Nir Soffer <span dir="ltr">&lt;<a href="mailto:nsoffer@redhat.com" target="_blank">nsoffer@redhat.com</a>&gt;</span> wrote:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><span class="gmail-">On Thu, Jan 12, 2017 at 6:01 PM, Nicolas Ecarnot &lt;<a href="mailto:nicolas@ecarnot.net">nicolas@ecarnot.net</a>&gt; wrote:<br>
</span><span class="gmail-">&gt; Hi,<br>
&gt;<br>
&gt; As we are using a very similar hardware and usage as Mark (Dell poweredge<br>
&gt; hosts, Dell Equallogic SAN, iSCSI, and tons of LUNs for all those VMs), I&#39;m<br>
&gt; jumping into this thread.<br>
<br>
</span>Can you share your multipath.conf that works with Dell Equallogic SAN?<br><br></blockquote><div><br></div><div>I jump in to share what is my current config with EQL SAN and RH EL / CentOS (but not oVirt).<br></div><div>the examples below for a system connected with a PS6510ES.<br></div><div>Please note that it is to be considered as an element of discussion and to be then mixed and integrated with oVirt specific requirements (eg no friendly names).<br></div><div>Also, it is what I&#39;m using on RH EL 6.8 clusters configured with RHCS. Not tested yet any RH EL / CentOS 7.x system with EQL iSCSI<br><br> - /etc/multipath.conf<br><br>defaults {<br>        user_friendly_names yes<br>}<br><br>blacklist {<br>       wwid my_internal_disk_wwid<br>  <br>       device {<br>               vendor  &quot;iDRAC&quot;<br>               product &quot;*&quot;<br>       }<br>}<br><br>devices {<br>        device {<br>                vendor                  &quot;EQLOGIC&quot;<br>                product                 &quot;100E-00&quot;<br>                path_grouping_policy    multibus<br>                features &quot;1 queue_if_no_path&quot;<br>                path_checker directio<br>                failback immediate<br>                path_selector &quot;round-robin 0&quot;<br>                rr_min_io 512<br>                rr_weight priorities<br>        }<br>}<br><br><br>multipaths {<br>        multipath {<br>                wwid one_of_my_luns_wwid<br>                alias mympfriendlyname<br>        }<br><br>        ... other multipath sections for other luns<br><br>}<br><br></div></div><br></div><div class="gmail_extra">other important configurations:<br><br>- /etc/iscsi/iscsid.conf<br>other than chap config parameters<br><br>diff iscsid.conf iscsid.conf.orig<br>&lt; #node.session.timeo.replacement_timeout = 120<br>&lt; node.session.timeo.replacement_timeout = 15<br>---<br>&gt; node.session.timeo.replacement_timeout = 120<br>130,131c125<br>&lt; #node.session.err_timeo.lu_reset_timeout = 30<br>&lt; node.session.err_timeo.lu_reset_timeout = 20<br>---<br>&gt; node.session.err_timeo.lu_reset_timeout = 30<br>168,169c162<br>&lt; # node.session.initial_login_retry_max = 8<br>&lt; node.session.initial_login_retry_max = 12<br>---<br>&gt; node.session.initial_login_retry_max = 8<br>178,179c171<br>&lt; #node.session.cmds_max = 128<br>&lt; node.session.cmds_max = 1024<br>---<br>&gt; node.session.cmds_max = 128<br>183,184c175<br>&lt; #node.session.queue_depth = 32<br>&lt; node.session.queue_depth = 128<br>---<br>&gt; node.session.queue_depth = 32<br>310,311c301<br>&lt; #node.session.iscsi.FastAbort = Yes<br>&lt; node.session.iscsi.FastAbort = No<br>---<br>&gt; node.session.iscsi.FastAbort = Yes<br><br><br>- network adapters dedicated to iSCSI config files <br>they are 10Gb/s interfaces<br>(<br>lspci gives<br>05:00.0 Ethernet controller: Intel Corporation 82599 10 Gigabit Dual Port Backplane Connection (rev 01)<br>)<br>/etc/sysconfig/network-scripts/ifcfg-eth4<br>DEVICE=eth4<br>BOOTPROTO=static<br>HWADDR=XX:XX:XX:XX:XX:XX<br>ONBOOT=yes<br>IPADDR=10.10.100.227<br>NETMASK=255.255.255.0<br>TYPE=Ethernet<br>MTU=9000<br><br>similar for eth5 (ip is 10.10.100.227)<br><br>ifup eth4<br>ifup eth5<br><br>- /etc/sysctl.conf<br>net.ipv4.conf.eth4.arp_announce=2<br>net.ipv4.conf.eth4.arp_ignore=1<br>net.ipv4.conf.eth4.arp_filter=2<br>#<br>net.ipv4.conf.eth5.arp_announce=2<br>net.ipv4.conf.eth5.arp_ignore=1<br>net.ipv4.conf.eth5.arp_filter=2<br><br>to acquire modification:<br>sysctl -p<br><br>Verify ping to the portal (10.10.100.7) from both interfaces<br>ping -I eth4 10.10.100.7<br>ping -I eth5 10.10.100.7<br><br>to verify jumbo frame connections (if configured, as in my case):<br>ping 10.10.100.7 -M do -s 8792 -I eth4<br>ping 10.10.100.7 -M do -s 8792 -I eth5<br><br><br>- configuration of the iscsi interfaces<br>iscsiadm -m iface -I ieth4 --op=new<br>iscsiadm -m iface -I ieth5 --op=new<br>iscsiadm -m iface -I ieth4 --op=update -n iface.hwaddress -v XX:XX:XX:XX:XX:XX<br>iscsiadm -m iface -I ieth5 --op=update -n iface.hwaddress -v YY:YY:YY:YY:YY:YY<br><br><br>output of some commands with this config<br><br># iscsiadm -m session | grep mylun<br>tcp: [3] <a href="http://10.10.100.7:3260">10.10.100.7:3260</a>,1 iqn.2001-05.com.equallogic:0-xxxxxxxx-mylun (non-flash)<br>tcp: [4] <a href="http://10.10.100.7:3260">10.10.100.7:3260</a>,1 iqn.2001-05.com.equallogic:0-xxxxxxxx-mylun (non-flash)<br><br>with &quot;-P 1&quot; option<br><br>Target: iqn.2001-05.com.equallogic:0-xxxxxxxx-mylun (non-flash)<br>        Current Portal: <a href="http://10.10.100.38:3260">10.10.100.38:3260</a>,1<br>        Persistent Portal: <a href="http://10.10.100.7:3260">10.10.100.7:3260</a>,1<br>                **********<br>                Interface:<br>                **********<br>                Iface Name: ieth5<br>                Iface Transport: tcp<br>                Iface Initiatorname: iqn.1994-05.com.redhat:aea9b71a9aaf<br>                Iface IPaddress: 10.10.100.228<br>                Iface HWaddress: &lt;empty&gt;<br>                Iface Netdev: eth5<br>                SID: 3<br>                iSCSI Connection State: LOGGED IN<br>                iSCSI Session State: LOGGED_IN<br>                Internal iscsid Session State: NO CHANGE<br>        Current Portal: <a href="http://10.10.100.37:3260">10.10.100.37:3260</a>,1<br>        Persistent Portal: <a href="http://10.10.100.7:3260">10.10.100.7:3260</a>,1<br>                **********<br>                Interface:<br>                **********<br>                Iface Name: ieth4<br>                Iface Transport: tcp<br>                Iface Initiatorname: iqn.1994-05.com.redhat:aea9b71a9aaf<br>                Iface IPaddress: 10.10.100.227<br>                Iface HWaddress: &lt;empty&gt;<br>                Iface Netdev: eth4<br>                SID: 4<br>                iSCSI Connection State: LOGGED IN<br>                iSCSI Session State: LOGGED_IN<br>                Internal iscsid Session State: NO CHANGE<br><br># multipath -l mympfriendlyname<br>mympfriendlyname (one_of_my_luns_wwid) dm-6 EQLOGIC,100E-00<br>size=30G features=&#39;1 queue_if_no_path&#39; hwhandler=&#39;0&#39; wp=rw<br>`-+- policy=&#39;round-robin 0&#39; prio=0 status=active<br>  |- 12:0:0:0 sdf 8:80  active undef running<br>  `- 13:0:0:0 sdg 8:96  active undef running<br><br></div><div class="gmail_extra">HIH discussion,<br></div><div class="gmail_extra">Gianluca<br></div></div>