[Users] iSCSI multipath with EqualLogic SAN
Hi all, I'm testing ovirt 3.1 on centos boxes. I setup ovirt management node and 4 vdsm hosts. vdsm hosts have 2 nics on the SAN subnet. When i create a iscsi storage domain, it use only one of the two nics on the SAN network (showed with iscsiadm -m session on vdsm nodes). Does ovirt support multiples nics on the same subnet for iscsi SAN connection ? Have a nice day. Regards. Baptiste.
Le 21/02/2013 11:30, Baptiste AGASSE a écrit :
Hi all,
I'm testing ovirt 3.1 on centos boxes. I setup ovirt management node and 4 vdsm hosts. vdsm hosts have 2 nics on the SAN subnet. When i create a iscsi storage domain, it use only one of the two nics on the SAN network (showed with iscsiadm -m session on vdsm nodes). Does ovirt support multiples nics on the same subnet for iscsi SAN connection ?
I don't know if this is the best setup, but this is exaclty what I did (iSCSI with an Equllogic SAN) : I bonded 4 interfaces of the iSCSI subnet, and it's working fine so far... -- Nicolas Ecarnot
Hi Baptiste, usually a SAN doesn't support bonding (see post of Nicolas) of its interfaces, so you have to use multipathing technology. You have to separate all nics in different subnets so multipath can work. Command multipath -ll with show the connected paths. If you "merge" all paths in one subnet you will have the result/behavior you just posted. So this is less oVirt related, more network specific. We have a running iSCSI config with 4 networks and oVirt runs well. Maybe the following link will help you here: https://access.redhat.com/knowledge/docs/en-US/Red_Hat_Enterprise_Linux/6/pd... Cheers, Sven. -----Ursprüngliche Nachricht----- Von: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] Im Auftrag von Nicolas Ecarnot Gesendet: Donnerstag, 21. Februar 2013 15:48 An: users@ovirt.org Betreff: Re: [Users] iSCSI multipath with EqualLogic SAN Le 21/02/2013 11:30, Baptiste AGASSE a écrit :
Hi all,
I'm testing ovirt 3.1 on centos boxes. I setup ovirt management node and 4 vdsm hosts. vdsm hosts have 2 nics on the SAN subnet. When i create a iscsi storage domain, it use only one of the two nics on the SAN network (showed with iscsiadm -m session on vdsm nodes). Does ovirt support multiples nics on the same subnet for iscsi SAN connection ?
I don't know if this is the best setup, but this is exaclty what I did (iSCSI with an Equllogic SAN) : I bonded 4 interfaces of the iSCSI subnet, and it's working fine so far... -- Nicolas Ecarnot _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Ive discussed this at length with dell's EQ support team, and on a regular system that's connected in to an equallogic san, all the iscsi ports would be on the same subnet. The kicker is, dell really wants you to use their specialized driver/iscsiinitiator to access (known as their HIT kit...host integration tools), and the HIT kit handles establishing all the multiple sessions into the EQ SAN. Unfortunately, equallogic doesnt support RHEV (and thus ovirt), and ovirt does not seem to execute the commands the HIT driver would want to intitiate multiple connections. Dell says that the use of bonding for iscsi just begs for tcp retransmits. since bonding is the only method of failover I see for now, were using anyway against their recommendations (so far zero retransmits, but were not running our systems hard yet). Cheers, Jonathan -----Original Message----- From: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] On Behalf Of Sven Knohsalla Sent: Thursday, February 21, 2013 8:55 AM To: Baptiste AGASSE Cc: users@ovirt.org Subject: Re: [Users] iSCSI multipath with EqualLogic SAN Hi Baptiste, usually a SAN doesn't support bonding (see post of Nicolas) of its interfaces, so you have to use multipathing technology. You have to separate all nics in different subnets so multipath can work. Command multipath -ll with show the connected paths. If you "merge" all paths in one subnet you will have the result/behavior you just posted. So this is less oVirt related, more network specific. We have a running iSCSI config with 4 networks and oVirt runs well. Maybe the following link will help you here: https://access.redhat.com/knowledge/docs/en-US/Red_Hat_Enterprise_Linux/6/pd... Cheers, Sven. -----Ursprüngliche Nachricht----- Von: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] Im Auftrag von Nicolas Ecarnot Gesendet: Donnerstag, 21. Februar 2013 15:48 An: users@ovirt.org Betreff: Re: [Users] iSCSI multipath with EqualLogic SAN Le 21/02/2013 11:30, Baptiste AGASSE a écrit :
Hi all,
I'm testing ovirt 3.1 on centos boxes. I setup ovirt management node and 4 vdsm hosts. vdsm hosts have 2 nics on the SAN subnet. When i create a iscsi storage domain, it use only one of the two nics on the SAN network (showed with iscsiadm -m session on vdsm nodes). Does ovirt support multiples nics on the same subnet for iscsi SAN connection ?
I don't know if this is the best setup, but this is exaclty what I did (iSCSI with an Equllogic SAN) : I bonded 4 interfaces of the iSCSI subnet, and it's working fine so far... -- Nicolas Ecarnot _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users ________________________________ This is a PRIVATE message. If you are not the intended recipient, please delete without copying and kindly advise us by e-mail of the mistake in delivery. NOTE: Regardless of content, this e-mail shall not operate to bind SKOPOS to any order or other contract unless pursuant to explicit written agreement or government initiative expressly permitting the use of e-mail for such purpose.
We have 2 Equallogic PS4100s. And someone more knowledgeable may prove me wrong here but, Multipathd is not my most favorite thing to configure, but you can configure your nodes to use the other paths using the command line on the Centos nodes. Yeah Dell will tell you that they want you to use their software (like the mem plugin in Vmware) but the Linux OS will see the other paths and treat it like any other SAN, you are just going to have to configure them to use them. The link sent earlier in the thread is the official guide to doing that. https://access.redhat.com/knowledge/docs/en-US/Red_Hat_Enterprise_Linux/6/pd... Here is another Doc I used that is for Rhel5 but I beleive the multipath commands are the same: http://www.equallogic.com/WorkArea/downloadasset.aspx?id=8727 On Thu, Feb 21, 2013 at 1:09 PM, Jonathan Horne <jhorne@skopos.us> wrote:
Ive discussed this at length with dell's EQ support team, and on a regular system that's connected in to an equallogic san, all the iscsi ports would be on the same subnet. The kicker is, dell really wants you to use their specialized driver/iscsiinitiator to access (known as their HIT kit...host integration tools), and the HIT kit handles establishing all the multiple sessions into the EQ SAN.
Unfortunately, equallogic doesnt support RHEV (and thus ovirt), and ovirt does not seem to execute the commands the HIT driver would want to intitiate multiple connections.
Dell says that the use of bonding for iscsi just begs for tcp retransmits. since bonding is the only method of failover I see for now, were using anyway against their recommendations (so far zero retransmits, but were not running our systems hard yet).
Cheers, Jonathan
-----Original Message----- From: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] On Behalf Of Sven Knohsalla Sent: Thursday, February 21, 2013 8:55 AM To: Baptiste AGASSE Cc: users@ovirt.org Subject: Re: [Users] iSCSI multipath with EqualLogic SAN
Hi Baptiste,
usually a SAN doesn't support bonding (see post of Nicolas) of its interfaces, so you have to use multipathing technology.
You have to separate all nics in different subnets so multipath can work. Command multipath -ll with show the connected paths.
If you "merge" all paths in one subnet you will have the result/behavior you just posted.
So this is less oVirt related, more network specific. We have a running iSCSI config with 4 networks and oVirt runs well.
Maybe the following link will help you here:
https://access.redhat.com/knowledge/docs/en-US/Red_Hat_Enterprise_Linux/6/pd...
Cheers, Sven.
-----Ursprüngliche Nachricht----- Von: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] Im Auftrag von Nicolas Ecarnot Gesendet: Donnerstag, 21. Februar 2013 15:48 An: users@ovirt.org Betreff: Re: [Users] iSCSI multipath with EqualLogic SAN
Le 21/02/2013 11:30, Baptiste AGASSE a écrit :
Hi all,
I'm testing ovirt 3.1 on centos boxes. I setup ovirt management node and 4 vdsm hosts. vdsm hosts have 2 nics on the SAN subnet. When i create a iscsi storage domain, it use only one of the two nics on the SAN network (showed with iscsiadm -m session on vdsm nodes). Does ovirt support multiples nics on the same subnet for iscsi SAN connection ?
I don't know if this is the best setup, but this is exaclty what I did (iSCSI with an Equllogic SAN) : I bonded 4 interfaces of the iSCSI subnet, and it's working fine so far...
-- Nicolas Ecarnot _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
________________________________ This is a PRIVATE message. If you are not the intended recipient, please delete without copying and kindly advise us by e-mail of the mistake in delivery. NOTE: Regardless of content, this e-mail shall not operate to bind SKOPOS to any order or other contract unless pursuant to explicit written agreement or government initiative expressly permitting the use of e-mail for such purpose. _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
-- Chris Noffsinger
--_000_DC9ABD90CB55EC448B1F682D5731AF7407A6F0329FIAD2MBX17mex0_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Never heard of HIT before. Seems to be a proprietary Dell solution? Ok, I just high-lighted the classical /most common SAN connection :) We are using a Dell MD3220i (much smaller then EQ series) with MD1200 units= , and yes the network configuration for subnet separated multipathing seems= to be more complicated at first, but it will give you load-balancing and auto fail-over functionality. Of course a nice and quick alternative as suggested here "...but you can co= nfigure your nodes to use the other paths using the command line on the Cen= tos nodes...", is also possible. Cheers, Sven. Von: Chris Noffsinger [mailto:cnoffsin@gmail.com] Gesendet: Donnerstag, 21. Februar 2013 20:05 An: Jonathan Horne Cc: Sven Knohsalla; Baptiste AGASSE; users@ovirt.org Betreff: Re: [Users] iSCSI multipath with EqualLogic SAN We have 2 Equallogic PS4100s. And someone more knowledgeable may prove me = wrong here but, Multipathd is not my most favorite thing to configure, but you can configur= e your nodes to use the other paths using the command line on the Centos no= des. Yeah Dell will tell you that they want you to use their software (like the = mem plugin in Vmware) but the Linux OS will see the other paths and treat i= t like any other SAN, you are just going to have to configure them to use t= hem. The link sent earlier in the thread is the official guide to doing t= hat. https://access.redhat.com/knowledge/docs/en-US/Red_Hat_Enterprise_Linux/6/p= df/DM_Multipath/Red_Hat_Enterprise_Linux-6-DM_Multipath-en-US.pdf Here is another Doc I used that is for Rhel5 but I beleive the multipath co= mmands are the same: http://www.equallogic.com/WorkArea/downloadasset.aspx?id=3D8727 On Thu, Feb 21, 2013 at 1:09 PM, Jonathan Horne <jhorne@skopos.us<mailto:jh= orne@skopos.us>> wrote: Ive discussed this at length with dell's EQ support team, and on a regular = system that's connected in to an equallogic san, all the iscsi ports would = be on the same subnet. The kicker is, dell really wants you to use their s= pecialized driver/iscsiinitiator to access (known as their HIT kit...host i= ntegration tools), and the HIT kit handles establishing all the multiple se= ssions into the EQ SAN. Unfortunately, equallogic doesnt support RHEV (and thus ovirt), and ovirt = does not seem to execute the commands the HIT driver would want to intitiat= e multiple connections. Dell says that the use of bonding for iscsi just begs for tcp retransmits. = since bonding is the only method of failover I see for now, were using any= way against their recommendations (so far zero retransmits, but were not ru= nning our systems hard yet). Cheers, Jonathan -----Original Message----- From: users-bounces@ovirt.org<mailto:users-bounces@ovirt.org> [mailto:users= -bounces@ovirt.org<mailto:users-bounces@ovirt.org>] On Behalf Of Sven Knohs= alla Sent: Thursday, February 21, 2013 8:55 AM To: Baptiste AGASSE Cc: users@ovirt.org<mailto:users@ovirt.org> Subject: Re: [Users] iSCSI multipath with EqualLogic SAN Hi Baptiste, usually a SAN doesn't support bonding (see post of Nicolas) of its interfac= es, so you have to use multipathing technology. You have to separate all nics in different subnets so multipath can work. Command multipath -ll with show the connected paths. If you "merge" all paths in one subnet you will have the result/behavior yo= u just posted. So this is less oVirt related, more network specific. We have a running iSCSI config with 4 networks and oVirt runs well. Maybe the following link will help you here: https://access.redhat.com/knowledge/docs/en-US/Red_Hat_Enterprise_Linux/6/p= df/DM_Multipath/Red_Hat_Enterprise_Linux-6-DM_Multipath-en-US.pdf Cheers, Sven. -----Urspr=FCngliche Nachricht----- Von: users-bounces@ovirt.org<mailto:users-bounces@ovirt.org> [mailto:users-= bounces@ovirt.org<mailto:users-bounces@ovirt.org>] Im Auftrag von Nicolas E= carnot Gesendet: Donnerstag, 21. Februar 2013 15:48 An: users@ovirt.org<mailto:users@ovirt.org> Betreff: Re: [Users] iSCSI multipath with EqualLogic SAN Le 21/02/2013 11:30, Baptiste AGASSE a =E9crit :
Hi all,
I'm testing ovirt 3.1 on centos boxes. I setup ovirt management node and 4 vdsm hosts. vdsm hosts have 2 nics on the SAN subnet. When i create a iscsi storage domain, it use only one of the two nics on the SAN network (showed with iscsiadm -m session on vdsm nodes). Does ovirt support multiples nics on the same subnet for iscsi SAN connection ?
Of course a nice and quick alternative as suggested here “…but= you can configure your nodes to use the other paths using the command line= on the Centos nodes…”,<o:p></o:p></span></p><p class=3DMsoNorm= al><span style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color= :#1F497D'>is also possible.<o:p></o:p></span></p><p class=3DMsoNormal><span=
<o:p> </o:p></p></div><p class=3DMsoNormal>Multipathd is not my most = favorite thing to configure, but you can configure your nodes to use the ot= her paths using the command line on the Centos nodes.<o:p></o:p></p><div><p= class=3DMsoNormal><o:p> </o:p></p></div><div><p class=3DMsoNormal>Yea= h Dell will tell you that they want you to use their software (like the mem=
<br>Subject: Re: [Users] iSCSI multipath with EqualLogic SAN<br><br>Hi Bap= tiste,<br><br>usually a SAN doesn't support bonding (see post of Nicolas) o= f its interfaces, so you have to use multipathing technology.<br><br>You ha= ve to separate all nics in different subnets so multipath can work.<br>Comm= and multipath -ll with show the connected paths.<br><br>If you "merge&= quot; all paths in one subnet you will have the result/behavior you just po= sted.<br><br>So this is less oVirt related, more network specific.<br>We ha= ve a running iSCSI config with 4 networks and oVirt runs well.<br><br>Maybe=
I don't know if this is the best setup, but this is exaclty what I did (iSC= SI with an Equllogic SAN) : I bonded 4 interfaces of the iSCSI subnet, and = it's working fine so far... -- Nicolas Ecarnot _______________________________________________ Users mailing list Users@ovirt.org<mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users _______________________________________________ Users mailing list Users@ovirt.org<mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users ________________________________ This is a PRIVATE message. If you are not the intended recipient, please de= lete without copying and kindly advise us by e-mail of the mistake in deliv= ery. NOTE: Regardless of content, this e-mail shall not operate to bind SKO= POS to any order or other contract unless pursuant to explicit written agre= ement or government initiative expressly permitting the use of e-mail for s= uch purpose. _______________________________________________ Users mailing list Users@ovirt.org<mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users -- Chris Noffsinger --_000_DC9ABD90CB55EC448B1F682D5731AF7407A6F0329FIAD2MBX17mex0_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable <html xmlns:v=3D"urn:schemas-microsoft-com:vml" xmlns:o=3D"urn:schemas-micr= osoft-com:office:office" xmlns:w=3D"urn:schemas-microsoft-com:office:word" = xmlns:m=3D"http://schemas.microsoft.com/office/2004/12/omml" xmlns=3D"http:= //www.w3.org/TR/REC-html40"><head><meta http-equiv=3DContent-Type content= =3D"text/html; charset=3Diso-8859-1"><meta name=3DGenerator content=3D"Micr= osoft Word 14 (filtered medium)"><style><!-- /* Font Definitions */ @font-face {font-family:Calibri; panose-1:2 15 5 2 2 2 4 3 2 4;} @font-face {font-family:Tahoma; panose-1:2 11 6 4 3 5 4 4 2 4;} /* Style Definitions */ p.MsoNormal, li.MsoNormal, div.MsoNormal {margin:0cm; margin-bottom:.0001pt; font-size:12.0pt; font-family:"Times New Roman","serif";} a:link, span.MsoHyperlink {mso-style-priority:99; color:blue; text-decoration:underline;} a:visited, span.MsoHyperlinkFollowed {mso-style-priority:99; color:purple; text-decoration:underline;} p.MsoAcetate, li.MsoAcetate, div.MsoAcetate {mso-style-priority:99; mso-style-link:"Sprechblasentext Zchn"; margin:0cm; margin-bottom:.0001pt; font-size:8.0pt; font-family:"Tahoma","sans-serif";} span.SprechblasentextZchn {mso-style-name:"Sprechblasentext Zchn"; mso-style-priority:99; mso-style-link:Sprechblasentext; font-family:"Tahoma","sans-serif";} span.E-MailFormatvorlage19 {mso-style-type:personal-reply; font-family:"Calibri","sans-serif"; color:#1F497D;} .MsoChpDefault {mso-style-type:export-only; font-family:"Calibri","sans-serif";} @page WordSection1 {size:612.0pt 792.0pt; margin:70.85pt 70.85pt 2.0cm 70.85pt;} div.WordSection1 {page:WordSection1;} --></style><!--[if gte mso 9]><xml> <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" /> </xml><![endif]--><!--[if gte mso 9]><xml> <o:shapelayout v:ext=3D"edit"> <o:idmap v:ext=3D"edit" data=3D"1" /> </o:shapelayout></xml><![endif]--></head><body lang=3DEN-US link=3Dblue vli= nk=3Dpurple><div class=3DWordSection1><p class=3DMsoNormal><span style=3D'f= ont-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Never hea= rd of HIT before.<br>Seems to be a proprietary Dell solution?<br>Ok, I just= high-lighted the classical /most common SAN connection :)<br><br>We are us= ing a Dell MD3220i (much smaller then EQ series) with MD1200 units, and yes= the network configuration for subnet separated multipathing seems to be mo= re complicated at first,<o:p></o:p></span></p><p class=3DMsoNormal><span st= yle=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>b= ut it will give you load-balancing and auto fail-over functionality.<br><br= style=3D'font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D= '><o:p> </o:p></span></p><p class=3DMsoNormal><span style=3D'font-size= :11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'>Cheers,<br>Sven.<= o:p></o:p></span></p><p class=3DMsoNormal><span style=3D'font-size:11.0pt;f= ont-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></= p><p class=3DMsoNormal><b><span style=3D'font-size:10.0pt;font-family:"Taho= ma","sans-serif"'>Von:</span></b><span style=3D'font-size:10.0pt;font-famil= y:"Tahoma","sans-serif"'> Chris Noffsinger [mailto:cnoffsin@gmail.com] <br>= <b>Gesendet:</b> Do</span><span lang=3DDE style=3D'font-size:10.0pt;font-fa= mily:"Tahoma","sans-serif"'>nnerstag, 21. Februar 2013 20:05<br><b>An:</b> = Jonathan Horne<br><b>Cc:</b> Sven Knohsalla; Baptiste AGASSE; users@ovirt.o= rg<br><b>Betreff:</b> Re: [Users] iSCSI multipath with EqualLogic SAN<o:p><= /o:p></span></p><p class=3DMsoNormal><o:p> </o:p></p><div><p class=3DM= soNormal>We have 2 Equallogic PS4100s. And someone more knowledgeable= may prove me wrong here but,<o:p></o:p></p></div><div><p class=3DMsoNormal= plugin in Vmware) but the Linux OS will see the other paths and treat it l= ike any other SAN, you are just going to have to configure them to use them= . The link sent earlier in the thread is the official guide to doing= that.<o:p></o:p></p></div><div><p class=3DMsoNormal><o:p> </o:p></p><= /div><div><p class=3DMsoNormal><a href=3D"https://access.redhat.com/knowled= ge/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/DM_Multipath/Red_Hat_Enterpris= e_Linux-6-DM_Multipath-en-US.pdf" target=3D"_blank">https://access.redhat.c= om/knowledge/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/DM_Multipath/Red_Hat= _Enterprise_Linux-6-DM_Multipath-en-US.pdf</a><br><br><br>Here is another D= oc I used that is for Rhel5 but I beleive the multipath commands are the sa= me:<o:p></o:p></p></div><div><p class=3DMsoNormal><o:p> </o:p></p></di= v><div><p class=3DMsoNormal><a href=3D"http://www.equallogic.com/WorkArea/d= ownloadasset.aspx?id=3D8727">http://www.equallogic.com/WorkArea/downloadass= et.aspx?id=3D8727</a><o:p></o:p></p></div><div><p class=3DMsoNormal><o:p>&n= bsp;</o:p></p></div><div><p class=3DMsoNormal><o:p> </o:p></p><div><p = class=3DMsoNormal>On Thu, Feb 21, 2013 at 1:09 PM, Jonathan Horne <<a hr= ef=3D"mailto:jhorne@skopos.us" target=3D"_blank">jhorne@skopos.us</a>> w= rote:<o:p></o:p></p><p class=3DMsoNormal>Ive discussed this at length with = dell's EQ support team, and on a regular system that's connected in to an e= quallogic san, all the iscsi ports would be on the same subnet. The k= icker is, dell really wants you to use their specialized driver/iscsiinitia= tor to access (known as their HIT kit...host integration tools), and the HI= T kit handles establishing all the multiple sessions into the EQ SAN.<br><b= r>Unfortunately, equallogic doesnt support RHEV (and thus ovirt), and= ovirt does not seem to execute the commands the HIT driver would want to i= ntitiate multiple connections.<br><br>Dell says that the use of bonding for= iscsi just begs for tcp retransmits. since bonding is the only metho= d of failover I see for now, were using anyway against their recommendation= s (so far zero retransmits, but were not running our systems hard yet).<br>= <br>Cheers,<br>Jonathan<br><br>-----Original Message-----<br>From: <a href= =3D"mailto:users-bounces@ovirt.org">users-bounces@ovirt.org</a> [mailto:<a = href=3D"mailto:users-bounces@ovirt.org">users-bounces@ovirt.org</a>] On Beh= alf Of Sven Knohsalla<br>Sent: Thursday, February 21, 2013 8:55 AM<br>To: B= aptiste AGASSE<br>Cc: <a href=3D"mailto:users@ovirt.org">users@ovirt.org</a= the following link will help you here:<br><a href=3D"https://access.redhat= .com/knowledge/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/DM_Multipath/Red_H= at_Enterprise_Linux-6-DM_Multipath-en-US.pdf" target=3D"_blank">https://acc= ess.redhat.com/knowledge/docs/en-US/Red_Hat_Enterprise_Linux/6/pdf/DM_Multi= path/Red_Hat_Enterprise_Linux-6-DM_Multipath-en-US.pdf</a><br><br>Cheers,<b= r>Sven.<br><br>-----Urspr=FCngliche Nachricht-----<br>Von: <a href=3D"mailt= o:users-bounces@ovirt.org">users-bounces@ovirt.org</a> [mailto:<a href=3D"m= ailto:users-bounces@ovirt.org">users-bounces@ovirt.org</a>] Im Auftrag von = Nicolas Ecarnot<br>Gesendet: Donnerstag, 21. Februar 2013 15:48<br>An: <a h= ref=3D"mailto:users@ovirt.org">users@ovirt.org</a><br>Betreff: Re: [Users] = iSCSI multipath with EqualLogic SAN<br><br>Le 21/02/2013 11:30, Baptiste AG= ASSE a =E9crit :<br>> Hi all,<br>><br>> I'm testing ovirt 3.1 on c= entos boxes. I setup ovirt management node<br>> and 4 vdsm hosts. vdsm h= osts have 2 nics on the SAN subnet. When i<br>> create a iscsi storage d= omain, it use only one of the two nics on the<br>> SAN network (showed w= ith iscsiadm -m session on vdsm nodes). Does<br>> ovirt support multiple= s nics on the same subnet for iscsi SAN<br>> connection ?<br><br>I don't= know if this is the best setup, but this is exaclty what I did (iSCSI with= an Equllogic SAN) : I bonded 4 interfaces of the iSCSI subnet, and it's wo= rking fine so far...<br><br>--<br>Nicolas Ecarnot<br>______________________= _________________________<br>Users mailing list<br><a href=3D"mailto:Users@= ovirt.org">Users@ovirt.org</a><br><a href=3D"http://lists.ovirt.org/mailman= /listinfo/users" target=3D"_blank">http://lists.ovirt.org/mailman/listinfo/= users</a><br>_______________________________________________<br>Users maili= ng list<br><a href=3D"mailto:Users@ovirt.org">Users@ovirt.org</a><br><a hre= f=3D"http://lists.ovirt.org/mailman/listinfo/users" target=3D"_blank">http:= //lists.ovirt.org/mailman/listinfo/users</a><br><br>_______________________= _________<br>This is a PRIVATE message. If you are not the intended recipie= nt, please delete without copying and kindly advise us by e-mail of the mis= take in delivery. NOTE: Regardless of content, this e-mail shall not operat= e to bind SKOPOS to any order or other contract unless pursuant to explicit= written agreement or government initiative expressly permitting the use of= e-mail for such purpose.<br>______________________________________________= _<br>Users mailing list<br><a href=3D"mailto:Users@ovirt.org">Users@ovirt.o= rg</a><br><a href=3D"http://lists.ovirt.org/mailman/listinfo/users" target= =3D"_blank">http://lists.ovirt.org/mailman/listinfo/users</a><o:p></o:p></p=
</div><p class=3DMsoNormal><br><br clear=3Dall><o:p></o:p></p><div><p clas= s=3DMsoNormal><o:p> </o:p></p></div><p class=3DMsoNormal>-- <br>Chris = Noffsinger<o:p></o:p></p></div></div></body></html>=
--_000_DC9ABD90CB55EC448B1F682D5731AF7407A6F0329FIAD2MBX17mex0_--
Hi all, ----- Mail original -----
De: "Sven Knohsalla" <s.knohsalla@netbiscuits.com> À: "Chris Noffsinger" <cnoffsin@gmail.com>, "Jonathan Horne" <jhorne@skopos.us> Cc: "Baptiste AGASSE" <baptiste.agasse@lyra-network.com>, users@ovirt.org Envoyé: Vendredi 22 Février 2013 06:30:11 Objet: AW: [Users] iSCSI multipath with EqualLogic SAN
Never heard of HIT before. Seems to be a proprietary Dell solution? Ok, I just high-lighted the classical /most common SAN connection :)
We are using a Dell MD3220i (much smaller then EQ series) with MD1200 units, and yes the network configuration for subnet separated multipathing seems to be more complicated at first,
but it will give you load-balancing and auto fail-over functionality.
Of course a nice and quick alternative as suggested here “…but you can configure your nodes to use the other paths using the command line on the Centos nodes…”,
is also possible.
Cheers, Sven.
Von: Chris Noffsinger [mailto:cnoffsin@gmail.com] Gesendet: Do nnerstag, 21. Februar 2013 20:05 An: Jonathan Horne Cc: Sven Knohsalla; Baptiste AGASSE; users@ovirt.org Betreff: Re: [Users] iSCSI multipath with EqualLogic SAN
We have 2 Equallogic PS4100s. And someone more knowledgeable may prove me wrong here but,
Multipathd is not my most favorite thing to configure, but you can configure your nodes to use the other paths using the command line on the Centos nodes.
Yeah Dell will tell you that they want you to use their software (like the mem plugin in Vmware) but the Linux OS will see the other paths and treat it like any other SAN, you are just going to have to configure them to use them. The link sent earlier in the thread is the official guide to doing that.
https://access.redhat.com/knowledge/docs/en-US/Red_Hat_Enterprise_Linux/6/pd...
Here is another Doc I used that is for Rhel5 but I beleive the multipath commands are the same:
http://www.equallogic.com/WorkArea/downloadasset.aspx?id=8727
On Thu, Feb 21, 2013 at 1:09 PM, Jonathan Horne < jhorne@skopos.us > wrote:
Ive discussed this at length with dell's EQ support team, and on a regular system that's connected in to an equallogic san, all the iscsi ports would be on the same subnet. The kicker is, dell really wants you to use their specialized driver/iscsiinitiator to access (known as their HIT kit...host integration tools), and the HIT kit handles establishing all the multiple sessions into the EQ SAN.
Unfortunately, equallogic doesnt support RHEV (and thus ovirt), and ovirt does not seem to execute the commands the HIT driver would want to intitiate multiple connections.
Dell says that the use of bonding for iscsi just begs for tcp retransmits. since bonding is the only method of failover I see for now, were using anyway against their recommendations (so far zero retransmits, but were not running our systems hard yet).
Cheers, Jonathan
-----Original Message----- From: users-bounces@ovirt.org [mailto: users-bounces@ovirt.org ] On Behalf Of Sven Knohsalla Sent: Thursday, February 21, 2013 8:55 AM To: Baptiste AGASSE Cc: users@ovirt.org Subject: Re: [Users] iSCSI multipath with EqualLogic SAN
Hi Baptiste,
usually a SAN doesn't support bonding (see post of Nicolas) of its interfaces, so you have to use multipathing technology.
You have to separate all nics in different subnets so multipath can work. Command multipath -ll with show the connected paths.
If you "merge" all paths in one subnet you will have the result/behavior you just posted.
So this is less oVirt related, more network specific. We have a running iSCSI config with 4 networks and oVirt runs well.
Maybe the following link will help you here: https://access.redhat.com/knowledge/docs/en-US/Red_Hat_Enterprise_Linux/6/pd...
Cheers, Sven.
-----Ursprüngliche Nachricht----- Von: users-bounces@ovirt.org [mailto: users-bounces@ovirt.org ] Im Auftrag von Nicolas Ecarnot Gesendet: Donnerstag, 21. Februar 2013 15:48 An: users@ovirt.org Betreff: Re: [Users] iSCSI multipath with EqualLogic SAN
Le 21/02/2013 11:30, Baptiste AGASSE a écrit :
Hi all,
I'm testing ovirt 3.1 on centos boxes. I setup ovirt management node and 4 vdsm hosts. vdsm hosts have 2 nics on the SAN subnet. When i create a iscsi storage domain, it use only one of the two nics on the SAN network (showed with iscsiadm -m session on vdsm nodes). Does ovirt support multiples nics on the same subnet for iscsi SAN connection ?
I don't know if this is the best setup, but this is exaclty what I did (iSCSI with an Equllogic SAN) : I bonded 4 interfaces of the iSCSI subnet, and it's working fine so far...
-- Nicolas Ecarnot
-- Chris Noffsinger
More precision, I use at this time in production el5/el6 clusters for years (xen|kvm + cman + rgmanager) with 2 nics on the same subnet (with 2 IPs addrs in this subnet, as equallogic want) + multipathd. It works fine and i'm happy with it. I don't use equallogic HIT Kit because i've multiple type of SANs (tgtd and equallogic) connected to my hosts. I want to test the same configuration with ovirt because it privides HA (as my el clusters), work with KVM and provides more features related to virtualization than my "basic" clusters. When i've added storage domain in my ovirt 3.1 test env, it only setup one iscsi connection to the LUN on the vdsm hosts. Maybe there is a problem with my vdsm hosts configurations or ovirt-engine. I just wanted to know if someone with the same config (2 nics on the same subnet, equallogic SAN) have setup multipath to access storage domain. Nicolas said that he have similar config, so ovirt support it and it's a problem on my test env, i will investigate this later. Thanks all for yours comments. Have a nice day. Regards. Baptiste.
I finally had some time to work on this again now that I have some more nodes to work with. I am trying to get the ovirt node to log in from more than 1 IP address to the Equallogic SAN wthout using dell's HIT-Kit. My test node has these interfaces: (all ovirt 3.1, mgmt. and nodes) Eth0 - 10.32.0.44 - ovritmgmt Eth1 - several VM IP data VLANs P1p1 - 10.32.10.44 iscsi network P1p2 - 10.32.10.64 iscsi network My EQ SAN is located at 10.32.10.21. I know there is a ton of issues behind that being the only IP, but right now I have a stranger problem. When I ping 10.32.10.21 like this: Ping 10.32.10.21 -I 10.32.10.44 Tcpdump looking at p1p1 shows pings going as normal from 10.32.10.44 to 10.32.10.21. then I do "ping 10.32.10.21 -I 10.32.10.64" and tcpdump still shows ping packets going from p1p1 and not from p1p2. Tcpdump shows nothing at all on p1p2. I don’t understand how multipath can work if all the packets exit out p1p1 and nothing exits from p1p2? At this point im grasping at straws on how to effectively use the equallogic SAN with ovirt, as our disk thruput is currently limited to 110mb sec from the single 1gig pipe. I tend to be very quick to believe I am on the wrong track here. Any help or advice is greatly appreciated. Thanks, jonathan ________________________________ This is a PRIVATE message. If you are not the intended recipient, please delete without copying and kindly advise us by e-mail of the mistake in delivery. NOTE: Regardless of content, this e-mail shall not operate to bind SKOPOS to any order or other contract unless pursuant to explicit written agreement or government initiative expressly permitting the use of e-mail for such purpose.
This is a multi-part message in MIME format. --------------020004050704080007000806 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit I think you should have p1p2 on a different network ;) .. same with the san, one NIC should/could be on a different network (or probably for you, the 2nd head should be in a different network?) ... i've got that working OK with a iSCSI target service on centos and multipath does everything as expected .. alex On 03/11/2013 04:28 PM, Jonathan Horne wrote:
I finally had some time to work on this again now that I have some more nodes to work with.
I am trying to get the ovirt node to log in from more than 1 IP address to the Equallogic SAN wthout using dell's HIT-Kit. My test node has these interfaces:
(all ovirt 3.1, mgmt. and nodes) Eth0 - 10.32.0.44 - ovritmgmt Eth1 - several VM IP data VLANs P1p1 - 10.32.10.44 iscsi network P1p2 - 10.32.10.64 iscsi network
My EQ SAN is located at 10.32.10.21. I know there is a ton of issues behind that being the only IP, but right now I have a stranger problem.
When I ping 10.32.10.21 like this:
Ping 10.32.10.21 -I 10.32.10.44
Tcpdump looking at p1p1 shows pings going as normal from 10.32.10.44 to 10.32.10.21. then I do "ping 10.32.10.21 -I 10.32.10.64" and tcpdump still shows ping packets going from p1p1 and not from p1p2. Tcpdump shows nothing at all on p1p2.
I don’t understand how multipath can work if all the packets exit out p1p1 and nothing exits from p1p2?
At this point im grasping at straws on how to effectively use the equallogic SAN with ovirt, as our disk thruput is currently limited to 110mb sec from the single 1gig pipe. I tend to be very quick to believe I am on the wrong track here.
Any help or advice is greatly appreciated. Thanks, jonathan
________________________________ This is a PRIVATE message. If you are not the intended recipient, please delete without copying and kindly advise us by e-mail of the mistake in delivery. NOTE: Regardless of content, this e-mail shall not operate to bind SKOPOS to any order or other contract unless pursuant to explicit written agreement or government initiative expressly permitting the use of e-mail for such purpose. _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
--------------020004050704080007000806 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit <html> <head> <meta content="text/html; charset=UTF-8" http-equiv="Content-Type"> </head> <body bgcolor="#FFFFFF" text="#000000"> <font size="-1"><font face="Tahoma">I think you should have p1p2 on a different network ;) .. same with the san, one NIC should/could be on a different network (or probably for you, the 2nd head should be in a different network?) ... i've got that working OK with a iSCSI target service on centos and multipath does everything as expected .. <br> <br> alex<br> </font></font><br> <br> On 03/11/2013 04:28 PM, Jonathan Horne wrote: <blockquote cite="mid:9BE6F493F83A594DA60C45E6A09DC5AC23B775C8@AUSP01DAG0201" type="cite"> <pre wrap="">I finally had some time to work on this again now that I have some more nodes to work with. I am trying to get the ovirt node to log in from more than 1 IP address to the Equallogic SAN wthout using dell's HIT-Kit. My test node has these interfaces: (all ovirt 3.1, mgmt. and nodes) Eth0 - 10.32.0.44 - ovritmgmt Eth1 - several VM IP data VLANs P1p1 - 10.32.10.44 iscsi network P1p2 - 10.32.10.64 iscsi network My EQ SAN is located at 10.32.10.21. I know there is a ton of issues behind that being the only IP, but right now I have a stranger problem. When I ping 10.32.10.21 like this: Ping 10.32.10.21 -I 10.32.10.44 Tcpdump looking at p1p1 shows pings going as normal from 10.32.10.44 to 10.32.10.21. then I do "ping 10.32.10.21 -I 10.32.10.64" and tcpdump still shows ping packets going from p1p1 and not from p1p2. Tcpdump shows nothing at all on p1p2. I don’t understand how multipath can work if all the packets exit out p1p1 and nothing exits from p1p2? At this point im grasping at straws on how to effectively use the equallogic SAN with ovirt, as our disk thruput is currently limited to 110mb sec from the single 1gig pipe. I tend to be very quick to believe I am on the wrong track here. Any help or advice is greatly appreciated. Thanks, jonathan ________________________________ This is a PRIVATE message. If you are not the intended recipient, please delete without copying and kindly advise us by e-mail of the mistake in delivery. NOTE: Regardless of content, this e-mail shall not operate to bind SKOPOS to any order or other contract unless pursuant to explicit written agreement or government initiative expressly permitting the use of e-mail for such purpose. _______________________________________________ Users mailing list <a class="moz-txt-link-abbreviated" href="mailto:Users@ovirt.org">Users@ovirt.org</a> <a class="moz-txt-link-freetext" href="http://lists.ovirt.org/mailman/listinfo/users">http://lists.ovirt.org/mailman/listinfo/users</a> </pre> </blockquote> </body> </html> --------------020004050704080007000806--
participants (6)
-
Alex Leonhardt -
Baptiste AGASSE -
Chris Noffsinger -
Jonathan Horne -
Nicolas Ecarnot -
Sven Knohsalla