integrate iSCSI and FC on the same oVirt datacenter
Hi, Not sure if this is the right place to ask but maybe someone can provide directions for my problem. I have a full FC setup with FC switch and FC HBAs on Linux (Centos) to access my storage. However we cannot afford expanding our FC infrastructure thus making it hard for us to add more nodes in the oVirt setup. FCoE requires compatible switches and adapters (correct?) which is also out of budget. Our storage supports only FC. I thought something like this might work: node[1]: FC - ISCSI <-> node[2]: ISCSI - FC share the FC block device over iscsi and then create a new FC target+initiator on the new node with same FC lun as the original? Could this work? How? Other ideas? regards, Giannis ps. a) a solution would also be to migrate completely to iSCSI but I'm trying to avoid that atm. b) another one would be to create a second datacenter for iSCSI but also trying to avoid that if I can
בתאריך 14 באוק׳ 2015 3:11 אחה״צ, "Kapetanakis Giannis" < bilias@edu.physics.uoc.gr> כתב:
Hi,
Not sure if this is the right place to ask but maybe someone can provide
directions for my problem.
I have a full FC setup with FC switch and FC HBAs on Linux (Centos) to
access my storage.
However we cannot afford expanding our FC infrastructure thus making it
hard for us to add more nodes in the oVirt setup.
FCoE requires compatible switches and adapters (correct?) which is also out of budget. Our storage supports only FC.
I thought something like this might work:
node[1]: FC - ISCSI <-> node[2]: ISCSI - FC
I dont follow - how do you want to share your fc storage over iscsi? And what are these nodes? Storage nodes? Hypervisors? Nir
share the FC block device over iscsi and then create a new FC
target+initiator on the new node with same FC lun as the original?
Could this work? How? Other ideas?
regards,
Giannis ps. a) a solution would also be to migrate completely to iSCSI but I'm trying
b) another one would be to create a second datacenter for iSCSI but also
to avoid that atm. trying to avoid that if I can
_______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
On 16/10/15 01:01, Nir Soffer wrote:
I thought something like this might work:
node[1]: FC - ISCSI <-> node[2]: ISCSI - FC
I dont follow - how do you want to share your fc storage over iscsi?
And what are these nodes? Storage nodes? Hypervisors?
Nir
The initial idea was to share FC over IP network. All nodes are ovirt nodes (hypervisors). One node see the FC storage share as a block device. Take this block device and share it over iscsi to node[2]. The node[2] will see the block device and create a new FC target to use it itself... I know, its science fiction... After reading a bit on the subject another solution would be FCoE vn2vn but this probably requires hardware. Specific switches with DCB and FIP snooping which i don't have. Any idea to extend FC to nodes without FC HBAs is welcome. G
On Fri, Oct 16, 2015 at 1:31 PM, Kapetanakis Giannis <bilias@edu.physics.uoc.gr> wrote:
On 16/10/15 01:01, Nir Soffer wrote:
I thought something like this might work:
node[1]: FC - ISCSI <-> node[2]: ISCSI - FC
I dont follow - how do you want to share your fc storage over iscsi?
And what are these nodes? Storage nodes? Hypervisors?
Nir
The initial idea was to share FC over IP network. All nodes are ovirt nodes (hypervisors).
One node see the FC storage share as a block device. Take this block device and share it over iscsi to node[2]. The node[2] will see the block device and create a new FC target to use it itself...
I know, its science fiction...
I still don't understand the problem you are trying to solve. Can you explain the network topology? - Do you have FC storage server, switch? - How many nodes to do you have with FC HBA? Do you want to add nodes without FC HBA, and you want to consume the FC storage? Or you want to add nodes with FC HBA, but you don't have an FC switch? Nir
After reading a bit on the subject another solution would be FCoE vn2vn but this probably requires hardware. Specific switches with DCB and FIP snooping which i don't have.
Any idea to extend FC to nodes without FC HBAs is welcome.
G
On 18/10/15 16:44, Nir Soffer wrote:
I still don't understand the problem you are trying to solve.
Can you explain the network topology?
- Do you have FC storage server, switch? - How many nodes to do you have with FC HBA?
Do you want to add nodes without FC HBA, and you want to consume the FC storage?
Or you want to add nodes with FC HBA, but you don't have an FC switch?
Nir
I have FC storage, FC switch and and with FC HBAs. I want to add new nodes to the FC storage and to the ovirt datacenter without using FC directly (no HBA, no switch). G
--_000_B91C8D28D6B74832836AB3CA1E73963Bvolusioncom_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable We use FCoE in our setup. All the configs are in /etc/fcoe/ and fcoeadm is = part of the ovirt-node iso. So this should work the same as setting up FCoE= on CentOS or RHEL. https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/6/ht= ml/Storage_Administration_Guide/fcoe-config.html -Patrick On Oct 19, 2015, at 2:34 AM, Kapetanakis Giannis <bilias@edu.physics.uoc.gr= <mailto:bilias@edu.physics.uoc.gr>> wrote: On 18/10/15 16:44, Nir Soffer wrote: I still don't understand the problem you are trying to solve. Can you explain the network topology? - Do you have FC storage server, switch? - How many nodes to do you have with FC HBA? Do you want to add nodes without FC HBA, and you want to consume the FC storage? Or you want to add nodes with FC HBA, but you don't have an FC switch? Nir I have FC storage, FC switch and and with FC HBAs. I want to add new nodes to the FC storage and to the ovirt datacenter witho= ut using FC directly (no HBA, no switch). G _______________________________________________ Users mailing list Users@ovirt.org<mailto:Users@ovirt.org> http://lists.ovirt.org/mailman/listinfo/users --_000_B91C8D28D6B74832836AB3CA1E73963Bvolusioncom_ Content-Type: text/html; charset="us-ascii" Content-ID: <525C490C7C76E54AB3D3D6F67BB2E60D@namprd04.prod.outlook.com> Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3Dus-ascii"=
</head> <body style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-lin= e-break: after-white-space;" class=3D""> We use FCoE in our setup. All the configs are in /etc/fcoe/ and fcoeadm is = part of the ovirt-node iso. So this should work the same as setting up FCoE= on CentOS or RHEL. <div class=3D""><br class=3D""> </div> <div class=3D""><a href=3D"https://access.redhat.com/documentation/en-US/Re= d_Hat_Enterprise_Linux/6/html/Storage_Administration_Guide/fcoe-config.html= " class=3D"">https://access.redhat.com/documentation/en-US/Red_Hat_Enterpri= se_Linux/6/html/Storage_Administration_Guide/fcoe-config.html</a></div> <div class=3D""><br class=3D""> </div> <div class=3D"">-Patrick</div> <div class=3D""><br class=3D""> <div> <blockquote type=3D"cite" class=3D""> <div class=3D"">On Oct 19, 2015, at 2:34 AM, Kapetanakis Giannis <<a hre= f=3D"mailto:bilias@edu.physics.uoc.gr" class=3D"">bilias@edu.physics.uoc.gr= </a>> wrote:</div> <br class=3D"Apple-interchange-newline"> <div class=3D"">On 18/10/15 16:44, Nir Soffer wrote:<br class=3D""> <blockquote type=3D"cite" class=3D"">I still don't understand the problem y= ou are trying to solve.<br class=3D""> <br class=3D""> Can you explain the network topology?<br class=3D""> <br class=3D""> - Do you have FC storage server, switch?<br class=3D""> - How many nodes to do you have with FC HBA?<br class=3D""> <br class=3D""> Do you want to add nodes without FC HBA, and you want to consume<br class= =3D""> the FC storage?<br class=3D""> <br class=3D""> Or you want to add nodes with FC HBA, but you don't have an FC switch?<br c= lass=3D""> <br class=3D""> Nir<br class=3D""> <br class=3D""> </blockquote> <br class=3D""> I have FC storage, FC switch and and with FC HBAs.<br class=3D""> <br class=3D""> I want to add new nodes to the FC storage and to the ovirt datacenter witho= ut using FC directly (no HBA, no switch).<br class=3D""> <br class=3D""> G<br class=3D""> _______________________________________________<br class=3D""> Users mailing list<br class=3D""> <a href=3D"mailto:Users@ovirt.org" class=3D"">Users@ovirt.org</a><br class= =3D""> http://lists.ovirt.org/mailman/listinfo/users<br class=3D""> </div> </blockquote> </div> <br class=3D""> </div> </body> </html> --_000_B91C8D28D6B74832836AB3CA1E73963Bvolusioncom_--
This is a multi-part message in MIME format. --------------070004020701090609040609 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit On 19/10/15 18:14, Patrick Russell wrote:
We use FCoE in our setup. All the configs are in /etc/fcoe/ and fcoeadm is part of the ovirt-node iso. So this should work the same as setting up FCoE on CentOS or RHEL.
https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/6/htm...
-Patrick
Do you use special hardware (switch or nics) for FCoE? G --------------070004020701090609040609 Content-Type: text/html; charset=windows-1252 Content-Transfer-Encoding: 7bit <html> <head> <meta content="text/html; charset=windows-1252" http-equiv="Content-Type"> </head> <body text="#000000" bgcolor="#FFFFFF"> <div class="moz-cite-prefix">On 19/10/15 18:14, Patrick Russell wrote:<br> </div> <blockquote cite="mid:B91C8D28-D6B7-4832-836A-B3CA1E73963B@volusion.com" type="cite"> <meta http-equiv="Content-Type" content="text/html; charset=windows-1252"> We use FCoE in our setup. All the configs are in /etc/fcoe/ and fcoeadm is part of the ovirt-node iso. So this should work the same as setting up FCoE on CentOS or RHEL. <div class=""><br class=""> </div> <div class=""><a moz-do-not-send="true" href="https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/6/htm..." class="">https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/6/html/Storage_Administration_Guide/fcoe-config.html</a></div> <div class=""><br class=""> </div> <div class="">-Patrick</div> <br> </blockquote> <br> Do you use special hardware (switch or nics) for FCoE?<br> <br> G<br> </body> </html> --------------070004020701090609040609--
--_000_8E000552AC574AE5BE8250008A2450CFvolusioncom_ Content-Type: text/plain; charset="Windows-1252" Content-Transfer-Encoding: quoted-printable You need a NIC that supports it. We are currently using the Broadcom Corpor= ation BCM57840 NetXtreme II 10 Gigabit Ethernet adapter. However, multiple = vendors sell a converged network adapter that should work. You=92ll also need to verify that your switch supports FCoE. This is where = you=92ll connect up to your SAN fabric. If you=92re in the market for new compute blades as well, you can go the ro= ute we did. The Dell FX2 platform has a couple of 4 port FCoE and Network s= witch in the back of each chassis so you can cable up directly to the fabri= c without changing your top of rack switches to FCoE. Here=92s some more in= formation: http://www.dell.com/us/business/p/poweredge-fx/pd Specifically the FN2210S IO Module for that chassis: http://www.dell.com/us/business/p/fn-io-aggregator/pd -Patrick On Oct 20, 2015, at 7:23 AM, Kapetanakis Giannis <bilias@edu.physics.uoc.gr= <mailto:bilias@edu.physics.uoc.gr>> wrote: On 19/10/15 18:14, Patrick Russell wrote: We use FCoE in our setup. All the configs are in /etc/fcoe/ and fcoeadm is = part of the ovirt-node iso. So this should work the same as setting up FCoE= on CentOS or RHEL. https://access.redhat.com/documentation/en-US/Red_Hat_Enterprise_Linux/6/ht= ml/Storage_Administration_Guide/fcoe-config.html -Patrick Do you use special hardware (switch or nics) for FCoE? G --_000_8E000552AC574AE5BE8250008A2450CFvolusioncom_ Content-Type: text/html; charset="Windows-1252" Content-ID: <C1F15F78D0FDDE4AB3B809410235BA37@namprd04.prod.outlook.com> Content-Transfer-Encoding: quoted-printable <html> <head> <meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3DWindows-1= 252"> </head> <body style=3D"word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-lin= e-break: after-white-space;" class=3D""> You need a NIC that supports it. We are currently using the Broadcom C= orporation BCM57840 NetXtreme II 10 Gigabit Ethernet adapter. However, mult= iple vendors sell a converged network adapter that should work. <div class=3D""><br class=3D""> </div> <div class=3D"">You=92ll also need to verify that your switch supports FCoE= . This is where you=92ll connect up to your SAN fabric. </div> <div class=3D""><br class=3D""> </div> <div class=3D"">If you=92re in the market for new compute blades as well, y= ou can go the route we did. The Dell FX2 platform has a couple of 4 port FC= oE and Network switch in the back of each chassis so you can cable up direc= tly to the fabric without changing your top of rack switches to FCoE. Here=92s some more information:</div> <div class=3D""><br class=3D""> </div> <div class=3D""><a href=3D"http://www.dell.com/us/business/p/poweredge-fx/p= d" class=3D"">http://www.dell.com/us/business/p/poweredge-fx/pd</a></div> <div class=3D""><br class=3D""> </div> <div class=3D"">Specifically the FN2210S IO Module for that chassis:</div> <div class=3D""><br class=3D""> </div> <div class=3D""><a href=3D"http://www.dell.com/us/business/p/fn-io-aggregat= or/pd" class=3D"">http://www.dell.com/us/business/p/fn-io-aggregator/pd</a>= </div> <div class=3D""><br class=3D""> </div> <div class=3D""><br class=3D""> </div> <div class=3D"">-Patrick</div> <div class=3D""><br class=3D""> <div> <blockquote type=3D"cite" class=3D""> <div class=3D"">On Oct 20, 2015, at 7:23 AM, Kapetanakis Giannis <<a hre= f=3D"mailto:bilias@edu.physics.uoc.gr" class=3D"">bilias@edu.physics.uoc.gr= </a>> wrote:</div> <br class=3D"Apple-interchange-newline"> <div class=3D""> <div text=3D"#000000" bgcolor=3D"#FFFFFF" class=3D""> <div class=3D"moz-cite-prefix">On 19/10/15 18:14, Patrick Russell wrote:<br= class=3D""> </div> <blockquote cite=3D"mid:B91C8D28-D6B7-4832-836A-B3CA1E73963B@volusion.com" = type=3D"cite" class=3D""> We use FCoE in our setup. All the configs are in /etc/fcoe/ and fcoeadm is = part of the ovirt-node iso. So this should work the same as setting up FCoE= on CentOS or RHEL. <div class=3D""><br class=3D""> </div> <div class=3D""><a moz-do-not-send=3D"true" href=3D"https://access.redhat.c= om/documentation/en-US/Red_Hat_Enterprise_Linux/6/html/Storage_Administrati= on_Guide/fcoe-config.html" class=3D"">https://access.redhat.com/documentati= on/en-US/Red_Hat_Enterprise_Linux/6/html/Storage_Administration_Guide/fcoe-= config.html</a></div> <div class=3D""><br class=3D""> </div> <div class=3D"">-Patrick</div> <br class=3D""> </blockquote> <br class=3D""> Do you use special hardware (switch or nics) for FCoE?<br class=3D""> <br class=3D""> G<br class=3D""> </div> </div> </blockquote> </div> <br class=3D""> </div> </body> </html> --_000_8E000552AC574AE5BE8250008A2450CFvolusioncom_--
participants (3)
-
Kapetanakis Giannis -
Nir Soffer -
Patrick Russell