[ovirt-users] Fwd: RE: FC QLogic question

Bill Dossett bill.dossett at pb.com
Fri Sep 12 07:01:41 UTC 2014


Hi,

Sorry, I got waylaid at the end of yesterday - catching up...  (sorry for length of thread now as well, but would like to get to the bottom of this)

Have seen posts about ovirt-node... I personally like the idea and hope that it continues to develop.  Having to load a Linux distro up and then put ovirt hypervisor on it is more work and then you need to worry about upgrading the linux distro and ovirt and suddenly ovirt doesn't run on the distro you have and you start over.  IMHO anyway.

All of the LUN names are listed in /dev/mapper

/etc/multipath.conf is thus

# RHEV REVISION 1.0

defaults {
    polling_interval        5
    getuid_callout          "/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/%n"
    no_path_retry           fail
    user_friendly_names     no
    flush_on_last_del       yes
    fast_io_fail_tmo        5
    dev_loss_tmo            30
    max_fds                 4096
}

devices {
device {
    vendor                  "HITACHI"
    product                 "DF.*"
    getuid_callout          "/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/%n"
}
device {
    vendor                  "COMPELNT"
    product                 "Compellent Vol"
    no_path_retry           fail
}
}

But on the multipath -ll round robin is enabled...

I can't see how the firmware missing can be a problem if all my disks are appearing on node.  Some cards don't need to be flashed, they can be if needed but if my LUNs are appearing, then I assume it is working.

Sorry, I am very new to node and not much experience with FC under Linux, so trying to get up to speed on commands...

Which ovirt am Iusing?  Not sure what you want back,  uname -a yields 2.6.32-431.3.1.el6.x86_6

The iso I used is ovirt-node-iso-3.4-20140423.0.el6.iso   from the releases/stable/iso folder - I am fairly sure, there are two ISOs there.  Unfortunately I am not in the office today and can't get to the desktop where I burned the ISOs from...

Thanks
Bill

-----Original Message-----
From: Fabian Deutsch [mailto:fdeutsch at redhat.com]
Sent: 11 September 2014 13:40
To: Daniel Helgenberger; Bill Dossett
Cc: users at ovirt.org
Subject: Re: [ovirt-users] Fwd: RE: FC QLogic question

----- Original Message -----
>
> On 11.09.2014 14:23, Fabian Deutsch wrote:
> > Hey Daniel,
> >
> > ----- Original Message -----
> >> On 11.09.2014 14:09, Fabian Deutsch wrote:
> >>> Hey Bill and Daniel,
> >>>
> >>> it would indeed be interesting - mandatory - to know if it's qla*
> >>> or qxl (qxl is IMHO related to graphics).
> >>> Once we know that I'll see if the bug below fixes it.
> >> Hello Fabian,
> >> indeed this was my mistake; while typing the mail I was reading on
> >> the spice website - so qla is the correct module of course! I
> >> already replied this to Bill but forgot to cc the list also ...
> >>
> >> Also, for the node iso it would make little sense to have the qlx
> >> module loaded. For completeness, I attach my answer to Bill.
> > Thanks :)
> >
> > So to summarize:
> > The adapter is recognized on Node?
> >
> > But it does not show up in Engine?

> Bill has to tell, but I think so. I suggested to him this might be

Ah, I mixed you an Bill up in the thread.

> because of dm-multipath, multipath.conf might blacklist here. My nodes
> are plain EL6 and I have multipath enabled - but I do not know if
> ovirt-node filters for dm-mp devnodes only by default (this would make
> sense because of iscsi-multipathing in ovirt 3.4).

Well, we did some multipath changes lately. Let#s see what Bill says:

Bill,
what node are you using?
What does multipath -l say?
How does /dev/mapper/* and /dev/multipath.conf look like?

And is the disk appearing on Node and/or Engine?

Thanks!
fabian

> Maybe you can help out on this topic?
>
> Thanks!
> >
> > Thanks
> > - fabian
> >
> >>> I'd need your help to verify that we are also including all
> >>> relevant dependencies.
> >>>
> >>> Thanks
> >>> - fabian
> >>>
> >>> ----- Original Message -----
> >> On 11.09.2014 13:05, Bill Dossett wrote:
> >>
> >>> Hi Daniel,
> >>>
> >>> I did a lsmod | grep qxl  and it returned nothing...  did you
> >>> perhaps mean qla?
> >>>
> >>> [root at ovirt141 ~]# lsmod | grep qla
> >>> qla2xxx               466573  56
> >>>
> >>> I think that is the one
> >> Indeed, sorry for that.
> >>
> >>> lsscsi does list all of the LUNs...  so that's working!
> >> Great!
> >>
> >>> But nothing in ovirt engine when I try to add a storage domain.
> >> Please check back in ovirt engine, with Hosts / Hardware info. You
> >> should see the adapter there, along with  WWN's ect.
> >>
> >> I am not quite sure, but AFAIK the node uses dm-multipath by
> >> default (for iscsi multipathing). So what does:
> >> # multipath -ll
> >> list?
> >>
> >> Thanks again, I guess I will try and get a bit further with the
> >> installs I have...
> >>
> >> Bill
> >>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> Hi Daniel,
> >>>>
> >>>> I did a lsmod | grep qxl  and it returned nothing...  did you
> >>>> perhaps mean qla?
> >>>>
> >>>> [root at ovirt141 ~]# lsmod | grep qla
> >>>> qla2xxx               466573  56
> >>>>
> >>>> I think that is the one
> >>>>
> >>>> lsscsi does list all of the LUNs...  so that's working!
> >>>>
> >>>> But nothing in ovirt engine when I try to add a storage domain.
> >>>>
> >>>> Thanks again, I guess I will try and get a bit further with the
> >>>> installs I have...
> >>>>
> >>>> Bill
> >>>>
> >>>>
> >>>>
> >>>> -----Original Message-----
> >>>> From: Daniel Helgenberger [mailto:daniel.helgenberger at m-box.de]
> >>>> Sent: 11 September 2014 11:53
> >>>> To: Bill Dossett
> >>>> Subject: Re: [ovirt-users] FC QLogic question
> >>>>
> >>>> On 11.09.2014 12:17, Bill Dossett wrote:
> >>>>> Thanks for responding Daniel.
> >>>> Never mind!
> >>>>>  I was wondering and thought the message may be irrelevant.  But
> >>>>> yes, it doesn't appear to be working.  When I try to add a FC
> >>>>> storage domain, no hosts are showing in the drop down box of
> >>>>> hosts.  I have loaded the latests ovirtnode (3.4.something...)
> >>>>> on two hosts now and neither are working.
> >>>> Lets first try to isolate your FC issure. So you are using the
> >>>> latest ovirt-node? EL6? Keep in mind, the kernel is standard
> >>>> Linux and therefore should support Qlogic adapters out of the box
> >>>> (IMHO they are the best supported HBAs in Linux).
> >>>> Please try a:
> >>>> # lsmod  | grep qxl
> >>>> to see whatever the qxl module is loaded. Keep in mind you can
> >>>> run into problems with other conrollers in your host, though I
> >>>> only had this with LSI SAS / FC controllers so far.
> >>>>
> >>>> Further check on the FC switch if the N port is logged in and the
> >>>> zoning is correct.
> >>>>
> >>>> Finally, check with
> >>>> # lsscsi
> >>>> if you can see the luns.
> >>>>
> >>>>> Also having a lot of issues with configuring the network.  I
> >>>>> configure an interface I can ping it, but it shows as
> >>>>> unconfigured... on one host I have added it to the manager and I
> >>>>> see the interfaces anyway, but on the second host I configure
> >>>>> the eth0, I can ping it, it added to the ovirt engine but it
> >>>>> shows no NICs.  Should I be using an earlier version maybe?
> >>>>>
> >>>>> thanks again and best regards.
> >>>>>
> >>>>>
> >>>>> *Bill Dossett*
> >>>>> *Virtualisation Architect*
> >>>>> *Pitney Bowes - Tech Central***
> >>>>> 6 Hercules Way, 600 Leavesden Park Watford, WD25 7GS
> >>>>> Phone(+44) (0)1923 279353 | VOIP: 54739353
> >>>>> Mobile(+44) (0)7775 908612
> >>>>> bill.dossett at pb.com <mailto:bill.dossett at pb.com> www.pb.com
> >>>>> <http://www.pb.com/> *In Engineering?**Raise a ticket via Remedy
> >>>>> Anywhere [HERE
> >>>>> <http://teamsite.inside.pb.com/sites/TCPPM/GES/Lists/Create%20In
> >>>>> cident
> >>>>> /newIncident.aspx>]takes
> >>>>> less than a minute*
> >>>>>
> >>>>> *ManageIQ User Guide available* [*HERE
> >>>>> <https://dl.dropbox.com/u/6219441/ManageIQ%20-%20User%20Manual%2
> >>>>> 0PB%20 v4.pdf>*] *Check out the ManageIQ Blog for recent
> >>>>> enhancements and information [HERE]
> >>>>> <http://teamsite.inside.pb.com/sites/TCPPM/GES/manageiq/default.
> >>>>> aspx>*
> >>>>>
> >>>>> On Sep 11, 2014, at 10:52 AM, Daniel Helgenberger
> >>>>> <daniel.helgenberger at m-box.de
> >>>>> <mailto:daniel.helgenberger at m-box.de>>
> >>>>> wrote:
> >>>>>
> >>>>>> Hello Bill,
> >>>>>>
> >>>>>> what are your problems acually? Is fibre channel not working
> >>>>>> (as expected)?
> >>>>>>
> >>>>>> The log snippet you provided is completly normal and the
> >>>>>> messages can safely be ignored. This is also unrelated to oVirt
> >>>>>> but rather CentOS (or the distro you are running) I suppose.
> >>>>>>
> >>>>>> Cheers!
> >>>>>>
> >>>>>> On 11.09.2014 10:51, Bill Dossett wrote:
> >>>>>>> Hi,
> >>>>>>>
> >>>>>>> I seem to have run into a problem setting up ovirt with Fibre
> >>>>>>> Channel storage.
> >>>>>>>
> >>>>>>> I have a 2MBs SAN and qlogic cards in the nodes.  I used this
> >>>>>>> same setup with RHEV about 6 months ago and it just worked,
> >>>>>>> storage was there no problems.  Now booting with ovirtnode
> >>>>>>> distro, I am seeing
> >>>>>>>
> >>>>>>> Sep  9 08:01:27 localhost kernel: qla2xxx [0000:0c:00.0]-0091:1:
> >>>>>>> Firmware images can be retrieved from:
> >>>>>>> http://ldriver.qlogic.com/firmware/.
> >>>>>>>
> >>>>>>> Sep  9 08:01:27 localhost kernel: scsi1 : qla2xxx
> >>>>>>>
> >>>>>>> Sep  9 08:01:27 localhost kernel: qla2xxx [0000:0c:00.0]-00fb:1:
> >>>>>>> QLogic QLE2460
> >>>>>>> - QLogic 4GB FC Single-Port PCI-E HBA for IBM System x.
> >>>>>>>
> >>>>>>> Sep  9 08:01:27 localhost kernel: qla2xxx [0000:0c:00.0]-00fc:1:
> >>>>>>> ISP2432: PCIe (2.5GT/s x4) @ 0000:0c:00.0 hdma+ host#=1
> >>>>>>> fw=4.00.26 (2).
> >>>>>>>
> >>>>>>> Sep  9 08:01:27 localhost kernel: ata_piix 0000:00:1f.1: PCI
> >>>>>>> INT A
> >>>>>>> -> GSI 16 (level, low) -> IRQ 16
> >>>>>>>
> >>>>>>> I have googled the firmware error and it says some cards need
> >>>>>>> a firmware flash and some don't.  These are pretty standard
> >>>>>>> HBAs so I would think they would be supported out of the box, but maybe not.
> >>>>>>> Looking at trying to add the firmware looked kind of complex -
> >>>>>>> if I need to do this, does anyone know of a nice and easy
> >>>>>>> howto guide on this.  I'm just getting started with ovirt and
> >>>>>>> appreciate any help
> >>>>>>>
> >>>>>>>
> >>>>>>> Thanks
> >>>>>>>
> >>>>>>> *Bill Dossett*
> >>>>>>>
> >>>>>>> *Virtualisation Architect*
> >>>>>>>
> >>>>>>> *Pitney Bowes - Tech Central***
> >>>>>>>
> >>>>>>> 6 Hercules Way, 600 Leavesden Park
> >>>>>>>
> >>>>>>> Watford, WD25 7GS
> >>>>>>>
> >>>>>>> Phone(+44) (0)1923 279353 | VOIP: 54739353
> >>>>>>>
> >>>>>>> Mobile(+44) (0)7775 908612
> >>>>>>>
> >>>>>>> bill.dossett at pb.com <mailto:bill.dossett at pb.com>
> >>>>>>> <mailto:bill.dossett at pb.com>
> >>>>>>>
> >>>>>>> www.pb.com <http://www.pb.com> <http://www.pb.com/>
> >>>>>>>
> >>>>>>> *In Engineering?**Raise a ticket via Remedy Anywhere [HERE
> >>>>>>> <http://teamsite.inside.pb.com/sites/TCPPM/GES/Lists/Create%20
> >>>>>>> Incid
> >>>>>>> ent/newIncident.aspx>]takes
> >>>>>>>
> >>>>>>> less than a minute*
> >>>>>>>
> >>>>>>> *ManageIQ User Guide available*[*HERE
> >>>>>>> <https://dl.dropbox.com/u/6219441/ManageIQ%20-%20User%20Manual
> >>>>>>> %20PB
> >>>>>>> %20v4.pdf>*]
> >>>>>>>
> >>>>>>> *Check out the ManageIQ Blog for recent enhancements and
> >>>>>>> information [HERE]
> >>>>>>> <http://teamsite.inside.pb.com/sites/TCPPM/GES/manageiq/defaul
> >>>>>>> t.asp
> >>>>>>> x>*
> >>>>>>>
> >>>>>>>
> >>>>>>> --------------------------------------------------------------
> >>>>>>> -----
> >>>>>>> -------------
> >>>>>>>
> >>>>>> --
> >>>>>> Daniel Helgenberger
> >>>>>> m box bewegtbild GmbH
> >>>>>>
> >>>>>> P: +49/30/2408781-22
> >>>>>> F: +49/30/2408781-10
> >>>>>>
> >>>>>> ACKERSTR. 19
> >>>>>> D-10115 BERLIN
> >>>>>>
> >>>>>>
> >>>>>> www.m-box.de <http://www.m-box.de> www.monkeymen.tv
> >>>>>> <http://www.monkeymen.tv>
> >>>>>>
> >>>>>> Geschäftsführer: Martin Retschitzegger / Michaela Göllner
> >>>>>> Handeslregister: Amtsgericht Charlottenburg / HRB 112767
> >>>>>>
> >>>>> ----------------------------------------------------------------
> >>>>> ------
> >>>>> ----------
> >>>>>
> >>>> --
> >>>> Daniel Helgenberger
> >>>> m box bewegtbild GmbH
> >>>>
> >>>> P: +49/30/2408781-22
> >>>> F: +49/30/2408781-10
> >>>>
> >>>> ACKERSTR. 19
> >>>> D-10115 BERLIN
> >>>>
> >>>>
> >>>> www.m-box.de  www.monkeymen.tv
> >>>>
> >>>> Geschäftsführer: Martin Retschitzegger / Michaela Göllner
> >>>> Handeslregister: Amtsgericht Charlottenburg / HRB 112767
> >>>>
> >>>>
> >>>> ________________________________
> >>>>
> >>>>
> >>>>
> >>>>
> >>>> _______________________________________________
> >>>> Users mailing list
> >>>> Users at ovirt.org
> >>>> http://lists.ovirt.org/mailman/listinfo/users
> >>>>
> >> --
> >> Daniel Helgenberger
> >> m box bewegtbild GmbH
> >>
> >> P: +49/30/2408781-22
> >> F: +49/30/2408781-10
> >>
> >> ACKERSTR. 19
> >> D-10115 BERLIN
> >>
> >>
> >> www.m-box.de  www.monkeymen.tv
> >>
> >> Geschäftsführer: Martin Retschitzegger / Michaela Göllner
> >> Handeslregister: Amtsgericht Charlottenburg / HRB 112767
> >>
> >> _______________________________________________
> >> Users mailing list
> >> Users at ovirt.org
> >> http://lists.ovirt.org/mailman/listinfo/users
> >>
>
> --
> Daniel Helgenberger
> m box bewegtbild GmbH
>
> P: +49/30/2408781-22
> F: +49/30/2408781-10
>
> ACKERSTR. 19
> D-10115 BERLIN
>
>
> www.m-box.de  www.monkeymen.tv
>
> Geschäftsführer: Martin Retschitzegger / Michaela Göllner
> Handeslregister: Amtsgericht Charlottenburg / HRB 112767
>
>

________________________________



More information about the Users mailing list