Hi,
Am 22.06.2018 um 18:12 schrieb Nir Soffer:
On Fri, Jun 22, 2018 at 6:48 PM Bernhard Dick <bernhard(a)bdick.de
<mailto:bernhard@bdick.de>> wrote:
Am 22.06.2018 um 17:38 schrieb Nir Soffer:
> On Fri, Jun 22, 2018 at 6:22 PM Bernhard Dick <bernhard(a)bdick.de
<mailto:bernhard@bdick.de>
> <mailto:bernhard@bdick.de <mailto:bernhard@bdick.de>>> wrote:
[...]
Is sdc your LUN?
here sdc is from the storage, sdd is from the linux based target.
> multipath -ll
No Output
You don't have any multipath devices. oVirt block storage is using
only multipath devices. This means that you will no see any devices
on engine side.
> cat /etc/multipath.conf
# VDSM REVISION 1.3
# VDSM PRIVATE
# VDSM REVISION 1.5
You are mixing several versions here. Is this 1.3 or 1.5 file?
hm I didn't
touch the file. Maybe something went weird during update
procedures.
# This file is managed by vdsm.
# [...]
defaults {
# [...]
polling_interval 5
# [...]
no_path_retry 4
According to this this is a 1.5 version.
# [...]
user_friendly_names no
# [...]
flush_on_last_del yes
# [...]
fast_io_fail_tmo 5
# [...]
dev_loss_tmo 30
# [...]
max_fds 4096
}
# Remove devices entries when overrides section is available.
devices {
device {
# [...]
all_devs yes
no_path_retry 4
}
}
# [...]
# inserted by blacklist_all_disks.sh
blacklist {
devnode "*"
}
This is your issue - why do you blacklist all devices?
By lsblk output I think you are running hyperconverge setup, which
wrongly disabled all multipath devices, instead of the local devices
used by gluster.
To fix this:
1. Remove the wrong multipath blacklist
2. Find the WWID of the local devices used by gluster
these are /dev/sda and /dev/sdb
3. Add blacklist for these specific devices using
blacklist {
wwid XXX-YYY
wwid YYY-ZZZ
}
With this you should be able to access all LUNs from the storage
server (assuming you configured the storage so the host can see them).
Finally, it is recommended to use a drop-in configuration file for
local changes, and *never* touch /etc/multipath.conf, so vdsm is
able to manage this file.
This is done by putting your changes in:
/etc/multipath/conf.d/local.conf
Example:
$ cat /etc/multipath/conf.d/local.conf
# Local multipath configuration for host XXX
# blacklist boot device and device used for gluster storage.
blacklist {
wwid XXX-YYY
wwid YYY-ZZZ
}
You probably want to backup these files and have a script to
deploy them to the hosts if you need to restore the setup.
Once you have a proper drop-in configuration, you can use
the standard vdsm multipath configuration by removing the line
# VDSM PRIVATE
And running:
vdsm-tool configure --force --module multipath
That solved it. Blacklisting the local drives however does not really
seem to work. I assume that is due to the local drives are virtio
storage drives in my case (as it is a testing environment based on
virtual Hosts) and they do have type 0x80 wwids of the Form "0QEMU
QEMU HARDDISK drive-scsi1".
Thanks for your help!
Regards
Bernhard
In EL7.6 we expect to have a fix for this issue, blacklisting
automatically local devices.
See
https://bugzilla.redhat.com/1593459
> vdsm-client Host getDeviceList
[]
Expected in this configuration.
> Nir
>
> When I logon to the ovirt hosts I see that they are connected
with the
> target LUNs (dmesg is telling that there are iscsi devices
being found
> and they are getting assigned to devices in /dev/sdX ).
Writing and
> reading from the devices (also accros hosts) works. Do you
have some
> advice how to troubleshoot this?
>
> Regards
> Bernhard
> _______________________________________________
> Users mailing list -- users(a)ovirt.org
<mailto:users@ovirt.org> <mailto:users@ovirt.org
<mailto:users@ovirt.org>>
> To unsubscribe send an email to users-leave(a)ovirt.org
<mailto:users-leave@ovirt.org>
> <mailto:users-leave@ovirt.org <mailto:users-leave@ovirt.org>>
> Privacy Statement:
https://www.ovirt.org/site/privacy-policy/
> oVirt Code of Conduct:
>
https://www.ovirt.org/community/about/community-guidelines/
> List Archives:
>
https://lists.ovirt.org/archives/list/users@ovirt.org/message/45IIDJUVOCN...
>
--
Dipl.-Inf. Bernhard Dick
Auf dem Anger 24
DE-46485 Wesel
www.BernhardDick.de <
http://www.BernhardDick.de>
jabber: bernhard(a)jabber.bdick.de <mailto:bernhard@jabber.bdick.de>
Tel : +49.2812068620 <tel:+49%20281%202068620>
Mobil : +49.1747607927 <tel:+49%20174%207607927>
FAX : +49.2812068621 <tel:+49%20281%202068621>
USt-IdNr.: DE274728845
--
Dipl.-Inf. Bernhard Dick
Auf dem Anger 24
DE-46485 Wesel
www.BernhardDick.de
jabber: bernhard(a)jabber.bdick.de
Tel : +49.2812068620
Mobil : +49.1747607927
FAX : +49.2812068621
USt-IdNr.: DE274728845