[ovirt-users] Storage network clarification

[Sahina Bose]

On 01/18/2016 07:26 PM, Fil Di Noto wrote:
> I'm having trouble setting up a dedicated storage network.
>
> I have a separate VLAN designated for storage, and configured separate
> IP addresses for each host that correspond to that subnet. I have
> tested this subnet extensively and it is working as expected.
>
> Prior to adding the hosts, I configured a storage network and
> configured the cluster to use that network for storage and not the
> ovirtmgmt network. I was hopping that this would be recognized when
> the hosts were added but it was not. I had to actually reconfigure the
> storage VLAN interface via oVirt "manage host networks" just to bring
> the host networks into compliance. The IP is configured directly on
> the bond0.<vlanid>, not on a bridge interface which I assume is
> correct since it is not a "VM" network.
>
> In this setup I was not able to activate any of the hosts due to VDSM
> gluster errors, I think it was because VDSM was trying to use the
> hostname/IP of the ovirtmgmt network. I manually set up the peers
> using "gluster peer probe" and I was able to activate the hosts but
> they were not using the storage network (tcpdump). I also tried adding
> DNS records for the storage network interfaces using different
> hostnames but gluster seemed to still consider the ovirtmgmt interface
> as the primary.
>
> With the hosts active, I couldn't create/activate any volumes until I
> changed the cluster network settings to use the ovirtmgmt network for
> storage. I ended up abandoning the dedicated storage subnet for the
> time being and I'm starting to wonder if running virtualization and
> gluster on the same hosts is intended to work this way.
>
> Assuming that it should work, what is the correct way to configure it?
> I can't find any docs that go in detail about storage networks. Is
> reverse DNS a factor? If I had a better understanding of what oVirt is
> expecting to see that would be helpful.


The steps to make sure gluster uses separate network for data traffic :

1. Create a logical network (non-VM), and mark it's role as "Gluster"
2. After adding the host via the ovirtmgmt hostname/ ip address, assign 
this gluster network to your interface (with the storage sub-net)
  This step will initiate a peer probe of the host with this additonal 
ip address.

3. When creating a volume after an interface/bond is tagged with gluster 
network, the bricks are added using the gluster n/w's ip address. Now 
when clients connect to the volume, traffic is routed via your gluster 
network that's used by bricks.

What were the vdsm gluster errors when you activated the gluster hosts?
Could you attach the earlier vdsm log?


> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users