[Users] Dedicated Bonding interface for Gluster

Wed Feb 12 12:18:39 EST 2014

Okay, here is what i did:

1.) i stopped the ovirt engine

2.) then i reconfigured the gluster nodes/bricks manually...(i changed the
path and host name)

Before:
=============
gluster> volume info

Volume Name: GlusterSuxx
Type: Replicate
Volume ID: 8339d0b8-49ad-4d2d-9def-102ec025937f
Status: Started
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: node2.local:/home/suxx
Brick2: node3.local:/home/suxx
Options Reconfigured:
auth.allow: *
user.cifs: disable
nfs.disable: on

After
===========
 gluster> volume info

Volume Name: GlusterSuxx
Type: Replicate
Volume ID: 8339d0b8-49ad-4d2d-9def-102ec025937f
Status: Started
Number of Bricks: 1 x 2 = 2
Transport-type: tcp
Bricks:
Brick1: node3.bond:/home/suxx2
Brick2: node2.bond:/home/suxx2
Options Reconfigured:
storage.owner-gid: 36
storage.owner-uid: 36
auth.allow: *
user.cifs: disable
nfs.disable: on

3.) Then i started the ovirt egine again

4.) The ovirt Engine still thinks the bricks are Brick1:
node2.local:/home/suxx and Brick2: node3.local:/home/suxx

Now the ovirt engine logs spits errors at me:
=================================
2014-02-12 18:13:06,255 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(DefaultQuartzScheduler_Worker-44) Exception: IRSGenericException:
IRSErrorException: IRSNoMasterDomainException: Cannot find master domain:
'spUUID=d6fb9dc4-e727-481a-940a-4923cd1d94eb,
msdUUID=8323035b-3a0a-4c40-a45e-ca764dfdb09f'
2014-02-12 18:13:08,448 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand]
(DefaultQuartzScheduler_Worker-44) Command ConnectStoragePoolVDS execution
failed. Exception: IRSNoMasterDomainException: IRSGenericException:
IRSErrorException: IRSNoMasterDomainException: Cannot find master domain:
'spUUID=d6fb9dc4-e727-481a-940a-4923cd1d94eb,
msdUUID=8323035b-3a0a-4c40-a45e-ca764dfdb09f'
2014-02-12 18:13:08,449 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(DefaultQuartzScheduler_Worker-44) IrsBroker::Failed::GetStoragePoolInfoVDS
2014-02-12 18:13:08,449 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(DefaultQuartzScheduler_Worker-44) Exception: IRSGenericException:
IRSErrorException: IRSNoMasterDomainException: Cannot find master domain:
'spUUID=d6fb9dc4-e727-481a-940a-4923cd1d94eb,
msdUUID=8323035b-3a0a-4c40-a45e-ca764dfdb09f'
2014-02-12 18:13:10,106 ERROR
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturnForXmlRpc]
(DefaultQuartzScheduler_Worker-64) Error while populating bricks of volume
8339d0b8-49ad-4d2d-9def-102ec025937f.: java.lang.RuntimeException:
java.net.UnknownHostException: node3.bond
2014-02-12 18:13:15,187 ERROR
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturnForXmlRpc]
(DefaultQuartzScheduler_Worker-72) Error while populating bricks of volume
8339d0b8-49ad-4d2d-9def-102ec025937f.: java.lang.RuntimeException:
java.net.UnknownHostException: node3.bond
2014-02-12 18:13:18,480 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand]
(DefaultQuartzScheduler_Worker-75) Command HSMGetAllTasksStatusesVDS
execution failed. Exception: IRSNonOperationalException:
IRSGenericException: IRSErrorException: IRSNonOperationalException: Not
SPM: ()
2014-02-12 18:13:20,138 ERROR
[org.ovirt.engine.core.vdsbroker.gluster.GlusterTasksListVDSCommand]
(DefaultQuartzScheduler_Worker-87) Command GlusterTasksListVDS execution
failed. Exception: VDSNetworkException: org.apache.xmlrpc.XmlRpcException:
<type 'exceptions.Exception'>:method "glusterTasksList" is not supported
2014-02-12 18:13:20,141 ERROR
[org.ovirt.engine.core.utils.timer.SchedulerUtilQuartzImpl]
(DefaultQuartzScheduler_Worker-87) Failed to invoke scheduled method
gluster_async_task_poll_event: java.lang.reflect.InvocationTargetException
Caused by: org.ovirt.engine.core.common.errors.VdcBLLException:
VdcBLLException:
org.ovirt.engine.core.vdsbroker.vdsbroker.VDSNetworkException:
org.apache.xmlrpc.XmlRpcException: <type 'exceptions.Exception'>:method
"glusterTasksList" is not supported (Failed with error VDS_NETWORK_ERROR
and code 5022)
2014-02-12 18:13:20,265 ERROR
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturnForXmlRpc]
(DefaultQuartzScheduler_Worker-86) Error while populating bricks of volume
8339d0b8-49ad-4d2d-9def-102ec025937f.: java.lang.RuntimeException:
java.net.UnknownHostException: node3.bond
2014-02-12 18:13:20,658 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand]
(DefaultQuartzScheduler_Worker-75) Command ConnectStoragePoolVDS execution
failed. Exception: IRSNoMasterDomainException: IRSGenericException:
IRSErrorException: IRSNoMasterDomainException: Cannot find master domain:
'spUUID=d6fb9dc4-e727-481a-940a-4923cd1d94eb,
msdUUID=8323035b-3a0a-4c40-a45e-ca764dfdb09f'
2014-02-12 18:13:20,660 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(DefaultQuartzScheduler_Worker-75) IrsBroker::Failed::GetStoragePoolInfoVDS
2014-02-12 18:13:20,660 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(DefaultQuartzScheduler_Worker-75) Exception: IRSGenericException:
IRSErrorException: IRSNoMasterDomainException: Cannot find master domain:
'spUUID=d6fb9dc4-e727-481a-940a-4923cd1d94eb,
msdUUID=8323035b-3a0a-4c40-a45e-ca764dfdb09f'
2014-02-12 18:13:22,851 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand]
(DefaultQuartzScheduler_Worker-75) Command ConnectStoragePoolVDS execution
failed. Exception: IRSNoMasterDomainException: IRSGenericException:
IRSErrorException: IRSNoMasterDomainException: Cannot find master domain:
'spUUID=d6fb9dc4-e727-481a-940a-4923cd1d94eb,
msdUUID=8323035b-3a0a-4c40-a45e-ca764dfdb09f'
2014-02-12 18:13:22,853 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(DefaultQuartzScheduler_Worker-75) IrsBroker::Failed::GetStoragePoolInfoVDS
2014-02-12 18:13:22,853 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(DefaultQuartzScheduler_Worker-75) Exception: IRSGenericException:
IRSErrorException: IRSNoMasterDomainException: Cannot find master domain:
'spUUID=d6fb9dc4-e727-481a-940a-4923cd1d94eb,
msdUUID=8323035b-3a0a-4c40-a45e-ca764dfdb09f'
2014-02-12 18:13:25,343 ERROR
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturnForXmlRpc]
(DefaultQuartzScheduler_Worker-91) Error while populating bricks of volume
8339d0b8-49ad-4d2d-9def-102ec025937f.: java.lang.RuntimeException:
java.net.UnknownHostException: node3.bond
2014-02-12 18:13:30,420 ERROR
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturnForXmlRpc]
(DefaultQuartzScheduler_Worker-97) Error while populating bricks of volume
8339d0b8-49ad-4d2d-9def-102ec025937f.: java.lang.RuntimeException:
java.net.UnknownHostException: node3.bond
2014-02-12 18:13:32,879 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.HSMGetAllTasksStatusesVDSCommand]
(DefaultQuartzScheduler_Worker-81) Command HSMGetAllTasksStatusesVDS
execution failed. Exception: IRSNonOperationalException:
IRSGenericException: IRSErrorException: IRSNonOperationalException: Not
SPM: ()
2014-02-12 18:13:35,062 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand]
(DefaultQuartzScheduler_Worker-81) Command ConnectStoragePoolVDS execution
failed. Exception: IRSNoMasterDomainException: IRSGenericException:
IRSErrorException: IRSNoMasterDomainException: Cannot find master domain:
'spUUID=d6fb9dc4-e727-481a-940a-4923cd1d94eb,
msdUUID=8323035b-3a0a-4c40-a45e-ca764dfdb09f'
2014-02-12 18:13:35,063 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(DefaultQuartzScheduler_Worker-81) IrsBroker::Failed::GetStoragePoolInfoVDS
2014-02-12 18:13:35,064 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(DefaultQuartzScheduler_Worker-81) Exception: IRSGenericException:
IRSErrorException: IRSNoMasterDomainException: Cannot find master domain:
'spUUID=d6fb9dc4-e727-481a-940a-4923cd1d94eb,
msdUUID=8323035b-3a0a-4c40-a45e-ca764dfdb09f'
2014-02-12 18:13:35,508 ERROR
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturnForXmlRpc]
(DefaultQuartzScheduler_Worker-3) [30914b8d] Error while populating bricks
of volume 8339d0b8-49ad-4d2d-9def-102ec025937f.:
java.lang.RuntimeException: java.net.UnknownHostException: node3.bond
2014-02-12 18:13:37,239 ERROR
[org.ovirt.engine.core.vdsbroker.vdsbroker.ConnectStoragePoolVDSCommand]
(DefaultQuartzScheduler_Worker-81) Command ConnectStoragePoolVDS execution
failed. Exception: IRSNoMasterDomainException: IRSGenericException:
IRSErrorException: IRSNoMasterDomainException: Cannot find master domain:
'spUUID=d6fb9dc4-e727-481a-940a-4923cd1d94eb,
msdUUID=8323035b-3a0a-4c40-a45e-ca764dfdb09f'
2014-02-12 18:13:37,243 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(DefaultQuartzScheduler_Worker-81) IrsBroker::Failed::GetStoragePoolInfoVDS
2014-02-12 18:13:37,244 ERROR
[org.ovirt.engine.core.vdsbroker.irsbroker.IrsBrokerCommand]
(DefaultQuartzScheduler_Worker-81) Exception: IRSGenericException:
IRSErrorException: IRSNoMasterDomainException: Cannot find master domain:
'spUUID=d6fb9dc4-e727-481a-940a-4923cd1d94eb,
msdUUID=8323035b-3a0a-4c40-a45e-ca764dfdb09f'
2014-02-12 18:13:40,598 ERROR
[org.ovirt.engine.core.vdsbroker.gluster.GlusterVolumesListReturnForXmlRpc]
(DefaultQuartzScheduler_Worker-13) Error while populating bricks of volume
8339d0b8-49ad-4d2d-9def-102ec025937f.: java.lang.RuntimeException:
java.net.UnknownHostException: node3.bond

I guess the brick details are stored in the postgres database and
everything else after will fail?!

Am i the only one with dedicated migration/storage interfaces? :)

Thanks,
Mario

On Wed, Feb 12, 2014 at 5:24 AM, Sahina Bose <sabose at redhat.com> wrote:

>
> On 02/12/2014 12:28 AM, ml ml wrote:
>
>  ...hmm....do i want/mean geo-replication?
>
>  if yes, i a missing this tab here:
> http://www.ovirt.org/images/5/51/Georepsession1list.png
>
>
> No. Geo-replication is for disaster recovery by replicating your gluster
> volume to a cluster in a different geography. And note that the management
> and monitoring of gluster geo-replication has not yet been added in oVirt.
>
> I think what you are looking for is the synchronous replication provided
> by the "replicated" volume types. Currently, there's no way to specify the
> interface to be used for gluster communication from within oVirt.  Please
> refer to this thread -
> http://lists.ovirt.org/pipermail/users/2014-February/020894.html - for
> help in setting this up.
>
>
>
> On Tue, Feb 11, 2014 at 5:40 PM, ml ml <mliebherr99 at googlemail.com> wrote:
>
>>     Hello List,
>>
>>  i would like to use a dedicated Bonding Interface for Gluster
>> Replication and Migration.
>>
>>  I was already able to add my Bonding Interfaces in my Hosts-Network Tab,
>> however i am failing to tell Gluster to use this interface. It only offers
>> me nodeX.local (which is my managment network).
>>
>>  More infos are collected here: http://oi58.tinypic.com/v6qaa1.jpg
>>
>>  Can someone tell me how to configure Gluster to use the dedicated bond
>> interface?
>>
>>  I already asked in the IRC Channel but nobody seems to know :-/
>>
>>  Thanks,
>>  Mario
>>
>
>
>
> _______________________________________________
> Users mailing listUsers at ovirt.orghttp://lists.ovirt.org/mailman/listinfo/users
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20140212/461ac53c/attachment-0001.html>