[Users] oVirt 3.1 -- GlusterFS 3.3

[Robert Middleswarth]

On 06/26/2012 12:28 AM, Itamar Heim wrote:
> On 06/26/2012 12:22 AM, Robert Middleswarth wrote:
>> On 06/25/2012 11:50 PM, Itamar Heim wrote:
>>> On 06/25/2012 07:59 PM, Nathan Stratton wrote:
>>>>
>>>> Steps:
>>>>
>>>> 1) Installed ovirt-engine, configured Cluster for GlusterFS
>>>> 2) Installed 8 ovirt 3.1 nodes
>>>> 3) Joined all 8 notes with ovirt-engine (all up and happy)
>>>> 4) Manually added all 8 peers for GlusterFS on hosts (all peers happy)
>>>
>>> I thought ovirt engine takes care of that.
>>> did you add these nodes to a gluster cluster from the UI?
>>>
>> No it doesn't. I have done several installs. I already bugged the issue
>> about the fact that the iptables ports don't get opened and if you do
>> anything inside the engine that updates the iptables it removes the ones
>> I manually add. I have done both a f17 install using beta and Jenkins
>> and the CentOS builds including the latest build 8 and none of these
>> setup IP tables or links the nodes.
>
> ip tables - no.
> peer addition - from what i understand, works if you use installVds=false
>
> still needs to be fixed to work with installVds=true as well.
>
> option A - a hacky way for now might be:
> 1. use installVds=true
> 2. add all hosts so they will get configured with vdsm and 
> certificates and regular ip tables
> 3. change installVds to false
> 4. remove/add them with the gluster flag
>
> not sure worth it for peer detection for now.
>
> option B
> 1. set InstallVds=false and disable ssl
> 2. yum install the hosts yourself
>
> option C
> 1. use like today and do peer detection manually until resolved.
>
> btw, i saw you manged to get it to work using NFS.
> did you try the gluster native client/mount as well?
For several weeks.  I got close but couldn't get that last 1 %.  I might 
try again after the beta2 builds come out but from reading on the net I 
am not sure how much using posix fs will get me compared to the cached 
nfs shares pointing at the local disk?  Maybe you guys can tell me why 
using the posix fs is going to be so much better?

Thanks
Robert
>
>
>
>>
>> Thanks
>> Robert
>>>> 5) Create Volume errors:
>>>>
>>>> 2012-06-25 16:44:42,412 WARN
>>>> [org.ovirt.engine.core.dal.job.ExecutionMessageDirector]
>>>> (ajp--0.0.0.0-8009-4) [6c02c1f5] The message key 
>>>> CreateGlusterVolume is
>>>> missing from bundles/ExecutionMessages
>>>> 2012-06-25 16:44:42,483 INFO
>>>> [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
>>>> (ajp--0.0.0.0-8009-4) [6c02c1f5] Running command:
>>>> CreateGlusterVolumeCommand internal: false. Entities affected : ID:
>>>> 99408929-82cf-4dc7-a532-9d998063fa95 Type: VdsGroups
>>>> 2012-06-25 16:44:42,486 INFO
>>>> [org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand] 
>>>>
>>>> (ajp--0.0.0.0-8009-4) [6c02c1f5] START,
>>>> CreateGlusterVolumeVDSCommand(vdsId =
>>>> 8324ff12-bf1c-11e1-b235-43d3f71a81d8), log id: 15757d4c
>>>> 2012-06-25 16:44:42,593 ERROR
>>>> [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase]
>>>> (ajp--0.0.0.0-8009-4) [6c02c1f5] Failed in CreateGlusterVolumeVDS 
>>>> method
>>>> 2012-06-25 16:44:42,594 ERROR
>>>> [org.ovirt.engine.core.vdsbroker.vdsbroker.BrokerCommandBase]
>>>> (ajp--0.0.0.0-8009-4) [6c02c1f5] Error code unexpected and error 
>>>> message
>>>> VDSGenericException: VDSErrorException: Failed to
>>>> CreateGlusterVolumeVDS, error = Unexpected exception
>>>> 2012-06-25 16:44:42,594 ERROR
>>>> [org.ovirt.engine.core.vdsbroker.VDSCommandBase] (ajp--0.0.0.0-8009-4)
>>>> [6c02c1f5] Command CreateGlusterVolumeVDS execution failed. Exception:
>>>> VDSErrorException: VDSGenericException: VDSErrorException: Failed to
>>>> CreateGlusterVolumeVDS, error = Unexpected exception
>>>> 2012-06-25 16:44:42,595 INFO
>>>> [org.ovirt.engine.core.vdsbroker.gluster.CreateGlusterVolumeVDSCommand] 
>>>>
>>>> (ajp--0.0.0.0-8009-4) [6c02c1f5] FINISH, 
>>>> CreateGlusterVolumeVDSCommand,
>>>> log id: 15757d4c
>>>> 2012-06-25 16:44:42,596 ERROR
>>>> [org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand]
>>>> (ajp--0.0.0.0-8009-4) [6c02c1f5] Command
>>>> org.ovirt.engine.core.bll.gluster.CreateGlusterVolumeCommand throw Vdc
>>>> Bll exception. With error message VdcBLLException:
>>>> org.ovirt.engine.core.vdsbroker.vdsbroker.VDSErrorException:
>>>> VDSGenericException: VDSErrorException: Failed to
>>>> CreateGlusterVolumeVDS, error = Unexpected exception
>>>>
>>>>
>>>>> <>
>>>> Nathan Stratton
>>>> nathan at robotics.net
>>>> http://www.robotics.net
>>>> _______________________________________________
>>>> Users mailing list
>>>> Users at ovirt.org
>>>> http://lists.ovirt.org/mailman/listinfo/users
>>>
>>> _______________________________________________
>>> Users mailing list
>>> Users at ovirt.org
>>> http://lists.ovirt.org/mailman/listinfo/users
>>
>>
>> _______________________________________________
>> Users mailing list
>> Users at ovirt.org
>> http://lists.ovirt.org/mailman/listinfo/users
>