On May 21, 2019 06:00, Satheesaran Sundaramoorthi <sasundar@redhat.com> wrote:
>
>
> On Fri, May 17, 2019 at 1:12 AM Nir Soffer <nsoffer@redhat.com> wrote:
>>
>> On Thu, May 16, 2019 at 10:12 PM Darrell Budic <budic@onholyground.com> wrote:
>>>
>>> On May 16, 2019, at 1:41 PM, Nir Soffer <nsoffer@redhat.com> wrote:
>>>>
>>>>
>>>> On Thu, May 16, 2019 at 8:38 PM Darrell Budic <budic@onholyground.com> wrote:
>>>>>
>>>>> I tried adding a new storage domain on my hyper converged test cluster running Ovirt 4.3.3.7 and gluster 6.1. I was able to create the new gluster volume fine, but it’s not able to add the gluster storage domain (as either a managed gluster volume or directly entering values). The created gluster volume mounts and looks fine from the CLI. Errors in VDSM log:
>>>>>
>>>> ... 
>>>>>
>>>>> 2019-05-16 10:25:09,584-0500 ERROR (jsonrpc/5) [storage.fileSD] Underlying file system doesn't supportdirect IO (fileSD:110)
>>>>> 2019-05-16 10:25:09,584-0500 INFO  (jsonrpc/5) [vdsm.api] FINISH createStorageDomain error=Storage Domain target is unsupported: () from=::ffff:10.100.90.5,44732, flow_id=31d993dd, task_id=ecea28f3-60d4-476d-9ba8-b753b7c9940d (api:52)
>>>>
>>>>
>>>> The direct I/O check has failed.
>>>>
>>>>
>>>> So something is wrong in the files system.
>>>>
>>>> To confirm, you can try to do:
>>>>
>>>> dd if=/dev/zero of=/path/to/mountoint/test bs=4096 count=1 oflag=direct
>>>>
>>>> This will probably fail with:
>>>> dd: failed to open '/path/to/mountoint/test': Invalid argument
>>>>
>>>> If it succeeds, but oVirt fail to connect to this domain, file a bug and we will investigate.
>>>>
>>>> Nir
>>>
>>>
>>> Yep, it fails as expected. Just to check, it is working on pre-existing volumes, so I poked around at gluster settings for the new volume. It has network.remote-dio=off set on the new volume, but enabled on old volumes. After enabling it, I’m able to run the dd test:
>>>
>>> [root@boneyard mnt]# gluster vol set test network.remote-dio enable
>>> volume set: success
>>> [root@boneyard mnt]# dd if=/dev/zero of=testfile bs=4096 count=1 oflag=direct
>>> 1+0 records in
>>> 1+0 records out
>>> 4096 bytes (4.1 kB) copied, 0.0018285 s, 2.2 MB/s
>>>
>>> I’m also able to add the storage domain in ovirt now.
>>>
>>> I see network.remote-dio=enable is part of the gluster virt group, so apparently it’s not getting set by ovirt duding the volume creation/optimze for storage?
>>
>>
>> I'm not sure who is responsible for changing these settings. oVirt always required directio, and we
>> never had to change anything in gluster.
>>
>> Sahina, maybe gluster changed the defaults?
>>
>> Darrell, please file a bug, probably for RHHI.
>
>
> Hello Darrell & Nir,
>
> Do we have a bug available now for this issue ?
> I just need to make sure performance.strict-o-direct=on is enabled on that volume.
>
>
> Satheesaran Sundaramoorthi
>
> Senior Quality Engineer, RHHI-V QE
>
> Red Hat APAC
>

Please check https://bugzilla.redhat.com/show_bug.cgi?id=1711054

Best Regards,
Strahil Nikolov