On Fri, Sep 13, 2019 at 3:54 PM Mikael Öhman <micketeer@gmail.com> wrote:
Perhaps it will help future sysadmins will learn from my mistake.
I also saw very poor upload speeds (~30MB/s) no matter what I tried. I went through the whole route with unix-sockets and whatnot.

But, in the end, it just turned out that the glusterfs itself was the bottleneck; abysmal performance for small block sizes.

What do you mean by "small block sizes"?

I found the list of suggested performance tweaks that RHEL suggests. In particular, it was the "network.remote-dio=on" setting that made all the difference. Almost 10x faster.

Note that network.remote-dio is not the recommended configuration
for ovirt, in particular if on hyperconverge setup when it can be harmful
by delaying sanlock I/O.

(Patch in discussion)

Nir