On Wed, Apr 24, 2019 at 12:13 AM Dev Ops <sipandbite(a)hotmail.com> wrote:
I am working on integrating a backup solution for our ovirt
environment
and having issues with the time it takes to backup the VM's. This backup
solution is simply taking a snapshot and making a clone and backing the
clone up to a backup server.
A VM that is 100 gig takes 52 minutes to back up. The same VM doing a file
backup using the same product, and bypassing their rhv plugin, takes 14
minutes. So the throughput is there but the ovirt imageio-proxy process
seems to be what manages how images are uploaded and is officially my
bottle neck. Load is not high on the engine or kvm hosts.
I had bumped up the Upload image size from 100MB to 10gig weeks ago and
that didn't seem to help.
[root@blah-lab-engine ~]# engine-config -a |grep Upload
UploadImageChunkSizeKB: 10240000 version: general
This will not help, 100 MiB should be big enough.
[root@bgl-vms-engine ~]# rpm -qa |grep ovirt-image
ovirt-imageio-proxy-1.4.6-1.el7.noarch
ovirt-imageio-common-1.4.6-1.el7.x86_64
ovirt-imageio-proxy-setup-1.4.6-1.el7.noarch
I have seen bugs reported to redhat about this but I am running above the
affected releases.
engine software is 4.2.8.2-1.el7
Any idea what we can tweak to open up this bottleneck?
The proxy is not meant to be used for backup and restore. It was created to
allow easy upload or
download from the UI.
For backup application you should use upload and download directly from the
host.
When you create an image transfer, you should use the image transfer
"transfer_url" instead of the "proxy_url".
When you upload or download directly from the host, you can take advantage
of keep alive connections
and fast zero support.
If your upload or download program is running on the host, you can take
advantage of unix socket support
for even faster transfers.
For upload, you should use ovirt_imageio_common.client module, using all
available features:
https://github.com/oVirt/ovirt-imageio/blob/master/examples/upload
The client does not provide a easy to use helper for download yet. A future
version will provide
download helper.
Please see the documentation:
http://ovirt.github.io/ovirt-imageio/random-io.html
http://ovirt.github.io/ovirt-imageio/unix-socket.html
And SDK examples:
https://github.com/oVirt/ovirt-engine-sdk/blob/master/sdk/examples/upload...
https://github.com/oVirt/ovirt-engine-sdk/blob/master/sdk/examples/downlo...
If direct download is still too slow, please file a bug and provide logs
imageio daemon logs.
Nir