I am working on integrating a backup solution for our ovirt environment and having issues with the time it takes to backup the VM's. This backup solution is simply taking a snapshot and making a clone and backing the clone up to a backup server.
A VM that is 100 gig takes 52 minutes to back up. The same VM doing a file backup using the same product, and bypassing their rhv plugin, takes 14 minutes. So the throughput is there but the ovirt imageio-proxy process seems to be what manages how images are uploaded and is officially my bottle neck. Load is not high on the engine or kvm hosts.
I had bumped up the Upload image size from 100MB to 10gig weeks ago and that didn't seem to help.
[root@blah-lab-engine ~]# engine-config -a |grep Upload
UploadImageChunkSizeKB: 10240000 version: general
This will not help, 100 MiB should be big enough.
[root@bgl-vms-engine ~]# rpm -qa |grep ovirt-image
ovirt-imageio-proxy-1.4.6-1.el7.noarch
ovirt-imageio-common-1.4.6-1.el7.x86_64
ovirt-imageio-proxy-setup-1.4.6-1.el7.noarch
I have seen bugs reported to redhat about this but I am running above the affected releases.
engine software is 4.2.8.2-1.el7
Any idea what we can tweak to open up this bottleneck?
The proxy is not meant to be used for backup and restore. It was created to allow easy upload or
download from the UI.
For backup application you should use upload and download directly from the host.
When you create an image transfer, you should use the image transfer "transfer_url" instead of the "proxy_url".
When you upload or download directly from the host, you can take advantage of keep alive connections
and fast zero support.
If your upload or download program is running on the host, you can take advantage of unix socket support
for even faster transfers.
For upload, you should use ovirt_imageio_common.client module, using all available features:
The client does not provide a easy to use helper for download yet. A future version will provide
download helper.
Please see the documentation:
And SDK examples:
If direct download is still too slow, please file a bug and provide logs imageio daemon logs.
Nir