Dear all, I have an Ovirt cluster with 3 Dell R7525 nodes and about 70 virtual machines. I have been using ovirtbackup (python) for a long time to save the VMs. Unfortunately it has always been a very slow process that with time and the ever-increasing size of the VMs has become unusable. The oVirt cluster has two storage domains. "DATA" is a the fibre channel type (8Gbs) with 18TB and an EXPORT domain NFS managed by a dual-processor server HPE Proliant with 4x1Gbs. I'll give you an example. I have a vm with four vdisk for a 1.8TB and these are the steps performed to backup this VM. As you will see it takes many hours to get the clone from the snapshot and then many hours to copy the clone to the NFS storage. How can I reduce the time needed to save ? Thank you ! Best Regards Enrico ----------------------------------------------------------------- Feb 2, 2025, 6:26:47 AM Snapshot 'Snapshot for backup script' creation for VM 'GRAYLOG-9' was initiated by admin@internal-authz. 45 admin@internal-authz infn-vm10.management GRAYLOG-9 Blank INFNPG DELL 70bbb81b-ed44-4700-839a-96c1df8daeea oVirt ----------------------------------------------------------------- Feb 2, 2025, 6:27:22 AM Snapshot 'Snapshot for backup script' creation for VM 'GRAYLOG-9' has been completed. 68 admin@internal-authz infn-vm10.management GRAYLOG-9 Blank INFNPG DELL 70bbb81b-ed44-4700-839a-96c1df8daeea oVirt ----------------------------------------------------------------- Feb 2, 2025, 6:27:37 AM VM GRAYLOG-9_BCK_020244 creation was initiated by admin@internal-authz. 37 admin@internal-authz GRAYLOG-9_BCK_020244 Blank INFNPG DATA_FC_P2050 DELL edde40d9-2a26-4d88-8a02-bd928c1ded4a oVirt ----------------------------------------------------------------- Feb 2, 2025, 1:59:30 PM VM GRAYLOG-9_BCK_020244 creation has been completed. 53 admin@internal-authz GRAYLOG-9_BCK_020244 Blank INFNPG DATA_FC_P2050 DELL edde40d9-2a26-4d88-8a02-bd928c1ded4a oVirt ----------------------------------------------------------------- Feb 2, 2025, 1:59:34 PM Snapshot 'Snapshot for backup script' deletion for VM 'GRAYLOG-9' was initiated by admin@internal-authz. 342 admin@internal-authz infn-vm10.management GRAYLOG-9 Blank INFNPG DELL fcfc6291-a55f-431a-8b4c-87cb8e3615ff oVirt ----------------------------------------------------------------- Feb 2, 2025, 2:04:00 PM Snapshot 'Snapshot for backup script' deletion for VM 'GRAYLOG-9' has been completed. 356 admin@internal-authz infn-vm10.management GRAYLOG-9 Blank INFNPG DELL fcfc6291-a55f-431a-8b4c-87cb8e3615ff oVirt ----------------------------------------------------------------- Feb 2, 2025, 2:04:08 PM Starting export Vm GRAYLOG-9_BCK_020244 to VMS_EXPORT 1162 admin@internal-authz GRAYLOG-9_BCK_020244 INFNPG VMS_EXPORT DELL b964e3b3-df13-4b82-8128-00984eea380b oVirt ----------------------------------------------------------------- Feb 4, 2025, 5:27:50 AM Vm GRAYLOG-9_BCK_020244 was exported successfully to VMS_EXPORT 1150 admin@internal-authz GRAYLOG-9_BCK_020244 INFNPG VMS_EXPORT DELL b964e3b3-df13-4b82-8128-00984eea380b oVirt ----------------------------------------------------------------- Feb 4, 2025, 5:27:53 AM VM GRAYLOG-9_BCK_020244 configuration was updated by admin@internal-authz. 35 admin@internal-authz GRAYLOG-9_BCK_020244 Blank INFNPG DELL 44480c68-10ad-4660-bd9b-297043210503 oVirt ----------------------------------------------------------------- Feb 4, 2025, 5:28:00 AM VM GRAYLOG-9_BCK_020244 was successfully removed by admin@internal-authz. 113 admin@internal-authz GRAYLOG-9_BCK_020244 Blank INFNPG DELL d141ad60-6cf8-4e77-b438-26b5481f4256 oVirt ----------------------------------------------------------------- _______________________________________________ Users mailing list -- users(a)ovirt.org To unsubscribe send an email to users-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/WNJZ5DAR2UE...

Same here. We happily use storware vprotect, performing full backups during the weekend and a couple of incremental backups every other day (for some VM 4 backups a day), for every VM living in our cluster. Full backup is quite slow (obviously proportional to VM size), but incremental backup is a matter of (few) minutes. An export domain is not the right choice for backups, I think you should look at it as a storage to move around VMs (between datacenters) when you need. HTH, gc On 04/02/2025 15:11, Jayme wrote: > I've always found the same personally. You'd be much better off if > you could implement an incremental backup solution. vProtect is one > option that might do the job > > > On Tue, Feb 4, 2025 at 9:44 AM Enrico Becchetti via Users > <users(a)ovirt.org <mailto:users@ovirt.org>> wrote: > >         Dear all, >     I have an Ovirt cluster with 3 Dell R7525 nodes and about 70 virtual >     machines. I have been using ovirtbackup (python) for a long time to >     save >     the VMs. > >     Unfortunately it has always been a very slow process that with > time and >     the ever-increasing size of the VMs has become unusable. > >     The oVirt cluster has two storage domains. "DATA" is a the fibre >     channel >     type (8Gbs) with 18TB and an EXPORT domain NFS  managed by a >     dual-processor server HPE Proliant with 4x1Gbs. > >     I'll give you an example. I have a vm with four vdisk for a 1.8TB > and >     these are the steps performed to backup this VM. >     As you will see it takes many hours to get the clone from the > snapshot >     and then many hours to copy the clone to the NFS storage. >     How can I reduce the time needed to save ? >     Thank you ! >     Best Regards >     Enrico > > ----------------------------------------------------------------- >     Feb 2, 2025, 6:26:47 AM >     Snapshot 'Snapshot for backup script' creation for VM 'GRAYLOG-9' > was >     initiated by admin@internal-authz. >     45 >     admin@internal-authz >     infn-vm10.management >     GRAYLOG-9 >     Blank >     INFNPG >     DELL >     70bbb81b-ed44-4700-839a-96c1df8daeea >     oVirt >   ----------------------------------------------------------------- > >     Feb 2, 2025, 6:27:22 AM >     Snapshot 'Snapshot for backup script' creation for VM 'GRAYLOG-9' > has >     been completed. >     68 >     admin@internal-authz >     infn-vm10.management >     GRAYLOG-9 >     Blank >     INFNPG >     DELL >     70bbb81b-ed44-4700-839a-96c1df8daeea >     oVirt >   ----------------------------------------------------------------- > >     Feb 2, 2025, 6:27:37 AM >     VM GRAYLOG-9_BCK_020244 creation was initiated by > admin@internal-authz. >     37 >     admin@internal-authz >     GRAYLOG-9_BCK_020244 >     Blank >     INFNPG >     DATA_FC_P2050 >     DELL >     edde40d9-2a26-4d88-8a02-bd928c1ded4a >     oVirt >   ----------------------------------------------------------------- > >     Feb 2, 2025, 1:59:30 PM >     VM GRAYLOG-9_BCK_020244 creation has been completed. >     53 >     admin@internal-authz >     GRAYLOG-9_BCK_020244 >     Blank >     INFNPG >     DATA_FC_P2050 >     DELL >     edde40d9-2a26-4d88-8a02-bd928c1ded4a >     oVirt >   ----------------------------------------------------------------- > >     Feb 2, 2025, 1:59:34 PM >     Snapshot 'Snapshot for backup script' deletion for VM 'GRAYLOG-9' > was >     initiated by admin@internal-authz. >     342 >     admin@internal-authz >     infn-vm10.management >     GRAYLOG-9 >     Blank >     INFNPG >     DELL >     fcfc6291-a55f-431a-8b4c-87cb8e3615ff >     oVirt >   ----------------------------------------------------------------- > >     Feb 2, 2025, 2:04:00 PM >     Snapshot 'Snapshot for backup script' deletion for VM 'GRAYLOG-9' > has >     been completed. >     356 >     admin@internal-authz >     infn-vm10.management >     GRAYLOG-9 >     Blank >     INFNPG >     DELL >     fcfc6291-a55f-431a-8b4c-87cb8e3615ff >     oVirt >   ----------------------------------------------------------------- > >     Feb 2, 2025, 2:04:08 PM >     Starting export Vm GRAYLOG-9_BCK_020244 to VMS_EXPORT >     1162 >     admin@internal-authz >     GRAYLOG-9_BCK_020244 >     INFNPG >     VMS_EXPORT >     DELL >     b964e3b3-df13-4b82-8128-00984eea380b >     oVirt >   ----------------------------------------------------------------- > >     Feb 4, 2025, 5:27:50 AM >     Vm GRAYLOG-9_BCK_020244 was exported successfully to VMS_EXPORT >     1150 >     admin@internal-authz >     GRAYLOG-9_BCK_020244 >     INFNPG >     VMS_EXPORT >     DELL >     b964e3b3-df13-4b82-8128-00984eea380b >     oVirt >   ----------------------------------------------------------------- > >     Feb 4, 2025, 5:27:53 AM >     VM GRAYLOG-9_BCK_020244 configuration was updated by admin@internal- >     authz. >     35 >     admin@internal-authz >     GRAYLOG-9_BCK_020244 >     Blank >     INFNPG >     DELL >     44480c68-10ad-4660-bd9b-297043210503 >     oVirt >   ----------------------------------------------------------------- > >     Feb 4, 2025, 5:28:00 AM >     VM GRAYLOG-9_BCK_020244 was successfully removed by admin@internal- >     authz. >     113 >     admin@internal-authz >     GRAYLOG-9_BCK_020244 >     Blank >     INFNPG >     DELL >     d141ad60-6cf8-4e77-b438-26b5481f4256 >     oVirt >   ----------------------------------------------------------------- >     _______________________________________________ >     Users mailing list -- users(a)ovirt.org <mailto:users@ovirt.org> >     To unsubscribe send an email to users-leave(a)ovirt.org <mailto:users- >     leave(a)ovirt.org&gt; >     Privacy Statement: https://www.ovirt.org/privacy-policy.html >     <https://www.ovirt.org/privacy-policy.html> >     oVirt Code of Conduct: https://www.ovirt.org/community/about/ >     community-guidelines/ <https://www.ovirt.org/community/about/ >     community-guidelines/> >     List Archives: https://lists.ovirt.org/archives/list/ >     users(a)ovirt.org/message/WNJZ5DAR2UEOVWTRKLEQJR77UKZ3UQHK/ <https:// >     lists.ovirt.org/archives/list/users@ovirt.org/message/ >     WNJZ5DAR2UEOVWTRKLEQJR77UKZ3UQHK/> > > > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/3N4SDOCC2Z5... _______________________________________________ Users mailing list -- users(a)ovirt.org To unsubscribe send an email to users-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/ZSUUFTJYL3G...

Correct, usually backups are performed through the snapshots mechanism, not cloning the VM. Ovirt implements also other export mechanism for backups (for example CBT, changed block tracking) that minimize the amount of data to be transfered. On 04/02/2025 16:00, Enrico Becchetti via Users wrote: > Dear all > > What do you think about the VM clone creation which happens very > slowly even though the domain data is fibre channel ? > with vproect it would be faster because it does not use this > mechanism to make backups? > > Enrico > > Il 04/02/25 15:24, Giulio Casella ha scritto: >> Same here. >> We happily use storware vprotect, performing full backups during the >> weekend and a couple of incremental backups every other day (for >> some VM 4 backups a day), for every VM living in our cluster. >> >> Full backup is quite slow (obviously proportional to VM size), but >> incremental backup is a matter of (few) minutes. >> >> An export domain is not the right choice for backups, I think you >> should look at it as a storage to move around VMs (between >> datacenters) when you need. >> >> HTH, >> gc >> >> >> On 04/02/2025 15:11, Jayme wrote: >>> I've always found the same personally. You'd be much better off if >>> you could implement an incremental backup solution. vProtect is one >>> option that might do the job >>> >>> >>> On Tue, Feb 4, 2025 at 9:44 AM Enrico Becchetti via Users >>> <users(a)ovirt.org <mailto:users@ovirt.org>> wrote: >>> >>>         Dear all, >>>     I have an Ovirt cluster with 3 Dell R7525 nodes and about 70 >>> virtual >>>     machines. I have been using ovirtbackup (python) for a long >>> time to >>>     save >>>     the VMs. >>> >>>     Unfortunately it has always been a very slow process that with >>> time and >>>     the ever-increasing size of the VMs has become unusable. >>> >>>     The oVirt cluster has two storage domains. "DATA" is a the fibre >>>     channel >>>     type (8Gbs) with 18TB and an EXPORT domain NFS  managed by a >>>     dual-processor server HPE Proliant with 4x1Gbs. >>> >>>     I'll give you an example. I have a vm with four vdisk for a >>> 1.8TB and >>>     these are the steps performed to backup this VM. >>>     As you will see it takes many hours to get the clone from the >>> snapshot >>>     and then many hours to copy the clone to the NFS storage. >>>     How can I reduce the time needed to save ? >>>     Thank you ! >>>     Best Regards >>>     Enrico >>> >>> ----------------------------------------------------------------- >>>     Feb 2, 2025, 6:26:47 AM >>>     Snapshot 'Snapshot for backup script' creation for VM >>> 'GRAYLOG-9' was >>>     initiated by admin@internal-authz. >>>     45 >>>     admin@internal-authz >>>     infn-vm10.management >>>     GRAYLOG-9 >>>     Blank >>>     INFNPG >>>     DELL >>>     70bbb81b-ed44-4700-839a-96c1df8daeea >>>     oVirt >>>   ----------------------------------------------------------------- >>> >>>     Feb 2, 2025, 6:27:22 AM >>>     Snapshot 'Snapshot for backup script' creation for VM >>> 'GRAYLOG-9' has >>>     been completed. >>>     68 >>>     admin@internal-authz >>>     infn-vm10.management >>>     GRAYLOG-9 >>>     Blank >>>     INFNPG >>>     DELL >>>     70bbb81b-ed44-4700-839a-96c1df8daeea >>>     oVirt >>>   ----------------------------------------------------------------- >>> >>>     Feb 2, 2025, 6:27:37 AM >>>     VM GRAYLOG-9_BCK_020244 creation was initiated by >>> admin@internal- authz. >>>     37 >>>     admin@internal-authz >>>     GRAYLOG-9_BCK_020244 >>>     Blank >>>     INFNPG >>>     DATA_FC_P2050 >>>     DELL >>>     edde40d9-2a26-4d88-8a02-bd928c1ded4a >>>     oVirt >>>   ----------------------------------------------------------------- >>> >>>     Feb 2, 2025, 1:59:30 PM >>>     VM GRAYLOG-9_BCK_020244 creation has been completed. >>>     53 >>>     admin@internal-authz >>>     GRAYLOG-9_BCK_020244 >>>     Blank >>>     INFNPG >>>     DATA_FC_P2050 >>>     DELL >>>     edde40d9-2a26-4d88-8a02-bd928c1ded4a >>>     oVirt >>>   ----------------------------------------------------------------- >>> >>>     Feb 2, 2025, 1:59:34 PM >>>     Snapshot 'Snapshot for backup script' deletion for VM >>> 'GRAYLOG-9' was >>>     initiated by admin@internal-authz. >>>     342 >>>     admin@internal-authz >>>     infn-vm10.management >>>     GRAYLOG-9 >>>     Blank >>>     INFNPG >>>     DELL >>>     fcfc6291-a55f-431a-8b4c-87cb8e3615ff >>>     oVirt >>>   ----------------------------------------------------------------- >>> >>>     Feb 2, 2025, 2:04:00 PM >>>     Snapshot 'Snapshot for backup script' deletion for VM >>> 'GRAYLOG-9' has >>>     been completed. >>>     356 >>>     admin@internal-authz >>>     infn-vm10.management >>>     GRAYLOG-9 >>>     Blank >>>     INFNPG >>>     DELL >>>     fcfc6291-a55f-431a-8b4c-87cb8e3615ff >>>     oVirt >>>   ----------------------------------------------------------------- >>> >>>     Feb 2, 2025, 2:04:08 PM >>>     Starting export Vm GRAYLOG-9_BCK_020244 to VMS_EXPORT >>>     1162 >>>     admin@internal-authz >>>     GRAYLOG-9_BCK_020244 >>>     INFNPG >>>     VMS_EXPORT >>>     DELL >>>     b964e3b3-df13-4b82-8128-00984eea380b >>>     oVirt >>>   ----------------------------------------------------------------- >>> >>>     Feb 4, 2025, 5:27:50 AM >>>     Vm GRAYLOG-9_BCK_020244 was exported successfully to VMS_EXPORT >>>     1150 >>>     admin@internal-authz >>>     GRAYLOG-9_BCK_020244 >>>     INFNPG >>>     VMS_EXPORT >>>     DELL >>>     b964e3b3-df13-4b82-8128-00984eea380b >>>     oVirt >>>   ----------------------------------------------------------------- >>> >>>     Feb 4, 2025, 5:27:53 AM >>>     VM GRAYLOG-9_BCK_020244 configuration was updated by >>> admin@internal- >>>     authz. >>>     35 >>>     admin@internal-authz >>>     GRAYLOG-9_BCK_020244 >>>     Blank >>>     INFNPG >>>     DELL >>>     44480c68-10ad-4660-bd9b-297043210503 >>>     oVirt >>>   ----------------------------------------------------------------- >>> >>>     Feb 4, 2025, 5:28:00 AM >>>     VM GRAYLOG-9_BCK_020244 was successfully removed by >>> admin@internal- >>>     authz. >>>     113 >>>     admin@internal-authz >>>     GRAYLOG-9_BCK_020244 >>>     Blank >>>     INFNPG >>>     DELL >>>     d141ad60-6cf8-4e77-b438-26b5481f4256 >>>     oVirt >>>   ----------------------------------------------------------------- >>>     _______________________________________________ >>>     Users mailing list -- users(a)ovirt.org <mailto:users@ovirt.org> >>>     To unsubscribe send an email to users-leave(a)ovirt.org >>> <mailto:users- >>>     leave(a)ovirt.org&gt; >>>     Privacy Statement: https://www.ovirt.org/privacy-policy.html >>>     <https://www.ovirt.org/privacy-policy.html> >>>     oVirt Code of Conduct: https://www.ovirt.org/community/about/ >>>     community-guidelines/ <https://www.ovirt.org/community/about/ >>>     community-guidelines/> >>>     List Archives: https://lists.ovirt.org/archives/list/ >>> users(a)ovirt.org/message/WNJZ5DAR2UEOVWTRKLEQJR77UKZ3UQHK/ <https:// >>>     lists.ovirt.org/archives/list/users@ovirt.org/message/ >>>     WNJZ5DAR2UEOVWTRKLEQJR77UKZ3UQHK/> >>> >>> >>> _______________________________________________ >>> Users mailing list -- users(a)ovirt.org >>> To unsubscribe send an email to users-leave(a)ovirt.org >>> Privacy Statement: https://www.ovirt.org/privacy-policy.html >>> oVirt Code of Conduct: https://www.ovirt.org/community/about/ >>> community-guidelines/ >>> List Archives: >>> https://lists.ovirt.org/archives/list/users@ovirt.org/ >>> message/3N4SDOCC2Z5PF5DCRBEEHRKJ2IBQX3XB/ >> >> _______________________________________________ >> Users mailing list -- users(a)ovirt.org >> To unsubscribe send an email to users-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/privacy-policy.html >> oVirt Code of Conduct: https://www.ovirt.org/community/about/ >> community-guidelines/ >> List Archives: >> https://lists.ovirt.org/archives/list/users@ovirt.org/ >> message/ZSUUFTJYL3GLD4P6QV2S7DS42AWBM64F/ >