[ovirt-users] Re: oVirt 4.5.5 snapshot - Migration failed due to an Error: Fatal error during migration

Hi Jorge, To get reliable migration, I had to have a 2 Gbps link. Before that, I would migrate one VM at a time to avoid migration failures. On Thu, Aug 10, 2023 at 5:45 PM Jorge Visentini <jorgevisentini(a)gmail.com&gt; wrote: > Any tips about this error? > > 2023-08-10 18:24:57,544-03 INFO > [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (default task-4) > [633be3a0-3afd-490c-b412-805d2b14e1c2] Lock Acquired to object > 'EngineLock:{exclusiveLocks='[29032e83-cfaf-4d30-bcc2-df72c5358552=VM]', > sharedLocks=''}' > 2023-08-10 18:24:57,578-03 INFO > [org.ovirt.engine.core.bll.MigrateVmToServerCommand] (default task-4) > [633be3a0-3afd-490c-b412-805d2b14e1c2] Running command: > MigrateVmToServerCommand internal: false. Entities affected : ID: > 29032e83-cfaf-4d30-bcc2-df72c5358552 Type: VMAction group MIGRATE_VM with > role type USER > 2023-08-10 18:24:57,628-03 INFO > [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-4) > [633be3a0-3afd-490c-b412-805d2b14e1c2] START, MigrateVDSCommand( > MigrateVDSCommandParameters:{hostId='282b69aa-8b74-4312-8cc0-9c20e01982b7', > vmId='29032e83-cfaf-4d30-bcc2-df72c5358552', srcHost='ksmmi1r01ovirt18', > dstVdsId='73c38b36-36da-4ffa-b17a-492fd7b093ae', > dstHost='ksmmi1r01ovirt19:54321', migrationMethod='ONLINE', > tunnelMigration='false', migrationDowntime='0', autoConverge='true', > migrateCompressed='false', migrateEncrypted='false', consoleAddress='null', > maxBandwidth='3125', parallel='null', enableGuestEvents='true', > maxIncomingMigrations='2', maxOutgoingMigrations='2', > convergenceSchedule='[init=[{name=setDowntime, params=[100]}], > stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, > action={name=setDowntime, params=[200]}}, {limit=3, > action={name=setDowntime, params=[300]}}, {limit=4, > action={name=setDowntime, params=[400]}}, {limit=6, > action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, > params=[]}}]]', dstQemu='10.250.156.19', cpusets='null', > numaNodesets='null'}), log id: 5bbc21d6 > 2023-08-10 18:24:57,628-03 INFO > [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] > (default task-4) [633be3a0-3afd-490c-b412-805d2b14e1c2] START, > MigrateBrokerVDSCommand(HostName = ksmmi1r01ovirt18, > MigrateVDSCommandParameters:{hostId='282b69aa-8b74-4312-8cc0-9c20e01982b7', > vmId='29032e83-cfaf-4d30-bcc2-df72c5358552', srcHost='ksmmi1r01ovirt18', > dstVdsId='73c38b36-36da-4ffa-b17a-492fd7b093ae', > dstHost='ksmmi1r01ovirt19:54321', migrationMethod='ONLINE', > tunnelMigration='false', migrationDowntime='0', autoConverge='true', > migrateCompressed='false', migrateEncrypted='false', consoleAddress='null', > maxBandwidth='3125', parallel='null', enableGuestEvents='true', > maxIncomingMigrations='2', maxOutgoingMigrations='2', > convergenceSchedule='[init=[{name=setDowntime, params=[100]}], > stalling=[{limit=1, action={name=setDowntime, params=[150]}}, {limit=2, > action={name=setDowntime, params=[200]}}, {limit=3, > action={name=setDowntime, params=[300]}}, {limit=4, > action={name=setDowntime, params=[400]}}, {limit=6, > action={name=setDowntime, params=[500]}}, {limit=-1, action={name=abort, > params=[]}}]]', dstQemu='10.250.156.19', cpusets='null', > numaNodesets='null'}), log id: 14d92c9 > 2023-08-10 18:24:57,631-03 INFO > [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateBrokerVDSCommand] > (default task-4) [633be3a0-3afd-490c-b412-805d2b14e1c2] FINISH, > MigrateBrokerVDSCommand, return: , log id: 14d92c9 > 2023-08-10 18:24:57,634-03 INFO > [org.ovirt.engine.core.vdsbroker.MigrateVDSCommand] (default task-4) > [633be3a0-3afd-490c-b412-805d2b14e1c2] FINISH, MigrateVDSCommand, return: > MigratingFrom, log id: 5bbc21d6 > 2023-08-10 18:24:57,639-03 INFO > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] > (default task-4) [633be3a0-3afd-490c-b412-805d2b14e1c2] EVENT_ID: > VM_MIGRATION_START(62), Migration started (VM: ROUTER, Source: > ksmmi1r01ovirt18, Destination: ksmmi1r01ovirt19, User: admin@ovirt > @internalkeycloak-authz). > 2023-08-10 18:24:57,641-03 INFO > [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] > (ForkJoinPool-1-worker-13) [] VM > '29032e83-cfaf-4d30-bcc2-df72c5358552'(ROUTER) moved from 'MigratingFrom' > --> 'Up' > 2023-08-10 18:24:57,641-03 INFO > [org.ovirt.engine.core.vdsbroker.monitoring.VmAnalyzer] > (ForkJoinPool-1-worker-13) [] Adding VM > '29032e83-cfaf-4d30-bcc2-df72c5358552'(ROUTER) to re-run list > 2023-08-10 18:24:57,643-03 ERROR > [org.ovirt.engine.core.vdsbroker.monitoring.VmsMonitoring] > (ForkJoinPool-1-worker-13) [] Rerun VM > '29032e83-cfaf-4d30-bcc2-df72c5358552'. Called from VDS 'ksmmi1r01ovirt18' > 2023-08-10 18:24:57,679-03 INFO > [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] > (EE-ManagedThreadFactory-engine-Thread-2194) [] START, > MigrateStatusVDSCommand(HostName = ksmmi1r01ovirt18, > MigrateStatusVDSCommandParameters:{hostId='282b69aa-8b74-4312-8cc0-9c20e01982b7', > vmId='29032e83-cfaf-4d30-bcc2-df72c5358552'}), log id: 445b81e0 > 2023-08-10 18:24:57,681-03 INFO > [org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusVDSCommand] > (EE-ManagedThreadFactory-engine-Thread-2194) [] FINISH, > MigrateStatusVDSCommand, return: > org.ovirt.engine.core.vdsbroker.vdsbroker.MigrateStatusReturn@12cb7b1b, > log id: 445b81e0 > 2023-08-10 18:24:57,695-03 ERROR > [org.ovirt.engine.core.dal.dbbroker.auditloghandling.AuditLogDirector] > (EE-ManagedThreadFactory-engine-Thread-2194) [] EVENT_ID: > VM_MIGRATION_TO_SERVER_FAILED(120), Migration failed due to an Error: Fatal > error during migration (VM: ROUTER, Source: ksmmi1r01ovirt18, Destination: > ksmmi1r01ovirt19). > 2023-08-10 18:24:57,698-03 INFO > [org.ovirt.engine.core.bll.MigrateVmToServerCommand] > (EE-ManagedThreadFactory-engine-Thread-2194) [] Lock freed to object > 'EngineLock:{exclusiveLocks='[29032e83-cfaf-4d30-bcc2-df72c5358552=VM]', > sharedLocks=''}' > > ovirt-release-master-4.5.5-0.0.master.20230612064154.git0c65b0e.el9.noarch > ovirt-imageio-common-2.5.1-0.202307060620.git4e5f7e0.el9.x86_64 > python3-ovirt-engine-sdk4-4.6.3-0.1.master.20230324091708.el9.x86_64 > ovirt-openvswitch-ovn-2.17-1.el9.noarch > ovirt-openvswitch-ovn-common-2.17-1.el9.noarch > ovirt-openvswitch-ovn-host-2.17-1.el9.noarch > ovirt-imageio-client-2.5.1-0.202307060620.git4e5f7e0.el9.x86_64 > ovirt-imageio-daemon-2.5.1-0.202307060620.git4e5f7e0.el9.x86_64 > > python3-ovirt-setup-lib-1.3.4-0.0.master.20220413133253.gitd32d35f.el9.noarch > python3.11-ovirt-engine-sdk4-4.6.3-0.1.master.20230324091708.el9.x86_64 > python3.11-ovirt-imageio-common-2.5.1-0.202307060620.git4e5f7e0.el9.x86_64 > python3.11-ovirt-imageio-client-2.5.1-0.202307060620.git4e5f7e0.el9.x86_64 > ovirt-ansible-collection-3.1.3-0.1.master.20230420113738.el9.noarch > ovirt-vmconsole-1.0.9-2.el9.noarch > ovirt-vmconsole-host-1.0.9-2.el9.noarch > ovirt-openvswitch-2.17-1.el9.noarch > ovirt-python-openvswitch-2.17-1.el9.noarch > ovirt-openvswitch-ipsec-2.17-1.el9.noarch > python3-ovirt-node-ng-nodectl-4.4.3-0.20220615.0.el9.noarch > ovirt-node-ng-nodectl-4.4.3-0.20220615.0.el9.noarch > ovirt-host-dependencies-4.5.0-3.1.20220510094000.git2f2d022.el9.x86_64 > > ovirt-hosted-engine-ha-2.5.1-0.0.master.20220707064804.20220707064802.git14b1139.el9.noarch > ovirt-provider-ovn-driver-1.2.37-0.20220610132522.git62111d0.el9.noarch > > ovirt-hosted-engine-setup-2.7.1-0.0.master.20230414113600.git340e19b.el9.noarch > ovirt-host-4.5.0-3.1.20220510094000.git2f2d022.el9.x86_64 > > ovirt-release-host-node-4.5.5-0.0.master.20230612064150.git0c65b0e.el9.x86_64 > > ovirt-node-ng-image-update-placeholder-4.5.5-0.0.master.20230612064150.git0c65b0e.el9.noarch > qemu-kvm-tools-8.0.0-6.el9.x86_64 > qemu-kvm-docs-8.0.0-6.el9.x86_64 > qemu-kvm-common-8.0.0-6.el9.x86_64 > qemu-kvm-device-display-virtio-gpu-8.0.0-6.el9.x86_64 > qemu-kvm-ui-opengl-8.0.0-6.el9.x86_64 > qemu-kvm-ui-egl-headless-8.0.0-6.el9.x86_64 > qemu-kvm-device-display-virtio-gpu-pci-8.0.0-6.el9.x86_64 > qemu-kvm-block-blkio-8.0.0-6.el9.x86_64 > qemu-kvm-device-display-virtio-vga-8.0.0-6.el9.x86_64 > qemu-kvm-device-usb-host-8.0.0-6.el9.x86_64 > qemu-kvm-device-usb-redirect-8.0.0-6.el9.x86_64 > qemu-kvm-audio-pa-8.0.0-6.el9.x86_64 > qemu-kvm-block-rbd-8.0.0-6.el9.x86_64 > qemu-kvm-core-8.0.0-6.el9.x86_64 > qemu-kvm-8.0.0-6.el9.x86_64 > libvirt-daemon-kvm-9.3.0-2.el9.x86_64 > > Cheers! > -- > Att, > Jorge Visentini > +55 55 98432-9868 > _______________________________________________ > Users mailing list -- users(a)ovirt.org > To unsubscribe send an email to users-leave(a)ovirt.org > Privacy Statement: https://www.ovirt.org/privacy-policy.html > oVirt Code of Conduct: > https://www.ovirt.org/community/about/community-guidelines/ > List Archives: > https://lists.ovirt.org/archives/list/users@ovirt.org/message/2RHTORMHBY3... >