I recently added a Windows 10 Pro 64 bit (release 1909) VM, and I'm seeing a lot of failures when oVirt tries to move the VM to another host (triggered by load balancing), These errors are showing up in the UI event log Migration failed (VM: <vm label>, Source: <host 1>, Destination: <host 2>). Followed by: VM <host> is down with error. Exit message: Lost connection with qemu process. Google returned some references to 'options kvm ignore_msrs=1' which I've added to /etc/modprobe/d/kvm.conf and restarted the hosts but that doesn't appear to have made a difference. Is this a known issue with Windows 10 guests? _______________________________________________ Users mailing list -- users(a)ovirt.org To unsubscribe send an email to users-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/QNJ7GFDXKBV...

I haven't got an active RHEL subscription so I can't view that solution unfortunately. Thanks for the log pointers though, looking in the qemu log I'm not surprised it's crashing... tcmalloc: large alloc 562949953421312 bytes == (nil) @ 0x7f93c080b4ef 0x7f93c082b367 0x7f93d8310736 0x55efa0670ac8 0x55efa06718e5 0x55efa0621bae 0x55efa06287b6 0x55efa07f0de5 0x55efa07ecbdf 0x7f93bf7b3e65 0x7f93bf4dc88d (process:1374): GLib-ERROR **: 09:26:39.525: gmem.c:135: *failed to allocate 562949953421312 bytes* 2020-04-06 08:26:43.036+0000: shutting down, reason=crashed ... libvirt version: 4.5.0, package: 23.el7_7.6 (CentOS BuildSystem < http://bugs.centos.org>;, 2020-03-17-23:39:10, x86-01.bsys.centos.org), qemu version: 2.12.0qemu-kvm-ev-2.12.0-33.1.el7_7.4, kernel: 3.10.0-1062.18.1.el7.x86_64 562949953421312 bytes is mighty big, nigh on 563 TB! The VM in question is allocated 4GB RAM and has a 60GB disk... Couldn't see any errors in the VDSM log at the time that qemu failed. On Tue, 7 Apr 2020 at 10:52, Shani Leviim <sleviim(a)redhat.com&gt; wrote: > Hi Brett, > According to [1], you can try to update the package qemu-kvm-rhev. > (Or yum update if there're more packages related need to be upgraded). > > You may also find some more information about that error on the vdsm log > (/var/log/vdsm/vdsm.log) > and the qemu log (/var/log/libvirt/qemu/vm_name.log) > > [1] https://access.redhat.com/solutions/3423481 > > > *Regards,* > > *Shani Leviim* > > > On Mon, Apr 6, 2020 at 12:09 PM Maton, Brett <matonb(a)ltresources.co.uk&gt; > wrote: > >> I recently added a Windows 10 Pro 64 bit (release 1909) VM, and I'm >> seeing a lot of failures when oVirt tries to move the VM to another host >> (triggered by load balancing), >> >> These errors are showing up in the UI event log >> >> Migration failed (VM: <vm label>, Source: <host 1>, Destination: <host >> 2>). >> >> Followed by: >> >> VM <host> is down with error. Exit message: Lost connection with qemu >> process. >> >> Google returned some references to 'options kvm ignore_msrs=1' which >> I've added to /etc/modprobe/d/kvm.conf and restarted the hosts but that >> doesn't appear to have made a difference. >> >> Is this a known issue with Windows 10 guests? >> _______________________________________________ >> Users mailing list -- users(a)ovirt.org >> To unsubscribe send an email to users-leave(a)ovirt.org >> Privacy Statement: https://www.ovirt.org/privacy-policy.html >> oVirt Code of Conduct: >> https://www.ovirt.org/community/about/community-guidelines/ >> List Archives: >> https://lists.ovirt.org/archives/list/users@ovirt.org/message/QNJ7GFDXKBV... >> >

I have a Windows 10 guest and a Server 2016 guest that migrate without an issue. Are your CPU architectures comparable between the hosts? BTW, 56294995342131 bytes is 562 terabytes. Are you sure that's correct? _______________________________________________ Users mailing list -- users(a)ovirt.org To unsubscribe send an email to users-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/7JDAC6SVJIP...

I found this thread on Stack overflow: https://stackoverflow.com/questions/9077457/how-to-trace-tcmalloc-large-a... See http://code.google.com/p/gperftools/source/browse/trunk/src/tcmalloc.cc?r... line 843 Depending on your application - the large allocation may or may not be a bug. In any case - the part after the @ mark is a stack trace and can be used to locate the source of the message The repeating number (4294488064 which seems to be equal to 4G-479232 or 0x100000000-0x75000) makes me suspect the original allocation call got a negative signed value and used it as an unsigned value. It also had this to trace the memory leak: to trace the mem address to a line in your code, use addr2line commandline tool.. use it as addr2line -e <executable name> then press enter and then paste an address and press enter I’m not sure if this is helpful but it does sound like a memory leak. In a related Microsoft doc it stated: 1073741824 Allocations larger than this value cause a stack trace to be dumped to stderr. The threshold for dumping stack traces is increased by a factor of 1.125 every time we print a message so that the threshold automatically goes up by a factor of ~1000 every 60 messages. This bounds the amount of extra logging generated by this flag. Default value of this flag is very large and therefore you should see no extra logging unless the flag is overridden. The default in Windows is 1 GB. I’m not sure about Linux. I hope this is helpful. Eric Evans Digital Data Services LLC. 304.660.9080 *From:* Maton, Brett <matonb(a)ltresources.co.uk&gt; *Sent:* Friday, April 10, 2020 4:53 PM *To:* eevans(a)digitaldatatechs.com *Cc:* Ovirt Users <users(a)ovirt.org&gt; *Subject:* [ovirt-users] Re: Windows 10 Pro 64 (1909) crashes when migrating The hosts are identical, and yes I'm sure about the 563 terrabytes, which is obviously wrong, and why I mentioned it. Possibly an overflow? On Fri, 10 Apr 2020, 21:31 , <eevans(a)digitaldatatechs.com&gt; wrote: I have a Windows 10 guest and a Server 2016 guest that migrate without an issue. Are your CPU architectures comparable between the hosts? BTW, 56294995342131 bytes is 562 terabytes. Are you sure that's correct? _______________________________________________ Users mailing list -- users(a)ovirt.org To unsubscribe send an email to users-leave(a)ovirt.org Privacy Statement: https://www.ovirt.org/privacy-policy.html oVirt Code of Conduct: https://www.ovirt.org/community/about/community-guidelines/ List Archives: https://lists.ovirt.org/archives/list/users@ovirt.org/message/7JDAC6SVJIP...