Re: [ovirt-users] Bad performance with Windows 2012 guests
On Apr 30, 2015 14:03, Martijn Grendelman <martijn.grendelman@isaac.nl> wrote:
Hi,
Ever since our first Windows Server 2012 deployment on oVirt (3.4 back then, now 3.5.1), I have noticed that working on these VMs via RDP or on the console via VNC is noticeably slower than on Windows 2008 guests on the same oVirt environment.
Basic things like starting an application (even the Server Manager that get started automatically on login) take a very long time, sometimes minutes. Everything is just... slow.
We have recently deployed Microsoft Exchange on a Windows Server 2012 guest on RHEV, and it doesn't perform well at all.
I haven't been able to find the cause for this slowness; CPU usage is not excessive and it doesn't seem I/O related. Moreover, other types of guests (Linux and even Windows 2008) do not have this problem.
We have 3 different environments: - oVirt 3.5.1, on old Dell servers with Penryn Family CPUs with fairly slow storage on replicated GlusterFS, running CentOS 6.6 - oVirt 3.5.1, on modern 6-core SandyBridge servers with local storage via NFS, running CentOS 7.0) - RHEV 3.4.4 on modern 10-core SandyBridge servers with an iSCSI SAN behind it, running on RHEV Hypervisor 6.5
All of these -very different- environments expose the same behaviour: Linux, Windows 2008 fast (or as fast as can be expected given the hardware), Windows 2012 painfully slow.
All Windows 2012 servers use VirtIO disk and network. I think all drivers are from the virtio-win-0.1-74 ISO.
Does anyone share this experience? Any idea why this could happen and how it can be fixed? Any other information I should share to get a better idea?
Btw, for the guests on the RHEV environment, we have a case with RedHat support, but that doesn't seem to lead to a quick solution, hence I'm writing here, too.
Thanks for any help.
Regards, Martijn Grendelman
Hi Martijn, Can you please provide the QEMU command line, together with kvm and qemu version? This information will be helpful for reproducing the problem. However, if the problem is not reproducible on a local setup, we will probably need to ask collecting some performance information with xperf tool. Doron
Hi Doron, I've also noticed that there seems to be a difference in performance between Win2k8 R2/Linux and Windows Server 2012. After reading Martijns post I've done some speed test regarding the drive speeds and was looking for a way to compare the VMs on a more professional way. My tests showed, that on the same hardware, the Win2k8 R2 was faster in response and throughput on the disks. I found a utility that somehow measures the latency on a system and that also showed a significant difference. What is the correct way to do a performance test on a VM running in KVM ? Sven -----Ursprüngliche Nachricht----- Von: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] Im Auftrag von Doron Fediuck Gesendet: Samstag, 2. Mai 2015 10:50 An: Martijn Grendelman Cc: Karen Noel; users@ovirt.org; Vadim Rozenfeld Betreff: Re: [ovirt-users] Bad performance with Windows 2012 guests On Apr 30, 2015 14:03, Martijn Grendelman <martijn.grendelman@isaac.nl> wrote:
Hi,
Ever since our first Windows Server 2012 deployment on oVirt (3.4 back then, now 3.5.1), I have noticed that working on these VMs via RDP or on the console via VNC is noticeably slower than on Windows 2008 guests on the same oVirt environment.
Basic things like starting an application (even the Server Manager that get started automatically on login) take a very long time, sometimes minutes. Everything is just... slow.
We have recently deployed Microsoft Exchange on a Windows Server 2012 guest on RHEV, and it doesn't perform well at all.
I haven't been able to find the cause for this slowness; CPU usage is not excessive and it doesn't seem I/O related. Moreover, other types of guests (Linux and even Windows 2008) do not have this problem.
We have 3 different environments: - oVirt 3.5.1, on old Dell servers with Penryn Family CPUs with fairly slow storage on replicated GlusterFS, running CentOS 6.6 - oVirt 3.5.1, on modern 6-core SandyBridge servers with local storage via NFS, running CentOS 7.0) - RHEV 3.4.4 on modern 10-core SandyBridge servers with an iSCSI SAN behind it, running on RHEV Hypervisor 6.5
All of these -very different- environments expose the same behaviour: Linux, Windows 2008 fast (or as fast as can be expected given the hardware), Windows 2012 painfully slow.
All Windows 2012 servers use VirtIO disk and network. I think all drivers are from the virtio-win-0.1-74 ISO.
Does anyone share this experience? Any idea why this could happen and how it can be fixed? Any other information I should share to get a better idea?
Btw, for the guests on the RHEV environment, we have a case with RedHat support, but that doesn't seem to lead to a quick solution, hence I'm writing here, too.
Thanks for any help.
Regards, Martijn Grendelman
Hi Martijn, Can you please provide the QEMU command line, together with kvm and qemu version? This information will be helpful for reproducing the problem. However, if the problem is not reproducible on a local setup, we will probably need to ask collecting some performance information with xperf tool. Doron _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
On Sun, 2015-05-03 at 06:48 -0500, Sven Achtelik wrote:
Hi Doron,
I've also noticed that there seems to be a difference in performance between Win2k8 R2/Linux and Windows Server 2012. After reading Martijns post I've done some speed test regarding the drive speeds and was looking for a way to compare the VMs on a more professional way. My tests showed, that on the same hardware, the Win2k8 R2 was faster in response and throughput on the disks. I found a utility that somehow measures the latency on a system and that also showed a significant difference. What is the correct way to do a performance test on a VM running in KVM ?
Sven
Hi Sven, Can you specify the type of disk on your system - ide, virtio-blk, or virtio-scsi? We usually use iometer for disk performance profiling. Sequential read/write, block size from 4K up to 256K, queue depth from 1 to 64. Vadim.
-----Ursprüngliche Nachricht----- Von: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] Im Auftrag von Doron Fediuck Gesendet: Samstag, 2. Mai 2015 10:50 An: Martijn Grendelman Cc: Karen Noel; users@ovirt.org; Vadim Rozenfeld Betreff: Re: [ovirt-users] Bad performance with Windows 2012 guests
On Apr 30, 2015 14:03, Martijn Grendelman <martijn.grendelman@isaac.nl> wrote:
Hi,
Ever since our first Windows Server 2012 deployment on oVirt (3.4 back then, now 3.5.1), I have noticed that working on these VMs via RDP or on the console via VNC is noticeably slower than on Windows 2008 guests on the same oVirt environment.
Basic things like starting an application (even the Server Manager that get started automatically on login) take a very long time, sometimes minutes. Everything is just... slow.
We have recently deployed Microsoft Exchange on a Windows Server 2012 guest on RHEV, and it doesn't perform well at all.
I haven't been able to find the cause for this slowness; CPU usage is not excessive and it doesn't seem I/O related. Moreover, other types of guests (Linux and even Windows 2008) do not have this problem.
We have 3 different environments: - oVirt 3.5.1, on old Dell servers with Penryn Family CPUs with fairly slow storage on replicated GlusterFS, running CentOS 6.6 - oVirt 3.5.1, on modern 6-core SandyBridge servers with local storage via NFS, running CentOS 7.0) - RHEV 3.4.4 on modern 10-core SandyBridge servers with an iSCSI SAN behind it, running on RHEV Hypervisor 6.5
All of these -very different- environments expose the same behaviour: Linux, Windows 2008 fast (or as fast as can be expected given the hardware), Windows 2012 painfully slow.
All Windows 2012 servers use VirtIO disk and network. I think all drivers are from the virtio-win-0.1-74 ISO.
Does anyone share this experience? Any idea why this could happen and how it can be fixed? Any other information I should share to get a better idea?
Btw, for the guests on the RHEV environment, we have a case with RedHat support, but that doesn't seem to lead to a quick solution, hence I'm writing here, too.
Thanks for any help.
Regards, Martijn Grendelman
Hi Martijn, Can you please provide the QEMU command line, together with kvm and qemu version?
This information will be helpful for reproducing the problem. However, if the problem is not reproducible on a local setup, we will probably need to ask collecting some performance information with xperf tool.
Doron _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Vadim, I've tested the performance with CrystalDiskMark from inside the Windows guest. Using Win2k8 R2 I got expected values for my system, about 88 MB/s on 4k random with 32 queues and 500MB/s + sequential writes with 32 queues. Using a Windows 2012 VM on the same system it's only 33MB/s on 4k random with 32 queues and 300MB/s sequential writes. Similar tests with a linux VM show a bit better values than the Win2k8 R2 and respond ultra-fast. My hosts are connected via iSCSI using a 10 GbE link and a ZFS appliance as the storage system. All tests have been run several times with the same results. Sven -----Ursprüngliche Nachricht----- Von: Vadim Rozenfeld [mailto:vrozenfe@redhat.com] Gesendet: Sonntag, 3. Mai 2015 14:35 An: Sven Achtelik Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users@ovirt.org Betreff: Re: AW: Bad performance with Windows 2012 guests On Sun, 2015-05-03 at 06:48 -0500, Sven Achtelik wrote:
Hi Doron,
I've also noticed that there seems to be a difference in performance between Win2k8 R2/Linux and Windows Server 2012. After reading Martijns post I've done some speed test regarding the drive speeds and was looking for a way to compare the VMs on a more professional way. My tests showed, that on the same hardware, the Win2k8 R2 was faster in response and throughput on the disks. I found a utility that somehow measures the latency on a system and that also showed a significant difference. What is the correct way to do a performance test on a VM running in KVM ?
Sven
Hi Sven, Can you specify the type of disk on your system - ide, virtio-blk, or virtio-scsi? We usually use iometer for disk performance profiling. Sequential read/write, block size from 4K up to 256K, queue depth from 1 to 64. Vadim.
-----Ursprüngliche Nachricht----- Von: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] Im Auftrag von Doron Fediuck Gesendet: Samstag, 2. Mai 2015 10:50 An: Martijn Grendelman Cc: Karen Noel; users@ovirt.org; Vadim Rozenfeld Betreff: Re: [ovirt-users] Bad performance with Windows 2012 guests
On Apr 30, 2015 14:03, Martijn Grendelman <martijn.grendelman@isaac.nl> wrote:
Hi,
Ever since our first Windows Server 2012 deployment on oVirt (3.4 back then, now 3.5.1), I have noticed that working on these VMs via RDP or on the console via VNC is noticeably slower than on Windows 2008 guests on the same oVirt environment.
Basic things like starting an application (even the Server Manager that get started automatically on login) take a very long time, sometimes minutes. Everything is just... slow.
We have recently deployed Microsoft Exchange on a Windows Server 2012 guest on RHEV, and it doesn't perform well at all.
I haven't been able to find the cause for this slowness; CPU usage is not excessive and it doesn't seem I/O related. Moreover, other types of guests (Linux and even Windows 2008) do not have this problem.
We have 3 different environments: - oVirt 3.5.1, on old Dell servers with Penryn Family CPUs with fairly slow storage on replicated GlusterFS, running CentOS 6.6 - oVirt 3.5.1, on modern 6-core SandyBridge servers with local storage via NFS, running CentOS 7.0) - RHEV 3.4.4 on modern 10-core SandyBridge servers with an iSCSI SAN behind it, running on RHEV Hypervisor 6.5
All of these -very different- environments expose the same behaviour: Linux, Windows 2008 fast (or as fast as can be expected given the hardware), Windows 2012 painfully slow.
All Windows 2012 servers use VirtIO disk and network. I think all drivers are from the virtio-win-0.1-74 ISO.
Does anyone share this experience? Any idea why this could happen and how it can be fixed? Any other information I should share to get a better idea?
Btw, for the guests on the RHEV environment, we have a case with RedHat support, but that doesn't seem to lead to a quick solution, hence I'm writing here, too.
Thanks for any help.
Regards, Martijn Grendelman
Hi Martijn, Can you please provide the QEMU command line, together with kvm and qemu version?
This information will be helpful for reproducing the problem. However, if the problem is not reproducible on a local setup, we will probably need to ask collecting some performance information with xperf tool.
Doron _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
On Sun, 2015-05-03 at 07:46 -0500, Sven Achtelik wrote:
Hi Vadim,
I've tested the performance with CrystalDiskMark from inside the Windows guest. Using Win2k8 R2 I got expected values for my system, about 88 MB/s on 4k random with 32 queues and 500MB/s + sequential writes with 32 queues. Using a Windows 2012 VM on the same system it's only 33MB/s on 4k random with 32 queues and 300MB/s sequential writes. Similar tests with a linux VM show a bit better values than the Win2k8 R2 and respond ultra-fast.
My hosts are connected via iSCSI using a 10 GbE link and a ZFS appliance as the storage system. All tests have been run several times with the same results.
Sven, Can I ask you to post the Windows 2012 VM qemu command line? Thanks, Vadim.
Sven
-----Ursprüngliche Nachricht----- Von: Vadim Rozenfeld [mailto:vrozenfe@redhat.com] Gesendet: Sonntag, 3. Mai 2015 14:35 An: Sven Achtelik Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users@ovirt.org Betreff: Re: AW: Bad performance with Windows 2012 guests
On Sun, 2015-05-03 at 06:48 -0500, Sven Achtelik wrote:
Hi Doron,
I've also noticed that there seems to be a difference in performance between Win2k8 R2/Linux and Windows Server 2012. After reading Martijns post I've done some speed test regarding the drive speeds and was looking for a way to compare the VMs on a more professional way. My tests showed, that on the same hardware, the Win2k8 R2 was faster in response and throughput on the disks. I found a utility that somehow measures the latency on a system and that also showed a significant difference. What is the correct way to do a performance test on a VM running in KVM ?
Sven
Hi Sven,
Can you specify the type of disk on your system - ide, virtio-blk, or virtio-scsi? We usually use iometer for disk performance profiling. Sequential read/write, block size from 4K up to 256K, queue depth from 1 to 64.
Vadim.
-----Ursprüngliche Nachricht----- Von: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] Im Auftrag von Doron Fediuck Gesendet: Samstag, 2. Mai 2015 10:50 An: Martijn Grendelman Cc: Karen Noel; users@ovirt.org; Vadim Rozenfeld Betreff: Re: [ovirt-users] Bad performance with Windows 2012 guests
On Apr 30, 2015 14:03, Martijn Grendelman <martijn.grendelman@isaac.nl> wrote:
Hi,
Ever since our first Windows Server 2012 deployment on oVirt (3.4 back then, now 3.5.1), I have noticed that working on these VMs via RDP or on the console via VNC is noticeably slower than on Windows 2008 guests on the same oVirt environment.
Basic things like starting an application (even the Server Manager that get started automatically on login) take a very long time, sometimes minutes. Everything is just... slow.
We have recently deployed Microsoft Exchange on a Windows Server 2012 guest on RHEV, and it doesn't perform well at all.
I haven't been able to find the cause for this slowness; CPU usage is not excessive and it doesn't seem I/O related. Moreover, other types of guests (Linux and even Windows 2008) do not have this problem.
We have 3 different environments: - oVirt 3.5.1, on old Dell servers with Penryn Family CPUs with fairly slow storage on replicated GlusterFS, running CentOS 6.6 - oVirt 3.5.1, on modern 6-core SandyBridge servers with local storage via NFS, running CentOS 7.0) - RHEV 3.4.4 on modern 10-core SandyBridge servers with an iSCSI SAN behind it, running on RHEV Hypervisor 6.5
All of these -very different- environments expose the same behaviour: Linux, Windows 2008 fast (or as fast as can be expected given the hardware), Windows 2012 painfully slow.
All Windows 2012 servers use VirtIO disk and network. I think all drivers are from the virtio-win-0.1-74 ISO.
Does anyone share this experience? Any idea why this could happen and how it can be fixed? Any other information I should share to get a better idea?
Btw, for the guests on the RHEV environment, we have a case with RedHat support, but that doesn't seem to lead to a quick solution, hence I'm writing here, too.
Thanks for any help.
Regards, Martijn Grendelman
Hi Martijn, Can you please provide the QEMU command line, together with kvm and qemu version?
This information will be helpful for reproducing the problem. However, if the problem is not reproducible on a local setup, we will probably need to ask collecting some performance information with xperf tool.
Doron _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Vadim, the command line: /usr/libexec/qemu-kvm -name wc_db01 -S -machine rhel6.5.0,accel=kvm,usb=off -cpu Westmere -m 12288 -realtime mlock=off -smp 2,maxcpus=16,sockets=16,cores=1,threads=1 -uuid fbbdc0a0-23a4-4d32-a526-a35c59eb790d -smbios type=1,manufacturer=oVirt,product=oVirt Node,version=7-1.1503.el7.centos.2.8,serial=4C4C4544-0035-4E10-8034-B4C04F4B4E31,uuid=fbbdc0a0-23a4-4d32-a526-a35c59eb790d -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/wc_db01.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2015-05-04T03:26:39,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5 -drive file=/rhev/data-center/mnt/ovirt-engine.mgmt.asl.local:_var_lib_exports_iso/d1559536-71da-4b7a-ad71-171b0b528d7f/images/11111111-1111-1111-1111-111111111111/SVR2012EVAL.iso,if=none,id=drive-ide0-1-0,readonly=on,format=raw,serial= -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0,bootindex=2 -drive file=/rhev/data-center/00000002-0002-0002-0002-0000000003e2/a7d4ddb9-4486-4e37-b524-29625d6a7e61/images/23672c7f-ec3c-4686-bc29-89a0f95eae1c/9741917b-9134-4e14-892d-d16abf13e406,if=none,id=drive-virtio-disk0,format=raw,serial=23672c7f-ec3c-4686-bc29-89a0f95eae1c,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive file=/rhev/data-center/00000002-0002-0002-0002-0000000003e2/a7d4ddb9-4486-4e37-b524-29625d6a7e61/images/238e79c3-378b-4117-9b6d-18f73832f286/a8730e05-ed95-4d41-a10d-e249b601ebd3,if=none,id=drive-virtio-disk1,format=qcow2,serial=238e79c3-378b-4117-9b6d-18f73832f286,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x7,drive=drive-virtio-disk1,id=virtio-disk1 -netdev tap,fd=29,id=hostnet0,vhost=on,vhostfd=30 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:00:1a:4a:ae:02,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/fbbdc0a0-23a4-4d32-a526-a35c59eb790d.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/fbbdc0a0-23a4-4d32-a526-a35c59eb790d.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev pty,id=charconsole0 -device virtconsole,chardev=charconsole0,id=console0 -device usb-tablet,id=input0 -vnc 172.16.1.14:2,password -k en-us -vga cirrus -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x8 -msg timestamp=on Sven -----Ursprüngliche Nachricht----- Von: Vadim Rozenfeld [mailto:vrozenfe@redhat.com] Gesendet: Montag, 4. Mai 2015 05:00 An: Sven Achtelik Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users@ovirt.org Betreff: Re: AW: AW: Bad performance with Windows 2012 guests On Sun, 2015-05-03 at 07:46 -0500, Sven Achtelik wrote:
Hi Vadim,
I've tested the performance with CrystalDiskMark from inside the Windows guest. Using Win2k8 R2 I got expected values for my system, about 88 MB/s on 4k random with 32 queues and 500MB/s + sequential writes with 32 queues. Using a Windows 2012 VM on the same system it's only 33MB/s on 4k random with 32 queues and 300MB/s sequential writes. Similar tests with a linux VM show a bit better values than the Win2k8 R2 and respond ultra-fast.
My hosts are connected via iSCSI using a 10 GbE link and a ZFS appliance as the storage system. All tests have been run several times with the same results.
Sven, Can I ask you to post the Windows 2012 VM qemu command line? Thanks, Vadim.
Sven
-----Ursprüngliche Nachricht----- Von: Vadim Rozenfeld [mailto:vrozenfe@redhat.com] Gesendet: Sonntag, 3. Mai 2015 14:35 An: Sven Achtelik Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users@ovirt.org Betreff: Re: AW: Bad performance with Windows 2012 guests
On Sun, 2015-05-03 at 06:48 -0500, Sven Achtelik wrote:
Hi Doron,
I've also noticed that there seems to be a difference in performance between Win2k8 R2/Linux and Windows Server 2012. After reading Martijns post I've done some speed test regarding the drive speeds and was looking for a way to compare the VMs on a more professional way. My tests showed, that on the same hardware, the Win2k8 R2 was faster in response and throughput on the disks. I found a utility that somehow measures the latency on a system and that also showed a significant difference. What is the correct way to do a performance test on a VM running in KVM ?
Sven
Hi Sven,
Can you specify the type of disk on your system - ide, virtio-blk, or virtio-scsi? We usually use iometer for disk performance profiling. Sequential read/write, block size from 4K up to 256K, queue depth from 1 to 64.
Vadim.
-----Ursprüngliche Nachricht----- Von: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] Im Auftrag von Doron Fediuck Gesendet: Samstag, 2. Mai 2015 10:50 An: Martijn Grendelman Cc: Karen Noel; users@ovirt.org; Vadim Rozenfeld Betreff: Re: [ovirt-users] Bad performance with Windows 2012 guests
On Apr 30, 2015 14:03, Martijn Grendelman <martijn.grendelman@isaac.nl> wrote:
Hi,
Ever since our first Windows Server 2012 deployment on oVirt (3.4 back then, now 3.5.1), I have noticed that working on these VMs via RDP or on the console via VNC is noticeably slower than on Windows 2008 guests on the same oVirt environment.
Basic things like starting an application (even the Server Manager that get started automatically on login) take a very long time, sometimes minutes. Everything is just... slow.
We have recently deployed Microsoft Exchange on a Windows Server 2012 guest on RHEV, and it doesn't perform well at all.
I haven't been able to find the cause for this slowness; CPU usage is not excessive and it doesn't seem I/O related. Moreover, other types of guests (Linux and even Windows 2008) do not have this problem.
We have 3 different environments: - oVirt 3.5.1, on old Dell servers with Penryn Family CPUs with fairly slow storage on replicated GlusterFS, running CentOS 6.6 - oVirt 3.5.1, on modern 6-core SandyBridge servers with local storage via NFS, running CentOS 7.0) - RHEV 3.4.4 on modern 10-core SandyBridge servers with an iSCSI SAN behind it, running on RHEV Hypervisor 6.5
All of these -very different- environments expose the same behaviour: Linux, Windows 2008 fast (or as fast as can be expected given the hardware), Windows 2012 painfully slow.
All Windows 2012 servers use VirtIO disk and network. I think all drivers are from the virtio-win-0.1-74 ISO.
Does anyone share this experience? Any idea why this could happen and how it can be fixed? Any other information I should share to get a better idea?
Btw, for the guests on the RHEV environment, we have a case with RedHat support, but that doesn't seem to lead to a quick solution, hence I'm writing here, too.
Thanks for any help.
Regards, Martijn Grendelman
Hi Martijn, Can you please provide the QEMU command line, together with kvm and qemu version?
This information will be helpful for reproducing the problem. However, if the problem is not reproducible on a local setup, we will probably need to ask collecting some performance information with xperf tool.
Doron _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
On Mon, 2015-05-04 at 03:32 -0500, Sven Achtelik wrote:
Hi Vadim,
the command line:
/usr/libexec/qemu-kvm -name wc_db01 -S -machine rhel6.5.0,accel=kvm,usb=off -cpu Westmere -m 12288 -realtime mlock=off -smp 2,maxcpus=16,sockets=16,cores=1,threads=1 -uuid fbbdc0a0-23a4-4d32-a526-a35c59eb790d -smbios type=1,manufacturer=oVirt,product=oVirt Node,version=7-1.1503.el7.centos.2.8,serial=4C4C4544-0035-4E10-8034-B4C04F4B4E31,uuid=fbbdc0a0-23a4-4d32-a526-a35c59eb790d -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/wc_db01.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2015-05-04T03:26:39,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5 -drive file=/rhev/data-center/mnt/ovirt-engine.mgmt.asl.local:_var_lib_exports_iso/d1559536-71da-4b7a-ad71-171b0b528d7f/images/11111111-1111-1111-1111-111111111111/SVR2012EVAL.iso,if=none,id=drive-ide0-1-0,readonly=on,format=raw,serial= -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0,bootindex=2 -drive file=/rhev/data-center/00000002-0002-0002-0002-0000000003e2/a7d4ddb9-4486-4e37-b524-29625d6a7e61/images/23672c7f-ec3c-4686-bc29-89a0f95eae1c/9741917b-9134-4e14-892d-d16abf13e406,if=none,id=drive-virtio-disk0,format=raw,serial=23672c7f-ec3c-4686-bc29-89a0f95eae1c,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive file=/rhev/data-center/00000002-0002-0002-0002-0000000003e2/a7d4ddb9-4486-4e37-b524-29625d6a7e61/images/238e79c3-378b-4117-9b6d-18f73832f286/a8730e05-ed95-4d41-a10d-e249b601ebd3,if=none,id=drive-virtio-disk1,format=qcow2,serial=238e79c3-378b-4117-9b6d-18f73832f286,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x7,drive=drive-virtio-disk1,id=virtio-disk1 -netdev tap,fd=29,id=hostnet0,vhost=on,vhostfd=30 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:00:1a:4a:ae:02,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/fbbdc0a0-23a4-4d32-a526-a35c59eb790d.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/fbbdc0a0-23a4-4d32-a526-a35c59eb790d.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev pty,id=charconsole0 -device virtconsole,chardev=charconsole0,id=console0 -device usb-tablet,id=input0 -vnc 172.16.1.14:2,password -k en-us -vga cirrus -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x8 -msg timestamp=on
Sven
Thanks a lot. I will try trace this issue on my local setup. Best regards, Vadim.
-----Ursprüngliche Nachricht----- Von: Vadim Rozenfeld [mailto:vrozenfe@redhat.com] Gesendet: Montag, 4. Mai 2015 05:00 An: Sven Achtelik Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users@ovirt.org Betreff: Re: AW: AW: Bad performance with Windows 2012 guests
On Sun, 2015-05-03 at 07:46 -0500, Sven Achtelik wrote:
Hi Vadim,
I've tested the performance with CrystalDiskMark from inside the Windows guest. Using Win2k8 R2 I got expected values for my system, about 88 MB/s on 4k random with 32 queues and 500MB/s + sequential writes with 32 queues. Using a Windows 2012 VM on the same system it's only 33MB/s on 4k random with 32 queues and 300MB/s sequential writes. Similar tests with a linux VM show a bit better values than the Win2k8 R2 and respond ultra-fast.
My hosts are connected via iSCSI using a 10 GbE link and a ZFS appliance as the storage system. All tests have been run several times with the same results.
Sven, Can I ask you to post the Windows 2012 VM qemu command line?
Thanks, Vadim.
Sven
-----Ursprüngliche Nachricht----- Von: Vadim Rozenfeld [mailto:vrozenfe@redhat.com] Gesendet: Sonntag, 3. Mai 2015 14:35 An: Sven Achtelik Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users@ovirt.org Betreff: Re: AW: Bad performance with Windows 2012 guests
On Sun, 2015-05-03 at 06:48 -0500, Sven Achtelik wrote:
Hi Doron,
I've also noticed that there seems to be a difference in performance between Win2k8 R2/Linux and Windows Server 2012. After reading Martijns post I've done some speed test regarding the drive speeds and was looking for a way to compare the VMs on a more professional way. My tests showed, that on the same hardware, the Win2k8 R2 was faster in response and throughput on the disks. I found a utility that somehow measures the latency on a system and that also showed a significant difference. What is the correct way to do a performance test on a VM running in KVM ?
Sven
Hi Sven,
Can you specify the type of disk on your system - ide, virtio-blk, or virtio-scsi? We usually use iometer for disk performance profiling. Sequential read/write, block size from 4K up to 256K, queue depth from 1 to 64.
Vadim.
-----Ursprüngliche Nachricht----- Von: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] Im Auftrag von Doron Fediuck Gesendet: Samstag, 2. Mai 2015 10:50 An: Martijn Grendelman Cc: Karen Noel; users@ovirt.org; Vadim Rozenfeld Betreff: Re: [ovirt-users] Bad performance with Windows 2012 guests
On Apr 30, 2015 14:03, Martijn Grendelman <martijn.grendelman@isaac.nl> wrote:
Hi,
Ever since our first Windows Server 2012 deployment on oVirt (3.4 back then, now 3.5.1), I have noticed that working on these VMs via RDP or on the console via VNC is noticeably slower than on Windows 2008 guests on the same oVirt environment.
Basic things like starting an application (even the Server Manager that get started automatically on login) take a very long time, sometimes minutes. Everything is just... slow.
We have recently deployed Microsoft Exchange on a Windows Server 2012 guest on RHEV, and it doesn't perform well at all.
I haven't been able to find the cause for this slowness; CPU usage is not excessive and it doesn't seem I/O related. Moreover, other types of guests (Linux and even Windows 2008) do not have this problem.
We have 3 different environments: - oVirt 3.5.1, on old Dell servers with Penryn Family CPUs with fairly slow storage on replicated GlusterFS, running CentOS 6.6 - oVirt 3.5.1, on modern 6-core SandyBridge servers with local storage via NFS, running CentOS 7.0) - RHEV 3.4.4 on modern 10-core SandyBridge servers with an iSCSI SAN behind it, running on RHEV Hypervisor 6.5
All of these -very different- environments expose the same behaviour: Linux, Windows 2008 fast (or as fast as can be expected given the hardware), Windows 2012 painfully slow.
All Windows 2012 servers use VirtIO disk and network. I think all drivers are from the virtio-win-0.1-74 ISO.
Does anyone share this experience? Any idea why this could happen and how it can be fixed? Any other information I should share to get a better idea?
Btw, for the guests on the RHEV environment, we have a case with RedHat support, but that doesn't seem to lead to a quick solution, hence I'm writing here, too.
Thanks for any help.
Regards, Martijn Grendelman
Hi Martijn, Can you please provide the QEMU command line, together with kvm and qemu version?
This information will be helpful for reproducing the problem. However, if the problem is not reproducible on a local setup, we will probably need to ask collecting some performance information with xperf tool.
Doron _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
Hi Vadim, could you reproduce my issue with your system ? Do you have any advice on getting more performance with Win2012 ? Thank you, Sven -----Ursprüngliche Nachricht----- Von: Vadim Rozenfeld [mailto:vrozenfe@redhat.com] Gesendet: Dienstag, 5. Mai 2015 02:57 An: Sven Achtelik Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users@ovirt.org Betreff: Re: AW: AW: AW: Bad performance with Windows 2012 guests On Mon, 2015-05-04 at 03:32 -0500, Sven Achtelik wrote:
Hi Vadim,
the command line:
/usr/libexec/qemu-kvm -name wc_db01 -S -machine rhel6.5.0,accel=kvm,usb=off -cpu Westmere -m 12288 -realtime mlock=off -smp 2,maxcpus=16,sockets=16,cores=1,threads=1 -uuid fbbdc0a0-23a4-4d32-a526-a35c59eb790d -smbios type=1,manufacturer=oVirt,product=oVirt Node,version=7-1.1503.el7.centos.2.8,serial=4C4C4544-0035-4E10-8034-B4C04F4B4E31,uuid=fbbdc0a0-23a4-4d32-a526-a35c59eb790d -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/wc_db01.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2015-05-04T03:26:39,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5 -drive file=/rhev/data-center/mnt/ovirt-engine.mgmt.asl.local:_var_lib_exports_iso/d1559536-71da-4b7a-ad71-171b0b528d7f/images/11111111-1111-1111-1111-111111111111/SVR2012EVAL.iso,if=none,id=drive-ide0-1-0,readonly=on,format=raw,serial= -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0,bootindex=2 -drive file=/rhev/data-center/00000002-0002-0002-0002-0000000003e2/a7d4ddb9-4486-4e37-b524-29625d6a7e61/images/23672c7f-ec3c-4686-bc29-89a0f95eae1c/9741917b-9134-4e14-892d-d16abf13e406,if=none,id=drive-virtio-disk0,format=raw,serial=23672c7f-ec3c-4686-bc29-89a0f95eae1c,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive file=/rhev/data-center/00000002-0002-0002-0002-0000000003e2/a7d4ddb9-4486-4e37-b524-29625d6a7e61/images/238e79c3-378b-4117-9b6d-18f73832f286/a8730e05-ed95-4d41-a10d-e249b601ebd3,if=none,id=drive-virtio-disk1,format=qcow2,serial=238e79c3-378b-4117-9b6d-18f73832f286,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x7,drive=drive-virtio-disk1,id=virtio-disk1 -netdev tap,fd=29,id=hostnet0,vhost=on,vhostfd=30 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:00:1a:4a:ae:02,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/fbbdc0a0-23a4-4d32-a526-a35c59eb790d.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/fbbdc0a0-23a4-4d32-a526-a35c59eb790d.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev pty,id=charconsole0 -device virtconsole,chardev=charconsole0,id=console0 -device usb-tablet,id=input0 -vnc 172.16.1.14:2,password -k en-us -vga cirrus -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x8 -msg timestamp=on
Sven
Thanks a lot. I will try trace this issue on my local setup. Best regards, Vadim.
-----Ursprüngliche Nachricht----- Von: Vadim Rozenfeld [mailto:vrozenfe@redhat.com] Gesendet: Montag, 4. Mai 2015 05:00 An: Sven Achtelik Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users@ovirt.org Betreff: Re: AW: AW: Bad performance with Windows 2012 guests
On Sun, 2015-05-03 at 07:46 -0500, Sven Achtelik wrote:
Hi Vadim,
I've tested the performance with CrystalDiskMark from inside the Windows guest. Using Win2k8 R2 I got expected values for my system, about 88 MB/s on 4k random with 32 queues and 500MB/s + sequential writes with 32 queues. Using a Windows 2012 VM on the same system it's only 33MB/s on 4k random with 32 queues and 300MB/s sequential writes. Similar tests with a linux VM show a bit better values than the Win2k8 R2 and respond ultra-fast.
My hosts are connected via iSCSI using a 10 GbE link and a ZFS appliance as the storage system. All tests have been run several times with the same results.
Sven, Can I ask you to post the Windows 2012 VM qemu command line?
Thanks, Vadim.
Sven
-----Ursprüngliche Nachricht----- Von: Vadim Rozenfeld [mailto:vrozenfe@redhat.com] Gesendet: Sonntag, 3. Mai 2015 14:35 An: Sven Achtelik Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users@ovirt.org Betreff: Re: AW: Bad performance with Windows 2012 guests
On Sun, 2015-05-03 at 06:48 -0500, Sven Achtelik wrote:
Hi Doron,
I've also noticed that there seems to be a difference in performance between Win2k8 R2/Linux and Windows Server 2012. After reading Martijns post I've done some speed test regarding the drive speeds and was looking for a way to compare the VMs on a more professional way. My tests showed, that on the same hardware, the Win2k8 R2 was faster in response and throughput on the disks. I found a utility that somehow measures the latency on a system and that also showed a significant difference. What is the correct way to do a performance test on a VM running in KVM ?
Sven
Hi Sven,
Can you specify the type of disk on your system - ide, virtio-blk, or virtio-scsi? We usually use iometer for disk performance profiling. Sequential read/write, block size from 4K up to 256K, queue depth from 1 to 64.
Vadim.
-----Ursprüngliche Nachricht----- Von: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] Im Auftrag von Doron Fediuck Gesendet: Samstag, 2. Mai 2015 10:50 An: Martijn Grendelman Cc: Karen Noel; users@ovirt.org; Vadim Rozenfeld Betreff: Re: [ovirt-users] Bad performance with Windows 2012 guests
On Apr 30, 2015 14:03, Martijn Grendelman <martijn.grendelman@isaac.nl> wrote:
Hi,
Ever since our first Windows Server 2012 deployment on oVirt (3.4 back then, now 3.5.1), I have noticed that working on these VMs via RDP or on the console via VNC is noticeably slower than on Windows 2008 guests on the same oVirt environment.
Basic things like starting an application (even the Server Manager that get started automatically on login) take a very long time, sometimes minutes. Everything is just... slow.
We have recently deployed Microsoft Exchange on a Windows Server 2012 guest on RHEV, and it doesn't perform well at all.
I haven't been able to find the cause for this slowness; CPU usage is not excessive and it doesn't seem I/O related. Moreover, other types of guests (Linux and even Windows 2008) do not have this problem.
We have 3 different environments: - oVirt 3.5.1, on old Dell servers with Penryn Family CPUs with fairly slow storage on replicated GlusterFS, running CentOS 6.6 - oVirt 3.5.1, on modern 6-core SandyBridge servers with local storage via NFS, running CentOS 7.0) - RHEV 3.4.4 on modern 10-core SandyBridge servers with an iSCSI SAN behind it, running on RHEV Hypervisor 6.5
All of these -very different- environments expose the same behaviour: Linux, Windows 2008 fast (or as fast as can be expected given the hardware), Windows 2012 painfully slow.
All Windows 2012 servers use VirtIO disk and network. I think all drivers are from the virtio-win-0.1-74 ISO.
Does anyone share this experience? Any idea why this could happen and how it can be fixed? Any other information I should share to get a better idea?
Btw, for the guests on the RHEV environment, we have a case with RedHat support, but that doesn't seem to lead to a quick solution, hence I'm writing here, too.
Thanks for any help.
Regards, Martijn Grendelman
Hi Martijn, Can you please provide the QEMU command line, together with kvm and qemu version?
This information will be helpful for reproducing the problem. However, if the problem is not reproducible on a local setup, we will probably need to ask collecting some performance information with xperf tool.
Doron _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
On Mon, 2015-05-18 at 10:41 -0500, Sven Achtelik wrote:
Hi Vadim,
could you reproduce my issue with your system ? Do you have any advice on getting more performance with Win2012 ?
Thank you,
Sven
Hi Sven, Sorry for the delay in my response. I got pretty much mixed results compering WS2008R2 vs WS2012R2 running on RHEL6.5, as well as WS2012R2 running on RHEL6.5 vs WS2012R2 on top of RHEL7.0. As you can see, no matter what, on my setup WS2012R2 always performs better than WS2008R2. However, read performance is really poor for WS2012R2 running on top of RHEL 6.5 host. I'm still running some tests to get better understanding of this issue. Best regards, Vadim. RHEL 6.5 RHEL 7 2012R2 2008R2 2012R2 WRITE QueueDepth Write MBps Write MBps Write MBps 1 37.216108 21.226565 35.023852 2 49.235277 25.07046 49.721528 4 74.12603 26.803523 70.124819 8 85.755117 33.16154 84.640384 16 85.082841 41.244631 88.212587 32 98.192543 39.191664 101.577272 64 94.408442 39.071777 98.469119 128 READ QueueDepth Read MBps Read MBps Read MBps 1 3.901276 6.144556 10.166953 2 2.439766 5.48212 6.111812 4 2.42859 5.695189 6.873459 8 2.454445 5.573197 6.503373 16 2.501744 5.860625 6.628163 32 3.077649 7.360166 10.912386 64 6.61292 10.185036 13.890179 124
-----Ursprüngliche Nachricht----- Von: Vadim Rozenfeld [mailto:vrozenfe@redhat.com] Gesendet: Dienstag, 5. Mai 2015 02:57 An: Sven Achtelik Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users@ovirt.org Betreff: Re: AW: AW: AW: Bad performance with Windows 2012 guests
On Mon, 2015-05-04 at 03:32 -0500, Sven Achtelik wrote:
Hi Vadim,
the command line:
/usr/libexec/qemu-kvm -name wc_db01 -S -machine rhel6.5.0,accel=kvm,usb=off -cpu Westmere -m 12288 -realtime mlock=off -smp 2,maxcpus=16,sockets=16,cores=1,threads=1 -uuid fbbdc0a0-23a4-4d32-a526-a35c59eb790d -smbios type=1,manufacturer=oVirt,product=oVirt Node,version=7-1.1503.el7.centos.2.8,serial=4C4C4544-0035-4E10-8034-B4C04F4B4E31,uuid=fbbdc0a0-23a4-4d32-a526-a35c59eb790d -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/wc_db01.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2015-05-04T03:26:39,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5 -drive file=/rhev/data-center/mnt/ovirt-engine.mgmt.asl.local:_var_lib_exports_iso/d1559536-71da-4b7a-ad71-171b0b528d7f/images/11111111-1111-1111-1111-111111111111/SVR2012EVAL.iso,if=none,id=drive-ide0-1-0,readonly=on,format=raw,serial= -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0,bootindex=2 -drive file=/rhev/data-center/00000002-0002-0002-0002-0000000003e2/a7d4ddb9-4486-4e37-b524-29625d6a7e61/images/23672c7f-ec3c-4686-bc29-89a0f95eae1c/9741917b-9134-4e14-892d-d16abf13e406,if=none,id=drive-virtio-disk0,format=raw,serial=23672c7f-ec3c-4686-bc29-89a0f95eae1c,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive file=/rhev/data-center/00000002-0002-0002-0002-0000000003e2/a7d4ddb9-4486-4e37-b524-29625d6a7e61/images/238e79c3-378b-4117-9b6d-18f73832f286/a8730e05-ed95-4d41-a10d-e249b601ebd3,if=none,id=drive-virtio-disk1,format=qcow2,serial=238e79c3-378b-4117-9b6d-18f73832f286,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x7,drive=drive-virtio-disk1,id=virtio-disk1 -netdev tap,fd=29,id=hostnet0,vhost=on,vhostfd=30 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:00:1a:4a:ae:02,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/fbbdc0a0-23a4-4d32-a526-a35c59eb790d.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/fbbdc0a0-23a4-4d32-a526-a35c59eb790d.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev pty,id=charconsole0 -device virtconsole,chardev=charconsole0,id=console0 -device usb-tablet,id=input0 -vnc 172.16.1.14:2,password -k en-us -vga cirrus -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x8 -msg timestamp=on
Sven
Thanks a lot. I will try trace this issue on my local setup. Best regards, Vadim.
-----Ursprüngliche Nachricht----- Von: Vadim Rozenfeld [mailto:vrozenfe@redhat.com] Gesendet: Montag, 4. Mai 2015 05:00 An: Sven Achtelik Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users@ovirt.org Betreff: Re: AW: AW: Bad performance with Windows 2012 guests
On Sun, 2015-05-03 at 07:46 -0500, Sven Achtelik wrote:
Hi Vadim,
I've tested the performance with CrystalDiskMark from inside the Windows guest. Using Win2k8 R2 I got expected values for my system, about 88 MB/s on 4k random with 32 queues and 500MB/s + sequential writes with 32 queues. Using a Windows 2012 VM on the same system it's only 33MB/s on 4k random with 32 queues and 300MB/s sequential writes. Similar tests with a linux VM show a bit better values than the Win2k8 R2 and respond ultra-fast.
My hosts are connected via iSCSI using a 10 GbE link and a ZFS appliance as the storage system. All tests have been run several times with the same results.
Sven, Can I ask you to post the Windows 2012 VM qemu command line?
Thanks, Vadim.
Sven
-----Ursprüngliche Nachricht----- Von: Vadim Rozenfeld [mailto:vrozenfe@redhat.com] Gesendet: Sonntag, 3. Mai 2015 14:35 An: Sven Achtelik Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users@ovirt.org Betreff: Re: AW: Bad performance with Windows 2012 guests
On Sun, 2015-05-03 at 06:48 -0500, Sven Achtelik wrote:
Hi Doron,
I've also noticed that there seems to be a difference in performance between Win2k8 R2/Linux and Windows Server 2012. After reading Martijns post I've done some speed test regarding the drive speeds and was looking for a way to compare the VMs on a more professional way. My tests showed, that on the same hardware, the Win2k8 R2 was faster in response and throughput on the disks. I found a utility that somehow measures the latency on a system and that also showed a significant difference. What is the correct way to do a performance test on a VM running in KVM ?
Sven
Hi Sven,
Can you specify the type of disk on your system - ide, virtio-blk, or virtio-scsi? We usually use iometer for disk performance profiling. Sequential read/write, block size from 4K up to 256K, queue depth from 1 to 64.
Vadim.
-----Ursprüngliche Nachricht----- Von: users-bounces@ovirt.org [mailto:users-bounces@ovirt.org] Im Auftrag von Doron Fediuck Gesendet: Samstag, 2. Mai 2015 10:50 An: Martijn Grendelman Cc: Karen Noel; users@ovirt.org; Vadim Rozenfeld Betreff: Re: [ovirt-users] Bad performance with Windows 2012 guests
On Apr 30, 2015 14:03, Martijn Grendelman <martijn.grendelman@isaac.nl> wrote:
Hi,
Ever since our first Windows Server 2012 deployment on oVirt (3.4 back then, now 3.5.1), I have noticed that working on these VMs via RDP or on the console via VNC is noticeably slower than on Windows 2008 guests on the same oVirt environment.
Basic things like starting an application (even the Server Manager that get started automatically on login) take a very long time, sometimes minutes. Everything is just... slow.
We have recently deployed Microsoft Exchange on a Windows Server 2012 guest on RHEV, and it doesn't perform well at all.
I haven't been able to find the cause for this slowness; CPU usage is not excessive and it doesn't seem I/O related. Moreover, other types of guests (Linux and even Windows 2008) do not have this problem.
We have 3 different environments: - oVirt 3.5.1, on old Dell servers with Penryn Family CPUs with fairly slow storage on replicated GlusterFS, running CentOS 6.6 - oVirt 3.5.1, on modern 6-core SandyBridge servers with local storage via NFS, running CentOS 7.0) - RHEV 3.4.4 on modern 10-core SandyBridge servers with an iSCSI SAN behind it, running on RHEV Hypervisor 6.5
All of these -very different- environments expose the same behaviour: Linux, Windows 2008 fast (or as fast as can be expected given the hardware), Windows 2012 painfully slow.
All Windows 2012 servers use VirtIO disk and network. I think all drivers are from the virtio-win-0.1-74 ISO.
Does anyone share this experience? Any idea why this could happen and how it can be fixed? Any other information I should share to get a better idea?
Btw, for the guests on the RHEV environment, we have a case with RedHat support, but that doesn't seem to lead to a quick solution, hence I'm writing here, too.
Thanks for any help.
Regards, Martijn Grendelman
Hi Martijn, Can you please provide the QEMU command line, together with kvm and qemu version?
This information will be helpful for reproducing the problem. However, if the problem is not reproducible on a local setup, we will probably need to ask collecting some performance information with xperf tool.
Doron _______________________________________________ Users mailing list Users@ovirt.org http://lists.ovirt.org/mailman/listinfo/users
participants (3)
-
Doron Fediuck -
Sven Achtelik -
Vadim Rozenfeld