[ovirt-users] Bad performance with Windows 2012 guests

Tue May 19 06:57:18 UTC 2015

On Mon, 2015-05-18 at 10:41 -0500, Sven Achtelik wrote:
> Hi Vadim, 
> 
> could you reproduce my issue with your system ? Do you have any advice on getting more performance with Win2012 ?
> 
> Thank you, 
> 
> Sven 

Hi Sven,
Sorry for the delay in my response.

I got pretty much mixed results compering WS2008R2 vs WS2012R2
running on RHEL6.5, as well as WS2012R2 running on RHEL6.5 vs
WS2012R2 on top of RHEL7.0. 

As you can see, no matter what, on my setup WS2012R2 always performs
better than WS2008R2. However, read performance is really poor for
WS2012R2 running on top of RHEL 6.5 host. I'm still running some tests
to get better understanding of this issue.

Best regards,
Vadim.

RHEL 6.5			RHEL 7
2012R2		2008R2		2012R2

WRITE						QueueDepth
Write MBps	Write MBps	Write MBps	1
37.216108	21.226565	35.023852	2
49.235277	25.07046	49.721528	4
74.12603	26.803523	70.124819	8
85.755117	33.16154	84.640384	16
85.082841	41.244631	88.212587	32
98.192543	39.191664	101.577272	64
94.408442	39.071777	98.469119	128

READ						QueueDepth
Read MBps	Read MBps	Read MBps	1
3.901276	6.144556	10.166953	2
2.439766	5.48212		6.111812	4
2.42859		5.695189	6.873459	8
2.454445	5.573197	6.503373	16
2.501744	5.860625	6.628163	32
3.077649	7.360166	10.912386	64
6.61292		10.185036	13.890179	124

> 
> -----Ursprüngliche Nachricht-----
> Von: Vadim Rozenfeld [mailto:vrozenfe at redhat.com] 
> Gesendet: Dienstag, 5. Mai 2015 02:57
> An: Sven Achtelik
> Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users at ovirt.org
> Betreff: Re: AW: AW: AW: Bad performance with Windows 2012 guests
> 
> On Mon, 2015-05-04 at 03:32 -0500, Sven Achtelik wrote:
> > Hi Vadim, 
> > 
> > the command line: 
> > 
> > /usr/libexec/qemu-kvm -name wc_db01 -S -machine rhel6.5.0,accel=kvm,usb=off -cpu Westmere -m 12288 -realtime mlock=off -smp 2,maxcpus=16,sockets=16,cores=1,threads=1 -uuid fbbdc0a0-23a4-4d32-a526-a35c59eb790d -smbios type=1,manufacturer=oVirt,product=oVirt Node,version=7-1.1503.el7.centos.2.8,serial=4C4C4544-0035-4E10-8034-B4C04F4B4E31,uuid=fbbdc0a0-23a4-4d32-a526-a35c59eb790d -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/wc_db01.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2015-05-04T03:26:39,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5 -drive file=/rhev/data-center/mnt/ovirt-engine.mgmt.asl.local:_var_lib_exports_iso/d1559536-71da-4b7a-ad71-171b0b528d7f/images/11111111-1111-1111-1111-111111111111/SVR2012EVAL.iso,if=none,id=drive-ide0-1-0,readonly=on,format=raw,serial= -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0,bootindex=2 -drive file=/rhev/data-center/00000002-0002-0002-0002-0000000003e2/a7d4ddb9-4486-4e37-b524-29625d6a7e61/images/23672c7f-ec3c-4686-bc29-89a0f95eae1c/9741917b-9134-4e14-892d-d16abf13e406,if=none,id=drive-virtio-disk0,format=raw,serial=23672c7f-ec3c-4686-bc29-89a0f95eae1c,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive file=/rhev/data-center/00000002-0002-0002-0002-0000000003e2/a7d4ddb9-4486-4e37-b524-29625d6a7e61/images/238e79c3-378b-4117-9b6d-18f73832f286/a8730e05-ed95-4d41-a10d-e249b601ebd3,if=none,id=drive-virtio-disk1,format=qcow2,serial=238e79c3-378b-4117-9b6d-18f73832f286,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x7,drive=drive-virtio-disk1,id=virtio-disk1 -netdev tap,fd=29,id=hostnet0,vhost=on,vhostfd=30 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:00:1a:4a:ae:02,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/fbbdc0a0-23a4-4d32-a526-a35c59eb790d.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/fbbdc0a0-23a4-4d32-a526-a35c59eb790d.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev pty,id=charconsole0 -device virtconsole,chardev=charconsole0,id=console0 -device usb-tablet,id=input0 -vnc 172.16.1.14:2,password -k en-us -vga cirrus -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x8 -msg timestamp=on
> > 
> > Sven 
> > 
> 
> Thanks a lot.
> I will try trace this issue on my local setup.
> Best regards,
> Vadim.
> 
> > -----Ursprüngliche Nachricht-----
> > Von: Vadim Rozenfeld [mailto:vrozenfe at redhat.com] 
> > Gesendet: Montag, 4. Mai 2015 05:00
> > An: Sven Achtelik
> > Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users at ovirt.org
> > Betreff: Re: AW: AW: Bad performance with Windows 2012 guests
> > 
> > On Sun, 2015-05-03 at 07:46 -0500, Sven Achtelik wrote:
> > > Hi Vadim,
> > > 
> > > I've tested the performance with CrystalDiskMark from inside the Windows guest. Using Win2k8 R2 I got expected values for my system, about 88 MB/s on 4k random with 32 queues and 500MB/s + sequential writes with 32 queues. Using a Windows 2012 VM on the same system it's only 33MB/s on 4k random with 32 queues and 300MB/s sequential writes. Similar tests with a linux VM show a bit better values than the Win2k8 R2 and respond ultra-fast.
> > > 
> > > My hosts are connected via iSCSI using a 10 GbE link and a ZFS appliance as the storage system. All tests have been run several times with the same results.
> > 
> > Sven,
> > Can I ask you to post the Windows 2012 VM qemu command line?
> > 
> > Thanks,
> > Vadim.
> > 
> > > 
> > > Sven
> > > 
> > > -----Ursprüngliche Nachricht-----
> > > Von: Vadim Rozenfeld [mailto:vrozenfe at redhat.com]
> > > Gesendet: Sonntag, 3. Mai 2015 14:35
> > > An: Sven Achtelik
> > > Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users at ovirt.org
> > > Betreff: Re: AW: Bad performance with Windows 2012 guests
> > > 
> > > On Sun, 2015-05-03 at 06:48 -0500, Sven Achtelik wrote:
> > > > Hi Doron,
> > > > 
> > > > I've also noticed that there seems to be a difference in performance between Win2k8 R2/Linux and Windows Server 2012. After reading Martijns post I've done some speed test regarding the drive speeds and was looking for a way to compare the VMs on a more professional way. My tests showed, that on the same hardware, the Win2k8 R2 was faster in response and throughput on the disks. I found a utility that somehow measures the latency on a system and that also showed a significant difference. What is the correct way to do a performance test on a VM running in KVM ? 
> > > > 
> > > > Sven
> > > > 
> > > Hi Sven,
> > > 
> > > Can you specify the type of disk on your system - ide, virtio-blk, or virtio-scsi?
> > > We usually use iometer for disk performance profiling. Sequential read/write, block size from 4K up to 256K, queue depth from 1 to 64.
> > >  
> > > Vadim.
> > > > -----Ursprüngliche Nachricht-----
> > > > Von: users-bounces at ovirt.org [mailto:users-bounces at ovirt.org] Im 
> > > > Auftrag von Doron Fediuck
> > > > Gesendet: Samstag, 2. Mai 2015 10:50
> > > > An: Martijn Grendelman
> > > > Cc: Karen Noel; users at ovirt.org; Vadim Rozenfeld
> > > > Betreff: Re: [ovirt-users] Bad performance with Windows 2012 guests
> > > > 
> > > > 
> > > > On Apr 30, 2015 14:03, Martijn Grendelman <martijn.grendelman at isaac.nl> wrote:
> > > > >
> > > > > Hi,
> > > > >
> > > > > Ever since our first Windows Server 2012 deployment on oVirt (3.4 
> > > > > back then, now 3.5.1), I have noticed that working on these VMs 
> > > > > via RDP or on the console via VNC is noticeably slower than on 
> > > > > Windows
> > > > > 2008 guests on the same oVirt environment.
> > > > >
> > > > > Basic things like starting an application (even the Server Manager 
> > > > > that get started automatically on login) take a very long time, 
> > > > > sometimes minutes. Everything is just... slow.
> > > > >
> > > > > We have recently deployed Microsoft Exchange on a Windows Server
> > > > > 2012 guest on RHEV, and it doesn't perform well at all.
> > > > >
> > > > > I haven't been able to find the cause for this slowness; CPU usage 
> > > > > is not excessive and it doesn't seem I/O related. Moreover, other 
> > > > > types of guests (Linux and even Windows 2008) do not have this problem.
> > > > >
> > > > > We have 3 different environments: 
> > > > > - oVirt 3.5.1, on old Dell servers with Penryn Family CPUs with 
> > > > > fairly slow storage on replicated GlusterFS, running CentOS 6.6
> > > > > - oVirt 3.5.1, on modern 6-core SandyBridge servers with local 
> > > > > storage via NFS, running CentOS 7.0)
> > > > > - RHEV 3.4.4 on modern 10-core SandyBridge servers with an iSCSI 
> > > > > SAN behind it, running on RHEV Hypervisor 6.5
> > > > >
> > > > > All of these -very different- environments expose the same behaviour: 
> > > > > Linux, Windows 2008 fast (or as fast as can be expected given the 
> > > > > hardware), Windows 2012 painfully slow.
> > > > >
> > > > > All Windows 2012 servers use VirtIO disk and network. I think all 
> > > > > drivers are from the virtio-win-0.1-74 ISO.
> > > > >
> > > > > Does anyone share this experience? 
> > > > > Any idea why this could happen and how it can be fixed? 
> > > > > Any other information I should share to get a better idea? 
> > > > >
> > > > > Btw, for the guests on the RHEV environment, we have a case with 
> > > > > RedHat support, but that doesn't seem to lead to a quick solution, 
> > > > > hence I'm writing here, too.
> > > > >
> > > > > Thanks for any help. 
> > > > >
> > > > > Regards,
> > > > > Martijn Grendelman
> > > > 
> > > > Hi Martijn,
> > > > Can you please provide the QEMU command line, together with kvm and qemu version?
> > > > 
> > > > This information will be helpful for reproducing the problem. However, if the problem is not reproducible on a local setup, we will probably need to ask collecting some performance information with xperf tool. 
> > > > 
> > > > Doron
> > > > _______________________________________________
> > > > Users mailing list
> > > > Users at ovirt.org
> > > > http://lists.ovirt.org/mailman/listinfo/users
> > > > 
> > > 
> > 
> 