[ovirt-users] Bad performance with Windows 2012 guests

Mon May 4 08:32:01 UTC 2015

Hi Vadim, 

the command line: 

/usr/libexec/qemu-kvm -name wc_db01 -S -machine rhel6.5.0,accel=kvm,usb=off -cpu Westmere -m 12288 -realtime mlock=off -smp 2,maxcpus=16,sockets=16,cores=1,threads=1 -uuid fbbdc0a0-23a4-4d32-a526-a35c59eb790d -smbios type=1,manufacturer=oVirt,product=oVirt Node,version=7-1.1503.el7.centos.2.8,serial=4C4C4544-0035-4E10-8034-B4C04F4B4E31,uuid=fbbdc0a0-23a4-4d32-a526-a35c59eb790d -no-user-config -nodefaults -chardev socket,id=charmonitor,path=/var/lib/libvirt/qemu/wc_db01.monitor,server,nowait -mon chardev=charmonitor,id=monitor,mode=control -rtc base=2015-05-04T03:26:39,driftfix=slew -global kvm-pit.lost_tick_policy=discard -no-hpet -no-shutdown -boot strict=on -device piix3-usb-uhci,id=usb,bus=pci.0,addr=0x1.0x2 -device virtio-scsi-pci,id=scsi0,bus=pci.0,addr=0x4 -device virtio-serial-pci,id=virtio-serial0,max_ports=16,bus=pci.0,addr=0x5 -drive file=/rhev/data-center/mnt/ovirt-engine.mgmt.asl.local:_var_lib_exports_iso/d1559536-71da-4b7a-ad71-171b0b528d7f/images/11111111-1111-1111-1111-111111111111/SVR2012EVAL.iso,if=none,id=drive-ide0-1-0,readonly=on,format=raw,serial= -device ide-cd,bus=ide.1,unit=0,drive=drive-ide0-1-0,id=ide0-1-0,bootindex=2 -drive file=/rhev/data-center/00000002-0002-0002-0002-0000000003e2/a7d4ddb9-4486-4e37-b524-29625d6a7e61/images/23672c7f-ec3c-4686-bc29-89a0f95eae1c/9741917b-9134-4e14-892d-d16abf13e406,if=none,id=drive-virtio-disk0,format=raw,serial=23672c7f-ec3c-4686-bc29-89a0f95eae1c,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x6,drive=drive-virtio-disk0,id=virtio-disk0,bootindex=1 -drive file=/rhev/data-center/00000002-0002-0002-0002-0000000003e2/a7d4ddb9-4486-4e37-b524-29625d6a7e61/images/238e79c3-378b-4117-9b6d-18f73832f286/a8730e05-ed95-4d41-a10d-e249b601ebd3,if=none,id=drive-virtio-disk1,format=qcow2,serial=238e79c3-378b-4117-9b6d-18f73832f286,cache=none,werror=stop,rerror=stop,aio=native -device virtio-blk-pci,scsi=off,bus=pci.0,addr=0x7,drive=drive-virtio-disk1,id=virtio-disk1 -netdev tap,fd=29,id=hostnet0,vhost=on,vhostfd=30 -device virtio-net-pci,netdev=hostnet0,id=net0,mac=00:00:1a:4a:ae:02,bus=pci.0,addr=0x3 -chardev socket,id=charchannel0,path=/var/lib/libvirt/qemu/channels/fbbdc0a0-23a4-4d32-a526-a35c59eb790d.com.redhat.rhevm.vdsm,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=1,chardev=charchannel0,id=channel0,name=com.redhat.rhevm.vdsm -chardev socket,id=charchannel1,path=/var/lib/libvirt/qemu/channels/fbbdc0a0-23a4-4d32-a526-a35c59eb790d.org.qemu.guest_agent.0,server,nowait -device virtserialport,bus=virtio-serial0.0,nr=2,chardev=charchannel1,id=channel1,name=org.qemu.guest_agent.0 -chardev pty,id=charconsole0 -device virtconsole,chardev=charconsole0,id=console0 -device usb-tablet,id=input0 -vnc 172.16.1.14:2,password -k en-us -vga cirrus -device virtio-balloon-pci,id=balloon0,bus=pci.0,addr=0x8 -msg timestamp=on

Sven 

-----Ursprüngliche Nachricht-----
Von: Vadim Rozenfeld [mailto:vrozenfe at redhat.com] 
Gesendet: Montag, 4. Mai 2015 05:00
An: Sven Achtelik
Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users at ovirt.org
Betreff: Re: AW: AW: Bad performance with Windows 2012 guests

On Sun, 2015-05-03 at 07:46 -0500, Sven Achtelik wrote:
> Hi Vadim,
> 
> I've tested the performance with CrystalDiskMark from inside the Windows guest. Using Win2k8 R2 I got expected values for my system, about 88 MB/s on 4k random with 32 queues and 500MB/s + sequential writes with 32 queues. Using a Windows 2012 VM on the same system it's only 33MB/s on 4k random with 32 queues and 300MB/s sequential writes. Similar tests with a linux VM show a bit better values than the Win2k8 R2 and respond ultra-fast.
> 
> My hosts are connected via iSCSI using a 10 GbE link and a ZFS appliance as the storage system. All tests have been run several times with the same results.

Sven,
Can I ask you to post the Windows 2012 VM qemu command line?

Thanks,
Vadim.

> 
> Sven
> 
> -----Ursprüngliche Nachricht-----
> Von: Vadim Rozenfeld [mailto:vrozenfe at redhat.com]
> Gesendet: Sonntag, 3. Mai 2015 14:35
> An: Sven Achtelik
> Cc: Doron Fediuck; Martijn Grendelman; Karen Noel; users at ovirt.org
> Betreff: Re: AW: Bad performance with Windows 2012 guests
> 
> On Sun, 2015-05-03 at 06:48 -0500, Sven Achtelik wrote:
> > Hi Doron,
> > 
> > I've also noticed that there seems to be a difference in performance between Win2k8 R2/Linux and Windows Server 2012. After reading Martijns post I've done some speed test regarding the drive speeds and was looking for a way to compare the VMs on a more professional way. My tests showed, that on the same hardware, the Win2k8 R2 was faster in response and throughput on the disks. I found a utility that somehow measures the latency on a system and that also showed a significant difference. What is the correct way to do a performance test on a VM running in KVM ? 
> > 
> > Sven
> > 
> Hi Sven,
> 
> Can you specify the type of disk on your system - ide, virtio-blk, or virtio-scsi?
> We usually use iometer for disk performance profiling. Sequential read/write, block size from 4K up to 256K, queue depth from 1 to 64.
>  
> Vadim.
> > -----Ursprüngliche Nachricht-----
> > Von: users-bounces at ovirt.org [mailto:users-bounces at ovirt.org] Im 
> > Auftrag von Doron Fediuck
> > Gesendet: Samstag, 2. Mai 2015 10:50
> > An: Martijn Grendelman
> > Cc: Karen Noel; users at ovirt.org; Vadim Rozenfeld
> > Betreff: Re: [ovirt-users] Bad performance with Windows 2012 guests
> > 
> > 
> > On Apr 30, 2015 14:03, Martijn Grendelman <martijn.grendelman at isaac.nl> wrote:
> > >
> > > Hi,
> > >
> > > Ever since our first Windows Server 2012 deployment on oVirt (3.4 
> > > back then, now 3.5.1), I have noticed that working on these VMs 
> > > via RDP or on the console via VNC is noticeably slower than on 
> > > Windows
> > > 2008 guests on the same oVirt environment.
> > >
> > > Basic things like starting an application (even the Server Manager 
> > > that get started automatically on login) take a very long time, 
> > > sometimes minutes. Everything is just... slow.
> > >
> > > We have recently deployed Microsoft Exchange on a Windows Server
> > > 2012 guest on RHEV, and it doesn't perform well at all.
> > >
> > > I haven't been able to find the cause for this slowness; CPU usage 
> > > is not excessive and it doesn't seem I/O related. Moreover, other 
> > > types of guests (Linux and even Windows 2008) do not have this problem.
> > >
> > > We have 3 different environments: 
> > > - oVirt 3.5.1, on old Dell servers with Penryn Family CPUs with 
> > > fairly slow storage on replicated GlusterFS, running CentOS 6.6
> > > - oVirt 3.5.1, on modern 6-core SandyBridge servers with local 
> > > storage via NFS, running CentOS 7.0)
> > > - RHEV 3.4.4 on modern 10-core SandyBridge servers with an iSCSI 
> > > SAN behind it, running on RHEV Hypervisor 6.5
> > >
> > > All of these -very different- environments expose the same behaviour: 
> > > Linux, Windows 2008 fast (or as fast as can be expected given the 
> > > hardware), Windows 2012 painfully slow.
> > >
> > > All Windows 2012 servers use VirtIO disk and network. I think all 
> > > drivers are from the virtio-win-0.1-74 ISO.
> > >
> > > Does anyone share this experience? 
> > > Any idea why this could happen and how it can be fixed? 
> > > Any other information I should share to get a better idea? 
> > >
> > > Btw, for the guests on the RHEV environment, we have a case with 
> > > RedHat support, but that doesn't seem to lead to a quick solution, 
> > > hence I'm writing here, too.
> > >
> > > Thanks for any help. 
> > >
> > > Regards,
> > > Martijn Grendelman
> > 
> > Hi Martijn,
> > Can you please provide the QEMU command line, together with kvm and qemu version?
> > 
> > This information will be helpful for reproducing the problem. However, if the problem is not reproducible on a local setup, we will probably need to ask collecting some performance information with xperf tool. 
> > 
> > Doron
> > _______________________________________________
> > Users mailing list
> > Users at ovirt.org
> > http://lists.ovirt.org/mailman/listinfo/users
> > 
> 