[ovirt-users] Performance Issue

[Thomas Fecke]

Atleast we found the Bottle neck. Our Data Domain is the Problem

IOStat:

Device:         rrqm/s   wrqm/s     r/s     w/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0,00   615,67   78,00  962,33  2125,33 37065,33    75,34     5,68    5,42    1,10    5,77   0,96  99,40

avg-cpu:  %user   %nice %system %iowait  %steal   %idle
           0,00    0,00    1,44   22,63    0,00   75,93

Device:         rrqm/s   wrqm/s     r/s     w/s    rkB/s    wkB/s avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
sda               0,67   655,33   92,00 1033,67  2446,67 38390,67    72,56     5,66    5,06    1,83    5,35   0,88  99,50


Any Idea why we got so much write Requests? Its getting up to 2000.

I guess the IO is from our Windows VM´s







From: users-bounces at ovirt.org <users-bounces at ovirt.org> On Behalf Of Thomas Fecke
Sent: Dienstag, 17. April 2018 16:18
To: Roy Golan <rgolan at redhat.com>
Cc: users at ovirt.org
Subject: Re: [ovirt-users] Performance Issue

Guest: Win 10 and 2016
Disk: VirtISCSI – Thin provision
Domain: Single Data Domain – NFS 4


From: Roy Golan <rgolan at redhat.com>
Sent: Dienstag, 17. April 2018 12:58
To: Thomas Fecke <thomas.fecke at eset.de>
Cc: users at ovirt.org
Subject: Re: [ovirt-users] Performance Issue


On Tue, 17 Apr 2018 at 12:58 Thomas Fecke <thomas.fecke at eset.de<mailto:thomas.fecke at eset.de>> wrote:
Hey Thank you,

If been monitoring vor about an Hour now. The Templates VM´s are really slow – copy a new Template is slow. Non Template VM´s are fast

Storage IO is average on 75 M/s Read Disk and 25 Write Disk. ( SSD Raid )
Network is on 500 Mbits/s internal ( 10 Gbit Stroage connection )
And about 25Mbit/s external ( 400.000 k Internet )

I realy cant find that bottle neck


what type is the disks, the domain, how many domains ?

From: Roy Golan <rgolan at redhat.com<mailto:rgolan at redhat.com>>
Sent: Dienstag, 17. April 2018 11:52
To: Thomas Fecke <thomas.fecke at eset.de<mailto:thomas.fecke at eset.de>>
Cc: users at ovirt.org<mailto:users at ovirt.org>
Subject: Re: [ovirt-users] Performance Issue


On Tue, 17 Apr 2018 at 12:45 Thomas Fecke <thomas.fecke at eset.de<mailto:thomas.fecke at eset.de>> wrote:
Okay,

it seems to be that the Storage IO is the Problem – every Write and Read Process takes a lot of time

Sometimes the copy Job stops with 0/Byte and the traffic goes up and down like a mountain.


But the Storage Read and Write M/s looking fine… I don’t get it

Any toughts?


Keep monitoring you storage backend interface and see what's going on there if you don't see anything special on the host. It could be the network that leads to slow IO as well, who knows.
If the initial VM creation is taking long you might want to create a pool from your template with Pre-Started VMs, and that would at least save you from the wait when you actually need the VM.

From: users-bounces at ovirt.org<mailto:users-bounces at ovirt.org> <users-bounces at ovirt.org<mailto:users-bounces at ovirt.org>> On Behalf Of Thomas Fecke
Sent: Dienstag, 17. April 2018 10:58
To: users at ovirt.org<mailto:users at ovirt.org>
Subject: [ovirt-users] Performance Issue

Hey Guys,

We Deploy a lot of Templates. We got our Training Environment build in Ovirt.

Our Problem – when we Deploy the Same Template. The VM´s getting slower every Time we deply a new VM from that Template.

And I really don’t know why. RAM locking good – CPU and Network looking good.

But it take about 15 Minute to create a new Template based VM – normaly it takes about 30 Seconds.

I checked nload and the Interface traffic – but its not really high.

Can someone explain why its getting so slow and how to troubleshoot?

_______________________________________________
Users mailing list
Users at ovirt.org<mailto:Users at ovirt.org>
http://lists.ovirt.org/mailman/listinfo/users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.ovirt.org/pipermail/users/attachments/20180418/6e2967ef/attachment.html>