[ovirt-users] Performance Issue

Tony Brian Albers tba at kb.dk
Wed Apr 18 12:25:59 UTC 2018


You need a lot faster disks to keep up with all that random I/O.

"Storage IO is average on 75 M/s Read Disk and 25 Write Disk. ( SSD
 >     Raid )"

Ehm, are you running VM's on a DD box?  Why on earth would you do that?

/tony


On 2018-04-18 14:09, Thomas Fecke wrote:
> Atleast we found the Bottle neck. Our Data Domain is the Problem
> 
> IOStat:
> 
> Device:         rrqm/s   wrqm/s     r/s     w/s    rkB/s    wkB/s 
> avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
> 
> sda               0,00   615,67   78,00  962,33  2125,33 37065,33    
> 75,34     5,68    5,42    1,10    5,77   0,96  99,40
> 
> avg-cpu:  %user   %nice %system %iowait  %steal   %idle
> 
>             0,00    0,00    1,44   22,63    0,00   75,93
> 
> Device:         rrqm/s   wrqm/s     r/s     w/s    rkB/s    wkB/s 
> avgrq-sz avgqu-sz   await r_await w_await  svctm  %util
> 
> sda               0,67   655,33   92,00 1033,67  2446,67 38390,67    
> 72,56     5,66    5,06    1,83    5,35   0,88  99,50
> 
> Any Idea why we got so much write Requests? Its getting up to 2000.
> 
> I guess the IO is from our Windows VM´s
> 
> *From:*users-bounces at ovirt.org <users-bounces at ovirt.org> *On Behalf Of 
> *Thomas Fecke
> *Sent:* Dienstag, 17. April 2018 16:18
> *To:* Roy Golan <rgolan at redhat.com>
> *Cc:* users at ovirt.org
> *Subject:* Re: [ovirt-users] Performance Issue
> 
> Guest: Win 10 and 2016
> 
> Disk: VirtISCSI – Thin provision
> 
> Domain: Single Data Domain – NFS 4
> 
> *From:*Roy Golan <rgolan at redhat.com>
> *Sent:* Dienstag, 17. April 2018 12:58
> *To:* Thomas Fecke <thomas.fecke at eset.de>
> *Cc:* users at ovirt.org
> *Subject:* Re: [ovirt-users] Performance Issue
> 
> On Tue, 17 Apr 2018 at 12:58 Thomas Fecke <thomas.fecke at eset.de 
> <mailto:thomas.fecke at eset.de>> wrote:
> 
>     Hey Thank you,
> 
>     If been monitoring vor about an Hour now. The Templates VM´s are
>     really slow – copy a new Template is slow. Non Template VM´s are fast
> 
>     Storage IO is average on 75 M/s Read Disk and 25 Write Disk. ( SSD
>     Raid )
> 
>     Network is on 500 Mbits/s internal ( 10 Gbit Stroage connection )
> 
>     And about 25Mbit/s external ( 400.000 k Internet )
> 
>     I realy cant find that bottle neck
> 
> 
> what type is the disks, the domain, how many domains ?
> 
>     *From:*Roy Golan <rgolan at redhat.com <mailto:rgolan at redhat.com>>
>     *Sent:* Dienstag, 17. April 2018 11:52
>     *To:* Thomas Fecke <thomas.fecke at eset.de <mailto:thomas.fecke at eset.de>>
>     *Cc:* users at ovirt.org <mailto:users at ovirt.org>
>     *Subject:* Re: [ovirt-users] Performance Issue
> 
>     On Tue, 17 Apr 2018 at 12:45 Thomas Fecke <thomas.fecke at eset.de
>     <mailto:thomas.fecke at eset.de>> wrote:
> 
>         Okay,
> 
>         it seems to be that the Storage IO is the Problem – every Write
>         and Read Process takes a lot of time
> 
>         Sometimes the copy Job stops with 0/Byte and the traffic goes up
>         and down like a mountain.
> 
>         But the Storage Read and Write M/s looking fine… I don’t get it
> 
>         Any toughts?
> 
>     Keep monitoring you storage backend interface and see what's going
>     on there if you don't see anything special on the host. It could be
>     the network that leads to slow IO as well, who knows.
> 
>     If the initial VM creation is taking long you might want to create a
>     pool from your template with Pre-Started VMs, and that would at
>     least save you from the wait when you actually need the VM.
> 
>         *From:* users-bounces at ovirt.org <mailto:users-bounces at ovirt.org>
>         <users-bounces at ovirt.org <mailto:users-bounces at ovirt.org>> *On
>         Behalf Of *Thomas Fecke
>         *Sent:* Dienstag, 17. April 2018 10:58
>         *To:* users at ovirt.org <mailto:users at ovirt.org>
>         *Subject:* [ovirt-users] Performance Issue
> 
>         Hey Guys,
> 
>         We Deploy a lot of Templates. We got our Training Environment
>         build in Ovirt.
> 
>         Our Problem – when we Deploy the Same Template. The VM´s getting
>         slower every Time we deply a new VM from that Template.
> 
>         And I really don’t know why. RAM locking good – CPU and Network
>         looking good.
> 
>         But it take about 15 Minute to create a new Template based VM –
>         normaly it takes about 30 Seconds.
> 
>         I checked nload and the Interface traffic – but its not really high.
> 
>         Can someone explain why its getting so slow and how to troubleshoot?
> 
>         _______________________________________________
>         Users mailing list
>         Users at ovirt.org <mailto:Users at ovirt.org>
>         http://lists.ovirt.org/mailman/listinfo/users
> 
> 
> 
> _______________________________________________
> Users mailing list
> Users at ovirt.org
> http://lists.ovirt.org/mailman/listinfo/users
> 


-- 
Tony Albers
Systems administrator, IT-development
Royal Danish Library, Victor Albecks Vej 1, 8000 Aarhus C, Denmark.
Tel: +45 2566 2383 / +45 8946 2316


More information about the Users mailing list