Re: ngn build jobs take more than twice (x) as long as in the last days

Hi, I checked SAR data on storage servers and compared loads yesterday and three weeks ago (May 3). Load values are in pretty much the same range, yet now most of the time they are around the "high" mark so we may be nearing a bottleneck, specifically on I/O where we mostly do writes to the NAS, not reads and there's quite a bit of overhead: VM -> QCOW -> file -> network -> NFS -> DRBD -> disk Surely, using local scratch disks stored on SSDs should greatly improve performance as at least half of the above steps will be gone. We don't really need to centrally store (NFS) or mirror (DRBD) data that slaves write to their disks all the time anyways. For VMs where we do need redundancy, I'd suggest using iSCSI storage domains in the long run. Regards, Evgheni Dereveanchin ----- Original Message ----- From: "Eyal Edri" <eedri(a)redhat.com&gt; To: "Sandro Bonazzola" <sbonazzo(a)redhat.com&gt;, "Evgheni Dereveanchin" <ederevea(a)redhat.com&gt;, "Anton Marchukov" <amarchuk(a)redhat.com&gt; Cc: "Fabian Deutsch" <fdeutsch(a)redhat.com&gt;, "infra" <infra(a)ovirt.org&gt; Sent: Wednesday, 25 May, 2016 9:31:43 AM Subject: Re: ngn build jobs take more than twice (x) as long as in the last days It might be more load on the storage servers with now running much more jobs. Evgheni - can you check if the load on the storage servers has changed significantly to justify this degradation of service? We need to expedite the enablement of SSDs in the hypervisors and move to local hooks. Anton - do we have a test VM that uses a local DISK we can use to test if it improves the runtime? On Tue, May 24, 2016 at 11:19 PM, Sandro Bonazzola <sbonazzo(a)redhat.com&gt; wrote: -- Eyal Edri Associate Manager RHEV DevOps EMEA ENG Virtualization R&D Red Hat Israel phone: +972-9-7692018 irc: eedri (on #tlv #rhev-dev #rhev-integ)