Suggestion how to enable caching
Hey. A couple of weeks ago I wrote about how I used squid to improve the build speed of images. I think the minimal, easy to maintain and valuable solution is this simple config: 1. Setup squid on builders (default install on Fedora) 2. Add the following lines to the /etc/squid.conf # Increase maximum size of cached objects and specify the cache_dir # REMEMBER the ORDER maximum_object_size 5 GB cache_dir ufs /var/spool/squid 20000 16 256 3. Enable and start squid service The service will only listen to connections from local networks, and will not proxy connections from public addresses. The usage then is as follows: Export http_proxy=127.0.0.1:3128 and all curl instances will pick up the proxy. Similar parameters exist for other tools like the livemedia-creator too. I am not familiar with writing a puppet class for this. But at least it is quite self contained. Thoughts? Geetings fabian
I wonder if we'll really need this on each and every builder. Wouldn't one central squid VM suffice? It could indeed be useful, also for caching packages pulled by yum. Barak. ----- Original Message -----
From: "Fabian Deutsch" <fdeutsch@redhat.com> To: "infra" <infra@ovirt.org> Sent: Wednesday, August 13, 2014 2:54:40 PM Subject: Suggestion how to enable caching
Hey.
A couple of weeks ago I wrote about how I used squid to improve the build speed of images.
I think the minimal, easy to maintain and valuable solution is this simple config:
1. Setup squid on builders (default install on Fedora) 2. Add the following lines to the /etc/squid.conf
# Increase maximum size of cached objects and specify the cache_dir # REMEMBER the ORDER maximum_object_size 5 GB cache_dir ufs /var/spool/squid 20000 16 256
3. Enable and start squid service
The service will only listen to connections from local networks, and will not proxy connections from public addresses.
The usage then is as follows:
Export http_proxy=127.0.0.1:3128 and all curl instances will pick up the proxy. Similar parameters exist for other tools like the livemedia-creator too.
I am not familiar with writing a puppet class for this. But at least it is quite self contained.
Thoughts?
Geetings fabian _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
----- Original Message -----
I wonder if we'll really need this on each and every builder. Wouldn't one central squid VM suffice? It could indeed be useful, also for caching packages pulled by yum.
One central caching instamnces also makes sense, as logn as tit shares the same network with the builders. - fabian
Barak.
----- Original Message -----
From: "Fabian Deutsch" <fdeutsch@redhat.com> To: "infra" <infra@ovirt.org> Sent: Wednesday, August 13, 2014 2:54:40 PM Subject: Suggestion how to enable caching
Hey.
A couple of weeks ago I wrote about how I used squid to improve the build speed of images.
I think the minimal, easy to maintain and valuable solution is this simple config:
1. Setup squid on builders (default install on Fedora) 2. Add the following lines to the /etc/squid.conf
# Increase maximum size of cached objects and specify the cache_dir # REMEMBER the ORDER maximum_object_size 5 GB cache_dir ufs /var/spool/squid 20000 16 256
3. Enable and start squid service
The service will only listen to connections from local networks, and will not proxy connections from public addresses.
The usage then is as follows:
Export http_proxy=127.0.0.1:3128 and all curl instances will pick up the proxy. Similar parameters exist for other tools like the livemedia-creator too.
I am not familiar with writing a puppet class for this. But at least it is quite self contained.
Thoughts?
Geetings fabian _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
_______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
--PkEWctFf+8E2rcii Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 01/14, Fabian Deutsch wrote:
----- Original Message -----
I wonder if we'll really need this on each and every builder. Wouldn't one central squid VM suffice? It could indeed be useful, also for caching packages pulled by yum. =20 One central caching instamnces also makes sense, as logn as tit shares the same network with the builders.
=20 - fabian =20
Barak. =20 ----- Original Message -----
From: "Fabian Deutsch" <fdeutsch@redhat.com> To: "infra" <infra@ovirt.org> Sent: Wednesday, August 13, 2014 2:54:40 PM Subject: Suggestion how to enable caching =20 Hey. =20 A couple of weeks ago I wrote about how I used squid to improve the b= uild speed of images. =20 I think the minimal, easy to maintain and valuable solution is this s= imple config: =20 1. Setup squid on builders (default install on Fedora) 2. Add the following lines to the /etc/squid.conf =20 # Increase maximum size of cached objects and specify the cache_dir # REMEMBER the ORDER maximum_object_size 5 GB cache_dir ufs /var/spool/squid 20000 16 256 =20 3. Enable and start squid service =20 The service will only listen to connections from local networks, and = will not proxy connections from public addresses. =20 The usage then is as follows: =20 Export http_proxy=3D127.0.0.1:3128 and all curl instances will pick u=
I started working on that, but had no time to set it up yet, I created the vm proxy-phx-ovirt-org and started playing with puppet modules for squid but still have to finish it. p the
proxy. Similar parameters exist for other tools like the livemedia-creator t= oo. =20 I am not familiar with writing a puppet class for this. But at least = it is quite self contained. =20 Thoughts? =20 Geetings fabian _______________________________________________ Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra =20
Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra =20
Infra mailing list Infra@ovirt.org http://lists.ovirt.org/mailman/listinfo/infra
--=20 David Caro Red Hat S.L. Continuous Integration Engineer - EMEA ENG Virtualization R&D Tel.: +420 532 294 605 Email: dcaro@redhat.com Web: www.redhat.com RHT Global #: 82-62605 --PkEWctFf+8E2rcii Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iQEcBAEBAgAGBQJUuOgOAAoJEEBxx+HSYmnDpiEH/jRWFk0bj5kOqQS0JakJIdRg K4r1rcHbldQlfOiPO6uuPRBloHpDKKcWqY2vhvyZjIU1nCzby3Mt1xEle+CNSua+ OUtaJ+0/2+EYUEnKdpjrz3muaWDFHmDasepKef8K7uW8loiD57hrRuaW/Z/g50oU /3DTWzhqQgA+EVZd30faFJVEY0+siJcT+Iwwdm+JfnsqAaeofm8Md4eiznKJoea4 WnFvZCYOsDh3Ay6G+AZFjjk1OOrRX2S5gWcuobSo1eeLHRHErcDK6LDpFwzpNhjq 1AwFgsGvbs7AZgX48Dfmc/BoZQrLn4ymwXFQgZn3b4vz7RCIx0d3XVxtMKI1tg4= =Jlbf -----END PGP SIGNATURE----- --PkEWctFf+8E2rcii--
participants (3)
-
Barak Korren -
David Caro -
Fabian Deutsch