From suporte at logicworks.pt Tue May 28 05:20:54 2013 Content-Type: multipart/mixed; boundary="===============5653121068099577060==" MIME-Version: 1.0 From: suporte at logicworks.pt To: users at ovirt.org Subject: Re: [Users] deduplication Date: Tue, 28 May 2013 10:20:42 +0100 Message-ID: <6392517.666.1369732848336.JavaMail.ferra@pc-ferra> In-Reply-To: 1733662497.7428890.1369512039613.JavaMail.root@redhat.com --===============5653121068099577060== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: quoted-printable ------=3D_Part_665_15117543.1369732848335 Content-Type: text/plain; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable Hi Theron,=3D20 Thanks, that's what I thought. So with dedup we save space in the storage a= =3D nd what about performance, will it increase performance? once it will not u= =3D se the same instance twice, is that right? i.e., if I have 2 VM's (let's sa= =3D y, Fedora 18), with the same kernel, does oVirt run 2 times the 2 instances= =3D or can it manage that so it will not have to run the same software twice, = =3D in order to save resources and performance.=3D20 I'm not sure if my English is enough for you to realize what I'm trying to = =3D explain.=3D20 Regards=3D20 Jose=3D20 ----- Original Message ----- From: "Theron Conrey" =3D20 To: suporte(a)logicworks.pt=3D20 Cc: Users(a)ovirt.org=3D20 Sent: S=3DC3=3DA1bado, 25 de Maio de 2013 21:00:39=3D20 Subject: Re: [Users] deduplication=3D20 Hi Jose,=3D20 Deduplication or dedup for short is usually a function of the storage appli= =3D ance, and as such is a "post-allocation" operation. As a quick example the = =3D hypervisor will request the space, allocate all of it, and if space can be = =3D reclaimed via a storage side operation like dedup, that's where it's handle= =3D d.=3D20 If you're leveraging oVirt with storage appliance that supports dedup it wi= =3D ll work just fine with oVirt as well.=3D20 We DO however support thin provisioning. This is a "pre-allocation" operati= =3D on handled by oVirt. Instead of just waiting on the storage to reclaim spac= =3D e via a dedup job (if this isn't done inline dedup can be taxing on the sto= =3D rage array and is usually a scheduled job that isn't constant) thin provisi= =3D oning only allocates the storage space that is actually required.=3D20 More information can be found on our wiki here: http://www.ovirt.org/Vdsm_D= =3D isk_Images=3D20 Theron Conrey=3D20 Open Source and Standards, Red Hat=3D20 @theronconrey=3D20 ----- Original Message -----=3D20 From: suporte(a)logicworks.pt=3D20 To: Users(a)ovirt.org=3D20 Sent: Saturday, May 25, 2013 9:02:40 AM=3D20 Subject: [Users] deduplication=3D20 is deduplication possible?=3D20 Regards=3D20 Jose=3D20 --=3D20 Jose Ferradeira=3D20 http://www.logicworks.pt=3D20 _______________________________________________=3D20 Users mailing list=3D20 Users(a)ovirt.org=3D20 http://lists.ovirt.org/mailman/listinfo/users=3D20 ------=3D_Part_665_15117543.1369732848335 Content-Type: text/html; charset=3Dutf-8 Content-Transfer-Encoding: quoted-printable <=3D div style=3D3D'font-family: arial,helvetica,sans-serif; font-size: 10pt; co= lo=3D r: #000000'>Hi Theron,

Thanks, that's what I thought. So with dedup = =3D we save space in the storage and what about performance, will it increase p= =3D erformance? once it will not use the same instance twice, is that right? i.= =3D e., if I have 2 VM's (let's say, Fedora 18), with the same kernel, does oVi= =3D rt run 2 times the 2 instances or can it manage that so it will not have to= =3D run the same software twice, in order to save resources and performance.
I'm not sure if my English is enough for you to realize what I'm tryi= =3D ng to explain.

Regards
Jose

Fr= =3D om: "Theron Conrey" <tconrey(a)redhat.com>
To: suporte(= a)lo=3D gicworks.pt
Cc: Users(a)ovirt.org
Sent: S=3DC3=3DA1bado= , 25 d=3D e Maio de 2013 21:00:39
Subject: Re: [Users] deduplication
Hi Jose,

Deduplication or dedup for short is usually a function of = =3D the storage appliance, and as such is a "post-allocation" operation.  = =3D As a quick example the hypervisor will request the space, allocate all of i= =3D t, and if space can be reclaimed via a storage side operation like dedup, t= =3D hat's where it's handled.  

If you're leveraging oVirt with sto= =3D rage appliance that supports dedup it will work just fine with oVirt as wel= =3D l.  

We DO however support thin provisioning.  This is a "= =3D pre-allocation" operation handled by oVirt.  Instead of just waiting o= =3D n the storage to reclaim space via a dedup job (if this isn't done inline d= =3D edup can be taxing on the storage array and is usually a scheduled job that= =3D isn't constant) thin provisioning only allocates the storage space that is= =3D actually required.  

More information can be found on our wiki= =3D here: http://www.ovirt.org/Vdsm_Disk_Images


Theron Conrey
Op= =3D en Source and Standards, Red Hat
@theronconrey



----- Orig= =3D inal Message -----
From: suporte(a)logicworks.pt
To: Users(a)ovirt.or= gSent: Saturday, May 25, 2013 9:02:40 AM
Subject: [Users] deduplication<= =3D br>
is deduplication possible?

Regards
Jose

--
<= =3D br>Jose Ferradeira
http://www.logicworks.pt


_______________= =3D ________________________________
Users mailing list
Users(a)ovirt.org= http://lists.ovirt.org/mailman/listinfo/users

<= =3D /html> ------=3D_Part_665_15117543.1369732848335-- --===============5653121068099577060== Content-Type: multipart/alternative MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="attachment.bin" LS0tLS0tPV9QYXJ0XzY2NV8xNTExNzU0My4xMzY5NzMyODQ4MzM1CkNvbnRlbnQtVHlwZTogdGV4 dC9wbGFpbjsgY2hhcnNldD11dGYtOApDb250ZW50LVRyYW5zZmVyLUVuY29kaW5nOiBxdW90ZWQt cHJpbnRhYmxlCgpIaSBUaGVyb24sPTIwCgpUaGFua3MsIHRoYXQncyB3aGF0IEkgdGhvdWdodC4g U28gd2l0aCBkZWR1cCB3ZSBzYXZlIHNwYWNlIGluIHRoZSBzdG9yYWdlIGE9Cm5kIHdoYXQgYWJv dXQgcGVyZm9ybWFuY2UsIHdpbGwgaXQgaW5jcmVhc2UgcGVyZm9ybWFuY2U/IG9uY2UgaXQgd2ls bCBub3QgdT0Kc2UgdGhlIHNhbWUgaW5zdGFuY2UgdHdpY2UsIGlzIHRoYXQgcmlnaHQ/IGkuZS4s IGlmIEkgaGF2ZSAyIFZNJ3MgKGxldCdzIHNhPQp5LCBGZWRvcmEgMTgpLCB3aXRoIHRoZSBzYW1l IGtlcm5lbCwgZG9lcyBvVmlydCBydW4gMiB0aW1lcyB0aGUgMiBpbnN0YW5jZXM9CiBvciBjYW4g aXQgbWFuYWdlIHRoYXQgc28gaXQgd2lsbCBub3QgaGF2ZSB0byBydW4gdGhlIHNhbWUgc29mdHdh cmUgdHdpY2UsID0KaW4gb3JkZXIgdG8gc2F2ZSByZXNvdXJjZXMgYW5kIHBlcmZvcm1hbmNlLj0y MAoKSSdtIG5vdCBzdXJlIGlmIG15IEVuZ2xpc2ggaXMgZW5vdWdoIGZvciB5b3UgdG8gcmVhbGl6 ZSB3aGF0IEknbSB0cnlpbmcgdG8gPQpleHBsYWluLj0yMAoKUmVnYXJkcz0yMApKb3NlPTIwCgot LS0tLSBPcmlnaW5hbCBNZXNzYWdlIC0tLS0tCgpGcm9tOiAiVGhlcm9uIENvbnJleSIgPHRjb25y ZXlAcmVkaGF0LmNvbT49MjAKVG86IHN1cG9ydGVAbG9naWN3b3Jrcy5wdD0yMApDYzogVXNlcnNA b3ZpcnQub3JnPTIwClNlbnQ6IFM9QzM9QTFiYWRvLCAyNSBkZSBNYWlvIGRlIDIwMTMgMjE6MDA6 Mzk9MjAKU3ViamVjdDogUmU6IFtVc2Vyc10gZGVkdXBsaWNhdGlvbj0yMAoKSGkgSm9zZSw9MjAK CkRlZHVwbGljYXRpb24gb3IgZGVkdXAgZm9yIHNob3J0IGlzIHVzdWFsbHkgYSBmdW5jdGlvbiBv ZiB0aGUgc3RvcmFnZSBhcHBsaT0KYW5jZSwgYW5kIGFzIHN1Y2ggaXMgYSAicG9zdC1hbGxvY2F0 aW9uIiBvcGVyYXRpb24uIEFzIGEgcXVpY2sgZXhhbXBsZSB0aGUgPQpoeXBlcnZpc29yIHdpbGwg cmVxdWVzdCB0aGUgc3BhY2UsIGFsbG9jYXRlIGFsbCBvZiBpdCwgYW5kIGlmIHNwYWNlIGNhbiBi ZSA9CnJlY2xhaW1lZCB2aWEgYSBzdG9yYWdlIHNpZGUgb3BlcmF0aW9uIGxpa2UgZGVkdXAsIHRo YXQncyB3aGVyZSBpdCdzIGhhbmRsZT0KZC49MjAKCklmIHlvdSdyZSBsZXZlcmFnaW5nIG9WaXJ0 IHdpdGggc3RvcmFnZSBhcHBsaWFuY2UgdGhhdCBzdXBwb3J0cyBkZWR1cCBpdCB3aT0KbGwgd29y ayBqdXN0IGZpbmUgd2l0aCBvVmlydCBhcyB3ZWxsLj0yMAoKV2UgRE8gaG93ZXZlciBzdXBwb3J0 IHRoaW4gcHJvdmlzaW9uaW5nLiBUaGlzIGlzIGEgInByZS1hbGxvY2F0aW9uIiBvcGVyYXRpPQpv biBoYW5kbGVkIGJ5IG9WaXJ0LiBJbnN0ZWFkIG9mIGp1c3Qgd2FpdGluZyBvbiB0aGUgc3RvcmFn ZSB0byByZWNsYWltIHNwYWM9CmUgdmlhIGEgZGVkdXAgam9iIChpZiB0aGlzIGlzbid0IGRvbmUg aW5saW5lIGRlZHVwIGNhbiBiZSB0YXhpbmcgb24gdGhlIHN0bz0KcmFnZSBhcnJheSBhbmQgaXMg dXN1YWxseSBhIHNjaGVkdWxlZCBqb2IgdGhhdCBpc24ndCBjb25zdGFudCkgdGhpbiBwcm92aXNp PQpvbmluZyBvbmx5IGFsbG9jYXRlcyB0aGUgc3RvcmFnZSBzcGFjZSB0aGF0IGlzIGFjdHVhbGx5 IHJlcXVpcmVkLj0yMAoKTW9yZSBpbmZvcm1hdGlvbiBjYW4gYmUgZm91bmQgb24gb3VyIHdpa2kg aGVyZTogaHR0cDovL3d3dy5vdmlydC5vcmcvVmRzbV9EPQppc2tfSW1hZ2VzPTIwCgoKVGhlcm9u IENvbnJleT0yMApPcGVuIFNvdXJjZSBhbmQgU3RhbmRhcmRzLCBSZWQgSGF0PTIwCkB0aGVyb25j b25yZXk9MjAKCgoKLS0tLS0gT3JpZ2luYWwgTWVzc2FnZSAtLS0tLT0yMApGcm9tOiBzdXBvcnRl QGxvZ2ljd29ya3MucHQ9MjAKVG86IFVzZXJzQG92aXJ0Lm9yZz0yMApTZW50OiBTYXR1cmRheSwg TWF5IDI1LCAyMDEzIDk6MDI6NDAgQU09MjAKU3ViamVjdDogW1VzZXJzXSBkZWR1cGxpY2F0aW9u PTIwCgppcyBkZWR1cGxpY2F0aW9uIHBvc3NpYmxlPz0yMAoKUmVnYXJkcz0yMApKb3NlPTIwCgot LT0yMAoKSm9zZSBGZXJyYWRlaXJhPTIwCmh0dHA6Ly93d3cubG9naWN3b3Jrcy5wdD0yMAoKCl9f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fPTIwClVzZXJzIG1h aWxpbmcgbGlzdD0yMApVc2Vyc0BvdmlydC5vcmc9MjAKaHR0cDovL2xpc3RzLm92aXJ0Lm9yZy9t YWlsbWFuL2xpc3RpbmZvL3VzZXJzPTIwCgoKLS0tLS0tPV9QYXJ0XzY2NV8xNTExNzU0My4xMzY5 NzMyODQ4MzM1CkNvbnRlbnQtVHlwZTogdGV4dC9odG1sOyBjaGFyc2V0PXV0Zi04CkNvbnRlbnQt VHJhbnNmZXItRW5jb2Rpbmc6IHF1b3RlZC1wcmludGFibGUKCjxodG1sPjxoZWFkPjxzdHlsZSB0 eXBlPTNEJ3RleHQvY3NzJz5wIHsgbWFyZ2luOiAwOyB9PC9zdHlsZT48L2hlYWQ+PGJvZHk+PD0K ZGl2IHN0eWxlPTNEJ2ZvbnQtZmFtaWx5OiBhcmlhbCxoZWx2ZXRpY2Esc2Fucy1zZXJpZjsgZm9u dC1zaXplOiAxMHB0OyBjb2xvPQpyOiAjMDAwMDAwJz5IaSBUaGVyb24sPGJyPjxicj5UaGFua3Ms IHRoYXQncyB3aGF0IEkgdGhvdWdodC4gU28gd2l0aCBkZWR1cCA9CndlIHNhdmUgc3BhY2UgaW4g dGhlIHN0b3JhZ2UgYW5kIHdoYXQgYWJvdXQgcGVyZm9ybWFuY2UsIHdpbGwgaXQgaW5jcmVhc2Ug cD0KZXJmb3JtYW5jZT8gb25jZSBpdCB3aWxsIG5vdCB1c2UgdGhlIHNhbWUgaW5zdGFuY2UgdHdp Y2UsIGlzIHRoYXQgcmlnaHQ/IGkuPQplLiwgaWYgSSBoYXZlIDIgVk0ncyAobGV0J3Mgc2F5LCBG ZWRvcmEgMTgpLCB3aXRoIHRoZSBzYW1lIGtlcm5lbCwgZG9lcyBvVmk9CnJ0IHJ1biAyIHRpbWVz IHRoZSAyIGluc3RhbmNlcyBvciBjYW4gaXQgbWFuYWdlIHRoYXQgc28gaXQgd2lsbCBub3QgaGF2 ZSB0bz0KIHJ1biB0aGUgc2FtZSBzb2Z0d2FyZSB0d2ljZSwgaW4gb3JkZXIgdG8gc2F2ZSByZXNv dXJjZXMgYW5kIHBlcmZvcm1hbmNlLjxiPQpyPjxicj5JJ20gbm90IHN1cmUgaWYgbXkgRW5nbGlz aCBpcyBlbm91Z2ggZm9yIHlvdSB0byByZWFsaXplIHdoYXQgSSdtIHRyeWk9Cm5nIHRvIGV4cGxh aW4uPGJyPjxicj5SZWdhcmRzPGJyPkpvc2U8YnI+PGJyPjxociBpZD0zRCJ6d2NociI+PGRpdiBz dHlsZT0zRD0KImNvbG9yOiByZ2IoMCwgMCwgMCk7IGZvbnQtd2VpZ2h0OiBub3JtYWw7IGZvbnQt c3R5bGU6IG5vcm1hbDsgdGV4dC1kZWNvcmF0PQppb246IG5vbmU7IGZvbnQtZmFtaWx5OiBIZWx2 ZXRpY2EsQXJpYWwsc2Fucy1zZXJpZjsgZm9udC1zaXplOiAxMnB0OyI+PGI+RnI9Cm9tOiA8L2I+ IlRoZXJvbiBDb25yZXkiICZsdDt0Y29ucmV5QHJlZGhhdC5jb20mZ3Q7PGJyPjxiPlRvOiA8L2I+ c3Vwb3J0ZUBsbz0KZ2ljd29ya3MucHQ8YnI+PGI+Q2M6IDwvYj5Vc2Vyc0BvdmlydC5vcmc8YnI+ PGI+U2VudDogPC9iPlM9QzM9QTFiYWRvLCAyNSBkPQplIE1haW8gZGUgMjAxMyAyMTowMDozOTxi cj48Yj5TdWJqZWN0OiA8L2I+UmU6IFtVc2Vyc10gZGVkdXBsaWNhdGlvbjxicj48YnI9Cj5IaSBK b3NlLDxicj48YnI+RGVkdXBsaWNhdGlvbiBvciBkZWR1cCBmb3Igc2hvcnQgaXMgdXN1YWxseSBh IGZ1bmN0aW9uIG9mID0KdGhlIHN0b3JhZ2UgYXBwbGlhbmNlLCBhbmQgYXMgc3VjaCBpcyBhICJw b3N0LWFsbG9jYXRpb24iIG9wZXJhdGlvbi4gJm5ic3A7PQpBcyBhIHF1aWNrIGV4YW1wbGUgdGhl IGh5cGVydmlzb3Igd2lsbCByZXF1ZXN0IHRoZSBzcGFjZSwgYWxsb2NhdGUgYWxsIG9mIGk9CnQs IGFuZCBpZiBzcGFjZSBjYW4gYmUgcmVjbGFpbWVkIHZpYSBhIHN0b3JhZ2Ugc2lkZSBvcGVyYXRp b24gbGlrZSBkZWR1cCwgdD0KaGF0J3Mgd2hlcmUgaXQncyBoYW5kbGVkLiAmbmJzcDs8YnI+PGJy PklmIHlvdSdyZSBsZXZlcmFnaW5nIG9WaXJ0IHdpdGggc3RvPQpyYWdlIGFwcGxpYW5jZSB0aGF0 IHN1cHBvcnRzIGRlZHVwIGl0IHdpbGwgd29yayBqdXN0IGZpbmUgd2l0aCBvVmlydCBhcyB3ZWw9 CmwuICZuYnNwOzxicj48YnI+V2UgRE8gaG93ZXZlciBzdXBwb3J0IHRoaW4gcHJvdmlzaW9uaW5n LiAmbmJzcDtUaGlzIGlzIGEgIj0KcHJlLWFsbG9jYXRpb24iIG9wZXJhdGlvbiBoYW5kbGVkIGJ5 IG9WaXJ0LiAmbmJzcDtJbnN0ZWFkIG9mIGp1c3Qgd2FpdGluZyBvPQpuIHRoZSBzdG9yYWdlIHRv IHJlY2xhaW0gc3BhY2UgdmlhIGEgZGVkdXAgam9iIChpZiB0aGlzIGlzbid0IGRvbmUgaW5saW5l IGQ9CmVkdXAgY2FuIGJlIHRheGluZyBvbiB0aGUgc3RvcmFnZSBhcnJheSBhbmQgaXMgdXN1YWxs eSBhIHNjaGVkdWxlZCBqb2IgdGhhdD0KIGlzbid0IGNvbnN0YW50KSB0aGluIHByb3Zpc2lvbmlu ZyBvbmx5IGFsbG9jYXRlcyB0aGUgc3RvcmFnZSBzcGFjZSB0aGF0IGlzPQogYWN0dWFsbHkgcmVx dWlyZWQuICZuYnNwOzxicj48YnI+TW9yZSBpbmZvcm1hdGlvbiBjYW4gYmUgZm91bmQgb24gb3Vy IHdpa2k9CiBoZXJlOiBodHRwOi8vd3d3Lm92aXJ0Lm9yZy9WZHNtX0Rpc2tfSW1hZ2VzPGJyPjxi cj48YnI+VGhlcm9uIENvbnJleTxicj5PcD0KZW4gU291cmNlIGFuZCBTdGFuZGFyZHMsIFJlZCBI YXQ8YnI+QHRoZXJvbmNvbnJleTxicj48YnI+PGJyPjxicj4tLS0tLSBPcmlnPQppbmFsIE1lc3Nh Z2UgLS0tLS08YnI+RnJvbTogc3Vwb3J0ZUBsb2dpY3dvcmtzLnB0PGJyPlRvOiBVc2Vyc0Bvdmly dC5vcmc8YnI9Cj5TZW50OiBTYXR1cmRheSwgTWF5IDI1LCAyMDEzIDk6MDI6NDAgQU08YnI+U3Vi amVjdDogW1VzZXJzXSBkZWR1cGxpY2F0aW9uPD0KYnI+PGJyPmlzIGRlZHVwbGljYXRpb24gcG9z c2libGU/IDxicj48YnI+UmVnYXJkcyA8YnI+Sm9zZSA8YnI+PGJyPi0tIDxicj48PQpicj5Kb3Nl IEZlcnJhZGVpcmEgPGJyPmh0dHA6Ly93d3cubG9naWN3b3Jrcy5wdCA8YnI+PGJyPjxicj5fX19f X19fX19fX19fX189Cl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fPGJyPlVzZXJzIG1h aWxpbmcgbGlzdDxicj5Vc2Vyc0BvdmlydC5vcmc8Yj0Kcj5odHRwOi8vbGlzdHMub3ZpcnQub3Jn L21haWxtYW4vbGlzdGluZm8vdXNlcnM8YnI+PC9kaXY+PGJyPjwvZGl2PjwvYm9keT48PQovaHRt bD4KLS0tLS0tPV9QYXJ0XzY2NV8xNTExNzU0My4xMzY5NzMyODQ4MzM1LS0K --===============5653121068099577060==--