From: =?ISO-8859-1?Q?P=E1draig_Brady?=
Subject: Re: [ANNOUNCE] Btrfs: a copy on write, snapshotting FS
Date: Tue, 19 Jun 2007 10:11:13 +0100
Message-ID: <46779DB1.7060807@draigBrady.com>
References: <20070612161029.GB28279@think.oraclecorp.com> <4676C2D6.8030708@vlnb.net>
Mime-Version: 1.0
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: QUOTED-PRINTABLE
Cc: Chris Mason , linux-kernel@vger.kernel.org,
linux-fsdevel@vger.kernel.org
To: Vladislav Bolkhovitin
Return-path:
In-Reply-To: <4676C2D6.8030708@vlnb.net>
Sender: linux-kernel-owner@vger.kernel.org
List-Id: linux-fsdevel.vger.kernel.org
Vladislav Bolkhovitin wrote:
>=20
> I would also suggest one more feature: support for block level
> de-duplication. I mean:
>=20
> 1. Ability for Btrfs to have blocks in several files to point to the
> same block on disk
>=20
> 2. Support for new syscall or IOCTL to de-duplicate as a single
> transaction two or more blocks on disk, i.e. link them to one of them
> and free others
>=20
> 3. De-de-duplicate blocks on disk, i.e. copy them on write
>=20
> I suppose that de-duplication itself would be done by some user space
> process that would scan files, determine blocks with the same data an=
d
> then de-duplicate them by using syscall or IOCTL (2).
>=20
> That would be very usable feature, which in most cases would allow to
> shrink occupied disk space on 50-90%.
Have you references for this number?
In my experience one gets a lot of benefit from
the much simpler process of "de-duplication" of files.
Note a checksum stored in file metadata,
that is automatically invalidated on write would
speed up user space file de duplification,
and rsync, etc....
P=E1draig.