From: Vladislav Bolkhovitin Subject: Re: [ANNOUNCE] Btrfs: a copy on write, snapshotting FS Date: Mon, 18 Jun 2007 21:37:26 +0400 Message-ID: <4676C2D6.8030708@vlnb.net> References: <20070612161029.GB28279@think.oraclecorp.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: linux-kernel@vger.kernel.org, linux-fsdevel@vger.kernel.org To: Chris Mason Return-path: Received: from mail-relay-02.mailcluster.net ([85.249.135.243]:45822 "EHLO mail-relay-02.mailcluster.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1762126AbXFRSHS (ORCPT ); Mon, 18 Jun 2007 14:07:18 -0400 In-Reply-To: <20070612161029.GB28279@think.oraclecorp.com> Sender: linux-fsdevel-owner@vger.kernel.org List-Id: linux-fsdevel.vger.kernel.org Chris Mason wrote: > Hello everyone, > > After the last FS summit, I started working on a new filesystem that > maintains checksums of all file data and metadata. Many thanks to Zach > Brown for his ideas, and to Dave Chinner for his help on > benchmarking analysis. > > The basic list of features looks like this: > > * Extent based file storage (2^64 max file size) > * Space efficient packing of small files > * Space efficient indexed directories > * Dynamic inode allocation > * Writable snapshots > * Subvolumes (separate internal filesystem roots) > - Object level mirroring and striping > * Checksums on data and metadata (multiple algorithms available) > - Strong integration with device mapper for multiple device support > - Online filesystem check > * Very fast offline filesystem check > - Efficient incremental backup and FS mirroring I would also suggest one more feature: support for block level de-duplication. I mean: 1. Ability for Btrfs to have blocks in several files to point to the same block on disk 2. Support for new syscall or IOCTL to de-duplicate as a single transaction two or more blocks on disk, i.e. link them to one of them and free others 3. De-de-duplicate blocks on disk, i.e. copy them on write I suppose that de-duplication itself would be done by some user space process that would scan files, determine blocks with the same data and then de-duplicate them by using syscall or IOCTL (2). That would be very usable feature, which in most cases would allow to shrink occupied disk space on 50-90%. Vlad