Ext4 improvements
Please be patient with my ignorance if what I am asking is meaningless in any way. I am not too technically knowledgeable about filesystem internals but I am willing to learn. (I thought of posting to linux-ext4 but did not want to intrude within the technical threads with my layman thread.)
From Wikipedia > ReiserFS article > Design section:
[quote]ext2 and other Berkeley FFS-like filesystems simply use a fixed formula for computing inode locations, hence limiting the number of files they may contain. Most such filesystems also store directories as simple lists of entries, which makes directory lookups and updates linear time operations and degrades performance on very large directories. The single B+ tree design in ReiserFS avoids both of these problems due to better scalability properties.[/quote]
So will ext4 avoid both of these problems just like ReiserFS? Does it use a B+ tree? Or this "dancing B* tree" that Reiser4 is supposed to have?
Also: I found that a newly created ext3 partition uses 128 MB whereas a new reiser3 partition uses only 32 MB. I assume that the 128 MB is the space taken for the pre-allocated inodes or such. And I now come to know that others have this problem much more serious on bigger filesystems - [see comment 2 at
http://linux.wordpress.com/2006/09/27/suse-102-ditching-reiserfs-as-it-default-fs/].
If ext4 uses a B+ (or B*?) tree like ReiserFS then this space can be reduced, right?
Thanks.
Shriramana Sharma.
P.S: Are there any recommended tutorials for learning filesystem basics?
P.P.S: I just put this post here because I want to convert from reiserfs of uncertain future to ext4, which is time-tested.
Quoted 8 lines · Shriramana Sharma
Please be patient with my ignorance if what I am asking is meaningless in any way. I am not too technically knowledgeable about filesystem internals but I am willing to learn. (I thought of posting to linux-ext4 but did not want to intrude within the technical threads with my layman thread.)
From Wikipedia > ReiserFS article > Design section:
Quoted 7 lines
[quote]ext2 and other Berkeley FFS-like filesystems simply use a fixed formula for computing inode locations, hence limiting the number of files they may contain. Most such filesystems also store directories as simple lists of entries, which makes directory lookups and updates linear time operations and degrades performance on very large directories. The single B+ tree design in ReiserFS avoids both of these problems due to better scalability properties.[/quote]
The large directory problem has been solved by htree dir indexing (which is already in ext3). Now only the readahead (see other threads)...
Quoted 2 lines
So will ext4 avoid both of these problems just like ReiserFS? Does it use a B+ tree? Or this "dancing B* tree" that Reiser4 is supposed to have?
One of the disadvantages of having inodes all over the disk is that it makes filesystem repair *extremely* expensive cause you have to read *every* block of the disk to figure out if it contains inodes. Given that drives double in size every two to three years but the drive speed only grows with 50% max in that same period, this will become an even bigger problem in the future. (FYI: e2fsck on a 1TB volume takes 40 minutes to an hour).
The "limiting number of files" problem is also nonexistent in my
experience: for datarecovery purposes we rebuild multiple complete filesystem trees for customers on our own machines and *never* ran out of inodes. Heck, I usually limit the amount of inodes to 12 million just to limit the waste of inodes.
Quoted 3 lines
Also: I found that a newly created ext3 partition uses 128 MB whereas a new reiser3 partition uses only 32 MB. I assume that the 128 MB is the space taken for the pre-allocated inodes or such.
No, it's the space taken up by the journal (which is just a special file you can't see).
Quoted 4 lines
And I now come to know
that others have this problem much more serious on bigger filesystems - [see comment 2 at
http://linux.wordpress.com/2006/09/27/suse-102-ditching-reiserfs-as-it-default-fs/].
That comment is wrong. Space for inodes is already allocated in ext[234] and doesn't grow. What that poster probably sees is space taken up by directories and/or lack of tail packing in ext[234].
Quoted 2 lines
If ext4 uses a B+ (or B*?) tree like ReiserFS then this space can be reduced, right?
Yes, but from an fsck point of view you don't want that. It is not a coincidence that ext[234] comes with the best filesystem repair tools.
Quoted 1 line
P.S: Are there any recommended tutorials for learning filesystem basics?
The linuxfs wiki has some interesting links: http://linuxfs.pbwiki.com/ .
Quoted 2 lines
P.P.S: I just put this post here because I want to convert from reiserfs of uncertain future to ext4, which is time-tested.
If you like to live on the edge, ext4 is your filesystem of choice. If you value your data, you'd rather use ext3. You are of course welcome to test ext4 on a separate partition.
Erik
Signature · 2 lines
+-- Erik Mouw -- www.harddisk-recovery.com -- +31 70 370 12 90 -- | Lab address: Delftechpark 26, 2628 XH, Delft, The Netherlands