Skip to contentSkip to conversation

adding more redundancy in XFS?

DISCUSSION Grozdan Nikolov 2 participants 2 messages Dec 21, 2006

lore
Share & tools
lore
#0 lore raw

Hi,

I have a simple question regarding XFS. A while back ago I read a research paper about the IRON (Internal Robustness) of file systems that tests and compares various Linux file systems on how they handle data-integrity in case of a unclean unmount or power failure or even a disk failure. Though I'm not a file system guru like you guys I learned that XFS does a fairly good job but fails bad in specific areas, like, and I quote from the paper: "when an ordered data block write fails, XFS continues to log the failed transaction to the journal resulting in data corruption"

The paper can be downloaded here: http://www.cs.wisc.edu/adsl/Publications/
(just click on the IRON file systems link for a PDF)

My question is, is it possible to add to XFS more sanity checking (maybe even CRC checks?) on things like inodes, bitmaps, indirect pointers, etc to further improve the integrity of XFS?

Thanks, GN

Signature · 4 lines
Windows: a 64-bit service pack to a 32-bit extension and GUI shell to a 16-bit 
patch to an 8-bit operating system originally coded for a 4-bit 
microprocessor and sold by a 2-bit company than can't stand 1-bit of 
competition
#1 lore raw
Quoted 10 lines · Grozdan Nikolov

Hi,

I have a simple question regarding XFS. A while back ago I read a research paper about the IRON (Internal Robustness) of file systems that tests and compares various Linux file systems on how they handle data-integrity in case of a unclean unmount or power failure or even a disk failure. Though I'm not a file system guru like you guys I learned that XFS does a fairly good job but fails bad in specific areas, like, and I quote from the paper: "when an ordered data block write fails, XFS continues to log the failed transaction to the journal resulting in data corruption"

XFS doesn't have an ordered journaling mode and I think their idea of a transaction is different to what XFS calls a transaction.

Quoted 2 lines

The paper can be downloaded here: http://www.cs.wisc.edu/adsl/Publications/
(just click on the IRON file systems link for a PDF)

Ok, I remember reading the preliminary paper that had the filesystem analysis about a year ago. I don't recall whether there was anything about XFS in it then.

Quote section 3.1.4:

"XFS supports only ordered journalling mode and data/writeback journaling modes are not present."

According to the paper's definition of writeback/ordered/data journalling, XFS uses writeback journalling. i.e. there is no synchronisation between metadata logging and the data being written. That's a pretty bad mistake....

Also it is stated that the XFS analysis is only preliminary because XFS wasn't fully instrumented and so coverage of the fileystem was only partial. Hence it doesn't have the same error detection/recovery maps as the other filesystems so we've got no clear idea what tests those conclusions are based on.

That being said, there's a lot of good stuff in that paper. Now all they've got to do is open source the tools they wrote and we can go and find and fix the problems their tool found....

Quoted 3 lines

My question is, is it possible to add to XFS more sanity checking (maybe even CRC checks?) on things like inodes, bitmaps, indirect pointers, etc to further improve the integrity of XFS?

Yes.

Cheers,

Dave.

Signature · 3 lines
Dave Chinner
Principal Engineer
SGI Australian Software Group