Skip to contentSkip to conversation

High speed filesystems

DISCUSSION Brian Beattie 3 participants 3 messages Oct 10, 2003 – Oct 11, 2003 VFS

lore
Share & tools
lore
#0 lore raw

I investigating options for very high speed datalogging. I was wondering if anybody could point me at any information and/or code in this area.

Signature · 6 lines
Brian Beattie            | Experienced kernel hacker/embedded systems
[email protected] | programmer, direct or contract, short or
www.beattie-home.net     | long term, available immediately.

"Honor isn't about making the right choices.
It's about dealing with the consequences." -- Midori Koto
#2 lore raw
In reply to Brian Beattie
Quoted 3 lines · Brian Beattie

I investigating options for very high speed datalogging. I was wondering if anybody could point me at any information and/or code in this area.

You'll get different results depending on how your data logging application works and the equipemt you are using. Things to consider:

* Robustness: apart from the speed, do you have robustness concerns? eg. Do you expect power loss etc. If so, you'll need a fs that tolerates this.

* Does you applicaion typically just do large append style transactions? If so, a fs that is inclined that way will do better than one designed for itty bitty transactions. Indeed if all you want to do is create a single monster file, then you could probably get the best performance without any file system (ie just write lumps of data directly to a block driver).

* Are you using wierdo media like flash instead of a hard disk? If so, then a flash oriented fs like JFFS2 or YAFFS might be the thing.

-- CHarles