Skip to contentSkip to conversation

bcache vs bcachefs

DISCUSSION Harald Dunkel 4 participants 6 messages Sep 6, 2016 – Sep 8, 2016

lore
Share & tools
lore
#0 lore raw

Hi folks,

I am pretty hesitant replacing the rock-solid ext4 by bcachefs on my servers. Meaning no offense, but surely I would prefer to have ext4 with a thin "SSD caching layer" over a completely different filesystem, potentially with alot of teething troubles.

Question: Is bcache EOL or can I rely on it for the next 5 to 10 years?

Regards
Harri

#1 lore raw
Quoted 8 lines · Harald Dunkel

Hi folks,

I am pretty hesitant replacing the rock-solid ext4 by bcachefs on my servers. Meaning no offense, but surely I would prefer to have ext4 with a thin "SSD caching layer" over a completely different filesystem, potentially with alot of teething troubles.

Question: Is bcache EOL or can I rely on it for the next 5 to 10 years?

bcache is not EOL - it's still receiving bugfixes.

That said though, there's no reason to expect a long teething period with bcachefs, it's already more reliable than btrfs in single device mode.

#2 lore raw
Quoted 8 lines · Kent Overstreet
Quoted 7 lines · Harald Dunkel

Hi folks,

I am pretty hesitant replacing the rock-solid ext4 by bcachefs on my servers. Meaning no offense, but surely I would prefer to have ext4 with a thin "SSD caching layer" over a completely different filesystem, potentially with alot of teething troubles.

Quoted 7 lines
Quoted 1 line

Question: Is bcache EOL or can I rely on it for the next 5 to 10 years?

bcache is not EOL - it's still receiving bugfixes.

That said though, there's no reason to expect a long teething period with bcachefs, it's already more reliable than btrfs in single device mode.

I'd be curious to see any actual data you have to back that up, especially regarding what kernel and userspace were involved with the BTRFS testing.

#3 lore raw
Quoted 11 lines · Austin S. Hemmelgarn
Quoted 10 lines · Kent Overstreet
Quoted 8 lines · Harald Dunkel

Hi folks,

I am pretty hesitant replacing the rock-solid ext4 by bcachefs on my servers. Meaning no offense, but surely I would prefer to have ext4 with a thin "SSD caching layer" over a completely different filesystem, potentially with alot of teething troubles.

Question: Is bcache EOL or can I rely on it for the next 5 to 10 years?

Quoted 7 lines
Quoted 5 lines

bcache is not EOL - it's still receiving bugfixes.

That said though, there's no reason to expect a long teething period with bcachefs, it's already more reliable than btrfs in single device mode.

I'd be curious to see any actual data you have to back that up, especially regarding what kernel and userspace were involved with the BTRFS testing.

I'm not a btrfs user, I'm mostly going off feedback from bcachefs users (many or most of whom are or have been btrfs users too).

On the bcachefs side, here's what we've seen so far:

- No one has lost data or seen any corruption when using the currently supported feature set (multiple devices and caching are not stable just yet).

I believe the worst bug anyone's hit was 0 length symlinks after unclean shutdown, and also 0 length files because we hadn't implemented the workarounds for applications that don't fsync yet.

- I _believe_ no one's seen any crashes/deadlocks/hangs in supported configurations - there was a report of a deadlock, but I believe he was using tiering and it hasn't reproduced since.

I haven't asked for details about the btrfs issues the bcachefs users have seen (one guy mentioned his 20 core machine panics running btrfs as the reason he was considering switching it to bcachefs).

Smaller sample size, unscientific comparisons, etc. etc. but it's certainly looking more robust so far.

That said, I'm not advocating people rush out to throw bcachefs on their servers or use it without backups yet, it's still young and needs more widespread testing.

#4 lore raw
Quoted 3 lines · Kent Overstreet

That said, I'm not advocating people rush out to throw bcachefs on their servers or use it without backups yet, it's still young and needs more widespread testing.

Hi Kent!

Have you started using xfstests to stress test bcachefs yet?

You may be interested in reading through this presentation, especially the last slide. :-)

https://thunk.org/gce-xfstests

- Ted

#5 lore raw
Quoted 8 lines · Theodore Ts'o
Quoted 3 lines · Kent Overstreet

That said, I'm not advocating people rush out to throw bcachefs on their servers or use it without backups yet, it's still young and needs more widespread testing.

Hi Kent!

Have you started using xfstests to stress test bcachefs yet?

Yep, since I had enough of a filesystem to test.

Quoted 4 lines

You may be interested in reading through this presentation, especially the last slide. :-)

https://thunk.org/gce-xfstests

Looks similar conceptually to my own xfstests wrapper...

lol @ the last slide :)