jbd: possible filesystem corruption fixes (take 2)
Get series with b4
b4 am [email protected]Versions newest first
- v1 Latest5 patches 39 repliesIn review
Patches in v1 No applies recorded yet
| # | Subject and files | Size | Replies | Applied |
|---|---|---|---|---|
| 1/5 | jbd: strictly check for write errors on data buffersfs/ | +9 | 17 replies | |
| 2/5 | jbd: ordered data integrity fixfs/ | +13 | 3 replies | |
| 3/5 | jbd: abort when failed to log metadata buffersfs/ | +3 | 3 replies | |
| 4/5 | jbd: fix error handling for checkpoint iofs/ fs/ fs/ +1 more | +64 | 2 replies | |
| 4/5 | jbd: fix error handling for checkpoint iofs/ fs/ fs/ +1 more | +65 | 11 replies | |
| 5/5 | ext3: abort ext3 if the journal has abortedfs/ fs/ | +15 | 1 reply |
Reviews trailers per patch
All 6 patches have a Reviewed-by or Acked-by.
| Patch | Jan Kara |
|---|---|
| 1/5 | A-b |
| 2/5 | A-b |
| 3/5 | A-b |
| 4/5 | A-b |
| 4/5 | A-b |
| 5/5 | A-b |
Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.
Cover letter [PATCH 0/5] jbd: possible filesystem corruption fixes (take 2)
Subject: [PATCH 0/5] jbd: possible filesystem corruption fixes (take 2)
This patch set is the take 2 of fixing error handling problem in ext3/JBD. The previous discussion can be found here:
http://lkml.org/lkml/2008/5/14/10
The same problem should also be in ext4/JBD, but I haven't prepared it yet.
Problem
=======
Currently some error checkings are missing, so the journal cannot abort correctly. This causes breakage of the ordered mode rule and filesystem corruption. Missing error checkings are:
(1) error check for dirty buffers flushed before the commit (addressed by PATCH 1/5 and 2/5)
(2) error check for the metadata writes to the journal before the commit (addressed by PATCH 3/5)
(3) error check for checkpointing and replay (addressed by PATCH 4/5
and 5/5)
Changes from take 1
===================
[PATCH 1/5]
o not changed
[PATCH 2/5]
o rewrite my coment in journal_dirty_data() comprehensibly
[PATCH 3/5]
o check for errors and abort the journal just before journal_write_commit_record() instead of after writing metadata buffers
[PATCH 4/5 and 5/5]
o separate the ext3 part from the jbd part in a patch
o use JFS_ABORT for checkpointing failures instead of introducing JFS_CP_ABORT flag
o don't update only the journal super block, but also j_tail and j_tail_sequence when the journal has aborted (at least we only have to avoid updating the super block, but keeping j_tail*'s values will be good thing because it may protect someone from adding bugs in the future)
o journal_destroy() returns -EIO when the journal has aborted so that ext3_put_super() can detect the abort
o journal_flush() uses j_checkpoint_mutex to avoid a race with __log_wait_for_space()
The last item targets a newly found problem. journal_flush() can be called while processing __log_wait_for_space(). In this case, cleanup_journal_tail() can be called between __journal_drop_transaction() and journal_abort(), then
the transaction with checkpointing failure is lost from the journal. Using j_checkpoint_mutex which is used by __log_wait_for_space(), we should avoid the race condition. But the test is not so sufficient because it is very difficult to produce this race. So I hope that this locking is reviewed carefully (including a possibility of deadlock.)
Regards,
Signature · 3 lines
Hidehiro Kawai Hitachi, Systems Development Laboratory Linux Technology Center