Skip to contentSkip to conversation

ext4, jbd2: abort journal on file data write error under data_err=abort

PATCH In review Aditya Srivastava 2 participants 3 messages Jun 23 – Jun 24

Subsystems (2)
lore
Share & tools
lore
#0 lore raw

PATCH 1/1 ext4, jbd2: abort journal on file data write error under data_err=abort

From: Aditya Prakash Srivastava <[email protected]>

The "data_err=abort" mount option in ext4 is designed to abort the journal and force the filesystem into read-only mode if a file data writeback failure is detected (to prevent silent data loss and stale data exposure).

However, in standard data=ordered mode, file data writeback is executed and waited for during transaction commit in journal_finish_inode_data_buffers(). When filemap_fdatawait_range_keep_errors() detects and returns a data writeback error (e.g. -EIO), JBD2 merely prints a warning message and then discards the error. This results in the transaction committing successfully, exposing stale/corrupted data and defeating the purpose of the data_err=abort option.

Fix this by:
1. Defining a new JBD2 configuration flag, JBD2_ABORT_ON_DATA_ERR.
2. In JBD2, if JBD2_ABORT_ON_DATA_ERR is set, abort the transaction commit and the journal thread via jbd2_journal_abort() if writeback fails.
3. In ext4, configure JBD2_ABORT_ON_DATA_ERR on the journal based on the ext4 "data_err=abort" mount option in ext4_init_journal_params().

---
 fs/ext4/super.c      | 4 ++++
 fs/jbd2/commit.c     | 2 ++
 include/linux/jbd2.h | 1 +
 3 files changed, 7 insertions(+)
fs/ext4/super.c +4 -0
index 7283108d7609..de34490a5b68 100644
@@ -5875,6 +5875,10 @@ static void ext4_init_journal_params(struct super_block *sb, journal_t *journal)
 		journal->j_flags |= JBD2_BARRIER;
 	else
 		journal->j_flags &= ~JBD2_BARRIER;
+	if (test_opt(sb, DATA_ERR_ABORT))
+		journal->j_flags |= JBD2_ABORT_ON_DATA_ERR;
+	else
+		journal->j_flags &= ~JBD2_ABORT_ON_DATA_ERR;
 	/*
 	 * Always enable journal cycle record option, letting the journal
 	 * records log transactions continuously between each mount.
fs/jbd2/commit.c +2 -0
index d8577725a2fb..49acc9d0809e 100644
@@ -768,6 +768,8 @@ void jbd2_journal_commit_transaction(journal_t *journal)
 		printk(KERN_WARNING
 			"JBD2: Detected IO errors %d while flushing file data on %s\n",
 			err, journal->j_devname);
+		if (journal->j_flags & JBD2_ABORT_ON_DATA_ERR)
+			jbd2_journal_abort(journal, err);
 		err = 0;
 	}
 
include/linux/jbd2.h +1 -0
index 7e785aa6d35d..e39679656de6 100644
@@ -1410,6 +1410,7 @@ JBD2_FEATURE_INCOMPAT_FUNCS(fast_commit,	FAST_COMMIT)
 #define JBD2_FLUSHED	0x008	/* The journal superblock has been flushed */
 #define JBD2_LOADED	0x010	/* The journal superblock has been loaded */
 #define JBD2_BARRIER	0x020	/* Use IDE barriers */
+#define JBD2_ABORT_ON_DATA_ERR	0x040	/* Abort the journal on file data write errors */
 #define JBD2_CYCLE_RECORD		0x080	/* Journal cycled record log on
 						 * clean and empty filesystem
 						 * logging area */
Signature · 1 line
2.47.3
#1 lore raw
Quoted 7 lines · Aditya Srivastava

From: Aditya Prakash Srivastava <[email protected]>

The "data_err=abort" mount option in ext4 is designed to abort the journal and force the filesystem into read-only mode if a file data writeback failure is detected (to prevent silent data loss and stale data exposure).

Quoted 8 lines

However, in standard data=ordered mode, file data writeback is executed and waited for during transaction commit in journal_finish_inode_data_buffers(). When filemap_fdatawait_range_keep_errors() detects and returns a data writeback error (e.g. -EIO), JBD2 merely prints a warning message and then discards the error. This results in the transaction committing successfully, exposing stale/corrupted data and defeating the purpose of the data_err=abort option.

Hi, Aditya!

Thanks for the patch. However, after commit ce51afb8cc5e ("ext4: abort journal on data writeback failure if in data_err=abort mode"), has already moved the abort logic into the end IO workqueue. In that case, it seems the journal abort would be triggered properly upon a data writeback failure. The issue described in this Bugzilla looks like an outdated one. Have you encountered any actual issues for now?

Thanks,
Yi.

Quoted 58 lines

Fix this by:
1. Defining a new JBD2 configuration flag, JBD2_ABORT_ON_DATA_ERR.
2. In JBD2, if JBD2_ABORT_ON_DATA_ERR is set, abort the transaction commit and the journal thread via jbd2_journal_abort() if writeback fails.
3. In ext4, configure JBD2_ABORT_ON_DATA_ERR on the journal based on the ext4 "data_err=abort" mount option in ext4_init_journal_params().

---
 fs/ext4/super.c      | 4 ++++
 fs/jbd2/commit.c     | 2 ++
 include/linux/jbd2.h | 1 +
 3 files changed, 7 insertions(+)
fs/ext4/super.c +4 -0
index 7283108d7609..de34490a5b68 100644
@@ -5875,6 +5875,10 @@ static void ext4_init_journal_params(struct super_block *sb, journal_t *journal)
 		journal->j_flags |= JBD2_BARRIER;
 	else
 		journal->j_flags &= ~JBD2_BARRIER;
+	if (test_opt(sb, DATA_ERR_ABORT))
+		journal->j_flags |= JBD2_ABORT_ON_DATA_ERR;
+	else
+		journal->j_flags &= ~JBD2_ABORT_ON_DATA_ERR;
 	/*
 	 * Always enable journal cycle record option, letting the journal
 	 * records log transactions continuously between each mount.
fs/jbd2/commit.c +2 -0
index d8577725a2fb..49acc9d0809e 100644
@@ -768,6 +768,8 @@ void jbd2_journal_commit_transaction(journal_t *journal)
 		printk(KERN_WARNING
 			"JBD2: Detected IO errors %d while flushing file data on %s\n",
 			err, journal->j_devname);
+		if (journal->j_flags & JBD2_ABORT_ON_DATA_ERR)
+			jbd2_journal_abort(journal, err);
 		err = 0;
 	}
 
include/linux/jbd2.h +1 -0
index 7e785aa6d35d..e39679656de6 100644
@@ -1410,6 +1410,7 @@ JBD2_FEATURE_INCOMPAT_FUNCS(fast_commit,	FAST_COMMIT)
 #define JBD2_FLUSHED	0x008	/* The journal superblock has been flushed */
 #define JBD2_LOADED	0x010	/* The journal superblock has been loaded */
 #define JBD2_BARRIER	0x020	/* Use IDE barriers */
+#define JBD2_ABORT_ON_DATA_ERR	0x040	/* Abort the journal on file data write errors */
 #define JBD2_CYCLE_RECORD		0x080	/* Journal cycled record log on
 						 * clean and empty filesystem
 						 * logging area */
#2 lore raw

Hi Yi,

Thank you very much for your feedback and for pointing out commit ce51afb8cc5e!

I was investigating the open Bugzilla ticket #207729, which was still marked as ASSIGNED and unresolved without any links to the fix. I'm very glad to hear that the abort logic has already been cleanly integrated into the end-I/O workqueue path by commit ce51afb8cc5e.

I have added a comment to Bugzilla ticket #207729 referencing commit ce51afb8cc5e so that the ticket can be resolved/closed and others don't duplicate this work in the future.

Thanks again for the review and guidance!

Best regards,
Aditya

Quoted 89 lines · Zhang Yi
Quoted 7 lines · Aditya Srivastava

From: Aditya Prakash Srivastava <[email protected]>

The "data_err=abort" mount option in ext4 is designed to abort the journal and force the filesystem into read-only mode if a file data writeback failure is detected (to prevent silent data loss and stale data exposure).

Quoted 8 lines

However, in standard data=ordered mode, file data writeback is executed and waited for during transaction commit in journal_finish_inode_data_buffers(). When filemap_fdatawait_range_keep_errors() detects and returns a data writeback error (e.g. -EIO), JBD2 merely prints a warning message and then discards the error. This results in the transaction committing successfully, exposing stale/corrupted data and defeating the purpose of the data_err=abort option.

Hi, Aditya!

Thanks for the patch. However, after commit ce51afb8cc5e ("ext4: abort journal on data writeback failure if in data_err=abort mode"), has already moved the abort logic into the end IO workqueue. In that case, it seems the journal abort would be triggered properly upon a data writeback failure. The issue described in this Bugzilla looks like an outdated one. Have you encountered any actual issues for now?

Thanks,
Yi.

Quoted 58 lines

Fix this by:
1. Defining a new JBD2 configuration flag, JBD2_ABORT_ON_DATA_ERR.
2. In JBD2, if JBD2_ABORT_ON_DATA_ERR is set, abort the transaction commit and the journal thread via jbd2_journal_abort() if writeback fails.
3. In ext4, configure JBD2_ABORT_ON_DATA_ERR on the journal based on the ext4 "data_err=abort" mount option in ext4_init_journal_params().

---
 fs/ext4/super.c      | 4 ++++
 fs/jbd2/commit.c     | 2 ++
 include/linux/jbd2.h | 1 +
 3 files changed, 7 insertions(+)
fs/ext4/super.c +4 -0
index 7283108d7609..de34490a5b68 100644
@@ -5875,6 +5875,10 @@ static void ext4_init_journal_params(struct super_block *sb, journal_t *journal)
              journal->j_flags |= JBD2_BARRIER;
      else
              journal->j_flags &= ~JBD2_BARRIER;
+     if (test_opt(sb, DATA_ERR_ABORT))
+             journal->j_flags |= JBD2_ABORT_ON_DATA_ERR;
+     else
+             journal->j_flags &= ~JBD2_ABORT_ON_DATA_ERR;
      /*
       * Always enable journal cycle record option, letting the journal
       * records log transactions continuously between each mount.
fs/jbd2/commit.c +2 -0
index d8577725a2fb..49acc9d0809e 100644
@@ -768,6 +768,8 @@ void jbd2_journal_commit_transaction(journal_t *journal)
              printk(KERN_WARNING
                      "JBD2: Detected IO errors %d while flushing file data on %s\n",
                      err, journal->j_devname);
+             if (journal->j_flags & JBD2_ABORT_ON_DATA_ERR)
+                     jbd2_journal_abort(journal, err);
              err = 0;
      }
 
include/linux/jbd2.h +1 -0
index 7e785aa6d35d..e39679656de6 100644
@@ -1410,6 +1410,7 @@ JBD2_FEATURE_INCOMPAT_FUNCS(fast_commit,        FAST_COMMIT)
 #define JBD2_FLUSHED 0x008   /* The journal superblock has been flushed */
 #define JBD2_LOADED  0x010   /* The journal superblock has been loaded */
 #define JBD2_BARRIER 0x020   /* Use IDE barriers */
+#define JBD2_ABORT_ON_DATA_ERR       0x040   /* Abort the journal on file data write errors */
 #define JBD2_CYCLE_RECORD            0x080   /* Journal cycled record log on
                                               * clean and empty filesystem
                                               * logging area */