Skip to contentSkip to conversation

fix error flag covered by journal recovery

PATCH Superseded Ye Bin 3 participants 6 messages Mar 1, 2023 – Mar 2, 2023 ext4 file system

v4 of 5 Superseded Latest is v5 →

lore
Share & tools
lore

Ye Bin

author
#0 lore raw

v4 cover fix error flag covered by journal recovery

From: Ye Bin <[email protected]>

Diff v4 Vs v3:
After journal replay recover 'es->s_state' error flag like recover error info.

Diff v3 Vs v2:
Only fix fs error flag lost when previous journal errno is not record in disk. As this may lead to drop orphan list, however fs not record error flag, then fsck will not repair deeply.

Diff v2 vs v1:
Move call 'j_replay_prepare_callback' and 'j_replay_end_callback' from ext4_load_journal() to jbd2_journal_recover().

When do fault injection test, got issue as follows:
EXT4-fs (dm-5): warning: mounting fs with errors, running e2fsck is recommended EXT4-fs (dm-5): Errors on filesystem, clearing orphan list.
EXT4-fs (dm-5): recovery complete
EXT4-fs (dm-5): mounted filesystem with ordered data mode. Opts: data_err=abort,errors=remount-ro

EXT4-fs (dm-5): recovery complete
EXT4-fs (dm-5): mounted filesystem with ordered data mode. Opts: data_err=abort,errors=remount-ro

Without do file system check, file system is clean when do second mount. Theoretically, the kernel will not clear fs error flag. In errors=remount-ro mode the last super block is commit directly. So super block in journal is not uptodate. When do jounral recovery, the uptodate super block will be covered by jounral data. If super block submit all failed after recover journal, then file system error flag is lost. When do "fsck -a" couldn't repair file system deeply.
To solve above issue we need to do extra handle when do super block journal recovery.

Ye Bin (2):
ext4: commit super block if fs record error when journal record
without error
ext4: make sure fs error flag setted before clear journal error

 fs/ext4/super.c | 8 ++++++--
 1 file changed, 6 insertions(+), 2 deletions(-)
Signature · 1 line
2.31.1
author
#1 lore raw

PATCH v4 1/2 ext4: commit super block if fs record error when journal record without error

From: Ye Bin <[email protected]>

Now, 'es->s_state' maybe covered by recover journal. And journal errno maybe not recorded in journal sb as IO error. ext4_update_super() only update error information when 'sbi->s_add_error_count' large than zero. Then 'EXT4_ERROR_FS' flag maybe lost.
To solve above issue just recover 'es->s_state' error flag after journal replay like error info.

---
 fs/ext4/super.c | 7 +++++++
 1 file changed, 7 insertions(+)
fs/ext4/super.c +7 -0
index faae05493471..9df8fada2dce 100644
@@ -5910,7 +5910,9 @@ static int ext4_load_journal(struct super_block *sb,
 	if (!ext4_has_feature_journal_needs_recovery(sb))
 		err = jbd2_journal_wipe(journal, !really_read_only);
 	if (!err) {
+		int err2;
 		char *save = kmalloc(EXT4_S_ERR_LEN, GFP_KERNEL);
+
 		if (save)
 			memcpy(save, ((char *) es) +
 			       EXT4_S_ERR_START, EXT4_S_ERR_LEN);
@@ -5919,6 +5921,11 @@ static int ext4_load_journal(struct super_block *sb,
 			memcpy(((char *) es) + EXT4_S_ERR_START,
 			       save, EXT4_S_ERR_LEN);
 		kfree(save);
+		es->s_state |= cpu_to_le16(EXT4_SB(sb)->s_mount_state &
+					   EXT4_ERROR_FS);
+		/* Write out restored error information to the superblock */
+		err2 = ext4_commit_super(sb);
+		err = err ? : err2;
 	}
 
 	if (err) {
Signature · 1 line
2.31.1
reviewer Reviewed-by on v4 1/2
#2 lore raw

Re: [PATCH v4 1/2] ext4: commit super block if fs record error when journal record without error

Quoted 10 lines · Ye Bin

From: Ye Bin <[email protected]>

Now, 'es->s_state' maybe covered by recover journal. And journal errno maybe not recorded in journal sb as IO error. ext4_update_super() only update error information when 'sbi->s_add_error_count' large than zero. Then 'EXT4_ERROR_FS' flag maybe lost.
To solve above issue just recover 'es->s_state' error flag after journal replay like error info.

Thanks. The patch looks good to me. Feel free to add:

Honza

Quoted 33 lines
---
 fs/ext4/super.c | 7 +++++++
 1 file changed, 7 insertions(+)
fs/ext4/super.c +7 -0
index faae05493471..9df8fada2dce 100644
@@ -5910,7 +5910,9 @@ static int ext4_load_journal(struct super_block *sb,
 	if (!ext4_has_feature_journal_needs_recovery(sb))
 		err = jbd2_journal_wipe(journal, !really_read_only);
 	if (!err) {
+		int err2;
 		char *save = kmalloc(EXT4_S_ERR_LEN, GFP_KERNEL);
+
 		if (save)
 			memcpy(save, ((char *) es) +
 			       EXT4_S_ERR_START, EXT4_S_ERR_LEN);
@@ -5919,6 +5921,11 @@ static int ext4_load_journal(struct super_block *sb,
 			memcpy(((char *) es) + EXT4_S_ERR_START,
 			       save, EXT4_S_ERR_LEN);
 		kfree(save);
+		es->s_state |= cpu_to_le16(EXT4_SB(sb)->s_mount_state &
+					   EXT4_ERROR_FS);
+		/* Write out restored error information to the superblock */
+		err2 = ext4_commit_super(sb);
+		err = err ? : err2;
 	}
 
 	if (err) {
Signature · 1 line
2.31.1
Signature · 2 lines
Jan Kara <[email protected]>
SUSE Labs, CR
Reviewed-by on v4 1/2
#3 lore raw

Re: [PATCH v4 1/2] ext4: commit super block if fs record error when journal record without error

In reply to Ye Bin
Quoted 10 lines · Ye Bin

From: Ye Bin <[email protected]>

Now, 'es->s_state' maybe covered by recover journal. And journal errno maybe not recorded in journal sb as IO error. ext4_update_super() only update error information when 'sbi->s_add_error_count' large than zero. Then 'EXT4_ERROR_FS' flag maybe lost.
To solve above issue just recover 'es->s_state' error flag after journal replay like error info.

Looks good to me.

Quoted 30 lines
---
  fs/ext4/super.c | 7 +++++++
  1 file changed, 7 insertions(+)
fs/ext4/super.c +7 -0
index faae05493471..9df8fada2dce 100644
@@ -5910,7 +5910,9 @@ static int ext4_load_journal(struct super_block *sb,
  	if (!ext4_has_feature_journal_needs_recovery(sb))
  		err = jbd2_journal_wipe(journal, !really_read_only);
  	if (!err) {
+		int err2;
  		char *save = kmalloc(EXT4_S_ERR_LEN, GFP_KERNEL);
+
  		if (save)
  			memcpy(save, ((char *) es) +
  			       EXT4_S_ERR_START, EXT4_S_ERR_LEN);
@@ -5919,6 +5921,11 @@ static int ext4_load_journal(struct super_block *sb,
  			memcpy(((char *) es) + EXT4_S_ERR_START,
  			       save, EXT4_S_ERR_LEN);
  		kfree(save);
+		es->s_state |= cpu_to_le16(EXT4_SB(sb)->s_mount_state &
+					   EXT4_ERROR_FS);
+		/* Write out restored error information to the superblock */
+		err2 = ext4_commit_super(sb);
+		err = err ? : err2;
  	}
 
  	if (err) {
Signature · 3 lines
With Best Regards,
Baokun Li
.
author
#4 lore raw

PATCH v4 2/2 ext4: make sure fs error flag setted before clear journal error

In reply to Ye Bin

From: Ye Bin <[email protected]>

Now, jounral error number maybe cleared even though ext4_commit_super() failed. This may lead to error flag miss, then fsck will miss to check file system deeply.

---
 fs/ext4/super.c | 6 ++++--
 1 file changed, 4 insertions(+), 2 deletions(-)
fs/ext4/super.c +4 -2
index 9df8fada2dce..7736c96d5a78 100644
@@ -6152,11 +6152,13 @@ static int ext4_clear_journal_err(struct super_block *sb,
 		errstr = ext4_decode_error(sb, j_errno, nbuf);
 		ext4_warning(sb, "Filesystem error recorded "
 			     "from previous mount: %s", errstr);
-		ext4_warning(sb, "Marking fs in need of filesystem check.");
 
 		EXT4_SB(sb)->s_mount_state |= EXT4_ERROR_FS;
 		es->s_state |= cpu_to_le16(EXT4_ERROR_FS);
-		ext4_commit_super(sb);
+		j_errno = ext4_commit_super(sb);
+		if (j_errno)
+			return j_errno;
+		ext4_warning(sb, "Marked fs in need of filesystem check.");
 
 		jbd2_journal_clear_err(journal);
 		jbd2_journal_update_sb_errno(journal);
Signature · 1 line
2.31.1
Reviewed-by on v4 2/2
#5 lore raw

Re: [PATCH v4 2/2] ext4: make sure fs error flag setted before clear journal error

Quoted 8 lines · Ye Bin

From: Ye Bin <[email protected]>

Now, jounral error number maybe cleared even though ext4_commit_super() failed. This may lead to error flag miss, then fsck will miss to check file system deeply.

Looks good to me.

Quoted 24 lines
---
  fs/ext4/super.c | 6 ++++--
  1 file changed, 4 insertions(+), 2 deletions(-)
fs/ext4/super.c +4 -2
index 9df8fada2dce..7736c96d5a78 100644
@@ -6152,11 +6152,13 @@ static int ext4_clear_journal_err(struct super_block *sb,
  		errstr = ext4_decode_error(sb, j_errno, nbuf);
  		ext4_warning(sb, "Filesystem error recorded "
  			     "from previous mount: %s", errstr);
-		ext4_warning(sb, "Marking fs in need of filesystem check.");
 
  		EXT4_SB(sb)->s_mount_state |= EXT4_ERROR_FS;
  		es->s_state |= cpu_to_le16(EXT4_ERROR_FS);
-		ext4_commit_super(sb);
+		j_errno = ext4_commit_super(sb);
+		if (j_errno)
+			return j_errno;
+		ext4_warning(sb, "Marked fs in need of filesystem check.");
 
  		jbd2_journal_clear_err(journal);
  		jbd2_journal_update_sb_errno(journal);
Signature · 3 lines
With Best Regards,
Baokun Li
.