Skip to contentSkip to conversation

make ext4_valid_block_bitmap() more verbose

PATCH In review Bernd Schubert 4 participants 5 messages Nov 12, 2010 – Nov 15, 2010 ext4 file system

lore
Share & tools
lore
#0 lore raw

PATCH 1/1 make ext4_valid_block_bitmap() more verbose

The real issue we want to debug with the patch below actually came up while stress testing Lustre using the RHEL5.5 kernel (so 2.6.32'ish ext4), but a more verbose error function should not hurt for vanilla ext4 either.

make ext4_valid_block_bitmap() more verbose

While running our stress test suite, ext4_valid_block_bitmap() frequently complains about an invalid block bitmap. However, e2fsck does not find anything. So in oder to be able to better debug this issue, make the function more verbose and let it complain about the two possible invalid bitmaps.

---
 fs/ext4/balloc.c |   44 +++++++++++++++++++++++++++++++-------------
 1 file changed, 31 insertions(+), 13 deletions(-)
fs/ext4/balloc.c +31 -13
Index: linux-git/fs/ext4/balloc.c
===================================================================
@@ -230,6 +230,16 @@ struct ext4_group_desc * ext4_get_group_
 	return desc;
 }
 
+/**
+ * ext4_get_group_desc() -- load group descriptor from disk
+ * @sb:			super block
+ * @ext4_group_desc:	blocks group descriptor
+ * @block_group		block group to check
+ * @bh:			pointer to the buffer head to store the block
+ *			group descriptor
+ *
+ * return 0 on error or 1 if valid
+ */
 static int ext4_valid_block_bitmap(struct super_block *sb,
 					struct ext4_group_desc *desc,
 					unsigned int block_group,
@@ -239,6 +249,7 @@ static int ext4_valid_block_bitmap(struc
 	ext4_grpblk_t next_zero_bit;
 	ext4_fsblk_t bitmap_blk;
 	ext4_fsblk_t group_first_block;
+	int valid = 1;
 
 	if (EXT4_HAS_INCOMPAT_FEATURE(sb, EXT4_FEATURE_INCOMPAT_FLEX_BG)) {
 		/* with FLEX_BG, the inode/block bitmaps and itable
@@ -254,16 +265,20 @@ static int ext4_valid_block_bitmap(struc
 	/* check whether block bitmap block number is set */
 	bitmap_blk = ext4_block_bitmap(sb, desc);
 	offset = bitmap_blk - group_first_block;
-	if (!ext4_test_bit(offset, bh->b_data))
-		/* bad block bitmap */
-		goto err_out;
+	if (!ext4_test_bit(offset, bh->b_data)) {
+		ext4_warning(sb, "bad block bitmap block = %llu, offset = %d",
+			     bitmap_blk, (int) offset);
+		valid = 0;
+	}
 
 	/* check whether the inode bitmap block number is set */
 	bitmap_blk = ext4_inode_bitmap(sb, desc);
 	offset = bitmap_blk - group_first_block;
-	if (!ext4_test_bit(offset, bh->b_data))
-		/* bad block bitmap */
-		goto err_out;
+	if (!ext4_test_bit(offset, bh->b_data)) {
+		ext4_warning(sb, "bad inode bitmap block = %llu, offset = %d",
+			     bitmap_blk, (int) offset);
+		valid = 0;
+	}
 
 	/* check whether the inode table block number is set */
 	bitmap_blk = ext4_inode_table(sb, desc);
@@ -271,14 +286,17 @@ static int ext4_valid_block_bitmap(struc
 	next_zero_bit = ext4_find_next_zero_bit(bh->b_data,
 				offset + EXT4_SB(sb)->s_itb_per_group,
 				offset);
-	if (next_zero_bit >= offset + EXT4_SB(sb)->s_itb_per_group)
-		/* good bitmap for inode tables */
-		return 1;
+	/* good bitmap for inode tables */
+	if (next_zero_bit < offset + EXT4_SB(sb)->s_itb_per_group) {
+		ext4_warning(sb, "bad inode table block = %llu, offset = %d",
+			     bitmap_blk, (int) offset);
+		valid = 0;
+	}
 
-err_out:
-	ext4_error(sb, "Invalid block bitmap - block_group = %d, block = %llu",
-			block_group, bitmap_blk);
-	return 0;
+	if (!valid)
+		ext4_error(sb, "Invalid block bitmap - block_group = %d",
+			   block_group);
+	return valid;
 }
 /**
  * ext4_read_block_bitmap()
Signature · 2 lines
Bernd Schubert
DataDirect Networks
#1 lore raw
Quoted 11 lines · Bernd Schubert

The real issue we want to debug with the patch below actually came up while stress testing Lustre using the RHEL5.5 kernel (so 2.6.32'ish ext4), but a more verbose error function should not hurt for vanilla ext4 either.

make ext4_valid_block_bitmap() more verbose

While running our stress test suite, ext4_valid_block_bitmap() frequently complains about an invalid block bitmap. However, e2fsck does not find anything. So in oder to be able to better debug this issue, make the function more verbose and let it complain about the two possible invalid bitmaps.

Bernd,
thanks for sending this in. I like the idea of making these messages more verbose, since they should rarely be hit and when they are it would be good to know why these checks failed.

Quoted 5 lines

+/**
+ * ext4_get_group_desc() -- load group descriptor from disk
+ * @sb: super block
+ * @ext4_group_desc: blocks group descriptor
+ * @block_group block group to check

Quoted 8 lines

+ * @bh: pointer to the buffer head to store the block
+ * group descriptor
+ *
+ * return 0 on error or 1 if valid
+ */
static int ext4_valid_block_bitmap(struct super_block *sb,
struct ext4_group_desc *desc, unsigned int block_group,

The function name in the comment block does not actually match the function...

Quoted 4 lines
fs/ext4/balloc.c +3 -0
@@ -254,16 +265,20 @@ static int ext4_valid_block_bitmap(struc
+	if (!ext4_test_bit(offset, bh->b_data)) {
+		ext4_warning(sb, "bad block bitmap block = %llu, offset = %d",
+			     bitmap_blk, (int) offset);

fs/ext4/balloc.c static int ext4_valid_block_bitmap(struc · line 277

Quoted 10 lines
fs/ext4/balloc.c +6 -0
+		valid = 0;
+	}
 
 	/* check whether the inode bitmap block number is set */
 	bitmap_blk = ext4_inode_bitmap(sb, desc);
 	offset = bitmap_blk - group_first_block;
+	if (!ext4_test_bit(offset, bh->b_data)) {
+		ext4_warning(sb, "bad inode bitmap block = %llu, offset = %d",
+			     bitmap_blk, (int) offset);
+		valid = 0;

This message (while correct) is a bit confusing, since it implies there is something wrong with the inode bitmap block itself, rather than the the bit in the block bitmap. I think it would be clearer to rewrite this as follows:

"unset bit for inode bitmap: block %llu, bit %u"

for consistency we should then change the block bitmap error to match.

While we are changing this code, all of the ext4_test_bit() checks should be wrapped in unlikely(), since we should very rarely be seeing these errors.

fs/ext4/balloc.c static int ext4_valid_block_bitmap(struc · line 289

Quoted 5 lines
fs/ext4/balloc.c +4 -0
@@ -271,14 +286,17 @@ static int ext4_valid_block_bitmap(struc
+	if (next_zero_bit < offset + EXT4_SB(sb)->s_itb_per_group) {
+		ext4_warning(sb, "bad inode table block = %llu, offset = %d",
+			     bitmap_blk, (int) offset);
+		valid = 0;

Similarly, this implies that there is a bad inode table block, so I prefer:

"unset bit for inode table block %u: block %llu, bit %u"

where the "inode table block" value is, I think, (next_zero_bit - offset)

fs/ext4/balloc.c static int ext4_valid_block_bitmap(struc · line 298

Quoted 3 lines
fs/ext4/balloc.c +3 -0
+	if (!valid)
+		ext4_error(sb, "Invalid block bitmap - block_group = %d",
+			   block_group);

It would probably be worthwhile to also print the block number of the bitmap itself.

Cheers, Andreas

#2 lore raw
Quoted 14 lines · Andreas Dilger
Quoted 5 lines · Bernd Schubert

The real issue we want to debug with the patch below actually came up while stress testing Lustre using the RHEL5.5 kernel (so 2.6.32'ish ext4), but a more verbose error function should not hurt for vanilla ext4 either.

Quoted 7 lines

make ext4_valid_block_bitmap() more verbose

While running our stress test suite, ext4_valid_block_bitmap() frequently complains about an invalid block bitmap. However, e2fsck does not find anything. So in oder to be able to better debug this issue, make the function more verbose and let it complain about the two possible invalid bitmaps.

Quoted 3 lines

Bernd, thanks for sending this in. I like the idea of making these messages more verbose, since they should rarely be hit and when they are it would be good to know why these checks failed.

Andreas, thanks for your helpful review, I will send an updated patch on Wednesday.

Quoted 5 lines
Quoted 2 lines
(quoted diff) +1 -0
+	if (!valid) +		ext4_error(sb, "Invalid block bitmap - block_group

= %d", + block_group);

It would probably be worthwhile to also print the block number of the bitmap itself.

I guess you mean bitmap_blk here? But that changes for every of the possible checks, so I already printed it above. Is it worth to print it again? And what if more than one problem is found, might become a bit confusing then?

Thanks,
Bernd

#3 lore raw
In reply to Bernd Schubert
Quoted 11 lines · Bernd Schubert

The real issue we want to debug with the patch below actually came up while stress testing Lustre using the RHEL5.5 kernel (so 2.6.32'ish ext4), but a more verbose error function should not hurt for vanilla ext4 either.

make ext4_valid_block_bitmap() more verbose

While running our stress test suite, ext4_valid_block_bitmap() frequently complains about an invalid block bitmap. However, e2fsck does not find anything. So in oder to be able to better debug this issue, make the function more verbose and let it complain about the two possible invalid bitmaps.

Making a raw e2image of the problematic filesystem would let us take a look at why e2fsck isn't finding problems; unless you plan to fix that yourself as well, which is just fine of course. :)

-Eric

Quoted 1 line
#4 lore raw
Quoted 13 lines · Eric Sandeen
Quoted 11 lines · Bernd Schubert

The real issue we want to debug with the patch below actually came up while stress testing Lustre using the RHEL5.5 kernel (so 2.6.32'ish ext4), but a more verbose error function should not hurt for vanilla ext4 either.

make ext4_valid_block_bitmap() more verbose

While running our stress test suite, ext4_valid_block_bitmap() frequently complains about an invalid block bitmap. However, e2fsck does not find anything. So in oder to be able to better debug this issue, make the function more verbose and let it complain about the two possible invalid bitmaps.

Quoted 4 lines

Making a raw e2image of the problematic filesystem would let us take a look at why e2fsck isn't finding problems; unless you plan to fix that yourself as well, which is just fine of course. :)

I already captured an e2image and will do again on Wednesday, now that I could reproduce it again with the updated code. Unfortunately no time before. Will try to check out myself with debugfs first, if there is really something wrong. It might be a race in the code as well...

Cheers,
Bernd