make ext4_valid_block_bitmap() more verbose
PATCH 1/1 make ext4_valid_block_bitmap() more verbose
The real issue we want to debug with the patch below actually came up while stress testing Lustre using the RHEL5.5 kernel (so 2.6.32'ish ext4), but a more verbose error function should not hurt for vanilla ext4 either.
make ext4_valid_block_bitmap() more verbose
While running our stress test suite, ext4_valid_block_bitmap() frequently complains about an invalid block bitmap. However, e2fsck does not find anything. So in oder to be able to better debug this issue, make the function more verbose and let it complain about the two possible invalid bitmaps.
--- fs/ext4/balloc.c | 44 +++++++++++++++++++++++++++++++------------- 1 file changed, 31 insertions(+), 13 deletions(-)
fs/ext4/balloc.c +31 -13
@@ -230,6 +230,16 @@ struct ext4_group_desc * ext4_get_group_return desc; } +/** +* ext4_get_group_desc() -- load group descriptor from disk +* @sb: super block +* @ext4_group_desc: blocks group descriptor +* @block_group block group to check +* @bh: pointer to the buffer head to store the block +* group descriptor +* +* return 0 on error or 1 if valid +*/ static int ext4_valid_block_bitmap(struct super_block *sb, struct ext4_group_desc *desc, unsigned int block_group,
@@ -239,6 +249,7 @@ static int ext4_valid_block_bitmap(strucext4_grpblk_t next_zero_bit;ext4_fsblk_t bitmap_blk;ext4_fsblk_t group_first_block; +int valid =1 ;if (EXT4_HAS_INCOMPAT_FEATURE (sb,EXT4_FEATURE_INCOMPAT_FLEX_BG )) {/* with FLEX_BG, the inode/block bitmaps and itable
@@ -254,16 +265,20 @@ static int ext4_valid_block_bitmap(struc/* check whether block bitmap block number is set */ bitmap_blk =ext4_block_bitmap (sb, desc); offset = bitmap_blk - group_first_block; -if (!ext4_test_bit (offset, bh->b_data)) -/* bad block bitmap */ - goto err_out; +if (!ext4_test_bit (offset, bh->b_data)) { +ext4_warning (sb,"bad block bitmap block = %llu, offset = %d" , + bitmap_blk, (int ) offset); + valid =0 ; + }/* check whether the inode bitmap block number is set */ bitmap_blk =ext4_inode_bitmap (sb, desc); offset = bitmap_blk - group_first_block; -if (!ext4_test_bit (offset, bh->b_data)) -/* bad block bitmap */ - goto err_out; +if (!ext4_test_bit (offset, bh->b_data)) { +ext4_warning (sb,"bad inode bitmap block = %llu, offset = %d" , + bitmap_blk, (int ) offset); + valid =0 ; + }/* check whether the inode table block number is set */ bitmap_blk =ext4_inode_table (sb, desc);
@@ -271,14 +286,17 @@ static int ext4_valid_block_bitmap(struc next_zero_bit =ext4_find_next_zero_bit (bh->b_data, offset +EXT4_SB (sb)->s_itb_per_group, offset); -if (next_zero_bit >= offset +EXT4_SB (sb)->s_itb_per_group) -/* good bitmap for inode tables */ -return 1 ; +/* good bitmap for inode tables */ +if (next_zero_bit < offset +EXT4_SB (sb)->s_itb_per_group) { +ext4_warning (sb,"bad inode table block = %llu, offset = %d" , + bitmap_blk, (int ) offset); + valid =0 ; + } -err_out: -ext4_error (sb,"Invalid block bitmap - block_group = %d, block = %llu" , - block_group, bitmap_blk); -return 0 ; +if (!valid) +ext4_error (sb,"Invalid block bitmap - block_group = %d" , + block_group); +return valid; }/** * ext4_read_block_bitmap()
Signature · 2 lines
Bernd Schubert DataDirect Networks
Andreas Dilger
reviewerQuoted 11 lines · Bernd Schubert
The real issue we want to debug with the patch below actually came up while stress testing Lustre using the RHEL5.5 kernel (so 2.6.32'ish ext4), but a more verbose error function should not hurt for vanilla ext4 either.
make
ext4_valid_block_bitmap()more verboseWhile running our stress test suite,
ext4_valid_block_bitmap()frequently complains about an invalid block bitmap. However, e2fsck does not find anything. So in oder to be able to better debug this issue, make the function more verbose and let it complain about the two possible invalid bitmaps.
Bernd,
thanks for sending this in. I like the idea of making these messages more verbose, since they should rarely be hit and when they are it would be good to know why these checks failed.
Quoted 5 lines
+/**
+ *ext4_get_group_desc()-- load group descriptor from disk
+ * @sb: super block
+ * @ext4_group_desc: blocks group descriptor
+ * @block_group block group to check
Quoted 8 lines
+ * @bh: pointer to the buffer head to store the block
+ * group descriptor
+ *
+ * return 0 on error or 1 if valid
+ */
static int ext4_valid_block_bitmap(structsuper_block*sb,
structext4_group_desc*desc, unsigned intblock_group,
The function name in the comment block does not actually match the function...
Quoted 4 lines
fs/ext4/balloc.c +3
-0@@ -254,16 +265,20 @@ static int ext4_valid_block_bitmap(struc +if (!ext4_test_bit (offset, bh->b_data)) { +ext4_warning (sb,"bad block bitmap block = %llu, offset = %d" , + bitmap_blk, (int ) offset);
fs/ext4/balloc.c static int ext4_valid_block_bitmap(struc · line 277
Quoted 10 lines
fs/ext4/balloc.c +6
-0+ valid =0 ; + }/* check whether the inode bitmap block number is set */ bitmap_blk =ext4_inode_bitmap (sb, desc); offset = bitmap_blk - group_first_block; +if (!ext4_test_bit (offset, bh->b_data)) { +ext4_warning (sb,"bad inode bitmap block = %llu, offset = %d" , + bitmap_blk, (int ) offset); + valid =0 ;
This message (while correct) is a bit confusing, since it implies there is something wrong with the inode bitmap block itself, rather than the the bit in the block bitmap. I think it would be clearer to rewrite this as follows:
"unset bit for inode bitmap: block %llu, bit %u"
for consistency we should then change the block bitmap error to match.
While we are changing this code, all of the ext4_test_bit() checks should be wrapped in unlikely(), since we should very rarely be seeing these errors.
fs/ext4/balloc.c static int ext4_valid_block_bitmap(struc · line 289
Quoted 5 lines
fs/ext4/balloc.c +4
-0@@ -271,14 +286,17 @@ static int ext4_valid_block_bitmap(struc +if (next_zero_bit < offset +EXT4_SB (sb)->s_itb_per_group) { +ext4_warning (sb,"bad inode table block = %llu, offset = %d" , + bitmap_blk, (int ) offset); + valid =0 ;
Similarly, this implies that there is a bad inode table block, so I prefer:
"unset bit for inode table block %u: block %llu, bit %u"
where the "inode table block" value is, I think, (next_zero_bit - offset)
fs/ext4/balloc.c static int ext4_valid_block_bitmap(struc · line 298
Quoted 3 lines
fs/ext4/balloc.c +3
-0+if (!valid) +ext4_error (sb,"Invalid block bitmap - block_group = %d" , + block_group);
It would probably be worthwhile to also print the block number of the bitmap itself.
Cheers, Andreas
Quoted 14 lines · Andreas Dilger
Quoted 5 lines · Bernd Schubert
The real issue we want to debug with the patch below actually came up while stress testing Lustre using the RHEL5.5 kernel (so 2.6.32'ish ext4), but a more verbose error function should not hurt for vanilla ext4 either.
Quoted 7 lines
make
ext4_valid_block_bitmap()more verboseWhile running our stress test suite,
ext4_valid_block_bitmap()frequently complains about an invalid block bitmap. However, e2fsck does not find anything. So in oder to be able to better debug this issue, make the function more verbose and let it complain about the two possible invalid bitmaps.
Quoted 3 lines
Bernd, thanks for sending this in. I like the idea of making these messages more verbose, since they should rarely be hit and when they are it would be good to know why these checks failed.
Andreas, thanks for your helpful review, I will send an updated patch on Wednesday.
Quoted 5 lines
Quoted 2 lines
(quoted diff) +1
-0+ if (!valid) + ext4_error(sb, "Invalid block bitmap - block_group= %d", +
block_group);It would probably be worthwhile to also print the block number of the bitmap itself.
I guess you mean bitmap_blk here? But that changes for every of the possible checks, so I already printed it above. Is it worth to print it again? And what if more than one problem is found, might become a bit confusing then?
Thanks,
Bernd
Quoted 11 lines · Bernd Schubert
The real issue we want to debug with the patch below actually came up while stress testing Lustre using the RHEL5.5 kernel (so 2.6.32'ish ext4), but a more verbose error function should not hurt for vanilla ext4 either.
make
ext4_valid_block_bitmap()more verboseWhile running our stress test suite,
ext4_valid_block_bitmap()frequently complains about an invalid block bitmap. However, e2fsck does not find anything. So in oder to be able to better debug this issue, make the function more verbose and let it complain about the two possible invalid bitmaps.
Making a raw e2image of the problematic filesystem would let us take a look at why e2fsck isn't finding problems; unless you plan to fix that yourself as well, which is just fine of course. :)
-Eric
Quoted 1 line
Signed-off-by Bernd Schubert <[email protected]>
Quoted 13 lines · Eric Sandeen
Quoted 11 lines · Bernd Schubert
The real issue we want to debug with the patch below actually came up while stress testing Lustre using the RHEL5.5 kernel (so 2.6.32'ish ext4), but a more verbose error function should not hurt for vanilla ext4 either.
make
ext4_valid_block_bitmap()more verboseWhile running our stress test suite,
ext4_valid_block_bitmap()frequently complains about an invalid block bitmap. However, e2fsck does not find anything. So in oder to be able to better debug this issue, make the function more verbose and let it complain about the two possible invalid bitmaps.
Quoted 4 lines
Making a raw e2image of the problematic filesystem would let us take a look at why e2fsck isn't finding problems; unless you plan to fix that yourself as well, which is just fine of course. :)
I already captured an e2image and will do again on Wednesday, now that I could reproduce it again with the updated code. Unfortunately no time before. Will try to check out myself with debugfs first, if there is really something wrong. It might be a race in the code as well...
Cheers,
Bernd