Fix two issues about bigalloc feature
v3 cover Fix two issues about bigalloc feature
From: Ye Bin <[email protected]>
Diff v3 Vs v2:
1. Add fixes tag and rename label 'out' for first patch.
2. Do not split string across lines for second patch.
3. Just check pending tree if empty, drop clear code for third patch.
Diff V2 vs V1:
Use ext4_error() when detect 'i_reserved_data_blocks' and pending tree abnormal.
Ye Bin (3):
ext4: fix incorrect calculate 'reserved' in '__es_remove_extent' when
enable bigalloc feature
ext4: record error when detect abnormal 'i_reserved_data_blocks'
ext4: add check pending tree when evict inode
fs/ext4/extents_status.c | 3 ++- fs/ext4/super.c | 13 +++++++++---- 2 files changed, 11 insertions(+), 5 deletions(-)
Signature · 1 line
2.31.1
PATCH v3 1/3 ext4: fix incorrect calculate 'reserved' in '__es_remove_extent' when enable bigalloc feature
From: Ye Bin <[email protected]>
Syzbot report issue as follows:
EXT4-fs error (device loop0): ext4_validate_block_bitmap:398: comm rep: bg 0: block 5: invalid block bitmap EXT4-fs (loop0): Delayed block allocation failed for inode 18 at logical offset 0 with max blocks 32 with error 28 EXT4-fs (loop0): This should not happen!! Data will be lost
EXT4-fs (loop0): Total free blocks count 0
EXT4-fs (loop0): Free/Dirty block details
EXT4-fs (loop0): free_blocks=0
EXT4-fs (loop0): dirty_blocks=32
EXT4-fs (loop0): Block reservation details
EXT4-fs (loop0): i_reserved_data_blocks=2
EXT4-fs (loop0): Inode 18 (00000000845cd634): i_reserved_data_blocks (1) not cleared!
Above issue happens as follows:
Assume:sbi->s_cluster_ratio = 16
Step1: Insert delay block [0, 31] -> ei->i_reserved_data_blocks=2 Step2:ext4_writepages
mpage_map_and_submit_extent -> return failed mpage_release_unused_pages -> to release [0, 30]
ext4_es_remove_extent -> remove lblk=0 end=30
__es_remove_extent -> len1=0 len2=31-30=1
__es_remove_extent:
...
if (len2 > 0) {
...
if (len1 > 0) {
...
} else {
es->es_lblk = end + 1;
es->es_len = len2;
...
}
if (count_reserved)
count_rsvd(inode, lblk, orig_es.es_len - len1 - len2, &orig_es, &rc);
goto out; -> will return but didn't calculate 'reserved' ...
Step3: ext4_destroy_inode -> trigger "i_reserved_data_blocks (1) not cleared!"
To solve above issue if 'len2>0' call 'get_rsvd()' before goto out.
--- fs/ext4/extents_status.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)
fs/ext4/extents_status.c +2 -1
@@ -1371,7 +1371,7 @@ static int __es_remove_extent(struct inode *inode, ext4_lblk_t lblk,if (count_reserved)count_rsvd (inode, lblk, orig_es.es_len - len1 - len2, &orig_es, &rc); - goto out; + goto out_get_reserved; }if (len1 >0 ) {
@@ -1413,6 +1413,7 @@ static int __es_remove_extent(struct inode *inode, ext4_lblk_t lblk, } } +out_get_reserved:if (count_reserved) *reserved =get_rsvd (inode, end, es, &rc); out:
Signature · 1 line
2.31.1
Re: [PATCH v3 1/3] ext4: fix incorrect calculate 'reserved' in '__es_remove_extent' when enable bigalloc feature
* Ye Bin <[email protected]>:
Quoted 65 lines
From: Ye Bin <[email protected]>
Syzbot report issue as follows:
EXT4-fs error (device loop0): ext4_validate_block_bitmap:398: comm rep: bg 0: block 5: invalid block bitmap EXT4-fs (loop0): Delayed block allocation failed for inode 18 at logical offset 0 with max blocks 32 with error 28 EXT4-fs (loop0): This should not happen!! Data will be lostEXT4-fs (loop0): Total free blocks count 0
EXT4-fs (loop0): Free/Dirty block details
EXT4-fs (loop0): free_blocks=0
EXT4-fs (loop0): dirty_blocks=32
EXT4-fs (loop0): Block reservation details
EXT4-fs (loop0): i_reserved_data_blocks=2
EXT4-fs (loop0): Inode 18 (00000000845cd634):i_reserved_data_blocks(1) not cleared!Above issue happens as follows:
Assume:sbi->s_cluster_ratio= 16
Step1: Insert delay block [0, 31] -> ei->i_reserved_data_blocks=2 Step2:ext4_writepages
mpage_map_and_submit_extent-> return failedmpage_release_unused_pages-> to release [0, 30]ext4_es_remove_extent -> remove lblk=0 end=30 __es_remove_extent -> len1=0 len2=31-30=1 __es_remove_extent: ... if (len2 > 0) { ... if (len1 > 0) { ... } else { es->es_lblk = end + 1; es->es_len = len2; ... } if (count_reserved) count_rsvd(inode, lblk, orig_es.es_len - len1 - len2, &orig_es, &rc); goto out; -> will return but didn't calculate 'reserved'...
Step3:ext4_destroy_inode-> trigger "i_reserved_data_blocks(1) not cleared!"To solve above issue if 'len2>0' call '
get_rsvd()' before goto out.Reported-by [email protected]Fixes 8fcc3a580651 ("ext4: rework reserved cluster accounting when invalidating pages")Signed-off-by Ye Bin <[email protected]>--- fs/ext4/extents_status.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)fs/ext4/extents_status.c +1
-1@@ -1371,7 +1371,7 @@ static int __es_remove_extent(struct inode *inode, ext4_lblk_t lblk,if (count_reserved)count_rsvd (inode, lblk, orig_es.es_len - len1 - len2, &orig_es, &rc); - goto out; + goto out_get_reserved; }if (len1 >0 ) {
fs/ext4/extents_status.c static int __es_remove_extent(struct inode *inode, ext4_lblk_t lblk, · line 1419
Quoted 7 lines
fs/ext4/extents_status.c +1
-0@@ -1413,6 +1413,7 @@ static int __es_remove_extent(struct inode *inode, ext4_lblk_t lblk, } } +out_get_reserved:if (count_reserved) *reserved =get_rsvd (inode, end, es, &rc); out:
The length of some lines in the commit description - probably those which are log output - is resulting in a checkpatch warning. It generally prefers lines to be a maximum of 75 characters (and Ted usually likes them limited to 72 characters. See my comment to patch #3. I'm not sure what Ted would want here, though I'd probably break them at 72 characters or less.
Otherwise, the patch looks good. Feel free to add:
Quoted 3 lines
Signature · 1 line
2.31.1
Re: [PATCH v3 1/3] ext4: fix incorrect calculate 'reserved' in '__es_remove_extent' when enable bigalloc feature
* Eric Whitney <[email protected]>:
Quoted 80 lines
* Ye Bin <[email protected]>:
Quoted 65 lines
From: Ye Bin <[email protected]>
Syzbot report issue as follows:
EXT4-fs error (device loop0): ext4_validate_block_bitmap:398: comm rep: bg 0: block 5: invalid block bitmap EXT4-fs (loop0): Delayed block allocation failed for inode 18 at logical offset 0 with max blocks 32 with error 28 EXT4-fs (loop0): This should not happen!! Data will be lostEXT4-fs (loop0): Total free blocks count 0
EXT4-fs (loop0): Free/Dirty block details
EXT4-fs (loop0): free_blocks=0
EXT4-fs (loop0): dirty_blocks=32
EXT4-fs (loop0): Block reservation details
EXT4-fs (loop0): i_reserved_data_blocks=2
EXT4-fs (loop0): Inode 18 (00000000845cd634):i_reserved_data_blocks(1) not cleared!Above issue happens as follows:
Assume:sbi->s_cluster_ratio= 16
Step1: Insert delay block [0, 31] -> ei->i_reserved_data_blocks=2 Step2:ext4_writepages
mpage_map_and_submit_extent-> return failedmpage_release_unused_pages-> to release [0, 30]ext4_es_remove_extent -> remove lblk=0 end=30 __es_remove_extent -> len1=0 len2=31-30=1 __es_remove_extent: ... if (len2 > 0) { ... if (len1 > 0) { ... } else { es->es_lblk = end + 1; es->es_len = len2; ... } if (count_reserved) count_rsvd(inode, lblk, orig_es.es_len - len1 - len2, &orig_es, &rc); goto out; -> will return but didn't calculate 'reserved'...
Step3:ext4_destroy_inode-> trigger "i_reserved_data_blocks(1) not cleared!"To solve above issue if 'len2>0' call '
get_rsvd()' before goto out.Reported-by [email protected]Fixes 8fcc3a580651 ("ext4: rework reserved cluster accounting when invalidating pages")Signed-off-by Ye Bin <[email protected]>--- fs/ext4/extents_status.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)fs/ext4/extents_status.c +1
-1@@ -1371,7 +1371,7 @@ static int __es_remove_extent(struct inode *inode, ext4_lblk_t lblk,if (count_reserved)count_rsvd (inode, lblk, orig_es.es_len - len1 - len2, &orig_es, &rc); - goto out; + goto out_get_reserved; }if (len1 >0 ) {fs/ext4/extents_status.c static int __es_remove_extent(struct inode *inode, ext4_lblk_t lblk, · line 1419
Quoted 7 lines
fs/ext4/extents_status.c +1
-0@@ -1413,6 +1413,7 @@ static int __es_remove_extent(struct inode *inode, ext4_lblk_t lblk, } } +out_get_reserved:if (count_reserved) *reserved =get_rsvd (inode, end, es, &rc); out:The length of some lines in the commit description - probably those which are log output - is resulting in a checkpatch warning. It generally prefers lines to be a maximum of 75 characters (and Ted usually likes them limited to 72 characters. See my comment to patch #3. I'm not sure what Ted would want here, though I'd probably break them at 72 characters or less.
Quoted 2 lines
Otherwise, the patch looks good. Feel free to add:
Looks good. As before, feel free to add:
Quoted 6 lines
Reviewed-by Eric Whitney <[email protected]>Quoted 3 lines
Signature · 1 line
2.31.1
Re: [PATCH v3 1/3] ext4: fix incorrect calculate 'reserved' in '__es_remove_extent' when enable bigalloc feature
* Eric Whitney <[email protected]>:
Quoted 81 lines
* Eric Whitney <[email protected]>:
Quoted 80 lines
* Ye Bin <[email protected]>:
Quoted 65 lines
From: Ye Bin <[email protected]>
Syzbot report issue as follows:
EXT4-fs error (device loop0): ext4_validate_block_bitmap:398: comm rep: bg 0: block 5: invalid block bitmap EXT4-fs (loop0): Delayed block allocation failed for inode 18 at logical offset 0 with max blocks 32 with error 28 EXT4-fs (loop0): This should not happen!! Data will be lostEXT4-fs (loop0): Total free blocks count 0
EXT4-fs (loop0): Free/Dirty block details
EXT4-fs (loop0): free_blocks=0
EXT4-fs (loop0): dirty_blocks=32
EXT4-fs (loop0): Block reservation details
EXT4-fs (loop0): i_reserved_data_blocks=2
EXT4-fs (loop0): Inode 18 (00000000845cd634):i_reserved_data_blocks(1) not cleared!Above issue happens as follows:
Assume:sbi->s_cluster_ratio= 16
Step1: Insert delay block [0, 31] -> ei->i_reserved_data_blocks=2 Step2:ext4_writepages
mpage_map_and_submit_extent-> return failedmpage_release_unused_pages-> to release [0, 30]ext4_es_remove_extent -> remove lblk=0 end=30 __es_remove_extent -> len1=0 len2=31-30=1 __es_remove_extent: ... if (len2 > 0) { ... if (len1 > 0) { ... } else { es->es_lblk = end + 1; es->es_len = len2; ... } if (count_reserved) count_rsvd(inode, lblk, orig_es.es_len - len1 - len2, &orig_es, &rc); goto out; -> will return but didn't calculate 'reserved'...
Step3:ext4_destroy_inode-> trigger "i_reserved_data_blocks(1) not cleared!"To solve above issue if 'len2>0' call '
get_rsvd()' before goto out.Reported-by [email protected]Fixes 8fcc3a580651 ("ext4: rework reserved cluster accounting when invalidating pages")Signed-off-by Ye Bin <[email protected]>--- fs/ext4/extents_status.c | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-)fs/ext4/extents_status.c +1
-1@@ -1371,7 +1371,7 @@ static int __es_remove_extent(struct inode *inode, ext4_lblk_t lblk,if (count_reserved)count_rsvd (inode, lblk, orig_es.es_len - len1 - len2, &orig_es, &rc); - goto out; + goto out_get_reserved; }if (len1 >0 ) {fs/ext4/extents_status.c static int __es_remove_extent(struct inode *inode, ext4_lblk_t lblk, · line 1419
Quoted 7 lines
fs/ext4/extents_status.c +1
-0@@ -1413,6 +1413,7 @@ static int __es_remove_extent(struct inode *inode, ext4_lblk_t lblk, } } +out_get_reserved:if (count_reserved) *reserved =get_rsvd (inode, end, es, &rc); out:The length of some lines in the commit description - probably those which are log output - is resulting in a checkpatch warning. It generally prefers lines to be a maximum of 75 characters (and Ted usually likes them limited to 72 characters. See my comment to patch #3. I'm not sure what Ted would want here, though I'd probably break them at 72 characters or less.
Quoted 7 lines
Quoted 2 lines
Otherwise, the patch looks good. Feel free to add:
Looks good. As before, feel free to add:
Quoted 1 line
Reviewed-by Eric Whitney <[email protected]>
Whoops. Please disregard - wrong patch.
Eric
PATCH v3 2/3 ext4: record error when detect abnormal 'i_reserved_data_blocks'
In reply to Ye BinFrom: Ye Bin <[email protected]>
If 'i_reserved_data_blocks' is not cleared which mean something wrong with code, free space accounting is likely wrong, according to Jan Kara's advice use ext4_error() to record this abnormal let fsck to repair and also we can capture this issue.
--- fs/ext4/super.c | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-)
fs/ext4/super.c +4 -4
@@ -1387,10 +1387,10 @@ static void ext4_destroy_inode(struct inode *inode) }if (EXT4_I (inode)->i_reserved_data_blocks) -ext4_msg (inode->i_sb,KERN_ERR , -"Inode %lu (%p): i_reserved_data_blocks (%u) not cleared!" , - inode->i_ino,EXT4_I (inode), -EXT4_I (inode)->i_reserved_data_blocks); +ext4_error (inode->i_sb, +"Inode %lu (%p): i_reserved_data_blocks (%u) not cleared!" , + inode->i_ino,EXT4_I (inode), +EXT4_I (inode)->i_reserved_data_blocks); }static void init_once (void *foo)
Signature · 1 line
2.31.1
Re: [PATCH v3 2/3] ext4: record error when detect abnormal 'i_reserved_data_blocks'
* Ye Bin <[email protected]>:
Quoted 18 lines
From: Ye Bin <[email protected]>
If '
i_reserved_data_blocks' is not cleared which mean something wrong with code, free space accounting is likely wrong, according to Jan Kara's advice useext4_error()to record this abnormal let fsck to repair and also we can capture this issue.Signed-off-by Ye Bin <[email protected]>--- fs/ext4/super.c | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-)fs/ext4/super.c +0
-0@@ -1387,10 +1387,10 @@ static void ext4_destroy_inode(struct inode *inode) }
fs/ext4/super.c static void ext4_destroy_inode(struct inode *inode) · line 1393
Quoted 10 lines
fs/ext4/super.c +4
-4if (EXT4_I (inode)->i_reserved_data_blocks) -ext4_msg (inode->i_sb,KERN_ERR , -"Inode %lu (%p): i_reserved_data_blocks (%u) not cleared!" , - inode->i_ino,EXT4_I (inode), -EXT4_I (inode)->i_reserved_data_blocks); +ext4_error (inode->i_sb, +"Inode %lu (%p): i_reserved_data_blocks (%u) not cleared!" , + inode->i_ino,EXT4_I (inode), +EXT4_I (inode)->i_reserved_data_blocks);
It would be better if the arguments to ext4_error after the first were aligned under "inode->i_sb", as you had in your first version. That's typical ext4 practice as seen earlier in this function, though this does pass checkpatch. Otherwise, looks good.
That said, feel free to add:
Quoted 6 lines
fs/ext4/super.c +0
-0}static void init_once (void *foo)Signature · 1 line
2.31.1
PATCH v3 3/3 ext4: add check pending tree when evict inode
In reply to Ye BinFrom: Ye Bin <[email protected]>
Syzbot found the following issue:
BUG: memory leak
unreferenced object 0xffff8881bde17420 (size 32):
comm "rep", pid 2327, jiffies 4295381963 (age 32.265s)
hex dump (first 32 bytes):
01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
backtrace:
[<00000000ac6d38f8>] __insert_pending+0x13c/0x2d0
[<00000000d717de3b>] ext4_es_insert_delayed_block+0x399/0x4e0
[<000000004be03913>] ext4_da_map_blocks.constprop.0+0x739/0xfa0
[<00000000885a832a>] ext4_da_get_block_prep+0x10c/0x440
[<0000000029b7f8ef>] __block_write_begin_int+0x28d/0x860
[<00000000e182ebc3>] ext4_da_write_inline_data_begin+0x2d1/0xf30
[<00000000ced0c8a2>] ext4_da_write_begin+0x612/0x860
[<000000008d5f27fa>] generic_perform_write+0x215/0x4d0
[<00000000552c1cde>] ext4_buffered_write_iter+0x101/0x3b0
[<0000000052177ae8>] do_iter_readv_writev+0x19f/0x340
[<000000004b9de834>] do_iter_write+0x13b/0x650
[<00000000e2401b9b>] iter_file_splice_write+0x5a5/0xab0
[<0000000023aa5d90>] direct_splice_actor+0x103/0x1e0
[<0000000089e00fc1>] splice_direct_to_actor+0x2c9/0x7b0
[<000000004386851e>] do_splice_direct+0x159/0x280
[<00000000b567e609>] do_sendfile+0x932/0x1200Above issue fixed by 1b8f787ef547 "ext4: fix warning in 'ext4_da_release_space'" in this scene. To make things better add check pending tree when evit inode. According to Eric Whitney's suggestion, bigalloc + inline is still in development so we just add test for this situation, there isn't need to add code to free pending tree entry.
--- fs/ext4/super.c | 5 +++++ 1 file changed, 5 insertions(+)
fs/ext4/super.c +5 -0
@@ -1391,6 +1391,11 @@ static void ext4_destroy_inode(struct inode *inode)"Inode %lu (%p): i_reserved_data_blocks (%u) not cleared!" , inode->i_ino,EXT4_I (inode), EXT4_I(inode)->i_reserved_data_blocks); + +if (!RB_EMPTY_ROOT (&EXT4_I (inode)->i_pending_tree.root)) +ext4_error (inode->i_sb, +"Inode %lu (%p): i_pending_tree not empty!" , + inode->i_ino,EXT4_I (inode)); }static void init_once (void *foo)
Signature · 1 line
2.31.1
Re: [PATCH v3 3/3] ext4: add check pending tree when evict inode
`* Ye Bin <[email protected]>:
Quoted 44 lines
From: Ye Bin <[email protected]>
Syzbot found the following issue:
BUG: memory leak unreferenced object 0xffff8881bde17420 (size 32): comm "rep", pid 2327, jiffies 4295381963 (age 32.265s) hex dump (first 32 bytes): 01 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................ backtrace: [<00000000ac6d38f8>] __insert_pending+0x13c/0x2d0 [<00000000d717de3b>] ext4_es_insert_delayed_block+0x399/0x4e0 [<000000004be03913>] ext4_da_map_blocks.constprop.0+0x739/0xfa0 [<00000000885a832a>] ext4_da_get_block_prep+0x10c/0x440 [<0000000029b7f8ef>] __block_write_begin_int+0x28d/0x860 [<00000000e182ebc3>] ext4_da_write_inline_data_begin+0x2d1/0xf30 [<00000000ced0c8a2>] ext4_da_write_begin+0x612/0x860 [<000000008d5f27fa>] generic_perform_write+0x215/0x4d0 [<00000000552c1cde>] ext4_buffered_write_iter+0x101/0x3b0 [<0000000052177ae8>] do_iter_readv_writev+0x19f/0x340 [<000000004b9de834>] do_iter_write+0x13b/0x650 [<00000000e2401b9b>] iter_file_splice_write+0x5a5/0xab0 [<0000000023aa5d90>] direct_splice_actor+0x103/0x1e0 [<0000000089e00fc1>] splice_direct_to_actor+0x2c9/0x7b0 [<000000004386851e>] do_splice_direct+0x159/0x280 [<00000000b567e609>] do_sendfile+0x932/0x1200Above issue fixed by
1b8f787ef547"ext4: fix warning in 'ext4_da_release_space'" in this scene. To make things better add check pending tree when evit inode. According to Eric Whitney's suggestion, bigalloc + inline is still in development so we just add test for this situation, there isn't need to add code to free pending tree entry.Reported-by [email protected]Signed-off-by Ye Bin <[email protected]>--- fs/ext4/super.c | 5 +++++ 1 file changed, 5 insertions(+)fs/ext4/super.c +0
-0
fs/ext4/super.c static void ext4_destroy_inode(struct inode *inode) · line 1400
Quoted 10 lines
fs/ext4/super.c +5
-0@@ -1391,6 +1391,11 @@ static void ext4_destroy_inode(struct inode *inode)"Inode %lu (%p): i_reserved_data_blocks (%u) not cleared!" , inode->i_ino,EXT4_I (inode), EXT4_I(inode)->i_reserved_data_blocks); + +if (!RB_EMPTY_ROOT (&EXT4_I (inode)->i_pending_tree.root)) +ext4_error (inode->i_sb, +"Inode %lu (%p): i_pending_tree not empty!" , + inode->i_ino,EXT4_I (inode)); }
It's always a good idea to run ./scripts/checkpatch.pl on your patches before submitting them. It's complaining that the lines in your commit description are too long (it wants a maximum of 75 characters per line, but Ted prefers a maximum of 72 for ext4 patches, IIRC). Also, it wants parentheses around the title of the patch mentioned in the commit message:
ie: commit 1b8f787ef547 ("ext4: fix warning in 'ext4_da_release_space'")
Also, typical ext4 practice is to align arguments to a function on following lines to the beginning of the first argument, as can be seen earlier in ext4_destroy_inode. Indenting as you've done here passes checkpatch, but it's different from most ext4 code (which also passes checkpatch).
Otherwise, it looks okay.
Eric
Quoted 4 lines
fs/ext4/super.c +0
-0static void init_once (void *foo)Signature · 1 line
2.31.1