btrfs: defrag: properly update range->start for autodefrag
PATCH 1/1 btrfs: defrag: properly update range->start for autodefrag
[BUG]
After commit 7b508037d4ca ("btrfs: defrag: use defrag_one_cluster() to implement btrfs_defrag_file()") autodefrag no longer properly re-defrag the file from previously finished location.
[CAUSE]
The recent refactor on defrag only focuses on defrag ioctl subpage support, doesn't take auto defrag into consideration.
There are two problems involved which prevents autodefrag to restart its scan:
- No range.start update
Previously when one defrag target is found, range->start will be updated to indicate where next search should start from.
But now btrfs_defrag_file() doesn't update it anymore, making all autodefrag to rescan from file offset 0.
This would also make autodefrag to mark the same range dirty again and again, causing extra IO.
- No proper quick exit for defrag_one_cluster()
Currently if we reached or exceed @max_sectors limit, we just exit defrag_one_cluster(), and let next defrag_one_cluster() call to do a quick exit.
This makes @cur increase, thus no way to properly know which range is defragged and which range is skipped.
[FIX]
The fix involves two modifications:
- Update range->start to next cluster start
This is a little different from the old behavior. Previously range->start is updated to the next defrag target.
But in the end, the behavior should still be pretty much the same, as now we skip to next defrag target inside btrfs_defrag_file().
Thus if auto-defrag determines to re-scan, then we still do the skip, just at a different timing.
- Make defrag_one_cluster() to return >0 to indicate a quick exit So that btrfs_defrag_file() can also do a quick exit, without increasing @cur to the range end, and re-use @cur to update @range->start.
- Add comment for btrfs_defrag_file() to mention the range->start update Currently only autodefrag utilize this behavior, as defrag ioctl won't set @max_to_defrag parameter, thus unless interrupted it will always try to defrag the whole range.
--- fs/btrfs/ioctl.c | 18 ++++++++++++++++-- 1 file changed, 16 insertions(+), 2 deletions(-)
fs/btrfs/ioctl.c +16 -2
@@ -1443,8 +1443,10 @@ static int defrag_one_cluster(struct btrfs_inode *inode,u32 range_len = entry->len;/* Reached or beyond the limit */ -if (max_sectors && *sectors_defragged >= max_sectors) +if (max_sectors && *sectors_defragged >= max_sectors) { + ret =1 ;break ; + }if (max_sectors) range_len = min_t(u32, range_len,
@@ -1487,7 +1489,10 @@ static int defrag_one_cluster(struct btrfs_inode *inode,* will be defragged. * * Return <0 for error. -* Return >=0 for the number of sectors defragged. +* Return >=0 for the number of sectors defragged, and range->start will be updated +* to indicate the file offset where next defrag should be started at. +* (Mostly for autodefrag, which sets @max_to_defrag thus we may exit early without +* defragging all the range). */ int btrfs_defrag_file(struct inode *inode, struct file_ra_state *ra, struct btrfs_ioctl_defrag_range_args *range,
@@ -1575,10 +1580,19 @@ int btrfs_defrag_file(struct inode *inode, struct file_ra_state *ra,if (ret <0 )break ; cur = cluster_end +1 ; +if (ret >0 ) { + ret =0 ; +break ; + } }if (ra_allocated)kfree (ra); +/* +* Update range.start for autodefrag, this will indicate where to start +* in next run. +*/ + range->start = cur;if (sectors_defragged) {/* * We have defragged some sectors, for compression case they
Signature · 1 line
2.34.1
Quoted 47 lines · Qu Wenruo
[BUG]
After commit7b508037d4ca("btrfs: defrag: usedefrag_one_cluster()to implementbtrfs_defrag_file()") autodefrag no longer properly re-defrag the file from previously finished location.[CAUSE]
The recent refactor on defrag only focuses on defrag ioctl subpage support, doesn't take auto defrag into consideration.There are two problems involved which prevents autodefrag to restart its scan:
- No range.start update
Previously when one defrag target is found,range->startwill be updated to indicate where next search should start from.But now
btrfs_defrag_file()doesn't update it anymore, making all autodefrag to rescan from file offset 0.This would also make autodefrag to mark the same range dirty again and again, causing extra IO.
- No proper quick exit for
defrag_one_cluster()
Currently if we reached or exceed @max_sectors limit, we just exitdefrag_one_cluster(), and let nextdefrag_one_cluster()call to do a quick exit.
This makes @cur increase, thus no way to properly know which range is defragged and which range is skipped.[FIX]
The fix involves two modifications:- Update
range->startto next cluster start
This is a little different from the old behavior. Previouslyrange->startis updated to the next defrag target.But in the end, the behavior should still be pretty much the same, as now we skip to next defrag target inside
btrfs_defrag_file().Thus if auto-defrag determines to re-scan, then we still do the skip, just at a different timing.
- Make
defrag_one_cluster()to return >0 to indicate a quick exit So thatbtrfs_defrag_file()can also do a quick exit, without increasing @cur to the range end, and re-use @cur to update @range->start.
Quoted 8 lines
- Add comment for
btrfs_defrag_file()to mention therange->startupdate Currently only autodefrag utilize this behavior, as defrag ioctl won't set @max_to_defrag parameter, thus unless interrupted it will always try to defrag the whole range.Reported-by Filipe Manana <[email protected]>Fixes 7b508037d4ca ("btrfs: defrag: use defrag_one_cluster() to implement btrfs_defrag_file()")Signed-off-by Qu Wenruo <[email protected]>
Looks good, thanks.
As mentioned in the other patch, please add a Link tag to the user's report:
Quoted 55 lines
--- fs/btrfs/ioctl.c | 18 ++++++++++++++++-- 1 file changed, 16 insertions(+), 2 deletions(-)fs/btrfs/ioctl.c +16
-2@@ -1443,8 +1443,10 @@ static int defrag_one_cluster(struct btrfs_inode *inode,u32 range_len = entry->len;/* Reached or beyond the limit */ -if (max_sectors && *sectors_defragged >= max_sectors) +if (max_sectors && *sectors_defragged >= max_sectors) { + ret =1 ;break ; + }if (max_sectors) range_len = min_t(u32, range_len,@@ -1487,7 +1489,10 @@ static int defrag_one_cluster(struct btrfs_inode *inode,* will be defragged. * * Return <0 for error. -* Return >=0 for the number of sectors defragged. +* Return >=0 for the number of sectors defragged, and range->start will be updated +* to indicate the file offset where next defrag should be started at. +* (Mostly for autodefrag, which sets @max_to_defrag thus we may exit early without +* defragging all the range). */ int btrfs_defrag_file(struct inode *inode, struct file_ra_state *ra, struct btrfs_ioctl_defrag_range_args *range,@@ -1575,10 +1580,19 @@ int btrfs_defrag_file(struct inode *inode, struct file_ra_state *ra,if (ret <0 )break ; cur = cluster_end +1 ; +if (ret >0 ) { + ret =0 ; +break ; + } }if (ra_allocated)kfree (ra); +/* +* Update range.start for autodefrag, this will indicate where to start +* in next run. +*/ + range->start = cur;if (sectors_defragged) {/* * We have defragged some sectors, for compression case they Signature · 1 line
2.34.1
Quoted 47 lines · Qu Wenruo
[BUG]
After commit7b508037d4ca("btrfs: defrag: usedefrag_one_cluster()to implementbtrfs_defrag_file()") autodefrag no longer properly re-defrag the file from previously finished location.[CAUSE]
The recent refactor on defrag only focuses on defrag ioctl subpage support, doesn't take auto defrag into consideration.There are two problems involved which prevents autodefrag to restart its scan:
- No range.start update
Previously when one defrag target is found,range->startwill be updated to indicate where next search should start from.But now
btrfs_defrag_file()doesn't update it anymore, making all autodefrag to rescan from file offset 0.This would also make autodefrag to mark the same range dirty again and again, causing extra IO.
- No proper quick exit for
defrag_one_cluster()
Currently if we reached or exceed @max_sectors limit, we just exitdefrag_one_cluster(), and let nextdefrag_one_cluster()call to do a quick exit.
This makes @cur increase, thus no way to properly know which range is defragged and which range is skipped.[FIX]
The fix involves two modifications:- Update
range->startto next cluster start
This is a little different from the old behavior. Previouslyrange->startis updated to the next defrag target.But in the end, the behavior should still be pretty much the same, as now we skip to next defrag target inside
btrfs_defrag_file().Thus if auto-defrag determines to re-scan, then we still do the skip, just at a different timing.
- Make
defrag_one_cluster()to return >0 to indicate a quick exit So thatbtrfs_defrag_file()can also do a quick exit, without increasing @cur to the range end, and re-use @cur to update @range->start.
Quoted 8 lines
- Add comment for
btrfs_defrag_file()to mention therange->startupdate Currently only autodefrag utilize this behavior, as defrag ioctl won't set @max_to_defrag parameter, thus unless interrupted it will always try to defrag the whole range.Reported-by Filipe Manana <[email protected]>Fixes 7b508037d4ca ("btrfs: defrag: use defrag_one_cluster() to implement btrfs_defrag_file()")Signed-off-by Qu Wenruo <[email protected]>
Added to misc-next, thanks.