My current patch queue
Subsystems (2)
v2 cover My current patch queue
v1->v2:
- addressed all of the issues brought up.
- added more comments.
- split up some patches.
original message:
This is the current queue of things that I've been working on. The main thing these patches are doing is separating out the delayed refs reservations from the global reserve into their own block rsv. We have been consistently hitting issues in production where we abort a transaction because we run out of the global reserve either while running delayed refs or while updating dirty block groups. This is because the math around global reserves is made up bullshit magic that has been tweaked more and more throughout the years. The result is something that is inconsistent across the board and sometimes wrong. So instead we need a way to know exactly how much space we need to keep around in order to satisfy our outstanding delayed refs and our dirty block groups.
Since we don't know how many delayed refs we need at the start of any modification we simply use the nr_items passed into btrfs_start_transaction() as a guess for what we may need. This has the side effect of putting more pressure on the ENOSPC system, but it's pressure we can deal with more intelligently because we always know how much space we have outstanding, instead of guessing with weird global reserve math.
This works similar to every other reservation we have, we reserve the worst case up front, and then at transaction end time we free up any space we didn't actually use for delayed refs.
My performance tests show that we are bit faster now since we can do more intelligent flushing and don't have to fall back on simply committing the transaction in hopes that we have enough space for everything we need to do.
That leads me to the 2nd part of this pull, there's a bunch of fixes around ENOSPC. Because we are a bit faster now there were a bunch of things uncovered in testing, but they seem to be all resolved now.
The final chunk of fixes are around transaction aborts. There were a lot of accounting bugs I was running into while running generic/435, so I fixed a bunch of those up so now it runs cleanly.
I have been running these patches through xfstests on multiple machines for a while, they are pretty solid and ready for wider testing and review. Thanks,
Josef
PATCH 1/36 btrfs: add btrfs_delete_ref_head helper
From: Josef Bacik <[email protected]>
We do this dance in cleanup_ref_head and check_ref_cleanup, unify it into a helper and cleanup the calling functions.
--- fs/btrfs/delayed-ref.c | 14 ++++++++++++++ fs/btrfs/delayed-ref.h | 3 ++- fs/btrfs/extent-tree.c | 22 +++------------------- 3 files changed, 19 insertions(+), 20 deletions(-)
fs/btrfs/delayed-ref.c +14 -0
@@ -393,6 +393,20 @@ btrfs_select_ref_head(struct btrfs_trans_handle *trans)return head; } +void btrfs_delete_ref_head (struct btrfs_delayed_ref_root *delayed_refs, +struct btrfs_delayed_ref_head *head) +{ +lockdep_assert_held (&delayed_refs->lock); +lockdep_assert_held (&head->lock); + +rb_erase (&head->href_node, &delayed_refs->href_root); +RB_CLEAR_NODE (&head->href_node); +atomic_dec (&delayed_refs->num_entries); + delayed_refs->num_heads--; +if (head->processing ==0 ) + delayed_refs->num_heads_ready--; +} +/* * Helper to insert the ref_node to the tail or merge with tail. *
fs/btrfs/delayed-ref.h +2 -1
@@ -261,7 +261,8 @@ static inline void btrfs_delayed_ref_unlock(struct btrfs_delayed_ref_head *head) {mutex_unlock (&head->mutex); } - +void btrfs_delete_ref_head (struct btrfs_delayed_ref_root *delayed_refs, +struct btrfs_delayed_ref_head *head);struct btrfs_delayed_ref_head *btrfs_select_ref_head (struct btrfs_trans_handle *trans);
fs/btrfs/extent-tree.c +3 -19
@@ -2492,12 +2492,9 @@ static int cleanup_ref_head(struct btrfs_trans_handle *trans,spin_unlock (&delayed_refs->lock);return 1 ; } - delayed_refs->num_heads--; -rb_erase (&head->href_node, &delayed_refs->href_root); -RB_CLEAR_NODE (&head->href_node); +btrfs_delete_ref_head (delayed_refs, head);spin_unlock (&head->lock);spin_unlock (&delayed_refs->lock); -atomic_dec (&delayed_refs->num_entries);trace_run_delayed_ref_head (fs_info, head,0 );
@@ -6984,22 +6981,9 @@ static noinline int check_ref_cleanup(struct btrfs_trans_handle *trans,if (!mutex_trylock (&head->mutex)) goto out; -/* -* at this point we have a head with no other entries. Go -* ahead and process it. -*/ -rb_erase (&head->href_node, &delayed_refs->href_root); -RB_CLEAR_NODE (&head->href_node); -atomic_dec (&delayed_refs->num_entries); - -/* -* we don't take a ref on the node because we're removing it from the -* tree, so we just steal the ref the tree was holding. -*/ - delayed_refs->num_heads--; -if (head->processing ==0 ) - delayed_refs->num_heads_ready--; +btrfs_delete_ref_head (delayed_refs, head); head->processing =0 ; +spin_unlock (&head->lock);spin_unlock (&delayed_refs->lock);
Signature · 1 line
2.14.3
Re: [PATCH 01/36] btrfs: add btrfs_delete_ref_head helper
Quoted 4 lines · Josef Bacik
From: Josef Bacik <[email protected]>
We do this dance in
cleanup_ref_headandcheck_ref_cleanup, unify it into a helper and cleanup the calling functions.
Quoted 92 lines
Signed-off-by Josef Bacik <[email protected]>--- fs/btrfs/delayed-ref.c | 14 ++++++++++++++ fs/btrfs/delayed-ref.h | 3 ++- fs/btrfs/extent-tree.c | 22 +++------------------- 3 files changed, 19 insertions(+), 20 deletions(-)fs/btrfs/delayed-ref.c +14
-0@@ -393,6 +393,20 @@ btrfs_select_ref_head(struct btrfs_trans_handle *trans)return head; } +void btrfs_delete_ref_head (struct btrfs_delayed_ref_root *delayed_refs, +struct btrfs_delayed_ref_head *head) +{ +lockdep_assert_held (&delayed_refs->lock); +lockdep_assert_held (&head->lock); + +rb_erase (&head->href_node, &delayed_refs->href_root); +RB_CLEAR_NODE (&head->href_node); +atomic_dec (&delayed_refs->num_entries); + delayed_refs->num_heads--; +if (head->processing ==0 ) + delayed_refs->num_heads_ready--; +} +/* * Helper to insert the ref_node to the tail or merge with tail. * fs/btrfs/delayed-ref.h +2
-1@@ -261,7 +261,8 @@ static inline void btrfs_delayed_ref_unlock(struct btrfs_delayed_ref_head *head) {mutex_unlock (&head->mutex); } - +void btrfs_delete_ref_head (struct btrfs_delayed_ref_root *delayed_refs, +struct btrfs_delayed_ref_head *head);struct btrfs_delayed_ref_head *btrfs_select_ref_head (struct btrfs_trans_handle *trans);fs/btrfs/extent-tree.c +3
-19@@ -2492,12 +2492,9 @@ static int cleanup_ref_head(struct btrfs_trans_handle *trans,spin_unlock (&delayed_refs->lock);return 1 ; } - delayed_refs->num_heads--; -rb_erase (&head->href_node, &delayed_refs->href_root); -RB_CLEAR_NODE (&head->href_node); +btrfs_delete_ref_head (delayed_refs, head);spin_unlock (&head->lock);spin_unlock (&delayed_refs->lock); -atomic_dec (&delayed_refs->num_entries);trace_run_delayed_ref_head (fs_info, head,0 );@@ -6984,22 +6981,9 @@ static noinline int check_ref_cleanup(struct btrfs_trans_handle *trans,if (!mutex_trylock (&head->mutex)) goto out; -/* -* at this point we have a head with no other entries. Go -* ahead and process it. -*/ -rb_erase (&head->href_node, &delayed_refs->href_root); -RB_CLEAR_NODE (&head->href_node); -atomic_dec (&delayed_refs->num_entries); - -/* -* we don't take a ref on the node because we're removing it from the -* tree, so we just steal the ref the tree was holding. -*/ - delayed_refs->num_heads--; -if (head->processing ==0 ) - delayed_refs->num_heads_ready--; +btrfs_delete_ref_head (delayed_refs, head); head->processing =0 ; +spin_unlock (&head->lock);spin_unlock (&delayed_refs->lock);Signature · 1 line
2.14.3
PATCH 2/36 btrfs: add cleanup_ref_head_accounting helper
In reply to Josef BacikFrom: Josef Bacik <[email protected]>
We were missing some quota cleanups in check_ref_cleanup, so break the ref head accounting cleanup into a helper and call that from both check_ref_cleanup and cleanup_ref_head. This will hopefully ensure that we don't screw up accounting in the future for other things that we add.
--- fs/btrfs/extent-tree.c | 67 +++++++++++++++++++++++++++++--------------------- 1 file changed, 39 insertions(+), 28 deletions(-)
fs/btrfs/extent-tree.c +39 -28
@@ -2461,6 +2461,41 @@ static int cleanup_extent_op(struct btrfs_trans_handle *trans,return ret ? ret :1 ; } +static void cleanup_ref_head_accounting (struct btrfs_trans_handle *trans, +struct btrfs_delayed_ref_head *head) +{ +struct btrfs_fs_info *fs_info = trans->fs_info; +struct btrfs_delayed_ref_root *delayed_refs = + &trans->transaction->delayed_refs; + +if (head->total_ref_mod <0 ) { +struct btrfs_space_info *space_info; +u64 flags; + +if (head->is_data) + flags =BTRFS_BLOCK_GROUP_DATA ; +else if (head->is_system) + flags =BTRFS_BLOCK_GROUP_SYSTEM ; +else + flags =BTRFS_BLOCK_GROUP_METADATA ; + space_info =__find_space_info (fs_info, flags); +ASSERT (space_info); +percpu_counter_add_batch (&space_info->total_bytes_pinned, + -head->num_bytes, +BTRFS_TOTAL_BYTES_PINNED_BATCH ); + +if (head->is_data) { +spin_lock (&delayed_refs->lock); + delayed_refs->pending_csums -= head->num_bytes; +spin_unlock (&delayed_refs->lock); + } + } + +/* Also free its reserved qgroup space */ +btrfs_qgroup_free_delayed_ref (fs_info, head->qgroup_ref_root, + head->qgroup_reserved); +} +static int cleanup_ref_head (struct btrfs_trans_handle *trans,struct btrfs_delayed_ref_head *head) {
@@ -2496,31 +2531,6 @@ static int cleanup_ref_head(struct btrfs_trans_handle *trans,spin_unlock (&head->lock);spin_unlock (&delayed_refs->lock); -trace_run_delayed_ref_head (fs_info, head,0 ); - -if (head->total_ref_mod <0 ) { -struct btrfs_space_info *space_info; -u64 flags; - -if (head->is_data) - flags =BTRFS_BLOCK_GROUP_DATA ; -else if (head->is_system) - flags =BTRFS_BLOCK_GROUP_SYSTEM ; -else - flags =BTRFS_BLOCK_GROUP_METADATA ; - space_info =__find_space_info (fs_info, flags); -ASSERT (space_info); -percpu_counter_add_batch (&space_info->total_bytes_pinned, - -head->num_bytes, -BTRFS_TOTAL_BYTES_PINNED_BATCH ); - -if (head->is_data) { -spin_lock (&delayed_refs->lock); - delayed_refs->pending_csums -= head->num_bytes; -spin_unlock (&delayed_refs->lock); - } - } -if (head->must_insert_reserved) {btrfs_pin_extent (fs_info, head->bytenr, head->num_bytes,1 );
@@ -2530,9 +2540,9 @@ static int cleanup_ref_head(struct btrfs_trans_handle *trans, } } -/* Also free its reserved qgroup space */ -btrfs_qgroup_free_delayed_ref (fs_info, head->qgroup_ref_root, - head->qgroup_reserved); +cleanup_ref_head_accounting (trans, head); + +trace_run_delayed_ref_head (fs_info, head,0 );btrfs_delayed_ref_unlock (head);btrfs_put_delayed_ref_head (head);return 0 ;
@@ -6991,6 +7001,7 @@ static noinline int check_ref_cleanup(struct btrfs_trans_handle *trans,if (head->must_insert_reserved) ret =1 ; +cleanup_ref_head_accounting (trans, head);mutex_unlock (&head->mutex);btrfs_put_delayed_ref_head (head);return ret;
Signature · 1 line
2.14.3
PATCH 3/36 btrfs: cleanup extent_op handling
In reply to Josef BacikFrom: Josef Bacik <[email protected]>
The cleanup_extent_op function actually would run the extent_op if it needed running, which made the name sort of a misnomer. Change it to run_and_cleanup_extent_op, and move the actual cleanup work to cleanup_extent_op so it can be used by check_ref_cleanup() in order to unify the extent op handling.
--- fs/btrfs/extent-tree.c | 36 +++++++++++++++++++++++------------- 1 file changed, 23 insertions(+), 13 deletions(-)
fs/btrfs/extent-tree.c +23 -13
@@ -2442,19 +2442,33 @@ static void unselect_delayed_ref_head(struct btrfs_delayed_ref_root *delayed_refbtrfs_delayed_ref_unlock (head); } -static int cleanup_extent_op (struct btrfs_trans_handle *trans, -struct btrfs_delayed_ref_head *head) +static struct btrfs_delayed_extent_op * +cleanup_extent_op (struct btrfs_trans_handle *trans, +struct btrfs_delayed_ref_head *head) {struct btrfs_delayed_extent_op *extent_op = head->extent_op; -int ret;if (!extent_op) -return 0 ; - head->extent_op =NULL ; +return NULL ; +if (head->must_insert_reserved) { + head->extent_op =NULL ;btrfs_free_delayed_extent_op (extent_op); -return 0 ; +return NULL ; } +return extent_op; +} + +static int run_and_cleanup_extent_op (struct btrfs_trans_handle *trans, +struct btrfs_delayed_ref_head *head) +{ +struct btrfs_delayed_extent_op *extent_op = +cleanup_extent_op (trans, head); +int ret; + +if (!extent_op) +return 0 ; + head->extent_op =NULL ;spin_unlock (&head->lock); ret =run_delayed_extent_op (trans, head, extent_op);btrfs_free_delayed_extent_op (extent_op);
@@ -2506,7 +2520,7 @@ static int cleanup_ref_head(struct btrfs_trans_handle *trans, delayed_refs = &trans->transaction->delayed_refs; - ret =cleanup_extent_op (trans, head); + ret =run_and_cleanup_extent_op (trans, head);if (ret <0 ) {unselect_delayed_ref_head (delayed_refs, head);btrfs_debug (fs_info,"run_delayed_extent_op returned %d" , ret);
@@ -6977,12 +6991,8 @@ static noinline int check_ref_cleanup(struct btrfs_trans_handle *trans,if (!RB_EMPTY_ROOT (&head->ref_tree)) goto out; -if (head->extent_op) { -if (!head->must_insert_reserved) - goto out; -btrfs_free_delayed_extent_op (head->extent_op); - head->extent_op =NULL ; - } +if (cleanup_extent_op (trans, head) !=NULL ) + goto out;/* * waiting for the lock here would deadlock. If someone else has it
Signature · 1 line
2.14.3
Re: [PATCH 03/36] btrfs: cleanup extent_op handling
Quoted 31 lines · Josef Bacik
From: Josef Bacik <[email protected]>
The
cleanup_extent_opfunction actually would run theextent_opif it needed running, which made the name sort of a misnomer. Change it torun_and_cleanup_extent_op, and move the actual cleanup work tocleanup_extent_opso it can be used bycheck_ref_cleanup()in order to unify the extent op handling.Signed-off-by Josef Bacik <[email protected]>--- fs/btrfs/extent-tree.c | 36 +++++++++++++++++++++++------------- 1 file changed, 23 insertions(+), 13 deletions(-)fs/btrfs/extent-tree.c +3
-3@@ -2442,19 +2442,33 @@ static void unselect_delayed_ref_head(struct btrfs_delayed_ref_root *delayed_refbtrfs_delayed_ref_unlock (head); } -static int cleanup_extent_op (struct btrfs_trans_handle *trans, -struct btrfs_delayed_ref_head *head) +static struct btrfs_delayed_extent_op * +cleanup_extent_op (struct btrfs_trans_handle *trans, +struct btrfs_delayed_ref_head *head) {struct btrfs_delayed_extent_op *extent_op = head->extent_op; -int ret;if (!extent_op)
fs/btrfs/extent-tree.c static void unselect_delayed_ref_head(struct btrfs_delayed_ref_root *delayed_ref · line 2458
Quoted 10 lines
fs/btrfs/extent-tree.c +4
-3-return 0 ; - head->extent_op =NULL ; +return NULL ; +if (head->must_insert_reserved) { + head->extent_op =NULL ;btrfs_free_delayed_extent_op (extent_op); -return 0 ; +return NULL ; }
Now we don't set head->extent_op = NULL in this case when we call it from check_ref_cleanup(), is that a problem?
Quoted 43 lines
fs/btrfs/extent-tree.c +16
-7+return extent_op; +} + +static int run_and_cleanup_extent_op (struct btrfs_trans_handle *trans, +struct btrfs_delayed_ref_head *head) +{ +struct btrfs_delayed_extent_op *extent_op = +cleanup_extent_op (trans, head); +int ret; + +if (!extent_op) +return 0 ; + head->extent_op =NULL ;spin_unlock (&head->lock); ret =run_delayed_extent_op (trans, head, extent_op);btrfs_free_delayed_extent_op (extent_op);@@ -2506,7 +2520,7 @@ static int cleanup_ref_head(struct btrfs_trans_handle *trans, delayed_refs = &trans->transaction->delayed_refs; - ret =cleanup_extent_op (trans, head); + ret =run_and_cleanup_extent_op (trans, head);if (ret <0 ) {unselect_delayed_ref_head (delayed_refs, head);btrfs_debug (fs_info,"run_delayed_extent_op returned %d" , ret);@@ -6977,12 +6991,8 @@ static noinline int check_ref_cleanup(struct btrfs_trans_handle *trans,if (!RB_EMPTY_ROOT (&head->ref_tree)) goto out; -if (head->extent_op) { -if (!head->must_insert_reserved) - goto out; -btrfs_free_delayed_extent_op (head->extent_op); - head->extent_op =NULL ; - } +if (cleanup_extent_op (trans, head) !=NULL ) + goto out;/* * waiting for the lock here would deadlock. If someone else has it Signature · 1 line
2.14.3
PATCH 4/36 btrfs: only track ref_heads in delayed_ref_updates
In reply to Josef BacikFrom: Josef Bacik <[email protected]>
We use this number to figure out how many delayed refs to run, but __btrfs_run_delayed_refs really only checks every time we need a new delayed ref head, so we always run at least one ref head completely no matter what the number of items on it. Fix the accounting to only be adjusted when we add/remove a ref head.
--- fs/btrfs/delayed-ref.c | 3 --- 1 file changed, 3 deletions(-)
fs/btrfs/delayed-ref.c +0 -3
@@ -234,8 +234,6 @@ static inline void drop_delayed_ref(struct btrfs_trans_handle *trans, ref->in_tree =0 ;btrfs_put_delayed_ref (ref);atomic_dec (&delayed_refs->num_entries); -if (trans->delayed_ref_updates) - trans->delayed_ref_updates--; } static bool merge_ref(struct btrfs_trans_handle *trans,
@@ -460,7 +458,6 @@ static int insert_delayed_ref(struct btrfs_trans_handle *trans,if (ref->action ==BTRFS_ADD_DELAYED_REF )list_add_tail (&ref->add_list, &href->ref_add_list);atomic_inc (&root->num_entries); - trans->delayed_ref_updates++;spin_unlock (&href->lock);return ret; }
Signature · 1 line
2.14.3
PATCH 5/36 btrfs: only count ref heads run in __btrfs_run_delayed_refs
In reply to Josef BacikWe pick the number of ref's to run based on the number of ref heads, and only make the decision to stop once we've processed entire ref heads, so only count the ref heads we've run and bail once we've hit the number of ref heads we wanted to process.
--- fs/btrfs/extent-tree.c | 5 +---- 1 file changed, 1 insertion(+), 4 deletions(-)
fs/btrfs/extent-tree.c +1 -4
@@ -2592,6 +2592,7 @@ static noinline int __btrfs_run_delayed_refs(struct btrfs_trans_handle *trans,spin_unlock (&delayed_refs->lock);break ; } + count++;/* grab the lock that says we are going to process * all the refs for this head */
@@ -2605,7 +2606,6 @@ static noinline int __btrfs_run_delayed_refs(struct btrfs_trans_handle *trans,*/ if (ret == -EAGAIN ) { locked_ref =NULL ; - count++;continue ; } }
@@ -2633,7 +2633,6 @@ static noinline int __btrfs_run_delayed_refs(struct btrfs_trans_handle *trans,unselect_delayed_ref_head (delayed_refs, locked_ref); locked_ref =NULL ;cond_resched (); - count++;continue ; }
@@ -2651,7 +2650,6 @@ static noinline int __btrfs_run_delayed_refs(struct btrfs_trans_handle *trans,return ret; } locked_ref =NULL ; - count++;continue ; }
@@ -2702,7 +2700,6 @@ static noinline int __btrfs_run_delayed_refs(struct btrfs_trans_handle *trans, }btrfs_put_delayed_ref (ref); - count++;cond_resched (); }
Signature · 1 line
2.14.3
Re: [PATCH 05/36] btrfs: only count ref heads run in __btrfs_run_delayed_refs
Quoted 4 lines · Josef Bacik
We pick the number of ref's to run based on the number of ref heads, and only make the decision to stop once we've processed entire ref heads, so only count the ref heads we've run and bail once we've hit the number of ref heads we wanted to process.
Despite Nikolay's comment, it seems wrong to me to split this patch up from the previous one. After the first one, you have this nonsensical middle ground where the counter is number of heads but this counter is number of refs.
Quoted 52 lines
Signed-off-by Josef Bacik <[email protected]>--- fs/btrfs/extent-tree.c | 5 +---- 1 file changed, 1 insertion(+), 4 deletions(-)fs/btrfs/extent-tree.c +1
-4@@ -2592,6 +2592,7 @@ static noinline int __btrfs_run_delayed_refs(struct btrfs_trans_handle *trans,spin_unlock (&delayed_refs->lock);break ; } + count++;/* grab the lock that says we are going to process * all the refs for this head */ @@ -2605,7 +2606,6 @@ static noinline int __btrfs_run_delayed_refs(struct btrfs_trans_handle *trans,*/ if (ret == -EAGAIN ) { locked_ref =NULL ; - count++;continue ; } }@@ -2633,7 +2633,6 @@ static noinline int __btrfs_run_delayed_refs(struct btrfs_trans_handle *trans,unselect_delayed_ref_head (delayed_refs, locked_ref); locked_ref =NULL ;cond_resched (); - count++;continue ; }@@ -2651,7 +2650,6 @@ static noinline int __btrfs_run_delayed_refs(struct btrfs_trans_handle *trans,return ret; } locked_ref =NULL ; - count++;continue ; }@@ -2702,7 +2700,6 @@ static noinline int __btrfs_run_delayed_refs(struct btrfs_trans_handle *trans, }btrfs_put_delayed_ref (ref); - count++;cond_resched (); }Signature · 1 line
2.14.3
Re: [PATCH 05/36] btrfs: only count ref heads run in __btrfs_run_delayed_refs
Quoted 10 lines · Omar Sandoval
Quoted 4 lines · Josef Bacik
We pick the number of ref's to run based on the number of ref heads, and only make the decision to stop once we've processed entire ref heads, so only count the ref heads we've run and bail once we've hit the number of ref heads we wanted to process.
Despite Nikolay's comment, it seems wrong to me to split this patch up from the previous one. After the first one, you have this nonsensical middle ground where the counter is number of heads but this counter is number of refs.
If the changes now split in two are really just one, then this needs to be explained in the changelog. Nikolay's comment can be read in two ways, split the unrelated change, or add the reason why.
https://patchwork.kernel.org/patch/10534671/
As v1 od the patch says "We use this number ..." and the patch changes two variables, I find it ambiguous. Though the last sentence looks like it refers to the 'count', it's not very clear and I got lost there too.
PATCH 6/36 btrfs: introduce delayed_refs_rsv
In reply to Josef BacikFrom: Josef Bacik <[email protected]>
Traditionally we've had voodoo in btrfs to account for the space that delayed refs may take up by having a global_block_rsv. This works most of the time, except when it doesn't. We've had issues reported and seen in production where sometimes the global reserve is exhausted during transaction commit before we can run all of our delayed refs, resulting in an aborted transaction. Because of this voodoo we have equally dubious flushing semantics around throttling delayed refs which we often get wrong.
So instead give them their own block_rsv. This way we can always know exactly how much outstanding space we need for delayed refs. This allows us to make sure we are constantly filling that reservation up with space, and allows us to put more precise pressure on the enospc system. Instead of doing math to see if its a good time to throttle, the normal enospc code will be invoked if we have a lot of delayed refs pending, and they will be run via the normal flushing mechanism.
For now the delayed_refs_rsv will hold the reservations for the delayed refs, the block group updates, and deleting csums. We could have a separate rsv for the block group updates, but the csum deletion stuff is still handled via the delayed_refs so that will stay there.
--- fs/btrfs/ctree.h | 27 +++-- fs/btrfs/delayed-ref.c | 28 ++++- fs/btrfs/disk-io.c | 3 + fs/btrfs/extent-tree.c | 276 +++++++++++++++++++++++++++++++++++-------- fs/btrfs/inode.c | 2 +- fs/btrfs/transaction.c | 77 ++++++------ include/trace/events/btrfs.h | 2 + 7 files changed, 308 insertions(+), 107 deletions(-)
fs/btrfs/ctree.h +19 -8
@@ -452,8 +452,9 @@ struct btrfs_space_info {#define BTRFS_BLOCK_RSV_TRANS 3#define BTRFS_BLOCK_RSV_CHUNK 4#define BTRFS_BLOCK_RSV_DELOPS 5 -#define BTRFS_BLOCK_RSV_EMPTY 6 -#define BTRFS_BLOCK_RSV_TEMP 7 +#define BTRFS_BLOCK_RSV_DELREFS 6 +#define BTRFS_BLOCK_RSV_EMPTY 7 +#define BTRFS_BLOCK_RSV_TEMP 8struct btrfs_block_rsv {u64 size;
@@ -794,6 +795,8 @@ struct btrfs_fs_info {struct btrfs_block_rsv chunk_block_rsv;/* block reservation for delayed operations */ struct btrfs_block_rsv delayed_block_rsv; +/* block reservation for delayed refs */ +struct btrfs_block_rsv delayed_refs_rsv;struct btrfs_block_rsv empty_block_rsv;
@@ -2608,8 +2611,7 @@ static inline u64 btrfs_calc_trunc_metadata_size(struct btrfs_fs_info *fs_info,int btrfs_should_throttle_delayed_refs (struct btrfs_trans_handle *trans,struct btrfs_fs_info *fs_info); -int btrfs_check_space_for_delayed_refs (struct btrfs_trans_handle *trans, -struct btrfs_fs_info *fs_info); +bool btrfs_check_space_for_delayed_refs (struct btrfs_fs_info *fs_info);void btrfs_dec_block_group_reservations (struct btrfs_fs_info *fs_info,const u64 start);void btrfs_wait_block_group_reservations (struct btrfs_block_group_cache *bg);
@@ -2723,10 +2725,12 @@ enum btrfs_reserve_flush_enum {enum btrfs_flush_state {FLUSH_DELAYED_ITEMS_NR =1 ,FLUSH_DELAYED_ITEMS =2 , -FLUSH_DELALLOC =3 , -FLUSH_DELALLOC_WAIT =4 , -ALLOC_CHUNK =5 , -COMMIT_TRANS =6 , +FLUSH_DELAYED_REFS_NR =3 , +FLUSH_DELAYED_REFS =4 , +FLUSH_DELALLOC =5 , +FLUSH_DELALLOC_WAIT =6 , +ALLOC_CHUNK =7 , +COMMIT_TRANS =8 , };int btrfs_alloc_data_chunk_ondemand (struct btrfs_inode *inode,u64 bytes);
@@ -2777,6 +2781,13 @@ int btrfs_cond_migrate_bytes(struct btrfs_fs_info *fs_info,void btrfs_block_rsv_release (struct btrfs_fs_info *fs_info,struct btrfs_block_rsv *block_rsv,u64 num_bytes); +void btrfs_delayed_refs_rsv_release (struct btrfs_fs_info *fs_info,int nr); +void btrfs_update_delayed_refs_rsv (struct btrfs_trans_handle *trans); +int btrfs_throttle_delayed_refs (struct btrfs_fs_info *fs_info, +enum btrfs_reserve_flush_enum flush); +void btrfs_migrate_to_delayed_refs_rsv (struct btrfs_fs_info *fs_info, +struct btrfs_block_rsv *src, +u64 num_bytes);int btrfs_inc_block_group_ro (struct btrfs_block_group_cache *cache);void btrfs_dec_block_group_ro (struct btrfs_block_group_cache *cache);void btrfs_put_block_group_cache (struct btrfs_fs_info *info);
fs/btrfs/delayed-ref.c +23 -5
@@ -467,11 +467,14 @@ static int insert_delayed_ref(struct btrfs_trans_handle *trans,* existing and update must have the same bytenr */ static noinline void -update_existing_head_ref (struct btrfs_delayed_ref_root *delayed_refs, +update_existing_head_ref (struct btrfs_trans_handle *trans,struct btrfs_delayed_ref_head *existing,struct btrfs_delayed_ref_head *update,int *old_ref_mod_ret) { +struct btrfs_delayed_ref_root *delayed_refs = + &trans->transaction->delayed_refs; +struct btrfs_fs_info *fs_info = trans->fs_info;int old_ref_mod;BUG_ON (existing->is_data != update->is_data);
@@ -529,10 +532,18 @@ update_existing_head_ref(struct btrfs_delayed_ref_root *delayed_refs,* versa we need to make sure to adjust pending_csums accordingly. */ if (existing->is_data) { -if (existing->total_ref_mod >=0 && old_ref_mod <0 ) +u64 csum_items = +btrfs_csum_bytes_to_leaves (fs_info, + existing->num_bytes); + +if (existing->total_ref_mod >=0 && old_ref_mod <0 ) { delayed_refs->pending_csums -= existing->num_bytes; -if (existing->total_ref_mod <0 && old_ref_mod >=0 ) +btrfs_delayed_refs_rsv_release (fs_info, csum_items); + } +if (existing->total_ref_mod <0 && old_ref_mod >=0 ) { delayed_refs->pending_csums += existing->num_bytes; + trans->delayed_ref_updates += csum_items; + } }spin_unlock (&existing->lock); }
@@ -638,7 +649,7 @@ add_delayed_ref_head(struct btrfs_trans_handle *trans, && head_ref->qgroup_reserved && existing->qgroup_ref_root && existing->qgroup_reserved); -update_existing_head_ref (delayed_refs, existing, head_ref, +update_existing_head_ref (trans, existing, head_ref, old_ref_mod);/* * we've updated the existing ref, free the newly
@@ -649,8 +660,12 @@ add_delayed_ref_head(struct btrfs_trans_handle *trans, }else {if (old_ref_mod) *old_ref_mod =0 ; -if (head_ref->is_data && head_ref->ref_mod <0 ) +if (head_ref->is_data && head_ref->ref_mod <0 ) { delayed_refs->pending_csums += head_ref->num_bytes; + trans->delayed_ref_updates += +btrfs_csum_bytes_to_leaves (trans->fs_info, + head_ref->num_bytes); + } delayed_refs->num_heads++; delayed_refs->num_heads_ready++;atomic_inc (&delayed_refs->num_entries);
@@ -785,6 +800,7 @@ int btrfs_add_delayed_tree_ref(struct btrfs_trans_handle *trans, ret =insert_delayed_ref (trans, delayed_refs, head_ref, &ref->node);spin_unlock (&delayed_refs->lock); +btrfs_update_delayed_refs_rsv (trans); trace_add_delayed_tree_ref(fs_info, &ref->node, ref, action == BTRFS_ADD_DELAYED_EXTENT ?
@@ -866,6 +882,7 @@ int btrfs_add_delayed_data_ref(struct btrfs_trans_handle *trans, ret =insert_delayed_ref (trans, delayed_refs, head_ref, &ref->node);spin_unlock (&delayed_refs->lock); +btrfs_update_delayed_refs_rsv (trans); trace_add_delayed_data_ref(trans->fs_info, &ref->node, ref, action == BTRFS_ADD_DELAYED_EXTENT ?
@@ -903,6 +920,7 @@ int btrfs_add_delayed_extent_op(struct btrfs_fs_info *fs_info, NULL, NULL, NULL);spin_unlock (&delayed_refs->lock); +btrfs_update_delayed_refs_rsv (trans);return 0 ; }
fs/btrfs/disk-io.c +3 -0
@@ -2692,6 +2692,9 @@ int open_ctree(struct super_block *sb,btrfs_init_block_rsv (&fs_info->empty_block_rsv,BTRFS_BLOCK_RSV_EMPTY );btrfs_init_block_rsv (&fs_info->delayed_block_rsv,BTRFS_BLOCK_RSV_DELOPS ); +btrfs_init_block_rsv (&fs_info->delayed_refs_rsv, +BTRFS_BLOCK_RSV_DELREFS ); +atomic_set (&fs_info->async_delalloc_pages,0 );atomic_set (&fs_info->defrag_running,0 );atomic_set (&fs_info->qgroup_op_seq,0 );
fs/btrfs/extent-tree.c +225 -51
452 lines not on this page · raw message
fs/btrfs/inode.c +1 -1
@@ -5382,7 +5382,7 @@ static struct btrfs_trans_handle *evict_refill_and_join(struct btrfs_root *root,* Try to steal from the global reserve if there is space for * it. */ -if (!btrfs_check_space_for_delayed_refs (trans, fs_info) && +if (!btrfs_check_space_for_delayed_refs (fs_info) && !btrfs_block_rsv_migrate (global_rsv, rsv, min_size,0 ))return trans;
fs/btrfs/transaction.c +35 -42
140 lines not on this page · raw message
include/trace/events/btrfs.h +2 -0
@@ -1048,6 +1048,8 @@ TRACE_EVENT(btrfs_trigger_flush, { FLUSH_DELAYED_ITEMS, "FLUSH_DELAYED_ITEMS"}, \ { FLUSH_DELALLOC, "FLUSH_DELALLOC"}, \ { FLUSH_DELALLOC_WAIT, "FLUSH_DELALLOC_WAIT"}, \ + { FLUSH_DELAYED_REFS_NR, "FLUSH_DELAYED_REFS_NR"}, \ + { FLUSH_DELAYED_REFS, "FLUSH_ELAYED_REFS"}, \ { ALLOC_CHUNK, "ALLOC_CHUNK"}, \ { COMMIT_TRANS, "COMMIT_TRANS"})
Signature · 1 line
2.14.3
PATCH 7/36 btrfs: check if free bgs for commit
In reply to Josef Bacikmay_commit_transaction will skip committing the transaction if we don't have enough pinned space or if we're trying to find space for a SYSTEM chunk. However if we have pending free block groups in this transaction we still want to commit as we may be able to allocate a chunk to make our reservation. So instead of just returning ENOSPC, check if we have free block groups pending, and if so commit the transaction to allow us to use that free space.
--- fs/btrfs/extent-tree.c | 33 +++++++++++++++++++-------------- 1 file changed, 19 insertions(+), 14 deletions(-)
fs/btrfs/extent-tree.c +19 -14
@@ -4830,10 +4830,18 @@ static int may_commit_transaction(struct btrfs_fs_info *fs_info,if (!bytes)return 0 ; -/* See if there is enough pinned space to make this reservation */ -if (__percpu_counter_compare (&space_info->total_bytes_pinned, - bytes, -BTRFS_TOTAL_BYTES_PINNED_BATCH ) >=0 ) + trans =btrfs_join_transaction (fs_info->extent_root); +if (IS_ERR (trans)) +return -ENOSPC ; + +/* +* See if there is enough pinned space to make this reservation, or if +* we have bg's that are going to be freed, allowing us to possibly do a +* chunk allocation the next loop through. +*/ +if (test_bit (BTRFS_TRANS_HAVE_FREE_BGS , &trans->transaction->flags) || +__percpu_counter_compare (&space_info->total_bytes_pinned, bytes, +BTRFS_TOTAL_BYTES_PINNED_BATCH ) >=0 ) goto commit;/*
@@ -4841,7 +4849,7 @@ static int may_commit_transaction(struct btrfs_fs_info *fs_info,* this reservation. */ if (space_info != delayed_rsv->space_info) -return -ENOSPC ; + goto enospc;spin_lock (&delayed_rsv->lock); reclaim_bytes += delayed_rsv->reserved;
@@ -4855,17 +4863,14 @@ static int may_commit_transaction(struct btrfs_fs_info *fs_info, bytes -= reclaim_bytes;if (__percpu_counter_compare (&space_info->total_bytes_pinned, - bytes, -BTRFS_TOTAL_BYTES_PINNED_BATCH ) <0 ) { -return -ENOSPC ; - } - + bytes, +BTRFS_TOTAL_BYTES_PINNED_BATCH ) <0 ) + goto enospc; commit: - trans =btrfs_join_transaction (fs_info->extent_root); -if (IS_ERR (trans)) -return -ENOSPC ; -return btrfs_commit_transaction (trans); +enospc: +btrfs_end_transaction (trans); +return -ENOSPC ; }/*
Signature · 1 line
2.14.3
Re: [PATCH 07/36] btrfs: check if free bgs for commit
Quoted 7 lines · Josef Bacik
may_commit_transactionwill skip committing the transaction if we don't have enough pinned space or if we're trying to find space for a SYSTEM chunk. However if we have pending free block groups in this transaction we still want to commit as we may be able to allocate a chunk to make our reservation. So instead of just returning ENOSPC, check if we have free block groups pending, and if so commit the transaction to allow us to use that free space.
Quoted 68 lines
Signed-off-by Josef Bacik <[email protected]>--- fs/btrfs/extent-tree.c | 33 +++++++++++++++++++-------------- 1 file changed, 19 insertions(+), 14 deletions(-)fs/btrfs/extent-tree.c +19
-14@@ -4830,10 +4830,18 @@ static int may_commit_transaction(struct btrfs_fs_info *fs_info,if (!bytes)return 0 ; -/* See if there is enough pinned space to make this reservation */ -if (__percpu_counter_compare (&space_info->total_bytes_pinned, - bytes, -BTRFS_TOTAL_BYTES_PINNED_BATCH ) >=0 ) + trans =btrfs_join_transaction (fs_info->extent_root); +if (IS_ERR (trans)) +return -ENOSPC ; + +/* +* See if there is enough pinned space to make this reservation, or if +* we have bg's that are going to be freed, allowing us to possibly do a +* chunk allocation the next loop through. +*/ +if (test_bit (BTRFS_TRANS_HAVE_FREE_BGS , &trans->transaction->flags) || +__percpu_counter_compare (&space_info->total_bytes_pinned, bytes, +BTRFS_TOTAL_BYTES_PINNED_BATCH ) >=0 ) goto commit;/* @@ -4841,7 +4849,7 @@ static int may_commit_transaction(struct btrfs_fs_info *fs_info,* this reservation. */ if (space_info != delayed_rsv->space_info) -return -ENOSPC ; + goto enospc;spin_lock (&delayed_rsv->lock); reclaim_bytes += delayed_rsv->reserved;@@ -4855,17 +4863,14 @@ static int may_commit_transaction(struct btrfs_fs_info *fs_info, bytes -= reclaim_bytes;if (__percpu_counter_compare (&space_info->total_bytes_pinned, - bytes, -BTRFS_TOTAL_BYTES_PINNED_BATCH ) <0 ) { -return -ENOSPC ; - } - + bytes, +BTRFS_TOTAL_BYTES_PINNED_BATCH ) <0 ) + goto enospc; commit: - trans =btrfs_join_transaction (fs_info->extent_root); -if (IS_ERR (trans)) -return -ENOSPC ; -return btrfs_commit_transaction (trans); +enospc: +btrfs_end_transaction (trans); +return -ENOSPC ; }/* Signature · 1 line
2.14.3
PATCH 8/36 btrfs: dump block_rsv whe dumping space info
In reply to Josef BacikFor enospc_debug having the block rsvs is super helpful to see if we've done something wrong.
--- fs/btrfs/extent-tree.c | 16 ++++++++++++++++ 1 file changed, 16 insertions(+)
fs/btrfs/extent-tree.c +16 -0
@@ -7918,6 +7918,16 @@ static noinline int find_free_extent(struct btrfs_fs_info *fs_info,return ret; } +static void dump_block_rsv (struct btrfs_fs_info *fs_info, +struct btrfs_block_rsv *rsv) +{ +spin_lock (&rsv->lock); +btrfs_info (fs_info,"%d: size %llu reserved %llu\n" , + rsv->type, (unsigned long long )rsv->size, + (unsigned long long )rsv->reserved); +spin_unlock (&rsv->lock); +} +static void dump_space_info (struct btrfs_fs_info *fs_info,struct btrfs_space_info *info,u64 bytes,int dump_block_groups)
@@ -7937,6 +7947,12 @@ static void dump_space_info(struct btrfs_fs_info *fs_info, info->bytes_readonly);spin_unlock (&info->lock); +dump_block_rsv (fs_info, &fs_info->global_block_rsv); +dump_block_rsv (fs_info, &fs_info->trans_block_rsv); +dump_block_rsv (fs_info, &fs_info->chunk_block_rsv); +dump_block_rsv (fs_info, &fs_info->delayed_block_rsv); +dump_block_rsv (fs_info, &fs_info->delayed_refs_rsv); +if (!dump_block_groups)return ;
Signature · 1 line
2.14.3
Re: [PATCH 08/36] btrfs: dump block_rsv whe dumping space info
Quoted 13 lines · Josef Bacik
For
enospc_debughaving the block rsvs is super helpful to see if we've done something wrong.Signed-off-by Josef Bacik <[email protected]>--- fs/btrfs/extent-tree.c | 16 ++++++++++++++++ 1 file changed, 16 insertions(+)fs/btrfs/extent-tree.c +0
-0
fs/btrfs/extent-tree.c static noinline int find_free_extent(struct btrfs_fs_info *fs_info, · line 7927
Quoted 10 lines
fs/btrfs/extent-tree.c +7
-0@@ -7918,6 +7918,16 @@ static noinline int find_free_extent(struct btrfs_fs_info *fs_info,return ret; } +static void dump_block_rsv (struct btrfs_fs_info *fs_info, +struct btrfs_block_rsv *rsv) +{ +spin_lock (&rsv->lock); +btrfs_info (fs_info,"%d: size %llu reserved %llu\n" , + rsv->type, (unsigned long long )rsv->size, + (unsigned long long )rsv->reserved);
How about passing a string name for each of these instead of an ID which we have to cross-reference with the source?
Besides that,
Quoted 22 lines
fs/btrfs/extent-tree.c +9
-0+spin_unlock (&rsv->lock); +} +static void dump_space_info (struct btrfs_fs_info *fs_info,struct btrfs_space_info *info,u64 bytes,int dump_block_groups)@@ -7937,6 +7947,12 @@ static void dump_space_info(struct btrfs_fs_info *fs_info, info->bytes_readonly);spin_unlock (&info->lock); +dump_block_rsv (fs_info, &fs_info->global_block_rsv); +dump_block_rsv (fs_info, &fs_info->trans_block_rsv); +dump_block_rsv (fs_info, &fs_info->chunk_block_rsv); +dump_block_rsv (fs_info, &fs_info->delayed_block_rsv); +dump_block_rsv (fs_info, &fs_info->delayed_refs_rsv); +if (!dump_block_groups)return ;Signature · 1 line
2.14.3
Re: [PATCH 08/36] btrfs: dump block_rsv whe dumping space info
Quoted 17 lines · Omar Sandoval
Quoted 16 lines · Josef Bacik
For
enospc_debughaving the block rsvs is super helpful to see if we've done something wrong.Signed-off-by Josef Bacik <[email protected]>--- fs/btrfs/extent-tree.c | 16 ++++++++++++++++ 1 file changed, 16 insertions(+)fs/btrfs/extent-tree.c +0
-0@@ -7918,6 +7918,16 @@ static noinline int find_free_extent(struct btrfs_fs_info *fs_info,return ret; }
Quoted 5 lines
fs/btrfs/extent-tree.c static noinline int find_free_extent(struct btrfs_fs_info *fs_info, · line 7925
Quoted 5 lines
fs/btrfs/extent-tree.c +5
-0+static void dump_block_rsv (struct btrfs_fs_info *fs_info, +struct btrfs_block_rsv *rsv) +{ +spin_lock (&rsv->lock); + btrfs_info(fs_info, "%d: size %llu reserved %llu\n",
no "\n" for the message helpers
Quoted 2 lines
fs/btrfs/extent-tree.c static noinline int find_free_extent(struct btrfs_fs_info *fs_info, · line 7927
Quoted 2 lines
fs/btrfs/extent-tree.c +2
-0+ rsv->type, (unsigned long long )rsv->size, + (unsigned long long)rsv->reserved);
u64 does not need the (unsigned long long) typecast since long.
Quoted 2 lines
How about passing a string name for each of these instead of an ID which we have to cross-reference with the source?
Agreed, this would be better. As this is a debugging stuff, we can use macros to simplify it like:
#define DUMP_BLOCK_RSV(fs_info, rsv_name) \
do { \
struct btrfs_block_rsv *__rsv = &(fs_info)->rsv_name; \
spin_lock(&__rsv->lock); \
btrfs_info((fs_info), #rsv_name ": size ..."); \
spin_unlock(&__rsv->lock); \
} while(0)and use as
DUMP_BLOCK_RSV(fs_info, global_block_rsv);
The name of the block reserve name remains greppable.
PATCH 9/36 btrfs: release metadata before running delayed refs
In reply to Josef BacikWe want to release the unused reservation we have since it refills the delayed refs reserve, which will make everything go smoother when running the delayed refs if we're short on our reservation.
--- fs/btrfs/transaction.c | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-)
fs/btrfs/transaction.c +3 -3
@@ -1922,6 +1922,9 @@ int btrfs_commit_transaction(struct btrfs_trans_handle *trans)return ret; } +btrfs_trans_release_metadata (trans); + trans->block_rsv =NULL ; +/* make a pass through all the delayed refs we have so far * any runnings procs may add more while we are here */
@@ -1931,9 +1934,6 @@ int btrfs_commit_transaction(struct btrfs_trans_handle *trans)return ret; } -btrfs_trans_release_metadata (trans); - trans->block_rsv =NULL ; - cur_trans = trans->transaction;/*
Signature · 1 line
2.14.3
PATCH 10/36 btrfs: protect space cache inode alloc with nofs
In reply to Josef BacikIf we're allocating a new space cache inode it's likely going to be under a transaction handle, so we need to use memalloc_nofs_save() in order to avoid deadlocks, and more importantly lockdep messages that make xfstests fail.
--- fs/btrfs/free-space-cache.c | 8 ++++++++ 1 file changed, 8 insertions(+)
fs/btrfs/free-space-cache.c +8 -0
@@ -10,6 +10,7 @@#include <linux/math64.h> #include <linux/ratelimit.h> #include <linux/error-injection.h> +#include <linux/sched/mm.h> #include "ctree.h" #include "free-space-cache.h" #include "transaction.h"
@@ -47,6 +48,7 @@ static struct inode *__lookup_free_space_inode(struct btrfs_root *root,struct btrfs_free_space_header *header;struct extent_buffer *leaf;struct inode *inode =NULL ; +unsigned nofs_flag;int ret; key.objectid =BTRFS_FREE_SPACE_OBJECTID ;
@@ -68,7 +70,13 @@ static struct inode *__lookup_free_space_inode(struct btrfs_root *root,btrfs_disk_key_to_cpu (&location, &disk_key);btrfs_release_path (path); +/* +* We are often under a trans handle at this point, so we need to make +* sure NOFS is set to keep us from deadlocking. +*/ + nofs_flag =memalloc_nofs_save (); inode =btrfs_iget (fs_info->sb, &location, root,NULL ); +memalloc_nofs_restore (nofs_flag);if (IS_ERR (inode))return inode;
Signature · 1 line
2.14.3
PATCH 11/36 btrfs: fix truncate throttling
In reply to Josef BacikWe have a bunch of magic to make sure we're throttling delayed refs when truncating a file. Now that we have a delayed refs rsv and a mechanism for refilling that reserve simply use that instead of all of this magic.
--- fs/btrfs/inode.c | 78 ++++++++++++-------------------------------------------- 1 file changed, 16 insertions(+), 62 deletions(-)
fs/btrfs/inode.c +16 -62
@@ -4493,31 +4493,6 @@ static int btrfs_rmdir(struct inode *dir, struct dentry *dentry)return err; } -static int truncate_space_check (struct btrfs_trans_handle *trans, -struct btrfs_root *root, -u64 bytes_deleted) -{ -struct btrfs_fs_info *fs_info = root->fs_info; -int ret; - -/* -* This is only used to apply pressure to the enospc system, we don't -* intend to use this reservation at all. -*/ - bytes_deleted =btrfs_csum_bytes_to_leaves (fs_info, bytes_deleted); - bytes_deleted *= fs_info->nodesize; - ret =btrfs_block_rsv_add (root, &fs_info->trans_block_rsv, - bytes_deleted,BTRFS_RESERVE_NO_FLUSH ); -if (!ret) { -trace_btrfs_space_reservation (fs_info,"transaction" , - trans->transid, - bytes_deleted,1 ); - trans->bytes_reserved += bytes_deleted; - } -return ret; - -} -/* * Return this if we need to call truncate_block for the last bit of the * truncate.
@@ -4562,7 +4537,6 @@ int btrfs_truncate_inode_items(struct btrfs_trans_handle *trans,u64 bytes_deleted =0 ;bool be_nice = false;bool should_throttle = false; -bool should_end = false;BUG_ON (new_size >0 && min_type !=BTRFS_EXTENT_DATA_KEY );
@@ -4775,15 +4749,7 @@ int btrfs_truncate_inode_items(struct btrfs_trans_handle *trans,btrfs_abort_transaction (trans, ret);break ; } -if (btrfs_should_throttle_delayed_refs (trans, fs_info)) -btrfs_async_run_delayed_refs (fs_info, - trans->delayed_ref_updates *2 , - trans->transid,0 );if (be_nice) { -if (truncate_space_check (trans, root, - extent_num_bytes)) { - should_end = true; - }if (btrfs_should_throttle_delayed_refs (trans, fs_info)) should_throttle = true;
@@ -4795,7 +4761,7 @@ int btrfs_truncate_inode_items(struct btrfs_trans_handle *trans,if (path->slots[0 ] ==0 || path->slots[0 ] != pending_del_slot || - should_throttle || should_end) { + should_throttle) {if (pending_del_nr) { ret = btrfs_del_items(trans, root, path, pending_del_slot,
@@ -4807,23 +4773,23 @@ int btrfs_truncate_inode_items(struct btrfs_trans_handle *trans, pending_del_nr =0 ; }btrfs_release_path (path); -if (should_throttle) { -unsigned long updates = trans->delayed_ref_updates; -if (updates) { - trans->delayed_ref_updates =0 ; - ret =btrfs_run_delayed_refs (trans, - updates *2 ); -if (ret) -break ; - } - } +/* -* if we failed to refill our space rsv, bail out -* and let the transaction restart +* We can generate a lot of delayed refs, so we need to +* throttle every once and a while and make sure we're +* adding enough space to keep up with the work we are +* generating. Since we hold a transaction here we can +* only FLUSH_LIMIT, if this fails we just return EAGAIN +* and let the normal space allocation stuff do it's +* work. */ -if (should_end) { - ret = -EAGAIN ; -break ; +if (should_throttle) { + ret =btrfs_throttle_delayed_refs (fs_info, +BTRFS_RESERVE_FLUSH_LIMIT ); +if (ret) { + ret = -EAGAIN ; +break ; + } } goto search_again; }else {
@@ -4849,18 +4815,6 @@ int btrfs_truncate_inode_items(struct btrfs_trans_handle *trans, }btrfs_free_path (path); - -if (be_nice && bytes_deleted >SZ_32M && (ret >=0 || ret == -EAGAIN )) { -unsigned long updates = trans->delayed_ref_updates; -int err; - -if (updates) { - trans->delayed_ref_updates =0 ; - err =btrfs_run_delayed_refs (trans, updates *2 ); -if (err) - ret = err; - } - }return ret; }
Signature · 1 line
2.14.3
PATCH 12/36 btrfs: don't use global rsv for chunk allocation
In reply to Josef BacikWe've done this forever because of the voodoo around knowing how much space we have. However we have better ways of doing this now, and on normal file systems we'll easily have a global reserve of 512MiB, and since metadata chunks are usually 1GiB that means we'll allocate metadata chunks more readily. Instead use the actual used amount when determining if we need to allocate a chunk or not.
--- fs/btrfs/extent-tree.c | 9 --------- 1 file changed, 9 deletions(-)
fs/btrfs/extent-tree.c +0 -9
@@ -4374,21 +4374,12 @@ static inline u64 calc_global_rsv_need_space(struct btrfs_block_rsv *global)static int should_alloc_chunk (struct btrfs_fs_info *fs_info,struct btrfs_space_info *sinfo,int force) { -struct btrfs_block_rsv *global_rsv = &fs_info->global_block_rsv;u64 bytes_used =btrfs_space_info_used (sinfo, false);u64 thresh;if (force ==CHUNK_ALLOC_FORCE )return 1 ; -/* -* We need to take into account the global rsv because for all intents -* and purposes it's used space. Don't worry about locking the -* global_rsv, it doesn't change except when the transaction commits. -*/ -if (sinfo->flags &BTRFS_BLOCK_GROUP_METADATA ) - bytes_used +=calc_global_rsv_need_space (global_rsv); -/* * in limited mode, we want to have some free space up to * about 1% of the FS size.
Signature · 1 line
2.14.3
PATCH 13/36 btrfs: add ALLOC_CHUNK_FORCE to the flushing code
In reply to Josef BacikWith my change to no longer take into account the global reserve for metadata allocation chunks we have this side-effect for mixed block group fs'es where we are no longer allocating enough chunks for the data/metadata requirements. To deal with this add a ALLOC_CHUNK_FORCE step to the flushing state machine. This will only get used if we've already made a full loop through the flushing machinery and tried committing the transaction. If we have then we can try and force a chunk allocation since we likely need it to make progress. This resolves the issues I was seeing with the mixed bg tests in xfstests with my previous patch.
--- fs/btrfs/ctree.h | 3 ++- fs/btrfs/extent-tree.c | 18 +++++++++++++++++- include/trace/events/btrfs.h | 1 + 3 files changed, 20 insertions(+), 2 deletions(-)
fs/btrfs/ctree.h +2 -1
@@ -2730,7 +2730,8 @@ enum btrfs_flush_state {FLUSH_DELALLOC =5 ,FLUSH_DELALLOC_WAIT =6 ,ALLOC_CHUNK =7 , - COMMIT_TRANS = 8, +ALLOC_CHUNK_FORCE =8 , + COMMIT_TRANS = 9, };int btrfs_alloc_data_chunk_ondemand (struct btrfs_inode *inode,u64 bytes);
fs/btrfs/extent-tree.c +17 -1
@@ -4914,6 +4914,7 @@ static void flush_space(struct btrfs_fs_info *fs_info,btrfs_end_transaction (trans);break ;case ALLOC_CHUNK : +case ALLOC_CHUNK_FORCE : trans =btrfs_join_transaction (root);if (IS_ERR (trans)) { ret =PTR_ERR (trans);
@@ -4921,7 +4922,9 @@ static void flush_space(struct btrfs_fs_info *fs_info, } ret =do_chunk_alloc (trans,btrfs_metadata_alloc_profile (fs_info), -CHUNK_ALLOC_NO_FORCE ); + (state ==ALLOC_CHUNK ) ? +CHUNK_ALLOC_NO_FORCE : +CHUNK_ALLOC_FORCE );btrfs_end_transaction (trans);if (ret >0 || ret == -ENOSPC ) ret =0 ;
@@ -5057,6 +5060,19 @@ static void btrfs_async_reclaim_metadata_space(struct work_struct *work) commit_cycles--; } +/* +* We don't want to force a chunk allocation until we've tried +* pretty hard to reclaim space. Think of the case where we +* free'd up a bunch of space and so have a lot of pinned space +* to reclaim. We would rather use that than possibly create a +* underutilized metadata chunk. So if this is our first run +* through the flushing state machine skip ALLOC_CHUNK_FORCE and +* commit the transaction. If nothing has changed the next go +* around then we can force a chunk allocation. +*/ +if (flush_state ==ALLOC_CHUNK_FORCE && !commit_cycles) + flush_state++; +if (flush_state >COMMIT_TRANS ) { commit_cycles++;if (commit_cycles >2 ) {
include/trace/events/btrfs.h +1 -0
@@ -1051,6 +1051,7 @@ TRACE_EVENT(btrfs_trigger_flush, { FLUSH_DELAYED_REFS_NR, "FLUSH_DELAYED_REFS_NR"}, \ { FLUSH_DELAYED_REFS, "FLUSH_ELAYED_REFS"}, \ { ALLOC_CHUNK, "ALLOC_CHUNK"}, \ + { ALLOC_CHUNK_FORCE, "ALLOC_CHUNK_FORCE"}, \ { COMMIT_TRANS, "COMMIT_TRANS"}) TRACE_EVENT(btrfs_flush_space,
Signature · 1 line
2.14.3
PATCH 14/36 btrfs: reset max_extent_size properly
In reply to Josef BacikIf we use up our block group before allocating a new one we'll easily get a max_extent_size that's set really really low, which will result in a lot of fragmentation. We need to make sure we're resetting the max_extent_size when we add a new chunk or add new space.
--- fs/btrfs/extent-tree.c | 7 +++++++ 1 file changed, 7 insertions(+)
fs/btrfs/extent-tree.c +7 -0
@@ -4573,6 +4573,7 @@ static int do_chunk_alloc(struct btrfs_trans_handle *trans, u64 flags, goto out; }else { ret =1 ; + space_info->max_extent_size =0 ; } space_info->force_alloc =CHUNK_ALLOC_NO_FORCE ;
@@ -8084,11 +8085,17 @@ static int __btrfs_free_reserved_extent(struct btrfs_fs_info *fs_info,if (pin)pin_down_extent (fs_info, cache, start, len,1 );else { +struct btrfs_space_info *space_info = cache->space_info; +if (btrfs_test_opt (fs_info,DISCARD )) ret =btrfs_discard_extent (fs_info, start, len,NULL ,BTRFS_CLEAR_OP_DISCARD );btrfs_add_free_space (cache, start, len);btrfs_free_reserved_bytes (cache, len, delalloc); + +spin_lock (&space_info->lock); + space_info->max_extent_size =0 ; +spin_unlock (&space_info->lock);trace_btrfs_reserved_extent_free (fs_info, start, len); }
Signature · 1 line
2.14.3
Re: [PATCH 14/36] btrfs: reset max_extent_size properly
Quoted 29 lines · Josef Bacik
If we use up our block group before allocating a new one we'll easily get a
max_extent_sizethat's set really really low, which will result in a lot of fragmentation. We need to make sure we're resetting themax_extent_sizewhen we add a new chunk or add new space.Signed-off-by Josef Bacik <[email protected]>--- fs/btrfs/extent-tree.c | 7 +++++++ 1 file changed, 7 insertions(+)fs/btrfs/extent-tree.c +3
-0@@ -4573,6 +4573,7 @@ static int do_chunk_alloc(struct btrfs_trans_handle *trans, u64 flags, goto out; }else { ret =1 ; + space_info->max_extent_size =0 ; } space_info->force_alloc =CHUNK_ALLOC_NO_FORCE ;@@ -8084,11 +8085,17 @@ static int __btrfs_free_reserved_extent(struct btrfs_fs_info *fs_info,if (pin)pin_down_extent (fs_info, cache, start, len,1 );else { +struct btrfs_space_info *space_info = cache->space_info; +if (btrfs_test_opt (fs_info,DISCARD ))
fs/btrfs/extent-tree.c static int __btrfs_free_reserved_extent(struct btrfs_fs_info *fs_info, · line 8100
Quoted 10 lines
fs/btrfs/extent-tree.c +4
-0ret =btrfs_discard_extent (fs_info, start, len,NULL ,BTRFS_CLEAR_OP_DISCARD );btrfs_add_free_space (cache, start, len);btrfs_free_reserved_bytes (cache, len, delalloc); + +spin_lock (&space_info->lock); + space_info->max_extent_size =0 ; +spin_unlock (&space_info->lock);trace_btrfs_reserved_extent_free (fs_info, start, len); }
Do we need to do the same for btrfs_free_tree_block()? If so, maybe it can go in btrfs_free_reserved_bytes() instead?
PATCH 15/36 btrfs: don't enospc all tickets on flush failure
In reply to Josef BacikWith the introduction of the per-inode block_rsv it became possible to have really really large reservation requests made because of data fragmentation. Since the ticket stuff assumed that we'd always have relatively small reservation requests it just killed all tickets if we were unable to satisfy the current request. However this is generally not the case anymore. So fix this logic to instead see if we had a ticket that we were able to give some reservation to, and if we were continue the flushing loop again. Likewise we make the tickets use the space_info_add_old_bytes() method of returning what reservation they did receive in hopes that it could satisfy reservations down the line.
--- fs/btrfs/extent-tree.c | 45 +++++++++++++++++++++++++-------------------- 1 file changed, 25 insertions(+), 20 deletions(-)
fs/btrfs/extent-tree.c +25 -20
@@ -4779,6 +4779,7 @@ static void shrink_delalloc(struct btrfs_fs_info *fs_info, u64 to_reclaim, }struct reserve_ticket { +u64 orig_bytes;u64 bytes;int error;struct list_head list;
@@ -5000,7 +5001,7 @@ static inline int need_do_async_reclaim(struct btrfs_fs_info *fs_info, !test_bit(BTRFS_FS_STATE_REMOUNTING, &fs_info->fs_state)); } -static void wake_all_tickets (struct list_head *head) +static bool wake_all_tickets (struct list_head *head) {struct reserve_ticket *ticket;
@@ -5009,7 +5010,10 @@ static void wake_all_tickets(struct list_head *head)list_del_init (&ticket->list); ticket->error = -ENOSPC ;wake_up (&ticket->wait); +if (ticket->bytes != ticket->orig_bytes) +return true; } +return false; }/*
@@ -5077,8 +5081,12 @@ static void btrfs_async_reclaim_metadata_space(struct work_struct *work)if (flush_state >COMMIT_TRANS ) { commit_cycles++;if (commit_cycles >2 ) { -wake_all_tickets (&space_info->tickets); - space_info->flush =0 ; +if (wake_all_tickets (&space_info->tickets)) { + flush_state =FLUSH_DELAYED_ITEMS_NR ; + commit_cycles--; + }else { + space_info->flush =0 ; + } }else { flush_state =FLUSH_DELAYED_ITEMS_NR ; }
@@ -5130,10 +5138,11 @@ static void priority_reclaim_metadata_space(struct btrfs_fs_info *fs_info,static int wait_reserve_ticket (struct btrfs_fs_info *fs_info,struct btrfs_space_info *space_info, -struct reserve_ticket *ticket,u64 orig_bytes) +struct reserve_ticket *ticket) {DEFINE_WAIT (wait); +u64 reclaim_bytes =0 ;int ret =0 ;spin_lock (&space_info->lock);
@@ -5154,14 +5163,12 @@ static int wait_reserve_ticket(struct btrfs_fs_info *fs_info, ret = ticket->error;if (!list_empty (&ticket->list))list_del_init (&ticket->list); -if (ticket->bytes && ticket->bytes < orig_bytes) { -u64 num_bytes = orig_bytes - ticket->bytes; - space_info->bytes_may_use -= num_bytes; -trace_btrfs_space_reservation (fs_info,"space_info" , - space_info->flags, num_bytes,0 ); - } +if (ticket->bytes && ticket->bytes < ticket->orig_bytes) + reclaim_bytes = ticket->orig_bytes - ticket->bytes;spin_unlock (&space_info->lock); +if (reclaim_bytes) +space_info_add_old_bytes (fs_info, space_info, reclaim_bytes);return ret; }
@@ -5187,6 +5194,7 @@ static int __reserve_metadata_bytes(struct btrfs_fs_info *fs_info, {struct reserve_ticket ticket;u64 used; +u64 reclaim_bytes =0 ;int ret =0 ;ASSERT (orig_bytes);
@@ -5222,6 +5230,7 @@ static int __reserve_metadata_bytes(struct btrfs_fs_info *fs_info,* the list and we will do our own flushing further down. */ if (ret && flush !=BTRFS_RESERVE_NO_FLUSH ) { + ticket.orig_bytes = orig_bytes; ticket.bytes = orig_bytes; ticket.error =0 ;init_waitqueue_head (&ticket.wait);
@@ -5262,25 +5271,21 @@ static int __reserve_metadata_bytes(struct btrfs_fs_info *fs_info,return ret;if (flush ==BTRFS_RESERVE_FLUSH_ALL ) -return wait_reserve_ticket (fs_info, space_info, &ticket, - orig_bytes); +return wait_reserve_ticket (fs_info, space_info, &ticket); ret =0 ;priority_reclaim_metadata_space (fs_info, space_info, &ticket);spin_lock (&space_info->lock);if (ticket.bytes) { -if (ticket.bytes < orig_bytes) { -u64 num_bytes = orig_bytes - ticket.bytes; - space_info->bytes_may_use -= num_bytes; -trace_btrfs_space_reservation (fs_info,"space_info" , - space_info->flags, - num_bytes,0 ); - - } +if (ticket.bytes < orig_bytes) + reclaim_bytes = orig_bytes - ticket.bytes;list_del_init (&ticket.list); ret = -ENOSPC ; }spin_unlock (&space_info->lock); + +if (reclaim_bytes) +space_info_add_old_bytes (fs_info, space_info, reclaim_bytes);ASSERT (list_empty (&ticket.list));return ret; }
Signature · 1 line
2.14.3
PATCH 16/36 btrfs: run delayed iputs before committing
In reply to Josef BacikDelayed iputs means we can have final iputs of deleted inodes in the queue, which could potentially generate a lot of pinned space that could be free'd. So before we decide to commit the transaction for ENOPSC reasons, run the delayed iputs so that any potential space is free'd up. If there is and we freed enough we can then commit the transaction and potentially be able to make our reservation.
--- fs/btrfs/extent-tree.c | 9 +++++++++ 1 file changed, 9 insertions(+)
fs/btrfs/extent-tree.c +9 -0
@@ -4823,6 +4823,15 @@ static int may_commit_transaction(struct btrfs_fs_info *fs_info,if (!bytes)return 0 ; +/* +* If we have pending delayed iputs then we could free up a bunch of +* pinned space, so make sure we run the iputs before we do our pinned +* bytes check below. +*/ +mutex_lock (&fs_info->cleaner_delayed_iput_mutex); +btrfs_run_delayed_iputs (fs_info); +mutex_unlock (&fs_info->cleaner_delayed_iput_mutex); + trans =btrfs_join_transaction (fs_info->extent_root);if (IS_ERR (trans))return -ENOSPC ;
Signature · 1 line
2.14.3
Re: [PATCH 16/36] btrfs: run delayed iputs before committing
Quoted 6 lines · Josef Bacik
Delayed iputs means we can have final iputs of deleted inodes in the queue, which could potentially generate a lot of pinned space that could be free'd. So before we decide to commit the transaction for ENOPSC reasons, run the delayed iputs so that any potential space is free'd up. If there is and we freed enough we can then commit the transaction and potentially be able to make our reservation.
Quoted 28 lines
Signed-off-by Josef Bacik <[email protected]>--- fs/btrfs/extent-tree.c | 9 +++++++++ 1 file changed, 9 insertions(+)fs/btrfs/extent-tree.c +9
-0@@ -4823,6 +4823,15 @@ static int may_commit_transaction(struct btrfs_fs_info *fs_info,if (!bytes)return 0 ; +/* +* If we have pending delayed iputs then we could free up a bunch of +* pinned space, so make sure we run the iputs before we do our pinned +* bytes check below. +*/ +mutex_lock (&fs_info->cleaner_delayed_iput_mutex); +btrfs_run_delayed_iputs (fs_info); +mutex_unlock (&fs_info->cleaner_delayed_iput_mutex); + trans =btrfs_join_transaction (fs_info->extent_root);if (IS_ERR (trans))return -ENOSPC ;Signature · 1 line
2.14.3
PATCH 17/36 btrfs: loop in inode_rsv_refill
In reply to Josef BacikWith severe fragmentation we can end up with our inode rsv size being huge during writeout, which would cause us to need to make very large metadata reservations. However we may not actually need that much once writeout is complete. So instead try to make our reservation, and if we couldn't make it re-calculate our new reservation size and try again. If our reservation size doesn't change between tries then we know we are actually out of space and can error out.
--- fs/btrfs/extent-tree.c | 19 +++++++++++++++++-- 1 file changed, 17 insertions(+), 2 deletions(-)
fs/btrfs/extent-tree.c +17 -2
@@ -5790,10 +5790,11 @@ static int btrfs_inode_rsv_refill(struct btrfs_inode *inode, {struct btrfs_root *root = inode->root;struct btrfs_block_rsv *block_rsv = &inode->block_rsv; -u64 num_bytes =0 ; +u64 num_bytes =0 , last =0 ;u64 qgroup_num_bytes =0 ;int ret = -ENOSPC ; +again:spin_lock (&block_rsv->lock);if (block_rsv->reserved < block_rsv->size) num_bytes = block_rsv->size - block_rsv->reserved;
@@ -5818,8 +5819,22 @@ static int btrfs_inode_rsv_refill(struct btrfs_inode *inode,spin_lock (&block_rsv->lock); block_rsv->qgroup_rsv_reserved += qgroup_num_bytes;spin_unlock (&block_rsv->lock); - }else + }else {btrfs_qgroup_free_meta_prealloc (root, qgroup_num_bytes); + +/* +* If we are fragmented we can end up with a lot of outstanding +* extents which will make our size be much larger than our +* reserved amount. If we happen to try to do a reservation +* here that may result in us trying to do a pretty hefty +* reservation, which we may not need once delalloc flushing +* happens. If this is the case try and do the reserve again. +*/ +if (flush ==BTRFS_RESERVE_FLUSH_ALL && last != num_bytes) { + last = num_bytes; + goto again; + } + }return ret; }
Signature · 1 line
2.14.3
Re: [PATCH 17/36] btrfs: loop in inode_rsv_refill
Quoted 37 lines · Josef Bacik
With severe fragmentation we can end up with our inode rsv size being huge during writeout, which would cause us to need to make very large metadata reservations. However we may not actually need that much once writeout is complete. So instead try to make our reservation, and if we couldn't make it re-calculate our new reservation size and try again. If our reservation size doesn't change between tries then we know we are actually out of space and can error out.
Signed-off-by Josef Bacik <[email protected]>--- fs/btrfs/extent-tree.c | 19 +++++++++++++++++-- 1 file changed, 17 insertions(+), 2 deletions(-)fs/btrfs/extent-tree.c +3
-2@@ -5790,10 +5790,11 @@ static int btrfs_inode_rsv_refill(struct btrfs_inode *inode, {struct btrfs_root *root = inode->root;struct btrfs_block_rsv *block_rsv = &inode->block_rsv; -u64 num_bytes =0 ; +u64 num_bytes =0 , last =0 ;u64 qgroup_num_bytes =0 ;int ret = -ENOSPC ; +again:spin_lock (&block_rsv->lock);if (block_rsv->reserved < block_rsv->size) num_bytes = block_rsv->size - block_rsv->reserved;@@ -5818,8 +5819,22 @@ static int btrfs_inode_rsv_refill(struct btrfs_inode *inode,spin_lock (&block_rsv->lock); block_rsv->qgroup_rsv_reserved += qgroup_num_bytes;spin_unlock (&block_rsv->lock); - }else + }else {btrfs_qgroup_free_meta_prealloc (root, qgroup_num_bytes);
fs/btrfs/extent-tree.c static int btrfs_inode_rsv_refill(struct btrfs_inode *inode, · line 5833
Quoted 10 lines
fs/btrfs/extent-tree.c +10
-0+ +/* +* If we are fragmented we can end up with a lot of outstanding +* extents which will make our size be much larger than our +* reserved amount. If we happen to try to do a reservation +* here that may result in us trying to do a pretty hefty +* reservation, which we may not need once delalloc flushing +* happens. If this is the case try and do the reserve again. +*/ +if (flush ==BTRFS_RESERVE_FLUSH_ALL && last != num_bytes) {
Is there any point in retrying the reservation if num_bytes didn't change? As this is written, we will:
1. Calculate num_bytes
2. Try reservation, say it fails
3. Recalculate num_bytes, say it doesn't change
4. Retry the reservation anyways, and it fails again
Maybe we should check if it changed before we retry the reservation? So then we'd have
1. Calculate num_bytes
2. Try reservation, fails
3. Recalculate num_bytes, it doesn't change, bail out
Also, is it possible that num_bytes > last because of other operations happening at the same time, and should we still retry in that case?
Quoted 10 lines
fs/btrfs/extent-tree.c +4
-0+ last = num_bytes; + goto again; + } + }return ret; }Signature · 1 line
2.14.3
PATCH 18/36 btrfs: move the dio_sem higher up the callchain
In reply to Josef BacikWe're getting a lockdep splat because we take the dio_sem under the log_mutex. What we really need is to protect fsync() from logging an extent map for an extent we never waited on higher up, so just guard the whole thing with dio_sem.
--- fs/btrfs/file.c | 12 ++++++++++++ fs/btrfs/tree-log.c | 2 -- 2 files changed, 12 insertions(+), 2 deletions(-)
fs/btrfs/file.c +12 -0
@@ -2079,6 +2079,14 @@ int btrfs_sync_file(struct file *file, loff_t start, loff_t end, int datasync) goto out;inode_lock (inode); + +/* +* We take the dio_sem here because the tree log stuff can race with +* lockless dio writes and get an extent map logged for an extent we +* never waited on. We need it this high up for lockdep reasons. +*/ +down_write (&BTRFS_I (inode)->dio_sem); +atomic_inc (&root->log_batch);/*
@@ -2087,6 +2095,7 @@ int btrfs_sync_file(struct file *file, loff_t start, loff_t end, int datasync)*/ ret =btrfs_wait_ordered_range (inode, start, len);if (ret) { +up_write (&BTRFS_I (inode)->dio_sem);inode_unlock (inode); goto out; }
@@ -2110,6 +2119,7 @@ int btrfs_sync_file(struct file *file, loff_t start, loff_t end, int datasync)* checked called fsync. */ ret =filemap_check_wb_err (inode->i_mapping, file->f_wb_err); +up_write (&BTRFS_I (inode)->dio_sem);inode_unlock (inode); goto out; }
@@ -2128,6 +2138,7 @@ int btrfs_sync_file(struct file *file, loff_t start, loff_t end, int datasync) trans =btrfs_start_transaction (root,0 );if (IS_ERR (trans)) { ret =PTR_ERR (trans); +up_write (&BTRFS_I (inode)->dio_sem);inode_unlock (inode); goto out; }
@@ -2149,6 +2160,7 @@ int btrfs_sync_file(struct file *file, loff_t start, loff_t end, int datasync)* file again, but that will end up using the synchronization * inside btrfs_sync_log to keep things safe. */ +up_write (&BTRFS_I (inode)->dio_sem);inode_unlock (inode);/*
fs/btrfs/tree-log.c +0 -2
@@ -4374,7 +4374,6 @@ static int btrfs_log_changed_extents(struct btrfs_trans_handle *trans,INIT_LIST_HEAD (&extents); -down_write (&inode->dio_sem);write_lock (&tree->lock); test_gen = root->fs_info->last_trans_committed; logged_start = start;
@@ -4440,7 +4439,6 @@ static int btrfs_log_changed_extents(struct btrfs_trans_handle *trans, }WARN_ON (!list_empty (&extents));write_unlock (&tree->lock); -up_write (&inode->dio_sem);btrfs_release_path (path);if (!ret)
Signature · 1 line
2.14.3
PATCH 19/36 btrfs: set max_extent_size properly
In reply to Josef BacikFrom: Josef Bacik <[email protected]>
We can't use entry->bytes if our entry is a bitmap entry, we need to use entry->max_extent_size in that case. Fix up all the logic to make this consistent.
--- fs/btrfs/free-space-cache.c | 29 +++++++++++++++++++---------- 1 file changed, 19 insertions(+), 10 deletions(-)
fs/btrfs/free-space-cache.c +19 -10
@@ -1770,6 +1770,18 @@ static int search_bitmap(struct btrfs_free_space_ctl *ctl,return -1 ; } +static void set_max_extent_size (struct btrfs_free_space *entry, +u64 *max_extent_size) +{ +if (entry->bitmap) { +if (entry->max_extent_size > *max_extent_size) + *max_extent_size = entry->max_extent_size; + }else { +if (entry->bytes > *max_extent_size) + *max_extent_size = entry->bytes; + } +} +/* Cache the size of the max extent in bytes */ static struct btrfs_free_space * find_free_space(struct btrfs_free_space_ctl *ctl, u64 *offset, u64 *bytes,
@@ -1791,8 +1803,7 @@ find_free_space(struct btrfs_free_space_ctl *ctl, u64 *offset, u64 *bytes,for (node = &entry->offset_index; node; node =rb_next (node)) { entry = rb_entry(node, struct btrfs_free_space, offset_index);if (entry->bytes < *bytes) { -if (entry->bytes > *max_extent_size) - *max_extent_size = entry->bytes; +set_max_extent_size (entry, max_extent_size);continue ; }
@@ -1810,8 +1821,7 @@ find_free_space(struct btrfs_free_space_ctl *ctl, u64 *offset, u64 *bytes, }if (entry->bytes < *bytes + align_off) { -if (entry->bytes > *max_extent_size) - *max_extent_size = entry->bytes; +set_max_extent_size (entry, max_extent_size);continue ; }
@@ -1823,8 +1833,8 @@ find_free_space(struct btrfs_free_space_ctl *ctl, u64 *offset, u64 *bytes, *offset = tmp; *bytes = size;return entry; - }else if (size > *max_extent_size) { - *max_extent_size = size; + }else { +set_max_extent_size (entry, max_extent_size); }continue ; }
@@ -2684,8 +2694,7 @@ static u64 btrfs_alloc_from_bitmap(struct btrfs_block_group_cache *block_group, err =search_bitmap (ctl, entry, &search_start, &search_bytes, true);if (err) { -if (search_bytes > *max_extent_size) - *max_extent_size = search_bytes; +set_max_extent_size (entry, max_extent_size);return 0 ; }
@@ -2722,8 +2731,8 @@ u64 btrfs_alloc_from_cluster(struct btrfs_block_group_cache *block_group, entry = rb_entry(node, struct btrfs_free_space, offset_index);while (1 ) { -if (entry->bytes < bytes && entry->bytes > *max_extent_size) - *max_extent_size = entry->bytes; +if (entry->bytes < bytes) +set_max_extent_size (entry, max_extent_size);if (entry->bytes < bytes || (!entry->bitmap && entry->offset < min_start)) {
Signature · 1 line
2.14.3
PATCH 20/36 btrfs: don't use ctl->free_space for max_extent_size
In reply to Josef BacikFrom: Josef Bacik <[email protected]>
max_extent_size is supposed to be the largest contiguous range for the space info, and ctl->free_space is the total free space in the block group. We need to keep track of these separately and _only_ use the max_free_space if we don't have a max_extent_size, as that means our original request was too large to search any of the block groups for and therefore wouldn't have a max_extent_size set.
--- fs/btrfs/extent-tree.c | 7 +++++-- 1 file changed, 5 insertions(+), 2 deletions(-)
fs/btrfs/extent-tree.c +5 -2
@@ -7484,6 +7484,7 @@ static noinline int find_free_extent(struct btrfs_fs_info *fs_info,struct btrfs_block_group_cache *block_group =NULL ;u64 search_start =0 ;u64 max_extent_size =0 ; +u64 max_free_space =0 ;u64 empty_cluster =0 ;struct btrfs_space_info *space_info;int loop =0 ;
@@ -7779,8 +7780,8 @@ static noinline int find_free_extent(struct btrfs_fs_info *fs_info,spin_lock (&ctl->tree_lock);if (ctl->free_space < num_bytes + empty_cluster + empty_size) { -if (ctl->free_space > max_extent_size) - max_extent_size = ctl->free_space; + max_free_space =max (max_free_space, + ctl->free_space);spin_unlock (&ctl->tree_lock); goto loop; }
@@ -7947,6 +7948,8 @@ static noinline int find_free_extent(struct btrfs_fs_info *fs_info, } out:if (ret == -ENOSPC ) { +if (!max_extent_size) + max_extent_size = max_free_space;spin_lock (&space_info->lock); space_info->max_extent_size = max_extent_size;spin_unlock (&space_info->lock);
Signature · 1 line
2.14.3
PATCH 21/36 btrfs: reset max_extent_size on clear in a bitmap
In reply to Josef BacikFrom: Josef Bacik <[email protected]>
We need to clear the max_extent_size when we clear bits from a bitmap since it could have been from the range that contains the max_extent_size.
--- fs/btrfs/free-space-cache.c | 2 ++ 1 file changed, 2 insertions(+)
fs/btrfs/free-space-cache.c +2 -0
@@ -1687,6 +1687,8 @@ static inline void __bitmap_clear_bits(struct btrfs_free_space_ctl *ctl,bitmap_clear (info->bitmap, start, count); info->bytes -= bytes; +if (info->max_extent_size > ctl->unit) + info->max_extent_size =0 ; } static void bitmap_clear_bits(struct btrfs_free_space_ctl *ctl,
Signature · 1 line
2.14.3
PATCH 22/36 btrfs: only run delayed refs if we're committing
In reply to Josef BacikI noticed in a giant dbench run that we spent a lot of time on lock contention while running transaction commit. This is because dbench results in a lot of fsync()'s that do a btrfs_transaction_commit(), and they all run the delayed refs first thing, so they all contend with each other. This leads to seconds of 0 throughput. Change this to only run the delayed refs if we're the ones committing the transaction. This makes the latency go away and we get no more lock contention.
--- fs/btrfs/transaction.c | 24 +++++++++--------------- 1 file changed, 9 insertions(+), 15 deletions(-)
fs/btrfs/transaction.c +9 -15
@@ -1925,15 +1925,6 @@ int btrfs_commit_transaction(struct btrfs_trans_handle *trans)btrfs_trans_release_metadata (trans); trans->block_rsv =NULL ; -/* make a pass through all the delayed refs we have so far -* any runnings procs may add more while we are here -*/ - ret =btrfs_run_delayed_refs (trans,0 ); -if (ret) { -btrfs_end_transaction (trans); -return ret; - } - cur_trans = trans->transaction;/*
@@ -1946,12 +1937,6 @@ int btrfs_commit_transaction(struct btrfs_trans_handle *trans)if (!list_empty (&trans->new_bgs))btrfs_create_pending_block_groups (trans); - ret =btrfs_run_delayed_refs (trans,0 ); -if (ret) { -btrfs_end_transaction (trans); -return ret; - } -if (!test_bit (BTRFS_TRANS_DIRTY_BG_RUN , &cur_trans->flags)) {int run_it =0 ;
@@ -2022,6 +2007,15 @@ int btrfs_commit_transaction(struct btrfs_trans_handle *trans)spin_unlock (&fs_info->trans_lock); } +/* +* We are now the only one in the commit area, we can run delayed refs +* without hitting a bunch of lock contention from a lot of people +* trying to commit the transaction at once. +*/ + ret =btrfs_run_delayed_refs (trans,0 ); +if (ret) + goto cleanup_transaction; +extwriter_counter_dec (cur_trans, trans->type); ret =btrfs_start_delalloc_flush (fs_info);
Signature · 1 line
2.14.3
PATCH 23/36 btrfs: make sure we create all new bgs
In reply to Josef BacikAllocating new chunks modifies both the extent and chunk tree, which can trigger new chunk allocations. So instead of doing list_for_each_safe, just do while (!list_empty()) so we make sure we don't exit with other pending bg's still on our list.
--- fs/btrfs/extent-tree.c | 7 +++++-- 1 file changed, 5 insertions(+), 2 deletions(-)
fs/btrfs/extent-tree.c +5 -2
@@ -10356,7 +10356,7 @@ int btrfs_read_block_groups(struct btrfs_fs_info *info)void btrfs_create_pending_block_groups (struct btrfs_trans_handle *trans) {struct btrfs_fs_info *fs_info = trans->fs_info; -struct btrfs_block_group_cache *block_group, *tmp; +struct btrfs_block_group_cache *block_group;struct btrfs_root *extent_root = fs_info->extent_root;struct btrfs_block_group_item item;struct btrfs_key key;
@@ -10364,7 +10364,10 @@ void btrfs_create_pending_block_groups(struct btrfs_trans_handle *trans)bool can_flush_pending_bgs = trans->can_flush_pending_bgs; trans->can_flush_pending_bgs = false; -list_for_each_entry_safe (block_group, tmp, &trans->new_bgs, bg_list) { +while (!list_empty (&trans->new_bgs)) { + block_group =list_first_entry (&trans->new_bgs, + struct btrfs_block_group_cache, + bg_list);if (ret) goto next;
Signature · 1 line
2.14.3
PATCH 24/36 btrfs: assert on non-empty delayed iputs
In reply to Josef BacikI ran into an issue where there was some reference being held on an inode that I couldn't track. This assert wasn't triggered, but it at least rules out we're doing something stupid.
--- fs/btrfs/disk-io.c | 1 + 1 file changed, 1 insertion(+)
fs/btrfs/disk-io.c +1 -0
@@ -3979,6 +3979,7 @@ void close_ctree(struct btrfs_fs_info *fs_info)kthread_stop (fs_info->transaction_kthread);kthread_stop (fs_info->cleaner_kthread); +ASSERT (list_empty (&fs_info->delayed_iputs));set_bit (BTRFS_FS_CLOSING_DONE , &fs_info->flags);btrfs_free_qgroup_config (fs_info);
Signature · 1 line
2.14.3
PATCH 25/36 btrfs: pass delayed_refs_root to btrfs_delayed_ref_lock
In reply to Josef BacikWe don't need the trans except to get the delayed_refs_root, so just pass the delayed_refs_root into btrfs_delayed_ref_lock and call it a day.
--- fs/btrfs/delayed-ref.c | 5 +---- fs/btrfs/delayed-ref.h | 2 +- fs/btrfs/extent-tree.c | 2 +- 3 files changed, 3 insertions(+), 6 deletions(-)
fs/btrfs/delayed-ref.c +1 -4
@@ -197,12 +197,9 @@ find_ref_head(struct rb_root *root, u64 bytenr,return NULL ; } -int btrfs_delayed_ref_lock (struct btrfs_trans_handle *trans, +int btrfs_delayed_ref_lock (struct btrfs_delayed_ref_root *delayed_refs,struct btrfs_delayed_ref_head *head) { -struct btrfs_delayed_ref_root *delayed_refs; - - delayed_refs = &trans->transaction->delayed_refs;lockdep_assert_held (&delayed_refs->lock);if (mutex_trylock (&head->mutex))return 0 ;
fs/btrfs/delayed-ref.h +1 -1
@@ -255,7 +255,7 @@ void btrfs_merge_delayed_refs(struct btrfs_trans_handle *trans,struct btrfs_delayed_ref_head *btrfs_find_delayed_ref_head (struct btrfs_delayed_ref_root *delayed_refs,u64 bytenr); -int btrfs_delayed_ref_lock (struct btrfs_trans_handle *trans, +int btrfs_delayed_ref_lock (struct btrfs_delayed_ref_root *delayed_refs,struct btrfs_delayed_ref_head *head);static inline void btrfs_delayed_ref_unlock (struct btrfs_delayed_ref_head *head) {
fs/btrfs/extent-tree.c +1 -1
@@ -2600,7 +2600,7 @@ static noinline int __btrfs_run_delayed_refs(struct btrfs_trans_handle *trans,/* grab the lock that says we are going to process * all the refs for this head */ - ret =btrfs_delayed_ref_lock (trans, locked_ref); + ret =btrfs_delayed_ref_lock (delayed_refs, locked_ref);spin_unlock (&delayed_refs->lock);/* * we may have dropped the spin lock to get the head
Signature · 1 line
2.14.3
PATCH 26/36 btrfs: make btrfs_destroy_delayed_refs use btrfs_delayed_ref_lock
In reply to Josef BacikWe have this open coded in btrfs_destroy_delayed_refs, use the helper instead.
--- fs/btrfs/disk-io.c | 11 ++--------- 1 file changed, 2 insertions(+), 9 deletions(-)
fs/btrfs/disk-io.c +2 -9
@@ -4214,16 +4214,9 @@ static int btrfs_destroy_delayed_refs(struct btrfs_transaction *trans, head = rb_entry(node, struct btrfs_delayed_ref_head, href_node); -if (!mutex_trylock (&head->mutex)) { -refcount_inc (&head->refs); -spin_unlock (&delayed_refs->lock); - -mutex_lock (&head->mutex); -mutex_unlock (&head->mutex); -btrfs_put_delayed_ref_head (head); -spin_lock (&delayed_refs->lock); +if (btrfs_delayed_ref_lock (delayed_refs, head))continue ; - } +spin_lock (&head->lock);while ((n =rb_first (&head->ref_tree)) !=NULL ) { ref = rb_entry(n, struct btrfs_delayed_ref_node,
Signature · 1 line
2.14.3
PATCH 27/36 btrfs: make btrfs_destroy_delayed_refs use btrfs_delete_ref_head
In reply to Josef BacikInstead of open coding this stuff use the helper instead.
--- fs/btrfs/disk-io.c | 7 +------ 1 file changed, 1 insertion(+), 6 deletions(-)
fs/btrfs/disk-io.c +1 -6
@@ -4232,12 +4232,7 @@ static int btrfs_destroy_delayed_refs(struct btrfs_transaction *trans,if (head->must_insert_reserved) pin_bytes = true;btrfs_free_delayed_extent_op (head->extent_op); - delayed_refs->num_heads--; -if (head->processing ==0 ) - delayed_refs->num_heads_ready--; -atomic_dec (&delayed_refs->num_entries); -rb_erase (&head->href_node, &delayed_refs->href_root); -RB_CLEAR_NODE (&head->href_node); +btrfs_delete_ref_head (delayed_refs, head);spin_unlock (&head->lock);spin_unlock (&delayed_refs->lock);mutex_unlock (&head->mutex);
Signature · 1 line
2.14.3
PATCH 28/36 btrfs: handle delayed ref head accounting cleanup in abort
In reply to Josef BacikWe weren't doing any of the accounting cleanup when we aborted transactions. Fix this by making cleanup_ref_head_accounting global and calling it from the abort code, this fixes the issue where our accounting was all wrong after the fs aborts.
--- fs/btrfs/ctree.h | 5 +++++ fs/btrfs/disk-io.c | 1 + fs/btrfs/extent-tree.c | 13 ++++++------- 3 files changed, 12 insertions(+), 7 deletions(-)
fs/btrfs/ctree.h +5 -0
@@ -35,6 +35,7 @@struct btrfs_trans_handle ;struct btrfs_transaction ;struct btrfs_pending_snapshot ; +struct btrfs_delayed_ref_root ;extern struct kmem_cache *btrfs_trans_handle_cachep;extern struct kmem_cache *btrfs_bit_radix_cachep;extern struct kmem_cache *btrfs_path_cachep;
@@ -2623,6 +2624,10 @@ int btrfs_run_delayed_refs(struct btrfs_trans_handle *trans, unsigned long count);int btrfs_async_run_delayed_refs (struct btrfs_fs_info *fs_info,unsigned long count,u64 transid,int wait); +void +btrfs_cleanup_ref_head_accounting (struct btrfs_fs_info *fs_info, +struct btrfs_delayed_ref_root *delayed_refs, +struct btrfs_delayed_ref_head *head);int btrfs_lookup_data_extent (struct btrfs_fs_info *fs_info,u64 start,u64 len); int btrfs_lookup_extent_info(struct btrfs_trans_handle *trans, struct btrfs_fs_info *fs_info, u64 bytenr,
fs/btrfs/disk-io.c +1 -0
@@ -4240,6 +4240,7 @@ static int btrfs_destroy_delayed_refs(struct btrfs_transaction *trans,if (pin_bytes)btrfs_pin_extent (fs_info, head->bytenr, head->num_bytes,1 ); +btrfs_cleanup_ref_head_accounting (fs_info, delayed_refs, head);btrfs_put_delayed_ref_head (head);cond_resched ();spin_lock (&delayed_refs->lock);
fs/btrfs/extent-tree.c +6 -7
@@ -2475,12 +2475,11 @@ static int run_and_cleanup_extent_op(struct btrfs_trans_handle *trans,return ret ? ret :1 ; } -static void cleanup_ref_head_accounting (struct btrfs_trans_handle *trans, -struct btrfs_delayed_ref_head *head) +void +btrfs_cleanup_ref_head_accounting (struct btrfs_fs_info *fs_info, +struct btrfs_delayed_ref_root *delayed_refs, +struct btrfs_delayed_ref_head *head) { -struct btrfs_fs_info *fs_info = trans->fs_info; -struct btrfs_delayed_ref_root *delayed_refs = - &trans->transaction->delayed_refs;int nr_items =1 ;if (head->total_ref_mod <0 ) {
@@ -2558,7 +2557,7 @@ static int cleanup_ref_head(struct btrfs_trans_handle *trans, } } -cleanup_ref_head_accounting (trans, head); +btrfs_cleanup_ref_head_accounting (fs_info, delayed_refs, head);trace_run_delayed_ref_head (fs_info, head,0 );btrfs_delayed_ref_unlock (head);
@@ -7215,7 +7214,7 @@ static noinline int check_ref_cleanup(struct btrfs_trans_handle *trans,if (head->must_insert_reserved) ret =1 ; -cleanup_ref_head_accounting (trans, head); +btrfs_cleanup_ref_head_accounting (trans->fs_info, delayed_refs, head);mutex_unlock (&head->mutex);btrfs_put_delayed_ref_head (head);return ret;
Signature · 1 line
2.14.3
PATCH 29/36 btrfs: call btrfs_create_pending_block_groups unconditionally
In reply to Josef BacikThe first thing we do is loop through the list, this
if (!list_empty())
btrfs_create_pending_block_groups();
thing is just wasted space.
--- fs/btrfs/extent-tree.c | 3 +-- fs/btrfs/transaction.c | 6 ++---- 2 files changed, 3 insertions(+), 6 deletions(-)
fs/btrfs/extent-tree.c +1 -2
@@ -2978,8 +2978,7 @@ int btrfs_run_delayed_refs(struct btrfs_trans_handle *trans, }if (run_all) { -if (!list_empty (&trans->new_bgs)) -btrfs_create_pending_block_groups (trans); +btrfs_create_pending_block_groups (trans);spin_lock (&delayed_refs->lock); node =rb_first (&delayed_refs->href_root);
fs/btrfs/transaction.c +2 -4
@@ -846,8 +846,7 @@ static int __btrfs_end_transaction(struct btrfs_trans_handle *trans,btrfs_trans_release_metadata (trans); trans->block_rsv =NULL ; -if (!list_empty (&trans->new_bgs)) -btrfs_create_pending_block_groups (trans); +btrfs_create_pending_block_groups (trans);btrfs_trans_release_chunk_metadata (trans);
@@ -1934,8 +1933,7 @@ int btrfs_commit_transaction(struct btrfs_trans_handle *trans) cur_trans->delayed_refs.flushing =1 ;smp_wmb (); -if (!list_empty (&trans->new_bgs)) -btrfs_create_pending_block_groups (trans); +btrfs_create_pending_block_groups (trans);if (!test_bit (BTRFS_TRANS_DIRTY_BG_RUN , &cur_trans->flags)) {int run_it =0 ;
Signature · 1 line
2.14.3
PATCH 30/36 btrfs: just delete pending bgs if we are aborted
In reply to Josef BacikWe still need to do all of the accounting cleanup for pending block groups if we abort. So set the ret to trans->aborted so if we aborted the cleanup happens and everybody is happy.
--- fs/btrfs/extent-tree.c | 8 +++++++- 1 file changed, 7 insertions(+), 1 deletion(-)
fs/btrfs/extent-tree.c +7 -1
@@ -10358,9 +10358,15 @@ void btrfs_create_pending_block_groups(struct btrfs_trans_handle *trans)struct btrfs_root *extent_root = fs_info->extent_root;struct btrfs_block_group_item item;struct btrfs_key key; -int ret =0 ; +int ret;bool can_flush_pending_bgs = trans->can_flush_pending_bgs; +/* +* If we aborted the transaction with pending bg's we need to just +* cleanup the list and carry on. +*/ + ret = trans->aborted; + trans->can_flush_pending_bgs = false;while (!list_empty (&trans->new_bgs)) { block_group = list_first_entry(&trans->new_bgs,
Signature · 1 line
2.14.3
PATCH 31/36 btrfs: cleanup pending bgs on transaction abort
In reply to Josef BacikWe may abort the transaction during a commit and not have a chance to run the pending bgs stuff, which will leave block groups on our list and cause us accounting issues and leaked memory. Fix this by running the pending bgs when we cleanup a transaction.
--- fs/btrfs/transaction.c | 4 ++++ 1 file changed, 4 insertions(+)
fs/btrfs/transaction.c +4 -0
@@ -2280,6 +2280,10 @@ int btrfs_commit_transaction(struct btrfs_trans_handle *trans)btrfs_scrub_continue (fs_info); cleanup_transaction:btrfs_trans_release_metadata (trans); +/* This cleans up the pending block groups list properly. */ +if (!trans->aborted) + trans->aborted = ret; +btrfs_create_pending_block_groups (trans);btrfs_trans_release_chunk_metadata (trans); trans->block_rsv =NULL ;btrfs_warn (fs_info,"Skipping commit of aborted transaction." );
Signature · 1 line
2.14.3
PATCH 32/36 btrfs: clear delayed_refs_rsv for dirty bg cleanup
In reply to Josef BacikWe keep track of dirty bg's as a reservation in the delayed_refs_rsv, so when we abort and we cleanup those dirty bgs we need to drop their reservation so we don't have accounting issues and lots of scary messages on umount.
--- fs/btrfs/disk-io.c | 1 + 1 file changed, 1 insertion(+)
fs/btrfs/disk-io.c +1 -0
@@ -4412,6 +4412,7 @@ void btrfs_cleanup_dirty_bgs(struct btrfs_transaction *cur_trans,spin_unlock (&cur_trans->dirty_bgs_lock);btrfs_put_block_group (cache); +btrfs_delayed_refs_rsv_release (fs_info,1 );spin_lock (&cur_trans->dirty_bgs_lock); }spin_unlock (&cur_trans->dirty_bgs_lock);
Signature · 1 line
2.14.3
Re: [PATCH 32/36] btrfs: clear delayed_refs_rsv for dirty bg cleanup
Quoted 4 lines · Josef Bacik
We keep track of dirty bg's as a reservation in the
delayed_refs_rsv, so when we abort and we cleanup those dirty bgs we need to drop their reservation so we don't have accounting issues and lots of scary messages on umount.
Shouldn't this just be part of patch 6?
Quoted 20 lines
Signed-off-by Josef Bacik <[email protected]>--- fs/btrfs/disk-io.c | 1 + 1 file changed, 1 insertion(+)fs/btrfs/disk-io.c +1
-0@@ -4412,6 +4412,7 @@ void btrfs_cleanup_dirty_bgs(struct btrfs_transaction *cur_trans,spin_unlock (&cur_trans->dirty_bgs_lock);btrfs_put_block_group (cache); +btrfs_delayed_refs_rsv_release (fs_info,1 );spin_lock (&cur_trans->dirty_bgs_lock); }spin_unlock (&cur_trans->dirty_bgs_lock);Signature · 1 line
2.14.3
PATCH 33/36 btrfs: only free reserved extent if we didn't insert it
In reply to Josef BacikWhen we insert the file extent once the ordered extent completes we free the reserved extent reservation as it'll have been migrated to the bytes_used counter. However if we error out after this step we'll still clear the reserved extent reservation, resulting in a negative accounting of the reserved bytes for the block group and space info. Fix this by only doing the free if we didn't successfully insert a file extent for this extent.
--- fs/btrfs/inode.c | 10 +++++++++- 1 file changed, 9 insertions(+), 1 deletion(-)
fs/btrfs/inode.c +9 -1
@@ -2992,6 +2992,7 @@ static int btrfs_finish_ordered_io(struct btrfs_ordered_extent *ordered_extent)bool truncated = false;bool range_locked = false;bool clear_new_delalloc_bytes = false; +bool clear_reserved_extent = true; if (!test_bit(BTRFS_ORDERED_NOCOW, &ordered_extent->flags) && !test_bit(BTRFS_ORDERED_PREALLOC, &ordered_extent->flags) &&
@@ -3095,10 +3096,12 @@ static int btrfs_finish_ordered_io(struct btrfs_ordered_extent *ordered_extent) logical_len, logical_len, compress_type,0 ,0 , BTRFS_FILE_EXTENT_REG); -if (!ret) +if (!ret) { + clear_reserved_extent = false;btrfs_release_delalloc_bytes (fs_info, ordered_extent->start, ordered_extent->disk_len); + } } unpin_extent_cache(&BTRFS_I(inode)->extent_tree, ordered_extent->file_offset, ordered_extent->len,
@@ -3159,8 +3162,13 @@ static int btrfs_finish_ordered_io(struct btrfs_ordered_extent *ordered_extent)* wrong we need to return the space for this ordered extent * back to the allocator. We only free the extent in the * truncated case if we didn't write out the extent at all. +* +* If we made it past insert_reserved_file_extent before we +* errored out then we don't need to do this as the accounting +* has already been done. */ if ((ret || !logical_len) && + clear_reserved_extent && !test_bit (BTRFS_ORDERED_NOCOW , &ordered_extent->flags) && !test_bit (BTRFS_ORDERED_PREALLOC , &ordered_extent->flags)) btrfs_free_reserved_extent(fs_info,
Signature · 1 line
2.14.3
Re: [PATCH 33/36] btrfs: only free reserved extent if we didn't insert it
Quoted 7 lines · Josef Bacik
When we insert the file extent once the ordered extent completes we free the reserved extent reservation as it'll have been migrated to the
bytes_usedcounter. However if we error out after this step we'll still clear the reserved extent reservation, resulting in a negative accounting of the reserved bytes for the block group and space info. Fix this by only doing the free if we didn't successfully insert a file extent for this extent.
Quoted 48 lines
Signed-off-by Josef Bacik <[email protected]>--- fs/btrfs/inode.c | 10 +++++++++- 1 file changed, 9 insertions(+), 1 deletion(-)fs/btrfs/inode.c +9
-1@@ -2992,6 +2992,7 @@ static int btrfs_finish_ordered_io(struct btrfs_ordered_extent *ordered_extent)bool truncated = false;bool range_locked = false;bool clear_new_delalloc_bytes = false; +bool clear_reserved_extent = true; if (!test_bit(BTRFS_ORDERED_NOCOW, &ordered_extent->flags) && !test_bit(BTRFS_ORDERED_PREALLOC, &ordered_extent->flags) &&@@ -3095,10 +3096,12 @@ static int btrfs_finish_ordered_io(struct btrfs_ordered_extent *ordered_extent) logical_len, logical_len, compress_type,0 ,0 , BTRFS_FILE_EXTENT_REG); -if (!ret) +if (!ret) { + clear_reserved_extent = false;btrfs_release_delalloc_bytes (fs_info, ordered_extent->start, ordered_extent->disk_len); + } } unpin_extent_cache(&BTRFS_I(inode)->extent_tree, ordered_extent->file_offset, ordered_extent->len,@@ -3159,8 +3162,13 @@ static int btrfs_finish_ordered_io(struct btrfs_ordered_extent *ordered_extent)* wrong we need to return the space for this ordered extent * back to the allocator. We only free the extent in the * truncated case if we didn't write out the extent at all. +* +* If we made it past insert_reserved_file_extent before we +* errored out then we don't need to do this as the accounting +* has already been done. */ if ((ret || !logical_len) && + clear_reserved_extent && !test_bit (BTRFS_ORDERED_NOCOW , &ordered_extent->flags) && !test_bit (BTRFS_ORDERED_PREALLOC , &ordered_extent->flags)) btrfs_free_reserved_extent(fs_info,Signature · 1 line
2.14.3
PATCH 34/36 btrfs: fix insert_reserved error handling
In reply to Josef BacikWe were not handling the reserved byte accounting properly for data references. Metadata was fine, if it errored out the error paths would free the bytes_reserved count and pin the extent, but it even missed one of the error cases. So instead move this handling up into run_one_delayed_ref so we are sure that both cases are properly cleaned up in case of a transaction abort.
--- fs/btrfs/extent-tree.c | 12 ++++-------- 1 file changed, 4 insertions(+), 8 deletions(-)
fs/btrfs/extent-tree.c +4 -8
@@ -2405,6 +2405,9 @@ static int run_one_delayed_ref(struct btrfs_trans_handle *trans, insert_reserved); elseBUG (); +if (ret && insert_reserved) +btrfs_pin_extent (trans->fs_info, node->bytenr, + node->num_bytes,1 );return ret; }
@@ -8252,21 +8255,14 @@ static int alloc_reserved_tree_block(struct btrfs_trans_handle *trans, } path =btrfs_alloc_path (); -if (!path) { -btrfs_free_and_pin_reserved_extent (fs_info, - extent_key.objectid, - fs_info->nodesize); +if (!path)return -ENOMEM ; - } path->leave_spinning =1 ; ret =btrfs_insert_empty_item (trans, fs_info->extent_root, path, &extent_key, size);if (ret) {btrfs_free_path (path); -btrfs_free_and_pin_reserved_extent (fs_info, - extent_key.objectid, - fs_info->nodesize);return ret; }
Signature · 1 line
2.14.3
PATCH 35/36 btrfs: wait on ordered extents on abort cleanup
In reply to Josef BacikIf we flip read-only before we initiate writeback on all dirty pages for ordered extents we've created then we'll have ordered extents left over on umount, which results in all sorts of bad things happening. Fix this by making sure we wait on ordered extents if we have to do the aborted transaction cleanup stuff.
--- fs/btrfs/disk-io.c | 8 ++++++++ 1 file changed, 8 insertions(+)
fs/btrfs/disk-io.c +8 -0
@@ -4188,6 +4188,14 @@ static void btrfs_destroy_all_ordered_extents(struct btrfs_fs_info *fs_info)spin_lock (&fs_info->ordered_root_lock); }spin_unlock (&fs_info->ordered_root_lock); + +/* +* We need this here because if we've been flipped read-only we won't +* get sync() from the umount, so we need to make sure any ordered +* extents that haven't had their dirty pages IO start writeout yet +* actually get run and error out properly. +*/ +btrfs_wait_ordered_roots (fs_info,U64_MAX ,0 , (u64)-1 ); } static int btrfs_destroy_delayed_refs(struct btrfs_transaction *trans,
Signature · 1 line
2.14.3
PATCH 36/36 MAINTAINERS: update my email address for btrfs
In reply to Josef BacikMy work email is completely useless, switch it to my personal address so I get emails on a account I actually pay attention to.
--- MAINTAINERS | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
MAINTAINERS +1 -1
@@ -3095,7 +3095,7 @@ F: drivers/gpio/gpio-bt8xx.c BTRFS FILE SYSTEM M: Chris Mason <[email protected]> -M: Josef Bacik <[email protected]> +M: Josef Bacik <[email protected]> M: David Sterba <[email protected]> L: [email protected] W: http://btrfs.wiki.kernel.org/
Signature · 1 line
2.14.3