RFC RCU: Enable callbacks to benefit from expedited grace periods
Get series with b4
b4 am [email protected]Versions newest first
- v1 RFC Latest10 patches 8 repliesIn review
Patches in v1 No applies recorded yet
| # | Subject and files | Size | Replies | Applied |
|---|---|---|---|---|
| 1/10 | rcu/segcblist: Add SRCU and Tasks RCU wrapper functionskernel/ kernel/ kernel/ +1 more | +23 | 0 replies | |
| 2/10 | rcu/segcblist: Factor out rcu_segcblist_advance_compact() helperkernel/ | +32 | 0 replies | |
| 3/10 | rcu/segcblist: Change gp_seq to struct rcu_gp_oldstate gp_seq_fullinclude/ include/ kernel/ +3 more | +53 | 2 replies | |
| 4/10 | rcu: Add RCU_GET_STATE_NOT_TRACKED for subsystems without expedited GPskernel/ kernel/ | +13 | 0 replies | |
| 5/10 | rcu: Enable RCU callbacks to benefit from expedited grace periodskernel/ kernel/ kernel/ +1 more | +51 | 1 reply | |
| 6/10 | rcu: Update comments for gp_seq_full and expedited GP trackinginclude/ kernel/ kernel/ | +39 | 0 replies | |
| 7/10 | rcu: Wake NOCB rcuog kthreads on expedited grace period completionkernel/ kernel/ kernel/ | +31 | 2 replies | |
| 8/10 | rcu: Detect expedited grace period completion in rcu_pending()kernel/ | +7 | 1 reply | |
| 9/10 | rcu: Advance callbacks for expedited GP completion in rcu_core()kernel/ | +16 | 0 replies | |
| 10/10 | rcuscale: Add concurrent expedited GP threads for callback scaling testskernel/ | +82 | 0 replies |
Reviews trailers per patch
All 10 patches have a Reviewed-by or Acked-by.
| Patch | Paul E. McKenney |
|---|---|
| 1/10 | R-b |
| 2/10 | R-b |
| 3/10 | R-b |
| 4/10 | R-b |
| 5/10 | R-b |
| 6/10 | R-b |
| 7/10 | R-b |
| 8/10 | R-b |
| 9/10 | R-b |
| 10/10 | R-b |
Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.
Cover letter [RFC PATCH 00/10] RCU: Enable callbacks to benefit from expedited grace periods
RCU callbacks only track normal grace period sequence numbers. This means callbacks must wait for normal GPs even when expedited GPs have already elapsed.
This series tracks both normal and expedited GP sequences in the callback infrastructure using struct rcu_gp_oldstate, so callbacks advance when either GP type completes.
Commits 1-4 prepare the callback infrastructure: SRCU and Tasks RCU are isolated behind wrapper functions, the segment compaction logic is factored out for reuse, gp_seq is widened to struct rcu_gp_oldstate, and RCU_GET_STATE_NOT_TRACKED is added for subsystems that do not track expedited GPs.
Commit 5 is the core change: rcu_segcblist_advance() checks both normal and expedited GP completion via poll_state_synchronize_rcu_full(), and rcu_accelerate_cbs() captures both GP sequences via get_state_synchronize_rcu_full(). SRCU wrappers become standalone implementations since they cannot use poll_state_synchronize_rcu_full() which reads RCU-specific globals.
Commits 7-9 fix three notification paths so that expedited GP completion triggers callback processing: NOCB rcuog kthreads are woken, rcu_pending() detects the completion, and rcu_core() advances the callbacks.
Commit 10 adds nexp and exp_interval parameters to rcuscale for testing callback drain under concurrent expedited GP load.
Puranjay Mohan (10):
rcu/segcblist: Add SRCU and Tasks RCU wrapper functions rcu/segcblist: Factor out rcu_segcblist_advance_compact() helper rcu/segcblist: Change gp_seq to struct rcu_gp_oldstate gp_seq_full
rcu: Add RCU_GET_STATE_NOT_TRACKED for subsystems without expedited
GPs
rcu: Enable RCU callbacks to benefit from expedited grace periods
rcu: Update comments for gp_seq_full and expedited GP tracking
rcu: Wake NOCB rcuog kthreads on expedited grace period completion
rcu: Detect expedited grace period completion in rcu_pending()
rcu: Advance callbacks for expedited GP completion in rcu_core()
rcuscale: Add concurrent expedited GP threads for callback scaling
tests
include/linux/rcu_segcblist.h | 16 ++-- include/trace/events/rcu.h | 5 +- kernel/rcu/rcu.h | 13 ++- kernel/rcu/rcu_segcblist.c | 145 ++++++++++++++++++++++++---------- kernel/rcu/rcu_segcblist.h | 8 +- kernel/rcu/rcuscale.c | 84 +++++++++++++++++++- kernel/rcu/srcutree.c | 14 ++-- kernel/rcu/tasks.h | 8 +- kernel/rcu/tree.c | 54 +++++++++---- kernel/rcu/tree.h | 1 + kernel/rcu/tree_exp.h | 1 + kernel/rcu/tree_nocb.h | 77 ++++++++++++++---- 12 files changed, 324 insertions(+), 102 deletions(-)
base-commit: 51289896149317e0b6a4abf5d300a569c3353dca
Signature · 1 line
2.52.0