Skip to content

Improvements to RT response on big systems and expedited functions

Paul E. McKenney lkml 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest23 patches 61 repliesIn review

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/23rcu: Move RCU grace-period initialization into a kthreadkernel/rcutree.c kernel/rcutree.h+130 -643 replies
2/23rcu: Allow RCU grace-period initialization to be preemptedkernel/rcutree.c+10 -72 replies
3/23rcu: Move RCU grace-period cleanup into kthreadkernel/rcutree.c+62 -503 replies
4/23rcu: Allow RCU grace-period cleanup to be preemptedkernel/rcutree.c+5 -61 reply
5/23rcu: Prevent offline CPUs from executing RCU core codekernel/rcutree.c+2 -01 reply
6/23rcu: Break up rcu_gp_kthread() into subfunctionskernel/rcutree.c+138 -1227 replies
7/23rcu: Provide OOM handler to motivate lazy RCU callbackskernel/rcutree.h kernel/rcutree_plugin.h+84 -18 replies
8/23rcu: Segregate rcu_state fields to improve cache localitykernel/rcutree.h+2 -11 reply
9/23rcu: Move quiescent-state forcing into kthreadkernel/rcutree.c kernel/rcutree.h kernel/rcutree_plugin.h+82 -1300 replies
10/23rcu: Allow RCU quiescent-state forcing to be preemptedkernel/rcutree.c+1 -01 reply
11/23rcu: Adjust debugfs tracing for kthread-based quiescent-state forcingDocumentation/RCU/trace.txt kernel/rcutree.h kernel/rcutree_trace.c+17 -301 reply
12/23rcu: Prevent force_quiescent_state() memory contentionkernel/rcutree.c kernel/rcutree.h+38 -101 reply
13/23rcu: Control grace-period duration from sysfsDocumentation/kernel-parameters.txt kernel/rcutree.c+33 -36 replies
14/23rcu: Remove now-unused rcu_state fieldskernel/rcutree.h+0 -73 replies
15/23rcu: Make rcutree module parameters visible in sysfskernel/rcutree.c+4 -41 reply
16/23rcu: Prevent initialization-time quiescent-state racekernel/rcutree.c+19 -147 replies
17/23rcu: Fix day-zero grace-period initialization/cleanup racekernel/rcutree.c+13 -233 replies
18/23rcu: Add random PROVE_RCU_DELAY to grace-period initializationkernel/rcutree.c+5 -03 replies
19/23rcu: Adjust for unconditional ->completed assignmentkernel/rcutree.c+3 -11 reply
20/23rcu: Remove callback acceleration from grace-period initializationkernel/rcutree.c+0 -191 reply
21/23rcu: Eliminate signed overflow in synchronize_rcu_expedited()kernel/rcutree_plugin.h+4 -41 reply
22/23rcu: Reduce synchronize_rcu_expedited() latencykernel/rcutree_plugin.h+22 -81 reply
23/23rcu: Simplify quiescent-state detectionkernel/rcutree.c kernel/rcutree.h kernel/rcutree_plugin.h +1 more+16 -275 replies

Reviews trailers per patch

20 of 23 patches have a Reviewed-by or Acked-by.

PatchDimitri SivanichSasha LevinJosh Triplett
1/23R-b
2/23R-b
3/23R-b
4/23R-b
5/23R-b
6/23R-b
7/23T-b R-b
8/23T-b R-b
9/23
10/23R-b
11/23R-b
12/23
13/23R-b
14/23R-b
15/23R-b
16/23
17/23R-b
18/23R-b
19/23R-b
20/23R-b
21/23R-b
22/23R-b
23/23R-b

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes. Scroll the table sideways for all 3 reviewers.

Read the v1 thread

Cover letter [PATCH tip/core/rcu 0/23] Improvements to RT response on big systems and expedited functions

Hello!

This patch series contains additional improvements to latency for large systems (beyond those in 3.6), along with improvements to synchronize_rcu_expedited(). It also fixes one race introduced by the latency improvements and another that was there to start with (but made more probable by the latency improvements). These are in a single series due to conflicts that would otherwise occur. The individual patches are as follows:

1-6. Move RCU grace-period initialization and cleanup into a kthread:
1. Move RCU grace-period initialization into kthread.
2. Allow RCU grace-period initialization to be preempted.
3. Move RCU grace-period cleanup into kthread.
4. Allow RCU grace-period cleanup to be preempted.
5. Prevent offline CPUs from executing RCU core code.
6. Break up rcu_gp_kthread() into subfunctions.
7. Provide an OOM handler to allow lazy callbacks to be motivated
under memory pressure.
8. Segregate rcu_state fields to improve cache locality
(Courtesy of Dimitri Sivanich).
9-12. Move RCU grace-period forcing into a kthread.
9. Move quiescent-state forcing into kthread.
10. Allow RCU quiescent-state forcing to be preempted.
11. Adjust debugfs tracing for kthread-based quiescent-state
forcing.
12. Prevent force_quiescent_state() memory contention.
13. Control grace-period duration from sysfs.
14. Remove now-unused rcu_state fields.
15. Make rcutree module parameters visible in sysfs.
16. Prevent initialization-time quiescent-state race.
17. Fix day-zero grace-period initialization/cleanup race.
18. Add random PROVE_RCU_DELAY to provoke initalization races.
19. Adjust for unconditional ->completed assignment.
20. Remove callback acceleration from grace-period initialization
due it no longer being safe.
21. Eliminate signed overflow in synchronize_rcu_expedited().
22. Reduce synchronize_rcu_expedited() latency.
23. Simplify quiescent-state detection.

Thanx, Paul

------------------------------------------------------------------------

 b/Documentation/RCU/trace.txt         |   43 -
 b/Documentation/kernel-parameters.txt |   11 
 b/kernel/rcutree.c                    |  191 +++++---
 b/kernel/rcutree.h                    |    3 
 b/kernel/rcutree_plugin.h             |   80 +++
 b/kernel/rcutree_trace.c              |    3 
 kernel/rcutree.c                      |  805 +++++++++++++++++-----------------
 kernel/rcutree.h                      |   25 -
 kernel/rcutree_plugin.h               |   48 +-
 kernel/rcutree_trace.c                |   12 
 10 files changed, 690 insertions(+), 531 deletions(-)