Skip to content

rcu/context-tracking: Merge RCU eqs-dynticks counter to context tracking

Frederic Weisbecker lkml 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest19 patches 37 repliesIn review

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/19context_tracking: Rename __context_tracking_enter/exit() to __ct_user_enter/exit()include/linux/context_tracking.h kernel/context_tracking.c+16 -161 reply
2/19context_tracking: Rename context_tracking_user_enter/exit() to user_enter/exit_callable()arch/arm/kernel/entry-header.S arch/csky/kernel/entry.S arch/riscv/kernel/entry.S +2 more+25 -152 replies
3/19context_tracking: Rename context_tracking_enter/exit() to ct_user_enter/exit()include/linux/context_tracking.h kernel/context_tracking.c+13 -122 replies
4/19context_tracking: Rename context_tracking_cpu_set() to context_tracking_cpu_track_user()include/linux/context_tracking.h kernel/context_tracking.c kernel/time/tick-sched.c+4 -42 replies
5/19context_tracking: Split user tracking KconfigDocumentation/features/time/context-tracking/arch-support.txt arch/Kconfig arch/arm/Kconfig +19 more+54 -462 replies
6/19context_tracking: Take idle eqs entrypoints over RCUDocumentation/RCU/stallwarn.rst arch/arm/mach-imx/cpuidle-imx6q.c drivers/acpi/processor_idle.c +9 more+44 -202 replies
7/19context_tracking: Take IRQ eqs entrypoints over RCUDocumentation/RCU/Design/Requirements/Requirements.rst Documentation/RCU/stallwarn.rst arch/Kconfig +13 more+81 -421 reply
8/19context_tracking: Take NMI eqs entrypoints over RCUDocumentation/RCU/Design/Requirements/Requirements.rst arch/Kconfig arch/arm64/kernel/entry-common.c +6 more+27 -131 reply
9/19rcu/context-tracking: Remove rcu_irq_enter/exit()include/linux/rcutiny.h include/linux/rcutree.h kernel/context_tracking.c +1 more+55 -952 replies
10/19rcu/context_tracking: Move dynticks counter to context trackinginclude/linux/context_tracking_state.h kernel/context_tracking.c kernel/rcu/tree.c +3 more+48 -371 reply
11/19rcu/context_tracking: Move dynticks_nesting to context trackinginclude/linux/context_tracking_state.h kernel/context_tracking.c kernel/rcu/tree.c +2 more+20 -172 replies
12/19rcu/context_tracking: Move dynticks_nmi_nesting to context trackinginclude/linux/context_tracking_state.h kernel/context_tracking.c kernel/rcu/rcu.h +3 more+27 -331 reply
13/19rcu/context-tracking: Move deferred nocb resched to context trackinginclude/linux/rcutree.h kernel/context_tracking.c kernel/rcu/tree.c+16 -131 reply
14/19rcu/context-tracking: Move RCU-dynticks internal functions to context_trackinginclude/linux/context_tracking.h include/linux/rcutree.h kernel/context_tracking.c +3 more+366 -3634 replies
15/19rcu/context-tracking: Remove unused and/or unecessary middle functionsinclude/linux/hardirq.h include/linux/rcutiny.h include/linux/rcutree.h +1 more+44 -1052 replies
16/19context_tracking: Convert state to atomic_tinclude/linux/context_tracking.h include/linux/context_tracking_state.h kernel/context_tracking.c+47 -284 replies
17/19rcu/context-tracking: Use accessor for dynticks counter valueinclude/linux/context_tracking_state.h kernel/context_tracking.c kernel/rcu/tree.c+26 -141 reply
18/19rcu/context_tracking: Merge dynticks counter and context tracking statesinclude/linux/context_tracking.h include/linux/context_tracking_state.h kernel/context_tracking.c +2 more+81 -633 replies
19/19context_tracking: Exempt CONFIG_HAVE_CONTEXT_TRACKING_USER_OFFSTACK from non-active trackingkernel/context_tracking.c+4 -32 replies

Reviews trailers per patch

9 of 19 patches have a Reviewed-by or Acked-by.

PatchPaul E. McKenney
1/19A-b
2/19
3/19
4/19
5/19
6/19
7/19A-b
8/19A-b
9/19
10/19A-b
11/19A-b
12/19A-b
13/19A-b
14/19A-b
15/19
16/19
17/19A-b
18/19
19/19

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.

Read the v1 thread

Cover letter [PATCH 00/19] rcu/context-tracking: Merge RCU eqs-dynticks counter to context tracking

This mixes up the RCU dynticks counter and the context tracking state updates into a single atomic instruction. This may serve several purposes:

1) Improve CPU isolation with deferring some disturbances until sensitive userspace workload completes and goes to the kernel. This can take several forms, for example smp_call_function_housekeeping() or on_each_housekeeping_cpu() to enqueue and execute work on all housekeeping CPUs. Then an atomic operation on ct->state can defer the work on nohz_full CPUs until they run in kernel (or IPI them if they are in kernel mode), see this proposal by Peter:
https://lore.kernel.org/all/[email protected]/#r

2) Unearth sysidle (https://git.kernel.org/pub/scm/linux/kernel/git/paulmck/linux-rcu.git/commit/?h=sysidle.2017.05.11a&id=fe5ac724d81a3c7803e60c2232718f212f3f38d4)
This feature allowed to shutdown the tick on the last housekeeping
CPU once the rest of the system is fully idle. We needed some proper
fully ordered context tracking for that.

Inspired by Peterz: https://lore.kernel.org/all/[email protected]

git://git.kernel.org/pub/scm/linux/kernel/git/frederic/linux-dynticks.git
rcu/context-tracking

HEAD: e4eaff86ec91c1cbde9a113cf5232dac9f897337

Thanks,
Frederic
---

Frederic Weisbecker (19):
context_tracking: Rename __context_tracking_enter/exit() to __ct_user_enter/exit()
context_tracking: Rename context_tracking_user_enter/exit() to user_enter/exit_callable()
context_tracking: Rename context_tracking_enter/exit() to ct_user_enter/exit()
context_tracking: Rename context_tracking_cpu_set() to context_tracking_cpu_track_user()
context_tracking: Split user tracking Kconfig
context_tracking: Take idle eqs entrypoints over RCU
context_tracking: Take IRQ eqs entrypoints over RCU
context_tracking: Take NMI eqs entrypoints over RCU
rcu/context-tracking: Remove rcu_irq_enter/exit()
rcu/context_tracking: Move dynticks counter to context tracking rcu/context_tracking: Move dynticks_nesting to context tracking rcu/context_tracking: Move dynticks_nmi_nesting to context tracking rcu/context-tracking: Move deferred nocb resched to context tracking rcu/context-tracking: Move RCU-dynticks internal functions to context_tracking rcu/context-tracking: Remove unused and/or unecessary middle functions
context_tracking: Convert state to atomic_t
rcu/context-tracking: Use accessor for dynticks counter value rcu/context_tracking: Merge dynticks counter and context tracking states
context_tracking: Exempt CONFIG_HAVE_CONTEXT_TRACKING_USER_OFFSTACK from non-active tracking

 .../RCU/Design/Requirements/Requirements.rst       |  10 +-
 Documentation/RCU/stallwarn.rst                    |   6 +-
 .../time/context-tracking/arch-support.txt         |   6 +-
 arch/Kconfig                                       |   8 +-
 arch/arm/Kconfig                                   |   2 +-
 arch/arm/kernel/entry-common.S                     |   4 +-
 arch/arm/kernel/entry-header.S                     |  12 +-
 arch/arm/mach-imx/cpuidle-imx6q.c                  |   5 +-
 arch/arm64/Kconfig                                 |   2 +-
 arch/arm64/kernel/entry-common.c                   |  14 +-
 arch/csky/Kconfig                                  |   2 +-
 arch/csky/kernel/entry.S                           |   8 +-
 arch/mips/Kconfig                                  |   2 +-
 arch/powerpc/Kconfig                               |   2 +-
 arch/powerpc/include/asm/context_tracking.h        |   2 +-
 arch/riscv/Kconfig                                 |   2 +-
 arch/riscv/kernel/entry.S                          |  12 +-
 arch/sparc/Kconfig                                 |   2 +-
 arch/sparc/kernel/rtrap_64.S                       |   2 +-
 arch/x86/Kconfig                                   |   4 +-
 arch/x86/mm/fault.c                                |   2 +-
 drivers/acpi/processor_idle.c                      |   5 +-
 drivers/cpuidle/cpuidle-psci.c                     |   8 +-
 drivers/cpuidle/cpuidle.c                          |   9 +-
 include/linux/context_tracking.h                   |  81 ++--
 include/linux/context_tracking_irq.h               |  21 +
 include/linux/context_tracking_state.h             |  92 +++-
 include/linux/entry-common.h                       |  10 +-
 include/linux/hardirq.h                            |  12 +-
 include/linux/rcupdate.h                           |   7 +-
 include/linux/rcutiny.h                            |   6 -
 include/linux/rcutree.h                            |  15 +-
 include/linux/tracepoint.h                         |   4 +-
 init/Kconfig                                       |   4 +-
 kernel/context_tracking.c                          | 526 +++++++++++++++++++--
 kernel/cpu_pm.c                                    |   8 +-
 kernel/entry/common.c                              |  16 +-
 kernel/extable.c                                   |   4 +-
 kernel/locking/lockdep.c                           |   2 +-
 kernel/rcu/Kconfig                                 |   2 +
 kernel/rcu/rcu.h                                   |   4 -
 kernel/rcu/tree.c                                  | 478 ++-----------------
 kernel/rcu/tree.h                                  |   8 -
 kernel/rcu/tree_exp.h                              |   2 +-
 kernel/rcu/tree_plugin.h                           |  36 +-
 kernel/rcu/tree_stall.h                            |   7 +-
 kernel/rcu/update.c                                |   2 +-
 kernel/sched/core.c                                |   2 +-
 kernel/sched/idle.c                                |  11 +-
 kernel/softirq.c                                   |   4 +-
 kernel/time/Kconfig                                |  22 +-
 kernel/time/tick-sched.c                           |   2 +-
 kernel/trace/trace.c                               |   8 +-
 53 files changed, 793 insertions(+), 734 deletions(-)