Skip to content

Latest numa/core release, v16

Ingo Molnar linux-mm lkml 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest27 patches 40 repliesIn review

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/27mm/generic: Only flush the local TLB in ptep_set_access_flags()mm/pgtable-generic.c+3 -30 replies
2/27x86/mm: Only do a local tlb flush in ptep_set_access_flags()arch/x86/mm/pgtable.c+8 -10 replies
3/27x86/mm: Introduce pte_accessible()arch/x86/include/asm/pgtable.h include/asm-generic/pgtable.h+10 -00 replies
4/27mm: Only flush the TLB when clearing an accessible ptemm/pgtable-generic.c+2 -10 replies
5/27x86/mm: Completely drop the TLB flush from ptep_set_access_flags()arch/x86/mm/pgtable.c+0 -10 replies
6/27mm: Count the number of pages affected in change_protection()include/linux/hugetlb.h include/linux/mm.h mm/hugetlb.c +1 more+61 -180 replies
7/27mm: Optimize the TLB flush of sys_mprotect() and change_protection() usersmm/mprotect.c+3 -10 replies
8/27sched, numa, mm: Add last_cpu to page flagsinclude/linux/mm.h include/linux/mm_types.h include/linux/mmzone.h +3 more+146 -540 replies
9/27sched, mm, numa: Create generic NUMA fault infrastructure, with architectures overridesinclude/asm-generic/pgtable.h include/linux/huge_mm.h include/linux/mempolicy.h +12 more+430 -190 replies
10/27sched: Make find_busiest_queue() a methodkernel/sched/fair.c+12 -80 replies
11/27sched, numa, mm: Describe the NUMA scheduling problem formallyDocumentation/scheduler/numa-problem.txt+230 -00 replies
12/27numa, mm: Support NUMA hinting page faults from gup/gup_fastinclude/linux/mm.h mm/memory.c+18 -00 replies
13/27mm/migrate: Introduce migrate_misplaced_page()include/linux/migrate.h include/linux/migrate_mode.h mm/migrate.c+77 -90 replies
14/27sched, numa, mm, arch: Add variable locality exceptionarch/sh/mm/Kconfig init/Kconfig+8 -00 replies
15/27sched, numa, mm: Add credits for NUMA placementCREDITS kernel/sched/fair.c mm/memory.c+6 -00 replies
16/27sched, mm, x86: Add the ARCH_SUPPORTS_NUMA_BALANCING flaginit/Kconfig+7 -00 replies
17/27sched, numa, mm: Add the scanning page fault machineryinclude/linux/init_task.h include/linux/mempolicy.h include/linux/mm_types.h +6 more+294 -220 replies
18/27sched: Add adaptive NUMA affinity supportDocumentation/scheduler/numa-problem.txt arch/x86/Kconfig include/linux/sched.h +4 more+900 -1970 replies
19/27sched: Implement constant, per task Working Set Sampling (WSS) rateinclude/linux/mm_types.h include/linux/sched.h kernel/sched/fair.c +1 more+38 -120 replies
20/27sched, numa, mm: Count WS scanning against present PTEs, not virtual memory rangeskernel/sched/fair.c+21 -160 replies
21/27sched: Implement slow start for working set samplinginclude/linux/sched.h kernel/sched/core.c kernel/sched/fair.c +1 more+19 -70 replies
22/27sched, numa, mm: Interleave shared tasksmm/mempolicy.c+40 -140 replies
23/27sched: Implement NUMA scanning backoffkernel/sched/core.c kernel/sched/fair.c+13 -10 replies
24/27sched: Improve convergencekernel/sched/fair.c kernel/sched/features.h+33 -150 replies
25/27sched: Introduce staged average NUMA faultsinclude/linux/sched.h kernel/sched/fair.c+18 -30 replies
26/27sched: Track groups of shared tasksinclude/linux/sched.h kernel/sched/core.c kernel/sched/fair.c+151 -30 replies
27/27sched: Use the best-buddy 'ideal cpu' in balancing decisionskernel/sched/fair.c kernel/sched/features.h+34 -30 replies

Reviews trailers per patch

5 of 27 patches have a Reviewed-by or Acked-by of their own; the series has one for all of them.

PatchLinus TorvaldsPeter ZijlstraRik van RielAndrea ArcangeliLee SchermerhornMel GormanDan CarpenterDavid Rientjes
SeriesA-b A-b
1/27A-b A-b
2/27A-b A-b
3/27Fixed-by
4/27
5/27A-b A-b
6/27
7/27
8/27
9/27Original-Idea-by
10/27
11/27
12/27Originally-by
13/27R-b Based-on-work-by
14/27Named-by
15/27A-b
16/27
17/27Also-written-by
18/27
19/27Based-on-idea-by Bug-Found-By
20/27
21/27
22/27
23/27
24/27
25/27
26/27
27/27

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes. Scroll the table sideways for all 8 reviewers.

Read the v1 thread

Cover letter [PATCH 00/27] Latest numa/core release, v16

I'm pleased to announce the latest version of the numa/core tree.

Here are some quick, preliminary performance numbers on a 4-node, 32-way, 64 GB RAM system:

CONFIG_NUMA_BALANCING=y
-----------------------------------------------------------------------

  [ seconds         ]    v3.7  AutoNUMA   |  numa/core-v16    [ vs. v3.7]
  [ lower is better ]   -----  --------   |  -------------    -----------
                                          |
  numa01                340.3    192.3    |      139.4          +144.1%
  numa01_THREAD_ALLOC   425.1    135.1    |      121.1          +251.0%
  numa02                 56.1     25.3    |       17.5          +220.5%
                                          |
  [ SPECjbb transactions/sec ]            |
  [ higher is better         ]            |
                                          |
  SPECjbb single-1x32    524k     507k    |       638k           +21.7%

-----------------------------------------------------------------------

On my NUMA system the numa/core tree now significantly outperforms both the vanilla kernel and the AutoNUMA (v28) kernel, in these benchmarks. No NUMA balancing kernel has ever performed so well on this system.

It is notable that workloads where 'private' processing dominates (numa01_THREAD_ALLOC and numa02) are now very close to bare metal hard binding performance.

These are the main changes in this release:

- There are countless performance improvements. The new shared/private distinction metric we introduced in v15 is now further refined and is used in more places within the scheduler to converge in a better and more directed fashion.

- I restructured the whole tree to make it cleaner, to simplify its mm/ impact and in general to make it more mergable. It now includes either agreed-upon patches, or bare essentials that are needed to make the CONFIG_NUMA_BALANCING=y feature work. It is fully bisect tested - it builds and works at every point.

- The hard-coded "PROT_NONE" feature that reviewers complained about is now factored out and selectable on a per architecture basis. (the arch porting aspect of this is untested, but the basic fabric is there and should be pretty close to what we need.)

The generic PROT_NONE based facility can be used by architectures to prototype this feature quickly.

- I tried to pick up all fixes that were sent. Many thanks go to Hugh Dickins and Johannes Weiner! If I missed any fix or review feedback, please re-send, as the code base has changed significantly.

Future plans are to concentrate on converging 'shared' workloads even better, to address any pending review feedback, and to fix any regressions that might be remaining.

Bug reports, review feedback and suggestions are welcome!

Thanks,

Ingo

------------>

Andrea Arcangeli (1):
numa, mm: Support NUMA hinting page faults from gup/gup_fast

Ingo Molnar (9):
mm: Optimize the TLB flush of sys_mprotect() and change_protection()
users
sched, mm, numa: Create generic NUMA fault infrastructure, with
architectures overrides
sched, mm, x86: Add the ARCH_SUPPORTS_NUMA_BALANCING flag sched, numa, mm: Interleave shared tasks
sched: Implement NUMA scanning backoff
sched: Improve convergence
sched: Introduce staged average NUMA faults
sched: Track groups of shared tasks
sched: Use the best-buddy 'ideal cpu' in balancing decisions

Peter Zijlstra (11):
mm: Count the number of pages affected in change_protection() sched, numa, mm: Add last_cpu to page flags
sched: Make find_busiest_queue() a method
sched, numa, mm: Describe the NUMA scheduling problem formally mm/migrate: Introduce migrate_misplaced_page()
sched, numa, mm, arch: Add variable locality exception sched, numa, mm: Add the scanning page fault machinery
sched: Add adaptive NUMA affinity support
sched: Implement constant, per task Working Set Sampling (WSS) rate sched, numa, mm: Count WS scanning against present PTEs, not virtual
memory ranges
sched: Implement slow start for working set sampling

Rik van Riel (6):
mm/generic: Only flush the local TLB in ptep_set_access_flags() x86/mm: Only do a local tlb flush in ptep_set_access_flags() x86/mm: Introduce pte_accessible()
mm: Only flush the TLB when clearing an accessible pte x86/mm: Completely drop the TLB flush from ptep_set_access_flags() sched, numa, mm: Add credits for NUMA placement

 CREDITS                                  |    1 +
 Documentation/scheduler/numa-problem.txt |  236 ++++++
 arch/sh/mm/Kconfig                       |    1 +
 arch/x86/Kconfig                         |    2 +
 arch/x86/include/asm/pgtable.h           |    6 +
 arch/x86/mm/pgtable.c                    |    8 +-
 include/asm-generic/pgtable.h            |   59 ++
 include/linux/huge_mm.h                  |   12 +
 include/linux/hugetlb.h                  |    8 +-
 include/linux/init_task.h                |    8 +
 include/linux/mempolicy.h                |    8 +
 include/linux/migrate.h                  |    7 +
 include/linux/migrate_mode.h             |    3 +
 include/linux/mm.h                       |   99 ++-
 include/linux/mm_types.h                 |   10 +
 include/linux/mmzone.h                   |   14 +-
 include/linux/page-flags-layout.h        |   83 ++
 include/linux/sched.h                    |   52 +-
 init/Kconfig                             |   81 ++
 kernel/bounds.c                          |    4 +
 kernel/sched/core.c                      |   79 +-
 kernel/sched/fair.c                      | 1227 +++++++++++++++++++++++++-----
 kernel/sched/features.h                  |   10 +
 kernel/sched/sched.h                     |   38 +-
 kernel/sysctl.c                          |   45 +-
 mm/Makefile                              |    1 +
 mm/huge_memory.c                         |  163 ++++
 mm/hugetlb.c                             |   10 +-
 mm/internal.h                            |    5 +-
 mm/memcontrol.c                          |    7 +-
 mm/memory.c                              |  108 ++-
 mm/mempolicy.c                           |  183 ++++-
 mm/migrate.c                             |   81 +-
 mm/mprotect.c                            |   69 +-
 mm/numa.c                                |   73 ++
 mm/pgtable-generic.c                     |    9 +-
 36 files changed, 2492 insertions(+), 318 deletions(-)
 create mode 100644 Documentation/scheduler/numa-problem.txt
 create mode 100644 include/linux/page-flags-layout.h
 create mode 100644 mm/numa.c
Signature · 7 lines
1.7.11.7

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to [email protected].  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>