Skip to content

Add support for Sub-NUMA cluster (SNC) systems

Tony Luck linux-patches lkml 23 versions – Applied

Status from this message: The following commit has been merged into the x86/cache branch of tip:

Get series with b4
b4 am [email protected]

Versions newest first · linked by author and title

  1. v23 Latest19 patches 7 repliesApplied
  2. v2218 patches 5 repliesSuperseded
  3. v2118 patches 13 repliesSuperseded
Earlier versions · 20
VersionPostedPatchesRepliesStatus
v2018 patches42 repliesSuperseded
v1920 patches26 repliesSuperseded
v1817 patches24 repliesSuperseded
v179 patches16 repliesSuperseded
v169 patches11 repliesSuperseded
v158 patches0 repliesSuperseded
v148 patches1 replySuperseded
v138 patches11 repliesSuperseded
v128 patches10 repliesSuperseded
v118 patches16 repliesSuperseded
v108 patches8 repliesSuperseded
v98 patches8 repliesSuperseded
v88 patches7 repliesSuperseded
v78 patches3 repliesSuperseded
v68 patches15 repliesSuperseded
v58 patches58 repliesSuperseded
v47 patches26 repliesSuperseded
v38 patches33 repliesSuperseded
v27 patches18 repliesSuperseded
v17 patches26 repliesSuperseded

Patches in v23 Applied

#Subject and filesSizeRepliesApplied
1/19x86/resctrl: Prepare for new domain scopearch/x86/kernel/cpu/resctrl/core.c arch/x86/kernel/cpu/resctrl/ctrlmondata.c arch/x86/kernel/cpu/resctrl/pseudo_lock.c +2 more+49 -190 replies
2/19x86/resctrl: Prepare to split rdt_domain structurearch/x86/kernel/cpu/resctrl/core.c arch/x86/kernel/cpu/resctrl/ctrlmondata.c arch/x86/kernel/cpu/resctrl/monitor.c +3 more+81 -730 replies
3/19x86/resctrl: Prepare for different scope for control/monitor operationsarch/x86/kernel/cpu/resctrl/core.c arch/x86/kernel/cpu/resctrl/ctrlmondata.c arch/x86/kernel/cpu/resctrl/internal.h +4 more+240 -960 replies
4/19x86/resctrl: Split the rdt_domain and rdt_hw_domain structuresarch/x86/kernel/cpu/resctrl/core.c arch/x86/kernel/cpu/resctrl/ctrlmondata.c arch/x86/kernel/cpu/resctrl/internal.h +4 more+174 -1450 replies
5/19x86/resctrl: Add node-scope to the options for feature scopearch/x86/kernel/cpu/resctrl/core.c include/linux/resctrl.h+3 -00 replies
6/19x86/resctrl: Introduce snc_nodes_per_l3_cachearch/x86/kernel/cpu/resctrl/monitor.c+50 -61 reply
7/19x86/resctrl: Block use of mba_MBps mount option on Sub-NUMA Cluster (SNC) systemsarch/x86/kernel/cpu/resctrl/rdtgroup.c+9 -30 replies
8/19x86/resctrl: Prepare for new Sub-NUMA Cluster (SNC) monitor filesarch/x86/kernel/cpu/resctrl/core.c arch/x86/kernel/cpu/resctrl/pseudo_lock.c arch/x86/kernel/cpu/resctrl/rdtgroup.c +1 more+9 -30 replies
9/19x86/resctrl: Add a new field to struct rmid_read for summation of domainsarch/x86/kernel/cpu/resctrl/internal.h+19 -00 replies
10/19x86/resctrl: Initialize on-stack struct rmid_read instancesarch/x86/kernel/cpu/resctrl/ctrlmondata.c arch/x86/kernel/cpu/resctrl/monitor.c arch/x86/kernel/cpu/resctrl/rdtgroup.c+3 -50 replies
11/19x86/resctrl: Refactor mkdir_mondata_subdir() with a helper functionarch/x86/kernel/cpu/resctrl/rdtgroup.c+28 -170 replies
12/19x86/resctrl: Allocate a new field in union mon_data_bitsarch/x86/kernel/cpu/resctrl/internal.h+13 -70 replies
13/19x86/resctrl: Create Sub-NUMA Cluster (SNC) monitor filesarch/x86/kernel/cpu/resctrl/rdtgroup.c+46 -160 replies
14/19x86/resctrl: Handle removing directories in Sub-NUMA Cluster (SNC) modearch/x86/kernel/cpu/resctrl/rdtgroup.c+33 -73 replies
15/19x86/resctrl: Fill out rmid_read structure for smp_call*() to read a counterarch/x86/kernel/cpu/resctrl/ctrlmondata.c arch/x86/kernel/cpu/resctrl/internal.h arch/x86/kernel/cpu/resctrl/rdtgroup.c+34 -100 replies
16/19x86/resctrl: Make __mon_event_count() handle sum domainsarch/x86/kernel/cpu/resctrl/monitor.c+42 -90 replies
17/19x86/resctrl: Enable shared RMID mode on Sub-NUMA Cluster (SNC) systemsarch/x86/include/asm/msr-index.h arch/x86/kernel/cpu/resctrl/core.c arch/x86/kernel/cpu/resctrl/internal.h +1 more+31 -01 reply
18/19x86/resctrl: Sub-NUMA Cluster (SNC) detectionarch/x86/kernel/cpu/resctrl/monitor.c+66 -00 replies
19/19x86/resctrl: Update documentation with Sub-NUMA cluster changesDocumentation/arch/x86/resctrl.rst+27 -00 replies

Reviews trailers per patch

18 of 19 patches have a Reviewed-by or Acked-by.

PatchReinette ChatreBabu Moger
SeriesT-b
1/19R-b
2/19R-b
3/19R-b
4/19R-b
5/19R-b
6/19R-b
7/19R-b
8/19R-b
9/19
10/19R-b
11/19R-b
12/19R-b
13/19R-b
14/19R-b
15/19R-b
16/19R-b
17/19R-b
18/19R-b
19/19R-b

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.

Read the v23 thread

Cover letter [PATCH v23 00/19] Add support for Sub-NUMA cluster (SNC) systems

This series based on top of tip x86/cache commit f385f0246394 ("x86/resctrl: Replace open coded cacheinfo searches")

The Sub-NUMA cluster feature on some Intel processors partitions the CPUs that share an L3 cache into two or more sets. This plays havoc with the Resource Director Technology (RDT) monitoring features. Prior to this patch Intel has advised that SNC and RDT are incompatible.

Some of these CPUs support an MSR that can partition the RMID counters in the same way. This allows monitoring features to be used. Legacy monitoring files provide the sum of counters from each SNC node for backwards compatibility. Additional files per SNC node provide details per node.

Memory bandwidth allocation features continue to operate at the scope of the L3 cache.

L3 cache occupancy and allocation operate on the portion of L3 cache available for each SNC node.

---
Changes since v21: https://lore.kernel.org/all/[email protected]/

No net code changes (final version v23 == v22)

* Patch 9 split into two (9 & 10 in this series) Added Reinette's Reviewed-by tag to both.
* Added Reinette's Reviewed-by tag to parts 15 & 16 (were 14, 15 in v22)

Tony Luck (19):
x86/resctrl: Prepare for new domain scope
x86/resctrl: Prepare to split rdt_domain structure x86/resctrl: Prepare for different scope for control/monitor
operations
x86/resctrl: Split the rdt_domain and rdt_hw_domain structures x86/resctrl: Add node-scope to the options for feature scope x86/resctrl: Introduce snc_nodes_per_l3_cache
x86/resctrl: Block use of mba_MBps mount option on Sub-NUMA Cluster
(SNC) systems
x86/resctrl: Prepare for new Sub-NUMA Cluster (SNC) monitor files x86/resctrl: Add a new field to struct rmid_read for summation of
domains
x86/resctrl: Initialize on-stack struct rmid_read instances x86/resctrl: Refactor mkdir_mondata_subdir() with a helper function x86/resctrl: Allocate a new field in union mon_data_bits x86/resctrl: Create Sub-NUMA Cluster (SNC) monitor files x86/resctrl: Handle removing directories in Sub-NUMA Cluster (SNC)
mode
x86/resctrl: Fill out rmid_read structure for smp_call*() to read a
counter
x86/resctrl: Make __mon_event_count() handle sum domains x86/resctrl: Enable shared RMID mode on Sub-NUMA Cluster (SNC) systems x86/resctrl: Sub-NUMA Cluster (SNC) detection
x86/resctrl: Update documentation with Sub-NUMA cluster changes

 Documentation/arch/x86/resctrl.rst        |  27 ++
 include/linux/resctrl.h                   |  88 ++++--
 arch/x86/include/asm/msr-index.h          |   1 +
 arch/x86/kernel/cpu/resctrl/internal.h    | 108 +++++---
 arch/x86/kernel/cpu/resctrl/core.c        | 312 ++++++++++++++++------
 arch/x86/kernel/cpu/resctrl/ctrlmondata.c |  89 +++---
 arch/x86/kernel/cpu/resctrl/monitor.c     | 256 +++++++++++++++---
 arch/x86/kernel/cpu/resctrl/pseudo_lock.c |  27 +-
 arch/x86/kernel/cpu/resctrl/rdtgroup.c    | 281 ++++++++++++-------
 9 files changed, 865 insertions(+), 324 deletions(-)

base-commit: f385f024639431bec3e70c33cdbc9563894b3ee5

Signature · 1 line
2.45.2