Skip to content

mm/damon: support access monitoring of hugetlb-backed memory

SJ Park damon linux-mm lkml 1 version Applied

Status from this message: [merged mm-stable] mm-damon-paddr-support-hugetlb-folios-in-access-monitoring.patch removed from -mm tree

Get series with b4
b4 am [email protected]

Versions newest first

  1. v3 Latest3 patches 1 replyApplied 3/3

Changes in v3 from the cover letter

- v2: https://lore.kernel.org/[email protected]
- Drop verbose comments on damon_get_monitor_folio().
- Collect R-b: from SJ for patches 2 and 3.
- None.

Patches in v3 All 3 applied

#Subject and filesSizeRepliesApplied
1/3mm/damon: move damon_hugetlb_mkold() from vaddr to ops-commonmm/damon/ops-common.c mm/damon/ops-common.h mm/damon/vaddr.c+46 -340 repliesApplied
2/3mm/damon/ops-common: handle hugetlb folios in folio mkold/young rmap walkersmm/damon/ops-common.c+47 -140 repliesApplied
3/3mm/damon/paddr: support hugetlb folios in access monitoringmm/damon/ops-common.c mm/damon/ops-common.h mm/damon/paddr.c+24 -60 repliesApplied

Reviews trailers per patch

All 3 patches have a Reviewed-by or Acked-by.

PatchSJ Park
1/3R-b
2/3R-b
3/3R-b

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.

Read the v3 thread

Cover letter [PATCH v3 0/3] mm/damon: support access monitoring of hugetlb-backed memory

From: Krishna Iyer <[email protected]>

On virtualization hosts, most system memory is often backed by hugetlbfs. On our production hosts, for example, ~95% of RAM is 1 GiB hugetlb pages backing guest memory. DAMON's physical address space monitoring is blind to such memory: every access check starts at damon_get_folio(), which rejects folios that are not on the LRU lists, and hugetlb folios are managed outside of the LRU by design. As a result, all hugetlb-backed memory is silently reported as never accessed. In testing on a 1 TiB host, an hour of 4-thread random access over 842 GiB inside a guest was statistically indistinguishable from an idle host.

The first patch moves damon_hugetlb_mkold() from vaddr to ops-common as a preparation. The second patch teaches the folio mkold/young rmap walkers to handle hugetlb folios, aging the huge PTE and notifying secondary MMUs across the whole huge page size; the secondary MMU notification is what surfaces guest-side (e.g., KVM/EPT) accessed bits. The third patch adds damon_get_monitor_folio() and uses it from the paddr monitoring primitives only. DAMOS action appliers such as DAMON_RECLAIM and DAMON_LRU_SORT keep the LRU-only lookup and are behaviorally unchanged.

This series is the first half of an earlier six-patch series [1], split out as SJ suggested [2]. The second half (the 'aging_flush' TLB-flush-assisted aging) is deferred: we will gather more quantitative data on the gap it addresses, including the workload-side impact of the flushes and the working set measurement details SJ asked about, and post it separately once the data is in hand, aligned with the ongoing monitoring preparation actions work.

Per Documentation/process/generated-content.rst, this series was developed with the assistance of an AI coding assistant (Anthropic Claude, via Claude Code). The assistant helped draft the code and changelogs, and applied the v1 review feedback. All changes were reviewed by the human submitter, who takes full responsibility for the contribution.

The series as posted here was regression-tested on its base commit with a full x86_64 kernel build (no W=1 warnings in mm/damon), the DAMON kunit suite (41/41 passing) and the DAMON selftests (15/15 passing) on a kernel booted with virtme-ng.

Changes from v2
- v2: https://lore.kernel.org/[email protected]
- Drop verbose comments on damon_get_monitor_folio().
- Collect R-b: from SJ for patches 2 and 3.
- None.
Changes from v1
(https://lore.kernel.org/[email protected])
- Split the first three patches out as their own series, deferring the aging_flush patches (old patches 4-6) until more quantitative data is gathered (SJ Park)
- Drop too verbose comments on the hugetlb branches of the rmap walkers (SJ Park)
- Factor the non-hugetlb PTE young check out into damon_pte_young() to reduce indentation (SJ Park)
- Rename damon_get_folio_incl_hugetlb() to damon_get_monitor_folio() and damon_folio_observable(folio, incl_hugetlb) to damon_folio_acceptable(folio, monitor) (SJ Park)
- Drop 'kernel' from the host-side monitoring example in the patch 3 changelog, since kernel memory is not LRU-managed and hence not monitorable regardless (SJ Park)
- Add SJ's Reviewed-by to patch 1

[1] https://lore.kernel.org/[email protected]
[2] https://lore.kernel.org/[email protected]

Krishna Iyer (3):
mm/damon: move damon_hugetlb_mkold() from vaddr to ops-common mm/damon/ops-common: handle hugetlb folios in folio mkold/young rmap
walkers
mm/damon/paddr: support hugetlb folios in access monitoring

 mm/damon/ops-common.c | 123 +++++++++++++++++++++++++++++++++++-------
 mm/damon/ops-common.h |  10 ++++
 mm/damon/paddr.c      |   4 +-
 mm/damon/vaddr.c      |  34 ------------
 4 files changed, 117 insertions(+), 54 deletions(-)

base-commit: 7aef702c0e8b9870275f8ec9ac1d63dc1d254a2a

Signature · 1 line
2.47.3