Skip to contentSkip to conversation

DAMON Quaterly News Letter (2024 Q3)

DISCUSSION SeongJae Park 1 participant 1 message Oct 1, 2024

Subsystems (2)
lore
Share & tools
lore

SeongJae Park

author maintainer
#0 lore raw

Hello DAMON community,

Three more months have passed since the last DAMON quaterly news letter[0]. Let's look back what happened in the last three months.

Highlights of Highlights
========================

- New features. DAMON-based CXL memory tiering patchset has merged[1] into the mainline.
- More users. DAMON usages from AWS Aurora Serverless v2 has unveiled[6]. CONFIG_DAMON has enabled[9] on Debian kernels. Six more academic papers that exploring and/or utilizing DAMON has published or archived on OSDI[2,3], ATC[4,5], VLDB[6], and ArXiv[7]. Monthly PyPI downloads of DAMON user-space tool (DAMO) has significantly increase.
- Re:org. DAMON github repos have moved[8] from awslabs org to damonitor org.
- Conferences: Detailed DAMON usages from products and labs have presented on
OSS EU[10] and the VLDB paper[6]. Long-term DAMON plans for kernel that extensible and just works have shared and discussed[11] on LPC.

More detailed list of news per each month follows.

July 2024
=========

A couple of OSDI'24 papers[2,3] for memory tiering that references and exploring DAMON as a part of them are published.

ATC'24 also published two DAMON-citing papers at the same time. The first one[4] proposes a way to improve monitoring accuracy of DAMON, while the second one[5] mentions DAMON can be useful for extensible memory management.

VLDB paper about Aurora Serverless V2, which reveals their usage of DAMON on the product, is uploaded[6].

Memory Management subsystem pull request for Linux v6.11-rc1 with DAMON changes for CXL memory tiering has merged[1].

August 2024
===========

GitHub repos for non-kernel parts of DAMON project including 'damo', 'damon-tests' and 'damoos' have announced[8] to be moved from awslabs org to damonitor org. As of this writing, the reorganization is completed.

September 2024
==============

CONFIG_DAMON is enabled[9] on Debian kernels.

An academic paper preprint that optimizes THP using DAMON and BPF has uploaded[7] to ArXiv.

DAMON usages from labs and real-world products for profiling-guided optimizations, proactive reclamation (Auroa Serverless v2), and CXL memory tiering (SK hynix HMSDK) have shared[10] on Linux Conference at OSSummit EU'24.

DAMON long-term plans for making kernel extensible and just works have shared and discussed on Kernel Memory Management Micro-Conference[11] at LPC'24.

Monthly PyPI downloads of DAMON user-space tool (DAMO) surpassed 4,000. It took about 7 months since the record of 2,000 (2024-02), which took about 18 months from the beginning. The speed is apparently growing.

Previous quaterly news letters
==============================

- 2024 Q2: https://lore.kernel.org/[email protected]
- 2024 Q1: https://lore.kernel.org/[email protected]

More Past DAMON News
====================

If you're interested in a humblie list of more DAMON events that happened in past and curated by DAMON maintainer, please reach out to the project site's news page [12].

References
==========

[0] "DAMON Quaterly News Letter (2024 Q3)",

    https://lore.kernel.org/[email protected]
[1] "MM updates for 6.11-rc1",
    https://lore.kernel.org/[email protected]

[2] "Nomad: Non-Exclusive Memory Tiering via Transactional Page Migration",
https://www.usenix.org/conference/osdi24/presentation/xiang
[3] "Managing Memory Tiers with CXL in Virtualized Environments",
https://www.usenix.org/conference/osdi24/presentation/zhong-yuhong
[4] "Telescope: Telemetry for Gargantuan Memory Footprint Applications",
https://www.usenix.org/conference/atc24/presentation/nair
[5] "FBMM: Making Memory Management Extensible With Filesystems",
https://www.usenix.org/conference/atc24/presentation/tabatabai
[6] "Resource management in Aurora Serverless",
https://www.amazon.science/publications/resource-management-in-aurora-serverless
[7] "eBPF-mm: Userspace-guided memory management in Linux with eBPF",

    https://arxiv.org/pdf/2409.11220
[8] https://lore.kernel.org/all/[email protected]/
[9] https://salsa.debian.org/kernel-team/linux/-/merge_requests/1172
[10] "DAMON Recipes: Ways to Save Memory Using a Linux Kernel Subsystem in the Real World",
     https://sched.co/1ej2S
[11] "DAMON: Long-term Plans for Kernel That {Just Works,Extensible}",
     https://lpc.events/event/18/contributions/1768/

[12] https://sjp38.github.io/post/damon_news/

Wrapup
======

So, those were yet another grateful three months. Looking forward to get more news! If you have any question regarding DAMON, please feel free to reach out to the community and/or me.

Thanks,
SJ