Skip to contentSkip to conversation

DAMON Updates and Future Plans

LSF/MM/BPF TOPIC SeongJae Park 2 participants 5 messages Feb 14, 2023 – May 13, 2023

Subsystems (2)
lore
Share & tools
lore

SeongJae Park

author maintainer
#0 lore raw

Hi all,

DAMON has merged into mainline as a data access monitoring tool that equips a best-effort overhead-accuracy tradeoff mechanism, and then extended for data access-aware system operations. I'd like to briefly introduce current state of DAMON and share/discuss about 2023 plans including below.

- Finer and easier-to-use DAMOS tuning
- tuning aggressiveness based on user or kernel feed (e.g., QPS or PSI)
- Merging DAMON user space tool into the mainline
- Extending DAMON
- Page-granularity monitoring
- LRU-lists based page-granulariy monitoring
- CPU-specific access monitoring
- Read/Write-only access monitoring
- More DAMON-based Operation Schemes
- Tiered memory management
- THP memory footprint reduction
- NUMA balancing

I hope to hear concerns/interests about the plans for prioritizing each work items and get some suggestions of future works and collaboration with other kernel subsystems/hackers.

Thanks,
SJ

#1 lore raw

Hi SJ,

We discussed this earlier.

- Are there plans to make DAMON monitor/manage cgroup instead of individual pids?

Thanks,
Badari

-----Original Message-----
From: SeongJae Park <[email protected]>
Sent: Monday, February 13, 2023 4:33 PM
To: [email protected]
Cc: SeongJae Park <[email protected]>; [email protected]; [email protected]; [email protected]
Subject: [LSF/MM/BPF TOPIC] DAMON Updates and Future Plans

Hi all,

DAMON has merged into mainline as a data access monitoring tool that equips a best-effort overhead-accuracy tradeoff mechanism, and then extended for data access-aware system operations. I'd like to briefly introduce current state of DAMON and share/discuss about 2023 plans including below.

- Finer and easier-to-use DAMOS tuning
- tuning aggressiveness based on user or kernel feed (e.g., QPS or PSI)
- Merging DAMON user space tool into the mainline
- Extending DAMON
- Page-granularity monitoring
- LRU-lists based page-granulariy monitoring
- CPU-specific access monitoring
- Read/Write-only access monitoring
- More DAMON-based Operation Schemes
- Tiered memory management
- THP memory footprint reduction
- NUMA balancing

I hope to hear concerns/interests about the plans for prioritizing each work items and get some suggestions of future works and collaboration with other kernel subsystems/hackers.

Thanks,
SJ

author maintainer
#2 lore raw

Hi Badari,

Quoted 5 lines · Badari

Hi SJ,

We discussed this earlier.

- Are there plans to make DAMON monitor/manage cgroup instead of individual pids?

Yes.

For moniroting cgroups, there are only rough ideas at the moment, and no much progress has made so far. I hope to discuss about real needs of this feature (I didn't make much progress here mainly because there was no many people pushing this) and the best way for implementing it during the session if possible.

For monitoring-based memory management of cgroups (via DAMOS), however, DAMOS provides cgroup-based management action target memory filtering[1]. Using the feature, you can do cgroups-based access-aware memory management. The patchset has merged into the mainline a few days ago.

[1] https://lore.kernel.org/damon/[email protected]/

Thanks,
SJ

Quoted 35 lines

Thanks,
Badari

-----Original Message-----
From: SeongJae Park <[email protected]>
Sent: Monday, February 13, 2023 4:33 PM
To: [email protected]
Cc: SeongJae Park <[email protected]>; [email protected]; [email protected]; [email protected]
Subject: [LSF/MM/BPF TOPIC] DAMON Updates and Future Plans

Hi all,

DAMON has merged into mainline as a data access monitoring tool that equips a best-effort overhead-accuracy tradeoff mechanism, and then extended for data access-aware system operations. I'd like to briefly introduce current state of DAMON and share/discuss about 2023 plans including below.

- Finer and easier-to-use DAMOS tuning
- tuning aggressiveness based on user or kernel feed (e.g., QPS or PSI)
- Merging DAMON user space tool into the mainline
- Extending DAMON
- Page-granularity monitoring
- LRU-lists based page-granulariy monitoring
- CPU-specific access monitoring
- Read/Write-only access monitoring
- More DAMON-based Operation Schemes
- Tiered memory management
- THP memory footprint reduction
- NUMA balancing

I hope to hear concerns/interests about the plans for prioritizing each work items and get some suggestions of future works and collaboration with other kernel subsystems/hackers.

Thanks,
SJ

author maintainer
#3 lore raw
In reply to SeongJae Park

Hello,

Quoted 21 lines · On Tue, 14 Feb 2023 00:33:28 +0000 SeongJae Park <[email protected]> wrote:

Hi all,

DAMON has merged into mainline as a data access monitoring tool that equips a best-effort overhead-accuracy tradeoff mechanism, and then extended for data access-aware system operations. I'd like to briefly introduce current state of DAMON and share/discuss about 2023 plans including below.

- Finer and easier-to-use DAMOS tuning
- tuning aggressiveness based on user or kernel feed (e.g., QPS or PSI)
- Merging DAMON user space tool into the mainline
- Extending DAMON
- Page-granularity monitoring
- LRU-lists based page-granulariy monitoring
- CPU-specific access monitoring
- Read/Write-only access monitoring
- More DAMON-based Operation Schemes
- Tiered memory management
- THP memory footprint reduction
- NUMA balancing

Quoted 3 lines

I hope to hear concerns/interests about the plans for prioritizing each work items and get some suggestions of future works and collaboration with other kernel subsystems/hackers.

We will start the discussion after about 1 hour and 20 minutes, so sharing the slides here:
https://drive.google.com/file/d/10nsd4fq01On9p-oTmCS5KSW6qESmB6ER/view?usp=sharing

The link might be changed later. I will update on this thread in the case.

Thanks,
SJ

Quoted 5 lines

Thanks,
SJ

author maintainer
#4 lore raw
Quoted 29 lines · On Mon, 8 May 2023 21:40:19 +0000 SeongJae Park <[email protected]> wrote:

Hello,

Quoted 21 lines · On Tue, 14 Feb 2023 00:33:28 +0000 SeongJae Park <[email protected]> wrote:

Hi all,

DAMON has merged into mainline as a data access monitoring tool that equips a best-effort overhead-accuracy tradeoff mechanism, and then extended for data access-aware system operations. I'd like to briefly introduce current state of DAMON and share/discuss about 2023 plans including below.

- Finer and easier-to-use DAMOS tuning
- tuning aggressiveness based on user or kernel feed (e.g., QPS or PSI)
- Merging DAMON user space tool into the mainline
- Extending DAMON
- Page-granularity monitoring
- LRU-lists based page-granulariy monitoring
- CPU-specific access monitoring
- Read/Write-only access monitoring
- More DAMON-based Operation Schemes
- Tiered memory management
- THP memory footprint reduction
- NUMA balancing

Quoted 3 lines

I hope to hear concerns/interests about the plans for prioritizing each work items and get some suggestions of future works and collaboration with other kernel subsystems/hackers.

Quoted 5 lines

We will start the discussion after about 1 hour and 20 minutes, so sharing the slides here:
https://drive.google.com/file/d/10nsd4fq01On9p-oTmCS5KSW6qESmB6ER/view?usp=sharing

The link might be changed later. I will update on this thread in the case.

As mentioned above, I indeed moved it to Github[1]. Above Google Drive link may be expired soon.

[1] https://github.com/damonitor/talks/blob/master/2023/lsfmmbpf/damon_lsfmmbpf_2023.pdf

Thanks,
SJ

Quoted 10 lines

Thanks,
SJ

Quoted 5 lines

Thanks,
SJ