DAMON Updates and Future Plans
Subsystems (2)
SeongJae Park
maintainerHi all,
DAMON has merged into mainline as a data access monitoring tool that equips a best-effort overhead-accuracy tradeoff mechanism, and then extended for data access-aware system operations. I'd like to briefly introduce current state of DAMON and share/discuss about 2023 plans including below.
- Finer and easier-to-use DAMOS tuning
- tuning aggressiveness based on user or kernel feed (e.g., QPS or PSI)
- Merging DAMON user space tool into the mainline
- Extending DAMON
- Page-granularity monitoring
- LRU-lists based page-granulariy monitoring
- CPU-specific access monitoring
- Read/Write-only access monitoring
- More DAMON-based Operation Schemes
- Tiered memory management
- THP memory footprint reduction
- NUMA balancing
I hope to hear concerns/interests about the plans for prioritizing each work items and get some suggestions of future works and collaboration with other kernel subsystems/hackers.
Thanks,
SJ
Hi SJ,
We discussed this earlier.
- Are there plans to make DAMON monitor/manage cgroup instead of individual pids?
Thanks,
Badari
-----Original Message-----
From: SeongJae Park <[email protected]>
Sent: Monday, February 13, 2023 4:33 PM
To: [email protected]
Cc: SeongJae Park <[email protected]>; [email protected]; [email protected]; [email protected]
Subject: [LSF/MM/BPF TOPIC] DAMON Updates and Future Plans
Hi all,
DAMON has merged into mainline as a data access monitoring tool that equips a best-effort overhead-accuracy tradeoff mechanism, and then extended for data access-aware system operations. I'd like to briefly introduce current state of DAMON and share/discuss about 2023 plans including below.
- Finer and easier-to-use DAMOS tuning
- tuning aggressiveness based on user or kernel feed (e.g., QPS or PSI)
- Merging DAMON user space tool into the mainline
- Extending DAMON
- Page-granularity monitoring
- LRU-lists based page-granulariy monitoring
- CPU-specific access monitoring
- Read/Write-only access monitoring
- More DAMON-based Operation Schemes
- Tiered memory management
- THP memory footprint reduction
- NUMA balancing
I hope to hear concerns/interests about the plans for prioritizing each work items and get some suggestions of future works and collaboration with other kernel subsystems/hackers.
Thanks,
SJ
SeongJae Park
maintainerHi Badari,
Quoted 5 lines · Badari
Hi SJ,
We discussed this earlier.
- Are there plans to make DAMON monitor/manage cgroup instead of individual pids?
Yes.
For moniroting cgroups, there are only rough ideas at the moment, and no much progress has made so far. I hope to discuss about real needs of this feature (I didn't make much progress here mainly because there was no many people pushing this) and the best way for implementing it during the session if possible.
For monitoring-based memory management of cgroups (via DAMOS), however, DAMOS provides cgroup-based management action target memory filtering[1]. Using the feature, you can do cgroups-based access-aware memory management. The patchset has merged into the mainline a few days ago.
[1] https://lore.kernel.org/damon/[email protected]/
Thanks,
SJ
Quoted 35 lines
Thanks,
Badari-----Original Message-----
From: SeongJae Park <[email protected]>
Sent: Monday, February 13, 2023 4:33 PM
To: [email protected]
Cc: SeongJae Park <[email protected]>; [email protected]; [email protected]; [email protected]
Subject: [LSF/MM/BPF TOPIC] DAMON Updates and Future PlansHi all,
DAMON has merged into mainline as a data access monitoring tool that equips a best-effort overhead-accuracy tradeoff mechanism, and then extended for data access-aware system operations. I'd like to briefly introduce current state of DAMON and share/discuss about 2023 plans including below.
- Finer and easier-to-use DAMOS tuning
- tuning aggressiveness based on user or kernel feed (e.g., QPS or PSI)
- Merging DAMON user space tool into the mainline
- Extending DAMON
- Page-granularity monitoring
- LRU-lists based page-granulariy monitoring
- CPU-specific access monitoring
- Read/Write-only access monitoring
- More DAMON-based Operation Schemes
- Tiered memory management
- THP memory footprint reduction
- NUMA balancingI hope to hear concerns/interests about the plans for prioritizing each work items and get some suggestions of future works and collaboration with other kernel subsystems/hackers.
Thanks,
SJ
SeongJae Park
maintainerHello,
Quoted 21 lines · On Tue, 14 Feb 2023 00:33:28 +0000 SeongJae Park <[email protected]> wrote:
Hi all,
DAMON has merged into mainline as a data access monitoring tool that equips a best-effort overhead-accuracy tradeoff mechanism, and then extended for data access-aware system operations. I'd like to briefly introduce current state of DAMON and share/discuss about 2023 plans including below.
- Finer and easier-to-use DAMOS tuning
- tuning aggressiveness based on user or kernel feed (e.g., QPS or PSI)
- Merging DAMON user space tool into the mainline
- Extending DAMON
- Page-granularity monitoring
- LRU-lists based page-granulariy monitoring
- CPU-specific access monitoring
- Read/Write-only access monitoring
- More DAMON-based Operation Schemes
- Tiered memory management
- THP memory footprint reduction
- NUMA balancing
Quoted 3 lines
I hope to hear concerns/interests about the plans for prioritizing each work items and get some suggestions of future works and collaboration with other kernel subsystems/hackers.
We will start the discussion after about 1 hour and 20 minutes, so sharing the slides here:
https://drive.google.com/file/d/10nsd4fq01On9p-oTmCS5KSW6qESmB6ER/view?usp=sharing
The link might be changed later. I will update on this thread in the case.
Thanks,
SJ
Quoted 5 lines
Thanks,
SJ
SeongJae Park
maintainerQuoted 29 lines · On Mon, 8 May 2023 21:40:19 +0000 SeongJae Park <[email protected]> wrote:
Hello,
Quoted 21 lines · On Tue, 14 Feb 2023 00:33:28 +0000 SeongJae Park <[email protected]> wrote:
Hi all,
DAMON has merged into mainline as a data access monitoring tool that equips a best-effort overhead-accuracy tradeoff mechanism, and then extended for data access-aware system operations. I'd like to briefly introduce current state of DAMON and share/discuss about 2023 plans including below.
- Finer and easier-to-use DAMOS tuning
- tuning aggressiveness based on user or kernel feed (e.g., QPS or PSI)
- Merging DAMON user space tool into the mainline
- Extending DAMON
- Page-granularity monitoring
- LRU-lists based page-granulariy monitoring
- CPU-specific access monitoring
- Read/Write-only access monitoring
- More DAMON-based Operation Schemes
- Tiered memory management
- THP memory footprint reduction
- NUMA balancingQuoted 3 lines
I hope to hear concerns/interests about the plans for prioritizing each work items and get some suggestions of future works and collaboration with other kernel subsystems/hackers.
Quoted 5 lines
We will start the discussion after about 1 hour and 20 minutes, so sharing the slides here:
https://drive.google.com/file/d/10nsd4fq01On9p-oTmCS5KSW6qESmB6ER/view?usp=sharingThe link might be changed later. I will update on this thread in the case.
As mentioned above, I indeed moved it to Github[1]. Above Google Drive link may be expired soon.
[1] https://github.com/damonitor/talks/blob/master/2023/lsfmmbpf/damon_lsfmmbpf_2023.pdf
Thanks,
SJ
Quoted 10 lines
Thanks,
SJQuoted 5 lines
Thanks,
SJ