Data Access-aware Transparent Hugepages
Subsystems (2)
SeongJae Park
maintainerHello,
Transparent Huge Pages (THP) could be more efficient if those are used only for frequently accessed data. DAMON is one of the ways for fidning such hot data, and hence there were interests in utilizing DAMON for access-aware THP. A simple experiment leveraging MADV_[NO]HUGEPAGE based on DAMON-identifed hot and cold memory regions was conducted as a proof of the concept. The experiment demonstrated [1] an 80% reduction in memory overhead while retaining 46% of THP performance gains.
Multiple discussions for further developing production level access-aware THP solutions have followed. Most of the discussions were made in private, though Asier recently proposed yet another approach [2] on the mailing list. As a result, we collected interesting challenges and ideas for the production level data access-aware THP. Some of the ideas are not yet public, could be controversial, and missing important things that more eyeballs can find. I want to discuss those in LSF/MM/BPF to get more ideas and make high level community alignments for next steps.
[1] https://assets.amazon.science/b7/2b/ce53222247739b174f2b54498d1a/daos-data-access-aware-operating-system.pdf
[2] https://lore.kernel.org/[email protected]
Thanks,
SJ
SeongJae Park
maintainerForgot Cc-ing damon@ and linux-kernel@. Adding those. Sorry for noise.
Quoted 20 lines · On Tue, 10 Feb 2026 18:28:55 SeongJae Park <[email protected]> wrote:
Hello,
Transparent Huge Pages (THP) could be more efficient if those are used only for frequently accessed data. DAMON is one of the ways for fidning such hot data, and hence there were interests in utilizing DAMON for access-aware THP. A simple experiment leveraging MADV_[NO]HUGEPAGE based on DAMON-identifed hot and cold memory regions was conducted as a proof of the concept. The experiment demonstrated [1] an 80% reduction in memory overhead while retaining 46% of THP performance gains.
Multiple discussions for further developing production level access-aware THP solutions have followed. Most of the discussions were made in private, though Asier recently proposed yet another approach [2] on the mailing list. As a result, we collected interesting challenges and ideas for the production level data access-aware THP. Some of the ideas are not yet public, could be controversial, and missing important things that more eyeballs can find. I want to discuss those in LSF/MM/BPF to get more ideas and make high level community alignments for next steps.
Quoted 7 lines
[1] https://assets.amazon.science/b7/2b/ce53222247739b174f2b54498d1a/daos-data-access-aware-operating-system.pdf
[2] https://lore.kernel.org/[email protected]Thanks,
SJ
Sent using hkml (https://github.com/sjp38/hackermail)
SeongJae Park
maintainerQuoted 1 line · On Tue, 10 Feb 2026 20:45:33 -0800 SeongJae Park <[email protected]> wrote:
Forgot Cc-ing damon@ and linux-kernel@. Adding those. Sorry for noise.
And lsf-pc@ ...
Quoted 27 lines · On Tue, 10 Feb 2026 18:28:55 SeongJae Park <[email protected]> wrote:
Quoted 25 lines
Hello,
Transparent Huge Pages (THP) could be more efficient if those are used only for frequently accessed data. DAMON is one of the ways for fidning such hot data, and hence there were interests in utilizing DAMON for access-aware THP. A simple experiment leveraging MADV_[NO]HUGEPAGE based on DAMON-identifed hot and cold memory regions was conducted as a proof of the concept. The experiment demonstrated [1] an 80% reduction in memory overhead while retaining 46% of THP performance gains.
Multiple discussions for further developing production level access-aware THP solutions have followed. Most of the discussions were made in private, though Asier recently proposed yet another approach [2] on the mailing list. As a result, we collected interesting challenges and ideas for the production level data access-aware THP. Some of the ideas are not yet public, could be controversial, and missing important things that more eyeballs can find. I want to discuss those in LSF/MM/BPF to get more ideas and make high level community alignments for next steps.
[1] https://assets.amazon.science/b7/2b/ce53222247739b174f2b54498d1a/daos-data-access-aware-operating-system.pdf
[2] https://lore.kernel.org/[email protected]
Quoted 5 lines
Quoted 3 lines
Thanks,
SJSent using hkml (https://github.com/sjp38/hackermail)
Sent using hkml (https://github.com/sjp38/hackermail)
SeongJae Park
maintainerHello,
The slides for this topic is available at [1].
[1] https://lore.kernel.org/linux-mm/[email protected]/
Thanks,
SJ
[...]