Skip to content

RFC Enhance memory utilization with DMEMFS

[email protected] kvm linux-fsdevel linux-mm lkml oe-kbuild-all 2 versions – In review

Get series with b4
b4 am [email protected]

Versions newest first · linked by author and title

  1. v2 RFC Latest37 patches 3 repliesIn review
  2. v135 patches 25 repliesSuperseded

Changes in v2 from the cover letter

* Rebase the code the kernel version 5.10.0-rc3.
* Introudce dregion->memmap for dmem to add _refcount for each dmem page.
* Enable record_steal_time for dmem before entering guest system.
* Adjust page walking for dmem.

Patches in v2 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/37fs: introduce dmemfs modulefs/Kconfig fs/Makefile fs/dmemfs/Kconfig +3 more+289 -00 replies
2/37mm: support direct memory reservationDocumentation/admin-guide/kernel-parameters.txt arch/x86/kernel/setup.c include/linux/dmem.h +4 more+506 -00 replies
3/37dmem: implement dmem memory managementinclude/linux/dmem.h mm/dmem.c+677 -00 replies
4/37dmem: let pat recognize dmemarch/x86/mm/pat/memtype.c+21 -00 replies
5/37dmemfs: support mmap for dmemfsfs/dmemfs/inode.c include/linux/dmem.h+351 -20 replies
6/37dmemfs: support truncating inode downfs/dmemfs/inode.c+66 -10 replies
7/37dmem: trace core functionsfs/dmemfs/Makefile fs/dmemfs/inode.c fs/dmemfs/trace.h +2 more+134 -00 replies
8/37dmem: show some statistic in debugfsmm/Kconfig mm/dmem.c+107 -10 replies
9/37dmemfs: support remote accessfs/dmemfs/inode.c+46 -00 replies
10/37dmemfs: introduce max_alloc_try_dpages parameterfs/dmemfs/inode.c+41 -00 replies
11/37mm: export mempolicy interfaces to serve dmem allocatorinclude/linux/mempolicy.h mm/mempolicy.c+5 -20 replies
12/37dmem: introduce mempolicy supportarch/x86/Kconfig arch/x86/include/asm/pgtable.h arch/x86/include/asm/pgtable_types.h +4 more+94 -30 replies
13/37mm, dmem: introduce PFN_DMEM and pfn_t_dmeminclude/linux/pfn_t.h+16 -10 replies
14/37mm, dmem: differentiate dmem-pmd and thp-pmdarch/x86/include/asm/pgtable.h include/linux/pgtable.h+14 -10 replies
15/37mm: add pmd_special() check for pmd_trans_huge_lock()include/linux/huge_mm.h mm/huge_memory.c+3 -20 replies
16/37dmemfs: introduce ->split() to dmemfs_vm_opsfs/dmemfs/inode.c+8 -00 replies
17/37mm, dmemfs: support unmap_page_range() for dmemfs pmdmm/huge_memory.c mm/memory.c+7 -30 replies
18/37mm: follow_pmd_mask() for dmem huge pmdmm/gup.c+42 -00 replies
19/37mm: gup_huge_pmd() for dmem huge pmdmm/gup.c mm/pagewalk.c+6 -20 replies
20/37mm: support dmem huge pmd for vmf_insert_pfn_pmd()mm/huge_memory.c+3 -10 replies
21/37mm: support dmem huge pmd for follow_pfn()mm/memory.c+11 -30 replies
22/37kvm, x86: Distinguish dmemfs page from mmio pagearch/x86/kvm/mmu/mmu.c include/linux/dmem.h mm/dmem.c+15 -00 replies
23/37kvm, x86: introduce VM_DMEM for syscall support usagefs/dmemfs/inode.c include/linux/mm.h mm/gup.c +3 more+26 -60 replies
24/37dmemfs: support hugepage for dmemfsfs/dmemfs/inode.c+111 -20 replies
25/37mm, x86, dmem: fix estimation of reserved page for vaddr_get_pfn()drivers/vfio/vfio_iommu_type1.c+4 -00 replies
26/37mm, dmem: introduce pud_special() for dmem huge pud supportarch/x86/include/asm/pgtable.h include/linux/pgtable.h+23 -00 replies
27/37mm: add pud_special() check to support dmem huge pudarch/x86/include/asm/pgtable.h include/linux/huge_mm.h mm/gup.c +4 more+60 -90 replies
28/37mm, dmemfs: support huge_fault() for dmemfsfs/dmemfs/inode.c+40 -00 replies
29/37mm: add follow_pte_pud() to support huge pud look upmm/memory.c+44 -80 replies
30/37dmem: introduce dmem_bitmap_alloc() and dmem_bitmap_free()fs/inode.c include/linux/fs.h mm/dmem.c+50 -260 replies
31/37dmem: introduce mce handlerinclude/linux/dmem.h include/trace/events/dmem.h mm/dmem.c +1 more+102 -300 replies
32/37mm, dmemfs: register and handle the dmem mcefs/dmemfs/inode.c include/linux/dmem.h include/linux/mm.h +2 more+231 -170 replies
33/37kvm, x86: enable record_steal_time for dmemvirt/kvm/kvm_main.c+9 -40 replies
34/37dmem: add dmem unit teststools/testing/dmem/Kbuild tools/testing/dmem/Makefile tools/testing/dmem/dmem-test.c+195 -00 replies
35/37mm, dmem: introduce dregion->memmap for dmeminclude/linux/dmem.h mm/dmem.c+139 -130 replies
36/37vfio: support dmempage refcount for vfiodrivers/vfio/vfio_iommu_type1.c+8 -10 replies
37/37Add documentation for dmemfsDocumentation/filesystems/dmemfs.rst Documentation/filesystems/index.rst+59 -01 reply

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v2 yet.

Read the v2 thread

Cover letter [RFC V2 00/37] Enhance memory utilization with DMEMFS

From: Yulei Zhang <[email protected]>

In current system each physical memory page is assocaited with a page structure which is used to track the usage of this page. But due to the memory usage rapidly growing in cloud environment, we find the resource consuming for page structure storage becomes more and more remarkable. So is it possible that we could reclaim such memory and make it reusable?

This patchset introduces an idea about how to save the extra memory through a new virtual filesystem -- dmemfs.

Dmemfs (Direct Memory filesystem) is device memory or reserved memory based filesystem. This kind of memory is special as it is not managed by kernel and most important it is without 'struct page'. Therefore we can leverage the extra memory from the host system to support more tenants in our cloud service.

As the belowing figure shows, we uses a kernel boot parameter 'dmem=' to reserve the system memory when the host system boots up, the remaining system memory is still managed by system memory management which is associated with "struct page", the reserved memory will be managed by dmem and assigned to guest system, the details can be checked in /Documentation/admin-guide/kernel-parameters.txt.

   +------------------+--------------------------------------+
   |  system memory   |     memory for guest system          | 
   +------------------+--------------------------------------+
    |                                   |
    v                                   |
struct page                             |
    |                                   |
    v                                   v
    system mem management             dmem  

And during the usage, the dmemfs will handle the memory request to allocate and free the reserved memory on each NUMA node, the user space application could leverage the mmap interface to access the memory, and kernel module such as kvm and vfio would be able to pin the memory thongh follow_pfn() and get_user_page() in different given page size granularities.

          +-----------+  +-----------+
          |   QEMU    |  |  dpdk etc.|      user
          +-----+-----+  +-----------+
  +-----------|------\------------------------------+
  |           |       v                    kernel   |
  |           |     +-------+  +-------+            |
  |           |     |  KVM  |  | vfio  |            |
  |           |     +-------+  +-------+            |
  |           |         |          |                |
  |      +----v---------v----------v------+         |
  |      |                                |         |
  |      |             Dmemfs             |         |
  |      |                                |         |
  |      +--------------------------------+         |
  +-----------/-----------------------\-------------+
             /                         \
     +------v-----+                +----v-------+
     |   node 0   |                |   node 1   |
     +------------+                +------------+

Theoretically for each 4k physical page it can save 64 bytes if we drop the 'struct page', so for guest memory with 320G it can save about 5G physical memory totally.

Detailed usage of dmemfs is included in
/Documentation/filesystem/dmemfs.rst.

V1->V2:
* Rebase the code the kernel version 5.10.0-rc3.
* Introudce dregion->memmap for dmem to add _refcount for each dmem page.
* Enable record_steal_time for dmem before entering guest system.
* Adjust page walking for dmem.

Yulei Zhang (37):
fs: introduce dmemfs module
mm: support direct memory reservation
dmem: implement dmem memory management
dmem: let pat recognize dmem
dmemfs: support mmap for dmemfs
dmemfs: support truncating inode down
dmem: trace core functions
dmem: show some statistic in debugfs
dmemfs: support remote access
dmemfs: introduce max_alloc_try_dpages parameter
mm: export mempolicy interfaces to serve dmem allocator
dmem: introduce mempolicy support
mm, dmem: introduce PFN_DMEM and pfn_t_dmem
mm, dmem: differentiate dmem-pmd and thp-pmd
mm: add pmd_special() check for pmd_trans_huge_lock()
dmemfs: introduce ->split() to dmemfs_vm_ops
mm, dmemfs: support unmap_page_range() for dmemfs pmd
mm: follow_pmd_mask() for dmem huge pmd
mm: gup_huge_pmd() for dmem huge pmd
mm: support dmem huge pmd for vmf_insert_pfn_pmd()
mm: support dmem huge pmd for follow_pfn()
kvm, x86: Distinguish dmemfs page from mmio page
kvm, x86: introduce VM_DMEM for syscall support usage
dmemfs: support hugepage for dmemfs
mm, x86, dmem: fix estimation of reserved page for vaddr_get_pfn() mm, dmem: introduce pud_special() for dmem huge pud support
mm: add pud_special() check to support dmem huge pud mm, dmemfs: support huge_fault() for dmemfs
mm: add follow_pte_pud() to support huge pud look up
dmem: introduce dmem_bitmap_alloc() and dmem_bitmap_free()
dmem: introduce mce handler
mm, dmemfs: register and handle the dmem mce
kvm, x86: enable record_steal_time for dmem
dmem: add dmem unit tests
mm, dmem: introduce dregion->memmap for dmem
vfio: support dmempage refcount for vfio
Add documentation for dmemfs

 Documentation/admin-guide/kernel-parameters.txt |   38 +
 Documentation/filesystems/dmemfs.rst            |   58 ++
 Documentation/filesystems/index.rst             |    1 +
 arch/x86/Kconfig                                |    1 +
 arch/x86/include/asm/pgtable.h                  |   32 +-
 arch/x86/include/asm/pgtable_types.h            |   13 +-
 arch/x86/kernel/setup.c                         |    3 +
 arch/x86/kvm/mmu/mmu.c                          |    1 +
 arch/x86/mm/pat/memtype.c                       |   21 +
 drivers/vfio/vfio_iommu_type1.c                 |   13 +-
 fs/Kconfig                                      |    1 +
 fs/Makefile                                     |    1 +
 fs/dmemfs/Kconfig                               |   16 +
 fs/dmemfs/Makefile                              |    8 +
 fs/dmemfs/inode.c                               | 1060 ++++++++++++++++++++
 fs/dmemfs/trace.h                               |   54 +
 fs/inode.c                                      |    6 +
 include/linux/dmem.h                            |   54 +
 include/linux/fs.h                              |    1 +
 include/linux/huge_mm.h                         |    5 +-
 include/linux/mempolicy.h                       |    3 +
 include/linux/mm.h                              |    9 +
 include/linux/pfn_t.h                           |   17 +-
 include/linux/pgtable.h                         |   22 +
 include/trace/events/dmem.h                     |   85 ++
 include/uapi/linux/magic.h                      |    1 +
 mm/Kconfig                                      |   19 +
 mm/Makefile                                     |    1 +
 mm/dmem.c                                       | 1196 +++++++++++++++++++++++
 mm/dmem_reserve.c                               |  303 ++++++
 mm/gup.c                                        |  101 +-
 mm/huge_memory.c                                |   19 +-
 mm/memory-failure.c                             |   70 +-
 mm/memory.c                                     |   74 +-
 mm/mempolicy.c                                  |    4 +-
 mm/mincore.c                                    |    8 +-
 mm/mprotect.c                                   |    7 +-
 mm/mremap.c                                     |    3 +
 mm/pagewalk.c                                   |    4 +-
 tools/testing/dmem/Kbuild                       |    1 +
 tools/testing/dmem/Makefile                     |   10 +
 tools/testing/dmem/dmem-test.c                  |  184 ++++
 virt/kvm/kvm_main.c                             |   13 +-
 43 files changed, 3483 insertions(+), 58 deletions(-)
 create mode 100644 Documentation/filesystems/dmemfs.rst
 create mode 100644 fs/dmemfs/Kconfig
 create mode 100644 fs/dmemfs/Makefile
 create mode 100644 fs/dmemfs/inode.c
 create mode 100644 fs/dmemfs/trace.h
 create mode 100644 include/linux/dmem.h
 create mode 100644 include/trace/events/dmem.h
 create mode 100644 mm/dmem.c
 create mode 100644 mm/dmem_reserve.c
 create mode 100644 tools/testing/dmem/Kbuild
 create mode 100644 tools/testing/dmem/Makefile
 create mode 100644 tools/testing/dmem/dmem-test.c
Signature · 1 line
1.8.3.1