Account page tables at all levels
Subsystems (24)
v2 cover Account page tables at all levels
v1: https://lore.kernel.org/linux-mm/[email protected]/
This series should be considered in conjunction with Qi's series [1]. Together, they ensure that page table ctor/dtor are called at all levels (PTE to PGD) and all architectures, where page tables are regular pages. Besides the improvement in accounting and general cleanup, this also create a single place where construction/destruction hooks can be called for all page tables, namely the now-generic pagetable_dtor() introduced by Qi, and __pagetable_ctor() introduced in this series.
v2 is essentially v1 rebased on top of mm-unstable, which includes Qi's v4 series. A number of patches from v1 were dropped:
* v1 patch 4 is superseded by patch 6 in Qi's series.
* v1 patch 5 and 6 moved to Qi's series from v3 onwards.
* v1 patch 7 is superseded by patch 4 in Qi's series.
Changes from v1 in the remaining patches:
* Patch 1 only introduces __pagetable_ctor() as there is now a single generic pagetable_dtor().
* Patch 3 and 6: in arch/m68k/mm/motorola.c, free_pointer_table() can now unconditionally call pagetable_dtor() since it is the same for all levels.
* Patch 6 just uses pagetable_dtor() instead of introducing pagetable_pgd_dtor().
* Added Dave Hansen's Acked-by to all patches.
- Kevin
[1] https://lore.kernel.org/linux-mm/[email protected]/
---
Cc: Andrew Morton <[email protected]>
Cc: Catalin Marinas <[email protected]>
Cc: Dave Hansen <[email protected]>
Cc: Linus Walleij <[email protected]>
Cc: Andy Lutomirski <[email protected]>
Cc: Peter Zijlstra <[email protected]>
Cc: "Mike Rapoport (IBM)" <[email protected]>
Cc: Ryan Roberts <[email protected]>
Cc: Thomas Gleixner <[email protected]>
Cc: Will Deacon <[email protected]>
Cc: Matthew Wilcox <[email protected]>
Cc: Qi Zheng <[email protected]>
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
---
Kevin Brodsky (6):
mm: Move common part of pagetable_*_ctor to helper
parisc: mm: Ensure pagetable_pmd_[cd]tor are called
m68k: mm: Add calls to pagetable_pmd_[cd]tor
ARM: mm: Rename PGD helpers
asm-generic: pgalloc: Provide generic __pgd_{alloc,free}
mm: Introduce ctor/dtor at PGD level
arch/alpha/mm/init.c | 2 +- arch/arc/include/asm/pgalloc.h | 9 ++---- arch/arm/mm/pgd.c | 16 +++++----- arch/arm64/mm/pgd.c | 4 +-- arch/csky/include/asm/pgalloc.h | 2 +- arch/hexagon/include/asm/pgalloc.h | 2 +- arch/loongarch/mm/pgtable.c | 7 ++--- arch/m68k/include/asm/mcf_pgalloc.h | 3 +- arch/m68k/include/asm/motorola_pgalloc.h | 6 ++-- arch/m68k/include/asm/sun3_pgalloc.h | 2 +- arch/m68k/mm/motorola.c | 21 +++++++++---- arch/microblaze/include/asm/pgalloc.h | 7 +---- arch/mips/include/asm/pgalloc.h | 6 ---- arch/mips/mm/pgtable.c | 8 ++--- arch/nios2/mm/pgtable.c | 3 +- arch/openrisc/include/asm/pgalloc.h | 6 ++-- arch/parisc/include/asm/pgalloc.h | 39 ++++++++---------------- arch/riscv/include/asm/pgalloc.h | 3 +- arch/s390/include/asm/pgalloc.h | 9 +++++- arch/um/kernel/mem.c | 7 ++--- arch/x86/mm/pgtable.c | 24 +++++++-------- arch/xtensa/include/asm/pgalloc.h | 2 +- include/asm-generic/pgalloc.h | 28 ++++++++++++++++- include/linux/mm.h | 31 ++++++++++--------- 24 files changed, 126 insertions(+), 121 deletions(-)
base-commit: e2ce19225db5818f5dc22864cd225f8c425c3775
Signature · 1 line
2.47.0
PATCH v2 1/6 mm: Move common part of pagetable_*_ctor to helper
pagetable_*_ctor all have the same basic implementation. Move the common part to a helper to reduce duplication.
--- include/linux/mm.h | 28 ++++++++++++---------------- 1 file changed, 12 insertions(+), 16 deletions(-)
include/linux/mm.h +12 -16
@@ -3076,6 +3076,14 @@ static inline bool ptlock_init(struct ptdesc *ptdesc) { return true; }static inline void ptlock_free (struct ptdesc *ptdesc) {}#endif /* defined(CONFIG_SPLIT_PTE_PTLOCKS) */ +static inline void __pagetable_ctor (struct ptdesc *ptdesc) +{ +struct folio *folio =ptdesc_folio (ptdesc); + +__folio_set_pgtable (folio); +lruvec_stat_add_folio (folio,NR_PAGETABLE ); +} +static inline void pagetable_dtor (struct ptdesc *ptdesc) {struct folio *folio =ptdesc_folio (ptdesc);
@@ -3093,12 +3101,9 @@ static inline void pagetable_dtor_free(struct ptdesc *ptdesc)static inline bool pagetable_pte_ctor (struct ptdesc *ptdesc) { -struct folio *folio =ptdesc_folio (ptdesc); -if (!ptlock_init (ptdesc))return false; -__folio_set_pgtable (folio); -lruvec_stat_add_folio (folio,NR_PAGETABLE ); +__pagetable_ctor (ptdesc);return true; }
@@ -3202,13 +3207,10 @@ static inline spinlock_t *pmd_lock(struct mm_struct *mm, pmd_t *pmd)static inline bool pagetable_pmd_ctor (struct ptdesc *ptdesc) { -struct folio *folio =ptdesc_folio (ptdesc); -if (!pmd_ptlock_init (ptdesc))return false; -__folio_set_pgtable (folio);ptdesc_pmd_pts_init (ptdesc); -lruvec_stat_add_folio (folio,NR_PAGETABLE ); +__pagetable_ctor (ptdesc);return true; }
@@ -3233,18 +3235,12 @@ static inline spinlock_t *pud_lock(struct mm_struct *mm, pud_t *pud)static inline void pagetable_pud_ctor (struct ptdesc *ptdesc) { -struct folio *folio =ptdesc_folio (ptdesc); - -__folio_set_pgtable (folio); -lruvec_stat_add_folio (folio,NR_PAGETABLE ); +__pagetable_ctor (ptdesc); }static inline void pagetable_p4d_ctor (struct ptdesc *ptdesc) { -struct folio *folio =ptdesc_folio (ptdesc); - -__folio_set_pgtable (folio); -lruvec_stat_add_folio (folio,NR_PAGETABLE ); +__pagetable_ctor (ptdesc); }extern void __init pagecache_init (void );
Signature · 1 line
2.47.0
PATCH v2 2/6 parisc: mm: Ensure pagetable_pmd_[cd]tor are called
In reply to Kevin BrodskyThe implementation of pmd_{alloc_one,free} on parisc requires a non-zero allocation order, but is completely standard aside from that. Let's reuse the generic implementation of pmd_alloc_one(). Explicit zeroing is not needed as GFP_PGTABLE_KERNEL includes __GFP_ZERO. The generic pmd_free() can handle higher allocation orders so we don't need to define our own.
These changes ensure that pagetable_pmd_[cd]tor are called, improving the accounting of page table pages.
--- arch/parisc/include/asm/pgalloc.h | 23 ++++++++++++----------- 1 file changed, 12 insertions(+), 11 deletions(-)
arch/parisc/include/asm/pgalloc.h +12 -11
@@ -11,7 +11,6 @@#include <asm/cache.h> #define __HAVE_ARCH_PMD_ALLOC_ONE -#define __HAVE_ARCH_PMD_FREE#define __HAVE_ARCH_PGD_FREE#include <asm-generic/pgalloc.h>
@@ -46,17 +45,19 @@ static inline void pud_populate(struct mm_struct *mm, pud_t *pud, pmd_t *pmd)static inline pmd_t *pmd_alloc_one (struct mm_struct *mm,unsigned long address) { -pmd_t *pmd; +struct ptdesc *ptdesc; +gfp_t gfp =GFP_PGTABLE_USER ; - pmd = (pmd_t *)__get_free_pages (GFP_PGTABLE_KERNEL ,PMD_TABLE_ORDER ); -if (likely (pmd)) -memset ((void *)pmd,0 ,PAGE_SIZE <<PMD_TABLE_ORDER ); -return pmd; -} - -static inline void pmd_free (struct mm_struct *mm,pmd_t *pmd) -{ -free_pages ((unsigned long )pmd,PMD_TABLE_ORDER ); +if (mm == &init_mm) + gfp =GFP_PGTABLE_KERNEL ; + ptdesc =pagetable_alloc (gfp,PMD_TABLE_ORDER ); +if (!ptdesc) +return NULL ; +if (!pagetable_pmd_ctor (ptdesc)) { +pagetable_free (ptdesc); +return NULL ; + } +return ptdesc_address (ptdesc); }#endif
Signature · 1 line
2.47.0
PATCH v2 3/6 m68k: mm: Add calls to pagetable_pmd_[cd]tor
In reply to Kevin Brodskyget_pointer_table() and free_pointer_table() already special-case TABLE_PTE to call pagetable_pte_[cd]tor. Let's do the same at PMD level to improve accounting further. TABLE_PGD and TABLE_PMD are currently defined to the same value, so we first need to separate them. That also implies separating ptable_list for PMD/PGD levels.
--- arch/m68k/include/asm/motorola_pgalloc.h | 6 +++--- arch/m68k/mm/motorola.c | 17 ++++++++++++----- 2 files changed, 15 insertions(+), 8 deletions(-)
arch/m68k/include/asm/motorola_pgalloc.h +3 -3
@@ -9,9 +9,9 @@ extern void mmu_page_ctor(void *page);extern void mmu_page_dtor (void *page);enum m68k_table_types { -TABLE_PGD =0 , -TABLE_PMD =0 ,/* same size as PGD */ -TABLE_PTE =1 , +TABLE_PGD , +TABLE_PMD , +TABLE_PTE , };extern void init_pointer_table (void *table,int type);
arch/m68k/mm/motorola.c +12 -5
@@ -97,17 +97,19 @@ void mmu_page_dtor(void *page)typedef struct list_head ptable_desc ; -static struct list_head ptable_list[2 ] = { +static struct list_head ptable_list[3 ] = {LIST_HEAD_INIT (ptable_list[0 ]),LIST_HEAD_INIT (ptable_list[1 ]), +LIST_HEAD_INIT (ptable_list[2 ]), };#define PD_PTABLE (page) ((ptable_desc *)&(virt_to_page((void *)(page))->lru))#define PD_PAGE (ptable) (list_entry(ptable, struct page, lru))#define PD_MARKBITS (dp) (*(unsigned int *)&PD_PAGE(dp)->index) -static const int ptable_shift[2 ] = { -7 +2 ,/* PGD, PMD */ +static const int ptable_shift[3 ] = { +7 +2 ,/* PGD */ +7 +2 ,/* PMD */ 6 +2 ,/* PTE */ };
@@ -156,12 +158,17 @@ void *get_pointer_table(int type)if (!(page = (void *)get_zeroed_page (GFP_KERNEL )))return NULL ; -if (type ==TABLE_PTE ) { +switch (type) { +case TABLE_PTE :/* * m68k doesn't have SPLIT_PTE_PTLOCKS for not having * SMP. */ pagetable_pte_ctor (virt_to_ptdesc (page)); +break ; +case TABLE_PMD : +pagetable_pmd_ctor (virt_to_ptdesc (page)); +break ; }mmu_page_ctor (page);
@@ -200,7 +207,7 @@ int free_pointer_table(void *table, int type)/* all tables in page are free, free page */ list_del (dp);mmu_page_dtor ((void *)page); -if (type ==TABLE_PTE ) +if (type ==TABLE_PTE || type ==TABLE_PMD )pagetable_dtor (virt_to_ptdesc ((void *)page));free_page (page);return 1 ;
Signature · 1 line
2.47.0
PATCH v2 4/6 ARM: mm: Rename PGD helpers
In reply to Kevin BrodskyGeneric implementations of __pgd_alloc and __pgd_free are about to be introduced. Rename the macros in arch/arm/mm/pgd.c to avoid clashes. While we're at it, also pass down the mm as argument to those helpers, as it will be needed to call the generic __pgd_{alloc,free}.
--- arch/arm/mm/pgd.c | 14 +++++++------- 1 file changed, 7 insertions(+), 7 deletions(-)
arch/arm/mm/pgd.c +7 -7
@@ -17,11 +17,11 @@#include "mm.h" #ifdef CONFIG_ARM_LPAE -#define __pgd_alloc () kmalloc_array(PTRS_PER_PGD, sizeof(pgd_t), GFP_KERNEL) -#define __pgd_free (pgd) kfree(pgd) +#define _pgd_alloc (mm) kmalloc_array(PTRS_PER_PGD, sizeof(pgd_t), GFP_KERNEL) +#define _pgd_free (mm, pgd) kfree(pgd)#else -#define __pgd_alloc () (pgd_t *)__get_free_pages(GFP_KERNEL, 2) -#define __pgd_free (pgd) free_pages((unsigned long)pgd, 2) +#define _pgd_alloc (mm) (pgd_t *)__get_free_pages(GFP_KERNEL, 2) +#define _pgd_free (mm, pgd) free_pages((unsigned long)pgd, 2)#endif /*
@@ -35,7 +35,7 @@ pgd_t *pgd_alloc(struct mm_struct *mm)pmd_t *new_pmd, *init_pmd;pte_t *new_pte, *init_pte; - new_pgd =__pgd_alloc (); + new_pgd =_pgd_alloc (mm);if (!new_pgd) goto no_pgd;
@@ -134,7 +134,7 @@ pgd_t *pgd_alloc(struct mm_struct *mm) no_pud:p4d_free (mm, new_p4d); no_p4d: -__pgd_free (new_pgd); +_pgd_free (mm, new_pgd); no_pgd:return NULL ; }
@@ -207,5 +207,5 @@ void pgd_free(struct mm_struct *mm, pgd_t *pgd_base) p4d_free(mm, p4d); }#endif -__pgd_free (pgd_base); +_pgd_free (mm, pgd_base); }
Signature · 1 line
2.47.0
PATCH v2 5/6 asm-generic: pgalloc: Provide generic __pgd_{alloc,free}
In reply to Kevin BrodskyWe already have a generic implementation of alloc/free up to P4D level, as well as pgd_free(). Let's finish the work and add a generic PGD-level alloc helper as well.
Unlike at lower levels, almost all architectures need some specific magic at PGD level (typically initialising PGD entries), so introducing a generic pgd_alloc() isn't worth it. Instead we introduce two new helpers, __pgd_alloc() and __pgd_free(), and make use of them in the arch-specific pgd_alloc() and pgd_free() wherever possible. To accommodate as many arch as possible, __pgd_alloc() takes a page allocation order.
Because pagetable_alloc() allocates zeroed pages, explicit zeroing in pgd_alloc() becomes redundant and we can get rid of it. Some trivial implementations of pgd_free() also become unnecessary once __pgd_alloc() is used; remove them.
Another small improvement is consistent accounting of PGD pages by using GFP_PGTABLE_{USER,KERNEL} as appropriate.
Not all PGD allocations can be handled by the generic helpers. In particular, multiple architectures allocate PGDs from a kmem_cache, and those PGDs may not be page-sized.
--- arch/alpha/mm/init.c | 2 +- arch/arc/include/asm/pgalloc.h | 9 ++------- arch/arm/mm/pgd.c | 8 +++----- arch/arm64/mm/pgd.c | 4 ++-- arch/csky/include/asm/pgalloc.h | 2 +- arch/hexagon/include/asm/pgalloc.h | 2 +- arch/loongarch/mm/pgtable.c | 7 +++---- arch/m68k/include/asm/sun3_pgalloc.h | 2 +- arch/microblaze/include/asm/pgalloc.h | 7 +------ arch/mips/include/asm/pgalloc.h | 6 ------ arch/mips/mm/pgtable.c | 8 +++----- arch/nios2/mm/pgtable.c | 3 ++- arch/openrisc/include/asm/pgalloc.h | 6 ++---- arch/parisc/include/asm/pgalloc.h | 16 +--------------- arch/riscv/include/asm/pgalloc.h | 3 +-- arch/um/kernel/mem.c | 7 +++---- arch/x86/mm/pgtable.c | 24 +++++++++++------------- arch/xtensa/include/asm/pgalloc.h | 2 +- include/asm-generic/pgalloc.h | 27 ++++++++++++++++++++++++++- 19 files changed, 65 insertions(+), 80 deletions(-)
arch/alpha/mm/init.c +1 -1
@@ -42,7 +42,7 @@ pgd_alloc(struct mm_struct *mm) {pgd_t *ret, *init; - ret = (pgd_t *)__get_free_page (GFP_KERNEL | __GFP_ZERO); + ret =__pgd_alloc (mm,0 ); init =pgd_offset (&init_mm,0UL );if (ret) {#ifdef CONFIG_ALPHA_LARGE_VMALLOC
arch/arc/include/asm/pgalloc.h +2 -7
@@ -53,19 +53,14 @@ static inline void pmd_populate(struct mm_struct *mm, pmd_t *pmd, pgtable_t pte_static inline pgd_t *pgd_alloc (struct mm_struct *mm) { -pgd_t *ret = (pgd_t *)__get_free_page (GFP_KERNEL ); +pgd_t *ret =__pgd_alloc (mm,0 );if (ret) {int num, num2; - num =USER_PTRS_PER_PGD +USER_KERNEL_GUTTER /PGDIR_SIZE ; -memzero (ret, num *sizeof (pgd_t)); + num =USER_PTRS_PER_PGD +USER_KERNEL_GUTTER /PGDIR_SIZE ; num2 =VMALLOC_SIZE /PGDIR_SIZE ;memcpy (ret + num, swapper_pg_dir + num, num2 *sizeof (pgd_t)); - -memzero (ret + num + num2, - (PTRS_PER_PGD - num - num2) *sizeof (pgd_t)); - }return ret; }
arch/arm/mm/pgd.c +3 -5
@@ -17,11 +17,11 @@#include "mm.h" #ifdef CONFIG_ARM_LPAE -#define _pgd_alloc (mm) kmalloc_array(PTRS_PER_PGD, sizeof(pgd_t), GFP_KERNEL) +#define _pgd_alloc (mm) kmalloc_array(PTRS_PER_PGD, sizeof(pgd_t), GFP_KERNEL | __GFP_ZERO)#define _pgd_free (mm, pgd) kfree(pgd)#else -#define _pgd_alloc (mm) (pgd_t *)__get_free_pages(GFP_KERNEL, 2) -#define _pgd_free (mm, pgd) free_pages((unsigned long)pgd, 2) +#define _pgd_alloc (mm) __pgd_alloc(mm, 2) +#define _pgd_free (mm, pgd) __pgd_free(mm, pgd)#endif /*
@@ -39,8 +39,6 @@ pgd_t *pgd_alloc(struct mm_struct *mm)if (!new_pgd) goto no_pgd; -memset (new_pgd,0 ,USER_PTRS_PER_PGD *sizeof (pgd_t)); -/* * Copy over the kernel and IO PGD entries */
arch/arm64/mm/pgd.c +2 -2
@@ -33,7 +33,7 @@ pgd_t *pgd_alloc(struct mm_struct *mm)gfp_t gfp =GFP_PGTABLE_USER ;if (pgdir_is_page_size ()) -return (pgd_t *)__get_free_page (gfp); +return __pgd_alloc (mm,0 );else return kmem_cache_alloc (pgd_cache, gfp); }
@@ -41,7 +41,7 @@ pgd_t *pgd_alloc(struct mm_struct *mm)void pgd_free (struct mm_struct *mm,pgd_t *pgd) {if (pgdir_is_page_size ()) -free_page ((unsigned long )pgd); +__pgd_free (mm, pgd);else kmem_cache_free (pgd_cache, pgd); }
arch/csky/include/asm/pgalloc.h +1 -1
@@ -44,7 +44,7 @@ static inline pgd_t *pgd_alloc(struct mm_struct *mm)pgd_t *ret;pgd_t *init; - ret = (pgd_t *)__get_free_page (GFP_KERNEL ); + ret =__pgd_alloc (mm,0 );if (ret) { init =pgd_offset (&init_mm,0UL );pgd_init ((unsigned long *)ret);
arch/hexagon/include/asm/pgalloc.h +1 -1
@@ -22,7 +22,7 @@ static inline pgd_t *pgd_alloc(struct mm_struct *mm) {pgd_t *pgd; - pgd = (pgd_t *)__get_free_page (GFP_KERNEL | __GFP_ZERO); + pgd =__pgd_alloc (mm,0 );/* * There may be better ways to do this, but to ensure
arch/loongarch/mm/pgtable.c +3 -4
@@ -23,11 +23,10 @@ EXPORT_SYMBOL(tlb_virt_to_page);pgd_t *pgd_alloc (struct mm_struct *mm) { -pgd_t *init, *ret =NULL ; -struct ptdesc *ptdesc =pagetable_alloc (GFP_KERNEL & ~__GFP_HIGHMEM,0 ); +pgd_t *init, *ret; -if (ptdesc) { - ret = (pgd_t *)ptdesc_address (ptdesc); + ret =__pgd_alloc (mm,0 ); +if (ret) { init =pgd_offset (&init_mm,0UL );pgd_init (ret); memcpy(ret + USER_PTRS_PER_PGD, init + USER_PTRS_PER_PGD,
arch/m68k/include/asm/sun3_pgalloc.h +1 -1
@@ -43,7 +43,7 @@ static inline pgd_t * pgd_alloc(struct mm_struct *mm) {pgd_t *new_pgd; - new_pgd = (pgd_t *)get_zeroed_page (GFP_KERNEL ); + new_pgd =__pgd_alloc (mm,0 );memcpy (new_pgd, swapper_pg_dir,PAGE_SIZE );memset (new_pgd,0 , (PAGE_OFFSET >>PGDIR_SHIFT ));return new_pgd;
arch/microblaze/include/asm/pgalloc.h +1 -6
@@ -21,12 +21,7 @@extern void __bad_pte (pmd_t *pmd); -static inline pgd_t *get_pgd (void ) -{ -return (pgd_t *)__get_free_pages (GFP_KERNEL |__GFP_ZERO,0 ); -} - -#define pgd_alloc (mm) get_pgd() +#define pgd_alloc (mm) __pgd_alloc(mm, 0)extern pte_t *pte_alloc_one_kernel (struct mm_struct *mm);
arch/mips/include/asm/pgalloc.h +0 -6
@@ -15,7 +15,6 @@#define __HAVE_ARCH_PMD_ALLOC_ONE#define __HAVE_ARCH_PUD_ALLOC_ONE -#define __HAVE_ARCH_PGD_FREE#include <asm-generic/pgalloc.h> static inline void pmd_populate_kernel(struct mm_struct *mm, pmd_t *pmd,
@@ -49,11 +48,6 @@ static inline void pud_populate(struct mm_struct *mm, pud_t *pud, pmd_t *pmd)extern void pgd_init (void *addr);extern pgd_t *pgd_alloc (struct mm_struct *mm); -static inline void pgd_free (struct mm_struct *mm,pgd_t *pgd) -{ -pagetable_free (virt_to_ptdesc (pgd)); -} -#define __pte_free_tlb (tlb, pte, address) \ do { \ pagetable_dtor(page_ptdesc(pte)); \
arch/mips/mm/pgtable.c +3 -5
@@ -10,12 +10,10 @@pgd_t *pgd_alloc (struct mm_struct *mm) { -pgd_t *init, *ret =NULL ; -struct ptdesc *ptdesc =pagetable_alloc (GFP_KERNEL & ~__GFP_HIGHMEM, -PGD_TABLE_ORDER ); +pgd_t *init, *ret; -if (ptdesc) { - ret =ptdesc_address (ptdesc); + ret =__pgd_alloc (mm,PGD_TABLE_ORDER ); +if (ret) { init =pgd_offset (&init_mm,0UL );pgd_init (ret); memcpy(ret + USER_PTRS_PER_PGD, init + USER_PTRS_PER_PGD,
arch/nios2/mm/pgtable.c +2 -1
@@ -11,6 +11,7 @@#include <linux/sched.h> #include <asm/cpuinfo.h> +#include <asm/pgalloc.h> /* pteaddr: * ptbase | vpn* | zero
@@ -54,7 +55,7 @@ pgd_t *pgd_alloc(struct mm_struct *mm) {pgd_t *ret, *init; - ret = (pgd_t *)__get_free_page (GFP_KERNEL ); + ret =__pgd_alloc (mm,0 );if (ret) { init =pgd_offset (&init_mm,0UL );pgd_init (ret);
arch/openrisc/include/asm/pgalloc.h +2 -4
@@ -41,15 +41,13 @@ static inline void pmd_populate(struct mm_struct *mm, pmd_t *pmd,*/ static inline pgd_t *pgd_alloc (struct mm_struct *mm) { -pgd_t *ret = (pgd_t *)__get_free_page (GFP_KERNEL ); +pgd_t *ret =__pgd_alloc (mm,0 ); -if (ret) { -memset (ret,0 ,USER_PTRS_PER_PGD *sizeof (pgd_t)); +if (ret)memcpy (ret +USER_PTRS_PER_PGD , swapper_pg_dir +USER_PTRS_PER_PGD , (PTRS_PER_PGD -USER_PTRS_PER_PGD ) *sizeof (pgd_t)); - }return ret; }
arch/parisc/include/asm/pgalloc.h +1 -15
@@ -11,26 +11,12 @@#include <asm/cache.h> #define __HAVE_ARCH_PMD_ALLOC_ONE -#define __HAVE_ARCH_PGD_FREE#include <asm-generic/pgalloc.h> /* Allocate the top level pgd (page directory) */ static inline pgd_t *pgd_alloc (struct mm_struct *mm) { -pgd_t *pgd; - - pgd = (pgd_t *)__get_free_pages (GFP_KERNEL ,PGD_TABLE_ORDER ); -if (unlikely (pgd ==NULL )) -return NULL ; - -memset (pgd,0 ,PAGE_SIZE <<PGD_TABLE_ORDER ); - -return pgd; -} - -static inline void pgd_free (struct mm_struct *mm,pgd_t *pgd) -{ -free_pages ((unsigned long )pgd,PGD_TABLE_ORDER ); +return __pgd_alloc (mm,PGD_TABLE_ORDER ); }#if CONFIG_PGTABLE_LEVELS ==3
arch/riscv/include/asm/pgalloc.h +1 -2
@@ -130,9 +130,8 @@ static inline pgd_t *pgd_alloc(struct mm_struct *mm) {pgd_t *pgd; - pgd = (pgd_t *)__get_free_page (GFP_KERNEL ); + pgd =__pgd_alloc (mm,0 );if (likely (pgd !=NULL )) { -memset (pgd,0 ,USER_PTRS_PER_PGD *sizeof (pgd_t));/* Copy kernel mappings */ sync_kernel_mappings (pgd); }
arch/um/kernel/mem.c +3 -4
@@ -214,14 +214,13 @@ void free_initmem(void)pgd_t *pgd_alloc (struct mm_struct *mm) { -pgd_t *pgd = (pgd_t *)__get_free_page (GFP_KERNEL ); +pgd_t *pgd =__pgd_alloc (mm,0 ); -if (pgd) { -memset (pgd,0 ,USER_PTRS_PER_PGD *sizeof (pgd_t)); +if (pgd)memcpy (pgd +USER_PTRS_PER_PGD , swapper_pg_dir +USER_PTRS_PER_PGD , (PTRS_PER_PGD -USER_PTRS_PER_PGD ) *sizeof (pgd_t)); - } +return pgd; }
arch/x86/mm/pgtable.c +11 -13
@@ -395,15 +395,14 @@ void __init pgtable_cache_init(void) SLAB_PANIC, NULL); } -static inline pgd_t *_pgd_alloc (void ) +static inline pgd_t *_pgd_alloc (struct mm_struct *mm) {/* * If no SHARED_KERNEL_PMD, PAE kernel is running as a Xen domain. * We allocate one page for pgd. */ if (!SHARED_KERNEL_PMD ) -return (pgd_t *)__get_free_pages (GFP_PGTABLE_USER , -PGD_ALLOCATION_ORDER ); +return __pgd_alloc (mm,PGD_ALLOCATION_ORDER );/* * Now PAE kernel is not running as a Xen domain. We can allocate
@@ -412,24 +411,23 @@ static inline pgd_t *_pgd_alloc(void) return kmem_cache_alloc(pgd_cache, GFP_PGTABLE_USER); } -static inline void _pgd_free (pgd_t *pgd) +static inline void _pgd_free (struct mm_struct *mm,pgd_t *pgd) {if (!SHARED_KERNEL_PMD ) -free_pages ((unsigned long )pgd,PGD_ALLOCATION_ORDER ); +__pgd_free (mm, pgd);else kmem_cache_free (pgd_cache, pgd); }#else -static inline pgd_t *_pgd_alloc (void ) +static inline pgd_t *_pgd_alloc (struct mm_struct *mm) { -return (pgd_t *)__get_free_pages (GFP_PGTABLE_USER , -PGD_ALLOCATION_ORDER ); +return __pgd_alloc (mm,PGD_ALLOCATION_ORDER ); } -static inline void _pgd_free (pgd_t *pgd) +static inline void _pgd_free (struct mm_struct *mm,pgd_t *pgd) { -free_pages ((unsigned long )pgd,PGD_ALLOCATION_ORDER ); +__pgd_free (mm, pgd); }#endif /* CONFIG_X86_PAE */
@@ -439,7 +437,7 @@ pgd_t *pgd_alloc(struct mm_struct *mm)pmd_t *u_pmds[MAX_PREALLOCATED_USER_PMDS ];pmd_t *pmds[MAX_PREALLOCATED_PMDS ]; - pgd =_pgd_alloc (); + pgd =_pgd_alloc (mm);if (pgd ==NULL ) goto out;
@@ -482,7 +480,7 @@ pgd_t *pgd_alloc(struct mm_struct *mm)if (sizeof (pmds) !=0 )free_pmds (mm, pmds,PREALLOCATED_PMDS ); out_free_pgd: -_pgd_free (pgd); +_pgd_free (mm, pgd); out:return NULL ; }
@@ -492,7 +490,7 @@ void pgd_free(struct mm_struct *mm, pgd_t *pgd)pgd_mop_up_pmds (mm, pgd);pgd_dtor (pgd);paravirt_pgd_free (mm, pgd); -_pgd_free (pgd); +_pgd_free (mm, pgd); }/*
arch/xtensa/include/asm/pgalloc.h +1 -1
@@ -29,7 +29,7 @@static inline pgd_t *pgd_alloc (struct mm_struct *mm) { -return (pgd_t *)__get_free_page (GFP_KERNEL | __GFP_ZERO); +return __pgd_alloc (mm,0 ); }static inline void ptes_clear (pte_t *ptep)
include/asm-generic/pgalloc.h +26 -1
@@ -258,10 +258,35 @@ static inline void p4d_free(struct mm_struct *mm, p4d_t *p4d)#endif /* CONFIG_PGTABLE_LEVELS > 4 */ +static inline pgd_t *__pgd_alloc_noprof (struct mm_struct *mm,unsigned int order) +{ +gfp_t gfp =GFP_PGTABLE_USER ; +struct ptdesc *ptdesc; + +if (mm == &init_mm) + gfp =GFP_PGTABLE_KERNEL ; + gfp &= ~__GFP_HIGHMEM; + + ptdesc =pagetable_alloc_noprof (gfp, order); +if (!ptdesc) +return NULL ; + +return ptdesc_address (ptdesc); +} +#define __pgd_alloc (...) alloc_hooks(__pgd_alloc_noprof(__VA_ARGS__)) + +static inline void __pgd_free (struct mm_struct *mm,pgd_t *pgd) +{ +struct ptdesc *ptdesc =virt_to_ptdesc (pgd); + +BUG_ON ((unsigned long )pgd & (PAGE_SIZE -1 )); +pagetable_free (ptdesc); +} +#ifndef __HAVE_ARCH_PGD_FREEstatic inline void pgd_free (struct mm_struct *mm,pgd_t *pgd) { -pagetable_free (virt_to_ptdesc (pgd)); +__pgd_free (mm, pgd); }#endif
Signature · 1 line
2.47.0
PATCH v2 6/6 mm: Introduce ctor/dtor at PGD level
In reply to Kevin BrodskyFollowing on from the introduction of P4D-level ctor/dtor, let's finish the job and introduce ctor/dtor at PGD level. The incurred improvement in page accounting is minimal - the main motivation is to create a single, generic place where construction/destruction hooks can be added for all page table pages.
This patch should cover all architectures and all configurations where PGDs are one or more regular pages. This excludes any configuration where PGDs are allocated from a kmem_cache object.
--- arch/m68k/include/asm/mcf_pgalloc.h | 3 ++- arch/m68k/mm/motorola.c | 6 ++++-- arch/s390/include/asm/pgalloc.h | 9 ++++++++- include/asm-generic/pgalloc.h | 3 ++- include/linux/mm.h | 5 +++++ 5 files changed, 21 insertions(+), 5 deletions(-)
arch/m68k/include/asm/mcf_pgalloc.h +2 -1
@@ -73,7 +73,7 @@ static inline void pte_free(struct mm_struct *mm, pgtable_t pgtable)static inline void pgd_free (struct mm_struct *mm,pgd_t *pgd) { -pagetable_free (virt_to_ptdesc (pgd)); +pagetable_dtor_free (virt_to_ptdesc (pgd)); }static inline pgd_t *pgd_alloc (struct mm_struct *mm)
@@ -84,6 +84,7 @@ static inline pgd_t *pgd_alloc(struct mm_struct *mm)if (!ptdesc)return NULL ; +pagetable_pgd_ctor (ptdesc); new_pgd =ptdesc_address (ptdesc);memcpy (new_pgd, swapper_pg_dir,PTRS_PER_PGD *sizeof (pgd_t));
arch/m68k/mm/motorola.c +4 -2
@@ -169,6 +169,9 @@ void *get_pointer_table(int type)case TABLE_PMD :pagetable_pmd_ctor (virt_to_ptdesc (page));break ; +case TABLE_PGD : +pagetable_pgd_ctor (virt_to_ptdesc (page)); +break ; }mmu_page_ctor (page);
@@ -207,8 +210,7 @@ int free_pointer_table(void *table, int type)/* all tables in page are free, free page */ list_del (dp);mmu_page_dtor ((void *)page); -if (type ==TABLE_PTE || type ==TABLE_PMD ) -pagetable_dtor (virt_to_ptdesc ((void *)page)); +pagetable_dtor (virt_to_ptdesc ((void *)page));free_page (page);return 1 ; }else if (ptable_list[type].next != dp) {
arch/s390/include/asm/pgalloc.h +8 -1
@@ -130,11 +130,18 @@ static inline void pud_populate(struct mm_struct *mm, pud_t *pud, pmd_t *pmd)static inline pgd_t *pgd_alloc (struct mm_struct *mm) { -return (pgd_t *)crst_table_alloc (mm); +unsigned long *table =crst_table_alloc (mm); + +if (!table) +return NULL ; +pagetable_pgd_ctor (virt_to_ptdesc (table)); + +return (pgd_t *) table; }static inline void pgd_free (struct mm_struct *mm,pgd_t *pgd) { +pagetable_dtor (virt_to_ptdesc (pgd));crst_table_free (mm, (unsigned long *) pgd); }
include/asm-generic/pgalloc.h +2 -1
@@ -271,6 +271,7 @@ static inline pgd_t *__pgd_alloc_noprof(struct mm_struct *mm, unsigned int orderif (!ptdesc)return NULL ; +pagetable_pgd_ctor (ptdesc);return ptdesc_address (ptdesc); }#define __pgd_alloc (...) alloc_hooks(__pgd_alloc_noprof(__VA_ARGS__))
@@ -280,7 +281,7 @@ static inline void __pgd_free(struct mm_struct *mm, pgd_t *pgd)struct ptdesc *ptdesc =virt_to_ptdesc (pgd);BUG_ON ((unsigned long )pgd & (PAGE_SIZE -1 )); -pagetable_free (ptdesc); +pagetable_dtor_free (ptdesc); }#ifndef __HAVE_ARCH_PGD_FREE
include/linux/mm.h +5 -0
@@ -3243,6 +3243,11 @@ static inline void pagetable_p4d_ctor(struct ptdesc *ptdesc)__pagetable_ctor (ptdesc); } +static inline void pagetable_pgd_ctor (struct ptdesc *ptdesc) +{ +__pagetable_ctor (ptdesc); +} +extern void __init pagecache_init (void );extern void free_initmem (void );
Signature · 1 line
2.47.0
Alexander Gordeev
maintainerRe: [PATCH v2 6/6] mm: Introduce ctor/dtor at PGD level
On Fri, Jan 03, 2025 at 06:44:15PM +0000, Kevin Brodsky wrote:
Hi Kevin,
...
arch/s390/include/asm/pgalloc.h static inline void pud_populate(struct mm_struct *mm, pud_t *pud, pmd_t *pmd) · line 136
Quoted 13 lines
arch/s390/include/asm/pgalloc.h +4
-1@@ -130,11 +130,18 @@ static inline void pud_populate(struct mm_struct *mm, pud_t *pud, pmd_t *pmd)static inline pgd_t *pgd_alloc (struct mm_struct *mm) { -return (pgd_t *)crst_table_alloc (mm); +unsigned long *table =crst_table_alloc (mm); + +if (!table) +return NULL ;
I do not know status of this series, but FWIW, this call is missed:
crst_table_init(table, _REGION1_ENTRY_EMPTY);
arch/s390/include/asm/pgalloc.h static inline void pud_populate(struct mm_struct *mm, pud_t *pud, pmd_t *pmd) · line 146
Quoted 10 lines
arch/s390/include/asm/pgalloc.h +4
-0+pagetable_pgd_ctor (virt_to_ptdesc (table)); + +return (pgd_t *) table; }static inline void pgd_free (struct mm_struct *mm,pgd_t *pgd) { +pagetable_dtor (virt_to_ptdesc (pgd));crst_table_free (mm, (unsigned long *) pgd); }
...
Thanks!
Heiko Carstens
maintainerRe: [PATCH v2 6/6] mm: Introduce ctor/dtor at PGD level
Quoted 20 lines · Alexander Gordeev
On Fri, Jan 03, 2025 at 06:44:15PM +0000, Kevin Brodsky wrote:
Hi Kevin,
...arch/s390/include/asm/pgalloc.h static inline void pud_populate(struct mm_struct *mm, pud_t *pud, pmd_t *pmd) · line 136
Quoted 13 lines
arch/s390/include/asm/pgalloc.h +4
-1@@ -130,11 +130,18 @@ static inline void pud_populate(struct mm_struct *mm, pud_t *pud, pmd_t *pmd)static inline pgd_t *pgd_alloc (struct mm_struct *mm) { -return (pgd_t *)crst_table_alloc (mm); +unsigned long *table =crst_table_alloc (mm); + +if (!table) +return NULL ;I do not know status of this series, but FWIW, this call is missed:
Quoted 1 line
crst_table_init(table, _REGION1_ENTRY_EMPTY);
Why is that missing?
A pgd table can be a Region1, Region2, or Region3 table. The only caller of this function is mm_init() via mm_alloc_pgd(); and right after mm_alloc_pgd() there is a call to init_new_context() which will initialize the pgd correctly.
I guess what really gets odd, and might be broken (haven't checked yet) is what happens on dynamic upgrade of page table levels (->crst_table_upgrade()).
With that a pgd may become a pud, and with that we get an imbalance with the ctor/dtor calls for the various page table levels when they get freed again. Plus, at first glance, it looks also broken that we have open-coded crst_alloc() calls instead of using the "proper" page table allocation API within crst_table_upgrade(), which again would cause an imbalance.
Alexander Gordeev
maintainerRe: [PATCH v2 6/6] mm: Introduce ctor/dtor at PGD level
Quoted 10 lines · Heiko Carstens
Quoted 10 lines
arch/s390/include/asm/pgalloc.h static inline void pud_populate(struct mm_struct *mm, pud_t *pud, pmd_t *pmd) · line 136
Quoted 7 lines
static inline
pgd_t*pgd_alloc(structmm_struct*mm) {arch/s390/include/asm/pgalloc.h +4
-1-return (pgd_t *)crst_table_alloc (mm); +unsigned long *table =crst_table_alloc (mm); + +if (!table) +return NULL ;I do not know status of this series, but FWIW, this call is missed:
Quoted 3 lines
Quoted 1 line
crst_table_init(table, _REGION1_ENTRY_EMPTY);Why is that missing?
Because the follow-up pagetable_pgd_ctor() is called against uninitialized page table, while other pagetable_pXd_ctor() variants are called against initialized one. I could imagine complications as result of that.
Whether Region1 table is the right choice is a big question though, as you noticed below.
Quoted 3 lines
A pgd table can be a Region1, Region2, or Region3 table. The only caller of this function is
mm_init()viamm_alloc_pgd(); and right aftermm_alloc_pgd()there is a call toinit_new_context()which will initialize the pgd correctly.
init_new_context() is in a way a constructor as well, so whole thing looks odd to me. But I do not immedeately see a better way :(
Quoted 2 lines
I guess what really gets odd, and might be broken (haven't checked yet) is what happens on dynamic upgrade of page table levels (->crst_table_upgrade()).
Hmm, that is a good point.
Quoted 2 lines
With that a pgd may become a pud, and with that we get an imbalance with the ctor/dtor calls for the various page table levels when they get freed
The ctor/dtor mismatch should not be a problem, as pagetable_pgd|p4d|pud_ctor() are the same and there is one pagetable_dtor() for all top levels as of now. But if it ever comes to separate implementations, then we are in the world of pain.
Quoted 3 lines
again. Plus, at first glance, it looks also broken that we have open-coded
crst_alloc()calls instead of using the "proper" page table allocation API withincrst_table_upgrade(), which again would cause an imbalance.
This is a good point too.
Many thanks!
Alexander Gordeev
maintainerRe: [PATCH v2 6/6] mm: Introduce ctor/dtor at PGD level
On Wed, Jan 22, 2025 at 03:06:05PM +0100, Alexander Gordeev wrote:
Hi Kevin,
Quoted 13 lines · Heiko Carstens
Quoted 12 lines
Quoted 11 lines
Review
Quoted 7 lines
static inline
pgd_t*pgd_alloc(structmm_struct*mm) {(quoted diff) +4
-1- return (pgd_t *) crst_table_alloc(mm); + unsigned long *table = crst_table_alloc(mm); + + if (!table) + return NULL;I do not know status of this series, but FWIW, this call is missed:
crst_table_init(table, _REGION1_ENTRY_EMPTY);
Quoted 8 lines
Quoted 1 line
Why is that missing?
Because the follow-up
pagetable_pgd_ctor()is called against uninitialized page table, while otherpagetable_pXd_ctor()variants are called against initialized one. I could imagine complications as result of that.Whether Region1 table is the right choice is a big question though, as you noticed below.
As discussed with Heiko, we do not want to add the extra crst_table_init() call at least due to performance impact. So please ignore my comment.
Quoted 20 lines
Quoted 3 lines
A pgd table can be a Region1, Region2, or Region3 table. The only caller of this function is
mm_init()viamm_alloc_pgd(); and right aftermm_alloc_pgd()there is a call toinit_new_context()which will initialize the pgd correctly.
init_new_context()is in a way a constructor as well, so whole thing looks odd to me. But I do not immedeately see a better way :(Quoted 2 lines
I guess what really gets odd, and might be broken (haven't checked yet) is what happens on dynamic upgrade of page table levels (->crst_table_upgrade()).
Hmm, that is a good point.
Quoted 2 lines
With that a pgd may become a pud, and with that we get an imbalance with the ctor/dtor calls for the various page table levels when they get freed
The ctor/dtor mismatch should not be a problem, as pagetable_pgd|p4d|pud_ctor() are the same and there is one
pagetable_dtor()for all top levels as of now. But if it ever comes to separate implementations, then we are in the world of pain.
Quoted 5 lines
Quoted 3 lines
again. Plus, at first glance, it looks also broken that we have open-coded
crst_alloc()calls instead of using the "proper" page table allocation API withincrst_table_upgrade(), which again would cause an imbalance.This is a good point too.
The below bits are seems to be missed. We will test it and send a patch.
arch/s390/mm/pgalloc.c +3 -0
@@ -88,12 +88,14 @@ int crst_table_upgrade(struct mm_struct *mm, unsigned long end)if (unlikely (!p4d)) goto err_p4d;crst_table_init (p4d, _REGION2_ENTRY_EMPTY); +pagetable_p4d_ctor (virt_to_ptdesc (p4d)); }if (end > _REGION1_SIZE) { pgd =crst_table_alloc (mm);if (unlikely (!pgd)) goto err_pgd;crst_table_init (pgd, _REGION1_ENTRY_EMPTY); +pagetable_pgd_ctor (virt_to_ptdesc (pgd)); }spin_lock_bh (&mm->page_table_lock);
@@ -130,6 +132,7 @@ int crst_table_upgrade(struct mm_struct *mm, unsigned long end)return 0 ; err_pgd: +pagetable_dtor (virt_to_ptdesc (p4d));crst_table_free (mm, p4d); err_p4d:return -ENOMEM ;
Thanks!
Quoted 63 lines · Kevin Brodsky
v1: https://lore.kernel.org/linux-mm/[email protected]/
This series should be considered in conjunction with Qi's series [1]. Together, they ensure that page table ctor/dtor are called at all levels (PTE to PGD) and all architectures, where page tables are regular pages. Besides the improvement in accounting and general cleanup, this also create a single place where construction/destruction hooks can be called for all page tables, namely the now-generic
pagetable_dtor()introduced by Qi, and__pagetable_ctor()introduced in this series.v2 is essentially v1 rebased on top of mm-unstable, which includes Qi's v4 series. A number of patches from v1 were dropped:
* v1 patch 4 is superseded by patch 6 in Qi's series.
* v1 patch 5 and 6 moved to Qi's series from v3 onwards.
* v1 patch 7 is superseded by patch 4 in Qi's series.Changes from v1 in the remaining patches:
* Patch 1 only introduces
__pagetable_ctor()as there is now a single genericpagetable_dtor().* Patch 3 and 6: in
arch/m68k/mm/motorola.c,free_pointer_table()can now unconditionally callpagetable_dtor()since it is the same for all levels.* Patch 6 just uses
pagetable_dtor()instead of introducingpagetable_pgd_dtor().* Added Dave Hansen's Acked-by to all patches.
- Kevin
[1] https://lore.kernel.org/linux-mm/[email protected]/
---
Cc: Andrew Morton <[email protected]>
Cc: Catalin Marinas <[email protected]>
Cc: Dave Hansen <[email protected]>
Cc: Linus Walleij <[email protected]>
Cc: Andy Lutomirski <[email protected]>
Cc: Peter Zijlstra <[email protected]>
Cc: "Mike Rapoport (IBM)" <[email protected]>
Cc: Ryan Roberts <[email protected]>
Cc: Thomas Gleixner <[email protected]>
Cc: Will Deacon <[email protected]>
Cc: Matthew Wilcox <[email protected]>
Cc: Qi Zheng <[email protected]>
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Cc: [email protected]
Quoted 8 lines
---
Kevin Brodsky (6):
mm: Move common part of pagetable_*_ctor to helper
parisc: mm: Ensure pagetable_pmd_[cd]tor are called
m68k: mm: Add calls to pagetable_pmd_[cd]tor
ARM: mm: Rename PGD helpers
asm-generic: pgalloc: Provide generic __pgd_{alloc,free}
mm: Introduce ctor/dtor at PGD level
For this series:
Thanks!
Quoted 3 lines · Qi Zheng
For this series:
Acked-by Qi Zheng <[email protected]>
Thank you for the review, appreciated!
- Kevin
This series was applied to riscv/linux.git (fixes) by Andrew Morton <[email protected]>:
Hello:
This series was applied to riscv/linux.git (fixes) by Andrew Morton <[email protected]>:
Quoted 11 lines · On Fri, 3 Jan 2025 18:44:09 +0000 you wrote:
v1: https://lore.kernel.org/linux-mm/[email protected]/
This series should be considered in conjunction with Qi's series [1]. Together, they ensure that page table ctor/dtor are called at all levels (PTE to PGD) and all architectures, where page tables are regular pages. Besides the improvement in accounting and general cleanup, this also create a single place where construction/destruction hooks can be called for all page tables, namely the now-generic
pagetable_dtor()introduced by Qi, and__pagetable_ctor()introduced in this series.[...]
Here is the summary with links:
- [v2,1/6] mm: Move common part of pagetable_*_ctor to helper
https://git.kernel.org/riscv/c/11e2400b21a3 - [v2,2/6] parisc: mm: Ensure pagetable_pmd_[cd]tor are called https://git.kernel.org/riscv/c/3565522e15eb - [v2,3/6] m68k: mm: Add calls to pagetable_pmd_[cd]tor https://git.kernel.org/riscv/c/1879688e5c42 - [v2,4/6] ARM: mm: Rename PGD helpers https://git.kernel.org/riscv/c/94771023712a - [v2,5/6] asm-generic: pgalloc: Provide generic __pgd_{alloc,free} https://git.kernel.org/riscv/c/a9b3c355c2e6 - [v2,6/6] mm: Introduce ctor/dtor at PGD level https://git.kernel.org/riscv/c/d95936a2267c
You are awesome, thank you!
Signature · 2 lines
Deet-doot-dot, I am a bot. https://korg.docs.kernel.org/patchwork/pwbot.html