Support page table check PowerPC
Subsystems (7)
v11 cover Support page table check PowerPC
Support page table check on all PowerPC platforms. This works by serialising assignments, reassignments and clears of page table entries at each level in order to ensure that anonymous mappings have at most one writable consumer, and likewise that file-backed mappings are not simultaneously also anonymous mappings.
In order to support this infrastructure, a number of stubs must be defined for all powerpc platforms. Additionally, seperate set_pte_at() and set_pte_at_unchecked(), to allow for internal, uninstrumented mappings.
v11:
* The pud_pfn() stub, which previously had no legitimate users on any powerpc platform, now has users in Book3s64 with transparent pages. Include a stub of the same name for each platform that does not define their own.
* Drop patch that standardised use of p*d_leaf(), as already included upstream in v6.9.
* Provide fallback definitions of p{m,u}d_user_accessible_page() that do not reference p*d_leaf(), p*d_pte(), as they are defined after powerpc/mm headers by linux/mm headers.
* Ensure that set_pte_at_unchecked() has the same checks as set_pte_at().
v10:
* Revert patches that removed address and mm parameters from page table check routines, including consuming code from arm64, x86_64 and riscv.
* Implement *_user_accessible_page() routines in terms of pte_user() where available (64-bit, book3s) but otherwise by checking the address (on platforms where the pte does not imply whether the mapping is for user or kernel)
* Internal set_pte_at() calls replaced with set_pte_at_unchecked(), which is identical, but prevents double instrumentation.
v9:
* Adapt to using the set_ptes() API, using __set_pte_at() where we need must avoid instrumentation.
* Use the logic of *_access_permitted() for implementing *_user_accessible_page(), which are required routines for page table check.
* Even though we no longer need p{m,u,4}d_leaf(), still default implement these to assist in refactoring out extant p{m,u,4}_is_leaf().
* Add p{m,u}_pte() stubs where asm-generic does not provide them, as page table check wants all *user_accessible_page() variants, and we would like to default implement the variants in terms of pte_user_accessible_page().
* Avoid the ugly pmdp_collapse_flush() macro nonsense! Just instrument its constituent calls instead for radix and hash.
v8:
* Fix linux/page_table_check.h include in asm/pgtable.h breaking 32-bit.
v7:
* Remove use of extern in set_pte prototypes
* Clean up pmdp_collapse_flush macro
* Replace set_pte_at with static inline function
* Fix commit message for patch 7
v6:
* Support huge pages and p{m,u}d accounting.
* Remove instrumentation from set_pte from kernel internal pages.
* 64s: Implement pmdp_collapse_flush in terms of __pmdp_collapse_flush as access to the mm_struct * is required.
v5:
Rohan McLure (11):
Revert "mm/page_table_check: remove unused parameter in
[__]page_table_check_pud_set"
Revert "mm/page_table_check: remove unused parameter in
[__]page_table_check_pmd_set"
mm: Provide addr parameter to page_table_check_pte_set()
Revert "mm/page_table_check: remove unused parameter in
[__]page_table_check_pud_clear"
Revert "mm/page_table_check: remove unused parameter in
[__]page_table_check_pmd_clear"
Revert "mm/page_table_check: remove unused parameter in
[__]page_table_check_pte_clear" mm: Provide address parameter to p{te,md,ud}_user_accessible_page()
powerpc: mm: Add pud_pfn() stub
poweprc: mm: Implement *_user_accessible_page() for ptes
powerpc: mm: Use set_pte_at_unchecked() for early-boot / internal
usages
powerpc: mm: Support page table check
arch/arm64/include/asm/pgtable.h | 18 +++--- arch/powerpc/Kconfig | 1 + arch/powerpc/include/asm/book3s/32/pgtable.h | 12 +++- arch/powerpc/include/asm/book3s/64/pgtable.h | 62 +++++++++++++++--- arch/powerpc/include/asm/nohash/pgtable.h | 5 ++ arch/powerpc/include/asm/pgtable.h | 18 ++++++ arch/powerpc/mm/book3s64/hash_pgtable.c | 6 +- arch/powerpc/mm/book3s64/pgtable.c | 17 +++-- arch/powerpc/mm/book3s64/radix_pgtable.c | 11 ++-- arch/powerpc/mm/nohash/book3e_pgtable.c | 2 +- arch/powerpc/mm/pgtable.c | 12 ++++ arch/powerpc/mm/pgtable_32.c | 2 +- arch/riscv/include/asm/pgtable.h | 18 +++--- arch/x86/include/asm/pgtable.h | 20 +++--- include/linux/page_table_check.h | 67 ++++++++++++-------- include/linux/pgtable.h | 8 +-- mm/page_table_check.c | 39 +++++++----- 17 files changed, 220 insertions(+), 98 deletions(-)
Signature · 1 line
2.44.0
PATCH v11 1/11 Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pud_set"
This reverts commit 6d144436d954311f2dbacb5bf7b084042448d83e.
Reinstate previously unused parameters for the purpose of supporting powerpc platforms, as many do not encode user/kernel ownership of the page in the pte, but instead in the address of the access.
riscv: Respect change to delete mm, addr parameters from __set_pte_at()
This commit also changed calls to __set_pte_at() to use fewer parameters on riscv. Keep that change rather than reverting it, as the signature of __set_pte_at() is changed in a different commit.
--- arch/arm64/include/asm/pgtable.h | 2 +- arch/riscv/include/asm/pgtable.h | 2 +- arch/x86/include/asm/pgtable.h | 2 +- include/linux/page_table_check.h | 11 +++++++---- mm/page_table_check.c | 3 ++- 5 files changed, 12 insertions(+), 8 deletions(-)
arch/arm64/include/asm/pgtable.h +1 -1
@@ -568,7 +568,7 @@ static inline void set_pmd_at(struct mm_struct *mm, unsigned long addr,static inline void set_pud_at (struct mm_struct *mm,unsigned long addr,pud_t *pudp,pud_t pud) { -page_table_check_pud_set (mm, pudp, pud); +page_table_check_pud_set (mm, addr, pudp, pud);return __set_pte_at (mm, addr, (pte_t *)pudp,pud_pte (pud),PUD_SIZE >>PAGE_SHIFT ); }
arch/riscv/include/asm/pgtable.h +1 -1
@@ -719,7 +719,7 @@ static inline void set_pmd_at(struct mm_struct *mm, unsigned long addr,static inline void set_pud_at (struct mm_struct *mm,unsigned long addr,pud_t *pudp,pud_t pud) { -page_table_check_pud_set (mm, pudp, pud); +page_table_check_pud_set (mm, addr, pudp, pud);return __set_pte_at ((pte_t *)pudp,pud_pte (pud)); }
arch/x86/include/asm/pgtable.h +1 -1
@@ -1245,7 +1245,7 @@ static inline void set_pmd_at(struct mm_struct *mm, unsigned long addr,static inline void set_pud_at (struct mm_struct *mm,unsigned long addr,pud_t *pudp,pud_t pud) { -page_table_check_pud_set (mm, pudp, pud); +page_table_check_pud_set (mm, addr, pudp, pud);native_set_pud (pudp, pud); }
include/linux/page_table_check.h +7 -4
@@ -20,7 +20,8 @@ void __page_table_check_pud_clear(struct mm_struct *mm, pud_t pud);void __page_table_check_ptes_set (struct mm_struct *mm,pte_t *ptep,pte_t pte,unsigned int nr);void __page_table_check_pmd_set (struct mm_struct *mm,pmd_t *pmdp,pmd_t pmd); -void __page_table_check_pud_set (struct mm_struct *mm,pud_t *pudp,pud_t pud); +void __page_table_check_pud_set (struct mm_struct *mm,unsigned long addr, +pud_t *pudp,pud_t pud);void __page_table_check_pte_clear_range (struct mm_struct *mm,unsigned long addr,pmd_t pmd);
@@ -83,13 +84,14 @@ static inline void page_table_check_pmd_set(struct mm_struct *mm, pmd_t *pmdp,__page_table_check_pmd_set (mm, pmdp, pmd); } -static inline void page_table_check_pud_set (struct mm_struct *mm,pud_t *pudp, +static inline void page_table_check_pud_set (struct mm_struct *mm, +unsigned long addr,pud_t *pudp,pud_t pud) {if (static_branch_likely (&page_table_check_disabled))return ; -__page_table_check_pud_set (mm, pudp, pud); +__page_table_check_pud_set (mm, addr, pudp, pud); } static inline void page_table_check_pte_clear_range(struct mm_struct *mm,
@@ -134,7 +136,8 @@ static inline void page_table_check_pmd_set(struct mm_struct *mm, pmd_t *pmdp, { } -static inline void page_table_check_pud_set (struct mm_struct *mm,pud_t *pudp, +static inline void page_table_check_pud_set (struct mm_struct *mm, +unsigned long addr,pud_t *pudp,pud_t pud) { }
mm/page_table_check.c +2 -1
@@ -210,7 +210,8 @@ void __page_table_check_pmd_set(struct mm_struct *mm, pmd_t *pmdp, pmd_t pmd) }EXPORT_SYMBOL (__page_table_check_pmd_set); -void __page_table_check_pud_set (struct mm_struct *mm,pud_t *pudp,pud_t pud) +void __page_table_check_pud_set (struct mm_struct *mm,unsigned long addr, +pud_t *pudp,pud_t pud) {if (&init_mm == mm)return ;
Signature · 1 line
2.44.0
PATCH v11 2/11 Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pmd_set"
In reply to Rohan McLureThis reverts commit a3b837130b5865521fa8662aceaa6ebc8d29389a.
Reinstate previously unused parameters for the purpose of supporting powerpc platforms, as many do not encode user/kernel ownership of the page in the pte, but instead in the address of the access.
riscv: Respect change to delete mm, addr parameters from __set_pte_at()
This commit also changed calls to __set_pte_at() to use fewer parameters on riscv. Keep that change rather than reverting it, as the signature of __set_pte_at() is changed in a different commit.
--- arch/arm64/include/asm/pgtable.h | 4 ++-- arch/riscv/include/asm/pgtable.h | 4 ++-- arch/x86/include/asm/pgtable.h | 4 ++-- include/linux/page_table_check.h | 11 +++++++---- mm/page_table_check.c | 3 ++- 5 files changed, 15 insertions(+), 11 deletions(-)
arch/arm64/include/asm/pgtable.h +2 -2
@@ -560,7 +560,7 @@ static inline void __set_pte_at(struct mm_struct *mm,static inline void set_pmd_at (struct mm_struct *mm,unsigned long addr,pmd_t *pmdp,pmd_t pmd) { -page_table_check_pmd_set (mm, pmdp, pmd); +page_table_check_pmd_set (mm, addr, pmdp, pmd);return __set_pte_at (mm, addr, (pte_t *)pmdp,pmd_pte (pmd),PMD_SIZE >>PAGE_SHIFT ); }
@@ -1239,7 +1239,7 @@ static inline void pmdp_set_wrprotect(struct mm_struct *mm,static inline pmd_t pmdp_establish (struct vm_area_struct *vma,unsigned long address,pmd_t *pmdp,pmd_t pmd) { -page_table_check_pmd_set (vma->vm_mm, pmdp, pmd); +page_table_check_pmd_set (vma->vm_mm, address, pmdp, pmd);return __pmd (xchg_relaxed (&pmd_val (*pmdp),pmd_val (pmd))); }#endif
arch/riscv/include/asm/pgtable.h +2 -2
@@ -712,7 +712,7 @@ static inline pmd_t pmd_mkdirty(pmd_t pmd)static inline void set_pmd_at (struct mm_struct *mm,unsigned long addr,pmd_t *pmdp,pmd_t pmd) { -page_table_check_pmd_set (mm, pmdp, pmd); +page_table_check_pmd_set (mm, addr, pmdp, pmd);return __set_pte_at ((pte_t *)pmdp,pmd_pte (pmd)); }
@@ -783,7 +783,7 @@ static inline void pmdp_set_wrprotect(struct mm_struct *mm,static inline pmd_t pmdp_establish (struct vm_area_struct *vma,unsigned long address,pmd_t *pmdp,pmd_t pmd) { -page_table_check_pmd_set (vma->vm_mm, pmdp, pmd); +page_table_check_pmd_set (vma->vm_mm, address, pmdp, pmd);return __pmd (atomic_long_xchg ((atomic_long_t *)pmdp,pmd_val (pmd))); }
arch/x86/include/asm/pgtable.h +2 -2
@@ -1238,7 +1238,7 @@ static inline pud_t native_local_pudp_get_and_clear(pud_t *pudp)static inline void set_pmd_at (struct mm_struct *mm,unsigned long addr,pmd_t *pmdp,pmd_t pmd) { -page_table_check_pmd_set (mm, pmdp, pmd); +page_table_check_pmd_set (mm, addr, pmdp, pmd);set_pmd (pmdp, pmd); }
@@ -1383,7 +1383,7 @@ static inline void pmdp_set_wrprotect(struct mm_struct *mm,static inline pmd_t pmdp_establish (struct vm_area_struct *vma,unsigned long address,pmd_t *pmdp,pmd_t pmd) { -page_table_check_pmd_set (vma->vm_mm, pmdp, pmd); +page_table_check_pmd_set (vma->vm_mm, address, pmdp, pmd);if (IS_ENABLED (CONFIG_SMP )) {return xchg (pmdp, pmd); }else {
include/linux/page_table_check.h +7 -4
@@ -19,7 +19,8 @@ void __page_table_check_pmd_clear(struct mm_struct *mm, pmd_t pmd);void __page_table_check_pud_clear (struct mm_struct *mm,pud_t pud);void __page_table_check_ptes_set (struct mm_struct *mm,pte_t *ptep,pte_t pte,unsigned int nr); -void __page_table_check_pmd_set (struct mm_struct *mm,pmd_t *pmdp,pmd_t pmd); +void __page_table_check_pmd_set (struct mm_struct *mm,unsigned long addr, +pmd_t *pmdp,pmd_t pmd);void __page_table_check_pud_set (struct mm_struct *mm,unsigned long addr,pud_t *pudp,pud_t pud); void __page_table_check_pte_clear_range(struct mm_struct *mm,
@@ -75,13 +76,14 @@ static inline void page_table_check_ptes_set(struct mm_struct *mm,__page_table_check_ptes_set (mm, ptep, pte, nr); } -static inline void page_table_check_pmd_set (struct mm_struct *mm,pmd_t *pmdp, +static inline void page_table_check_pmd_set (struct mm_struct *mm, +unsigned long addr,pmd_t *pmdp,pmd_t pmd) {if (static_branch_likely (&page_table_check_disabled))return ; -__page_table_check_pmd_set (mm, pmdp, pmd); +__page_table_check_pmd_set (mm, addr, pmdp, pmd); } static inline void page_table_check_pud_set(struct mm_struct *mm,
@@ -131,7 +133,8 @@ static inline void page_table_check_ptes_set(struct mm_struct *mm, { } -static inline void page_table_check_pmd_set (struct mm_struct *mm,pmd_t *pmdp, +static inline void page_table_check_pmd_set (struct mm_struct *mm, +unsigned long addr,pmd_t *pmdp,pmd_t pmd) { }
mm/page_table_check.c +2 -1
@@ -197,7 +197,8 @@ void __page_table_check_ptes_set(struct mm_struct *mm, pte_t *ptep, pte_t pte, }EXPORT_SYMBOL (__page_table_check_ptes_set); -void __page_table_check_pmd_set (struct mm_struct *mm,pmd_t *pmdp,pmd_t pmd) +void __page_table_check_pmd_set (struct mm_struct *mm,unsigned long addr, +pmd_t *pmdp,pmd_t pmd) {if (&init_mm == mm)return ;
Signature · 1 line
2.44.0
PATCH v11 3/11 mm: Provide addr parameter to page_table_check_pte_set()
In reply to Rohan McLureTo provide support for powerpc platforms, provide an addr parameter to the page_table_check_pte_set() routine. This parameter is needed on some powerpc platforms which do not encode whether a mapping is for user or kernel in the pte. On such platforms, this can be inferred form the addr parameter.
--- arch/arm64/include/asm/pgtable.h | 2 +- arch/riscv/include/asm/pgtable.h | 2 +- include/linux/page_table_check.h | 12 +++++++----- include/linux/pgtable.h | 2 +- mm/page_table_check.c | 4 ++-- 5 files changed, 12 insertions(+), 10 deletions(-)
arch/arm64/include/asm/pgtable.h +1 -1
@@ -376,7 +376,7 @@ static inline void __set_ptes(struct mm_struct *mm,unsigned long __always_unused addr, pte_t *ptep, pte_t pte, unsigned int nr) { -page_table_check_ptes_set (mm ,ptep ,pte ,nr ); +page_table_check_ptes_set (mm ,addr ,ptep ,pte ,nr );__sync_cache_and_tags (pte, nr);for (;;) {
arch/riscv/include/asm/pgtable.h +1 -1
@@ -532,7 +532,7 @@ static inline void __set_pte_at(pte_t *ptep, pte_t pteval)static inline void set_ptes (struct mm_struct *mm,unsigned long addr,pte_t *ptep,pte_t pteval,unsigned int nr) { -page_table_check_ptes_set (mm, ptep, pteval, nr); +page_table_check_ptes_set (mm, addr, ptep, pteval, nr);for (;;) {__set_pte_at (ptep, pteval);
include/linux/page_table_check.h +7 -5
@@ -17,8 +17,8 @@ void __page_table_check_zero(struct page *page, unsigned int order);void __page_table_check_pte_clear (struct mm_struct *mm,pte_t pte);void __page_table_check_pmd_clear (struct mm_struct *mm,pmd_t pmd);void __page_table_check_pud_clear (struct mm_struct *mm,pud_t pud); -void __page_table_check_ptes_set (struct mm_struct *mm,pte_t *ptep,pte_t pte, -unsigned int nr); +void __page_table_check_ptes_set (struct mm_struct *mm,unsigned long addr, +pte_t *ptep,pte_t pte,unsigned int nr);void __page_table_check_pmd_set (struct mm_struct *mm,unsigned long addr,pmd_t *pmdp,pmd_t pmd); void __page_table_check_pud_set(struct mm_struct *mm, unsigned long addr,
@@ -68,12 +68,13 @@ static inline void page_table_check_pud_clear(struct mm_struct *mm, pud_t pud) }static inline void page_table_check_ptes_set (struct mm_struct *mm, -pte_t *ptep,pte_t pte,unsigned int nr) +unsigned long addr,pte_t *ptep, +pte_t pte,unsigned int nr) {if (static_branch_likely (&page_table_check_disabled))return ; -__page_table_check_ptes_set (mm, ptep, pte, nr); +__page_table_check_ptes_set (mm, addr, ptep, pte, nr); } static inline void page_table_check_pmd_set(struct mm_struct *mm,
@@ -129,7 +130,8 @@ static inline void page_table_check_pud_clear(struct mm_struct *mm, pud_t pud) }static inline void page_table_check_ptes_set (struct mm_struct *mm, -pte_t *ptep,pte_t pte,unsigned int nr) +unsigned long addr,pte_t *ptep, +pte_t pte,unsigned int nr) { }
include/linux/pgtable.h +1 -1
@@ -264,7 +264,7 @@ static inline pte_t pte_advance_pfn(pte_t pte, unsigned long nr)static inline void set_ptes (struct mm_struct *mm,unsigned long addr,pte_t *ptep,pte_t pte,unsigned int nr) { -page_table_check_ptes_set (mm, ptep, pte, nr); +page_table_check_ptes_set (mm, addr, ptep, pte, nr);arch_enter_lazy_mmu_mode ();for (;;) {
mm/page_table_check.c +2 -2
@@ -182,8 +182,8 @@ void __page_table_check_pud_clear(struct mm_struct *mm, pud_t pud) }EXPORT_SYMBOL (__page_table_check_pud_clear); -void __page_table_check_ptes_set (struct mm_struct *mm,pte_t *ptep,pte_t pte, -unsigned int nr) +void __page_table_check_ptes_set (struct mm_struct *mm,unsigned long addr, +pte_t *ptep,pte_t pte,unsigned int nr) {unsigned int i;
Signature · 7 lines
2.44.0 _______________________________________________ linux-riscv mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-riscv
PATCH v11 4/11 Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pud_clear"
In reply to Rohan McLureThis reverts commit 931c38e16499a057e30a3033f4d6a9c242f0f156.
Reinstate previously unused parameters for the purpose of supporting powerpc platforms, as many do not encode user/kernel ownership of the page in the pte, but instead in the address of the access.
--- arch/x86/include/asm/pgtable.h | 2 +- include/linux/page_table_check.h | 11 +++++++---- include/linux/pgtable.h | 2 +- mm/page_table_check.c | 5 +++-- 4 files changed, 12 insertions(+), 8 deletions(-)
arch/x86/include/asm/pgtable.h +1 -1
@@ -1356,7 +1356,7 @@ static inline pud_t pudp_huge_get_and_clear(struct mm_struct *mm, {pud_t pud =native_pudp_get_and_clear (pudp); -page_table_check_pud_clear (mm, pud); +page_table_check_pud_clear (mm, addr, pud);return pud; }
include/linux/page_table_check.h +7 -4
@@ -16,7 +16,8 @@ extern struct page_ext_operations page_table_check_ops;void __page_table_check_zero (struct page *page,unsigned int order);void __page_table_check_pte_clear (struct mm_struct *mm,pte_t pte);void __page_table_check_pmd_clear (struct mm_struct *mm,pmd_t pmd); -void __page_table_check_pud_clear (struct mm_struct *mm,pud_t pud); +void __page_table_check_pud_clear (struct mm_struct *mm,unsigned long addr, +pud_t pud);void __page_table_check_ptes_set (struct mm_struct *mm,unsigned long addr,pte_t *ptep,pte_t pte,unsigned int nr); void __page_table_check_pmd_set(struct mm_struct *mm, unsigned long addr,
@@ -59,12 +60,13 @@ static inline void page_table_check_pmd_clear(struct mm_struct *mm, pmd_t pmd)__page_table_check_pmd_clear (mm, pmd); } -static inline void page_table_check_pud_clear (struct mm_struct *mm,pud_t pud) +static inline void page_table_check_pud_clear (struct mm_struct *mm, +unsigned long addr,pud_t pud) {if (static_branch_likely (&page_table_check_disabled))return ; -__page_table_check_pud_clear (mm, pud); +__page_table_check_pud_clear (mm, addr, pud); } static inline void page_table_check_ptes_set(struct mm_struct *mm,
@@ -125,7 +127,8 @@ static inline void page_table_check_pmd_clear(struct mm_struct *mm, pmd_t pmd) { } -static inline void page_table_check_pud_clear (struct mm_struct *mm,pud_t pud) +static inline void page_table_check_pud_clear (struct mm_struct *mm, +unsigned long addr,pud_t pud) { }
include/linux/pgtable.h +1 -1
@@ -570,7 +570,7 @@ static inline pud_t pudp_huge_get_and_clear(struct mm_struct *mm,pud_t pud = *pudp;pud_clear (pudp); -page_table_check_pud_clear (mm, pud); +page_table_check_pud_clear (mm, address, pud);return pud; }
mm/page_table_check.c +3 -2
@@ -171,7 +171,8 @@ void __page_table_check_pmd_clear(struct mm_struct *mm, pmd_t pmd) }EXPORT_SYMBOL (__page_table_check_pmd_clear); -void __page_table_check_pud_clear (struct mm_struct *mm,pud_t pud) +void __page_table_check_pud_clear (struct mm_struct *mm,unsigned long addr, +pud_t pud) {if (&init_mm == mm)return ;
@@ -217,7 +218,7 @@ void __page_table_check_pud_set(struct mm_struct *mm, unsigned long addr,if (&init_mm == mm)return ; -__page_table_check_pud_clear (mm, *pudp); +__page_table_check_pud_clear (mm, addr, *pudp);if (pud_user_accessible_page (pud)) {page_table_check_set (pud_pfn (pud),PUD_SIZE >>PAGE_SHIFT ,pud_write (pud));
Signature · 1 line
2.44.0
PATCH v11 5/11 Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pmd_clear"
In reply to Rohan McLureThis reverts commit 1831414cd729a34af937d56ad684a66599de6344.
Reinstate previously unused parameters for the purpose of supporting powerpc platforms, as many do not encode user/kernel ownership of the page in the pte, but instead in the address of the access.
--- arch/arm64/include/asm/pgtable.h | 2 +- arch/riscv/include/asm/pgtable.h | 2 +- arch/x86/include/asm/pgtable.h | 2 +- include/linux/page_table_check.h | 11 +++++++---- include/linux/pgtable.h | 2 +- mm/page_table_check.c | 5 +++-- 6 files changed, 14 insertions(+), 10 deletions(-)
arch/arm64/include/asm/pgtable.h +1 -1
@@ -1188,7 +1188,7 @@ static inline pmd_t pmdp_huge_get_and_clear(struct mm_struct *mm, {pmd_t pmd =__pmd (xchg_relaxed (&pmd_val (*pmdp),0 )); -page_table_check_pmd_clear (mm, pmd); +page_table_check_pmd_clear (mm, address, pmd);return pmd; }
arch/riscv/include/asm/pgtable.h +1 -1
@@ -767,7 +767,7 @@ static inline pmd_t pmdp_huge_get_and_clear(struct mm_struct *mm, {pmd_t pmd =__pmd (atomic_long_xchg ((atomic_long_t *)pmdp,0 )); -page_table_check_pmd_clear (mm, pmd); +page_table_check_pmd_clear (mm, address, pmd);return pmd; }
arch/x86/include/asm/pgtable.h +1 -1
@@ -1345,7 +1345,7 @@ static inline pmd_t pmdp_huge_get_and_clear(struct mm_struct *mm, unsigned long {pmd_t pmd =native_pmdp_get_and_clear (pmdp); -page_table_check_pmd_clear (mm, pmd); +page_table_check_pmd_clear (mm, addr, pmd);return pmd; }
include/linux/page_table_check.h +7 -4
@@ -15,7 +15,8 @@ extern struct page_ext_operations page_table_check_ops;void __page_table_check_zero (struct page *page,unsigned int order);void __page_table_check_pte_clear (struct mm_struct *mm,pte_t pte); -void __page_table_check_pmd_clear (struct mm_struct *mm,pmd_t pmd); +void __page_table_check_pmd_clear (struct mm_struct *mm,unsigned long addr, +pmd_t pmd);void __page_table_check_pud_clear (struct mm_struct *mm,unsigned long addr,pud_t pud); void __page_table_check_ptes_set(struct mm_struct *mm, unsigned long addr,
@@ -52,12 +53,13 @@ static inline void page_table_check_pte_clear(struct mm_struct *mm, pte_t pte)__page_table_check_pte_clear (mm, pte); } -static inline void page_table_check_pmd_clear (struct mm_struct *mm,pmd_t pmd) +static inline void page_table_check_pmd_clear (struct mm_struct *mm, +unsigned long addr,pmd_t pmd) {if (static_branch_likely (&page_table_check_disabled))return ; -__page_table_check_pmd_clear (mm, pmd); +__page_table_check_pmd_clear (mm, addr, pmd); } static inline void page_table_check_pud_clear(struct mm_struct *mm,
@@ -123,7 +125,8 @@ static inline void page_table_check_pte_clear(struct mm_struct *mm, pte_t pte) { } -static inline void page_table_check_pmd_clear (struct mm_struct *mm,pmd_t pmd) +static inline void page_table_check_pmd_clear (struct mm_struct *mm, +unsigned long addr,pmd_t pmd) { }
include/linux/pgtable.h +1 -1
@@ -557,7 +557,7 @@ static inline pmd_t pmdp_huge_get_and_clear(struct mm_struct *mm,pmd_t pmd = *pmdp;pmd_clear (pmdp); -page_table_check_pmd_clear (mm, pmd); +page_table_check_pmd_clear (mm, address, pmd);return pmd; }
mm/page_table_check.c +3 -2
@@ -160,7 +160,8 @@ void __page_table_check_pte_clear(struct mm_struct *mm, pte_t pte) }EXPORT_SYMBOL (__page_table_check_pte_clear); -void __page_table_check_pmd_clear (struct mm_struct *mm,pmd_t pmd) +void __page_table_check_pmd_clear (struct mm_struct *mm,unsigned long addr, +pmd_t pmd) {if (&init_mm == mm)return ;
@@ -204,7 +205,7 @@ void __page_table_check_pmd_set(struct mm_struct *mm, unsigned long addr,if (&init_mm == mm)return ; -__page_table_check_pmd_clear (mm, *pmdp); +__page_table_check_pmd_clear (mm, addr, *pmdp);if (pmd_user_accessible_page (pmd)) {page_table_check_set (pmd_pfn (pmd),PMD_SIZE >>PAGE_SHIFT ,pmd_write (pmd));
Signature · 1 line
2.44.0
PATCH v11 6/11 Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pte_clear"
In reply to Rohan McLureThis reverts commit aa232204c4689427cefa55fe975692b57291523a.
Reinstate previously unused parameters for the purpose of supporting powerpc platforms, as many do not encode user/kernel ownership of the page in the pte, but instead in the address of the access.
--- arch/arm64/include/asm/pgtable.h | 2 +- arch/riscv/include/asm/pgtable.h | 2 +- arch/x86/include/asm/pgtable.h | 4 ++-- include/linux/page_table_check.h | 11 +++++++---- include/linux/pgtable.h | 2 +- mm/page_table_check.c | 7 ++++--- 6 files changed, 16 insertions(+), 12 deletions(-)
arch/arm64/include/asm/pgtable.h +1 -1
@@ -1145,7 +1145,7 @@ static inline pte_t __ptep_get_and_clear(struct mm_struct *mm, {pte_t pte =__pte (xchg_relaxed (&pte_val (*ptep),0 )); -page_table_check_pte_clear (mm, pte); +page_table_check_pte_clear (mm, address, pte);return pte; }
arch/riscv/include/asm/pgtable.h +1 -1
@@ -563,7 +563,7 @@ static inline pte_t ptep_get_and_clear(struct mm_struct *mm, {pte_t pte =__pte (atomic_long_xchg ((atomic_long_t *)ptep,0 )); -page_table_check_pte_clear (mm, pte); +page_table_check_pte_clear (mm, address, pte);return pte; }
arch/x86/include/asm/pgtable.h +2 -2
@@ -1276,7 +1276,7 @@ static inline pte_t ptep_get_and_clear(struct mm_struct *mm, unsigned long addr, pte_t *ptep) {pte_t pte =native_ptep_get_and_clear (ptep); -page_table_check_pte_clear (mm, pte); +page_table_check_pte_clear (mm, addr, pte);return pte; }
@@ -1292,7 +1292,7 @@ static inline pte_t ptep_get_and_clear_full(struct mm_struct *mm,* care about updates and native needs no locking */ pte =native_local_ptep_get_and_clear (ptep); -page_table_check_pte_clear (mm, pte); +page_table_check_pte_clear (mm, addr, pte); }else { pte =ptep_get_and_clear (mm, addr, ptep); }
include/linux/page_table_check.h +7 -4
@@ -14,7 +14,8 @@ extern struct static_key_true page_table_check_disabled;extern struct page_ext_operations page_table_check_ops;void __page_table_check_zero (struct page *page,unsigned int order); -void __page_table_check_pte_clear (struct mm_struct *mm,pte_t pte); +void __page_table_check_pte_clear (struct mm_struct *mm,unsigned long addr, +pte_t pte);void __page_table_check_pmd_clear (struct mm_struct *mm,unsigned long addr,pmd_t pmd); void __page_table_check_pud_clear(struct mm_struct *mm, unsigned long addr,
@@ -45,12 +46,13 @@ static inline void page_table_check_free(struct page *page, unsigned int order)__page_table_check_zero (page, order); } -static inline void page_table_check_pte_clear (struct mm_struct *mm,pte_t pte) +static inline void page_table_check_pte_clear (struct mm_struct *mm, +unsigned long addr,pte_t pte) {if (static_branch_likely (&page_table_check_disabled))return ; -__page_table_check_pte_clear (mm, pte); +__page_table_check_pte_clear (mm, addr, pte); } static inline void page_table_check_pmd_clear(struct mm_struct *mm,
@@ -121,7 +123,8 @@ static inline void page_table_check_free(struct page *page, unsigned int order) { } -static inline void page_table_check_pte_clear (struct mm_struct *mm,pte_t pte) +static inline void page_table_check_pte_clear (struct mm_struct *mm, +unsigned long addr,pte_t pte) { }
include/linux/pgtable.h +1 -1
@@ -454,7 +454,7 @@ static inline pte_t ptep_get_and_clear(struct mm_struct *mm, {pte_t pte =ptep_get (ptep);pte_clear (mm, address, ptep); -page_table_check_pte_clear (mm, pte); +page_table_check_pte_clear (mm, address, pte);return pte; }#endif
mm/page_table_check.c +4 -3
@@ -149,7 +149,8 @@ void __page_table_check_zero(struct page *page, unsigned int order)page_ext_put (page_ext); } -void __page_table_check_pte_clear (struct mm_struct *mm,pte_t pte) +void __page_table_check_pte_clear (struct mm_struct *mm,unsigned long addr, +pte_t pte) {if (&init_mm == mm)return ;
@@ -193,7 +194,7 @@ void __page_table_check_ptes_set(struct mm_struct *mm, unsigned long addr,return ;for (i =0 ; i < nr; i++) -__page_table_check_pte_clear (mm,ptep_get (ptep + i)); +__page_table_check_pte_clear (mm, addr,ptep_get (ptep + i));if (pte_user_accessible_page (pte))page_table_check_set (pte_pfn (pte), nr,pte_write (pte)); }
@@ -241,7 +242,7 @@ void __page_table_check_pte_clear_range(struct mm_struct *mm,if (WARN_ON (!ptep))return ;for (i =0 ; i <PTRS_PER_PTE ; i++) { -__page_table_check_pte_clear (mm,ptep_get (ptep)); +__page_table_check_pte_clear (mm, addr,ptep_get (ptep)); addr +=PAGE_SIZE ; ptep++; }
Signature · 1 line
2.44.0
PATCH v11 7/11 mm: Provide address parameter to p{te,md,ud}_user_accessible_page()
In reply to Rohan McLureOn several powerpc platforms, a page table entry may not imply whether the relevant mapping is for userspace or kernelspace. Instead, such platforms infer this by the address which is being accessed.
Add an additional address argument to each of these routines in order to provide support for page table check on powerpc.
--- arch/arm64/include/asm/pgtable.h | 6 +++--- arch/riscv/include/asm/pgtable.h | 6 +++--- arch/x86/include/asm/pgtable.h | 6 +++--- mm/page_table_check.c | 12 ++++++------ 4 files changed, 15 insertions(+), 15 deletions(-)
arch/arm64/include/asm/pgtable.h +3 -3
@@ -1074,17 +1074,17 @@ static inline int pgd_devmap(pgd_t pgd)#endif #ifdef CONFIG_PAGE_TABLE_CHECK -static inline bool pte_user_accessible_page (pte_t pte) +static inline bool pte_user_accessible_page (pte_t pte,unsigned long addr) {return pte_present (pte) && (pte_user (pte) ||pte_user_exec (pte)); } -static inline bool pmd_user_accessible_page (pmd_t pmd) +static inline bool pmd_user_accessible_page (pmd_t pmd,unsigned long addr) {return pmd_leaf (pmd) && !pmd_present_invalid (pmd) && (pmd_user (pmd) ||pmd_user_exec (pmd)); } -static inline bool pud_user_accessible_page (pud_t pud) +static inline bool pud_user_accessible_page (pud_t pud,unsigned long addr) {return pud_leaf (pud) && (pud_user (pud) ||pud_user_exec (pud)); }
arch/riscv/include/asm/pgtable.h +3 -3
@@ -724,17 +724,17 @@ static inline void set_pud_at(struct mm_struct *mm, unsigned long addr, }#ifdef CONFIG_PAGE_TABLE_CHECK -static inline bool pte_user_accessible_page (pte_t pte) +static inline bool pte_user_accessible_page (pte_t pte,unsigned long addr) {return pte_present (pte) &&pte_user (pte); } -static inline bool pmd_user_accessible_page (pmd_t pmd) +static inline bool pmd_user_accessible_page (pmd_t pmd,unsigned long addr) {return pmd_leaf (pmd) &&pmd_user (pmd); } -static inline bool pud_user_accessible_page (pud_t pud) +static inline bool pud_user_accessible_page (pud_t pud,unsigned long addr) {return pud_leaf (pud) &&pud_user (pud); }
arch/x86/include/asm/pgtable.h +3 -3
@@ -1688,17 +1688,17 @@ static inline bool arch_has_hw_nonleaf_pmd_young(void)#endif #ifdef CONFIG_PAGE_TABLE_CHECK -static inline bool pte_user_accessible_page (pte_t pte) +static inline bool pte_user_accessible_page (pte_t pte,unsigned long addr) {return (pte_val (pte) & _PAGE_PRESENT) && (pte_val (pte) & _PAGE_USER); } -static inline bool pmd_user_accessible_page (pmd_t pmd) +static inline bool pmd_user_accessible_page (pmd_t pmd,unsigned long addr) {return pmd_leaf (pmd) && (pmd_val (pmd) & _PAGE_PRESENT) && (pmd_val (pmd) & _PAGE_USER); } -static inline bool pud_user_accessible_page (pud_t pud) +static inline bool pud_user_accessible_page (pud_t pud,unsigned long addr) {return pud_leaf (pud) && (pud_val (pud) & _PAGE_PRESENT) && (pud_val (pud) & _PAGE_USER); }
mm/page_table_check.c +6 -6
@@ -155,7 +155,7 @@ void __page_table_check_pte_clear(struct mm_struct *mm, unsigned long addr,if (&init_mm == mm)return ; -if (pte_user_accessible_page (pte)) { +if (pte_user_accessible_page (pte, addr)) {page_table_check_clear (pte_pfn (pte),PAGE_SIZE >>PAGE_SHIFT ); } }
@@ -167,7 +167,7 @@ void __page_table_check_pmd_clear(struct mm_struct *mm, unsigned long addr,if (&init_mm == mm)return ; -if (pmd_user_accessible_page (pmd)) { +if (pmd_user_accessible_page (pmd, addr)) {page_table_check_clear (pmd_pfn (pmd),PMD_SIZE >>PAGE_SHIFT ); } }
@@ -179,7 +179,7 @@ void __page_table_check_pud_clear(struct mm_struct *mm, unsigned long addr,if (&init_mm == mm)return ; -if (pud_user_accessible_page (pud)) { +if (pud_user_accessible_page (pud, addr)) {page_table_check_clear (pud_pfn (pud),PUD_SIZE >>PAGE_SHIFT ); } }
@@ -195,7 +195,7 @@ void __page_table_check_ptes_set(struct mm_struct *mm, unsigned long addr,for (i =0 ; i < nr; i++)__page_table_check_pte_clear (mm, addr,ptep_get (ptep + i)); -if (pte_user_accessible_page (pte)) +if (pte_user_accessible_page (pte, addr))page_table_check_set (pte_pfn (pte), nr,pte_write (pte)); }EXPORT_SYMBOL (__page_table_check_ptes_set);
@@ -207,7 +207,7 @@ void __page_table_check_pmd_set(struct mm_struct *mm, unsigned long addr,return ;__page_table_check_pmd_clear (mm, addr, *pmdp); -if (pmd_user_accessible_page (pmd)) { +if (pmd_user_accessible_page (pmd, addr)) {page_table_check_set (pmd_pfn (pmd),PMD_SIZE >>PAGE_SHIFT ,pmd_write (pmd)); }
@@ -221,7 +221,7 @@ void __page_table_check_pud_set(struct mm_struct *mm, unsigned long addr,return ;__page_table_check_pud_clear (mm, addr, *pudp); -if (pud_user_accessible_page (pud)) { +if (pud_user_accessible_page (pud, addr)) {page_table_check_set (pud_pfn (pud),PUD_SIZE >>PAGE_SHIFT ,pud_write (pud)); }
Signature · 1 line
2.44.0
PATCH v11 8/11 powerpc: mm: Add pud_pfn() stub
In reply to Rohan McLureThe page table check feature requires that pud_pfn() be defined on each consuming architecture. Since only 64-bit, Book3S platforms allow for hugepages at this upper level, and since the calling code is gated by a call to pud_user_accessible_page(), which will return zero, include this stub as a BUILD_BUG().
---
v11: pud_pfn() stub has been removed upstream as it has valid users now in transparent hugepages. Create a BUG_ON() for other, non Book3S64 platforms.
--- arch/powerpc/include/asm/pgtable.h | 8 ++++++++ 1 file changed, 8 insertions(+)
arch/powerpc/include/asm/pgtable.h +8 -0
@@ -211,6 +211,14 @@ static inline bool arch_supports_memmap_on_memory(unsigned long vmemmap_size)#endif /* CONFIG_PPC64 */ +#ifndef pud_pfn +#define pud_pfn pud_pfn +static inline int pud_pfn (pud_t pud) +{ +BUILD_BUG (); +} +#endif +#endif /* __ASSEMBLY__ */ #endif /* _ASM_POWERPC_PGTABLE_H */
Signature · 7 lines
2.44.0 _______________________________________________ linux-riscv mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-riscv
Re: [PATCH v11 08/11] powerpc: mm: Add pud_pfn() stub
Le 28/03/2024 à 05:55, Rohan McLure a écrit :
Quoted 20 lines
The page table check feature requires that
pud_pfn()be defined on each consuming architecture. Since only 64-bit, Book3S platforms allow for hugepages at this upper level, and since the calling code is gated by a call topud_user_accessible_page(), which will return zero, include this stub as aBUILD_BUG().Signed-off-by Rohan McLure <[email protected]>---
v11:pud_pfn()stub has been removed upstream as it has valid users now in transparent hugepages. Create aBUG_ON()for other, non Book3S64 platforms.--- arch/powerpc/include/asm/pgtable.h | 8 ++++++++ 1 file changed, 8 insertions(+)arch/powerpc/include/asm/pgtable.h +0
-0
arch/powerpc/include/asm/pgtable.h static inline bool arch_supports_memmap_on_memory(unsigned long vmemmap_size) · line 218
Quoted 8 lines
arch/powerpc/include/asm/pgtable.h +5
-0@@ -211,6 +211,14 @@ static inline bool arch_supports_memmap_on_memory(unsigned long vmemmap_size)#endif /* CONFIG_PPC64 */ +#ifndef pud_pfn +#define pud_pfn pud_pfn +static inline int pud_pfn (pud_t pud) +{ +BUILD_BUG ();
This function must return something.
Quoted 6 lines
arch/powerpc/include/asm/pgtable.h +3
-0+} +#endif +#endif /* __ASSEMBLY__ */ #endif /* _ASM_POWERPC_PGTABLE_H */
PATCH v11 9/11 poweprc: mm: Implement *_user_accessible_page() for ptes
In reply to Rohan McLurePage table checking depends on architectures providing an implementation of p{te,md,ud}_user_accessible_page. With refactorisations made on powerpc/mm, the pte_access_permitted() and similar methods verify whether a userland page is accessible with the required permissions.
Since page table checking is the only user of p{te,md,ud}_user_accessible_page(), implement these for all platforms, using some of the same preliminary checks taken by pte_access_permitted() on that platform.
Since Commit 8e9bd41e4ce1 ("powerpc/nohash: Replace pte_user() by pte_read()") pte_user() is no longer required to be present on all platforms as it may be equivalent to or implied by pte_read(). Hence implementations of pte_user_accessible_page() are specialised.
---
v9: New implementation
v10: Let book3s/64 use pte_user(), but otherwise default other platforms to using the address provided with the call to infer whether it is a user page or not. pmd/pud variants will warn on all other platforms, as they should not be used for user page mappings
v11: Conditionally define p{m,u}d_user_accessible_page(), as not all platforms have p{m,u}d_leaf(), p{m,u}d_pte() stubs.
--- arch/powerpc/include/asm/book3s/32/pgtable.h | 5 +++++ arch/powerpc/include/asm/book3s/64/pgtable.h | 17 +++++++++++++++++ arch/powerpc/include/asm/nohash/pgtable.h | 5 +++++ arch/powerpc/include/asm/pgtable.h | 8 ++++++++ 4 files changed, 35 insertions(+)
arch/powerpc/include/asm/book3s/32/pgtable.h +5 -0
@@ -436,6 +436,11 @@ static inline bool pte_access_permitted(pte_t pte, bool write)return true; } +static inline bool pte_user_accessible_page (pte_t pte,unsigned long addr) +{ +return pte_present (pte) && !is_kernel_addr (addr); +} +/* Conversion functions: convert a page and protection to a page entry, * and a page entry and page directory to the page they refer to. *
arch/powerpc/include/asm/book3s/64/pgtable.h +17 -0
@@ -538,6 +538,11 @@ static inline bool pte_access_permitted(pte_t pte, bool write)return arch_pte_access_permitted (pte_val (pte), write,0 ); } +static inline bool pte_user_accessible_page (pte_t pte,unsigned long addr) +{ +return pte_present (pte) &&pte_user (pte); +} +/* * Conversion functions: convert a page and protection to a page entry, * and a page entry and page directory to the page they refer to.
@@ -1441,5 +1446,17 @@ static inline bool pud_leaf(pud_t pud)return !!(pud_raw (pud) &cpu_to_be64 (_PAGE_PTE)); } +#define pmd_user_accessible_page pmd_user_accessible_page +static inline bool pmd_user_accessible_page (pmd_t pmd,unsigned long addr) +{ +return pmd_leaf (pmd) &&pte_user_accessible_page (pmd_pte (pmd), addr); +} + +#define pud_user_accessible_page pud_user_accessible_page +static inline bool pud_user_accessible_page (pud_t pud,unsigned long addr) +{ +return pud_leaf (pud) &&pte_user_accessible_page (pud_pte (pud), addr); +} +#endif /* __ASSEMBLY__ */ #endif /* _ASM_POWERPC_BOOK3S_64_PGTABLE_H_ */
arch/powerpc/include/asm/nohash/pgtable.h +5 -0
@@ -213,6 +213,11 @@ static inline bool pte_access_permitted(pte_t pte, bool write)return true; } +static inline bool pte_user_accessible_page (pte_t pte,unsigned long addr) +{ +return pte_present (pte) && !is_kernel_addr (addr); +} +/* Conversion functions: convert a page and protection to a page entry, * and a page entry and page directory to the page they refer to. *
arch/powerpc/include/asm/pgtable.h +8 -0
@@ -219,6 +219,14 @@ static inline int pud_pfn(pud_t pud) }#endif +#ifndef pmd_user_accessible_page +#define pmd_user_accessible_page (pmd, addr) false +#endif + +#ifndef pud_user_accessible_page +#define pud_user_accessible_page (pud, addr) false +#endif +#endif /* __ASSEMBLY__ */ #endif /* _ASM_POWERPC_PGTABLE_H */
Signature · 7 lines
2.44.0 _______________________________________________ linux-riscv mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-riscv
Re: [PATCH v11 09/11] poweprc: mm: Implement *_user_accessible_page() for ptes
Le 28/03/2024 à 05:55, Rohan McLure a écrit :
Quoted 17 lines
Page table checking depends on architectures providing an implementation of p{te,md,ud}_user_accessible_page. With refactorisations made on powerpc/mm, the
pte_access_permitted()and similar methods verify whether a userland page is accessible with the required permissions.Since page table checking is the only user of p{te,md,ud}_user_accessible_page(), implement these for all platforms, using some of the same preliminary checks taken by
pte_access_permitted()on that platform.Since Commit
8e9bd41e4ce1("powerpc/nohash: Replacepte_user()bypte_read()")pte_user()is no longer required to be present on all platforms as it may be equivalent to or implied bypte_read(). Hence implementations ofpte_user_accessible_page()are specialised.Signed-off-by Rohan McLure <[email protected]>
Quoted 8 lines
---
v9: New implementation
v10: Let book3s/64 usepte_user(), but otherwise default other platforms to using the address provided with the call to infer whether it is a user page or not. pmd/pud variants will warn on all other platforms, as they should not be used for user page mappings
v11: Conditionally define p{m,u}d_user_accessible_page(), as not all platforms have p{m,u}d_leaf(), p{m,u}d_pte() stubs.
See my comment to v10 patch 10.
p{m,u}d_leaf() is defined for all platforms (There is a fallback definition in include/linux/pgtable.h) so p{m,u}d_user_accessible_page() can be defined for all platforms, no need for a conditionally define.
Quoted 92 lines
--- arch/powerpc/include/asm/book3s/32/pgtable.h | 5 +++++ arch/powerpc/include/asm/book3s/64/pgtable.h | 17 +++++++++++++++++ arch/powerpc/include/asm/nohash/pgtable.h | 5 +++++ arch/powerpc/include/asm/pgtable.h | 8 ++++++++ 4 files changed, 35 insertions(+)arch/powerpc/include/asm/book3s/32/pgtable.h +5
-0@@ -436,6 +436,11 @@ static inline bool pte_access_permitted(pte_t pte, bool write)return true; } +static inline bool pte_user_accessible_page (pte_t pte,unsigned long addr) +{ +return pte_present (pte) && !is_kernel_addr (addr); +} +/* Conversion functions: convert a page and protection to a page entry, * and a page entry and page directory to the page they refer to. * arch/powerpc/include/asm/book3s/64/pgtable.h +17
-0@@ -538,6 +538,11 @@ static inline bool pte_access_permitted(pte_t pte, bool write)return arch_pte_access_permitted (pte_val (pte), write,0 ); } +static inline bool pte_user_accessible_page (pte_t pte,unsigned long addr) +{ +return pte_present (pte) &&pte_user (pte); +} +/* * Conversion functions: convert a page and protection to a page entry, * and a page entry and page directory to the page they refer to. @@ -1441,5 +1446,17 @@ static inline bool pud_leaf(pud_t pud)return !!(pud_raw (pud) &cpu_to_be64 (_PAGE_PTE)); } +#define pmd_user_accessible_page pmd_user_accessible_page +static inline bool pmd_user_accessible_page (pmd_t pmd,unsigned long addr) +{ +return pmd_leaf (pmd) &&pte_user_accessible_page (pmd_pte (pmd), addr); +} + +#define pud_user_accessible_page pud_user_accessible_page +static inline bool pud_user_accessible_page (pud_t pud,unsigned long addr) +{ +return pud_leaf (pud) &&pte_user_accessible_page (pud_pte (pud), addr); +} +#endif /* __ASSEMBLY__ */ #endif /* _ASM_POWERPC_BOOK3S_64_PGTABLE_H_ */ arch/powerpc/include/asm/nohash/pgtable.h +5
-0@@ -213,6 +213,11 @@ static inline bool pte_access_permitted(pte_t pte, bool write)return true; } +static inline bool pte_user_accessible_page (pte_t pte,unsigned long addr) +{ +return pte_present (pte) && !is_kernel_addr (addr); +} +/* Conversion functions: convert a page and protection to a page entry, * and a page entry and page directory to the page they refer to. * arch/powerpc/include/asm/pgtable.h +8
-0@@ -219,6 +219,14 @@ static inline int pud_pfn(pud_t pud) }#endif +#ifndef pmd_user_accessible_page +#define pmd_user_accessible_page (pmd, addr) false +#endif + +#ifndef pud_user_accessible_page +#define pud_user_accessible_page (pud, addr) false +#endif +#endif /* __ASSEMBLY__ */ #endif /* _ASM_POWERPC_PGTABLE_H */
Re: [PATCH v11 09/11] poweprc: mm: Implement *_user_accessible_page() for ptes
Quoted 39 lines · Christophe Leroy
Le 28/03/2024 à 05:55, Rohan McLure a écrit :
Quoted 23 lines
Page table checking depends on architectures providing an implementation of p{te,md,ud}_user_accessible_page. With refactorisations made on powerpc/mm, the
pte_access_permitted()and similar methods verify whether a userland page is accessible with the
required permissions.Since page table checking is the only user of p{te,md,ud}_user_accessible_page(), implement these for all platforms,
using some of the same preliminary checks taken bypte_access_permitted()
on that platform.Since Commit
8e9bd41e4ce1("powerpc/nohash: Replacepte_user()bypte_read()")pte_user()is no longer required to be present on all platforms as it
may be equivalent to or implied bypte_read(). Hence implementations ofpte_user_accessible_page()are specialised.Signed-off-by Rohan McLure <[email protected]>Quoted 12 lines
---
v9: New implementation
v10: Let book3s/64 usepte_user(), but otherwise default other platforms
to using the address provided with the call to infer whether it is a
user page or not. pmd/pud variants will warn on all other platforms, as
they should not be used for user page mappings
v11: Conditionally define p{m,u}d_user_accessible_page(), as not all
platforms have p{m,u}d_leaf(), p{m,u}d_pte() stubs.
Quoted 6 lines
See my comment to v10 patch 10.
p{m,u}d_leaf() is defined for all platforms (There is a fallback definition in
include/linux/pgtable.h) so p{m,u}d_user_accessible_page()
can be defined for all platforms, no need for a conditionally define.
The issue I see is that the definition in include/linux/pgtable.h occurs after this header is included. Prior to the removal of a local definition of p{m,u}d_leaf() etc we didn't run into this issue, but we still do now.
Not insistent on doing it this way with ifndef, so amenable to suggestions if you have a preference.
Quoted 111 lines
Quoted 111 lines
---
arch/powerpc/include/asm/book3s/32/pgtable.h| 5 +++++arch/powerpc/include/asm/book3s/64/pgtable.h| 17
+++++++++++++++++
arch/powerpc/include/asm/nohash/pgtable.h | 5 +++++ arch/powerpc/include/asm/pgtable.h | 8 ++++++++4 files changed, 35 insertions(+)arch/powerpc/include/asm/book3s/32/pgtable.h +0
-0@@ -436,6 +436,11 @@ static inline bool pte_access_permitted(pte_t pte, bool write) return true; }
+static inline boolpte_user_accessible_page(pte_t pte, unsigned long addr)arch/powerpc/include/asm/book3s/32/pgtable.h +4
-0+{ +return pte_present (pte) && !is_kernel_addr (addr); +} +/* Conversion functions: convert a page and protection to a page entry,
* and a page entry and page directory to the page they refer to. *arch/powerpc/include/asm/book3s/64/pgtable.h +0
-0@@ -538,6 +538,11 @@ static inline bool pte_access_permitted(pte_t pte, bool write) return arch_pte_access_permitted(pte_val(pte), write, 0); }
+static inline boolpte_user_accessible_page(pte_t pte, unsigned long addr)arch/powerpc/include/asm/book3s/64/pgtable.h +4
-0+{ +return pte_present (pte) &&pte_user (pte); +} +/*
* Conversion functions: convert a page and protection to a page entry,
* and a page entry and page directory to the page they refer to.arch/powerpc/include/asm/book3s/64/pgtable.h +0
-0@@ -1441,5 +1446,17 @@ static inline bool pud_leaf(pud_t pud) return !!(pud_raw(pud) & cpu_to_be64(_PAGE_PTE)); }arch/powerpc/include/asm/book3s/64/pgtable.h +2
-0+#define pmd_user_accessible_page pmd_user_accessible_page +static inline bool pmd_user_accessible_page(pmd_t pmd, unsignedlong addr)
arch/powerpc/include/asm/book3s/64/pgtable.h +2
-0+{ + return pmd_leaf(pmd) &&
pte_user_accessible_page(pmd_pte(pmd), addr);arch/powerpc/include/asm/book3s/64/pgtable.h +4
-0+} + +#define pud_user_accessible_page pud_user_accessible_page +static inline bool pud_user_accessible_page(pud_t pud, unsignedlong addr)
arch/powerpc/include/asm/book3s/64/pgtable.h +2
-0+{ + return pud_leaf(pud) &&
pte_user_accessible_page(pud_pte(pud), addr);arch/powerpc/include/asm/book3s/64/pgtable.h +2
-0+} +#endif /*
__ASSEMBLY__*/
#endif /* _ASM_POWERPC_BOOK3S_64_PGTABLE_H_ */arch/powerpc/include/asm/nohash/pgtable.h +0
-0@@ -213,6 +213,11 @@ static inline bool pte_access_permitted(pte_t pte, bool write) return true; }
+static inline boolpte_user_accessible_page(pte_t pte, unsigned long addr)arch/powerpc/include/asm/nohash/pgtable.h +4
-0+{ +return pte_present (pte) && !is_kernel_addr (addr); +} +/* Conversion functions: convert a page and protection to a page entry,
* and a page entry and page directory to the page they refer to. *arch/powerpc/include/asm/pgtable.h +0
-0@@ -219,6 +219,14 @@ static inline int pud_pfn(pud_t pud) } #endifarch/powerpc/include/asm/pgtable.h +8
-0+#ifndef pmd_user_accessible_page +#define pmd_user_accessible_page (pmd, addr) false +#endif + +#ifndef pud_user_accessible_page +#define pud_user_accessible_page (pud, addr) false +#endif +#endif /*
__ASSEMBLY__*/
#endif /*_ASM_POWERPC_PGTABLE_H*/
PATCH v11 10/11 powerpc: mm: Use set_pte_at_unchecked() for early-boot / internal usages
In reply to Rohan McLureIn the new set_ptes() API, set_pte_at() (a special case of set_ptes()) is intended to be instrumented by the page table check facility. There are however several other routines that constitute the API for setting page table entries, including set_pmd_at() among others. Such routines are themselves implemented in terms of set_ptes_at().
A future patch providing support for page table checking on powerpc must take care to avoid duplicate calls to page_table_check_p{te,md,ud}_set(). Allow for assignment of pte entries without instrumentation through the set_pte_at_unchecked() routine introduced in this patch.
Cause API-facing routines that call set_pte_at() to instead call set_pte_at_unchecked(), which will remain uninstrumented by page table check. set_ptes() is itself implemented by calls to __set_pte_at(), so this eliminates redundant code.
Also prefer set_pte_at_unchecked() in early-boot usages which should not be instrumented.
---
v9: New patch
v10: don't reuse __set_pte_at(), as that will not apply filters. Instead use new set_pte_at_unchecked().
v11: Include the assertion that hwvalid => !protnone. It is possible that some of these calls can be safely replaced with __set_pte_at(), however that will have to be done at a later stage.
--- arch/powerpc/include/asm/pgtable.h | 2 ++ arch/powerpc/mm/book3s64/hash_pgtable.c | 2 +- arch/powerpc/mm/book3s64/pgtable.c | 6 +++--- arch/powerpc/mm/book3s64/radix_pgtable.c | 8 ++++---- arch/powerpc/mm/nohash/book3e_pgtable.c | 2 +- arch/powerpc/mm/pgtable.c | 8 ++++++++ arch/powerpc/mm/pgtable_32.c | 2 +- 7 files changed, 20 insertions(+), 10 deletions(-)
arch/powerpc/include/asm/pgtable.h +2 -0
@@ -46,6 +46,8 @@ struct mm_struct;void set_ptes (struct mm_struct *mm,unsigned long addr,pte_t *ptep,pte_t pte,unsigned int nr);#define set_ptes set_ptes +void set_pte_at_unchecked (struct mm_struct *mm,unsigned long addr, +pte_t *ptep,pte_t pte);#define update_mmu_cache (vma, addr, ptep) \ update_mmu_cache_range(NULL, vma, addr, ptep, 1)
arch/powerpc/mm/book3s64/hash_pgtable.c +1 -1
@@ -165,7 +165,7 @@ int hash__map_kernel_page(unsigned long ea, unsigned long pa, pgprot_t prot) ptep =pte_alloc_kernel (pmdp, ea);if (!ptep)return -ENOMEM ; -set_pte_at (&init_mm, ea, ptep,pfn_pte (pa >>PAGE_SHIFT , prot)); +set_pte_at_unchecked (&init_mm, ea, ptep,pfn_pte (pa >>PAGE_SHIFT , prot)); }else {/* * If the mm subsystem is not fully up, we cannot create a
arch/powerpc/mm/book3s64/pgtable.c +3 -3
@@ -116,7 +116,7 @@ void set_pmd_at(struct mm_struct *mm, unsigned long addr,WARN_ON (!(pmd_leaf (pmd)));#endif trace_hugepage_set_pmd (addr,pmd_val (pmd)); -return set_pte_at (mm, addr,pmdp_ptep (pmdp),pmd_pte (pmd)); +return set_pte_at_unchecked (mm, addr,pmdp_ptep (pmdp),pmd_pte (pmd)); } void set_pud_at(struct mm_struct *mm, unsigned long addr,
@@ -133,7 +133,7 @@ void set_pud_at(struct mm_struct *mm, unsigned long addr,WARN_ON (!(pud_leaf (pud)));#endif trace_hugepage_set_pud (addr,pud_val (pud)); -return set_pte_at (mm, addr,pudp_ptep (pudp),pud_pte (pud)); +return set_pte_at_unchecked (mm, addr,pudp_ptep (pudp),pud_pte (pud)); }static void do_serialize (void *arg)
@@ -539,7 +539,7 @@ void ptep_modify_prot_commit(struct vm_area_struct *vma, unsigned long addr,if (radix_enabled ())return radix__ptep_modify_prot_commit (vma, addr, ptep, old_pte, pte); -set_pte_at (vma->vm_mm, addr, ptep, pte); +set_pte_at_unchecked (vma->vm_mm, addr, ptep, pte); }#ifdef CONFIG_TRANSPARENT_HUGEPAGE
arch/powerpc/mm/book3s64/radix_pgtable.c +4 -4
@@ -109,7 +109,7 @@ static int early_map_kernel_page(unsigned long ea, unsigned long pa, ptep =pte_offset_kernel (pmdp, ea); set_the_pte: -set_pte_at (&init_mm, ea, ptep,pfn_pte (pfn, flags)); +set_pte_at_unchecked (&init_mm, ea, ptep,pfn_pte (pfn, flags)); asmvolatile ("ptesync" : : :"memory" );return 0 ; }
@@ -1522,7 +1522,7 @@ void radix__ptep_modify_prot_commit(struct vm_area_struct *vma, (atomic_read(&mm->context.copros) > 0))radix__flush_tlb_page (vma, addr); -set_pte_at (mm, addr, ptep, pte); +set_pte_at_unchecked (mm, addr, ptep, pte); }int pud_set_huge (pud_t *pud,phys_addr_t addr,pgprot_t prot)
@@ -1533,7 +1533,7 @@ int pud_set_huge(pud_t *pud, phys_addr_t addr, pgprot_t prot)if (!radix_enabled ())return 0 ; -set_pte_at (&init_mm,0 /* radix unused */ , ptep, new_pud); +set_pte_at_unchecked (&init_mm,0 /* radix unused */ , ptep, new_pud);return 1 ; }
@@ -1580,7 +1580,7 @@ int pmd_set_huge(pmd_t *pmd, phys_addr_t addr, pgprot_t prot)if (!radix_enabled ())return 0 ; -set_pte_at (&init_mm,0 /* radix unused */ , ptep, new_pmd); +set_pte_at_unchecked (&init_mm,0 /* radix unused */ , ptep, new_pmd);return 1 ; }
arch/powerpc/mm/nohash/book3e_pgtable.c +1 -1
@@ -111,7 +111,7 @@ int __ref map_kernel_page(unsigned long ea, phys_addr_t pa, pgprot_t prot) } ptep =pte_offset_kernel (pmdp, ea); } -set_pte_at (&init_mm, ea, ptep,pfn_pte (pa >>PAGE_SHIFT , prot)); +set_pte_at_unchecked (&init_mm, ea, ptep,pfn_pte (pa >>PAGE_SHIFT , prot));smp_wmb ();return 0 ;
arch/powerpc/mm/pgtable.c +8 -0
@@ -224,6 +224,14 @@ void set_ptes(struct mm_struct *mm, unsigned long addr, pte_t *ptep, } } +void set_pte_at_unchecked (struct mm_struct *mm,unsigned long addr, +pte_t *ptep,pte_t pte) +{ +VM_WARN_ON (pte_hw_valid (*ptep) && !pte_protnone (*ptep)); + pte =set_pte_filter (pte, addr); +__set_pte_at (mm, addr, ptep, pte,0 ); +} +void unmap_kernel_page (unsigned long va) {pmd_t *pmdp =pmd_off_k (va);
arch/powerpc/mm/pgtable_32.c +1 -1
@@ -89,7 +89,7 @@ int __ref map_kernel_page(unsigned long va, phys_addr_t pa, pgprot_t prot)* hash table */ BUG_ON ((pte_present (*pg) |pte_hashpte (*pg)) &&pgprot_val (prot)); -set_pte_at (&init_mm, va, pg,pfn_pte (pa >>PAGE_SHIFT , prot)); +set_pte_at_unchecked (&init_mm, va, pg,pfn_pte (pa >>PAGE_SHIFT , prot)); }smp_wmb ();return err;
Signature · 7 lines
2.44.0 _______________________________________________ linux-riscv mailing list [email protected] http://lists.infradead.org/mailman/listinfo/linux-riscv
PATCH v11 11/11 powerpc: mm: Support page table check
In reply to Rohan McLureOn creation and clearing of a page table mapping, instrument such calls by invoking page_table_check_pte_set and page_table_check_pte_clear respectively. These calls serve as a sanity check against illegal mappings.
Enable ARCH_SUPPORTS_PAGE_TABLE_CHECK for all platforms.
See also:
riscv support in commit 3fee229a8eb9 ("riscv/mm: enable ARCH_SUPPORTS_PAGE_TABLE_CHECK")
arm64 in commit 42b2547137f5 ("arm64/mm: enable ARCH_SUPPORTS_PAGE_TABLE_CHECK")x86_64 in commit d283d422c6c4 ("x86: mm: add x86_64 support for page table check")
---
v9: Updated for new API. Instrument pmdp_collapse_flush's two constituent calls to avoid header hell
v10: Cause p{u,m}dp_huge_get_and_clear() to resemble one another
--- arch/powerpc/Kconfig | 1 + arch/powerpc/include/asm/book3s/32/pgtable.h | 7 ++- arch/powerpc/include/asm/book3s/64/pgtable.h | 45 +++++++++++++++----- arch/powerpc/mm/book3s64/hash_pgtable.c | 4 ++ arch/powerpc/mm/book3s64/pgtable.c | 11 +++-- arch/powerpc/mm/book3s64/radix_pgtable.c | 3 ++ arch/powerpc/mm/pgtable.c | 4 ++ 7 files changed, 61 insertions(+), 14 deletions(-)
arch/powerpc/Kconfig +1 -0
@@ -166,6 +166,7 @@ config PPC select ARCH_STACKWALK select ARCH_SUPPORTS_ATOMIC_RMW select ARCH_SUPPORTS_DEBUG_PAGEALLOC if PPC_BOOK3S || PPC_8xx || 40x + select ARCH_SUPPORTS_PAGE_TABLE_CHECK select ARCH_USE_BUILTIN_BSWAP select ARCH_USE_CMPXCHG_LOCKREF if PPC64 select ARCH_USE_MEMTEST
arch/powerpc/include/asm/book3s/32/pgtable.h +6 -1
@@ -201,6 +201,7 @@ void unmap_kernel_page(unsigned long va);#ifndef __ASSEMBLY__#include <linux/sched.h> #include <linux/threads.h> +#include <linux/page_table_check.h> /* Bits to mask out from a PGD to get to the PUD page */ #define PGD_MASKED_BITS 0
@@ -314,7 +315,11 @@ static inline int __ptep_test_and_clear_young(struct mm_struct *mm,static inline pte_t ptep_get_and_clear (struct mm_struct *mm,unsigned long addr,pte_t *ptep) { -return __pte (pte_update (mm, addr, ptep, ~_PAGE_HASHPTE,0 ,0 )); +pte_t old_pte =__pte (pte_update (mm, addr, ptep, ~_PAGE_HASHPTE,0 ,0 )); + +page_table_check_pte_clear (mm, addr, old_pte); + +return old_pte; }#define __HAVE_ARCH_PTEP_SET_WRPROTECT
arch/powerpc/include/asm/book3s/64/pgtable.h +35 -10
79 lines not on this page · raw message
arch/powerpc/mm/book3s64/hash_pgtable.c +4 -0
@@ -8,6 +8,7 @@#include <linux/sched.h> #include <linux/mm_types.h> #include <linux/mm.h> +#include <linux/page_table_check.h> #include <linux/stop_machine.h> #include <asm/sections.h>
@@ -231,6 +232,9 @@ pmd_t hash__pmdp_collapse_flush(struct vm_area_struct *vma, unsigned long addres pmd = *pmdp;pmd_clear (pmdp); + +page_table_check_pmd_clear (vma->vm_mm, address, pmd); +/* * Wait for all pending hash_page to finish. This is needed * in case of subpage collapse. When we collapse normal pages
arch/powerpc/mm/book3s64/pgtable.c +8 -3
@@ -10,6 +10,7 @@#include <linux/pkeys.h> #include <linux/debugfs.h> #include <linux/proc_fs.h> +#include <linux/page_table_check.h> #include <misc/cxl-base.h> #include <asm/pgalloc.h>
@@ -116,6 +117,7 @@ void set_pmd_at(struct mm_struct *mm, unsigned long addr,WARN_ON (!(pmd_leaf (pmd)));#endif trace_hugepage_set_pmd (addr,pmd_val (pmd)); +page_table_check_pmd_set (mm, addr, pmdp, pmd);return set_pte_at_unchecked (mm, addr,pmdp_ptep (pmdp),pmd_pte (pmd)); }
@@ -133,6 +135,7 @@ void set_pud_at(struct mm_struct *mm, unsigned long addr,WARN_ON (!(pud_leaf (pud)));#endif trace_hugepage_set_pud (addr,pud_val (pud)); +page_table_check_pud_set (mm, addr, pudp, pud);return set_pte_at_unchecked (mm, addr,pudp_ptep (pudp),pud_pte (pud)); }
@@ -168,11 +171,13 @@ void serialize_against_pte_lookup(struct mm_struct *mm)pmd_t pmdp_invalidate (struct vm_area_struct *vma,unsigned long address,pmd_t *pmdp) { -unsigned long old_pmd; +pmd_t old_pmd; - old_pmd =pmd_hugepage_update (vma->vm_mm, address, pmdp, _PAGE_PRESENT, _PAGE_INVALID); + old_pmd =__pmd (pmd_hugepage_update (vma->vm_mm, address, pmdp, _PAGE_PRESENT, _PAGE_INVALID));flush_pmd_tlb_range (vma, address, address +HPAGE_PMD_SIZE ); -return __pmd (old_pmd); +page_table_check_pmd_clear (vma->vm_mm, address, old_pmd); + +return old_pmd; } pmd_t pmdp_huge_get_and_clear_full(struct vm_area_struct *vma,
arch/powerpc/mm/book3s64/radix_pgtable.c +3 -0
@@ -14,6 +14,7 @@#include <linux/of.h> #include <linux/of_fdt.h> #include <linux/mm.h> +#include <linux/page_table_check.h> #include <linux/hugetlb.h> #include <linux/string_helpers.h> #include <linux/memory.h>
@@ -1390,6 +1391,8 @@ pmd_t radix__pmdp_collapse_flush(struct vm_area_struct *vma, unsigned long addre pmd = *pmdp;pmd_clear (pmdp); +page_table_check_pmd_clear (vma->vm_mm, address, pmd); +radix__flush_tlb_collapsed_pmd (vma->vm_mm, address);return pmd;
arch/powerpc/mm/pgtable.c +4 -0
@@ -22,6 +22,7 @@#include <linux/mm.h> #include <linux/percpu.h> #include <linux/hardirq.h> +#include <linux/page_table_check.h> #include <linux/hugetlb.h> #include <asm/tlbflush.h> #include <asm/tlb.h>
@@ -206,6 +207,9 @@ void set_ptes(struct mm_struct *mm, unsigned long addr, pte_t *ptep,* and not hw_valid ptes. Hence there is no translation cache flush * involved that need to be batched. */ + +page_table_check_ptes_set (mm, addr, ptep, pte, nr); +for (;;) {/*
Signature · 1 line
2.44.0
Le 28/03/2024 à 05:55, Rohan McLure a écrit :
Quoted 9 lines
Support page table check on all PowerPC platforms. This works by serialising assignments, reassignments and clears of page table entries at each level in order to ensure that anonymous mappings have at most one writable consumer, and likewise that file-backed mappings are not simultaneously also anonymous mappings.
In order to support this infrastructure, a number of stubs must be defined for all powerpc platforms. Additionally, seperate
set_pte_at()andset_pte_at_unchecked(), to allow for internal, uninstrumented mappings.
I gave it a try on QEMU e500 (64 bits), and get the following Oops. What do I have to look for ?
Freeing unused kernel image (initmem) memory: 2588K This architecture does not have kernel memory protection. Run /init as init process
------------[ cut here ]------------ kernel BUG at mm/page_table_check.c:119! Oops: Exception in kernel mode, sig: 5 [#1] BE PAGE_SIZE=4K SMP NR_CPUS=32 QEMU e500 Modules linked in: CPU: 0 PID: 1 Comm: init Not tainted 6.8.0-13732-gc5347beead0b-dirty #784 Hardware name: QEMU ppce500 e5500 0x80240020 QEMU e500 NIP: c0000000002951a0 LR: c0000000002951bc CTR: 0000000000000000 REGS: c0000000032e7440 TRAP: 0700 Not tainted
(6.8.0-13732-gc5347beead0b-dirty)
MSR: 0000000080029002 <CE,EE,ME> CR: 24044248 XER: 00000000
IRQMASK: 0
GPR00: c000000000029d90 c0000000032e76e0 c000000000d44000 c000000003017e18
GPR04: 00000000ffb11000 c000000007f16888 0000000fc324123d 0000000000000000
GPR08: 0000000000000000 0000000000000001 c000000001184000 0000000084004248
GPR12: 00000000000000c0 c0000000011b9000 c000000007f16888 c000000007f19000
GPR16: 0000000000001000 00003ffffffff000 0000000000000000 0000000000000000
GPR20: 0000400000000000 0000000000000000 0000000000000001 ffffc000ffb12000
GPR24: c000000007f19000 c000000006008000 c000000006008000 0000000000000030
GPR28: 0000000000000001 c00000000118afe8 c000000003017e18 0000000000000001 NIP [c0000000002951a0] __page_table_check_ptes_set+0x210/0x2ac LR [c0000000002951bc] __page_table_check_ptes_set+0x22c/0x2ac
Call Trace:
[c0000000032e76e0] [c0000000032e7790] 0xc0000000032e7790 (unreliable) [c0000000032e7730] [c000000000029d90] set_ptes+0x178/0x210 [c0000000032e7790] [c00000000024c72c] move_page_tables+0x298/0x750 [c0000000032e7870] [c0000000002a944c] shift_arg_pages+0x120/0x254 [c0000000032e79a0] [c0000000002a9f94] setup_arg_pages+0x244/0x418 [c0000000032e7b30] [c000000000331610] load_elf_binary+0x584/0x17d4 [c0000000032e7c30] [c0000000002aa3e8] bprm_execve+0x280/0x704 [c0000000032e7d00] [c0000000002ac158] kernel_execve+0x16c/0x214 [c0000000032e7d50] [c0000000000011c8] run_init_process+0x100/0x168 [c0000000032e7de0] [c00000000000214c] kernel_init+0x84/0x1f8 [c0000000032e7e50] [c000000000000594] ret_from_kernel_user_thread+0x14/0x1c --- interrupt: 0 at 0x0
Code: 81230004 7d2907b4 0b090000 7c0004ac 7d201828 31290001 7d20192d 40c2fff4 7c0004ac 2c090002 39200000 7d29e01e <0b090000> e93d0000 37ffffff 7fde4a14 ---[ end trace 0000000000000000 ]---
note: init[1] exited with irqs disabled
Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000005
Rebooting in 180 seconds..
Le 28/03/2024 à 07:52, Christophe Leroy a écrit :
Quoted 17 lines
Le 28/03/2024 à 05:55, Rohan McLure a écrit :
Quoted 10 lines
Support page table check on all PowerPC platforms. This works by serialising assignments, reassignments and clears of page table entries at each level in order to ensure that anonymous mappings have at most one writable consumer, and likewise that file-backed mappings are not simultaneously also anonymous mappings.
In order to support this infrastructure, a number of stubs must be defined for all powerpc platforms. Additionally, seperate
set_pte_at()andset_pte_at_unchecked(), to allow for internal, uninstrumented mappings.I gave it a try on QEMU e500 (64 bits), and get the following Oops. What do I have to look for ?
Quoted 7 lines
Freeing unused kernel image (initmem) memory: 2588K This architecture does not have kernel memory protection. Run /init as init process
------------[ cut here ]------------ kernel BUG at mm/page_table_check.c:119! Oops: Exception in kernel mode, sig: 5 [#1]BE PAGE_SIZE=4K SMP NR_CPUS=32 QEMU e500
Same problem on my 8xx board:
[ 7.358146] Freeing unused kernel image (initmem) memory: 448K [ 7.363957] Run /init as init process [ 7.370955] ------------[ cut here ]------------ [ 7.375411] kernel BUG at mm/page_table_check.c:119! [ 7.380393] Oops: Exception in kernel mode, sig: 5 [#1] [ 7.385621] BE PAGE_SIZE=16K PREEMPT CMPC885 [ 7.393483] CPU: 0 PID: 1 Comm: init Not tainted 6.8.0-s3k-dev-13737-g8d9e247585fb #787 [ 7.401505] Hardware name: MIAE 8xx 0x500000 CMPC885 [ 7.406481] NIP: c0183278 LR: c018316c CTR: 00000001 [ 7.411541] REGS: c902bb20 TRAP: 0700 Not tainted (6.8.0-s3k-dev-13737-g8d9e247585fb) [ 7.419657] MSR: 00029032 <EE,ME,IR,DR,RI> CR: 35055355 XER: 80007100 [ 7.426550] [ 7.426550] GPR00: c018316c c902bbe0 c2118000 c7f7a0d8 7fab8000 c23b5ae0 c902bc20 00000002 [ 7.426550] GPR08: c11a0000 c7f7a0d8 c11143e0 00000000 95003355 00000000 c0004a38 c23a0a00 [ 7.426550] GPR16: 00004000 7fffc000 80000000 c23a0a00 00000001 7fab8000 ffabc000 80000000 [ 7.426550] GPR24: 7fffc000 c33be1c0 00004000 c902bc20 7fab8000 00000001 c7fb0360 00000000 [ 7.463291] NIP [c0183278] __page_table_check_ptes_set+0x1c8/0x210 [ 7.469491] LR [c018316c] __page_table_check_ptes_set+0xbc/0x210 [ 7.475514] Call Trace: [ 7.477957] [c902bbe0] [c018316c] __page_table_check_ptes_set+0xbc/0x210 (unreliable) [ 7.485809] [c902bc00] [c0012474] set_ptes+0x148/0x16c [ 7.490958] [c902bc50] [c0158a3c] move_page_tables+0x228/0x578 [ 7.496806] [c902bcf0] [c0192f38] shift_arg_pages+0xf0/0x1d4 [ 7.502479] [c902bd90] [c0193b40] setup_arg_pages+0x1c8/0x36c [ 7.508238] [c902be40] [c01f51a0] load_elf_binary+0x3c0/0x1218 [ 7.514086] [c902beb0] [c01934b0] bprm_execve+0x21c/0x4a4 [ 7.519497] [c902bf00] [c019516c] kernel_execve+0x13c/0x200 [ 7.525082] [c902bf20] [c0004aa8] kernel_init+0x70/0x1b0 [ 7.530406] [c902bf30] [c00111e4] ret_from_kernel_user_thread+0x10/0x18 [ 7.537038] --- interrupt: 0 at 0x0 [ 7.540534] Code: 39290004 7ce04828 30e70001 7ce0492d 40a2fff4 2c070000 4080ff94 0fe00000 0fe00000 0fe00000 2c1f0000 4082ff80 <0fe00000> 0fe00000 392affff 4bfffef8 [ 7.556068] ---[ end trace 0000000000000000 ]--- [ 7.560692] [ 8.531997] note: init[1] exited with irqs disabled [ 8.536891] note: init[1] exited with preempt_count 1 [ 8.542032] Kernel panic - not syncing: Attempted to kill init! exitcode=0x00000005 [ 8.549602] Rebooting in 180 seconds..
Le 28/03/2024 à 08:57, Christophe Leroy a écrit :
Quoted 28 lines
Le 28/03/2024 à 07:52, Christophe Leroy a écrit :
Quoted 17 lines
Le 28/03/2024 à 05:55, Rohan McLure a écrit :
Quoted 10 lines
Support page table check on all PowerPC platforms. This works by serialising assignments, reassignments and clears of page table entries at each level in order to ensure that anonymous mappings have at most one writable consumer, and likewise that file-backed mappings are not simultaneously also anonymous mappings.
In order to support this infrastructure, a number of stubs must be defined for all powerpc platforms. Additionally, seperate
set_pte_at()andset_pte_at_unchecked(), to allow for internal, uninstrumented mappings.I gave it a try on QEMU e500 (64 bits), and get the following Oops. What do I have to look for ?
Quoted 7 lines
Freeing unused kernel image (initmem) memory: 2588K This architecture does not have kernel memory protection. Run /init as init process
------------[ cut here ]------------ kernel BUG at mm/page_table_check.c:119! Oops: Exception in kernel mode, sig: 5 [#1]BE PAGE_SIZE=4K SMP NR_CPUS=32 QEMU e500
Quoted 8 lines
Same problem on my 8xx board:
[ 7.358146] Freeing unused kernel image (initmem) memory: 448K [ 7.363957] Run /init as init process
[ 7.370955] ------------[ cut here ]------------
[ 7.375411] kernel BUG atmm/page_table_check.c:119! [ 7.380393] Oops: Exception in kernel mode, sig: 5 [#1] [ 7.385621] BE PAGE_SIZE=16K PREEMPT CMPC885
Both problems are fixed by following change:
(quoted diff) +0 -0
b/arch/powerpc/include/asm/nohash/pgtable.h
index 413d01a51e6f..5b932632a5d7 100644
arch/powerpc/include/asm/nohash/pgtable.h +0 -0
@@ -29,6 +29,8 @@ static inline pte_basic_t pte_update(struct mm_struct
*mm, unsigned long addr, p
#ifndef __ASSEMBLY__
+#include <linux/page_table_check.h>
+
extern int icache_44x_need_flush;
/*
@@ -92,7 +94,11 @@ static inline void ptep_set_wrprotect(struct mm_struct *mm, unsigned long addr,
static inline pte_t ptep_get_and_clear(struct mm_struct *mm, unsigned
long addr,
pte_t *ptep)
{
- return __pte(pte_update(mm, addr, ptep, ~0UL, 0, 0));
+ pte_t old_pte = __pte(pte_update(mm, addr, ptep, ~0UL, 0, 0));
+
+ page_table_check_pte_clear(mm, addr, old_pte);
+
+ return old_pte;
}
#define __HAVE_ARCH_PTEP_GET_AND_CLEAR
Quoted 6 lines · Rohan McLure
Rohan McLure (11):
Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pud_set" Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pmd_set" Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pud_clear" Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pmd_clear" Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pte_clear"
Just a process request: please give these commits proper titles, they are not really 'reverts' in the classical sense, and this title hides what is being done in the commit. The typical use of reverts is to revert a bad change because it broke something. Here the goal is to reintroduce functionality.
So please name these 5 patches accordingly, to shed light on what is being reintroduced. You can mention it at the end of the changelog that it's a functional revert of commit XYZ, but that's not the primary purpose of the commit.
Thanks,
Ingo
Quoted 21 lines · Ingo Molnar
Quoted 11 lines · Rohan McLure
Rohan McLure (11):
Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pud_set"
Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pmd_set"
Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pud_clear"
Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pmd_clear"
Revert "mm/page_table_check: remove unused parameter in [__]page_table_check_pte_clear"Just a process request: please give these commits proper titles, they are not really 'reverts' in the classical sense, and this title hides what is being done in the commit. The typical use of reverts is to revert a bad change because it broke something. Here the goal is to reintroduce functionality.
Quoted 5 lines
So please name these 5 patches accordingly, to shed light on what is being reintroduced. You can mention it at the end of the changelog that
it's a functional revert of commit XYZ, but that's not the primary purpose of the commit.
Thanks for your email, I'll do just that.
Quoted 4 lines
Thanks,
Ingo
Cheers,
Rohan