mm, drm/ttm: Fix pte insertion with customized protection
Subsystems (5)
v4 cover mm, drm/ttm: Fix pte insertion with customized protection
From: Thomas Hellstrom <[email protected]>
The drm/ttm module is using a modified on-stack copy of the struct vm_area_struct to be able to set a page protection with customized caching. Fix that by adding a vmf_insert_mixed_prot() function similar to the existing vmf_insert_pfn_prot() for use with drm/ttm.
I'd like to merge this through a drm tree.
Changes since v1:
*) Formatting fixes in patch 1
*) Updated commit message of patch 2.
Changes since v2:
*) Moved vmf_insert_mixed_prot() export to patch 2 (Michal Hocko) *) Documented under which conditions it's safe to use a page protection
different from struct vm_area_struct::vm_page_prot. (Michal Hocko)
Changes since v3:
*) More documentation regarding under which conditions it's safe to use a
page protection different from struct vm_area_struct::vm_page_prot. This time also in core vm. (Michal Hocko)
Signature · 6 lines
2.21.0 _______________________________________________ dri-devel mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/dri-devel
PATCH v4 1/2 mm: Add a vmf_insert_mixed_prot() function
From: Thomas Hellstrom <[email protected]>
The TTM module today uses a hack to be able to set a different page protection than struct vm_area_struct::vm_page_prot. To be able to do this properly, add the needed vm functionality as vmf_insert_mixed_prot().
--- include/linux/mm.h | 2 ++ include/linux/mm_types.h | 7 ++++++- mm/memory.c | 43 ++++++++++++++++++++++++++++++++++++---- 3 files changed, 47 insertions(+), 5 deletions(-)
include/linux/mm.h +2 -0
@@ -2548,6 +2548,8 @@ vm_fault_t vmf_insert_pfn_prot(struct vm_area_struct *vma, unsigned long addr, unsigned long pfn, pgprot_t pgprot);vm_fault_t vmf_insert_mixed (struct vm_area_struct *vma,unsigned long addr,pfn_t pfn); +vm_fault_t vmf_insert_mixed_prot (struct vm_area_struct *vma,unsigned long addr, +pfn_t pfn,pgprot_t pgprot);vm_fault_t vmf_insert_mixed_mkwrite (struct vm_area_struct *vma,unsigned long addr,pfn_t pfn);int vm_iomap_memory (struct vm_area_struct *vma,phys_addr_t start,unsigned long len);
include/linux/mm_types.h +6 -1
@@ -307,7 +307,12 @@ struct vm_area_struct {/* Second cache line starts here. */ struct mm_struct *vm_mm;/* The address space we belong to. */ -pgprot_t vm_page_prot;/* Access permissions of this VMA. */ + +/* +* Access permissions of this VMA. +* See vmf_insert_mixed() for discussion. +*/ +pgprot_t vm_page_prot;unsigned long vm_flags;/* Flags, see mm.h. */ /*
mm/memory.c +39 -4
71 lines not on this page · raw message
Signature · 1 line
2.21.0
Re: [PATCH v4 1/2] mm: Add a vmf_insert_mixed_prot() function
Quoted 39 lines · Thomas Hellström (VMware)
From: Thomas Hellstrom <[email protected]>
The TTM module today uses a hack to be able to set a different page protection than struct
vm_area_struct::vm_page_prot. To be able to do this properly, add the needed vm functionality asvmf_insert_mixed_prot().Cc Andrew Morton <[email protected]>Cc Michal Hocko <[email protected]>Cc "Matthew Wilcox (Oracle)" <[email protected]>Cc "Kirill A. Shutemov" <[email protected]>Cc Ralph Campbell <[email protected]>Cc "Jérôme Glisse" <[email protected]>Cc "Christian König" <[email protected]>Signed-off-by Thomas Hellstrom <[email protected]>Acked-by Christian König <[email protected]>--- include/linux/mm.h | 2 ++ include/linux/mm_types.h | 7 ++++++- mm/memory.c | 43 ++++++++++++++++++++++++++++++++++++---- 3 files changed, 47 insertions(+), 5 deletions(-)include/linux/mm.h +2
-0@@ -2548,6 +2548,8 @@ vm_fault_t vmf_insert_pfn_prot(struct vm_area_struct *vma, unsigned long addr, unsigned long pfn, pgprot_t pgprot);vm_fault_t vmf_insert_mixed (struct vm_area_struct *vma,unsigned long addr,pfn_t pfn); +vm_fault_t vmf_insert_mixed_prot (struct vm_area_struct *vma,unsigned long addr, +pfn_t pfn,pgprot_t pgprot);vm_fault_t vmf_insert_mixed_mkwrite (struct vm_area_struct *vma,unsigned long addr,pfn_t pfn);int vm_iomap_memory (struct vm_area_struct *vma,phys_addr_t start,unsigned long len);include/linux/mm_types.h +0
-0
include/linux/mm_types.h struct vm_area_struct { · line 313
Quoted 8 lines
include/linux/mm_types.h +4
-1@@ -307,7 +307,12 @@ struct vm_area_struct {/* Second cache line starts here. */ struct mm_struct *vm_mm;/* The address space we belong to. */ -pgprot_t vm_page_prot;/* Access permissions of this VMA. */ + +/* +* Access permissions of this VMA. +* See vmf_insert_mixed() for discussion.
Typo. will of course be vmf_insert_mixed_prot() in the final version.
_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel
Re: [PATCH v4 1/2] mm: Add a vmf_insert_mixed_prot() function
In reply to Thomas Hellström (VMware)Quoted 6 lines · Thomas Hellström (VMware)
From: Thomas Hellstrom <[email protected]>
The TTM module today uses a hack to be able to set a different page protection than struct
vm_area_struct::vm_page_prot. To be able to do this properly, add the needed vm functionality asvmf_insert_mixed_prot().
Quoted 9 lines
Cc Andrew Morton <[email protected]>Cc Michal Hocko <[email protected]>Cc "Matthew Wilcox (Oracle)" <[email protected]>Cc "Kirill A. Shutemov" <[email protected]>Cc Ralph Campbell <[email protected]>Cc "Jérôme Glisse" <[email protected]>Cc "Christian König" <[email protected]>Signed-off-by Thomas Hellstrom <[email protected]>Acked-by Christian König <[email protected]>
I cannot say I am happy about this because it adds a discrepancy and that is always tricky but I do agree that a formalized discrepancy is better than ad-hoc hacks so
Thanks for extending the documentation.
Quoted 118 lines
--- include/linux/mm.h | 2 ++ include/linux/mm_types.h | 7 ++++++- mm/memory.c | 43 ++++++++++++++++++++++++++++++++++++---- 3 files changed, 47 insertions(+), 5 deletions(-)include/linux/mm.h +2
-0@@ -2548,6 +2548,8 @@ vm_fault_t vmf_insert_pfn_prot(struct vm_area_struct *vma, unsigned long addr, unsigned long pfn, pgprot_t pgprot);vm_fault_t vmf_insert_mixed (struct vm_area_struct *vma,unsigned long addr,pfn_t pfn); +vm_fault_t vmf_insert_mixed_prot (struct vm_area_struct *vma,unsigned long addr, +pfn_t pfn,pgprot_t pgprot);vm_fault_t vmf_insert_mixed_mkwrite (struct vm_area_struct *vma,unsigned long addr,pfn_t pfn);int vm_iomap_memory (struct vm_area_struct *vma,phys_addr_t start,unsigned long len);include/linux/mm_types.h +6
-1@@ -307,7 +307,12 @@ struct vm_area_struct {/* Second cache line starts here. */ struct mm_struct *vm_mm;/* The address space we belong to. */ -pgprot_t vm_page_prot;/* Access permissions of this VMA. */ + +/* +* Access permissions of this VMA. +* See vmf_insert_mixed() for discussion. +*/ +pgprot_t vm_page_prot;unsigned long vm_flags;/* Flags, see mm.h. */ /* mm/memory.c +39
-4@@ -1646,6 +1646,9 @@ static vm_fault_t insert_pfn(struct vm_area_struct *vma, unsigned long addr,* vmf_insert_pfn_prot should only be used if using multiple VMAs is * impractical. * +* See vmf_insert_mixed_prot() for a discussion of the implication of using +* a value of @pgprot different from that of @vma->vm_page_prot. +* * Context: Process context. May allocate using %GFP_KERNEL. * Return: vm_fault_t value. */ @@ -1719,9 +1722,9 @@ static bool vm_mixed_ok(struct vm_area_struct *vma, pfn_t pfn) }static vm_fault_t __vm_insert_mixed (struct vm_area_struct *vma, -unsigned long addr,pfn_t pfn,bool mkwrite) +unsigned long addr,pfn_t pfn,pgprot_t pgprot, +bool mkwrite) { -pgprot_t pgprot = vma->vm_page_prot;int err;BUG_ON (!vm_mixed_ok (vma, pfn));@@ -1764,10 +1767,42 @@ static vm_fault_t __vm_insert_mixed(struct vm_area_struct *vma,return VM_FAULT_NOPAGE ; } +/** +* vmf_insert_mixed_prot - insert single pfn into user vma with specified pgprot +* @vma: user vma to map to +* @addr: target user address of this page +* @pfn: source kernel pfn +* @pgprot: pgprot flags for the inserted page +* +* This is exactly like vmf_insert_mixed(), except that it allows drivers to +* to override pgprot on a per-page basis. +* +* Typically this function should be used by drivers to set caching- and +* encryption bits different than those of @vma->vm_page_prot, because +* the caching- or encryption mode may not be known at mmap() time. +* This is ok as long as @vma->vm_page_prot is not used by the core vm +* to set caching and encryption bits for those vmas (except for COW pages). +* This is ensured by core vm only modifying these page table entries using +* functions that don't touch caching- or encryption bits, using pte_modify() +* if needed. (See for example mprotect()). +* Also when new page-table entries are created, this is only done using the +* fault() callback, and never using the value of vma->vm_page_prot, +* except for page-table entries that point to anonymous pages as the result +* of COW. +* +* Context: Process context. May allocate using %GFP_KERNEL. +* Return: vm_fault_t value. +*/ +vm_fault_t vmf_insert_mixed_prot (struct vm_area_struct *vma,unsigned long addr, +pfn_t pfn,pgprot_t pgprot) +{ +return __vm_insert_mixed (vma, addr, pfn, pgprot, false); +} +vm_fault_t vmf_insert_mixed (struct vm_area_struct *vma,unsigned long addr,pfn_t pfn) { -return __vm_insert_mixed (vma, addr, pfn, false); +return __vm_insert_mixed (vma, addr, pfn, vma->vm_page_prot, false); }EXPORT_SYMBOL (vmf_insert_mixed);@@ -1779,7 +1814,7 @@ EXPORT_SYMBOL(vmf_insert_mixed);vm_fault_t vmf_insert_mixed_mkwrite (struct vm_area_struct *vma,unsigned long addr,pfn_t pfn) { -return __vm_insert_mixed (vma, addr, pfn, true); +return __vm_insert_mixed (vma, addr, pfn, vma->vm_page_prot, true); }EXPORT_SYMBOL (vmf_insert_mixed_mkwrite);Signature · 1 line
2.21.0
Signature · 6 lines
Michal Hocko SUSE Labs _______________________________________________ dri-devel mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/dri-devel
PATCH v4 2/2 mm, drm/ttm: Fix vm page protection handling
In reply to Thomas Hellström (VMware)From: Thomas Hellstrom <[email protected]>
TTM graphics buffer objects may, transparently to user-space, move between IO and system memory. When that happens, all PTEs pointing to the old location are zapped before the move and then faulted in again if needed. When that happens, the page protection caching mode- and encryption bits may change and be different from those of struct vm_area_struct::vm_page_prot.
We were using an ugly hack to set the page protection correctly. Fix that and instead export and use vmf_insert_mixed_prot() or use vmf_insert_pfn_prot().
Also get the default page protection from
struct vm_area_struct::vm_page_prot rather than using vm_get_page_prot(). This way we catch modifications done by the vm system for drivers that want write-notification.
--- drivers/gpu/drm/ttm/ttm_bo_vm.c | 22 +++++++++++++++------- mm/memory.c | 1 + 2 files changed, 16 insertions(+), 7 deletions(-)
drivers/gpu/drm/ttm/ttm_bo_vm.c +15 -7
@@ -173,7 +173,6 @@ vm_fault_t ttm_bo_vm_fault_reserved(struct vm_fault *vmf, pgoff_t num_prefault) {struct vm_area_struct *vma = vmf->vma; -struct vm_area_struct cvma = *vma;struct ttm_buffer_object *bo = vma->vm_private_data;struct ttm_bo_device *bdev = bo->bdev;unsigned long page_offset;
@@ -244,7 +243,7 @@ vm_fault_t ttm_bo_vm_fault_reserved(struct vm_fault *vmf, goto out_io_unlock; } - cvma.vm_page_prot =ttm_io_prot (bo->mem.placement, prot); + prot =ttm_io_prot (bo->mem.placement, prot);if (!bo->mem.bus.is_iomem) {struct ttm_operation_ctx ctx = { .interruptible = false,
@@ -260,7 +259,7 @@ vm_fault_t ttm_bo_vm_fault_reserved(struct vm_fault *vmf, } }else {/* Iomem should not be marked encrypted */ - cvma.vm_page_prot =pgprot_decrypted (cvma.vm_page_prot); + prot =pgprot_decrypted (prot); }/*
@@ -283,11 +282,20 @@ vm_fault_t ttm_bo_vm_fault_reserved(struct vm_fault *vmf, pfn =page_to_pfn (page); } +/* +* Note that the value of @prot at this point may differ from +* the value of @vma->vm_page_prot in the caching- and +* encryption bits. This is because the exact location of the +* data may not be known at mmap() time and may also change +* at arbitrary times while the data is mmap'ed. +* See vmf_insert_mixed_prot() for a discussion. +*/ if (vma->vm_flags &VM_MIXEDMAP ) - ret =vmf_insert_mixed (&cvma, address, -__pfn_to_pfn_t (pfn,PFN_DEV )); + ret =vmf_insert_mixed_prot (vma, address, +__pfn_to_pfn_t (pfn,PFN_DEV ), + prot);else - ret =vmf_insert_pfn (&cvma, address, pfn); + ret =vmf_insert_pfn_prot (vma, address, pfn, prot);/* Never error on prefaulted PTEs */ if (unlikely ((ret &VM_FAULT_ERROR ))) {
@@ -319,7 +327,7 @@ vm_fault_t ttm_bo_vm_fault(struct vm_fault *vmf)if (ret)return ret; - prot =vm_get_page_prot (vma->vm_flags); + prot = vma->vm_page_prot; ret =ttm_bo_vm_fault_reserved (vmf, prot,TTM_BO_VM_NUM_PREFAULT );if (ret ==VM_FAULT_RETRY && !(vmf->flags &FAULT_FLAG_RETRY_NOWAIT ))return ret;
mm/memory.c +1 -0
@@ -1798,6 +1798,7 @@ vm_fault_t vmf_insert_mixed_prot(struct vm_area_struct *vma, unsigned long addr, {return __vm_insert_mixed (vma, addr, pfn, pgprot, false); } +EXPORT_SYMBOL (vmf_insert_mixed_prot);vm_fault_t vmf_insert_mixed (struct vm_area_struct *vma,unsigned long addr,pfn_t pfn)
Signature · 1 line
2.21.0
Ack to merge through DRM tree? WAS [PATCH v4 0/2] mm, drm/ttm: Fix pte insertion with customized protection
In reply to Thomas Hellström (VMware)Andrew,
Quoted 21 lines · Thomas Hellström (VMware)
From: Thomas Hellstrom <[email protected]>
The drm/ttm module is using a modified on-stack copy of the struct
vm_area_structto be able to set a page protection with customized caching. Fix that by adding avmf_insert_mixed_prot()function similar to the existingvmf_insert_pfn_prot()for use with drm/ttm.I'd like to merge this through a drm tree.
Changes since v1:
*) Formatting fixes in patch 1
*) Updated commit message of patch 2.
Changes since v2:
*) Movedvmf_insert_mixed_prot()export to patch 2 (Michal Hocko) *) Documented under which conditions it's safe to use a page protection
different from structvm_area_struct::vm_page_prot. (Michal Hocko)
Changes since v3:
*) More documentation regarding under which conditions it's safe to use a
page protection different from structvm_area_struct::vm_page_prot. This time also in core vm. (Michal Hocko)
Quoted 8 lines
Cc Andrew Morton <[email protected]>Cc Michal Hocko <[email protected]>Cc "Matthew Wilcox (Oracle)" <[email protected]>Cc "Kirill A. Shutemov" <[email protected]>Cc Ralph Campbell <[email protected]>Cc "Jérôme Glisse" <[email protected]>Cc "Christian König" <[email protected]>
Seems all concerns with this series have been addressed. Could I have an ack to merge this through a DRM tree?
Thanks,
Thomas
_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel
Re: Ack to merge through DRM tree? WAS [PATCH v4 0/2] mm, drm/ttm: Fix pte insertion with customized protection
Quoted 32 lines · On Fri, 20 Dec 2019 09:06:08 +0100 Thomas Hellström (VMware)…
Andrew,
Quoted 21 lines · Thomas Hellström (VMware)
From: Thomas Hellstrom <[email protected]>
The drm/ttm module is using a modified on-stack copy of the struct
vm_area_structto be able to set a page protection with customized caching. Fix that by adding avmf_insert_mixed_prot()function similar to the existingvmf_insert_pfn_prot()for use with drm/ttm.I'd like to merge this through a drm tree.
Changes since v1:
*) Formatting fixes in patch 1
*) Updated commit message of patch 2.
Changes since v2:
*) Movedvmf_insert_mixed_prot()export to patch 2 (Michal Hocko) *) Documented under which conditions it's safe to use a page protection
different from structvm_area_struct::vm_page_prot. (Michal Hocko)
Changes since v3:
*) More documentation regarding under which conditions it's safe to use a
page protection different from structvm_area_struct::vm_page_prot. This time also in core vm. (Michal Hocko)Quoted 8 lines
Cc Andrew Morton <[email protected]>Cc Michal Hocko <[email protected]>Cc "Matthew Wilcox (Oracle)" <[email protected]>Cc "Kirill A. Shutemov" <[email protected]>Cc Ralph Campbell <[email protected]>Cc "Jérôme Glisse" <[email protected]>Cc "Christian König" <[email protected]>
Quoted 3 lines
Seems all concerns with this series have been addressed. Could I have an ack to merge this through a DRM tree?
Yes, please do that.
for both.
_______________________________________________
dri-devel mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/dri-devel