hmm_range_fault related fixes and legacy API removal v2
Subsystems (6)
Hi Jérôme, Ben and Jason,
below is a series against the hmm tree which fixes up the mmap_sem locking in nouveau and while at it also removes leftover legacy HMM APIs only used by nouveau.
Changes since v1:
- don't return the valid state from hmm_range_unregister
- additional nouveau cleanups
_______________________________________________
Nouveau mailing list [email protected]
https://lists.freedesktop.org/mailman/listinfo/nouveau
PATCH 1/6 mm: always return EBUSY for invalid ranges in hmm_range_{fault,snapshot}
We should not have two different error codes for the same condition. In addition this really complicates the code due to the special handling of EAGAIN that drops the mmap_sem due to the FAULT_FLAG_ALLOW_RETRY logic in the core vm.
--- Documentation/vm/hmm.rst | 2 +- mm/hmm.c | 10 ++++------ 2 files changed, 5 insertions(+), 7 deletions(-)
Documentation/vm/hmm.rst +1 -1
@@ -237,7 +237,7 @@ The usage pattern is:: ret = hmm_range_snapshot(&range); if (ret) { up_read(&mm->mmap_sem); - if (ret == -EAGAIN) { + if (ret == -EBUSY) { /* * No need to check hmm_range_wait_until_valid() return value * on retry we will get proper error with hmm_range_snapshot()
mm/hmm.c +4 -6
@@ -946,7 +946,7 @@ EXPORT_SYMBOL(hmm_range_unregister);* @range: range * Return: -EINVAL if invalid argument, -ENOMEM out of memory, -EPERM invalid * permission (for instance asking for write and range is read only), -* -EAGAIN if you need to retry, -EFAULT invalid (ie either no valid +* -EBUSY if you need to retry, -EFAULT invalid (ie either no valid * vma or it is illegal to access that range), number of valid pages * in range->pfns[] (from range start address). *
@@ -967,7 +967,7 @@ long hmm_range_snapshot(struct hmm_range *range) do { /* If range is no longer valid force retry. */ if (!range->valid) - return -EAGAIN; + return -EBUSY; vma = find_vma(hmm->mm, start); if (vma == NULL || (vma->vm_flags & device_vma))
@@ -1062,10 +1062,8 @@ long hmm_range_fault(struct hmm_range *range, bool block) do { /* If range is no longer valid force retry. */ - if (!range->valid) { - up_read(&hmm->mm->mmap_sem); - return -EAGAIN; - } + if (!range->valid) + return -EBUSY; vma = find_vma(hmm->mm, start); if (vma == NULL || (vma->vm_flags & device_vma))
Signature · 6 lines
2.20.1 _______________________________________________ Nouveau mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/nouveau
PATCH 2/6 mm: move hmm_vma_range_done and hmm_vma_fault to nouveau
In reply to Christoph HellwigThese two functions are marked as a legacy APIs to get rid of, but seem to suit the current nouveau flow. Move it to the only user in preparation for fixing a locking bug involving caller and callee. All comments referring to the old API have been removed as this now is a driver private helper.
--- drivers/gpu/drm/nouveau/nouveau_svm.c | 52 +++++++++++++++++++++- include/linux/hmm.h | 63 --------------------------- 2 files changed, 50 insertions(+), 65 deletions(-)
drivers/gpu/drm/nouveau/nouveau_svm.c +50 -2
@@ -36,6 +36,13 @@#include <linux/sort.h> #include <linux/hmm.h> +/* +* When waiting for mmu notifiers we need some kind of time out otherwise we +* could potentialy wait for ever, 1000ms ie 1s sounds like a long time to +* wait already. +*/ +#define NOUVEAU_RANGE_FAULT_TIMEOUT 1000 +struct nouveau_svm {struct nouveau_drm *drm;struct mutex mutex;
@@ -475,6 +482,47 @@ nouveau_svm_fault_cache(struct nouveau_svm *svm, fault->inst, fault->addr, fault->access); } +static inline bool nouveau_range_done (struct hmm_range *range) +{ +bool ret =hmm_range_valid (range); + +hmm_range_unregister (range); +return ret; +} + +static int +nouveau_range_fault (struct hmm_mirror *mirror,struct hmm_range *range, +bool block) +{ +long ret; + + range->default_flags =0 ; + range->pfn_flags_mask =-1UL ; + + ret =hmm_range_register (range, mirror, + range->start, range->end, +PAGE_SHIFT ); +if (ret) +return (int )ret; + +if (!hmm_range_wait_until_valid (range,NOUVEAU_RANGE_FAULT_TIMEOUT )) { +up_read (&range->vma->vm_mm->mmap_sem); +return -EAGAIN ; + } + + ret =hmm_range_fault (range, block); +if (ret <=0 ) { +if (ret == -EBUSY || !ret) { +up_read (&range->vma->vm_mm->mmap_sem); + ret = -EBUSY ; + }else if (ret == -EAGAIN ) + ret = -EBUSY ; +hmm_range_unregister (range); +return ret; + } +return 0 ; +} +static int nouveau_svm_fault (struct nvif_notify *notify) {
@@ -649,10 +697,10 @@ nouveau_svm_fault(struct nvif_notify *notify) range.values = nouveau_svm_pfn_values; range.pfn_shift =NVIF_VMM_PFNMAP_V0_ADDR_SHIFT ; again: - ret =hmm_vma_fault (&svmm->mirror, &range, true); + ret =nouveau_range_fault (&svmm->mirror, &range, true);if (ret ==0 ) {mutex_lock (&svmm->mutex); -if (!hmm_vma_range_done (&range)) { +if (!nouveau_range_done (&range)) {mutex_unlock (&svmm->mutex); goto again; }
include/linux/hmm.h +0 -63
69 lines not on this page · raw message
Signature · 6 lines
2.20.1 _______________________________________________ Nouveau mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/nouveau
PATCH 3/6 nouveau: remove the block parameter to nouveau_range_fault
In reply to Christoph HellwigThe parameter is always false, so remove it as well as the -EAGAIN handling that can only happen for the non-blocking case.
--- drivers/gpu/drm/nouveau/nouveau_svm.c | 7 +++---- 1 file changed, 3 insertions(+), 4 deletions(-)
drivers/gpu/drm/nouveau/nouveau_svm.c +3 -4
@@ -491,8 +491,7 @@ static inline bool nouveau_range_done(struct hmm_range *range) }static int -nouveau_range_fault (struct hmm_mirror *mirror,struct hmm_range *range, -bool block) +nouveau_range_fault (struct hmm_mirror *mirror,struct hmm_range *range) {long ret;
@@ -510,7 +509,7 @@ nouveau_range_fault(struct hmm_mirror *mirror, struct hmm_range *range,return -EAGAIN ; } - ret =hmm_range_fault (range, block); + ret =hmm_range_fault (range, true);if (ret <=0 ) {if (ret == -EBUSY || !ret) {up_read (&range->vma->vm_mm->mmap_sem);
@@ -697,7 +696,7 @@ nouveau_svm_fault(struct nvif_notify *notify) range.values = nouveau_svm_pfn_values; range.pfn_shift =NVIF_VMM_PFNMAP_V0_ADDR_SHIFT ; again: - ret =nouveau_range_fault (&svmm->mirror, &range, true); + ret =nouveau_range_fault (&svmm->mirror, &range);if (ret ==0 ) {mutex_lock (&svmm->mutex);if (!nouveau_range_done (&range)) {
Signature · 6 lines
2.20.1 _______________________________________________ Nouveau mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/nouveau
PATCH 4/6 nouveau: unlock mmap_sem on all errors from nouveau_range_fault
In reply to Christoph HellwigCurrently nouveau_svm_fault expects nouveau_range_fault to never unlock mmap_sem, but the latter unlocks it for a random selection of error codes. Fix this up by always unlocking mmap_sem for non-zero return values in nouveau_range_fault, and only unlocking it in the caller for successful returns.
--- drivers/gpu/drm/nouveau/nouveau_svm.c | 12 ++++++------ 1 file changed, 6 insertions(+), 6 deletions(-)
drivers/gpu/drm/nouveau/nouveau_svm.c +6 -6
@@ -501,8 +501,10 @@ nouveau_range_fault(struct hmm_mirror *mirror, struct hmm_range *range) ret =hmm_range_register (range, mirror, range->start, range->end,PAGE_SHIFT ); -if (ret) +if (ret) { +up_read (&range->vma->vm_mm->mmap_sem);return (int )ret; + }if (!hmm_range_wait_until_valid (range,NOUVEAU_RANGE_FAULT_TIMEOUT )) {up_read (&range->vma->vm_mm->mmap_sem);
@@ -511,11 +513,9 @@ nouveau_range_fault(struct hmm_mirror *mirror, struct hmm_range *range) ret =hmm_range_fault (range, true);if (ret <=0 ) { -if (ret == -EBUSY || !ret) { -up_read (&range->vma->vm_mm->mmap_sem); - ret = -EBUSY ; - }else if (ret == -EAGAIN ) +if (ret ==0 ) ret = -EBUSY ; +up_read (&range->vma->vm_mm->mmap_sem);hmm_range_unregister (range);return ret; }
@@ -713,8 +713,8 @@ nouveau_svm_fault(struct nvif_notify *notify) NULL); svmm->vmm->vmm.object.client->super = false;mutex_unlock (&svmm->mutex); +up_read (&svmm->mm->mmap_sem); } -up_read (&svmm->mm->mmap_sem);/* Cancel any faults in the window whose pages didn't manage * to keep their valid bit, or stay writeable when required.
Signature · 1 line
2.20.1
PATCH 5/6 nouveau: return -EBUSY when hmm_range_wait_until_valid fails
In reply to Christoph Hellwig-EAGAIN has a magic meaning for non-blocking faults, so don't overload it. Given that the caller doesn't check for specific error codes this change is purely cosmetic.
--- drivers/gpu/drm/nouveau/nouveau_svm.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
drivers/gpu/drm/nouveau/nouveau_svm.c +1 -1
@@ -508,7 +508,7 @@ nouveau_range_fault(struct hmm_mirror *mirror, struct hmm_range *range)if (!hmm_range_wait_until_valid (range,NOUVEAU_RANGE_FAULT_TIMEOUT )) {up_read (&range->vma->vm_mm->mmap_sem); -return -EAGAIN ; +return -EBUSY ; } ret =hmm_range_fault (range, true);
Signature · 6 lines
2.20.1 _______________________________________________ Nouveau mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/nouveau
PATCH 6/6 mm: remove the legacy hmm_pfn_* APIs
In reply to Christoph HellwigSwitch the one remaining user in nouveau over to its replacement, and remove all the wrappers.
--- drivers/gpu/drm/nouveau/nouveau_dmem.c | 2 +- include/linux/hmm.h | 34 -------------------------- 2 files changed, 1 insertion(+), 35 deletions(-)
drivers/gpu/drm/nouveau/nouveau_dmem.c +1 -1
@@ -844,7 +844,7 @@ nouveau_dmem_convert_pfn(struct nouveau_drm *drm,struct page *page;uint64_t addr; - page =hmm_pfn_to_page (range, range->pfns[i]); + page =hmm_device_entry_to_page (range, range->pfns[i]);if (page ==NULL )continue ;
include/linux/hmm.h +0 -34
@@ -290,40 +290,6 @@ static inline uint64_t hmm_device_entry_from_pfn(const struct hmm_range *range, range->flags[HMM_PFN_VALID ]; } -/* -* Old API: -* hmm_pfn_to_page() -* hmm_pfn_to_pfn() -* hmm_pfn_from_page() -* hmm_pfn_from_pfn() -* -* This are the OLD API please use new API, it is here to avoid cross-tree -* merge painfullness ie we convert things to new API in stages. -*/ -static inline struct page *hmm_pfn_to_page (const struct hmm_range *range, -uint64_t pfn) -{ -return hmm_device_entry_to_page (range, pfn); -} - -static inline unsigned long hmm_pfn_to_pfn (const struct hmm_range *range, -uint64_t pfn) -{ -return hmm_device_entry_to_pfn (range, pfn); -} - -static inline uint64_t hmm_pfn_from_page (const struct hmm_range *range, -struct page *page) -{ -return hmm_device_entry_from_page (range, page); -} - -static inline uint64_t hmm_pfn_from_pfn (const struct hmm_range *range, -unsigned long pfn) -{ -return hmm_device_entry_from_pfn (range, pfn); -} -/* * Mirroring: how to synchronize device page table with CPU page table. *
Signature · 6 lines
2.20.1 _______________________________________________ Nouveau mailing list [email protected] https://lists.freedesktop.org/mailman/listinfo/nouveau
Quoted 9 lines · Christoph Hellwig
Hi Jérôme, Ben and Jason,
below is a series against the hmm tree which fixes up the
mmap_semlocking in nouveau and while at it also removes leftover legacy HMM APIs only used by nouveau.Changes since v1:
- don't return the valid state fromhmm_range_unregister
- additional nouveau cleanups
Ralph, since most of this is nouveau could you contribute a Tested-by? Thanks
Jason
Quoted 7 lines · Jason Gunthorpe
Quoted 6 lines · Christoph Hellwig
Hi Jérôme, Ben and Jason,
below is a series against the hmm tree which fixes up the
mmap_semlocking in nouveau and while at it also removes leftover legacy HMM APIs only used by nouveau.
Quoted 9 lines
Quoted 3 lines
Changes since v1:
- don't return the valid state fromhmm_range_unregister
- additional nouveau cleanupsRalph, since most of this is nouveau could you contribute a Tested-by? Thanks
Jason
I can test things fairly easily but with all the different patches, conflicts, and personal git trees, can you specify the git tree and branch with everything applied that you want me to test?
Quoted 16 lines · Ralph Campbell
Quoted 14 lines · Jason Gunthorpe
Quoted 9 lines · Christoph Hellwig
Hi Jérôme, Ben and Jason,
below is a series against the hmm tree which fixes up the
mmap_semlocking in nouveau and while at it also removes leftover legacy HMM APIs only used by nouveau.Changes since v1:
- don't return the valid state fromhmm_range_unregister
- additional nouveau cleanupsRalph, since most of this is nouveau could you contribute a Tested-by? Thanks
Quoted 6 lines
Quoted 2 lines
Jason
I can test things fairly easily but with all the different patches, conflicts, and personal git trees, can you specify the git tree and branch with everything applied that you want me to test?
This series will be pushed to the next cycle, so if you test v5.3-rc1
+ this series you'd get the right coverage.
Thanks,
Jason
_______________________________________________
Nouveau mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/nouveau
Quoted 5 lines · Christoph Hellwig
Hi Jérôme, Ben and Jason,
below is a series against the hmm tree which fixes up the
mmap_semlocking in nouveau and while at it also removes leftover legacy HMM APIs only used by nouveau.
As much as I like this series, it won't make it to this merge window, sorry.
Let's revisit it in a few weeks at rc1.
Regards,
Jason
Quoted 9 lines · Jason Gunthorpe
Quoted 5 lines · Christoph Hellwig
Hi Jérôme, Ben and Jason,
below is a series against the hmm tree which fixes up the
mmap_semlocking in nouveau and while at it also removes leftover legacy HMM APIs only used by nouveau.As much as I like this series, it won't make it to this merge window, sorry.
Note that patch 4 fixes a pretty severe locking bug, and 1-3 is just preparation for that.
Quoted 8 lines · Christoph Hellwig
Quoted 7 lines · Jason Gunthorpe
Quoted 5 lines · Christoph Hellwig
Hi Jérôme, Ben and Jason,
below is a series against the hmm tree which fixes up the
mmap_semlocking in nouveau and while at it also removes leftover legacy HMM APIs only used by nouveau.
Quoted 5 lines
Quoted 2 lines
As much as I like this series, it won't make it to this merge window, sorry.
Note that patch 4 fixes a pretty severe locking bug, and 1-3 is just preparation for that.
Yes, I know, but that code is all marked STAGING last I saw, so I don't feel an urgency to get severe bug fixes in for it after the merge window opens.
I'd like to apply it to hmm.git when rc1 comes out with Ralph's test result..
Jason
_______________________________________________
Nouveau mailing list
[email protected]
https://lists.freedesktop.org/mailman/listinfo/nouveau