Skip to contentSkip to conversation

mm/gup: Fix follow_devmap_p[mu]d() on page==NULL handling

PATCH Applied Peter Xu 3 participants 4 messages Nov 23, 2023 – Nov 27, 2023

Subsystems (2)
lore
Share & tools
lore

Peter Xu

author reviewer
#0 lore raw

PATCH 1/1 mm/gup: Fix follow_devmap_p[mu]d() on page==NULL handling

This is a bug found not by any report but only by code observations.

When GUP sees a devpmd/devpud and if page==NULL is returned, it means a fault is probably required. Here falling through when page==NULL can cause unexpected behavior.

Fix both cases by catching the page==NULL cases with no_page_table().

Fixes 3565fce3a659 ("mm, x86: get_user_pages() for dax mappings")
Fixes 080dbb618b4b ("mm/follow_page_mask: split follow_page_mask to smaller functions.")
Cc Dan Williams <[email protected]>
Cc Mel Gorman <[email protected]>
Cc Matthew Wilcox <[email protected]>
Cc Aneesh Kumar K.V <[email protected]>
Cc Christoph Hellwig <[email protected]>
---
 mm/gup.c | 2 ++
 1 file changed, 2 insertions(+)
mm/gup.c +2 -0
index 231711efa390..0a5f0e91bfec 100644
@@ -710,6 +710,7 @@ static struct page *follow_pmd_mask(struct vm_area_struct *vma,
 		spin_unlock(ptl);
 		if (page)
 			return page;
+		return no_page_table(vma, flags);
 	}
 	if (likely(!pmd_trans_huge(pmdval)))
 		return follow_page_pte(vma, address, pmd, flags, &ctx->pgmap);
@@ -758,6 +759,7 @@ static struct page *follow_pud_mask(struct vm_area_struct *vma,
 		spin_unlock(ptl);
 		if (page)
 			return page;
+		return no_page_table(vma, flags);
 	}
 	if (unlikely(pud_bad(*pud)))
 		return no_page_table(vma, flags);
Signature · 1 line
2.41.0
maintainer
#1 lore raw
Quoted 6 lines · On Thu, 23 Nov 2023 13:02:22 -0500 Peter Xu <[email protected]> wrote:

This is a bug found not by any report but only by code observations.

When GUP sees a devpmd/devpud and if page==NULL is returned, it means a fault is probably required. Here falling through when page==NULL can cause unexpected behavior.

Well this is worrisome. We aren't able to construct a test case to demonstrate this bug? Why is that? Is it perhaps just dead code?

author reviewer
#2 lore raw
Quoted 11 lines · Andrew Morton
Quoted 6 lines · On Thu, 23 Nov 2023 13:02:22 -0500 Peter Xu <[email protected]> wrote:

This is a bug found not by any report but only by code observations.

When GUP sees a devpmd/devpud and if page==NULL is returned, it means a fault is probably required. Here falling through when page==NULL can cause unexpected behavior.

Well this is worrisome. We aren't able to construct a test case to demonstrate this bug? Why is that? Is it perhaps just dead code?

IIUC it's not dead code. Take the example of follow_devmap_pmd(), it can return page==NULL at least when seeing write bit missing:

	if (flags & FOLL_WRITE && !pmd_write(*pmd))
		return NULL;

AFAICT it can happen if someone does "echo 4 > /proc/$PID/clear_refs" when the mm contains the devmap pmd. Same to pud.

It'll be nice if someone that works with dax would like to verify it. In my series (refactor hugetlb gup, part 2) IIUC some hugetlb selftest can start to trigger this path, but I'll need to check. So far it's dax-only.

Thanks,

Signature · 1 line
Peter Xu
#3 lore raw
Quoted 19 lines · Peter Xu
Quoted 11 lines · Andrew Morton
Quoted 6 lines · On Thu, 23 Nov 2023 13:02:22 -0500 Peter Xu <[email protected]> wrote:

This is a bug found not by any report but only by code observations.

When GUP sees a devpmd/devpud and if page==NULL is returned, it means a fault is probably required. Here falling through when page==NULL can cause unexpected behavior.

Well this is worrisome. We aren't able to construct a test case to demonstrate this bug? Why is that? Is it perhaps just dead code?

IIUC it's not dead code. Take the example of follow_devmap_pmd(), it can return page==NULL at least when seeing write bit missing:

	if (flags & FOLL_WRITE && !pmd_write(*pmd))
		return NULL;
Quoted 6 lines

AFAICT it can happen if someone does "echo 4 > /proc/$PID/clear_refs" when the mm contains the devmap pmd. Same to pud.

It'll be nice if someone that works with dax would like to verify it. In my series (refactor hugetlb gup, part 2) IIUC some hugetlb selftest can start to trigger this path, but I'll need to check. So far it's dax-only.

It certainly looks weird to continue there. Triggering it by mmaping some devdax device might be possible (e.g., using devdax emulation).

We know the PMD is present and the PMD is devmap. We take the pmd lock, and in follow_devmap_pmd() we recheck both.

I suspect the original idea was: if it's suddenly no longer present or no longer devmap, it was replaced by a PTE table. So we know a deeper level is there and can simply continue instead of triggering a fault.

But that does not seem to be the case, because I suspect the PMD could have been zapped (MADV_DONTNEED?) in the meantime, and the "writability" check is similarly weird.

So I assume the patch from Peter is ok: even if the PMD got replaced by a PTE table, we'd trigger a fault and simply retry.

Signature · 3 lines
Cheers,

David / dhildenb