Revert VM_POPULATE?
Subsystems (3)
Michel, I propose that we revert 3.9-rc1's VM_POPULATE flag - 186930500985 "mm: introduce VM_POPULATE flag to better deal with racy userspace programs".
Konstantin's 3.7 cleanup of VM_flags has left several bits below 32 free, but sooner or later someone will want to come through again and free some more, and I think VM_POPULATE will be among the first to go.
It just doesn't add much value, and flags a transient condition which then sticks around indefinitely. Better we remove it now than later.
You said yourself in the 0/8 or 1/8:
- Patch 8 is optional to this entire series. It only helps to deal more nicely with racy userspace programs that might modify their mappings while we're trying to populate them. It adds a new VM_POPULATE flag on the mappings we do want to populate, so that if userspace replaces them with mappings it doesn't want populated, mm_populate() won't populate those replacement mappings.
when you were just testing the waters with 8/8 to see if it was wanted.
I don't see any serious problem with it. We can probably contrive a case in which someone mlocks-then-munlocks scattered segments of a large vma, and the VM_POPULATE flag left behind prevents the segments from being merged back into a single vma; but that can happen in other ways, so it doesn't count for much.
(I presume VM_POPULATE is left uncleared, because there could always be races when it's cleared too soon - if userspace is racing with itself.)
I just don't see VM_POPLULATE solving any real problem: the kernel code appears to be safe enough without it, and if userspace wishes to play racing mmap games, oh, just let it.
The original patch appears to revert cleanly, except in mm/mmap.c where "*populate = true;" has since become "*populate = len;".
Hugh
--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
Quoted 19 lines · Hugh Dickins
Michel, I propose that we revert 3.9-rc1's
VM_POPULATEflag - 186930500985 "mm: introduceVM_POPULATEflag to better deal with racy userspace programs".Konstantin's 3.7 cleanup of
VM_flagshas left several bits below 32 free, but sooner or later someone will want to come through again and free some more, and I thinkVM_POPULATEwill be among the first to go.It just doesn't add much value, and flags a transient condition which then sticks around indefinitely. Better we remove it now than later.
You said yourself in the 0/8 or 1/8:
- Patch 8 is optional to this entire series. It only helps to deal more nicely with racy userspace programs that might modify their mappings while we're trying to populate them. It adds a newVM_POPULATEflag on the mappings we do want to populate, so that if userspace replaces them with mappings it doesn't want populated,mm_populate()won't populate those replacement mappings.
when you were just testing the waters with 8/8 to see if it was wanted.
Quoted 8 lines
I don't see any serious problem with it. We can probably contrive a case in which someone mlocks-then-munlocks scattered segments of a large vma, and the
VM_POPULATEflag left behind prevents the segments from being merged back into a single vma; but that can happen in other ways, so it doesn't count for much.(I presume
VM_POPULATEis left uncleared, because there could always be races when it's cleared too soon - if userspace is racing with itself.)
Yes, VM_POPULATE is never cleared.
Quoted 3 lines
I just don't see
VM_POPLULATEsolving any real problem: the kernel code appears to be safe enough without it, and if userspace wishes to play racing mmap games, oh, just let it.
All right. I have no major objections - the kernel will be fine without VM_POPULATE, and the only downside of removing it is that we might do more work to populate new mappings if userspace plays games, as you say, unmapping and remapping vmas before the original mmap call that created it returns (or while an mlock call that operates on it is running). I don't care strongly about kernel behavior in such cases as long as it doesn't affect other processes, so I'm OK with reverting VM_POPULATE as long as others agree.
I'll send out a code review to do that.
Signature · 8 lines
Michel "Walken" Lespinasse A program is never fully debugged until the last user dies. -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
PATCH 1/1 Revert "mm: introduce VM_POPULATE flag to better deal with racy userspace programs"
This reverts commit 1869305009857cdeaabe6283bcdc2359c5784543.
VM_POPULATE only has any effect when userspace plays racy games with vmas by trying to unmap and remap memory regions that mmap or mlock are operating on.
Also, the only effect of VM_POPULATE when userspace plays such games is that it avoids populating new memory regions that get remapped into the address range that was being operated on by the original mmap or mlock calls.
Let's remove VM_POPULATE as there isn't any strong argument to mandate a new vm_flag.
--- include/linux/mm.h | 1 - include/linux/mman.h | 4 +--- mm/fremap.c | 12 ++---------- mm/mlock.c | 11 +++++------ mm/mmap.c | 4 +++- 5 files changed, 11 insertions(+), 21 deletions(-)
include/linux/mm.h +0 -1
@@ -87,7 +87,6 @@ extern unsigned int kobjsize(const void *objp);#define VM_PFNMAP 0x00000400/* Page-ranges managed without "struct page", just pure PFN */ #define VM_DENYWRITE 0x00000800/* ETXTBSY on write attempts.. */ -#define VM_POPULATE 0x00001000#define VM_LOCKED 0x00002000#define VM_IO 0x00004000/* Memory mapped I/O or similar */
include/linux/mman.h +1 -3
@@ -79,8 +79,6 @@ calc_vm_flag_bits(unsigned long flags) {return _calc_vm_trans (flags,MAP_GROWSDOWN ,VM_GROWSDOWN ) |_calc_vm_trans (flags,MAP_DENYWRITE ,VM_DENYWRITE ) | - ((flags &MAP_LOCKED ) ? (VM_LOCKED |VM_POPULATE ) :0 ) | - (((flags & (MAP_POPULATE |MAP_NONBLOCK )) ==MAP_POPULATE ) ? -VM_POPULATE :0 ); +_calc_vm_trans (flags,MAP_LOCKED ,VM_LOCKED ); }#endif /* _LINUX_MMAN_H */
mm/fremap.c +2 -10
@@ -204,10 +204,8 @@ get_write_lock:unsigned long addr;struct file *file =get_file (vma->vm_file); - vm_flags = vma->vm_flags; -if (!(flags &MAP_NONBLOCK )) - vm_flags |=VM_POPULATE ; - addr =mmap_region (file, start, size, vm_flags, pgoff); + addr =mmap_region (file, start, size, + vma->vm_flags, pgoff);fput (file);if (IS_ERR_VALUE (addr)) { err = addr;
@@ -226,12 +224,6 @@ get_write_lock:mutex_unlock (&mapping->i_mmap_mutex); } -if (!(flags &MAP_NONBLOCK ) && !(vma->vm_flags &VM_POPULATE )) { -if (!has_write_lock) - goto get_write_lock; - vma->vm_flags |=VM_POPULATE ; - } -if (vma->vm_flags &VM_LOCKED ) {/* * drop PG_Mlocked flag for over-mapped range
mm/mlock.c +5 -6
@@ -358,7 +358,7 @@ static int do_mlock(unsigned long start, size_t len, int on) newflags = vma->vm_flags & ~VM_LOCKED ;if (on) - newflags |=VM_LOCKED |VM_POPULATE ; + newflags |=VM_LOCKED ; tmp = vma->vm_end;if (tmp > end)
@@ -418,8 +418,7 @@ int __mm_populate(unsigned long start, unsigned long len, int ignore_errors)* range with the first VMA. Also, skip undesirable VMA types. */ nend =min (end, vma->vm_end); -if ((vma->vm_flags & (VM_IO |VM_PFNMAP |VM_POPULATE )) != -VM_POPULATE ) +if (vma->vm_flags & (VM_IO |VM_PFNMAP ))continue ;if (nstart < vma->vm_start) nstart = vma->vm_start;
@@ -492,9 +491,9 @@ static int do_mlockall(int flags)struct vm_area_struct * vma, * prev =NULL ;if (flags &MCL_FUTURE ) - current->mm->def_flags |=VM_LOCKED |VM_POPULATE ; + current->mm->def_flags |=VM_LOCKED ;else - current->mm->def_flags &= ~(VM_LOCKED |VM_POPULATE ); + current->mm->def_flags &= ~VM_LOCKED ;if (flags ==MCL_FUTURE ) goto out;
@@ -503,7 +502,7 @@ static int do_mlockall(int flags) newflags = vma->vm_flags & ~VM_LOCKED ;if (flags &MCL_CURRENT ) - newflags |=VM_LOCKED |VM_POPULATE ; + newflags |=VM_LOCKED ;/* Ignore errors */ mlock_fixup (vma, &prev, vma->vm_start, vma->vm_end, newflags);
mm/mmap.c +3 -1
@@ -1306,7 +1306,9 @@ unsigned long do_mmap_pgoff(struct file *file, unsigned long addr, } addr =mmap_region (file, addr, len, vm_flags, pgoff); -if (!IS_ERR_VALUE (addr) && (vm_flags &VM_POPULATE )) +if (!IS_ERR_VALUE (addr) && + ((vm_flags &VM_LOCKED ) || + (flags & (MAP_POPULATE |MAP_NONBLOCK )) ==MAP_POPULATE )) *populate = len;return addr; }
Signature · 8 lines
Michel "Walken" Lespinasse A program is never fully debugged until the last user dies. -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
PATCH 1/1 Revert "mm: introduce VM_POPULATE flag to better deal with racy userspace programs"
From: Michel Lespinasse <[email protected]>
This reverts commit 1869305009857cdeaabe6283bcdc2359c5784543 ("mm:
introduce VM_POPULATE flag to better deal with racy userspace programs").
VM_POPULATE only has any effect when userspace plays racy games with vmas by trying to unmap and remap memory regions that mmap or mlock are operating on.
Also, the only effect of VM_POPULATE when userspace plays such games is that it avoids populating new memory regions that get remapped into the address range that was being operated on by the original mmap or mlock calls.
Let's remove VM_POPULATE as there isn't any strong argument to mandate a new vm_flag.
---
Andrew has taken this patch into his tree, but remarked that he is away from keyboard until the end of next week: though not a serious matter, I think we had better include this revert in -rc5 than later.
include/linux/mm.h | 1 - include/linux/mman.h | 4 +--- mm/fremap.c | 12 ++---------- mm/mlock.c | 11 +++++------ mm/mmap.c | 4 +++- 5 files changed, 11 insertions(+), 21 deletions(-)
include/linux/mm.h +0 -1
@@ -87,7 +87,6 @@ extern unsigned int kobjsize(const void *objp);#define VM_PFNMAP 0x00000400/* Page-ranges managed without "struct page", just pure PFN */ #define VM_DENYWRITE 0x00000800/* ETXTBSY on write attempts.. */ -#define VM_POPULATE 0x00001000#define VM_LOCKED 0x00002000#define VM_IO 0x00004000/* Memory mapped I/O or similar */
include/linux/mman.h +1 -3
@@ -79,8 +79,6 @@ calc_vm_flag_bits(unsigned long flags) {return _calc_vm_trans (flags,MAP_GROWSDOWN ,VM_GROWSDOWN ) |_calc_vm_trans (flags,MAP_DENYWRITE ,VM_DENYWRITE ) | - ((flags &MAP_LOCKED ) ? (VM_LOCKED |VM_POPULATE ) :0 ) | - (((flags & (MAP_POPULATE |MAP_NONBLOCK )) ==MAP_POPULATE ) ? -VM_POPULATE :0 ); +_calc_vm_trans (flags,MAP_LOCKED ,VM_LOCKED ); }#endif /* _LINUX_MMAN_H */
mm/fremap.c +2 -10
@@ -204,10 +204,8 @@ get_write_lock:unsigned long addr;struct file *file =get_file (vma->vm_file); - vm_flags = vma->vm_flags; -if (!(flags &MAP_NONBLOCK )) - vm_flags |=VM_POPULATE ; - addr =mmap_region (file, start, size, vm_flags, pgoff); + addr =mmap_region (file, start, size, + vma->vm_flags, pgoff);fput (file);if (IS_ERR_VALUE (addr)) { err = addr;
@@ -226,12 +224,6 @@ get_write_lock:mutex_unlock (&mapping->i_mmap_mutex); } -if (!(flags &MAP_NONBLOCK ) && !(vma->vm_flags &VM_POPULATE )) { -if (!has_write_lock) - goto get_write_lock; - vma->vm_flags |=VM_POPULATE ; - } -if (vma->vm_flags &VM_LOCKED ) {/* * drop PG_Mlocked flag for over-mapped range
mm/mlock.c +5 -6
@@ -358,7 +358,7 @@ static int do_mlock(unsigned long start, size_t len, int on) newflags = vma->vm_flags & ~VM_LOCKED ;if (on) - newflags |=VM_LOCKED |VM_POPULATE ; + newflags |=VM_LOCKED ; tmp = vma->vm_end;if (tmp > end)
@@ -418,8 +418,7 @@ int __mm_populate(unsigned long start, unsigned long len, int ignore_errors)* range with the first VMA. Also, skip undesirable VMA types. */ nend =min (end, vma->vm_end); -if ((vma->vm_flags & (VM_IO |VM_PFNMAP |VM_POPULATE )) != -VM_POPULATE ) +if (vma->vm_flags & (VM_IO |VM_PFNMAP ))continue ;if (nstart < vma->vm_start) nstart = vma->vm_start;
@@ -492,9 +491,9 @@ static int do_mlockall(int flags)struct vm_area_struct * vma, * prev =NULL ;if (flags &MCL_FUTURE ) - current->mm->def_flags |=VM_LOCKED |VM_POPULATE ; + current->mm->def_flags |=VM_LOCKED ;else - current->mm->def_flags &= ~(VM_LOCKED |VM_POPULATE ); + current->mm->def_flags &= ~VM_LOCKED ;if (flags ==MCL_FUTURE ) goto out;
@@ -503,7 +502,7 @@ static int do_mlockall(int flags) newflags = vma->vm_flags & ~VM_LOCKED ;if (flags &MCL_CURRENT ) - newflags |=VM_LOCKED |VM_POPULATE ; + newflags |=VM_LOCKED ;/* Ignore errors */ mlock_fixup (vma, &prev, vma->vm_start, vma->vm_end, newflags);
mm/mmap.c +3 -1
@@ -1306,7 +1306,9 @@ unsigned long do_mmap_pgoff(struct file *file, unsigned long addr, } addr =mmap_region (file, addr, len, vm_flags, pgoff); -if (!IS_ERR_VALUE (addr) && (vm_flags &VM_POPULATE )) +if (!IS_ERR_VALUE (addr) && + ((vm_flags &VM_LOCKED ) || + (flags & (MAP_POPULATE |MAP_NONBLOCK )) ==MAP_POPULATE )) *populate = len;return addr; }
Signature · 8 lines
Michel "Walken" Lespinasse A program is never fully debugged until the last user dies. -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"[email protected]"> [email protected] </a>