Skip to content

VM pageout scalability improvements

Rik van Riel linux-mm lkml 1 version In review

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest19 patches 54 repliesIn review

Changelog from the cover letter

- merge memcontroller split LRU code into the main split LRU patch, since it is not functionally different (it was split up only to help people who had seen the last version of the patch series review it)
- drop the page_file_cache debugging patch, since it never triggered
- reintroduce code to not scan anon list if swap is full
- add code to scan anon list if page cache is very small already
- use lumpy reclaim more aggressively for smaller order > 1 allocations

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/19move isolate_lru_page() to vmscan.cinclude/linux/migrate.h mm/internal.h mm/mempolicy.c +2 more+61 -421 reply
2/19free swap space on swap-in/activationinclude/linux/pagevec.h mm/swap.c mm/vmscan.c+26 -01 reply
3/19define page_file_cache() functioninclude/linux/mm_inline.h include/linux/page-flags.h mm/memory.c +4 more+38 -03 replies
4/19Use an indexed array for LRU variablesinclude/linux/mm_inline.h include/linux/mmzone.h mm/page_alloc.c +3 more+109 -930 replies
5/19split LRU lists into anon & file setsdrivers/base/node.c fs/cifs/file.c fs/nfs/dir.c +20 more+619 -47932 replies
6/19SEQ replacement for anonymous pagesinclude/linux/mm_inline.h include/linux/mmzone.h mm/page_alloc.c +2 more+92 -80 replies
7/19(NEW) add some sanity checks to get_scan_ratiomm/vmscan.c+15 -12 replies
8/19add newly swapped in pages to the inactive listmm/swap_state.c+1 -11 reply
9/19(NEW) more aggressively use lumpy reclaimmm/vmscan.c+16 -42 replies
10/19No Reclaim LRU Infrastructureinclude/linux/mm_inline.h include/linux/mmzone.h include/linux/page-flags.h +9 more+309 -293 replies
11/19Non-reclaimable page statisticsdrivers/base/node.c fs/proc/proc_misc.c mm/page_alloc.c +1 more+30 -10 replies
12/19scan noreclaim list for reclaimable pagesdrivers/base/node.c include/linux/swap.h kernel/sysctl.c +1 more+171 -00 replies
13/19ramfs pages are non-reclaimabledrivers/block/brd.c fs/ramfs/inode.c include/linux/pagemap.h +1 more+40 -00 replies
14/19SHM_LOCKED pages are nonreclaimableinclude/linux/pagemap.h include/linux/swap.h mm/shmem.c +1 more+99 -190 replies
15/19non-reclaimable mlocked pagesinclude/linux/page-flags.h include/linux/rmap.h mm/Kconfig +7 more+509 -440 replies
16/19mlock vma pages under mmap_sem held for readmm/internal.h mm/mlock.c+64 -120 replies
17/19handle mlocked pages during map/unmap and truncatemm/filemap.c mm/mmap.c mm/mremap.c +2 more+59 -90 replies
18/19account mlocked pagesdrivers/base/node.c fs/proc/proc_misc.c include/linux/mmzone.h +3 more+55 -132 replies
19/19cull non-reclaimable anon pages from the LRU at fault timemm/memory.c mm/swap_state.c+9 -60 replies

Reviews trailers per patch

5 of 19 patches have a Reviewed-by or Acked-by.

PatchKOSAKI MotohiroChristoph LameterMel Gorman
1/19R-b
2/19R-b
3/19
4/19
5/19
6/19R-b
7/19
8/19R-b
9/19R-b A-b
10/19
11/19
12/19
13/19
14/19
15/19
16/19
17/19
18/19
19/19

Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes. Scroll the table sideways for all 3 reviewers.

Read the v1 thread

Cover letter [patch 00/19] VM pageout scalability improvements

On large memory systems, the VM can spend way too much time scanning through pages that it cannot (or should not) evict from memory. Not only does it use up CPU time, but it also provokes lock contention and can leave large systems under memory presure in a catatonic state.

Against 2.6.24-rc6-mm1

This patch series improves VM scalability by:

1) making the locking a little more scalable

2) putting filesystem backed, swap backed and non-reclaimable pages onto their own LRUs, so the system only scans the pages that it can/should evict from memory

3) switching to SEQ replacement for the anonymous LRUs, so the number of pages that need to be scanned when the system starts swapping is bound to a reasonable number

More info on the overall design can be found at:

http://linux-mm.org/PageReplacementDesign

Changelog:
- merge memcontroller split LRU code into the main split LRU patch, since it is not functionally different (it was split up only to help people who had seen the last version of the patch series review it)
- drop the page_file_cache debugging patch, since it never triggered
- reintroduce code to not scan anon list if swap is full
- add code to scan anon list if page cache is very small already
- use lumpy reclaim more aggressively for smaller order > 1 allocations

Signature · 7 lines
All Rights Reversed

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to [email protected].  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>