VM pageout scalability improvements
Get series with b4
b4 am [email protected]Versions newest first
- v1 Latest21 patches 38 repliesIn review
Changelog from the cover letter
- pull the memcontrol lru arrayification earlier into the patch series
- use a pagevec array similar to the lru array
- clean up the code in various places
- improved pageout balancing and reduced pageout cpu use
- fix compilation on PPC and without memcontrol
- make page_is_pagecache more readable
- replace get_scan_ratio with correct version
- merge memcontroller split LRU code into the main split LRU patch, since it is not functionally different (it was split up only to help people who had seen the last version of the patch series review it)
- drop the page_file_cache debugging patch, since it never triggered
- reintroduce code to not scan anon list if swap is full
- add code to scan anon list if page cache is very small already
- use lumpy reclaim more aggressively for smaller order > 1 allocations
Patches in v1 No applies recorded yet
| # | Subject and files | Size | Replies | Applied |
|---|---|---|---|---|
| 1/21 | move isolate_lru_page() to vmscan.cinclude/ mm/ mm/ +2 more | +60 | 3 replies | |
| 2/21 | Use an indexed array for LRU variablesinclude/ include/ include/ +5 more | +158 | 2 replies | |
| 3/21 | use an array for the LRU pagevecsinclude/ include/ include/ +2 more | +76 | 5 replies | |
| 4/21 | free swap space on swap-in/activationinclude/ mm/ mm/ | +26 | 2 replies | |
| 5/21 | define page_file_cache() functioninclude/ include/ mm/ +4 more | +38 | 1 reply | |
| 6/21 | split LRU lists into anon & file setsdrivers/ fs/ fs/ +19 more | +488 | 2 replies | |
| 7/21 | SEQ replacement for anonymous pagesinclude/ include/ mm/ +2 more | +92 | 1 reply | |
| 8/21 | (NEW) add some sanity checks to get_scan_ratioinclude/ mm/ mm/ +1 more | +77 | 1 reply | |
| 9/21 | (NEW) improve reclaim balancingmm/ | +9 | 2 replies | |
| 10/21 | add newly swapped in pages to the inactive listmm/ | +1 | 0 replies | |
| 11/21 | (NEW) more aggressively use lumpy reclaimmm/ | +16 | 2 replies | |
| 12/21 | No Reclaim LRU Infrastructureinclude/ include/ include/ +9 more | +270 | 9 replies | |
| 13/21 | Non-reclaimable page statisticsdrivers/ fs/ mm/ +1 more | +30 | 0 replies | |
| 14/21 | scan noreclaim list for reclaimable pagesdrivers/ include/ kernel/ +1 more | +171 | 2 replies | |
| 15/21 | ramfs pages are non-reclaimabledrivers/ fs/ include/ +1 more | +40 | 0 replies | |
| 16/21 | SHM_LOCKED pages are nonreclaimableinclude/ include/ mm/ +1 more | +99 | 0 replies | |
| 17/21 | non-reclaimable mlocked pagesinclude/ include/ mm/ +7 more | +509 | 1 reply | |
| 18/21 | mlock vma pages under mmap_sem held for readmm/ mm/ | +64 | 0 replies | |
| 19/21 | handle mlocked pages during map/unmap and truncatemm/ mm/ mm/ +2 more | +59 | 0 replies | |
| 20/21 | account mlocked pagesdrivers/ fs/ include/ +3 more | +56 | 0 replies | |
| 21/21 | cull non-reclaimable anon pages from the LRU at fault timemm/ mm/ | +9 | 2 replies |
Reviews trailers per patch
1 of 21 patches has a Reviewed-by or Acked-by.
| Patch | KOSAKI Motohiro |
|---|---|
| 1/21 | |
| 2/21 | |
| 3/21 | |
| 4/21 | |
| 5/21 | |
| 6/21 | |
| 7/21 | R-b |
| 8/21 | |
| 9/21 | |
| 10/21 | |
| 11/21 | |
| 12/21 | |
| 13/21 | |
| 14/21 | |
| 15/21 | |
| 16/21 | |
| 17/21 | |
| 18/21 | |
| 19/21 | |
| 20/21 | |
| 21/21 |
Trailers given in replies are filled; those carried in the patches from earlier versions are outlined with dashes.
Cover letter [patch 00/21] VM pageout scalability improvements
On large memory systems, the VM can spend way too much time scanning through pages that it cannot (or should not) evict from memory. Not only does it use up CPU time, but it also provokes lock contention and can leave large systems under memory presure in a catatonic state.
Against 2.6.24-rc6-mm1
This patch series improves VM scalability by:
1) making the locking a little more scalable
2) putting filesystem backed, swap backed and non-reclaimable pages onto their own LRUs, so the system only scans the pages that it can/should evict from memory
3) switching to SEQ replacement for the anonymous LRUs, so the number of pages that need to be scanned when the system starts swapping is bound to a reasonable number
More info on the overall design can be found at:
http://linux-mm.org/PageReplacementDesign
Changelog:
- pull the memcontrol lru arrayification earlier into the patch series
- use a pagevec array similar to the lru array
- clean up the code in various places
- improved pageout balancing and reduced pageout cpu use
- fix compilation on PPC and without memcontrol
- make page_is_pagecache more readable
- replace get_scan_ratio with correct version
- merge memcontroller split LRU code into the main split LRU patch, since it is not functionally different (it was split up only to help people who had seen the last version of the patch series review it)
- drop the page_file_cache debugging patch, since it never triggered
- reintroduce code to not scan anon list if swap is full
- add code to scan anon list if page cache is very small already
- use lumpy reclaim more aggressively for smaller order > 1 allocations
Signature · 7 lines
All Rights Reversed -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: <a href=mailto:"[email protected]"> [email protected] </a>