support large folio swap-out and swap-in for shmem
Subsystems (9)
Baolin Wang
reviewerRFC PATCH 2/8 mm: vmscan: add validation before spliting shmem large folio
In reply to Baolin WangAdd swap available space validation before spliting shmem large folio to avoid redundant split, since we can not write shmem folio to the swap device in this case.
--- mm/vmscan.c | 8 ++++++++ 1 file changed, 8 insertions(+)
mm/vmscan.c +8 -0
@@ -1252,6 +1252,14 @@ static unsigned int shrink_folio_list(struct list_head *folio_list, } }else if (folio_test_swapbacked (folio) &&folio_test_large (folio)) { + +/* +* Do not split shmem folio if no swap memory +* available. +*/ +if (!total_swap_pages) + goto activate_locked; +/* Split shmem folio */ if (split_folio_to_list (folio, folio_list)) goto keep_locked;
Signature · 1 line
2.39.3
Baolin Wang
reviewerRFC PATCH 3/8 mm: swap: extend swap_shmem_alloc() to support batch SWAP_MAP_SHMEM flag setting
In reply to Baolin WangTo support shmem large folio swap operations, add a new parameter to swap_shmem_alloc() that allows batch SWAP_MAP_SHMEM flag setting for shmem swap entries.
While we are at it, using folio_nr_pages() to get the number of pages of the folio as a preparation.
--- include/linux/swap.h | 4 +- mm/shmem.c | 6 ++- mm/swapfile.c | 98 +++++++++++++++++++++++--------------------- 3 files changed, 57 insertions(+), 51 deletions(-)
include/linux/swap.h +2 -2
@@ -479,7 +479,7 @@ void put_swap_folio(struct folio *folio, swp_entry_t entry);extern swp_entry_t get_swap_page_of_type (int );extern int get_swap_pages (int n,swp_entry_t swp_entries[],int order);extern int add_swap_count_continuation (swp_entry_t ,gfp_t ); -extern void swap_shmem_alloc (swp_entry_t ); +extern void swap_shmem_alloc (swp_entry_t ,int );extern int swap_duplicate (swp_entry_t );extern int swapcache_prepare (swp_entry_t );extern void swap_free_nr (swp_entry_t entry,int nr_pages);
@@ -546,7 +546,7 @@ static inline int add_swap_count_continuation(swp_entry_t swp, gfp_t gfp_mask)return 0 ; } -static inline void swap_shmem_alloc (swp_entry_t swp) +static inline void swap_shmem_alloc (swp_entry_t swp,int nr) { }
mm/shmem.c +4 -2
@@ -1433,6 +1433,7 @@ static int shmem_writepage(struct page *page, struct writeback_control *wbc)struct shmem_sb_info *sbinfo =SHMEM_SB (inode->i_sb);swp_entry_t swap;pgoff_t index; +int nr_pages;/* * Our capabilities prevent regular writeback or sync from ever calling
@@ -1465,6 +1466,7 @@ static int shmem_writepage(struct page *page, struct writeback_control *wbc) } index = folio->index; + nr_pages =folio_nr_pages (folio);/* * This is somewhat ridiculous, but without plumbing a SWAP_MAP_FALLOC
@@ -1517,8 +1519,8 @@ static int shmem_writepage(struct page *page, struct writeback_control *wbc)if (add_to_swap_cache (folio, swap, __GFP_HIGH | __GFP_NOMEMALLOC | __GFP_NOWARN,NULL ) ==0 ) { -shmem_recalc_inode (inode,0 ,1 ); -swap_shmem_alloc (swap); +shmem_recalc_inode (inode,0 , nr_pages); +swap_shmem_alloc (swap, nr_pages);shmem_delete_from_page_cache (folio,swp_to_radix_entry (swap));mutex_unlock (&shmem_swaplist_mutex);
mm/swapfile.c +51 -47
138 lines not on this page · raw message
Signature · 1 line
2.39.3
Baolin Wang
reviewercover support large folio swap-out and swap-in for shmem
Shmem will support large folio allocation [1] [2] to get a better performance, however, the memory reclaim still splits the precious large folios when trying to swap-out shmem, which may lead to the memory fragmentation issue and can not take advantage of the large folio for shmeme.
Moreover, the swap code already supports for swapping out large folio without split, and large folio swap-in[3] is under reviewing. Hence this patch set also supports the large folio swap-out and swap-in for shmem.
Note: this patch set is currently just to show some thoughts and gather some suggestionsis, and it is based on Barry's large folio swap-in patch set [3] and my anon shmem mTHP patch set [1].
[1] https://lore.kernel.org/all/[email protected]/
[2] https://lore.kernel.org/all/[email protected]/
[3] https://lore.kernel.org/all/[email protected]/T/
Baolin Wang (8):
mm: fix shmem swapout statistic
mm: vmscan: add validation before spliting shmem large folio
mm: swap: extend swap_shmem_alloc() to support batch SWAP_MAP_SHMEM
flag setting
mm: shmem: support large folio allocation for shmem_replace_folio()
mm: shmem: extend shmem_partial_swap_usage() to support large folio
swap
mm: add new 'orders' parameter for find_get_entries() and
find_lock_entries()
mm: shmem: use swap_free_nr() to free shmem swap entries
mm: shmem: support large folio swap out
drivers/gpu/drm/i915/gem/i915_gem_shmem.c | 1 + include/linux/swap.h | 4 +- include/linux/writeback.h | 1 + mm/filemap.c | 27 ++++++- mm/internal.h | 4 +- mm/page_io.c | 4 +- mm/shmem.c | 59 ++++++++------ mm/swapfile.c | 98 ++++++++++++----------- mm/truncate.c | 8 +- mm/vmscan.c | 22 ++++- 10 files changed, 143 insertions(+), 85 deletions(-)
Signature · 1 line
2.39.3
Baolin Wang
reviewerRFC PATCH 5/8 mm: shmem: extend shmem_partial_swap_usage() to support large folio swap
To support shmem large folio swapout in the following patches, using xa_get_order() to get the order of the swap entry to calculate the swap usage of shmem.
--- mm/shmem.c | 7 +++++-- 1 file changed, 5 insertions(+), 2 deletions(-)
mm/shmem.c +5 -2
@@ -865,13 +865,16 @@ unsigned long shmem_partial_swap_usage(struct address_space *mapping,struct page *page;unsigned long swapped =0 ;unsigned long max = end -1 ; +int order;rcu_read_lock ();xas_for_each (&xas, page, max) {if (xas_retry (&xas, page))continue ; -if (xa_is_value (page)) - swapped++; +if (xa_is_value (page)) { + order =xa_get_order (xas.xa, xas.xa_index); + swapped +=1 << order; + }if (xas.xa_index == max)break ;if (need_resched ()) {
Signature · 1 line
2.39.3
Baolin Wang
reviewerRFC PATCH 1/8 mm: fix shmem swapout statistic
In reply to Baolin WangAs we know, shmem not only supports the sharing of anonymous pages, but also the RAM-based temporary filesystem. Therefore, shmem swapouts should not be marked as anonymous swapout statistics. Fix it by adding folio_test_anon().
--- mm/page_io.c | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)
mm/page_io.c +3 -1
@@ -217,7 +217,9 @@ static inline void count_swpout_vm_event(struct folio *folio)count_memcg_folio_events (folio,THP_SWPOUT ,1 ); count_vm_event(THP_SWPOUT); } -count_mthp_stat (folio_order (folio),MTHP_STAT_ANON_SWPOUT ); + +if (folio_test_anon (folio)) +count_mthp_stat (folio_order (folio),MTHP_STAT_ANON_SWPOUT );#endif count_vm_events (PSWPOUT ,folio_nr_pages (folio)); }
Signature · 1 line
2.39.3
Baolin Wang
reviewerRFC PATCH 6/8 mm: add new 'orders' parameter for find_get_entries() and find_lock_entries()
In reply to Baolin WangIn the following patches, shmem will support the swap out of large folios, which means the shmem mappings may contain large order swap entries, so an 'orders' array is added for find_get_entries() and find_lock_entries() to obtain the order size of shmem swap entries, which will help in the release of shmem large folio swap entries.
--- mm/filemap.c | 27 +++++++++++++++++++++++++-- mm/internal.h | 4 ++-- mm/shmem.c | 17 +++++++++-------- mm/truncate.c | 8 ++++---- 4 files changed, 40 insertions(+), 16 deletions(-)
mm/filemap.c +25 -2
@@ -2036,14 +2036,24 @@ static inline struct folio *find_get_entry(struct xa_state *xas, pgoff_t max,* Return: The number of entries which were found. */ unsigned find_get_entries (struct address_space *mapping,pgoff_t *start, -pgoff_t end,struct folio_batch *fbatch,pgoff_t *indices) +pgoff_t end,struct folio_batch *fbatch,pgoff_t *indices, +int *orders) {XA_STATE (xas, &mapping->i_pages, *start);struct folio *folio; +int order;rcu_read_lock ();while ((folio =find_get_entry (&xas, end,XA_PRESENT )) !=NULL ) { indices[fbatch->nr] = xas.xa_index; +if (orders) { +if (!xa_is_value (folio)) + order =folio_order (folio); +else + order =xa_get_order (xas.xa, xas.xa_index); + + orders[fbatch->nr] = order; + }if (!folio_batch_add (fbatch, folio))break ; }
@@ -2056,6 +2066,8 @@ unsigned find_get_entries(struct address_space *mapping, pgoff_t *start, folio = fbatch->folios[idx];if (!xa_is_value (folio)) nr =folio_nr_pages (folio); +else if (orders) + nr =1 << orders[idx]; *start = indices[idx] + nr; }return folio_batch_count (fbatch);
@@ -2082,10 +2094,12 @@ unsigned find_get_entries(struct address_space *mapping, pgoff_t *start,* Return: The number of entries which were found. */ unsigned find_lock_entries (struct address_space *mapping,pgoff_t *start, -pgoff_t end,struct folio_batch *fbatch,pgoff_t *indices) +pgoff_t end,struct folio_batch *fbatch,pgoff_t *indices, +int *orders) {XA_STATE (xas, &mapping->i_pages, *start);struct folio *folio; +int order;rcu_read_lock ();while ((folio =find_get_entry (&xas, end,XA_PRESENT ))) {
@@ -2099,9 +2113,16 @@ unsigned find_lock_entries(struct address_space *mapping, pgoff_t *start,if (folio->mapping != mapping ||folio_test_writeback (folio)) goto unlock; +if (orders) + order =folio_order (folio);VM_BUG_ON_FOLIO (!folio_contains (folio, xas.xa_index), folio); + }else if (orders) { + order =xa_get_order (xas.xa, xas.xa_index); } + +if (orders) + orders[fbatch->nr] = order; indices[fbatch->nr] = xas.xa_index;if (!folio_batch_add (fbatch, folio))break ;
@@ -2120,6 +2141,8 @@ unsigned find_lock_entries(struct address_space *mapping, pgoff_t *start, folio = fbatch->folios[idx];if (!xa_is_value (folio)) nr =folio_nr_pages (folio); +else if (orders) + nr =1 << orders[idx]; *start = indices[idx] + nr; }return folio_batch_count (fbatch);
mm/internal.h +2 -2
@@ -339,9 +339,9 @@ static inline void force_page_cache_readahead(struct address_space *mapping, }unsigned find_lock_entries (struct address_space *mapping,pgoff_t *start, -pgoff_t end,struct folio_batch *fbatch,pgoff_t *indices); +pgoff_t end,struct folio_batch *fbatch,pgoff_t *indices,int *orders);unsigned find_get_entries (struct address_space *mapping,pgoff_t *start, -pgoff_t end,struct folio_batch *fbatch,pgoff_t *indices); +pgoff_t end,struct folio_batch *fbatch,pgoff_t *indices,int *orders);void filemap_free_folio (struct address_space *mapping,struct folio *folio);int truncate_inode_folio (struct address_space *mapping,struct folio *folio); bool truncate_inode_partial_folio(struct folio *folio, loff_t start,
mm/shmem.c +9 -8
@@ -840,14 +840,14 @@ static void shmem_delete_from_page_cache(struct folio *folio, void *radswap)* Remove swap entry from page cache, free the swap and its page cache. */ static int shmem_free_swap (struct address_space *mapping, -pgoff_t index,void *radswap) +pgoff_t index,void *radswap,int order) {void *old; old =xa_cmpxchg_irq (&mapping->i_pages, index, radswap,NULL ,0 );if (old != radswap)return -ENOENT ; -free_swap_and_cache (radix_to_swp_entry (radswap)); +free_swap_and_cache_nr (radix_to_swp_entry (radswap),1 << order);return 0 ; }
@@ -981,6 +981,7 @@ static void shmem_undo_range(struct inode *inode, loff_t lstart, loff_t lend,pgoff_t end = (lend +1 ) >>PAGE_SHIFT ;struct folio_batch fbatch;pgoff_t indices[PAGEVEC_SIZE ]; +int orders[PAGEVEC_SIZE ];struct folio *folio;bool same_folio;long nr_swaps_freed =0 ;
@@ -996,15 +997,15 @@ static void shmem_undo_range(struct inode *inode, loff_t lstart, loff_t lend,folio_batch_init (&fbatch); index = start;while (index < end &&find_lock_entries (mapping, &index, end -1 , - &fbatch, indices)) { + &fbatch, indices, orders)) {for (i =0 ; i <folio_batch_count (&fbatch); i++) { folio = fbatch.folios[i];if (xa_is_value (folio)) {if (unfalloc)continue ; - nr_swaps_freed += !shmem_free_swap (mapping, - indices[i], folio); +if (!shmem_free_swap (mapping, indices[i], folio, orders[i])) + nr_swaps_freed +=1 << orders[i];continue ; }
@@ -1058,7 +1059,7 @@ static void shmem_undo_range(struct inode *inode, loff_t lstart, loff_t lend,cond_resched ();if (!find_get_entries (mapping, &index, end -1 , &fbatch, - indices)) { + indices, orders)) {/* If all gone or hole-punch or unfalloc, we're done */ if (index == start || end !=-1 )break ;
@@ -1072,12 +1073,12 @@ static void shmem_undo_range(struct inode *inode, loff_t lstart, loff_t lend,if (xa_is_value (folio)) {if (unfalloc)continue ; -if (shmem_free_swap (mapping, indices[i], folio)) { +if (shmem_free_swap (mapping, indices[i], folio, orders[i])) {/* Swap was replaced by page: retry */ index = indices[i];break ; } - nr_swaps_freed++; + nr_swaps_freed +=1 << orders[i];continue ; }
mm/truncate.c +4 -4
@@ -352,7 +352,7 @@ void truncate_inode_pages_range(struct address_space *mapping,folio_batch_init (&fbatch); index = start;while (index < end &&find_lock_entries (mapping, &index, end -1 , - &fbatch, indices)) { + &fbatch, indices,NULL )) {truncate_folio_batch_exceptionals (mapping, &fbatch, indices);for (i =0 ; i <folio_batch_count (&fbatch); i++)truncate_cleanup_folio (fbatch.folios[i]);
@@ -392,7 +392,7 @@ void truncate_inode_pages_range(struct address_space *mapping,while (index < end) {cond_resched ();if (!find_get_entries (mapping, &index, end -1 , &fbatch, - indices)) { + indices,NULL )) {/* If all gone from start onwards, we're done */ if (index == start)break ;
@@ -496,7 +496,7 @@ unsigned long mapping_try_invalidate(struct address_space *mapping,int i;folio_batch_init (&fbatch); -while (find_lock_entries (mapping, &index, end, &fbatch, indices)) { +while (find_lock_entries (mapping, &index, end, &fbatch, indices,NULL )) {for (i =0 ; i <folio_batch_count (&fbatch); i++) {struct folio *folio = fbatch.folios[i];
@@ -622,7 +622,7 @@ int invalidate_inode_pages2_range(struct address_space *mapping,folio_batch_init (&fbatch); index = start; -while (find_get_entries (mapping, &index, end, &fbatch, indices)) { +while (find_get_entries (mapping, &index, end, &fbatch, indices,NULL )) {for (i =0 ; i <folio_batch_count (&fbatch); i++) {struct folio *folio = fbatch.folios[i];
Signature · 1 line
2.39.3
Baolin Wang
reviewerRFC PATCH 4/8 mm: shmem: support large folio allocation for shmem_replace_folio()
In reply to Baolin WangTo support large folio swapin for shmem in the following patches, add large folio allocation for the new replacement folio in shmem_replace_folio(), as well as updating statistics using the number of pages in the folio.
--- mm/shmem.c | 13 +++++++------ 1 file changed, 7 insertions(+), 6 deletions(-)
mm/shmem.c +7 -6
@@ -1901,8 +1901,7 @@ static int shmem_replace_folio(struct folio **foliop, gfp_t gfp,* limit chance of success by further cpuset and node constraints. */ gfp &= ~GFP_CONSTRAINT_MASK ; -VM_BUG_ON_FOLIO (folio_test_large (old), old); - new =shmem_alloc_folio (gfp, info, index); + new =shmem_alloc_hugefolio (gfp, info, index,folio_order (old));if (!new)return -ENOMEM ;
@@ -1923,11 +1922,13 @@ static int shmem_replace_folio(struct folio **foliop, gfp_t gfp,xa_lock_irq (&swap_mapping->i_pages); error =shmem_replace_entry (swap_mapping, swap_index, old, new);if (!error) { +int nr_pages =folio_nr_pages (old); +mem_cgroup_migrate (old, new); -__lruvec_stat_mod_folio (new,NR_FILE_PAGES ,1 ); -__lruvec_stat_mod_folio (new,NR_SHMEM ,1 ); -__lruvec_stat_mod_folio (old,NR_FILE_PAGES ,-1 ); -__lruvec_stat_mod_folio (old,NR_SHMEM ,-1 ); +__lruvec_stat_mod_folio (new,NR_FILE_PAGES , nr_pages); +__lruvec_stat_mod_folio (new,NR_SHMEM , nr_pages); +__lruvec_stat_mod_folio (old,NR_FILE_PAGES , -nr_pages); +__lruvec_stat_mod_folio (old,NR_SHMEM , -nr_pages); }xa_unlock_irq (&swap_mapping->i_pages);
Signature · 1 line
2.39.3
Baolin Wang
reviewerRFC PATCH 7/8 mm: shmem: use swap_free_nr() to free shmem swap entries
In reply to Baolin WangAs a preparation for supporting shmem large folio swapout, use swap_free_nr() to free some continuous swap entries of the shmem large folio when the large folio was swapped in from the swap cache.
--- mm/shmem.c | 13 ++++++++----- 1 file changed, 8 insertions(+), 5 deletions(-)
mm/shmem.c +8 -5
@@ -1962,6 +1962,7 @@ static void shmem_set_folio_swapin_error(struct inode *inode, pgoff_t index,struct address_space *mapping = inode->i_mapping;swp_entry_t swapin_error;void *old; +int nr_pages; swapin_error =make_poisoned_swp_entry (); old = xa_cmpxchg_irq(&mapping->i_pages, index,
@@ -1970,6 +1971,7 @@ static void shmem_set_folio_swapin_error(struct inode *inode, pgoff_t index,if (old !=swp_to_radix_entry (swap))return ; + nr_pages =folio_nr_pages (folio);folio_wait_writeback (folio);delete_from_swap_cache (folio);/*
@@ -1977,8 +1979,8 @@ static void shmem_set_folio_swapin_error(struct inode *inode, pgoff_t index,* won't be 0 when inode is released and thus trigger WARN_ON(i_blocks) * in shmem_evict_inode(). */ -shmem_recalc_inode (inode,-1 ,-1 ); -swap_free (swap); +shmem_recalc_inode (inode, -nr_pages, -nr_pages); +swap_free_nr (swap, nr_pages); }/*
@@ -1997,7 +1999,7 @@ static int shmem_swapin_folio(struct inode *inode, pgoff_t index,struct swap_info_struct *si;struct folio *folio =NULL ;swp_entry_t swap; -int error; +int error, nr_pages;VM_BUG_ON (!*foliop || !xa_is_value (*foliop)); swap =radix_to_swp_entry (*foliop);
@@ -2044,6 +2046,7 @@ static int shmem_swapin_folio(struct inode *inode, pgoff_t index, goto failed; }folio_wait_writeback (folio); + nr_pages =folio_nr_pages (folio);/* * Some architectures may have to restore extra metadata to the
@@ -2062,14 +2065,14 @@ static int shmem_swapin_folio(struct inode *inode, pgoff_t index,if (error) goto failed; -shmem_recalc_inode (inode,0 ,-1 ); +shmem_recalc_inode (inode,0 , -nr_pages);if (sgp ==SGP_WRITE )folio_mark_accessed (folio);delete_from_swap_cache (folio);folio_mark_dirty (folio); -swap_free (swap); +swap_free_nr (swap, nr_pages);put_swap_device (si); *foliop = folio;
Signature · 1 line
2.39.3
Baolin Wang
reviewerRFC PATCH 8/8 mm: shmem: support large folio swap out
In reply to Baolin WangShmem will support large folio allocation [1] [2] to get a better performance, however, the memory reclaim still splits the precious large folios when trying to swap out shmem, which may lead to the memory fragmentation issue and can not take advantage of the large folio for shmeme.
Moreover, the swap code already supports for swapping out large folio without split, hence this patch set supports the large folio swap out for shmem.
Note the i915_gem_shmem driver still need to be split when swapping, thus add a new flag 'split_large_folio' for writeback_control to indicate spliting the large folio.
[1] https://lore.kernel.org/all/[email protected]/
[2] https://lore.kernel.org/all/[email protected]/
--- drivers/gpu/drm/i915/gem/i915_gem_shmem.c | 1 + include/linux/writeback.h | 1 + mm/shmem.c | 3 +-- mm/vmscan.c | 14 ++++++++++++-- 4 files changed, 15 insertions(+), 4 deletions(-)
drivers/gpu/drm/i915/gem/i915_gem_shmem.c +1 -0
@@ -308,6 +308,7 @@ void __shmem_writeback(size_t size, struct address_space *mapping) .range_start = 0, .range_end = LLONG_MAX, .for_reclaim = 1, + .split_large_folio = 1, };unsigned long i;
include/linux/writeback.h +1 -0
@@ -63,6 +63,7 @@ struct writeback_control { unsigned range_cyclic:1; /* range_start is cyclic */ unsigned for_sync:1; /* sync(2) WB_SYNC_ALL writeback */ unsigned unpinned_netfs_wb:1; /* Cleared I_PINNING_NETFS_WB */ + unsigned split_large_folio:1; /* Split large folio for shmem writeback *//* * When writeback IOs are bounced through async layers, only the
mm/shmem.c +1 -2
@@ -776,7 +776,6 @@ static int shmem_add_to_page_cache(struct folio *folio,VM_BUG_ON_FOLIO (index !=round_down (index, nr), folio);VM_BUG_ON_FOLIO (!folio_test_locked (folio), folio);VM_BUG_ON_FOLIO (!folio_test_swapbacked (folio), folio); -VM_BUG_ON (expected &&folio_test_large (folio));folio_ref_add (folio, nr); folio->mapping = mapping;
@@ -1460,7 +1459,7 @@ static int shmem_writepage(struct page *page, struct writeback_control *wbc)* "force", drivers/gpu/drm/i915/gem/i915_gem_shmem.c gets huge pages, * and its shmem_writeback() needs them to be split when swapping. */ -if (folio_test_large (folio)) { +if (wbc->split_large_folio &&folio_test_large (folio)) {/* Ensure the subpages are still dirty */ folio_test_set_dirty (folio);if (split_huge_page (page) <0 )
mm/vmscan.c +12 -2
@@ -1260,8 +1260,12 @@ static unsigned int shrink_folio_list(struct list_head *folio_list,if (!total_swap_pages) goto activate_locked; -/* Split shmem folio */ -if (split_folio_to_list (folio, folio_list)) +/* +* Only split shmem folio when CONFIG_THP_SWAP +* is not enabled. +*/ +if (!IS_ENABLED (CONFIG_THP_SWAP ) && +split_folio_to_list (folio, folio_list)) goto keep_locked; }
@@ -1363,10 +1367,16 @@ static unsigned int shrink_folio_list(struct list_head *folio_list,* starts and then write it out here. */ try_to_unmap_flush_dirty (); +try_pageout:switch (pageout (folio, mapping, &plug)) {case PAGE_KEEP : goto keep_locked;case PAGE_ACTIVATE : +if (shmem_mapping (mapping) &&folio_test_large (folio) && + !split_folio_to_list (folio, folio_list)) { + nr_pages =1 ; + goto try_pageout; + } goto activate_locked;case PAGE_SUCCESS : stat->nr_pageout += nr_pages;
Signature · 1 line
2.39.3
Re: [RFC PATCH 1/8] mm: fix shmem swapout statistic
In reply to Baolin WangQuoted 15 lines · Baolin Wang
As we know, shmem not only supports the sharing of anonymous pages, but also the RAM-based temporary filesystem. Therefore, shmem swapouts should not be marked as anonymous swapout statistics. Fix it by adding
folio_test_anon().Fixes d0f048ac39f6 ("mm: add per-order mTHP anon_swpout and anon_swpout_fallback counters")Signed-off-by Baolin Wang <[email protected]>--- mm/page_io.c | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)mm/page_io.c +0
-0
mm/page_io.c static inline void count_swpout_vm_event(struct folio *folio) · line 222
Quoted 7 lines
mm/page_io.c +3
-1@@ -217,7 +217,9 @@ static inline void count_swpout_vm_event(struct folio *folio)count_memcg_folio_events (folio,THP_SWPOUT ,1 );count_vm_event (THP_SWPOUT ); } -count_mthp_stat (folio_order (folio),MTHP_STAT_ANON_SWPOUT ); + +if (folio_test_anon (folio)) +count_mthp_stat (folio_order (folio),MTHP_STAT_ANON_SWPOUT );
Do we need to distinguish anonymous swapout and non-anonymous swapout? IMHO, we don't. Just like we have done for small folio and THP.
If so, how about fix this in another direction? That is, remove "ANON" from mTHP swapout statistics?
mm/page_io.c static inline void count_swpout_vm_event(struct folio *folio) · line 225
Quoted 3 lines
mm/page_io.c +0
-0#endif count_vm_events (PSWPOUT ,folio_nr_pages (folio)); }
--
Best Regards,
Huang, Ying
Baolin Wang
reviewerRe: [RFC PATCH 1/8] mm: fix shmem swapout statistic
Quoted 12 lines · Ying
Quoted 10 lines · Baolin Wang
As we know, shmem not only supports the sharing of anonymous pages, but also the RAM-based temporary filesystem. Therefore, shmem swapouts should not be marked as anonymous swapout statistics. Fix it by adding
folio_test_anon().Fixes d0f048ac39f6 ("mm: add per-order mTHP anon_swpout and anon_swpout_fallback counters")Signed-off-by Baolin Wang <[email protected]>--- mm/page_io.c | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-)
Quoted 15 lines
mm/page_io.c static inline void count_swpout_vm_event(struct folio *folio) · line 222
Quoted 12 lines
mm/page_io.c +3
-1@@ -217,7 +217,9 @@ static inline void count_swpout_vm_event(struct folio *folio)count_memcg_folio_events (folio,THP_SWPOUT ,1 );count_vm_event (THP_SWPOUT ); } -count_mthp_stat (folio_order (folio),MTHP_STAT_ANON_SWPOUT ); + +if (folio_test_anon (folio)) +count_mthp_stat (folio_order (folio),MTHP_STAT_ANON_SWPOUT );Do we need to distinguish anonymous swapout and non-anonymous swapout? IMHO, we don't. Just like we have done for small folio and THP.
Yes, old counters did not add 'anon_' prefix.
Quoted 2 lines
If so, how about fix this in another direction? That is, remove "ANON" from mTHP swapout statistics?
This sounds good to me. And I will separate out an individual patch with your suggestion. Thanks.