Clean up and fixes for swap
Subsystems (3)
cover Clean up and fixes for swap
From: Kairui Song <[email protected]>
This series cleanup some code path, saves a few cycles and reduce the object size by a bit, also fixes some rare race issue of statistics.
Kairui Song (5):
swapfile: get rid of volatile and avoid redundant read
swap: avoid a redundant pte map if ra window is 1
swap: fold swap_ra_clamp_pfn into swap_ra_info
swap: remove the swap lock in swap_cache_get_folio
swap: avoid ra statistic lost when swapin races
mm/shmem.c | 8 +++++- mm/swap_state.c | 66 +++++++++++++++++++------------------------------ mm/swapfile.c | 7 +++--- 3 files changed, 36 insertions(+), 45 deletions(-)
Signature · 1 line
2.35.2
PATCH 1/5 swapfile: get rid of volatile and avoid redundant read
From: Kairui Song <[email protected]>
Convert a volatile variable to more readable READ_ONCE. And this actually avoids the code from reading the variable twice redundantly when it races.
--- mm/swapfile.c | 7 ++++--- 1 file changed, 4 insertions(+), 3 deletions(-)
mm/swapfile.c +4 -3
@@ -1836,13 +1836,13 @@ static int unuse_pte_range(struct vm_area_struct *vma, pmd_t *pmd,pte_t *pte;struct swap_info_struct *si;int ret =0 ; -volatile unsigned char *swap_map; si = swap_info[type]; pte =pte_offset_map (pmd, addr); do { struct folio *folio; unsigned long offset; + unsigned char swp_count; if (!is_swap_pte(*pte)) continue;
@@ -1853,7 +1853,6 @@ static int unuse_pte_range(struct vm_area_struct *vma, pmd_t *pmd, offset =swp_offset (entry);pte_unmap (pte); - swap_map = &si->swap_map[offset]; folio =swap_cache_get_folio (entry, vma, addr);if (!folio) {struct page *page;
@@ -1870,8 +1869,10 @@ static int unuse_pte_range(struct vm_area_struct *vma, pmd_t *pmd, folio =page_folio (page); }if (!folio) { -if (*swap_map ==0 || *swap_map ==SWAP_MAP_BAD ) + swp_count =READ_ONCE (si->swap_map[offset]); +if (swp_count ==0 || swp_count ==SWAP_MAP_BAD ) goto try_next; +return -ENOMEM ; }
Signature · 1 line
2.35.2
Re: [PATCH 1/5] swapfile: get rid of volatile and avoid redundant read
Quoted 7 lines · Kairui Song
From: Kairui Song <[email protected]>
Convert a volatile variable to more readable
READ_ONCE. And this actually avoids the code from reading the variable twice redundantly when it races.Signed-off-by Kairui Song <[email protected]>
LGTM, Thanks!
Quoted 42 lines
--- mm/swapfile.c | 7 ++++--- 1 file changed, 4 insertions(+), 3 deletions(-)mm/swapfile.c +4
-3@@ -1836,13 +1836,13 @@ static int unuse_pte_range(struct vm_area_struct *vma, pmd_t *pmd,pte_t *pte;struct swap_info_struct *si;int ret =0 ; -volatile unsigned char *swap_map; si = swap_info[type]; pte =pte_offset_map (pmd, addr); do { struct folio *folio; unsigned long offset; + unsigned char swp_count; if (!is_swap_pte(*pte)) continue;@@ -1853,7 +1853,6 @@ static int unuse_pte_range(struct vm_area_struct *vma, pmd_t *pmd, offset =swp_offset (entry);pte_unmap (pte); - swap_map = &si->swap_map[offset]; folio =swap_cache_get_folio (entry, vma, addr);if (!folio) {struct page *page;@@ -1870,8 +1869,10 @@ static int unuse_pte_range(struct vm_area_struct *vma, pmd_t *pmd, folio =page_folio (page); }if (!folio) { -if (*swap_map ==0 || *swap_map ==SWAP_MAP_BAD ) + swp_count =READ_ONCE (si->swap_map[offset]); +if (swp_count ==0 || swp_count ==SWAP_MAP_BAD ) goto try_next; +return -ENOMEM ; }
PATCH 2/5 swap: avoid a redundant pte map if ra window is 1
In reply to Kairui SongFrom: Kairui Song <[email protected]>
Avoid a redundant pte map/unmap when swap readahead window is 1.
--- mm/swap_state.c | 7 ++----- 1 file changed, 2 insertions(+), 5 deletions(-)
mm/swap_state.c +2 -5
@@ -730,8 +730,6 @@ static void swap_ra_info(struct vm_fault *vmf, } faddr = vmf->address; - orig_pte = pte =pte_offset_map (vmf->pmd, faddr); - fpfn =PFN_DOWN (faddr); ra_val =GET_SWAP_RA_VAL (vma); pfn =PFN_DOWN (SWAP_RA_ADDR (ra_val));
@@ -742,12 +740,11 @@ static void swap_ra_info(struct vm_fault *vmf,atomic_long_set (&vma->swap_readahead_info,SWAP_RA_VAL (faddr, win,0 )); -if (win ==1 ) { -pte_unmap (orig_pte); +if (win ==1 )return ; - }/* Copy the PTEs because the page table may be unmapped */ + orig_pte = pte =pte_offset_map (vmf->pmd, faddr);if (fpfn == pfn +1 )swap_ra_clamp_pfn (vma, faddr, fpfn, fpfn + win, &start, &end);else if (pfn == fpfn +1 )
Signature · 1 line
2.35.2
Re: [PATCH 2/5] swap: avoid a redundant pte map if ra window is 1
Quoted 8 lines · Kairui Song
From: Kairui Song <[email protected]>
Avoid a redundant pte map/unmap when swap readahead window is 1.
Signed-off-by Kairui Song <[email protected]>--- mm/swap_state.c | 7 ++----- 1 file changed, 2 insertions(+), 5 deletions(-)
Good to reduce the line of code. Thanks!
Quoted 28 lines
mm/swap_state.c +2
-5@@ -730,8 +730,6 @@ static void swap_ra_info(struct vm_fault *vmf, } faddr = vmf->address; - orig_pte = pte =pte_offset_map (vmf->pmd, faddr); - fpfn =PFN_DOWN (faddr); ra_val =GET_SWAP_RA_VAL (vma); pfn =PFN_DOWN (SWAP_RA_ADDR (ra_val));@@ -742,12 +740,11 @@ static void swap_ra_info(struct vm_fault *vmf,atomic_long_set (&vma->swap_readahead_info,SWAP_RA_VAL (faddr, win,0 )); -if (win ==1 ) { -pte_unmap (orig_pte); +if (win ==1 )return ; - }/* Copy the PTEs because the page table may be unmapped */ + orig_pte = pte =pte_offset_map (vmf->pmd, faddr);if (fpfn == pfn +1 )swap_ra_clamp_pfn (vma, faddr, fpfn, fpfn + win, &start, &end);else if (pfn == fpfn +1 )
PATCH 3/5 swap: fold swap_ra_clamp_pfn into swap_ra_info
In reply to Kairui SongFrom: Kairui Song <[email protected]>
This make the code cleaner. This helper is made of only two line of self explanational code and not reused anywhere else.
And this actually make the compiled object smaller by a bit:
text data bss dec hex filename
Before: 9502 976 12 10490 28fa mm/swap_state.o After: 9470 976 12 10458 28da mm/swap_state.o
--- mm/swap_state.c | 44 +++++++++++++++++++------------------------- 1 file changed, 19 insertions(+), 25 deletions(-)
mm/swap_state.c +19 -25
@@ -696,28 +696,15 @@ void exit_swap_address_space(unsigned int type) swapper_spaces[type] =NULL ; } -static inline void swap_ra_clamp_pfn (struct vm_area_struct *vma, -unsigned long faddr, -unsigned long lpfn, -unsigned long rpfn, -unsigned long *start, -unsigned long *end) -{ - *start =max3 (lpfn,PFN_DOWN (vma->vm_start), -PFN_DOWN (faddr &PMD_MASK )); - *end =min3 (rpfn,PFN_DOWN (vma->vm_end), -PFN_DOWN ((faddr &PMD_MASK ) +PMD_SIZE )); -} -static void swap_ra_info (struct vm_fault *vmf, -struct vma_swap_readahead *ra_info) +struct vma_swap_readahead *ra_info) {struct vm_area_struct *vma = vmf->vma;unsigned long ra_val; -unsigned long faddr, pfn, fpfn; +unsigned long faddr, pfn, fpfn, lpfn, rpfn;unsigned long start, end;pte_t *pte, *orig_pte; -unsigned int max_win, hits, prev_win, win, left; +unsigned int max_win, hits, prev_win, win;#ifndef CONFIG_64BIT pte_t *tpte;#endif
@@ -745,16 +732,23 @@ static void swap_ra_info(struct vm_fault *vmf,/* Copy the PTEs because the page table may be unmapped */ orig_pte = pte =pte_offset_map (vmf->pmd, faddr); -if (fpfn == pfn +1 ) -swap_ra_clamp_pfn (vma, faddr, fpfn, fpfn + win, &start, &end); -else if (pfn == fpfn +1 ) -swap_ra_clamp_pfn (vma, faddr, fpfn - win +1 , fpfn +1 , - &start, &end); -else { - left = (win -1 ) /2 ; -swap_ra_clamp_pfn (vma, faddr, fpfn - left, fpfn + win - left, - &start, &end); +if (fpfn == pfn +1 ) { + lpfn = fpfn; + rpfn = fpfn + win; + }else if (pfn == fpfn +1 ) { + lpfn = fpfn - win +1 ; + rpfn = fpfn +1 ; + }else { +unsigned int left = (win -1 ) /2 ; + + lpfn = fpfn - left; + rpfn = fpfn + win - left; } + start =max3 (lpfn,PFN_DOWN (vma->vm_start), +PFN_DOWN (faddr &PMD_MASK )); + end =min3 (rpfn,PFN_DOWN (vma->vm_end), +PFN_DOWN ((faddr &PMD_MASK ) +PMD_SIZE )); + ra_info->nr_pte = end - start; ra_info->offset = fpfn - start; pte -= ra_info->offset;
Signature · 1 line
2.35.2
Re: [PATCH 3/5] swap: fold swap_ra_clamp_pfn into swap_ra_info
Quoted 10 lines · Kairui Song
From: Kairui Song <[email protected]>
This make the code cleaner. This helper is made of only two line of self explanational code and not reused anywhere else.
And this actually make the compiled object smaller by a bit:
text data bss dec hex filename
Before: 9502 976 12 10490 28fa mm/swap_state.o After: 9470 976 12 10458 28da mm/swap_state.o
FYI, you can use scripts/bloat-o-meter to get a slightly more useful analysis of object code changes.
Re: [PATCH 3/5] swap: fold swap_ra_clamp_pfn into swap_ra_info
Quoted 7 lines · Matthew Wilcox <[email protected]> 于2022年12月9日周五 03:09写道:
Quoted 5 lines · Kairui Song
From: Kairui Song <[email protected]>
This make the code cleaner. This helper is made of only two line of self explanational code and not reused anywhere else.
Quoted 9 lines
Quoted 5 lines
And this actually make the compiled object smaller by a bit:
text data bss dec hex filename
Before: 9502 976 12 10490 28fa mm/swap_state.o After: 9470 976 12 10458 28da mm/swap_state.oFYI, you can use
scripts/bloat-o-meterto get a slightly more useful analysis of object code changes.
Thanks! That's very helpful info, I got following output from bloat-o-meter:
./scripts/bloat-o-meter mm/swap_state.o.old mm/swap_state.o add/remove: 0/0 grow/shrink: 0/1 up/down: 0/-35 (-35)
Function old new delta swap_ra_info.constprop 512 477 -35
Total: Before=8388, After=8353, chg -0.42%
I'll attach this info in commit message from now on.
Re: [PATCH 3/5] swap: fold swap_ra_clamp_pfn into swap_ra_info
In reply to Kairui SongQuoted 7 lines · Kairui Song
From: Kairui Song <[email protected]>
This make the code cleaner. This helper is made of only two line of self explanational code and not reused anywhere else.
And this actually make the compiled object smaller by a bit:
Quoted 8 lines
text data bss dec hex filename
Before: 9502 976 12 10490 28fa mm/swap_state.o After: 9470 976 12 10458 28da mm/swap_state.oSigned-off-by Kairui Song <[email protected]>--- mm/swap_state.c | 44 +++++++++++++++++++------------------------- 1 file changed, 19 insertions(+), 25 deletions(-)
LGTM, Thanks!
Quoted 69 lines
mm/swap_state.c +19
-25@@ -696,28 +696,15 @@ void exit_swap_address_space(unsigned int type) swapper_spaces[type] =NULL ; } -static inline void swap_ra_clamp_pfn (struct vm_area_struct *vma, -unsigned long faddr, -unsigned long lpfn, -unsigned long rpfn, -unsigned long *start, -unsigned long *end) -{ - *start =max3 (lpfn,PFN_DOWN (vma->vm_start), -PFN_DOWN (faddr &PMD_MASK )); - *end =min3 (rpfn,PFN_DOWN (vma->vm_end), -PFN_DOWN ((faddr &PMD_MASK ) +PMD_SIZE )); -} -static void swap_ra_info (struct vm_fault *vmf, -struct vma_swap_readahead *ra_info) +struct vma_swap_readahead *ra_info) {struct vm_area_struct *vma = vmf->vma;unsigned long ra_val; -unsigned long faddr, pfn, fpfn; +unsigned long faddr, pfn, fpfn, lpfn, rpfn;unsigned long start, end;pte_t *pte, *orig_pte; -unsigned int max_win, hits, prev_win, win, left; +unsigned int max_win, hits, prev_win, win;#ifndef CONFIG_64BIT pte_t *tpte;#endif @@ -745,16 +732,23 @@ static void swap_ra_info(struct vm_fault *vmf,/* Copy the PTEs because the page table may be unmapped */ orig_pte = pte =pte_offset_map (vmf->pmd, faddr); -if (fpfn == pfn +1 ) -swap_ra_clamp_pfn (vma, faddr, fpfn, fpfn + win, &start, &end); -else if (pfn == fpfn +1 ) -swap_ra_clamp_pfn (vma, faddr, fpfn - win +1 , fpfn +1 , - &start, &end); -else { - left = (win -1 ) /2 ; -swap_ra_clamp_pfn (vma, faddr, fpfn - left, fpfn + win - left, - &start, &end); +if (fpfn == pfn +1 ) { + lpfn = fpfn; + rpfn = fpfn + win; + }else if (pfn == fpfn +1 ) { + lpfn = fpfn - win +1 ; + rpfn = fpfn +1 ; + }else { +unsigned int left = (win -1 ) /2 ; + + lpfn = fpfn - left; + rpfn = fpfn + win - left; } + start =max3 (lpfn,PFN_DOWN (vma->vm_start), +PFN_DOWN (faddr &PMD_MASK )); + end =min3 (rpfn,PFN_DOWN (vma->vm_end), +PFN_DOWN ((faddr &PMD_MASK ) +PMD_SIZE )); + ra_info->nr_pte = end - start; ra_info->offset = fpfn - start; pte -= ra_info->offset;
PATCH 4/5 swap: remove the swap lock in swap_cache_get_folio
In reply to Kairui SongFrom: Kairui Song <[email protected]>
There is only one caller not keep holding a reference or lock the swap device while calling this function. Just move the lock out of this function, it only used to prevent swapoff, and this helper function is very short so there is no performance regression issue. Help saves a few cycles.
--- mm/shmem.c | 8 +++++++- mm/swap_state.c | 8 ++------ 2 files changed, 9 insertions(+), 7 deletions(-)
mm/shmem.c +7 -1
@@ -1725,6 +1725,7 @@ static int shmem_swapin_folio(struct inode *inode, pgoff_t index,struct address_space *mapping = inode->i_mapping;struct shmem_inode_info *info =SHMEM_I (inode);struct mm_struct *charge_mm = vma ? vma->vm_mm :NULL ; +struct swap_info_struct *si;struct folio *folio =NULL ;swp_entry_t swap;int error;
@@ -1737,7 +1738,12 @@ static int shmem_swapin_folio(struct inode *inode, pgoff_t index,return -EIO ;/* Look it up and read it in.. */ - folio =swap_cache_get_folio (swap,NULL ,0 ); + si =get_swap_device (swap); +if (si) { + folio =swap_cache_get_folio (swap,NULL ,0 ); +put_swap_device (si); + } +if (!folio) {/* Or update major stats only when swapin succeeds?? */ if (fault_type) {
mm/swap_state.c +2 -6
@@ -324,19 +324,15 @@ static inline bool swap_use_vma_readahead(void)* unlocked and with its refcount incremented - we rely on the kernel * lock getting page table operations atomic even if we drop the folio * lock before returning. +* +* Caller must lock the swap device or hold a reference to keep it valid. */ struct folio *swap_cache_get_folio (swp_entry_t entry,struct vm_area_struct *vma,unsigned long addr) {struct folio *folio; -struct swap_info_struct *si; - si =get_swap_device (entry); -if (!si) -return NULL ; folio =filemap_get_folio (swap_address_space (entry),swp_offset (entry)); -put_swap_device (si); -if (folio) {bool vma_ra =swap_use_vma_readahead ();bool readahead;
Signature · 1 line
2.35.2
Re: [PATCH 4/5] swap: remove the swap lock in swap_cache_get_folio
Quoted 9 lines · Kairui Song
From: Kairui Song <[email protected]>
There is only one caller not keep holding a reference or lock the swap device while calling this function. Just move the lock out of this function, it only used to prevent swapoff, and this helper function is very short so there is no performance regression issue. Help saves a few cycles.
Subject: Re: [PATCH 4/5] swap: remove the swap lock in
swap_cache_get_folio
I don't think you remove swap lock in swap_cache_get_folio(). Just avoid to inc/dec the reference count.
And I think it's better to add '()' after swap_cache_get_folio to make it clear it's a function.
Quoted 19 lines
Signed-off-by Kairui Song <[email protected]>--- mm/shmem.c | 8 +++++++- mm/swap_state.c | 8 ++------ 2 files changed, 9 insertions(+), 7 deletions(-)mm/shmem.c +1
-0@@ -1725,6 +1725,7 @@ static int shmem_swapin_folio(struct inode *inode, pgoff_t index,struct address_space *mapping = inode->i_mapping;struct shmem_inode_info *info =SHMEM_I (inode);struct mm_struct *charge_mm = vma ? vma->vm_mm :NULL ; +struct swap_info_struct *si;struct folio *folio =NULL ;swp_entry_t swap;int error;
mm/shmem.c static int shmem_swapin_folio(struct inode *inode, pgoff_t index, · line 1744
Quoted 8 lines
mm/shmem.c +4
-1@@ -1737,7 +1738,12 @@ static int shmem_swapin_folio(struct inode *inode, pgoff_t index,return -EIO ;/* Look it up and read it in.. */ - folio =swap_cache_get_folio (swap,NULL ,0 ); + si =get_swap_device (swap); +if (si) { + folio =swap_cache_get_folio (swap,NULL ,0 ); +put_swap_device (si);
I'd rather to call put_swap_device() at the end of function. That is, whenever we get a swap entry without proper lock/reference to prevent swapoff, we should call get_swap_device() to check its validity and prevent the swap device from swapoff.
Best Regards,
Huang, Ying
Quoted 31 lines
mm/shmem.c +2
-0+ } +if (!folio) {/* Or update major stats only when swapin succeeds?? */ if (fault_type) {mm/swap_state.c +2
-6@@ -324,19 +324,15 @@ static inline bool swap_use_vma_readahead(void)* unlocked and with its refcount incremented - we rely on the kernel * lock getting page table operations atomic even if we drop the folio * lock before returning. +* +* Caller must lock the swap device or hold a reference to keep it valid. */ struct folio *swap_cache_get_folio (swp_entry_t entry,struct vm_area_struct *vma,unsigned long addr) {struct folio *folio; -struct swap_info_struct *si; - si =get_swap_device (entry); -if (!si) -return NULL ; folio =filemap_get_folio (swap_address_space (entry),swp_offset (entry)); -put_swap_device (si); -if (folio) {bool vma_ra =swap_use_vma_readahead ();bool readahead;
Re: [PATCH 4/5] swap: remove the swap lock in swap_cache_get_folio
Quoted 11 lines · Huang, Ying <[email protected]> 于2022年12月11日周日 19:40写道:
Quoted 7 lines · Kairui Song
From: Kairui Song <[email protected]>
There is only one caller not keep holding a reference or lock the swap device while calling this function. Just move the lock out of this function, it only used to prevent swapoff, and this helper function is very short so there is no performance regression issue. Help saves a few cycles.
Quoted 4 lines
Quoted 1 line
Subject: Re: [PATCH 4/5] swap: remove the swap lock in
swap_cache_get_folioI don't think you remove
swap lockinswap_cache_get_folio(). Just avoid to inc/dec the reference count.
Yes, that's more accurate, it's kind of like 'locked the swap device from being swapped off', so I used some inaccurate word. I'll correct this in V2.
Quoted 3 lines
And I think it's better to add '()' after
swap_cache_get_folioto make it clear it's a function.
Good suggestion.
Quoted 22 lines
Quoted 22 lines
Signed-off-by Kairui Song <[email protected]>--- mm/shmem.c | 8 +++++++- mm/swap_state.c | 8 ++------ 2 files changed, 9 insertions(+), 7 deletions(-)mm/shmem.c +1
-0@@ -1725,6 +1725,7 @@ static int shmem_swapin_folio(struct inode *inode, pgoff_t index,struct address_space *mapping = inode->i_mapping;struct shmem_inode_info *info =SHMEM_I (inode);struct mm_struct *charge_mm = vma ? vma->vm_mm :NULL ; +struct swap_info_struct *si;struct folio *folio =NULL ;swp_entry_t swap;int error;@@ -1737,7 +1738,12 @@ static int shmem_swapin_folio(struct inode *inode, pgoff_t index,return -EIO ;
Quoted 11 lines
mm/shmem.c static int shmem_swapin_folio(struct inode *inode, pgoff_t index, · line 1744
Quoted 6 lines
mm/shmem.c +4
-1/* Look it up and read it in.. */ - folio =swap_cache_get_folio (swap,NULL ,0 ); + si =get_swap_device (swap); +if (si) { + folio =swap_cache_get_folio (swap,NULL ,0 ); +put_swap_device (si);I'd rather to call
put_swap_device()at the end of function. That is, whenever we get a swap entry without proper lock/reference to prevent swapoff, we should callget_swap_device()to check its validity and prevent the swap device from swapoff.
Yes, that's the right way to do it, my code is buggy here, sorry for being so careless, I'll fix it.
Quoted 35 lines
Best Regards,
Huang, YingQuoted 31 lines
mm/shmem.c +2
-0+ } +if (!folio) {/* Or update major stats only when swapin succeeds?? */ if (fault_type) {mm/swap_state.c +2
-6@@ -324,19 +324,15 @@ static inline bool swap_use_vma_readahead(void)* unlocked and with its refcount incremented - we rely on the kernel * lock getting page table operations atomic even if we drop the folio * lock before returning. +* +* Caller must lock the swap device or hold a reference to keep it valid. */ struct folio *swap_cache_get_folio (swp_entry_t entry,struct vm_area_struct *vma,unsigned long addr) {struct folio *folio; -struct swap_info_struct *si; - si =get_swap_device (entry); -if (!si) -return NULL ; folio =filemap_get_folio (swap_address_space (entry),swp_offset (entry)); -put_swap_device (si); -if (folio) {bool vma_ra =swap_use_vma_readahead ();bool readahead;
PATCH 5/5 swap: avoid ra statistic lost when swapin races
In reply to Kairui SongFrom: Kairui Song <[email protected]>
__read_swap_cache_async should just call swap_cache_get_folio for trying to look up the swap cache. Because swap_cache_get_folio handles the readahead statistic, and clears the RA flag, looking up the cache directly will skip these parts.
And the comment no longer applies after commit 442701e7058b ("mm/swap: remove swap_cache_info statistics"), just remove them.
--- mm/swap_state.c | 7 ++----- 1 file changed, 2 insertions(+), 5 deletions(-)
mm/swap_state.c +2 -5
@@ -418,15 +418,12 @@ struct page *__read_swap_cache_async(swp_entry_t entry, gfp_t gfp_mask,for (;;) {int err;/* -* First check the swap cache. Since this is normally -* called after swap_cache_get_folio() failed, re-calling -* that would confuse statistics. +* First check the swap cache in case of race. */ si =get_swap_device (entry);if (!si)return NULL ; - folio =filemap_get_folio (swap_address_space (entry), -swp_offset (entry)); + folio =swap_cache_get_folio (entry, vma, addr);put_swap_device (si);if (folio)return folio_file_page (folio,swp_offset (entry));
Signature · 1 line
2.35.2
Re: [PATCH 5/5] swap: avoid ra statistic lost when swapin races
Quoted 9 lines · Kairui Song
From: Kairui Song <[email protected]>
__read_swap_cache_asyncshould just callswap_cache_get_foliofor trying to look up the swap cache. Becauseswap_cache_get_foliohandles the readahead statistic, and clears the RA flag, looking up the cache directly will skip these parts.And the comment no longer applies after commit
442701e7058b("mm/swap: removeswap_cache_infostatistics"), just remove them.
But what about the readahead stats?
Quoted 32 lines
Fixes 442701e7058b ("mm/swap: remove swap_cache_info statistics")Signed-off-by Kairui Song <[email protected]>--- mm/swap_state.c | 7 ++----- 1 file changed, 2 insertions(+), 5 deletions(-)mm/swap_state.c +2
-5@@ -418,15 +418,12 @@ struct page *__read_swap_cache_async(swp_entry_t entry, gfp_t gfp_mask,for (;;) {int err;/* -* First check the swap cache. Since this is normally -* called after swap_cache_get_folio() failed, re-calling -* that would confuse statistics. +* First check the swap cache in case of race. */ si =get_swap_device (entry);if (!si)return NULL ; - folio =filemap_get_folio (swap_address_space (entry), -swp_offset (entry)); + folio =swap_cache_get_folio (entry, vma, addr);put_swap_device (si);if (folio)return folio_file_page (folio,swp_offset (entry));Signature · 1 line
2.35.2
Re: [PATCH 5/5] swap: avoid ra statistic lost when swapin races
Quoted 1 line · Matthew Wilcox <[email protected]> 于2022年12月9日周五 03:14写道:
Hi, thanks for the review.
Quoted 8 lines · Kairui Song
Quoted 7 lines
From: Kairui Song <[email protected]>
__read_swap_cache_asyncshould just callswap_cache_get_foliofor trying to look up the swap cache. Becauseswap_cache_get_foliohandles the readahead statistic, and clears the RA flag, looking up the cache directly will skip these parts.
Quoted 5 lines
Quoted 2 lines
And the comment no longer applies after commit
442701e7058b("mm/swap: removeswap_cache_infostatistics"), just remove them.But what about the readahead stats?
Shouldn't readahead stats be accounted here? __read_swap_cache_async is called by swap read in path, if it hits the swap cache, and the page have readahead page flag set, then accounting that readahead should be just the right thing todo. And the readahead flag is checked with folio_test_clear_readahead, so there should be no issue about repeated accounting.
Only the addr info of the swap_readahead_info could be updated for multiple times by racing readers, but I think that seems fine, since we don't know which swap read comes later in case of race, just let the last reader that hits the swap cache update the address info of readahead makes sense to me.
Or do you mean I should update the comment about the readahead stat instead of just drop the commnet?
Re: [PATCH 5/5] swap: avoid ra statistic lost when swapin races
Quoted 26 lines · Kairui Song
Quoted 1 line · Matthew Wilcox <[email protected]> 于2022年12月9日周五 03:14写道:
Hi, thanks for the review.
Quoted 8 lines · Kairui Song
Quoted 7 lines
From: Kairui Song <[email protected]>
__read_swap_cache_asyncshould just callswap_cache_get_foliofor trying to look up the swap cache. Becauseswap_cache_get_foliohandles the readahead statistic, and clears the RA flag, looking up the cache directly will skip these parts.Quoted 5 lines
Quoted 2 lines
And the comment no longer applies after commit
442701e7058b("mm/swap: removeswap_cache_infostatistics"), just remove them.But what about the readahead stats?
Shouldn't readahead stats be accounted here?
__read_swap_cache_asyncis called by swap read in path, if it hits the swap cache, and the page have readahead page flag set, then accounting that readahead should be just the right thing todo. And the readahead flag is checked withfolio_test_clear_readahead, so there should be no issue about repeated accounting.
Quoted 8 lines
Only the addr info of the
swap_readahead_infocould be updated for multiple times by racing readers, but I think that seems fine, since we don't know which swap read comes later in case of race, just let the last reader that hits the swap cache update the address info of readahead makes sense to me.Or do you mean I should update the comment about the readahead stat instead of just drop the commnet?
__read_swap_cache_async() is called by readahead too (swap_vma_readahead/__read_swap_cache_async). I don't think that it's a good idea to do swap readahead operation in this function.
Best Regards,
Huang, Ying
Re: [PATCH 5/5] swap: avoid ra statistic lost when swapin races
Quoted 35 lines · Huang, Ying <[email protected]> 于2022年12月11日周日 20:03写道:
Quoted 32 lines · Kairui Song
Quoted 1 line · Matthew Wilcox <[email protected]> 于2022年12月9日周五 03:14写道:
Hi, thanks for the review.
Quoted 8 lines · Kairui Song
Quoted 7 lines
From: Kairui Song <[email protected]>
__read_swap_cache_asyncshould just callswap_cache_get_foliofor trying to look up the swap cache. Becauseswap_cache_get_foliohandles the readahead statistic, and clears the RA flag, looking up the cache directly will skip these parts.Quoted 5 lines
Quoted 2 lines
And the comment no longer applies after commit
442701e7058b("mm/swap: removeswap_cache_infostatistics"), just remove them.But what about the readahead stats?
Shouldn't readahead stats be accounted here?
__read_swap_cache_asyncis called by swap read in path, if it hits the swap cache, and the page have readahead page flag set, then accounting that readahead should be just the right thing todo. And the readahead flag is checked withfolio_test_clear_readahead, so there should be no issue about repeated accounting.Only the addr info of the
swap_readahead_infocould be updated for multiple times by racing readers, but I think that seems fine, since we don't know which swap read comes later in case of race, just let the last reader that hits the swap cache update the address info of readahead makes sense to me.
Quoted 6 lines
Quoted 2 lines
Or do you mean I should update the comment about the readahead stat instead of just drop the commnet?
__read_swap_cache_async()is called by readahead too (swap_vma_readahead/__read_swap_cache_async). I don't think that it's a good idea to do swap readahead operation in this function.
Ah, I got it.
Thanks for pointing out the issue, I'll drop this patch.
Quoted 3 lines
Best Regards,
Huang, Ying