ksm: count all zero pages placed by KSM
PATCH v5 3/6 ksm: count all zero pages placed by KSM
From: xu xin <[email protected]>
As pages_sharing and pages_shared don't include the number of zero pages merged by KSM, we cannot know how many pages are zero pages placed by KSM when enabling use_zero_pages, which leads to KSM not being transparent with all actual merged pages by KSM. In the early days of use_zero_pages, zero-pages was unable to get unshared by the ways like MADV_UNMERGEABLE so it's hard to count how many times one of those zeropages was then unmerged.
But now, unsharing KSM-placed zero page accurately has been achieved, so we can easily count both how many times a page full of zeroes was merged with zero-page and how many times one of those pages was then unmerged. and so, it helps to estimate memory demands when each and every shared page could get unshared.
So we add zero_pages_sharing under /sys/kernel/mm/ksm/ to show the number of all zero pages placed by KSM.
v4->v5:
fix warning mm/ksm.c:3238:9: warning: no previous prototype for 'zero_pages_sharing_show' [-Wmissing-prototypes].
--- mm/ksm.c | 19 +++++++++++++++++-- 1 file changed, 17 insertions(+), 2 deletions(-)
mm/ksm.c +17 -2
@@ -276,6 +276,9 @@ static unsigned int zero_checksum __read_mostly;/* Whether to merge empty (zeroed) pages with actual zero pages */ static bool ksm_use_zero_pages__read_mostly ; +/* The number of zero pages placed by KSM use_zero_pages */ +static unsigned long ksm_zero_pages_sharing; +#ifdef CONFIG_NUMA /* Zeroed when merging across nodes is not allowed */ static unsigned int ksm_merge_across_nodes =1 ;
@@ -789,8 +792,10 @@ static struct page *get_ksm_page(struct ksm_stable_node *stable_node,*/ static inline void clean_rmap_item_zero_flag (struct ksm_rmap_item *rmap_item) { -if (rmap_item->address &ZERO_PAGE_FLAG ) +if (rmap_item->address &ZERO_PAGE_FLAG ) { + ksm_zero_pages_sharing--; rmap_item->address &=PAGE_MASK ; + } }/* Only called when rmap_item is going to be freed */
@@ -2109,8 +2114,10 @@ static int try_to_merge_with_kernel_zero_page(struct ksm_rmap_item *rmap_item,if (vma) { err =try_to_merge_one_page (vma, page,ZERO_PAGE (rmap_item->address)); -if (!err) +if (!err) { rmap_item->address |=ZERO_PAGE_FLAG ; + ksm_zero_pages_sharing++; + } }else {/* If the vma is out of date, we do not need to continue. */ err =0 ;
@@ -3228,6 +3235,13 @@ static ssize_t pages_volatile_show(struct kobject *kobj, }KSM_ATTR_RO (pages_volatile); +static ssize_t zero_pages_sharing_show (struct kobject *kobj, +struct kobj_attribute *attr,char *buf) +{ +return sysfs_emit (buf,"%ld\n" , ksm_zero_pages_sharing); +} +KSM_ATTR_RO (zero_pages_sharing); +static ssize_t stable_node_dups_show (struct kobject *kobj,struct kobj_attribute *attr,char *buf) {
@@ -3283,6 +3297,7 @@ static struct attribute *ksm_attrs[] = { &pages_sharing_attr.attr, &pages_unshared_attr.attr, &pages_volatile_attr.attr, + &zero_pages_sharing_attr.attr, &full_scans_attr.attr, #ifdef CONFIG_NUMA &merge_across_nodes_attr.attr,
Signature · 1 line
2.15.2
Quoted 37 lines · On 30.12.22 02:15, [email protected] wrote:
From: xu xin <[email protected]>
As
pages_sharingandpages_shareddon't include the number of zero pages merged by KSM, we cannot know how many pages are zero pages placed by KSM when enablinguse_zero_pages, which leads to KSM not being transparent with all actual merged pages by KSM. In the early days ofuse_zero_pages, zero-pages was unable to get unshared by the ways likeMADV_UNMERGEABLEso it's hard to count how many times one of those zeropages was then unmerged.But now, unsharing KSM-placed zero page accurately has been achieved, so we can easily count both how many times a page full of zeroes was merged with zero-page and how many times one of those pages was then unmerged. and so, it helps to estimate memory demands when each and every shared page could get unshared.
So we add
zero_pages_sharingunder/sys/kernel/mm/ksm/to show the number of all zero pages placed by KSM.Signed-off-by xu xin <[email protected]>Cc Claudio Imbrenda <[email protected]>Cc David Hildenbrand <[email protected]>Cc Xuexin Jiang <[email protected]>Reviewed-by Xiaokai Ran <[email protected]>Reviewed-by Yang Yang <[email protected]>
v4->v5:
fix warningmm/ksm.c:3238:9: warning: no previous prototype for 'zero_pages_sharing_show' [-Wmissing-prototypes].--- mm/ksm.c | 19 +++++++++++++++++-- 1 file changed, 17 insertions(+), 2 deletions(-)mm/ksm.c +0
-0
mm/ksm.c static unsigned int zero_checksum __read_mostly; · line 280
Quoted 5 lines
mm/ksm.c +2
-0@@ -276,6 +276,9 @@ static unsigned int zero_checksum __read_mostly;/* Whether to merge empty (zeroed) pages with actual zero pages */ static bool ksm_use_zero_pages__read_mostly ; +/* The number of zero pages placed by KSM use_zero_pages */ +static unsigned long ksm_zero_pages_sharing;
Does this count how many zero pages are currently placed or how many rmap items with ZERO_PAGE_FLAG are in the system?
IOW, if someone triggers MADV_DONTNEED on such a zeropage, the counter will not get updated, correct?
Signature · 3 lines
Thanks, David / dhildenb
Quoted 8 lines
Quoted 8 lines
mm/ksm.c +0
-0@@ -276,6 +276,9 @@ static unsigned int zero_checksum __read_mostly;/* Whether to merge empty (zeroed) pages with actual zero pages */ static bool ksm_use_zero_pages__read_mostly ;
Quoted 5 lines
mm/ksm.c static unsigned int zero_checksum __read_mostly; · line 280
Quoted 2 lines
mm/ksm.c +2
-0+/* The number of zero pages placed by KSM use_zero_pages */ +static unsigned long ksm_zero_pages_sharing;Does this count how many zero pages are currently placed or how many rmap items with
ZERO_PAGE_FLAGare in the system?
Yes, it counts how many ksm zero pages are currently placed. and we use rmap items with ZERO_PAGE_FLAG to record these zero page, similar to ksm_pages_sharing and ksm_pages_shared which are recorded by the rmap_items with STABLE_FLAG.
Quoted 3 lines
IOW, if someone triggers
MADV_DONTNEEDon such a zeropage, the counter will not get updated, correct?
Well, the counter can get updated as someone triggers MADV_DONTNEED on such a zeropage. You might write a simple code to test it.
Quoted 20 lines · On 09.02.23 13:01, [email protected] wrote:
Quoted 8 lines
Quoted 8 lines
mm/ksm.c +0
-0@@ -276,6 +276,9 @@ static unsigned int zero_checksum __read_mostly;/* Whether to merge empty (zeroed) pages with actual zero pages */ static bool ksm_use_zero_pages__read_mostly ;Quoted 5 lines
mm/ksm.c static unsigned int zero_checksum __read_mostly; · line 280
Quoted 2 lines
mm/ksm.c +2
-0+/* The number of zero pages placed by KSM use_zero_pages */ +static unsigned long ksm_zero_pages_sharing;Does this count how many zero pages are currently placed or how many rmap items with
ZERO_PAGE_FLAGare in the system?Yes, it counts how many ksm zero pages are currently placed. and we use rmap items with
ZERO_PAGE_FLAGto record these zero page, similar toksm_pages_sharingandksm_pages_sharedwhich are recorded by thermap_itemswithSTABLE_FLAG.Quoted 1 line
Quoted 5 lines
Quoted 2 lines
IOW, if someone triggers
MADV_DONTNEEDon such a zeropage, the counter will not get updated, correct?Well, the counter can get updated as someone triggers
MADV_DONTNEEDon such a zeropage. You might write a simple code to test it.
Interesting, I'll have a look how that will be triggered.
Signature · 3 lines
Thanks, David / dhildenb