mem: child memory alloc should larger than memory.max+memory.swap.max if lite==1
PATCH 1/2 mem: child memory alloc should larger than memory.max+memory.swap.max if lite==1
oom03 often gets fail while setting 'memory.swap.max = TESTMEM' in CGroup, because in that scenario (lite == 1), child_alloc only start a single process to dirty 'TESTMEM + 1MB' anonymous memory for testing:
testoom(, lite == 1, ,)
? oom(, lite == 1, ,)
? ? child_alloc(, lite == 1,)
? ? ? ? alloc_mem(TESTMEM + MB, )
mem.c:224: TINFO: start normal OOM testing.
mem.c:146: TINFO: expected victim is 80466.
mem.c:38: TINFO: thread (7f411c69d740), allocating 1074790400 bytes.
mem.c:64: TINFO: swapped is 25546752 bytes. <-------- swap occuring -----
mem.c:164: TFAIL: victim unexpectedly ended with retcode: 0, expected: 12
TBH, it can NOT really test the memory.swap.max as expected, since in kernel side mem_cgroup_out_of_memory split OOM margin into two part, one for memory.max limit, another for memory.swap.max, if any of them get overflow, then involk out_of_memory to kill victim-process.
Theoretically, alloc_mem(TESTMEM + MB, ) should work while 'memory.max' is equal to TESTMEM, but with swappiness enable (default value is 60 on RHEL), it likely has part of memory swapping out during the allocating, so the two limit loss effect@the same time. (unless disable swappiness completely then memory.max will take effect in precisely)
To stay on the safe side, here raising the single process to alloc a bit more memory which is larger than 'memory.max + memory.swap.max' (TESTMEM * 2 + 1MB), that will obviously work fine in real situations.
---
Notes:
This is debugging code for showing swapped:
--- a/testcases/kernel/mem/lib/mem.c
+++ b/testcases/kernel/mem/lib/mem.c
@@ -59,6 +59,10 @@ static int alloc_mem(long int length, int testcase)
for (i = 0; i < length; i += pagesz)
s[i] = '\a';
+ long swapped = SAFE_READ_PROC_STATUS(getpid(), "VmSwap:");
+ tst_res(TINFO, "swapped is %ld bytes.", swapped * 1024);
+
return 0;
}testcases/kernel/mem/lib/mem.c | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
testcases/kernel/mem/lib/mem.c +1 -1
@@ -78,7 +78,7 @@ static void child_alloc(int testcase, int lite, int threads)pthread_t *th;if (lite) { -int ret =alloc_mem (TESTMEM +MB , testcase); +int ret =alloc_mem (TESTMEM +TESTMEM +MB , testcase);exit (ret); }
Signature · 1 line
2.31.1
PATCH 2/2 oom: enable lite == 1 for memory.swap.max testing
oom03: adding print info and restore memory.swap.max after testing
oom05: enable lite == 1 for memory.swap.max testing
--- testcases/kernel/mem/oom/oom03.c | 7 +++++++ testcases/kernel/mem/oom/oom05.c | 2 +- 2 files changed, 8 insertions(+), 1 deletion(-)
testcases/kernel/mem/oom/oom03.c +7 -0
@@ -46,8 +46,15 @@ static void verify_oom(void)testoom (0 ,0 ,ENOMEM ,1 );if (SAFE_CGROUP_HAS (cg,"memory.swap.max" )) { +tst_res (TINFO ,"OOM on MEMCG with special memswap limitation:" );SAFE_CGROUP_PRINTF (cg,"memory.swap.max" ,"%lu" ,TESTMEM ); +testoom (0 ,1 ,ENOMEM ,1 ); + +if (TST_CGROUP_VER (cg,"memory" ) ==TST_CGROUP_V1 ) +SAFE_CGROUP_PRINTF (cg,"memory.swap.max" ,"%lu" , ~0UL ); +else +SAFE_CGROUP_PRINT (cg,"memory.swap.max" ,"max" ); }/* OOM for MEMCG with mempolicy */
testcases/kernel/mem/oom/oom05.c +1 -1
@@ -64,7 +64,7 @@ static void verify_oom(void)tst_res (TINFO ,"OOM on CPUSET & MEMCG with " "special memswap limitation:" );SAFE_CGROUP_PRINTF (cg,"memory.swap.max" ,"%lu" ,TESTMEM ); -testoom (0 ,0 ,ENOMEM ,1 ); +testoom (0 ,1 ,ENOMEM ,1 );tst_res (TINFO ,"OOM on CPUSET & MEMCG with " "disabled memswap limitation:" );
Signature · 1 line
2.31.1
PATCH 1/2 mem: child memory alloc should larger than memory.max+memory.swap.max if lite==1
In reply to Li WangForget to mention, this is debugging/analysis under Cgroup V2. Since Cgroup V1 has a unified memory+swap counter that tracks a data page regardless whether it's in-core or swapped out. But Cgroup V2 tracks memory and swap in separate, so it splits memory and swap counter.
That's the main reason why oom03 got PASS in Cgroup v1 but FAIL in V2.
So, int ret = alloc_mem(TESTMEM + TESTMEM + MB, testcase); is tend to make Cgroup V2 happy, but also works for v1, because it allocates more memory larger than previous.
Or, we could test separately for V1 and V2, and that should not be very hard.
Signature · 5 lines
Regards, Li Wang -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.linux.it/pipermail/ltp/attachments/20210621/c254d8ef/attachment.htm>