Skip to contentSkip to conversation

New: "bad pmd" on fork() of process with hugepage shared memory segments attached

Bugme-new Andrew Morton 3 participants 8 messages May 13, 2009 – May 14, 2009 1 message not in the archive Memory management

lore
Share & tools
lore

A message that is not in the archive (sent off-list or not yet received): [email protected]/

Andrew Morton

author maintainer
#1 lore raw

(switched to email. Please respond via emailed reply-to-all, not via the bugzilla web interface).

(Please read this ^^^^ !)

Quoted 23 lines · On Wed, 13 May 2009 19:54:10 GMT [email protected] wrote:

http://bugzilla.kernel.org/show_bug.cgi?id=13302

Summary: "bad pmd" on fork() of process with hugepage shared
memory segments attached
Product: Memory Management
Version: 2.5
Kernel Version: 2.6.29.1
Platform: All
OS/Version: Linux
Tree: Mainline
Status: NEW
Severity: normal
Priority: P1
Component: Other
AssignedTo: [email protected]
ReportedBy: [email protected]
Regression: Yes

Kernel reports "bad pmd" errors when process with hugepage shared memory segments attached executes fork() system call. Using vfork() avoids the issue.

Quoted 8 lines

Bug also appears in RHEL5 2.6.18-128.1.6.el5 and causes leakage of huge pages.

Bug does not appear in RHEL4 2.6.9-78.0.13.ELsmp.

See bug 12134 for an example of the errors reported by 'dmesg'.

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>

#2 lore raw
Quoted 40 lines · Andrew Morton

(switched to email. Please respond via emailed reply-to-all, not via the bugzilla web interface).

(Please read this ^^^^ !)

Quoted 31 lines · On Wed, 13 May 2009 19:54:10 GMT [email protected] wrote:

http://bugzilla.kernel.org/show_bug.cgi?id=13302

Summary: "bad pmd" on fork() of process with hugepage shared
memory segments attached
Product: Memory Management
Version: 2.5
Kernel Version: 2.6.29.1
Platform: All
OS/Version: Linux
Tree: Mainline
Status: NEW
Severity: normal
Priority: P1
Component: Other
AssignedTo: [email protected]
ReportedBy: [email protected]
Regression: Yes

Kernel reports "bad pmd" errors when process with hugepage shared memory segments attached executes fork() system call. Using vfork() avoids the issue.

Bug also appears in RHEL5 2.6.18-128.1.6.el5 and causes leakage of huge pages.

Bug does not appear in RHEL4 2.6.9-78.0.13.ELsmp.

See bug 12134 for an example of the errors reported by 'dmesg'.

This seems familiar and I believe it couldn't be reproduced the last time and then the problem reporter went away. We need a reproduction case so I modified on of the libhugetlbfs tests to do what I think you described above. However, it does not trigger the problem for me on x86 or x86-64 running 2.6.29.1.

[email protected], can you try the reproduction steps on your system please? If it reproduces, can you send me your .config please? If it does not reproduce, can you look at the test program and tell me what it's doing different to your reproduction case?

1. wget http://heanet.dl.sourceforge.net/sourceforge/libhugetlbfs/libhugetlbfs-2.3.tar.gz
2. tar -zxf libhugetlbfs-2.3.tar.gz
3. cd libhugetlbfs-2.3
4. wget http://www.csn.ul.ie/~mel/shm-fork.c (program is below for reference)
5. mv shm-fork.c tests/
6. make
7. ./obj/hugeadm --create-global-mounts
8. ./obj/hugeadm --pool-pages-min 2M:20
(Adjust pagesize of 2M if necessary. If x86 and not 2M, tell me
and send me your .config)
9. ./tests/obj32/shm-fork 10 2

On my two systems, I saw something like

# ./tests/obj32/shm-fork 10 2
Starting testcase "./tests/obj32/shm-fork", pid 3527
Requesting 4194304 bytes for each test
Spawning children glibc_fork:..........glibc_fork
Spawning children glibc_vfork:..........glibc_vfork
Spawning children sys_fork:..........sys_fork
PASS

Test program I used is below and is a modified version of what's in libhugetlbfs. It does not compile standalone. The steps it takes are

1. Gets the hugepage size
2. Calls shmget() to create a suitably large shared memory segment
3. Creates a requested number of children
4. Each child attaches to the share memory segment
5. Each child creates a grandchild

6.   The child and grandchildren write the segment
7.   The grandchild exists, the child waits for the grandchild
8.   The child detaches and exists

9. The parent waits for the child to exit

It does this for glibc fork, glibc vfork and a direct call to the system call fork().

Thanks

==== CUT HERE ====

/*
* libhugetlbfs - Easy use of Linux hugepages
* Copyright (C) 2005-2006 David Gibson & Adam Litke, IBM Corporation. *
* This library is free software; you can redistribute it and/or
* modify it under the terms of the GNU Lesser General Public License
* as published by the Free Software Foundation; either version 2.1 of
* the License, or (at your option) any later version.
*
* This library is distributed in the hope that it will be useful, but
* WITHOUT ANY WARRANTY; without even the implied warranty of
* MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
* Lesser General Public License for more details.
*
* You should have received a copy of the GNU Lesser General Public
* License along with this library; if not, write to the Free Software
* Foundation, Inc., 51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA */
#include <stdio.h>
#include <stdlib.h>
#include <string.h>
#include <errno.h>
#include <unistd.h>
#include <syscall.h>
#include <sys/types.h>
#include <sys/shm.h>
#include <sys/mman.h>
#include <sys/wait.h>
#include <hugetlbfs.h>
#include "hugetests.h"

#define P "shm-fork"

#define DESC \
	"* Test shared memory behavior when multiple threads are attached  *\n"\
	"* to a segment.  A segment is created and then children are       *\n"\
	"* spawned which attach, write, read (verify), and detach from the *\n"\
	"* shared memory segment.                                          *"

extern int errno;

/* Global Configuration */
static int nr_hugepages;
static int numprocs;
static int shmid = -1;

#define MAX_PROCS 200
#define BUF_SZ 256

#define GLIBC_FORK 0
#define GLIBC_VFORK 1
#define SYS_FORK 2
static char *testnames[] = { "glibc_fork", "glibc_vfork", "sys_fork" };

#define CHILD_FAIL(thread, fmt, ...) \
	do { \
		verbose_printf("Thread %d (pid=%d) FAIL: " fmt, \
			       thread, getpid(), __VA_ARGS__); \
		exit(1); \
	} while (0)

void cleanup(void)

{
	remove_shmid(shmid);
}

static void do_child(int thread, unsigned long size, int testtype)

{
	volatile char *shmaddr;
	int j, k;
	int pid, status;

	verbose_printf(".");
	for (j=0; j<5; j++) {
		shmaddr = shmat(shmid, 0, SHM_RND);
		if (shmaddr == MAP_FAILED)
			CHILD_FAIL(thread, "shmat() failed: %s",
				   strerror(errno));

		/* Create even more children to double up the work */
		switch (testtype) {
			case GLIBC_FORK:
				if ((pid = fork()) < 0)
					FAIL("glibc_fork(): %s", strerror(errno));
				break;
			case GLIBC_VFORK:
				if ((pid = vfork()) < 0)
					FAIL("glibc_vfork(): %s", strerror(errno));
				break;
			case SYS_FORK:
				if ((pid = syscall(__NR_fork)) < 0)
					FAIL("sys_fork(): %s", strerror(errno));
				break;
			default:
				FAIL("Test type %d not implemented\n", testtype);
		}

		/* Child and parent access the shared area */
		for (k=0;k<size;k++)
			shmaddr[k] = (char) (k);
		for (k=0;k<size;k++)
			if (shmaddr[k] != (char)k)
				CHILD_FAIL(thread, "Index %d mismatch", k);

		/* Children exits */
		if (pid == 0)
			exit(0);
		
		/* Parent waits for child and detaches */
		waitpid(pid, &status, 0);
		if (shmdt((const void *)shmaddr) != 0)
			CHILD_FAIL(thread, "shmdt() failed: %s",
				   strerror(errno));
	}
	exit(0);
}

static void do_test(unsigned long size, int testtype)

{
	int wait_list[MAX_PROCS];
	int i;
	int pid, status;
	char *testname = testnames[testtype];

	if ((shmid = shmget(2, size, SHM_HUGETLB|IPC_CREAT|SHM_R|SHM_W )) < 0)
		FAIL("shmget(): %s", strerror(errno));

	verbose_printf("Spawning children %s:", testname);
	for (i=0; i<numprocs; i++) {
		switch (testtype) {
			case GLIBC_FORK:
				if ((pid = fork()) < 0)
					FAIL("glibc_fork(): %s", strerror(errno));
				break;
			case GLIBC_VFORK:
				if ((pid = vfork()) < 0)
					FAIL("glibc_vfork(): %s", strerror(errno));
				break;
			case SYS_FORK:
				if ((pid = syscall(__NR_fork)) < 0)
					FAIL("sys_fork(): %s", strerror(errno));
				break;
			default:
				FAIL("Test type %d not implemented\n", testtype);
		}

		if (pid == 0)
			do_child(i, size, testtype);

		wait_list[i] = pid;
	}

	for (i=0; i<numprocs; i++) {
		waitpid(wait_list[i], &status, 0);
		if (WEXITSTATUS(status) != 0)
			FAIL("Thread %d (pid=%d) failed", i, wait_list[i]);

		if (WIFSIGNALED(status))
			FAIL("Thread %d (pid=%d) received unhandled signal",
			     i, wait_list[i]);
	}
	printf("%s\n", testname);
}

int main(int argc, char ** argv)

{
	unsigned long size;
	long hpage_size;

	test_init(argc, argv);

	if (argc < 3)
		CONFIG("Usage:  %s <# procs> <# pages>", argv[0]);

	numprocs = atoi(argv[1]);
	nr_hugepages = atoi(argv[2]);

	if (numprocs > MAX_PROCS)
		CONFIG("Cannot spawn more than %d processes", MAX_PROCS);

	check_hugetlb_shm_group();

	hpage_size = check_hugepagesize();
        size = hpage_size * nr_hugepages;

	verbose_printf("Requesting %lu bytes for each test\n", size);
	do_test(size, GLIBC_FORK);
	do_test(size, GLIBC_VFORK);
	do_test(size, SYS_FORK);
	PASS();
}

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>

#3 lore raw
Quoted 48 lines · Mel Gorman
Quoted 40 lines · Andrew Morton

(switched to email. Please respond via emailed reply-to-all, not via the bugzilla web interface).

(Please read this ^^^^ !)

Quoted 31 lines · On Wed, 13 May 2009 19:54:10 GMT [email protected] wrote:

http://bugzilla.kernel.org/show_bug.cgi?id=13302

Summary: "bad pmd" on fork() of process with hugepage shared
memory segments attached
Product: Memory Management
Version: 2.5
Kernel Version: 2.6.29.1
Platform: All
OS/Version: Linux
Tree: Mainline
Status: NEW
Severity: normal
Priority: P1
Component: Other
AssignedTo: [email protected]
ReportedBy: [email protected]
Regression: Yes

Kernel reports "bad pmd" errors when process with hugepage shared memory segments attached executes fork() system call. Using vfork() avoids the issue.

Bug also appears in RHEL5 2.6.18-128.1.6.el5 and causes leakage of huge pages.

Bug does not appear in RHEL4 2.6.9-78.0.13.ELsmp.

See bug 12134 for an example of the errors reported by 'dmesg'.

This seems familiar and I believe it couldn't be reproduced the last time and then the problem reporter went away. We need a reproduction case so I modified on of the libhugetlbfs tests to do what I think you described above. However, it does not trigger the problem for me on x86 or x86-64 running 2.6.29.1.

Quoted 5 lines

[email protected], can you try the reproduction steps on your system please? If it reproduces, can you send me your .config please? If it does not reproduce, can you look at the test program and tell me what it's doing different to your reproduction case?

Another question on top of this.

At any point, do you call madvise(MADV_WILLNEED), fadvise(FADV_WILLNEED) or readahead() on the share memory segment?

Signature · 9 lines
Mel Gorman
Part-time Phd Student                          Linux Technology Center
University of Limerick                         IBM Dublin Software Lab

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to [email protected].  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
#4 lore raw

Definately no.

The possibly unusual thing done is that a file is read into something like 30% of the segment, and the remaining pages are not touched.

Quoted 4 lines · Mel Gorman

Another question on top of this.

At any point, do you call madvise(MADV_WILLNEED), fadvise(FADV_WILLNEED) or readahead() on the share memory segment?

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>

#5 lore raw
Quoted 12 lines · On Thu, May 14, 2009 at 01:20:09PM -0400, [email protected] wrote:
Quoted 4 lines · Mel Gorman

Another question on top of this.

At any point, do you call madvise(MADV_WILLNEED), fadvise(FADV_WILLNEED) or readahead() on the share memory segment?

Definately no.

The possibly unusual thing done is that a file is read into something like 30% of the segment, and the remaining pages are not touched.

Ok, I just tried that there - parent writing 30% of the shared memory before forking but still did not reproduce the problem :(

Signature · 9 lines
Mel Gorman
Part-time Phd Student                          Linux Technology Center
University of Limerick                         IBM Dublin Software Lab

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in
the body to [email protected].  For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>
#6 lore raw
Quoted 2 lines · Mel Gorman

Ok, I just tried that there - parent writing 30% of the shared memory before forking but still did not reproduce the problem :(

Maybe it makes a difference to have lots of RAM (16GB on this server), and about 1.5 GB of hugepage shared memory allocated in the forking process in about four segments. Often have all free memory consumed by the file cache, but I don't belive this is necessary to produce the problem as it will happen even right after a reboot. [RHEL5 meminfo attached]

Other possible factors:
daemon is non-root but has explicit
CAP_IPC_LOCK, CAP_NET_RAW, CAP_SYS_NICE set via 'setcap cap_net_raw,cap_ipc_lock,cap_sys_nice+ep daemon'
ulimit -Hl and -Sl are set to <unlimited>
process group is set in /proc/sys/vm/hugetlb_shm_group /proc/sys/vm/nr_hugepages is set to 2048
daemon has 200 threads at time of fork()
shared memory segments explictly located [RHEL5 pmap -x attached] between fork & exec these syscalls are issued
sched_getscheduler/sched_setscheduler getpriority/setpriority
seteuid(getuid())
setegid(getgid())
with vfork() work-around, no syscalls are made before exec()

Don't think it's something anything specific to the DL160 (Intel E5430) we have because the DL165 (Opteron 2354) also exhibits the problem.

Will run the test cases provided this weekend for certain and will let you know if bug is reproduced.

Have to go silent on this till the weekend.

MemTotal:     16443828 kB
MemFree:        105364 kB
Buffers:          8476 kB
Cached:       11626260 kB
SwapCached:          0 kB
Active:         121876 kB
Inactive:     11570788 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     16443828 kB
LowFree:        105364 kB
SwapTotal:     2031608 kB
SwapFree:      2031396 kB
Dirty:          417224 kB
Writeback:           0 kB
AnonPages:       62700 kB
Mapped:          10640 kB
Slab:           416872 kB
PageTables:       1904 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   8156368 kB
Committed_AS:    71692 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    266280 kB
VmallocChunk: 34359471371 kB
HugePages_Total:  2048
HugePages_Free:    889
HugePages_Rsvd:      0
Hugepagesize:     2048 kB
Address           Kbytes     RSS    Anon  Locked Mode   Mapping
0000000000400000    2976       -       -       - r-x--  daemon
00000000007e8000       8       -       -       - rw---  daemon
00000000007ea000     192       -       -       - rw---    [ anon ]
000000001546d000    9228       -       -       - rw---    [ anon ]
0000000040955000       4       -       -       - -----    [ anon ]
0000000040956000     128       -       -       - rw---    [ anon ]
0000000040976000       4       -       -       - -----    [ anon ]
0000000040977000     128       -       -       - rw---    [ anon ]
0000000040997000       4       -       -       - -----    [ anon ]
0000000040998000     128       -       -       - rw---    [ anon ]
00000000409b8000       4       -       -       - -----    [ anon ]
00000000409b9000     128       -       -       - rw---    [ anon ]
000000004193a000       4       -       -       - -----    [ anon ]
000000004193b000     128       -       -       - rw---    [ anon ]
000000004195b000       4       -       -       - -----    [ anon ]
000000004195c000     128       -       -       - rw---    [ anon ]
000000004197c000       4       -       -       - -----    [ anon ]
000000004197d000     128       -       -       - rw---    [ anon ]
000000004199d000       4       -       -       - -----    [ anon ]
000000004199e000     128       -       -       - rw---    [ anon ]
00000000419be000       4       -       -       - -----    [ anon ]
00000000419bf000     128       -       -       - rw---    [ anon ]
00000000419df000       4       -       -       - -----    [ anon ]
00000000419e0000     128       -       -       - rw---    [ anon ]
0000000041a00000       4       -       -       - -----    [ anon ]
0000000041a01000     128       -       -       - rw---    [ anon ]
0000000041a21000       4       -       -       - -----    [ anon ]
0000000041a22000     128       -       -       - rw---    [ anon ]
0000000041a42000       4       -       -       - -----    [ anon ]
0000000041a43000     128       -       -       - rw---    [ anon ]
0000000041a63000       4       -       -       - -----    [ anon ]
0000000041a64000     128       -       -       - rw---    [ anon ]
0000000041a84000       4       -       -       - -----    [ anon ]
0000000041a85000     128       -       -       - rw---    [ anon ]
0000000041aa5000       4       -       -       - -----    [ anon ]
0000000041aa6000     128       -       -       - rw---    [ anon ]
0000000041ac6000       4       -       -       - -----    [ anon ]
0000000041ac7000     128       -       -       - rw---    [ anon ]
0000000041ae7000       4       -       -       - -----    [ anon ]
0000000041ae8000     128       -       -       - rw---    [ anon ]
0000000041b08000       4       -       -       - -----    [ anon ]
0000000041b09000     128       -       -       - rw---    [ anon ]
0000000041b29000       4       -       -       - -----    [ anon ]
0000000041b2a000     128       -       -       - rw---    [ anon ]
0000000041b4a000       4       -       -       - -----    [ anon ]
0000000041b4b000     128       -       -       - rw---    [ anon ]
0000000041b6b000       4       -       -       - -----    [ anon ]
0000000041b6c000     128       -       -       - rw---    [ anon ]
0000000041b8c000       4       -       -       - -----    [ anon ]
0000000041b8d000     128       -       -       - rw---    [ anon ]
0000000041bad000       4       -       -       - -----    [ anon ]
0000000041bae000     128       -       -       - rw---    [ anon ]
0000000041bce000       4       -       -       - -----    [ anon ]
0000000041bcf000     128       -       -       - rw---    [ anon ]
0000000041bef000       4       -       -       - -----    [ anon ]
0000000041bf0000     128       -       -       - rw---    [ anon ]
0000000041c10000       4       -       -       - -----    [ anon ]
0000000041c11000     128       -       -       - rw---    [ anon ]
0000000041c31000       4       -       -       - -----    [ anon ]
0000000041c32000     128       -       -       - rw---    [ anon ]
0000000041c52000       4       -       -       - -----    [ anon ]
0000000041c53000     128       -       -       - rw---    [ anon ]
0000000041c73000       4       -       -       - -----    [ anon ]
0000000041c74000     128       -       -       - rw---    [ anon ]
0000000041c94000       4       -       -       - -----    [ anon ]
0000000041c95000     128       -       -       - rw---    [ anon ]
0000000041cb5000       4       -       -       - -----    [ anon ]
0000000041cb6000     128       -       -       - rw---    [ anon ]
0000000041cd6000       4       -       -       - -----    [ anon ]
0000000041cd7000     128       -       -       - rw---    [ anon ]
0000000041cf7000       4       -       -       - -----    [ anon ]
0000000041cf8000     128       -       -       - rw---    [ anon ]
0000000041d18000       4       -       -       - -----    [ anon ]
0000000041d19000     128       -       -       - rw---    [ anon ]
0000000041d39000       4       -       -       - -----    [ anon ]
0000000041d3a000     128       -       -       - rw---    [ anon ]
0000000041d5a000       4       -       -       - -----    [ anon ]
0000000041d5b000     128       -       -       - rw---    [ anon ]
0000000041d7b000       4       -       -       - -----    [ anon ]
0000000041d7c000     128       -       -       - rw---    [ anon ]
0000000041d9c000       4       -       -       - -----    [ anon ]
0000000041d9d000     128       -       -       - rw---    [ anon ]
0000000041dbd000       4       -       -       - -----    [ anon ]
0000000041dbe000     128       -       -       - rw---    [ anon ]
0000000041dde000       4       -       -       - -----    [ anon ]
0000000041ddf000     128       -       -       - rw---    [ anon ]
0000000041dff000       4       -       -       - -----    [ anon ]
0000000041e00000     128       -       -       - rw---    [ anon ]
0000000041e20000       4       -       -       - -----    [ anon ]
0000000041e21000     128       -       -       - rw---    [ anon ]
0000000041e41000       4       -       -       - -----    [ anon ]
0000000041e42000     128       -       -       - rw---    [ anon ]
0000000041e62000       4       -       -       - -----    [ anon ]
0000000041e63000     128       -       -       - rw---    [ anon ]
0000000041e83000       4       -       -       - -----    [ anon ]
0000000041e84000     128       -       -       - rw---    [ anon ]
0000000041ea4000       4       -       -       - -----    [ anon ]
0000000041ea5000     128       -       -       - rw---    [ anon ]
0000000041ec5000       4       -       -       - -----    [ anon ]
0000000041ec6000     128       -       -       - rw---    [ anon ]
0000000041ee6000       4       -       -       - -----    [ anon ]
0000000041ee7000     128       -       -       - rw---    [ anon ]
0000000041f07000       4       -       -       - -----    [ anon ]
0000000041f08000     128       -       -       - rw---    [ anon ]
0000000041f28000       4       -       -       - -----    [ anon ]
0000000041f29000     128       -       -       - rw---    [ anon ]
0000000041f49000       4       -       -       - -----    [ anon ]
0000000041f4a000     128       -       -       - rw---    [ anon ]
0000000041f6a000       4       -       -       - -----    [ anon ]
0000000041f6b000     128       -       -       - rw---    [ anon ]
0000000041f8b000       4       -       -       - -----    [ anon ]
0000000041f8c000     128       -       -       - rw---    [ anon ]
0000000041fac000       4       -       -       - -----    [ anon ]
0000000041fad000     128       -       -       - rw---    [ anon ]
0000000041fcd000       4       -       -       - -----    [ anon ]
0000000041fce000     128       -       -       - rw---    [ anon ]
0000000041fee000       4       -       -       - -----    [ anon ]
0000000041fef000     128       -       -       - rw---    [ anon ]
000000004200f000       4       -       -       - -----    [ anon ]
0000000042010000     128       -       -       - rw---    [ anon ]
0000000042030000       4       -       -       - -----    [ anon ]
0000000042031000     128       -       -       - rw---    [ anon ]
0000000042051000       4       -       -       - -----    [ anon ]
0000000042052000     128       -       -       - rw---    [ anon ]
0000000042072000       4       -       -       - -----    [ anon ]
0000000042073000     128       -       -       - rw---    [ anon ]
0000000042093000       4       -       -       - -----    [ anon ]
0000000042094000     128       -       -       - rw---    [ anon ]
00000000420b4000       4       -       -       - -----    [ anon ]
00000000420b5000     128       -       -       - rw---    [ anon ]
00000000420d5000       4       -       -       - -----    [ anon ]
00000000420d6000     128       -       -       - rw---    [ anon ]
00000000420f6000       4       -       -       - -----    [ anon ]
00000000420f7000     128       -       -       - rw---    [ anon ]
0000000042117000       4       -       -       - -----    [ anon ]
0000000042118000     128       -       -       - rw---    [ anon ]
0000000042138000       4       -       -       - -----    [ anon ]
0000000042139000     128       -       -       - rw---    [ anon ]
0000000042159000       4       -       -       - -----    [ anon ]
000000004215a000     128       -       -       - rw---    [ anon ]
000000004217a000       4       -       -       - -----    [ anon ]
000000004217b000     128       -       -       - rw---    [ anon ]
000000004219b000       4       -       -       - -----    [ anon ]
000000004219c000     128       -       -       - rw---    [ anon ]
00000000421bc000       4       -       -       - -----    [ anon ]
00000000421bd000     128       -       -       - rw---    [ anon ]
00000000421dd000       4       -       -       - -----    [ anon ]
00000000421de000     128       -       -       - rw---    [ anon ]
00000000421fe000       4       -       -       - -----    [ anon ]
00000000421ff000     128       -       -       - rw---    [ anon ]
000000004221f000       4       -       -       - -----    [ anon ]
0000000042220000     128       -       -       - rw---    [ anon ]
0000000042240000       4       -       -       - -----    [ anon ]
0000000042241000     128       -       -       - rw---    [ anon ]
0000000042261000       4       -       -       - -----    [ anon ]
0000000042262000     128       -       -       - rw---    [ anon ]
0000000042282000       4       -       -       - -----    [ anon ]
0000000042283000     128       -       -       - rw---    [ anon ]
00000000422a3000       4       -       -       - -----    [ anon ]
00000000422a4000     128       -       -       - rw---    [ anon ]
00000000422c4000       4       -       -       - -----    [ anon ]
00000000422c5000     128       -       -       - rw---    [ anon ]
00000000422e5000       4       -       -       - -----    [ anon ]
00000000422e6000     128       -       -       - rw---    [ anon ]
0000000042306000       4       -       -       - -----    [ anon ]
0000000042307000     128       -       -       - rw---    [ anon ]
0000000042327000       4       -       -       - -----    [ anon ]
0000000042328000     128       -       -       - rw---    [ anon ]
0000000042348000       4       -       -       - -----    [ anon ]
0000000042349000     128       -       -       - rw---    [ anon ]
0000000042369000       4       -       -       - -----    [ anon ]
000000004236a000     128       -       -       - rw---    [ anon ]
000000004238a000       4       -       -       - -----    [ anon ]
000000004238b000     128       -       -       - rw---    [ anon ]
00000000423ab000       4       -       -       - -----    [ anon ]
00000000423ac000     128       -       -       - rw---    [ anon ]
00000000423cc000       4       -       -       - -----    [ anon ]
00000000423cd000     128       -       -       - rw---    [ anon ]
00000000423ed000       4       -       -       - -----    [ anon ]
00000000423ee000     128       -       -       - rw---    [ anon ]
000000004240e000       4       -       -       - -----    [ anon ]
000000004240f000     128       -       -       - rw---    [ anon ]
000000004242f000       4       -       -       - -----    [ anon ]
0000000042430000     128       -       -       - rw---    [ anon ]
0000000042450000       4       -       -       - -----    [ anon ]
0000000042451000     128       -       -       - rw---    [ anon ]
0000000042471000       4       -       -       - -----    [ anon ]
0000000042472000     128       -       -       - rw---    [ anon ]
0000000042492000       4       -       -       - -----    [ anon ]
0000000042493000     128       -       -       - rw---    [ anon ]
00000000424b3000       4       -       -       - -----    [ anon ]
00000000424b4000     128       -       -       - rw---    [ anon ]
00000000424d4000       4       -       -       - -----    [ anon ]
00000000424d5000     128       -       -       - rw---    [ anon ]
00000000424f5000       4       -       -       - -----    [ anon ]
00000000424f6000     128       -       -       - rw---    [ anon ]
0000000042516000       4       -       -       - -----    [ anon ]
0000000042517000     128       -       -       - rw---    [ anon ]
0000000042537000       4       -       -       - -----    [ anon ]
0000000042538000     128       -       -       - rw---    [ anon ]
0000000042558000       4       -       -       - -----    [ anon ]
0000000042559000     128       -       -       - rw---    [ anon ]
0000000042579000       4       -       -       - -----    [ anon ]
000000004257a000     128       -       -       - rw---    [ anon ]
000000004259a000       4       -       -       - -----    [ anon ]
000000004259b000     128       -       -       - rw---    [ anon ]
00000000425bb000       4       -       -       - -----    [ anon ]
00000000425bc000     128       -       -       - rw---    [ anon ]
00000000425dc000       4       -       -       - -----    [ anon ]
00000000425dd000     128       -       -       - rw---    [ anon ]
00000000425fd000       4       -       -       - -----    [ anon ]
00000000425fe000     128       -       -       - rw---    [ anon ]
000000004261e000       4       -       -       - -----    [ anon ]
000000004261f000     128       -       -       - rw---    [ anon ]
000000004263f000       4       -       -       - -----    [ anon ]
0000000042640000     128       -       -       - rw---    [ anon ]
0000000042660000       4       -       -       - -----    [ anon ]
0000000042661000     128       -       -       - rw---    [ anon ]
0000000042681000       4       -       -       - -----    [ anon ]
0000000042682000     128       -       -       - rw---    [ anon ]
00000000426a2000       4       -       -       - -----    [ anon ]
00000000426a3000     128       -       -       - rw---    [ anon ]
00000000426c3000       4       -       -       - -----    [ anon ]
00000000426c4000     128       -       -       - rw---    [ anon ]
00000000426e4000       4       -       -       - -----    [ anon ]
00000000426e5000     128       -       -       - rw---    [ anon ]
0000000042705000       4       -       -       - -----    [ anon ]
0000000042706000     128       -       -       - rw---    [ anon ]
0000000042726000       4       -       -       - -----    [ anon ]
0000000042727000     128       -       -       - rw---    [ anon ]
0000000042747000       4       -       -       - -----    [ anon ]
0000000042748000     128       -       -       - rw---    [ anon ]
0000000042768000       4       -       -       - -----    [ anon ]
0000000042769000     128       -       -       - rw---    [ anon ]
0000000042789000       4       -       -       - -----    [ anon ]
000000004278a000     128       -       -       - rw---    [ anon ]
00000000427aa000       4       -       -       - -----    [ anon ]
00000000427ab000     128       -       -       - rw---    [ anon ]
00000000427cb000       4       -       -       - -----    [ anon ]
00000000427cc000     128       -       -       - rw---    [ anon ]
00000000427ec000       4       -       -       - -----    [ anon ]
00000000427ed000     128       -       -       - rw---    [ anon ]
000000004280d000       4       -       -       - -----    [ anon ]
000000004280e000      28       -       -       - rw---    [ anon ]
0000000042815000       4       -       -       - -----    [ anon ]
0000000042816000      28       -       -       - rw---    [ anon ]
000000004281d000       4       -       -       - -----    [ anon ]
000000004281e000      28       -       -       - rw---    [ anon ]
0000000042825000       4       -       -       - -----    [ anon ]
0000000042826000      28       -       -       - rw---    [ anon ]
000000004282d000       4       -       -       - -----    [ anon ]
000000004282e000      28       -       -       - rw---    [ anon ]
0000000042835000       4       -       -       - -----    [ anon ]
0000000042836000      28       -       -       - rw---    [ anon ]
000000004283d000       4       -       -       - -----    [ anon ]
000000004283e000      28       -       -       - rw---    [ anon ]
0000000042845000       4       -       -       - -----    [ anon ]
0000000042846000      28       -       -       - rw---    [ anon ]
000000004284d000       4       -       -       - -----    [ anon ]
000000004284e000      28       -       -       - rw---    [ anon ]
0000000300000000  524288       -       -       - rw-s-  9 (deleted)
0000000330000000  131072       -       -       - rw-s-  6 (deleted)
00000003c0000000   98304       -       -       - rw-s-  8 (deleted)
00000003d8000000  169984       -       -       - rw-s-  5 (deleted)
00000003f0000000    2048       -       -       - rw-s-  1 (deleted)
00000003f0400000    2048       -       -       - rw-s-  7 (deleted)
0000000400000000 1048576       -       -       - rw-s-  3 (deleted)
0000000580000000  262144       -       -       - rw-s-  4 (deleted)
0000000600000000  131072       -       -       - rw-s-  2 (deleted)
00000032d5400000     112       -       -       - r-x--  ld-2.5.so
00000032d561b000       4       -       -       - r----  ld-2.5.so
00000032d561c000       4       -       -       - rw---  ld-2.5.so
00000032d5800000    1328       -       -       - r-x--  libc-2.5.so
00000032d594c000    2048       -       -       - -----  libc-2.5.so
00000032d5b4c000      16       -       -       - r----  libc-2.5.so
00000032d5b50000       4       -       -       - rw---  libc-2.5.so
00000032d5b51000      20       -       -       - rw---    [ anon ]
00000032d6800000     520       -       -       - r-x--  libm-2.5.so
00000032d6882000    2044       -       -       - -----  libm-2.5.so
00000032d6a81000       4       -       -       - r----  libm-2.5.so
00000032d6a82000       4       -       -       - rw---  libm-2.5.so
00000032d6c00000      88       -       -       - r-x--  libpthread-2.5.so
00000032d6c16000    2044       -       -       - -----  libpthread-2.5.so
00000032d6e15000       4       -       -       - r----  libpthread-2.5.so
00000032d6e16000       4       -       -       - rw---  libpthread-2.5.so
00000032d6e17000      16       -       -       - rw---    [ anon ]
00000032d7000000      28       -       -       - r-x--  librt-2.5.so
00000032d7007000    2048       -       -       - -----  librt-2.5.so
00000032d7207000       4       -       -       - r----  librt-2.5.so
00000032d7208000       4       -       -       - rw---  librt-2.5.so
00002aaaac000000     132       -       -       - rw---    [ anon ]
00002aaaac021000   65404       -       -       - -----    [ anon ]
00002aaab0000000     132       -       -       - rw---    [ anon ]
00002aaab0021000   65404       -       -       - -----    [ anon ]
00002aaab4000000     132       -       -       - rw---    [ anon ]
00002aaab4021000   65404       -       -       - -----    [ anon ]
00002ad69510e000       4       -       -       - rw---    [ anon ]
00002ad695115000       4       -       -       - rw---    [ anon ]
00002ad695116000     944       -       -       - r-x--  libstdc++.so.6.0.10
00002ad695202000    1024       -       -       - -----  libstdc++.so.6.0.10
00002ad695302000       8       -       -       - r----  libstdc++.so.6.0.10
00002ad695304000      28       -       -       - rw---  libstdc++.so.6.0.10
00002ad69530b000      80       -       -       - rw---    [ anon ]
00002ad69531f000      88       -       -       - r-x--  libgcc_s.so.1
00002ad695335000    1020       -       -       - -----  libgcc_s.so.1
00002ad695434000       4       -       -       - rw---  libgcc_s.so.1
00002ad695435000   24776       -       -       - rw---    [ anon ]
00007fff1597d000     124       -       -       - rw---    [ stack ]
ffffffffff600000    8192       -       -       - -----    [ anon ]

---------------- ------ ------ ------ ------
total kB 2641188 - - -

#7 lore raw
In reply to Mel Gorman
Quoted 2 lines · Mel Gorman

Ok, I just tried that there - parent writing 30% of the shared memory before forking but still did not reproduce the problem :(

Maybe it makes a difference to have lots of RAM (16GB on this server), and about 1.5 GB of hugepage shared memory allocated in the forking process in about four segments. Often have all free memory consumed by the file cache, but I don't belive this is necessary to produce the problem as it will happen even right after a reboot. [RHEL5 meminfo attached]

Other possible factors:
daemon is non-root but has explicit
CAP_IPC_LOCK, CAP_NET_RAW, CAP_SYS_NICE set via 'setcap cap_net_raw,cap_ipc_lock,cap_sys_nice+ep daemon'
ulimit -Hl and -Sl are set to <unlimited>
process group is set in /proc/sys/vm/hugetlb_shm_group /proc/sys/vm/nr_hugepages is set to 2048
daemon has 200 threads at time of fork()
shared memory segments explictly located [RHEL5 pmap -x attached] between fork & exec these syscalls are issued
sched_getscheduler/sched_setscheduler getpriority/setpriority
seteuid(getuid())
setegid(getgid())
with vfork() work-around, no syscalls are made before exec()

Don't think it's something anything specific to the DL160 (Intel E5430) we have because the DL165 (Opteron 2354) also exhibits the problem.

Will run the test cases provided this weekend for certain and will let you know if bug is reproduced.

Have to go silent on this till the weekend.

MemTotal:     16443828 kB
MemFree:        105364 kB
Buffers:          8476 kB
Cached:       11626260 kB
SwapCached:          0 kB
Active:         121876 kB
Inactive:     11570788 kB
HighTotal:           0 kB
HighFree:            0 kB
LowTotal:     16443828 kB
LowFree:        105364 kB
SwapTotal:     2031608 kB
SwapFree:      2031396 kB
Dirty:          417224 kB
Writeback:           0 kB
AnonPages:       62700 kB
Mapped:          10640 kB
Slab:           416872 kB
PageTables:       1904 kB
NFS_Unstable:        0 kB
Bounce:              0 kB
CommitLimit:   8156368 kB
Committed_AS:    71692 kB
VmallocTotal: 34359738367 kB
VmallocUsed:    266280 kB
VmallocChunk: 34359471371 kB
HugePages_Total:  2048
HugePages_Free:    889
HugePages_Rsvd:      0
Hugepagesize:     2048 kB
Address           Kbytes     RSS    Anon  Locked Mode   Mapping
0000000000400000    2976       -       -       - r-x--  daemon
00000000007e8000       8       -       -       - rw---  daemon
00000000007ea000     192       -       -       - rw---    [ anon ]
000000001546d000    9228       -       -       - rw---    [ anon ]
0000000040955000       4       -       -       - -----    [ anon ]
0000000040956000     128       -       -       - rw---    [ anon ]
0000000040976000       4       -       -       - -----    [ anon ]
0000000040977000     128       -       -       - rw---    [ anon ]
0000000040997000       4       -       -       - -----    [ anon ]
0000000040998000     128       -       -       - rw---    [ anon ]
00000000409b8000       4       -       -       - -----    [ anon ]
00000000409b9000     128       -       -       - rw---    [ anon ]
000000004193a000       4       -       -       - -----    [ anon ]
000000004193b000     128       -       -       - rw---    [ anon ]
000000004195b000       4       -       -       - -----    [ anon ]
000000004195c000     128       -       -       - rw---    [ anon ]
000000004197c000       4       -       -       - -----    [ anon ]
000000004197d000     128       -       -       - rw---    [ anon ]
000000004199d000       4       -       -       - -----    [ anon ]
000000004199e000     128       -       -       - rw---    [ anon ]
00000000419be000       4       -       -       - -----    [ anon ]
00000000419bf000     128       -       -       - rw---    [ anon ]
00000000419df000       4       -       -       - -----    [ anon ]
00000000419e0000     128       -       -       - rw---    [ anon ]
0000000041a00000       4       -       -       - -----    [ anon ]
0000000041a01000     128       -       -       - rw---    [ anon ]
0000000041a21000       4       -       -       - -----    [ anon ]
0000000041a22000     128       -       -       - rw---    [ anon ]
0000000041a42000       4       -       -       - -----    [ anon ]
0000000041a43000     128       -       -       - rw---    [ anon ]
0000000041a63000       4       -       -       - -----    [ anon ]
0000000041a64000     128       -       -       - rw---    [ anon ]
0000000041a84000       4       -       -       - -----    [ anon ]
0000000041a85000     128       -       -       - rw---    [ anon ]
0000000041aa5000       4       -       -       - -----    [ anon ]
0000000041aa6000     128       -       -       - rw---    [ anon ]
0000000041ac6000       4       -       -       - -----    [ anon ]
0000000041ac7000     128       -       -       - rw---    [ anon ]
0000000041ae7000       4       -       -       - -----    [ anon ]
0000000041ae8000     128       -       -       - rw---    [ anon ]
0000000041b08000       4       -       -       - -----    [ anon ]
0000000041b09000     128       -       -       - rw---    [ anon ]
0000000041b29000       4       -       -       - -----    [ anon ]
0000000041b2a000     128       -       -       - rw---    [ anon ]
0000000041b4a000       4       -       -       - -----    [ anon ]
0000000041b4b000     128       -       -       - rw---    [ anon ]
0000000041b6b000       4       -       -       - -----    [ anon ]
0000000041b6c000     128       -       -       - rw---    [ anon ]
0000000041b8c000       4       -       -       - -----    [ anon ]
0000000041b8d000     128       -       -       - rw---    [ anon ]
0000000041bad000       4       -       -       - -----    [ anon ]
0000000041bae000     128       -       -       - rw---    [ anon ]
0000000041bce000       4       -       -       - -----    [ anon ]
0000000041bcf000     128       -       -       - rw---    [ anon ]
0000000041bef000       4       -       -       - -----    [ anon ]
0000000041bf0000     128       -       -       - rw---    [ anon ]
0000000041c10000       4       -       -       - -----    [ anon ]
0000000041c11000     128       -       -       - rw---    [ anon ]
0000000041c31000       4       -       -       - -----    [ anon ]
0000000041c32000     128       -       -       - rw---    [ anon ]
0000000041c52000       4       -       -       - -----    [ anon ]
0000000041c53000     128       -       -       - rw---    [ anon ]
0000000041c73000       4       -       -       - -----    [ anon ]
0000000041c74000     128       -       -       - rw---    [ anon ]
0000000041c94000       4       -       -       - -----    [ anon ]
0000000041c95000     128       -       -       - rw---    [ anon ]
0000000041cb5000       4       -       -       - -----    [ anon ]
0000000041cb6000     128       -       -       - rw---    [ anon ]
0000000041cd6000       4       -       -       - -----    [ anon ]
0000000041cd7000     128       -       -       - rw---    [ anon ]
0000000041cf7000       4       -       -       - -----    [ anon ]
0000000041cf8000     128       -       -       - rw---    [ anon ]
0000000041d18000       4       -       -       - -----    [ anon ]
0000000041d19000     128       -       -       - rw---    [ anon ]
0000000041d39000       4       -       -       - -----    [ anon ]
0000000041d3a000     128       -       -       - rw---    [ anon ]
0000000041d5a000       4       -       -       - -----    [ anon ]
0000000041d5b000     128       -       -       - rw---    [ anon ]
0000000041d7b000       4       -       -       - -----    [ anon ]
0000000041d7c000     128       -       -       - rw---    [ anon ]
0000000041d9c000       4       -       -       - -----    [ anon ]
0000000041d9d000     128       -       -       - rw---    [ anon ]
0000000041dbd000       4       -       -       - -----    [ anon ]
0000000041dbe000     128       -       -       - rw---    [ anon ]
0000000041dde000       4       -       -       - -----    [ anon ]
0000000041ddf000     128       -       -       - rw---    [ anon ]
0000000041dff000       4       -       -       - -----    [ anon ]
0000000041e00000     128       -       -       - rw---    [ anon ]
0000000041e20000       4       -       -       - -----    [ anon ]
0000000041e21000     128       -       -       - rw---    [ anon ]
0000000041e41000       4       -       -       - -----    [ anon ]
0000000041e42000     128       -       -       - rw---    [ anon ]
0000000041e62000       4       -       -       - -----    [ anon ]
0000000041e63000     128       -       -       - rw---    [ anon ]
0000000041e83000       4       -       -       - -----    [ anon ]
0000000041e84000     128       -       -       - rw---    [ anon ]
0000000041ea4000       4       -       -       - -----    [ anon ]
0000000041ea5000     128       -       -       - rw---    [ anon ]
0000000041ec5000       4       -       -       - -----    [ anon ]
0000000041ec6000     128       -       -       - rw---    [ anon ]
0000000041ee6000       4       -       -       - -----    [ anon ]
0000000041ee7000     128       -       -       - rw---    [ anon ]
0000000041f07000       4       -       -       - -----    [ anon ]
0000000041f08000     128       -       -       - rw---    [ anon ]
0000000041f28000       4       -       -       - -----    [ anon ]
0000000041f29000     128       -       -       - rw---    [ anon ]
0000000041f49000       4       -       -       - -----    [ anon ]
0000000041f4a000     128       -       -       - rw---    [ anon ]
0000000041f6a000       4       -       -       - -----    [ anon ]
0000000041f6b000     128       -       -       - rw---    [ anon ]
0000000041f8b000       4       -       -       - -----    [ anon ]
0000000041f8c000     128       -       -       - rw---    [ anon ]
0000000041fac000       4       -       -       - -----    [ anon ]
0000000041fad000     128       -       -       - rw---    [ anon ]
0000000041fcd000       4       -       -       - -----    [ anon ]
0000000041fce000     128       -       -       - rw---    [ anon ]
0000000041fee000       4       -       -       - -----    [ anon ]
0000000041fef000     128       -       -       - rw---    [ anon ]
000000004200f000       4       -       -       - -----    [ anon ]
0000000042010000     128       -       -       - rw---    [ anon ]
0000000042030000       4       -       -       - -----    [ anon ]
0000000042031000     128       -       -       - rw---    [ anon ]
0000000042051000       4       -       -       - -----    [ anon ]
0000000042052000     128       -       -       - rw---    [ anon ]
0000000042072000       4       -       -       - -----    [ anon ]
0000000042073000     128       -       -       - rw---    [ anon ]
0000000042093000       4       -       -       - -----    [ anon ]
0000000042094000     128       -       -       - rw---    [ anon ]
00000000420b4000       4       -       -       - -----    [ anon ]
00000000420b5000     128       -       -       - rw---    [ anon ]
00000000420d5000       4       -       -       - -----    [ anon ]
00000000420d6000     128       -       -       - rw---    [ anon ]
00000000420f6000       4       -       -       - -----    [ anon ]
00000000420f7000     128       -       -       - rw---    [ anon ]
0000000042117000       4       -       -       - -----    [ anon ]
0000000042118000     128       -       -       - rw---    [ anon ]
0000000042138000       4       -       -       - -----    [ anon ]
0000000042139000     128       -       -       - rw---    [ anon ]
0000000042159000       4       -       -       - -----    [ anon ]
000000004215a000     128       -       -       - rw---    [ anon ]
000000004217a000       4       -       -       - -----    [ anon ]
000000004217b000     128       -       -       - rw---    [ anon ]
000000004219b000       4       -       -       - -----    [ anon ]
000000004219c000     128       -       -       - rw---    [ anon ]
00000000421bc000       4       -       -       - -----    [ anon ]
00000000421bd000     128       -       -       - rw---    [ anon ]
00000000421dd000       4       -       -       - -----    [ anon ]
00000000421de000     128       -       -       - rw---    [ anon ]
00000000421fe000       4       -       -       - -----    [ anon ]
00000000421ff000     128       -       -       - rw---    [ anon ]
000000004221f000       4       -       -       - -----    [ anon ]
0000000042220000     128       -       -       - rw---    [ anon ]
0000000042240000       4       -       -       - -----    [ anon ]
0000000042241000     128       -       -       - rw---    [ anon ]
0000000042261000       4       -       -       - -----    [ anon ]
0000000042262000     128       -       -       - rw---    [ anon ]
0000000042282000       4       -       -       - -----    [ anon ]
0000000042283000     128       -       -       - rw---    [ anon ]
00000000422a3000       4       -       -       - -----    [ anon ]
00000000422a4000     128       -       -       - rw---    [ anon ]
00000000422c4000       4       -       -       - -----    [ anon ]
00000000422c5000     128       -       -       - rw---    [ anon ]
00000000422e5000       4       -       -       - -----    [ anon ]
00000000422e6000     128       -       -       - rw---    [ anon ]
0000000042306000       4       -       -       - -----    [ anon ]
0000000042307000     128       -       -       - rw---    [ anon ]
0000000042327000       4       -       -       - -----    [ anon ]
0000000042328000     128       -       -       - rw---    [ anon ]
0000000042348000       4       -       -       - -----    [ anon ]
0000000042349000     128       -       -       - rw---    [ anon ]
0000000042369000       4       -       -       - -----    [ anon ]
000000004236a000     128       -       -       - rw---    [ anon ]
000000004238a000       4       -       -       - -----    [ anon ]
000000004238b000     128       -       -       - rw---    [ anon ]
00000000423ab000       4       -       -       - -----    [ anon ]
00000000423ac000     128       -       -       - rw---    [ anon ]
00000000423cc000       4       -       -       - -----    [ anon ]
00000000423cd000     128       -       -       - rw---    [ anon ]
00000000423ed000       4       -       -       - -----    [ anon ]
00000000423ee000     128       -       -       - rw---    [ anon ]
000000004240e000       4       -       -       - -----    [ anon ]
000000004240f000     128       -       -       - rw---    [ anon ]
000000004242f000       4       -       -       - -----    [ anon ]
0000000042430000     128       -       -       - rw---    [ anon ]
0000000042450000       4       -       -       - -----    [ anon ]
0000000042451000     128       -       -       - rw---    [ anon ]
0000000042471000       4       -       -       - -----    [ anon ]
0000000042472000     128       -       -       - rw---    [ anon ]
0000000042492000       4       -       -       - -----    [ anon ]
0000000042493000     128       -       -       - rw---    [ anon ]
00000000424b3000       4       -       -       - -----    [ anon ]
00000000424b4000     128       -       -       - rw---    [ anon ]
00000000424d4000       4       -       -       - -----    [ anon ]
00000000424d5000     128       -       -       - rw---    [ anon ]
00000000424f5000       4       -       -       - -----    [ anon ]
00000000424f6000     128       -       -       - rw---    [ anon ]
0000000042516000       4       -       -       - -----    [ anon ]
0000000042517000     128       -       -       - rw---    [ anon ]
0000000042537000       4       -       -       - -----    [ anon ]
0000000042538000     128       -       -       - rw---    [ anon ]
0000000042558000       4       -       -       - -----    [ anon ]
0000000042559000     128       -       -       - rw---    [ anon ]
0000000042579000       4       -       -       - -----    [ anon ]
000000004257a000     128       -       -       - rw---    [ anon ]
000000004259a000       4       -       -       - -----    [ anon ]
000000004259b000     128       -       -       - rw---    [ anon ]
00000000425bb000       4       -       -       - -----    [ anon ]
00000000425bc000     128       -       -       - rw---    [ anon ]
00000000425dc000       4       -       -       - -----    [ anon ]
00000000425dd000     128       -       -       - rw---    [ anon ]
00000000425fd000       4       -       -       - -----    [ anon ]
00000000425fe000     128       -       -       - rw---    [ anon ]
000000004261e000       4       -       -       - -----    [ anon ]
000000004261f000     128       -       -       - rw---    [ anon ]
000000004263f000       4       -       -       - -----    [ anon ]
0000000042640000     128       -       -       - rw---    [ anon ]
0000000042660000       4       -       -       - -----    [ anon ]
0000000042661000     128       -       -       - rw---    [ anon ]
0000000042681000       4       -       -       - -----    [ anon ]
0000000042682000     128       -       -       - rw---    [ anon ]
00000000426a2000       4       -       -       - -----    [ anon ]
00000000426a3000     128       -       -       - rw---    [ anon ]
00000000426c3000       4       -       -       - -----    [ anon ]
00000000426c4000     128       -       -       - rw---    [ anon ]
00000000426e4000       4       -       -       - -----    [ anon ]
00000000426e5000     128       -       -       - rw---    [ anon ]
0000000042705000       4       -       -       - -----    [ anon ]
0000000042706000     128       -       -       - rw---    [ anon ]
0000000042726000       4       -       -       - -----    [ anon ]
0000000042727000     128       -       -       - rw---    [ anon ]
0000000042747000       4       -       -       - -----    [ anon ]
0000000042748000     128       -       -       - rw---    [ anon ]
0000000042768000       4       -       -       - -----    [ anon ]
0000000042769000     128       -       -       - rw---    [ anon ]
0000000042789000       4       -       -       - -----    [ anon ]
000000004278a000     128       -       -       - rw---    [ anon ]
00000000427aa000       4       -       -       - -----    [ anon ]
00000000427ab000     128       -       -       - rw---    [ anon ]
00000000427cb000       4       -       -       - -----    [ anon ]
00000000427cc000     128       -       -       - rw---    [ anon ]
00000000427ec000       4       -       -       - -----    [ anon ]
00000000427ed000     128       -       -       - rw---    [ anon ]
000000004280d000       4       -       -       - -----    [ anon ]
000000004280e000      28       -       -       - rw---    [ anon ]
0000000042815000       4       -       -       - -----    [ anon ]
0000000042816000      28       -       -       - rw---    [ anon ]
000000004281d000       4       -       -       - -----    [ anon ]
000000004281e000      28       -       -       - rw---    [ anon ]
0000000042825000       4       -       -       - -----    [ anon ]
0000000042826000      28       -       -       - rw---    [ anon ]
000000004282d000       4       -       -       - -----    [ anon ]
000000004282e000      28       -       -       - rw---    [ anon ]
0000000042835000       4       -       -       - -----    [ anon ]
0000000042836000      28       -       -       - rw---    [ anon ]
000000004283d000       4       -       -       - -----    [ anon ]
000000004283e000      28       -       -       - rw---    [ anon ]
0000000042845000       4       -       -       - -----    [ anon ]
0000000042846000      28       -       -       - rw---    [ anon ]
000000004284d000       4       -       -       - -----    [ anon ]
000000004284e000      28       -       -       - rw---    [ anon ]
0000000300000000  524288       -       -       - rw-s-  9 (deleted)
0000000330000000  131072       -       -       - rw-s-  6 (deleted)
00000003c0000000   98304       -       -       - rw-s-  8 (deleted)
00000003d8000000  169984       -       -       - rw-s-  5 (deleted)
00000003f0000000    2048       -       -       - rw-s-  1 (deleted)
00000003f0400000    2048       -       -       - rw-s-  7 (deleted)
0000000400000000 1048576       -       -       - rw-s-  3 (deleted)
0000000580000000  262144       -       -       - rw-s-  4 (deleted)
0000000600000000  131072       -       -       - rw-s-  2 (deleted)
00000032d5400000     112       -       -       - r-x--  ld-2.5.so
00000032d561b000       4       -       -       - r----  ld-2.5.so
00000032d561c000       4       -       -       - rw---  ld-2.5.so
00000032d5800000    1328       -       -       - r-x--  libc-2.5.so
00000032d594c000    2048       -       -       - -----  libc-2.5.so
00000032d5b4c000      16       -       -       - r----  libc-2.5.so
00000032d5b50000       4       -       -       - rw---  libc-2.5.so
00000032d5b51000      20       -       -       - rw---    [ anon ]
00000032d6800000     520       -       -       - r-x--  libm-2.5.so
00000032d6882000    2044       -       -       - -----  libm-2.5.so
00000032d6a81000       4       -       -       - r----  libm-2.5.so
00000032d6a82000       4       -       -       - rw---  libm-2.5.so
00000032d6c00000      88       -       -       - r-x--  libpthread-2.5.so
00000032d6c16000    2044       -       -       - -----  libpthread-2.5.so
00000032d6e15000       4       -       -       - r----  libpthread-2.5.so
00000032d6e16000       4       -       -       - rw---  libpthread-2.5.so
00000032d6e17000      16       -       -       - rw---    [ anon ]
00000032d7000000      28       -       -       - r-x--  librt-2.5.so
00000032d7007000    2048       -       -       - -----  librt-2.5.so
00000032d7207000       4       -       -       - r----  librt-2.5.so
00000032d7208000       4       -       -       - rw---  librt-2.5.so
00002aaaac000000     132       -       -       - rw---    [ anon ]
00002aaaac021000   65404       -       -       - -----    [ anon ]
00002aaab0000000     132       -       -       - rw---    [ anon ]
00002aaab0021000   65404       -       -       - -----    [ anon ]
00002aaab4000000     132       -       -       - rw---    [ anon ]
00002aaab4021000   65404       -       -       - -----    [ anon ]
00002ad69510e000       4       -       -       - rw---    [ anon ]
00002ad695115000       4       -       -       - rw---    [ anon ]
00002ad695116000     944       -       -       - r-x--  libstdc++.so.6.0.10
00002ad695202000    1024       -       -       - -----  libstdc++.so.6.0.10
00002ad695302000       8       -       -       - r----  libstdc++.so.6.0.10
00002ad695304000      28       -       -       - rw---  libstdc++.so.6.0.10
00002ad69530b000      80       -       -       - rw---    [ anon ]
00002ad69531f000      88       -       -       - r-x--  libgcc_s.so.1
00002ad695335000    1020       -       -       - -----  libgcc_s.so.1
00002ad695434000       4       -       -       - rw---  libgcc_s.so.1
00002ad695435000   24776       -       -       - rw---    [ anon ]
00007fff1597d000     124       -       -       - rw---    [ stack ]
ffffffffff600000    8192       -       -       - -----    [ anon ]

---------------- ------ ------ ------ ------
total kB 2641188 - - -

#8 lore raw
In reply to Mel Gorman

Will try it out, but it has to wait till this weekend.

Quoted 5 lines · Mel Gorman

[email protected], can you try the reproduction steps on your system please? If it reproduces, can you send me your .config please? If it does not reproduce, can you look at the test program and tell me what it's doing different to your reproduction case?

--
To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to [email protected]. For more info on Linux MM,
see: http://www.linux-mm.org/ .
Don't email: <a href=mailto:"[email protected]"> [email protected] </a>