NUMA Questions
I'm running a Tyan K8W 2885, with two Opteron 240s and 512MB in each memory bank. I've compiled kernel 2.6.7-rc1 with the following in my config:
CONFIG_K8_NUMA=yCONFIG_DISCONTIGMEM=yCONFIG_NUMA=y
In /var/log/messages, I see:
May 24 14:45:11 Corwin Scanning NUMA topology in Northbridge 24 May 24 14:45:11 Corwin Number of nodes 2 (10010) May 24 14:45:11 Corwin Node 0 MemBase 0000000000000000 Limit 000000001fffffff May 24 14:45:11 Corwin Node 1 MemBase 0000000020000000 Limit 000000003fff0000 May 24 14:45:11 Corwin Using node hash shift of 24 May 24 14:45:11 Corwin Bootmem setup node 0 0000000000000000-000000001fffffff May 24 14:45:11 Corwin Bootmem setup node 1 0000000020000000-000000003fff0000 May 24 14:45:11 Corwin ACPI: have wakeup address 0x10020005000 May 24 14:45:11 Corwin No mptable found. May 24 14:45:11 Corwin No mptable found. May 24 14:45:11 Corwin setting up node 0 0-1ffff May 24 14:45:11 Corwin On node 0 totalpages: 131071 May 24 14:45:11 Corwin DMA zone: 4096 pages, LIFO batch:1 May 24 14:45:11 Corwin Normal zone: 126975 pages, LIFO batch:16 May 24 14:45:11 Corwin HighMem zone: 0 pages, LIFO batch:1 May 24 14:45:11 Corwin setting up node 1 20000-3fff0 May 24 14:45:11 Corwin On node 1 totalpages: 131056 May 24 14:45:11 Corwin DMA zone: 0 pages, LIFO batch:1 May 24 14:45:11 Corwin Normal zone: 131056 pages, LIFO batch:16 May 24 14:45:11 Corwin HighMem zone: 0 pages, LIFO batch:1
So am I correct in assuming that NUMA is up and running? I note that Andi's numastat displays:
node1 node0numa_hit 304539 472556numa_miss 0 0numa_foreign 0 0interleave_hit 0 0local_node 303607 472549other_node 932 7
Yet when I run Andi's numactl, it states:
Corwin /usr/src/numactl-0.6.3 # numactl --show
No NUMA support available on this system.
A quick test program, and I see:
numa_available() returns -1numa_max_node() return 1
Can anyone shed light on this?
Signature · 3 lines
Scott Robert Ladd Coyote Gulch Productions (http://www.coyotegulch.com) Software Invention for High-Performance Computing