intel 5100/iwlagn bug in 2.6.35-rc2 during large file transfer

The repeated line appears ad infinitum filling my dmesg buffer. This of hangcheck timer seem to trigger with every large file transfer on my intel 5100. What would you like me to do to provide a more useful output as this is currently extremely easy to reproduce. Kernel 2.6.34 using compat-wireless stable 2.6.35-rc2

Thanks,
Rick Farina

phy0: failed to reallocate TX buffer
phy0: failed to reallocate TX buffer
phy0: failed to reallocate TX buffer
phy0: failed to reallocate TX buffer
phy0: failed to reallocate TX buffer
phy0: failed to reallocate TX buffer
phy0: failed to reallocate TX buffer
net_ratelimit: 22 callbacks suppressed __alloc_pages_slowpath: 3799 callbacks suppressed
swapper: page allocation failure. order:1, mode:0x4020
Pid: 0, comm: swapper Not tainted 2.6.34-pentoo #5

Call Trace:
<IRQ>  [<ffffffff8109cb74>] __alloc_pages_nodemask+0x571/0x5b9
[<ffffffff816732e9>] ? skb_release_data+0xc4/0xc9
[<ffffffffa04701e4>] iwlagn_rx_allocate+0x98/0x25a [iwlagn]
[<ffffffffa046fbd3>] ? iwlagn_rx_reply_rx+0x332/0x34d [iwlagn]
[<ffffffff814739c5>] ? is_swiotlb_buffer+0x2e/0x3b
[<ffffffffa04704f7>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[<ffffffffa0464bb3>] iwl_rx_handle+0x2b8/0x2d1 [iwlagn]
[<ffffffffa04652c0>] iwl_irq_tasklet+0x2f7/0x412 [iwlagn]
[<ffffffff81044f58>] tasklet_action+0x6f/0xba
[<ffffffff81045998>] __do_softirq+0x91/0x119
[<ffffffff8100384c>] call_softirq+0x1c/0x28
[<ffffffff8100550b>] do_softirq+0x33/0x68
[<ffffffff81045695>] irq_exit+0x36/0x87
[<ffffffff81004bef>] do_IRQ+0xa7/0xbe
[<ffffffff8176c253>] ret_from_intr+0x0/0xa
<EOI>  [<ffffffff81058ca9>] ? __atomic_notifier_call_chain+0x28/0x4c
[<ffffffff814e822d>] ? acpi_idle_enter_simple+0x150/0x17b
[<ffffffff814e8223>] ? acpi_idle_enter_simple+0x146/0x17b
[<ffffffff816407cc>] cpuidle_idle_call+0x8b/0xc3
[<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[<ffffffff8174a8e1>] rest_init+0xb5/0xba
[<ffffffff81cc1b5c>] start_kernel+0x3f7/0x402
[<ffffffff81cc10b6>] x86_64_start_reservations+0xb3/0xb7
[<ffffffff81cc119a>] x86_64_start_kernel+0xe0/0xe7

Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 156
CPU 1: hi: 186, btch: 31 usd: 156
Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 155
CPU 1: hi: 186, btch: 31 usd: 162
active_anon:324509 inactive_anon:110799 isolated_anon:0
active_file:223980 inactive_file:241231 isolated_file:270
unevictable:23 dirty:95383 writeback:565 unstable:41418
free:7201 slab_reclaimable:8226 slab_unreclaimable:18924
mapped:32967 shmem:11570 pagetables:3468 bounce:0
DMA free:15636kB min:28kB low:32kB high:40kB active_anon:52kB inactive_anon:128kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 2900 3910 3910
DMA32 free:11032kB min:5924kB low:7404kB high:8884kB active_anon:1148572kB inactive_anon:292840kB active_file:602436kB inactive_file:671388kB unevictable:0kB isolated(anon):0kB isolated(file):136kB present:2970488kB mlocked:0kB dirty:270116kB writeback:1904kB mapped:102852kB shmem:14292kB slab_reclaimable:14856kB slab_unreclaimable:46416kB kernel_stack:296kB pagetables:3980kB unstable:109116kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 1010 1010
Normal free:2136kB min:2060kB low:2572kB high:3088kB active_anon:149412kB inactive_anon:150228kB active_file:293484kB inactive_file:293536kB unevictable:92kB isolated(anon):0kB isolated(file):944kB present:1034240kB mlocked:0kB dirty:111416kB writeback:356kB mapped:29016kB shmem:31988kB slab_reclaimable:18048kB slab_unreclaimable:29272kB kernel_stack:1904kB pagetables:9892kB unstable:56556kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 3*4kB 1*8kB 2*16kB 2*32kB 3*64kB 0*128kB 2*256kB 1*512kB 2*1024kB 2*2048kB 2*4096kB = 15668kB
DMA32: 2480*4kB 121*8kB 2*16kB 2*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 11112kB
Normal: 442*4kB 34*8kB 2*16kB 0*32kB 1*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2136kB
477072 total pagecache pages
125 pages in swap cache
Swap cache stats: add 584, delete 459, find 25/46
Free swap = 4199436kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
612955 pages shared
380169 pages non-shared
iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 0 free buffers remaining.

My dmesg is absolutely filling with stuff like this. Can someone tell me how to provide a more useful bug report?

Thanks,
Rick Farina

Normal free:1700kB min:2060kB low:2572kB high:3088kB active_anon:196252kB inactive_anon:269284kB active_file:212608kB inactive_file:212512kB unevictable:232kB isolated(anon):0kB isolated(file):132kB present:1034240kB mlocked:140kB dirty:52kB writeback:86380kB mapped:45604kB shmem:6688kB slab_reclaimable:17076kB slab_unreclaimable:18092kB kernel_stack:1320kB pagetables:4740kB unstable:11584kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 1*4kB 0*8kB 1*16kB 1*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15668kB
DMA32: 3923*4kB 3*8kB 21*16kB 20*32kB 1*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 16756kB
Normal: 331*4kB 12*8kB 5*16kB 1*32kB 2*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1660kB
456109 total pagecache pages
210 pages in swap cache
Swap cache stats: add 2576, delete 2366, find 88793/88820
Free swap = 4191576kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
657041 pages shared
419080 pages non-shared
swapper: page allocation failure. order:1, mode:0x4020
Pid: 0, comm: swapper Not tainted 2.6.34-pentoo #5

Call Trace:
<IRQ>  [<ffffffff8109cb74>] __alloc_pages_nodemask+0x571/0x5b9
[<ffffffffa04881e4>] iwlagn_rx_allocate+0x98/0x25a [iwlagn]
[<ffffffffa0487bd3>] ? iwlagn_rx_reply_rx+0x332/0x34d [iwlagn]
[<ffffffff814739c5>] ? is_swiotlb_buffer+0x2e/0x3b
[<ffffffffa04884f7>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[<ffffffffa047cbb3>] iwl_rx_handle+0x2b8/0x2d1 [iwlagn]
[<ffffffff81059679>] ? sched_clock_cpu+0xc6/0xd4
[<ffffffffa047d2c0>] iwl_irq_tasklet+0x2f7/0x412 [iwlagn]
[<ffffffff81044f58>] tasklet_action+0x6f/0xba
[<ffffffff81045998>] __do_softirq+0x91/0x119
[<ffffffff8100384c>] call_softirq+0x1c/0x28
[<ffffffff8100550b>] do_softirq+0x33/0x68
[<ffffffff81045695>] irq_exit+0x36/0x87
[<ffffffff81004bef>] do_IRQ+0xa7/0xbe
[<ffffffff8176c253>] ret_from_intr+0x0/0xa
<EOI>  [<ffffffff814e822d>] ? acpi_idle_enter_simple+0x150/0x17b
[<ffffffff814e8223>] ? acpi_idle_enter_simple+0x146/0x17b
[<ffffffff816407cc>] cpuidle_idle_call+0x8b/0xc3
[<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[<ffffffff8174a8e1>] rest_init+0xb5/0xba
[<ffffffff81cc1b5c>] start_kernel+0x3f7/0x402
[<ffffffff81cc10b6>] x86_64_start_reservations+0xb3/0xb7
[<ffffffff81cc119a>] x86_64_start_kernel+0xe0/0xe7

Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 156
CPU 1: hi: 186, btch: 31 usd: 133
Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 156
CPU 1: hi: 186, btch: 31 usd: 168
active_anon:310188 inactive_anon:151651 isolated_anon:0
active_file:221724 inactive_file:221738 isolated_file:98
unevictable:58 dirty:37 writeback:81998 unstable:9264
free:8527 slab_reclaimable:8494 slab_unreclaimable:12301
mapped:40138 shmem:12341 pagetables:3763 bounce:0
DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:180kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 2900 3910 3910
DMA32 free:16780kB min:5924kB low:7404kB high:8884kB active_anon:1044500kB inactive_anon:337320kB active_file:674288kB inactive_file:674260kB unevictable:0kB isolated(anon):0kB isolated(file):260kB present:2970488kB mlocked:0kB dirty:96kB writeback:241672kB mapped:114948kB shmem:42676kB slab_reclaimable:16900kB slab_unreclaimable:31144kB kernel_stack:1048kB pagetables:10312kB unstable:25412kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 1010 1010
Normal free:1684kB min:2060kB low:2572kB high:3088kB active_anon:196252kB inactive_anon:269284kB active_file:212608kB inactive_file:212512kB unevictable:232kB isolated(anon):0kB isolated(file):132kB present:1034240kB mlocked:140kB dirty:52kB writeback:86320kB mapped:45604kB shmem:6688kB slab_reclaimable:17076kB slab_unreclaimable:18052kB kernel_stack:1320kB pagetables:4740kB unstable:11644kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 1*4kB 1*8kB 1*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15644kB
DMA32: 3923*4kB 5*8kB 24*16kB 18*32kB 1*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 16756kB
Normal: 331*4kB 7*8kB 5*16kB 1*32kB 3*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1684kB
456111 total pagecache pages
224 pages in swap cache
Swap cache stats: add 2592, delete 2368, find 88793/88822
Free swap = 4191584kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
656984 pages shared
419095 pages non-shared
swapper: page allocation failure. order:1, mode:0x4020
Pid: 0, comm: swapper Not tainted 2.6.34-pentoo #5

Call Trace:
<IRQ>  [<ffffffff8109cb74>] __alloc_pages_nodemask+0x571/0x5b9
[<ffffffffa04881e4>] iwlagn_rx_allocate+0x98/0x25a [iwlagn]
[<ffffffffa0487bd3>] ? iwlagn_rx_reply_rx+0x332/0x34d [iwlagn]
[<ffffffff814739c5>] ? is_swiotlb_buffer+0x2e/0x3b
[<ffffffffa04884f7>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[<ffffffffa047cbb3>] iwl_rx_handle+0x2b8/0x2d1 [iwlagn]
[<ffffffff81059679>] ? sched_clock_cpu+0xc6/0xd4
[<ffffffffa047d2c0>] iwl_irq_tasklet+0x2f7/0x412 [iwlagn]
[<ffffffff81044f58>] tasklet_action+0x6f/0xba
[<ffffffff81045998>] __do_softirq+0x91/0x119
[<ffffffff8100384c>] call_softirq+0x1c/0x28
[<ffffffff8100550b>] do_softirq+0x33/0x68
[<ffffffff81045695>] irq_exit+0x36/0x87
[<ffffffff81004bef>] do_IRQ+0xa7/0xbe
[<ffffffff8176c253>] ret_from_intr+0x0/0xa
<EOI>  [<ffffffff814e822d>] ? acpi_idle_enter_simple+0x150/0x17b
[<ffffffff814e8223>] ? acpi_idle_enter_simple+0x146/0x17b
[<ffffffff816407cc>] cpuidle_idle_call+0x8b/0xc3
[<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[<ffffffff8174a8e1>] rest_init+0xb5/0xba
[<ffffffff81cc1b5c>] start_kernel+0x3f7/0x402
[<ffffffff81cc10b6>] x86_64_start_reservations+0xb3/0xb7
[<ffffffff81cc119a>] x86_64_start_kernel+0xe0/0xe7

Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 156
CPU 1: hi: 186, btch: 31 usd: 132
Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 156
CPU 1: hi: 186, btch: 31 usd: 168
active_anon:310188 inactive_anon:151651 isolated_anon:0
active_file:221724 inactive_file:221738 isolated_file:98
unevictable:58 dirty:37 writeback:81961 unstable:9301
free:8533 slab_reclaimable:8494 slab_unreclaimable:12329
mapped:40138 shmem:12341 pagetables:3763 bounce:0
DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:180kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 2900 3910 3910
DMA32 free:16804kB min:5924kB low:7404kB high:8884kB active_anon:1044500kB inactive_anon:337320kB active_file:674288kB inactive_file:674260kB unevictable:0kB isolated(anon):0kB isolated(file):260kB present:2970488kB mlocked:0kB dirty:96kB writeback:241524kB mapped:114948kB shmem:42676kB slab_reclaimable:16900kB slab_unreclaimable:31256kB kernel_stack:1048kB pagetables:10312kB unstable:25560kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 1010 1010
Normal free:1684kB min:2060kB low:2572kB high:3088kB active_anon:196252kB inactive_anon:269284kB active_file:212608kB inactive_file:212512kB unevictable:232kB isolated(anon):0kB isolated(file):132kB present:1034240kB mlocked:140kB dirty:52kB writeback:86320kB mapped:45604kB shmem:6688kB slab_reclaimable:17076kB slab_unreclaimable:18052kB kernel_stack:1320kB pagetables:4740kB unstable:11644kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 1*4kB 1*8kB 1*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15644kB
DMA32: 3923*4kB 15*8kB 28*16kB 18*32kB 1*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 16900kB
Normal: 331*4kB 23*8kB 5*16kB 1*32kB 3*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1812kB
456111 total pagecache pages
224 pages in swap cache
Swap cache stats: add 2592, delete 2368, find 88793/88822
Free swap = 4191584kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
656934 pages shared
419028 pages non-shared
swapper: page allocation failure. order:1, mode:0x4020
Pid: 0, comm: swapper Not tainted 2.6.34-pentoo #5

Call Trace:
<IRQ>  [<ffffffff8109cb74>] __alloc_pages_nodemask+0x571/0x5b9
[<ffffffffa04881e4>] iwlagn_rx_allocate+0x98/0x25a [iwlagn]
[<ffffffff816732e9>] ? skb_release_data+0xc4/0xc9
[<ffffffff814739c5>] ? is_swiotlb_buffer+0x2e/0x3b
[<ffffffffa04884f7>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[<ffffffffa047cb95>] iwl_rx_handle+0x29a/0x2d1 [iwlagn]
[<ffffffffa047d2c0>] iwl_irq_tasklet+0x2f7/0x412 [iwlagn]
[<ffffffff81044f58>] tasklet_action+0x6f/0xba
[<ffffffff81045998>] __do_softirq+0x91/0x119
[<ffffffff8100384c>] call_softirq+0x1c/0x28
[<ffffffff8100550b>] do_softirq+0x33/0x68
[<ffffffff81045695>] irq_exit+0x36/0x87
[<ffffffff81004bef>] do_IRQ+0xa7/0xbe
[<ffffffff8176c253>] ret_from_intr+0x0/0xa
<EOI>  [<ffffffff814e822d>] ? acpi_idle_enter_simple+0x150/0x17b
[<ffffffff814e8223>] ? acpi_idle_enter_simple+0x146/0x17b
[<ffffffff816407cc>] cpuidle_idle_call+0x8b/0xc3
[<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[<ffffffff8174a8e1>] rest_init+0xb5/0xba
[<ffffffff81cc1b5c>] start_kernel+0x3f7/0x402
[<ffffffff81cc10b6>] x86_64_start_reservations+0xb3/0xb7
[<ffffffff81cc119a>] x86_64_start_kernel+0xe0/0xe7

Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 156
CPU 1: hi: 186, btch: 31 usd: 132
Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 156
CPU 1: hi: 186, btch: 31 usd: 168
active_anon:310188 inactive_anon:151651 isolated_anon:0
active_file:221724 inactive_file:221738 isolated_file:98
unevictable:58 dirty:37 writeback:81961 unstable:9301
free:8533 slab_reclaimable:8494 slab_unreclaimable:12329
mapped:40138 shmem:12341 pagetables:3763 bounce:0
DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:180kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 2900 3910 3910
DMA32 free:16804kB min:5924kB low:7404kB high:8884kB active_anon:1044500kB inactive_anon:337320kB active_file:674288kB inactive_file:674260kB unevictable:0kB isolated(anon):0kB isolated(file):260kB present:2970488kB mlocked:0kB dirty:96kB writeback:241524kB mapped:114948kB shmem:42676kB slab_reclaimable:16900kB slab_unreclaimable:31256kB kernel_stack:1048kB pagetables:10312kB unstable:25560kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 1010 1010
Normal free:1684kB min:2060kB low:2572kB high:3088kB active_anon:196252kB inactive_anon:269284kB active_file:212608kB inactive_file:212512kB unevictable:232kB isolated(anon):0kB isolated(file):132kB present:1034240kB mlocked:140kB dirty:52kB writeback:86320kB mapped:45604kB shmem:6688kB slab_reclaimable:17076kB slab_unreclaimable:18052kB kernel_stack:1320kB pagetables:4740kB unstable:11644kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 1*4kB 1*8kB 1*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15644kB
DMA32: 3923*4kB 15*8kB 28*16kB 18*32kB 1*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 16900kB
Normal: 331*4kB 23*8kB 5*16kB 1*32kB 3*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 1812kB
456111 total pagecache pages
224 pages in swap cache
Swap cache stats: add 2592, delete 2368, find 88793/88822
Free swap = 4191584kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
656934 pages shared
419028 pages non-shared
__alloc_pages_slowpath: 7 callbacks suppressed
swapper: page allocation failure. order:1, mode:0x4020
Pid: 0, comm: swapper Not tainted 2.6.34-pentoo #5

Call Trace:
<IRQ>  [<ffffffff8109cb74>] __alloc_pages_nodemask+0x571/0x5b9
[<ffffffffa04881e4>] iwlagn_rx_allocate+0x98/0x25a [iwlagn]
[<ffffffff816732e9>] ? skb_release_data+0xc4/0xc9
[<ffffffffa04884f7>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[<ffffffffa047cb95>] iwl_rx_handle+0x29a/0x2d1 [iwlagn]
[<ffffffffa047d2c0>] iwl_irq_tasklet+0x2f7/0x412 [iwlagn]
[<ffffffff81044f58>] tasklet_action+0x6f/0xba
[<ffffffff81045998>] __do_softirq+0x91/0x119
[<ffffffff8100384c>] call_softirq+0x1c/0x28
[<ffffffff8100550b>] do_softirq+0x33/0x68
[<ffffffff81045695>] irq_exit+0x36/0x87
[<ffffffff81004bef>] do_IRQ+0xa7/0xbe
[<ffffffff8176c253>] ret_from_intr+0x0/0xa
<EOI>  [<ffffffff814e7dec>] ? acpi_idle_enter_c1+0xdc/0xf7
[<ffffffff814e7dce>] ? acpi_idle_enter_c1+0xbe/0xf7
[<ffffffff816407cc>] cpuidle_idle_call+0x8b/0xc3
[<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[<ffffffff8174a8e1>] rest_init+0xb5/0xba
[<ffffffff81cc1b5c>] start_kernel+0x3f7/0x402
[<ffffffff81cc10b6>] x86_64_start_reservations+0xb3/0xb7
[<ffffffff81cc119a>] x86_64_start_kernel+0xe0/0xe7

Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 57
CPU 1: hi: 186, btch: 31 usd: 156
Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 53
CPU 1: hi: 186, btch: 31 usd: 119
active_anon:310769 inactive_anon:151667 isolated_anon:0
active_file:221427 inactive_file:221406 isolated_file:196
unevictable:58 dirty:57 writeback:78685 unstable:12577
free:8938 slab_reclaimable:8493 slab_unreclaimable:12282
mapped:40115 shmem:12921 pagetables:3763 bounce:0
DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:180kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 2900 3910 3910
DMA32 free:17540kB min:5924kB low:7404kB high:8884kB active_anon:1046340kB inactive_anon:337384kB active_file:673368kB inactive_file:673268kB unevictable:0kB isolated(anon):0kB isolated(file):524kB present:2970488kB mlocked:0kB dirty:152kB writeback:231716kB mapped:114856kB shmem:44512kB slab_reclaimable:16896kB slab_unreclaimable:31052kB kernel_stack:1048kB pagetables:10312kB unstable:35368kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 1010 1010
Normal free:2568kB min:2060kB low:2572kB high:3088kB active_anon:196736kB inactive_anon:269284kB active_file:212340kB inactive_file:212176kB unevictable:232kB isolated(anon):0kB isolated(file):260kB present:1034240kB mlocked:140kB dirty:76kB writeback:83024kB mapped:45604kB shmem:7172kB slab_reclaimable:17076kB slab_unreclaimable:18068kB kernel_stack:1320kB pagetables:4740kB unstable:14940kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 1*4kB 1*8kB 1*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15644kB
DMA32: 4125*4kB 24*8kB 8*16kB 19*32kB 3*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 17620kB
Normal: 574*4kB 4*8kB 5*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2568kB
456115 total pagecache pages
224 pages in swap cache
Swap cache stats: add 2592, delete 2368, find 88793/88822
Free swap = 4191584kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
654200 pages shared
418328 pages non-shared
net_ratelimit: 35 callbacks suppressed
iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 4 free buffers remaining.
swapper: page allocation failure. order:1, mode:0x4020
Pid: 0, comm: swapper Not tainted 2.6.34-pentoo #5

Call Trace:
<IRQ>  [<ffffffff8109cb74>] __alloc_pages_nodemask+0x571/0x5b9
[<ffffffffa04881e4>] iwlagn_rx_allocate+0x98/0x25a [iwlagn]
[<ffffffffa0487bd3>] ? iwlagn_rx_reply_rx+0x332/0x34d [iwlagn]
[<ffffffff814739c5>] ? is_swiotlb_buffer+0x2e/0x3b
[<ffffffffa04884f7>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[<ffffffffa047cbb3>] iwl_rx_handle+0x2b8/0x2d1 [iwlagn]
[<ffffffffa047d2c0>] iwl_irq_tasklet+0x2f7/0x412 [iwlagn]
[<ffffffff81044f58>] tasklet_action+0x6f/0xba
[<ffffffff81045998>] __do_softirq+0x91/0x119
[<ffffffff8100384c>] call_softirq+0x1c/0x28
[<ffffffff8100550b>] do_softirq+0x33/0x68
[<ffffffff81045695>] irq_exit+0x36/0x87
[<ffffffff81004bef>] do_IRQ+0xa7/0xbe
[<ffffffff8176c253>] ret_from_intr+0x0/0xa
<EOI>  [<ffffffff814e7dec>] ? acpi_idle_enter_c1+0xdc/0xf7
[<ffffffff814e7dce>] ? acpi_idle_enter_c1+0xbe/0xf7
[<ffffffff816407cc>] cpuidle_idle_call+0x8b/0xc3
[<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[<ffffffff8174a8e1>] rest_init+0xb5/0xba
[<ffffffff81cc1b5c>] start_kernel+0x3f7/0x402
[<ffffffff81cc10b6>] x86_64_start_reservations+0xb3/0xb7
[<ffffffff81cc119a>] x86_64_start_kernel+0xe0/0xe7

Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 57
CPU 1: hi: 186, btch: 31 usd: 156
Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 53
CPU 1: hi: 186, btch: 31 usd: 119
active_anon:310769 inactive_anon:151667 isolated_anon:0
active_file:221427 inactive_file:221406 isolated_file:196
unevictable:58 dirty:57 writeback:78685 unstable:12577
free:8938 slab_reclaimable:8493 slab_unreclaimable:12282
mapped:40115 shmem:12921 pagetables:3763 bounce:0
DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:180kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 2900 3910 3910
DMA32 free:17540kB min:5924kB low:7404kB high:8884kB active_anon:1046340kB inactive_anon:337384kB active_file:673368kB inactive_file:673268kB unevictable:0kB isolated(anon):0kB isolated(file):524kB present:2970488kB mlocked:0kB dirty:152kB writeback:231716kB mapped:114856kB shmem:44512kB slab_reclaimable:16896kB slab_unreclaimable:31052kB kernel_stack:1048kB pagetables:10312kB unstable:35368kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 1010 1010
Normal free:2568kB min:2060kB low:2572kB high:3088kB active_anon:196736kB inactive_anon:269284kB active_file:212340kB inactive_file:212176kB unevictable:232kB isolated(anon):0kB isolated(file):260kB present:1034240kB mlocked:140kB dirty:76kB writeback:83024kB mapped:45604kB shmem:7172kB slab_reclaimable:17076kB slab_unreclaimable:18068kB kernel_stack:1320kB pagetables:4740kB unstable:14940kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 1*4kB 1*8kB 1*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15644kB
DMA32: 4125*4kB 25*8kB 8*16kB 19*32kB 3*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 17628kB
Normal: 574*4kB 4*8kB 5*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2568kB
456115 total pagecache pages
224 pages in swap cache
Swap cache stats: add 2592, delete 2368, find 88793/88822
Free swap = 4191584kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
654200 pages shared
418325 pages non-shared
iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 4 free buffers remaining.
syslog-ng: page allocation failure. order:1, mode:0x4020
Pid: 5830, comm: syslog-ng Not tainted 2.6.34-pentoo #5

Call Trace:
<IRQ>  [<ffffffff8109cb74>] __alloc_pages_nodemask+0x571/0x5b9
[<ffffffffa04881e4>] iwlagn_rx_allocate+0x98/0x25a [iwlagn]
[<ffffffff814739c5>] ? is_swiotlb_buffer+0x2e/0x3b
[<ffffffffa04884f7>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[<ffffffffa047cb95>] iwl_rx_handle+0x29a/0x2d1 [iwlagn]
[<ffffffffa047d2c0>] iwl_irq_tasklet+0x2f7/0x412 [iwlagn]
[<ffffffff81044f58>] tasklet_action+0x6f/0xba
[<ffffffff81045998>] __do_softirq+0x91/0x119
[<ffffffff8100384c>] call_softirq+0x1c/0x28
[<ffffffff8100550b>] do_softirq+0x33/0x68
[<ffffffff81045695>] irq_exit+0x36/0x87
[<ffffffff81004bef>] do_IRQ+0xa7/0xbe
[<ffffffff8176c253>] ret_from_intr+0x0/0xa
<EOI>  [<ffffffff8100330e>] ? apic_timer_interrupt+0xe/0x20
[<ffffffff8176be39>] ? _raw_spin_unlock_irq+0x10/0x28
[<ffffffff81037326>] finish_task_switch+0x45/0xae
[<ffffffff81769e8a>] schedule+0x76f/0x842
[<ffffffff8176ad50>] schedule_hrtimeout_range+0xeb/0x132
[<ffffffff81057346>] ? hrtimer_wakeup+0x0/0x21
[<ffffffff81057e68>] ? hrtimer_start_range_ns+0xf/0x11
[<ffffffff810df1b2>] poll_schedule_timeout+0x43/0x5f
[<ffffffff810df5b8>] do_sys_poll+0x35a/0x3e5
[<ffffffff810e02d7>] ? __pollwait+0x0/0xc7
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff81491fb3>] ? tty_ldisc_deref+0x9/0xb
[<ffffffff8148c609>] ? tty_write+0x210/0x22c
[<ffffffff8105c8fe>] ? ktime_get_ts+0xad/0xba
[<ffffffff810df154>] ? poll_select_set_timeout+0x61/0x7c
[<ffffffff810df7d7>] sys_poll+0x50/0xba
[<ffffffff810029ab>] system_call_fastpath+0x16/0x1b

Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 57
CPU 1: hi: 186, btch: 31 usd: 152
Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 53
CPU 1: hi: 186, btch: 31 usd: 120
active_anon:310769 inactive_anon:151667 isolated_anon:0
active_file:221427 inactive_file:221406 isolated_file:196
unevictable:58 dirty:57 writeback:78685 unstable:12577
free:8938 slab_reclaimable:8493 slab_unreclaimable:12282
mapped:40115 shmem:12921 pagetables:3763 bounce:0
DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:180kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 2900 3910 3910
DMA32 free:17540kB min:5924kB low:7404kB high:8884kB active_anon:1046340kB inactive_anon:337384kB active_file:673368kB inactive_file:673268kB unevictable:0kB isolated(anon):0kB isolated(file):524kB present:2970488kB mlocked:0kB dirty:152kB writeback:231716kB mapped:114856kB shmem:44512kB slab_reclaimable:16896kB slab_unreclaimable:31052kB kernel_stack:1048kB pagetables:10312kB unstable:35368kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 1010 1010
Normal free:2568kB min:2060kB low:2572kB high:3088kB active_anon:196736kB inactive_anon:269284kB active_file:212340kB inactive_file:212176kB unevictable:232kB isolated(anon):0kB isolated(file):260kB present:1034240kB mlocked:140kB dirty:76kB writeback:83024kB mapped:45604kB shmem:7172kB slab_reclaimable:17076kB slab_unreclaimable:18068kB kernel_stack:1320kB pagetables:4740kB unstable:14940kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 1*4kB 1*8kB 1*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15644kB
DMA32: 4125*4kB 25*8kB 8*16kB 19*32kB 3*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 17628kB
Normal: 574*4kB 4*8kB 5*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2568kB
456115 total pagecache pages
224 pages in swap cache
Swap cache stats: add 2592, delete 2368, find 88793/88822
Free swap = 4191584kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
654204 pages shared
418327 pages non-shared
iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 1 free buffers remaining.
syslog-ng: page allocation failure. order:1, mode:0x4020
Pid: 5830, comm: syslog-ng Not tainted 2.6.34-pentoo #5

Call Trace:
<IRQ>  [<ffffffff8109cb74>] __alloc_pages_nodemask+0x571/0x5b9
[<ffffffffa04881e4>] iwlagn_rx_allocate+0x98/0x25a [iwlagn]
[<ffffffffa0487bd3>] ? iwlagn_rx_reply_rx+0x332/0x34d [iwlagn]
[<ffffffff814739c5>] ? is_swiotlb_buffer+0x2e/0x3b
[<ffffffffa04884f7>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[<ffffffffa047cb95>] iwl_rx_handle+0x29a/0x2d1 [iwlagn]
[<ffffffffa047d2c0>] iwl_irq_tasklet+0x2f7/0x412 [iwlagn]
[<ffffffff81044f58>] tasklet_action+0x6f/0xba
[<ffffffff81045998>] __do_softirq+0x91/0x119
[<ffffffff8100384c>] call_softirq+0x1c/0x28
[<ffffffff8100550b>] do_softirq+0x33/0x68
[<ffffffff81045695>] irq_exit+0x36/0x87
[<ffffffff81004bef>] do_IRQ+0xa7/0xbe
[<ffffffff8176c253>] ret_from_intr+0x0/0xa
<EOI>  [<ffffffff8100330e>] ? apic_timer_interrupt+0xe/0x20
[<ffffffff8176be39>] ? _raw_spin_unlock_irq+0x10/0x28
[<ffffffff81037326>] finish_task_switch+0x45/0xae
[<ffffffff81769e8a>] schedule+0x76f/0x842
[<ffffffff8176ad50>] schedule_hrtimeout_range+0xeb/0x132
[<ffffffff81057346>] ? hrtimer_wakeup+0x0/0x21
[<ffffffff81057e68>] ? hrtimer_start_range_ns+0xf/0x11
[<ffffffff810df1b2>] poll_schedule_timeout+0x43/0x5f
[<ffffffff810df5b8>] do_sys_poll+0x35a/0x3e5
[<ffffffff810e02d7>] ? __pollwait+0x0/0xc7
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff81491fb3>] ? tty_ldisc_deref+0x9/0xb
[<ffffffff8148c609>] ? tty_write+0x210/0x22c
[<ffffffff8105c8fe>] ? ktime_get_ts+0xad/0xba
[<ffffffff810df154>] ? poll_select_set_timeout+0x61/0x7c
[<ffffffff810df7d7>] sys_poll+0x50/0xba
[<ffffffff810029ab>] system_call_fastpath+0x16/0x1b

Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 57
CPU 1: hi: 186, btch: 31 usd: 152
Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 53
CPU 1: hi: 186, btch: 31 usd: 120
active_anon:310769 inactive_anon:151667 isolated_anon:0
active_file:221427 inactive_file:221406 isolated_file:196
unevictable:58 dirty:57 writeback:78685 unstable:12577
free:8938 slab_reclaimable:8493 slab_unreclaimable:12282
mapped:40115 shmem:12921 pagetables:3763 bounce:0
DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:180kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 2900 3910 3910
DMA32 free:17540kB min:5924kB low:7404kB high:8884kB active_anon:1046340kB inactive_anon:337384kB active_file:673368kB inactive_file:673268kB unevictable:0kB isolated(anon):0kB isolated(file):524kB present:2970488kB mlocked:0kB dirty:152kB writeback:231716kB mapped:114856kB shmem:44512kB slab_reclaimable:16896kB slab_unreclaimable:31052kB kernel_stack:1048kB pagetables:10312kB unstable:35368kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 1010 1010
Normal free:2568kB min:2060kB low:2572kB high:3088kB active_anon:196736kB inactive_anon:269284kB active_file:212340kB inactive_file:212176kB unevictable:232kB isolated(anon):0kB isolated(file):260kB present:1034240kB mlocked:140kB dirty:76kB writeback:83024kB mapped:45604kB shmem:7172kB slab_reclaimable:17076kB slab_unreclaimable:18068kB kernel_stack:1320kB pagetables:4740kB unstable:14940kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 1*4kB 1*8kB 1*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15644kB
DMA32: 4125*4kB 27*8kB 8*16kB 19*32kB 3*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 17644kB
Normal: 574*4kB 4*8kB 5*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2568kB
456115 total pagecache pages
224 pages in swap cache
Swap cache stats: add 2592, delete 2368, find 88793/88822
Free swap = 4191584kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
654204 pages shared
418323 pages non-shared
iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 6 free buffers remaining.
syslog-ng: page allocation failure. order:1, mode:0x4020
Pid: 5830, comm: syslog-ng Not tainted 2.6.34-pentoo #5

Call Trace:
<IRQ>  [<ffffffff8109cb74>] __alloc_pages_nodemask+0x571/0x5b9
[<ffffffffa04881e4>] iwlagn_rx_allocate+0x98/0x25a [iwlagn]
[<ffffffffa0487bd3>] ? iwlagn_rx_reply_rx+0x332/0x34d [iwlagn]
[<ffffffff814739c5>] ? is_swiotlb_buffer+0x2e/0x3b
[<ffffffffa04884f7>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[<ffffffffa047cb95>] iwl_rx_handle+0x29a/0x2d1 [iwlagn]
[<ffffffffa047d2c0>] iwl_irq_tasklet+0x2f7/0x412 [iwlagn]
[<ffffffff81044f58>] tasklet_action+0x6f/0xba
[<ffffffff81045998>] __do_softirq+0x91/0x119
[<ffffffff8100384c>] call_softirq+0x1c/0x28
[<ffffffff8100550b>] do_softirq+0x33/0x68
[<ffffffff81045695>] irq_exit+0x36/0x87
[<ffffffff81004bef>] do_IRQ+0xa7/0xbe
[<ffffffff8176c253>] ret_from_intr+0x0/0xa
<EOI>  [<ffffffff8100330e>] ? apic_timer_interrupt+0xe/0x20
[<ffffffff8176be39>] ? _raw_spin_unlock_irq+0x10/0x28
[<ffffffff81037326>] finish_task_switch+0x45/0xae
[<ffffffff81769e8a>] schedule+0x76f/0x842
[<ffffffff8176ad50>] schedule_hrtimeout_range+0xeb/0x132
[<ffffffff81057346>] ? hrtimer_wakeup+0x0/0x21
[<ffffffff81057e68>] ? hrtimer_start_range_ns+0xf/0x11
[<ffffffff810df1b2>] poll_schedule_timeout+0x43/0x5f
[<ffffffff810df5b8>] do_sys_poll+0x35a/0x3e5
[<ffffffff810e02d7>] ? __pollwait+0x0/0xc7
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff81491fb3>] ? tty_ldisc_deref+0x9/0xb
[<ffffffff8148c609>] ? tty_write+0x210/0x22c
[<ffffffff8105c8fe>] ? ktime_get_ts+0xad/0xba
[<ffffffff810df154>] ? poll_select_set_timeout+0x61/0x7c
[<ffffffff810df7d7>] sys_poll+0x50/0xba
[<ffffffff810029ab>] system_call_fastpath+0x16/0x1b

Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 57
CPU 1: hi: 186, btch: 31 usd: 152
Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 53
CPU 1: hi: 186, btch: 31 usd: 120
active_anon:310769 inactive_anon:151667 isolated_anon:0
active_file:221427 inactive_file:221406 isolated_file:196
unevictable:58 dirty:57 writeback:78685 unstable:12577
free:8938 slab_reclaimable:8493 slab_unreclaimable:12282
mapped:40115 shmem:12921 pagetables:3763 bounce:0
DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:180kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 2900 3910 3910
DMA32 free:17540kB min:5924kB low:7404kB high:8884kB active_anon:1046340kB inactive_anon:337384kB active_file:673368kB inactive_file:673268kB unevictable:0kB isolated(anon):0kB isolated(file):524kB present:2970488kB mlocked:0kB dirty:152kB writeback:231716kB mapped:114856kB shmem:44512kB slab_reclaimable:16896kB slab_unreclaimable:31052kB kernel_stack:1048kB pagetables:10312kB unstable:35368kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 1010 1010
Normal free:2568kB min:2060kB low:2572kB high:3088kB active_anon:196736kB inactive_anon:269284kB active_file:212340kB inactive_file:212176kB unevictable:232kB isolated(anon):0kB isolated(file):260kB present:1034240kB mlocked:140kB dirty:76kB writeback:83024kB mapped:45604kB shmem:7172kB slab_reclaimable:17076kB slab_unreclaimable:18068kB kernel_stack:1320kB pagetables:4740kB unstable:14940kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 1*4kB 1*8kB 1*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15644kB
DMA32: 4125*4kB 29*8kB 8*16kB 19*32kB 3*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 17660kB
Normal: 574*4kB 4*8kB 5*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2568kB
456115 total pagecache pages
224 pages in swap cache
Swap cache stats: add 2592, delete 2368, find 88793/88822
Free swap = 4191584kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
654204 pages shared
418319 pages non-shared
iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 6 free buffers remaining.
syslog-ng: page allocation failure. order:1, mode:0x4020
Pid: 5830, comm: syslog-ng Not tainted 2.6.34-pentoo #5

Call Trace:
<IRQ>  [<ffffffff8109cb74>] __alloc_pages_nodemask+0x571/0x5b9
[<ffffffffa04881e4>] iwlagn_rx_allocate+0x98/0x25a [iwlagn]
[<ffffffffa0487bd3>] ? iwlagn_rx_reply_rx+0x332/0x34d [iwlagn]
[<ffffffff814739c5>] ? is_swiotlb_buffer+0x2e/0x3b
[<ffffffffa04884f7>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[<ffffffffa047cb95>] iwl_rx_handle+0x29a/0x2d1 [iwlagn]
[<ffffffffa047d2c0>] iwl_irq_tasklet+0x2f7/0x412 [iwlagn]
[<ffffffff81044f58>] tasklet_action+0x6f/0xba
[<ffffffff81045998>] __do_softirq+0x91/0x119
[<ffffffff8100384c>] call_softirq+0x1c/0x28
[<ffffffff8100550b>] do_softirq+0x33/0x68
[<ffffffff81045695>] irq_exit+0x36/0x87
[<ffffffff81004bef>] do_IRQ+0xa7/0xbe
[<ffffffff8176c253>] ret_from_intr+0x0/0xa
<EOI>  [<ffffffff8100330e>] ? apic_timer_interrupt+0xe/0x20
[<ffffffff8176be39>] ? _raw_spin_unlock_irq+0x10/0x28
[<ffffffff81037326>] finish_task_switch+0x45/0xae
[<ffffffff81769e8a>] schedule+0x76f/0x842
[<ffffffff8176ad50>] schedule_hrtimeout_range+0xeb/0x132
[<ffffffff81057346>] ? hrtimer_wakeup+0x0/0x21
[<ffffffff81057e68>] ? hrtimer_start_range_ns+0xf/0x11
[<ffffffff810df1b2>] poll_schedule_timeout+0x43/0x5f
[<ffffffff810df5b8>] do_sys_poll+0x35a/0x3e5
[<ffffffff810e02d7>] ? __pollwait+0x0/0xc7
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff81491fb3>] ? tty_ldisc_deref+0x9/0xb
[<ffffffff8148c609>] ? tty_write+0x210/0x22c
[<ffffffff8105c8fe>] ? ktime_get_ts+0xad/0xba
[<ffffffff810df154>] ? poll_select_set_timeout+0x61/0x7c
[<ffffffff810df7d7>] sys_poll+0x50/0xba
[<ffffffff810029ab>] system_call_fastpath+0x16/0x1b

Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 57
CPU 1: hi: 186, btch: 31 usd: 152
Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 53
CPU 1: hi: 186, btch: 31 usd: 120
active_anon:310769 inactive_anon:151667 isolated_anon:0
active_file:221427 inactive_file:221406 isolated_file:196
unevictable:58 dirty:57 writeback:78685 unstable:12577
free:8938 slab_reclaimable:8493 slab_unreclaimable:12282
mapped:40115 shmem:12921 pagetables:3763 bounce:0
DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:180kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 2900 3910 3910
DMA32 free:17540kB min:5924kB low:7404kB high:8884kB active_anon:1046340kB inactive_anon:337384kB active_file:673368kB inactive_file:673268kB unevictable:0kB isolated(anon):0kB isolated(file):524kB present:2970488kB mlocked:0kB dirty:152kB writeback:231716kB mapped:114856kB shmem:44512kB slab_reclaimable:16896kB slab_unreclaimable:31052kB kernel_stack:1048kB pagetables:10312kB unstable:35368kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 1010 1010
Normal free:2568kB min:2060kB low:2572kB high:3088kB active_anon:196736kB inactive_anon:269284kB active_file:212340kB inactive_file:212176kB unevictable:232kB isolated(anon):0kB isolated(file):260kB present:1034240kB mlocked:140kB dirty:76kB writeback:83024kB mapped:45604kB shmem:7172kB slab_reclaimable:17076kB slab_unreclaimable:18068kB kernel_stack:1320kB pagetables:4740kB unstable:14940kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 1*4kB 1*8kB 1*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15644kB
DMA32: 4125*4kB 30*8kB 8*16kB 19*32kB 3*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 17668kB
Normal: 574*4kB 4*8kB 5*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2568kB
456115 total pagecache pages
224 pages in swap cache
Swap cache stats: add 2592, delete 2368, find 88793/88822
Free swap = 4191584kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
654204 pages shared
418317 pages non-shared
syslog-ng: page allocation failure. order:1, mode:0x4020
Pid: 5830, comm: syslog-ng Not tainted 2.6.34-pentoo #5

Call Trace:
<IRQ>  [<ffffffff8109cb74>] __alloc_pages_nodemask+0x571/0x5b9
[<ffffffffa04881e4>] iwlagn_rx_allocate+0x98/0x25a [iwlagn]
[<ffffffffa0487bd3>] ? iwlagn_rx_reply_rx+0x332/0x34d [iwlagn]
[<ffffffff814739c5>] ? is_swiotlb_buffer+0x2e/0x3b
[<ffffffffa04884f7>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[<ffffffffa047cb95>] iwl_rx_handle+0x29a/0x2d1 [iwlagn]
[<ffffffffa047d2c0>] iwl_irq_tasklet+0x2f7/0x412 [iwlagn]
[<ffffffff81044f58>] tasklet_action+0x6f/0xba
[<ffffffff81045998>] __do_softirq+0x91/0x119
[<ffffffff8100384c>] call_softirq+0x1c/0x28
[<ffffffff8100550b>] do_softirq+0x33/0x68
[<ffffffff81045695>] irq_exit+0x36/0x87
[<ffffffff81004bef>] do_IRQ+0xa7/0xbe
[<ffffffff8176c253>] ret_from_intr+0x0/0xa
<EOI>  [<ffffffff8100330e>] ? apic_timer_interrupt+0xe/0x20
[<ffffffff8176be39>] ? _raw_spin_unlock_irq+0x10/0x28
[<ffffffff81037326>] finish_task_switch+0x45/0xae
[<ffffffff81769e8a>] schedule+0x76f/0x842
[<ffffffff8176ad50>] schedule_hrtimeout_range+0xeb/0x132
[<ffffffff81057346>] ? hrtimer_wakeup+0x0/0x21
[<ffffffff81057e68>] ? hrtimer_start_range_ns+0xf/0x11
[<ffffffff810df1b2>] poll_schedule_timeout+0x43/0x5f
[<ffffffff810df5b8>] do_sys_poll+0x35a/0x3e5
[<ffffffff810e02d7>] ? __pollwait+0x0/0xc7
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff81491fb3>] ? tty_ldisc_deref+0x9/0xb
[<ffffffff8148c609>] ? tty_write+0x210/0x22c
[<ffffffff8105c8fe>] ? ktime_get_ts+0xad/0xba
[<ffffffff810df154>] ? poll_select_set_timeout+0x61/0x7c
[<ffffffff810df7d7>] sys_poll+0x50/0xba
[<ffffffff810029ab>] system_call_fastpath+0x16/0x1b

Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 57
CPU 1: hi: 186, btch: 31 usd: 152
Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 53
CPU 1: hi: 186, btch: 31 usd: 120
active_anon:310769 inactive_anon:151667 isolated_anon:0
active_file:221427 inactive_file:221406 isolated_file:196
unevictable:58 dirty:57 writeback:78685 unstable:12577
free:8938 slab_reclaimable:8493 slab_unreclaimable:12282
mapped:40115 shmem:12921 pagetables:3763 bounce:0
DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:180kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 2900 3910 3910
DMA32 free:17540kB min:5924kB low:7404kB high:8884kB active_anon:1046340kB inactive_anon:337384kB active_file:673368kB inactive_file:673268kB unevictable:0kB isolated(anon):0kB isolated(file):524kB present:2970488kB mlocked:0kB dirty:152kB writeback:231716kB mapped:114856kB shmem:44512kB slab_reclaimable:16896kB slab_unreclaimable:31052kB kernel_stack:1048kB pagetables:10312kB unstable:35368kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 1010 1010
Normal free:2568kB min:2060kB low:2572kB high:3088kB active_anon:196736kB inactive_anon:269284kB active_file:212340kB inactive_file:212176kB unevictable:232kB isolated(anon):0kB isolated(file):260kB present:1034240kB mlocked:140kB dirty:76kB writeback:83024kB mapped:45604kB shmem:7172kB slab_reclaimable:17076kB slab_unreclaimable:18068kB kernel_stack:1320kB pagetables:4740kB unstable:14940kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 1*4kB 1*8kB 1*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15644kB
DMA32: 4125*4kB 20*8kB 8*16kB 19*32kB 3*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 17588kB
Normal: 574*4kB 4*8kB 5*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2568kB
456115 total pagecache pages
224 pages in swap cache
Swap cache stats: add 2592, delete 2368, find 88793/88822
Free swap = 4191584kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
654204 pages shared
418337 pages non-shared
syslog-ng: page allocation failure. order:1, mode:0x4020
Pid: 5830, comm: syslog-ng Not tainted 2.6.34-pentoo #5

Call Trace:
<IRQ>  [<ffffffff8109cb74>] __alloc_pages_nodemask+0x571/0x5b9
[<ffffffffa04881e4>] iwlagn_rx_allocate+0x98/0x25a [iwlagn]
[<ffffffffa0487bd3>] ? iwlagn_rx_reply_rx+0x332/0x34d [iwlagn]
[<ffffffff814739c5>] ? is_swiotlb_buffer+0x2e/0x3b
[<ffffffffa04884f7>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[<ffffffffa047cb95>] iwl_rx_handle+0x29a/0x2d1 [iwlagn]
[<ffffffffa047d2c0>] iwl_irq_tasklet+0x2f7/0x412 [iwlagn]
[<ffffffff81044f58>] tasklet_action+0x6f/0xba
[<ffffffff81045998>] __do_softirq+0x91/0x119
[<ffffffff8100384c>] call_softirq+0x1c/0x28
[<ffffffff8100550b>] do_softirq+0x33/0x68
[<ffffffff81045695>] irq_exit+0x36/0x87
[<ffffffff81004bef>] do_IRQ+0xa7/0xbe
[<ffffffff8176c253>] ret_from_intr+0x0/0xa
<EOI>  [<ffffffff8100330e>] ? apic_timer_interrupt+0xe/0x20
[<ffffffff8176be39>] ? _raw_spin_unlock_irq+0x10/0x28
[<ffffffff81037326>] finish_task_switch+0x45/0xae
[<ffffffff81769e8a>] schedule+0x76f/0x842
[<ffffffff8176ad50>] schedule_hrtimeout_range+0xeb/0x132
[<ffffffff81057346>] ? hrtimer_wakeup+0x0/0x21
[<ffffffff81057e68>] ? hrtimer_start_range_ns+0xf/0x11
[<ffffffff810df1b2>] poll_schedule_timeout+0x43/0x5f
[<ffffffff810df5b8>] do_sys_poll+0x35a/0x3e5
[<ffffffff810e02d7>] ? __pollwait+0x0/0xc7
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff81491fb3>] ? tty_ldisc_deref+0x9/0xb
[<ffffffff8148c609>] ? tty_write+0x210/0x22c
[<ffffffff8105c8fe>] ? ktime_get_ts+0xad/0xba
[<ffffffff810df154>] ? poll_select_set_timeout+0x61/0x7c
[<ffffffff810df7d7>] sys_poll+0x50/0xba
[<ffffffff810029ab>] system_call_fastpath+0x16/0x1b

Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 57
CPU 1: hi: 186, btch: 31 usd: 151
Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 53
CPU 1: hi: 186, btch: 31 usd: 120
active_anon:310769 inactive_anon:151667 isolated_anon:0
active_file:221427 inactive_file:221406 isolated_file:196
unevictable:58 dirty:57 writeback:78685 unstable:12577
free:8938 slab_reclaimable:8493 slab_unreclaimable:12282
mapped:40115 shmem:12921 pagetables:3763 bounce:0
DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:180kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 2900 3910 3910
DMA32 free:17540kB min:5924kB low:7404kB high:8884kB active_anon:1046340kB inactive_anon:337384kB active_file:673368kB inactive_file:673268kB unevictable:0kB isolated(anon):0kB isolated(file):524kB present:2970488kB mlocked:0kB dirty:152kB writeback:231716kB mapped:114856kB shmem:44512kB slab_reclaimable:16896kB slab_unreclaimable:31052kB kernel_stack:1048kB pagetables:10312kB unstable:35368kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 1010 1010
Normal free:2568kB min:2060kB low:2572kB high:3088kB active_anon:196736kB inactive_anon:269284kB active_file:212340kB inactive_file:212176kB unevictable:232kB isolated(anon):0kB isolated(file):260kB present:1034240kB mlocked:140kB dirty:76kB writeback:83024kB mapped:45604kB shmem:7172kB slab_reclaimable:17076kB slab_unreclaimable:18068kB kernel_stack:1320kB pagetables:4740kB unstable:14940kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 1*4kB 1*8kB 1*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15644kB
DMA32: 4125*4kB 23*8kB 8*16kB 19*32kB 3*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 17612kB
Normal: 574*4kB 4*8kB 5*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2568kB
456115 total pagecache pages
224 pages in swap cache
Swap cache stats: add 2592, delete 2368, find 88793/88822
Free swap = 4191584kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
654204 pages shared
418332 pages non-shared
syslog-ng: page allocation failure. order:1, mode:0x4020
Pid: 5830, comm: syslog-ng Not tainted 2.6.34-pentoo #5

Call Trace:
<IRQ>  [<ffffffff8109cb74>] __alloc_pages_nodemask+0x571/0x5b9
[<ffffffffa04881e4>] iwlagn_rx_allocate+0x98/0x25a [iwlagn]
[<ffffffff8105175a>] ? queue_work+0x4b/0x55
[<ffffffff814739c5>] ? is_swiotlb_buffer+0x2e/0x3b
[<ffffffffa04884f7>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[<ffffffffa047cb95>] iwl_rx_handle+0x29a/0x2d1 [iwlagn]
[<ffffffffa047d2c0>] iwl_irq_tasklet+0x2f7/0x412 [iwlagn]
[<ffffffff81044f58>] tasklet_action+0x6f/0xba
[<ffffffff81045998>] __do_softirq+0x91/0x119
[<ffffffff8100384c>] call_softirq+0x1c/0x28
[<ffffffff8100550b>] do_softirq+0x33/0x68
[<ffffffff81045695>] irq_exit+0x36/0x87
[<ffffffff81004bef>] do_IRQ+0xa7/0xbe
[<ffffffff8176c253>] ret_from_intr+0x0/0xa
<EOI>  [<ffffffff8100330e>] ? apic_timer_interrupt+0xe/0x20
[<ffffffff8176be39>] ? _raw_spin_unlock_irq+0x10/0x28
[<ffffffff81037326>] finish_task_switch+0x45/0xae
[<ffffffff81769e8a>] schedule+0x76f/0x842
[<ffffffff8176ad50>] schedule_hrtimeout_range+0xeb/0x132
[<ffffffff81057346>] ? hrtimer_wakeup+0x0/0x21
[<ffffffff81057e68>] ? hrtimer_start_range_ns+0xf/0x11
[<ffffffff810df1b2>] poll_schedule_timeout+0x43/0x5f
[<ffffffff810df5b8>] do_sys_poll+0x35a/0x3e5
[<ffffffff810e02d7>] ? __pollwait+0x0/0xc7
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff81491fb3>] ? tty_ldisc_deref+0x9/0xb
[<ffffffff8148c609>] ? tty_write+0x210/0x22c
[<ffffffff8105c8fe>] ? ktime_get_ts+0xad/0xba
[<ffffffff810df154>] ? poll_select_set_timeout+0x61/0x7c
[<ffffffff810df7d7>] sys_poll+0x50/0xba
[<ffffffff810029ab>] system_call_fastpath+0x16/0x1b

Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 57
CPU 1: hi: 186, btch: 31 usd: 151
Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 53
CPU 1: hi: 186, btch: 31 usd: 120
active_anon:310769 inactive_anon:151667 isolated_anon:0
active_file:221427 inactive_file:221406 isolated_file:196
unevictable:58 dirty:57 writeback:78685 unstable:12577
free:8938 slab_reclaimable:8493 slab_unreclaimable:12282
mapped:40115 shmem:12921 pagetables:3763 bounce:0
DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:180kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 2900 3910 3910
DMA32 free:17540kB min:5924kB low:7404kB high:8884kB active_anon:1046340kB inactive_anon:337384kB active_file:673368kB inactive_file:673268kB unevictable:0kB isolated(anon):0kB isolated(file):524kB present:2970488kB mlocked:0kB dirty:152kB writeback:231716kB mapped:114856kB shmem:44512kB slab_reclaimable:16896kB slab_unreclaimable:31052kB kernel_stack:1048kB pagetables:10312kB unstable:35368kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 1010 1010
Normal free:2568kB min:2060kB low:2572kB high:3088kB active_anon:196736kB inactive_anon:269284kB active_file:212340kB inactive_file:212176kB unevictable:232kB isolated(anon):0kB isolated(file):260kB present:1034240kB mlocked:140kB dirty:76kB writeback:83024kB mapped:45604kB shmem:7172kB slab_reclaimable:17076kB slab_unreclaimable:18068kB kernel_stack:1320kB pagetables:4740kB unstable:14940kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 1*4kB 1*8kB 1*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15644kB
DMA32: 4125*4kB 23*8kB 8*16kB 19*32kB 3*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 17612kB
Normal: 574*4kB 4*8kB 5*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2568kB
456115 total pagecache pages
224 pages in swap cache
Swap cache stats: add 2592, delete 2368, find 88793/88822
Free swap = 4191584kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
654204 pages shared
418332 pages non-shared
syslog-ng: page allocation failure. order:1, mode:0x4020
Pid: 5830, comm: syslog-ng Not tainted 2.6.34-pentoo #5

Call Trace:
<IRQ>  [<ffffffff8109cb74>] __alloc_pages_nodemask+0x571/0x5b9
[<ffffffffa04881e4>] iwlagn_rx_allocate+0x98/0x25a [iwlagn]
[<ffffffffa0487bd3>] ? iwlagn_rx_reply_rx+0x332/0x34d [iwlagn]
[<ffffffff814739c5>] ? is_swiotlb_buffer+0x2e/0x3b
[<ffffffffa04884f7>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[<ffffffffa047cb95>] iwl_rx_handle+0x29a/0x2d1 [iwlagn]
[<ffffffffa047d2c0>] iwl_irq_tasklet+0x2f7/0x412 [iwlagn]
[<ffffffff81044f58>] tasklet_action+0x6f/0xba
[<ffffffff81045998>] __do_softirq+0x91/0x119
[<ffffffff8100384c>] call_softirq+0x1c/0x28
[<ffffffff8100550b>] do_softirq+0x33/0x68
[<ffffffff81045695>] irq_exit+0x36/0x87
[<ffffffff81004bef>] do_IRQ+0xa7/0xbe
[<ffffffff8176c253>] ret_from_intr+0x0/0xa
<EOI>  [<ffffffff8100330e>] ? apic_timer_interrupt+0xe/0x20
[<ffffffff8176be39>] ? _raw_spin_unlock_irq+0x10/0x28
[<ffffffff81037326>] finish_task_switch+0x45/0xae
[<ffffffff81769e8a>] schedule+0x76f/0x842
[<ffffffff8176ad50>] schedule_hrtimeout_range+0xeb/0x132
[<ffffffff81057346>] ? hrtimer_wakeup+0x0/0x21
[<ffffffff81057e68>] ? hrtimer_start_range_ns+0xf/0x11
[<ffffffff810df1b2>] poll_schedule_timeout+0x43/0x5f
[<ffffffff810df5b8>] do_sys_poll+0x35a/0x3e5
[<ffffffff810e02d7>] ? __pollwait+0x0/0xc7
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff810e039e>] ? pollwake+0x0/0x52
[<ffffffff81491fb3>] ? tty_ldisc_deref+0x9/0xb
[<ffffffff8148c609>] ? tty_write+0x210/0x22c
[<ffffffff8105c8fe>] ? ktime_get_ts+0xad/0xba
[<ffffffff810df154>] ? poll_select_set_timeout+0x61/0x7c
[<ffffffff810df7d7>] sys_poll+0x50/0xba
[<ffffffff810029ab>] system_call_fastpath+0x16/0x1b

Mem-Info:
DMA per-cpu:
CPU 0: hi: 0, btch: 1 usd: 0
CPU 1: hi: 0, btch: 1 usd: 0
DMA32 per-cpu:
CPU 0: hi: 186, btch: 31 usd: 55
CPU 1: hi: 186, btch: 31 usd: 151
Normal per-cpu:
CPU 0: hi: 186, btch: 31 usd: 53
CPU 1: hi: 186, btch: 31 usd: 120
active_anon:310769 inactive_anon:151667 isolated_anon:0
active_file:221427 inactive_file:221406 isolated_file:196
unevictable:58 dirty:57 writeback:78685 unstable:12577
free:8938 slab_reclaimable:8493 slab_unreclaimable:12282
mapped:40115 shmem:12921 pagetables:3763 bounce:0
DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:180kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 2900 3910 3910
DMA32 free:17540kB min:5924kB low:7404kB high:8884kB active_anon:1046340kB inactive_anon:337384kB active_file:673368kB inactive_file:673268kB unevictable:0kB isolated(anon):0kB isolated(file):524kB present:2970488kB mlocked:0kB dirty:152kB writeback:231716kB mapped:114856kB shmem:44512kB slab_reclaimable:16896kB slab_unreclaimable:31052kB kernel_stack:1048kB pagetables:10312kB unstable:35368kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no lowmem_reserve[]: 0 0 1010 1010
Normal free:2568kB min:2060kB low:2572kB high:3088kB active_anon:196736kB inactive_anon:269284kB active_file:212340kB inactive_file:212176kB unevictable:232kB isolated(anon):0kB isolated(file):260kB present:1034240kB mlocked:140kB dirty:76kB writeback:83024kB mapped:45604kB shmem:7172kB slab_reclaimable:17076kB slab_unreclaimable:18068kB kernel_stack:1320kB pagetables:4740kB unstable:14940kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no lowmem_reserve[]: 0 0 0 0
DMA: 1*4kB 1*8kB 1*16kB 0*32kB 0*64kB 0*128kB 1*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15644kB
DMA32: 4125*4kB 25*8kB 8*16kB 19*32kB 3*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 17628kB
Normal: 574*4kB 4*8kB 5*16kB 1*32kB 0*64kB 1*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 2568kB
456115 total pagecache pages
224 pages in swap cache
Swap cache stats: add 2592, delete 2368, find 88793/88822
Free swap = 4191584kB
Total swap = 4200992kB
1048560 pages RAM
83434 pages reserved
654203 pages shared
418328 pages non-shared
net_ratelimit: 4701 callbacks suppressed
Monitor-Mwait will be used to enter C-2 state
Monitor-Mwait will be used to enter C-3 state

First mac80211 runs out of memory ... it cannot even allocate enough memory for a skb header.

Next driver runs out of memory.

Note that the above are all atomic allocations that fail and should be able to recover.

Is your system low on memory? Are you running applications that take a lot of memory? Does your wifi connection drop or otherwise suffer at the time you see these messages?

Reinette

I have 4GB of RAM on this system, I often run a VM which wastes like half that but that still leaves 2GB for linux and I'm running XFCE4 so not exactly a memory hog. It's possible that firefox leaks ram until I'm out but that would be a LOT of leak, much more than I usually see.

Yeah, as you may guess these errors cause my wifi connection to slow drastically. If I had to guess, since this happens when I make a large file transfer it is likely that something related is leaking RAM. I'm using wget or axel to download and NFS to dump the files on a NAS. I'll try to trigger this again and watch memory usage to see if I can find something other than the driver that could be leaking. Failing that, what do I need to enable to find a leak in the driver?

Thanks,
Rick Farina

Hi Richard,

There has been an issue with atomic memory allocations ever since 2.6.31. This used to be easy to trigger with iwlagn, but we fixed a number of issues. There are still issue with any atomic memory allocation (not just iwlagn) and this issue is still open. You can find more information at https://bugzilla.kernel.org/show_bug.cgi?id=14141

The driver, when unable to allocate memory atomically, will reattempt the allocation later when it can use GFP_KERNEL. I think there may be ways in which we can try to optimize this since right now it will only schedule this when there are about 8 buffers remaining. I was looking at your trace again and even though you state "Kernel 2.6.34 using compat-wireless stable 2.6.35-rc2" ... the trace you provide does not seem to match the driver code from 2.6.35-rc2. Could you please confirm which version of driver you are running so that I can prepare a patch?

Does this happen every time you run this test? I would like to get an idea whether we will get a clear indication whether our changes will help or not.

Perhaps kmemleak?

Reinette

There were two compat-wireless releases for 2.6.35_rc2 because Luis had asked me to test and then he changed it for the official release. I'll use the official 2.6.35_rc2 release for the current testing so if there are any patches you wish to toss my way please base them on that. The other option is you tell me what to do, I can run any kernel, any git snapshot, whatever you say. Like I said, all I have to do is download something or transfer something large so it is pretty easily reproducible here so I'll test whatever you like.

Thanks,
Rick Farina

Could you please try out this patch? It is based on the latest linux-2.6 so should apply cleanly to your latest 2.6.35 stable compat.

index 0f292a2..028db74 100644
@@ -613,7 +613,7 @@ void iwlagn_rx_allocate(struct iwl_priv *priv, gfp_t priority)
 		}
 		spin_unlock_irqrestore(&rxq->lock, flags);
 
-		if (rxq->free_count > RX_LOW_WATERMARK)
+		if (rxq->free_count > 8)
 			gfp_mask |= __GFP_NOWARN;
 
 		if (priv->hw_params.rx_page_order > 0)

index 113c366..396a16c 100644
@@ -426,7 +426,7 @@
  * RX related structures and functions
  */
 #define RX_FREE_BUFFERS 64
-#define RX_LOW_WATERMARK 8
+#define RX_LOW_WATERMARK 64
 
 /* Size of one Rx buffer in host DRAM */
 #define IWL_RX_BUF_SIZE_3K (3 * 1000) /* 3945 only */

I've added this patch to my system. I'm about 5GB into a download right now and here are the issues. First, and relatively quickly this line showed up in dmesg:

[ 1589.605470] CE: hpet increased min_delta_ns to 7500 nsec

I've been carefully monitoring my system and I have loads of RAM spare.
Things have been much smoother but the system still freezes up for a few seconds at a time. Mind you, this is an improvement as the freezes are slightly less frequent and before the patch the freezes were hitting the 120s hangcheck timer in the kernel and now they last like 20-60 seconds.

I finally managed to trigger the oops again but it does seem that it took much longer this time. Pasted at the bottom. (please note the timestamps included are accurate to show the time difference bettween the hpet warning and the oops).

What else can I do to provide useful information? Or do you just want to update the thresholds again?

Thanks,
Rick Farina

PS> The patch does look at bit odd as you change RX_LOW_WATERMARK while at the same time removing one of the places that uses it. I'm sure that is on purpose just seems odd to me as I don't understand.

[ 4705.404568] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 14 free buffers remaining.
[ 4705.404586] swapper: page allocation failure. order:1, mode:0x4020
[ 4705.404589] Pid: 0, comm: swapper Not tainted 2.6.34-pentoo-r2 #2
[ 4705.404591] Call Trace:
[ 4705.404593]  <IRQ>  [<ffffffff810984c0>] __alloc_pages_nodemask+0x571/0x5b9
[ 4705.404614]  [<ffffffffa05162f3>] iwlagn_rx_allocate+0x98/0x2e0 [iwlagn]
[ 4705.404622]  [<ffffffffa051668c>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[ 4705.404628]  [<ffffffffa0500cc6>] iwl_rx_handle+0x4a6/0x4c2 [iwlagn]
[ 4705.404632]  [<ffffffff8103156c>] ? __wake_up_common+0x49/0x7f
[ 4705.404639]  [<ffffffffa0502766>] iwl_irq_tasklet+0xb0e/0xecd [iwlagn]
[ 4705.404644]  [<ffffffff8170ab2f>] ? _raw_spin_unlock_irq+0x26/0x28
[ 4705.404650]  [<ffffffffa050a7ef>] ? iwl_isr_ict+0x8e7/0xa49 [iwlagn]
[ 4705.404653]  [<ffffffff81044ca0>] tasklet_action+0x6f/0xba
[ 4705.404657]  [<ffffffff810193dc>] ? lapic_next_event+0x18/0x1c
[ 4705.404660]  [<ffffffff810456d7>] __do_softirq+0x91/0x11a
[ 4705.404664]  [<ffffffff8100384c>] call_softirq+0x1c/0x28
[ 4705.404666]  [<ffffffff8100550b>] do_softirq+0x33/0x68
[ 4705.404669]  [<ffffffff810453d4>] irq_exit+0x36/0x87
[ 4705.404672]  [<ffffffff81004bf0>] do_IRQ+0xa7/0xbe
[ 4705.404675]  [<ffffffff8170af13>] ret_from_intr+0x0/0xa
[ 4705.404677]  <EOI>  [<ffffffff814f2453>] ? acpi_idle_enter_simple+0x150/0x17b
[ 4705.404684]  [<ffffffff814f2449>] ? acpi_idle_enter_simple+0x146/0x17b
[ 4705.404689]  [<ffffffff816035c4>] cpuidle_idle_call+0x8b/0xc3
[ 4705.404692]  [<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[ 4705.404696]  [<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[ 4705.404700]  [<ffffffff816ecbc1>] rest_init+0xb5/0xba
[ 4705.404704]  [<ffffffff81acbb65>] start_kernel+0x3f2/0x3fd
[ 4705.404707]  [<ffffffff81acb0b6>] x86_64_start_reservations+0xb3/0xb7
[ 4705.404710]  [<ffffffff81acb19a>] x86_64_start_kernel+0xe0/0xe7
[ 4705.404712] Mem-Info:
[ 4705.404714] DMA per-cpu:
[ 4705.404716] CPU    0: hi:    0, btch:   1 usd:   0
[ 4705.404718] CPU    1: hi:    0, btch:   1 usd:   0
[ 4705.404719] DMA32 per-cpu:
[ 4705.404721] CPU    0: hi:  186, btch:  31 usd: 160
[ 4705.404723] CPU    1: hi:  186, btch:  31 usd: 154
[ 4705.404724] Normal per-cpu:
[ 4705.404726] CPU    0: hi:  186, btch:  31 usd: 145
[ 4705.404728] CPU    1: hi:  186, btch:  31 usd: 185
[ 4705.404732] active_anon:341531 inactive_anon:114822 isolated_anon:0
[ 4705.404733]  active_file:153488 inactive_file:295800 isolated_file:210
[ 4705.404734]  unevictable:23 dirty:14035 writeback:28555 unstable:33013
[ 4705.404735]  free:6788 slab_reclaimable:9432 slab_unreclaimable:12868
[ 4705.404736]  mapped:37668 shmem:12218 pagetables:3822 bounce:0
[ 4705.404742] DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:120kB inactive_file:60kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.404747] lowmem_reserve[]: 0 2900 3910 3910
[ 4705.404755] DMA32 free:10748kB min:5924kB low:7404kB high:8884kB active_anon:1238044kB inactive_anon:323152kB active_file:347988kB inactive_file:909448kB unevictable:0kB isolated(anon):0kB isolated(file):576kB present:2970488kB mlocked:0kB dirty:45440kB writeback:92884kB mapped:8036kB shmem:14132kB slab_reclaimable:15944kB slab_unreclaimable:26600kB kernel_stack:104kB pagetables:3688kB unstable:101736kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.404761] lowmem_reserve[]: 0 0 1010 1010
[ 4705.404768] Normal free:760kB min:2060kB low:2572kB high:3088kB active_anon:128080kB inactive_anon:136136kB active_file:265844kB inactive_file:273692kB unevictable:92kB isolated(anon):0kB isolated(file):264kB present:1034240kB mlocked:0kB dirty:10700kB writeback:21336kB mapped:142636kB shmem:34740kB slab_reclaimable:21784kB slab_unreclaimable:24864kB kernel_stack:2160kB pagetables:11600kB unstable:30316kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.404774] lowmem_reserve[]: 0 0 0 0
[ 4705.404777] DMA: 3*4kB 2*8kB 0*16kB 2*32kB 3*64kB 0*128kB 2*256kB 1*512kB 2*1024kB 2*2048kB 2*4096kB = 15644kB
[ 4705.404785] DMA32: 2440*4kB 78*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 10832kB
[ 4705.404792] Normal: 76*4kB 11*8kB 17*16kB 3*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 760kB
[ 4705.404800] 461661 total pagecache pages
[ 4705.404801] 0 pages in swap cache
[ 4705.404803] Swap cache stats: add 0, delete 0, find 0/0
[ 4705.404804] Free swap  = 4200992kB
[ 4705.404806] Total swap = 4200992kB
[ 4705.419628] 1048560 pages RAM
[ 4705.419630] 83243 pages reserved
[ 4705.419632] 626146 pages shared
[ 4705.419633] 399708 pages non-shared
[ 4705.419637] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 5 free buffers remaining.
[ 4705.419690] swapper: page allocation failure. order:1, mode:0x4020
[ 4705.419694] Pid: 0, comm: swapper Not tainted 2.6.34-pentoo-r2 #2
[ 4705.419696] Call Trace:
[ 4705.419698]  <IRQ>  [<ffffffff810984c0>] __alloc_pages_nodemask+0x571/0x5b9
[ 4705.419717]  [<ffffffffa05162f3>] iwlagn_rx_allocate+0x98/0x2e0 [iwlagn]
[ 4705.419722]  [<ffffffff810bebf8>] ? discard_slab+0x31/0x33
[ 4705.419727]  [<ffffffff8147e871>] ? is_swiotlb_buffer+0x2e/0x3b
[ 4705.419735]  [<ffffffffa051668c>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[ 4705.419742]  [<ffffffffa0500ca1>] iwl_rx_handle+0x481/0x4c2 [iwlagn]
[ 4705.419747]  [<ffffffff8162c7b6>] ? __kfree_skb+0x19/0x7c
[ 4705.419753]  [<ffffffffa0502766>] iwl_irq_tasklet+0xb0e/0xecd [iwlagn]
[ 4705.419757]  [<ffffffff8162c01f>] ? skb_dequeue+0x5f/0x6b
[ 4705.419761]  [<ffffffff81044ca0>] tasklet_action+0x6f/0xba
[ 4705.419765]  [<ffffffff810456d7>] __do_softirq+0x91/0x11a
[ 4705.419769]  [<ffffffff8100384c>] call_softirq+0x1c/0x28
[ 4705.419773]  [<ffffffff8100550b>] do_softirq+0x33/0x68
[ 4705.419776]  [<ffffffff810453d4>] irq_exit+0x36/0x87
[ 4705.419779]  [<ffffffff81004bf0>] do_IRQ+0xa7/0xbe
[ 4705.419784]  [<ffffffff8170af13>] ret_from_intr+0x0/0xa
[ 4705.419786]  <EOI>  [<ffffffff814f2453>] ? acpi_idle_enter_simple+0x150/0x17b
[ 4705.419794]  [<ffffffff814f2449>] ? acpi_idle_enter_simple+0x146/0x17b
[ 4705.419799]  [<ffffffff816035c4>] cpuidle_idle_call+0x8b/0xc3
[ 4705.419803]  [<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[ 4705.419807]  [<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[ 4705.419811]  [<ffffffff816ecbc1>] rest_init+0xb5/0xba
[ 4705.419816]  [<ffffffff81acbb65>] start_kernel+0x3f2/0x3fd
[ 4705.419820]  [<ffffffff81acb0b6>] x86_64_start_reservations+0xb3/0xb7
[ 4705.419823]  [<ffffffff81acb19a>] x86_64_start_kernel+0xe0/0xe7
[ 4705.419825] Mem-Info:
[ 4705.419827] DMA per-cpu:
[ 4705.419830] CPU    0: hi:    0, btch:   1 usd:   0
[ 4705.419832] CPU    1: hi:    0, btch:   1 usd:   0
[ 4705.419833] DMA32 per-cpu:
[ 4705.419835] CPU    0: hi:  186, btch:  31 usd: 160
[ 4705.419838] CPU    1: hi:  186, btch:  31 usd: 155
[ 4705.419839] Normal per-cpu:
[ 4705.419841] CPU    0: hi:  186, btch:  31 usd: 151
[ 4705.419844] CPU    1: hi:  186, btch:  31 usd: 185
[ 4705.419848] active_anon:341531 inactive_anon:114822 isolated_anon:0
[ 4705.419849]  active_file:153488 inactive_file:295800 isolated_file:210
[ 4705.419850]  unevictable:23 dirty:14035 writeback:28555 unstable:33013
[ 4705.419851]  free:6788 slab_reclaimable:9432 slab_unreclaimable:12851
[ 4705.419852]  mapped:37668 shmem:12218 pagetables:3822 bounce:0
[ 4705.419859] DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:120kB inactive_file:60kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.419864] lowmem_reserve[]: 0 2900 3910 3910
[ 4705.419874] DMA32 free:10748kB min:5924kB low:7404kB high:8884kB active_anon:1238044kB inactive_anon:323152kB active_file:347988kB inactive_file:909448kB unevictable:0kB isolated(anon):0kB isolated(file):576kB present:2970488kB mlocked:0kB dirty:45440kB writeback:92884kB mapped:8036kB shmem:14132kB slab_reclaimable:15944kB slab_unreclaimable:26600kB kernel_stack:104kB pagetables:3688kB unstable:101736kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.419880] lowmem_reserve[]: 0 0 1010 1010
[ 4705.419890] Normal free:760kB min:2060kB low:2572kB high:3088kB active_anon:128080kB inactive_anon:136136kB active_file:265844kB inactive_file:273692kB unevictable:92kB isolated(anon):0kB isolated(file):264kB present:1034240kB mlocked:0kB dirty:10700kB writeback:21336kB mapped:142636kB shmem:34740kB slab_reclaimable:21784kB slab_unreclaimable:24796kB kernel_stack:2160kB pagetables:11600kB unstable:30316kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.419896] lowmem_reserve[]: 0 0 0 0
[ 4705.419901] DMA: 3*4kB 2*8kB 0*16kB 2*32kB 3*64kB 0*128kB 2*256kB 1*512kB 2*1024kB 2*2048kB 2*4096kB = 15644kB
[ 4705.419914] DMA32: 2440*4kB 78*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 10832kB
[ 4705.419926] Normal: 76*4kB 11*8kB 17*16kB 3*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 760kB
[ 4705.419939] 461661 total pagecache pages
[ 4705.419941] 0 pages in swap cache
[ 4705.419943] Swap cache stats: add 0, delete 0, find 0/0
[ 4705.419945] Free swap  = 4200992kB
[ 4705.419946] Total swap = 4200992kB
[ 4705.435226] 1048560 pages RAM
[ 4705.435229] 83243 pages reserved
[ 4705.435230] 626151 pages shared
[ 4705.435232] 399702 pages non-shared
[ 4705.435235] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 1 free buffers remaining.
[ 4705.435289] swapper: page allocation failure. order:1, mode:0x4020
[ 4705.435293] Pid: 0, comm: swapper Not tainted 2.6.34-pentoo-r2 #2
[ 4705.435295] Call Trace:
[ 4705.435297]  <IRQ>  [<ffffffff810984c0>] __alloc_pages_nodemask+0x571/0x5b9
[ 4705.435318]  [<ffffffffa05162f3>] iwlagn_rx_allocate+0x98/0x2e0 [iwlagn]
[ 4705.435331]  [<ffffffffa04cf5bb>] ? iwl_rx_statistics+0x2f5/0x325 [iwlcore]
[ 4705.435336]  [<ffffffff8147e871>] ? is_swiotlb_buffer+0x2e/0x3b
[ 4705.435343]  [<ffffffffa051668c>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[ 4705.435349]  [<ffffffffa0500ca1>] iwl_rx_handle+0x481/0x4c2 [iwlagn]
[ 4705.435354]  [<ffffffff8162c7b6>] ? __kfree_skb+0x19/0x7c
[ 4705.435360]  [<ffffffffa0502766>] iwl_irq_tasklet+0xb0e/0xecd [iwlagn]
[ 4705.435363]  [<ffffffff8162c01f>] ? skb_dequeue+0x5f/0x6b
[ 4705.435367]  [<ffffffff81044ca0>] tasklet_action+0x6f/0xba
[ 4705.435370]  [<ffffffff810456d7>] __do_softirq+0x91/0x11a
[ 4705.435374]  [<ffffffff8100384c>] call_softirq+0x1c/0x28
[ 4705.435377]  [<ffffffff8100550b>] do_softirq+0x33/0x68
[ 4705.435379]  [<ffffffff810453d4>] irq_exit+0x36/0x87
[ 4705.435382]  [<ffffffff81004bf0>] do_IRQ+0xa7/0xbe
[ 4705.435387]  [<ffffffff8170af13>] ret_from_intr+0x0/0xa
[ 4705.435389]  <EOI>  [<ffffffff814f2453>] ? acpi_idle_enter_simple+0x150/0x17b
[ 4705.435396]  [<ffffffff814f2449>] ? acpi_idle_enter_simple+0x146/0x17b
[ 4705.435401]  [<ffffffff816035c4>] cpuidle_idle_call+0x8b/0xc3
[ 4705.435405]  [<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[ 4705.435409]  [<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[ 4705.435414]  [<ffffffff816ecbc1>] rest_init+0xb5/0xba
[ 4705.435418]  [<ffffffff81acbb65>] start_kernel+0x3f2/0x3fd
[ 4705.435422]  [<ffffffff81acb0b6>] x86_64_start_reservations+0xb3/0xb7
[ 4705.435425]  [<ffffffff81acb19a>] x86_64_start_kernel+0xe0/0xe7
[ 4705.435426] Mem-Info:
[ 4705.435428] DMA per-cpu:
[ 4705.435430] CPU    0: hi:    0, btch:   1 usd:   0
[ 4705.435432] CPU    1: hi:    0, btch:   1 usd:   0
[ 4705.435433] DMA32 per-cpu:
[ 4705.435435] CPU    0: hi:  186, btch:  31 usd: 159
[ 4705.435437] CPU    1: hi:  186, btch:  31 usd: 150
[ 4705.435438] Normal per-cpu:
[ 4705.435440] CPU    0: hi:  186, btch:  31 usd: 151
[ 4705.435442] CPU    1: hi:  186, btch:  31 usd: 185
[ 4705.435447] active_anon:341531 inactive_anon:114822 isolated_anon:0
[ 4705.435448]  active_file:153488 inactive_file:295800 isolated_file:210
[ 4705.435449]  unevictable:23 dirty:14035 writeback:28555 unstable:33013
[ 4705.435450]  free:6788 slab_reclaimable:9432 slab_unreclaimable:12851
[ 4705.435451]  mapped:37668 shmem:12218 pagetables:3822 bounce:0
[ 4705.435457] DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:120kB inactive_file:60kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.435462] lowmem_reserve[]: 0 2900 3910 3910
[ 4705.435470] DMA32 free:10748kB min:5924kB low:7404kB high:8884kB active_anon:1238044kB inactive_anon:323152kB active_file:347988kB inactive_file:909448kB unevictable:0kB isolated(anon):0kB isolated(file):576kB present:2970488kB mlocked:0kB dirty:45440kB writeback:92884kB mapped:8036kB shmem:14132kB slab_reclaimable:15944kB slab_unreclaimable:26600kB kernel_stack:104kB pagetables:3688kB unstable:101736kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.435476] lowmem_reserve[]: 0 0 1010 1010
[ 4705.435484] Normal free:760kB min:2060kB low:2572kB high:3088kB active_anon:128080kB inactive_anon:136136kB active_file:265844kB inactive_file:273692kB unevictable:92kB isolated(anon):0kB isolated(file):264kB present:1034240kB mlocked:0kB dirty:10700kB writeback:21336kB mapped:142636kB shmem:34740kB slab_reclaimable:21784kB slab_unreclaimable:24796kB kernel_stack:2160kB pagetables:11600kB unstable:30316kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.435489] lowmem_reserve[]: 0 0 0 0
[ 4705.435492] DMA: 3*4kB 2*8kB 0*16kB 2*32kB 3*64kB 0*128kB 2*256kB 1*512kB 2*1024kB 2*2048kB 2*4096kB = 15644kB
[ 4705.435501] DMA32: 2440*4kB 81*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 10856kB
[ 4705.435509] Normal: 76*4kB 11*8kB 17*16kB 3*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 760kB
[ 4705.435517] 461661 total pagecache pages
[ 4705.435519] 0 pages in swap cache
[ 4705.435521] Swap cache stats: add 0, delete 0, find 0/0
[ 4705.435522] Free swap  = 4200992kB
[ 4705.435523] Total swap = 4200992kB
[ 4705.450608] 1048560 pages RAM
[ 4705.450610] 83243 pages reserved
[ 4705.450611] 626155 pages shared
[ 4705.450612] 399697 pages non-shared
[ 4705.450616] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 5 free buffers remaining.
[ 4705.450675] swapper: page allocation failure. order:1, mode:0x4020
[ 4705.450679] Pid: 0, comm: swapper Not tainted 2.6.34-pentoo-r2 #2
[ 4705.450681] Call Trace:
[ 4705.450683]  <IRQ>  [<ffffffff810984c0>] __alloc_pages_nodemask+0x571/0x5b9
[ 4705.450703]  [<ffffffffa05162f3>] iwlagn_rx_allocate+0x98/0x2e0 [iwlagn]
[ 4705.450709]  [<ffffffff8147e871>] ? is_swiotlb_buffer+0x2e/0x3b
[ 4705.450716]  [<ffffffffa051668c>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[ 4705.450722]  [<ffffffffa0500ca1>] iwl_rx_handle+0x481/0x4c2 [iwlagn]
[ 4705.450726]  [<ffffffff8162c7b6>] ? __kfree_skb+0x19/0x7c
[ 4705.450733]  [<ffffffffa0502766>] iwl_irq_tasklet+0xb0e/0xecd [iwlagn]
[ 4705.450736]  [<ffffffff8162c01f>] ? skb_dequeue+0x5f/0x6b
[ 4705.450740]  [<ffffffff81044ca0>] tasklet_action+0x6f/0xba
[ 4705.450743]  [<ffffffff810456d7>] __do_softirq+0x91/0x11a
[ 4705.450747]  [<ffffffff8100384c>] call_softirq+0x1c/0x28
[ 4705.450750]  [<ffffffff8100550b>] do_softirq+0x33/0x68
[ 4705.450753]  [<ffffffff810453d4>] irq_exit+0x36/0x87
[ 4705.450755]  [<ffffffff81004bf0>] do_IRQ+0xa7/0xbe
[ 4705.450761]  [<ffffffff8170af13>] ret_from_intr+0x0/0xa
[ 4705.450762]  <EOI>  [<ffffffff814f2453>] ? acpi_idle_enter_simple+0x150/0x17b
[ 4705.450770]  [<ffffffff814f2449>] ? acpi_idle_enter_simple+0x146/0x17b
[ 4705.450775]  [<ffffffff816035c4>] cpuidle_idle_call+0x8b/0xc3
[ 4705.450780]  [<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[ 4705.450783]  [<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[ 4705.450789]  [<ffffffff816ecbc1>] rest_init+0xb5/0xba
[ 4705.450793]  [<ffffffff81acbb65>] start_kernel+0x3f2/0x3fd
[ 4705.450797]  [<ffffffff81acb0b6>] x86_64_start_reservations+0xb3/0xb7
[ 4705.450800]  [<ffffffff81acb19a>] x86_64_start_kernel+0xe0/0xe7
[ 4705.450801] Mem-Info:
[ 4705.450803] DMA per-cpu:
[ 4705.450805] CPU    0: hi:    0, btch:   1 usd:   0
[ 4705.450807] CPU    1: hi:    0, btch:   1 usd:   0
[ 4705.450808] DMA32 per-cpu:
[ 4705.450810] CPU    0: hi:  186, btch:  31 usd: 155
[ 4705.450812] CPU    1: hi:  186, btch:  31 usd: 148
[ 4705.450813] Normal per-cpu:
[ 4705.450815] CPU    0: hi:  186, btch:  31 usd: 151
[ 4705.450817] CPU    1: hi:  186, btch:  31 usd: 185
[ 4705.450821] active_anon:341531 inactive_anon:114822 isolated_anon:0
[ 4705.450822]  active_file:153488 inactive_file:295800 isolated_file:210
[ 4705.450823]  unevictable:23 dirty:14035 writeback:28555 unstable:33013
[ 4705.450824]  free:6788 slab_reclaimable:9432 slab_unreclaimable:12851
[ 4705.450825]  mapped:37668 shmem:12218 pagetables:3822 bounce:0
[ 4705.450831] DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:120kB inactive_file:60kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.450835] lowmem_reserve[]: 0 2900 3910 3910
[ 4705.450843] DMA32 free:10748kB min:5924kB low:7404kB high:8884kB active_anon:1238044kB inactive_anon:323152kB active_file:347988kB inactive_file:909448kB unevictable:0kB isolated(anon):0kB isolated(file):576kB present:2970488kB mlocked:0kB dirty:45440kB writeback:92884kB mapped:8036kB shmem:14132kB slab_reclaimable:15944kB slab_unreclaimable:26600kB kernel_stack:104kB pagetables:3688kB unstable:101736kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.450848] lowmem_reserve[]: 0 0 1010 1010
[ 4705.450855] Normal free:760kB min:2060kB low:2572kB high:3088kB active_anon:128080kB inactive_anon:136136kB active_file:265844kB inactive_file:273692kB unevictable:92kB isolated(anon):0kB isolated(file):264kB present:1034240kB mlocked:0kB dirty:10700kB writeback:21336kB mapped:142636kB shmem:34740kB slab_reclaimable:21784kB slab_unreclaimable:24796kB kernel_stack:2160kB pagetables:11600kB unstable:30316kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.450860] lowmem_reserve[]: 0 0 0 0
[ 4705.450863] DMA: 3*4kB 2*8kB 0*16kB 2*32kB 3*64kB 0*128kB 2*256kB 1*512kB 2*1024kB 2*2048kB 2*4096kB = 15644kB
[ 4705.450871] DMA32: 2440*4kB 85*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 10888kB
[ 4705.450878] Normal: 76*4kB 11*8kB 17*16kB 3*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 760kB
[ 4705.450885] 461661 total pagecache pages
[ 4705.450887] 0 pages in swap cache
[ 4705.450888] Swap cache stats: add 0, delete 0, find 0/0
[ 4705.450890] Free swap  = 4200992kB
[ 4705.450891] Total swap = 4200992kB
[ 4705.465982] 1048560 pages RAM
[ 4705.465984] 83243 pages reserved
[ 4705.465986] 626159 pages shared
[ 4705.465987] 399693 pages non-shared
[ 4705.465990] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 4 free buffers remaining.
[ 4705.466048] swapper: page allocation failure. order:1, mode:0x4020
[ 4705.466052] Pid: 0, comm: swapper Not tainted 2.6.34-pentoo-r2 #2
[ 4705.466054] Call Trace:
[ 4705.466056]  <IRQ>  [<ffffffff810984c0>] __alloc_pages_nodemask+0x571/0x5b9
[ 4705.466076]  [<ffffffffa05162f3>] iwlagn_rx_allocate+0x98/0x2e0 [iwlagn]
[ 4705.466080]  [<ffffffff810513ca>] ? queue_work+0x4b/0x55
[ 4705.466085]  [<ffffffff8147e871>] ? is_swiotlb_buffer+0x2e/0x3b
[ 4705.466092]  [<ffffffffa051668c>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[ 4705.466098]  [<ffffffffa0500ca1>] iwl_rx_handle+0x481/0x4c2 [iwlagn]
[ 4705.466103]  [<ffffffff8162c7b6>] ? __kfree_skb+0x19/0x7c
[ 4705.466109]  [<ffffffffa0502766>] iwl_irq_tasklet+0xb0e/0xecd [iwlagn]
[ 4705.466112]  [<ffffffff8162c01f>] ? skb_dequeue+0x5f/0x6b
[ 4705.466116]  [<ffffffff81044ca0>] tasklet_action+0x6f/0xba
[ 4705.466119]  [<ffffffff810456d7>] __do_softirq+0x91/0x11a
[ 4705.466123]  [<ffffffff8100384c>] call_softirq+0x1c/0x28
[ 4705.466126]  [<ffffffff8100550b>] do_softirq+0x33/0x68
[ 4705.466128]  [<ffffffff810453d4>] irq_exit+0x36/0x87
[ 4705.466131]  [<ffffffff81004bf0>] do_IRQ+0xa7/0xbe
[ 4705.466137]  [<ffffffff8170af13>] ret_from_intr+0x0/0xa
[ 4705.466139]  <EOI>  [<ffffffff814f2453>] ? acpi_idle_enter_simple+0x150/0x17b
[ 4705.466146]  [<ffffffff814f2449>] ? acpi_idle_enter_simple+0x146/0x17b
[ 4705.466150]  [<ffffffff816035c4>] cpuidle_idle_call+0x8b/0xc3
[ 4705.466154]  [<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[ 4705.466158]  [<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[ 4705.466163]  [<ffffffff816ecbc1>] rest_init+0xb5/0xba
[ 4705.466168]  [<ffffffff81acbb65>] start_kernel+0x3f2/0x3fd
[ 4705.466171]  [<ffffffff81acb0b6>] x86_64_start_reservations+0xb3/0xb7
[ 4705.466174]  [<ffffffff81acb19a>] x86_64_start_kernel+0xe0/0xe7
[ 4705.466176] Mem-Info:
[ 4705.466178] DMA per-cpu:
[ 4705.466179] CPU    0: hi:    0, btch:   1 usd:   0
[ 4705.466181] CPU    1: hi:    0, btch:   1 usd:   0
[ 4705.466183] DMA32 per-cpu:
[ 4705.466184] CPU    0: hi:  186, btch:  31 usd: 151
[ 4705.466186] CPU    1: hi:  186, btch:  31 usd: 147
[ 4705.466188] Normal per-cpu:
[ 4705.466190] CPU    0: hi:  186, btch:  31 usd: 151
[ 4705.466192] CPU    1: hi:  186, btch:  31 usd: 185
[ 4705.466196] active_anon:341531 inactive_anon:114822 isolated_anon:0
[ 4705.466197]  active_file:153488 inactive_file:295800 isolated_file:210
[ 4705.466198]  unevictable:23 dirty:14035 writeback:28555 unstable:33013
[ 4705.466199]  free:6813 slab_reclaimable:9432 slab_unreclaimable:12851
[ 4705.466200]  mapped:37668 shmem:12218 pagetables:3822 bounce:0
[ 4705.466206] DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:120kB inactive_file:60kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.466211] lowmem_reserve[]: 0 2900 3910 3910
[ 4705.466219] DMA32 free:10848kB min:5924kB low:7404kB high:8884kB active_anon:1238044kB inactive_anon:323152kB active_file:347988kB inactive_file:909448kB unevictable:0kB isolated(anon):0kB isolated(file):576kB present:2970488kB mlocked:0kB dirty:45440kB writeback:92884kB mapped:8036kB shmem:14132kB slab_reclaimable:15944kB slab_unreclaimable:26600kB kernel_stack:104kB pagetables:3688kB unstable:101736kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.466225] lowmem_reserve[]: 0 0 1010 1010
[ 4705.466233] Normal free:760kB min:2060kB low:2572kB high:3088kB active_anon:128080kB inactive_anon:136136kB active_file:265844kB inactive_file:273692kB unevictable:92kB isolated(anon):0kB isolated(file):264kB present:1034240kB mlocked:0kB dirty:10700kB writeback:21336kB mapped:142636kB shmem:34740kB slab_reclaimable:21784kB slab_unreclaimable:24796kB kernel_stack:2160kB pagetables:11600kB unstable:30316kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.466238] lowmem_reserve[]: 0 0 0 0
[ 4705.466241] DMA: 3*4kB 2*8kB 0*16kB 2*32kB 3*64kB 0*128kB 2*256kB 1*512kB 2*1024kB 2*2048kB 2*4096kB = 15644kB
[ 4705.466250] DMA32: 2440*4kB 89*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 10920kB
[ 4705.466258] Normal: 76*4kB 11*8kB 17*16kB 3*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 760kB
[ 4705.466266] 461661 total pagecache pages
[ 4705.466268] 0 pages in swap cache
[ 4705.466270] Swap cache stats: add 0, delete 0, find 0/0
[ 4705.466271] Free swap  = 4200992kB
[ 4705.466272] Total swap = 4200992kB
[ 4705.481398] 1048560 pages RAM
[ 4705.481400] 83243 pages reserved
[ 4705.481402] 626163 pages shared
[ 4705.481403] 399690 pages non-shared
[ 4705.481458] swapper: page allocation failure. order:1, mode:0x4020
[ 4705.481462] Pid: 0, comm: swapper Not tainted 2.6.34-pentoo-r2 #2
[ 4705.481464] Call Trace:
[ 4705.481465]  <IRQ>  [<ffffffff810984c0>] __alloc_pages_nodemask+0x571/0x5b9
[ 4705.481483]  [<ffffffffa05162f3>] iwlagn_rx_allocate+0x98/0x2e0 [iwlagn]
[ 4705.481488]  [<ffffffff8147e871>] ? is_swiotlb_buffer+0x2e/0x3b
[ 4705.481495]  [<ffffffffa051668c>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[ 4705.481501]  [<ffffffffa0500ca1>] iwl_rx_handle+0x481/0x4c2 [iwlagn]
[ 4705.481506]  [<ffffffff8162c7b6>] ? __kfree_skb+0x19/0x7c
[ 4705.481512]  [<ffffffffa0502766>] iwl_irq_tasklet+0xb0e/0xecd [iwlagn]
[ 4705.481515]  [<ffffffff8162c01f>] ? skb_dequeue+0x5f/0x6b
[ 4705.481519]  [<ffffffff81044ca0>] tasklet_action+0x6f/0xba
[ 4705.481522]  [<ffffffff810456d7>] __do_softirq+0x91/0x11a
[ 4705.481526]  [<ffffffff8100384c>] call_softirq+0x1c/0x28
[ 4705.481529]  [<ffffffff8100550b>] do_softirq+0x33/0x68
[ 4705.481531]  [<ffffffff810453d4>] irq_exit+0x36/0x87
[ 4705.481534]  [<ffffffff81004bf0>] do_IRQ+0xa7/0xbe
[ 4705.481539]  [<ffffffff8170af13>] ret_from_intr+0x0/0xa
[ 4705.481540]  <EOI>  [<ffffffff814f2453>] ? acpi_idle_enter_simple+0x150/0x17b
[ 4705.481547]  [<ffffffff814f2449>] ? acpi_idle_enter_simple+0x146/0x17b
[ 4705.481551]  [<ffffffff816035c4>] cpuidle_idle_call+0x8b/0xc3
[ 4705.481555]  [<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[ 4705.481559]  [<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[ 4705.481563]  [<ffffffff816ecbc1>] rest_init+0xb5/0xba
[ 4705.481567]  [<ffffffff81acbb65>] start_kernel+0x3f2/0x3fd
[ 4705.481570]  [<ffffffff81acb0b6>] x86_64_start_reservations+0xb3/0xb7
[ 4705.481573]  [<ffffffff81acb19a>] x86_64_start_kernel+0xe0/0xe7
[ 4705.481575] Mem-Info:
[ 4705.481577] DMA per-cpu:
[ 4705.481578] CPU    0: hi:    0, btch:   1 usd:   0
[ 4705.481580] CPU    1: hi:    0, btch:   1 usd:   0
[ 4705.481582] DMA32 per-cpu:
[ 4705.481584] CPU    0: hi:  186, btch:  31 usd: 146
[ 4705.481585] CPU    1: hi:  186, btch:  31 usd: 144
[ 4705.481587] Normal per-cpu:
[ 4705.481589] CPU    0: hi:  186, btch:  31 usd: 151
[ 4705.481591] CPU    1: hi:  186, btch:  31 usd: 185
[ 4705.481595] active_anon:341531 inactive_anon:114822 isolated_anon:0
[ 4705.481596]  active_file:153488 inactive_file:295800 isolated_file:210
[ 4705.481597]  unevictable:23 dirty:14035 writeback:28555 unstable:33013
[ 4705.481598]  free:6813 slab_reclaimable:9432 slab_unreclaimable:12876
[ 4705.481599]  mapped:37668 shmem:12218 pagetables:3822 bounce:0
[ 4705.481605] DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:120kB inactive_file:60kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.481610] lowmem_reserve[]: 0 2900 3910 3910
[ 4705.481618] DMA32 free:10848kB min:5924kB low:7404kB high:8884kB active_anon:1238044kB inactive_anon:323152kB active_file:347988kB inactive_file:909448kB unevictable:0kB isolated(anon):0kB isolated(file):576kB present:2970488kB mlocked:0kB dirty:45440kB writeback:92884kB mapped:8036kB shmem:14132kB slab_reclaimable:15944kB slab_unreclaimable:26700kB kernel_stack:104kB pagetables:3688kB unstable:101736kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.481624] lowmem_reserve[]: 0 0 1010 1010
[ 4705.481632] Normal free:760kB min:2060kB low:2572kB high:3088kB active_anon:128080kB inactive_anon:136136kB active_file:265844kB inactive_file:273692kB unevictable:92kB isolated(anon):0kB isolated(file):264kB present:1034240kB mlocked:0kB dirty:10700kB writeback:21336kB mapped:142636kB shmem:34740kB slab_reclaimable:21784kB slab_unreclaimable:24796kB kernel_stack:2160kB pagetables:11600kB unstable:30316kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.481637] lowmem_reserve[]: 0 0 0 0
[ 4705.481640] DMA: 3*4kB 2*8kB 0*16kB 2*32kB 3*64kB 0*128kB 2*256kB 1*512kB 2*1024kB 2*2048kB 2*4096kB = 15644kB
[ 4705.481649] DMA32: 2440*4kB 93*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 10952kB
[ 4705.481657] Normal: 76*4kB 11*8kB 17*16kB 3*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 760kB
[ 4705.481665] 461661 total pagecache pages
[ 4705.481666] 0 pages in swap cache
[ 4705.481668] Swap cache stats: add 0, delete 0, find 0/0
[ 4705.481670] Free swap  = 4200992kB
[ 4705.481671] Total swap = 4200992kB
[ 4705.497155] 1048560 pages RAM
[ 4705.497157] 83243 pages reserved
[ 4705.497158] 626163 pages shared
[ 4705.497160] 399687 pages non-shared
[ 4705.497211] swapper: page allocation failure. order:1, mode:0x4020
[ 4705.497215] Pid: 0, comm: swapper Not tainted 2.6.34-pentoo-r2 #2
[ 4705.497217] Call Trace:
[ 4705.497219]  <IRQ>  [<ffffffff810984c0>] __alloc_pages_nodemask+0x571/0x5b9
[ 4705.497238]  [<ffffffffa05162f3>] iwlagn_rx_allocate+0x98/0x2e0 [iwlagn]
[ 4705.497243]  [<ffffffff810513ca>] ? queue_work+0x4b/0x55
[ 4705.497248]  [<ffffffff8147e871>] ? is_swiotlb_buffer+0x2e/0x3b
[ 4705.497256]  [<ffffffffa051668c>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[ 4705.497262]  [<ffffffffa0500ca1>] iwl_rx_handle+0x481/0x4c2 [iwlagn]
[ 4705.497267]  [<ffffffff8162c7b6>] ? __kfree_skb+0x19/0x7c
[ 4705.497274]  [<ffffffffa0502766>] iwl_irq_tasklet+0xb0e/0xecd [iwlagn]
[ 4705.497277]  [<ffffffff8162c01f>] ? skb_dequeue+0x5f/0x6b
[ 4705.497282]  [<ffffffff81044ca0>] tasklet_action+0x6f/0xba
[ 4705.497285]  [<ffffffff810456d7>] __do_softirq+0x91/0x11a
[ 4705.497289]  [<ffffffff8100384c>] call_softirq+0x1c/0x28
[ 4705.497293]  [<ffffffff8100550b>] do_softirq+0x33/0x68
[ 4705.497296]  [<ffffffff810453d4>] irq_exit+0x36/0x87
[ 4705.497299]  [<ffffffff81004bf0>] do_IRQ+0xa7/0xbe
[ 4705.497304]  [<ffffffff8170af13>] ret_from_intr+0x0/0xa
[ 4705.497306]  <EOI>  [<ffffffff814f2453>] ? acpi_idle_enter_simple+0x150/0x17b
[ 4705.497314]  [<ffffffff814f2449>] ? acpi_idle_enter_simple+0x146/0x17b
[ 4705.497319]  [<ffffffff816035c4>] cpuidle_idle_call+0x8b/0xc3
[ 4705.497323]  [<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[ 4705.497327]  [<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[ 4705.497331]  [<ffffffff816ecbc1>] rest_init+0xb5/0xba
[ 4705.497336]  [<ffffffff81acbb65>] start_kernel+0x3f2/0x3fd
[ 4705.497340]  [<ffffffff81acb0b6>] x86_64_start_reservations+0xb3/0xb7
[ 4705.497344]  [<ffffffff81acb19a>] x86_64_start_kernel+0xe0/0xe7
[ 4705.497346] Mem-Info:
[ 4705.497348] DMA per-cpu:
[ 4705.497350] CPU    0: hi:    0, btch:   1 usd:   0
[ 4705.497352] CPU    1: hi:    0, btch:   1 usd:   0
[ 4705.497354] DMA32 per-cpu:
[ 4705.497356] CPU    0: hi:  186, btch:  31 usd: 173
[ 4705.497358] CPU    1: hi:  186, btch:  31 usd: 145
[ 4705.497360] Normal per-cpu:
[ 4705.497361] CPU    0: hi:  186, btch:  31 usd: 151
[ 4705.497364] CPU    1: hi:  186, btch:  31 usd: 185
[ 4705.497368] active_anon:341531 inactive_anon:114822 isolated_anon:0
[ 4705.497369]  active_file:153488 inactive_file:295800 isolated_file:210
[ 4705.497370]  unevictable:23 dirty:14035 writeback:28555 unstable:33013
[ 4705.497371]  free:6813 slab_reclaimable:9432 slab_unreclaimable:12876
[ 4705.497372]  mapped:37668 shmem:12218 pagetables:3822 bounce:0
[ 4705.497379] DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:120kB inactive_file:60kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.497384] lowmem_reserve[]: 0 2900 3910 3910
[ 4705.497394] DMA32 free:10848kB min:5924kB low:7404kB high:8884kB active_anon:1238044kB inactive_anon:323152kB active_file:347988kB inactive_file:909448kB unevictable:0kB isolated(anon):0kB isolated(file):576kB present:2970488kB mlocked:0kB dirty:45440kB writeback:92884kB mapped:8036kB shmem:14132kB slab_reclaimable:15944kB slab_unreclaimable:26700kB kernel_stack:104kB pagetables:3688kB unstable:101736kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.497400] lowmem_reserve[]: 0 0 1010 1010
[ 4705.497410] Normal free:760kB min:2060kB low:2572kB high:3088kB active_anon:128080kB inactive_anon:136136kB active_file:265844kB inactive_file:273692kB unevictable:92kB isolated(anon):0kB isolated(file):264kB present:1034240kB mlocked:0kB dirty:10700kB writeback:21336kB mapped:142636kB shmem:34740kB slab_reclaimable:21784kB slab_unreclaimable:24796kB kernel_stack:2160kB pagetables:11600kB unstable:30316kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.497416] lowmem_reserve[]: 0 0 0 0
[ 4705.497421] DMA: 3*4kB 2*8kB 0*16kB 2*32kB 3*64kB 0*128kB 2*256kB 1*512kB 2*1024kB 2*2048kB 2*4096kB = 15644kB
[ 4705.497433] DMA32: 2451*4kB 76*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 10860kB
[ 4705.497446] Normal: 76*4kB 11*8kB 17*16kB 3*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 760kB
[ 4705.497459] 461661 total pagecache pages
[ 4705.497461] 0 pages in swap cache
[ 4705.497463] Swap cache stats: add 0, delete 0, find 0/0
[ 4705.497465] Free swap  = 4200992kB
[ 4705.497467] Total swap = 4200992kB
[ 4705.513089] 1048560 pages RAM
[ 4705.513091] 83243 pages reserved
[ 4705.513092] 626165 pages shared
[ 4705.513094] 399682 pages non-shared
[ 4705.513153] swapper: page allocation failure. order:1, mode:0x4020
[ 4705.513157] Pid: 0, comm: swapper Not tainted 2.6.34-pentoo-r2 #2
[ 4705.513159] Call Trace:
[ 4705.513161]  <IRQ>  [<ffffffff810984c0>] __alloc_pages_nodemask+0x571/0x5b9
[ 4705.513182]  [<ffffffffa05162f3>] iwlagn_rx_allocate+0x98/0x2e0 [iwlagn]
[ 4705.513187]  [<ffffffff8147e871>] ? is_swiotlb_buffer+0x2e/0x3b
[ 4705.513194]  [<ffffffffa051668c>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[ 4705.513201]  [<ffffffffa0500ca1>] iwl_rx_handle+0x481/0x4c2 [iwlagn]
[ 4705.513206]  [<ffffffff8162c7b6>] ? __kfree_skb+0x19/0x7c
[ 4705.513213]  [<ffffffffa0502766>] iwl_irq_tasklet+0xb0e/0xecd [iwlagn]
[ 4705.513216]  [<ffffffff8162c01f>] ? skb_dequeue+0x5f/0x6b
[ 4705.513221]  [<ffffffff81044ca0>] tasklet_action+0x6f/0xba
[ 4705.513225]  [<ffffffff810456d7>] __do_softirq+0x91/0x11a
[ 4705.513229]  [<ffffffff8100384c>] call_softirq+0x1c/0x28
[ 4705.513232]  [<ffffffff8100550b>] do_softirq+0x33/0x68
[ 4705.513236]  [<ffffffff810453d4>] irq_exit+0x36/0x87
[ 4705.513239]  [<ffffffff81004bf0>] do_IRQ+0xa7/0xbe
[ 4705.513244]  [<ffffffff8170af13>] ret_from_intr+0x0/0xa
[ 4705.513246]  <EOI>  [<ffffffff814f2453>] ? acpi_idle_enter_simple+0x150/0x17b
[ 4705.513254]  [<ffffffff814f2449>] ? acpi_idle_enter_simple+0x146/0x17b
[ 4705.513259]  [<ffffffff816035c4>] cpuidle_idle_call+0x8b/0xc3
[ 4705.513263]  [<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[ 4705.513267]  [<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[ 4705.513271]  [<ffffffff816ecbc1>] rest_init+0xb5/0xba
[ 4705.513276]  [<ffffffff81acbb65>] start_kernel+0x3f2/0x3fd
[ 4705.513280]  [<ffffffff81acb0b6>] x86_64_start_reservations+0xb3/0xb7
[ 4705.513283]  [<ffffffff81acb19a>] x86_64_start_kernel+0xe0/0xe7
[ 4705.513286] Mem-Info:
[ 4705.513287] DMA per-cpu:
[ 4705.513289] CPU    0: hi:    0, btch:   1 usd:   0
[ 4705.513291] CPU    1: hi:    0, btch:   1 usd:   0
[ 4705.513293] DMA32 per-cpu:
[ 4705.513295] CPU    0: hi:  186, btch:  31 usd: 169
[ 4705.513298] CPU    1: hi:  186, btch:  31 usd: 142
[ 4705.513299] Normal per-cpu:
[ 4705.513301] CPU    0: hi:  186, btch:  31 usd: 151
[ 4705.513303] CPU    1: hi:  186, btch:  31 usd: 185
[ 4705.513308] active_anon:341531 inactive_anon:114822 isolated_anon:0
[ 4705.513309]  active_file:153488 inactive_file:295800 isolated_file:210
[ 4705.513310]  unevictable:23 dirty:14035 writeback:28555 unstable:33013
[ 4705.513311]  free:6813 slab_reclaimable:9432 slab_unreclaimable:12876
[ 4705.513312]  mapped:37668 shmem:12218 pagetables:3822 bounce:0
[ 4705.513319] DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:120kB inactive_file:60kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.513324] lowmem_reserve[]: 0 2900 3910 3910
[ 4705.513334] DMA32 free:10848kB min:5924kB low:7404kB high:8884kB active_anon:1238044kB inactive_anon:323152kB active_file:347988kB inactive_file:909448kB unevictable:0kB isolated(anon):0kB isolated(file):576kB present:2970488kB mlocked:0kB dirty:45440kB writeback:92884kB mapped:8036kB shmem:14132kB slab_reclaimable:15944kB slab_unreclaimable:26700kB kernel_stack:104kB pagetables:3688kB unstable:101736kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.513340] lowmem_reserve[]: 0 0 1010 1010
[ 4705.513350] Normal free:760kB min:2060kB low:2572kB high:3088kB active_anon:128080kB inactive_anon:136136kB active_file:265844kB inactive_file:273692kB unevictable:92kB isolated(anon):0kB isolated(file):264kB present:1034240kB mlocked:0kB dirty:10700kB writeback:21336kB mapped:142636kB shmem:34740kB slab_reclaimable:21784kB slab_unreclaimable:24796kB kernel_stack:2160kB pagetables:11600kB unstable:30316kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.513356] lowmem_reserve[]: 0 0 0 0
[ 4705.513361] DMA: 3*4kB 2*8kB 0*16kB 2*32kB 3*64kB 0*128kB 2*256kB 1*512kB 2*1024kB 2*2048kB 2*4096kB = 15644kB
[ 4705.513374] DMA32: 2451*4kB 80*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 10892kB
[ 4705.513386] Normal: 76*4kB 11*8kB 17*16kB 3*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 760kB
[ 4705.513399] 461661 total pagecache pages
[ 4705.513401] 0 pages in swap cache
[ 4705.513403] Swap cache stats: add 0, delete 0, find 0/0
[ 4705.513405] Free swap  = 4200992kB
[ 4705.513406] Total swap = 4200992kB
[ 4705.528482] 1048560 pages RAM
[ 4705.528484] 83243 pages reserved
[ 4705.528485] 626172 pages shared
[ 4705.528487] 399630 pages non-shared
[ 4705.528586] swapper: page allocation failure. order:1, mode:0x4020
[ 4705.528590] Pid: 0, comm: swapper Not tainted 2.6.34-pentoo-r2 #2
[ 4705.528591] Call Trace:
[ 4705.528593]  <IRQ>  [<ffffffff810984c0>] __alloc_pages_nodemask+0x571/0x5b9
[ 4705.528611]  [<ffffffffa05162f3>] iwlagn_rx_allocate+0x98/0x2e0 [iwlagn]
[ 4705.528617]  [<ffffffff8147e871>] ? is_swiotlb_buffer+0x2e/0x3b
[ 4705.528624]  [<ffffffffa051668c>] iwlagn_rx_replenish_now+0x16/0x23 [iwlagn]
[ 4705.528630]  [<ffffffffa0500ca1>] iwl_rx_handle+0x481/0x4c2 [iwlagn]
[ 4705.528635]  [<ffffffff8162c7b6>] ? __kfree_skb+0x19/0x7c
[ 4705.528641]  [<ffffffffa0502766>] iwl_irq_tasklet+0xb0e/0xecd [iwlagn]
[ 4705.528644]  [<ffffffff8162c01f>] ? skb_dequeue+0x5f/0x6b
[ 4705.528649]  [<ffffffff81044ca0>] tasklet_action+0x6f/0xba
[ 4705.528652]  [<ffffffff810456d7>] __do_softirq+0x91/0x11a
[ 4705.528655]  [<ffffffff8100384c>] call_softirq+0x1c/0x28
[ 4705.528658]  [<ffffffff8100550b>] do_softirq+0x33/0x68
[ 4705.528661]  [<ffffffff810453d4>] irq_exit+0x36/0x87
[ 4705.528664]  [<ffffffff81004bf0>] do_IRQ+0xa7/0xbe
[ 4705.528668]  [<ffffffff8170af13>] ret_from_intr+0x0/0xa
[ 4705.528670]  <EOI>  [<ffffffff814f2453>] ? acpi_idle_enter_simple+0x150/0x17b
[ 4705.528678]  [<ffffffff814f2449>] ? acpi_idle_enter_simple+0x146/0x17b
[ 4705.528682]  [<ffffffff816035c4>] cpuidle_idle_call+0x8b/0xc3
[ 4705.528685]  [<ffffffff81001ca7>] cpu_idle+0xa6/0xe7
[ 4705.528688]  [<ffffffff81003750>] ? kernel_thread_helper+0x0/0x10
[ 4705.528693]  [<ffffffff816ecbc1>] rest_init+0xb5/0xba
[ 4705.528699]  [<ffffffff81acbb65>] start_kernel+0x3f2/0x3fd
[ 4705.528703]  [<ffffffff81acb0b6>] x86_64_start_reservations+0xb3/0xb7
[ 4705.528706]  [<ffffffff81acb19a>] x86_64_start_kernel+0xe0/0xe7
[ 4705.528708] Mem-Info:
[ 4705.528709] DMA per-cpu:
[ 4705.528711] CPU    0: hi:    0, btch:   1 usd:   0
[ 4705.528714] CPU    1: hi:    0, btch:   1 usd:   0
[ 4705.528715] DMA32 per-cpu:
[ 4705.528717] CPU    0: hi:  186, btch:  31 usd: 164
[ 4705.528719] CPU    1: hi:  186, btch:  31 usd: 154
[ 4705.528720] Normal per-cpu:
[ 4705.528721] CPU    0: hi:  186, btch:  31 usd: 148
[ 4705.528723] CPU    1: hi:  186, btch:  31 usd: 179
[ 4705.528728] active_anon:341531 inactive_anon:114822 isolated_anon:0
[ 4705.528729]  active_file:153488 inactive_file:295736 isolated_file:245
[ 4705.528730]  unevictable:23 dirty:14035 writeback:28555 unstable:33013
[ 4705.528731]  free:6808 slab_reclaimable:9432 slab_unreclaimable:12876
[ 4705.528732]  mapped:37668 shmem:12218 pagetables:3822 bounce:0
[ 4705.528737] DMA free:15644kB min:28kB low:32kB high:40kB active_anon:0kB inactive_anon:0kB active_file:120kB inactive_file:60kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15708kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:8kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.528741] lowmem_reserve[]: 0 2900 3910 3910
[ 4705.528749] DMA32 free:10848kB min:5924kB low:7404kB high:8884kB active_anon:1238044kB inactive_anon:323152kB active_file:347988kB inactive_file:909272kB unevictable:0kB isolated(anon):0kB isolated(file):716kB present:2970488kB mlocked:0kB dirty:45440kB writeback:92884kB mapped:8036kB shmem:14132kB slab_reclaimable:15944kB slab_unreclaimable:26700kB kernel_stack:104kB pagetables:3688kB unstable:101736kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.528754] lowmem_reserve[]: 0 0 1010 1010
[ 4705.528761] Normal free:740kB min:2060kB low:2572kB high:3088kB active_anon:128080kB inactive_anon:136136kB active_file:265844kB inactive_file:273612kB unevictable:92kB isolated(anon):0kB isolated(file):264kB present:1034240kB mlocked:0kB dirty:10700kB writeback:21336kB mapped:142636kB shmem:34740kB slab_reclaimable:21784kB slab_unreclaimable:24796kB kernel_stack:2160kB pagetables:11600kB unstable:30316kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4705.528766] lowmem_reserve[]: 0 0 0 0
[ 4705.528769] DMA: 3*4kB 2*8kB 0*16kB 2*32kB 3*64kB 0*128kB 2*256kB 1*512kB 2*1024kB 2*2048kB 2*4096kB = 15644kB
[ 4705.528778] DMA32: 2451*4kB 88*8kB 0*16kB 0*32kB 1*64kB 1*128kB 1*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 10956kB
[ 4705.528785] Normal: 93*4kB 0*8kB 17*16kB 3*32kB 0*64kB 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 740kB
[ 4705.528792] 461599 total pagecache pages
[ 4705.528793] 0 pages in swap cache
[ 4705.528795] Swap cache stats: add 0, delete 0, find 0/0
[ 4705.528796] Free swap  = 4200992kB
[ 4705.528798] Total swap = 4200992kB
[ 4705.544019] 1048560 pages RAM
[ 4705.544021] 83243 pages reserved
[ 4705.544023] 626171 pages shared
[ 4705.544024] 399657 pages non-shared

I googled a bit for this string and found a few mentions where it is connected to system hangs. I do not know if you are running into the same issue as these people (did not spend much time reading through all the bug reports), but I did notice that sometimes the people were able to work around the issue by booting with a different clock source (eg. clocksource=jiffies) or disabling hpet (eg. hpet=disable). I am very unfamiliar with this aspect so if this is giving you issues I'd propose you go to lkml or kernel.org bugzilla.

They seem pretty far apart so may not be related ...

Sure ... let's try that. Patch is below. I also made things less noisy when it does fail in atomic.

That was on purpose. Since I increased the watermark I did not want to increase the threshold used to print warnings to the user also. That is why I just made that a hard 8 so that if memory allocation fails we will only start seeing the dumps when we are down to 8 buffers and not the new high watermark.

---
 drivers/net/wireless/iwlwifi/iwl-agn-lib.c |    5 +++--
 drivers/net/wireless/iwlwifi/iwl-fh.h      |    2 +-
 2 files changed, 4 insertions(+), 3 deletions(-)

index 0f292a2..2815ee7 100644
@@ -613,7 +613,8 @@ void iwlagn_rx_allocate(struct iwl_priv *priv, gfp_t priority)
 		}
 		spin_unlock_irqrestore(&rxq->lock, flags);
 
-		if (rxq->free_count > RX_LOW_WATERMARK)
+		if ((priority == GFP_ATOMIC) ||
+		    (rxq->free_count > RX_LOW_WATERMARK / 4))
 			gfp_mask |= __GFP_NOWARN;
 
 		if (priv->hw_params.rx_page_order > 0)

@@ -627,7 +628,7 @@ void iwlagn_rx_allocate(struct iwl_priv *priv, gfp_t priority)
 					       "order: %d\n",
 					       priv->hw_params.rx_page_order);
 
-			if ((rxq->free_count <= RX_LOW_WATERMARK) &&
+			if ((rxq->free_count <= RX_LOW_WATERMARK / 4) &&
 			    net_ratelimit())
 				IWL_CRIT(priv, "Failed to alloc_pages with %s. Only %u free buffers remaining.\n",
 					 priority == GFP_ATOMIC ?  "GFP_ATOMIC" : "GFP_KERNEL",

index 113c366..431bc58 100644
@@ -426,7 +426,7 @@
  * RX related structures and functions
  */
 #define RX_FREE_BUFFERS 64
-#define RX_LOW_WATERMARK 8
+#define RX_LOW_WATERMARK 128
 
 /* Size of one Rx buffer in host DRAM */
 #define IWL_RX_BUF_SIZE_3K (3 * 1000) /* 3945 only */

1.7.0.4

Here I set the allocation mask to not print _any_ warnings when allocation is atomic ...

... clearly this is an allocation warning ...

... but it is an atomic one, which after the patch should not be printing _any_ warning ...

I am very confused now.

Reinette

I dunno, I really don't. but I did just verify the patch and it is correct and applied.

Thanks,
Rick

Could you please verify that it is the patch below and not an earlier patch I sent? Apart from what I mention above there is another strange thing in the logs you provide. In your logs you have the message:

iwlagn 0000:02:00.0: Failed to alloc_pages with
GFP_ATOMIC. Only 40 free buffers remaining.

while the code is:

»-------»-------»-------if ((rxq->free_count <= RX_LOW_WATERMARK / 4) &&
»-------»-------»------- net_ratelimit())
»-------»-------»-------»-------IWL_CRIT(priv, "Failed to alloc_pages with %s. Only %u free buffers remaining.\n", »-------»-------»-------»-------»------- priority == GFP_ATOMIC ? "GFP_ATOMIC" : "GFP_KERNEL", »-------»-------»-------»-------»------- rxq->free_count);

with :
#define RX_LOW_WATERMARK 128

The message in your log should thus not be there since it should only print the message if the free_count less than or equal to 32.

From: Reinette Chatre <[email protected]>
Date: Thu, 24 Jun 2010 10:48:59 -0700
Subject: [PATCH] increase low watermark

---
 drivers/net/wireless/iwlwifi/iwl-agn-lib.c |    5 +++--
 drivers/net/wireless/iwlwifi/iwl-fh.h      |    2 +-
 2 files changed, 4 insertions(+), 3 deletions(-)

index 0f292a2..2815ee7 100644
@@ -613,7 +613,8 @@ void iwlagn_rx_allocate(struct iwl_priv *priv, gfp_t priority)
 		}
 		spin_unlock_irqrestore(&rxq->lock, flags);
 
-		if (rxq->free_count > RX_LOW_WATERMARK)
+		if ((priority == GFP_ATOMIC) ||
+		    (rxq->free_count > RX_LOW_WATERMARK / 4))
 			gfp_mask |= __GFP_NOWARN;
 
 		if (priv->hw_params.rx_page_order > 0)

@@ -627,7 +628,7 @@ void iwlagn_rx_allocate(struct iwl_priv *priv, gfp_t priority)
 					       "order: %d\n",
 					       priv->hw_params.rx_page_order);
 
-			if ((rxq->free_count <= RX_LOW_WATERMARK) &&
+			if ((rxq->free_count <= RX_LOW_WATERMARK / 4) &&
 			    net_ratelimit())
 				IWL_CRIT(priv, "Failed to alloc_pages with %s. Only %u free buffers remaining.\n",
 					 priority == GFP_ATOMIC ?  "GFP_ATOMIC" : "GFP_KERNEL",

index 113c366..431bc58 100644
@@ -426,7 +426,7 @@
  * RX related structures and functions
  */
 #define RX_FREE_BUFFERS 64
-#define RX_LOW_WATERMARK 8
+#define RX_LOW_WATERMARK 128
 
 /* Size of one Rx buffer in host DRAM */
 #define IWL_RX_BUF_SIZE_3K (3 * 1000) /* 3945 only */

1.7.0.4

I verified that I applied the correct patch (for the third time), sad part is, now it is different... I guess I messed up the first three times. Anyway, no oops yet but:

[ 3091.463559] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 21 free buffers remaining.
[ 3091.534626] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 0 free buffers remaining.
[ 3593.179843] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 1 free buffers remaining.
[ 3593.307837] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 26 free buffers remaining.
[ 4091.542698] net_ratelimit: 34 callbacks suppressed
[ 4091.542702] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 25 free buffers remaining.
[ 4091.542724] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 3 free buffers remaining.
[ 4091.555285] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 26 free buffers remaining.
[ 4091.555305] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 0 free buffers remaining.
[ 4258.724351] net_ratelimit: 2073 callbacks suppressed
[ 4258.724372] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 0 free buffers remaining.
[ 4258.753286] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 31 free buffers remaining.
[ 4258.753309] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 2 free buffers remaining.
[ 4258.774133] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 28 free buffers remaining.
[ 5165.260524] net_ratelimit: 21 callbacks suppressed
[ 5166.400305] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 4 free buffers remaining.
[ 5167.126059] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 13 free buffers remaining.
[ 5454.561708] net_ratelimit: 4 callbacks suppressed
[ 5455.245019] iwlagn 0000:02:00.0: Failed to alloc_pages with GFP_ATOMIC. Only 1 free buffers remaining.

I'd certainly list it as improved as it hardly freezes and those aren't kernel oops. However it should be noted that this test didn't seem to have nearly the same speed as the previous test (which may well be due to my internet connection or any number of things having nothing to do with this patch). Point is, I'd definately like to get a faster test it to see if it explodes. Assuming it doesn't, how can I help you find out why it keeps running out of buffers? I'm guessing this isn't expected behavior...

Thanks,
Rick Farina

Some good news is always welcome.

I do not like the idea that this is making your connection slower though ... this could be because we are not more likely to attempt memory allocation when there is still a large number of buffers left ... so we do memory allocation more (too?) often.

Well, the good news seems to be that your system is not running out of memory completely ... it is just that the memory available to atomic allocations is not enough to satisfy all requests. This really sounds like https://bugzilla.kernel.org/show_bug.cgi?id=14141 , which has unfortunately not been resolved yet.

Since the patch below appears to be the one making your system slower ... could you modify the patch to set RX_LOW_WATERMARK to 64? I know it is what we had before, but hopefully that together with the the other changes in this patch will help to make system faster as well as less noisy.

Thank you

Reinette