NFS(?) bug in 2.6.16-rc5-mm3
In certain cases, when programmatically traversing a directory tree mounted through NFS, I get a kernel oops.
Two examples are listed below.
-Joe
BUG: unable to handle kernel paging request at virtual address 0005023c printing eip: c0169848 *pde = 00000000 Oops: 0000 [#1] PREEMPT last sysfs file: /class/net/eth2/ifindex Modules linked in: pl2303 usbserial softdog cisco_ipsec snd_pcm_oss
snd_mixer_oss snd_cs46xx gameport snd_raw
midi snd_seq_device snd_ac97_codec snd_ac97_bus snd_pcm snd_timer snd soundcore snd_page_alloc zoran i2c_algo_bit videodev saa7111 i2c_core pegasus arc4 ppp_mppe ppp_deflate ppp_generic slhc usblp
CPU: 0 EIP: 0060:[<c0169848>] Tainted: P VLI EFLAGS: 00210202 (2.6.16-rc5-mm3 #9)
EIP is at clear_inode+0x70/0x108
eax: d8d81a00 ebx: d3f50860 ecx: d8d81a00 edx: 00050238
esi: d3f50984 edi: 00000002 ebp: ffffe000 esp: f7d8bea8
ds: 007b es: 007b ss: 0068
Process kswapd0 (pid: 176, threadinfo=f7d8a000 task=f7d30030)
Stack: <0>00200296 d3f50860 d8d81a00 c016a853 d3f50860 d3563a20 c016a8e9 d3563a14
c0167e41 f7d8a000 f7d8a000 00000097 000255a8 c17deac0 c0168230 c013c911
f7d8bf54 c013a0fd 00000000 012ad400 00000000 0002d036 000255a8 0000006a
Call Trace:
<c016a853> generic_forget_inode+0x12a/0x15c <c016a8e9> iput+0x53/0x65
<c0167e41> prune_dcache+0x12d/0x162 <c0168230> shrink_dcache_memory+0x14/0x37
<c013c911> shrink_slab+0x131/0x1f7 <c013a0fd> throttle_vm_writeout+0x1e/0x5d
<c013de1f> balance_pgdat+0x2a9/0x36c <c013dfcf> kswapd+0xed/0x103
<c012805c> autoremove_wake_function+0x0/0x43 <c0102866> ret_from_fork+0x6/0x14
<c012805c> autoremove_wake_function+0x0/0x43 <c013dee2> kswapd+0x0/0x103
<c0100eed> kernel_thread_helper+0x5/0xb
Code: 01 00 00 a8 08 0f 85 9b 00 00 00 f6 83 2c 01 00 00 20 0f 85 86 00 00 00 8b83 90 00 00 00 85 c0 89 c1 7
4 31 8b 50 24 85 d2 74 1c <8b> 52 04 85 d2 74 15 31 d2 8b b4 93 e4 00 00 00 85 f6 75 52 83
============================================================================
BUG: unable to handle kernel paging request at virtual address 08ed08b5 printing eip: c016a8b3 *pde = 00000000 Oops: 0000 [#2] PREEMPT last sysfs file: /class/net/eth2/ifindex Modules linked in: pl2303 usbserial softdog cisco_ipsec snd_pcm_oss
snd_mixer_oss snd_cs46xx gameport snd_raw
midi snd_seq_device snd_ac97_codec snd_ac97_bus snd_pcm snd_timer snd soundcore snd_page_alloc zoran i2c_algo_bit videodev saa7111 i2c_core pegasus arc4 ppp_mppe ppp_deflate ppp_generic slhc usblp
CPU: 0 EIP: 0060:[<c016a8b3>] Tainted: P VLI EFLAGS: 00010202 (2.6.16-rc5-mm3 #9)
EIP is at iput+0x1d/0x65
eax: 08ed08a1 ebx: d3f50a00 ecx: d3f50a18 edx: d3f50a18
esi: cf443aa0 edi: 00000045 ebp: ffffe000 esp: c821fb90
ds: 007b es: 007b ss: 0068
Process dvddump (pid: 4210, threadinfo=c821e000 task=f1599570)
Stack: <0>cf443a94 c0167e41 c821e000 c821e000 0000010b 00041c58 c17deac0 c0168230
c013c911 00000000 0001d060 00000000 020e2c00 00000000 00027ae4 00041c58
000000d4 00000000 00000000 000000d0 00000040 c821fc5c c05a51f0 0000000a
Call Trace:
<c0167e41> prune_dcache+0x12d/0x162 <c0168230> shrink_dcache_memory+0x14/0x37
<c013c911> shrink_slab+0x131/0x1f7 <c013dab9> try_to_free_pages+0xee/0x1ab
<c0138ea8> __alloc_pages+0x113/0x29c <c014e03c> cache_grow+0x108/0x171
<c014d344> kmem_getpages+0x2f/0x95 <c014dff8> cache_grow+0xc4/0x171
<c014e20c> cache_alloc_refill+0x167/0x22c <c014e4cb> kmem_cache_alloc+0x3f/0x41
<c016826e> d_alloc+0x1b/0x176 <c01688a6> d_lookup+0x19/0x39
<c022bd94> nfs_readdir_lookup+0xd8/0x34b <c022ab91> nfs_do_filldir+0x5b/0x184
<c0163484> filldir64+0x0/0xdc <c022afcb> nfs_readdir+0x311/0x7a2
<c0163484> filldir64+0x0/0xdc <c0150006> sys_faccessat+0x45/0x132
<c015f233> __link_path_walk+0xc62/0xd4b <c045a61b>
rpcauth_lookup_credcache+0x7f/0x206
<c045a801> rpcauth_lookupcred+0x5f/0xb5 <c0286dea>
radix_tree_gang_lookup_tag+0x49/0x61
<c028958c> __copy_to_user_ll+0x5b/0x69 <c02896a2> copy_to_user+0x36/0x53
<c015aa56> cp_new_stat64+0xfa/0x10e <c0239d5f> nfs3_decode_dirent+0x0/0x1ac
<c0163484> filldir64+0x0/0xdc <c0163214> vfs_readdir+0x94/0xa9
<c01635cd> sys_getdents64+0x6d/0xc0 <c0162799> do_fcntl+0x9e/0x155
<c0102997> syscall_call+0x7/0xb
Code: 85 c9 75 05 e9 4a fd ff ff e9 93 fe ff ff 85 c0 53 89 c3 74 4c 8b 80 90 0000 00 83 bb 24 01 00 00 20 8
b 40 20 74 42 85 c0 74 07 <8b> 50 14 85 d2 75 31 8d 43 24 ba 80 84 68 c0 e8 8d a2 11 00 85
Quoted 3 lines · Joe Feise
In certain cases, when programmatically traversing a directory tree mounted through NFS, I get a kernel oops.
Two examples are listed below.
Please could you retry without the cisco_ipsec module (and whatever else is tainting the kernel).
Cheers,
Trond
Quoted 88 lines
-Joe
BUG: unable to handle kernel paging request at virtual address 0005023c printing eip: c0169848 *pde = 00000000 Oops: 0000 [#1] PREEMPT last sysfs file: /class/net/eth2/ifindex Modules linked in: pl2303 usbserial softdog cisco_ipsec snd_pcm_oss
snd_mixer_osssnd_cs46xxgameportsnd_raw
midisnd_seq_devicesnd_ac97_codecsnd_ac97_bussnd_pcmsnd_timersnd soundcoresnd_page_alloczorani2c_algo_bitvideodev saa7111i2c_corepegasus arc4ppp_mppeppp_deflateppp_genericslhc usblpCPU: 0 EIP: 0060:[<c0169848>] Tainted: P VLI EFLAGS: 00210202 (2.6.16-rc5-mm3 #9)EIP is at
clear_inode+0x70/0x108
eax:d8d81a00ebx:d3f50860ecx:d8d81a00edx: 00050238
esi:d3f50984edi: 00000002 ebp:ffffe000esp:f7d8bea8
ds: 007b es: 007b ss: 0068
Process kswapd0 (pid: 176, threadinfo=f7d8a000 task=f7d30030)Stack: <0>00200296 d3f50860 d8d81a00 c016a853 d3f50860 d3563a20 c016a8e9 d3563a14 c0167e41 f7d8a000 f7d8a000 00000097 000255a8 c17deac0 c0168230 c013c911 f7d8bf54 c013a0fd 00000000 012ad400 00000000 0002d036 000255a8 0000006a Call Trace: <c016a853> generic_forget_inode+0x12a/0x15c <c016a8e9> iput+0x53/0x65 <c0167e41> prune_dcache+0x12d/0x162 <c0168230> shrink_dcache_memory+0x14/0x37 <c013c911> shrink_slab+0x131/0x1f7 <c013a0fd> throttle_vm_writeout+0x1e/0x5d <c013de1f> balance_pgdat+0x2a9/0x36c <c013dfcf> kswapd+0xed/0x103 <c012805c> autoremove_wake_function+0x0/0x43 <c0102866> ret_from_fork+0x6/0x14 <c012805c> autoremove_wake_function+0x0/0x43 <c013dee2> kswapd+0x0/0x103 <c0100eed> kernel_thread_helper+0x5/0xb Code: 01 00 00 a8 08 0f 85 9b 00 00 00 f6 83 2c 01 00 00 20 0f 85 86 00 00 00 8b83 90 00 00 00 85 c0 89 c1 7
4 31 8b 50 24 85 d2 74 1c <8b> 52 04 85 d2 74 15 31 d2 8b b4 93 e4 00 00 00 85 f6 75 52 83
============================================================================BUG: unable to handle kernel paging request at virtual address 08ed08b5 printing eip: c016a8b3 *pde = 00000000 Oops: 0000 [#2] PREEMPT last sysfs file: /class/net/eth2/ifindex Modules linked in: pl2303 usbserial softdog cisco_ipsec snd_pcm_oss
snd_mixer_osssnd_cs46xxgameportsnd_raw
midisnd_seq_devicesnd_ac97_codecsnd_ac97_bussnd_pcmsnd_timersnd soundcoresnd_page_alloczorani2c_algo_bitvideodev saa7111i2c_corepegasus arc4ppp_mppeppp_deflateppp_genericslhc usblpCPU: 0 EIP: 0060:[<c016a8b3>] Tainted: P VLI EFLAGS: 00010202 (2.6.16-rc5-mm3 #9)EIP is at
iput+0x1d/0x65
eax:08ed08a1ebx:d3f50a00ecx:d3f50a18edx:d3f50a18
esi:cf443aa0edi: 00000045 ebp:ffffe000esp:c821fb90
ds: 007b es: 007b ss: 0068
Process dvddump (pid: 4210, threadinfo=c821e000 task=f1599570)Stack: <0>cf443a94 c0167e41 c821e000 c821e000 0000010b 00041c58 c17deac0 c0168230 c013c911 00000000 0001d060 00000000 020e2c00 00000000 00027ae4 00041c58 000000d4 00000000 00000000 000000d0 00000040 c821fc5c c05a51f0 0000000a Call Trace: <c0167e41> prune_dcache+0x12d/0x162 <c0168230> shrink_dcache_memory+0x14/0x37 <c013c911> shrink_slab+0x131/0x1f7 <c013dab9> try_to_free_pages+0xee/0x1ab <c0138ea8> __alloc_pages+0x113/0x29c <c014e03c> cache_grow+0x108/0x171 <c014d344> kmem_getpages+0x2f/0x95 <c014dff8> cache_grow+0xc4/0x171 <c014e20c> cache_alloc_refill+0x167/0x22c <c014e4cb> kmem_cache_alloc+0x3f/0x41 <c016826e> d_alloc+0x1b/0x176 <c01688a6> d_lookup+0x19/0x39 <c022bd94> nfs_readdir_lookup+0xd8/0x34b <c022ab91> nfs_do_filldir+0x5b/0x184 <c0163484> filldir64+0x0/0xdc <c022afcb> nfs_readdir+0x311/0x7a2 <c0163484> filldir64+0x0/0xdc <c0150006> sys_faccessat+0x45/0x132 <c015f233> __link_path_walk+0xc62/0xd4b <c045a61b> rpcauth_lookup_credcache+0x7f/0x206 <c045a801> rpcauth_lookupcred+0x5f/0xb5 <c0286dea> radix_tree_gang_lookup_tag+0x49/0x61 <c028958c> __copy_to_user_ll+0x5b/0x69 <c02896a2> copy_to_user+0x36/0x53 <c015aa56> cp_new_stat64+0xfa/0x10e <c0239d5f> nfs3_decode_dirent+0x0/0x1ac <c0163484> filldir64+0x0/0xdc <c0163214> vfs_readdir+0x94/0xa9 <c01635cd> sys_getdents64+0x6d/0xc0 <c0162799> do_fcntl+0x9e/0x155 <c0102997> syscall_call+0x7/0xb Code: 85 c9 75 05 e9 4a fd ff ff e9 93 fe ff ff 85 c0 53 89 c3 74 4c 8b 80 90 0000 00 83 bb 24 01 00 00 20 8
b 40 20 74 42 85 c0 74 07 <8b> 50 14 85 d2 75 31 8d 43 24 ba 80 84 68 c0 e8 8d a2 11 00 85
Trond Myklebust wrote on 03/12/06 13:35:
Quoted 7 lines · Joe Feise
Quoted 3 lines
In certain cases, when programmatically traversing a directory tree mounted through NFS, I get a kernel oops.
Two examples are listed below.Please could you retry without the
cisco_ipsecmodule (and whatever else is tainting the kernel).
Here is the problem without the cisco_ipsec module, with an untainted kernel.
-Joe
BUG: unable to handle kernel paging request at virtual address 02b00025 printing eip: c016a8b3 *pde = 00000000 Oops: 0000 [#1] PREEMPT last sysfs file: /class/net/eth2/ifindex Modules linked in: pl2303 usbserial softdog snd_pcm_oss snd_mixer_oss snd_cs46xx
gameport snd_rawmidi snd_seq_de
vice snd_ac97_codec snd_ac97_bus snd_pcm snd_timer snd soundcore snd_page_alloc zoran i2c_algo_bit videodev saa7
111 i2c_core pegasus arc4 ppp_mppe ppp_deflate ppp_generic slhc usblp
CPU: 0 EIP: 0060:[<c016a8b3>] Not tainted VLI EFLAGS: 00010206 (2.6.16-rc5-mm3 #9)
EIP is at iput+0x1d/0x65
eax: 02b00011 ebx: d4bb5a00 ecx: d4bb5a18 edx: d4bb5a18
esi: f2183d20 edi: 00000020 ebp: ffffe000 esp: c7c67e3c
ds: 007b es: 007b ss: 0068
Process cc1 (pid: 11024, threadinfo=c7c66000 task=f7c8f570)
Stack: <0>f2183d14 c0167e41 c7c66000 c7c66000 000000b6 0004aa24 c17deac0 c0168230
c013c911 00000000 0001eaf8 00000000 012a8900 00000000 00025c2d 0004aa24
0000007e 00000000 00000000 000280d2 00000020 c7c67f08 c05a5218 0000000c
Call Trace:
<c0167e41> prune_dcache+0x12d/0x162 <c0168230> shrink_dcache_memory+0x14/0x37
<c013c911> shrink_slab+0x131/0x1f7 <c013dab9> try_to_free_pages+0xee/0x1ab
<c0138ea8> __alloc_pages+0x113/0x29c <c0141352> do_anonymous_page+0x40/0x148
<c0141796> __handle_mm_fault+0xa5/0x1d9 <c0467197> notifier_call_chain+0x17/0x2b
<c0466cb7> do_page_fault+0x16a/0x633 <c0466b4d> do_page_fault+0x0/0x633
<c010342b> error_code+0x4f/0x54
Code: 85 c9 75 05 e9 4a fd ff ff e9 93 fe ff ff 85 c0 53 89 c3 74 4c 8b 80 90 0000 00 83 bb 24 01 00 00 20 8b 4
0 20 74 42 85 c0 74 07 <8b> 50 14 85 d2 75 31 8d 43 24 ba 80 84 68 c0 e8 8d a2 11 00 85
Joe Feise wrote on 03/12/06 11:33:
Quoted 2 lines
In certain cases, when programmatically traversing a directory tree mounted through NFS, I get a kernel oops.
Update: this doesn't seem to be limited to NFS.
I just got a kernel oops of the same kind, in prune_dcache, while compiling:
BUG: unable to handle kernel paging request at virtual address 0a1d2030 printing eip: c016a8b3 *pde = 00000000 Oops: 0000 [#2] PREEMPT last sysfs file: /class/net/eth2/ifindex Modules linked in: pl2303 usbserial softdog cisco_ipsec snd_pcm_oss
snd_mixer_oss snd_cs46xx gameport snd_rawmidi snd_s eq_device snd_ac97_codec snd_ac97_bus snd_pcm snd_timer snd soundcore snd_page_alloc zoran i2c_algo_bit videodev saa711
1 i2c_core pegasus arc4 ppp_mppe ppp_deflate ppp_generic slhc usblp
CPU: 0 EIP: 0060:[<c016a8b3>] Tainted: P VLI EFLAGS: 00010202 (2.6.16-rc5-mm3 #9)
EIP is at iput+0x1d/0x65
eax: 0a1d201c ebx: d4f10a00 ecx: d4f10a18 edx: d4f10a18
esi: d6f38420 edi: 0000002a ebp: ffffe000 esp: e36c1d48
ds: 007b es: 007b ss: 0068
Process qmail-send (pid: 2678, threadinfo=e36c0000 task=e353cab0)
Stack: <0>d6f38414 c0167e41 e36c0000 e36c0000 00000082 000049d4 c17deac0 c0168230
c013c911 00000000 000225da 00000000 00127500 00000000 000329cf 000049d4
00000005 00000000 00000000 000000d0 00000020 e36c1e14 c05a51f0 0000000c
Call Trace:
<c0167e41> prune_dcache+0x12d/0x162 <c0168230> shrink_dcache_memory+0x14/0x37
<c013c911> shrink_slab+0x131/0x1f7 <c013dab9> try_to_free_pages+0xee/0x1ab
<c0138ea8> __alloc_pages+0x113/0x29c <c014d344> kmem_getpages+0x2f/0x95
<c014dff8> cache_grow+0xc4/0x171 <c015f385> link_path_walk+0x69/0xc0
<c014e20c> cache_alloc_refill+0x167/0x22c <c014e4cb> kmem_cache_alloc+0x3f/0x41
<c015230a> get_empty_filp+0x41/0x11c <c015f778> do_path_lookup+0x102/0x1fb
<c015f8ab> __path_lookup_intent_open+0x22/0x90 <c015f93c>
path_lookup_open+0x23/0x2b
<c016010d> open_namei+0x6a/0x68f <c0164938> fifo_open+0x0/0x2a0