XFS problems with 2.6.27
Hello!
We"ve got two different systems running with XFS, one of them is publishing shares via NFS, the other via Samba. We've recently encountered filesystem issues on both servers, and received the following call traces. They look very much alike.
Are these something you are familiar with? We'd like to at least establish that the problem really is with XFS... We don't really have the possibility to update the kernels (2.6.27.10) on those machines, but we can possibly apply patches etc. These systems are usually under a fairly high load and host a large number of files.
Filesystem "dm-16": Disabling barriers, trial barrier write failed XFS mounting filesystem dm-16
Starting XFS recovery on filesystem: dm-16 (logdev: internal) XFS internal error XFS_WANT_CORRUPTED_GOTO at line 1590 of file fs/xfs/xfs_alloc.c. Caller 0xffffffff80398ca7
Pid: 15745, comm: mount Not tainted 2.6.27.10
#24
Call Trace: [<ffffffff80396fb8>] xfs_free_ag_extent+0x378/0x740 [<ffffffff80398ca7>] xfs_free_extent+0xc7/0x110 [<ffffffff803d7642>] xlog_recover_process_efi+0x122/0x1a0 [<ffffffff803d7727>] xlog_recover_process_efis+0x67/0x90 [<ffffffff803d87dc>] xlog_recover_finish+0x1c/0xd0 [<ffffffff803d0790>] xfs_log_mount_finish+0x20/0x30 [<ffffffff803dac3d>] xfs_mountfs+0x2bd/0x640 [<ffffffff803c0440>] xfs_fstrm_free_func+0x0/0x90 [<ffffffff803dbaca>] xfs_mru_cache_create+0x15a/0x1c0 [<ffffffff803f2c04>] xfs_fs_fill_super+0x214/0x450 [<ffffffff80299100>] set_bdev_super+0x0/0x10 [<ffffffff8029925f>] get_sb_bdev+0x13f/0x180 [<ffffffff803f29f0>] xfs_fs_fill_super+0x0/0x450 [<ffffffff802994f1>] vfs_kern_mount+0x81/0x160 [<ffffffff8029961d>] do_kern_mount+0x4d/0x110 [<ffffffff802b0fbb>] do_new_mount+0x9b/0xe0 [<ffffffff802b1849>] do_mount+0x209/0x220 [<ffffffff80274ea2>] __alloc_pages_internal+0x92/0x430 [<ffffffff802752d7>] __get_free_pages+0x17/0x80 [<ffffffff802cbdf4>] compat_sys_mount+0xa4/0x270 [<ffffffff80228282>] ia32_sysret+0x0/0xa
Failed to recover EFIs on filesystem: dm-16
XFS: log mount finish failed
NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
NFSD: starting 90-second grace period
bootsplash: status on console 0 changed to off
usb 3-2: USB disconnect, address 2
00000000: 00 00 00 00 00 28 00 e0 00 00 00 00 00 00 00 00 .....(.......... Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 23023, comm: smbd Not tainted 2.6.27.10
#24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8023ee0f>] try_to_del_timer_sync+0x4f/0x60 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff8069dfd9>] _spin_lock_bh+0x9/0x20 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff805de663>] sock_aio_read+0x163/0x170 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff8024a450>] autoremove_wake_function+0x0/0x30 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a1f3>] vfs_stat_fd+0x23/0x80 [<ffffffff8022879f>] sys32_stat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 00 00 00 00 00 28 00 e0 00 00 00 00 00 00 00 00 .....(.......... Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 23023, comm: smbd Not tainted 2.6.27.10
#24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8023ee0f>] try_to_del_timer_sync+0x4f/0x60 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff8069dfd9>] _spin_lock_bh+0x9/0x20 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff805de663>] sock_aio_read+0x163/0x170 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff8024a450>] autoremove_wake_function+0x0/0x30 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a1f3>] vfs_stat_fd+0x23/0x80 [<ffffffff8022879f>] sys32_stat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa
Quoted 1 line
From the other system we only have these logs:
2010/01/27 00:22:07|Pid: 17209, comm: nfsd Not tainted 2.6.27.10 #12 2010/01/27 00:22:07| 2010/01/27 00:22:07|Call Trace: 2010/01/27 00:22:07|[<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 2010/01/27 00:22:07|[<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 2010/01/27 00:22:07|[<ffffffff803ead07>] xfs_buf_read_flags+0x67/0x90 2010/01/27 00:22:07|[<ffffffff803df247>] xfs_trans_read_buf+0x147/0x310 2010/01/27 00:22:07|[<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 2010/01/27 00:22:07|[<ffffffff803b3748>] xfs_da_node_lookup_int+0x88/0x2a0 2010/01/27 00:22:07|[<ffffffff803b3748>] xfs_da_node_lookup_int+0x88/0x2a0 2010/01/27 00:22:07|[<ffffffff803bd2f8>] xfs_dir2_node_lookup+0x48/0x120 2010/01/27 00:22:07|[<ffffffff803b697a>] xfs_dir_lookup+0x1aa/0x1c0 2010/01/27 00:22:07|[<ffffffff803e3267>] xfs_lookup+0x57/0xd0 2010/01/27 00:22:07|[<ffffffff8035279e>] nfsd_permission+0x7e/0x130 2010/01/27 00:22:07|[<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 2010/01/27 00:22:07|[<ffffffff802a9f95>] d_alloc+0x125/0x1b0 2010/01/27 00:22:07|[<ffffffff802a048c>] __lookup_hash+0xec/0x180 2010/01/27 00:22:07|[<ffffffff802a0629>] lookup_one_len+0x59/0x60 2010/01/27 00:22:07|[<ffffffff8035023c>] nfsd_lookup_dentry+0x12c/0x4d0 2010/01/27 00:22:07|[<ffffffff80350610>] nfsd_lookup+0x30/0x100 2010/01/27 00:22:07|[<ffffffff803599a7>] nfsd3_proc_lookup+0xa7/0x100 2010/01/27 00:22:07|[<ffffffff8034ca6e>] nfsd_dispatch+0xae/0x260 2010/01/27 00:22:07|[<ffffffff80669a87>] svc_process+0x307/0x740 2010/01/27 00:22:07|[<ffffffff8034c892>] nfsd+0x172/0x2a0 2010/01/27 00:22:07|[<ffffffff8034c720>] nfsd+0x0/0x2a0 2010/01/27 00:22:07|[<ffffffff80249d3c>] kthread+0x6c/0xa0 2010/01/27 00:22:07|[<ffffffff8020d1c9>] child_rip+0xa/0x11 2010/01/27 00:22:07|[<ffffffff80249cd0>] kthread+0x0/0xa0 2010/01/27 00:22:07|[<ffffffff8020d1bf>] child_rip+0x0/0x11 2010/01/27 00:22:07| 2010/01/27 00:22:09|Pid: 17189, comm: nfsd Not tainted 2.6.27.10 #12 2010/01/27 00:22:09| 2010/01/27 00:22:09|Call Trace: 2010/01/27 00:22:09|[<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 2010/01/27 00:22:09|[<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 2010/01/27 00:22:09|[<ffffffff803b2bed>] xfs_da_buf_make+0x13d/0x150 2010/01/27 00:22:09|[<ffffffff803df247>] xfs_trans_read_buf+0x147/0x310 2010/01/27 00:22:09|[<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 2010/01/27 00:22:09|[<ffffffff803bbd5b>] xfs_dir2_leafn_lookup_for_entry+0x16b/0x350 2010/01/27 00:22:09|[<ffffffff803bbd5b>] xfs_dir2_leafn_lookup_for_entry+0x16b/0x350 2010/01/27 00:22:09|[<ffffffff803b38f7>] xfs_da_node_lookup_int+0x237/0x2a0 2010/01/27 00:22:09|[<ffffffff803bd2f8>] xfs_dir2_node_lookup+0x48/0x120 2010/01/27 00:22:09|[<ffffffff803b697a>] xfs_dir_lookup+0x1aa/0x1c0 2010/01/27 00:22:09|[<ffffffff803e3267>] xfs_lookup+0x57/0xd0 2010/01/27 00:22:09|[<ffffffff8035279e>] nfsd_permission+0x7e/0x130 2010/01/27 00:22:09|[<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 2010/01/27 00:22:09|[<ffffffff802a9f95>] d_alloc+0x125/0x1b0 2010/01/27 00:22:09|[<ffffffff802a048c>] __lookup_hash+0xec/0x180 2010/01/27 00:22:09|[<ffffffff802a0629>] lookup_one_len+0x59/0x60 2010/01/27 00:22:09|[<ffffffff8035023c>] nfsd_lookup_dentry+0x12c/0x4d0 2010/01/27 00:22:09|[<ffffffff80350610>] nfsd_lookup+0x30/0x100 2010/01/27 00:22:09|[<ffffffff803599a7>] nfsd3_proc_lookup+0xa7/0x100 2010/01/27 00:22:09|[<ffffffff8034ca6e>] nfsd_dispatch+0xae/0x260 2010/01/27 00:22:09|[<ffffffff80669a87>] svc_process+0x307/0x740 2010/01/27 00:22:09|[<ffffffff8034c892>] nfsd+0x172/0x2a0 2010/01/27 00:22:09|[<ffffffff8034c720>] nfsd+0x0/0x2a0 2010/01/27 00:22:09|[<ffffffff80249d3c>] kthread+0x6c/0xa0 2010/01/27 00:22:09|[<ffffffff8020d1c9>] child_rip+0xa/0x11 2010/01/27 00:22:09|[<ffffffff80249cd0>] kthread+0x0/0xa0 2010/01/27 00:22:09|[<ffffffff8020d1bf>] child_rip+0x0/0x11
EXT3 FS on ram15, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
kjournald starting. Commit interval 5 seconds
EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
EXT3 FS on dm-17, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
Filesystem "dm-20": Disabling barriers, trial barrier write failed
XFS mounting filesystem dm-20
Ending clean XFS mount for filesystem: dm-20
kjournald starting. Commit interval 5 seconds
EXT3-fs warning: maximal mount count reached, running e2fsck is recommended
EXT3 FS on dm-13, internal journal
EXT3-fs: mounted filesystem with ordered data mode.
Filesystem "dm-16": Disabling barriers, trial barrier write failed
XFS mounting filesystem dm-16
Starting XFS recovery on filesystem: dm-16 (logdev: internal)
XFS internal error XFS_WANT_CORRUPTED_GOTO at line 1590 of file fs/xfs/xfs_alloc.c. Caller 0xffffffff80398ca7
Pid: 15745, comm: mount Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff80396fb8>] xfs_free_ag_extent+0x378/0x740 [<ffffffff80398ca7>] xfs_free_extent+0xc7/0x110 [<ffffffff803d7642>] xlog_recover_process_efi+0x122/0x1a0 [<ffffffff803d7727>] xlog_recover_process_efis+0x67/0x90 [<ffffffff803d87dc>] xlog_recover_finish+0x1c/0xd0 [<ffffffff803d0790>] xfs_log_mount_finish+0x20/0x30 [<ffffffff803dac3d>] xfs_mountfs+0x2bd/0x640 [<ffffffff803c0440>] xfs_fstrm_free_func+0x0/0x90 [<ffffffff803dbaca>] xfs_mru_cache_create+0x15a/0x1c0 [<ffffffff803f2c04>] xfs_fs_fill_super+0x214/0x450 [<ffffffff80299100>] set_bdev_super+0x0/0x10 [<ffffffff8029925f>] get_sb_bdev+0x13f/0x180 [<ffffffff803f29f0>] xfs_fs_fill_super+0x0/0x450 [<ffffffff802994f1>] vfs_kern_mount+0x81/0x160 [<ffffffff8029961d>] do_kern_mount+0x4d/0x110 [<ffffffff802b0fbb>] do_new_mount+0x9b/0xe0 [<ffffffff802b1849>] do_mount+0x209/0x220 [<ffffffff80274ea2>] __alloc_pages_internal+0x92/0x430 [<ffffffff802752d7>] __get_free_pages+0x17/0x80 [<ffffffff802cbdf4>] compat_sys_mount+0xa4/0x270 [<ffffffff80228282>] ia32_sysret+0x0/0xa
Failed to recover EFIs on filesystem: dm-16
XFS: log mount finish failed
NFSD: Using /var/lib/nfs/v4recovery as the NFSv4 state recovery directory
NFSD: starting 90-second grace period
bootsplash: status on console 0 changed to off
usb 3-2: USB disconnect, address 2
00000000: 00 00 00 00 00 28 00 e0 00 00 00 00 00 00 00 00 .....(..........
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 23023, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8023ee0f>] try_to_del_timer_sync+0x4f/0x60 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff8069dfd9>] _spin_lock_bh+0x9/0x20 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff805de663>] sock_aio_read+0x163/0x170 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff8024a450>] autoremove_wake_function+0x0/0x30 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a1f3>] vfs_stat_fd+0x23/0x80 [<ffffffff8022879f>] sys32_stat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 00 00 00 00 00 28 00 e0 00 00 00 00 00 00 00 00 .....(..........
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 23023, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8023ee0f>] try_to_del_timer_sync+0x4f/0x60 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff8069dfd9>] _spin_lock_bh+0x9/0x20 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff805de663>] sock_aio_read+0x163/0x170 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff8024a450>] autoremove_wake_function+0x0/0x30 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a1f3>] vfs_stat_fd+0x23/0x80 [<ffffffff8022879f>] sys32_stat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 00 00 00 00 00 28 00 e0 00 00 00 00 00 00 00 00 .....(..........
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 23023, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff802a0016>] path_walk+0x66/0xb0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b6d59>] xfs_dir2_block_getdents+0x99/0x200 [<ffffffff803b6d59>] xfs_dir2_block_getdents+0x99/0x200 [<ffffffff803eb8a0>] xfs_hack_filldir+0x0/0x60 [<ffffffff803eb8a0>] xfs_hack_filldir+0x0/0x60 [<ffffffff803b660b>] xfs_readdir+0xbb/0xf0 [<ffffffff802cc300>] compat_filldir64+0x0/0xe0 [<ffffffff803eb9be>] xfs_file_readdir+0xbe/0x170 [<ffffffff802cc300>] compat_filldir64+0x0/0xe0 [<ffffffff802a4880>] vfs_readdir+0xc0/0xe0 [<ffffffff802cc46a>] compat_sys_getdents64+0x8a/0xf0 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 00 00 00 00 00 28 00 e0 00 00 00 00 00 00 00 00 .....(..........
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 23023, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8024e4a6>] up+0x16/0x50 [<ffffffff802361c7>] release_console_sem+0x1a7/0x1d0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff80425701>] __up_read+0x21/0xb0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a280>] vfs_lstat_fd+0x20/0x80 [<ffffffff8022880f>] sys32_lstat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 00 00 c0 49 00 30 00 c3 00 00 00 00 00 00 00 00 ...I.0..........
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 23041, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8023ee0f>] try_to_del_timer_sync+0x4f/0x60 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff8069dfd9>] _spin_lock_bh+0x9/0x20 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff805de663>] sock_aio_read+0x163/0x170 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff8024a450>] autoremove_wake_function+0x0/0x30 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a1f3>] vfs_stat_fd+0x23/0x80 [<ffffffff8022879f>] sys32_stat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 00 00 c0 49 00 30 00 c3 00 00 00 00 00 00 00 00 ...I.0..........
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 23041, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8023ee0f>] try_to_del_timer_sync+0x4f/0x60 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff8069dfd9>] _spin_lock_bh+0x9/0x20 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff805de663>] sock_aio_read+0x163/0x170 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff8024a450>] autoremove_wake_function+0x0/0x30 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a1f3>] vfs_stat_fd+0x23/0x80 [<ffffffff8022879f>] sys32_stat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 00 00 c0 49 00 30 00 c3 00 00 00 00 00 00 00 00 ...I.0..........
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 23041, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff802a0016>] path_walk+0x66/0xb0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b6d59>] xfs_dir2_block_getdents+0x99/0x200 [<ffffffff803b6d59>] xfs_dir2_block_getdents+0x99/0x200 [<ffffffff803eb8a0>] xfs_hack_filldir+0x0/0x60 [<ffffffff803eb8a0>] xfs_hack_filldir+0x0/0x60 [<ffffffff803b660b>] xfs_readdir+0xbb/0xf0 [<ffffffff802cc300>] compat_filldir64+0x0/0xe0 [<ffffffff803eb9be>] xfs_file_readdir+0xbe/0x170 [<ffffffff802cc300>] compat_filldir64+0x0/0xe0 [<ffffffff802a4880>] vfs_readdir+0xc0/0xe0 [<ffffffff802cc46a>] compat_sys_getdents64+0x8a/0xf0 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 00 00 c0 49 00 30 00 c3 00 00 00 00 00 00 00 00 ...I.0..........
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 23041, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8024e4a6>] up+0x16/0x50 [<ffffffff802361c7>] release_console_sem+0x1a7/0x1d0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff80425701>] __up_read+0x21/0xb0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a280>] vfs_lstat_fd+0x20/0x80 [<ffffffff8022880f>] sys32_lstat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 11 0a 73 bb 0f c9 01 c2 00 00 ff ff 00 00 ff ff ..s.............
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 27909, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8023ee0f>] try_to_del_timer_sync+0x4f/0x60 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff8069dfd9>] _spin_lock_bh+0x9/0x20 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff805de663>] sock_aio_read+0x163/0x170 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff8024a450>] autoremove_wake_function+0x0/0x30 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a1f3>] vfs_stat_fd+0x23/0x80 [<ffffffff8022879f>] sys32_stat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 11 0a 73 bb 0f c9 01 c2 00 00 ff ff 00 00 ff ff ..s.............
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 27909, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8023ee0f>] try_to_del_timer_sync+0x4f/0x60 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff8069dfd9>] _spin_lock_bh+0x9/0x20 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff805de663>] sock_aio_read+0x163/0x170 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff8024a450>] autoremove_wake_function+0x0/0x30 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a1f3>] vfs_stat_fd+0x23/0x80 [<ffffffff8022879f>] sys32_stat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 11 0a 73 bb 0f c9 01 c2 00 00 ff ff 00 00 ff ff ..s.............
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 27909, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff802a0016>] path_walk+0x66/0xb0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b6d59>] xfs_dir2_block_getdents+0x99/0x200 [<ffffffff803b6d59>] xfs_dir2_block_getdents+0x99/0x200 [<ffffffff803eb8a0>] xfs_hack_filldir+0x0/0x60 [<ffffffff803eb8a0>] xfs_hack_filldir+0x0/0x60 [<ffffffff803b660b>] xfs_readdir+0xbb/0xf0 [<ffffffff802cc300>] compat_filldir64+0x0/0xe0 [<ffffffff803eb9be>] xfs_file_readdir+0xbe/0x170 [<ffffffff802cc300>] compat_filldir64+0x0/0xe0 [<ffffffff802a4880>] vfs_readdir+0xc0/0xe0 [<ffffffff802cc46a>] compat_sys_getdents64+0x8a/0xf0 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 11 0a 73 bb 0f c9 01 c2 00 00 ff ff 00 00 ff ff ..s.............
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 27909, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8024e4a6>] up+0x16/0x50 [<ffffffff802361c7>] release_console_sem+0x1a7/0x1d0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff80425701>] __up_read+0x21/0xb0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a280>] vfs_lstat_fd+0x20/0x80 [<ffffffff8022880f>] sys32_lstat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 00 00 c0 49 00 03 00 03 00 00 00 00 00 00 00 00 ...I............
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 31333, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8023ee0f>] try_to_del_timer_sync+0x4f/0x60 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff8069dfd9>] _spin_lock_bh+0x9/0x20 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff805de663>] sock_aio_read+0x163/0x170 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff8024a450>] autoremove_wake_function+0x0/0x30 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a1f3>] vfs_stat_fd+0x23/0x80 [<ffffffff8022879f>] sys32_stat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 00 00 c0 49 00 03 00 03 00 00 00 00 00 00 00 00 ...I............
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 31333, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8023ee0f>] try_to_del_timer_sync+0x4f/0x60 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff8069dfd9>] _spin_lock_bh+0x9/0x20 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff805de663>] sock_aio_read+0x163/0x170 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff8022b06c>] __dequeue_entity+0x6c/0xa0 [<ffffffff8020b1a5>] __switch_to+0x315/0x380 [<ffffffff8029a1f3>] vfs_stat_fd+0x23/0x80 [<ffffffff8022879f>] sys32_stat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 00 00 c0 49 00 03 00 03 00 00 00 00 00 00 00 00 ...I............
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 31333, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff802a0016>] path_walk+0x66/0xb0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b6d59>] xfs_dir2_block_getdents+0x99/0x200 [<ffffffff803b6d59>] xfs_dir2_block_getdents+0x99/0x200 [<ffffffff803eb8a0>] xfs_hack_filldir+0x0/0x60 [<ffffffff803eb8a0>] xfs_hack_filldir+0x0/0x60 [<ffffffff803b660b>] xfs_readdir+0xbb/0xf0 [<ffffffff802cc300>] compat_filldir64+0x0/0xe0 [<ffffffff803eb9be>] xfs_file_readdir+0xbe/0x170 [<ffffffff802cc300>] compat_filldir64+0x0/0xe0 [<ffffffff802a4880>] vfs_readdir+0xc0/0xe0 [<ffffffff802cc46a>] compat_sys_getdents64+0x8a/0xf0 [<ffffffff80228282>] ia32_sysret+0x0/0xa
00000000: 00 00 c0 49 00 03 00 03 00 00 00 00 00 00 00 00 ...I............
Filesystem "dm-20": XFS internal error xfs_da_do_buf(2) at line 2112 of file fs/xfs/xfs_da_btree.c. Caller 0xffffffff803b34b4
Pid: 31333, comm: smbd Not tainted 2.6.27.10 #24
Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8024e4a6>] up+0x16/0x50 [<ffffffff802361c7>] release_console_sem+0x1a7/0x1d0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff80425701>] __up_read+0x21/0xb0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a280>] vfs_lstat_fd+0x20/0x80 [<ffffffff8022880f>] sys32_lstat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa
_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
Can somebody help with this problem? If you need more details, please let me know.
Quoted 174 lines
Hello!
We"ve got two different systems running with XFS, one of them is publishing shares via NFS, the other via Samba. We've recently encountered filesystem issues on both servers, and received the following call traces. They look very much alike.
Are these something you are familiar with? We'd like to at least establish that the problem really is with XFS... We don't really have the possibility to update the kernels (2.6.27.10) on those machines, but we can possibly apply patches etc. These systems are usually under a fairly high load and host a large number of files.
Filesystem "dm-16": Disabling barriers, trial barrier write failed XFS mounting filesystem dm-16
Starting XFS recovery on filesystem: dm-16 (logdev: internal) XFS internal errorXFS_WANT_CORRUPTED_GOTOat line 1590 of filefs/xfs/xfs_alloc.c. Caller0xffffffff80398ca7
Pid: 15745, comm: mount Not tainted 2.6.27.10
#24Call Trace: [<ffffffff80396fb8>] xfs_free_ag_extent+0x378/0x740 [<ffffffff80398ca7>] xfs_free_extent+0xc7/0x110 [<ffffffff803d7642>] xlog_recover_process_efi+0x122/0x1a0 [<ffffffff803d7727>] xlog_recover_process_efis+0x67/0x90 [<ffffffff803d87dc>] xlog_recover_finish+0x1c/0xd0 [<ffffffff803d0790>] xfs_log_mount_finish+0x20/0x30 [<ffffffff803dac3d>] xfs_mountfs+0x2bd/0x640 [<ffffffff803c0440>] xfs_fstrm_free_func+0x0/0x90 [<ffffffff803dbaca>] xfs_mru_cache_create+0x15a/0x1c0 [<ffffffff803f2c04>] xfs_fs_fill_super+0x214/0x450 [<ffffffff80299100>] set_bdev_super+0x0/0x10 [<ffffffff8029925f>] get_sb_bdev+0x13f/0x180 [<ffffffff803f29f0>] xfs_fs_fill_super+0x0/0x450 [<ffffffff802994f1>] vfs_kern_mount+0x81/0x160 [<ffffffff8029961d>] do_kern_mount+0x4d/0x110 [<ffffffff802b0fbb>] do_new_mount+0x9b/0xe0 [<ffffffff802b1849>] do_mount+0x209/0x220 [<ffffffff80274ea2>] __alloc_pages_internal+0x92/0x430 [<ffffffff802752d7>] __get_free_pages+0x17/0x80 [<ffffffff802cbdf4>] compat_sys_mount+0xa4/0x270 [<ffffffff80228282>] ia32_sysret+0x0/0xaFailed to recover EFIs on filesystem: dm-16
XFS: log mount finish failed
NFSD: Using/var/lib/nfs/v4recoveryas the NFSv4 state recovery directory
NFSD: starting 90-second grace period
bootsplash: status on console 0 changed to off
usb 3-2: USB disconnect, address 2
00000000: 00 00 00 00 00 28 00 e0 00 00 00 00 00 00 00 00 .....(.......... Filesystem "dm-20": XFS internal errorxfs_da_do_buf(2)at line 2112 of filefs/xfs/xfs_da_btree.c. Caller0xffffffff803b34b4
Pid: 23023, comm: smbd Not tainted 2.6.27.10
#24Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8023ee0f>] try_to_del_timer_sync+0x4f/0x60 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff8069dfd9>] _spin_lock_bh+0x9/0x20 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff805de663>] sock_aio_read+0x163/0x170 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff8024a450>] autoremove_wake_function+0x0/0x30 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a1f3>] vfs_stat_fd+0x23/0x80 [<ffffffff8022879f>] sys32_stat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xa00000000: 00 00 00 00 00 28 00 e0 00 00 00 00 00 00 00 00 .....(.......... Filesystem "dm-20": XFS internal error
xfs_da_do_buf(2)at line 2112 of filefs/xfs/xfs_da_btree.c. Caller0xffffffff803b34b4
Pid: 23023, comm: smbd Not tainted 2.6.27.10
#24Call Trace: [<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff8023ee0f>] try_to_del_timer_sync+0x4f/0x60 [<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b77e5>] xfs_dir2_block_lookup_int+0x45/0x1a0 [<ffffffff803b7958>] xfs_dir2_block_lookup+0x18/0xc0 [<ffffffff803b624f>] xfs_dir2_isblock+0x1f/0x60 [<ffffffff803b696d>] xfs_dir_lookup+0x19d/0x1c0 [<ffffffff803e3267>] xfs_lookup+0x57/0xd0 [<ffffffff8069dfd9>] _spin_lock_bh+0x9/0x20 [<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 [<ffffffff802a9f95>] d_alloc+0x125/0x1b0 [<ffffffff8029f155>] do_lookup+0x175/0x220 [<ffffffff8029ea79>] generic_permission+0x69/0x130 [<ffffffff8029fa01>] __link_path_walk+0x801/0xdb0 [<ffffffff805de663>] sock_aio_read+0x163/0x170 [<ffffffff802a0007>] path_walk+0x57/0xb0 [<ffffffff802a0183>] do_path_lookup+0x123/0x1b0 [<ffffffff802a06f4>] user_path_at+0x44/0x80 [<ffffffff8024a450>] autoremove_wake_function+0x0/0x30 [<ffffffff802af5c1>] mntput_no_expire+0x21/0x120 [<ffffffff8029a1f3>] vfs_stat_fd+0x23/0x80 [<ffffffff8022879f>] sys32_stat64+0x1f/0x70 [<ffffffff80228282>] ia32_sysret+0x0/0xaQuoted 1 line
From the other system we only have these logs:
2010/01/27 00:22:07|Pid: 17209, comm: nfsd Not tainted 2.6.27.10 #12 2010/01/27 00:22:07| 2010/01/27 00:22:07|Call Trace: 2010/01/27 00:22:07|[<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 2010/01/27 00:22:07|[<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 2010/01/27 00:22:07|[<ffffffff803ead07>] xfs_buf_read_flags+0x67/0x90 2010/01/27 00:22:07|[<ffffffff803df247>] xfs_trans_read_buf+0x147/0x310 2010/01/27 00:22:07|[<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 2010/01/27 00:22:07|[<ffffffff803b3748>] xfs_da_node_lookup_int+0x88/0x2a0 2010/01/27 00:22:07|[<ffffffff803b3748>] xfs_da_node_lookup_int+0x88/0x2a0 2010/01/27 00:22:07|[<ffffffff803bd2f8>] xfs_dir2_node_lookup+0x48/0x120 2010/01/27 00:22:07|[<ffffffff803b697a>] xfs_dir_lookup+0x1aa/0x1c0 2010/01/27 00:22:07|[<ffffffff803e3267>] xfs_lookup+0x57/0xd0 2010/01/27 00:22:07|[<ffffffff8035279e>] nfsd_permission+0x7e/0x130 2010/01/27 00:22:07|[<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 2010/01/27 00:22:07|[<ffffffff802a9f95>] d_alloc+0x125/0x1b0 2010/01/27 00:22:07|[<ffffffff802a048c>] __lookup_hash+0xec/0x180 2010/01/27 00:22:07|[<ffffffff802a0629>] lookup_one_len+0x59/0x60 2010/01/27 00:22:07|[<ffffffff8035023c>] nfsd_lookup_dentry+0x12c/0x4d0 2010/01/27 00:22:07|[<ffffffff80350610>] nfsd_lookup+0x30/0x100 2010/01/27 00:22:07|[<ffffffff803599a7>] nfsd3_proc_lookup+0xa7/0x100 2010/01/27 00:22:07|[<ffffffff8034ca6e>] nfsd_dispatch+0xae/0x260 2010/01/27 00:22:07|[<ffffffff80669a87>] svc_process+0x307/0x740 2010/01/27 00:22:07|[<ffffffff8034c892>] nfsd+0x172/0x2a0 2010/01/27 00:22:07|[<ffffffff8034c720>] nfsd+0x0/0x2a0 2010/01/27 00:22:07|[<ffffffff80249d3c>] kthread+0x6c/0xa0 2010/01/27 00:22:07|[<ffffffff8020d1c9>] child_rip+0xa/0x11 2010/01/27 00:22:07|[<ffffffff80249cd0>] kthread+0x0/0xa0 2010/01/27 00:22:07|[<ffffffff8020d1bf>] child_rip+0x0/0x11 2010/01/27 00:22:07| 2010/01/27 00:22:09|Pid: 17189, comm: nfsd Not tainted 2.6.27.10 #12 2010/01/27 00:22:09| 2010/01/27 00:22:09|Call Trace: 2010/01/27 00:22:09|[<ffffffff803b33b6>] xfs_da_do_buf+0x626/0x6b0 2010/01/27 00:22:09|[<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 2010/01/27 00:22:09|[<ffffffff803b2bed>] xfs_da_buf_make+0x13d/0x150 2010/01/27 00:22:09|[<ffffffff803df247>] xfs_trans_read_buf+0x147/0x310 2010/01/27 00:22:09|[<ffffffff803b34b4>] xfs_da_read_buf+0x24/0x30 2010/01/27 00:22:09|[<ffffffff803bbd5b>] xfs_dir2_leafn_lookup_for_entry+0x16b/0x350 2010/01/27 00:22:09|[<ffffffff803bbd5b>] xfs_dir2_leafn_lookup_for_entry+0x16b/0x350 2010/01/27 00:22:09|[<ffffffff803b38f7>] xfs_da_node_lookup_int+0x237/0x2a0 2010/01/27 00:22:09|[<ffffffff803bd2f8>] xfs_dir2_node_lookup+0x48/0x120 2010/01/27 00:22:09|[<ffffffff803b697a>] xfs_dir_lookup+0x1aa/0x1c0 2010/01/27 00:22:09|[<ffffffff803e3267>] xfs_lookup+0x57/0xd0 2010/01/27 00:22:09|[<ffffffff8035279e>] nfsd_permission+0x7e/0x130 2010/01/27 00:22:09|[<ffffffff803ee6e4>] xfs_vn_lookup+0x64/0xc0 2010/01/27 00:22:09|[<ffffffff802a9f95>] d_alloc+0x125/0x1b0 2010/01/27 00:22:09|[<ffffffff802a048c>] __lookup_hash+0xec/0x180 2010/01/27 00:22:09|[<ffffffff802a0629>] lookup_one_len+0x59/0x60 2010/01/27 00:22:09|[<ffffffff8035023c>] nfsd_lookup_dentry+0x12c/0x4d0 2010/01/27 00:22:09|[<ffffffff80350610>] nfsd_lookup+0x30/0x100 2010/01/27 00:22:09|[<ffffffff803599a7>] nfsd3_proc_lookup+0xa7/0x100
Quoted 11 lines
2010/01/27 00:22:09|[<ffffffff8034ca6e>] nfsd_dispatch+0xae/0x260 2010/01/27 00:22:09|[<ffffffff80669a87>] svc_process+0x307/0x740 2010/01/27 00:22:09|[<ffffffff8034c892>] nfsd+0x172/0x2a0 2010/01/27 00:22:09|[<ffffffff8034c720>] nfsd+0x0/0x2a0 2010/01/27 00:22:09|[<ffffffff80249d3c>] kthread+0x6c/0xa0 2010/01/27 00:22:09|[<ffffffff8020d1c9>] child_rip+0xa/0x11 2010/01/27 00:22:09|[<ffffffff80249cd0>] kthread+0x0/0xa0 2010/01/27 00:22:09|[<ffffffff8020d1bf>] child_rip+0x0/0x11
_______________________________________________
xfs mailing list
[email protected]
http://oss.sgi.com/mailman/listinfo/xfs
Quoted 2 lines · On Thu, Feb 18, 2010 at 09:07:30AM +0100, [email protected] wrote:
Can somebody help with this problem? If you need more details, please let me know.
You've got lots of problems.
Quoted 14 lines
Quoted 14 lines
Hello!
We"ve got two different systems running with XFS, one of them is publishing shares via NFS, the other via Samba. We've recently encountered filesystem issues on both servers, and received the following call traces. They look very much alike.
Are these something you are familiar with? We'd like to at least establish that the problem really is with XFS... We don't really have the possibility to update the kernels (2.6.27.10) on those machines, but we can possibly apply patches etc. These systems are usually under a fairly high load and host a large number of files.
Quoted 7 lines
Quoted 7 lines
Filesystem "dm-16": Disabling barriers, trial barrier write failed XFS mounting filesystem dm-16
Starting XFS recovery on filesystem: dm-16 (logdev: internal) XFS internal errorXFS_WANT_CORRUPTED_GOTOat line 1590 of filefs/xfs/xfs_alloc.c. Caller0xffffffff80398ca7
Pid: 15745, comm: mount Not tainted 2.6.27.10
#24
That's a corrupt free space tree => xfs_repair.
Quoted 8 lines
Quoted 8 lines
NFSD: starting 90-second grace period
bootsplash: status on console 0 changed to off
usb 3-2: USB disconnect, address 2
00000000: 00 00 00 00 00 28 00 e0 00 00 00 00 00 00 00 00 .....(.......... Filesystem "dm-20": XFS internal errorxfs_da_do_buf(2)at line 2112 of filefs/xfs/xfs_da_btree.c. Caller0xffffffff803b34b4
Pid: 23023, comm: smbd Not tainted 2.6.27.10
#24
That's a corrupt directory block. The output there bears no resemblance to an XFS directory header - you might be hitting the problem where DM fails to mark a cancelled readahead bio correctly and XFS detects it in xfs_da_do_buf() as an uninitialised buffer and shuts down the filesystem.
I'd say run repair and if it doesn't find any directory corruption, you need to get the DM and XFS fixes for the cancelled readhead bios backported.
Cheers,
Dave.
Signature · 7 lines
Dave Chinner [email protected] _______________________________________________ xfs mailing list [email protected] http://oss.sgi.com/mailman/listinfo/xfs