Skip to contentSkip to conversation

xfs mounting problem, hdb1 just freezes

DISCUSSION [email protected] 2 participants 3 messages Oct 19, 2006 – Oct 20, 2006

lore
Share & tools
lore
#0 lore raw

Hello.
Thanks for your answer.

That's what i have: dmesg print with kernel-2.6.16-gentoo-r3 and an print of xfs_bg.

Quoted 2 lines

You could print out the offending inode with xfs_db to show us what it looks like: $xfs_db -r /dev/hdb1 -c "inode 950759" -c "print".

I don't know what you mean with it but i added it anyway. (done with kernel-2.6.18-gentoo if it matters)

dmesg, kernel-2.6.16-gentoo-r3 (~23. April):

XFS mounting filesystem hdb1
Starting XFS recovery on filesystem: hdb1 (logdev: internal) Access to block zero: fs: <hdb1> inode: 950759 start_block : 0 start_off : 0 blkcnt : 0 extent-state : 0

------------[ cut here ]------------
kernel BUG at fs/xfs/support/debug.c:57!
invalid opcode: 0000 [#1]
PREEMPT
Modules linked in:
CPU:    0
EIP:    0060:[<c034398f>]    Not tainted VLI
EFLAGS: 00010246   (2.6.16-gentoo-r3 #6)

EIP is at cmn_err+0xaf/0xe0
eax: 00000000 ebx: f7876000 ecx: 000034a6 edx: c05ac001
esi: 00000000 edi: c065f300 ebp: 00000000 esp: f7877a18
ds: 007b es: 007b ss: 0068
Process mount (pid: 2233, threadinfo=f7876000 task=f7fd1a70)

Stack: <0>c055eb7d c052b8b2 c065f300 00000293 00000000 00000000 f7877b1c
00000000
       c02e47c2 00000000 c05506fc f79bdd40 000e81e7 00000000 00000000
 00000000 00000000 00000000 00000000 00000000 00000000 f7877afc f7877b1c
 00000000 Call Trace:
 [<c02e47c2>] xfs_bmap_search_extents+0x122/0x130
 [<c02e7881>] xfs_bunmapi+0x1a1/0x1290
 [<c0339f89>] _xfs_buf_lookup_pages+0x1d9/0x2d0
 [<c014893d>] activate_page+0x9d/0xb0
 [<c030fb30>] xfs_iformat_btree+0x120/0x240
 [<c03377b0>] kmem_zone_alloc+0x90/0xc0
 [<c032aafd>] xfs_trans_log_inode+0x2d/0x60
 [<c0310fe4>] xfs_itruncate_finish+0x2a4/0x430
 [<c0331983>] xfs_inactive+0x4c3/0x5e0
 [<c030ed49>] xfs_itobp+0xe9/0x250
 [<c03421d1>] linvfs_clear_inode+0x61/0x90
 [<c017de68>] clear_inode+0xd8/0xf0
 [<c017eeb7>] generic_delete_inode+0xf7/0x120
 [<c03219b3>] xlog_recover_process_iunlinks+0x363/0x3e0
 [<c0322d50>] xlog_recover_finish+0xc0/0xd0
 [<c03192d8>] xfs_log_mount_finish+0x48/0x60
 [<c0324678>] xfs_mountfs+0x938/0x1040
 [<c051067f>] __down_failed+0x7/0xc
 [<c033a855>] xfs_buf_rele+0x25/0xe0
 [<c0323a49>] xfs_readsb+0x199/0x230
 [<c03142e6>] xfs_ioinit+0x26/0x50
 [<c032c9f8>] xfs_mount+0x3e8/0x6d0
 [<c0342b61>] linvfs_fill_super+0xa1/0x1f0
 [<c0366ec7>] snprintf+0x27/0x30
 [<c019fb32>] disk_name+0x62/0xd0
 [<c016a64e>] sb_set_blocksize+0x2e/0x60
 [<c0169fdd>] get_sb_bdev+0xdd/0x150
 [<c0342cdf>] linvfs_get_sb+0x2f/0x40
 [<c0342ac0>] linvfs_fill_super+0x0/0x1f0
 [<c016a27b>] do_kern_mount+0x5b/0xd0
 [<c0182423>] do_new_mount+0x83/0xe0
 [<c0182b45>] do_mount+0x1e5/0x220
 [<c0182900>] copy_mount_options+0x60/0xc0
 [<c0182ecf>] sys_mount+0x9f/0xe0
 [<c01031c5>] syscall_call+0x7/0xb
Code: c7 44 24 08 00 f3 65 c0 c7 04 24 7d eb 55 c0 89 44 24 04 e8 a4 95 dd ff

ff 74 24 0c 9d ff 4b 14 8b 43 08 a8 08 75 20 85 ed 75 08 <0f> 0b 39 00 c3 6d 53 c0 8b 5c 24 10 8b 74 24 14 8b 7c 24 18 8b
<6>Adding 1004020k swap on /dev/hda6. Priority:-1 extents:1 across:1004020k
snd: version magic '2.6.16-gentoo-r3 preempt K7 gcc-4.1' should be '2.6.16-gentoo-r3 preempt K7 gcc-3.4'
snd_hwdep: version magic '2.6.16-gentoo-r3 preempt K7 gcc-4.1' should be '2.6.16-gentoo-r3 preempt K7 gcc-3.4'
snd_util_mem: version magic '2.6.16-gentoo-r3 preempt K7 gcc-4.1' should be '2.6.16-gentoo-r3 preempt K7 gcc-3.4'
snd_page_alloc: version magic '2.6.16-gentoo-r3 preempt K7 gcc-4.1' should be '2.6.16-gentoo-r3 preempt K7 gcc-3.4'
snd_timer: version magic '2.6.16-gentoo-r3 preempt K7 gcc-4.1' should be '2.6.16-gentoo-r3 preempt K7 gcc-3.4'
snd_seq_device: version magic '2.6.16-gentoo-r3 preempt K7 gcc-4.1' should be '2.6.16-gentoo-r3 preempt K7 gcc-3.4'
snd_pcm: version magic '2.6.16-gentoo-r3 preempt K7 gcc-4.1' should be '2.6.16-gentoo-r3 preempt K7 gcc-3.4'
snd_ac97_bus: version magic '2.6.16-gentoo-r3 preempt K7 gcc-4.1' should be '2.6.16-gentoo-r3 preempt K7 gcc-3.4'
snd_ac97_codec: version magic '2.6.16-gentoo-r3 preempt K7 gcc-4.1' should be '2.6.16-gentoo-r3 preempt K7 gcc-3.4'
snd_rawmidi: version magic '2.6.16-gentoo-r3 preempt K7 gcc-4.1' should be '2.6.16-gentoo-r3 preempt K7 gcc-3.4'
snd_emu10k1: version magic '2.6.16-gentoo-r3 preempt K7 gcc-4.1' should be '2.6.16-gentoo-r3 preempt K7 gcc-3.4'
nvidia: module license 'NVIDIA' taints kernel.
ACPI: PCI Interrupt 0000:01:00.0[A] -> Link [LNKA] -> GSI 11 (level, low) -> IRQ 11

xfs_db:

CLX ~ # xfs_db -r /dev/hdb1 -c "inode 950759" -c "print" core.magic = 0x494e
core.mode = 0100644
core.version = 1
core.format = 3 (btree)
core.nlinkv1 = 0
core.uid = 1000
core.gid = 100
core.flushiter = 0
core.atime.sec = Sun Aug 27 14:56:52 2006 core.atime.nsec = 657389250
core.mtime.sec = Sun Aug 27 16:29:40 2006 core.mtime.nsec = 080196250
core.ctime.sec = Thu Oct 5 01:17:40 2006 core.ctime.nsec = 976565958
core.size = 32071862
core.nblocks = 7833
core.extsize = 0
core.nextents = 28
core.naextents = 0
core.forkoff = 0
core.aformat = 2 (extents)
core.dmevmask = 0
core.dmstate = 0
core.newrtbm = 0
core.prealloc = 0
core.realtime = 0
core.immutable = 0
core.append = 0
core.sync = 0
core.noatime = 0
core.nodump = 0
core.rtinherit = 0
core.projinherit = 0
core.nosymlinks = 0
core.extsz = 0
core.extszinherit = 0
core.gen = 0
next_unlinked = null
u.bmbt.level = 1
u.bmbt.numrecs = 1
u.bmbt.keys[1] = [startoff] 1:[0] u.bmbt.ptrs[1] = 1:185933

Am Mittwoch, 18. Oktober 2006 06:54 schrieben Sie:

Quoted 37 lines

Hi,

Quoted 5 lines · --On 16 October 2006 9:14:35 PM +0000 [email protected] wrote:

I've got a problem with my xfs-partition after my pc crashed. Every programm that tries to use hdb1 just freezes like mount or even xfs_check (even killall -9 proc-name doesn't help)

thats what i get with dmesg. maybe someone of you can understand it.

It was in the log recovery code.
Part of the recovery code processes the unlinked list, which has referenced inodes which have been unlinked from their parent directories. On the unclean unmount ("pc crashed"), during recovery it is supposed to delete these inodes and truncate their extents, so it can recover the space etc...
During this processing we've died in xfs_bmap_search_extents when it detects an error it calls xfs_cmn_err CE_ALERT -> cmn_err CE_PANIC in support/debug.c.
I guess there is a problem after it processes the extents in xfs_bmap_search_multiextents which sets up the found extent entry. You could print out the offending inode with xfs_db to show us what it looks like: $xfs_db -r /dev/hdb1 -c "inode 950759" -c "print".

Interestingly with an older xfs we never did inode unlink processing because of a double endian conversion bug which Shailendra found. So without the fix, it ended up just skipping over these inodes and they were cleaned up until xfs_repair was used; but it would still do the actual log replay nonetheless.

So it would be interesting to do a recovery without unlinked-list processing. It looks like we have a mount flag for this but are not setting it (used by something else) - d'oh.
Do you have a kernel dated prior to May 26?
It might be interesting to mount with it since it didn't do the unlink processing effectively. Then one could unmount straight afterwards and run repair.

Quoted 86 lines

--Tim

Quoted 84 lines

thanks in advance.

dmesg on hdb1 on boot:

XFS mounting filesystem hdb1
Starting XFS recovery on filesystem: hdb1 (logdev: internal) Access to block zero: fs: <hdb1> inode: 950759 start_block : 0 start_off

: 0 blkcnt : 0 extent-state : 0

------------[ cut here ]------------
kernel BUG at fs/xfs/support/debug.c:57!
invalid opcode: 0000 [#1]
PREEMPT
Modules linked in:
CPU:    0
EIP:    0060:[<c03378f9>]    Not tainted VLI
EFLAGS: 00010246   (2.6.18-gentoo #7)

EIP is at cmn_err+0xb9/0xe0
eax: 00000000 ebx: 00000297 ecx: ffffffff edx: 00004301
esi: f78c97a0 edi: c064e2e0 ebp: 00000000 esp: f7c9b75c
ds: 007b es: 007b ss: 0068
Process mount (pid: 2114, ti=f7c9a000 task=f7c5d050 task.ti=f7c9a000)

Stack: c0556f3b c052284a c064e2e0 f7c9b788 f7c9b8f8 f78c97a0 f7c9b93c
00000000 c02dec27 00000000 c0548610 f7cd54c0 000e81e7 00000000 00000000
00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000001
00000000 Call Trace:
 [<c02dec27>] xfs_bmap_search_extents+0x117/0x120
 [<c02e23d4>] xfs_bunmapi+0x1d4/0x1db0
 [<c04070c0>] ide_dma_exec_cmd+0x30/0x40
 [<c0406773>] ide_dma_start+0x33/0x50
 [<c03fea22>] ide_do_request+0x682/0x830
 [<c03fe33c>] ide_end_request+0x14c/0x160
 [<c0147658>] mempool_alloc+0x38/0x120
 [<c0147658>] mempool_alloc+0x38/0x120
 [<c034fcf6>] as_set_request+0x26/0x80
 [<c0143f5c>] find_lock_page+0x2c/0xc0
 [<c02e2200>] xfs_bunmapi+0x0/0x1db0
 [<c030672f>] xfs_itruncate_finish+0x28f/0x460
 [<c0329198>] xfs_inactive+0x668/0xca0
 [<c032f233>] xfs_buf_get_flags+0x293/0x4a0
 [<c032f474>] xfs_buf_read_flags+0x34/0xa0
 [<c031dfcc>] xfs_trans_read_buf+0x5c/0x3e0
 [<c032df74>] xfs_buf_offset+0x44/0x50
 [<c0336c3e>] xfs_fs_clear_inode+0x3e/0xa0
 [<c018063a>] clear_inode+0x5a/0xe0
 [<c01807b6>] generic_delete_inode+0xf6/0x130
 [<c0314ca9>] xlog_recover_process_iunlinks+0x559/0x580
 [<c032e3ab>] xfs_buf_free+0x5b/0x110
 [<c03150a2>] xlog_recover_finish+0x3d2/0x510
 [<c03368db>] xfs_initialize_vnode+0x3ab/0x3c0
 [<c03029c9>] xfs_iget+0x429/0x737
 [<c03198a0>] xfs_mountfs+0xe40/0x1060
 [<c0116d20>] default_wake_function+0x0/0x20
 [<c04fe527>] __down_failed+0x7/0xc
 [<c034aff0>] generic_unplug_device+0x0/0x40
 [<c032e485>] xfs_buf_rele+0x25/0xe0
 [<c03218d1>] xfs_mount+0x6e1/0xa60
 [<c0336a5d>] xfs_fs_fill_super+0x9d/0x240
 [<c035a78b>] snprintf+0x2b/0x30
 [<c01a3b98>] disk_name+0x98/0xd0
 [<c016cd3f>] sb_set_blocksize+0x1f/0x50
 [<c016c30b>] get_sb_bdev+0x13b/0x180
 [<c0335aa7>] xfs_fs_get_sb+0x37/0x40
 [<c03369c0>] xfs_fs_fill_super+0x0/0x240
 [<c016bfec>] vfs_kern_mount+0x4c/0xa0
 [<c016c0b2>] do_kern_mount+0x42/0x60
 [<c018464d>] do_mount+0x28d/0x730
 [<c017646d>] link_path_walk+0x7d/0x100
 [<c017ec43>] dput+0x23/0x190
 [<c0174fe1>] putname+0x31/0x40
 [<c0176720>] do_path_lookup+0xb0/0x2e0
 [<c01750a1>] getname+0xb1/0x100
 [<c016f4af>] vfs_stat+0x1f/0x30
 [<c01498b4>] __get_free_pages+0x34/0x60
 [<c0182fe4>] copy_mount_options+0x44/0x130
 [<c0184b8d>] sys_mount+0x9d/0xe0
 [<c010318b>] syscall_call+0x7/0xb
Code: e0 e2 64 c0 c7 04 24 3b 6f 55 c0 89 44 24 04 e8 7e 37 de ff 53 9d

89 e0 25 00 e0 ff ff ff 48 14 8b 40 08 a8 08 75 20 85 ed 75 08 <0f> 0b 39 00 b8 ec 52 c0 8b 5c 24 10 8b 74 24 14 8b 7c 24 18 8b
EIP: [<c03378f9>] cmn_err+0xb9/0xe0 SS:ESP 0068:f7c9b75c
<6>Adding 1004020k swap on /dev/hda6. Priority:-1 extents:1
across:1004020k

-------------------------------------------------------

#1 lore raw
Quoted 49 lines · --On 19 October 2006 2:36:13 PM +0000 [email protected] wrote:

Hello.
Thanks for your answer.

That's what i have: dmesg print with kernel-2.6.16-gentoo-r3 and an print of xfs_bg.

Quoted 2 lines

You could print out the offending inode with xfs_db to show us what it looks like: $xfs_db -r /dev/hdb1 -c "inode 950759" -c "print".

I don't know what you mean with it but i added it anyway. (done with kernel-2.6.18-gentoo if it matters)

xfs_db:

CLX ~ # xfs_db -r /dev/hdb1 -c "inode 950759" -c "print" core.magic = 0x494e
core.mode = 0100644
core.version = 1
core.format = 3 (btree)
core.nlinkv1 = 0
core.uid = 1000
core.gid = 100
core.flushiter = 0
core.atime.sec = Sun Aug 27 14:56:52 2006 core.atime.nsec = 657389250
core.mtime.sec = Sun Aug 27 16:29:40 2006 core.mtime.nsec = 080196250
core.ctime.sec = Thu Oct 5 01:17:40 2006 core.ctime.nsec = 976565958
core.size = 32071862
core.nblocks = 7833
core.extsize = 0
core.nextents = 28
core.naextents = 0
core.forkoff = 0
core.aformat = 2 (extents)
core.dmevmask = 0
core.dmstate = 0
core.newrtbm = 0
core.prealloc = 0
core.realtime = 0
core.immutable = 0
core.append = 0
core.sync = 0
core.noatime = 0
core.nodump = 0
core.rtinherit = 0
core.projinherit = 0
core.nosymlinks = 0

Quoted 9 lines

core.extsz = 0
core.extszinherit = 0
core.gen = 0
next_unlinked = null
u.bmbt.level = 1
u.bmbt.numrecs = 1
u.bmbt.keys[1] = [startoff] 1:[0]
u.bmbt.ptrs[1] = 1:185933

And now:

xfs_db -r /dev/hadb1 -c "fsb 185933" -c "type bmapbtd" -c "p"

to look at the 28 extent records.

--Tim

#2 lore raw
Quoted 58 lines · Timothy Shimmin
Quoted 49 lines

Hello.
Thanks for your answer.

That's what i have: dmesg print with kernel-2.6.16-gentoo-r3 and an print of xfs_bg.

Quoted 2 lines

You could print out the offending inode with xfs_db to show us what it looks like: $xfs_db -r /dev/hdb1 -c "inode 950759" -c "print".

I don't know what you mean with it but i added it anyway. (done with kernel-2.6.18-gentoo if it matters)

xfs_db:

CLX ~ # xfs_db -r /dev/hdb1 -c "inode 950759" -c "print" core.magic = 0x494e
core.mode = 0100644
core.version = 1
core.format = 3 (btree)
core.nlinkv1 = 0
core.uid = 1000
core.gid = 100
core.flushiter = 0
core.atime.sec = Sun Aug 27 14:56:52 2006 core.atime.nsec = 657389250
core.mtime.sec = Sun Aug 27 16:29:40 2006 core.mtime.nsec = 080196250
core.ctime.sec = Thu Oct  5 01:17:40 2006 core.ctime.nsec = 976565958
core.size = 32071862
core.nblocks = 7833
core.extsize = 0
core.nextents = 28
core.naextents = 0
core.forkoff = 0
core.aformat = 2 (extents)
core.dmevmask = 0
core.dmstate = 0
core.newrtbm = 0
core.prealloc = 0
core.realtime = 0
core.immutable = 0
core.append = 0
core.sync = 0
core.noatime = 0
core.nodump = 0
core.rtinherit = 0
core.projinherit = 0
core.nosymlinks = 0

Quoted 8 lines

core.extsz = 0
core.extszinherit = 0
core.gen = 0
next_unlinked = null
u.bmbt.level = 1
u.bmbt.numrecs = 1
u.bmbt.keys[1] = [startoff] 1:[0]
u.bmbt.ptrs[1] = 1:185933

Quoted 7 lines

And now:

xfs_db -r /dev/hadb1 -c "fsb 185933" -c "type bmapbtd" -c "p"

to look at the 28 extent records.

--Tim

Hello, thanks again for your fast answer
Sorry for the double post last time.
here it comes

CLX ~ # xfs_db -r /dev/hdb1 -c "fsb 185933" -c "type bmapbtd" -c "p" magic = 0x424d4150
level = 0
numrecs = 27
leftsib = null
rightsib = null
recs[1-27] = [startoff,startblock,blockcount,extentflag] 1:[0,185637,16,0] 2:
[16,185537,8,0] 3:[24,185718,8,0] 4:[32,185706,8,0] 5:[40,185836,8,0] 6:
[48,185848,16,0] 7:[64,185865,16,0] 8:[80,185882,8,0] 9:[96,185899,16,0] 10:
[112,185916,16,0] 11:[340,185934,2,0] 12:[342,4768704,1320,0] 13:
[1662,4770389,239,0] 14:[1901,4770919,264,0] 15:[2165,4771391,165,0] 16:
[2330,4771860,227,0] 17:[2557,4861204,351,0] 18:[2908,4861800,257,0] 19:
[3165,4862282,349,0] 20:[3514,4862934,230,0] 21:[3744,4863506,383,0] 22:
[4127,4864141,348,0] 23:[4475,4864871,228,0] 24:[4703,4865358,268,0] 25:
[4971,4865882,593,0] 26:[5564,4866818,339,0] 27:[5903,4867729,1928,0]