Skip to contentSkip to conversation

SLAB bug SMP 64bit / XFS mess

parisc-linux Grant Grundler 1 participant 3 messages Apr 11, 2005 4 messages not in the archive

lore
Share & tools
lore

A message that is not in the archive (sent off-list or not yet received): [email protected]

A message that is not in the archive (sent off-list or not yet received): [email protected]

A message that is not in the archive (sent off-list or not yet received): [email protected]

A message that is not in the archive (sent off-list or not yet received): [email protected]

#4 lore raw
Quoted 5 lines · Thibaut VARENE

Just for the records:

while trying to debug the XFS issue on my J6k, here what i noticed:

32bit kernel: no bug

Sorry, though my j6k did not panic with 32-bit kernel, there is definitely some XFS bug(s?). Test output and details follow.

grundler <511>uname -a
Linux gggj6k 2.6.12-rc2-pa1 #5 SMP Sun Apr 10 14:13:59 PDT 2005 parisc GNU/Linux

That's despite sym2 using I/O Port space:
CONFIG_SCSI_SYM53C8XX_IOMAPPED=y

I got alot (> 500 linus scrollback) of the following on console:

0x0: ed 41 00 00 00 10 00 00 a0 c4 59 42 4c ab 26 42
Filesystem "sdb3": XFS internal error xfs_da_do_buf(2) at line 2271 of file fs/4

Backtrace:
 [<1027d514>] xfs_da_do_buf+0x354/0x754
 [<1027d974>] xfs_da_read_buf+0x2c/0x38
 [<1028157c>] xfs_dir2_block_lookup_int+0x74/0x1fc
 [<1028146c>] xfs_dir2_block_lookup+0x1c/0xb8
 [<1027fd30>] xfs_dir2_lookup+0xc8/0x140
 [<102ad50c>] xfs_dir_lookup_int+0x50/0x118
 [<102b26a8>] xfs_lookup+0x68/0xac
 [<102c0894>] linvfs_lookup+0x60/0xa4
 [<1019e8d8>] __lookup_hash+0xc0/0xf8
 [<1019fa58>] lookup_create+0x68/0xcc
 [<1019ff1c>] sys_mkdir+0x78/0x134
 [<1010e178>] syscall_exit+0x0/0x14

And then the last console output was:
0x0: 58 44 32 44 0e 58 01 a8 07 c8 00 20 09 50 00 20
Filesystem "sdb3": XFS internal error xfs_dir2_block_addname at line 128 of fil4

Backtrace:
 [<10281124>] xfs_dir2_block_addname+0x6c0/0x6d4
 [<1027fc14>] xfs_dir2_createname+0x124/0x178
 [<102b3ee8>] xfs_mkdir+0x484/0x6e4
 [<102c07b8>] linvfs_mknod+0x1d0/0x210
 [<1019fe78>] vfs_mkdir+0x94/0xc0
 [<1019ff68>] sys_mkdir+0xc4/0x134
 [<1010e178>] syscall_exit+0x0/0x14

xfs_force_shutdown(sdb3,0x8) called from line 1091 of file fs/xfs/xfs_trans.c. c Filesystem "sdb3": Corruption of in-memory data detected. Shutting down filesy3 Please umount the filesystem, and rectify the problem(s)
SMP CALL FUNCTION TIMED OUT! (cpu=1), try 1

My test was "time rsync -aWx --stats / /mnt" with two disks:

grundler@gggj6k:~$ lsscsi
[1:0:5:0]    disk    HP       18.2GB C 80-D94N D94N  /dev/sda
[1:0:6:0]    disk    SEAGATE  ST318203LC       0001  /dev/sdb
grundler@gggj6k:~$ df
Filesystem           1K-blocks      Used Available Use% Mounted on
/dev/sda3             16911576  13625088   2427416  85% /
tmpfs                  1812796         0   1812796   0% /dev/shm
/dev/sda1                85528     28487     52625  36% /boot
/dev/sdb3             17171264  13671156   3500108  80% /mnt

Ext3 on sda3 and freshly made "mkfs.xfs -f /dev/sdb3":
/dev/sda3 on / type ext3 (rw,errors=remount-ro)

The rsync complained *alot* (> 500 lines of scrollback) about:
rsync: stat "/mnt/home/tftpboot/pa8800/var/spool/postfix/deferred/8" failed: Input/output error (5)

rsync stats output:

Number of files: 394227
Number of files transferred: 349625
Total file size: 12845404686 bytes
Total transferred file size: 12845269080 bytes
Literal data: 12845327899 bytes
Matched data: 0 bytes
File list size: 7360585
Total bytes sent: 12869390640
Total bytes received: 6992520

sent 12869390640 bytes received 6992520 bytes 5379729.75 bytes/sec total size is 12845404686 speedup is 1.00
rsync error: some files could not be transferred (code 23) at main.c(702)

real    39m52.694s
user    5m52.069s
sys     7m34.079s

hth,
grant
_______________________________________________
parisc-linux mailing list
[email protected]
http://lists.parisc-linux.org/mailman/listinfo/parisc-linux

#5 lore raw
Quoted 2 lines · Grant Grundler

Sorry, though my j6k did not panic with 32-bit kernel, there is definitely some XFS bug(s?). Test output and details follow.

Just for comparison, I ran the same workload on ext3 and it worked fine. Started with "mke2fs /dev/sdb3; mount /dev/sdb3 /mnt" and then ran my pet test-of-the-week again:

root@gggj6k:~# time rsync -aWx --stats / /mnt

Number of files: 394228
Number of files transferred: 349626
Total file size: 12845690938 bytes
Total transferred file size: 12845555332 bytes
Literal data: 12845560371 bytes
Matched data: 0 bytes
File list size: 7360607
Total bytes sent: 12869623206
Total bytes received: 6992540

sent 12869623206 bytes received 6992540 bytes 9908900.15 bytes/sec total size is 12845690938 speedup is 1.00

real    21m39.937s
user    5m47.908s
sys     5m50.986s

root@gggj6k:~#

"iostat 10" on another login reported pretty impressive numbers at times like for this 30 second period (rsync says avg is 1/4th of this):

avg-cpu: %user %nice %sys %iowait %idle

          27.54    0.00   24.04   28.49   19.94

Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn
sda 208.60 43289.60 100.80 432896 1008
sdb 46.40 22.40 40007.20 224 400072

avg-cpu: %user %nice %sys %iowait %idle

          28.96    0.00   24.06   40.77    6.20

Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn
sda 212.30 45693.60 68.80 456936 688
sdb 48.40 4.00 35515.20 40 355152

avg-cpu: %user %nice %sys %iowait %idle

          30.70    0.00   23.45   37.30    8.55

Device: tps Blk_read/s Blk_wrtn/s Blk_read Blk_wrtn
sda 180.20 48866.40 51.20 488664 512
sdb 55.40 23.20 37864.80 232 378648

hth,
grant
_______________________________________________
parisc-linux mailing list
[email protected]
http://lists.parisc-linux.org/mailman/listinfo/parisc-linux

#6 lore raw
Quoted 1 line · Grant Grundler

Just for comparison, I ran the same workload on ext3 and it worked fine.

Sorry, I meant ext2.

Here is the correct rsync output for ext3 on /dev/sdb3:

root@gggj6k:~# time rsync -aWx --stats / /mnt

Number of files: 394228
Number of files transferred: 349626
Total file size: 12845701275 bytes
Total transferred file size: 12845565669 bytes
Literal data: 12845570528 bytes
Matched data: 0 bytes
File list size: 7360229
Total bytes sent: 12869632989
Total bytes received: 6992540

sent 12869632989 bytes received 6992540 bytes 8178231.52 bytes/sec total size is 12845701275 speedup is 1.00

real    26m14.078s
user    5m47.767s
sys     7m11.995s

root@gggj6k:~#

grant
_______________________________________________
parisc-linux mailing list
[email protected]
http://lists.parisc-linux.org/mailman/listinfo/parisc-linux