Data Loss (flex_bg and ext4_mb_generate_buddy errors)
https://bugzilla.kernel.org/show_bug.cgi?id=15576
--- Comment #1 from Theodore Tso <[email protected]> 2010-03-22 02:13:37 ---
Quoted 11 lines · On Fri, Mar 19, 2010 at 01:05:23AM +0000, [email protected]…
# create a 484 cylinder disk [3.7 GB] dd of=disk.bin bs=512 count=0 seek=$((484*255*63))# associate with loop device losetup /dev/loop0 disk.bin# generate bad blocks file [600 MB] for((i=360491;i<=497992;i++)); do echo $i; done > omit# format disk with ext4 mkfs.ext4 -l omit /dev/loop0
This is an e2fsprogs bug. If you run e2fsck at this point, pass 5 errors will be reported, that exactly correspond with what you report the kernel ends up complaining about:
Free blocks count wrong for group #12 (2, counted=0).
Free blocks count wrong for group #13 (2, counted=0).
Free blocks count wrong for group #14 (2, counted=0).
Free blocks count wrong for group #15 (9913, counted=9911).
Free blocks count wrong (800730, counted=800722).
Quoted 4 lines
Worse off, however, if rather than creating a 2 GB file, you use this partition as the target root partition for installation using the latest [32-bit] Ubuntu installer ... consistently at 57 percent of the install ext4 reports data loss.
That's because the the file system is getting remounted read-only when the file system corruption is detected:
Quoted 3 lines
[ 1129.344600] EXT4-fs error (device sda1): ext4_mb_generate_buddy: EXT4-fs: group 12: 0 blocks in bitmap, 2 in gd [ 1129.380697] EXT4-fs (sda1): Remounting filesystem read-only
The basic idea behind this is when there is a discrepancy between the pass #5 summary statistics and the block allocation bitmap, the problem could be in the block allocation bitmap. (In this case it is the summary statistics, but there's no way for the code to know that.) If the block allocation bitmap is bogus, it's very dangerous to continue writing into the file system, since we may end up allocating blocks that are already in use by other files, and this would cause data loss when those data blocks get overwritten.
Once the file system is marked as read-only, data written just before the file system was remounted read-only can't be pushed out to disk, which is the reason for the warnign message:
Quoted 3 lines
[ 1129.574343] mpage_da_map_blocks block allocation failed for inode 41510 at logical offset 0 with max blocks 6 with error -30 [ 1129.574352] This should not happen.!! Data will be lost
(Error -30 is "EROFS".)
We should probably improve the error messages here, but there's not much else we can do.
The real core issue is the fact that mke2fs isn't doing the right thing when there are bad blocks and flex_bg is specified. It's something we don't test for, since in practice it never happens with modern disk drives.
- Ted
Signature · 3 lines
Configure bugmail: https://bugzilla.kernel.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching the assignee of the bug.
https://bugzilla.kernel.org/show_bug.cgi?id=15576
--- Comment #2 from [email protected] 2010-03-22 05:34:37 --- You guys are awesome :) This let's me get back on my way.
Signature · 3 lines
Configure bugmail: https://bugzilla.kernel.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching the assignee of the bug.
https://bugzilla.kernel.org/show_bug.cgi?id=15576
Theodore Tso <[email protected]> changed:
What |Removed |Added
----------------------------------------------------------------------------
CC| |[email protected] Kernel Version|Linux elitemx-desktop |2.6.31-20-generic |2.6.31-20-generic |#58-Ubuntu SMP |#58-Ubuntu SMP Fri Mar 12 | |05:23:09 UTC 2010 i686 | |GNU/Linux |
Signature · 3 lines
Configure bugmail: https://bugzilla.kernel.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching the assignee of the bug.
https://bugzilla.kernel.org/show_bug.cgi?id=15576
Alan <[email protected]> changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|NEW |RESOLVED
CC| |[email protected]
Resolution| |DOCUMENTEDSignature · 3 lines
Configure bugmail: https://bugzilla.kernel.org/userprefs.cgi?tab=email ------- You are receiving this mail because: ------- You are watching the assignee of the bug.