BTRFS error in __btrfs_inc_extent_ref:1935: Object already exists
Hello,
Trying to balance a 2TB filesystem on the 3.8.5 kernel:
Label: 'p2' uuid: 01f6cc8b-d305-40e1-bac8-8fdd548f611e
Total devices 1 FS bytes used 1.32TB
devid 1 size 1.80TB used 1.37TB path /dev/sda2
System: total=4.00MB, used=156.00KB
Data+Metadata: total=1.37TB, used=1.32TB
I am getting a Segmentation fault in 'btrfs' utility, and following in dmesg. What is the problem here?
[12259.667681] btrfs: relocating block group 246973202432 flags 5 [12274.481651] btrfs: found 80 extents [12284.273736] btrfs: found 1 extents [12290.803209] btrfs: relocating block group 245899460608 flags 5 [12298.070756] btrfs: found 48 extents [12304.272924] btrfs: relocating block group 244825718784 flags 5 [12318.361116] btrfs: found 511 extents [12327.932489] btrfs: found 6 extents [12335.071480] btrfs: relocating block group 243751976960 flags 5 [12346.588372] btrfs: found 221 extents [12357.535910] btrfs: found 2 extents [12363.295088] btrfs: relocating block group 242678235136 flags 5 [12377.999629] btrfs: found 67 extents [12389.909611] btrfs: found 8 extents [12397.101725] btrfs: relocating block group 241604493312 flags 5 [12411.303919] btrfs: found 94 extents [12418.516308] btrfs: relocating block group 240530751488 flags 5 [12432.028091] btrfs: found 176 extents [12439.785920] btrfs: relocating block group 239457009664 flags 5 [12451.489826] ------------[ cut here ]------------ [12451.489873] WARNING: at fs/btrfs/super.c:256 __btrfs_abort_transaction+0xdf/0x100 [btrfs]() [12451.489880] Hardware name: KS [12451.489885] btrfs: Transaction aborted [12451.489890] Modules linked in: nf_conntrack_ipv6(F) nf_defrag_ipv6(F) ip6t_REJECT(F) ip6table_filter(F) ip6_tables(F) ipt_REJECT(F) xt_tcpudp(F) xt_state(F) xt_limit(F) iptable_nat(F) nf_conntrack_ipv4(F) nf_defrag_ipv4(F) nf_nat_ipv4(F) nf_nat(F) nf_conntrack(F) iptable_filter(F) ip_tables(F) x_tables(F) btrfs(F) zlib_deflate(F) libcrc32c(F) w83627ehf(F) hwmon_vid(F) coretemp(F) gpio_ich(F) snd_pcm(F) i915(F) snd_timer(F) snd(F) soundcore(F) snd_page_alloc(F) microcode(F) psmouse(F) tpm_tis(F) drm_kms_helper(F) pcspkr(F) serio_raw(F) drm(F) lpc_ich(F) i2c_i801(F) r8169(F) i2c_algo_bit(F) mac_hid(F) video(F) [12451.489981] Pid: 1053, comm: btrfs Tainted: GF 3.8.5-gnu #1 [12451.489987] Call Trace: [12451.490006] [<ffffffff81058bef>] warn_slowpath_common+0x7f/0xc0 [12451.490020] [<ffffffff81058ce6>] warn_slowpath_fmt+0x46/0x50 [12451.490064] [<ffffffffa0220b37>] ? free_extent_buffer+0x37/0x90 [btrfs] [12451.490098] [<ffffffffa01da01f>] __btrfs_abort_transaction+0xdf/0x100 [btrfs] [12451.490204] [<ffffffffa01e6d8c>] ? insert_tree_block_ref+0x4c/0x70 [btrfs] [12451.490295] [<ffffffffa01e9908>] __btrfs_inc_extent_ref+0x1b8/0x200 [btrfs] [12451.490337] [<ffffffffa02450d9>] ? btrfs_merge_delayed_refs+0x289/0x300 [btrfs] [12451.490408] [<ffffffffa01ef87e>] run_clustered_refs+0x9ce/0xae0 [btrfs] [12451.490438] [<ffffffffa01dd8bd>] ? btrfs_put_tree_mod_seq+0x10d/0x150 [btrfs] [12451.490470] [<ffffffffa01f32c0>] btrfs_run_delayed_refs+0xd0/0x2f0 [btrfs] [12451.490504] [<ffffffffa0203987>] __btrfs_end_transaction+0xf7/0x410 [btrfs] [12451.490538] [<ffffffffa0203cd3>] btrfs_end_transaction_throttle+0x13/0x20 [btrfs] [12451.490576] [<ffffffffa024bf34>] merge_reloc_root+0x274/0x500 [btrfs] [12451.490606] [<ffffffffa01dd32a>] ? btrfs_free_path+0x2a/0x40 [btrfs] [12451.490698] [<ffffffffa024c2d8>] merge_reloc_roots+0x118/0x150 [btrfs] [12451.490741] [<ffffffffa024c91b>] relocate_block_group+0x3db/0x640 [btrfs] [12451.490784] [<ffffffffa024cd45>] btrfs_relocate_block_group+0x1c5/0x300 [btrfs] [12451.490825] [<ffffffffa02250b5>] btrfs_relocate_chunk.isra.54+0x75/0x730 [btrfs] [12451.490864] [<ffffffffa021b5e1>] ? release_extent_buffer.isra.26+0x81/0xf0 [btrfs] [12451.490904] [<ffffffffa0220b37>] ? free_extent_buffer+0x37/0x90 [btrfs] [12451.490945] [<ffffffffa02294d7>] btrfs_balance+0x8e7/0xe00 [btrfs] [12451.490988] [<ffffffffa023135f>] btrfs_ioctl_balance+0x22f/0x570 [btrfs] [12451.491030] [<ffffffffa0233cb0>] btrfs_ioctl+0xee0/0x1b70 [btrfs] [12451.491045] [<ffffffff811a66a3>] ? user_path_at_empty+0x63/0xa0 [12451.491058] [<ffffffff816d74a0>] ? __do_page_fault+0x240/0x540 [12451.491157] [<ffffffff811a87d8>] do_vfs_ioctl+0x98/0x550 [12451.491182] [<ffffffff81162173>] ? do_brk+0x1b3/0x330 [12451.491191] [<ffffffff811a8d21>] sys_ioctl+0x91/0xb0 [12451.491201] [<ffffffff816dbe1d>] system_call_fastpath+0x1a/0x1f [12451.491208] ---[ end trace a10e7cae6b920c78 ]--- [12451.491217] BTRFS error (device sda2) in __btrfs_inc_extent_ref:1935: Object already exists [12451.494408] btrfs is forced readonly [12451.495143] ------------[ cut here ]------------ [12451.498178] Kernel BUG at ffffffffa024bdbe [verbose debug info unavailable] [12451.498178] invalid opcode: 0000 [#1] SMP [12451.498178] Modules linked in: nf_conntrack_ipv6(F) nf_defrag_ipv6(F) ip6t_REJECT(F) ip6table_filter(F) ip6_tables(F) ipt_REJECT(F) xt_tcpudp(F) xt_state(F) xt_limit(F) iptable_nat(F) nf_conntrack_ipv4(F) nf_defrag_ipv4(F) nf_nat_ipv4(F) nf_nat(F) nf_conntrack(F) iptable_filter(F) ip_tables(F) x_tables(F) btrfs(F) zlib_deflate(F) libcrc32c(F) w83627ehf(F) hwmon_vid(F) coretemp(F) gpio_ich(F) snd_pcm(F) i915(F) snd_timer(F) snd(F) soundcore(F) snd_page_alloc(F) microcode(F) psmouse(F) tpm_tis(F) drm_kms_helper(F) pcspkr(F) serio_raw(F) drm(F) lpc_ich(F) i2c_i801(F) r8169(F) i2c_algo_bit(F) mac_hid(F) video(F) [12451.498178] CPU 0 [12451.498178] Pid: 1053, comm: btrfs Tainted: GF W 3.8.5-gnu #1 OVH KS/D425KT [12451.498178] RIP: 0010:[<ffffffffa024bdbe>] [<ffffffffa024bdbe>] merge_reloc_root+0xfe/0x500 [btrfs] [12451.498178] RSP: 0018:ffff88011c9bb998 EFLAGS: 00010206 [12451.498178] RAX: ffffffffffffffe2 RBX: ffff880114c24cf0 RCX: 0000000000000002 [12451.498178] RDX: 0000000000000000 RSI: ffff88012976e000 RDI: ffff88011a987800 [12451.498178] RBP: ffff88011c9bba58 R08: ffffea00047430c0 R09: 0000000000000000 [12451.498178] R10: 0000000000000000 R11: 0000000000000000 R12: ffff88011a066000 [12451.498178] R13: ffffffffffffffe2 R14: ffff88011a987800 R15: ffff880119ade800 [12451.498178] FS: 00007f116b017760(0000) GS:ffff88012fc00000(0000) knlGS:0000000000000000 [12451.498178] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [12451.498178] CR2: ffffffffff600400 CR3: 0000000119fed000 CR4: 00000000000007f0 [12451.498178] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [12451.498178] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [12451.498178] Process btrfs (pid: 1053, threadinfo ffff88011c9ba000, task ffff880128231740) [12451.498178] Stack: [12451.498178] ffff880100000002 ffffffffa01dd32a ffff880119ade000 0000000000000000 [12451.498178] 000000021c9bba58 0000e00000000001 ffff88011c9bb9d8 000774ff81350f5b [12451.498178] 00006c0000000000 080d000000000068 006c000000000000 74000000003cba70 [12451.498178] Call Trace: [12451.498178] [<ffffffffa01dd32a>] ? btrfs_free_path+0x2a/0x40 [btrfs] [12451.498178] [<ffffffffa024c2d8>] merge_reloc_roots+0x118/0x150 [btrfs] [12451.498178] [<ffffffffa024c91b>] relocate_block_group+0x3db/0x640 [btrfs] [12451.498178] [<ffffffffa024cd45>] btrfs_relocate_block_group+0x1c5/0x300 [btrfs] [12451.498178] [<ffffffffa02250b5>] btrfs_relocate_chunk.isra.54+0x75/0x730 [btrfs] [12451.498178] [<ffffffffa021b5e1>] ? release_extent_buffer.isra.26+0x81/0xf0 [btrfs] [12451.498178] [<ffffffffa0220b37>] ? free_extent_buffer+0x37/0x90 [btrfs] [12451.498178] [<ffffffffa02294d7>] btrfs_balance+0x8e7/0xe00 [btrfs] [12451.498178] [<ffffffffa023135f>] btrfs_ioctl_balance+0x22f/0x570 [btrfs] [12451.498178] [<ffffffffa0233cb0>] btrfs_ioctl+0xee0/0x1b70 [btrfs] [12451.498178] [<ffffffff811a66a3>] ? user_path_at_empty+0x63/0xa0 [12451.498178] [<ffffffff816d74a0>] ? __do_page_fault+0x240/0x540 [12451.498178] [<ffffffff811a87d8>] do_vfs_ioctl+0x98/0x550 [12451.498178] [<ffffffff81162173>] ? do_brk+0x1b3/0x330 [12451.498178] [<ffffffff811a8d21>] sys_ioctl+0x91/0xb0 [12451.498178] [<ffffffff816dbe1d>] system_call_fastpath+0x1a/0x1f [12451.498178] Code: 00 00 4c 89 f7 49 89 45 40 49 8b 74 24 18 e8 6a 1d fa ff 85 c0 74 16 83 f8 f5 75 0f 4c 89 f6 4c 89 ef e8 b6 6f fb ff 85 c0 74 b2 <0f> 0b 8b 45 cc 48 8d 55 cc 48 89 de 4c 89 ff 89 85 64 ff ff ff [12451.498178] RIP [<ffffffffa024bdbe>] merge_reloc_root+0xfe/0x500 [btrfs] [12451.498178] RSP <ffff88011c9bb998> [12451.740494] ---[ end trace a10e7cae6b920c79 ]---
Signature · 2 lines
With respect, Roman
Hello,
After a reboot the filesystem now does not mount at all, with similar messages.
[ 66.874267] Btrfs loaded [ 66.876222] device label p2 devid 1 transid 22985 /dev/sda2 [ 66.878175] btrfs: use lzo compression [ 66.878185] btrfs: disk space caching is enabled [ 79.112680] ------------[ cut here ]------------ [ 79.112713] WARNING: at fs/btrfs/super.c:256 __btrfs_abort_transaction+0xdf/0x100 [btrfs]() [ 79.112717] Hardware name: KS [ 79.112721] btrfs: Transaction aborted [ 79.112724] Modules linked in: btrfs(F) zlib_deflate(F) libcrc32c(F) nf_conntrack_ipv6(F) nf_defrag_ipv6(F) ip6t_REJECT(F) ip6table_filter(F) ip6_tables(F) ipt_REJECT(F) xt_tcpudp(F) xt_state(F) xt_limit(F) iptable_nat(F) nf_conntrack_ipv4(F) nf_defrag_ipv4(F) nf_nat_ipv4(F) nf_nat(F) nf_conntrack(F) iptable_filter(F) ip_tables(F) x_tables(F) w83627ehf(F) hwmon_vid(F) coretemp(F) gpio_ich(F) i915(F) snd_pcm(F) snd_timer(F) tpm_tis(F) drm_kms_helper(F) microcode(F) snd(F) soundcore(F) drm(F) snd_page_alloc(F) psmouse(F) pcspkr(F) r8169(F) mac_hid(F) i2c_algo_bit(F) i2c_i801(F) serio_raw(F) lpc_ich(F) video(F) [ 79.112793] Pid: 1037, comm: mount Tainted: GF 3.8.5-gnu #1 [ 79.112796] Call Trace: [ 79.112810] [<ffffffff81058bef>] warn_slowpath_common+0x7f/0xc0 [ 79.112818] [<ffffffff81058ce6>] warn_slowpath_fmt+0x46/0x50 [ 79.112848] [<ffffffffa028db37>] ? free_extent_buffer+0x37/0x90 [btrfs] [ 79.112870] [<ffffffffa024701f>] __btrfs_abort_transaction+0xdf/0x100 [btrfs] [ 79.112893] [<ffffffffa0253d8c>] ? insert_tree_block_ref+0x4c/0x70 [btrfs] [ 79.112916] [<ffffffffa0256908>] __btrfs_inc_extent_ref+0x1b8/0x200 [btrfs] [ 79.112947] [<ffffffffa02b20d9>] ? btrfs_merge_delayed_refs+0x289/0x300 [btrfs] [ 79.112971] [<ffffffffa025c87e>] run_clustered_refs+0x9ce/0xae0 [btrfs] [ 79.112994] [<ffffffffa024a8bd>] ? btrfs_put_tree_mod_seq+0x10d/0x150 [btrfs] [ 79.113018] [<ffffffffa02602c0>] btrfs_run_delayed_refs+0xd0/0x2f0 [btrfs] [ 79.113045] [<ffffffffa0270987>] __btrfs_end_transaction+0xf7/0x410 [btrfs] [ 79.113072] [<ffffffffa0270cd3>] btrfs_end_transaction_throttle+0x13/0x20 [btrfs] [ 79.113102] [<ffffffffa02b8f34>] merge_reloc_root+0x274/0x500 [btrfs] [ 79.113125] [<ffffffffa024a32a>] ? btrfs_free_path+0x2a/0x40 [btrfs] [ 79.113155] [<ffffffffa02b92d8>] merge_reloc_roots+0x118/0x150 [btrfs] [ 79.113186] [<ffffffffa02ba22b>] btrfs_recover_relocation+0x3ab/0x400 [btrfs] [ 79.113212] [<ffffffffa026e472>] open_ctree+0x1c52/0x1d70 [btrfs] [ 79.113235] [<ffffffffa0246bbb>] btrfs_mount+0x57b/0x670 [btrfs] [ 79.113245] [<ffffffff8119aa53>] mount_fs+0x43/0x1b0 [ 79.113252] [<ffffffff811b5226>] vfs_kern_mount+0x76/0x120 [ 79.113260] [<ffffffff811b748d>] do_mount+0x1fd/0xa40 [ 79.113267] [<ffffffff811b70fa>] ? copy_mount_options+0x3a/0x180 [ 79.113274] [<ffffffff811b7d60>] sys_mount+0x90/0xe0 [ 79.113283] [<ffffffff816dbe1d>] system_call_fastpath+0x1a/0x1f [ 79.113288] ---[ end trace abe4f5e37903fe08 ]--- [ 79.113294] BTRFS error (device sda2) in __btrfs_inc_extent_ref:1935: Object already exists [ 79.115793] ------------[ cut here ]------------ [ 79.116014] Kernel BUG at ffffffffa02b8dbe [verbose debug info unavailable] [ 79.116014] invalid opcode: 0000 [#1] SMP [ 79.116014] Modules linked in: btrfs(F) zlib_deflate(F) libcrc32c(F) nf_conntrack_ipv6(F) nf_defrag_ipv6(F) ip6t_REJECT(F) ip6table_filter(F) ip6_tables(F) ipt_REJECT(F) xt_tcpudp(F) xt_state(F) xt_limit(F) iptable_nat(F) nf_conntrack_ipv4(F) nf_defrag_ipv4(F) nf_nat_ipv4(F) nf_nat(F) nf_conntrack(F) iptable_filter(F) ip_tables(F) x_tables(F) w83627ehf(F) hwmon_vid(F) coretemp(F) gpio_ich(F) i915(F) snd_pcm(F) snd_timer(F) tpm_tis(F) drm_kms_helper(F) microcode(F) snd(F) soundcore(F) drm(F) snd_page_alloc(F) psmouse(F) pcspkr(F) r8169(F) mac_hid(F) i2c_algo_bit(F) i2c_i801(F) serio_raw(F) lpc_ich(F) video(F) [ 79.116014] CPU 1 [ 79.116014] Pid: 1037, comm: mount Tainted: GF W 3.8.5-gnu #1 OVH KS/D425KT [ 79.116014] RIP: 0010:[<ffffffffa02b8dbe>] [<ffffffffa02b8dbe>] merge_reloc_root+0xfe/0x500 [btrfs] [ 79.116014] RSP: 0018:ffff88011eef1a08 EFLAGS: 00010202 [ 79.116014] RAX: ffffffffffffffef RBX: ffff8801204e6ea0 RCX: 0000000000000064 [ 79.116014] RDX: 0000000000000063 RSI: ffff8801205ba980 RDI: 000000000001bdc0 [ 79.116014] RBP: ffff88011eef1ac8 R08: ffffea0004816e80 R09: 0000000000000000 [ 79.116014] R10: 0000000000000000 R11: ffffffff81850668 R12: ffff88011ff24800 [ 79.116014] R13: ffffffffffffffef R14: ffff88012765f800 R15: ffff880127cbf000 [ 79.116014] FS: 00007f0025e1c7e0(0000) GS:ffff88012fc80000(0000) knlGS:0000000000000000 [ 79.116014] CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b [ 79.116014] CR2: ffffffffff600400 CR3: 000000011edf9000 CR4: 00000000000007e0 [ 79.116014] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 79.116014] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [ 79.116014] Process mount (pid: 1037, threadinfo ffff88011eef0000, task ffff880129311740) [ 79.116014] Stack: [ 79.116014] ffff880100000002 ffffffffa024a32a ffff88012765f000 0000000000000000 [ 79.116014] 000000021eef1ac8 0000e00000000001 ffff88011eef1a48 000774ff81350f5b [ 79.116014] 00006c0000000000 080d000000000068 006c000000000000 74000000003cba70 [ 79.116014] Call Trace: [ 79.116014] [<ffffffffa024a32a>] ? btrfs_free_path+0x2a/0x40 [btrfs] [ 79.116014] [<ffffffffa02b92d8>] merge_reloc_roots+0x118/0x150 [btrfs] [ 79.116014] [<ffffffffa02ba22b>] btrfs_recover_relocation+0x3ab/0x400 [btrfs] [ 79.116014] [<ffffffffa026e472>] open_ctree+0x1c52/0x1d70 [btrfs] [ 79.116014] [<ffffffffa0246bbb>] btrfs_mount+0x57b/0x670 [btrfs] [ 79.116014] [<ffffffff8119aa53>] mount_fs+0x43/0x1b0 [ 79.116014] [<ffffffff811b5226>] vfs_kern_mount+0x76/0x120 [ 79.116014] [<ffffffff811b748d>] do_mount+0x1fd/0xa40 [ 79.116014] [<ffffffff811b70fa>] ? copy_mount_options+0x3a/0x180 [ 79.116014] [<ffffffff811b7d60>] sys_mount+0x90/0xe0 [ 79.116014] [<ffffffff816dbe1d>] system_call_fastpath+0x1a/0x1f [ 79.116014] Code: 00 00 4c 89 f7 49 89 45 40 49 8b 74 24 18 e8 6a 1d fa ff 85 c0 74 16 83 f8 f5 75 0f 4c 89 f6 4c 89 ef e8 b6 6f fb ff 85 c0 74 b2 <0f> 0b 8b 45 cc 48 8d 55 cc 48 89 de 4c 89 ff 89 85 64 ff ff ff [ 79.116014] RIP [<ffffffffa02b8dbe>] merge_reloc_root+0xfe/0x500 [btrfs] [ 79.116014] RSP <ffff88011eef1a08> [ 79.264721] ---[ end trace abe4f5e37903fe09 ]---
Signature · 2 lines
With respect, Roman
Quoted 3 lines · On Mon, 1 Apr 2013 04:36:05 +0600 Roman Mamedov <[email protected]> wrote:
Hello,
After a reboot the filesystem now does not mount at all, with similar messages.
So thinking this was an isolated incident, I foolishly continued setting up scheduled balance on other systems with btrfs that I have.
And got into exactly the same situation on another machine!!
Trying to balance this with -dusage=5, on kernel 3.8.5:
Data: total=215.01GB, used=141.76GB
System, DUP: total=32.00MB, used=32.00KB
System: total=4.00MB, used=0.00
Metadata, DUP: total=9.38GB, used=1.09GB
Same messages, "Object already exists".
While I currently left the previously mentioned 2TB FS in an unmounted broken state, still waiting for any response from you on how to properly recover from this problem, in this new case I needed to restore the machine as soon as possible.
I tried btrfsck --repair, it corrected a lot of errors, but in the end gave up with a message saying that it can't repair the filesystem; then I did btrfs-zero-log. After this the FS started mounting successfully again.
Not sure if I got any data corruption as a result, but this is the root FS and /home, and the machine successfully booted up with no data lost in any of the apps that were active just before the crash (e.g browser, IM and IRC clients), so probably not.
Signature · 2 lines
With respect, Roman
Quoted 26 lines · Roman Mamedov
Quoted 3 lines · On Mon, 1 Apr 2013 04:36:05 +0600 Roman Mamedov <[email protected]> wrote:
Hello,
After a reboot the filesystem now does not mount at all, with similar messages.
So thinking this was an isolated incident, I foolishly continued setting up scheduled balance on other systems with btrfs that I have.
And got into exactly the same situation on another machine!!
Trying to balance this with -dusage=5, on kernel 3.8.5:
Data: total=215.01GB, used=141.76GB
System, DUP: total=32.00MB, used=32.00KB
System: total=4.00MB, used=0.00
Metadata, DUP: total=9.38GB, used=1.09GBSame messages, "Object already exists".
While I currently left the previously mentioned 2TB FS in an unmounted broken state, still waiting for any response from you on how to properly recover from this problem, in this new case I needed to restore the machine as soon as possible.
Quoted 9 lines
I tried btrfsck --repair, it corrected a lot of errors, but in the end gave up with a message saying that it can't repair the filesystem; then I did btrfs-zero-log. After this the FS started mounting successfully again.
Not sure if I got any data corruption as a result, but this is the root FS and /home, and the machine successfully booted up with no data lost in any of the apps that were active just before the crash (e.g browser, IM and IRC clients), so probably not.
Can you capture an image of these broken file systems the next time it happens? You'll need to clone the progs here
git://github.com/josefbacik/btrfs-progs.git
and build and then run
btrfs-image -w /dev/whatever blah.img
and then upload blah.img up somewhere I can pull it down. You can use the -t and -c options too, but the -w is the most important since you have extent tree corruption. Thanks,
Josef
I have a (larger, 7x2TB at RAID10) filesystem that was recently hit by this. Same story; filesystem works normally, balance start, works for a while, then fails with similar stack traces and remounts read-only, after a reboot does not mount at all with similar error messages and stack traces.
The FS is still in that state. I'll grab an image and mail a link privately. I don't need to do anything special for btrfs-image on a multi-device fs, right?
Kernel version is 3.8.4-1-ARCH (archlinux.)
Quoted 55 lines · Josef Bacik
Quoted 26 lines · Roman Mamedov
Quoted 3 lines · On Mon, 1 Apr 2013 04:36:05 +0600 Roman Mamedov <[email protected]> wrote:
Hello,
After a reboot the filesystem now does not mount at all, with similar messages.
So thinking this was an isolated incident, I foolishly continued setting up scheduled balance on other systems with btrfs that I have.
And got into exactly the same situation on another machine!!
Trying to balance this with -dusage=5, on kernel 3.8.5:
Data: total=215.01GB, used=141.76GB
System, DUP: total=32.00MB, used=32.00KB
System: total=4.00MB, used=0.00
Metadata, DUP: total=9.38GB, used=1.09GBSame messages, "Object already exists".
While I currently left the previously mentioned 2TB FS in an unmounted broken state, still waiting for any response from you on how to properly recover from this problem, in this new case I needed to restore the machine as soon as possible.
Quoted 9 lines
I tried btrfsck --repair, it corrected a lot of errors, but in the end gave up with a message saying that it can't repair the filesystem; then I did btrfs-zero-log. After this the FS started mounting successfully again.
Not sure if I got any data corruption as a result, but this is the root FS and /home, and the machine successfully booted up with no data lost in any of the apps that were active just before the crash (e.g browser, IM and IRC clients), so probably not.
Can you capture an image of these broken file systems the next time it happens? You'll need to clone the progs here
git://github.com/josefbacik/btrfs-progs.gitand build and then run
btrfs-image -w
/dev/whateverblah.imgand then upload blah.img up somewhere I can pull it down. You can use the -t and -c options too, but the -w is the most important since you have extent tree corruption. Thanks,
Josef
--
To unsubscribe from this list: send the line "unsubscribe linux-btrfs" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html
Quoted 10 lines · Chris Kastorff
I have a (larger, 7x2TB at RAID10) filesystem that was recently hit by this. Same story; filesystem works normally, balance start, works for a while, then fails with similar stack traces and remounts read-only, after a reboot does not mount at all with similar error messages and stack traces.
The FS is still in that state. I'll grab an image and mail a link privately. I don't need to do anything special for btrfs-image on a multi-device fs, right?
Right it will grab stuff from whatever mirror it's on and put it in the image. Make sure to use -w, if the extent tree is corrupt the -w will make sure it actually grabs all of the file system. Thanks,
Josef
Quoted 5 lines · On Mon, 1 Apr 2013 09:31:10 -0400 Josef Bacik <[email protected]> wrote:
Can you capture an image of these broken file systems the next time it happens? You'll need to clone the progs here
git://github.com/josefbacik/btrfs-progs.git
Quoted 7 lines
and build and then run
btrfs-image -w
/dev/whateverblah.imgand then upload blah.img up somewhere I can pull it down. You can use the -t and -c options too, but the -w is the most important since you have extent tree corruption. Thanks,
Hello,
I have sent the link privately to your E-Mail.
Signature · 2 lines
With respect, Roman
Quoted 2 lines
I tried btrfsck --repair,
I am not indicating this is the cause but, kindly note that btrfsck --repair has a bug which it will let kernel to reset the uuid of the root.
the fix is at:
[PATCH] btrfs-progs: root_item generation_v2 is out of sync after btrfsck
Thanks, Anand
Quoted 8 lines · Roman Mamedov
Hello,
Trying to balance a 2TB filesystem on the 3.8.5 kernel:
Label: 'p2' uuid: 01f6cc8b-d305-40e1-bac8-8fdd548f611e
Total devices 1 FS bytes used 1.32TB
devid 1 size 1.80TB used 1.37TB path/dev/sda2
Quoted 6 lines
System: total=4.00MB, used=156.00KB
Data+Metadata: total=1.37TB, used=1.32TBI am getting a Segmentation fault in 'btrfs' utility, and following in dmesg. What is the problem here?
I just posted a patch for this bug, I can mount your image now without it panicing and it passes fsck on either side of the mount. Let me know if it doesn't work for you. Thanks,
Josef
Quoted 3 lines · On Mon, 1 Apr 2013 20:46:45 -0400 Josef Bacik <[email protected]> wrote:
I just posted a patch for this bug, I can mount your image now without it panicing and it passes fsck on either side of the mount. Let me know if it doesn't work for you. Thanks,
Thank you, it now mounted and works without issues.
Signature · 2 lines
With respect, Roman