Skip to contentSkip to conversation

Running Apache Derby on 3.8 and BTRFS cause kernel oops

DISCUSSION Daniel Kozák 5 participants 13 messages Feb 27, 2013 – Feb 28, 2013 Btrfs file system

lore
Share & tools
lore
#0 lore raw

Hello,

On my both machine I have ArchLinux with recent kernel 3.8.0 btrfs as a filesystem (with lzo compression). When I try use Apache derby (create database), I almost every time get this kernel oops:

 ------------[ cut here ]------------
[ 7169.133088] WARNING: at fs/btrfs/extent_io.c:4718 map_private_extent_buffer+0xd4/0xe0 [btrfs]()
[ 7169.133092] Hardware name: To Be Filled By O.E.M.
[ 7169.133096] btrfs bad mapping eb start 277946368 len 4096, wanted 4096 8
[ 7169.133099] Modules linked in: fuse ip6table_filter ip6_tables ebtable_nat ebtables ipt_MASQUERADE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT xt_CHECKSUM iptable_mangle xt_tcpudp iptable_filter ip_tables x_tables bridge stp llc w83627ehf hwmon_vid nls_cp437 vfat fat ext4 crc16 jbd2 mbcache acpi_cpufreq mperf kvm_amd kvm ghash_clmulni_intel aesni_intel sp5100_tco aes_x86_64 snd_hda_codec_hdmi xts lrw gf128mul fglrx(PO) ablk_helper cryptd snd_hda_codec_realtek psmouse i2c_piix4 processor serio_raw pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc snd_timer snd soundcore i2c_core amd_iommu_v2 r8169 mii joydev edac_core evdev edac_mce_amd button k10temp microcode fam15h_power btrfs libcrc32c zlib_deflate sd_mod ata_generic pata_acpi
[ 7169.133175]  hid_generic usbhid hid crc32c_intel ahci pata_atiixp libahci ehci_pci ohci_hcd ehci_hcd xhci_hcd libata scsi_mod usbcore usb_common
[ 7169.133194] Pid: 19609, comm: java Tainted: P           O 3.8.0-2-ARCH #1
[ 7169.133197] Call Trace:
[ 7169.133208]  [<ffffffff810574ff>] warn_slowpath_common+0x7f/0xc0
[ 7169.133215]  [<ffffffff810575f6>] warn_slowpath_fmt+0x46/0x50
[ 7169.133244]  [<ffffffffa02f9d74>] map_private_extent_buffer+0xd4/0xe0 [btrfs]
[ 7169.133269]  [<ffffffffa02efbfb>] btrfs_set_token_64+0x6b/0x100 [btrfs]
[ 7169.133294]  [<ffffffffa031225b>] btrfs_log_changed_extents+0x3ab/0x670 [btrfs]
[ 7169.133320]  [<ffffffffa031291a>] btrfs_log_inode+0x3fa/0x690 [btrfs]
[ 7169.133327]  [<ffffffff81130946>] ? pagevec_lookup_tag+0x26/0x40
[ 7169.133352]  [<ffffffffa0313ffc>] btrfs_log_inode_parent+0x17c/0x450 [btrfs]
[ 7169.133376]  [<ffffffffa0314317>] btrfs_log_dentry_safe+0x47/0x70 [btrfs]
[ 7169.133402]  [<ffffffffa02ea47e>] btrfs_sync_file+0x19e/0x260 [btrfs]
[ 7169.133410]  [<ffffffff811bc6cd>] generic_write_sync+0x4d/0x60
[ 7169.133435]  [<ffffffffa02ebd59>] btrfs_file_aio_write+0x3e9/0x5d0 [btrfs]
[ 7169.133441]  [<ffffffff811bea80>] ? __wait_on_buffer+0x30/0x30
[ 7169.133449]  [<ffffffff814ccc1c>] ? out_of_line_wait_on_bit+0x7c/0x90
[ 7169.133457]  [<ffffffff8118c7c7>] do_sync_write+0xa7/0xe0
[ 7169.133466]  [<ffffffff8118ce98>] vfs_write+0xa8/0x180
[ 7169.133471]  [<ffffffff8118d1e2>] sys_write+0x52/0xa0
[ 7169.133477]  [<ffffffff814d1329>] ? do_device_not_available+0x19/0x20
[ 7169.133485]  [<ffffffff814d7b1d>] system_call_fastpath+0x1a/0x1f
[ 7169.133489] ---[ end trace e84bd97b472af615 ]---
[ 7169.133503] BUG: unable to handle kernel NULL pointer dereference at           (null)
[ 7169.133508] IP: [<ffffffffa02f9f83>] write_extent_buffer+0xd3/0x150 [btrfs]
[ 7169.133530] PGD 10a51e067 PUD 123d60067 PMD 0
[ 7169.133537] Oops: 0000 [#1] PREEMPT SMP
[ 7169.133543] Modules linked in: fuse ip6table_filter ip6_tables ebtable_nat ebtables ipt_MASQUERADE iptable_nat nf_nat_ipv4 nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack ipt_REJECT xt_CHECKSUM iptable_mangle xt_tcpudp iptable_filter ip_tables x_tables bridge stp llc w83627ehf hwmon_vid nls_cp437 vfat fat ext4 crc16 jbd2 mbcache acpi_cpufreq mperf kvm_amd kvm ghash_clmulni_intel aesni_intel sp5100_tco aes_x86_64 snd_hda_codec_hdmi xts lrw gf128mul fglrx(PO) ablk_helper cryptd snd_hda_codec_realtek psmouse i2c_piix4 processor serio_raw pcspkr snd_hda_intel snd_hda_codec snd_hwdep snd_pcm snd_page_alloc snd_timer snd soundcore i2c_core amd_iommu_v2 r8169 mii joydev edac_core evdev edac_mce_amd button k10temp microcode fam15h_power btrfs libcrc32c zlib_deflate sd_mod ata_generic pata_acpi
[ 7169.133625]  hid_generic usbhid hid crc32c_intel ahci pata_atiixp libahci ehci_pci ohci_hcd ehci_hcd xhci_hcd libata scsi_mod usbcore usb_common
[ 7169.133641] CPU 2
[ 7169.133646] Pid: 19609, comm: java Tainted: P        W  O 3.8.0-2-ARCH #1 To Be Filled By O.E.M. To Be Filled By O.E.M./970 Pro3
[ 7169.133650] RIP: 0010:[<ffffffffa02f9f83>]  [<ffffffffa02f9f83>] write_extent_buffer+0xd3/0x150 [btrfs]
[ 7169.133673] RSP: 0018:ffff880123ded938  EFLAGS: 00010202
[ 7169.133676] RAX: 0000000000000000 RBX: ffff880123ded9b0 RCX: 0000000000000008
[ 7169.133680] RDX: 0000000000001008 RSI: ffff880123ded9b0 RDI: 0000000000001000
[ 7169.133683] RBP: ffff880123ded978 R08: 000000000000000a R09: 000000000000043e
[ 7169.133686] R10: 0000000000001000 R11: 000000000000043d R12: 0000000000000008
[ 7169.133689] R13: ffff88011411cac0 R14: 0000000000000000 R15: 0000000000000008
[ 7169.133693] FS:  00007f200c798700(0000) GS:ffff88023ed00000(0000) knlGS:00000000f7776700
[ 7169.133697] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
[ 7169.133700] CR2: 0000000000000000 CR3: 000000010a51b000 CR4: 00000000000407e0
[ 7169.133703] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 7169.133707] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 7169.133710] Process java (pid: 19609, threadinfo ffff880123dec000, task ffff8801fb8d0860)
[ 7169.133713] Stack:
[ 7169.133715]  0000000000001000 0000000000001000 ffff880123ded978 ffff880123dedab0
[ 7169.133722]  ffff88011411cac0 0000000000001000 000000000000002d 0000000000000fd3
[ 7169.133728]  ffff880123ded9e8 ffffffffa02efc80 ffff880123ded9e8 0000000000001000
[ 7169.133735] Call Trace:
[ 7169.133761]  [<ffffffffa02efc80>] btrfs_set_token_64+0xf0/0x100 [btrfs]
[ 7169.133786]  [<ffffffffa031225b>] btrfs_log_changed_extents+0x3ab/0x670 [btrfs]
[ 7169.133812]  [<ffffffffa031291a>] btrfs_log_inode+0x3fa/0x690 [btrfs]
[ 7169.133818]  [<ffffffff81130946>] ? pagevec_lookup_tag+0x26/0x40
[ 7169.133844]  [<ffffffffa0313ffc>] btrfs_log_inode_parent+0x17c/0x450 [btrfs]
[ 7169.133868]  [<ffffffffa0314317>] btrfs_log_dentry_safe+0x47/0x70 [btrfs]
[ 7169.133893]  [<ffffffffa02ea47e>] btrfs_sync_file+0x19e/0x260 [btrfs]
[ 7169.133901]  [<ffffffff811bc6cd>] generic_write_sync+0x4d/0x60
[ 7169.133926]  [<ffffffffa02ebd59>] btrfs_file_aio_write+0x3e9/0x5d0 [btrfs]
[ 7169.133932]  [<ffffffff811bea80>] ? __wait_on_buffer+0x30/0x30
[ 7169.133938]  [<ffffffff814ccc1c>] ? out_of_line_wait_on_bit+0x7c/0x90
[ 7169.133946]  [<ffffffff8118c7c7>] do_sync_write+0xa7/0xe0
[ 7169.133954]  [<ffffffff8118ce98>] vfs_write+0xa8/0x180
[ 7169.133960]  [<ffffffff8118d1e2>] sys_write+0x52/0xa0
[ 7169.133966]  [<ffffffff814d1329>] ? do_device_not_available+0x19/0x20
[ 7169.133973]  [<ffffffff814d7b1d>] system_call_fastpath+0x1a/0x1f
[ 7169.133976] Code: e0 0c 48 01 d0 4c 89 c2 4a 8d 3c 30 45 31 f6 e8 f4 46 f8 e0 4c 8b 45 c8 4c 01 c3 4d 29 c7 74 38 49 8b 85 50 01 00 00 4a 8b 04 20 <48> 8b 30 83 e6 08 75 95 be af 12 00 00 48 c7 c7 86 6e 34 a0 48
[ 7169.134036] RIP  [<ffffffffa02f9f83>] write_extent_buffer+0xd3/0x150 [btrfs]
[ 7169.134058]  RSP <ffff880123ded938>
[ 7169.134061] CR2: 0000000000000000
[ 7169.134065] ---[ end trace e84bd97b472af616 ]---

Daniel Kozak

#1 lore raw
Quoted 5 lines · Daniel Kozák

Hello,

On my both machine I have ArchLinux with recent kernel 3.8.0 btrfs as a filesystem (with lzo compression). When I try use Apache derby (create database), I almost every time get this kernel oops:

Sweet somebody else is hitting this and I haven't been able to reproduce. Can you give me the exact commands you run so I can try and reproduce myself? Thanks,

Josef

#2 lore raw

[kozzi@KozziFX ~]$ mkdir derby
[kozzi@KozziFX ~]$ cd derby/
[kozzi@KozziFX derby]$ wget -c -q http://mirror.hosting90.cz/apache//db/derby/db-derby-10.9.1.0/db-derby-10.9.1.0-bin.zip
[kozzi@KozziFX derby]$ unzip -qq db-derby-10.9.1.0-bin.zip
[kozzi@KozziFX derby]$ cd db-derby-10.9.1.0-bin/
[kozzi@KozziFX db-derby-10.9.1.0-bin]$ DERBY_HOME=pwd
[kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar server start & [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar ij
verze ij 10.9
ij> CONNECT 'jdbc:derby://localhost:1527/seconddb;create=true';

BTW. after this I must restart my PC, and after restart, my system doesn't boot anymore :-) (some more btrfs oops). So I must use btrfs check --repair /dev/sdaX.

Dne Wed, 27 Feb 2013 14:25:13 +0100 Josef Bacik <[email protected]> napsal(a):

Quoted 12 lines · Daniel Kozák
Quoted 5 lines

Hello,

On my both machine I have ArchLinux with recent kernel 3.8.0 btrfs as a filesystem (with lzo compression). When I try use Apache derby (create database), I almost every time get this kernel oops:

Sweet somebody else is hitting this and I haven't been able to reproduce. Can you give me the exact commands you run so I can try and reproduce myself? Thanks,

Josef

Signature · 1 line
Vytvořeno poštovní aplikací Opery: http://www.opera.com/mail/
#3 lore raw
Quoted 15 lines · Daniel Kozák

[kozzi@KozziFX ~]$ mkdir derby
[kozzi@KozziFX ~]$ cd derby/
[kozzi@KozziFX derby]$ wget -c -q
http://mirror.hosting90.cz/apache//db/derby/db-derby-10.9.1.0/db-derby-10.9.1.0-bin.zip
[kozzi@KozziFX derby]$ unzip -qq db-derby-10.9.1.0-bin.zip [kozzi@KozziFX derby]$ cd db-derby-10.9.1.0-bin/ [kozzi@KozziFX db-derby-10.9.1.0-bin]$ DERBY_HOME=pwd [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar server start & [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar ij
verze ij 10.9
ij> CONNECT 'jdbc:derby://localhost:1527/seconddb;create=true';

Quoted 4 lines

BTW. after this I must restart my PC, and after restart, my system doesn't boot anymore :-) (some more btrfs oops).
So I must use btrfs check --repair /dev/sdaX.

Sigh and of course I can't reproduce myself, even with importing a huge database into derby. So you are just mounting with -o compress=lzo? What about the mkfs, are you using raid or anything? Are you on a ssd? Also when this happens is there any output above the --- [ cut here ] ---? There should be something about length and such. Thanks,

Josef

#4 lore raw
Quoted 21 lines · Josef Bacik
Quoted 15 lines · Daniel Kozák

[kozzi@KozziFX ~]$ mkdir derby
[kozzi@KozziFX ~]$ cd derby/
[kozzi@KozziFX derby]$ wget -c -q
http://mirror.hosting90.cz/apache//db/derby/db-derby-10.9.1.0/db-derby-10.9.1.0-bin.zip
[kozzi@KozziFX derby]$ unzip -qq db-derby-10.9.1.0-bin.zip [kozzi@KozziFX derby]$ cd db-derby-10.9.1.0-bin/ [kozzi@KozziFX db-derby-10.9.1.0-bin]$ DERBY_HOME=pwd [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar server start & [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar ij
verze ij 10.9
ij> CONNECT 'jdbc:derby://localhost:1527/seconddb;create=true';

Quoted 4 lines

BTW. after this I must restart my PC, and after restart, my system doesn't boot anymore :-) (some more btrfs oops).
So I must use btrfs check --repair /dev/sdaX.

Quoted 6 lines

Sigh and of course I can't reproduce myself, even with importing a huge database into derby. So you are just mounting with -o compress=lzo? What about the mkfs, are you using raid or anything? Are you on a ssd? Also when this happens is there any output above the --- [ cut here ] ---? There should be something about length and such. Thanks,

I was able to reproduce on with 3.8 using Ubuntu 13.04 running in KVM using the commands exactly as given, but it only after stopping and starting the server again.

I use the cloud image from here, boot of an Ubuntu CD-ROM ISO to change from ext4 to btrfs, then installed openjdk.

http://cloud-images.ubuntu.com/raring/current/raring-server-cloudimg-amd64-disk1.img

I could make my image available for download later if you need it, in a pre-failure state. Let me know.

Blair

landscape-client is not configured, please run landscape-config.
Cloud-init v. 0.7.1 running 'modules:final' at Wed, 27 Feb 2013 21:29:24 +0000. Up 11.54 seconds. Cloud-init v. 0.7.1 finished at Wed, 27 Feb 2013 21:29:24 +0000. Datasource DataSourceEc2. Up 11.67 seconds

[ 4884.271027] btrfs bad mapping eb start 494796800 len 4096, wanted 4096 8
[ 4884.273834] BUG: unable to handle kernel NULL pointer dereference at 
          (null)
[ 4884.276166] IP: [<ffffffffa00ca9a3>] write_extent_buffer+0xd3/0x150 [btrfs]
[ 4884.276848] PGD 3e907067 PUD 3a281067 PMD 0
[ 4884.276848] Oops: 0000 [#1] SMP
[ 4884.276848] Modules linked in: dm_crypt(F) microcode(F) virtio_balloon(F) psmouse(F) serio_raw(F) acpiphp(F) btrfs(F) zlib_deflate(F) libcrc32c(F) ghash_clmulni_intel(F) aesni_intel(F) 8139too(F) aes_x86_64(F) floppy(F) xts(F) lrw(F) gf128mul(F) ablk_helper(F) cryptd(F) 8139cp(F)
[ 4884.276848] CPU 0
[ 4884.276848] Pid: 13258, comm: java Tainted: GF       W 3.8.0-7-generic #15-Ubuntu Bochs Bochs
[ 4884.276848] RIP: 0010:[<ffffffffa00ca9a3>]  [<ffffffffa00ca9a3>] write_extent_buffer+0xd3/0x150 [btrfs]
[ 4884.276848] RSP: 0018:ffff8800380d79c8  EFLAGS: 00010202
[ 4884.276848] RAX: 0000000000000000 RBX: 0000000000000008 RCX: 0000000000000008
[ 4884.276848] RDX: 0000000000001008 RSI: 0000000000001000 RDI: ffff880037c31428
[ 4884.276848] RBP: ffff8800380d79f8 R08: 000000000000000a R09: 0000000000000000
[ 4884.276848] R10: 0000000000001000 R11: 0000000000000002 R12: ffff8800380d7a28
[ 4884.276848] R13: ffff880037c31428 R14: 0000000000000000 R15: 0000000000000008
[ 4884.276848] FS:  00007f28536a8700(0000) GS:ffff88006ca00000(0000) knlGS:0000000000000000
[ 4884.276848] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 4884.276848] CR2: 0000000001960000 CR3: 000000003d7c7000 CR4: 00000000000407f0
[ 4884.276848] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 4884.276848] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
[ 4884.276848] Process java (pid: 13258, threadinfo ffff8800380d6000, task ffff880067e38000)
[ 4884.276848] Stack:
[ 4884.276848]  0000000000001000 ffff8800380d7b18 ffff880037c31428 0000000000001000
[ 4884.276848]  000000000000002d 0000000000000fd3 ffff8800380d7a58 ffffffffa00c0bd0
[ 4884.276848]  0000000000001000 ffff880038007000 0000000000001000 0000000000001000
[ 4884.276848] Call Trace:
[ 4884.276848]  [<ffffffffa00c0bd0>] btrfs_set_token_64+0xf0/0x100 [btrfs]
[ 4884.276848]  [<ffffffffa00df98b>] btrfs_log_changed_extents+0x3ab/0x670 [btrfs]
[ 4884.276848]  [<ffffffffa00e3425>] btrfs_log_inode+0x3d5/0x650 [btrfs]
[ 4884.276848]  [<ffffffff8113aae1>] ? pagevec_lookup_tag+0x21/0x30
[ 4884.276848]  [<ffffffffa00e433c>] btrfs_log_inode_parent+0x17c/0x460 [btrfs]
[ 4884.276848]  [<ffffffffa00e4667>] btrfs_log_dentry_safe+0x47/0x70 [btrfs]
[ 4884.276848]  [<ffffffffa00bb597>] btrfs_sync_file+0x167/0x230 [btrfs]
[ 4884.276848]  [<ffffffff811c2c9d>] generic_write_sync+0x4d/0x60
[ 4884.276848]  [<ffffffffa00bce20>] btrfs_file_aio_write+0x3d0/0x590 [btrfs]
[ 4884.276848]  [<ffffffff816c161e>] ? __wait_on_bit+0x7e/0x90
[ 4884.276848]  [<ffffffff81193117>] do_sync_write+0xa7/0xe0
[ 4884.276848]  [<ffffffff811937fc>] vfs_write+0xac/0x180
[ 4884.276848]  [<ffffffff81193b42>] sys_write+0x52/0xa0
[ 4884.276848]  [<ffffffff816cc5dd>] system_call_fastpath+0x1a/0x1f
[ 4884.276848] Code: e0 0c 48 01 d0 4c 89 c2 4a 8d 3c 30 45 31 f6 e8 f4 88 28 e1 4c 8b 45 d0 4d 01 c4 4d 29 c7 74 38 49 8b 85 50 01 00 00 48 8b 04 18 <48> 8b 30 83 e6 08 75 95 be af 12 00 00 48 c7 c7 e8 7a 11 a0 48
[ 4884.276848] RIP  [<ffffffffa00ca9a3>] write_extent_buffer+0xd3/0x150 [btrfs]
[ 4884.276848]  RSP <ffff8800380d79c8>
[ 4884.276848] CR2: 0000000000000000
[ 4884.327410] ---[ end trace 932d1698c8bbdd7c ]---
#5 lore raw
Quoted 33 lines · Blair Zajac
Quoted 21 lines · Josef Bacik
Quoted 15 lines · Daniel Kozák

[kozzi@KozziFX ~]$ mkdir derby
[kozzi@KozziFX ~]$ cd derby/
[kozzi@KozziFX derby]$ wget -c -q
http://mirror.hosting90.cz/apache//db/derby/db-derby-10.9.1.0/db-derby-10.9.1.0-bin.zip
[kozzi@KozziFX derby]$ unzip -qq db-derby-10.9.1.0-bin.zip [kozzi@KozziFX derby]$ cd db-derby-10.9.1.0-bin/ [kozzi@KozziFX db-derby-10.9.1.0-bin]$ DERBY_HOME=pwd [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar server start & [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar ij
verze ij 10.9
ij> CONNECT 'jdbc:derby://localhost:1527/seconddb;create=true';

Quoted 4 lines

BTW. after this I must restart my PC, and after restart, my system doesn't boot anymore :-) (some more btrfs oops).
So I must use btrfs check --repair /dev/sdaX.

Quoted 6 lines

Sigh and of course I can't reproduce myself, even with importing a huge database into derby. So you are just mounting with -o compress=lzo? What about the mkfs, are you using raid or anything? Are you on a ssd? Also when this happens is there any output above the --- [ cut here ] ---? There should be something about length and such. Thanks,

I was able to reproduce on with 3.8 using Ubuntu 13.04 running in KVM using the commands exactly as given, but it only after stopping and starting the server again.

Quoted 8 lines

I use the cloud image from here, boot of an Ubuntu CD-ROM ISO to change from ext4 to btrfs, then installed openjdk.

http://cloud-images.ubuntu.com/raring/current/raring-server-cloudimg-amd64-disk1.img

I could make my image available for download later if you need it, in a pre-failure state. Let me know.

Yeah I still can't reproduce, can either of you send me your kernel config so I can see if it's something in my config that's causing problems? Thanks,

Josef

#6 lore raw

Dne Thu, 28 Feb 2013 16:47:21 +0100 Josef Bacik <[email protected]> napsal(a):

Quoted 42 lines · Blair Zajac
Quoted 41 lines · Josef Bacik
Quoted 1 line

On Wed, Feb 27, 2013 at 1:19 PM, Daniel Kozák <[email protected]>

Quoted 5 lines · wrote:
Quoted 5 lines

[kozzi@KozziFX ~]$ mkdir derby
[kozzi@KozziFX ~]$ cd derby/
[kozzi@KozziFX derby]$ wget -c -q

http://mirror.hosting90.cz/apache//db/derby/db-derby-10.9.1.0/db-derby-10.9.1.0-bin.zip

Quoted 11 lines
Quoted 11 lines

[kozzi@KozziFX derby]$ unzip -qq db-derby-10.9.1.0-bin.zip [kozzi@KozziFX derby]$ cd db-derby-10.9.1.0-bin/ [kozzi@KozziFX db-derby-10.9.1.0-bin]$ DERBY_HOME=pwd [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar server start & [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar ij
verze ij 10.9
ij> CONNECT 'jdbc:derby://localhost:1527/seconddb;create=true';

BTW. after this I must restart my PC, and after restart, my system

doesn't

Quoted 10 lines
Quoted 3 lines

boot anymore :-) (some more btrfs oops).
So I must use btrfs check --repair /dev/sdaX.

Sigh and of course I can't reproduce myself, even with importing a huge database into derby. So you are just mounting with -o compress=lzo? What about the mkfs, are you using raid or anything? Are you on a ssd? Also when this happens is there any output above the --- [ cut here ] ---? There should be something about length and such. Thanks,

I was able to reproduce on with 3.8 using Ubuntu 13.04 running in KVM using the commands exactly as given, but it only after stopping and starting the server again.

I use the cloud image from here, boot of an Ubuntu CD-ROM ISO to change from ext4 to btrfs, then installed openjdk.

http://cloud-images.ubuntu.com/raring/current/raring-server-cloudimg-amd64-disk1.img

Quoted 8 lines
Quoted 3 lines

I could make my image available for download later if you need it, in a pre-failure state. Let me know.

Yeah I still can't reproduce, can either of you send me your kernel config so I can see if it's something in my config that's causing problems? Thanks,

Josef

Yes, here is it

Signature · 1 line
Vytvořeno poštovní aplikací Opery: http://www.opera.com/mail/
#7 lore raw
Quoted 49 lines · Daniel Kozák

Dne Thu, 28 Feb 2013 16:47:21 +0100 Josef Bacik <[email protected]> napsal(a):

Quoted 46 lines · Blair Zajac
Quoted 44 lines · Josef Bacik
Quoted 1 line

On Wed, Feb 27, 2013 at 1:19 PM, Daniel Kozák <[email protected]>

Quoted 5 lines · wrote:
Quoted 5 lines

[kozzi@KozziFX ~]$ mkdir derby
[kozzi@KozziFX ~]$ cd derby/
[kozzi@KozziFX derby]$ wget -c -q

http://mirror.hosting90.cz/apache//db/derby/db-derby-10.9.1.0/db-derby-10.9.1.0-bin.zip

Quoted 11 lines
Quoted 11 lines

[kozzi@KozziFX derby]$ unzip -qq db-derby-10.9.1.0-bin.zip [kozzi@KozziFX derby]$ cd db-derby-10.9.1.0-bin/ [kozzi@KozziFX db-derby-10.9.1.0-bin]$ DERBY_HOME=pwd [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar server start & [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar ij
verze ij 10.9
ij> CONNECT 'jdbc:derby://localhost:1527/seconddb;create=true';

BTW. after this I must restart my PC, and after restart, my system

doesn't

Quoted 10 lines
Quoted 3 lines

boot anymore :-) (some more btrfs oops).
So I must use btrfs check --repair /dev/sdaX.

Sigh and of course I can't reproduce myself, even with importing a huge database into derby. So you are just mounting with -o compress=lzo? What about the mkfs, are you using raid or anything? Are you on a ssd? Also when this happens is there any output above the --- [ cut here ] ---? There should be something about length and such. Thanks,

I was able to reproduce on with 3.8 using Ubuntu 13.04 running in KVM using the commands exactly as given, but it only after stopping and starting the server again.

I use the cloud image from here, boot of an Ubuntu CD-ROM ISO to change from ext4 to btrfs, then installed openjdk.

http://cloud-images.ubuntu.com/raring/current/raring-server-cloudimg-amd64-disk1.img

I could make my image available for download later if you need it, in a pre-failure state. Let me know.

Quoted 8 lines
Quoted 5 lines

Yeah I still can't reproduce, can either of you send me your kernel config so I
can see if it's something in my config that's causing problems? Thanks,

Josef

Yes, here is it

Great I'll set this up on both of my boxes and see if I can reproduce. In the meantime will you try btrfs-next? I just pushed a tree-log fix that I don't think will fix your problem but since I don't know what your problem is yet it might, so I'd like to at least eliminate it. Thanks,

Josef

#8 lore raw
Quoted 56 lines · Josef Bacik
Quoted 55 lines · Daniel Kozák

Dne Thu, 28 Feb 2013 16:47:21 +0100 Josef Bacik <[email protected]> napsal(a):

Quoted 51 lines · Blair Zajac
Quoted 36 lines · Josef Bacik
Quoted 1 line

On Wed, Feb 27, 2013 at 1:19 PM, Daniel Kozák <[email protected]>

Quoted 5 lines · wrote:
Quoted 5 lines

[kozzi@KozziFX ~]$ mkdir derby
[kozzi@KozziFX ~]$ cd derby/
[kozzi@KozziFX derby]$ wget -c -q

http://mirror.hosting90.cz/apache//db/derby/db-derby-10.9.1.0/db-derby-10.9.1.0-bin.zip

Quoted 11 lines
Quoted 11 lines

[kozzi@KozziFX derby]$ unzip -qq db-derby-10.9.1.0-bin.zip [kozzi@KozziFX derby]$ cd db-derby-10.9.1.0-bin/ [kozzi@KozziFX db-derby-10.9.1.0-bin]$ DERBY_HOME=pwd [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar server start & [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar ij
verze ij 10.9
ij> CONNECT 'jdbc:derby://localhost:1527/seconddb;create=true';

BTW. after this I must restart my PC, and after restart, my system

doesn't

Quoted 10 lines
Quoted 3 lines

boot anymore :-) (some more btrfs oops).
So I must use btrfs check --repair /dev/sdaX.

Sigh and of course I can't reproduce myself, even with importing a huge database into derby. So you are just mounting with -o compress=lzo? What about the mkfs, are you using raid or anything? Are you on a ssd? Also when this happens is there any output above the --- [ cut here ] ---? There should be something about length and such. Thanks,

I was able to reproduce on with 3.8 using Ubuntu 13.04 running in KVM using the commands exactly as given, but it only after stopping and starting the server again.

Quoted 8 lines

I use the cloud image from here, boot of an Ubuntu CD-ROM ISO to change from ext4 to btrfs, then installed openjdk.

http://cloud-images.ubuntu.com/raring/current/raring-server-cloudimg-amd64-disk1.img

I could make my image available for download later if you need it, in a pre-failure state. Let me know.

Yeah I still can't reproduce, can either of you send me your kernel config so I
can see if it's something in my config that's causing problems? Thanks,

Josef

Quoted 7 lines
Quoted 2 lines

Yes, here is it

Great I'll set this up on both of my boxes and see if I can reproduce. In the meantime will you try btrfs-next? I just pushed a tree-log fix that I don't think will fix your problem but since I don't know what your problem is yet it might, so I'd like to at least eliminate it. Thanks,

I put a KVM image up at that you can try:

http://www-devel.orcaware.com/blair/btrfs/2013-02-28/

Download all three files, make a copy of raring-server-cloudimg-amd64-disk1.img since I can only reproduce from the initial state, run launch_image.sh, log in as ubuntu/ubuntu. I had most luck getting the issue by running 'sync' and then BTRFS.sh. Without the 'sync' it doesn't fail as often. If it doesn't fail the first time, stop the instance, restore the image from your copy and try again. A 'while true; ./BTRFS.sh; done' loop doesn't fail if it doesn't fail the first time. It can take up to 5 times before it locks up on me.

Blair

#9 lore raw
Quoted 69 lines · Blair Zajac
Quoted 56 lines · Josef Bacik
Quoted 55 lines · Daniel Kozák

Dne Thu, 28 Feb 2013 16:47:21 +0100 Josef Bacik <[email protected]> napsal(a):

Quoted 51 lines · Blair Zajac
Quoted 36 lines · Josef Bacik
Quoted 1 line

On Wed, Feb 27, 2013 at 1:19 PM, Daniel Kozák <[email protected]>

Quoted 5 lines · wrote:
Quoted 5 lines

[kozzi@KozziFX ~]$ mkdir derby
[kozzi@KozziFX ~]$ cd derby/
[kozzi@KozziFX derby]$ wget -c -q

http://mirror.hosting90.cz/apache//db/derby/db-derby-10.9.1.0/db-derby-10.9.1.0-bin.zip

Quoted 11 lines
Quoted 11 lines

[kozzi@KozziFX derby]$ unzip -qq db-derby-10.9.1.0-bin.zip [kozzi@KozziFX derby]$ cd db-derby-10.9.1.0-bin/ [kozzi@KozziFX db-derby-10.9.1.0-bin]$ DERBY_HOME=pwd [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar server start & [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar ij
verze ij 10.9
ij> CONNECT 'jdbc:derby://localhost:1527/seconddb;create=true';

BTW. after this I must restart my PC, and after restart, my system

doesn't

Quoted 10 lines
Quoted 3 lines

boot anymore :-) (some more btrfs oops).
So I must use btrfs check --repair /dev/sdaX.

Sigh and of course I can't reproduce myself, even with importing a huge database into derby. So you are just mounting with -o compress=lzo? What about the mkfs, are you using raid or anything? Are you on a ssd? Also when this happens is there any output above the --- [ cut here ] ---? There should be something about length and such. Thanks,

I was able to reproduce on with 3.8 using Ubuntu 13.04 running in KVM using the commands exactly as given, but it only after stopping and starting the server again.

Quoted 8 lines

I use the cloud image from here, boot of an Ubuntu CD-ROM ISO to change from ext4 to btrfs, then installed openjdk.

http://cloud-images.ubuntu.com/raring/current/raring-server-cloudimg-amd64-disk1.img

I could make my image available for download later if you need it, in a pre-failure state. Let me know.

Yeah I still can't reproduce, can either of you send me your kernel config so I
can see if it's something in my config that's causing problems? Thanks,

Josef

Quoted 7 lines
Quoted 2 lines

Yes, here is it

Great I'll set this up on both of my boxes and see if I can reproduce. In the meantime will you try btrfs-next? I just pushed a tree-log fix that I don't think will fix your problem but since I don't know what your problem is yet it might, so I'd like to at least eliminate it. Thanks,

I put a KVM image up at that you can try:

http://www-devel.orcaware.com/blair/btrfs/2013-02-28/

Quoted 9 lines

Download all three files, make a copy of raring-server-cloudimg-amd64-disk1.img since I can only reproduce from the initial state, run launch_image.sh, log in as ubuntu/ubuntu. I had most luck getting the issue by running 'sync' and then BTRFS.sh. Without the 'sync' it doesn't fail as often. If it doesn't fail the first time, stop the instance, restore the image from your copy and try again. A 'while true; ./BTRFS.sh; done' loop doesn't fail if it doesn't fail the first time. It can take up to 5 times before it locks up on me.

Ok so now that I have it reproducing, how do I go about getting a custom kernel on there? I'm used to libvirt where all the networking stuff is done for me, this doesn't seem to connect to the network at all and it also doesn't seem to have mount.nfs so I can't do what I normally do and mount my local drive as nfs and install the new kernel. What is the best way to go about doing this? Thanks,

Josef

#10 lore raw
Quoted 6 lines · Josef Bacik

Ok so now that I have it reproducing, how do I go about getting a custom kernel on there? I'm used to libvirt where all the networking stuff is done for me, this doesn't seem to connect to the network at all and it also doesn't seem to have mount.nfs so I can't do what I normally do and mount my local drive as nfs and install the new kernel. What is the best way to go about doing this?

I run these images in OpenStack or with kvm. Its a very bare OS, so you'll need to install NFS and anything else you need on it.

Did it not come up with networking? I was able to do an 'apt-get update' on it. It needs to boot with the seed.iso for it to get proper networking, as it uses the cloud-init package to configure itself (it's meant to be deployed into EC2 or OpenStack).

Blair

#11 lore raw
In reply to Josef Bacik
Quoted 25 lines · Josef Bacik
Quoted 25 lines
Quoted 15 lines
Quoted 15 lines
Quoted 14 lines
Quoted 8 lines

I use the cloud image from here, boot of an Ubuntu CD-ROM ISO to change from ext4 to btrfs, then installed openjdk.

http://cloud-images.ubuntu.com/raring/current/raring-server-cloudimg-amd64-disk1.img

I could make my image available for download later if you need it, in a pre-failure state. Let me know.

Yeah I still can't reproduce, can either of you send me your kernel config so I
can see if it's something in my config that's causing problems? Thanks,

Josef

Quoted 7 lines
Quoted 2 lines

Yes, here is it

Great I'll set this up on both of my boxes and see if I can reproduce. In the meantime will you try btrfs-next? I just pushed a tree-log fix that I don't think will fix your problem but since I don't know what your problem is yet it might, so I'd like to at least eliminate it. Thanks,

I put a KVM image up at that you can try:

Quoted 7 lines
Quoted 2 lines

http://www-devel.orcaware.com/blair/btrfs/2013-02-28/

Ok so now that I have it reproducing, how do I go about getting a custom kernel on there? I'm used to libvirt where all the networking stuff is done for me, this doesn't seem to connect to the network at all and it also doesn't seem to have mount.nfs so I can't do what I normally do and mount my local drive as nfs and install the new kernel. What is the best way to go about doing this?

You can run start image by invoking qemu-kvm with custom kernel:
-kernel bzImage use 'bzImage' as kernel image
-append cmdline use 'cmdline' as kernel command line
-initrd file use 'file' as initial ram disk

Signature · 2 lines
Tomasz Torcz                Only gods can safely risk perfection,
xmpp: [email protected]     it's a dangerous thing for a man.  -- Alia
#12 lore raw
In reply to Josef Bacik
Quoted 84 lines · Josef Bacik

[email protected]>
<[email protected]>
In-Reply-To: <[email protected]>
Accept-Language: en-US
Content-Language: en-US X-MS-Exchange-Organization-AuthAs: Internal X-MS-Exchange-Organization-AuthMechanism: 06 X-MS-Exchange-Organization-AuthSource: mail1.int.fusionio.com X-MS-Has-Attach:
X-MS-TNEF-Correlator:
user-agent: Mutt/1.5.21 (2011-07-01)
Content-Type: text/plain; charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0

Quoted 7 lines · Blair Zajac
Quoted 6 lines · Josef Bacik
Quoted 5 lines · On Thu, Feb 28, 2013 at 11:31:15AM -0700, Daniel Koz=E1k wrote:

Dne Thu, 28 Feb 2013 16:47:21 +0100 Josef Bacik <[email protected]> napsal(a):

Quoted 2 lines · Blair Zajac
Quoted 1 line · Josef Bacik
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 1 line

On Wed, Feb 27, 2013 at 1:19 PM, Daniel Koz=E1k <[email protected]>

Quoted 5 lines · wrote:
Quoted 5 lines

[kozzi@KozziFX ~]$ mkdir derby
[kozzi@KozziFX ~]$ cd derby/
[kozzi@KozziFX derby]$ wget -c -q

http://mirror.hosting90.cz/apache//db/derby/db-derby-10.9.1.0/db-der=

by-10.9.1.0-bin.zip

Quoted 11 lines
Quoted 11 lines
Quoted 11 lines
Quoted 11 lines
Quoted 11 lines
Quoted 11 lines
Quoted 11 lines

[kozzi@KozziFX derby]$ unzip -qq db-derby-10.9.1.0-bin.zip [kozzi@KozziFX derby]$ cd db-derby-10.9.1.0-bin/ [kozzi@KozziFX db-derby-10.9.1.0-bin]$ DERBY_HOME=3Dpwd [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar server start & [kozzi@KozziFX db-derby-10.9.1.0-bin]$ java -jar $DERBY_HOME/lib/derbyrun.jar ij
verze ij 10.9
ij> CONNECT 'jdbc:derby://localhost:1527/seconddb;create=3Dtrue';

BTW. after this I must restart my PC, and after restart, my system

Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines
Quoted 8 lines

doesn't

Quoted 7 lines
Quoted 3 lines

boot anymore :-) (some more btrfs oops).
So I must use btrfs check --repair /dev/sdaX.

Sigh and of course I can't reproduce myself, even with importing a huge database into derby. So you are just mounting with -o compress=3Dlzo? What about the mkfs, are you using raid or anythin=

g?

Quoted 2 lines
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines

Are you on a ssd? Also when this happens is there any output above the --- [ cut here ] ---? There should be something about length a=

nd

Quoted 3 lines
Quoted 3 lines
Quoted 3 lines
Quoted 3 lines
Quoted 3 lines
Quoted 1 line

such. Thanks,

I was able to reproduce on with 3.8 using Ubuntu 13.04 running in KV=

M

Quoted 4 lines
Quoted 4 lines
Quoted 4 lines
Quoted 4 lines
Quoted 4 lines

using the commands exactly as given, but it only after stopping and starting the server again.

I use the cloud image from here, boot of an Ubuntu CD-ROM ISO to cha=

nge

Quoted 3 lines
Quoted 3 lines
Quoted 3 lines
Quoted 3 lines
Quoted 3 lines

from ext4 to btrfs, then installed openjdk.

http://cloud-images.ubuntu.com/raring/current/raring-server-cloudimg=

-amd64-disk1.img

Quoted 2 lines
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines
Quoted 2 lines

I could make my image available for download later if you need it, i=

n a

Quoted 6 lines
Quoted 6 lines
Quoted 6 lines
Quoted 6 lines
Quoted 2 lines

pre-failure state. Let me know.

Yeah I still can't reproduce, can either of you send me your kernel config so I
can see if it's something in my config that's causing problems? Than=

ks,

Quoted 6 lines
Quoted 6 lines
Quoted 5 lines
Quoted 2 lines

Josef

Yes, here is it

Quoted 19 lines
Quoted 1 line
Quoted 1 line

Great I'll set this up on both of my boxes and see if I can reproduce. =

In the

Quoted 1 line
Quoted 1 line

meantime will you try btrfs-next? I just pushed a tree-log fix that I =

don't

Quoted 1 line
Quoted 1 line

think will fix your problem but since I don't know what your problem is=

yet it

Quoted 13 lines
Quoted 1 line

might, so I'd like to at least eliminate it. Thanks,

=20
I put a KVM image up at that you can try:
=20
http://www-devel.orcaware.com/blair/btrfs/2013-02-28/
=20
Download all three files, make a copy of=20 raring-server-cloudimg-amd64-disk1.img since I can only reproduce from=20 the initial state, run launch_image.sh, log in as ubuntu/ubuntu. I had=20 most luck getting the issue by running 'sync' and then BTRFS.sh.=20 Without the 'sync' it doesn't fail as often. If it doesn't fail the=20 first time, stop the instance, restore the image from your copy and try=20 again. A 'while

Ok I was running btrfs.sh on my other box while screwing around with KVM and didn't notice that I had reproduced it there. Thanks everyobdy for your help, I'll tackle this tomorrow morning and hopefully will have a patch. Thanks,

Josef