Skip to contentSkip to conversation

kernel panic

AX25 Bernard Pidoux 3 participants 7 messages Sep 9, 2009 – Sep 21, 2009 3 messages not in the archive

Subsystems (2)
Networking Network drivers
lore
Share & tools
lore

Bernard Pidoux

author
#0 lore raw

Hi Ralf,

Here is a set of not so frequent kernel panics captured via netconsole that seem related to AX25 timer.

Regards,

Bernard Pidoux

------------------------
sam. août 8 22:08:26 CEST 2009
------------------------

BUG: unable to handle kernel paging request at ffff880004c90648
IP: [<ffffffff80249451>] del_timer+0x11/0xb0
PGD 202063 PUD 206063 PMD 7e2067 PTE 4c90160
Oops: 0002 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/devices/system/cpu/cpu0/cpufreq/scaling_cur_freq
CPU 0 
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm i2c_viapro snd_timer snd_page_alloc snd_mixer_oss snd i2c_core soundcore sr_mod 8139cp 8139too mii shpchp pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table floppy sg rtc_cmos thermal via_agp processor evdev button pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 0, comm: swapper Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffff80249451>]  [<ffffffff80249451>] del_timer+0x11/0xb0
RSP: 0018:ffffffff80717e00  EFLAGS: 00010246
RAX: ffffffff8067f0b8 RBX: ffff880004c90400 RCX: 0000000000000058
RDX: ffffe200009cb3d8 RSI: ffffffff8067f060 RDI: ffff880004c90618
RBP: ffffffff80717e20 R08: 0000000000000001 R09: 0000000000000490
R10: 0000000000000002 R11: ffffffff8067f008 R12: ffff880004c90618
R13: ffff880004c90400 R14: 0000000000000000 R15: ffffffff80717ed0
FS:  0000000000000000(0000) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: ffff880004c90648 CR3: 0000000074843000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffffffff8068c000, task ffffffff80632360)
Stack:
 ffff880004c90400 ffff880004c90400 ffff880004c90400 ffffffffa035bb30
 ffffffff80717e30 ffffffffa035b850 ffffffff80717e60 ffffffffa035edb4
 ffff880004c90400 ffff880004c90400 0000000000000000 ffffffffa035bb30
Call Trace:
 <IRQ> <0> [<ffffffffa035bb30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
 [<ffffffffa035b850>] ax25_stop_heartbeat+0x10/0x20 [ax25]
 [<ffffffffa035edb4>] ax25_destroy_socket+0x64/0x210 [ax25]
 [<ffffffffa035bb30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
 [<ffffffffa035b045>] ax25_std_heartbeat_expiry+0xf5/0x100 [ax25]
 [<ffffffff80217c56>] ? read_tsc+0x16/0x40
 [<ffffffffa035bb55>] ax25_heartbeat_expiry+0x25/0x60 [ax25]
 [<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
 [<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
 [<ffffffff8024506c>] __do_softirq+0x7c/0x110
 [<ffffffff8021271c>] call_softirq+0x1c/0x30
 [<ffffffff8021407d>] do_softirq+0x5d/0xa0
 [<ffffffff80244c95>] irq_exit+0x45/0x50
 [<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
 [<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
 <EOI> <0> [<ffffffff80218afd>] ? mwait_idle+0x5d/0x70
 [<ffffffff8020fdd2>] ? enter_idle+0x22/0x30
 [<ffffffff8020fe2e>] ? cpu_idle+0x4e/0x80
 [<ffffffff804eb5cd>] ? rest_init+0x5d/0x70
Code: 10 18 00 00 eb a6 0f 1f 40 00 48 0f b6 c2 48 c1 e0 04 48 8d 54 07 10 eb 93 90 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 fc 53 <48> c7 47 30 00 00 00 00 48 83 3f 00 75 16 eb 76 0f 1f 80 00 00 
RIP  [<ffffffff80249451>] del_timer+0x11/0xb0
 RSP <ffffffff80717e00>
CR2: ffff880004c90648
---[ end trace 366e8cf762bbf316 ]---
Kernel panic - not syncing: Fatal exception in interrupt
Rebooting in 60 seconds..BUG: unable to handle kernel paging request at ffff88001bbee248
IP: [<ffffffff80249451>] del_timer+0x11/0xb0
PGD 202063 PUD 206063 PMD 899067 PTE 1bbee160
Oops: 0002 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/devices/system/cpu/cpu0/cpufreq/scaling_cur_freq
CPU 0 
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm 8139cp snd_timer snd_page_alloc snd_mixer_oss snd soundcore sr_mod 8139too mii i2c_viapro i2c_core shpchp pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table thermal processor floppy rtc_cmos via_agp button sg evdev pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 0, comm: swapper Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffff80249451>]  [<ffffffff80249451>] del_timer+0x11/0xb0
RSP: 0018:ffffffff80717e00  EFLAGS: 00010246
RAX: ffffffff8067f0b8 RBX: ffff88001bbee000 RCX: 0000000000000058
RDX: ffffe2000060cbb8 RSI: ffffffff8067f060 RDI: ffff88001bbee218
RBP: ffffffff80717e20 R08: 0000000000000001 R09: 00000000000003ee
R10: 0000000000000002 R11: ffffffff8067f008 R12: ffff88001bbee218
R13: ffff88001bbee000 R14: 0000000000000000 R15: ffffffff80717ed0
FS:  0000000000000000(0000) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: ffff88001bbee248 CR3: 00000000296e7000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffffffff8068c000, task ffffffff80632360)
Stack:
 ffff88001bbee000 ffff88001bbee000 ffff88001bbee000 ffffffffa0355b30
 ffffffff80717e30 ffffffffa0355850 ffffffff80717e60 ffffffffa0358db4
 ffff88001bbee000 ffff88001bbee000 0000000000000000 ffffffffa0355b30
Call Trace:
 <IRQ> <0> [<ffffffffa0355b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
 [<ffffffffa0355850>] ax25_stop_heartbeat+0x10/0x20 [ax25]
 [<ffffffffa0358db4>] ax25_destroy_socket+0x64/0x210 [ax25]
 [<ffffffffa0355b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
 [<ffffffffa0355045>] ax25_std_heartbeat_expiry+0xf5/0x100 [ax25]
 [<ffffffff80217c56>] ? read_tsc+0x16/0x40
 [<ffffffffa0355b55>] ax25_heartbeat_expiry+0x25/0x60 [ax25]
 [<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
 [<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
 [<ffffffff8024506c>] __do_softirq+0x7c/0x110
 [<ffffffff8021271c>] call_softirq+0x1c/0x30
 [<ffffffff8021407d>] do_softirq+0x5d/0xa0
 [<ffffffff80244c95>] irq_exit+0x45/0x50
 [<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
 [<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
 <EOI> <0> [<ffffffff80218afd>] ? mwait_idle+0x5d/0x70
 [<ffffffff8020fdd2>] ? enter_idle+0x22/0x30
 [<ffffffff8020fe2e>] ? cpu_idle+0x4e/0x80
 [<ffffffff804eb5cd>] ? rest_init+0x5d/0x70
Code: 10 18 00 00 eb a6 0f 1f 40 00 48 0f b6 c2 48 c1 e0 04 48 8d 54 07 10 eb 93 90 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 fc 53 <48> c7 47 30 00 00 00 00 48 83 3f 00 75 16 eb 76 0f 1f 80 00 00 
RIP  [<ffffffff80249451>] del_timer+0x11/0xb0
 RSP <ffffffff80717e00>
CR2: ffff88001bbee248
---[ end trace b7e0c620509cd638 ]---
Kernel panic - not syncing: Fatal exception in interrupt
Rebooting in 60 seconds..------------------------
jeu. août 13 00:13:13 CEST 2009
------------------------
BUG: unable to handle kernel paging request at ffff880071c80e48
IP: [<ffffffff80249451>] del_timer+0x11/0xb0
PGD 202063 PUD 9bc067 PMD b4b067 PTE 71c80160
Oops: 0002 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/devices/system/cpu/cpu0/cpufreq/scaling_cur_freq
CPU 0 
Modules linked in: loop netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss 8139cp i2c_viapro snd soundcore sr_mod 8139too i2c_core mii shpchp pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table thermal floppy rtc_cmos processor via_agp button sg evdev pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 0, comm: swapper Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffff80249451>]  [<ffffffff80249451>] del_timer+0x11/0xb0
RSP: 0018:ffffffff80717e00  EFLAGS: 00010246
RAX: ffffffff8067f0b8 RBX: ffff880071c80c00 RCX: 0000000000000058
RDX: ffffe200010313d8 RSI: ffffffff8067f060 RDI: ffff880071c80e18
RBP: ffffffff80717e20 R08: 0000000000000001 R09: 0000000000000480
R10: 0000000000000002 R11: ffffffff8067f008 R12: ffff880071c80e18
R13: ffff880071c80c00 R14: 0000000000000000 R15: ffffffff80717ed0
FS:  0000000000000000(0000) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: ffff880071c80e48 CR3: 000000007a11c000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffffffff8068c000, task ffffffff80632360)
Stack:
 ffff880071c80c00 ffff880071c80c00 ffff880071c80c00 ffffffffa0358b30
 ffffffff80717e30 ffffffffa0358850 ffffffff80717e60 ffffffffa035bdb4
 ffff880071c80c00 ffff880071c80c00 0000000000000000 ffffffffa0358b30
Call Trace:
 <IRQ> <0> [<ffffffffa0358b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
 [<ffffffffa0358850>] ax25_stop_heartbeat+0x10/0x20 [ax25]
 [<ffffffffa035bdb4>] ax25_destroy_socket+0x64/0x210 [ax25]
 [<ffffffffa0358b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
 [<ffffffffa0358045>] ax25_std_heartbeat_expiry+0xf5/0x100 [ax25]
 [<ffffffff80217c56>] ? read_tsc+0x16/0x40
 [<ffffffffa0358b55>] ax25_heartbeat_expiry+0x25/0x60 [ax25]
 [<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
 [<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
 [<ffffffff8024506c>] __do_softirq+0x7c/0x110
 [<ffffffff8021271c>] call_softirq+0x1c/0x30
 [<ffffffff8021407d>] do_softirq+0x5d/0xa0
 [<ffffffff80244c95>] irq_exit+0x45/0x50
 [<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
 [<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
 <EOI> <0> [<ffffffff80218afd>] ? mwait_idle+0x5d/0x70
 [<ffffffff8020fdd2>] ? enter_idle+0x22/0x30
 [<ffffffff8020fe2e>] ? cpu_idle+0x4e/0x80
 [<ffffffff804eb5cd>] ? rest_init+0x5d/0x70
Code: 10 18 00 00 eb a6 0f 1f 40 00 48 0f b6 c2 48 c1 e0 04 48 8d 54 07 10 eb 93 90 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 fc 53 <48> c7 47 30 00 00 00 00 48 83 3f 00 75 16 eb 76 0f 1f 80 00 00 
RIP  [<ffffffff80249451>] del_timer+0x11/0xb0
 RSP <ffffffff80717e00>
CR2: ffff880071c80e48
---[ end trace d516331eccbfb939 ]---
Kernel panic - not syncing: Fatal exception in interrupt

Rebooting in 60 seconds..------------------------
sam. août 15 10:15:34 CEST 2009
------------------------

------------------------
sam. août 15 10:16:32 CEST 2009
------------------------

-------------------------------
sam. août 15 13:11:53 CEST 2009
-------------------------------

-------------------------------
sam. août 15 13:16:21 CEST 2009
-------------------------------

-------------------------------
sam. août 15 14:36:50 CEST 2009
-------------------------------

-------------------------------
Sun Aug 16 04:03:12 CEST 2009
-------------------------------

-------------------------------
Mon Aug 17 04:03:21 CEST 2009
-------------------------------

-------------------------------
lun. août 17 12:43:33 CEST 2009
-------------------------------

-------------------------------
lun. août 17 14:03:50 CEST 2009
-------------------------------

-------------------------------
Tue Aug 18 04:03:17 CEST 2009
-------------------------------

-------------------------------
Wed Aug 19 04:03:22 CEST 2009
-------------------------------

-------------------------------
Thu Aug 20 04:03:24 CEST 2009
-------------------------------

-------------------------------
jeu. août 20 14:21:57 CEST 2009
-------------------------------

-------------------------------
jeu. août 20 15:42:15 CEST 2009
-------------------------------

general protection fault: 0000 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/class/vc/vcsa6/dev
CPU 0 
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc i2c_viapro snd_mixer_oss snd i2c_core soundcore sr_mod 8139too mii shpchp pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table floppy sg rtc_cmos via_agp thermal evdev processor button pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 30904, comm: astropulse_5.06 Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffffa034fb3d>]  [<ffffffffa034fb3d>] ax25_heartbeat_expiry+0xd/0x60 [ax25]
RSP: 0000:ffffffff80717ea0  EFLAGS: 00010206
RAX: ffff880061829fd8 RBX: ffff88006f59b000 RCX: ffffffffa034fb30
RDX: 6e75203a7473696c RSI: 0000000000000e3f RDI: ffff88006f59b000
RBP: ffffffff80717ea0 R08: ffff88006f59b250 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000100
R13: ffffffff8075a600 R14: ffffffffa034fb30 R15: ffffffff80717ed0
FS:  0000000001493860(0063) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f771ebbd000 CR3: 000000006b867000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process astropulse_5.06 (pid: 30904, threadinfo ffff880061828000, task ffff8800618641a0)
Stack:
 ffffffff80717f10 ffffffff8024976c ffffffff8075c210 ffffffff8075be10
 ffffffff8075ba10 ffffffff8075b610 ffff88006f512970 ffff88006f512970
 ffffffff8025f8ff 0000000000000008 0000000000000001 0000000000000100
Call Trace:
 <IRQ> <0> [<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
 [<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
 [<ffffffff8024506c>] __do_softirq+0x7c/0x110
 [<ffffffff8021271c>] call_softirq+0x1c/0x30
 [<ffffffff8021407d>] do_softirq+0x5d/0xa0
 [<ffffffff80244c95>] irq_exit+0x45/0x50
 [<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
 [<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
 <EOI> <0>Code: 80 7a 58 00 66 90 74 da c9 0f 1f 44 00 00 c3 66 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 8b 57 28 48 89 e5 48 85 d2 74 0c <8b> 42 50 85 c0 78 11 83 f8 01 7f 17 0f 1f 80 00 00 00 00 e8 fb 
RIP  [<ffffffffa034fb3d>] ax25_heartbeat_expiry+0xd/0x60 [ax25]
 RSP <ffffffff80717ea0>
---[ end trace 0dee287bd3d290a3 ]---
Kernel panic - not syncing: Fatal exception in interrupt

Rebooting in 60 seconds..
-------------------------------
Fri Aug 21 04:03:18 CEST 2009
-------------------------------

-------------------------------
Sat Aug 22 04:03:24 CEST 2009
-------------------------------

-------------------------------
Sun Aug 23 04:03:27 CEST 2009
-------------------------------

-------------------------------
Mon Aug 24 04:03:26 CEST 2009
-------------------------------

-------------------------------
Tue Aug 25 04:03:23 CEST 2009
-------------------------------

-------------------------------
Wed Aug 26 04:03:25 CEST 2009
-------------------------------

general protection fault: 0000 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/class/vc/vcsa12/dev
CPU 0 
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd 8139too mii i2c_viapro soundcore i2c_core sr_mod shpchp pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table floppy sg rtc_cmos via_agp thermal evdev processor button pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 28253, comm: astropulse_5.06 Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffffa0342ae8>]  [<ffffffffa0342ae8>] ax25_t1timer_expiry+0x8/0x50 [ax25]
RSP: 0000:ffffffff80717ea0  EFLAGS: 00010246
RAX: ffff880074023fd8 RBX: ffff88007bc90000 RCX: ffffffffa0342ae0
RDX: a86496acda711900 RSI: 0000000000000000 RDI: ffff88007bc90000
RBP: ffffffff80717ea0 R08: ffff88007bc90078 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000100
R13: ffffffff8075a600 R14: ffffffffa0342ae0 R15: ffffffff80717ed0
FS:  000000000224b860(0063) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa029a4e000 CR3: 000000007e8e9000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process astropulse_5.06 (pid: 28253, threadinfo ffff880074022000, task ffff8800714c2bc0)
Stack:
 ffffffff80717f10 ffffffff8024976c ffffffff8075c210 ffffffff8075be10
 ffffffff8075ba10 ffffffff8075b610 ffffffff80717ed0 ffffffff80717ed0
 ffffffff8025f8ff 0000000000000008 0000000000000001 0000000000000100
Call Trace:
 <IRQ> <0> [<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
 [<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
 [<ffffffff8024506c>] __do_softirq+0x7c/0x110
 [<ffffffff8021271c>] call_softirq+0x1c/0x30
 [<ffffffff8021407d>] do_softirq+0x5d/0xa0
 [<ffffffff80244c95>] irq_exit+0x45/0x50
 [<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
 [<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
 <EOI> <0>Code: 44 00 00 75 e7 80 7a 58 00 66 90 74 da c9 0f 1f 44 00 00 c3 66 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 8b 57 28 48 89 e5 <8b> 42 50 85 c0 78 0a 83 f8 01 7f 14 e8 e7 f1 ff ff c9 66 0f 1f 
RIP  [<ffffffffa0342ae8>] ax25_t1timer_expiry+0x8/0x50 [ax25]
 RSP <ffffffff80717ea0>
---[ end trace 963e5b19794631dc ]---
Kernel panic - not syncing: Fatal exception in interrupt

Rebooting in 60 seconds..
-------------------------------
Thu Aug 27 04:03:22 CEST 2009
-------------------------------

-------------------------------
Fri Aug 28 04:03:26 CEST 2009
-------------------------------

BUG: unable to handle kernel paging request at ffff880077ca0e48
IP: [<ffffffff80249451>] del_timer+0x11/0xb0
PGD 202063 PUD 9bc067 PMD b7b067 PTE 77ca0160
Oops: 0002 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/class/vc/vcsa6/dev
CPU 0 
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd i2c_viapro soundcore i2c_core sr_mod 8139too mii shpchp pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table floppy sg rtc_cmos via_agp thermal evdev processor button pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 30841, comm: setiathome-5.28 Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffff80249451>]  [<ffffffff80249451>] del_timer+0x11/0xb0
RSP: 0000:ffffffff80717e00  EFLAGS: 00010246
RAX: ffffffff8067f0b8 RBX: ffff880077ca0c00 RCX: 0000000000000058
RDX: ffffe20001a29a48 RSI: ffffffff8067f060 RDI: ffff880077ca0e18
RBP: ffffffff80717e20 R08: 0000000000000001 R09: 00000000000004a0
R10: 0000000000000002 R11: ffffffff8067f008 R12: ffff880077ca0e18
R13: ffff880077ca0c00 R14: 0000000000000000 R15: ffffffff80717ed0
FS:  0000000041b93940(0063) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffff880077ca0e48 CR3: 000000006e1fc000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process setiathome-5.28 (pid: 30841, threadinfo ffff88007957c000, task ffff8800750cabc0)
Stack:
 ffff880077ca0c00 ffff880077ca0c00 ffff880077ca0c00 ffffffffa034fb30
 ffffffff80717e30 ffffffffa034f850 ffffffff80717e60 ffffffffa0352db4
 ffff880077ca0c00 ffff880077ca0c00 0000000000000000 ffffffffa034fb30
Call Trace:
 <IRQ> <0> [<ffffffffa034fb30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
 [<ffffffffa034f850>] ax25_stop_heartbeat+0x10/0x20 [ax25]
 [<ffffffffa0352db4>] ax25_destroy_socket+0x64/0x210 [ax25]
 [<ffffffffa034fb30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
 [<ffffffffa034f045>] ax25_std_heartbeat_expiry+0xf5/0x100 [ax25]
 [<ffffffff80217c56>] ? read_tsc+0x16/0x40
 [<ffffffffa034fb55>] ax25_heartbeat_expiry+0x25/0x60 [ax25]
 [<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
 [<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
 [<ffffffff8024506c>] __do_softirq+0x7c/0x110
 [<ffffffff8021271c>] call_softirq+0x1c/0x30
 [<ffffffff8021407d>] do_softirq+0x5d/0xa0
 [<ffffffff80244c95>] irq_exit+0x45/0x50
 [<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
 [<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
 <EOI> <0>Code: 10 18 00 00 eb a6 0f 1f 40 00 48 0f b6 c2 48 c1 e0 04 48 8d 54 07 10 eb 93 90 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 fc 53 <48> c7 47 30 00 00 00 00 48 83 3f 00 75 16 eb 76 0f 1f 80 00 00 
RIP  [<ffffffff80249451>] del_timer+0x11/0xb0
 RSP <ffffffff80717e00>
CR2: ffff880077ca0e48
---[ end trace 2278e28e8ee624db ]---
Kernel panic - not syncing: Fatal exception in interrupt

Rebooting in 60 seconds..
-------------------------------
Sat Aug 29 04:03:23 CEST 2009
-------------------------------

-------------------------------
Sun Aug 30 04:03:21 CEST 2009
-------------------------------

-------------------------------
Mon Aug 31 04:03:24 CEST 2009
-------------------------------

BUG: unable to handle kernel paging request at ffff88006eca8a48
IP: [<ffffffff80249451>] del_timer+0x11/0xb0
PGD 202063 PUD 9bc067 PMD b33067 PTE 6eca8160
Oops: 0002 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/devices/system/cpu/cpu0/cpufreq/scaling_cur_freq
CPU 0 
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd i2c_viapro 8139too i2c_core soundcore sr_mod mii shpchp pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table via_agp rtc_cmos floppy thermal processor button sg evdev pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 0, comm: swapper Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffff80249451>]  [<ffffffff80249451>] del_timer+0x11/0xb0
RSP: 0018:ffffffff80717e00  EFLAGS: 00010246
RAX: ffffffff8067f0b8 RBX: ffff88006eca8800 RCX: 0000000000000058
RDX: ffffe200017e8f68 RSI: ffffffff8067f060 RDI: ffff88006eca8a18
RBP: ffffffff80717e20 R08: 0000000000000001 R09: 00000000000004a8
R10: 0000000000000002 R11: ffffffff8067f008 R12: ffff88006eca8a18
R13: ffff88006eca8800 R14: 0000000000000000 R15: ffffffff80717ed0
FS:  0000000000000000(0000) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: ffff88006eca8a48 CR3: 000000006e00b000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffffffff8068c000, task ffffffff80632360)
Stack:
 ffff88006eca8800 ffff88006eca8800 ffff88006eca8800 ffffffffa0345b30
 ffffffff80717e30 ffffffffa0345850 ffffffff80717e60 ffffffffa0348db4
 ffff88006eca8800 ffff88006eca8800 0000000000000000 ffffffffa0345b30
Call Trace:
 <IRQ> <0> [<ffffffffa0345b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
 [<ffffffffa0345850>] ax25_stop_heartbeat+0x10/0x20 [ax25]
 [<ffffffffa0348db4>] ax25_destroy_socket+0x64/0x210 [ax25]
 [<ffffffffa0345b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
 [<ffffffffa0345045>] ax25_std_heartbeat_expiry+0xf5/0x100 [ax25]
 [<ffffffff80217c56>] ? read_tsc+0x16/0x40
 [<ffffffffa0345b55>] ax25_heartbeat_expiry+0x25/0x60 [ax25]
 [<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
 [<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
 [<ffffffff8024506c>] __do_softirq+0x7c/0x110
 [<ffffffff8021271c>] call_softirq+0x1c/0x30
 [<ffffffff8021407d>] do_softirq+0x5d/0xa0
 [<ffffffff80244c95>] irq_exit+0x45/0x50
 [<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
 [<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
 <EOI> <0> [<ffffffff80218afd>] ? mwait_idle+0x5d/0x70
 [<ffffffff8020fdd2>] ? enter_idle+0x22/0x30
 [<ffffffff8020fe2e>] ? cpu_idle+0x4e/0x80
 [<ffffffff804eb5cd>] ? rest_init+0x5d/0x70
Code: 10 18 00 00 eb a6 0f 1f 40 00 48 0f b6 c2 48 c1 e0 04 48 8d 54 07 10 eb 93 90 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 fc 53 <48> c7 47 30 00 00 00 00 48 83 3f 00 75 16 eb 76 0f 1f 80 00 00 
RIP  [<ffffffff80249451>] del_timer+0x11/0xb0
 RSP <ffffffff80717e00>
CR2: ffff88006eca8a48
---[ end trace 62fd644f9e0af320 ]---
Kernel panic - not syncing: Fatal exception in interrupt

Rebooting in 60 seconds..
-------------------------------
Tue Sep 1 04:03:25 CEST 2009
-------------------------------

BUG: unable to handle kernel paging request at ffff88000ad0a248
IP: [<ffffffff80249451>] del_timer+0x11/0xb0
PGD 202063 PUD 206063 PMD 812067 PTE ad0a160
Oops: 0002 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/class/vc/vcsa5/dev
CPU 0 
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd soundcore i2c_viapro i2c_core sr_mod 8139too mii shpchp pci_hotplug binfmt_misc ext3 jbd rtc_cmos floppy thermal button cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table processor via_agp evdev sg pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 0, comm: swapper Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffff80249451>]  [<ffffffff80249451>] del_timer+0x11/0xb0
RSP: 0018:ffffffff80717e00  EFLAGS: 00010246
RAX: ffffffff8067f0b8 RBX: ffff88000ad0a000 RCX: 0000000000000058
RDX: ffffe200019d57a8 RSI: ffffffff8067f060 RDI: ffff88000ad0a218
RBP: ffffffff80717e20 R08: 0000000000000001 R09: 000000000000050a
R10: 0000000000000002 R11: ffffffff8067f008 R12: ffff88000ad0a218
R13: ffff88000ad0a000 R14: 0000000000000000 R15: ffffffff80717ed0
FS:  0000000000000000(0000) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: ffff88000ad0a248 CR3: 00000000751da000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffffffff8068c000, task ffffffff80632360)
Stack:
 ffff88000ad0a000 ffff88000ad0a000 ffff88000ad0a000 ffffffffa0350b30
 ffffffff80717e30 ffffffffa0350850 ffffffff80717e60 ffffffffa0353db4
 ffff88000ad0a000 ffff88000ad0a000 0000000000000000 ffffffffa0350b30
Call Trace:
 <IRQ> <0> [<ffffffffa0350b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
 [<ffffffffa0350850>] ax25_stop_heartbeat+0x10/0x20 [ax25]
 [<ffffffffa0353db4>] ax25_destroy_socket+0x64/0x210 [ax25]
 [<ffffffffa0350b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
 [<ffffffffa0350045>] ax25_std_heartbeat_expiry+0xf5/0x100 [ax25]
 [<ffffffffa0350b55>] ax25_heartbeat_expiry+0x25/0x60 [ax25]
 [<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
 [<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
 [<ffffffff8024506c>] __do_softirq+0x7c/0x110
 [<ffffffff8021271c>] call_softirq+0x1c/0x30
 [<ffffffff8021407d>] do_softirq+0x5d/0xa0
 [<ffffffff80244c95>] irq_exit+0x45/0x50
 [<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
 [<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
 <EOI> <0> [<ffffffff80218afd>] ? mwait_idle+0x5d/0x70
 [<ffffffff8020fdd2>] ? enter_idle+0x22/0x30
 [<ffffffff8020fe2e>] ? cpu_idle+0x4e/0x80
 [<ffffffff804eb5cd>] ? rest_init+0x5d/0x70
Code: 10 18 00 00 eb a6 0f 1f 40 00 48 0f b6 c2 48 c1 e0 04 48 8d 54 07 10 eb 93 90 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 fc 53 <48> c7 47 30 00 00 00 00 48 83 3f 00 75 16 eb 76 0f 1f 80 00 00 
RIP  [<ffffffff80249451>] del_timer+0x11/0xb0
 RSP <ffffffff80717e00>
CR2: ffff88000ad0a248
---[ end trace 8cace7d340707eda ]---
Kernel panic - not syncing: Fatal exception in interrupt

Rebooting in 60 seconds..
-------------------------------
Wed Sep 2 04:03:25 CEST 2009
-------------------------------

-------------------------------
Thu Sep 3 04:03:19 CEST 2009
-------------------------------

-------------------------------
Fri Sep 4 04:03:21 CEST 2009
-------------------------------

BUG: unable to handle kernel paging request at ffff8800141b6a48
IP: [<ffffffff80249451>] del_timer+0x11/0xb0
PGD 202063 PUD 206063 PMD 85c067 PTE 141b6160
Oops: 0002 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/class/vc/vcsa6/dev
CPU 0 
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd shpchp i2c_viapro 8139too pci_hotplug soundcore i2c_core sr_mod mii binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table via_agp floppy sg rtc_cmos thermal evdev processor button pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 32129, comm: setiathome-5.28 Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffff80249451>]  [<ffffffff80249451>] del_timer+0x11/0xb0
RSP: 0000:ffffffff80717e00  EFLAGS: 00010246
RAX: ffffffff8067f0b8 RBX: ffff8800141b6800 RCX: 0000000000000058
RDX: ffffe200004610c8 RSI: ffffffff8067f060 RDI: ffff8800141b6a18
RBP: ffffffff80717e20 R08: 0000000000000001 R09: 00000000000001b6
R10: 0000000000000002 R11: ffffffff8067f008 R12: ffff8800141b6a18
R13: ffff8800141b6800 R14: 0000000000000000 R15: ffffffff80717ed0
FS:  0000000041ee4940(0063) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffff8800141b6a48 CR3: 00000000781d5000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process setiathome-5.28 (pid: 32129, threadinfo ffff8800781e2000, task ffff8800183641a0)
Stack:
 ffff8800141b6800 ffff8800141b6800 ffff8800141b6800 ffffffffa034ab30
 ffffffff80717e30 ffffffffa034a850 ffffffff80717e60 ffffffffa034ddb4
 ffff8800141b6800 ffff8800141b6800 0000000000000000 ffffffffa034ab30
Call Trace:
 <IRQ> <0> [<ffffffffa034ab30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
 [<ffffffffa034a850>] ax25_stop_heartbeat+0x10/0x20 [ax25]
 [<ffffffffa034ddb4>] ax25_destroy_socket+0x64/0x210 [ax25]
 [<ffffffffa034ab30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
 [<ffffffffa034a045>] ax25_std_heartbeat_expiry+0xf5/0x100 [ax25]
 [<ffffffff80217c56>] ? read_tsc+0x16/0x40
 [<ffffffffa034ab55>] ax25_heartbeat_expiry+0x25/0x60 [ax25]
 [<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
 [<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
 [<ffffffff8024506c>] __do_softirq+0x7c/0x110
 [<ffffffff8021271c>] call_softirq+0x1c/0x30
 [<ffffffff8021407d>] do_softirq+0x5d/0xa0
 [<ffffffff80244c95>] irq_exit+0x45/0x50
 [<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
 [<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
 <EOI> <0>Code: 10 18 00 00 eb a6 0f 1f 40 00 48 0f b6 c2 48 c1 e0 04 48 8d 54 07 10 eb 93 90 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 fc 53 <48> c7 47 30 00 00 00 00 48 83 3f 00 75 16 eb 76 0f 1f 80 00 00 
RIP  [<ffffffff80249451>] del_timer+0x11/0xb0
 RSP <ffffffff80717e00>
CR2: ffff8800141b6a48
---[ end trace 469a474dc114bf10 ]---
Kernel panic - not syncing: Fatal exception in interrupt

Rebooting in 60 seconds..
-------------------------------
Sat Sep 5 04:03:26 CEST 2009
-------------------------------

-------------------------------
Sun Sep 6 04:03:11 CEST 2009
-------------------------------

-------------------------------
Mon Sep 7 04:03:20 CEST 2009
-------------------------------

#1 lore raw

Bernard Pidoux wrote, On 09/10/2009 12:28 AM:

Quoted 9 lines

Hi Ralf,

Here is a set of not so frequent kernel panics captured via netconsole that seem related to AX25 timer.

Regards,

Bernard Pidoux

Hi Bernard,

Could/did you try to turn on this debugging option below, btw?

Regards,
Jarek P.

CONFIG_DEBUG_OBJECTS_TIMERS:

  ?                                                                                                        ?  
  ? If you say Y here, additional code will be inserted into the                                           ?  
  ? timer routines to track the life time of timer objects and                                             ?  
  ? validate the timer operations.                                                                         ?  
  ?                                                                                                        ?  
  ? Symbol: DEBUG_OBJECTS_TIMERS [=y]                                                                      ?  
  ? Prompt: Debug timer objects                                                                            ?  
  ?   Defined at lib/Kconfig.debug:247                                                                     ?  
  ?   Depends on: DEBUG_OBJECTS                                                                            ?  
  ?   Location:                                                                                            ?  
  ?     -> Kernel hacking                                                                                  ?  
  ?       -> Kernel debugging (DEBUG_KERNEL [=y])                                                          ?  
  ?         -> Debug object operations (DEBUG_OBJECTS [=y])                                                ?

?

author
#2 lore raw

Hi Jarek,

I was not aware of this debug option and will turn it ON. Thanks for the suggestion.

Bernard

Quoted 35 lines · Jarek Poplawski

Bernard Pidoux wrote, On 09/10/2009 12:28 AM:

Quoted 10 lines

Hi Ralf,

Here is a set of not so frequent kernel panics captured via netconsole that seem related to AX25 timer.

Regards,

Bernard Pidoux

Hi Bernard,

Could/did you try to turn on this debugging option below, btw?

Regards,
Jarek P.

CONFIG_DEBUG_OBJECTS_TIMERS:

  ?                                                                                                        ?  
  ? If you say Y here, additional code will be inserted into the                                           ?  
  ? timer routines to track the life time of timer objects and                                             ?  
  ? validate the timer operations.                                                                         ?  
  ?                                                                                                        ?  
  ? Symbol: DEBUG_OBJECTS_TIMERS [=y]                                                                      ?  
  ? Prompt: Debug timer objects                                                                            ?  
  ?   Defined at lib/Kconfig.debug:247                                                                     ?  
  ?   Depends on: DEBUG_OBJECTS                                                                            ?  
  ?   Location:                                                                                            ?  
  ?     -> Kernel hacking                                                                                  ?  
  ?       -> Kernel debugging (DEBUG_KERNEL [=y])                                                          ?  
  ?         -> Debug object operations (DEBUG_OBJECTS [=y])                                                ?
Quoted 3 lines

?

--
To unsubscribe from this list: send the line "unsubscribe linux-hams" in the body of a message to [email protected]
More majordomo info at http://vger.kernel.org/majordomo-info.html

A message that is not in the archive (sent off-list or not yet received): [email protected]

A message that is not in the archive (sent off-list or not yet received): [email protected]

A message that is not in the archive (sent off-list or not yet received): [email protected]

author
#6 lore raw

Hi,

Here are the first events noticed since I turned on CONFIG_DEBUG_OBJECTS_TIMERS option.

First a kernel BUG, second a kernel panic.

Best regards,

Bernard Pidoux

------------[ cut here ]------------
kernel BUG at kernel/timer.c:913!
invalid opcode: 0000 [#1] 
last sysfs file: /sys/devices/system/cpu/cpu0/cpufreq/scaling_cur_freq
CPU 0 
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 binfmt_misc loop ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd soundcore shpchp pci_hotplug i2c_viapro i2c_core via_agp floppy 8139cp 8139too mii sg sr_mod processor rtc_cmos button thermal evdev pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 24497, comm: astropulse_5.06 Not tainted 2.6.31-nosmp #3 MS-7258
RIP: 0010:[<ffffffff81061412>]  [<ffffffff81061412>] cascade+0xb2/0xc0
RSP: 0000:ffffffff8155be00  EFLAGS: 00010082
RAX: 0000000000000000 RBX: ffff880050c4c218 RCX: 0000000104445204
RDX: ffffffff8132b3d0 RSI: ffff880050c4c218 RDI: ffffffff81673540
RBP: ffffffff8155be40 R08: 0000000000000004 R09: ffffffff81568bc0
R10: ffffffff8155be28 R11: 0000000000000001 R12: ffffffff81673540
R13: ffffffff8155be00 R14: 0000000000000012 R15: 0000000000000001
FS:  00000000016e2860(0063) GS:ffffffff81558000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fe3eb15029c CR3: 000000007ecff000 CR4: 00000000000006f0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff4ff0 DR7: 0000000000000400
Process astropulse_5.06 (pid: 24497, threadinfo ffff88005807a000, task ffff880049588000)
Stack:
 ffff8800445748e0 ffff88007e86ab98 ffffffff8155be88 000000008c85481d
<0> 0000000000000000 ffffffff81673540 ffffffff8155be70 0000000000000081
<0> ffffffff8155bec0 ffffffff81061613 ffffffff81675150 ffffffff81674d50
Call Trace:
 <IRQ> 
 [<ffffffff81061613>] run_timer_softirq+0xf3/0x250
 [<ffffffff8102d0db>] ? lapic_next_event+0x2b/0x50
 [<ffffffff8107fc42>] ? clockevents_program_event+0x62/0xc0
 [<ffffffff8105b242>] __do_softirq+0xe2/0x1d0
 [<ffffffff8101414a>] call_softirq+0x1a/0x30
 [<ffffffff810162c5>] do_softirq+0x75/0xc0
 [<ffffffff8105ac45>] irq_exit+0x65/0x80
 [<ffffffff8102ddb5>] smp_apic_timer_interrupt+0x65/0xb0
 [<ffffffff81013c73>] apic_timer_interrupt+0x13/0x20
 <EOI> 
Code: 45 fe ff ff 4c 39 eb 48 8b 13 75 dd 48 8b 55 d8 65 48 33 14 25 28 00 00 00 44 89 f0 75 11 48 83 c4 20 5b 41 5c 41 5d 41 5e c9 c3 <0f> 0b eb fe e8 c5 29 ff ff 0f 1f 44 00 00 55 48 89 e5 48 83 ec 
RIP  [<ffffffff81061412>] cascade+0xb2/0xc0
 RSP <ffffffff8155be00>
---[ end trace 2efb8d4aaedbf503 ]---
Kernel panic - not syncing: Fatal exception in interrupt
Pid: 24497, comm: astropulse_5.06 Tainted: G      D    2.6.31-nosmp #3
Call Trace:
 <IRQ>  [<ffffffff813d5e52>] panic+0xb2/0x180
 [<ffffffff8132f8ff>] ? __kfree_skb+0x6f/0xe0
 [<ffffffff810549bd>] ? console_unblank+0x8d/0xd0
 [<ffffffff812bdcee>] ? unblank_screen+0x1e/0x40
 [<ffffffff81053a36>] ? oops_exit+0x36/0x60
 [<ffffffff81017947>] oops_end+0xe7/0x100
 [<ffffffff810179bd>] ? oops_begin+0x5d/0x80
 [<ffffffff81017b52>] die+0x62/0xa0
 [<ffffffff81014e86>] do_trap+0x166/0x190
 [<ffffffff8107715d>] ? notify_die+0x3d/0x60
 [<ffffffff810153a5>] do_invalid_op+0xa5/0xd0
 [<ffffffff81061412>] ? cascade+0xb2/0xc0
 [<ffffffff8104dcde>] ? wake_up_state+0x1e/0x40
 [<ffffffff81013ddb>] invalid_op+0x1b/0x20
 [<ffffffff8132b3d0>] ? sock_def_write_space+0x0/0xb0
 [<ffffffff81061412>] ? cascade+0xb2/0xc0
 [<ffffffff81061613>] run_timer_softirq+0xf3/0x250
 [<ffffffff8102d0db>] ? lapic_next_event+0x2b/0x50
 [<ffffffff8107fc42>] ? clockevents_program_event+0x62/0xc0
 [<ffffffff8105b242>] __do_softirq+0xe2/0x1d0
 [<ffffffff8101414a>] call_softirq+0x1a/0x30
 [<ffffffff810162c5>] do_softirq+0x75/0xc0
 [<ffffffff8105ac45>] irq_exit+0x65/0x80
 [<ffffffff8102ddb5>] smp_apic_timer_interrupt+0x65/0xb0
 [<ffffffff81013c73>] apic_timer_interrupt+0x13/0x20
 <EOI>

Rebooting in 60 seconds..[root@f6bvp-9 bernard]#

#7 lore raw

hi Bernard,

My problem wasn't exactly the same has your.
But !

Doing a boot with the kernel option "nosmp" wasn't suffisant... it seemed to load the smp and then, while reading the boot option, unsetting them... but it was too late. (I saw that looking the dmesg).

My solution has been to compile a kernel without smp to be sure that nothing goes up... and it worked !

Regards
f8arr

Quoted 14 lines · Bernard Pidoux

Hi,

Here are the first events noticed since I turned on CONFIG_DEBUG_OBJECTS_TIMERS option.

First a kernel BUG, second a kernel panic.

Best regards,

Bernard Pidoux

#8 lore raw
In reply to Bernard Pidoux
Quoted 6 lines · Bernard Pidoux

Hi,

Here are the first events noticed since I turned on CONFIG_DEBUG_OBJECTS_TIMERS option.

First a kernel BUG, second a kernel panic.

...

Quoted 2 lines
------------[ cut here ]------------
kernel BUG at kernel/timer.c:913!

Alas this BUG doesn't show much (this new debugging didn't trigger here). Maybe the patch below will be luckier.

Best regards,
Jarek P.
---

 include/net/ax25.h |   36 ++++++++++++++++++++++++++++++++++++
 net/ax25/af_ax25.c |    3 +++
 2 files changed, 39 insertions(+), 0 deletions(-)
include/net/ax25.h +36 -0
index 717e219..e8f6e33 100644
@@ -252,9 +252,45 @@ typedef struct ax25_cb {
 #define ax25_cb_hold(__ax25) \
 	atomic_inc(&((__ax25)->refcount))
 
+static __inline__ int ax25_timers_warn(ax25_cb *ax25)
+{
+	int err = 0;
+
+	if (del_timer(&ax25->timer)) {
+		WARN_ON_ONCE(1);
+		err = 1;
+	}
+	if (del_timer(&ax25->t1timer)) {
+		WARN_ON_ONCE(1);
+		err += 2;
+	}
+	if (del_timer(&ax25->t2timer)) {
+		WARN_ON_ONCE(1);
+		err += 4;
+	}
+	if (del_timer(&ax25->t3timer)) {
+		WARN_ON_ONCE(1);
+		err += 8;
+	}
+	if (del_timer(&ax25->idletimer)) {
+		WARN_ON_ONCE(1);
+		err += 16;
+	}
+	if (del_timer(&ax25->dtimer)) {
+		WARN_ON_ONCE(1);
+		err += 32;
+	}
+	if (err)
+		printk(KERN_WARNING "AX25_DBG: %d %p %u\n", err, ax25,
+		       ax25->state);
+
+	return err;
+}
+
 static __inline__ void ax25_cb_put(ax25_cb *ax25)
 {
 	if (atomic_dec_and_test(&ax25->refcount)) {
+		ax25_timers_warn(ax25);
 		kfree(ax25->digipeat);
 		kfree(ax25);
 	}
net/ax25/af_ax25.c +3 -0
index da0f64f..f443fe0 100644
@@ -58,6 +58,9 @@ static const struct proto_ops ax25_proto_ops;
 
 static void ax25_free_sock(struct sock *sk)
 {
+	if (ax25_timers_warn(ax25_sk(sk)))
+		printk(KERN_WARNING "AX25_DBG: %p %u %u %u\n", sk,
+		       sk->sk_family, sk->sk_type, sk->sk_protocol);
 	ax25_cb_put(ax25_sk(sk));
 }
author
#9 lore raw

Hi Jarek,

Good fishing !

During the night I catched the following two identical AX25_DBG messages with netconsole sending already reported message: kernel BUG at kernel/timer.c:913! and followed by kernel panics and the machine rebooting.

Sep 21 03:24:06 f6bvp-11 klogd: ------------[ cut here ]------------
Sep 21 03:24:06 f6bvp-11 klogd: WARNING: at include/net/ax25.h:260 ax25_kiss_rcv+0x650/0xab0 [ax25]()
Sep 21 03:24:06 f6bvp-11 klogd: Hardware name: MS-7258
Sep 21 03:24:06 f6bvp-11 klogd: Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl aut

h_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss
snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss i2c_viapro snd i2c
_core soundcore 8139cp 8139too shpchp pci_hotplug mii sr_mod binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table floppy rtc_cmos processor thermal button via_agp sg evdev pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif

Sep 21 03:24:06 f6bvp-11 klogd: Pid: 5, comm: events/0 Not tainted 2.6.31-nosmp #3
Sep 21 03:24:06 f6bvp-11 klogd: Call Trace:
Sep 21 03:24:06 f6bvp-11 klogd:  <IRQ>  [<ffffffffa03ab750>] ? ax25_kiss_rcv+0x650/0xab0 [ax25]
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff81053b90>] warn_slowpath_common+0x80/0xe0
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff81053c12>] warn_slowpath_null+0x22/0x40
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffffa03ab750>] ax25_kiss_rcv+0x650/0xab0 [ax25]
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff8132b4bd>] ? sock_def_readable+0x3d/0x80
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff8132c96d>] ? sock_queue_rcv_skb+0x12d/0x160
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff8133a831>] netif_receive_skb+0x351/0x5f0
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff81061699>] ? run_timer_softirq+0x179/0x250
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff8133ab50>] process_backlog+0x80/0xe0
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff8133b4a4>] net_rx_action+0xf4/0x220
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff8105b242>] __do_softirq+0xe2/0x1d0
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff8101414a>] call_softirq+0x1a/0x30
Sep 21 03:24:06 f6bvp-11 klogd:  <EOI>  [<ffffffff810162c5>] do_softirq+0x75/0xc0
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff8105b094>] local_bh_enable+0xc4/0xd0
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffffa03cd798>] mkiss_receive_buf+0x3a8/0x460 [mkiss]
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff8104b864>] ? finish_task_switch+0x44/0xe0
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff812af800>] flush_to_ldisc+0x110/0x1f0
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff812af6f0>] ? flush_to_ldisc+0x0/0x1f0
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff8106c263>] worker_thread+0x173/0x260
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff81071be0>] ? autoremove_wake_function+0x0/0x60
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff8106c0f0>] ? worker_thread+0x0/0x260
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff8107149e>] kthread+0xae/0xc0
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff8101404a>] child_rip+0xa/0x20
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff810713f0>] ? kthread+0x0/0xc0
Sep 21 03:24:06 f6bvp-11 klogd:  [<ffffffff81014040>] ? child_rip+0x0/0x20
Sep 21 03:24:06 f6bvp-11 klogd: ---[ end trace cea93cec47668ffd ]---
Sep 21 03:24:06 f6bvp-11 klogd: AX25_DBG: 1 ffff88005a127c00 0
Sep 21 04:30:40 f6bvp-11 klogd: ------------[ cut here ]------------
Sep 21 04:30:40 f6bvp-11 klogd: WARNING: at include/net/ax25.h:260 ax25_kiss_rcv+0x650/0xab0 [ax25]()
Sep 21 04:30:40 f6bvp-11 klogd: Hardware name: MS-7258
Sep 21 04:30:40 f6bvp-11 klogd: Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd 8139cp i2c_viapro 8139too soundcore i2c_core shpchp sr_mod mii pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table processor rtc_cmos floppy button thermal via_agp evdev sg pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Sep 21 04:30:40 f6bvp-11 klogd: Pid: 5, comm: events/0 Not tainted 2.6.31-nosmp #3
Sep 21 04:30:40 f6bvp-11 klogd: Call Trace:
Sep 21 04:30:40 f6bvp-11 klogd:  <IRQ>  [<ffffffffa03ab750>] ? ax25_kiss_rcv+0x650/0xab0 [ax25]
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff81053b90>] warn_slowpath_common+0x80/0xe0
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff81053c12>] warn_slowpath_null+0x22/0x40
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffffa03ab750>] ax25_kiss_rcv+0x650/0xab0 [ax25]
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff8132b4bd>] ? sock_def_readable+0x3d/0x80
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff8132c96d>] ? sock_queue_rcv_skb+0x12d/0x160
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff8133a831>] netif_receive_skb+0x351/0x5f0
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff81061699>] ? run_timer_softirq+0x179/0x250
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff8133ab50>] process_backlog+0x80/0xe0
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff8133b4a4>] net_rx_action+0xf4/0x220
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff8105b242>] __do_softirq+0xe2/0x1d0
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff8101414a>] call_softirq+0x1a/0x30
Sep 21 04:30:40 f6bvp-11 klogd:  <EOI>  [<ffffffff810162c5>] do_softirq+0x75/0xc0
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff8105b094>] local_bh_enable+0xc4/0xd0
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffffa03cd798>] mkiss_receive_buf+0x3a8/0x460 [mkiss]
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff8104b864>] ? finish_task_switch+0x44/0xe0
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff812af800>] flush_to_ldisc+0x110/0x1f0
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff8106c71c>] ? schedule_delayed_work+0x2c/0x50
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff812af6f0>] ? flush_to_ldisc+0x0/0x1f0
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff8106c263>] worker_thread+0x173/0x260
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff81071be0>] ? autoremove_wake_function+0x0/0x60
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff8106c0f0>] ? worker_thread+0x0/0x260
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff8107149e>] kthread+0xae/0xc0
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff8101404a>] child_rip+0xa/0x20
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff810713f0>] ? kthread+0x0/0xc0
Sep 21 04:30:40 f6bvp-11 klogd:  [<ffffffff81014040>] ? child_rip+0x0/0x20
Sep 21 04:30:40 f6bvp-11 klogd: ---[ end trace 5e079e87d8b30365 ]---
Sep 21 04:30:40 f6bvp-11 klogd: AX25_DBG: 1 ffff880064471c00 0

Regards,

Bernard