Skip to contentSkip to conversation

2.6.18-rc2-mm1

DISCUSSION Jan Beulich 2 participants 2 messages Jul 28, 2006 1 message not in the archive

lore
Share & tools
lore

A message that is not in the archive (sent off-list or not yet received): [email protected]

#1 lore raw
Quoted 4 lines
Quoted 1 line
Quoted 1 line

Andrew Morton <[email protected]> 28.07.06 10:19 >>>

More unwinder problems. Seems to be specific to -mm. (Followups on-list are preferred, thanks).

That's another of the lose ends - while Andi and I had decided to put a proper stack frame in place for the switch to the irq stack in the interrupt macro, we had forgotten about doing something similar for call_softirq() - as the code is written currently, there simply is now way of annotating the code properly. If Andi is agreeable to this, then I'll just change the code so that it'll have a proper stack frame.

The recursive traces appear to result from the fact that when we did the change to the interrupt macro, we neglected the fact that show_trace() expects to find the old stack pointer as the very first item on the interrupt stack, which isn't the case anymore. The value of where the subsequent stack access fails is a little strange, though. Making this assumption be true again would, however, require adding a push to both the interrupt macro and call_softirq. I'm afraid Andi's not going to be too happy about that, but on the other hand I can't see any other possible way that would get away without adding some code to these paths.

Jan

***************************************************
Begin forwarded message:

Date: Fri, 28 Jul 2006 20:09:35 +1200
From: Reuben Farrelly <[email protected]>
To: Andrew Morton <[email protected]>
Cc: [email protected], Linux Netdev List <[email protected]>, [email protected]
Subject: Re: 2.6.18-rc2-mm1

Quoted 9 lines · Andrew Morton

ftp://ftp.kernel.org/pub/linux/kernel/people/akpm/patches/2.6/2.6.18-rc2/2.6.18-rc2-mm1/

- git-klibc has been dropped due to very bad parallel-make problems.

- Added a new line to the boilerplate, below!

- Added Sam's lxdialog tree, as git-lxdialog.patch. You no longer need x-ray spectacles to read the menuconfig screens.

Quoted 8 lines

- Lots of random patches. Many of them are bugfixes and I shall, as usual, go through them all identifying 2.6.18 material. But I can miss things, so please don't be afraid to point 2.6.18 candidates out to me.

I also have, as usual, a number of bugfixes agains the git trees. I'll send these to the maintainers until they stick and then I lose track of them. So don't be afraid to send reminders to the subsystem maintainers either.

Still seeing breakage with the e1000/NAT. Now the problem isn't so much that the bug exists, but that unlike in -rc1-mm2, the trace scrolls over and over and over (with some variation down into it) until the kernel completely panics and the box has to be rebooted.

http://www.ussg.iu.edu/hypermail/linux/kernel/0607.1/2689.html from Herbert Xu talks about the original problem.

It's a regression from the previous -mm whereby the trace would print out just once.

Starting Dovecot Imap: [ OK ]
Starting clamd: [ OK ]
Starting amavisd: BUG: warning at net/core/dev.c:1168/skb_checksum_help()

Call Trace:
  [<ffffffff80269c65>] show_trace+0xb5/0x324
  [<ffffffff80269ee9>] dump_stack+0x15/0x1c
  [<ffffffff8043d4e8>] skb_checksum_help+0x63/0x13b
  [<ffffffff8802f35f>] :iptable_nat:ip_nat_fn+0x5f/0x1d2
  [<ffffffff8802f71b>] :iptable_nat:ip_nat_local_fn+0x33/0xbc
  [<ffffffff80234c9e>] nf_iterate+0x5a/0x9b
  [<ffffffff80258960>] nf_hook_slow+0x60/0xcd
  [<ffffffff80235174>] ip_queue_xmit+0x444/0x4c0
  [<ffffffff8022157f>] tcp_transmit_skb+0x68f/0x6cf
  [<ffffffff80233b67>] __tcp_push_pending_frames+0x867/0x95a
  [<ffffffff8021b9fc>] tcp_rcv_established+0x72c/0x7c4
  [<ffffffff8023c60e>] tcp_v4_do_rcv+0x2e/0x317
  [<ffffffff8022719c>] tcp_v4_rcv+0x9fc/0xa79
  [<ffffffff80235389>] ip_local_deliver+0x199/0x270
  [<ffffffff802363c3>] ip_rcv+0x4d3/0x52b
  [<ffffffff8021fdcb>] netif_receive_skb+0x1eb/0x27b
  [<ffffffff803c9491>] e1000_clean_rx_irq_ps+0x5c1/0x6a0
  [<ffffffff803c7b45>] e1000_clean+0x325/0x45b
  [<ffffffff8020c9b7>] net_rx_action+0x8e/0x147
  [<ffffffff80211663>] __do_softirq+0x78/0x105
  [<ffffffff80260716>] call_softirq+0x1e/0x28
DWARF2 unwinder stuck at call_softirq+0x1e/0x28
Leftover inexact backtrace:
  <IRQ> [<ffffffff8026b679>] do_softirq+0x39/0xa4
  [<ffffffff802888b8>] irq_exit+0x58/0x5a
  [<ffffffff8026b798>] do_IRQ+0xb4/0xbe
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  <EOI><1>Unable to handle kernel paging request at ffffffff82800000 RIP:
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
PGD 203027 PUD 205027 PMD 0
Oops: 0000 [1] SMP
last sysfs file: /class/net/sit0/address
CPU 0
Modules linked in: hidp rfcomm l2cap bluetooth ipv6 ip_gre iptable_filter 

iptable_nat ip_nat ip_conntrack nfnetlink iptable_mangle

ip_tables binfmt_misc iTCO_wdt i2c_i801 serio_raw
Pid: 2127, comm: imap Not tainted 2.6.18-rc2-mm1 #1

RIP: 0010:[<ffffffff80269e6f>]  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
RSP: 0000:ffffffff806366f0  EFLAGS: 00010206
RAX: 0000000000000000 RBX: 0000000000000000 RCX: 0000000000000004
RDX: 0000000000000010 RSI: ffff81003d95c840 RDI: ffff81003d95c140
RBP: ffffffff806367f0 R08: 0000000000000001 R09: 0000000000000001
R10: 0000000000000002 R11: 0000000000000001 R12: ffffffff827ffff9
R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff80907000
FS:  00002ab5ab544860(0000) GS:ffffffff808b2000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffff82800000 CR3: 0000000029dea000 CR4: 00000000000006e0
Process imap (pid: 2127, threadinfo ffff810029e62000, task ffff81003d95c140)
Stack:  ffffffff806cec48 ffffffff80636fc0 0000000000000001 ffff81002c9d78f8
  0000000000000000 0000000000000000 00007fffff571020 ffff810029e63f58
  ffffffff80636f80 0000000000000046 0000000000000000 0000000000000000
Call Trace:
  [<ffffffff80269ee9>] dump_stack+0x15/0x1c
  [<ffffffff8043d4e8>] skb_checksum_help+0x63/0x13b
  [<ffffffff8802f35f>] :iptable_nat:ip_nat_fn+0x5f/0x1d2
  [<ffffffff8802f71b>] :iptable_nat:ip_nat_local_fn+0x33/0xbc
  [<ffffffff80234c9e>] nf_iterate+0x5a/0x9b
  [<ffffffff80258960>] nf_hook_slow+0x60/0xcd
  [<ffffffff80235174>] ip_queue_xmit+0x444/0x4c0
  [<ffffffff8022157f>] tcp_transmit_skb+0x68f/0x6cf
  [<ffffffff80233b67>] __tcp_push_pending_frames+0x867/0x95a
  [<ffffffff8021b9fc>] tcp_rcv_established+0x72c/0x7c4
  [<ffffffff8023c60e>] tcp_v4_do_rcv+0x2e/0x317
  [<ffffffff8022719c>] tcp_v4_rcv+0x9fc/0xa79
  [<ffffffff80235389>] ip_local_deliver+0x199/0x270
  [<ffffffff802363c3>] ip_rcv+0x4d3/0x52b
  [<ffffffff8021fdcb>] netif_receive_skb+0x1eb/0x27b
  [<ffffffff803c9491>] e1000_clean_rx_irq_ps+0x5c1/0x6a0
  [<ffffffff803c7b45>] e1000_clean+0x325/0x45b
  [<ffffffff8020c9b7>] net_rx_action+0x8e/0x147
  [<ffffffff80211663>] __do_softirq+0x78/0x105
  [<ffffffff80260716>] call_softirq+0x1e/0x28
DWARF2 unwinder stuck at call_softirq+0x1e/0x28
Leftover inexact backtrace:
  <IRQ> [<ffffffff8026b679>] do_softirq+0x39/0xa4
  [<ffffffff802888b8>] irq_exit+0x58/0x5a
  [<ffffffff8026b798>] do_IRQ+0xb4/0xbe
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  <EOI><1>Unable to handle kernel paging request at ffffffff82800000 RIP:
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
PGD 203027 PUD 205027 PMD 0
Oops: 0000 [2] SMP
last sysfs file: /class/net/sit0/address
CPU 0
Modules linked in: hidp rfcomm l2cap bluetooth ipv6 ip_gre iptable_filter 

iptable_nat ip_nat ip_conntrack nfnetlink iptable_mangle

ip_tables binfmt_misc iTCO_wdt i2c_i801 serio_raw
Pid: 2127, comm: imap Not tainted 2.6.18-rc2-mm1 #1

RIP: 0010:[<ffffffff80269e6f>]  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
RSP: 0000:ffffffff80636378  EFLAGS: 00010006
RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff880a3808
RDX: ffff81003d95c140 RSI: 0000000000000001 RDI: 0000000000000000
RBP: ffffffff80636478 R08: 0000000000000000 R09: 0000000000000001
R10: ffffffff8029fae0 R11: 0000000000000000 R12: ffffffff827ffff9
R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff80907000
FS:  00002ab5ab544860(0000) GS:ffffffff808b2000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffff82800000 CR3: 0000000029dea000 CR4: 00000000000006e0
Process imap (pid: 2127, threadinfo ffff810029e62000, task ffff81003d95c140)
Stack:  000000000000000b ffffffff80636fc0 0000000080632fc0 0000000000000000
  0000000000000000 0000000000000000 00007fffff571020 ffff810029e63f58
  ffffffff80636f80 0000000000000046 0000000000000001 0000000000000002
Call Trace:
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff802601ed>] error_exit+0x0/0x96
DWARF2 unwinder stuck at error_exit+0x0/0x96
Leftover inexact backtrace:
  <IRQ> [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff80269ee9>] dump_stack+0x15/0x1c
  [<ffffffff8043d4e8>] skb_checksum_help+0x63/0x13b
  [<ffffffff8802f35f>] :iptable_nat:ip_nat_fn+0x5f/0x1d2
  [<ffffffff8802f71b>] :iptable_nat:ip_nat_local_fn+0x33/0xbc
  [<ffffffff80234c9e>] nf_iterate+0x5a/0x9b
  [<ffffffff804579a6>] dst_output+0x0/0x10
  [<ffffffff80258960>] nf_hook_slow+0x60/0xcd
  [<ffffffff804579a6>] dst_output+0x0/0x10
  [<ffffffff80265999>] _spin_unlock_irqrestore+0x3f/0x47
  [<ffffffff80235174>] ip_queue_xmit+0x444/0x4c0
  [<ffffffff8024bc5d>] tso_fragment+0x5d/0x20e
  [<ffffffff80210009>] __kmalloc_track_caller+0x109/0x11b
  [<ffffffff8022157f>] tcp_transmit_skb+0x68f/0x6cf
  [<ffffffff8024bda6>] tso_fragment+0x1a6/0x20e
  [<ffffffff80233b67>] __tcp_push_pending_frames+0x867/0x95a
  [<ffffffff80228ef8>] __kfree_skb+0xfc/0x101
  [<ffffffff80236fe1>] tcp_data_queue+0x651/0xc39
  [<ffffffff8021b9fc>] tcp_rcv_established+0x72c/0x7c4
  [<ffffffff8023c60e>] tcp_v4_do_rcv+0x2e/0x317
  [<ffffffff8022719c>] tcp_v4_rcv+0x9fc/0xa79
  [<ffffffff80258960>] nf_hook_slow+0x60/0xcd
  [<ffffffff804552b0>] ip_local_deliver_finish+0x0/0x1fb
  [<ffffffff80235389>] ip_local_deliver+0x199/0x270
  [<ffffffff802363c3>] ip_rcv+0x4d3/0x52b
  [<ffffffff80439ccc>] kfree_skb+0x2c/0x31
  [<ffffffff8021fdcb>] netif_receive_skb+0x1eb/0x27b
  [<ffffffff803c9491>] e1000_clean_rx_irq_ps+0x5c1/0x6a0
  [<ffffffff803c7b45>] e1000_clean+0x325/0x45b
  [<ffffffff8020c9b7>] net_rx_action+0x8e/0x147
  [<ffffffff8021164f>] __do_softirq+0x64/0x105
  [<ffffffff80211663>] __do_softirq+0x78/0x105
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff8026b679>] do_softirq+0x39/0xa4
  [<ffffffff802888b8>] irq_exit+0x58/0x5a
  [<ffffffff8026b798>] do_IRQ+0xb4/0xbe
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  <EOI><1>Unable to handle kernel paging request at ffffffff82800000 RIP:
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
PGD 203027 PUD 205027 PMD 0
Oops: 0000 [3] SMP
last sysfs file: /class/net/sit0/address
CPU 0
Modules linked in: hidp rfcomm l2cap bluetooth ipv6 ip_gre iptable_filter 

iptable_nat ip_nat ip_conntrack nfnetlink iptable_mangle

ip_tables binfmt_misc iTCO_wdt i2c_i801 serio_raw
Pid: 2127, comm: imap Not tainted 2.6.18-rc2-mm1 #1

RIP: 0010:[<ffffffff80269e6f>]  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
RSP: 0000:ffffffff80635ff8  EFLAGS: 00010006
RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff880a3808
RDX: ffff81003d95c140 RSI: 0000000000000001 RDI: 0000000000000000
RBP: ffffffff806360f8 R08: 0000000000000000 R09: 0000000000000001
R10: ffffffff8029fae0 R11: 0000000000000000 R12: ffffffff827ffff9
R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff80907000
FS:  00002ab5ab544860(0000) GS:ffffffff808b2000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffff82800000 CR3: 0000000029dea000 CR4: 00000000000006e0
Process imap (pid: 2127, threadinfo ffff810029e62000, task ffff81003d95c140)
Stack:  000000000000000b ffffffff80636fc0 0000000080632fc0 0000000000000000
  ffffffff80907000 0000000000000000 0000000000000000 ffffffff827ffff9
  000000008025fa27 0000000000000001 0000000000000000 ffffffff8029fae0
Call Trace:
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff802601ed>] error_exit+0x0/0x96
DWARF2 unwinder stuck at error_exit+0x0/0x96
Leftover inexact backtrace:
  <IRQ> [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80269e7b>] show_trace+0x2cb/0x324
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff8029a627>] mark_held_locks+0x5d/0x96
  [<ffffffff8029a7e7>] trace_hardirqs_on+0xec/0x12c
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff80269ee9>] dump_stack+0x15/0x1c
  [<ffffffff8043d4e8>] skb_checksum_help+0x63/0x13b
  [<ffffffff8802f35f>] :iptable_nat:ip_nat_fn+0x5f/0x1d2
  [<ffffffff8802f71b>] :iptable_nat:ip_nat_local_fn+0x33/0xbc
  [<ffffffff80234c9e>] nf_iterate+0x5a/0x9b
  [<ffffffff804579a6>] dst_output+0x0/0x10
  [<ffffffff80258960>] nf_hook_slow+0x60/0xcd
  [<ffffffff804579a6>] dst_output+0x0/0x10
  [<ffffffff80265999>] _spin_unlock_irqrestore+0x3f/0x47
  [<ffffffff80235174>] ip_queue_xmit+0x444/0x4c0
  [<ffffffff8024bc5d>] tso_fragment+0x5d/0x20e
  [<ffffffff80210009>] __kmalloc_track_caller+0x109/0x11b
  [<ffffffff8022157f>] tcp_transmit_skb+0x68f/0x6cf
  [<ffffffff8024bda6>] tso_fragment+0x1a6/0x20e
  [<ffffffff80233b67>] __tcp_push_pending_frames+0x867/0x95a
  [<ffffffff80228ef8>] __kfree_skb+0xfc/0x101
  [<ffffffff80236fe1>] tcp_data_queue+0x651/0xc39
  [<ffffffff8021b9fc>] tcp_rcv_established+0x72c/0x7c4
  [<ffffffff8023c60e>] tcp_v4_do_rcv+0x2e/0x317
  [<ffffffff8022719c>] tcp_v4_rcv+0x9fc/0xa79
  [<ffffffff80258960>] nf_hook_slow+0x60/0xcd
  [<ffffffff804552b0>] ip_local_deliver_finish+0x0/0x1fb
  [<ffffffff80235389>] ip_local_deliver+0x199/0x270
  [<ffffffff802363c3>] ip_rcv+0x4d3/0x52b
  [<ffffffff80439ccc>] kfree_skb+0x2c/0x31
  [<ffffffff8021fdcb>] netif_receive_skb+0x1eb/0x27b
  [<ffffffff803c9491>] e1000_clean_rx_irq_ps+0x5c1/0x6a0
  [<ffffffff803c7b45>] e1000_clean+0x325/0x45b
  [<ffffffff8020c9b7>] net_rx_action+0x8e/0x147
  [<ffffffff8021164f>] __do_softirq+0x64/0x105
  [<ffffffff80211663>] __do_softirq+0x78/0x105
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff8026b679>] do_softirq+0x39/0xa4
  [<ffffffff802888b8>] irq_exit+0x58/0x5a
  [<ffffffff8026b798>] do_IRQ+0xb4/0xbe
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  <EOI><1>Unable to handle kernel paging request at ffffffff82800000 RIP:
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
PGD 203027 PUD 205027 PMD 0
Oops: 0000 [4] SMP
last sysfs file: /class/net/sit0/address
CPU 0
Modules linked in: hidp rfcomm l2cap bluetooth ipv6 ip_gre iptable_filter 

iptable_nat ip_nat ip_conntrack nfnetlink iptable_mangle

ip_tables binfmt_misc iTCO_wdt i2c_i801 serio_raw
Pid: 2127, comm: imap Not tainted 2.6.18-rc2-mm1 #1

RIP: 0010:[<ffffffff80269e6f>]  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
RSP: 0000:ffffffff80635c78  EFLAGS: 00010006
RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff880a3808
RDX: ffff81003d95c140 RSI: 0000000000000001 RDI: 0000000000000000
RBP: ffffffff80635d78 R08: 0000000000000000 R09: 0000000000000001
R10: ffffffff8029fae0 R11: 0000000000000000 R12: ffffffff827ffff9
R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff80907000
FS:  00002ab5ab544860(0000) GS:ffffffff808b2000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffff82800000 CR3: 0000000029dea000 CR4: 00000000000006e0
Process imap (pid: 2127, threadinfo ffff810029e62000, task ffff81003d95c140)
Stack:  000000000000000b ffffffff80636fc0 0000000080632fc0 0000000000000000
  ffffffff80907000 0000000000000000 0000000000000000 ffffffff827ffff9
  000000008025fa27 0000000000000001 0000000000000000 ffffffff8029fae0
Call Trace:
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff802601ed>] error_exit+0x0/0x96
DWARF2 unwinder stuck at error_exit+0x0/0x96
Leftover inexact backtrace:
  <IRQ> [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80269e7b>] show_trace+0x2cb/0x324
  [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff80285f9f>] vprintk+0x30f/0x35d
  [<ffffffff802a2f8a>] kallsyms_lookup+0xea/0x1b5
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80269e7b>] show_trace+0x2cb/0x324
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff8029a627>] mark_held_locks+0x5d/0x96
  [<ffffffff8029a7e7>] trace_hardirqs_on+0xec/0x12c
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff80269ee9>] dump_stack+0x15/0x1c
  [<ffffffff8043d4e8>] skb_checksum_help+0x63/0x13b
  [<ffffffff8802f35f>] :iptable_nat:ip_nat_fn+0x5f/0x1d2
  [<ffffffff8802f71b>] :iptable_nat:ip_nat_local_fn+0x33/0xbc
  [<ffffffff80234c9e>] nf_iterate+0x5a/0x9b
  [<ffffffff804579a6>] dst_output+0x0/0x10
  [<ffffffff80258960>] nf_hook_slow+0x60/0xcd
  [<ffffffff804579a6>] dst_output+0x0/0x10
  [<ffffffff80265999>] _spin_unlock_irqrestore+0x3f/0x47
  [<ffffffff80235174>] ip_queue_xmit+0x444/0x4c0
  [<ffffffff8024bc5d>] tso_fragment+0x5d/0x20e
  [<ffffffff80210009>] __kmalloc_track_caller+0x109/0x11b
  [<ffffffff8022157f>] tcp_transmit_skb+0x68f/0x6cf
  [<ffffffff8024bda6>] tso_fragment+0x1a6/0x20e
  [<ffffffff80233b67>] __tcp_push_pending_frames+0x867/0x95a
  [<ffffffff80228ef8>] __kfree_skb+0xfc/0x101
  [<ffffffff80236fe1>] tcp_data_queue+0x651/0xc39
  [<ffffffff8021b9fc>] tcp_rcv_established+0x72c/0x7c4
  [<ffffffff8023c60e>] tcp_v4_do_rcv+0x2e/0x317
  [<ffffffff8022719c>] tcp_v4_rcv+0x9fc/0xa79
  [<ffffffff80258960>] nf_hook_slow+0x60/0xcd
  [<ffffffff804552b0>] ip_local_deliver_finish+0x0/0x1fb
  [<ffffffff80235389>] ip_local_deliver+0x199/0x270
  [<ffffffff802363c3>] ip_rcv+0x4d3/0x52b
  [<ffffffff80439ccc>] kfree_skb+0x2c/0x31
  [<ffffffff8021fdcb>] netif_receive_skb+0x1eb/0x27b
  [<ffffffff803c9491>] e1000_clean_rx_irq_ps+0x5c1/0x6a0
  [<ffffffff803c7b45>] e1000_clean+0x325/0x45b
  [<ffffffff8020c9b7>] net_rx_action+0x8e/0x147
  [<ffffffff8021164f>] __do_softirq+0x64/0x105
  [<ffffffff80211663>] __do_softirq+0x78/0x105
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff8026b679>] do_softirq+0x39/0xa4
  [<ffffffff802888b8>] irq_exit+0x58/0x5a
  [<ffffffff8026b798>] do_IRQ+0xb4/0xbe
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  <EOI><1>Unable to handle kernel paging request at ffffffff82800000 RIP:
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
PGD 203027 PUD 205027 PMD 0
Oops: 0000 [5] SMP
last sysfs file: /class/net/sit0/address
CPU 0
Modules linked in: hidp rfcomm l2cap bluetooth ipv6 ip_gre iptable_filter 

iptable_nat ip_nat ip_conntrack nfnetlink iptable_mangle

ip_tables binfmt_misc iTCO_wdt i2c_i801 serio_raw
Pid: 2127, comm: imap Not tainted 2.6.18-rc2-mm1 #1

RIP: 0010:[<ffffffff80269e6f>]  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
RSP: 0000:ffffffff806358f8  EFLAGS: 00010006
RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff880a3808
RDX: ffff81003d95c140 RSI: 0000000000000001 RDI: 0000000000000000
RBP: ffffffff806359f8 R08: 0000000000000000 R09: 0000000000000001
R10: ffffffff8029fae0 R11: 0000000000000000 R12: ffffffff827ffff9
R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff80907000
FS:  00002ab5ab544860(0000) GS:ffffffff808b2000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffff82800000 CR3: 0000000029dea000 CR4: 00000000000006e0
Process imap (pid: 2127, threadinfo ffff810029e62000, task ffff81003d95c140)
Stack:  000000000000000b ffffffff80636fc0 0000000080632fc0 0000000000000000
  ffffffff80907000 0000000000000000 0000000000000000 ffffffff827ffff9
  000000008025fa27 0000000000000001 0000000000000000 ffffffff8029fae0
Call Trace:
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff802601ed>] error_exit+0x0/0x96
DWARF2 unwinder stuck at error_exit+0x0/0x96
Leftover inexact backtrace:
  <IRQ> [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80269e7b>] show_trace+0x2cb/0x324
  [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff80285f9f>] vprintk+0x30f/0x35d
  [<ffffffff8802f71b>] :iptable_nat:ip_nat_local_fn+0x33/0xbc
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80269e7b>] show_trace+0x2cb/0x324
  [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff80285f9f>] vprintk+0x30f/0x35d
  [<ffffffff802a2f8a>] kallsyms_lookup+0xea/0x1b5
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80269e7b>] show_trace+0x2cb/0x324
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff8029a627>] mark_held_locks+0x5d/0x96
  [<ffffffff8029a7e7>] trace_hardirqs_on+0xec/0x12c
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff80269ee9>] dump_stack+0x15/0x1c
  [<ffffffff8043d4e8>] skb_checksum_help+0x63/0x13b
  [<ffffffff8802f35f>] :iptable_nat:ip_nat_fn+0x5f/0x1d2
  [<ffffffff8802f71b>] :iptable_nat:ip_nat_local_fn+0x33/0xbc
  [<ffffffff80234c9e>] nf_iterate+0x5a/0x9b
  [<ffffffff804579a6>] dst_output+0x0/0x10
  [<ffffffff80258960>] nf_hook_slow+0x60/0xcd
  [<ffffffff804579a6>] dst_output+0x0/0x10
  [<ffffffff80265999>] _spin_unlock_irqrestore+0x3f/0x47
  [<ffffffff80235174>] ip_queue_xmit+0x444/0x4c0
  [<ffffffff8024bc5d>] tso_fragment+0x5d/0x20e
  [<ffffffff80210009>] __kmalloc_track_caller+0x109/0x11b
  [<ffffffff8022157f>] tcp_transmit_skb+0x68f/0x6cf
  [<ffffffff8024bda6>] tso_fragment+0x1a6/0x20e
  [<ffffffff80233b67>] __tcp_push_pending_frames+0x867/0x95a
  [<ffffffff80228ef8>] __kfree_skb+0xfc/0x101
  [<ffffffff80236fe1>] tcp_data_queue+0x651/0xc39
  [<ffffffff8021b9fc>] tcp_rcv_established+0x72c/0x7c4
  [<ffffffff8023c60e>] tcp_v4_do_rcv+0x2e/0x317
  [<ffffffff8022719c>] tcp_v4_rcv+0x9fc/0xa79
  [<ffffffff80258960>] nf_hook_slow+0x60/0xcd
  [<ffffffff804552b0>] ip_local_deliver_finish+0x0/0x1fb
  [<ffffffff80235389>] ip_local_deliver+0x199/0x270
  [<ffffffff802363c3>] ip_rcv+0x4d3/0x52b
  [<ffffffff80439ccc>] kfree_skb+0x2c/0x31
  [<ffffffff8021fdcb>] netif_receive_skb+0x1eb/0x27b
  [<ffffffff803c9491>] e1000_clean_rx_irq_ps+0x5c1/0x6a0
  [<ffffffff803c7b45>] e1000_clean+0x325/0x45b
  [<ffffffff8020c9b7>] net_rx_action+0x8e/0x147
  [<ffffffff8021164f>] __do_softirq+0x64/0x105
  [<ffffffff80211663>] __do_softirq+0x78/0x105
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff8026b679>] do_softirq+0x39/0xa4
  [<ffffffff802888b8>] irq_exit+0x58/0x5a
  [<ffffffff8026b798>] do_IRQ+0xb4/0xbe
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  <EOI><1>Unable to handle kernel paging request at ffffffff82800000 RIP:
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
PGD 203027 PUD 205027 PMD 0
Oops: 0000 [6] SMP
last sysfs file: /class/net/sit0/address
CPU 0
Modules linked in: hidp rfcomm l2cap bluetooth ipv6 ip_gre iptable_filter 

iptable_nat ip_nat ip_conntrack nfnetlink iptable_mangle

ip_tables binfmt_misc iTCO_wdt i2c_i801 serio_raw
Pid: 2127, comm: imap Not tainted 2.6.18-rc2-mm1 #1

RIP: 0010:[<ffffffff80269e6f>]  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
RSP: 0000:ffffffff80635578  EFLAGS: 00010006
RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff880a3808
RDX: ffff81003d95c140 RSI: 0000000000000001 RDI: 0000000000000000
RBP: ffffffff80635678 R08: 0000000000000000 R09: 0000000000000001
R10: ffffffff8029fae0 R11: 0000000000000000 R12: ffffffff827ffff9
R13: 0000000000000000 R14: 0000000000000000 R15: ffffffff80907000
FS:  00002ab5ab544860(0000) GS:ffffffff808b2000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffff82800000 CR3: 0000000029dea000 CR4: 00000000000006e0
Process imap (pid: 2127, threadinfo ffff810029e62000, task ffff81003d95c140)
Stack:  000000000000000b ffffffff80636fc0 0000000080632fc0 0000000000000000
  ffffffff80907000 0000000000000000 0000000000000000 ffffffff827ffff9
  000000008025fa27 0000000000000001 0000000000000000 ffffffff8029fae0
Call Trace:
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff802601ed>] error_exit+0x0/0x96
DWARF2 unwinder stuck at error_exit+0x0/0x96
Leftover inexact backtrace:
  <IRQ> [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80269e7b>] show_trace+0x2cb/0x324
  [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff80285f9f>] vprintk+0x30f/0x35d
  [<ffffffff8802f71b>] :iptable_nat:ip_nat_local_fn+0x33/0xbc
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80269e7b>] show_trace+0x2cb/0x324
  [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff80285f9f>] vprintk+0x30f/0x35d
  [<ffffffff8802f71b>] :iptable_nat:ip_nat_local_fn+0x33/0xbc
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80269e7b>] show_trace+0x2cb/0x324
  [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff80285f9f>] vprintk+0x30f/0x35d
  [<ffffffff802a2f8a>] kallsyms_lookup+0xea/0x1b5
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff8029fae0>] module_text_address+0x16/0x46
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80269e7b>] show_trace+0x2cb/0x324
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff80269fdf>] _show_stack+0xef/0xfe
  [<ffffffff8026a07a>] show_registers+0x8c/0x101
  [<ffffffff8026a18f>] __die+0xa0/0xe3
  [<ffffffff8020af95>] do_page_fault+0x785/0x89d
  [<ffffffff8029a627>] mark_held_locks+0x5d/0x96
  [<ffffffff8029a7e7>] trace_hardirqs_on+0xec/0x12c
  [<ffffffff802601ed>] error_exit+0x0/0x96
  [<ffffffff80269e6f>] show_trace+0x2bf/0x324
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff80269ee9>] dump_stack+0x15/0x1c
  [<ffffffff8043d4e8>] skb_checksum_help+0x63/0x13b
  [<ffffffff8802f35f>] :iptable_nat:ip_nat_fn+0x5f/0x1d2
  [<ffffffff8802f71b>] :iptable_nat:ip_nat_local_fn+0x33/0xbc
  [<ffffffff80234c9e>] nf_iterate+0x5a/0x9b
  [<ffffffff804579a6>] dst_output+0x0/0x10
  [<ffffffff80258960>] nf_hook_slow+0x60/0xcd
  [<ffffffff804579a6>] dst_output+0x0/0x10
  [<ffffffff80265999>] _spin_unlock_irqrestore+0x3f/0x47
  [<ffffffff80235174>] ip_queue_xmit+0x444/0x4c0
  [<ffffffff8024bc5d>] tso_fragment+0x5d/0x20e
  [<ffffffff80210009>] __kmalloc_track_caller+0x109/0x11b
  [<ffffffff8022157f>] tcp_transmit_skb+0x68f/0x6cf
  [<ffffffff8024bda6>] tso_fragment+0x1a6/0x20e
  [<ffffffff80233b67>] __tcp_push_pending_frames+0x867/0x95a
  [<ffffffff80228ef8>] __kfree_skb+0xfc/0x101
  [<ffffffff80236fe1>] tcp_data_queue+0x651/0xc39
  [<ffffffff8021b9fc>] tcp_rcv_established+0x72c/0x7c4
  [<ffffffff8023c60e>] tcp_v4_do_rcv+0x2e/0x317
  [<ffffffff8022719c>] tcp_v4_rcv+0x9fc/0xa79
  [<ffffffff80258960>] nf_hook_slow+0x60/0xcd
  [<ffffffff804552b0>] ip_local_deliver_finish+0x0/0x1fb
  [<ffffffff80235389>] ip_local_deliver+0x199/0x270
  [<ffffffff802363c3>] ip_rcv+0x4d3/0x52b
  [<ffffffff80439ccc>] kfree_skb+0x2c/0x31
  [<ffffffff8021fdcb>] netif_receive_skb+0x1eb/0x27b
  [<ffffffff803c9491>] e1000_clean_rx_irq_ps+0x5c1/0x6a0
  [<ffffffff803c7b45>] e1000_clean+0x325/0x45b
  [<ffffffff8020c9b7>] net_rx_action+0x8e/0x147
  [<ffffffff8021164f>] __do_softirq+0x64/0x105
  [<ffffffff80211663>] __do_softirq+0x78/0x105
  [<ffffffff80260716>] call_softirq+0x1e/0x28
  [<ffffffff8026b679>] do_softirq+0x39/0xa4
  [<ffffffff802888b8>] irq_exit+0x58/0x5a
  [<ffffffff8026b798>] do_IRQ+0xb4/0xbe
  [<ffffffff8025f9a1>] ret_from_intr+0x0/0xf
  <EOI>

Thanks,
Reuben

#2 lore raw
Quoted 11 lines · Jan Beulich
Quoted 4 lines
Quoted 1 line
Quoted 1 line

Andrew Morton <[email protected]> 28.07.06 10:19 >>>

More unwinder problems. Seems to be specific to -mm. (Followups on-list are preferred, thanks).

That's another of the lose ends - while Andi and I had decided to put a proper stack frame in place for the switch to the irq stack in the interrupt macro, we had forgotten about doing something similar for call_softirq() - as the code is written currently, there simply is now way of annotating the code properly. If Andi is agreeable to this, then I'll just change the code so that it'll have a proper stack frame.

Fine by me. I'll just fix it up.

Quoted 11 lines

The recursive traces appear to result from the fact that when we did the change to the interrupt macro, we neglected the fact that show_trace() expects to find the old stack pointer as the very first item on the interrupt stack, which isn't the case anymore. The value of where the subsequent stack access fails is a little strange, though. Making this assumption be true again would, however, require adding a push to both the interrupt macro and call_softirq. I'm afraid Andi's not going to be too happy about that, but on the other hand I can't see any other possible way that would get away without adding some code to these paths.

I can just add the push.

-Andi