Skip to contentSkip to conversation

mm snapshot broken-out-2006-08-08-00-59.tar.gz uploaded

DISCUSSION Michal Piotrowski 5 participants 18 messages Aug 8, 2006 – Aug 10, 2006 1 message not in the archive Memory management

lore
Share & tools
lore

A message that is not in the archive (sent off-list or not yet received): [email protected]

#1 lore raw

Hi Andrew,

Quoted 5 lines · On 08/08/06, [email protected] <[email protected]> wrote:

The mm snapshot broken-out-2006-08-08-00-59.tar.gz has been uploaded to

   ftp://ftp.kernel.org/pub/linux/kernel/people/akpm/mm/broken-out-2006-08-08-00-59.tar.gz

It contains the following patches against 2.6.18-rc4:

It appears very early. 2.6.18-rc3-mm2 was fine.

DWARF2 unwinder stuck at error_code+0x39/0x40
Leftover inexact backtrace

[<c0104194>] show_stack_log_lvl+0x8c/0x97
[<c0104320>] show_registers+0x181/0x215
[<c0104576>] die+0x1c2/0x2dd
[<c0117419>] do_page_fault+ox410/0x4f3
[<c02f5271>] error_code+0x39/0x40
[<c0104194>] show_stack_log_lvl+0x8c/0x97
[<c0104320>] show_registers+0x181/0x215
[<c0104576>] die+0x1c2/0x2dd
[<c0117419>] do_page_fault+0x410/0x4f3
[<c02f5271>] error_code+0x39/0x40
[<c047b609>] start_kernel+0x224/0x3a2
[<c0100210>] 0xc0100210
Code: 00 39 .......
EIP:[<c01040ca>] show_trace_log_lvl+0x11b/0x159 SS:ESP 0068:c0479e74

<0> Kernel panic - not syncing: Attempted to kill idle task!

http://www.stardust.webpages.pl/files/mm/2.6.18-rc4-mm1/mm-config

Regards,
Michal

Signature · 3 lines
Michal K. K. Piotrowski
LTG - Linux Testers Group
(http://www.stardust.webpages.pl/ltg/wiki/)
#2 lore raw
Quoted 5 lines · On Tue, 8 Aug 2006 22:29:03 +0200 "Michal Piotrowski"…

Hi Andrew,

Quoted 2 lines · On 08/08/06, [email protected] <[email protected]> wrote:

The mm snapshot broken-out-2006-08-08-00-59.tar.gz has been uploaded to

Quoted 7 lines
Quoted 3 lines
   ftp://ftp.kernel.org/pub/linux/kernel/people/akpm/mm/broken-out-2006-08-08-00-59.tar.gz

It contains the following patches against 2.6.18-rc4:

It appears very early. 2.6.18-rc3-mm2 was fine.

DWARF2 unwinder stuck at error_code+0x39/0x40

The novelty of this thing has worn off. Guys, please let's not release 2.6.18 in this state.

Quoted 15 lines

Leftover inexact backtrace

[<c0104194>] show_stack_log_lvl+0x8c/0x97
[<c0104320>] show_registers+0x181/0x215
[<c0104576>] die+0x1c2/0x2dd
[<c0117419>] do_page_fault+ox410/0x4f3
[<c02f5271>] error_code+0x39/0x40
[<c0104194>] show_stack_log_lvl+0x8c/0x97
[<c0104320>] show_registers+0x181/0x215
[<c0104576>] die+0x1c2/0x2dd
[<c0117419>] do_page_fault+0x410/0x4f3
[<c02f5271>] error_code+0x39/0x40
[<c047b609>] start_kernel+0x224/0x3a2
[<c0100210>] 0xc0100210
Code: 00 39 .......
EIP:[<c01040ca>] show_trace_log_lvl+0x11b/0x159 SS:ESP 0068:c0479e74
Quoted 4 lines

<0> Kernel panic - not syncing: Attempted to kill idle task!

http://www.stardust.webpages.pl/files/mm/2.6.18-rc4-mm1/mm-config

So I guess the dwarf unwinder oopsed and wrecked our oops. Perhaps you'll get better info with CONFIG_UNWIND_INFO=n, CONFIG_STACK_UNWIND=n.

Now, _perhaps_ it oopsed at "[<c047b609>] start_kernel+0x224/0x3a2". You can look these things up in gdb or using addr2line, provided you have CONFIG_DEBUG_INFO=y.

#3 lore raw
Quoted 36 lines · Andrew Morton
Quoted 5 lines · On Tue, 8 Aug 2006 22:29:03 +0200 "Michal Piotrowski"…

Hi Andrew,

Quoted 2 lines · On 08/08/06, [email protected] <[email protected]> wrote:

The mm snapshot broken-out-2006-08-08-00-59.tar.gz has been uploaded to

Quoted 7 lines
Quoted 3 lines
   ftp://ftp.kernel.org/pub/linux/kernel/people/akpm/mm/broken-out-2006-08-08-00-59.tar.gz

It contains the following patches against 2.6.18-rc4:

It appears very early. 2.6.18-rc3-mm2 was fine.

DWARF2 unwinder stuck at error_code+0x39/0x40

The novelty of this thing has worn off. Guys, please let's not release 2.6.18 in this state.

Quoted 17 lines

Leftover inexact backtrace

[<c0104194>] show_stack_log_lvl+0x8c/0x97
[<c0104320>] show_registers+0x181/0x215
[<c0104576>] die+0x1c2/0x2dd
[<c0117419>] do_page_fault+ox410/0x4f3
[<c02f5271>] error_code+0x39/0x40
[<c0104194>] show_stack_log_lvl+0x8c/0x97
[<c0104320>] show_registers+0x181/0x215
[<c0104576>] die+0x1c2/0x2dd
[<c0117419>] do_page_fault+0x410/0x4f3
[<c02f5271>] error_code+0x39/0x40
[<c047b609>] start_kernel+0x224/0x3a2
[<c0100210>] 0xc0100210
Code: 00 39 .......
EIP:[<c01040ca>] show_trace_log_lvl+0x11b/0x159 SS:ESP 0068:c0479e74

<0> Kernel panic - not syncing: Attempted to kill idle task!

Quoted 7 lines
Quoted 2 lines

http://www.stardust.webpages.pl/files/mm/2.6.18-rc4-mm1/mm-config

So I guess the dwarf unwinder oopsed and wrecked our oops. Perhaps you'll get better info with CONFIG_UNWIND_INFO=n, CONFIG_STACK_UNWIND=n.

Now, _perhaps_ it oopsed at "[<c047b609>] start_kernel+0x224/0x3a2".

eghm... typo.
[<c047d609>]

Quoted 5 lines

You
can look these things up in gdb or using addr2line, provided you have CONFIG_DEBUG_INFO=y.

(gdb) list *0xc047d609
0xc047d609 is in start_kernel (/usr/src/linux-work1/init/main.c:577).

572             cpuset_init_early();
573             mem_init();
574             kmem_cache_init();
575             setup_per_cpu_pageset();
576             numa_policy_init();
577             if (late_time_init)
578                     late_time_init();
579             calibrate_delay();
580             pidmap_init();
581             pgtable_cache_init();

Regards,
Michal

Signature · 3 lines
Michal K. K. Piotrowski
LTG - Linux Testers Group
(http://www.stardust.webpages.pl/ltg/wiki/)
#4 lore raw
Quoted 8 lines · On Tue, 8 Aug 2006 23:19:09 +0200 "Michal Piotrowski"…
Quoted 5 lines

You
can look these things up in gdb or using addr2line, provided you have CONFIG_DEBUG_INFO=y.

(gdb) list *0xc047d609
0xc047d609 is in start_kernel (/usr/src/linux-work1/init/main.c:577).

Quoted 10 lines
572             cpuset_init_early();
573             mem_init();
574             kmem_cache_init();
575             setup_per_cpu_pageset();
576             numa_policy_init();
577             if (late_time_init)
578                     late_time_init();
579             calibrate_delay();
580             pidmap_init();
581             pgtable_cache_init();

hm.

- Try to get the full oops record, find out what the faulting address is ("unable to handle kernel paging request at virtual address xxxx") and see if that lines up with any symbol in .vmlinux.

- Might be something bad in numa_policy_init(). I assume you don't have CONFIG_NUMA=y ;)

This'll be hard to diagnose without a full oops trace.

#5 lore raw
Quoted 22 lines · Andrew Morton
Quoted 8 lines · On Tue, 8 Aug 2006 23:19:09 +0200 "Michal Piotrowski"…
Quoted 5 lines

You
can look these things up in gdb or using addr2line, provided you have CONFIG_DEBUG_INFO=y.

(gdb) list *0xc047d609
0xc047d609 is in start_kernel (/usr/src/linux-work1/init/main.c:577).

Quoted 10 lines
572             cpuset_init_early();
573             mem_init();
574             kmem_cache_init();
575             setup_per_cpu_pageset();
576             numa_policy_init();
577             if (late_time_init)
578                     late_time_init();
579             calibrate_delay();
580             pidmap_init();
581             pgtable_cache_init();
Quoted 3 lines

hm.

- Try to get the full oops record,

BUG: unable to handle kernel paging request at virtual address 01020304
printing eip:
c041b95c
*pde= 00000000
Oops: 0000 [#1]
4K_STACK PREEMPT SMP
last sysfs file:
Modules linked in:

CPU 0
EIP: 0060: [<c041b95c>] Not tainted VLI
EFLAGS: 00010202
EIP is at kmem_cache_init+0x389/0x3f0
[..]

Call Trace:
[<c0104063>] show_stack_log_lvl+0x8c/0x97
[<c010422b>] show_registers+0x181/0x215
[<c0104481>] die+0x1c2/0x2dd
[<c0117419>] do_page_fault+0x410/0x4f3
[<c02f40a1>] error_code+0x39/0x40
[<c040b604>] start_kernel+0x21f/0x39d

[<c0100210>] 0xc0100210
[..]
EIP: [<c041b95c>] kmem_cache_init+0x389/0x3f0 SS:ESP0068:c0409fc4 <0> Kernel panic - not syncing: Attempted to kill idle task!

(gdb) list *0xc041b95c
0xc041b95c is in kmem_cache_init (/usr/src/linux-work1/mm/slab.c:714).
709 lockdep_set_class(&l3->list_lock,
&on_slab_l3_key);
710 alc = l3->alien;
711 if (!alc)
712 continue;
713 for_each_node(r) {
714 if (alc[r])
715 lockdep_set_class(&alc[r]->lock,
716 &on_slab_alc_key);
717 }
718 }

Quoted 3 lines

find out what the faulting address is
("unable to handle kernel paging request at virtual address xxxx") and see if that lines up with any symbol in .vmlinux.

Did you mean "list 01020304"?

Quoted 3 lines

- Might be something bad in numa_policy_init(). I assume you don't have CONFIG_NUMA=y ;)

No, I don't.

Quoted 4 lines

This'll be hard to diagnose without a full oops trace.

Regards,
Michal

Signature · 3 lines
Michal K. K. Piotrowski
LTG - Linux Testers Group
(http://www.stardust.webpages.pl/ltg/wiki/)
#6 lore raw
Quoted 52 lines · Michal Piotrowski
Quoted 22 lines · Andrew Morton
Quoted 8 lines · On Tue, 8 Aug 2006 23:19:09 +0200 "Michal Piotrowski"…
Quoted 5 lines

You
can look these things up in gdb or using addr2line, provided you have CONFIG_DEBUG_INFO=y.

(gdb) list *0xc047d609
0xc047d609 is in start_kernel (/usr/src/linux-work1/init/main.c:577).

Quoted 10 lines
572             cpuset_init_early();
573             mem_init();
574             kmem_cache_init();
575             setup_per_cpu_pageset();
576             numa_policy_init();
577             if (late_time_init)
578                     late_time_init();
579             calibrate_delay();
580             pidmap_init();
581             pgtable_cache_init();
Quoted 3 lines

hm.

- Try to get the full oops record,

BUG: unable to handle kernel paging request at virtual address 01020304
printing eip:
c041b95c
*pde= 00000000
Oops: 0000 [#1]
4K_STACK PREEMPT SMP
last sysfs file:
Modules linked in:

CPU 0
EIP: 0060: [<c041b95c>] Not tainted VLI
EFLAGS: 00010202
EIP is at kmem_cache_init+0x389/0x3f0
[..]

Call Trace:
[<c0104063>] show_stack_log_lvl+0x8c/0x97
[<c010422b>] show_registers+0x181/0x215
[<c0104481>] die+0x1c2/0x2dd
[<c0117419>] do_page_fault+0x410/0x4f3
[<c02f40a1>] error_code+0x39/0x40
[<c040b604>] start_kernel+0x21f/0x39d

[<c0100210>] 0xc0100210
[..]
EIP: [<c041b95c>] kmem_cache_init+0x389/0x3f0 SS:ESP0068:c0409fc4 <0> Kernel panic - not syncing: Attempted to kill idle task!

Quoted 14 lines

(gdb) list *0xc041b95c
0xc041b95c is in kmem_cache_init (/usr/src/linux-work1/mm/slab.c:714).
709 lockdep_set_class(&l3->list_lock,
&on_slab_l3_key);
710 alc = l3->alien;
711 if (!alc)
712 continue;
713 for_each_node(r) {
714 if (alc[r])
715 lockdep_set_class(&alc[r]->lock,
716 &on_slab_alc_key);
717 }
718 }

System works well without this patches slab-cache-shrinker-statistics.patch slab-fix-lockdep-warnings.patch slab-optimize-kmalloc_node-the-same-way-as-kmalloc-fix.patch slab-optimize-kmalloc_node-the-same-way-as-kmalloc.patch slab-respect-architecture-and-caller-mandated-alignment.patch

Regards,
Michal

Signature · 3 lines
Michal K. K. Piotrowski
LTG - Linux Testers Group
(http://www.stardust.webpages.pl/ltg/wiki/)
#7 lore raw
In reply to Michal Piotrowski
Quoted 52 lines · On Wed, 9 Aug 2006 00:11:38 +0200 "Michal Piotrowski"…
Quoted 22 lines · Andrew Morton
Quoted 8 lines · On Tue, 8 Aug 2006 23:19:09 +0200 "Michal Piotrowski"…
Quoted 5 lines

You
can look these things up in gdb or using addr2line, provided you have CONFIG_DEBUG_INFO=y.

(gdb) list *0xc047d609
0xc047d609 is in start_kernel (/usr/src/linux-work1/init/main.c:577).

Quoted 10 lines
572             cpuset_init_early();
573             mem_init();
574             kmem_cache_init();
575             setup_per_cpu_pageset();
576             numa_policy_init();
577             if (late_time_init)
578                     late_time_init();
579             calibrate_delay();
580             pidmap_init();
581             pgtable_cache_init();
Quoted 3 lines

hm.

- Try to get the full oops record,

BUG: unable to handle kernel paging request at virtual address 01020304
printing eip:
c041b95c
*pde= 00000000
Oops: 0000 [#1]
4K_STACK PREEMPT SMP
last sysfs file:
Modules linked in:

CPU 0
EIP: 0060: [<c041b95c>] Not tainted VLI
EFLAGS: 00010202
EIP is at kmem_cache_init+0x389/0x3f0
[..]

Call Trace:
[<c0104063>] show_stack_log_lvl+0x8c/0x97
[<c010422b>] show_registers+0x181/0x215
[<c0104481>] die+0x1c2/0x2dd
[<c0117419>] do_page_fault+0x410/0x4f3
[<c02f40a1>] error_code+0x39/0x40
[<c040b604>] start_kernel+0x21f/0x39d

[<c0100210>] 0xc0100210
[..]
EIP: [<c041b95c>] kmem_cache_init+0x389/0x3f0 SS:ESP0068:c0409fc4 <0> Kernel panic - not syncing: Attempted to kill idle task!

Quoted 13 lines

(gdb) list *0xc041b95c
0xc041b95c is in kmem_cache_init (/usr/src/linux-work1/mm/slab.c:714).
709 lockdep_set_class(&l3->list_lock,
&on_slab_l3_key);
710 alc = l3->alien;
711 if (!alc)
712 continue;
713 for_each_node(r) {
714 if (alc[r])
715 lockdep_set_class(&alc[r]->lock,
716 &on_slab_alc_key);
717 }
718 }

ah-hah, thanks. The oopsing statement was added by slab-fix-lockdep-warnings.patch.

I guess we can fix this by whacking another #ifdef CONFIG_NUMA in there but I don't think that's how we want to address this.

We've been moving towards making the NUMA slab code work OK in a non-NUMA build by setting the NUMA-specific fields to NULL and simply blowing a few cycles at runtime to avoid many tens of ifdefs (it's that bad).

Here, we should have had either l3==NULL or l3->alien==NULL, but that has been violated, hence the crash.

Kiran, could you take a look please? The 0x01020304 is interesting...

#8 lore raw
Quoted 69 lines · Andrew Morton
Quoted 52 lines · On Wed, 9 Aug 2006 00:11:38 +0200 "Michal Piotrowski"…
Quoted 22 lines · Andrew Morton
Quoted 8 lines · On Tue, 8 Aug 2006 23:19:09 +0200 "Michal Piotrowski"…
Quoted 5 lines

You
can look these things up in gdb or using addr2line, provided you have CONFIG_DEBUG_INFO=y.

(gdb) list *0xc047d609
0xc047d609 is in start_kernel (/usr/src/linux-work1/init/main.c:577).

Quoted 10 lines
572             cpuset_init_early();
573             mem_init();
574             kmem_cache_init();
575             setup_per_cpu_pageset();
576             numa_policy_init();
577             if (late_time_init)
578                     late_time_init();
579             calibrate_delay();
580             pidmap_init();
581             pgtable_cache_init();
Quoted 3 lines

hm.

- Try to get the full oops record,

BUG: unable to handle kernel paging request at virtual address 01020304
printing eip:
c041b95c
*pde= 00000000
Oops: 0000 [#1]
4K_STACK PREEMPT SMP
last sysfs file:
Modules linked in:

CPU 0
EIP: 0060: [<c041b95c>] Not tainted VLI
EFLAGS: 00010202
EIP is at kmem_cache_init+0x389/0x3f0
[..]

Call Trace:
[<c0104063>] show_stack_log_lvl+0x8c/0x97
[<c010422b>] show_registers+0x181/0x215
[<c0104481>] die+0x1c2/0x2dd
[<c0117419>] do_page_fault+0x410/0x4f3
[<c02f40a1>] error_code+0x39/0x40
[<c040b604>] start_kernel+0x21f/0x39d

[<c0100210>] 0xc0100210
[..]
EIP: [<c041b95c>] kmem_cache_init+0x389/0x3f0 SS:ESP0068:c0409fc4 <0> Kernel panic - not syncing: Attempted to kill idle task!

Quoted 13 lines

(gdb) list *0xc041b95c
0xc041b95c is in kmem_cache_init (/usr/src/linux-work1/mm/slab.c:714).
709 lockdep_set_class(&l3->list_lock,
&on_slab_l3_key);
710 alc = l3->alien;
711 if (!alc)
712 continue;
713 for_each_node(r) {
714 if (alc[r])
715 lockdep_set_class(&alc[r]->lock,
716 &on_slab_alc_key);
717 }
718 }

Quoted 2 lines

ah-hah, thanks. The oopsing statement was added by slab-fix-lockdep-warnings.patch.

Confirmed.

Regards,
Michal

Signature · 3 lines
Michal K. K. Piotrowski
LTG - Linux Testers Group
(http://www.stardust.webpages.pl/ltg/wiki/)
#9 lore raw
In reply to Andrew Morton
Quoted 9 lines · Andrew Morton

On Wed, 9 Aug 2006 00:11:38 +0200
"Michal Piotrowski" <[email protected]> wrote:

ah-hah, thanks. The oopsing statement was added by slab-fix-lockdep-warnings.patch.

I guess we can fix this by whacking another #ifdef CONFIG_NUMA in there but I don't think that's how we want to address this.

Quoted 7 lines

We've been moving towards making the NUMA slab code work OK in a non-NUMA build by setting the NUMA-specific fields to NULL and simply blowing a few cycles at runtime to avoid many tens of ifdefs (it's that bad).

Here, we should have had either l3==NULL or l3->alien==NULL, but that has been violated, hence the crash.
Kiran, could you take a look please? The 0x01020304 is interesting...

Eeesh, because on SMP, alloc_alien_cache returns 0x01020304 instead of NULL, And it returns 0x01020304 because CPU_UP_PREPARE fails if alloc_alien_cache returns NULL. NUMA and non NUMA slab should be able to work even without alien caches, currently that doesn't seem to be the case. We are working on that. In the meanwhile, the following patch should fix the oops due to locdep annotation.

Thanks,
Kiran

Fix oops due to alien cache locdep annotation on non NUMA configurations. A plain alien != NULL won't work as l3->alien is initialized with 0x01020304ul

mm/slab.c +11 -2
Index: linux-2.6.18-rc3mm3/mm/slab.c
===================================================================
@@ -674,6 +674,8 @@ static struct kmem_cache cache_cache = {
 #endif
 };
 
+#define BAD_ALIEN_MAGIC 0x01020304ul
+
 #ifdef CONFIG_LOCKDEP
 
 /*
@@ -705,7 +707,14 @@ static inline void init_lock_keys(void)
 				continue;
 			lockdep_set_class(&l3->list_lock, &on_slab_l3_key);
 			alc = l3->alien;
-			if (!alc)
+			/*
+			 * FIXME: This check for BAD_ALIEN_MAGIC
+			 * should go away when common slab code is taught to 
+			 * work even without alien caches.  
+			 * Currently, non NUMA code returns BAD_ALIEN_MAGIC
+			 * for alloc_alien_cache,
+			 */
+			if (!alc || (unsigned long) alc == BAD_ALIEN_MAGIC)
 				continue;
 			for_each_node(r) {
 				if (alc[r])
@@ -1112,7 +1121,7 @@ static inline int cache_free_alien(struc
 
 static inline struct array_cache **alloc_alien_cache(int node, int limit)
 {
-	return (struct array_cache **) 0x01020304ul;
+	return (struct array_cache **) BAD_ALIEN_MAGIC;
 }
 
 static inline void free_alien_cache(struct array_cache **ac_ptr)
#10 lore raw

Hi,

Quoted 25 lines · Ravikiran G Thirumalai
Quoted 9 lines · Andrew Morton

On Wed, 9 Aug 2006 00:11:38 +0200
"Michal Piotrowski" <[email protected]> wrote:

ah-hah, thanks. The oopsing statement was added by slab-fix-lockdep-warnings.patch.

I guess we can fix this by whacking another #ifdef CONFIG_NUMA in there but I don't think that's how we want to address this.

Quoted 7 lines

We've been moving towards making the NUMA slab code work OK in a non-NUMA build by setting the NUMA-specific fields to NULL and simply blowing a few cycles at runtime to avoid many tens of ifdefs (it's that bad).

Here, we should have had either l3==NULL or l3->alien==NULL, but that has been violated, hence the crash.
Kiran, could you take a look please? The 0x01020304 is interesting...

Eeesh, because on SMP, alloc_alien_cache returns 0x01020304 instead of NULL, And it returns 0x01020304 because CPU_UP_PREPARE fails if alloc_alien_cache returns NULL. NUMA and non NUMA slab should be able to work even without alien caches, currently that doesn't seem to be the case. We are working on that. In the meanwhile, the following patch should fix the oops due to locdep annotation.

Quoted 6 lines

Thanks,
Kiran

Fix oops due to alien cache locdep annotation on non NUMA configurations. A plain alien != NULL won't work as l3->alien is initialized with 0x01020304ul

Bug fixed, thanks.

Regards,
Michal

Signature · 3 lines
Michal K. K. Piotrowski
LTG - Linux Testers Group
(http://www.stardust.webpages.pl/ltg/wiki/)
#11 lore raw
In reply to Michal Piotrowski
Quoted 35 lines · Michal Piotrowski
Quoted 22 lines · Andrew Morton
Quoted 8 lines · On Tue, 8 Aug 2006 23:19:09 +0200 "Michal Piotrowski"…
Quoted 5 lines

You
can look these things up in gdb or using addr2line, provided you have CONFIG_DEBUG_INFO=y.

(gdb) list *0xc047d609
0xc047d609 is in start_kernel (/usr/src/linux-work1/init/main.c:577).

Quoted 10 lines
572             cpuset_init_early();
573             mem_init();
574             kmem_cache_init();
575             setup_per_cpu_pageset();
576             numa_policy_init();
577             if (late_time_init)
578                     late_time_init();
579             calibrate_delay();
580             pidmap_init();
581             pgtable_cache_init();
Quoted 3 lines

hm.

- Try to get the full oops record,

BUG: unable to handle kernel paging request at virtual address 01020304
printing eip:
c041b95c
*pde= 00000000
Oops: 0000 [#1]
4K_STACK PREEMPT SMP
last sysfs file:
Modules linked in:
Quoted 4 lines

CPU 0
EIP: 0060: [<c041b95c>] Not tainted VLI
EFLAGS: 00010202
EIP is at kmem_cache_init+0x389/0x3f0

Well it didn't crash in the unwinder.

Quoted 1 line

[..]

And that [..] isn't a unwinder problem, but a human operator error. Michal, you removed the valuable part of the backtrace.

-AndI

Quoted 8 lines
Call Trace:
[<c0104063>] show_stack_log_lvl+0x8c/0x97
[<c010422b>] show_registers+0x181/0x215
[<c0104481>] die+0x1c2/0x2dd
[<c0117419>] do_page_fault+0x410/0x4f3
[<c02f40a1>] error_code+0x39/0x40
[<c040b604>] start_kernel+0x21f/0x39d

[<c0100210>] 0xc0100210

#12 lore raw
Quoted 14 lines · Andi Kleen
Quoted 8 lines · Michal Piotrowski
BUG: unable to handle kernel paging request at virtual address 01020304
printing eip:
c041b95c
*pde= 00000000
Oops: 0000 [#1]
4K_STACK PREEMPT SMP
last sysfs file:
Modules linked in:
Quoted 4 lines

CPU 0
EIP: 0060: [<c041b95c>] Not tainted VLI
EFLAGS: 00010202
EIP is at kmem_cache_init+0x389/0x3f0

Quoted 5 lines

Well it didn't crash in the unwinder.

Quoted 1 line

[..]

And that [..] isn't a unwinder problem, but a human operator error. Michal, you removed the valuable part of the backtrace.

No, I didn't. I haven't seen that oops. I don't have a serial console, and the system hangs very early.

Quoted 3 lines

-AndI

Regards,
Michal

Signature · 3 lines
Michal K. K. Piotrowski
LTG - Linux Testers Group
(http://www.stardust.webpages.pl/ltg/wiki/)
#13 lore raw
In reply to Andrew Morton
Quoted 10 lines · Andrew Morton
Quoted 7 lines · On Tue, 8 Aug 2006 22:29:03 +0200 "Michal Piotrowski"…

Hi Andrew,

Quoted 4 lines · On 08/08/06, [email protected] <[email protected]> wrote:

The mm snapshot broken-out-2006-08-08-00-59.tar.gz has been uploaded to

   ftp://ftp.kernel.org/pub/linux/kernel/people/akpm/mm/broken-out-2006-08-08-00-59.tar.gz
Quoted 8 lines
Quoted 5 lines
Quoted 1 line

It contains the following patches against 2.6.18-rc4:

It appears very early. 2.6.18-rc3-mm2 was fine.

DWARF2 unwinder stuck at error_code+0x39/0x40

The novelty of this thing has worn off. Guys, please let's not release 2.6.18 in this state.

The stucks are harmless (and currently expected) as long as the dwarf2 trace and the leftover trace give you a full picture and the unwinder doesn't crash (the later would be a bug that needs to be fixed before)

I have various fixed queued for the unwinder (or rather for annotations used by the unwinder), but expect them to only be merged with .19.

Quoted 3 lines
Quoted 3 lines

Leftover inexact backtrace
[<c0104194>] show_stack_log_lvl+0x8c/0x97

This might be ok.

Quoted 5 lines
Quoted 5 lines
[<c0104320>] show_registers+0x181/0x215
[<c0104576>] die+0x1c2/0x2dd
[<c0117419>] do_page_fault+ox410/0x4f3
[<c02f5271>] error_code+0x39/0x40
[<c0104194>] show_stack_log_lvl+0x8c/0x97
Quoted 8 lines
Quoted 8 lines
[<c0104320>] show_registers+0x181/0x215
[<c0104576>] die+0x1c2/0x2dd
[<c0117419>] do_page_fault+0x410/0x4f3
[<c02f5271>] error_code+0x39/0x40
[<c047b609>] start_kernel+0x224/0x3a2
[<c0100210>] 0xc0100210
Code: 00 39 .......
EIP:[<c01040ca>] show_trace_log_lvl+0x11b/0x159 SS:ESP 0068:c0479e74

This might be not. Hard to tell. Can we have a complete oops please? (using netconsole or digital camera or firescope)

-andi

#14 lore raw
In reply to a message not in the archive
Quoted 4 lines · On 08/08/06, [email protected] <[email protected]> wrote:

The mm snapshot broken-out-2006-08-08-00-59.tar.gz has been uploaded to

   ftp://ftp.kernel.org/pub/linux/kernel/people/akpm/mm/broken-out-2006-08-08-00-59.tar.gz

When I want to halt system I type "init 0", but it stops on

Halting system...
Synchronizing SCSI cache for disk sda
Shutdown: hda

Problem appears on 2.6.18-rc3-mm*. I guess that this is an IDE or ACPI bug. I'll revert IDE and ACPI patches. If it won't help, I'll do binary search.

Regards,
Michal

Signature · 3 lines
Michal K. K. Piotrowski
LTG - Linux Testers Group
(http://www.stardust.webpages.pl/ltg/wiki/)
#15 lore raw

Hi,

Quoted 6 lines · Michal Piotrowski
Quoted 4 lines · On 08/08/06, [email protected] <[email protected]> wrote:

The mm snapshot broken-out-2006-08-08-00-59.tar.gz has been uploaded to

   ftp://ftp.kernel.org/pub/linux/kernel/people/akpm/mm/broken-out-2006-08-08-00-59.tar.gz
Quoted 8 lines

When I want to halt system I type "init 0", but it stops on

Halting system...
Synchronizing SCSI cache for disk sda
Shutdown: hda

Problem appears on 2.6.18-rc3-mm*. I guess that this is an IDE or ACPI bug. I'll revert IDE and ACPI patches. If it won't help, I'll do binary search.

It's a git-block.patch

Jens, can you look at this?

Here is a config file
http://www.stardust.webpages.pl/files/mm/2.6.18-rc4-mm1/mm-config2

Regards,
Michal

Signature · 3 lines
Michal K. K. Piotrowski
LTG - Linux Testers Group
(http://www.stardust.webpages.pl/ltg/wiki/)
#16 lore raw
Quoted 19 lines · Michal Piotrowski

Hi,

Quoted 7 lines · Michal Piotrowski
Quoted 3 lines · On 08/08/06, [email protected] <[email protected]> wrote:

The mm snapshot broken-out-2006-08-08-00-59.tar.gz has been uploaded to

ftp://ftp.kernel.org/pub/linux/kernel/people/akpm/mm/broken-out-2006-08-08-00-59.tar.gz

Quoted 1 line
Quoted 8 lines

When I want to halt system I type "init 0", but it stops on

Halting system...
Synchronizing SCSI cache for disk sda
Shutdown: hda

Problem appears on 2.6.18-rc3-mm*. I guess that this is an IDE or ACPI bug. I'll revert IDE and ACPI patches. If it won't help, I'll do binary search.

Quoted 6 lines

It's a git-block.patch

Jens, can you look at this?

Here is a config file
http://www.stardust.webpages.pl/files/mm/2.6.18-rc4-mm1/mm-config2

It's the already solved bug, I believe. The version referenced above still has the fixed REQ_TYPE_ATA_TASKFILE and ->end_io_data for suspend problem.

Let me know if it works or not with this applied.

drivers/ide/ide.c +2 -2
diff -urp linux-2.6.18-rc3.virgin/drivers/ide/ide.c linux-2.6.18-rc3/drivers/ide/ide.c
@@ -1223,7 +1223,7 @@ static int generic_ide_suspend(struct de
 	memset(&args, 0, sizeof(args));
 	rq.cmd_type = REQ_TYPE_PM_SUSPEND;
 	rq.special = &args;
-	rq.end_io_data = &rqpm;
+	rq.data = &rqpm;
 	rqpm.pm_step = ide_pm_state_start_suspend;
 	if (mesg.event == PM_EVENT_PRETHAW)
 		mesg.event = PM_EVENT_FREEZE;
@@ -1244,7 +1244,7 @@ static int generic_ide_resume(struct dev
 	memset(&args, 0, sizeof(args));
 	rq.cmd_type = REQ_TYPE_PM_RESUME;
 	rq.special = &args;
-	rq.end_io_data = &rqpm;
+	rq.data = &rqpm;
 	rqpm.pm_step = ide_pm_state_start_resume;
 	rqpm.pm_state = PM_EVENT_ON;
 
drivers/ide/ide-io.c +6 -6
diff -urp linux-2.6.18-rc3.virgin/drivers/ide/ide-io.c linux-2.6.18-rc3/drivers/ide/ide-io.c
@@ -141,7 +141,7 @@ enum {
 
 static void ide_complete_power_step(ide_drive_t *drive, struct request *rq, u8 stat, u8 error)
 {
-	struct request_pm_state *pm = rq->end_io_data;
+	struct request_pm_state *pm = rq->data;
 
 	if (drive->media != ide_disk)
 		return;
@@ -167,7 +167,7 @@ static void ide_complete_power_step(ide_
 
 static ide_startstop_t ide_start_power_step(ide_drive_t *drive, struct request *rq)
 {
-	struct request_pm_state *pm = rq->end_io_data;
+	struct request_pm_state *pm = rq->data;
 	ide_task_t *args = rq->special;
 
 	memset(args, 0, sizeof(*args));
@@ -402,7 +402,7 @@ void ide_end_drive_cmd (ide_drive_t *dri
 			args[5] = hwif->INB(IDE_HCYL_REG);
 			args[6] = hwif->INB(IDE_SELECT_REG);
 		}
-	} else if (rq->cmd_type & REQ_TYPE_ATA_TASKFILE) {
+	} else if (rq->cmd_type == REQ_TYPE_ATA_TASKFILE) {
 		ide_task_t *args = (ide_task_t *) rq->special;
 		if (rq->errors == 0)
 			rq->errors = !OK_STAT(stat,READY_STAT,BAD_STAT);
@@ -433,7 +433,7 @@ void ide_end_drive_cmd (ide_drive_t *dri
 			}
 		}
 	} else if (blk_pm_request(rq)) {
-		struct request_pm_state *pm = rq->end_io_data;
+		struct request_pm_state *pm = rq->data;
 #ifdef DEBUG_PM
 		printk("%s: complete_power_step(step: %d, stat: %x, err: %x)\n",
 			drive->name, rq->pm->pm_step, stat, err);
@@ -945,7 +945,7 @@ done:
 
 static void ide_check_pm_state(ide_drive_t *drive, struct request *rq)
 {
-	struct request_pm_state *pm = rq->end_io_data;
+	struct request_pm_state *pm = rq->data;
 
 	if (blk_pm_suspend_request(rq) &&
 	    pm->pm_step == ide_pm_state_start_suspend)
@@ -1030,7 +1030,7 @@ static ide_startstop_t start_request (id
 		    rq->cmd_type == REQ_TYPE_ATA_TASKFILE)
 			return execute_drive_cmd(drive, rq);
 		else if (blk_pm_request(rq)) {
-			struct request_pm_state *pm = rq->end_io_data;
+			struct request_pm_state *pm = rq->data;
 #ifdef DEBUG_PM
 			printk("%s: start_power_step(step: %d)\n",
 				drive->name, rq->pm->pm_step);
Signature · 1 line
Jens Axboe
#17 lore raw
Quoted 24 lines · Jens Axboe
Quoted 23 lines · Michal Piotrowski

Hi,

Quoted 7 lines · Michal Piotrowski
Quoted 3 lines · On 08/08/06, [email protected] <[email protected]> wrote:

The mm snapshot broken-out-2006-08-08-00-59.tar.gz has been uploaded to

ftp://ftp.kernel.org/pub/linux/kernel/people/akpm/mm/broken-out-2006-08-08-00-59.tar.gz

Quoted 1 line
Quoted 8 lines

When I want to halt system I type "init 0", but it stops on

Halting system...
Synchronizing SCSI cache for disk sda
Shutdown: hda

Problem appears on 2.6.18-rc3-mm*. I guess that this is an IDE or ACPI bug. I'll revert IDE and ACPI patches. If it won't help, I'll do binary search.

It's a git-block.patch

Jens, can you look at this?

Quoted 9 lines
Quoted 2 lines

Here is a config file
http://www.stardust.webpages.pl/files/mm/2.6.18-rc4-mm1/mm-config2

It's the already solved bug, I believe. The version referenced above still has the fixed REQ_TYPE_ATA_TASKFILE and ->end_io_data for suspend problem.

Let me know if it works or not with this applied.

It works. Thanks!

Andrew, please add this patch to -mm.

Quoted 4 lines

--
Jens Axboe

Regards,
Michal

Signature · 3 lines
Michal K. K. Piotrowski
LTG - Linux Testers Group
(http://www.stardust.webpages.pl/ltg/wiki/)
#18 lore raw
Quoted 36 lines · Michal Piotrowski
Quoted 35 lines · Jens Axboe
Quoted 5 lines · Michal Piotrowski

Hi,

Quoted 2 lines · Michal Piotrowski
Quoted 1 line · On 08/08/06, [email protected] <[email protected]> wrote:

The mm snapshot broken-out-2006-08-08-00-59.tar.gz has been uploaded

to

Quoted 13 lines
Quoted 2 lines
Quoted 2 lines

ftp://ftp.kernel.org/pub/linux/kernel/people/akpm/mm/broken-out-2006-08-08-00-59.tar.gz

Quoted 9 lines
Quoted 1 line

When I want to halt system I type "init 0", but it stops on

Halting system...
Synchronizing SCSI cache for disk sda
Shutdown: hda

Problem appears on 2.6.18-rc3-mm*. I guess that this is an IDE or ACPI

bug.

Quoted 1 line
Quoted 1 line

I'll revert IDE and ACPI patches. If it won't help, I'll do binary

search.

Quoted 7 lines

It's a git-block.patch

Jens, can you look at this?

Here is a config file
http://www.stardust.webpages.pl/files/mm/2.6.18-rc4-mm1/mm-config2

It's the already solved bug, I believe. The version referenced above still has the fixed REQ_TYPE_ATA_TASKFILE and ->end_io_data for suspend problem.

Quoted 6 lines
Quoted 2 lines

Let me know if it works or not with this applied.

It works. Thanks!

Andrew, please add this patch to -mm.

It should just work, when andrew pulls for 'for-akpm' branch for the next -mm. At least the included fixes are already there.

Signature · 1 line
Jens Axboe