MCE boot crash in qemu
Hi,
I get an MCE-related crash like this in latest linus tree:
[ 0.115341] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line) [ 0.116396] CPU: L2 Cache: 512K (64 bytes/line) [ 0.120570] mce: CPU supports 0 MCE banks [ 0.124870] BUG: unable to handle kernel NULL pointer dereference at 00000000 00000010 [ 0.128001] IP: [<ffffffff813b98ad>] mcheck_init+0x278/0x320 [ 0.128001] PGD 0 [ 0.128001] Thread overran stack, or stack corrupted [ 0.128001] Oops: 0002 [#1] PREEMPT SMP [ 0.128001] last sysfs file: [ 0.128001] CPU 0 [ 0.128001] Modules linked in: [ 0.128001] Pid: 0, comm: swapper Not tainted 2.6.30 #426 [ 0.128001] RIP: 0010:[<ffffffff813b98ad>] [<ffffffff813b98ad>] mcheck_init+ 0x278/0x320 [ 0.128001] RSP: 0018:ffffffff81595e38 EFLAGS: 00000246 [ 0.128001] RAX: 0000000000000010 RBX: ffffffff8158f900 RCX: 0000000000000000 [ 0.128001] RDX: 0000000000000000 RSI: 00000000000000ff RDI: 0000000000000010 [ 0.128001] RBP: ffffffff81595e68 R08: 0000000000000001 R09: 0000000000000000 [ 0.128001] R10: 0000000000000010 R11: 0000000000000000 R12: 0000000000000000 [ 0.128001] R13: 00000000ffffffff R14: 0000000000000000 R15: 0000000000000000 [ 0.128001] FS: 0000000000000000(0000) GS:ffff880002288000(0000) knlGS:00000 00000000000 [ 0.128001] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b [ 0.128001] CR2: 0000000000000010 CR3: 0000000001001000 CR4: 00000000000006b0 [ 0.128001] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 0.128001] DR3: 0000000000000000 DR6: 0000000000000000 DR7: 0000000000000000 [ 0.128001] Process swapper (pid: 0, threadinfo ffffffff81594000, task ffffff ff8152a4a0) [ 0.128001] Stack: [ 0.128001] 0000000081595e68 5aa50ed3b4ddbe6e ffffffff8158f900 ffffffff8158f 914 [ 0.128001] ffffffff8158f948 0000000000000000 ffffffff81595eb8 ffffffff813b8 69c [ 0.128001] 5aa50ed3b4ddbe6e 00000001078bfbfd 0000062300000800 5aa50ed3b4ddb e6e [ 0.128001] Call Trace: [ 0.128001] [<ffffffff813b869c>] identify_cpu+0x331/0x392 [ 0.128001] [<ffffffff815a1445>] identify_boot_cpu+0x23/0x6e [ 0.128001] [<ffffffff815a14ac>] check_bugs+0x1c/0x60 [ 0.128001] [<ffffffff8159c075>] start_kernel+0x403/0x46e [ 0.128001] [<ffffffff8159b2ac>] x86_64_start_reservations+0xac/0xd5 [ 0.128001] [<ffffffff8159b3ea>] x86_64_start_kernel+0x115/0x14b [ 0.128001] [<ffffffff8159b140>] ? early_idt_handler+0x0/0x71 [ 0.128001] Code: c7 48 89 05 9e 71 40 00 74 2a 48 63 15 91 71 40 00 be ff 00 00 00 48 c1 e2 03 e8 bf a1 e2 ff e9 3f fe ff ff 48 8b 05 7b 71 40 00 <48> c7 00 00 00 00 00 eb 84 c7 05 40 71 40 00 01 00 00 00 e9 2b [ 0.128001] RIP [<ffffffff813b98ad>] mcheck_init+0x278/0x320 [ 0.128001] RSP <ffffffff81595e38> [ 0.128001] CR2: 0000000000000010 [ 0.129306] ---[ end trace a7919e7f17c0a725 ]---
It's this:
/*
* Various K7s with broken bank 0 around. Always disable
* by default.
*/
if (c->x86 == 6)
bank[0] = 0;in mce_cpu_quirks() in arch/x86/kernel/cpu/mcheck/mce.c around line 1217. Strange that it thinks this is AMD cpu, though?
Attached full boot log.
Vegard
[ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Linux version 2.6.30 (vegard@damson) (gcc version 4.3.2 20081105 (Red Hat 4.3.2-7) (GCC) ) #426 SMP PREEMPT Mon Jun 15 13:34:20 CEST 2009 [ 0.000000] Command line: root=/dev/sda1 console=ttyS0 console=tty0 ignore_loglevel acpi=force no_console_suspend resume=/dev/sdb1 init=/getty.sh kmemcheck=0 [ 0.000000] KERNEL supported cpus: [ 0.000000] Intel GenuineIntel [ 0.000000] AMD AuthenticAMD [ 0.000000] Centaur CentaurHauls [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: 0000000000000000 - 000000000009fc00 (usable) [ 0.000000] BIOS-e820: 000000000009fc00 - 00000000000a0000 (reserved) [ 0.000000] BIOS-e820: 00000000000e8000 - 0000000000100000 (reserved) [ 0.000000] BIOS-e820: 0000000000100000 - 0000000007ff0000 (usable) [ 0.000000] BIOS-e820: 0000000007ff0000 - 0000000008000000 (ACPI data) [ 0.000000] BIOS-e820: 00000000fffc0000 - 0000000100000000 (reserved) [ 0.000000] debug: ignoring loglevel setting. [ 0.000000] last_pfn = 0x7ff0 max_arch_pfn = 0x400000000 [ 0.000000] initial memory mapped : 0 - 20000000 [ 0.000000] init_memory_mapping: 0000000000000000-0000000007ff0000 [ 0.000000] 0000000000 - 0007ff0000 page 4k [ 0.000000] kernel direct mapping tables up to 7ff0000 @ 8000-4a000 [ 0.000000] (5 early reservations) ==> bootmem [0000000000 - 0007ff0000] [ 0.000000] #0 [0000000000 - 0000001000] BIOS data page ==> [0000000000 - 0000001000] [ 0.000000] #1 [0000006000 - 0000008000] TRAMPOLINE ==> [0000006000 - 0000008000] [ 0.000000] #2 [0001000000 - 00022819fc] TEXT DATA BSS ==> [0001000000 - 00022819fc] [ 0.000000] #3 [000009fc00 - 0000100000] BIOS reserved ==> [000009fc00 - 0000100000] [ 0.000000] #4 [0000008000 - 0000048000] PGTABLE ==> [0000008000 - 0000048000] [ 0.000000] found SMP MP-table at [ffff8800000fa6d0] fa6d0 [ 0.000000] [ffffea0000000000-ffffea00003fffff] PMD -> [ffff880002800000-ffff880002bfffff] on node 0 [ 0.000000] Zone PFN ranges: [ 0.000000] DMA 0x00000000 -> 0x00001000 [ 0.000000] DMA32 0x00001000 -> 0x00100000 [ 0.000000] Normal 0x00100000 -> 0x00100000 [ 0.000000] Movable zone start PFN for each node [ 0.000000] early_node_map[2] active PFN ranges [ 0.000000] 0: 0x00000000 -> 0x0000009f [ 0.000000] 0: 0x00000100 -> 0x00007ff0 [ 0.000000] On node 0 totalpages: 32655 [ 0.000000] DMA zone: 112 pages used for memmap [ 0.000000] DMA zone: 163 pages reserved [ 0.000000] DMA zone: 3724 pages, LIFO batch:0 [ 0.000000] DMA32 zone: 784 pages used for memmap [ 0.000000] DMA32 zone: 27872 pages, LIFO batch:7 [ 0.000000] Intel MultiProcessor Specification v1.4 [ 0.000000] MPTABLE: OEM ID: QEMUCPU [ 0.000000] MPTABLE: Product ID: 0.1 [ 0.000000] MPTABLE: APIC at: 0xFEE00000 [ 0.000000] Processor #0 (Bootup-CPU) [ 0.000000] Processor #1 [ 0.000000] I/O APIC #2 Version 17 at 0xFEC00000. [ 0.000000] Processors: 2 [ 0.000000] SMP: Allowing 2 CPUs, 0 hotplug CPUs [ 0.000000] nr_irqs_gsi: 24 [ 0.000000] Allocating PCI resources starting at 8000000 (gap: 8000000:f7fc0000) [ 0.000000] NR_CPUS:32 nr_cpumask_bits:32 nr_cpu_ids:2 nr_node_ids:1 [ 0.000000] PERCPU: Embedded 474 pages at ffff880002288000, static data 1909152 bytes [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 31596 [ 0.000000] Kernel command line: root=/dev/sda1 console=ttyS0 console=tty0 ignore_loglevel acpi=force no_console_suspend resume=/dev/sdb1 init=/getty.sh kmemcheck=0 [ 0.000000] PID hash table entries: 512 (order: 9, 4096 bytes) [ 0.000000] Dentry cache hash table entries: 16384 (order: 5, 131072 bytes) [ 0.000000] Inode-cache hash table entries: 8192 (order: 4, 65536 bytes) [ 0.000000] Initializing CPU#0 [ 0.000000] Checking aperture... [ 0.000000] No AGP bridge found [ 0.000000] Memory: 103132k/131008k available (3866k kernel code, 388k absent, 27348k reserved, 1818k data, 2176k init) [ 0.000000] Experimental hierarchical RCU implementation. [ 0.000000] Experimental hierarchical RCU init done. [ 0.000000] NR_IRQS:4352 nr_irqs:424 [ 0.000000] Fast TSC calibration using PIT [ 0.000000] Detected 1462.925 MHz processor. [ 0.004000] Console: colour VGA+ 80x25 [ 0.004000] console [tty0] enabled [ 0.004000] console [ttyS0] enabled [ 0.004000] Lock dependency validator: Copyright (c) 2006 Red Hat, Inc., Ingo Molnar [ 0.004000] ... MAX_LOCKDEP_SUBCLASSES: 8 [ 0.004000] ... MAX_LOCK_DEPTH: 48 [ 0.004000] ... MAX_LOCKDEP_KEYS: 8191 [ 0.004000] ... CLASSHASH_SIZE: 4096 [ 0.004000] ... MAX_LOCKDEP_ENTRIES: 16384 [ 0.004000] ... MAX_LOCKDEP_CHAINS: 32768 [ 0.004000] ... CHAINHASH_SIZE: 16384 [ 0.004000] memory used by lock dependency info: 6207 kB [ 0.004000] per task-struct memory footprint: 2688 bytes [ 0.004000] ------------------------ [ 0.004000] | Locking API testsuite: [ 0.004000] ---------------------------------------------------------------------------- [ 0.004000] | spin |wlock |rlock |mutex | wsem | rsem | [ 0.004000] -------------------------------------------------------------------------- [ 0.004000] A-A deadlock: ok | ok | ok | ok | ok | ok | [ 0.004000] A-B-B-A deadlock: ok | ok | ok | ok | ok | ok | [ 0.004000] A-B-B-C-C-A deadlock: ok | ok | ok | ok | ok | ok | [ 0.004000] A-B-C-A-B-C deadlock: ok | ok | ok | ok | ok | ok | [ 0.004000] A-B-B-C-C-D-D-A deadlock: ok | ok | ok | ok | ok | ok | [ 0.004000] A-B-C-D-B-D-D-A deadlock: ok | ok | ok | ok | ok | ok | [ 0.004000] A-B-C-D-B-C-D-A deadlock: ok | ok | ok | ok | ok | ok | [ 0.004000] double unlock: ok | ok | ok | ok | ok | ok | [ 0.004000] initialize held: ok | ok | ok | ok | ok | ok | [ 0.004000] bad unlock order: ok | ok | ok | ok | ok | ok | [ 0.004000] -------------------------------------------------------------------------- [ 0.004000] recursive read-lock: | ok | | ok | [ 0.004000] recursive read-lock #2: | ok | | ok | [ 0.004000] mixed read-write-lock: | ok | | ok | [ 0.004000] mixed write-read-lock: | ok | | ok | [ 0.004000] -------------------------------------------------------------------------- [ 0.004000] hard-irqs-on + irq-safe-A/12: ok | ok | ok | [ 0.004000] soft-irqs-on + irq-safe-A/12: ok | ok | ok | [ 0.004000] hard-irqs-on + irq-safe-A/21: ok | ok | ok | [ 0.004000] soft-irqs-on + irq-safe-A/21: ok | ok | ok | [ 0.004000] sirq-safe-A => hirqs-on/12: ok | ok | ok | [ 0.004000] sirq-safe-A => hirqs-on/21: ok | ok | ok | [ 0.004000] hard-safe-A + irqs-on/12: ok | ok | ok | [ 0.004000] soft-safe-A + irqs-on/12: ok | ok | ok | [ 0.004000] hard-safe-A + irqs-on/21: ok | ok | ok | [ 0.004000] soft-safe-A + irqs-on/21: ok | ok | ok | [ 0.004000] hard-safe-A + unsafe-B #1/123: ok | ok | ok | [ 0.004000] soft-safe-A + unsafe-B #1/123: ok | ok | ok | [ 0.004000] hard-safe-A + unsafe-B #1/132: ok | ok | ok | [ 0.004000] soft-safe-A + unsafe-B #1/132: ok | ok | ok | [ 0.004000] hard-safe-A + unsafe-B #1/213: ok | ok | ok | [ 0.004000] soft-safe-A + unsafe-B #1/213: ok | ok | ok | [ 0.004000] hard-safe-A + unsafe-B #1/231: ok | ok | ok | [ 0.004000] soft-safe-A + unsafe-B #1/231: ok | ok | ok | [ 0.004000] hard-safe-A + unsafe-B #1/312: ok | ok | ok | [ 0.004000] soft-safe-A + unsafe-B #1/312: ok | ok | ok | [ 0.004000] hard-safe-A + unsafe-B #1/321: ok | ok | ok | [ 0.004000] soft-safe-A + unsafe-B #1/321: ok | ok | ok | [ 0.004000] hard-safe-A + unsafe-B #2/123: ok | ok | ok | [ 0.004000] soft-safe-A + unsafe-B #2/123: ok | ok | ok | [ 0.004000] hard-safe-A + unsafe-B #2/132: ok | ok | ok | [ 0.004000] soft-safe-A + unsafe-B #2/132: ok | ok | ok | [ 0.004000] hard-safe-A + unsafe-B #2/213: ok | ok | ok | [ 0.004000] soft-safe-A + unsafe-B #2/213: ok | ok | ok | [ 0.004000] hard-safe-A + unsafe-B #2/231: ok | ok | ok | [ 0.004000] soft-safe-A + unsafe-B #2/231: ok | ok | ok | [ 0.004000] hard-safe-A + unsafe-B #2/312: ok | ok | ok | [ 0.004000] soft-safe-A + unsafe-B #2/312: ok | ok | ok | [ 0.004000] hard-safe-A + unsafe-B #2/321: ok | ok | ok | [ 0.004000] soft-safe-A + unsafe-B #2/321: ok | ok | ok | [ 0.004000] hard-irq lock-inversion/123: ok | ok | ok | [ 0.004000] soft-irq lock-inversion/123: ok | ok | ok | [ 0.004000] hard-irq lock-inversion/132: ok | ok | ok | [ 0.004000] soft-irq lock-inversion/132: ok | ok | ok | [ 0.004000] hard-irq lock-inversion/213: ok | ok | ok | [ 0.004000] soft-irq lock-inversion/213: ok | ok | ok | [ 0.004000] hard-irq lock-inversion/231: ok | ok | ok | [ 0.004000] soft-irq lock-inversion/231: ok | ok | ok | [ 0.004000] hard-irq lock-inversion/312: ok | ok | ok | [ 0.004000] soft-irq lock-inversion/312: ok | ok | ok | [ 0.004000] hard-irq lock-inversion/321: ok | ok | ok | [ 0.004000] soft-irq lock-inversion/321: ok | ok | ok | [ 0.004000] hard-irq read-recursion/123: ok | [ 0.004000] soft-irq read-recursion/123: ok | [ 0.004000] hard-irq read-recursion/132: ok | [ 0.004000] soft-irq read-recursion/132: ok | [ 0.004000] hard-irq read-recursion/213: ok | [ 0.004000] soft-irq read-recursion/213: ok | [ 0.004000] hard-irq read-recursion/231: ok | [ 0.004000] soft-irq read-recursion/231: ok | [ 0.004000] hard-irq read-recursion/312: ok | [ 0.004000] soft-irq read-recursion/312: ok | [ 0.004000] hard-irq read-recursion/321: ok | [ 0.004000] soft-irq read-recursion/321: ok | [ 0.004000] ------------------------------------------------------- [ 0.004000] Good, all 218 testcases passed! | [ 0.004000] --------------------------------- [ 0.004000] allocated 1310720 bytes of page_cgroup [ 0.004000] please try cgroup_disable=memory option if you don't want [ 0.008988] Calibrating delay loop (skipped), value calculated using timer frequency.. 2925.85 BogoMIPS (lpj=5851700) [ 0.030071] Security Framework initialized [ 0.033281] TOMOYO Linux initialized [ 0.045394] Mount-cache hash table entries: 256 [ 0.097008] Initializing cgroup subsys debug [ 0.098789] Initializing cgroup subsys ns [ 0.100572] Initializing cgroup subsys cpuacct [ 0.105127] Initializing cgroup subsys memory [ 0.110394] Initializing cgroup subsys freezer [ 0.115341] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line) [ 0.116396] CPU: L2 Cache: 512K (64 bytes/line) [ 0.120570] mce: CPU supports 0 MCE banks [ 0.124870] BUG: unable to handle kernel NULL pointer dereference at 0000000000000010 [ 0.128001] IP: [<ffffffff813b98ad>] mcheck_init+0x278/0x320 [ 0.128001] PGD 0 [ 0.128001] Thread overran stack, or stack corrupted [ 0.128001] Oops: 0002 [#1] PREEMPT SMP [ 0.128001] last sysfs file: [ 0.128001] CPU 0 [ 0.128001] Modules linked in: [ 0.128001] Pid: 0, comm: swapper Not tainted 2.6.30 #426 [ 0.128001] RIP: 0010:[<ffffffff813b98ad>] [<ffffffff813b98ad>] mcheck_init+0x278/0x320 [ 0.128001] RSP: 0018:ffffffff81595e38 EFLAGS: 00000246 [ 0.128001] RAX: 0000000000000010 RBX: ffffffff8158f900 RCX: 0000000000000000 [ 0.128001] RDX: 0000000000000000 RSI: 00000000000000ff RDI: 0000000000000010 [ 0.128001] RBP: ffffffff81595e68 R08: 0000000000000001 R09: 0000000000000000 [ 0.128001] R10: 0000000000000010 R11: 0000000000000000 R12: 0000000000000000 [ 0.128001] R13: 00000000ffffffff R14: 0000000000000000 R15: 0000000000000000 [ 0.128001] FS: 0000000000000000(0000) GS:ffff880002288000(0000) knlGS:0000000000000000 [ 0.128001] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b [ 0.128001] CR2: 0000000000000010 CR3: 0000000001001000 CR4: 00000000000006b0 [ 0.128001] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 0.128001] DR3: 0000000000000000 DR6: 0000000000000000 DR7: 0000000000000000 [ 0.128001] Process swapper (pid: 0, threadinfo ffffffff81594000, task ffffffff8152a4a0) [ 0.128001] Stack: [ 0.128001] 0000000081595e68 5aa50ed3b4ddbe6e ffffffff8158f900 ffffffff8158f914 [ 0.128001] ffffffff8158f948 0000000000000000 ffffffff81595eb8 ffffffff813b869c [ 0.128001] 5aa50ed3b4ddbe6e 00000001078bfbfd 0000062300000800 5aa50ed3b4ddbe6e [ 0.128001] Call Trace: [ 0.128001] [<ffffffff813b869c>] identify_cpu+0x331/0x392 [ 0.128001] [<ffffffff815a1445>] identify_boot_cpu+0x23/0x6e [ 0.128001] [<ffffffff815a14ac>] check_bugs+0x1c/0x60 [ 0.128001] [<ffffffff8159c075>] start_kernel+0x403/0x46e [ 0.128001] [<ffffffff8159b2ac>] x86_64_start_reservations+0xac/0xd5 [ 0.128001] [<ffffffff8159b3ea>] x86_64_start_kernel+0x115/0x14b [ 0.128001] [<ffffffff8159b140>] ? early_idt_handler+0x0/0x71 [ 0.128001] Code: c7 48 89 05 9e 71 40 00 74 2a 48 63 15 91 71 40 00 be ff 00 00 00 48 c1 e2 03 e8 bf a1 e2 ff e9 3f fe ff ff 48 8b 05 7b 71 40 00 <48> c7 00 00 00 00 00 eb 84 c7 05 40 71 40 00 01 00 00 00 e9 2b [ 0.128001] RIP [<ffffffff813b98ad>] mcheck_init+0x278/0x320 [ 0.128001] RSP <ffffffff81595e38> [ 0.128001] CR2: 0000000000000010 [ 0.129306] ---[ end trace a7919e7f17c0a725 ]--- [ 0.132404] Kernel panic - not syncing: Attempted to kill the idle task! [ 0.140325] Pid: 0, comm: swapper Tainted: G D 2.6.30 #426 [ 0.142882] Call Trace: [ 0.144307] [<ffffffff813bf004>] panic+0x94/0x170 [ 0.146152] [<ffffffff81051951>] do_exit+0x6c1/0x870 [ 0.148287] [<ffffffff81010e8e>] oops_end+0xce/0xe0 [ 0.150202] [<ffffffff8102f7c8>] no_context+0x108/0x290 [ 0.152298] [<ffffffff8102fabd>] __bad_area_nosemaphore+0x16d/0x210 [ 0.154691] [<ffffffff813c2953>] ? trace_hardirqs_on_thunk+0x3a/0x3f [ 0.156289] [<ffffffff8107c004>] ? tick_nohz_stop_sched_tick+0x154/0x3e0 [ 0.160282] [<ffffffff8100c4d4>] ? restore_args+0x0/0x30 [ 0.162375] [<ffffffff8102ff75>] ? do_page_fault+0x1b5/0x310 [ 0.164286] [<ffffffff8102fb81>] bad_area_nosemaphore+0x21/0x40 [ 0.168316] [<ffffffff8107dce7>] ? trace_hardirqs_off_caller+0xa7/0xe0 [ 0.172326] [<ffffffff8103001e>] do_page_fault+0x25e/0x310 [ 0.176305] [<ffffffff813c2992>] ? trace_hardirqs_off_thunk+0x3a/0x3c [ 0.178663] [<ffffffff813c42f5>] page_fault+0x25/0x30 [ 0.180296] [<ffffffff813b98ad>] ? mcheck_init+0x278/0x320 [ 0.184295] [<ffffffff813b98a1>] ? mcheck_init+0x26c/0x320 [ 0.186424] [<ffffffff813b869c>] identify_cpu+0x331/0x392 [ 0.188322] [<ffffffff815a1445>] identify_boot_cpu+0x23/0x6e [ 0.190602] [<ffffffff815a14ac>] check_bugs+0x1c/0x60 [ 0.192287] [<ffffffff8159c075>] start_kernel+0x403/0x46e [ 0.196301] [<ffffffff8159b2ac>] x86_64_start_reservations+0xac/0xd5 [ 0.198909] [<ffffffff8159b3ea>] x86_64_start_kernel+0x115/0x14b [ 0.200338] [<ffffffff8159b140>] ? early_idt_handler+0x0/0x71
Quoted 65 lines · Vegard Nossum
Hi,
I get an MCE-related crash like this in latest linus tree:
[ 0.115341] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line) [ 0.116396] CPU: L2 Cache: 512K (64 bytes/line) [ 0.120570] mce: CPU supports 0 MCE banks [ 0.124870] BUG: unable to handle kernel NULL pointer dereference at 00000000 00000010 [ 0.128001] IP: [<ffffffff813b98ad>] mcheck_init+0x278/0x320 [ 0.128001] PGD 0 [ 0.128001] Thread overran stack, or stack corrupted [ 0.128001] Oops: 0002 [#1] PREEMPT SMP [ 0.128001] last sysfs file: [ 0.128001] CPU 0 [ 0.128001] Modules linked in: [ 0.128001] Pid: 0, comm: swapper Not tainted 2.6.30 #426 [ 0.128001] RIP: 0010:[<ffffffff813b98ad>] [<ffffffff813b98ad>] mcheck_init+ 0x278/0x320 [ 0.128001] RSP: 0018:ffffffff81595e38 EFLAGS: 00000246 [ 0.128001] RAX: 0000000000000010 RBX: ffffffff8158f900 RCX: 0000000000000000 [ 0.128001] RDX: 0000000000000000 RSI: 00000000000000ff RDI: 0000000000000010 [ 0.128001] RBP: ffffffff81595e68 R08: 0000000000000001 R09: 0000000000000000 [ 0.128001] R10: 0000000000000010 R11: 0000000000000000 R12: 0000000000000000 [ 0.128001] R13: 00000000ffffffff R14: 0000000000000000 R15: 0000000000000000 [ 0.128001] FS: 0000000000000000(0000) GS:ffff880002288000(0000) knlGS:00000 00000000000 [ 0.128001] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b [ 0.128001] CR2: 0000000000000010 CR3: 0000000001001000 CR4: 00000000000006b0 [ 0.128001] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 0.128001] DR3: 0000000000000000 DR6: 0000000000000000 DR7: 0000000000000000 [ 0.128001] Process swapper (pid: 0, threadinfo ffffffff81594000, task ffffff ff8152a4a0) [ 0.128001] Stack: [ 0.128001] 0000000081595e68 5aa50ed3b4ddbe6e ffffffff8158f900 ffffffff8158f 914 [ 0.128001] ffffffff8158f948 0000000000000000 ffffffff81595eb8 ffffffff813b8 69c [ 0.128001] 5aa50ed3b4ddbe6e 00000001078bfbfd 0000062300000800 5aa50ed3b4ddb e6e [ 0.128001] Call Trace: [ 0.128001] [<ffffffff813b869c>] identify_cpu+0x331/0x392 [ 0.128001] [<ffffffff815a1445>] identify_boot_cpu+0x23/0x6e [ 0.128001] [<ffffffff815a14ac>] check_bugs+0x1c/0x60 [ 0.128001] [<ffffffff8159c075>] start_kernel+0x403/0x46e [ 0.128001] [<ffffffff8159b2ac>] x86_64_start_reservations+0xac/0xd5 [ 0.128001] [<ffffffff8159b3ea>] x86_64_start_kernel+0x115/0x14b [ 0.128001] [<ffffffff8159b140>] ? early_idt_handler+0x0/0x71 [ 0.128001] Code: c7 48 89 05 9e 71 40 00 74 2a 48 63 15 91 71 40 00 be ff 00 00 00 48 c1 e2 03 e8 bf a1 e2 ff e9 3f fe ff ff 48 8b 05 7b 71 40 00 <48> c7 00 00 00 00 00 eb 84 c7 05 40 71 40 00 01 00 00 00 e9 2b [ 0.128001] RIP [<ffffffff813b98ad>] mcheck_init+0x278/0x320 [ 0.128001] RSP <ffffffff81595e38> [ 0.128001] CR2: 0000000000000010 [ 0.129306] ---[ end trace a7919e7f17c0a725 ]---It's this:
/* * Various K7s with broken bank 0 around. Always disable * by default. */ if (c->x86 == 6) bank[0] = 0;
Quoted 4 lines
in
mce_cpu_quirks()inarch/x86/kernel/cpu/mcheck/mce.caround line 1217. Strange that it thinks this is AMD cpu, though?Attached full boot log.
I saw something like this too with qemu/x86_64.
Pekka
Quoted 65 lines · Vegard Nossum
Hi,
I get an MCE-related crash like this in latest linus tree:
[ 0.115341] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line) [ 0.116396] CPU: L2 Cache: 512K (64 bytes/line) [ 0.120570] mce: CPU supports 0 MCE banks [ 0.124870] BUG: unable to handle kernel NULL pointer dereference at 00000000 00000010 [ 0.128001] IP: [<ffffffff813b98ad>] mcheck_init+0x278/0x320 [ 0.128001] PGD 0 [ 0.128001] Thread overran stack, or stack corrupted [ 0.128001] Oops: 0002 [#1] PREEMPT SMP [ 0.128001] last sysfs file: [ 0.128001] CPU 0 [ 0.128001] Modules linked in: [ 0.128001] Pid: 0, comm: swapper Not tainted 2.6.30 #426 [ 0.128001] RIP: 0010:[<ffffffff813b98ad>] [<ffffffff813b98ad>] mcheck_init+ 0x278/0x320 [ 0.128001] RSP: 0018:ffffffff81595e38 EFLAGS: 00000246 [ 0.128001] RAX: 0000000000000010 RBX: ffffffff8158f900 RCX: 0000000000000000 [ 0.128001] RDX: 0000000000000000 RSI: 00000000000000ff RDI: 0000000000000010 [ 0.128001] RBP: ffffffff81595e68 R08: 0000000000000001 R09: 0000000000000000 [ 0.128001] R10: 0000000000000010 R11: 0000000000000000 R12: 0000000000000000 [ 0.128001] R13: 00000000ffffffff R14: 0000000000000000 R15: 0000000000000000 [ 0.128001] FS: 0000000000000000(0000) GS:ffff880002288000(0000) knlGS:00000 00000000000 [ 0.128001] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b [ 0.128001] CR2: 0000000000000010 CR3: 0000000001001000 CR4: 00000000000006b0 [ 0.128001] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 0.128001] DR3: 0000000000000000 DR6: 0000000000000000 DR7: 0000000000000000 [ 0.128001] Process swapper (pid: 0, threadinfo ffffffff81594000, task ffffff ff8152a4a0) [ 0.128001] Stack: [ 0.128001] 0000000081595e68 5aa50ed3b4ddbe6e ffffffff8158f900 ffffffff8158f 914 [ 0.128001] ffffffff8158f948 0000000000000000 ffffffff81595eb8 ffffffff813b8 69c [ 0.128001] 5aa50ed3b4ddbe6e 00000001078bfbfd 0000062300000800 5aa50ed3b4ddb e6e [ 0.128001] Call Trace: [ 0.128001] [<ffffffff813b869c>] identify_cpu+0x331/0x392 [ 0.128001] [<ffffffff815a1445>] identify_boot_cpu+0x23/0x6e [ 0.128001] [<ffffffff815a14ac>] check_bugs+0x1c/0x60 [ 0.128001] [<ffffffff8159c075>] start_kernel+0x403/0x46e [ 0.128001] [<ffffffff8159b2ac>] x86_64_start_reservations+0xac/0xd5 [ 0.128001] [<ffffffff8159b3ea>] x86_64_start_kernel+0x115/0x14b [ 0.128001] [<ffffffff8159b140>] ? early_idt_handler+0x0/0x71 [ 0.128001] Code: c7 48 89 05 9e 71 40 00 74 2a 48 63 15 91 71 40 00 be ff 00 00 00 48 c1 e2 03 e8 bf a1 e2 ff e9 3f fe ff ff 48 8b 05 7b 71 40 00 <48> c7 00 00 00 00 00 eb 84 c7 05 40 71 40 00 01 00 00 00 e9 2b [ 0.128001] RIP [<ffffffff813b98ad>] mcheck_init+0x278/0x320 [ 0.128001] RSP <ffffffff81595e38> [ 0.128001] CR2: 0000000000000010 [ 0.129306] ---[ end trace a7919e7f17c0a725 ]---It's this:
/* * Various K7s with broken bank 0 around. Always disable * by default. */ if (c->x86 == 6) bank[0] = 0;
Quoted 2 lines
in
mce_cpu_quirks()inarch/x86/kernel/cpu/mcheck/mce.caround line 1217. Strange that it thinks this is AMD cpu, though?
Probably qemu fakes that. You can check in /proc/cpuinfo after it booted.
It should really clear the mca cpuid flag if it doesn't have any mca banks, but ok.
Here's a untested patch (sorry not able to test any patches currently). Does it fix the problem?
A workaround if you don't want to apply the patch is to boot with mce=off
-Andi
---
x86: mce: Handle banks == 0 case in K7 quirk
This happens on QEMU which reports MCA capability, but no banks. Without this patch there is a buffer overrun and boot ops because the code would try to initialize the 0 element of a zero length kmalloc() buffer.
arch/x86/kernel/cpu/mcheck/mce.c renamed from arch/x86/kernel/cpu/mcheck/mce.c-o +1 -1
@@ -1245,7 +1245,7 @@* Various K7s with broken bank 0 around. Always disable * by default. */ -if (c->x86 ==6 ) +if (c->x86 ==6 && banks >0 ) bank[0 ] =0 ; }
Pekka Enberg
Tested-byQuoted 8 lines · Andi Kleen
x86: mce: Handle banks == 0 case in K7 quirk
This happens on QEMU which reports MCA capability, but no banks. Without this patch there is a buffer overrun and boot ops because the code would try to initialize the 0 element of a zero length
kmalloc()buffer.Signed-off-by Andi Kleen <[email protected]>
This fixes the bug for me!
Pekka
Quoted 8 lines · Pekka Enberg
Quoted 7 lines · Andi Kleen
x86: mce: Handle banks == 0 case in K7 quirk
This happens on QEMU which reports MCA capability, but no banks. Without this patch there is a buffer overrun and boot ops because the code would try to initialize the 0 element of a zero length
kmalloc()buffer.
Quoted 5 lines
Quoted 1 line
Signed-off-by Andi Kleen <[email protected]>This fixes the bug for me!
Tested-by Pekka Enberg <[email protected]>
Ingo, I hit this again in my testing after rebasing to linus/master so I really would like this in mainline.
Pekka
Quoted 9 lines · Pekka Enberg
Quoted 8 lines · Pekka Enberg
Quoted 7 lines · Andi Kleen
x86: mce: Handle banks == 0 case in K7 quirk
This happens on QEMU which reports MCA capability, but no banks. Without this patch there is a buffer overrun and boot ops because the code would try to initialize the 0 element of a zero length
kmalloc()buffer.
Quoted 8 lines
Quoted 5 lines
Quoted 1 line
Signed-off-by Andi Kleen <[email protected]>This fixes the bug for me!
Tested-by Pekka Enberg <[email protected]>Ingo, I hit this again in my testing after rebasing to linus/master so I really would like this in mainline.
yep, i've tidied up the changelog and have committed it to x86/urgent.
But the bank[] code is quirky and butt-ugly and that needs to be cleaned up - it's no wonder that bugs like this slip in.
- There's zero description about the hw model it represents and how it relates to the bank[] array - what do the banks mean, how are they organized.
- It's full of magic constants and implicitly-assumed size calculations with little explanation and little extensibility:
...
if (c->x86 == 15 && banks > 4) {
/*
* disable GART TBL walk error reporting, which
* trips off incorrectly with the IOMMU & 3ware
* & Cerberus:
*/
clear_bit(10, (unsigned long *)&bank[4]);
}
...
bank = kmalloc(banks * sizeof(u64), GFP_KERNEL);
...
memset(bank, 0xff, banks * sizeof(u64));
...- There's lots of bitmaps, arrays, flags interacting, creating a maze of logic.
Instead of this messy code, the proper approach is to introduce an abstract data structure representing the attributes of an MCE bank register:
struct mce_bank_register {
int enabled;
int polled;
int dont_init;
int msr_idx;};
( There's lots of other structural problems with the MCE code too -
but now that it's unified lets first fix the most obvious ones... )
Ingo
[tip:x86/urgent] x86: mce: Handle banks == 0 case in K7 quirk
In reply to Andi KleenCommit-ID: 203abd67b75f7714ce98ab0cdbd6cfd7ad79dec4 Gitweb: http://git.kernel.org/tip/203abd67b75f7714ce98ab0cdbd6cfd7ad79dec4 Author: Andi Kleen <[email protected]> AuthorDate: Mon, 15 Jun 2009 14:52:01 +0200 Committer: Ingo Molnar <[email protected]> CommitDate: Wed, 17 Jun 2009 08:59:45 +0200
x86: mce: Handle banks == 0 case in K7 quirk
Vegard Nossum reported:
Quoted 36 lines
I get an MCE-related crash like this in latest linus tree:
[ 0.115341] CPU: L1 I Cache: 64K (64 bytes/line), D cache 64K (64 bytes/line) [ 0.116396] CPU: L2 Cache: 512K (64 bytes/line) [ 0.120570] mce: CPU supports 0 MCE banks [ 0.124870] BUG: unable to handle kernel NULL pointer dereference at 00000000 00000010 [ 0.128001] IP: [<ffffffff813b98ad>] mcheck_init+0x278/0x320 [ 0.128001] PGD 0 [ 0.128001] Thread overran stack, or stack corrupted [ 0.128001] Oops: 0002 [#1] PREEMPT SMP [ 0.128001] last sysfs file: [ 0.128001] CPU 0 [ 0.128001] Modules linked in: [ 0.128001] Pid: 0, comm: swapper Not tainted 2.6.30 #426 [ 0.128001] RIP: 0010:[<ffffffff813b98ad>] [<ffffffff813b98ad>] mcheck_init+0x278/0x320 [ 0.128001] RSP: 0018:ffffffff81595e38 EFLAGS: 00000246 [ 0.128001] RAX: 0000000000000010 RBX: ffffffff8158f900 RCX: 0000000000000000 [ 0.128001] RDX: 0000000000000000 RSI: 00000000000000ff RDI: 0000000000000010 [ 0.128001] RBP: ffffffff81595e68 R08: 0000000000000001 R09: 0000000000000000 [ 0.128001] R10: 0000000000000010 R11: 0000000000000000 R12: 0000000000000000 [ 0.128001] R13: 00000000ffffffff R14: 0000000000000000 R15: 0000000000000000 [ 0.128001] FS: 0000000000000000(0000) GS:ffff880002288000(0000) knlGS:00000 00000000000 [ 0.128001] CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b [ 0.128001] CR2: 0000000000000010 CR3: 0000000001001000 CR4: 00000000000006b0 [ 0.128001] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [ 0.128001] DR3: 0000000000000000 DR6: 0000000000000000 DR7: 0000000000000000 [ 0.128001] Process swapper (pid: 0, threadinfo ffffffff81594000, task ffffff ff8152a4a0) [ 0.128001] Stack: [ 0.128001] 0000000081595e68 5aa50ed3b4ddbe6e ffffffff8158f900 ffffffff8158f 914 [ 0.128001] ffffffff8158f948 0000000000000000 ffffffff81595eb8 ffffffff813b8 69c [ 0.128001] 5aa50ed3b4ddbe6e 00000001078bfbfd 0000062300000800 5aa50ed3b4ddbe6e
Quoted 8 lines
[ 0.128001] Call Trace: [ 0.128001] [<ffffffff813b869c>] identify_cpu+0x331/0x392 [ 0.128001] [<ffffffff815a1445>] identify_boot_cpu+0x23/0x6e [ 0.128001] [<ffffffff815a14ac>] check_bugs+0x1c/0x60 [ 0.128001] [<ffffffff8159c075>] start_kernel+0x403/0x46e [ 0.128001] [<ffffffff8159b2ac>] x86_64_start_reservations+0xac/0xd5 [ 0.128001] [<ffffffff8159b3ea>] x86_64_start_kernel+0x115/0x14b [ 0.128001] [<ffffffff8159b140>] ? early_idt_handler+0x0/0x71
This happens on QEMU which reports MCA capability, but no banks. Without this patch there is a buffer overrun and boot ops because the code would try to initialize the 0 element of a zero length kmalloc() buffer.
LKML-Reference: <[email protected]>
--- arch/x86/kernel/cpu/mcheck/mce.c | 2 +- 1 files changed, 1 insertions(+), 1 deletions(-)
arch/x86/kernel/cpu/mcheck/mce.c +1 -1
@@ -1245,7 +1245,7 @@ static void mce_cpu_quirks(struct cpuinfo_x86 *c)* Various K7s with broken bank 0 around. Always disable * by default. */ -if (c->x86 ==6 ) +if (c->x86 ==6 && banks >0 ) bank[0 ] =0 ; }