New: OOPS in cpufreq driver with AMD Kaveri CPU
https://bugzilla.kernel.org/show_bug.cgi?id=81701
Bug ID: 81701
Summary: OOPS in cpufreq driver with AMD Kaveri CPU
Product: Power Management
Version: 2.5
Kernel Version: 3.16.0
Hardware: x86-64
OS: Linux
Tree: Mainline
Status: NEW
Severity: high
Priority: P1
Component: cpufreq
Assignee: [email protected]
Reporter: [email protected]
Regression: NoOccasionally I get my machine hung completely. Fortunately, I've got and saved oops listing using netconsole before hang, and here it is [1].
Here is little piece of oops from the link above:
===
[15051.270461] BUG: unable to handle kernel paging request at 00000000ff5ae8e4 [15051.271583] IP: [<ffffffff8109ae6e>] srcu_notifier_call_chain+0xe/0x20 … [15051.956205] Call Trace: [15051.980641] [<ffffffff81606085>] ? __cpufreq_notify_transition+0x95/0x1e0 [15052.005640] [<ffffffff816081ee>] cpufreq_notify_transition+0x3e/0x70 [15052.030240] [<ffffffff816083d8>] cpufreq_freq_transition_begin+0xe8/0x130 [15052.054522] [<ffffffff813b8940>] ? ucs2_strncmp+0x70/0x70 [15052.078208] [<ffffffff816089bf>] __target_index+0xbf/0x1a0 [15052.101348] [<ffffffff81608b9c>] __cpufreq_driver_target+0xfc/0x160 [15052.124250] [<ffffffff8160b0d4>] od_check_cpu+0xa4/0xb0 [15052.146789] [<ffffffff8160c9ec>] dbs_check_cpu+0x16c/0x1c0 [15052.168935] [<ffffffff8160b4dd>] od_dbs_timer+0x11d/0x180 [15052.190607] [<ffffffff8108e6ff>] process_one_work+0x17f/0x4c0 [15052.211825] [<ffffffff8108f46b>] worker_thread+0x11b/0x3f0 [15052.232490] [<ffffffff8108f350>] ? create_and_start_worker+0x80/0x80 [15052.253127] [<ffffffff81096479>] kthread+0xc9/0xe0 [15052.273292] [<ffffffff810963b0>] ? flush_kthread_worker+0xb0/0xb0 [15052.293487] [<ffffffff81793efc>] ret_from_fork+0x7c/0xb0 [15052.313544] [<ffffffff810963b0>] ? flush_kthread_worker+0xb0/0xb0
…
===
Also here is my lspci [2] and cpuinfo [3] as well.
Vanilla 3.15.8 and 3.16.0 are affected as well as latest Ubuntu 3.13 kernel.
No visible reason to trigger the bug. After hang machine doesn't respond via network, there's no disk IO, and also it doesn't respond to pressing power button in order to perform soft off.
[1] https://gist.github.com/085af9da81197faf6637
[2] https://gist.github.com/318ebda5576b099590b8
[3] https://gist.github.com/9c1307463c7ad6835b2d
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #1 from Oleksandr Natalenko <[email protected]> --- Created attachment 145781
--> https://bugzilla.kernel.org/attachment.cgi?id=145781&action=edit/proc/cpuinfo
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #2 from Oleksandr Natalenko <[email protected]> --- Created attachment 145791
--> https://bugzilla.kernel.org/attachment.cgi?id=145791&action=editlsb_release -rd
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #3 from Oleksandr Natalenko <[email protected]> --- Created attachment 145801
--> https://bugzilla.kernel.org/attachment.cgi?id=145801&action=edit
Stacktrace via netconsole
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #4 from Oleksandr Natalenko <[email protected]> --- Created attachment 145811
--> https://bugzilla.kernel.org/attachment.cgi?id=145811&action=edit
lspci output
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #5 from Oleksandr Natalenko <[email protected]> --- Disabling cpufreq section in kernel configuration seems to work around this issue.
Using NOHZ_IDLE instead of NOHZ_FULL doesn't fix the issue (I also suspected RCU bugs or so).
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #6 from Oleksandr Natalenko <[email protected]> --- Created attachment 145821
--> https://bugzilla.kernel.org/attachment.cgi?id=145821&action=edit
sudo lspci -vv output
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #7 from Oleksandr Natalenko <[email protected]> --- Created attachment 145831
--> https://bugzilla.kernel.org/attachment.cgi?id=145831&action=edit/proc/modules
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
Oleksandr Natalenko <[email protected]> changed:
What |Removed |Added
----------------------------------------------------------------------------
Attachment #145821|sudo lspci -vv output |sudo lspci -vvv output
description| |Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #8 from Oleksandr Natalenko <[email protected]> --- Launchpad bugreport:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1352567
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #9 from Oleksandr Natalenko <[email protected]> --- Created attachment 145851
--> https://bugzilla.kernel.org/attachment.cgi?id=145851&action=edit
.config
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #10 from Oleksandr Natalenko <[email protected]> --- Created attachment 145861
--> https://bugzilla.kernel.org/attachment.cgi?id=145861&action=edit/proc/iomem
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #11 from Oleksandr Natalenko <[email protected]> --- Created attachment 145871
--> https://bugzilla.kernel.org/attachment.cgi?id=145871&action=edit/proc/ioports
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #12 from Oleksandr Natalenko <[email protected]> --- Created attachment 145881
--> https://bugzilla.kernel.org/attachment.cgi?id=145881&action=edit
/proc
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #13 from Oleksandr Natalenko <[email protected]> --- Created attachment 145891
--> https://bugzilla.kernel.org/attachment.cgi?id=145891&action=edit/proc/scsi/scsi
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #14 from Oleksandr Natalenko <[email protected]> --- Also the issue happens no matter whether acpi-cpufreq is built-in or compiled as module.
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
Ayan <[email protected]> changed:
What |Removed |Added
----------------------------------------------------------------------------
CC| |[email protected]
--- Comment #15 from Ayan <[email protected]> ---
I am trying to recreate the issue on my system. I am running 3.16 kernel on a x86 machine. I have made a small script which tries to load the cpu( for increasing the cpu frequency) and then sleeps for some time( to decrease the cpu frequency). My cpufreq governor is "ondemand".
My request to you is to use the same script which I will upload and provide me the last log of the script before the system hangs up. I have been executing the script for the last one hour but I have not observed any hang-up
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #16 from Ayan <[email protected]> --- Created attachment 146301
--> https://bugzilla.kernel.org/attachment.cgi?id=146301&action=edit
Script to increase/decrease the cpu load
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #17 from Oleksandr Natalenko <[email protected]> --- @Ayan: I've put pr_info to cpufreq transition notifiers, and what I can see is that frequency changes often enough (several times per second), so there's no need to do extra CPU load/relax cycles.
Also, machine could hang after 2 hours of successful uptime, or after 25 hours, and there's no obvious reason for hang.
To answer your question, I've tried your script (stress-testing for several hours), and got nohing as well, but that is not significant result.
You may follow linux-pm thread where Viresh tells me how to debug this issue:
http://marc.info/?l=linux-pm&m=140786965520720&w=2
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU - AMD Athlon(tm) 5150 APU with Radeon(tm) R3
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
Len Brown <[email protected]> changed:
What |Removed |Added
----------------------------------------------------------------------------
CC| |[email protected] Summary|OOPS in cpufreq driver with |OOPS in cpufreq driver with |AMD Kaveri CPU |AMD Kaveri CPU - AMD | |Athlon(tm) 5150 APU with | |Radeon(tm) R3
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU - AMD Athlon(tm) 5150 APU with Radeon(tm) R3
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
--- Comment #18 from Oleksandr Natalenko <[email protected]> --- It seems that this bug has nothing to do with acpi-cpufreq code but with another ACPI area.
With ACPI enabled kernel may hang in a day or in a week (never survived more than approx. 2 weeks). With acpi=off it seems to work OK. For instance, I had to boot Ubuntu installer with acpi disabled to finish it successfully.
Usually, hanging is not accompanied by panic log. Only small vertical red lines appear on the screen near letters (tried to use plaintext 80x25 console without radeon and got the same issue).
Still observing this for 3.16 kernel.
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU - AMD Athlon(tm) 5150 APU with Radeon(tm) R3
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
Len Brown <[email protected]> changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|NEW |NEEDINFO
--- Comment #19 from Len Brown <[email protected]> ---
Subject: Re: [BUG] oops in cpufreq driver with AMD Kaveri CPU From: Oleksandr Natalenko <oleksandr () natalenko ! name> Date: 2014-11-18 19:07:51
acpi=off as well as disabling ASPM and NMI watchdog didn't help
Now trying to update BIOS.
P.S. Still affected while using 3.17.2 kernel.
ref. http://marc.info/?l=linux-acpi&m=141633767812764&w=2
Did the BIOS update help?
Are you certain that running an old kernel is stable?
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.
[Bug 81701] OOPS in cpufreq driver with AMD Kaveri CPU - AMD Athlon(tm) 5150 APU with Radeon(tm) R3
In reply to [email protected]https://bugzilla.kernel.org/show_bug.cgi?id=81701
Oleksandr Natalenko <[email protected]> changed:
What |Removed |Added
----------------------------------------------------------------------------
Status|NEEDINFO |CLOSED
Resolution|--- |INVALID--- Comment #20 from Oleksandr Natalenko <[email protected]> --- Definitely not a kernel bug.
I've replaced RAM module with another one and the issue went away.
No idea why oopses refered to ACPI, but they seem to be the result of simple hardware incompatibility.
Signature · 2 lines
You are receiving this mail because: You are the assignee for the bug.