ACPI: Be in TS_POLLING state during mwait based C-state entry
Len Brown
reviewerPATCH 1/1 ACPI: Be in TS_POLLING state during mwait based C-state entry
From: Pallipadi, Venkatesh <[email protected]>
upstream d306ebc28649b89877a22158fe0076f06cc46f60
ACPI deep C-state entry had a long standing bug/missing feature, wherein we were sending resched IPIs when an idle CPU is in mwait based deep C-state. Only mwait based C1 was using the write to the monitored address to wake up mwait'ing CPU.
This patch changes the code to retain TS_POLLING bit if we are entering an mwait based deep C-state.
The patch has been verified to reduce the number of resched IPIs in general and also improves the performance/power on workloads with low system utilization (i.e., when mwait based deep C-states are being used).
Fixes "netperf ~50% regression with 2.6.33-rc1, bisect to 1b9508f"
http://marc.info/?l=linux-kernel&m=126441481427331&w=4
--- drivers/acpi/processor_idle.c | 28 ++++++++++++++++------------ 1 files changed, 16 insertions(+), 12 deletions(-)
drivers/acpi/processor_idle.c +16 -12
@@ -880,12 +880,14 @@ static int acpi_idle_enter_simple(struct cpuidle_device *dev,return (acpi_idle_enter_c1 (dev, state));local_irq_disable (); -current_thread_info ()->status &= ~TS_POLLING ; -/* -* TS_POLLING-cleared state must be visible before we test -* NEED_RESCHED: -*/ -smp_mb (); +if (cx->entry_method !=ACPI_CSTATE_FFH ) { +current_thread_info ()->status &= ~TS_POLLING ; +/* +* TS_POLLING-cleared state must be visible before we test +* NEED_RESCHED: +*/ +smp_mb (); + }if (unlikely (need_resched ())) {current_thread_info ()->status |=TS_POLLING ;
@@ -965,12 +967,14 @@ static int acpi_idle_enter_bm(struct cpuidle_device *dev, }local_irq_disable (); -current_thread_info ()->status &= ~TS_POLLING ; -/* -* TS_POLLING-cleared state must be visible before we test -* NEED_RESCHED: -*/ -smp_mb (); +if (cx->entry_method !=ACPI_CSTATE_FFH ) { +current_thread_info ()->status &= ~TS_POLLING ; +/* +* TS_POLLING-cleared state must be visible before we test +* NEED_RESCHED: +*/ +smp_mb (); + }if (unlikely (need_resched ())) {current_thread_info ()->status |=TS_POLLING ;
Signature · 1 line
1.7.0.83.g241b9