cpuidle/pseries: Fix kernel command line parameter smt-snooze-delay
smt-snooze-delay is a tun-able provided currently on powerpc to delay the entry of an idle cpu to NAP state. By default, the value is 100us, which is entry criteria for NAP state i.e only if the idle period is above 100us it would enter NAP. Value of -1 disables entry into NAP. This value can be set either through sysfs, ppc64_cpu util or by passing it via kernel command line. Currently this feature is broken when the value is passed via the kernel command line.
This patch aims to fix this, by taking the appropriate action based on the value after the pseries driver is registered. This check is carried on in the back-end driver rather than setup_smt_snooze_delay(), as one is not sure if the cpuidle driver is even registered when setup routine is executed. Also, this fixes re-enabling of NAP states by setting appropriate value without having to reboot using smt-snooze-delay parameter.
Also, to note is, smt-snooze-delay is per-cpu variable. This can be used to enable/disable NAP on per-cpu basis using sysfs but when this variable is passed via kernel command line or using the smt-snooze-delay it applies to all the cpus. Per-cpu tuning can only be done via sysfs.
--- arch/powerpc/platforms/pseries/processor_idle.c | 34 ++++++++++++++++++----- 1 file changed, 27 insertions(+), 7 deletions(-)
arch/powerpc/platforms/pseries/processor_idle.c +27 -7
@@ -170,18 +170,36 @@ static struct cpuidle_state shared_states[MAX_IDLE_STATE_COUNT] = {void update_smt_snooze_delay (int cpu,int residency) {struct cpuidle_driver *drv =cpuidle_get_driver (); -struct cpuidle_device *dev =per_cpu (cpuidle_devices, cpu); +struct cpuidle_device *dev;if (cpuidle_state_table != dedicated_states)return ; -if (residency <0 ) { -/* Disable the Nap state on that cpu */ -if (dev) - dev->states_usage[1 ].disable =1 ; - }else -if (drv) +if (!drv) +return ; + +if (cpu ==-1 ) { +if (residency <0 ) { +/* Disable NAP on all cpus */ + drv->states[1 ].disabled = true; + }else { drv->states[1 ].target_residency = residency; + drv->states[1 ].disabled = false; + } +return ; + } + + dev =per_cpu (cpuidle_devices, cpu); +if (!dev) +return ; + +if (residency <0 ) + dev->states_usage[1 ].disable =1 ; +else { + drv->states[1 ].target_residency = residency; + drv->states[1 ].disabled = false; + dev->states_usage[1 ].disable =0 ; + } } static int pseries_cpuidle_add_cpu_notifier(struct notifier_block *n,
@@ -331,6 +349,8 @@ static int __init pseries_processor_idle_init(void)return retval; } +update_smt_snooze_delay (-1 ,per_cpu (smt_snooze_delay,0 )); + retval =pseries_idle_devices_init ();if (retval) {pseries_idle_devices_uninit ();
Regards,
Deepthi
Quoted 7 lines · Deepthi Dharwar
smt-snooze-delay is a tun-able provided currently on powerpc to delay the entry of an idle cpu to NAP state. By default, the value is 100us, which is entry criteria for NAP state i.e only if the idle period is above 100us it would enter NAP. Value of -1 disables entry into NAP. This value can be set either through sysfs,
ppc64_cpuutil or by passing it via kernel command line. Currently this feature is broken when the value is passed via the kernel command line.
Has it always been broken? Or just since some commit?
Quoted 54 lines
This patch aims to fix this, by taking the appropriate action based on the value after the pseries driver is registered. This check is carried on in the back-end driver rather than
setup_smt_snooze_delay(), as one is not sure if the cpuidle driver is even registered when setup routine is executed. Also, this fixes re-enabling of NAP states by setting appropriate value without having to reboot using smt-snooze-delay parameter.Also, to note is, smt-snooze-delay is per-cpu variable. This can be used to enable/disable NAP on per-cpu basis using sysfs but when this variable is passed via kernel command line or using the smt-snooze-delay it applies to all the cpus. Per-cpu tuning can only be done via sysfs.
Signed-off-by Deepthi Dharwar <[email protected]>--- arch/powerpc/platforms/pseries/processor_idle.c | 34 ++++++++++++++++++----- 1 file changed, 27 insertions(+), 7 deletions(-)arch/powerpc/platforms/pseries/processor_idle.c +14
-7@@ -170,18 +170,36 @@ static struct cpuidle_state shared_states[MAX_IDLE_STATE_COUNT] = {void update_smt_snooze_delay (int cpu,int residency) {struct cpuidle_driver *drv =cpuidle_get_driver (); -struct cpuidle_device *dev =per_cpu (cpuidle_devices, cpu); +struct cpuidle_device *dev;if (cpuidle_state_table != dedicated_states)return ; -if (residency <0 ) { -/* Disable the Nap state on that cpu */ -if (dev) - dev->states_usage[1 ].disable =1 ; - }else -if (drv) +if (!drv) +return ; + +if (cpu ==-1 ) { +if (residency <0 ) { +/* Disable NAP on all cpus */ + drv->states[1 ].disabled = true; + }else { drv->states[1 ].target_residency = residency; + drv->states[1 ].disabled = false; + } +return ; + } +
arch/powerpc/platforms/pseries/processor_idle.c static struct cpuidle_state shared_states[MAX_IDLE_STATE_COUNT] = { · line 201
Quoted 10 lines
arch/powerpc/platforms/pseries/processor_idle.c +10
-0+ dev =per_cpu (cpuidle_devices, cpu); +if (!dev) +return ; + +if (residency <0 ) + dev->states_usage[1 ].disable =1 ; +else { + drv->states[1 ].target_residency = residency; + drv->states[1 ].disabled = false; + dev->states_usage[1 ].disable =0 ;
Why are we indexing into all these array with '1' ?
cheers
Quoted 10 lines · Michael Ellerman
Quoted 7 lines · Deepthi Dharwar
smt-snooze-delay is a tun-able provided currently on powerpc to delay the entry of an idle cpu to NAP state. By default, the value is 100us, which is entry criteria for NAP state i.e only if the idle period is above 100us it would enter NAP. Value of -1 disables entry into NAP. This value can be set either through sysfs,
ppc64_cpuutil or by passing it via kernel command line. Currently this feature is broken when the value is passed via the kernel command line.Has it always been broken? Or just since some commit?
Yes, it is broken since inclusion of pseries back-end driver, around 3.3 kernel time-frame.
Quoted 58 lines
Quoted 58 lines
This patch aims to fix this, by taking the appropriate action based on the value after the pseries driver is registered. This check is carried on in the back-end driver rather than
setup_smt_snooze_delay(), as one is not sure if the cpuidle driver is even registered when setup routine is executed. Also, this fixes re-enabling of NAP states by setting appropriate value without having to reboot using smt-snooze-delay parameter.Also, to note is, smt-snooze-delay is per-cpu variable. This can be used to enable/disable NAP on per-cpu basis using sysfs but when this variable is passed via kernel command line or using the smt-snooze-delay it applies to all the cpus. Per-cpu tuning can only be done via sysfs.
Signed-off-by Deepthi Dharwar <[email protected]>--- arch/powerpc/platforms/pseries/processor_idle.c | 34 ++++++++++++++++++----- 1 file changed, 27 insertions(+), 7 deletions(-)arch/powerpc/platforms/pseries/processor_idle.c +18
-7@@ -170,18 +170,36 @@ static struct cpuidle_state shared_states[MAX_IDLE_STATE_COUNT] = {void update_smt_snooze_delay (int cpu,int residency) {struct cpuidle_driver *drv =cpuidle_get_driver (); -struct cpuidle_device *dev =per_cpu (cpuidle_devices, cpu); +struct cpuidle_device *dev;if (cpuidle_state_table != dedicated_states)return ; -if (residency <0 ) { -/* Disable the Nap state on that cpu */ -if (dev) - dev->states_usage[1 ].disable =1 ; - }else -if (drv) +if (!drv) +return ; + +if (cpu ==-1 ) { +if (residency <0 ) { +/* Disable NAP on all cpus */ + drv->states[1 ].disabled = true; + }else { drv->states[1 ].target_residency = residency; + drv->states[1 ].disabled = false; + } +return ; + } + + dev =per_cpu (cpuidle_devices, cpu); +if (!dev) +return ; +
Quoted 8 lines
arch/powerpc/platforms/pseries/processor_idle.c static struct cpuidle_state shared_states[MAX_IDLE_STATE_COUNT] = { · line 201
Quoted 6 lines
arch/powerpc/platforms/pseries/processor_idle.c +6
-0+if (residency <0 ) + dev->states_usage[1 ].disable =1 ; +else { + drv->states[1 ].target_residency = residency; + drv->states[1 ].disabled = false; + dev->states_usage[1 ].disable =0 ;Why are we indexing into all these array with '1' ?
We are disabling/enabling NAP state, which indexes into pseries cpuidle state table array with index value of 1.
smt-snooze-delay of -1, disables NAP state.
Else, we need to set the residency of NAP state i.e minimum time CPU should spend in NAP state ( based on which menu governor takes a decision on selection of Idle state) there by delaying the entry to NAP state.
Thanks for the review.
Regards,
Deepthi
Quoted 2 lines
cheers