Skip to content

big.LITTLE low-level CPU and cluster power management

Dave Martin linux-arm-kernel linux-tegra 1 version New

Get series with b4
b4 am [email protected]

Versions newest first

  1. v1 Latest16 patches 0 repliesNew

Patches in v1 No applies recorded yet

#Subject and filesSizeRepliesApplied
1/16ARM: b.L: secondary kernel entry code+0 -00 replies
1/16ARM: b.L: secondary kernel entry code+0 -00 replies
2/16ARM: b.L: introduce the CPU/cluster power API+0 -00 replies
3/16ARM: b.L: introduce helpers for platform coherency exit/setuparch/arm/common/bL_entry.c arch/arm/include/asm/bL_entry.h+4 -21 reply
3/16ARM: b.L: introduce helpers for platform coherency exit/setup+0 -00 replies
3/16ARM: b.L: introduce helpers for platform coherency exit/setup+0 -00 replies
3/16ARM: b.L: introduce helpers for platform coherency exit/setup+0 -00 replies
3/16ARM: b.L: introduce helpers for platform coherency exit/setup+0 -01 reply
3/16ARM: b.L: introduce helpers for platform coherency exit/setuparch/arm/common/bL_entry.c+44 -131 reply
3/16ARM: b.L: introduce helpers for platform coherency exit/setup+0 -01 reply
4/16ARM: b.L: Add baremetal voting mutexes+0 -00 replies
6/16ARM: b.L: generic SMP secondary bringup and hotplug support+0 -00 replies
6/16ARM: b.L: generic SMP secondary bringup and hotplug support+0 -00 replies
7/16ARM: bL_platsmp.c: close the kernel entry gate before hot-unplugging a CPU+0 -01 reply
13/16drivers: misc: add ARM CCI support+0 -00 replies
14/16ARM: TC2: ensure powerdown-time data is flushed from cache+0 -01 reply
14/16ARM: TC2: ensure powerdown-time data is flushed from cache+0 -00 replies
15/16ARM: vexpress/dcscb: handle platform coherency exit/setup and CCIarch/arm/mach-vexpress/dcscb.c+1 -10 replies
15/16ARM: vexpress/dcscb: handle platform coherency exit/setup and CCI+0 -03 replies

Reviews trailers per patch

No Reviewed-by, Acked-by or Tested-by trailers for v1 yet.

Read the v1 thread

Cover letter [PATCH 00/16] big.LITTLE low-level CPU and cluster power management
Quoted 88 lines · Nicolas Pitre
Quoted 53 lines · Joseph Lo

Hi Nicolas,

Quoted 40 lines · Nicolas Pitre

This is the initial public posting of the initial support for big.LITTLE. Included here is the code required to safely power up and down CPUs in a b.L system, whether this is via CPU hotplug, a cpuidle driver or the Linaro b.L in-kernel switcher[*] on top of this. Only SMP secondary boot and CPU hotplug support is included at this time. Getting to this point already represents a significcant chunk of code as illustrated by the diffstat below.

This work was presented at Linaro Connect in Copenhagen by Dave Martin and myself. The presentation slides are available here:

http://www.linaro.org/documents/download/f3569407bb1fb8bde0d6da80e285b832508f92f57223c

The code is now stable on both Fast Models as well as Virtual Express TC2 and ready for public review.

Platform support is included for Fast Models implementing the Cortex-A15x4-A7x4 and Cortex-A15x1-A7x1 configurations. To allow successful compilation, I also included a preliminary version of the CCI400 driver from Lorenzo Pieralisi.

Support for actual hardware such as Vexpress TC2 should come later, once the basic infrastructure from this series is merged. A few DT bindings are used but not yet documented.

This series is made of the following parts:

Low-level support code:
[PATCH 01/16] ARM: b.L: secondary kernel entry code [PATCH 02/16] ARM: b.L: introduce the CPU/cluster power API [PATCH 03/16] ARM: b.L: introduce helpers for platform coherency [PATCH 04/16] ARM: b.L: Add baremetal voting mutexes [PATCH 05/16] ARM: bL_head: vlock-based first man election

Adaptation layer to hook with the generic kernel infrastructure:
[PATCH 06/16] ARM: b.L: generic SMP secondary bringup and hotplug [PATCH 07/16] ARM: bL_platsmp.c: close the kernel entry gate before [PATCH 08/16] ARM: bL_platsmp.c: make sure the GIC interface of a [PATCH 09/16] ARM: vexpress: Select the correct SMP operations at

Quoted 9 lines

Fast Models support:
[PATCH 10/16] ARM: vexpress: introduce DCSCB support [PATCH 11/16] ARM: vexpress/dcscb: add CPU use counts to the power [PATCH 12/16] ARM: vexpress/dcscb: do not hardcode number of CPUs [PATCH 13/16] drivers: misc: add ARM CCI support
[PATCH 14/16] ARM: TC2: ensure powerdown-time data is flushed from [PATCH 15/16] ARM: vexpress/dcscb: handle platform coherency [PATCH 16/16] ARM: vexpress/dcscb: probe via device tree

Quoted 5 lines

Thanks for introducing this series.
I am taking a look at this series. It introduced an algorithm for syncing and avoid racing when syncing the power status of clusters and CPUs. Do you think these codes could have a chance to become a generic framework?

Yes. As I mentioned before, the bL_ prefix is implied only by the fact that big.LITTLE was the motivation for creating this code.

Quoted 1 line

The Tegra chip series had a similar design for CPU clusters and it

had

Quoted 11 lines

limitation that the CPU0 always needs to be the last CPU to be shut down before cluster power down as well. I believe it can also get benefits of this works. We indeed need a similar algorithm to sync CPUs power status before cluster power down and switching.

The "bL_entry.c", "bL_entry.S", "bL_entry.h", "vlock.h" and "vlock.S" looks have a chance to be a common framework for ARM platform even if it just support one cluster. Because some systems had the limitations for cluster power down. That's why the coupled cpuidle been introduced. And this framework could be enabled automatically if platform dependent or by menuconfig.

Absolutely.

Quoted 4 lines

For ex,

	select CPUS_CLUSTERS_POWER_SYNC_FRAMEWORK if SMP && CPU_PM

How do you think of this suggestion?

I'd prefer a more concise name though.

Quoted 8 lines
Quoted 6 lines

BTW, some questions...
1. The "bL_entry_point" looks like a first run function when CPUs just power up, then jumping to original reset vector that it should be called. Do you think this should be a function and be called by reset handler? Or in your design, this should be called as soon as possible when the CPU power be resumed?

This should be called as soon as possible.

For one thing, you can't safely turn on the MMU or do anything which may affect any other CPU, until the code at bL_entry_point has run.

On most real hardware, the first thing to run on a powered-up CPU will be some boot ROM or firmware, but we expect bL_entry_point to be the initial entry point into Linux in these scenarios.

Quoted 11 lines
Quoted 3 lines

2. Does the Last_man mechanism should implement in platform specific code to check something like cpu_online_status and if there is a limitation for the specific last CPU to be powered down?

The selection of the last man is accomplished using a platform specific mechanism. By the time this has to be done, the CPU is already dead as far as the Linux kernel is concerned, and therefore the generic CPU map is not reliable. In the DCSCB case we simply look at the hardware reset register being modified to directly determine the last man. On TC2 (not yet posted) we have to keep a local map of online CPUs.

Quoted 2 lines

In your case, the selection of the last man would simply be forced on CPU0.

Things are actually simpler in your scenario, because there is only one CPU that can possibly become the last man. However, the algorithm could still be re-used: it doesn't matter that it is "too safe" for your situation, and some aspects remain important, such as checking for CPUs unexpectedly powering up while a cluster power- down is pending, for example.

Cheers
---Dave