Invoke rpmh_flush for non OSI targets
Subsystems (4)
v8 cover Invoke rpmh_flush for non OSI targets
Changes in v8:
- Address Stephen's comments on changes 2 and 3
- Add Reviewed by from Stephen on change 1
Changes in v7:
- Address Srinivas's comments to update commit text
- Add Reviewed by from Srinivas
Changes in v6:
- Drop 1 & 2 changes from v5 as they already landed in maintainer tree
- Drop 3 & 4 changes from v5 as no user at present for power domain in rsc
- Rename subject to appropriate since power domain changes are dropped
- Rebase other changes on top of next-20200221
Changes in v5:
- Add Rob's Acked by on dt-bindings change
- Drop firmware psci change
- Update cpuidle stats in dtsi to follow PC mode
- Include change to update dirty flag when data is updated from [4]
- Add change to invoke rpmh_flush when caches are dirty
Changes in v4:
- Add change to allow hierarchical topology in PC mode
- Drop hierarchical domain idle states converter from v3
- Address Merge sc7180 dtsi change to add low power modes
Changes in v3:
- Address Rob's comment on dt property value
- Address Stephen's comments on rpmh-rsc driver change
- Include sc7180 cpuidle low power mode changes from [1]
- Include hierarchical domain idle states converter change from [2]
Changes in v2:
- Add Stephen's Reviewed-By to the first three patches
- Addressed Stephen's comments on fourth patch
- Include changes to connect rpmh domain to cpuidle and genpds
Resource State Coordinator (RSC) is responsible for powering off/lowering the requirements from CPU subsystem for the associated hardware like buses, clocks, and regulators when all CPUs and cluster is powered down.
RSC power domain uses last-man activities provided by genpd framework based on Ulf Hansoon's patch series[3], when the cluster of CPUs enter deepest idle states. As a part of domain poweroff, RSC can lower resource state requirements by flushing the cached sleep and wake state votes for various resources.
[1] https://patchwork.kernel.org/patch/11218965
[2] https://patchwork.kernel.org/patch/10941671
[3] https://patchwork.kernel.org/project/linux-arm-msm/list/?series=222355
[4] https://patchwork.kernel.org/project/linux-arm-msm/list/?series=236503
Maulik Shah (3):
arm64: dts: qcom: sc7180: Add cpuidle low power states
soc: qcom: rpmh: Update dirty flag only when data changes
soc: qcom: rpmh: Invoke rpmh_flush for dirty caches
arch/arm64/boot/dts/qcom/sc7180.dtsi | 78 ++++++++++++++++++++++++++++++++++++ drivers/soc/qcom/rpmh.c | 27 ++++++++++--- 2 files changed, 100 insertions(+), 5 deletions(-)
Signature · 2 lines
QUALCOMM INDIA, on behalf of Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum, hosted by The Linux Foundation
PATCH v8 1/3 arm64: dts: qcom: sc7180: Add cpuidle low power states
Add device bindings for cpuidle states for cpu devices.
--- arch/arm64/boot/dts/qcom/sc7180.dtsi | 78 ++++++++++++++++++++++++++++++++++++ 1 file changed, 78 insertions(+)
arch/arm64/boot/dts/qcom/sc7180.dtsi +78 -0
@@ -86,6 +86,9 @@ compatible = "arm,armv8"; reg = <0x0 0x0>; enable-method = "psci"; + cpu-idle-states = <&LITTLE_CPU_SLEEP_0 + &LITTLE_CPU_SLEEP_1 + &CLUSTER_SLEEP_0>; next-level-cache = <&L2_0>; #cooling-cells = <2>; qcom,freq-domain = <&cpufreq_hw 0>;
@@ -103,6 +106,9 @@ compatible = "arm,armv8"; reg = <0x0 0x100>; enable-method = "psci"; + cpu-idle-states = <&LITTLE_CPU_SLEEP_0 + &LITTLE_CPU_SLEEP_1 + &CLUSTER_SLEEP_0>; next-level-cache = <&L2_100>; #cooling-cells = <2>; qcom,freq-domain = <&cpufreq_hw 0>;
@@ -117,6 +123,9 @@ compatible = "arm,armv8"; reg = <0x0 0x200>; enable-method = "psci"; + cpu-idle-states = <&LITTLE_CPU_SLEEP_0 + &LITTLE_CPU_SLEEP_1 + &CLUSTER_SLEEP_0>; next-level-cache = <&L2_200>; #cooling-cells = <2>; qcom,freq-domain = <&cpufreq_hw 0>;
@@ -131,6 +140,9 @@ compatible = "arm,armv8"; reg = <0x0 0x300>; enable-method = "psci"; + cpu-idle-states = <&LITTLE_CPU_SLEEP_0 + &LITTLE_CPU_SLEEP_1 + &CLUSTER_SLEEP_0>; next-level-cache = <&L2_300>; #cooling-cells = <2>; qcom,freq-domain = <&cpufreq_hw 0>;
@@ -145,6 +157,9 @@ compatible = "arm,armv8"; reg = <0x0 0x400>; enable-method = "psci"; + cpu-idle-states = <&LITTLE_CPU_SLEEP_0 + &LITTLE_CPU_SLEEP_1 + &CLUSTER_SLEEP_0>; next-level-cache = <&L2_400>; #cooling-cells = <2>; qcom,freq-domain = <&cpufreq_hw 0>;
@@ -159,6 +174,9 @@ compatible = "arm,armv8"; reg = <0x0 0x500>; enable-method = "psci"; + cpu-idle-states = <&LITTLE_CPU_SLEEP_0 + &LITTLE_CPU_SLEEP_1 + &CLUSTER_SLEEP_0>; next-level-cache = <&L2_500>; #cooling-cells = <2>; qcom,freq-domain = <&cpufreq_hw 0>;
@@ -173,6 +191,9 @@ compatible = "arm,armv8"; reg = <0x0 0x600>; enable-method = "psci"; + cpu-idle-states = <&BIG_CPU_SLEEP_0 + &BIG_CPU_SLEEP_1 + &CLUSTER_SLEEP_0>; next-level-cache = <&L2_600>; #cooling-cells = <2>; qcom,freq-domain = <&cpufreq_hw 1>;
@@ -187,6 +208,9 @@ compatible = "arm,armv8"; reg = <0x0 0x700>; enable-method = "psci"; + cpu-idle-states = <&BIG_CPU_SLEEP_0 + &BIG_CPU_SLEEP_1 + &CLUSTER_SLEEP_0>; next-level-cache = <&L2_700>; #cooling-cells = <2>; qcom,freq-domain = <&cpufreq_hw 1>;
@@ -195,6 +219,60 @@ next-level-cache = <&L3_0>; }; }; + + idle-states { + entry-method = "psci"; + + LITTLE_CPU_SLEEP_0: cpu-sleep-0-0 { + compatible = "arm,idle-state"; + idle-state-name = "little-power-down"; + arm,psci-suspend-param = <0x40000003>; + entry-latency-us = <549>; + exit-latency-us = <901>; + min-residency-us = <1774>; + local-timer-stop; + }; + + LITTLE_CPU_SLEEP_1: cpu-sleep-0-1 { + compatible = "arm,idle-state"; + idle-state-name = "little-rail-power-down"; + arm,psci-suspend-param = <0x40000004>; + entry-latency-us = <702>; + exit-latency-us = <915>; + min-residency-us = <4001>; + local-timer-stop; + }; + + BIG_CPU_SLEEP_0: cpu-sleep-1-0 { + compatible = "arm,idle-state"; + idle-state-name = "big-power-down"; + arm,psci-suspend-param = <0x40000003>; + entry-latency-us = <523>; + exit-latency-us = <1244>; + min-residency-us = <2207>; + local-timer-stop; + }; + + BIG_CPU_SLEEP_1: cpu-sleep-1-1 { + compatible = "arm,idle-state"; + idle-state-name = "big-rail-power-down"; + arm,psci-suspend-param = <0x40000004>; + entry-latency-us = <526>; + exit-latency-us = <1854>; + min-residency-us = <5555>; + local-timer-stop; + }; + + CLUSTER_SLEEP_0: cluster-sleep-0 { + compatible = "arm,idle-state"; + idle-state-name = "cluster-power-down"; + arm,psci-suspend-param = <0x40003444>; + entry-latency-us = <3263>; + exit-latency-us = <6562>; + min-residency-us = <9926>; + local-timer-stop; + }; + }; }; memory@80000000 {
Signature · 2 lines
QUALCOMM INDIA, on behalf of Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum, hosted by The Linux Foundation
PATCH v8 2/3 soc: qcom: rpmh: Update dirty flag only when data changes
In reply to Maulik ShahCurrently rpmh ctrlr dirty flag is set for all cases regardless of data is really changed or not. Add changes to update dirty flag when data is changed to newer values.
Also move dirty flag updates to happen from within cache_lock and remove unnecessary INIT_LIST_HEAD() call and a default case from switch.
--- drivers/soc/qcom/rpmh.c | 29 ++++++++++++++++------------- 1 file changed, 16 insertions(+), 13 deletions(-)
drivers/soc/qcom/rpmh.c +16 -13
@@ -133,26 +133,30 @@ static struct cache_req *cache_rpm_request(struct rpmh_ctrlr *ctrlr, req->addr = cmd->addr; req->sleep_val = req->wake_val =UINT_MAX ; -INIT_LIST_HEAD (&req->list);list_add_tail (&req->list, &ctrlr->cache); existing:switch (state) {case RPMH_ACTIVE_ONLY_STATE : -if (req->sleep_val !=UINT_MAX ) +if (req->sleep_val !=UINT_MAX ) { req->wake_val = cmd->data; + ctrlr->dirty = true; + }break ;case RPMH_WAKE_ONLY_STATE : - req->wake_val = cmd->data; +if (req->wake_val != cmd->data) { + req->wake_val = cmd->data; + ctrlr->dirty = true; + }break ;case RPMH_SLEEP_STATE : - req->sleep_val = cmd->data; -break ; -default : +if (req->sleep_val != cmd->data) { + req->sleep_val = cmd->data; + ctrlr->dirty = true; + }break ; } - ctrlr->dirty = true; unlock:spin_unlock_irqrestore (&ctrlr->cache_lock, flags);
@@ -287,6 +291,7 @@ static void cache_batch(struct rpmh_ctrlr *ctrlr, struct batch_cache_req *req)spin_lock_irqsave (&ctrlr->cache_lock, flags);list_add_tail (&req->list, &ctrlr->batch_cache); + ctrlr->dirty = true;spin_unlock_irqrestore (&ctrlr->cache_lock, flags); }
@@ -323,6 +328,7 @@ static void invalidate_batch(struct rpmh_ctrlr *ctrlr)list_for_each_entry_safe (req, tmp, &ctrlr->batch_cache, list)kfree (req);INIT_LIST_HEAD (&ctrlr->batch_cache); + ctrlr->dirty = true;spin_unlock_irqrestore (&ctrlr->cache_lock, flags); }
@@ -456,13 +462,9 @@ static int send_single(struct rpmh_ctrlr *ctrlr, enum rpmh_state state,int rpmh_flush (struct rpmh_ctrlr *ctrlr) {struct cache_req *p; +unsigned long flags;int ret; -if (!ctrlr->dirty) { -pr_debug ("Skipping flush, TCS has latest data.\n" ); -return 0 ; - } -/* First flush the cached batch requests */ ret =flush_batch (ctrlr);if (ret)
@@ -488,7 +490,9 @@ int rpmh_flush(struct rpmh_ctrlr *ctrlr)return ret; } +spin_lock_irqsave (&ctrlr->cache_lock, flags); ctrlr->dirty = false; +spin_unlock_irqrestore (&ctrlr->cache_lock, flags);return 0 ; }
@@ -507,7 +511,6 @@ int rpmh_invalidate(const struct device *dev)int ret;invalidate_batch (ctrlr); - ctrlr->dirty = true; do { ret = rpmh_rsc_invalidate(ctrlr_to_drv(ctrlr));
Signature · 2 lines
QUALCOMM INDIA, on behalf of Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum, hosted by The Linux Foundation
Re: [PATCH v8 2/3] soc: qcom: rpmh: Update dirty flag only when data changes
Quoted 20 lines · Maulik Shah
Currently rpmh ctrlr dirty flag is set for all cases regardless of data is really changed or not. Add changes to update dirty flag when data is changed to newer values.
Also move dirty flag updates to happen from within
cache_lockand remove unnecessaryINIT_LIST_HEAD()call and a default case from switch.Fixes 600513dfeef3 ("drivers: qcom: rpmh: cache sleep/wake state requests")Signed-off-by Maulik Shah <[email protected]>Reviewed-by Srinivas Rao L <[email protected]>--- drivers/soc/qcom/rpmh.c | 29 ++++++++++++++++------------- 1 file changed, 16 insertions(+), 13 deletions(-)drivers/soc/qcom/rpmh.c +0
-0
drivers/soc/qcom/rpmh.c static struct cache_req *cache_rpm_request(struct rpmh_ctrlr *ctrlr, · line 136
Quoted 4 lines
drivers/soc/qcom/rpmh.c +0
-1@@ -133,26 +133,30 @@ static struct cache_req *cache_rpm_request(struct rpmh_ctrlr *ctrlr, req->addr = cmd->addr; req->sleep_val = req->wake_val =UINT_MAX ; -INIT_LIST_HEAD (&req->list);
Thanks!
Quoted 65 lines
drivers/soc/qcom/rpmh.c +14
-11list_add_tail (&req->list, &ctrlr->cache); existing:switch (state) {case RPMH_ACTIVE_ONLY_STATE : -if (req->sleep_val !=UINT_MAX ) +if (req->sleep_val !=UINT_MAX ) { req->wake_val = cmd->data; + ctrlr->dirty = true; + }break ;case RPMH_WAKE_ONLY_STATE : - req->wake_val = cmd->data; +if (req->wake_val != cmd->data) { + req->wake_val = cmd->data; + ctrlr->dirty = true; + }break ;case RPMH_SLEEP_STATE : - req->sleep_val = cmd->data; -break ; -default : +if (req->sleep_val != cmd->data) { + req->sleep_val = cmd->data; + ctrlr->dirty = true; + }break ; } - ctrlr->dirty = true; unlock:spin_unlock_irqrestore (&ctrlr->cache_lock, flags);@@ -287,6 +291,7 @@ static void cache_batch(struct rpmh_ctrlr *ctrlr, struct batch_cache_req *req)spin_lock_irqsave (&ctrlr->cache_lock, flags);list_add_tail (&req->list, &ctrlr->batch_cache); + ctrlr->dirty = true;spin_unlock_irqrestore (&ctrlr->cache_lock, flags); }@@ -323,6 +328,7 @@ static void invalidate_batch(struct rpmh_ctrlr *ctrlr)list_for_each_entry_safe (req, tmp, &ctrlr->batch_cache, list)kfree (req);INIT_LIST_HEAD (&ctrlr->batch_cache); + ctrlr->dirty = true;spin_unlock_irqrestore (&ctrlr->cache_lock, flags); }@@ -456,13 +462,9 @@ static int send_single(struct rpmh_ctrlr *ctrlr, enum rpmh_state state,int rpmh_flush (struct rpmh_ctrlr *ctrlr) {struct cache_req *p; +unsigned long flags;int ret; -if (!ctrlr->dirty) { -pr_debug ("Skipping flush, TCS has latest data.\n" ); -return 0 ; - } -/* First flush the cached batch requests */ ret =flush_batch (ctrlr);if (ret)
drivers/soc/qcom/rpmh.c int rpmh_flush(struct rpmh_ctrlr *ctrlr) · line 495
Quoted 6 lines
drivers/soc/qcom/rpmh.c +2
-0@@ -488,7 +490,9 @@ int rpmh_flush(struct rpmh_ctrlr *ctrlr)return ret; } +spin_lock_irqsave (&ctrlr->cache_lock, flags); ctrlr->dirty = false; +spin_unlock_irqrestore (&ctrlr->cache_lock, flags);
You're acquiring a lock around an operation that's already inherently atomic, which is not right. If the comment earlier in this function is still correct that "Nobody else should be calling this function other than system PM, hence we can run without locks", then you can simply remove this hunk and the part moving ->dirty = true into invalidate_batch.
However, if rpmh_flush() can now be called in a scenario where pre-emption is enabled or multiple cores are alive, then ctrlr->cache is no longer adequately protected. You'd need to add a lock acquire/release around the list iteration above, and fix up the comment.
-Evan
Re: [PATCH v8 2/3] soc: qcom: rpmh: Update dirty flag only when data changes
Quoted 104 lines · Evan Green
Quoted 19 lines · Maulik Shah
Currently rpmh ctrlr dirty flag is set for all cases regardless of data is really changed or not. Add changes to update dirty flag when data is changed to newer values.
Also move dirty flag updates to happen from within
cache_lockand remove unnecessaryINIT_LIST_HEAD()call and a default case from switch.Fixes 600513dfeef3 ("drivers: qcom: rpmh: cache sleep/wake state requests")Signed-off-by Maulik Shah <[email protected]>Reviewed-by Srinivas Rao L <[email protected]>--- drivers/soc/qcom/rpmh.c | 29 ++++++++++++++++------------- 1 file changed, 16 insertions(+), 13 deletions(-)drivers/soc/qcom/rpmh.c +0
-0drivers/soc/qcom/rpmh.c static struct cache_req *cache_rpm_request(struct rpmh_ctrlr *ctrlr, · line 136
Quoted 4 lines
drivers/soc/qcom/rpmh.c +0
-1@@ -133,26 +133,30 @@ static struct cache_req *cache_rpm_request(struct rpmh_ctrlr *ctrlr, req->addr = cmd->addr; req->sleep_val = req->wake_val =UINT_MAX ; -INIT_LIST_HEAD (&req->list);Thanks!
Quoted 65 lines
drivers/soc/qcom/rpmh.c +14
-11list_add_tail (&req->list, &ctrlr->cache); existing:switch (state) {case RPMH_ACTIVE_ONLY_STATE : -if (req->sleep_val !=UINT_MAX ) +if (req->sleep_val !=UINT_MAX ) { req->wake_val = cmd->data; + ctrlr->dirty = true; + }break ;case RPMH_WAKE_ONLY_STATE : - req->wake_val = cmd->data; +if (req->wake_val != cmd->data) { + req->wake_val = cmd->data; + ctrlr->dirty = true; + }break ;case RPMH_SLEEP_STATE : - req->sleep_val = cmd->data; -break ; -default : +if (req->sleep_val != cmd->data) { + req->sleep_val = cmd->data; + ctrlr->dirty = true; + }break ; } - ctrlr->dirty = true; unlock:spin_unlock_irqrestore (&ctrlr->cache_lock, flags);@@ -287,6 +291,7 @@ static void cache_batch(struct rpmh_ctrlr *ctrlr, struct batch_cache_req *req)spin_lock_irqsave (&ctrlr->cache_lock, flags);list_add_tail (&req->list, &ctrlr->batch_cache); + ctrlr->dirty = true;spin_unlock_irqrestore (&ctrlr->cache_lock, flags); }@@ -323,6 +328,7 @@ static void invalidate_batch(struct rpmh_ctrlr *ctrlr)list_for_each_entry_safe (req, tmp, &ctrlr->batch_cache, list)kfree (req);INIT_LIST_HEAD (&ctrlr->batch_cache); + ctrlr->dirty = true;spin_unlock_irqrestore (&ctrlr->cache_lock, flags); }@@ -456,13 +462,9 @@ static int send_single(struct rpmh_ctrlr *ctrlr, enum rpmh_state state,int rpmh_flush (struct rpmh_ctrlr *ctrlr) {struct cache_req *p; +unsigned long flags;int ret; -if (!ctrlr->dirty) { -pr_debug ("Skipping flush, TCS has latest data.\n" ); -return 0 ; - } -/* First flush the cached batch requests */ ret =flush_batch (ctrlr);if (ret)drivers/soc/qcom/rpmh.c int rpmh_flush(struct rpmh_ctrlr *ctrlr) · line 495
Quoted 6 lines
drivers/soc/qcom/rpmh.c +2
-0@@ -488,7 +490,9 @@ int rpmh_flush(struct rpmh_ctrlr *ctrlr)return ret; } +spin_lock_irqsave (&ctrlr->cache_lock, flags); ctrlr->dirty = false; +spin_unlock_irqrestore (&ctrlr->cache_lock, flags);You're acquiring a lock around an operation that's already inherently atomic, which is not right. If the comment earlier in this function is still correct that "Nobody else should be calling this function other than system PM, hence we can run without locks", then you can simply remove this hunk and the part moving ->dirty = true into
invalidate_batch.
Quoted 6 lines
However, if
rpmh_flush()can now be called in a scenario where pre-emption is enabled or multiple cores are alive, thenctrlr->cacheis no longer adequately protected. You'd need to add a lock acquire/release around the list iteration above, and fix up the comment.
-Evan
Hi Evan,
Right, rpmh_flush() now can be called from any cpu. i will remove comments from above.
part for rpmh_flush(), flush_batch() and ctrlr->dirty update was already covered within cache lock, however its needed to protect
entire rpmh_flush() in cache_lock now.
updates in v9.
Thanks,
Maulik
Signature · 1 line
QUALCOMM INDIA, on behalf of Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum, hosted by The Linux Foundation
PATCH v8 3/3 soc: qcom: rpmh: Invoke rpmh_flush() for dirty caches
In reply to Maulik ShahAdd changes to invoke rpmh flush() when the data in cache is dirty.
This is done only if OSI is not supported in PSCI. If OSI is supported rpmh_flush can get invoked when the last cpu going to power collapse deepest low power mode.
Also remove "depends on COMPILE_TEST" for Kconfig option QCOM_RPMH so the driver is only compiled for arm64 which supports psci_has_osi_support() API.
--- drivers/soc/qcom/Kconfig | 2 +- drivers/soc/qcom/rpmh.c | 6 ++++++ 2 files changed, 7 insertions(+), 1 deletion(-)
drivers/soc/qcom/Kconfig +1 -1
@@ -105,7 +105,7 @@ config QCOM_RMTFS_MEM config QCOM_RPMH bool "Qualcomm RPM-Hardened (RPMH) Communication" - depends on ARCH_QCOM && ARM64 || COMPILE_TEST + depends on ARCH_QCOM && ARM64 help Support for communication with the hardened-RPM blocks in Qualcomm Technologies Inc (QTI) SoCs. RPMH communication uses an
drivers/soc/qcom/rpmh.c +6 -0
@@ -12,6 +12,7 @@#include <linux/module.h> #include <linux/of.h> #include <linux/platform_device.h> +#include <linux/psci.h> #include <linux/slab.h> #include <linux/spinlock.h> #include <linux/types.h>
@@ -160,6 +161,9 @@ static struct cache_req *cache_rpm_request(struct rpmh_ctrlr *ctrlr, unlock:spin_unlock_irqrestore (&ctrlr->cache_lock, flags); +if (ctrlr->dirty && !psci_has_osi_support ()) +return rpmh_flush (ctrlr) ?ERR_PTR (-EINVAL ) : req; +return req; }
@@ -388,6 +392,8 @@ int rpmh_write_batch(const struct device *dev, enum rpmh_state state,if (state !=RPMH_ACTIVE_ONLY_STATE ) {cache_batch (ctrlr, req); +if (!psci_has_osi_support ()) +return rpmh_flush (ctrlr);return 0 ; }
Signature · 2 lines
QUALCOMM INDIA, on behalf of Qualcomm Innovation Center, Inc. is a member of Code Aurora Forum, hosted by The Linux Foundation