Add support for A7-A11 AIC
Subsystems (3)
v3 cover Add support for A7-A11 AIC
Hi,
This patch series introduce support for A7-A11 SoCs into the AIC driver by if'ing out some features unavailable on them. For background information about these SoCs, see v1.
Changes since v2:
- Removed mention of the IPI-always-ack code path in aic_handle_fiq(). The patch to enable A7-A10 SoC to work is a bug fix to avoid accessing sysregs on configurations that do not provide them, and the rest of the message already explains what's going on.
Changes since v1:
- Corrected dt-binding issues pointed out by Rob, all of A7-M1 gets its own SoC compat, as well as the "apple,aic" generic fallback.
- Order the AIC dt-bindings of the SoCs by release dates instead of alphabetical
order: 's5l8960x' (A7) -> 't7000' (A8) -> 's8000' (A9) -> 't8010' (A10) -> 't8015' (A11) -> 't8103' (M1)
- The patch to disallow local fast IPI on A11 now comes before the patch that enables to AIC driver to work on slow IPI systems. This ensures all IPI-always-ack code path in aic_handle_fiq() is removed by the slow IPI patch.
- Keep local fast IPI enabled on AIC2, mistake in V1
- Describe the feature levels in the description of AIC.
- Add new patch to remove unneccessary enablement of use_fast_ipi.
- Do not try to enable use_local_fast_ipi, because it is enabled by default.
In theory M1 can also get the apple,t8015-aic (A11) compatible. However, I do not see a point in doing that.
Previous versions:
v1: https://lore.kernel.org/asahi/[email protected]
v2: https://lore.kernel.org/asahi/[email protected]
Nick Chan
Konrad Dybcio (1):
irqchip/apple-aic: Only access system registers on SoCs which provide
them
Nick Chan (3):
dt-bindings: apple,aic: Document A7-A11 compatibles irqchip/apple-aic: Skip unnecessary setting of use_fast_ipi irqchip/apple-aic: Add a new "Global fast IPIs only" feature level
.../interrupt-controller/apple,aic.yaml | 14 ++++- drivers/irqchip/irq-apple-aic.c | 53 +++++++++++++------ 2 files changed, 49 insertions(+), 18 deletions(-)
base-commit: 985bf40edf4343dcb04c33f58b40b4a85c1776d4
Signature · 1 line
2.46.0
PATCH v3 1/4 dt-bindings: apple,aic: Document A7-A11 compatibles
Document and describe the compatibles for Apple A7-A11 SoCs.
There are three feature levels:
- apple,aic: No fast IPI, for A7-A10
- apple,t8015-aic: fast IPI, global only, for A11
- apple,t8103-aic: fast IPI with local and global support, for M1
Each feature level is an extension of the previous, for example, M1 will also work with the A7 feature level.
All of A7-M1 gets its own SoC-specific compatible, and the "apple,aic" compatible as a fallback.
--- .../bindings/interrupt-controller/apple,aic.yaml | 14 +++++++++++++- 1 file changed, 13 insertions(+), 1 deletion(-)
Documentation/devicetree/bindings/interrupt-controller/apple,aic.yaml +13 -1
@@ -31,13 +31,25 @@ description: | This device also represents the FIQ interrupt sources on platforms using AIC, which do not go through a discrete interrupt controller. + IPIs may be performed via MMIO registers on all variants of AIC. Starting + from A11, system registers may also be used for "fast" IPIs. Starting from + M1, even faster IPIs within the same cluster may be achieved by writing to + a "local" fast IPI register as opposed to using the "global" fast IPI + register. + allOf: - $ref: /schemas/interrupt-controller.yaml# properties: compatible: items: - - const: apple,t8103-aic + - enum: + - apple,s5l8960x-aic + - apple,t7000-aic + - apple,s8000-aic + - apple,t8010-aic + - apple,t8015-aic + - apple,t8103-aic - const: apple,aic interrupt-controller: true
Signature · 1 line
2.46.0
[tip: irq/core] dt-bindings: apple,aic: Document A7-A11 compatibles
The following commit has been merged into the irq/core branch of tip:
The following commit has been merged into the irq/core branch of tip:
Commit-ID: 9e65863194ad253f1de48bb9000a586e6caa5eed Gitweb: https://git.kernel.org/tip/9e65863194ad253f1de48bb9000a586e6caa5eed Author: Nick Chan <[email protected]> AuthorDate: Sun, 01 Sep 2024 11:40:04 +08:00 Committer: Thomas Gleixner <[email protected]> CommitterDate: Wed, 04 Sep 2024 20:43:29 +02:00
dt-bindings: apple,aic: Document A7-A11 compatibles
Document and describe the compatibles for Apple A7-A11 SoCs. There are three feature levels:
- apple,aic: No fast IPI, for A7-A10
- apple,t8015-aic: fast IPI, global only, for A11
- apple,t8103-aic: fast IPI with local and global support, for M1
Each feature level is an extension of the previous, for example, M1 will also work with the A7 feature level.
All of A7-M1 gets its own SoC-specific compatible, and the "apple,aic" compatible as a fallback.
--- Documentation/devicetree/bindings/interrupt-controller/apple,aic.yaml | 14 +++++++++++++- 1 file changed, 13 insertions(+), 1 deletion(-)
Documentation/devicetree/bindings/interrupt-controller/apple,aic.yaml +13 -1
@@ -31,13 +31,25 @@ description: | This device also represents the FIQ interrupt sources on platforms using AIC, which do not go through a discrete interrupt controller. + IPIs may be performed via MMIO registers on all variants of AIC. Starting + from A11, system registers may also be used for "fast" IPIs. Starting from + M1, even faster IPIs within the same cluster may be achieved by writing to + a "local" fast IPI register as opposed to using the "global" fast IPI + register. + allOf: - $ref: /schemas/interrupt-controller.yaml# properties: compatible: items: - - const: apple,t8103-aic + - enum: + - apple,s5l8960x-aic + - apple,t7000-aic + - apple,s8000-aic + - apple,t8010-aic + - apple,t8015-aic + - apple,t8103-aic - const: apple,aic interrupt-controller: true
PATCH v3 2/4 irqchip/apple-aic: Skip unnecessary setting of use_fast_ipi
In reply to Nick Chanuse_fast_ipi is true by default and there is no need to "enable" it.
--- drivers/irqchip/irq-apple-aic.c | 4 +--- 1 file changed, 1 insertion(+), 3 deletions(-)
drivers/irqchip/irq-apple-aic.c +1 -3
@@ -987,9 +987,7 @@ static int __init aic_of_ic_init(struct device_node *node, struct device_node *p off +=sizeof (u32) * (irqc->max_irq >>5 );/* MASK_CLR */ off +=sizeof (u32) * (irqc->max_irq >>5 );/* HW_STATE */ -if (irqc->info.fast_ipi) -static_branch_enable (&use_fast_ipi); -else +if (!irqc->info.fast_ipi)static_branch_disable (&use_fast_ipi); irqc->info.die_stride = off - start_off;
Signature · 1 line
2.46.0
[tip: irq/core] irqchip/apple-aic: Skip unnecessary enabling of use_fast_ipi
The following commit has been merged into the irq/core branch of tip:
The following commit has been merged into the irq/core branch of tip:
Commit-ID: 5527b06c96715518bc58d1ebb29efc3653f66c5e Gitweb: https://git.kernel.org/tip/5527b06c96715518bc58d1ebb29efc3653f66c5e Author: Nick Chan <[email protected]> AuthorDate: Sun, 01 Sep 2024 11:40:05 +08:00 Committer: Thomas Gleixner <[email protected]> CommitterDate: Wed, 04 Sep 2024 20:43:30 +02:00
irqchip/apple-aic: Skip unnecessary enabling of use_fast_ipi
use_fast_ipi is true by default and there is no need to "enable" it.
--- drivers/irqchip/irq-apple-aic.c | 4 +--- 1 file changed, 1 insertion(+), 3 deletions(-)
drivers/irqchip/irq-apple-aic.c +1 -3
@@ -987,9 +987,7 @@ static int __init aic_of_ic_init(struct device_node *node, struct device_node *p off +=sizeof (u32) * (irqc->max_irq >>5 );/* MASK_CLR */ off +=sizeof (u32) * (irqc->max_irq >>5 );/* HW_STATE */ -if (irqc->info.fast_ipi) -static_branch_enable (&use_fast_ipi); -else +if (!irqc->info.fast_ipi)static_branch_disable (&use_fast_ipi); irqc->info.die_stride = off - start_off;
PATCH v3 3/4 irqchip/apple-aic: Add a new "Global fast IPIs only" feature level
In reply to Nick ChanStarting with the A11 (T8015) SoC, Apple began using arm64 sysregs for fast IPIs. However, on A11, there is no such things as "Local" fast IPIs, as the SYS_IMP_APL_IPI_RR_LOCAL_EL1 register does not seem to exist.
Add a new feature level, used by the compatible "apple,t8015-aic", controlled by a static branch key named use_local_fast_ipi. When use_fast_ipi is true and use_local_fast_ipi is false, fast IPIs are used but all IPIs goes through the register SYS_IMP_APL_IPI_RR_GLOBAL_EL1, as "global" IPIs.
--- drivers/irqchip/irq-apple-aic.c | 24 +++++++++++++++++++++++- 1 file changed, 23 insertions(+), 1 deletion(-)
drivers/irqchip/irq-apple-aic.c +23 -1
@@ -235,6 +235,8 @@ enum fiq_hwirq { };static DEFINE_STATIC_KEY_TRUE (use_fast_ipi); +/* True if SYS_IMP_APL_IPI_RR_LOCAL_EL1 exists for local fast IPIs (M1+) */ +static DEFINE_STATIC_KEY_TRUE (use_local_fast_ipi);struct aic_info {int version;
@@ -252,6 +254,7 @@ struct aic_info {/* Features */ bool fast_ipi; +bool local_fast_ipi; };static const struct aic_info aic1_info__initconst = {
@@ -270,17 +273,32 @@ static const struct aic_info aic1_fipi_info __initconst = { .fast_ipi = true, }; +static const struct aic_info aic1_local_fipi_info__initconst = { + .version =1 , + + .event =AIC_EVENT , + .target_cpu =AIC_TARGET_CPU , + + .fast_ipi = true, + .local_fast_ipi = true, +}; +static const struct aic_info aic2_info__initconst = { .version =2 , .irq_cfg =AIC2_IRQ_CFG , .fast_ipi = true, + .local_fast_ipi = true, };static const struct of_device_id aic_info_match[] = { { .compatible ="apple,t8103-aic" , + .data = &aic1_local_fipi_info, + }, + { + .compatible ="apple,t8015-aic" , .data = &aic1_fipi_info, }, {
@@ -750,7 +768,8 @@ static void aic_ipi_send_fast(int cpu)u64 cluster =MPIDR_CLUSTER (mpidr);u64 idx =MPIDR_CPU (mpidr); -if (MPIDR_CLUSTER (my_mpidr) == cluster) +if (static_branch_likely (&use_local_fast_ipi) && +MPIDR_CLUSTER (my_mpidr) == cluster)write_sysreg_s (FIELD_PREP (IPI_RR_CPU , idx),SYS_IMP_APL_IPI_RR_LOCAL_EL1 );else
@@ -990,6 +1009,9 @@ static int __init aic_of_ic_init(struct device_node *node, struct device_node *pif (!irqc->info.fast_ipi)static_branch_disable (&use_fast_ipi); +if (!irqc->info.local_fast_ipi) +static_branch_disable (&use_local_fast_ipi); + irqc->info.die_stride = off - start_off; irqc->hw_domain = irq_domain_create_tree(of_node_to_fwnode(node),
Signature · 1 line
2.46.0
[tip: irq/core] irqchip/apple-aic: Add a new "Global fast IPIs only" feature level
The following commit has been merged into the irq/core branch of tip:
The following commit has been merged into the irq/core branch of tip:
Commit-ID: a845342e6e5fb4937564f93cc88e00c732286fe3 Gitweb: https://git.kernel.org/tip/a845342e6e5fb4937564f93cc88e00c732286fe3 Author: Nick Chan <[email protected]> AuthorDate: Sun, 01 Sep 2024 11:40:06 +08:00 Committer: Thomas Gleixner <[email protected]> CommitterDate: Wed, 04 Sep 2024 20:43:30 +02:00
irqchip/apple-aic: Add a new "Global fast IPIs only" feature level
Starting with the A11 (T8015) SoC, Apple began using arm64 sysregs for fast IPIs. However, on A11, there is no such things as "Local" fast IPIs, as the SYS_IMP_APL_IPI_RR_LOCAL_EL1 register does not seem to exist.
Add a new feature level, used by the compatible "apple,t8015-aic", controlled by a static branch key named use_local_fast_ipi. When use_fast_ipi is true and use_local_fast_ipi is false, fast IPIs are used but all IPIs goes through the register SYS_IMP_APL_IPI_RR_GLOBAL_EL1, as "global" IPIs.
--- drivers/irqchip/irq-apple-aic.c | 29 +++++++++++++++++++++++++---- 1 file changed, 25 insertions(+), 4 deletions(-)
drivers/irqchip/irq-apple-aic.c +25 -4
@@ -235,6 +235,8 @@ enum fiq_hwirq { };static DEFINE_STATIC_KEY_TRUE (use_fast_ipi); +/* True if SYS_IMP_APL_IPI_RR_LOCAL_EL1 exists for local fast IPIs (M1+) */ +static DEFINE_STATIC_KEY_TRUE (use_local_fast_ipi);struct aic_info {int version;
@@ -252,6 +254,7 @@ struct aic_info {/* Features */ bool fast_ipi; +bool local_fast_ipi; };static const struct aic_info aic1_info__initconst = {
@@ -270,17 +273,32 @@ static const struct aic_info aic1_fipi_info __initconst = { .fast_ipi = true, }; +static const struct aic_info aic1_local_fipi_info__initconst = { + .version =1 , + + .event =AIC_EVENT , + .target_cpu =AIC_TARGET_CPU , + + .fast_ipi = true, + .local_fast_ipi = true, +}; +static const struct aic_info aic2_info__initconst = { .version =2 , .irq_cfg =AIC2_IRQ_CFG , .fast_ipi = true, + .local_fast_ipi = true, };static const struct of_device_id aic_info_match[] = { { .compatible ="apple,t8103-aic" , + .data = &aic1_local_fipi_info, + }, + { + .compatible ="apple,t8015-aic" , .data = &aic1_fipi_info, }, {
@@ -750,12 +768,12 @@ static void aic_ipi_send_fast(int cpu)u64 cluster =MPIDR_CLUSTER (mpidr);u64 idx =MPIDR_CPU (mpidr); -if (MPIDR_CLUSTER (my_mpidr) == cluster) -write_sysreg_s (FIELD_PREP (IPI_RR_CPU , idx), -SYS_IMP_APL_IPI_RR_LOCAL_EL1 ); -else +if (static_branch_likely (&use_local_fast_ipi) &&MPIDR_CLUSTER (my_mpidr) == cluster) { +write_sysreg_s (FIELD_PREP (IPI_RR_CPU , idx),SYS_IMP_APL_IPI_RR_LOCAL_EL1 ); + }else {write_sysreg_s (FIELD_PREP (IPI_RR_CPU , idx) |FIELD_PREP (IPI_RR_CLUSTER , cluster),SYS_IMP_APL_IPI_RR_GLOBAL_EL1 ); + }isb (); }
@@ -990,6 +1008,9 @@ static int __init aic_of_ic_init(struct device_node *node, struct device_node *pif (!irqc->info.fast_ipi)static_branch_disable (&use_fast_ipi); +if (!irqc->info.local_fast_ipi) +static_branch_disable (&use_local_fast_ipi); + irqc->info.die_stride = off - start_off; irqc->hw_domain = irq_domain_create_tree(of_node_to_fwnode(node),
PATCH v3 4/4 irqchip/apple-aic: Only access system registers on SoCs which provide them
In reply to Nick ChanFrom: Konrad Dybcio <[email protected]>
Starting from the A11 (T8015) SoC, Apple introuced system registers for fast IPI and UNCORE PMC control. These sysregs do not exist on earlier A7-A10 SoCs and trying to access them results in an instant crash.
Restrict sysreg access within the AIC driver to configurations where use_fast_ipi is true to allow AIC to function properly on A7-A10 SoCs.
--- drivers/irqchip/irq-apple-aic.c | 25 ++++++++++++------------- 1 file changed, 12 insertions(+), 13 deletions(-)
drivers/irqchip/irq-apple-aic.c +12 -13
@@ -234,6 +234,7 @@ enum fiq_hwirq { AIC_NR_FIQ }; +/* True if UNCORE/UNCORE2 and Sn_... IPI registers are present and used (A11+) */ static DEFINE_STATIC_KEY_TRUE (use_fast_ipi);/* True if SYS_IMP_APL_IPI_RR_LOCAL_EL1 exists for local fast IPIs (M1+) */ static DEFINE_STATIC_KEY_TRUE (use_local_fast_ipi);
@@ -550,14 +551,9 @@ static void __exception_irq_entry aic_handle_fiq(struct pt_regs *regs)* we check for everything here, even things we don't support yet. */ -if (read_sysreg_s (SYS_IMP_APL_IPI_SR_EL1 ) &IPI_SR_PENDING ) { -if (static_branch_likely (&use_fast_ipi)) { -aic_handle_ipi (regs); - }else { -pr_err_ratelimited ("Fast IPI fired. Acking.\n" ); -write_sysreg_s (IPI_SR_PENDING ,SYS_IMP_APL_IPI_SR_EL1 ); - } - } +if (static_branch_likely (&use_fast_ipi) && + (read_sysreg_s (SYS_IMP_APL_IPI_SR_EL1 ) &IPI_SR_PENDING )) +aic_handle_ipi (regs);if (TIMER_FIRING (read_sysreg (cntp_ctl_el0))) generic_handle_domain_irq(aic_irqc->hw_domain,
@@ -592,8 +588,9 @@ static void __exception_irq_entry aic_handle_fiq(struct pt_regs *regs) AIC_FIQ_HWIRQ(irq)); } -if (FIELD_GET (UPMCR0_IMODE ,read_sysreg_s (SYS_IMP_APL_UPMCR0_EL1 )) ==UPMCR0_IMODE_FIQ && - (read_sysreg_s (SYS_IMP_APL_UPMSR_EL1 ) &UPMSR_IACT )) { +if (static_branch_likely (&use_fast_ipi) && + (FIELD_GET (UPMCR0_IMODE ,read_sysreg_s (SYS_IMP_APL_UPMCR0_EL1 )) ==UPMCR0_IMODE_FIQ ) && + (read_sysreg_s (SYS_IMP_APL_UPMSR_EL1 ) &UPMSR_IACT )) {/* Same story with uncore PMCs */ pr_err_ratelimited ("Uncore PMC FIQ fired. Masking.\n" ); sysreg_clear_set_s(SYS_IMP_APL_UPMCR0_EL1, UPMCR0_IMODE,
@@ -830,7 +827,8 @@ static int aic_init_cpu(unsigned int cpu)/* Mask all hard-wired per-CPU IRQ/FIQ sources */ /* Pending Fast IPI FIQs */ -write_sysreg_s (IPI_SR_PENDING ,SYS_IMP_APL_IPI_SR_EL1 ); +if (static_branch_likely (&use_fast_ipi)) +write_sysreg_s (IPI_SR_PENDING ,SYS_IMP_APL_IPI_SR_EL1 );/* Timer FIQs */ sysreg_clear_set (cntp_ctl_el0,0 ,ARCH_TIMER_CTRL_IT_MASK );
@@ -851,8 +849,9 @@ static int aic_init_cpu(unsigned int cpu) FIELD_PREP(PMCR0_IMODE, PMCR0_IMODE_OFF));/* Uncore PMC FIQ */ -sysreg_clear_set_s (SYS_IMP_APL_UPMCR0_EL1 ,UPMCR0_IMODE , -FIELD_PREP (UPMCR0_IMODE ,UPMCR0_IMODE_OFF )); +if (static_branch_likely (&use_fast_ipi)) +sysreg_clear_set_s (SYS_IMP_APL_UPMCR0_EL1 ,UPMCR0_IMODE , +FIELD_PREP (UPMCR0_IMODE ,UPMCR0_IMODE_OFF ));/* Commit all of the above */ isb ();
Signature · 1 line
2.46.0
[tip: irq/core] irqchip/apple-aic: Only access system registers on SoCs which provide them
The following commit has been merged into the irq/core branch of tip:
The following commit has been merged into the irq/core branch of tip:
Commit-ID: 59fc20ba70294d2c5f620ad6206aa661ce7718d6 Gitweb: https://git.kernel.org/tip/59fc20ba70294d2c5f620ad6206aa661ce7718d6 Author: Konrad Dybcio <[email protected]> AuthorDate: Sun, 01 Sep 2024 11:40:07 +08:00 Committer: Thomas Gleixner <[email protected]> CommitterDate: Wed, 04 Sep 2024 20:43:30 +02:00
irqchip/apple-aic: Only access system registers on SoCs which provide them
Starting from the A11 (T8015) SoC, Apple introuced system registers for fast IPI and UNCORE PMC control. These sysregs do not exist on earlier A7-A10 SoCs and trying to access them results in an instant crash.
Restrict sysreg access within the AIC driver to configurations where use_fast_ipi is true to allow AIC to function properly on A7-A10 SoCs.
--- drivers/irqchip/irq-apple-aic.c | 26 +++++++++++++------------- 1 file changed, 13 insertions(+), 13 deletions(-)
drivers/irqchip/irq-apple-aic.c +13 -13
@@ -234,6 +234,7 @@ enum fiq_hwirq { AIC_NR_FIQ }; +/* True if UNCORE/UNCORE2 and Sn_... IPI registers are present and used (A11+) */ static DEFINE_STATIC_KEY_TRUE (use_fast_ipi);/* True if SYS_IMP_APL_IPI_RR_LOCAL_EL1 exists for local fast IPIs (M1+) */ static DEFINE_STATIC_KEY_TRUE (use_local_fast_ipi);
@@ -550,14 +551,9 @@ static void __exception_irq_entry aic_handle_fiq(struct pt_regs *regs)* we check for everything here, even things we don't support yet. */ -if (read_sysreg_s (SYS_IMP_APL_IPI_SR_EL1 ) &IPI_SR_PENDING ) { -if (static_branch_likely (&use_fast_ipi)) { -aic_handle_ipi (regs); - }else { -pr_err_ratelimited ("Fast IPI fired. Acking.\n" ); -write_sysreg_s (IPI_SR_PENDING ,SYS_IMP_APL_IPI_SR_EL1 ); - } - } +if (static_branch_likely (&use_fast_ipi) && + (read_sysreg_s (SYS_IMP_APL_IPI_SR_EL1 ) &IPI_SR_PENDING )) +aic_handle_ipi (regs);if (TIMER_FIRING (read_sysreg (cntp_ctl_el0))) generic_handle_domain_irq(aic_irqc->hw_domain,
@@ -592,8 +588,9 @@ static void __exception_irq_entry aic_handle_fiq(struct pt_regs *regs) AIC_FIQ_HWIRQ(irq)); } -if (FIELD_GET (UPMCR0_IMODE ,read_sysreg_s (SYS_IMP_APL_UPMCR0_EL1 )) ==UPMCR0_IMODE_FIQ && - (read_sysreg_s (SYS_IMP_APL_UPMSR_EL1 ) &UPMSR_IACT )) { +if (static_branch_likely (&use_fast_ipi) && + (FIELD_GET (UPMCR0_IMODE ,read_sysreg_s (SYS_IMP_APL_UPMCR0_EL1 )) ==UPMCR0_IMODE_FIQ ) && + (read_sysreg_s (SYS_IMP_APL_UPMSR_EL1 ) &UPMSR_IACT )) {/* Same story with uncore PMCs */ pr_err_ratelimited ("Uncore PMC FIQ fired. Masking.\n" ); sysreg_clear_set_s(SYS_IMP_APL_UPMCR0_EL1, UPMCR0_IMODE,
@@ -829,7 +826,8 @@ static int aic_init_cpu(unsigned int cpu)/* Mask all hard-wired per-CPU IRQ/FIQ sources */ /* Pending Fast IPI FIQs */ -write_sysreg_s (IPI_SR_PENDING ,SYS_IMP_APL_IPI_SR_EL1 ); +if (static_branch_likely (&use_fast_ipi)) +write_sysreg_s (IPI_SR_PENDING ,SYS_IMP_APL_IPI_SR_EL1 );/* Timer FIQs */ sysreg_clear_set (cntp_ctl_el0,0 ,ARCH_TIMER_CTRL_IT_MASK );
@@ -850,8 +848,10 @@ static int aic_init_cpu(unsigned int cpu) FIELD_PREP(PMCR0_IMODE, PMCR0_IMODE_OFF));/* Uncore PMC FIQ */ -sysreg_clear_set_s (SYS_IMP_APL_UPMCR0_EL1 ,UPMCR0_IMODE , -FIELD_PREP (UPMCR0_IMODE ,UPMCR0_IMODE_OFF )); +if (static_branch_likely (&use_fast_ipi)) { +sysreg_clear_set_s (SYS_IMP_APL_UPMCR0_EL1 ,UPMCR0_IMODE , +FIELD_PREP (UPMCR0_IMODE ,UPMCR0_IMODE_OFF )); + }/* Commit all of the above */ isb ();