GMU-less A6xx support (A610, A619_holi)
Subsystems (6)
v4 cover GMU-less A6xx support (A610, A619_holi)
v3 -> v4:
- Drop the mistakengly-included and wrong A3xx-A5xx bindings changes
- Improve bindings commit messages to better explain what GMU Wrapper is
- Drop the A680 highest bank bit value adjustment patch
- Sort UBWC config variables in a reverse-Christmass-tree fashion [4/14]
- Don't alter any UBWC config values in [4/14]
- Do so for a619_holi in [8/14]
- Rebase on next-20230314 (shouldn't matter at all)
v3: https://lore.kernel.org/r/[email protected]
v2 -> v3:
New dependencies:
- https://lore.kernel.org/linux-arm-msm/[email protected]/T/#t
- https://lore.kernel.org/linux-arm-msm/[email protected]/
Sidenote: A speedbin rework is in progress, the of_machine_is_compatible calls in A619_holi are ugly (but well, necessary..) but they'll be replaced with socid matching in this or the next kernel cycle.
Due to the new way of identifying GMU wrapper GPUs, configuring 6350 to use wrapper would cause the wrong fuse values to be checked, but that will be solved by the conversion + the ultimate goal is to use the GMU whenever possible with the wrapper left for GMU-less Adrenos and early bringup debugging of GMU-equipped ones.
- Ship dt-bindings in this series as we're referencing the compatible now
- "De-staticize" -> "remove static keyword" [3/15]
- Track down all the values in [4/15]
- Add many comments and explanations in [4/15]
- Fix possible return-before-mutex-unlock [5/15]
- Explain the GMU wrapper a bit more in the commit msg [5/15]
- Separate out pm_resume/suspend for GMU-wrapper GPUs to make things cleaner [5/15]
- Don't check if info exists, it has to at this point [5/15]
- Assign gpu->info early and clean up following if statements in a6xx_gpu_init [5/15]
- Determine whether we use GMU wrapper based on the GMU compatible instead of a quirk [5/15]
- Use a struct field to annotate whether we're using gmu wrapper so that it can be assigned at runtime (turns out a619 holi-ness cannot be determined by patchid + that will make it easier to test out GMU GPUs without actually turning on the GMU if anybody wants to do so) [5/15]
- Unconditionally hook up gx to the gmu wrapper (otherwise our gpu will not get power) [5/15]
- Don't check for gx domain presence in gmu_wrapper paths, it's guaranteed [5/15]
- Use opp set rate in the gmuwrapper suspend path [5/15]
- Call opp functions on the GPU device and not on the DRM device of mdp4/5/DPU1 half the time (WHOOOOPS!) [5/15]
- Disable the memory clock in a6xx_pm_suspend instead of enabling it (moderate oops) [5/15]
- Call the forgotten clk_bulk_disable_unprepare in a6xx_pm_suspend [5/15]
- Set rate to FMIN (a6xx really doesn't like rate=0 + that's what msm-5.x does anyway) before disabling core clock [5/15]
- pm_runtime_get_sync -> pm_runtime_resume_and_get [5/15]
- Don't annotate no cached BO support with a quirk, as A619_holi is merged into the A619 entry in the big const struct - this means that all GPUs operating in gmu wrapper configuration will be implicitly treated as if they didn't have this feature [7/15]
- Drop OPP rate & icc related patches, they're a part of a separate series now; rebase on it
- Clean up extra parentheses [8/15]
- Identify A619_holi by checking the compatible of its GMU instead of patchlevel [8/15]
- Drop "Fix up A6XX protected registers" - unnecessary, Rob will add a comment explaining why
- Fix existing UBWC values for A680, new patch [10/15]
- Use adreno_is_aXYZ macros in speedbin matching [13/15] - new patch
v2: https://lore.kernel.org/linux-arm-msm/[email protected]/
v1 -> v2:
- Fix A630 values in [2/14]
- Fix [6/14] for GMU-equipped GPUs
Link to v1: https://lore.kernel.org/linux-arm-msm/[email protected]/
This series concludes my couple-weeks-long suffering of figuring out the ins and outs of the "non-standard" A6xx GPUs which feature no GMU.
The GMU functionality is essentially emulated by parting out a "GMU wrapper" region, which is essentially just a register space within the GPU. It's modeled to be as similar to the actual GMU as possible while staying as unnecessary as we can make it - there's no IRQs, communicating with a microcontroller, no RPMh communication etc. etc. I tried to reuse as much code as possible without making a mess where every even line is used for GMU and every odd line is used for GMU wrapper..
This series contains:
- plumbing for non-GMU operation, if-ing out GMU calls based on GMU presence
- GMU wrapper support
- A610 support (w/ speedbin)
- A619 support (w/ speedbin)
- couple of minor fixes and improvements
- VDDCX/VDDGX scaling fix for non-GMU GPUs (concerns more than just A6xx)
- Enablement of opp interconnect properties
A619_holi works perfectly fine using the already-present A619 support in mesa. A610 needs more work on that front, but can already replay command traces captures on downstream.
NOTE: the "drm/msm/a6xx: Add support for A619_holi" patch contains two occurences of 0x18 used in place of a register #define, as it's supposed to be RBBM_GPR0_CNTL, but that will only be present after mesa-side changes are merged and headers are synced from there.
Speedbin patches depend on:
https://lore.kernel.org/linux-arm-msm/[email protected]/
---
Konrad Dybcio (14):
dt-bindings: display/msm: gpu: Document GMU wrapper-equipped A6xx
dt-bindings: display/msm/gmu: Add GMU wrapper
drm/msm/a6xx: Remove static keyword from sptprac en/disable functions drm/msm/a6xx: Extend and explain UBWC config
drm/msm/a6xx: Introduce GMU wrapper support
drm/msm/a6xx: Remove both GBIF and RBBM GBIF halt on hw init drm/msm/adreno: Disable has_cached_coherent in GMU wrapper configurations drm/msm/a6xx: Add support for A619_holi
drm/msm/a6xx: Add A610 support
drm/msm/a6xx: Fix some A619 tunables
drm/msm/a6xx: Use "else if" in GPU speedbin rev matching drm/msm/a6xx: Use adreno_is_aXYZ macros in speedbin matching drm/msm/a6xx: Add A619_holi speedbin support
drm/msm/a6xx: Add A610 speedbin support
.../devicetree/bindings/display/msm/gmu.yaml | 49 +- .../devicetree/bindings/display/msm/gpu.yaml | 57 ++- drivers/gpu/drm/msm/adreno/a6xx_gmu.c | 57 ++- drivers/gpu/drm/msm/adreno/a6xx_gmu.h | 2 + drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 494 ++++++++++++++++++--- drivers/gpu/drm/msm/adreno/a6xx_gpu.h | 1 + drivers/gpu/drm/msm/adreno/a6xx_gpu_state.c | 14 +- drivers/gpu/drm/msm/adreno/adreno_device.c | 17 +- drivers/gpu/drm/msm/adreno/adreno_gpu.h | 33 +- 9 files changed, 632 insertions(+), 92 deletions(-)
---
base-commit: 647ef0d33d52a103b50469d7109b63d453686c11
change-id: 20230223-topic-gmuwrapper-b4fff5fd7789
Best regards,
Signature · 1 line
Konrad Dybcio <[email protected]>
PATCH v4 1/14 dt-bindings: display/msm: gpu: Document GMU wrapper-equipped A6xx
The "GMU Wrapper" is Qualcomm's name for "let's treat the GPU blocks we'd normally assign to the GMU as if they were a part of the GMU, even though they are not". It's a (good) software representation of the GMU_CX and GMU_GX register spaces within the GPUSS that helps us programatically treat these de-facto GMU-less parts in a way that's very similar to their GMU-equipped cousins, massively saving up on code duplication.
The "wrapper" register space was specifically designed to mimic the layout of a real GMU, though it rather obviously does not have the M3 core et al.
GMU wrapper-equipped A6xx GPUs require clocks and clock-names to be specified under the GPU node, just like their older cousins. Account for that.
--- .../devicetree/bindings/display/msm/gpu.yaml | 57 ++++++++++++++++++---- 1 file changed, 48 insertions(+), 9 deletions(-)
Documentation/devicetree/bindings/display/msm/gpu.yaml +48 -9
@@ -36,10 +36,7 @@ properties: reg-names: minItems: 1 - items: - - const: kgsl_3d0_reg_memory - - const: cx_mem - - const: cx_dbgc + maxItems: 3 interrupts: maxItems: 1
@@ -157,16 +154,58 @@ allOf: required: - clocks - clock-names + - if: properties: compatible: contains: - pattern: '^qcom,adreno-6[0-9][0-9]\.[0-9]$' - - then: # Since Adreno 6xx series clocks should be defined in GMU + enum: + - qcom,adreno-610.0 + - qcom,adreno-619.1 + then: properties: - clocks: false - clock-names: false + clock-names: + items: + - const: core + description: GPU Core clock + - const: iface + description: GPU Interface clock + - const: mem_iface + description: GPU Memory Interface clock + - const: alt_mem_iface + description: GPU Alternative Memory Interface clock + - const: gmu + description: CX GMU clock + - const: xo + description: GPUCC clocksource clock + + reg-names: + minItems: 1 + items: + - const: kgsl_3d0_reg_memory + - const: cx_dbgc + + required: + - clocks + - clock-names + else: + if: + properties: + compatible: + contains: + pattern: '^qcom,adreno-6[0-9][0-9]\.[0-9]$' + + then: # Starting with A6xx, the clocks are usually defined in the GMU node + properties: + clocks: false + clock-names: false + + reg-names: + minItems: 1 + items: + - const: kgsl_3d0_reg_memory + - const: cx_mem + - const: cx_dbgc examples: - |
Signature · 1 line
2.39.2
Re: [PATCH v4 01/14] dt-bindings: display/msm: gpu: Document GMU wrapper-equipped A6xx
Quoted 58 lines · Konrad Dybcio
The "GMU Wrapper" is Qualcomm's name for "let's treat the GPU blocks we'd normally assign to the GMU as if they were a part of the GMU, even though they are not". It's a (good) software representation of the
GMU_CXandGMU_GXregister spaces within the GPUSS that helps us programatically treat these de-facto GMU-less parts in a way that's very similar to their GMU-equipped cousins, massively saving up on code duplication.The "wrapper" register space was specifically designed to mimic the layout of a real GMU, though it rather obviously does not have the M3 core et al.
GMU wrapper-equipped A6xx GPUs require clocks and clock-names to be specified under the GPU node, just like their older cousins. Account for that.
Signed-off-by Konrad Dybcio <[email protected]>--- .../devicetree/bindings/display/msm/gpu.yaml | 57 ++++++++++++++++++---- 1 file changed, 48 insertions(+), 9 deletions(-)Documentation/devicetree/bindings/display/msm/gpu.yaml +10
-9@@ -36,10 +36,7 @@ properties: reg-names: minItems: 1 - items: - - const: kgsl_3d0_reg_memory - - const: cx_mem - - const: cx_dbgc + maxItems: 3 interrupts: maxItems: 1@@ -157,16 +154,58 @@ allOf: required: - clocks - clock-names + - if: properties: compatible: contains: - pattern: '^qcom,adreno-6[0-9][0-9]\.[0-9]$' - - then: # Since Adreno 6xx series clocks should be defined in GMU + enum: + - qcom,adreno-610.0 + - qcom,adreno-619.1 + then: properties: - clocks: false - clock-names: false + clock-names: + items: + - const: core + description: GPU Core clock
Documentation/devicetree/bindings/display/msm/gpu.yaml allOf: · line 180
Quoted 10 lines
Documentation/devicetree/bindings/display/msm/gpu.yaml +10
-0+ - const: iface + description: GPU Interface clock + - const: mem_iface + description: GPU Memory Interface clock + - const: alt_mem_iface + description: GPU Alternative Memory Interface clock + - const: gmu + description: CX GMU clock + - const: xo + description: GPUCC clocksource clock
Since you require fixed number of clocks, you also need:
clocks:
minItems: 6
maxItems: 6
Best regards,
Krzysztof
PATCH v4 2/14 dt-bindings: display/msm/gmu: Add GMU wrapper
In reply to Konrad DybcioThe "GMU Wrapper" is Qualcomm's name for "let's treat the GPU blocks we'd normally assign to the GMU as if they were a part of the GMU, even though they are not". It's a (good) software representation of the GMU_CX and GMU_GX register spaces within the GPUSS that helps us programatically treat these de-facto GMU-less parts in a way that's very similar to their GMU-equipped cousins, massively saving up on code duplication.
The "wrapper" register space was specifically designed to mimic the layout of a real GMU, though it rather obviously does not have the M3 core et al.
To sum it all up, the GMU wrapper is essentially a register space within the GPU, which Linux sees as a dumbed-down regular GMU: there's no clocks, interrupts, multiple reg spaces, iommus and OPP. Document it.
--- .../devicetree/bindings/display/msm/gmu.yaml | 49 ++++++++++++++++------ 1 file changed, 37 insertions(+), 12 deletions(-)
Documentation/devicetree/bindings/display/msm/gmu.yaml +37 -12
@@ -19,16 +19,18 @@ description: | properties: compatible: - items: - - pattern: '^qcom,adreno-gmu-6[0-9][0-9]\.[0-9]$' - - const: qcom,adreno-gmu + oneOf: + - items: + - pattern: '^qcom,adreno-gmu-6[0-9][0-9]\.[0-9]$' + - const: qcom,adreno-gmu + - const: qcom,adreno-gmu-wrapper reg: - minItems: 3 + minItems: 1 maxItems: 4 reg-names: - minItems: 3 + minItems: 1 maxItems: 4 clocks:
@@ -44,7 +46,6 @@ properties: - description: GMU HFI interrupt - description: GMU interrupt - interrupt-names: items: - const: hfi
@@ -72,14 +73,8 @@ required: - compatible - reg - reg-names - - clocks - - clock-names - - interrupts - - interrupt-names - power-domains - power-domain-names - - iommus - - operating-points-v2 additionalProperties: false
@@ -216,6 +211,27 @@ allOf: - const: cxo - const: axi - const: memnoc + - if: + properties: + compatible: + contains: + const: qcom,adreno-gmu-wrapper + then: + properties: + reg: + items: + - description: GMU wrapper register space + reg-names: + items: + - const: gmu + else: + required: + - clocks + - clock-names + - interrupts + - interrupt-names + - iommus + - operating-points-v2 examples: - |
@@ -249,3 +265,12 @@ examples: iommus = <&adreno_smmu 5>; operating-points-v2 = <&gmu_opp_table>; }; + + gmu_wrapper: gmu@596a000 { + compatible = "qcom,adreno-gmu-wrapper"; + reg = <0x0596a000 0x30000>; + reg-names = "gmu"; + power-domains = <&gpucc GPU_CX_GDSC>, + <&gpucc GPU_GX_GDSC>; + power-domain-names = "cx", "gx"; + };
Signature · 1 line
2.39.2
Re: [PATCH v4 02/14] dt-bindings: display/msm/gmu: Add GMU wrapper
Quoted 71 lines · Konrad Dybcio
The "GMU Wrapper" is Qualcomm's name for "let's treat the GPU blocks we'd normally assign to the GMU as if they were a part of the GMU, even though they are not". It's a (good) software representation of the
GMU_CXandGMU_GXregister spaces within the GPUSS that helps us programatically treat these de-facto GMU-less parts in a way that's very similar to their GMU-equipped cousins, massively saving up on code duplication.The "wrapper" register space was specifically designed to mimic the layout of a real GMU, though it rather obviously does not have the M3 core et al.
To sum it all up, the GMU wrapper is essentially a register space within the GPU, which Linux sees as a dumbed-down regular GMU: there's no clocks, interrupts, multiple reg spaces, iommus and OPP. Document it.
Signed-off-by Konrad Dybcio <[email protected]>--- .../devicetree/bindings/display/msm/gmu.yaml | 49 ++++++++++++++++------ 1 file changed, 37 insertions(+), 12 deletions(-)Documentation/devicetree/bindings/display/msm/gmu.yaml +7
-12@@ -19,16 +19,18 @@ description: | properties: compatible: - items: - - pattern: '^qcom,adreno-gmu-6[0-9][0-9]\.[0-9]$' - - const: qcom,adreno-gmu + oneOf: + - items: + - pattern: '^qcom,adreno-gmu-6[0-9][0-9]\.[0-9]$' + - const: qcom,adreno-gmu + - const: qcom,adreno-gmu-wrapper reg: - minItems: 3 + minItems: 1 maxItems: 4 reg-names: - minItems: 3 + minItems: 1 maxItems: 4 clocks:@@ -44,7 +46,6 @@ properties: - description: GMU HFI interrupt - description: GMU interrupt - interrupt-names: items: - const: hfi@@ -72,14 +73,8 @@ required: - compatible - reg - reg-names - - clocks - - clock-names - - interrupts - - interrupt-names - power-domains - power-domain-names - - iommus - - operating-points-v2 additionalProperties: false
Documentation/devicetree/bindings/display/msm/gmu.yaml allOf: · line 213
Quoted 3 lines
Documentation/devicetree/bindings/display/msm/gmu.yaml +0
-0@@ -216,6 +211,27 @@ allOf: - const: cxo - const: axi - const: memnoc
Blank line (you added such between ifs in previous patch)
Best regards,
Krzysztof
PATCH v4 3/14 drm/msm/a6xx: Remove static keyword from sptprac en/disable functions
In reply to Konrad DybcioThese two will be reused by at least A619_holi in the non-gmu paths. Turn them non-static them to make it possible.
--- drivers/gpu/drm/msm/adreno/a6xx_gmu.c | 4 ++-- drivers/gpu/drm/msm/adreno/a6xx_gmu.h | 2 ++ 2 files changed, 4 insertions(+), 2 deletions(-)
drivers/gpu/drm/msm/adreno/a6xx_gmu.c +2 -2
@@ -354,7 +354,7 @@ void a6xx_gmu_clear_oob(struct a6xx_gmu *gmu, enum a6xx_gmu_oob_state state) }/* Enable CPU control of SPTP power power collapse */ -static int a6xx_sptprac_enable (struct a6xx_gmu *gmu) +int a6xx_sptprac_enable (struct a6xx_gmu *gmu) {int ret;u32 val;
@@ -376,7 +376,7 @@ static int a6xx_sptprac_enable(struct a6xx_gmu *gmu) }/* Disable CPU control of SPTP power power collapse */ -static void a6xx_sptprac_disable (struct a6xx_gmu *gmu) +void a6xx_sptprac_disable (struct a6xx_gmu *gmu) {u32 val;int ret;
drivers/gpu/drm/msm/adreno/a6xx_gmu.h +2 -0
@@ -186,5 +186,7 @@ int a6xx_hfi_set_freq(struct a6xx_gmu *gmu, int index);bool a6xx_gmu_gx_is_on (struct a6xx_gmu *gmu);bool a6xx_gmu_sptprac_is_on (struct a6xx_gmu *gmu); +void a6xx_sptprac_disable (struct a6xx_gmu *gmu); +int a6xx_sptprac_enable (struct a6xx_gmu *gmu);#endif
Signature · 1 line
2.39.2
PATCH v4 4/14 drm/msm/a6xx: Extend and explain UBWC config
In reply to Konrad DybcioRename lower_bit to hbb_lo and explain what it signifies. Add explanations (wherever possible to other tunables).
Port setting min_access_length, ubwc_mode and hbb_hi from downstream.
--- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 39 +++++++++++++++++++++++++++-------- 1 file changed, 30 insertions(+), 9 deletions(-)
drivers/gpu/drm/msm/adreno/a6xx_gpu.c +30 -9
@@ -786,10 +786,25 @@ static void a6xx_set_cp_protect(struct msm_gpu *gpu)static void a6xx_set_ubwc_config (struct msm_gpu *gpu) {struct adreno_gpu *adreno_gpu =to_adreno_gpu (gpu); -u32 lower_bit =2 ; -u32 amsbc =0 ; +/* Unknown, introduced with A650 family, related to UBWC mode/ver 4 */ u32 rgb565_predicator =0 ; +/* Unknown, introduced with A650 family */ u32 uavflagprd_inv =0 ; +/* Whether the minimum access length is 64 bits */ +u32 min_acc_len =0 ; +/* Entirely magic, per-GPU-gen value */ +u32 ubwc_mode =0 ; +/* +* The Highest Bank Bit value represents the bit of the highest DDR bank. +* We then subtract 13 from it (13 is the minimum value allowed by hw) and +* write the lowest two bits of the remaining value as hbb_lo and the +* one above it as hbb_hi to the hardware. This should ideally use DRAM +* type detection. +*/ +u32 hbb_hi =0 ; +u32 hbb_lo =2 ; +/* Unknown, introduced with A640/680 */ +u32 amsbc =0 ;/* a618 is using the hw default values */ if (adreno_is_a618 (adreno_gpu))
@@ -800,25 +815,31 @@ static void a6xx_set_ubwc_config(struct msm_gpu *gpu)if (adreno_is_a650 (adreno_gpu) ||adreno_is_a660 (adreno_gpu)) {/* TODO: get ddr type from bootloader and use 2 for LPDDR4 */ - lower_bit =3 ; + hbb_lo =3 ; amsbc =1 ; rgb565_predicator =1 ; uavflagprd_inv =2 ; }if (adreno_is_7c3 (adreno_gpu)) { - lower_bit =1 ; + hbb_lo =1 ; amsbc =1 ; rgb565_predicator =1 ; uavflagprd_inv =2 ; }gpu_write (gpu,REG_A6XX_RB_NC_MODE_CNTL , - rgb565_predicator <<11 | amsbc <<4 | lower_bit <<1 ); -gpu_write (gpu,REG_A6XX_TPL1_NC_MODE_CNTL , lower_bit <<1 ); -gpu_write (gpu,REG_A6XX_SP_NC_MODE_CNTL , - uavflagprd_inv <<4 | lower_bit <<1 ); -gpu_write (gpu,REG_A6XX_UCHE_MODE_CNTL , lower_bit <<21 ); + rgb565_predicator <<11 | hbb_hi <<10 | amsbc <<4 | + min_acc_len <<3 | hbb_lo <<1 | ubwc_mode); + +gpu_write (gpu,REG_A6XX_TPL1_NC_MODE_CNTL , hbb_hi <<4 | + min_acc_len <<3 | hbb_lo <<1 | ubwc_mode); + +gpu_write (gpu,REG_A6XX_SP_NC_MODE_CNTL , hbb_hi <<10 | + uavflagprd_inv <<4 | min_acc_len <<3 | + hbb_lo <<1 | ubwc_mode); + +gpu_write (gpu,REG_A6XX_UCHE_MODE_CNTL , min_acc_len <<23 | hbb_lo <<21 ); }static int a6xx_cp_init (struct msm_gpu *gpu)
Signature · 1 line
2.39.2
Re: [PATCH v4 04/14] drm/msm/a6xx: Extend and explain UBWC config
Quoted 7 lines · Konrad Dybcio
Rename
lower_bittohbb_loand explain what it signifies. Add explanations (wherever possible to other tunables).Port setting
min_access_length,ubwc_modeandhbb_hifrom downstream.Signed-off-by Konrad Dybcio <[email protected]>
Quoted 79 lines
--- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 39 +++++++++++++++++++++++++++-------- 1 file changed, 30 insertions(+), 9 deletions(-)drivers/gpu/drm/msm/adreno/a6xx_gpu.c +30
-10@@ -786,10 +786,25 @@ static void a6xx_set_cp_protect(struct msm_gpu *gpu)static void a6xx_set_ubwc_config (struct msm_gpu *gpu) {struct adreno_gpu *adreno_gpu =to_adreno_gpu (gpu); -u32 lower_bit =2 ; -u32 amsbc =0 ; +/* Unknown, introduced with A650 family, related to UBWC mode/ver 4 */ u32 rgb565_predicator =0 ; +/* Unknown, introduced with A650 family */ u32 uavflagprd_inv =0 ; +/* Whether the minimum access length is 64 bits */ +u32 min_acc_len =0 ; +/* Entirely magic, per-GPU-gen value */ +u32 ubwc_mode =0 ; +/* +* The Highest Bank Bit value represents the bit of the highest DDR bank. +* We then subtract 13 from it (13 is the minimum value allowed by hw) and +* write the lowest two bits of the remaining value as hbb_lo and the +* one above it as hbb_hi to the hardware. This should ideally use DRAM +* type detection. +*/ +u32 hbb_hi =0 ; +u32 hbb_lo =2 ; +/* Unknown, introduced with A640/680 */ +u32 amsbc =0 ;/* a618 is using the hw default values */ if (adreno_is_a618 (adreno_gpu))@@ -800,25 +815,31 @@ static void a6xx_set_ubwc_config(struct msm_gpu *gpu)if (adreno_is_a650 (adreno_gpu) ||adreno_is_a660 (adreno_gpu)) {/* TODO: get ddr type from bootloader and use 2 for LPDDR4 */ - lower_bit =3 ; + hbb_lo =3 ; amsbc =1 ; rgb565_predicator =1 ; uavflagprd_inv =2 ; }if (adreno_is_7c3 (adreno_gpu)) { - lower_bit =1 ; + hbb_lo =1 ; amsbc =1 ; rgb565_predicator =1 ; uavflagprd_inv =2 ; }gpu_write (gpu,REG_A6XX_RB_NC_MODE_CNTL , - rgb565_predicator <<11 | amsbc <<4 | lower_bit <<1 ); -gpu_write (gpu,REG_A6XX_TPL1_NC_MODE_CNTL , lower_bit <<1 ); -gpu_write (gpu,REG_A6XX_SP_NC_MODE_CNTL , - uavflagprd_inv <<4 | lower_bit <<1 ); -gpu_write (gpu,REG_A6XX_UCHE_MODE_CNTL , lower_bit <<21 ); + rgb565_predicator <<11 | hbb_hi <<10 | amsbc <<4 | + min_acc_len <<3 | hbb_lo <<1 | ubwc_mode); + +gpu_write (gpu,REG_A6XX_TPL1_NC_MODE_CNTL , hbb_hi <<4 | + min_acc_len <<3 | hbb_lo <<1 | ubwc_mode); + +gpu_write (gpu,REG_A6XX_SP_NC_MODE_CNTL , hbb_hi <<10 | + uavflagprd_inv <<4 | min_acc_len <<3 | + hbb_lo <<1 | ubwc_mode); + +gpu_write (gpu,REG_A6XX_UCHE_MODE_CNTL , min_acc_len <<23 | hbb_lo <<21 ); }static int a6xx_cp_init (struct msm_gpu *gpu) --2.39.2
PATCH v4 5/14 drm/msm/a6xx: Introduce GMU wrapper support
In reply to Konrad DybcioSome (particularly SMD_RPM, a.k.a non-RPMh) SoCs implement A6XX GPUs but don't implement the associated GMUs. This is due to the fact that the GMU directly pokes at RPMh. Sadly, this means we have to take care of enabling & scaling power rails, clocks and bandwidth ourselves.
Reuse existing Adreno-common code and modify the deeply-GMU-infused A6XX code to facilitate these GPUs. This involves if-ing out lots of GMU callbacks and introducing a new type of GMU - GMU wrapper (it's the actual name that Qualcomm uses in their downstream kernels).
This is essentially a register region which is convenient to model as a device. We'll use it for managing the GDSCs. The register layout matches the actual GMU_CX/GX regions on the "real GMU" devices and lets us reuse quite a bit of gmu_read/write/rmw calls.
--- drivers/gpu/drm/msm/adreno/a6xx_gmu.c | 53 +++++- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 244 +++++++++++++++++++++++++--- drivers/gpu/drm/msm/adreno/a6xx_gpu.h | 1 + drivers/gpu/drm/msm/adreno/a6xx_gpu_state.c | 14 +- drivers/gpu/drm/msm/adreno/adreno_gpu.h | 6 + 5 files changed, 282 insertions(+), 36 deletions(-)
drivers/gpu/drm/msm/adreno/a6xx_gmu.c +50 -3
@@ -1474,6 +1474,7 @@ static int a6xx_gmu_get_irq(struct a6xx_gmu *gmu, struct platform_device *pdev,void a6xx_gmu_remove (struct a6xx_gpu *a6xx_gpu) { +struct adreno_gpu *adreno_gpu = &a6xx_gpu->base;struct a6xx_gmu *gmu = &a6xx_gpu->gmu;struct platform_device *pdev =to_platform_device (gmu->dev);
@@ -1493,10 +1494,12 @@ void a6xx_gmu_remove(struct a6xx_gpu *a6xx_gpu) gmu->mmio =NULL ; gmu->rscc =NULL ; -a6xx_gmu_memory_free (gmu); +if (!adreno_has_gmu_wrapper (adreno_gpu)) { +a6xx_gmu_memory_free (gmu); -free_irq (gmu->gmu_irq, gmu); -free_irq (gmu->hfi_irq, gmu); +free_irq (gmu->gmu_irq, gmu); +free_irq (gmu->hfi_irq, gmu); + }/* Drop reference taken in of_find_device_by_node */ put_device (gmu->dev);
@@ -1504,6 +1507,50 @@ void a6xx_gmu_remove(struct a6xx_gpu *a6xx_gpu) gmu->initialized = false; } +int a6xx_gmu_wrapper_init (struct a6xx_gpu *a6xx_gpu,struct device_node *node) +{ +struct platform_device *pdev =of_find_device_by_node (node); +struct a6xx_gmu *gmu = &a6xx_gpu->gmu; +int ret; + +if (!pdev) +return -ENODEV ; + + gmu->dev = &pdev->dev; + +of_dma_configure (gmu->dev, node, true); + +pm_runtime_enable (gmu->dev); + +/* Mark legacy for manual SPTPRAC control */ + gmu->legacy = true; + +/* Map the GMU registers */ + gmu->mmio =a6xx_gmu_get_mmio (pdev,"gmu" ); +if (IS_ERR (gmu->mmio)) { + ret =PTR_ERR (gmu->mmio); + goto err_mmio; + } + +/* Get a link to the GX power domain to reset the GPU */ + gmu->gxpd =dev_pm_domain_attach_by_name (gmu->dev,"gx" ); +if (IS_ERR (gmu->gxpd)) + goto err_mmio; + + gmu->initialized = true; + +return 0 ; + +err_mmio: +iounmap (gmu->mmio); + ret = -ENODEV ; + +/* Drop reference taken in of_find_device_by_node */ +put_device (gmu->dev); + +return ret; +} +int a6xx_gmu_init (struct a6xx_gpu *a6xx_gpu,struct device_node *node) {struct adreno_gpu *adreno_gpu = &a6xx_gpu->base;
drivers/gpu/drm/msm/adreno/a6xx_gpu.c +217 -27
374 lines not on this page · raw message
drivers/gpu/drm/msm/adreno/a6xx_gpu.h +1 -0
@@ -76,6 +76,7 @@ int a6xx_gmu_set_oob(struct a6xx_gmu *gmu, enum a6xx_gmu_oob_state state);void a6xx_gmu_clear_oob (struct a6xx_gmu *gmu,enum a6xx_gmu_oob_state state);int a6xx_gmu_init (struct a6xx_gpu *a6xx_gpu,struct device_node *node); +int a6xx_gmu_wrapper_init (struct a6xx_gpu *a6xx_gpu,struct device_node *node);void a6xx_gmu_remove (struct a6xx_gpu *a6xx_gpu); void a6xx_gmu_set_freq(struct msm_gpu *gpu, struct dev_pm_opp *opp,
drivers/gpu/drm/msm/adreno/a6xx_gpu_state.c +8 -6
@@ -1041,16 +1041,18 @@ struct msm_gpu_state *a6xx_gpu_state_get(struct msm_gpu *gpu)/* Get the generic state from the adreno core */ adreno_gpu_state_get (gpu, &a6xx_state->base); -a6xx_get_gmu_registers (gpu, a6xx_state); +if (!adreno_has_gmu_wrapper (adreno_gpu)) { +a6xx_get_gmu_registers (gpu, a6xx_state); - a6xx_state->gmu_log =a6xx_snapshot_gmu_bo (a6xx_state, &a6xx_gpu->gmu.log); - a6xx_state->gmu_hfi =a6xx_snapshot_gmu_bo (a6xx_state, &a6xx_gpu->gmu.hfi); - a6xx_state->gmu_debug =a6xx_snapshot_gmu_bo (a6xx_state, &a6xx_gpu->gmu.debug); + a6xx_state->gmu_log =a6xx_snapshot_gmu_bo (a6xx_state, &a6xx_gpu->gmu.log); + a6xx_state->gmu_hfi =a6xx_snapshot_gmu_bo (a6xx_state, &a6xx_gpu->gmu.hfi); + a6xx_state->gmu_debug =a6xx_snapshot_gmu_bo (a6xx_state, &a6xx_gpu->gmu.debug); -a6xx_snapshot_gmu_hfi_history (gpu, a6xx_state); +a6xx_snapshot_gmu_hfi_history (gpu, a6xx_state); + }/* If GX isn't on the rest of the data isn't going to be accessible */ -if (!a6xx_gmu_gx_is_on (&a6xx_gpu->gmu)) +if (!adreno_has_gmu_wrapper (adreno_gpu) && !a6xx_gmu_gx_is_on (&a6xx_gpu->gmu))return &a6xx_state->base;/* Get the banks of indexed registers */
drivers/gpu/drm/msm/adreno/adreno_gpu.h +6 -0
@@ -115,6 +115,7 @@ struct adreno_gpu {* code (a3xx_gpu.c) and stored in this common location. */ const unsigned int *reg_offsets; +bool gmu_is_wrapper; };#define to_adreno_gpu (x) container_of(x, struct adreno_gpu, base)
@@ -145,6 +146,11 @@ struct adreno_platform_config {bool adreno_cmp_rev (struct adreno_rev rev1,struct adreno_rev rev2); +static inline bool adreno_has_gmu_wrapper (struct adreno_gpu *gpu) +{ +return gpu->gmu_is_wrapper; +} +static inline bool adreno_is_a2xx (struct adreno_gpu *gpu) {return (gpu->revn <300 );
Signature · 1 line
2.39.2
PATCH v4 6/14 drm/msm/a6xx: Remove both GBIF and RBBM GBIF halt on hw init
In reply to Konrad DybcioCurrently we're only deasserting REG_A6XX_RBBM_GBIF_HALT, but we also need REG_A6XX_GBIF_HALT to be set to 0. For GMU-equipped GPUs this is done in a6xx_bus_clear_pending_transactions(), but for the GMU-less ones we have to do it *somewhere*. Unhalting both side by side sounds like a good plan and it won't cause any issues if it's unnecessary.
Also, add a memory barrier to ensure it's gone through.
--- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-)
drivers/gpu/drm/msm/adreno/a6xx_gpu.c +5 -1
@@ -1015,8 +1015,12 @@ static int hw_init(struct msm_gpu *gpu) }/* Clear GBIF halt in case GX domain was not collapsed */ -if (a6xx_has_gbif (adreno_gpu)) +if (a6xx_has_gbif (adreno_gpu)) { +gpu_write (gpu,REG_A6XX_GBIF_HALT ,0 );gpu_write (gpu,REG_A6XX_RBBM_GBIF_HALT ,0 ); +/* Let's make extra sure that the GPU can access the memory.. */ +mb (); + }gpu_write (gpu,REG_A6XX_RBBM_SECVID_TSB_CNTL ,0 );
Signature · 1 line
2.39.2
Re: [PATCH v4 06/14] drm/msm/a6xx: Remove both GBIF and RBBM GBIF halt on hw init
Quoted 6 lines · Konrad Dybcio
Currently we're only deasserting
REG_A6XX_RBBM_GBIF_HALT, but we also needREG_A6XX_GBIF_HALTto be set to 0. For GMU-equipped GPUs this is done ina6xx_bus_clear_pending_transactions(), but for the GMU-less ones we have to do it *somewhere*. Unhalting both side by side sounds like a good plan and it won't cause any issues if it's unnecessary.
Quoted 6 lines
Also, add a memory barrier to ensure it's gone through.
Signed-off-by Konrad Dybcio <[email protected]>--- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-)
Signature · 2 lines
With best wishes Dmitry
PATCH v4 7/14 drm/msm/adreno: Disable has_cached_coherent in GMU wrapper configurations
In reply to Konrad DybcioA610 and A619_holi don't support the feature. Disable it to make the GPU stop crashing after almost each and every submission - the received data on the GPU end was simply incomplete in garbled, resulting in almost nothing being executed properly. Extend the disablement to adreno_has_gmu_wrapper, as none of the GMU wrapper Adrenos that don't support yet seem to feature it.
--- drivers/gpu/drm/msm/adreno/adreno_device.c | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-)
drivers/gpu/drm/msm/adreno/adreno_device.c +4 -1
@@ -540,7 +540,6 @@ static int adreno_bind(struct device *dev, struct device *master, void *data) config.rev.minor, config.rev.patchid); priv->is_a2xx = config.rev.core ==2 ; - priv->has_cached_coherent = config.rev.core >=6 ; gpu = info->init (drm);if (IS_ERR (gpu)) {
@@ -552,6 +551,10 @@ static int adreno_bind(struct device *dev, struct device *master, void *data)if (ret)return ret; +if (config.rev.core >=6 ) +if (!adreno_has_gmu_wrapper (to_adreno_gpu (gpu))) + priv->has_cached_coherent = true; +return 0 ; }
Signature · 1 line
2.39.2
PATCH v4 8/14 drm/msm/a6xx: Add support for A619_holi
In reply to Konrad DybcioA619_holi is a GMU-less variant of the already-supported A619 GPU. It's present on at least SM4350 (holi) and SM6375 (blair). No mesa changes are required. Add the required kernel-side support for it.
--- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 42 ++++++++++++++++++++++++++------- drivers/gpu/drm/msm/adreno/adreno_gpu.h | 5 ++++ 2 files changed, 39 insertions(+), 8 deletions(-)
drivers/gpu/drm/msm/adreno/a6xx_gpu.c +34 -8
@@ -614,14 +614,16 @@ static void a6xx_set_hwcg(struct msm_gpu *gpu, bool state)return ;/* Disable SP clock before programming HWCG registers */ -if (!adreno_has_gmu_wrapper (adreno_gpu)) +if (!adreno_has_gmu_wrapper (adreno_gpu) || +adreno_is_a619_holi (adreno_gpu))gmu_rmw (gmu,REG_A6XX_GPU_GMU_GX_SPTPRAC_CLOCK_CONTROL ,1 ,0 );for (i =0 ; (reg = &adreno_gpu->info->hwcg[i], reg->offset); i++)gpu_write (gpu, reg->offset, state ? reg->value :0 );/* Enable SP clock */ -if (!adreno_has_gmu_wrapper (adreno_gpu)) +if (!adreno_has_gmu_wrapper (adreno_gpu) || +adreno_is_a619_holi (adreno_gpu))gmu_rmw (gmu,REG_A6XX_GPU_GMU_GX_SPTPRAC_CLOCK_CONTROL ,0 ,1 );gpu_write (gpu,REG_A6XX_RBBM_CLOCK_CNTL , state ? clock_cntl_on :0 );
@@ -814,6 +816,9 @@ static void a6xx_set_ubwc_config(struct msm_gpu *gpu)if (adreno_is_a618 (adreno_gpu))return ; +if (adreno_is_a619_holi (gpu)) + hbb_lo =0 ; +if (adreno_is_a640_family (adreno_gpu)) amsbc =1 ;
@@ -1015,7 +1020,12 @@ static int hw_init(struct msm_gpu *gpu) }/* Clear GBIF halt in case GX domain was not collapsed */ -if (a6xx_has_gbif (adreno_gpu)) { +if (adreno_is_a619_holi (adreno_gpu)) { +gpu_write (gpu,REG_A6XX_GBIF_HALT ,0 ); +gpu_write (gpu,0x18 ,0 ); +/* Let's make extra sure that the GPU can access the memory.. */ +mb (); + }else if (a6xx_has_gbif (adreno_gpu)) {gpu_write (gpu,REG_A6XX_GBIF_HALT ,0 );gpu_write (gpu,REG_A6XX_RBBM_GBIF_HALT ,0 );/* Let's make extra sure that the GPU can access the memory.. */
@@ -1024,6 +1034,9 @@ static int hw_init(struct msm_gpu *gpu)gpu_write (gpu,REG_A6XX_RBBM_SECVID_TSB_CNTL ,0 ); +if (adreno_is_a619_holi (adreno_gpu)) +a6xx_sptprac_enable (gmu); +/* * Disable the trusted memory range - we don't actually supported secure * memory rendering at this point in time and we don't want to block off
@@ -1301,7 +1314,8 @@ static void a6xx_dump(struct msm_gpu *gpu)#define GBIF_CLIENT_HALT_MASK BIT(0)#define GBIF_ARB_HALT_MASK BIT(1)#define VBIF_RESET_ACK_TIMEOUT 100 -#define VBIF_RESET_ACK_MASK 0x00f0 +#define VBIF_RESET_ACK_MASK 0xF0 +#define GPR0_GBIF_HALT_REQUEST 0x1E0static void a6xx_recover (struct msm_gpu *gpu) {
@@ -1358,10 +1372,16 @@ static void a6xx_recover(struct msm_gpu *gpu)/* Software-reset the GPU */ if (adreno_has_gmu_wrapper (adreno_gpu)) { -/* Halt the GX side of GBIF */ -gpu_write (gpu,REG_A6XX_RBBM_GBIF_HALT ,GBIF_GX_HALT_MASK ); -spin_until (gpu_read (gpu,REG_A6XX_RBBM_GBIF_HALT_ACK ) & -GBIF_GX_HALT_MASK ); +if (adreno_is_a619_holi (adreno_gpu)) { +gpu_write (gpu,0x18 ,GPR0_GBIF_HALT_REQUEST ); +spin_until ((gpu_read (gpu,REG_A6XX_RBBM_VBIF_GX_RESET_STATUS ) & + (VBIF_RESET_ACK_MASK )) ==VBIF_RESET_ACK_MASK ); + }else { +/* Halt the GX side of GBIF */ +gpu_write (gpu,REG_A6XX_RBBM_GBIF_HALT ,GBIF_GX_HALT_MASK ); +spin_until (gpu_read (gpu,REG_A6XX_RBBM_GBIF_HALT_ACK ) & +GBIF_GX_HALT_MASK ); + }/* Halt new client requests on GBIF */ gpu_write (gpu,REG_A6XX_GBIF_HALT ,GBIF_CLIENT_HALT_MASK );
@@ -1783,6 +1803,9 @@ static int a6xx_pm_resume(struct msm_gpu *gpu)if (ret) goto err; +if (adreno_is_a619_holi (adreno_gpu)) +a6xx_sptprac_enable (gmu); + err:mutex_unlock (&a6xx_gpu->gmu.lock);
@@ -1837,6 +1860,9 @@ static int a6xx_pm_suspend(struct msm_gpu *gpu)mutex_lock (&a6xx_gpu->gmu.lock); +if (adreno_is_a619_holi (adreno_gpu)) +a6xx_sptprac_disable (gmu); +clk_disable_unprepare (gpu->ebi1_clk);clk_bulk_disable_unprepare (gpu->nr_clocks, gpu->grp_clks);
drivers/gpu/drm/msm/adreno/adreno_gpu.h +5 -0
@@ -252,6 +252,11 @@ static inline int adreno_is_a619(struct adreno_gpu *gpu)return gpu->revn ==619 ; } +static inline int adreno_is_a619_holi (struct adreno_gpu *gpu) +{ +return adreno_is_a619 (gpu) &&adreno_has_gmu_wrapper (gpu); +} +static inline int adreno_is_a630 (struct adreno_gpu *gpu) {return gpu->revn ==630 ;
Signature · 1 line
2.39.2
PATCH v4 9/14 drm/msm/a6xx: Add A610 support
In reply to Konrad DybcioA610 is one of (if not the) lowest-tier SKUs in the A6XX family. It features no GMU, as it's implemented solely on SoCs with SMD_RPM. What's more interesting is that it does not feature a VDDGX line either, being powered solely by VDDCX and has an unfortunate hardware quirk that makes its reset line broken - after a couple of assert/ deassert cycles, it will hang for good and will not wake up again.
This GPU requires mesa changes for proper rendering, and lots of them at that. The command streams are quite far away from any other A6XX GPU and hence it needs special care. This patch was validated both by running an (incomplete) downstream mesa with some hacks (frames rendered correctly, though some instructions made the GPU hangcheck which is expected - garbage in, garbage out) and by replaying RD traces captured with the downstream KGSL driver - no crashes there, ever.
Add support for this GPU on the kernel side, which comes down to pretty simply adding A612 HWCG tables, altering a few values and adding a special case for handling the reset line.
--- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 97 +++++++++++++++++++++++++++--- drivers/gpu/drm/msm/adreno/adreno_device.c | 12 ++++ drivers/gpu/drm/msm/adreno/adreno_gpu.h | 8 ++- 3 files changed, 107 insertions(+), 10 deletions(-)
drivers/gpu/drm/msm/adreno/a6xx_gpu.c +88 -9
@@ -254,6 +254,56 @@ static void a6xx_submit(struct msm_gpu *gpu, struct msm_gem_submit *submit)a6xx_flush (gpu, ring); } +const struct adreno_reglist a612_hwcg[] = { + {REG_A6XX_RBBM_CLOCK_CNTL_SP0 ,0x22222222 }, + {REG_A6XX_RBBM_CLOCK_CNTL2_SP0 ,0x02222220 }, + {REG_A6XX_RBBM_CLOCK_DELAY_SP0 ,0x00000081 }, + {REG_A6XX_RBBM_CLOCK_HYST_SP0 ,0x0000f3cf }, + {REG_A6XX_RBBM_CLOCK_CNTL_TP0 ,0x22222222 }, + {REG_A6XX_RBBM_CLOCK_CNTL2_TP0 ,0x22222222 }, + {REG_A6XX_RBBM_CLOCK_CNTL3_TP0 ,0x22222222 }, + {REG_A6XX_RBBM_CLOCK_CNTL4_TP0 ,0x00022222 }, + {REG_A6XX_RBBM_CLOCK_DELAY_TP0 ,0x11111111 }, + {REG_A6XX_RBBM_CLOCK_DELAY2_TP0 ,0x11111111 }, + {REG_A6XX_RBBM_CLOCK_DELAY3_TP0 ,0x11111111 }, + {REG_A6XX_RBBM_CLOCK_DELAY4_TP0 ,0x00011111 }, + {REG_A6XX_RBBM_CLOCK_HYST_TP0 ,0x77777777 }, + {REG_A6XX_RBBM_CLOCK_HYST2_TP0 ,0x77777777 }, + {REG_A6XX_RBBM_CLOCK_HYST3_TP0 ,0x77777777 }, + {REG_A6XX_RBBM_CLOCK_HYST4_TP0 ,0x00077777 }, + {REG_A6XX_RBBM_CLOCK_CNTL_RB0 ,0x22222222 }, + {REG_A6XX_RBBM_CLOCK_CNTL2_RB0 ,0x01202222 }, + {REG_A6XX_RBBM_CLOCK_CNTL_CCU0 ,0x00002220 }, + {REG_A6XX_RBBM_CLOCK_HYST_RB_CCU0 ,0x00040f00 }, + {REG_A6XX_RBBM_CLOCK_CNTL_RAC ,0x05522022 }, + {REG_A6XX_RBBM_CLOCK_CNTL2_RAC ,0x00005555 }, + {REG_A6XX_RBBM_CLOCK_DELAY_RAC ,0x00000011 }, + {REG_A6XX_RBBM_CLOCK_HYST_RAC ,0x00445044 }, + {REG_A6XX_RBBM_CLOCK_CNTL_TSE_RAS_RBBM ,0x04222222 }, + {REG_A6XX_RBBM_CLOCK_MODE_VFD ,0x00002222 }, + {REG_A6XX_RBBM_CLOCK_MODE_GPC ,0x02222222 }, + {REG_A6XX_RBBM_CLOCK_DELAY_HLSQ_2 ,0x00000002 }, + {REG_A6XX_RBBM_CLOCK_MODE_HLSQ ,0x00002222 }, + {REG_A6XX_RBBM_CLOCK_DELAY_TSE_RAS_RBBM ,0x00004000 }, + {REG_A6XX_RBBM_CLOCK_DELAY_VFD ,0x00002222 }, + {REG_A6XX_RBBM_CLOCK_DELAY_GPC ,0x00000200 }, + {REG_A6XX_RBBM_CLOCK_DELAY_HLSQ ,0x00000000 }, + {REG_A6XX_RBBM_CLOCK_HYST_TSE_RAS_RBBM ,0x00000000 }, + {REG_A6XX_RBBM_CLOCK_HYST_VFD ,0x00000000 }, + {REG_A6XX_RBBM_CLOCK_HYST_GPC ,0x04104004 }, + {REG_A6XX_RBBM_CLOCK_HYST_HLSQ ,0x00000000 }, + {REG_A6XX_RBBM_CLOCK_CNTL_UCHE ,0x22222222 }, + {REG_A6XX_RBBM_CLOCK_HYST_UCHE ,0x00000004 }, + {REG_A6XX_RBBM_CLOCK_DELAY_UCHE ,0x00000002 }, + {REG_A6XX_RBBM_ISDB_CNT ,0x00000182 }, + {REG_A6XX_RBBM_RAC_THRESHOLD_CNT ,0x00000000 }, + {REG_A6XX_RBBM_SP_HYST_CNT ,0x00000000 }, + {REG_A6XX_RBBM_CLOCK_CNTL_GMU_GX ,0x00000222 }, + {REG_A6XX_RBBM_CLOCK_DELAY_GMU_GX ,0x00000111 }, + {REG_A6XX_RBBM_CLOCK_HYST_GMU_GX ,0x00000555 }, + {}, +}; +/* For a615 family (a615, a616, a618 and a619) */ const struct adreno_reglist a615_hwcg[] = { {REG_A6XX_RBBM_CLOCK_CNTL_SP0 ,0x02222222 },
@@ -604,6 +654,8 @@ static void a6xx_set_hwcg(struct msm_gpu *gpu, bool state)if (adreno_is_a630 (adreno_gpu)) clock_cntl_on =0x8aa8aa02 ; +else if (adreno_is_a610 (adreno_gpu)) + clock_cntl_on =0xaaa8aa82 ;else clock_cntl_on =0x8aa8aa82 ;
@@ -812,6 +864,13 @@ static void a6xx_set_ubwc_config(struct msm_gpu *gpu)/* Unknown, introduced with A640/680 */ u32 amsbc =0 ; +if (adreno_is_a610 (adreno_gpu)) { +/* HBB = 14 */ + hbb_lo =1 ; + min_acc_len =1 ; + ubwc_mode =1 ; + } +/* a618 is using the hw default values */ if (adreno_is_a618 (adreno_gpu))return ;
@@ -1063,13 +1122,13 @@ static int hw_init(struct msm_gpu *gpu)a6xx_set_hwcg (gpu, true);/* VBIF/GBIF start*/ -if (adreno_is_a640_family (adreno_gpu) || +if (adreno_is_a610 (adreno_gpu) || +adreno_is_a640_family (adreno_gpu) ||adreno_is_a650_family (adreno_gpu)) {gpu_write (gpu,REG_A6XX_GBIF_QSB_SIDE0 ,0x00071620 );gpu_write (gpu,REG_A6XX_GBIF_QSB_SIDE1 ,0x00071620 );gpu_write (gpu,REG_A6XX_GBIF_QSB_SIDE2 ,0x00071620 );gpu_write (gpu,REG_A6XX_GBIF_QSB_SIDE3 ,0x00071620 ); -gpu_write (gpu,REG_A6XX_GBIF_QSB_SIDE3 ,0x00071620 );gpu_write (gpu,REG_A6XX_RBBM_GBIF_CLIENT_QOS_CNTL ,0x3 ); }else {gpu_write (gpu,REG_A6XX_RBBM_VBIF_CLIENT_QOS_CNTL ,0x3 );
@@ -1100,18 +1159,26 @@ static int hw_init(struct msm_gpu *gpu)gpu_write (gpu,REG_A6XX_UCHE_FILTER_CNTL ,0x804 );gpu_write (gpu,REG_A6XX_UCHE_CACHE_WAYS ,0x4 ); -if (adreno_is_a640_family (adreno_gpu) || -adreno_is_a650_family (adreno_gpu)) +if (adreno_is_a640_family (adreno_gpu) ||adreno_is_a650_family (adreno_gpu)) {gpu_write (gpu,REG_A6XX_CP_ROQ_THRESHOLDS_2 ,0x02000140 ); -else +gpu_write (gpu,REG_A6XX_CP_ROQ_THRESHOLDS_1 ,0x8040362c ); + }else if (adreno_is_a610 (adreno_gpu)) { +gpu_write (gpu,REG_A6XX_CP_ROQ_THRESHOLDS_2 ,0x00800060 ); +gpu_write (gpu,REG_A6XX_CP_ROQ_THRESHOLDS_1 ,0x40201b16 ); + }else {gpu_write (gpu,REG_A6XX_CP_ROQ_THRESHOLDS_2 ,0x010000c0 ); -gpu_write (gpu,REG_A6XX_CP_ROQ_THRESHOLDS_1 ,0x8040362c ); +gpu_write (gpu,REG_A6XX_CP_ROQ_THRESHOLDS_1 ,0x8040362c ); + }if (adreno_is_a660_family (adreno_gpu))gpu_write (gpu,REG_A6XX_CP_LPAC_PROG_FIFO_SIZE ,0x00000020 );/* Setting the mem pool size */ -gpu_write (gpu,REG_A6XX_CP_MEM_POOL_SIZE ,128 ); +if (adreno_is_a610 (adreno_gpu)) { +gpu_write (gpu,REG_A6XX_CP_MEM_POOL_SIZE ,48 ); +gpu_write (gpu,REG_A6XX_CP_MEM_POOL_DBG_ADDR ,47 ); + }else +gpu_write (gpu,REG_A6XX_CP_MEM_POOL_SIZE ,128 );/* Setting the primFifo thresholds default values, * and vccCacheSkipDis=1 bit (0x200) for A640 and newer
@@ -1122,6 +1189,8 @@ static int hw_init(struct msm_gpu *gpu)gpu_write (gpu,REG_A6XX_PC_DBG_ECO_CNTL ,0x00200200 ); else if (adreno_is_a650(adreno_gpu) || adreno_is_a660(adreno_gpu)) gpu_write(gpu, REG_A6XX_PC_DBG_ECO_CNTL, 0x00300200); + else if (adreno_is_a610(adreno_gpu)) + gpu_write(gpu, REG_A6XX_PC_DBG_ECO_CNTL, 0x00080000); else gpu_write(gpu, REG_A6XX_PC_DBG_ECO_CNTL, 0x00180000);
@@ -1137,8 +1206,10 @@ static int hw_init(struct msm_gpu *gpu)a6xx_set_ubwc_config (gpu);/* Enable fault detection */ -gpu_write (gpu,REG_A6XX_RBBM_INTERFACE_HANG_INT_CNTL , - (1 <<30 ) |0x1fffff ); +if (adreno_is_a610 (adreno_gpu)) +gpu_write (gpu,REG_A6XX_RBBM_INTERFACE_HANG_INT_CNTL , (1 <<30 ) |0x3ffff ); +else +gpu_write (gpu,REG_A6XX_RBBM_INTERFACE_HANG_INT_CNTL , (1 <<30 ) |0x1fffff );gpu_write (gpu,REG_A6XX_UCHE_CLIENT_PF ,1 );
@@ -1372,6 +1443,14 @@ static void a6xx_recover(struct msm_gpu *gpu)/* Software-reset the GPU */ if (adreno_has_gmu_wrapper (adreno_gpu)) { +/* 11nm chips (i.e. A610-hosting ones) have HW issues with the reset line */ +if (!adreno_is_a610 (adreno_gpu)) { +gpu_write (gpu,REG_A6XX_RBBM_SW_RESET_CMD ,1 ); +gpu_read (gpu,REG_A6XX_RBBM_SW_RESET_CMD ); +udelay (100 ); +gpu_write (gpu,REG_A6XX_RBBM_SW_RESET_CMD ,0 ); + } +if (adreno_is_a619_holi (adreno_gpu)) {gpu_write (gpu,0x18 ,GPR0_GBIF_HALT_REQUEST ); spin_until((gpu_read(gpu, REG_A6XX_RBBM_VBIF_GX_RESET_STATUS) &
drivers/gpu/drm/msm/adreno/adreno_device.c +12 -0
@@ -253,6 +253,18 @@ static const struct adreno_info gpulist[] = { .quirks = ADRENO_QUIRK_LMLOADKILL_DISABLE, .init = a5xx_gpu_init, .zapfw = "a540_zap.mdt", + }, { + .rev = ADRENO_REV(6, 1, 0, ANY_ID), + .revn = 610, + .name = "A610", + .fw = { + [ADRENO_FW_SQE] = "a630_sqe.fw", + }, + .gmem = (SZ_128K + SZ_4K), + .inactive_period = 500, + .init = a6xx_gpu_init, + .zapfw = "a610_zap.mdt", + .hwcg = a612_hwcg, }, { .rev = ADRENO_REV(6, 1, 8, ANY_ID), .revn = 618,
drivers/gpu/drm/msm/adreno/adreno_gpu.h +7 -1
@@ -55,7 +55,8 @@ struct adreno_reglist {u32 value; }; -extern const struct adreno_reglist a615_hwcg[], a630_hwcg[], a640_hwcg[], a650_hwcg[], a660_hwcg[]; +extern const struct adreno_reglist a612_hwcg[], a615_hwcg[], a630_hwcg[], a640_hwcg[], a650_hwcg[]; +extern const struct adreno_reglist a660_hwcg[];struct adreno_info {struct adreno_rev rev;
@@ -242,6 +243,11 @@ static inline int adreno_is_a540(struct adreno_gpu *gpu)return gpu->revn ==540 ; } +static inline int adreno_is_a610 (struct adreno_gpu *gpu) +{ +return gpu->revn ==610 ; +} +static inline int adreno_is_a618 (struct adreno_gpu *gpu) {return gpu->revn ==618 ;
Signature · 1 line
2.39.2
PATCH v4 10/14 drm/msm/a6xx: Fix some A619 tunables
In reply to Konrad DybcioAdreno 619 expects some tunables to be set differently. Make up for it.
--- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 6 +++++- 1 file changed, 5 insertions(+), 1 deletion(-)
drivers/gpu/drm/msm/adreno/a6xx_gpu.c +5 -1
@@ -1189,6 +1189,8 @@ static int hw_init(struct msm_gpu *gpu)gpu_write (gpu,REG_A6XX_PC_DBG_ECO_CNTL ,0x00200200 ); else if (adreno_is_a650(adreno_gpu) || adreno_is_a660(adreno_gpu)) gpu_write(gpu, REG_A6XX_PC_DBG_ECO_CNTL, 0x00300200); + else if (adreno_is_a619(adreno_gpu)) + gpu_write(gpu, REG_A6XX_PC_DBG_ECO_CNTL, 0x00018000); else if (adreno_is_a610(adreno_gpu)) gpu_write(gpu, REG_A6XX_PC_DBG_ECO_CNTL, 0x00080000); else
@@ -1206,7 +1208,9 @@ static int hw_init(struct msm_gpu *gpu)a6xx_set_ubwc_config (gpu);/* Enable fault detection */ -if (adreno_is_a610 (adreno_gpu)) +if (adreno_is_a619 (adreno_gpu)) +gpu_write (gpu,REG_A6XX_RBBM_INTERFACE_HANG_INT_CNTL , (1 <<30 ) |0x3fffff ); +else if (adreno_is_a610 (adreno_gpu))gpu_write (gpu,REG_A6XX_RBBM_INTERFACE_HANG_INT_CNTL , (1 <<30 ) |0x3ffff );else gpu_write (gpu,REG_A6XX_RBBM_INTERFACE_HANG_INT_CNTL , (1 <<30 ) |0x1fffff );
Signature · 1 line
2.39.2
PATCH v4 11/14 drm/msm/a6xx: Use "else if" in GPU speedbin rev matching
In reply to Konrad DybcioThe GPU can only be one at a time. Turn a series of ifs into if + elseifs to save some CPU cycles.
--- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-)
drivers/gpu/drm/msm/adreno/a6xx_gpu.c +4 -4
@@ -2207,16 +2207,16 @@ static u32 fuse_to_supp_hw(struct device *dev, struct adreno_rev rev, u32 fuse)if (adreno_cmp_rev (ADRENO_REV (6 ,1 ,8 ,ANY_ID ), rev)) val =a618_get_speed_bin (fuse); -if (adreno_cmp_rev (ADRENO_REV (6 ,1 ,9 ,ANY_ID ), rev)) +else if (adreno_cmp_rev (ADRENO_REV (6 ,1 ,9 ,ANY_ID ), rev)) val =a619_get_speed_bin (fuse); -if (adreno_cmp_rev (ADRENO_REV (6 ,3 ,5 ,ANY_ID ), rev)) +else if (adreno_cmp_rev (ADRENO_REV (6 ,3 ,5 ,ANY_ID ), rev)) val =adreno_7c3_get_speed_bin (fuse); -if (adreno_cmp_rev (ADRENO_REV (6 ,4 ,0 ,ANY_ID ), rev)) +else if (adreno_cmp_rev (ADRENO_REV (6 ,4 ,0 ,ANY_ID ), rev)) val =a640_get_speed_bin (fuse); -if (adreno_cmp_rev (ADRENO_REV (6 ,5 ,0 ,ANY_ID ), rev)) +else if (adreno_cmp_rev (ADRENO_REV (6 ,5 ,0 ,ANY_ID ), rev)) val =a650_get_speed_bin (fuse);if (val ==UINT_MAX ) {
Signature · 1 line
2.39.2
PATCH v4 12/14 drm/msm/a6xx: Use adreno_is_aXYZ macros in speedbin matching
In reply to Konrad DybcioBefore transitioning to using per-SoC and not per-Adreno speedbin fuse values (need another patchset to land elsewhere), a good improvement/stopgap solution is to use adreno_is_aXYZ macros in place of explicit revision matching. Do so to allow differentiating between A619 and A619_holi.
--- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 18 +++++++++--------- drivers/gpu/drm/msm/adreno/adreno_gpu.h | 14 ++++++++++++-- 2 files changed, 21 insertions(+), 11 deletions(-)
drivers/gpu/drm/msm/adreno/a6xx_gpu.c +9 -9
@@ -2200,23 +2200,23 @@ static u32 adreno_7c3_get_speed_bin(u32 fuse)return UINT_MAX ; } -static u32 fuse_to_supp_hw (struct device *dev,struct adreno_rev rev,u32 fuse) +static u32 fuse_to_supp_hw (struct device *dev,struct adreno_gpu *adreno_gpu,u32 fuse) {u32 val =UINT_MAX ; -if (adreno_cmp_rev (ADRENO_REV (6 ,1 ,8 ,ANY_ID ), rev)) +if (adreno_is_a618 (adreno_gpu)) val =a618_get_speed_bin (fuse); -else if (adreno_cmp_rev (ADRENO_REV (6 ,1 ,9 ,ANY_ID ), rev)) +else if (adreno_is_a619 (adreno_gpu)) val =a619_get_speed_bin (fuse); -else if (adreno_cmp_rev (ADRENO_REV (6 ,3 ,5 ,ANY_ID ), rev)) +else if (adreno_is_7c3 (adreno_gpu)) val =adreno_7c3_get_speed_bin (fuse); -else if (adreno_cmp_rev (ADRENO_REV (6 ,4 ,0 ,ANY_ID ), rev)) +else if (adreno_is_a640 (adreno_gpu)) val =a640_get_speed_bin (fuse); -else if (adreno_cmp_rev (ADRENO_REV (6 ,5 ,0 ,ANY_ID ), rev)) +else if (adreno_is_a650 (adreno_gpu)) val =a650_get_speed_bin (fuse);if (val ==UINT_MAX ) {
@@ -2229,7 +2229,7 @@ static u32 fuse_to_supp_hw(struct device *dev, struct adreno_rev rev, u32 fuse)return (1 << val); } -static int a6xx_set_supported_hw (struct device *dev,struct adreno_rev rev) +static int a6xx_set_supported_hw (struct device *dev,struct adreno_gpu *adreno_gpu) {u32 supp_hw;u32 speedbin;
@@ -2248,7 +2248,7 @@ static int a6xx_set_supported_hw(struct device *dev, struct adreno_rev rev)return ret; } - supp_hw =fuse_to_supp_hw (dev, rev, speedbin); + supp_hw =fuse_to_supp_hw (dev, adreno_gpu, speedbin); ret =devm_pm_opp_set_supported_hw (dev, &supp_hw,1 );if (ret)
@@ -2367,7 +2367,7 @@ struct msm_gpu *a6xx_gpu_init(struct drm_device *dev)if (!adreno_has_gmu_wrapper (adreno_gpu))a6xx_llc_slices_init (pdev, a6xx_gpu); - ret =a6xx_set_supported_hw (&pdev->dev, config->rev); + ret =a6xx_set_supported_hw (&pdev->dev, adreno_gpu);if (ret) {a6xx_destroy (&(a6xx_gpu->base.base));return ERR_PTR (ret);
drivers/gpu/drm/msm/adreno/adreno_gpu.h +12 -2
@@ -268,9 +268,9 @@ static inline int adreno_is_a630(struct adreno_gpu *gpu)return gpu->revn ==630 ; } -static inline int adreno_is_a640_family (struct adreno_gpu *gpu) +static inline int adreno_is_a640 (struct adreno_gpu *gpu) { -return (gpu->revn ==640 ) || (gpu->revn ==680 ); +return gpu->revn ==640 ; }static inline int adreno_is_a650 (struct adreno_gpu *gpu)
@@ -289,6 +289,11 @@ static inline int adreno_is_a660(struct adreno_gpu *gpu)return gpu->revn ==660 ; } +static inline int adreno_is_a680 (struct adreno_gpu *gpu) +{ +return gpu->revn ==680 ; +} +/* check for a615, a616, a618, a619 or any derivatives */ static inline int adreno_is_a615_family (struct adreno_gpu *gpu) {
@@ -306,6 +311,11 @@ static inline int adreno_is_a650_family(struct adreno_gpu *gpu)return gpu->revn ==650 || gpu->revn ==620 ||adreno_is_a660_family (gpu); } +static inline int adreno_is_a640_family (struct adreno_gpu *gpu) +{ +return adreno_is_a640 (gpu) ||adreno_is_a680 (gpu); +} +u64 adreno_private_address_space_size (struct msm_gpu *gpu);int adreno_get_param (struct msm_gpu *gpu,struct msm_file_private *ctx,uint32_t param,uint64_t *value,uint32_t *len);
Signature · 1 line
2.39.2
Re: [PATCH v4 12/14] drm/msm/a6xx: Use adreno_is_aXYZ macros in speedbin matching
Quoted 11 lines · Konrad Dybcio
Before transitioning to using per-SoC and not per-Adreno speedbin fuse values (need another patchset to land elsewhere), a good improvement/stopgap solution is to use
adreno_is_aXYZmacros in place of explicit revision matching. Do so to allow differentiating between A619 andA619_holi.Signed-off-by Konrad Dybcio <[email protected]>--- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 18 +++++++++--------- drivers/gpu/drm/msm/adreno/adreno_gpu.h | 14 ++++++++++++-- 2 files changed, 21 insertions(+), 11 deletions(-)
Signature · 2 lines
With best wishes Dmitry
PATCH v4 13/14 drm/msm/a6xx: Add A619_holi speedbin support
In reply to Konrad DybcioA619_holi is implemented on at least two SoCs: SM4350 (holi) and SM6375 (blair). This is what seems to be a first occurrence of this happening, but it's easy to overcome by guarding the SoC-specific fuse values with of_machine_is_compatible(). Do just that to enable frequency limiting on these SoCs.
--- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 31 +++++++++++++++++++++++++++++++ 1 file changed, 31 insertions(+)
drivers/gpu/drm/msm/adreno/a6xx_gpu.c +31 -0
@@ -2148,6 +2148,34 @@ static u32 a618_get_speed_bin(u32 fuse)return UINT_MAX ; } +static u32 a619_holi_get_speed_bin (u32 fuse) +{ +/* +* There are (at least) two SoCs implementing A619_holi: SM4350 (holi) +* and SM6375 (blair). Limit the fuse matching to the corresponding +* SoC to prevent bogus frequency setting (as improbable as it may be, +* given unexpected fuse values are.. unexpected! But still possible.) +*/ + +if (fuse ==0 ) +return 0 ; + +if (of_machine_is_compatible ("qcom,sm4350" )) { +if (fuse ==138 ) +return 1 ; +else if (fuse ==92 ) +return 2 ; + }else if (of_machine_is_compatible ("qcom,sm6375" )) { +if (fuse ==190 ) +return 1 ; +else if (fuse ==177 ) +return 2 ; + }else +pr_warn ("Unknown SoC implementing A619_holi!\n" ); + +return UINT_MAX ; +} +static u32 a619_get_speed_bin (u32 fuse) {if (fuse ==0 )
@@ -2207,6 +2235,9 @@ static u32 fuse_to_supp_hw(struct device *dev, struct adreno_gpu *adreno_gpu, u3if (adreno_is_a618 (adreno_gpu)) val =a618_get_speed_bin (fuse); +else if (adreno_is_a619_holi (adreno_gpu)) + val =a619_holi_get_speed_bin (fuse); +else if (adreno_is_a619 (adreno_gpu)) val =a619_get_speed_bin (fuse);
Signature · 1 line
2.39.2
Re: [PATCH v4 13/14] drm/msm/a6xx: Add A619_holi speedbin support
Quoted 10 lines · Konrad Dybcio
A619_holiis implemented on at least two SoCs: SM4350 (holi) and SM6375 (blair). This is what seems to be a first occurrence of this happening, but it's easy to overcome by guarding the SoC-specific fuse values withof_machine_is_compatible(). Do just that to enable frequency limiting on these SoCs.Signed-off-by Konrad Dybcio <[email protected]>--- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 31 +++++++++++++++++++++++++++++++ 1 file changed, 31 insertions(+)
Signature · 2 lines
With best wishes Dmitry
PATCH v4 14/14 drm/msm/a6xx: Add A610 speedbin support
In reply to Konrad DybcioA610 is implemented on at least three SoCs: SM6115 (bengal), SM6125 (trinket) and SM6225 (khaje). Trinket does not support speed binning (only a single SKU exists) and we don't yet support khaje upstream. Hence, add a fuse mapping table for bengal to allow for per-chip frequency limiting.
--- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 27 +++++++++++++++++++++++++++ 1 file changed, 27 insertions(+)
drivers/gpu/drm/msm/adreno/a6xx_gpu.c +27 -0
@@ -2136,6 +2136,30 @@ static bool a6xx_progress(struct msm_gpu *gpu, struct msm_ringbuffer *ring)return progress; } +static u32 a610_get_speed_bin (u32 fuse) +{ +/* +* There are (at least) three SoCs implementing A610: SM6125 (trinket), +* SM6115 (bengal) and SM6225 (khaje). Trinket does not have speedbinning, +* as only a single SKU exists and we don't support khaje upstream yet. +* Hence, this matching table is only valid for bengal and can be easily +* expanded if need be. +*/ + +if (fuse ==0 ) +return 0 ; +else if (fuse ==206 ) +return 1 ; +else if (fuse ==200 ) +return 2 ; +else if (fuse ==157 ) +return 3 ; +else if (fuse ==127 ) +return 4 ; + +return UINT_MAX ; +} +static u32 a618_get_speed_bin (u32 fuse) {if (fuse ==0 )
@@ -2232,6 +2256,9 @@ static u32 fuse_to_supp_hw(struct device *dev, struct adreno_gpu *adreno_gpu, u3 {u32 val =UINT_MAX ; +if (adreno_is_a610 (adreno_gpu)) + val =a610_get_speed_bin (fuse); +if (adreno_is_a618 (adreno_gpu)) val =a618_get_speed_bin (fuse);
Signature · 1 line
2.39.2
Re: [PATCH v4 14/14] drm/msm/a6xx: Add A610 speedbin support
Quoted 11 lines · Konrad Dybcio
A610 is implemented on at least three SoCs: SM6115 (bengal), SM6125 (trinket) and SM6225 (khaje). Trinket does not support speed binning (only a single SKU exists) and we don't yet support khaje upstream. Hence, add a fuse mapping table for bengal to allow for per-chip frequency limiting.
Reviewed-by Dmitry Baryshkov <[email protected]>Signed-off-by Konrad Dybcio <[email protected]>--- drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 27 +++++++++++++++++++++++++++ 1 file changed, 27 insertions(+)
Signature · 2 lines
With best wishes Dmitry
Quoted 8 lines · Konrad Dybcio
v3 -> v4:
- Drop the mistakengly-included and wrong A3xx-A5xx bindings changes
- Improve bindings commit messages to better explain what GMU Wrapper is
- Drop the A680 highest bank bit value adjustment patch
- Sort UBWC config variables in a reverse-Christmass-tree fashion [4/14]
- Don't alter any UBWC config values in [4/14]
- Do so fora619_holiin [8/14]
- Rebase on next-20230314 (shouldn't matter at all)
After Johan's recent runtime PM fix, this kinda broke.. When entering the error-fail-retry path (e.g. when not embedding the firmware in initrd, then starting a DE and letting the kernel get the fw from the root partition), the GPU does not wake up fully:
[ 24.744344] msm_dpu 5e01000.display-controller: [drm:adreno_wait_ring] *ERROR* timeout waiting for space in ringbuffer 0 [ 25.744343] [drm:a6xx_idle] *ERROR* A619: a6xx_hw_init: timeout waiting for GPU to idle: status 00800005 irq 00800000 rptr/wptr 12/12 [ 25.744401] msm_dpu 5e01000.display-controller: [drm:adreno_load_gpu] *ERROR* gpu hw init failed: -22 [ 25.744494] adreno 5900000.gpu: [drm:a6xx_irq] *ERROR* gpu fault ring 0 fence ffffff00 status 00800005 rb 000c/000c ib1 0000000000000000/0000 ib2 0000000000000000/0000 [ 25.744544] msm_dpu 5e01000.display-controller: [drm:recover_worker] *ERROR* A619: hangcheck recover!
Adding a random 1s sleep in hw_init() fixes it. Because of course it does. Investigating that, merging this will be suboptimal until then..
Konrad
Quoted 164 lines
v3: https://lore.kernel.org/r/[email protected]
v2 -> v3:
New dependencies:
- https://lore.kernel.org/linux-arm-msm/[email protected]/T/#t
- https://lore.kernel.org/linux-arm-msm/[email protected]/Sidenote: A speedbin rework is in progress, the
of_machine_is_compatiblecalls inA619_holiare ugly (but well, necessary..) but they'll be replaced with socid matching in this or the next kernel cycle.Due to the new way of identifying GMU wrapper GPUs, configuring 6350 to use wrapper would cause the wrong fuse values to be checked, but that will be solved by the conversion + the ultimate goal is to use the GMU whenever possible with the wrapper left for GMU-less Adrenos and early bringup debugging of GMU-equipped ones.
- Ship dt-bindings in this series as we're referencing the compatible now
- "De-staticize" -> "remove static keyword" [3/15]
- Track down all the values in [4/15]
- Add many comments and explanations in [4/15]
- Fix possible return-before-mutex-unlock [5/15]
- Explain the GMU wrapper a bit more in the commit msg [5/15]
- Separate out pm_resume/suspend for GMU-wrapper GPUs to make things cleaner [5/15]
- Don't check if
infoexists, it has to at this point [5/15]- Assign
gpu->infoearly and clean up following if statements ina6xx_gpu_init[5/15]- Determine whether we use GMU wrapper based on the GMU compatible instead of a quirk [5/15]
- Use a struct field to annotate whether we're using gmu wrapper so that it can be assigned at runtime (turns out a619 holi-ness cannot be determined by patchid + that will make it easier to test out GMU GPUs without actually turning on the GMU if anybody wants to do so) [5/15]
- Unconditionally hook up gx to the gmu wrapper (otherwise our gpu will not get power) [5/15]
- Don't check for gx domain presence in
gmu_wrapperpaths, it's guaranteed [5/15]- Use opp set rate in the gmuwrapper suspend path [5/15]
- Call opp functions on the GPU device and not on the DRM device of mdp4/5/DPU1 half the time (WHOOOOPS!) [5/15]
- Disable the memory clock in
a6xx_pm_suspendinstead of enabling it (moderate oops) [5/15]- Call the forgotten
clk_bulk_disable_unprepareina6xx_pm_suspend[5/15]- Set rate to FMIN (a6xx really doesn't like rate=0 + that's what msm-5.x does anyway) before disabling core clock [5/15]
-
pm_runtime_get_sync->pm_runtime_resume_and_get[5/15]- Don't annotate no cached BO support with a quirk, as
A619_holiis merged into the A619 entry in the big const struct - this means that all GPUs operating in gmu wrapper configuration will be implicitly treated as if they didn't have this feature [7/15]- Drop OPP rate & icc related patches, they're a part of a separate series now; rebase on it
- Clean up extra parentheses [8/15]
- Identify
A619_holiby checking the compatible of its GMU instead of patchlevel [8/15]- Drop "Fix up A6XX protected registers" - unnecessary, Rob will add a comment explaining why
- Fix existing UBWC values for A680, new patch [10/15]
- Use
adreno_is_aXYZmacros in speedbin matching [13/15] - new patchv2: https://lore.kernel.org/linux-arm-msm/[email protected]/
v1 -> v2:
- Fix A630 values in [2/14]
- Fix [6/14] for GMU-equipped GPUsLink to v1: https://lore.kernel.org/linux-arm-msm/[email protected]/
This series concludes my couple-weeks-long suffering of figuring out the ins and outs of the "non-standard" A6xx GPUs which feature no GMU.
The GMU functionality is essentially emulated by parting out a "GMU wrapper" region, which is essentially just a register space within the GPU. It's modeled to be as similar to the actual GMU as possible while staying as unnecessary as we can make it - there's no IRQs, communicating with a microcontroller, no RPMh communication etc. etc. I tried to reuse as much code as possible without making a mess where every even line is used for GMU and every odd line is used for GMU wrapper..
This series contains:
- plumbing for non-GMU operation, if-ing out GMU calls based on GMU presence
- GMU wrapper support
- A610 support (w/ speedbin)
- A619 support (w/ speedbin)
- couple of minor fixes and improvements
- VDDCX/VDDGX scaling fix for non-GMU GPUs (concerns more than just A6xx)
- Enablement of opp interconnect properties
A619_holiworks perfectly fine using the already-present A619 support in mesa. A610 needs more work on that front, but can already replay command traces captures on downstream.NOTE: the "drm/msm/a6xx: Add support for
A619_holi" patch contains two occurences of0x18used in place of a register #define, as it's supposed to beRBBM_GPR0_CNTL, but that will only be present after mesa-side changes are merged and headers are synced from there.Speedbin patches depend on:
https://lore.kernel.org/linux-arm-msm/[email protected]/Signed-off-by Konrad Dybcio <[email protected]>---
Konrad Dybcio (14):
dt-bindings: display/msm: gpu: Document GMU wrapper-equipped A6xx
dt-bindings: display/msm/gmu: Add GMU wrapper
drm/msm/a6xx: Remove static keyword from sptprac en/disable functions drm/msm/a6xx: Extend and explain UBWC config
drm/msm/a6xx: Introduce GMU wrapper support
drm/msm/a6xx: Remove both GBIF and RBBM GBIF halt on hw init drm/msm/adreno: Disablehas_cached_coherentin GMU wrapper configurations drm/msm/a6xx: Add support forA619_holi
drm/msm/a6xx: Add A610 support
drm/msm/a6xx: Fix some A619 tunables
drm/msm/a6xx: Use "else if" in GPU speedbin rev matching drm/msm/a6xx: Useadreno_is_aXYZmacros in speedbin matching drm/msm/a6xx: AddA619_holispeedbin support
drm/msm/a6xx: Add A610 speedbin support.../devicetree/bindings/display/msm/gmu.yaml | 49 +- .../devicetree/bindings/display/msm/gpu.yaml | 57 ++- drivers/gpu/drm/msm/adreno/a6xx_gmu.c | 57 ++- drivers/gpu/drm/msm/adreno/a6xx_gmu.h | 2 + drivers/gpu/drm/msm/adreno/a6xx_gpu.c | 494 ++++++++++++++++++--- drivers/gpu/drm/msm/adreno/a6xx_gpu.h | 1 + drivers/gpu/drm/msm/adreno/a6xx_gpu_state.c | 14 +- drivers/gpu/drm/msm/adreno/adreno_device.c | 17 +- drivers/gpu/drm/msm/adreno/adreno_gpu.h | 33 +- 9 files changed, 632 insertions(+), 92 deletions(-)---
base-commit:647ef0d33d52a103b50469d7109b63d453686c11
change-id: 20230223-topic-gmuwrapper-b4fff5fd7789Best regards,